2023-10-09T11:21:31.065 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T11:21:31.065 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425 --name vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/orig.config.yaml 2023-10-09T11:21:31.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:21:31.187 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: vshankar@redhat.com first_in_suite: false job_id: '7418425' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231009.111138 sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-vshankar-testing-20231009.111138 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQPwAR7jfuyZjq2/T7yRLjXRu5wIqQBc/b9XplrhgboaQoDLoR4nvMWl64rbPbowUO1BJi5oduWkcwZZNvJEc4= smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtnQGeA3ZIqGsDMcojbchoWQx6n3QWRs0jse8s6mrpnnIWtTGMkUmFsG2zbobQgJ/H89ysJK8+ZjuMsSWFSMLY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_11:13:22 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T11:21:31.187 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa; will attempt to use it 2023-10-09T11:21:31.188 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks 2023-10-09T11:21:31.188 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T11:21:31.190 INFO:teuthology.task.internal:Checking packages... 2023-10-09T11:21:31.210 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T11:21:31.210 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T11:21:31.210 INFO:teuthology.packaging:ref: None 2023-10-09T11:21:31.210 INFO:teuthology.packaging:tag: None 2023-10-09T11:21:31.210 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:21:31.210 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:21:31.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:21:31.362 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T11:21:31.362 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T11:21:31.369 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T11:21:31.369 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T11:21:31.413 INFO:teuthology.task.internal:Saving configuration 2023-10-09T11:21:31.429 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T11:21:31.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:21:31.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.992544', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQPwAR7jfuyZjq2/T7yRLjXRu5wIqQBc/b9XplrhgboaQoDLoR4nvMWl64rbPbowUO1BJi5oduWkcwZZNvJEc4='} 2023-10-09T11:21:31.489 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.994321', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtnQGeA3ZIqGsDMcojbchoWQx6n3QWRs0jse8s6mrpnnIWtTGMkUmFsG2zbobQgJ/H89ysJK8+ZjuMsSWFSMLY='} 2023-10-09T11:21:31.490 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T11:21:31.497 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T11:21:31.497 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T11:21:31.497 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T11:21:31.588 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f57573d4b80>, signals=[15]) 2023-10-09T11:21:31.588 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T11:21:31.595 INFO:teuthology.task.internal:Opening connections... 2023-10-09T11:21:31.596 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:21:31.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:21:31.664 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:21:31.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:21:31.732 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T11:21:31.739 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-10-09T11:21:31.756 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-10-09T11:21:31.757 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.4" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:21:31.813 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:21:31.814 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:21:31.815 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-10-09T11:21:31.838 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-10-09T11:21:31.854 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-10-09T11:21:31.854 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-10-09T11:21:31.910 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:21:31.910 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:21:31.910 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-10-09T11:21:31.910 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:21:31.911 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:21:31.912 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-10-09T11:21:31.929 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T11:21:31.938 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T11:21:31.963 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T11:21:31.963 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:21:31.965 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:21:31.980 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T11:21:31.986 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T11:21:31.986 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:21:32.022 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:21:32.036 INFO:teuthology.orchestra.run.smithi026.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:21:32.037 INFO:teuthology.orchestra.run.smithi067.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:21:32.038 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T11:21:32.093 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T11:21:32.107 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T11:21:32.107 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-09T11:21:32.107 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-09T11:21:32.107 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:21:32.108 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:21:32.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:21:32.123 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-10-09T11:21:32.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:21:32.124 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-09T11:21:32.179 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:21:32.179 INFO:teuthology.task.kernel:Running kernel on smithi067: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:21:32.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2023-10-09T11:21:32.181 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:21:32.181 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:21:32.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2023-10-09T11:21:33.617 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:33.618 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-10-09T11:21:33.624 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:33.624 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-09T11:21:34.963 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 34 kB/s | 3.5 kB 00:00 2023-10-09T11:21:34.965 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 34 kB/s | 3.5 kB 00:00 2023-10-09T11:21:35.801 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-09T11:21:35.819 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-09T11:21:39.346 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-09T11:21:39.379 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-09T11:21:40.050 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T11:21:40.050 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T11:21:40.050 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T11:21:40.130 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T11:21:40.131 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T11:21:40.131 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T11:21:40.210 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-10-09T11:21:40.211 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2023-10-09T11:21:40.211 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-10-09T11:21:40.299 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-10-09T11:21:40.300 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-10-09T11:21:40.300 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-10-09T11:21:40.334 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2023-10-09T11:21:40.416 DEBUG:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2023-10-09T11:21:40.699 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:40.699 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-10-09T11:21:40.820 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:40.821 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-09T11:21:41.006 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:21:39 AM UTC. 2023-10-09T11:21:41.125 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:21:39 AM UTC. 2023-10-09T11:21:41.168 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:21:41.168 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:41.168 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:41.191 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-10-09T11:21:41.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2023-10-09T11:21:41.260 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:21:41.260 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:41.260 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:41.286 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-10-09T11:21:41.336 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2023-10-09T11:21:41.605 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:41.605 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-10-09T11:21:41.699 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-09T11:21:41.700 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-09T11:21:41.902 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:21:39 AM UTC. 2023-10-09T11:21:41.996 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:21:39 AM UTC. 2023-10-09T11:21:42.050 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:21:42.051 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:42.051 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-10-09T11:21:42.117 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:21:42.143 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:21:42.143 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:42.143 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:21:42.158 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-10-09T11:21:42.208 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:21:42.246 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.247 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.247 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.247 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T11:21:42.247 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T11:21:42.248 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-09T11:21:42.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T11:21:42.248 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:21:42.338 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.338 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.338 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.338 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T11:21:42.338 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T11:21:42.338 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-09T11:21:42.338 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T11:21:42.339 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:21:42.377 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.377 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.02 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 99.el8_4.1 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2023-10-09T11:21:42.406 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Group : System Environment/Base 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 9264631 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Relocations : (not relocatable) 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : Red Hat, Inc. 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:21:42.407 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:21:42.408 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:21:42.409 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:21:42.409 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:21:42.468 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.469 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.02 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 99.el8_4.1 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Group : System Environment/Base 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 9264631 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2023-10-09T11:21:42.497 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Relocations : (not relocatable) 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : Red Hat, Inc. 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:21:42.498 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:21:42.499 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:21:42.499 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2023-10-09T11:21:42.499 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:21:42.499 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:21:42.500 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:21:42.500 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:42.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:21:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-10-09T11:21:43.845 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2023-10-09T11:21:45.354 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-10-09T11:21:45.355 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-09T11:21:45.368 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.Gf7fTcPwij 2023-10-09T11:21:45.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Gf7fTcPwij 2023-10-09T11:21:45.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.Gf7fTcPwij 2023-10-09T11:21:45.500 INFO:teuthology.orchestra.run.smithi067.stderr:done 2023-10-09T11:21:45.502 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-10-09T11:21:45.527 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.Uh0GLEkMvF 2023-10-09T11:21:45.527 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Uh0GLEkMvF 2023-10-09T11:21:45.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.Uh0GLEkMvF 2023-10-09T11:21:45.610 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.Gf7fTcPwij is 6KB 2023-10-09T11:21:45.658 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.Gf7fTcPwij 2023-10-09T11:21:45.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:21:45.749 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:21:45.749 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:21:45.749 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:21:45.749 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:21:45.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:45.753 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.Uh0GLEkMvF is 6KB 2023-10-09T11:21:45.801 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.Uh0GLEkMvF 2023-10-09T11:21:45.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:21:45.877 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:21:45.877 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:21:45.877 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:21:45.877 INFO:teuthology.orchestra.run.smithi067.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:21:45.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:21:45.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2023-10-09T11:21:46.068 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2023-10-09T11:22:15.929 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T11:22:15.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:22:15.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:16.071 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T11:22:16.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:22:16.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:34.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-10-09T11:22:34.495 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-10-09T11:22:43.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:22:43.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:43.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:22:43.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:46.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-10-09T11:22:58.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:22:58.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:01.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-10-09T11:23:13.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:23:13.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:14.477 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-09T11:23:14.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:23:14.763 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T11:23:14.763 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-09T11:23:14.818 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T11:23:14.818 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:23:14.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:23:14.818 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:23:15.819 DEBUG:teuthology.parallel:result is None 2023-10-09T11:23:16.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-10-09T11:23:31.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:23:31.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:32.386 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-10-09T11:23:32.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:23:32.650 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T11:23:32.651 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-10-09T11:23:32.709 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T11:23:32.709 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:23:32.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:23:32.710 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:23:33.710 DEBUG:teuthology.parallel:result is None 2023-10-09T11:23:33.710 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T11:23:33.718 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T11:23:33.718 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:23:33.722 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:23:33.738 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T11:23:33.752 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T11:23:33.789 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T11:23:33.789 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:23:33.791 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:23:33.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T11:23:33.844 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T11:23:33.845 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:23:33.859 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:23:33.959 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:23:33.974 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:23:34.048 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:23:34.106 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:23:34.108 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T11:23:34.118 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T11:23:34.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:23:34.120 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:23:34.507 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T11:23:34.516 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T11:23:34.517 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:23:34.519 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:23:34.820 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:23:34.867 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:23:34.937 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:23:34.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:23:35.024 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:23:35.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:23:35.091 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:23:35.463 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:23:35.893 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:23:36.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:23:36.450 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:23:36.450 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:23:36.486 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-10-09T11:23:36.488 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2023-10-09T11:23:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:23:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:23:37.028 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T11:23:37.037 INFO:teuthology.task.internal:Starting timer... 2023-10-09T11:23:37.037 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T11:23:37.089 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T11:23:37.123 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T11:23:37.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2023-10-09T11:23:37.184 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: [ OK ] 2023-10-09T11:23:37.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2023-10-09T11:23:37.462 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: [ OK ] 2023-10-09T11:23:37.464 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T11:23:37.464 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2023-10-09T11:23:37.491 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2023-10-09T11:23:37.491 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2023-10-09T11:23:37.529 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2023-10-09T11:23:37.530 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi067.front.sepia.ceph.com': 'permissive'} 2023-10-09T11:23:37.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:23:37.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:23:37.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:23:37.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:23:37.598 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T11:23:37.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:23:37.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:23:37.663 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T11:23:37.672 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-09T11:23:37.672 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T11:23:37.690 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T11:23:37.691 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T11:32:13.296 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2023-10-09T11:32:13.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:32:13.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:32:13.368 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-09T11:32:13.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-09T11:32:13.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:32:13.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:32:13.461 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-10-09T11:32:13.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-09T11:32:13.525 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T11:32:13.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T11:32:13.536 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:32:13.537 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:32:13.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:32:13.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:32:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:32:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:32:13.594 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:32:13.608 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:32:13.615 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2023-10-09T11:32:13.626 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2023-10-09T11:32:13.640 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2023-10-09T11:32:13.640 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:32:13.650 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2023-10-09T11:32:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:32:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:32:13.678 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:32:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.730 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.756 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:210 Number of sources = 4 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.759 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:32:13.760 INFO:teuthology.run_tasks:Running task install... 2023-10-09T11:32:13.768 DEBUG:teuthology.task.install:project ceph 2023-10-09T11:32:13.768 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T11:32:13.768 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T11:32:13.768 INFO:teuthology.task.install:Using flavor: default 2023-10-09T11:32:13.783 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T11:32:13.783 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T11:32:13.784 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:32:13.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:32:13.787 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:32:13.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:32:13.958 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:32:13.958 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:32:14.035 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:32:14.035 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:32:14.161 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:32:14.162 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:32:14.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:32:14.164 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:32:14.164 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:32:14.164 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:32:14.190 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:32:14.190 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:32:14.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:32:14.192 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:32:14.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:32:14.261 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:32:14.336 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:32:14.337 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:32:14.401 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2023-10-09T11:32:14.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2023-10-09T11:32:14.405 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-10-09T11:32:14.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-10-09T11:32:14.813 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-09T11:32:14.815 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-10-09T11:32:15.724 INFO:teuthology.orchestra.run.smithi026.stdout:44 files removed 2023-10-09T11:32:15.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:32:15.971 INFO:teuthology.orchestra.run.smithi067.stdout:44 files removed 2023-10-09T11:32:16.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:32:16.145 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-10-09T11:32:16.400 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-09T11:32:17.825 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 352 kB/s | 78 kB 00:00 2023-10-09T11:32:17.985 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 234 kB/s | 78 kB 00:00 2023-10-09T11:32:18.050 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 50 kB/s | 9.2 kB 00:00 2023-10-09T11:32:18.214 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 50 kB/s | 9.2 kB 00:00 2023-10-09T11:32:18.266 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 7.9 kB/s | 1.5 kB 00:00 2023-10-09T11:32:18.379 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-09T11:32:18.547 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-09T11:32:18.671 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-09T11:32:18.893 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-10-09T11:32:19.387 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-09T11:32:22.469 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-09T11:32:22.908 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 108 MB/s | 38 MB 00:00 2023-10-09T11:32:22.923 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-09T11:32:23.364 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 107 MB/s | 38 MB 00:00 2023-10-09T11:32:28.877 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 MB/s | 33 MB 00:00 2023-10-09T11:32:29.293 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 MB/s | 33 MB 00:00 2023-10-09T11:32:37.290 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:32:37.291 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:32:37.301 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:32:37.301 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:32:37.302 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:32:37.303 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:32:37.305 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:32:37.307 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:32:37.308 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:32:37.725 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:32:37.726 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:32:37.737 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:32:37.738 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:32:37.739 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:32:37.740 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:32:37.742 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:32:37.744 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:32:37.745 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:32:37.828 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-10-09T11:32:37.838 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-10-09T11:32:37.838 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:32:37.839 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:32:37.840 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:32:37.841 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:32:37.842 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:32:37.843 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:32:37.844 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:32:37.845 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:32:37.846 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:32:37.847 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:32:37.848 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:32:37.849 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-10-09T11:32:37.850 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-10-09T11:32:37.850 INFO:teuthology.orchestra.run.smithi026.stdout:Install 118 Packages 2023-10-09T11:32:37.850 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2023-10-09T11:32:37.850 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:32:37.850 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 202 M 2023-10-09T11:32:37.851 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-10-09T11:32:38.208 INFO:teuthology.orchestra.run.smithi026.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-10-09T11:32:38.269 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:32:38.281 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:32:38.282 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:32:38.285 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:32:38.285 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:32:38.285 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:32:38.286 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:32:38.287 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:32:38.288 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:32:38.289 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:32:38.290 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:32:38.291 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:32:38.292 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:32:38.293 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:32:38.294 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:32:38.295 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:32:38.296 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================================== 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout:Install 118 Packages 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2023-10-09T11:32:38.297 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:32:38.298 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 202 M 2023-10-09T11:32:38.298 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-10-09T11:32:38.644 INFO:teuthology.orchestra.run.smithi067.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-09T11:32:39.018 INFO:teuthology.orchestra.run.smithi026.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.1 MB/s | 876 kB 00:00 2023-10-09T11:32:39.162 INFO:teuthology.orchestra.run.smithi026.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.1 MB/s | 162 kB 00:00 2023-10-09T11:32:39.596 INFO:teuthology.orchestra.run.smithi067.stdout:(2/120): ceph-common-17.2.6-1320.g08cac018.el8. 18 MB/s | 23 MB 00:01 2023-10-09T11:32:39.658 INFO:teuthology.orchestra.run.smithi067.stdout:(3/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 863 kB/s | 876 kB 00:01 2023-10-09T11:32:39.660 INFO:teuthology.orchestra.run.smithi067.stdout:(4/120): ceph-immutable-object-cache-17.2.6-132 2.5 MB/s | 162 kB 00:00 2023-10-09T11:32:39.740 INFO:teuthology.orchestra.run.smithi067.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 20 MB/s | 1.6 MB 00:00 2023-10-09T11:32:39.941 INFO:teuthology.orchestra.run.smithi067.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 20 MB/s | 3.9 MB 00:00 2023-10-09T11:32:39.954 INFO:teuthology.orchestra.run.smithi026.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-10-09T11:32:40.460 INFO:teuthology.orchestra.run.smithi026.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.1 MB/s | 1.6 MB 00:00 2023-10-09T11:32:40.913 INFO:teuthology.orchestra.run.smithi067.stdout:(7/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 17 MB/s | 17 MB 00:00 2023-10-09T11:32:41.046 INFO:teuthology.orchestra.run.smithi067.stdout:(8/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 5.2 MB 00:02 2023-10-09T11:32:41.116 INFO:teuthology.orchestra.run.smithi067.stdout:(9/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-10-09T11:32:41.124 INFO:teuthology.orchestra.run.smithi067.stdout:(10/120): ceph-selinux-17.2.6-1320.g08cac018.el 310 kB/s | 24 kB 00:00 2023-10-09T11:32:41.152 INFO:teuthology.orchestra.run.smithi026.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 5.7 MB/s | 3.9 MB 00:00 2023-10-09T11:32:41.196 INFO:teuthology.orchestra.run.smithi067.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.5 MB/s | 255 kB 00:00 2023-10-09T11:32:41.276 INFO:teuthology.orchestra.run.smithi067.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 311 kB/s | 25 kB 00:00 2023-10-09T11:32:41.539 INFO:teuthology.orchestra.run.smithi067.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 3.0 MB/s | 797 kB 00:00 2023-10-09T11:32:41.619 INFO:teuthology.orchestra.run.smithi067.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.1 MB/s | 174 kB 00:00 2023-10-09T11:32:41.687 INFO:teuthology.orchestra.run.smithi067.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 1.9 MB/s | 130 kB 00:00 2023-10-09T11:32:41.828 INFO:teuthology.orchestra.run.smithi067.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 3.5 MB/s | 507 kB 00:00 2023-10-09T11:32:42.062 INFO:teuthology.orchestra.run.smithi067.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 15 MB/s | 17 MB 00:01 2023-10-09T11:32:42.091 INFO:teuthology.orchestra.run.smithi067.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.5 MB/s | 45 kB 00:00 2023-10-09T11:32:42.117 INFO:teuthology.orchestra.run.smithi067.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 4.2 MB/s | 115 kB 00:00 2023-10-09T11:32:42.158 INFO:teuthology.orchestra.run.smithi067.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 4.7 MB/s | 190 kB 00:00 2023-10-09T11:32:42.206 INFO:teuthology.orchestra.run.smithi067.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 7.5 MB/s | 371 kB 00:00 2023-10-09T11:32:42.224 INFO:teuthology.orchestra.run.smithi026.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.2 MB/s | 5.2 MB 00:04 2023-10-09T11:32:42.259 INFO:teuthology.orchestra.run.smithi067.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 6.7 MB/s | 358 kB 00:00 2023-10-09T11:32:42.305 INFO:teuthology.orchestra.run.smithi067.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.3 MB/s | 107 kB 00:00 2023-10-09T11:32:42.331 INFO:teuthology.orchestra.run.smithi067.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 3.4 MB/s | 90 kB 00:00 2023-10-09T11:32:42.618 INFO:teuthology.orchestra.run.smithi067.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 7.0 MB/s | 5.6 MB 00:00 2023-10-09T11:32:42.628 INFO:teuthology.orchestra.run.smithi067.stdout:(26/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-09T11:32:42.654 INFO:teuthology.orchestra.run.smithi067.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 896 kB/s | 23 kB 00:00 2023-10-09T11:32:42.656 INFO:teuthology.orchestra.run.smithi067.stdout:(28/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 4.4 MB/s | 173 kB 00:00 2023-10-09T11:32:42.677 INFO:teuthology.orchestra.run.smithi067.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.3 MB/s | 121 kB 00:00 2023-10-09T11:32:42.871 INFO:teuthology.orchestra.run.smithi067.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 7.9 MB/s | 1.7 MB 00:00 2023-10-09T11:32:42.939 INFO:teuthology.orchestra.run.smithi067.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.4 MB/s | 238 kB 00:00 2023-10-09T11:32:43.001 INFO:teuthology.orchestra.run.smithi067.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 797 kB/s | 47 kB 00:00 2023-10-09T11:32:43.059 INFO:teuthology.orchestra.run.smithi067.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 242 kB/s | 14 kB 00:00 2023-10-09T11:32:43.127 INFO:teuthology.orchestra.run.smithi067.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.8 MB/s | 267 kB 00:00 2023-10-09T11:32:43.190 INFO:teuthology.orchestra.run.smithi067.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.3 MB/s | 80 kB 00:00 2023-10-09T11:32:43.251 INFO:teuthology.orchestra.run.smithi067.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 298 kB/s | 18 kB 00:00 2023-10-09T11:32:43.293 INFO:teuthology.orchestra.run.smithi067.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-10-09T11:32:43.454 INFO:teuthology.orchestra.run.smithi026.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 7.3 MB/s | 17 MB 00:02 2023-10-09T11:32:43.492 INFO:teuthology.orchestra.run.smithi026.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 652 kB/s | 24 kB 00:00 2023-10-09T11:32:43.613 INFO:teuthology.orchestra.run.smithi067.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 183 kB/s | 59 kB 00:00 2023-10-09T11:32:43.747 INFO:teuthology.orchestra.run.smithi067.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 617 kB/s | 306 kB 00:00 2023-10-09T11:32:43.757 INFO:teuthology.orchestra.run.smithi067.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 522 kB/s | 75 kB 00:00 2023-10-09T11:32:43.844 INFO:teuthology.orchestra.run.smithi067.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 506 kB/s | 44 kB 00:00 2023-10-09T11:32:43.917 INFO:teuthology.orchestra.run.smithi067.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-10-09T11:32:43.990 INFO:teuthology.orchestra.run.smithi067.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 452 kB/s | 33 kB 00:00 2023-10-09T11:32:43.994 INFO:teuthology.orchestra.run.smithi067.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-09T11:32:44.062 INFO:teuthology.orchestra.run.smithi067.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 227 kB/s | 16 kB 00:00 2023-10-09T11:32:44.092 INFO:teuthology.orchestra.run.smithi067.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-09T11:32:44.164 INFO:teuthology.orchestra.run.smithi067.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-10-09T11:32:44.177 INFO:teuthology.orchestra.run.smithi067.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 959 kB/s | 81 kB 00:00 2023-10-09T11:32:44.237 INFO:teuthology.orchestra.run.smithi067.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 153 kB/s | 11 kB 00:00 2023-10-09T11:32:44.251 INFO:teuthology.orchestra.run.smithi067.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 236 kB/s | 18 kB 00:00 2023-10-09T11:32:44.331 INFO:teuthology.orchestra.run.smithi067.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 612 kB/s | 49 kB 00:00 2023-10-09T11:32:44.402 INFO:teuthology.orchestra.run.smithi067.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-10-09T11:32:44.411 INFO:teuthology.orchestra.run.smithi067.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 737 kB/s | 59 kB 00:00 2023-10-09T11:32:44.475 INFO:teuthology.orchestra.run.smithi067.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 835 kB/s | 60 kB 00:00 2023-10-09T11:32:44.526 INFO:teuthology.orchestra.run.smithi067.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-09T11:32:44.547 INFO:teuthology.orchestra.run.smithi067.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 217 kB/s | 16 kB 00:00 2023-10-09T11:32:44.601 INFO:teuthology.orchestra.run.smithi067.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-10-09T11:32:44.624 INFO:teuthology.orchestra.run.smithi067.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-09T11:32:44.681 INFO:teuthology.orchestra.run.smithi067.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 804 kB/s | 64 kB 00:00 2023-10-09T11:32:44.695 INFO:teuthology.orchestra.run.smithi067.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 262 kB/s | 19 kB 00:00 2023-10-09T11:32:44.756 INFO:teuthology.orchestra.run.smithi067.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 322 kB/s | 24 kB 00:00 2023-10-09T11:32:44.767 INFO:teuthology.orchestra.run.smithi067.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 408 kB/s | 29 kB 00:00 2023-10-09T11:32:44.831 INFO:teuthology.orchestra.run.smithi067.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 363 kB/s | 27 kB 00:00 2023-10-09T11:32:44.845 INFO:teuthology.orchestra.run.smithi067.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 3.2 MB/s | 255 kB 00:00 2023-10-09T11:32:44.918 INFO:teuthology.orchestra.run.smithi067.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 844 kB/s | 61 kB 00:00 2023-10-09T11:32:44.939 INFO:teuthology.orchestra.run.smithi067.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-09T11:32:44.992 INFO:teuthology.orchestra.run.smithi067.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-09T11:32:45.013 INFO:teuthology.orchestra.run.smithi067.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 310 kB/s | 23 kB 00:00 2023-10-09T11:32:45.080 INFO:teuthology.orchestra.run.smithi067.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 70 kB 00:00 2023-10-09T11:32:45.119 INFO:teuthology.orchestra.run.smithi067.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-10-09T11:32:45.121 INFO:teuthology.orchestra.run.smithi067.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 453 kB/s | 19 kB 00:00 2023-10-09T11:32:45.147 INFO:teuthology.orchestra.run.smithi067.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.0 MB/s | 155 kB 00:00 2023-10-09T11:32:45.164 INFO:teuthology.orchestra.run.smithi067.stdout:(73/120): python3-jwt-1.6.1-2.el8.noarch.rpm 956 kB/s | 43 kB 00:00 2023-10-09T11:32:45.173 INFO:teuthology.orchestra.run.smithi067.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.2 MB/s | 220 kB 00:00 2023-10-09T11:32:45.190 INFO:teuthology.orchestra.run.smithi067.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.7 MB/s | 48 kB 00:00 2023-10-09T11:32:45.204 INFO:teuthology.orchestra.run.smithi067.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.4 MB/s | 229 kB 00:00 2023-10-09T11:32:45.217 INFO:teuthology.orchestra.run.smithi067.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.6 MB/s | 43 kB 00:00 2023-10-09T11:32:45.241 INFO:teuthology.orchestra.run.smithi067.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 740 kB/s | 18 kB 00:00 2023-10-09T11:32:45.259 INFO:teuthology.orchestra.run.smithi067.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 42 MB/s | 2.3 MB 00:00 2023-10-09T11:32:45.275 INFO:teuthology.orchestra.run.smithi067.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2023-10-09T11:32:45.297 INFO:teuthology.orchestra.run.smithi067.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 2.1 MB/s | 83 kB 00:00 2023-10-09T11:32:45.306 INFO:teuthology.orchestra.run.smithi067.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 1.8 MB/s | 59 kB 00:00 2023-10-09T11:32:45.326 INFO:teuthology.orchestra.run.smithi067.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 5.9 MB/s | 169 kB 00:00 2023-10-09T11:32:45.332 INFO:teuthology.orchestra.run.smithi067.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.4 MB/s | 38 kB 00:00 2023-10-09T11:32:45.354 INFO:teuthology.orchestra.run.smithi067.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.0 MB/s | 86 kB 00:00 2023-10-09T11:32:45.360 INFO:teuthology.orchestra.run.smithi067.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.0 MB/s | 58 kB 00:00 2023-10-09T11:32:45.384 INFO:teuthology.orchestra.run.smithi067.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2023-10-09T11:32:45.395 INFO:teuthology.orchestra.run.smithi067.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 16 MB/s | 559 kB 00:00 2023-10-09T11:32:45.416 INFO:teuthology.orchestra.run.smithi067.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2023-10-09T11:32:45.421 INFO:teuthology.orchestra.run.smithi067.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-09T11:32:45.442 INFO:teuthology.orchestra.run.smithi067.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 7.5 MB/s | 200 kB 00:00 2023-10-09T11:32:45.446 INFO:teuthology.orchestra.run.smithi067.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 3.8 MB/s | 97 kB 00:00 2023-10-09T11:32:45.472 INFO:teuthology.orchestra.run.smithi067.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2023-10-09T11:32:45.495 INFO:teuthology.orchestra.run.smithi067.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2023-10-09T11:32:45.522 INFO:teuthology.orchestra.run.smithi067.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 5.9 MB/s | 161 kB 00:00 2023-10-09T11:32:45.551 INFO:teuthology.orchestra.run.smithi067.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2023-10-09T11:32:45.583 INFO:teuthology.orchestra.run.smithi067.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2023-10-09T11:32:45.717 INFO:teuthology.orchestra.run.smithi067.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 53 MB/s | 15 MB 00:00 2023-10-09T11:32:45.744 INFO:teuthology.orchestra.run.smithi067.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.4 MB/s | 39 kB 00:00 2023-10-09T11:32:45.771 INFO:teuthology.orchestra.run.smithi067.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-10-09T11:32:45.780 INFO:teuthology.orchestra.run.smithi067.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 19 MB/s | 688 kB 00:00 2023-10-09T11:32:45.802 INFO:teuthology.orchestra.run.smithi067.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.4 MB/s | 259 kB 00:00 2023-10-09T11:32:45.812 INFO:teuthology.orchestra.run.smithi067.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 6.9 MB/s | 225 kB 00:00 2023-10-09T11:32:45.828 INFO:teuthology.orchestra.run.smithi067.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.7 MB/s | 126 kB 00:00 2023-10-09T11:32:45.865 INFO:teuthology.orchestra.run.smithi067.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 5.1 MB/s | 187 kB 00:00 2023-10-09T11:32:45.887 INFO:teuthology.orchestra.run.smithi067.stdout:(106/120): python3-numpy-1.14.3-9.el8.x86_64.rp 50 MB/s | 3.7 MB 00:00 2023-10-09T11:32:45.898 INFO:teuthology.orchestra.run.smithi067.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 16 MB/s | 538 kB 00:00 2023-10-09T11:32:45.921 INFO:teuthology.orchestra.run.smithi067.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 8.6 MB/s | 302 kB 00:00 2023-10-09T11:32:45.930 INFO:teuthology.orchestra.run.smithi067.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 4.8 MB/s | 157 kB 00:00 2023-10-09T11:32:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.5 MB/s | 110 kB 00:00 2023-10-09T11:32:45.964 INFO:teuthology.orchestra.run.smithi067.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2023-10-09T11:32:45.980 INFO:teuthology.orchestra.run.smithi067.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 713 kB/s | 20 kB 00:00 2023-10-09T11:32:46.004 INFO:teuthology.orchestra.run.smithi067.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-10-09T11:32:46.007 INFO:teuthology.orchestra.run.smithi067.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2023-10-09T11:32:46.103 INFO:teuthology.orchestra.run.smithi067.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 48 MB/s | 4.7 MB 00:00 2023-10-09T11:32:46.119 INFO:teuthology.orchestra.run.smithi067.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 41 MB/s | 4.6 MB 00:00 2023-10-09T11:32:46.143 INFO:teuthology.orchestra.run.smithi067.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2023-10-09T11:32:46.639 INFO:teuthology.orchestra.run.smithi067.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 7.2 MB/s | 3.6 MB 00:00 2023-10-09T11:32:46.785 INFO:teuthology.orchestra.run.smithi067.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 5.2 MB/s | 3.5 MB 00:00 2023-10-09T11:32:47.585 INFO:teuthology.orchestra.run.smithi026.stdout:(10/120): ceph-test-17.2.6-1320.g08cac018.el8.x 13 MB/s | 52 MB 00:04 2023-10-09T11:32:47.638 INFO:teuthology.orchestra.run.smithi026.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 4.7 MB/s | 255 kB 00:00 2023-10-09T11:32:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:(12/120): ceph-radosgw-17.2.6-1320.g08cac018.el 3.0 MB/s | 17 MB 00:05 2023-10-09T11:32:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 176 kB/s | 25 kB 00:00 2023-10-09T11:32:47.822 INFO:teuthology.orchestra.run.smithi026.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 4.1 MB/s | 174 kB 00:00 2023-10-09T11:32:47.859 INFO:teuthology.orchestra.run.smithi026.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 3.4 MB/s | 130 kB 00:00 2023-10-09T11:32:47.934 INFO:teuthology.orchestra.run.smithi026.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 6.6 MB/s | 507 kB 00:00 2023-10-09T11:32:47.962 INFO:teuthology.orchestra.run.smithi026.stdout:(17/120): libcephfs2-17.2.6-1320.g08cac018.el8. 4.2 MB/s | 797 kB 00:00 2023-10-09T11:32:47.999 INFO:teuthology.orchestra.run.smithi026.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.2 MB/s | 45 kB 00:00 2023-10-09T11:32:48.036 INFO:teuthology.orchestra.run.smithi026.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 3.1 MB/s | 115 kB 00:00 2023-10-09T11:32:48.117 INFO:teuthology.orchestra.run.smithi026.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 2.3 MB/s | 190 kB 00:00 2023-10-09T11:32:48.211 INFO:teuthology.orchestra.run.smithi026.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 3.9 MB/s | 371 kB 00:00 2023-10-09T11:32:48.304 INFO:teuthology.orchestra.run.smithi026.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 3.8 MB/s | 358 kB 00:00 2023-10-09T11:32:48.356 INFO:teuthology.orchestra.run.smithi026.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.0 MB/s | 107 kB 00:00 2023-10-09T11:32:48.383 INFO:teuthology.orchestra.run.smithi026.stdout:(24/120): librgw2-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 5.6 MB 00:00 2023-10-09T11:32:48.402 INFO:teuthology.orchestra.run.smithi026.stdout:(25/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 90 kB 00:00 2023-10-09T11:32:48.448 INFO:teuthology.orchestra.run.smithi026.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 3.7 MB/s | 173 kB 00:00 2023-10-09T11:32:48.486 INFO:teuthology.orchestra.run.smithi026.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 606 kB/s | 23 kB 00:00 2023-10-09T11:32:48.533 INFO:teuthology.orchestra.run.smithi026.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 2.5 MB/s | 121 kB 00:00 2023-10-09T11:32:48.642 INFO:teuthology.orchestra.run.smithi026.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 13 MB/s | 3.5 MB 00:00 2023-10-09T11:32:48.882 INFO:teuthology.orchestra.run.smithi026.stdout:(30/120): ceph-common-17.2.6-1320.g08cac018.el8 2.1 MB/s | 23 MB 00:10 2023-10-09T11:32:48.944 INFO:teuthology.orchestra.run.smithi026.stdout:(31/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 4.1 MB/s | 1.7 MB 00:00 2023-10-09T11:32:48.963 INFO:teuthology.orchestra.run.smithi026.stdout:(32/120): ceph-mgr-modules-core-17.2.6-1320.g08 2.9 MB/s | 238 kB 00:00 2023-10-09T11:32:48.981 INFO:teuthology.orchestra.run.smithi026.stdout:(33/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 1.2 MB/s | 47 kB 00:00 2023-10-09T11:32:48.999 INFO:teuthology.orchestra.run.smithi026.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1320.g0 401 kB/s | 14 kB 00:00 2023-10-09T11:32:49.037 INFO:teuthology.orchestra.run.smithi026.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-09T11:32:49.060 INFO:teuthology.orchestra.run.smithi026.stdout:(36/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.4 MB/s | 267 kB 00:00 2023-10-09T11:32:49.077 INFO:teuthology.orchestra.run.smithi026.stdout:(37/120): cephfs-top-17.2.6-1320.g08cac018.el8. 451 kB/s | 18 kB 00:00 2023-10-09T11:32:49.219 INFO:teuthology.orchestra.run.smithi026.stdout:(38/120): ceph-mgr-diskprediction-local-17.2.6- 13 MB/s | 7.4 MB 00:00 2023-10-09T11:32:49.475 INFO:teuthology.orchestra.run.smithi026.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 148 kB/s | 59 kB 00:00 2023-10-09T11:32:49.640 INFO:teuthology.orchestra.run.smithi026.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 528 kB/s | 306 kB 00:00 2023-10-09T11:32:49.644 INFO:teuthology.orchestra.run.smithi026.stdout:(41/120): libunwind-1.3.1-3.el8.x86_64.rpm 177 kB/s | 75 kB 00:00 2023-10-09T11:32:49.755 INFO:teuthology.orchestra.run.smithi026.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 378 kB/s | 44 kB 00:00 2023-10-09T11:32:49.841 INFO:teuthology.orchestra.run.smithi026.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-10-09T11:32:49.880 INFO:teuthology.orchestra.run.smithi026.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 265 kB/s | 33 kB 00:00 2023-10-09T11:32:49.909 INFO:teuthology.orchestra.run.smithi026.stdout:(45/120): python3-beautifulsoup4-4.6.3-2.el8.1. 701 kB/s | 185 kB 00:00 2023-10-09T11:32:49.951 INFO:teuthology.orchestra.run.smithi026.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 149 kB/s | 16 kB 00:00 2023-10-09T11:32:50.019 INFO:teuthology.orchestra.run.smithi026.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-09T11:32:50.041 INFO:teuthology.orchestra.run.smithi026.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 906 kB/s | 81 kB 00:00 2023-10-09T11:32:50.117 INFO:teuthology.orchestra.run.smithi026.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 113 kB/s | 11 kB 00:00 2023-10-09T11:32:50.130 INFO:teuthology.orchestra.run.smithi026.stdout:(50/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-10-09T11:32:50.149 INFO:teuthology.orchestra.run.smithi026.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 163 kB/s | 18 kB 00:00 2023-10-09T11:32:50.228 INFO:teuthology.orchestra.run.smithi026.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 500 kB/s | 49 kB 00:00 2023-10-09T11:32:50.247 INFO:teuthology.orchestra.run.smithi026.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 603 kB/s | 59 kB 00:00 2023-10-09T11:32:50.315 INFO:teuthology.orchestra.run.smithi026.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 693 kB/s | 60 kB 00:00 2023-10-09T11:32:50.376 INFO:teuthology.orchestra.run.smithi026.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-09T11:32:50.391 INFO:teuthology.orchestra.run.smithi026.stdout:(56/120): python3-kubernetes-11.0.0-6.el8.noarc 4.3 MB/s | 1.2 MB 00:00 2023-10-09T11:32:50.395 INFO:teuthology.orchestra.run.smithi026.stdout:(57/120): python3-portend-2.6-1.el8.noarch.rpm 196 kB/s | 16 kB 00:00 2023-10-09T11:32:50.473 INFO:teuthology.orchestra.run.smithi026.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 347 kB/s | 34 kB 00:00 2023-10-09T11:32:50.486 INFO:teuthology.orchestra.run.smithi026.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 2.0 MB/s | 196 kB 00:00 2023-10-09T11:32:50.489 INFO:teuthology.orchestra.run.smithi026.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 681 kB/s | 64 kB 00:00 2023-10-09T11:32:50.562 INFO:teuthology.orchestra.run.smithi026.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 210 kB/s | 19 kB 00:00 2023-10-09T11:32:50.572 INFO:teuthology.orchestra.run.smithi026.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 279 kB/s | 24 kB 00:00 2023-10-09T11:32:50.587 INFO:teuthology.orchestra.run.smithi026.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 301 kB/s | 29 kB 00:00 2023-10-09T11:32:50.645 INFO:teuthology.orchestra.run.smithi026.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 334 kB/s | 27 kB 00:00 2023-10-09T11:32:50.669 INFO:teuthology.orchestra.run.smithi026.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 2.6 MB/s | 255 kB 00:00 2023-10-09T11:32:50.707 INFO:teuthology.orchestra.run.smithi026.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-10-09T11:32:50.732 INFO:teuthology.orchestra.run.smithi026.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 708 kB/s | 61 kB 00:00 2023-10-09T11:32:50.751 INFO:teuthology.orchestra.run.smithi026.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-10-09T11:32:50.756 INFO:teuthology.orchestra.run.smithi026.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-09T11:32:50.795 INFO:teuthology.orchestra.run.smithi026.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 489 kB/s | 19 kB 00:00 2023-10-09T11:32:50.798 INFO:teuthology.orchestra.run.smithi026.stdout:(71/120): python3-zc-lockfile-2.0-2.el8.noarch. 250 kB/s | 23 kB 00:00 2023-10-09T11:32:50.807 INFO:teuthology.orchestra.run.smithi026.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.3 MB/s | 43 kB 00:00 2023-10-09T11:32:50.824 INFO:teuthology.orchestra.run.smithi026.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-09T11:32:50.837 INFO:teuthology.orchestra.run.smithi026.stdout:(74/120): python3-oauthlib-2.1.0-1.el8.noarch.r 4.0 MB/s | 155 kB 00:00 2023-10-09T11:32:50.842 INFO:teuthology.orchestra.run.smithi026.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.7 MB/s | 48 kB 00:00 2023-10-09T11:32:50.855 INFO:teuthology.orchestra.run.smithi026.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-09T11:32:50.859 INFO:teuthology.orchestra.run.smithi026.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2023-10-09T11:32:50.881 INFO:teuthology.orchestra.run.smithi026.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 836 kB/s | 18 kB 00:00 2023-10-09T11:32:50.906 INFO:teuthology.orchestra.run.smithi026.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-10-09T11:32:50.914 INFO:teuthology.orchestra.run.smithi026.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 40 MB/s | 2.3 MB 00:00 2023-10-09T11:32:50.921 INFO:teuthology.orchestra.run.smithi026.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.2 MB/s | 83 kB 00:00 2023-10-09T11:32:50.931 INFO:teuthology.orchestra.run.smithi026.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.4 MB/s | 59 kB 00:00 2023-10-09T11:32:50.937 INFO:teuthology.orchestra.run.smithi026.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-09T11:32:50.946 INFO:teuthology.orchestra.run.smithi026.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.4 MB/s | 38 kB 00:00 2023-10-09T11:32:50.951 INFO:teuthology.orchestra.run.smithi026.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.8 MB/s | 86 kB 00:00 2023-10-09T11:32:50.967 INFO:teuthology.orchestra.run.smithi026.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.7 MB/s | 58 kB 00:00 2023-10-09T11:32:50.976 INFO:teuthology.orchestra.run.smithi026.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-10-09T11:32:50.991 INFO:teuthology.orchestra.run.smithi026.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 24 MB/s | 559 kB 00:00 2023-10-09T11:32:51.001 INFO:teuthology.orchestra.run.smithi026.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-10-09T11:32:51.013 INFO:teuthology.orchestra.run.smithi026.stdout:(90/120): thrift-0.13.0-2.el8.x86_64.rpm 6.2 MB/s | 1.7 MB 00:00 2023-10-09T11:32:51.015 INFO:teuthology.orchestra.run.smithi026.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-09T11:32:51.026 INFO:teuthology.orchestra.run.smithi026.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 8.0 MB/s | 200 kB 00:00 2023-10-09T11:32:51.043 INFO:teuthology.orchestra.run.smithi026.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.5 MB/s | 44 kB 00:00 2023-10-09T11:32:51.054 INFO:teuthology.orchestra.run.smithi026.stdout:(94/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.3 MB/s | 97 kB 00:00 2023-10-09T11:32:51.058 INFO:teuthology.orchestra.run.smithi026.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-09T11:32:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 7.9 MB/s | 161 kB 00:00 2023-10-09T11:32:51.080 INFO:teuthology.orchestra.run.smithi026.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-09T11:32:51.098 INFO:teuthology.orchestra.run.smithi026.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2023-10-09T11:32:51.113 INFO:teuthology.orchestra.run.smithi026.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.7 MB/s | 39 kB 00:00 2023-10-09T11:32:51.143 INFO:teuthology.orchestra.run.smithi026.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2023-10-09T11:32:51.164 INFO:teuthology.orchestra.run.smithi026.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-10-09T11:32:51.181 INFO:teuthology.orchestra.run.smithi026.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 47 MB/s | 4.8 MB 00:00 2023-10-09T11:32:51.185 INFO:teuthology.orchestra.run.smithi026.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 10 MB/s | 225 kB 00:00 2023-10-09T11:32:51.198 INFO:teuthology.orchestra.run.smithi026.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.5 MB/s | 126 kB 00:00 2023-10-09T11:32:51.218 INFO:teuthology.orchestra.run.smithi026.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.1 MB/s | 187 kB 00:00 2023-10-09T11:32:51.245 INFO:teuthology.orchestra.run.smithi026.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2023-10-09T11:32:51.349 INFO:teuthology.orchestra.run.smithi026.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 44 MB/s | 15 MB 00:00 2023-10-09T11:32:51.354 INFO:teuthology.orchestra.run.smithi026.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.7 MB/s | 302 kB 00:00 2023-10-09T11:32:51.368 INFO:teuthology.orchestra.run.smithi026.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-10-09T11:32:51.370 INFO:teuthology.orchestra.run.smithi026.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 7.4 MB/s | 157 kB 00:00 2023-10-09T11:32:51.382 INFO:teuthology.orchestra.run.smithi026.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.9 MB/s | 110 kB 00:00 2023-10-09T11:32:51.387 INFO:teuthology.orchestra.run.smithi026.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.2 MB/s | 20 kB 00:00 2023-10-09T11:32:51.396 INFO:teuthology.orchestra.run.smithi026.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2023-10-09T11:32:51.404 INFO:teuthology.orchestra.run.smithi026.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-10-09T11:32:51.407 INFO:teuthology.orchestra.run.smithi026.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-09T11:32:51.436 INFO:teuthology.orchestra.run.smithi026.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2023-10-09T11:32:51.489 INFO:teuthology.orchestra.run.smithi026.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 51 MB/s | 4.7 MB 00:00 2023-10-09T11:32:51.512 INFO:teuthology.orchestra.run.smithi026.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 42 MB/s | 4.6 MB 00:00 2023-10-09T11:32:51.845 INFO:teuthology.orchestra.run.smithi026.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 8.5 MB/s | 3.5 MB 00:00 2023-10-09T11:32:52.257 INFO:teuthology.orchestra.run.smithi026.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 4.7 MB/s | 3.6 MB 00:00 2023-10-09T11:32:52.261 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:32:52.262 INFO:teuthology.orchestra.run.smithi026.stdout:Total 14 MB/s | 202 MB 00:14 2023-10-09T11:32:52.315 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-10-09T11:32:52.439 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-10-09T11:32:52.440 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-10-09T11:32:52.542 INFO:teuthology.orchestra.run.smithi067.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 4.5 MB/s | 52 MB 00:11 2023-10-09T11:32:52.546 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:32:52.547 INFO:teuthology.orchestra.run.smithi067.stdout:Total 14 MB/s | 202 MB 00:14 2023-10-09T11:32:52.606 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-10-09T11:32:52.797 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-10-09T11:32:52.797 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-10-09T11:32:54.145 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-10-09T11:32:54.150 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-10-09T11:32:54.473 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-10-09T11:32:54.477 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-10-09T11:32:58.916 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-10-09T11:32:59.177 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:32:59.360 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:32:59.512 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:32:59.684 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:32:59.928 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-10-09T11:33:00.098 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:33:00.188 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:33:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:33:00.409 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:33:00.535 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:33:00.698 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:33:00.751 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:33:00.926 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:33:01.081 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:33:01.162 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:33:01.275 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:33:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:33:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:33:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:33:01.833 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:33:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T11:33:02.067 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:33:02.191 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:33:02.426 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:33:02.551 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:33:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:33:02.773 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:33:02.775 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:33:02.873 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:33:03.110 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T11:33:03.113 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:33:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:33:03.501 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:33:03.624 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:33:03.789 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:33:04.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:33:04.500 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:33:04.534 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:33:04.606 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:33:04.782 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:33:04.792 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T11:33:04.942 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:33:05.096 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T11:33:05.150 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:33:05.252 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:33:05.324 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T11:33:05.434 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:33:05.505 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T11:33:05.514 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:33:05.667 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:33:05.716 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T11:33:05.804 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:33:05.991 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:33:06.007 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T11:33:06.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T11:33:06.450 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T11:33:06.569 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:33:06.600 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:33:06.716 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:33:06.747 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:33:06.933 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:33:07.285 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:33:07.475 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:33:07.502 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:33:07.700 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:33:08.220 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:33:08.249 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:33:08.433 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:33:08.471 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T11:33:08.704 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T11:33:08.963 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:33:09.132 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:33:09.240 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:33:09.269 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:33:09.505 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T11:33:09.579 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:33:09.807 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T11:33:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T11:33:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:33:10.103 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T11:33:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:33:10.291 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:33:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:33:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:33:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T11:33:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T11:33:11.583 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:33:12.482 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:33:12.801 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T11:33:13.786 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:33:13.896 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T11:33:14.159 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T11:33:14.236 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T11:33:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T11:33:14.715 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:33:14.945 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:33:15.136 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:33:15.189 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T11:33:15.298 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:33:15.561 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T11:33:15.596 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:33:15.806 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T11:33:15.837 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T11:33:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T11:33:16.107 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:33:16.214 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T11:33:16.345 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:33:16.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T11:33:16.603 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:33:16.615 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:33:16.685 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:33:16.806 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:33:16.881 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T11:33:17.055 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T11:33:17.123 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:33:17.219 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T11:33:17.331 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T11:33:17.404 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T11:33:17.515 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T11:33:17.560 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T11:33:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T11:33:17.743 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T11:33:17.877 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T11:33:17.954 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T11:33:18.084 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T11:33:18.164 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:33:18.237 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T11:33:18.251 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:33:18.476 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T11:33:18.602 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T11:33:18.669 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T11:33:18.841 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T11:33:18.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T11:33:19.076 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T11:33:19.097 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T11:33:19.276 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T11:33:19.380 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T11:33:19.435 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T11:33:19.532 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:33:19.620 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T11:33:19.705 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:33:19.849 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T11:33:19.996 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:33:20.020 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T11:33:20.199 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:33:20.368 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T11:33:20.432 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:33:20.565 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:33:20.680 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T11:33:20.729 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:33:20.942 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T11:33:20.948 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:33:21.132 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:33:21.226 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T11:33:21.365 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:33:21.408 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:33:21.535 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:33:21.571 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:33:21.681 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:33:21.851 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:33:21.939 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:33:22.091 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:33:22.153 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:33:22.331 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:33:22.413 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:33:22.520 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:33:22.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:33:22.718 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:33:22.879 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:33:22.981 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:33:23.140 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:33:23.166 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:33:23.398 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:33:23.424 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:33:23.611 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:33:23.748 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:33:23.997 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:33:24.237 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:33:24.472 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:33:24.604 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:33:24.801 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:33:24.931 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:33:25.115 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:33:25.142 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:33:25.342 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:33:25.639 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:33:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:33:25.908 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:33:26.237 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:33:26.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:33:26.699 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:33:26.878 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:33:26.922 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:33:27.198 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:33:27.459 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:33:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:33:28.147 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:33:28.514 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:33:28.728 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:33:28.959 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:33:29.190 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:33:32.260 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:32.447 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:33.056 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:33.372 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:33:33.479 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:33:33.629 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:33:34.679 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:34.939 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:35.576 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:33:36.540 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:33:36.626 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:33:36.790 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2023-10-09T11:33:52.010 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2023-10-09T11:33:52.011 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2023-10-09T11:33:52.011 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-10-09T11:33:52.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:33:52.384 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:33:53.967 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:33:54.160 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:33:54.405 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:33:54.610 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:33:55.028 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:33:55.192 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:33:55.210 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /run 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2023-10-09T11:33:55.325 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2023-10-09T11:33:55.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2023-10-09T11:33:55.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-10-09T11:33:55.326 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:33:55.720 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:33:57.298 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:33:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:33:57.747 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:33:57.916 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:33:58.252 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:33:58.329 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:33:58.421 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:33:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:33:58.495 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:33:58.648 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:33:58.842 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:33:59.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:33:59.294 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:33:59.542 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:34:00.574 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:34:00.758 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:34:00.860 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:34:01.274 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:34:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:34:01.498 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:34:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:34:01.648 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:34:01.657 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:34:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:34:01.876 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:34:02.101 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:34:02.302 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:34:02.529 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:34:02.745 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:34:03.353 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:34:03.600 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:34:03.695 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:34:03.776 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:34:03.858 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:34:03.903 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:34:03.985 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:34:04.087 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:34:04.108 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:34:04.476 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:34:04.478 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:34:04.650 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:34:04.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:34:04.716 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:34:04.877 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:34:04.888 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:34:06.623 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:34:06.870 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:34:06.949 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:34:07.118 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:34:07.162 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:34:07.352 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:34:07.722 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:34:07.918 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:34:09.895 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:34:10.858 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:34:11.187 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T11:34:11.426 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T11:34:11.648 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T11:34:11.840 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:34:11.852 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:34:12.011 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:34:12.145 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:34:12.340 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:34:12.499 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:34:12.761 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:34:12.956 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:34:13.017 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:34:13.151 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:34:13.173 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:34:13.182 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:34:13.326 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T11:34:13.326 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:34:13.501 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:34:13.501 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:14.205 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:34:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:34:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:34:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:34:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:34:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:34:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:34:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:34:14.395 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:34:14.396 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:34:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:34:14.398 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:34:14.399 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T11:34:14.400 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T11:34:14.401 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T11:34:14.402 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T11:34:14.403 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T11:34:14.404 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T11:34:14.404 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T11:34:14.404 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:34:14.404 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:34:14.404 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:34:14.589 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T11:34:14.806 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T11:34:15.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T11:34:15.192 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:34:15.203 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:34:15.388 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:34:15.569 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:34:15.726 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:34:15.929 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:34:16.213 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:34:16.417 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:34:16.479 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:34:16.568 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:16.568 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:48 ago on Mon 09 Oct 2023 11:32:28 AM UTC. 2023-10-09T11:34:16.692 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:34:16.701 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:34:16.836 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T11:34:16.836 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:34:17.070 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:34:17.070 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:34:18.031 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:34:18.032 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:34:18.033 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:34:18.034 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:34:18.034 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:34:18.035 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:34:18.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:34:18.043 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:34:18.043 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:34:18.044 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:34:18.045 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:34:18.046 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T11:34:18.047 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T11:34:18.048 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T11:34:18.049 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:34:18.050 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:34:18.051 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:34:18.674 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-10-09T11:34:18.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:18.827 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-10-09T11:34:18.827 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.827 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.828 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.830 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:34:18.831 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:34:18.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:34:18.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:34:18.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:34:18.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:34:18.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:34:18.837 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:34:18.838 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:34:18.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:18.838 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-10-09T11:34:19.129 DEBUG:teuthology.parallel:result is None 2023-10-09T11:34:20.313 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:34:20.313 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:51 ago on Mon 09 Oct 2023 11:32:29 AM UTC. 2023-10-09T11:34:22.467 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-10-09T11:34:22.621 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.622 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.623 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.624 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.625 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:34:22.626 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:34:22.627 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:34:22.628 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:34:22.629 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:34:22.630 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:34:22.631 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:34:22.632 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:34:22.632 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:34:22.632 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:22.632 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-10-09T11:34:22.907 DEBUG:teuthology.parallel:result is None 2023-10-09T11:34:22.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:34:23.067 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:34:23.092 INFO:teuthology.orchestra.run.smithi026.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:34:23.093 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:34:23.093 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:34:23.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:34:23.314 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:34:23.336 INFO:teuthology.orchestra.run.smithi067.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:34:23.337 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:34:23.337 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:34:23.337 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T11:34:23.339 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:23.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:34:23.382 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:23.383 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:34:23.422 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T11:34:23.423 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:23.423 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:34:23.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:34:23.517 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:23.518 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:34:23.543 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:34:23.610 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T11:34:23.610 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:23.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:34:23.636 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:34:23.702 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:23.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:34:23.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:34:23.791 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T11:34:23.792 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:23.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:34:23.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:34:23.883 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:23.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:34:23.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:34:23.975 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T11:34:24.246 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T11:34:24.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-10-09T11:34:24.249 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2023-10-09T11:34:24.274 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T11:34:24.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:34:24.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:34:24.343 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T11:34:24.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:34:24.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:34:24.417 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T11:34:24.432 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T11:34:24.452 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T11:34:24.452 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:24.452 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:34:24.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:24.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:24.609 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:24.610 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:34:24.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:24.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:24.769 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T11:34:24.769 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T11:34:24.769 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418425', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231009.111138', 'sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231009.111138', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba', 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQPwAR7jfuyZjq2/T7yRLjXRu5wIqQBc/b9XplrhgboaQoDLoR4nvMWl64rbPbowUO1BJi5oduWkcwZZNvJEc4=', 'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtnQGeA3ZIqGsDMcojbchoWQx6n3QWRs0jse8s6mrpnnIWtTGMkUmFsG2zbobQgJ/H89ysJK8+ZjuMsSWFSMLY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_11:13:22', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T11:34:24.770 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:34:24.774 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:34:24.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:34:24.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:34:24.884 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:24.884 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:34:24.907 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:34:24.907 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-10-09T11:34:24.962 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:34:24.962 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 222554 Links: 1 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-09 11:34:13.978804769 +0000 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-09 11:31:41.829243635 +0000 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-09 11:31:41.829243635 +0000 2023-10-09T11:34:24.963 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-09T11:34:24.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:34:25.027 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-09T11:34:25.027 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-09T11:34:25.027 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.00011544 s, 4.4 MB/s 2023-10-09T11:34:25.028 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:34:25.084 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-10-09T11:34:25.139 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 223455 Links: 1 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-09 11:34:13.978804769 +0000 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-09 11:31:42.354236000 +0000 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-09 11:31:42.354236000 +0000 2023-10-09T11:34:25.140 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-09T11:34:25.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:34:25.203 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-09T11:34:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-09T11:34:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000115937 s, 4.4 MB/s 2023-10-09T11:34:25.205 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:34:25.261 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-10-09T11:34:25.316 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:34:25.316 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:25.316 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 219632 Links: 1 2023-10-09T11:34:25.316 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:25.316 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:25.317 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-09 11:34:13.978804769 +0000 2023-10-09T11:34:25.317 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-09 11:31:42.879228366 +0000 2023-10-09T11:34:25.317 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-09 11:31:42.879228366 +0000 2023-10-09T11:34:25.317 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-09T11:34:25.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:34:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-09T11:34:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-09T11:34:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000117301 s, 4.4 MB/s 2023-10-09T11:34:25.380 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:34:25.437 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-10-09T11:34:25.492 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:34:25.492 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:25.492 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 218419 Links: 1 2023-10-09T11:34:25.492 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:25.493 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:25.493 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-09 11:34:13.978804769 +0000 2023-10-09T11:34:25.493 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-09 11:31:43.389220947 +0000 2023-10-09T11:34:25.493 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-09 11:31:43.389220947 +0000 2023-10-09T11:34:25.493 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-09T11:34:25.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:34:25.555 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-09T11:34:25.556 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-09T11:34:25.556 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000113181 s, 4.5 MB/s 2023-10-09T11:34:25.557 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:34:25.613 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:25.613 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:25.613 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:34:25.631 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:34:25.631 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 219693 Links: 1 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-09 11:34:17.591457419 +0000 2023-10-09T11:34:25.690 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-09 11:31:42.682444601 +0000 2023-10-09T11:34:25.691 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-09 11:31:42.682444601 +0000 2023-10-09T11:34:25.691 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-09T11:34:25.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:34:25.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-09T11:34:25.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-09T11:34:25.757 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.0002654 s, 1.9 MB/s 2023-10-09T11:34:25.758 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:34:25.817 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2023-10-09T11:34:25.873 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 220993 Links: 1 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-09 11:34:17.591457419 +0000 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-09 11:31:43.206432812 +0000 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-09 11:31:43.206432812 +0000 2023-10-09T11:34:25.874 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-09T11:34:25.875 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:34:25.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-09T11:34:25.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-09T11:34:25.940 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000212671 s, 2.4 MB/s 2023-10-09T11:34:25.941 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:34:25.998 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2023-10-09T11:34:26.054 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:34:26.054 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 213454 Links: 1 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-09 11:34:17.592457397 +0000 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-09 11:31:43.708421518 +0000 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-09 11:31:43.708421518 +0000 2023-10-09T11:34:26.055 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-09T11:34:26.055 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:34:26.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-09T11:34:26.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-09T11:34:26.120 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225786 s, 2.3 MB/s 2023-10-09T11:34:26.121 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:34:26.179 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 221484 Links: 1 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-09 11:34:17.592457397 +0000 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-09 11:31:44.234409684 +0000 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-09 11:31:44.234409684 +0000 2023-10-09T11:34:26.235 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-09T11:34:26.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:34:26.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-09T11:34:26.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-09T11:34:26.300 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000196831 s, 2.6 MB/s 2023-10-09T11:34:26.301 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:34:26.357 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:26.357 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:34:26.357 INFO:tasks.ceph:Generating config... 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] pid file = 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T11:34:26.361 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T11:34:26.361 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T11:34:26.361 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T11:34:26.361 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T11:34:26.361 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T11:34:26.362 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T11:34:26.363 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T11:34:26.363 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T11:34:26.363 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-09T11:34:26.364 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T11:34:26.364 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T11:34:26.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T11:34:26.413 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T11:34:26.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T11:34:26.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:34:26.521 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]')] 2023-10-09T11:34:26.522 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T11:34:26.523 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:26.523 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:34:26.577 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid d2192364-4346-4c74-aa8c-103a3c519dbd 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = octopus 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:fsid d2192364-4346-4c74-aa8c-103a3c519dbd 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-10-09T11:34:26.660836+0000 2023-10-09T11:34:26.661 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-10-09T11:34:26.660836+0000 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 15 (octopus) 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2023-10-09T11:34:26.662 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T11:34:26.663 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:34:26.718 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d2192364-4346-4c74-aa8c-103a3c519dbd... 2023-10-09T11:34:26.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:34:26.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:34:26.802 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-10-09T11:34:26.802 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.803 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.804 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.805 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-10-09T11:34:26.806 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on skipped message = False 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = d2192364-4346-4c74-aa8c-103a3c519dbd 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-10-09T11:34:26.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-10-09T11:34:26.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2023-10-09T11:34:26.809 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-10-09T11:34:26.810 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-10-09T11:34:26.811 INFO:teuthology.orchestra.run.smithi026.stdout: debug finisher = 20 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-10-09T11:34:26.812 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-10-09T11:34:26.813 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-10-09T11:34:26.814 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = "" 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-10-09T11:34:26.815 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-09T11:34:26.816 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-09T11:34:26.817 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2023-10-09T11:34:26.818 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2023-10-09T11:34:26.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.820 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.26,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = d2192364-4346-4c74-aa8c-103a3c519dbd 2023-10-09T11:34:26.821 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2023-10-09T11:34:26.822 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:34:26.823 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-09T11:34:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2023-10-09T11:34:26.825 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug finisher = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2023-10-09T11:34:26.826 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.827 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2023-10-09T11:34:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2023-10-09T11:34:26.829 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-10-09T11:34:26.830 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-10-09T11:34:26.831 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-10-09T11:34:26.832 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T11:34:26.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T11:34:26.924 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T11:34:26.925 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:26.925 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T11:34:26.940 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:26.940 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T11:34:26.995 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:34:26.995 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:26.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:34:26.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:34:27.142 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:27.142 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:27.433 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:34:27.434 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:27.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:34:27.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:34:27.477 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:27.478 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:27.535 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T11:34:27.535 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T11:34:27.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:34:27.587 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:34:27.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:34:27.659 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:34:27.662 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T11:34:27.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:34:27.714 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:34:27.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T11:34:27.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:34:27.831 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:34:27.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T11:34:27.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:34:27.912 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:34:27.915 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T11:34:27.941 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:34:28.032 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:34:28.034 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T11:34:28.059 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T11:34:28.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T11:34:28.098 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T11:34:28.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T11:34:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T11:34:28.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T11:34:28.241 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T11:34:28.254 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T11:34:28.334 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T11:34:28.347 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T11:34:28.347 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:34:28.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T11:34:28.373 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:28.373 INFO:tasks.ceph:role: osd.0 2023-10-09T11:34:28.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:34:28.373 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:34:28.438 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:28.439 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:28.440 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:28.440 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:28.440 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:28.461 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-09T11:34:28.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-09T11:34:28.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T11:34:28.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T11:34:28.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T11:34:28.677 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:28.677 INFO:tasks.ceph:role: osd.1 2023-10-09T11:34:28.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:34:28.678 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:34:28.742 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:28.742 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:28.743 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:28.765 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-09T11:34:28.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-09T11:34:28.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T11:34:28.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T11:34:28.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T11:34:28.980 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:28.980 INFO:tasks.ceph:role: osd.2 2023-10-09T11:34:28.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:34:28.980 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:29.045 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:29.046 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:29.070 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-09T11:34:29.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-09T11:34:29.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T11:34:29.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T11:34:29.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T11:34:29.282 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:29.283 INFO:tasks.ceph:role: osd.3 2023-10-09T11:34:29.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:34:29.283 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:34:29.347 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:29.370 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-09T11:34:29.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-09T11:34:29.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T11:34:29.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T11:34:29.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T11:34:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T11:34:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:34:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:34:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:34:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:29.607+0000 7f506b785540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-09T11:34:30.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:30.129+0000 7f506b785540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:30.895+0000 7f506b785540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:31.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:31.657+0000 7f506b785540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:32.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T11:34:32.481 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T11:34:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T11:34:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:34:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:34:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:34:32.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:32.567+0000 7f5edb849540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-09T11:34:33.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:33.091+0000 7f5edb849540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:33.856+0000 7f5edb849540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:34.621+0000 7f5edb849540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:35.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T11:34:35.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.537+0000 7f64696ff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T11:34:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.537+0000 7f64696ff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T11:34:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.537+0000 7f64696ff540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:34:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.537+0000 7f64696ff540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:34:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.537+0000 7f64696ff540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:34:35.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:35.538+0000 7f64696ff540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-09T11:34:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:36.060+0000 7f64696ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:36.822+0000 7f64696ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:37.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:37.584+0000 7f64696ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:38.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T11:34:38.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:38.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T11:34:38.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T11:34:38.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:34:38.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:34:38.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:34:38.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:38.503+0000 7fe8ff2c3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-09T11:34:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:39.030+0000 7fe8ff2c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:39.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:39.796+0000 7fe8ff2c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:40.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:40.559+0000 7fe8ff2c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:41.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T11:34:41.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T11:34:41.409 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:41.409 INFO:tasks.ceph:role: osd.4 2023-10-09T11:34:41.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:34:41.409 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:34:41.484 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:41.485 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:41.918 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-09T11:34:41.920 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-09T11:34:41.920 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T11:34:42.099 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T11:34:42.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T11:34:42.208 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:42.209 INFO:tasks.ceph:role: osd.5 2023-10-09T11:34:42.209 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:34:42.209 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:42.284 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:42.285 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:42.285 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:42.285 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:42.705 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-09T11:34:42.707 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-09T11:34:42.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T11:34:42.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T11:34:42.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T11:34:42.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:42.919 INFO:tasks.ceph:role: osd.6 2023-10-09T11:34:42.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:34:42.919 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:42.993 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:43.447 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-09T11:34:43.449 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-09T11:34:43.449 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T11:34:43.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T11:34:43.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T11:34:43.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:34:43.732 INFO:tasks.ceph:role: osd.7 2023-10-09T11:34:43.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:34:43.732 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:34:43.808 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:34:43.808 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:34:43.808 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:34:43.808 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:34:43.809 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:34:44.243 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-09T11:34:44.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-09T11:34:44.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T11:34:44.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T11:34:44.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:44.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T11:34:44.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T11:34:44.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:34:44.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:34:44.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:34:44.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:44.646+0000 7f0dfe548540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-09T11:34:45.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:45.179+0000 7f0dfe548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:45.941+0000 7f0dfe548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:46.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:46.704+0000 7f0dfe548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:47.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T11:34:47.532 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:47.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.618+0000 7fe1c9973540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T11:34:47.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.618+0000 7fe1c9973540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T11:34:47.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.619+0000 7fe1c9973540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:34:47.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.619+0000 7fe1c9973540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:34:47.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.619+0000 7fe1c9973540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:34:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:47.619+0000 7fe1c9973540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-09T11:34:48.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:48.147+0000 7fe1c9973540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:48.908+0000 7fe1c9973540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:49.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:49.671+0000 7fe1c9973540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:50.463 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T11:34:50.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.579+0000 7fa7d9e5c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.579+0000 7fa7d9e5c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.579+0000 7fa7d9e5c540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.579+0000 7fa7d9e5c540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.579+0000 7fa7d9e5c540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:34:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:50.580+0000 7fa7d9e5c540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-09T11:34:51.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:51.106+0000 7fa7d9e5c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:51.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:51.870+0000 7fa7d9e5c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:52.632+0000 7fa7d9e5c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:53.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T11:34:53.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.545+0000 7fbf2839f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T11:34:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.546+0000 7fbf2839f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T11:34:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.546+0000 7fbf2839f540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:34:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.546+0000 7fbf2839f540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:34:53.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.546+0000 7fbf2839f540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:34:53.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:53.546+0000 7fbf2839f540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-09T11:34:54.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:54.072+0000 7fbf2839f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:54.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:54.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:34:54.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:54.842+0000 7fbf2839f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:55.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:34:55.605+0000 7fbf2839f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:34:56.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T11:34:56.432 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T11:34:56.432 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T11:34:56.462 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T11:34:56.531 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T11:34:56.601 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T11:34:56.669 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T11:34:56.738 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T11:34:56.806 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:56.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T11:34:56.874 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:56.874 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T11:34:56.904 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:56.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T11:34:56.973 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:56.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T11:34:57.043 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T11:34:57.111 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.111 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T11:34:57.178 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T11:34:57.244 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T11:34:57.309 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:57.309 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T11:34:57.328 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:57.328 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T11:34:57.386 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.386 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T11:34:57.401 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:57.401 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T11:34:57.458 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T11:34:57.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:34:57.460 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ== 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg== 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ== 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-10-09T11:34:57.501 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ== 2023-10-09T11:34:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g== 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww== 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg== 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg== 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg== 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-09T11:34:57.503 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow== 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout:[client.2] 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA== 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A== 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout:[client.3] 2023-10-09T11:34:57.504 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ== 2023-10-09T11:34:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2023-10-09T11:34:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ== 2023-10-09T11:34:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-10-09T11:34:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg== 2023-10-09T11:34:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ== 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g== 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw== 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw== 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2023-10-09T11:34:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ== 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw== 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ== 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g== 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww== 2023-10-09T11:34:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg== 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg== 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg== 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow== 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA== 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2023-10-09T11:34:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A== 2023-10-09T11:34:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:[client.3] 2023-10-09T11:34:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ== 2023-10-09T11:34:57.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:34:57.547 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:34:57.616 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:57.619 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:57.671 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:57.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:57.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.778 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:57.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:34:57.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:34:57.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:57.981 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:58.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:58.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:34:58.087 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.089 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.193 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:34:58.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.295 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.457 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:34:58.508 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T11:34:58.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T11:34:58.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:34:58.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T11:34:58.651 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T11:34:58.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:34:58.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T11:34:58.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T11:34:58.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:34:58.953 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T11:34:58.978 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:58.980 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:34:59.032 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T11:34:59.033 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T11:34:59.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T11:34:59.036 INFO:tasks.ceph.mon.a:Started 2023-10-09T11:34:59.036 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T11:34:59.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T11:34:59.075 INFO:tasks.ceph.mon.b:Started 2023-10-09T11:34:59.075 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T11:34:59.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T11:34:59.077 INFO:tasks.ceph.mon.c:Started 2023-10-09T11:34:59.078 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T11:34:59.078 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T11:34:59.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T11:34:59.080 INFO:tasks.ceph.mgr.y:Started 2023-10-09T11:34:59.080 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T11:34:59.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T11:34:59.082 INFO:tasks.ceph.mgr.x:Started 2023-10-09T11:34:59.082 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T11:34:59.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T11:34:59.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.202+0000 7fcbc4b05700 1 Processor -- start 2023-10-09T11:34:59.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.202+0000 7fcbc4b05700 1 -- start start 2023-10-09T11:34:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbc4b05700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcbc00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbc4b05700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00c32a0 con 0x7fcbc0157930 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbc4b05700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00c4100 con 0x7fcbc00ccba0 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbc4b05700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c9730 con 0x7fcbc00ca2c0 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbe59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcbc0157930 0x7fcbc00ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42204/0 (socket says 172.21.15.26:42204) 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbe59c700 1 -- 172.21.15.26:0/2389611808 learned_addr learned my addr 172.21.15.26:0/2389611808 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcbc00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbdd9b700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 msgr2=0x7fcbc00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T11:34:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbdd9b700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 msgr2=0x7fcbc00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T11:34:59.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcbc00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T11:34:59.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.203+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcbc00ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:34:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.368+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639968069 0 0) 0x7fcbc00c32a0 con 0x7fcbc0157930 2023-10-09T11:34:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.368+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba8003570 con 0x7fcbc0157930 2023-10-09T11:34:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763943902 0 0) 0x7fcbc00c4100 con 0x7fcbc00ccba0 2023-10-09T11:34:59.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc00c32a0 con 0x7fcbc00ccba0 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255010951 0 0) 0x7fcba8003570 con 0x7fcbc0157930 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 msgr2=0x7fcbc00ca730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcbc00ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 >> v1:172.21.15.67:6789/0 conn(0x7fcbc00ccba0 legacy=0x7fcbc00c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00c34f0 con 0x7fcbc0157930 2023-10-09T11:34:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fcbb00017f0 con 0x7fcbc0157930 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 >> v1:172.21.15.26:6789/0 conn(0x7fcbc0157930 legacy=0x7fcbc00ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8003c20 0x7fcba8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcba8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcba8004da0 0x7fcba8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c9730 con 0x7fcba8004da0 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba800bbf0 con 0x7fcba8003c20 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.369+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba800bdb0 con 0x7fcbc00ca2c0 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbe59c700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8003c20 0x7fcba8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcba8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcba8004da0 0x7fcba8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 msgr2=0x7fcba8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc00ca2c0 0x7fcba8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8003c20 msgr2=0x7fcba8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8003c20 0x7fcba8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 -- 172.21.15.26:0/2389611808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8003570 con 0x7fcba8004da0 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbed9d700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcba8004da0 0x7fcba8005210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001a10 tx=0x7fcbb8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9ac7cc82fe364a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800c5d0 con 0x7fcba8004da0 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb800c730 con 0x7fcba8004da0 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.370+0000 7fcbbd59a700 1 -- 172.21.15.26:0/2389611808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800cad0 con 0x7fcba8004da0 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 -- 172.21.15.26:0/2389611808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcba8004da0 msgr2=0x7fcba8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 --2- 172.21.15.26:0/2389611808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcba8004da0 0x7fcba8005210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001a10 tx=0x7fcbb8007d30 comp rx=0 tx=0).stop 2023-10-09T11:34:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbbed9d700 1 -- 172.21.15.26:0/2389611808 reap_dead start 2023-10-09T11:34:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 -- 172.21.15.26:0/2389611808 shutdown_connections 2023-10-09T11:34:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 -- 172.21.15.26:0/2389611808 >> 172.21.15.26:0/2389611808 conn(0x7fcbc0088000 msgr2=0x7fcbc00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:34:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 -- 172.21.15.26:0/2389611808 shutdown_connections 2023-10-09T11:34:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.371+0000 7fcbc4b05700 1 -- 172.21.15.26:0/2389611808 wait complete. 2023-10-09T11:34:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 Processor -- start 2023-10-09T11:34:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 -- start start 2023-10-09T11:34:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 0x7fcbc0152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 0x7fcbc01549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc006f5f0 0x7fcbc0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c7890 con 0x7fcbc006f180 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b12a0 con 0x7fcba8004da0 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.373+0000 7fcbc4b05700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c7b00 con 0x7fcbc006f5f0 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 0x7fcbc0152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 0x7fcbc0152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:56070/0 (socket says 172.21.15.26:56070) 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbe59c700 1 -- 172.21.15.26:0/1274929338 learned_addr learned my addr 172.21.15.26:0/1274929338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 0x7fcbc01549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbed9d700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc006f5f0 0x7fcbc0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 -- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc006f5f0 msgr2=0x7fcbc0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc006f5f0 0x7fcbc0154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 -- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 msgr2=0x7fcbc0152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 0x7fcbc0152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 -- 172.21.15.26:0/1274929338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00c7de0 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.374+0000 7fcbbdd9b700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 0x7fcbc01549d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4010aa0 tx=0x7fcbb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.375+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4010e80 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.375+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400e8d0 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.375+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400ec90 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.375+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00c80c0 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.376+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc006d850 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.376+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcbb4016690 con 0x7fcbc006f180 2023-10-09T11:34:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.376+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcbb4014780 con 0x7fcbc006f180 2023-10-09T11:34:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.377+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc004c3c0 con 0x7fcbc006f180 2023-10-09T11:34:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.380+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcbb403e6d0 con 0x7fcbc006f180 2023-10-09T11:34:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.456+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcbc00cb2f0 con 0x7fcbc006f180 2023-10-09T11:34:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.458+0000 7fcbae7fc700 1 -- 172.21.15.26:0/1274929338 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcbb402d020 con 0x7fcbc006f180 2023-10-09T11:34:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 msgr2=0x7fcbc01549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 0x7fcbc01549d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4010aa0 tx=0x7fcbb4008040 comp rx=0 tx=0).stop 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 shutdown_connections 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbc006f5f0 0x7fcbc0154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcba8004da0 0x7fcbc0152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 --2- 172.21.15.26:0/1274929338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc006f180 0x7fcbc01549d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.459+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 >> 172.21.15.26:0/1274929338 conn(0x7fcbc0088000 msgr2=0x7fcbc00cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:34:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.460+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 shutdown_connections 2023-10-09T11:34:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:34:59.460+0000 7fcbc4b05700 1 -- 172.21.15.26:0/1274929338 wait complete. 2023-10-09T11:34:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-10-09T11:34:59.472 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T11:34:59.472 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:59.472 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T11:34:59.497 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:59.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T11:34:59.562 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:59.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T11:34:59.630 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-09T11:34:59.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T11:34:59.695 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:59.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T11:34:59.720 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:59.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T11:34:59.786 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:59.786 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T11:34:59.851 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-09T11:34:59.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T11:34:59.917 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 70c62846-a727-4140-9249-74d6d1fbcf4c 0 2023-10-09T11:35:00.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.074+0000 7f01e158c700 1 Processor -- start 2023-10-09T11:35:00.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.074+0000 7f01e158c700 1 -- start start 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01e158c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01dc0c8ee0 0x7f01dc159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01e158c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0c71a0 con 0x7f01dc06f060 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01e158c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0c7a40 con 0x7f01dc1597e0 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01e158c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc06d3d0 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01daffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f01dc1597e0 0x7f01dc06e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40996/0 (socket says 172.21.15.67:40996) 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01daffd700 1 -- 172.21.15.67:0/1686600448 learned_addr learned my addr 172.21.15.67:0/1686600448 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01db7fe700 1 --2- 172.21.15.67:0/1686600448 >> v2:172.21.15.26:3300/0 conn(0x7f01dc0c8ee0 0x7f01dc159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236946515 0 0) 0x7f01dc0c7a40 con 0x7f01dc1597e0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c4003570 con 0x7f01dc1597e0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123843309 0 0) 0x7f01dc0c71a0 con 0x7f01dc06f060 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc0c7a40 con 0x7f01dc06f060 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01db7fe700 1 -- 172.21.15.67:0/1686600448 >> v1:172.21.15.67:6789/0 conn(0x7f01dc1597e0 legacy=0x7f01dc06e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01db7fe700 1 -- 172.21.15.67:0/1686600448 >> v1:172.21.15.26:6789/0 conn(0x7f01dc06f060 legacy=0x7f01dc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.075+0000 7f01db7fe700 1 -- 172.21.15.67:0/1686600448 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0c73f0 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01db7fe700 1 --2- 172.21.15.67:0/1686600448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc159bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009e60 tx=0x7f01d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cf01324573eb9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400e070 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d400bab0 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01d9ffb700 1 -- 172.21.15.67:0/1686600448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400be70 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01e158c700 1 -- 172.21.15.67:0/1686600448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 msgr2=0x7f01dc159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01e158c700 1 --2- 172.21.15.67:0/1686600448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc159bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009e60 tx=0x7f01d4009780 comp rx=0 tx=0).stop 2023-10-09T11:35:00.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01e158c700 1 -- 172.21.15.67:0/1686600448 shutdown_connections 2023-10-09T11:35:00.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.076+0000 7f01e158c700 1 --2- 172.21.15.67:0/1686600448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc159bb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.077+0000 7f01e158c700 1 -- 172.21.15.67:0/1686600448 >> 172.21.15.67:0/1686600448 conn(0x7f01dc0ccb60 msgr2=0x7f01dc0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.077+0000 7f01e158c700 1 -- 172.21.15.67:0/1686600448 shutdown_connections 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.077+0000 7f01e158c700 1 -- 172.21.15.67:0/1686600448 wait complete. 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.078+0000 7f01e158c700 1 Processor -- start 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.078+0000 7f01e158c700 1 -- start start 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 0x7f01dc0c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1433b0 con 0x7f01dc0c8ee0 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0afd40 con 0x7f01dc1597e0 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0b0020 con 0x7f01dc06f060 2023-10-09T11:35:00.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01daffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 0x7f01dc0c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01daffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43752/0 (socket says 172.21.15.67:43752) 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01daffd700 1 -- 172.21.15.67:0/2367565384 learned_addr learned my addr 172.21.15.67:0/2367565384 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01da7fc700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 -- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 msgr2=0x7f01dc156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 -- 172.21.15.67:0/2367565384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 msgr2=0x7f01dc0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc0c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 -- 172.21.15.67:0/2367565384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009a20 con 0x7f01dc1597e0 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01daffd700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01da7fc700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01db7fe700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 0x7f01dc0c5880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01d4016000 tx=0x7f01d4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4012db0 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d4025430 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40257f0 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.079+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc0b0300 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.080+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc0b0940 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.080+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f01d4025b60 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.080+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f01d401ca20 con 0x7f01dc1597e0 2023-10-09T11:35:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.080+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc04c3c0 con 0x7f01dc1597e0 2023-10-09T11:35:00.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.084+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f01d40446d0 con 0x7f01dc1597e0 2023-10-09T11:35:00.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.168+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70c62846-a727-4140-9249-74d6d1fbcf4c", "id": 0} v 0) v1 -- 0x7f01dc157040 con 0x7f01dc1597e0 2023-10-09T11:35:00.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.172+0000 7f01c2ffd700 1 -- 172.21.15.67:0/2367565384 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70c62846-a727-4140-9249-74d6d1fbcf4c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01d4033030 con 0x7f01dc1597e0 2023-10-09T11:35:00.173 INFO:teuthology.orchestra.run.smithi067.stdout:0 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 msgr2=0x7f01dc0c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 0x7f01dc0c5880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01d4016000 tx=0x7f01d4019000 comp rx=0 tx=0).stop 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 shutdown_connections 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc1597e0 0x7f01dc0c5880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01dc06f060 0x7f01dc156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 --2- 172.21.15.67:0/2367565384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01dc0c8ee0 0x7f01dc0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 >> 172.21.15.67:0/2367565384 conn(0x7f01dc0ccb60 msgr2=0x7f01dc0cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 shutdown_connections 2023-10-09T11:35:00.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.173+0000 7f01e158c700 1 -- 172.21.15.67:0/2367565384 wait complete. 2023-10-09T11:35:00.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 945aece4-746d-41e2-9a58-bb9cd9a39c7b 1 2023-10-09T11:35:00.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.302+0000 7f4a92763700 1 Processor -- start 2023-10-09T11:35:00.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.302+0000 7f4a92763700 1 -- start start 2023-10-09T11:35:00.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a92763700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a8c159530 0x7f4a8c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a92763700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8c0ccfd0 con 0x7f4a8c06dc70 2023-10-09T11:35:00.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a92763700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8c0cf0e0 con 0x7f4a8c06e0e0 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a92763700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8c15a3d0 con 0x7f4a8c159530 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a8c159530 0x7f4a8c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a90d00700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4a8c06e0e0 0x7f4a8c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43326/0 (socket says 172.21.15.67:43326) 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a8c159530 0x7f4a8c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54132/0 (socket says 172.21.15.67:54132) 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a90d00700 1 -- 172.21.15.67:0/2510483786 learned_addr learned my addr 172.21.15.67:0/2510483786 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8bfff700 1 -- 172.21.15.67:0/2510483786 >> v1:172.21.15.67:6789/0 conn(0x7f4a8c06e0e0 legacy=0x7f4a8c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8bfff700 1 -- 172.21.15.67:0/2510483786 >> v1:172.21.15.26:6789/0 conn(0x7f4a8c06dc70 legacy=0x7f4a8c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8bfff700 1 -- 172.21.15.67:0/2510483786 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c15a6b0 con 0x7f4a8c159530 2023-10-09T11:35:00.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.303+0000 7f4a8affd700 1 -- 172.21.15.67:0/2510483786 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182967505 0 0) 0x7f4a8c0ccfd0 con 0x7f4a8c06dc70 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a8bfff700 1 --2- 172.21.15.67:0/2510483786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c0ceba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a800098e0 tx=0x7f4a800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8162635cc25c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a8affd700 1 -- 172.21.15.67:0/2510483786 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80009e80 con 0x7f4a8c159530 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a8affd700 1 -- 172.21.15.67:0/2510483786 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8000b860 con 0x7f4a8c159530 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a8affd700 1 -- 172.21.15.67:0/2510483786 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000bbe0 con 0x7f4a8c159530 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 -- 172.21.15.67:0/2510483786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 msgr2=0x7f4a8c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 --2- 172.21.15.67:0/2510483786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c0ceba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a800098e0 tx=0x7f4a800091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 -- 172.21.15.67:0/2510483786 shutdown_connections 2023-10-09T11:35:00.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 --2- 172.21.15.67:0/2510483786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c0ceba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 -- 172.21.15.67:0/2510483786 >> 172.21.15.67:0/2510483786 conn(0x7f4a8c0703a0 msgr2=0x7f4a8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 -- 172.21.15.67:0/2510483786 shutdown_connections 2023-10-09T11:35:00.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.304+0000 7f4a92763700 1 -- 172.21.15.67:0/2510483786 wait complete. 2023-10-09T11:35:00.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.305+0000 7f4a92763700 1 Processor -- start 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 -- start start 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 0x7f4a8c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a8c06e0e0 0x7f4a8c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c16dfa0 con 0x7f4a8c06e0e0 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c16d670 con 0x7f4a8c159530 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a92763700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c16d950 con 0x7f4a8c06dc70 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.306+0000 7f4a90d00700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a8bfff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 0x7f4a8c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54134/0 (socket says 172.21.15.67:54134) 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 -- 172.21.15.67:0/1544300344 learned_addr learned my addr 172.21.15.67:0/1544300344 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a8b7fe700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a8c06e0e0 0x7f4a8c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 -- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 msgr2=0x7f4a8c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 0x7f4a8c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 -- 172.21.15.67:0/1544300344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a8c06e0e0 msgr2=0x7f4a8c15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a8c06e0e0 0x7f4a8c15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 -- 172.21.15.67:0/1544300344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80009420 con 0x7f4a8c159530 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a8bfff700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 0x7f4a8c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a90d00700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400cc40 tx=0x7f4a84001a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400a8b0 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8400aa10 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c16dc30 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400add0 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c16a3d0 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4a84007300 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.307+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f4a8401b7c0 con 0x7f4a8c159530 2023-10-09T11:35:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.308+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c04c3c0 con 0x7f4a8c159530 2023-10-09T11:35:00.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.310+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4a84007740 con 0x7f4a8c159530 2023-10-09T11:35:00.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.396+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "945aece4-746d-41e2-9a58-bb9cd9a39c7b", "id": 1} v 0) v1 -- 0x7f4a8c15a990 con 0x7f4a8c159530 2023-10-09T11:35:00.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a73fff700 1 -- 172.21.15.67:0/1544300344 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "945aece4-746d-41e2-9a58-bb9cd9a39c7b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a840078e0 con 0x7f4a8c159530 2023-10-09T11:35:00.400 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 msgr2=0x7f4a8c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400cc40 tx=0x7f4a84001a50 comp rx=0 tx=0).stop 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 shutdown_connections 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a8c159530 0x7f4a8c15c8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a8c06dc70 0x7f4a8c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 --2- 172.21.15.67:0/1544300344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a8c06e0e0 0x7f4a8c15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.399+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 >> 172.21.15.67:0/1544300344 conn(0x7f4a8c0703a0 msgr2=0x7f4a8c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.400+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 shutdown_connections 2023-10-09T11:35:00.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.400+0000 7f4a92763700 1 -- 172.21.15.67:0/1544300344 wait complete. 2023-10-09T11:35:00.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 42631142-8153-4679-8c4d-20c0d6370326 2 2023-10-09T11:35:00.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.530+0000 7fd84208e700 1 Processor -- start 2023-10-09T11:35:00.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.530+0000 7fd84208e700 1 -- start start 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd84208e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd83c159530 0x7fd83c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd84208e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0ccfd0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd84208e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0cf0e0 con 0x7fd83c06dc70 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd84208e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c15a3d0 con 0x7fd83c159530 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83affd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd83c06dc70 0x7fd83c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43340/0 (socket says 172.21.15.67:43340) 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83affd700 1 -- 172.21.15.67:0/3745921877 learned_addr learned my addr 172.21.15.67:0/3745921877 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-09T11:35:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83b7fe700 1 --2- 172.21.15.67:0/3745921877 >> v2:172.21.15.26:3300/0 conn(0x7fd83c159530 0x7fd83c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166004761 0 0) 0x7fd83c0cf0e0 con 0x7fd83c06dc70 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd824003570 con 0x7fd83c06dc70 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029916837 0 0) 0x7fd83c0ccfd0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd83c0cf0e0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83b7fe700 1 -- 172.21.15.67:0/3745921877 >> v1:172.21.15.67:6789/0 conn(0x7fd83c06dc70 legacy=0x7fd83c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83b7fe700 1 -- 172.21.15.67:0/3745921877 >> v1:172.21.15.26:6789/0 conn(0x7fd83c06e0e0 legacy=0x7fd83c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.531+0000 7fd83b7fe700 1 -- 172.21.15.67:0/3745921877 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c15a6b0 con 0x7fd83c159530 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.532+0000 7fd83b7fe700 1 --2- 172.21.15.67:0/3745921877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c159530 0x7fd83c0ceba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c9843a8cea7d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.532+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011630 con 0x7fd83c159530 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.532+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c011790 con 0x7fd83c159530 2023-10-09T11:35:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.532+0000 7fd83a7fc700 1 -- 172.21.15.67:0/3745921877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011b30 con 0x7fd83c159530 2023-10-09T11:35:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 -- 172.21.15.67:0/3745921877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c159530 msgr2=0x7fd83c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 --2- 172.21.15.67:0/3745921877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c159530 0x7fd83c0ceba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 -- 172.21.15.67:0/3745921877 shutdown_connections 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 --2- 172.21.15.67:0/3745921877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c159530 0x7fd83c0ceba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 -- 172.21.15.67:0/3745921877 >> 172.21.15.67:0/3745921877 conn(0x7fd83c0703a0 msgr2=0x7fd83c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 -- 172.21.15.67:0/3745921877 shutdown_connections 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.533+0000 7fd84208e700 1 -- 172.21.15.67:0/3745921877 wait complete. 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.534+0000 7fd84208e700 1 Processor -- start 2023-10-09T11:35:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.534+0000 7fd84208e700 1 -- start start 2023-10-09T11:35:00.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 0x7fd83c14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 0x7fd83c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c14e820 con 0x7fd83c06dc70 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0b1810 con 0x7fd83c06e0e0 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd84208e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0c8a30 con 0x7fd83c159530 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83bfff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 0x7fd83c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54136/0 (socket says 172.21.15.67:54136) 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 -- 172.21.15.67:0/3218587013 learned_addr learned my addr 172.21.15.67:0/3218587013 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83b7fe700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 0x7fd83c14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 -- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 msgr2=0x7fd83c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 0x7fd83c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 -- 172.21.15.67:0/3218587013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 msgr2=0x7fd83c14e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 0x7fd83c14e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 -- 172.21.15.67:0/3218587013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009420 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83b7fe700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 0x7fd83c14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83bfff700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 0x7fd83c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.535+0000 7fd83affd700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c790 tx=0x7fd830007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005b30 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830005cd0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0ca3e0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830007320 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0b0ee0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd83001c6c0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.536+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fd830005e40 con 0x7fd83c06e0e0 2023-10-09T11:35:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.537+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0b1980 con 0x7fd83c06e0e0 2023-10-09T11:35:00.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.539+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd830021060 con 0x7fd83c06e0e0 2023-10-09T11:35:00.582 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:00.581+0000 7fbc4fca6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:35:00.586 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:00.585+0000 7f4947903180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:35:00.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.623+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42631142-8153-4679-8c4d-20c0d6370326", "id": 2} v 0) v1 -- 0x7fd83c15a990 con 0x7fd83c06e0e0 2023-10-09T11:35:00.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd8237fe700 1 -- 172.21.15.67:0/3218587013 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42631142-8153-4679-8c4d-20c0d6370326", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd83002a0b0 con 0x7fd83c06e0e0 2023-10-09T11:35:00.627 INFO:teuthology.orchestra.run.smithi067.stdout:2 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 msgr2=0x7fd83c0c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c790 tx=0x7fd830007e80 comp rx=0 tx=0).stop 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 shutdown_connections 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd83c159530 0x7fd83c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd83c06dc70 0x7fd83c14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.626+0000 7fd84208e700 1 --2- 172.21.15.67:0/3218587013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c06e0e0 0x7fd83c0c84f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.627+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 >> 172.21.15.67:0/3218587013 conn(0x7fd83c0703a0 msgr2=0x7fd83c15ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.627+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 shutdown_connections 2023-10-09T11:35:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.627+0000 7fd84208e700 1 -- 172.21.15.67:0/3218587013 wait complete. 2023-10-09T11:35:00.639 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new cceea557-fc4b-4629-982a-78161536c447 3 2023-10-09T11:35:00.721 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:00.720+0000 7fbc4fca6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:00.726 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:00.726+0000 7f4947903180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.756+0000 7ff18d4ee700 1 Processor -- start 2023-10-09T11:35:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.756+0000 7ff18d4ee700 1 -- start start 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff18d4ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff18d4ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1880c32a0 con 0x7ff188157930 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff18d4ee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1880c4100 con 0x7ff1880ccba0 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff18d4ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880c9730 con 0x7ff1880ca2c0 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff1867fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff1877fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff1880ccba0 0x7ff1880c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43354/0 (socket says 172.21.15.67:43354) 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff1877fe700 1 -- 172.21.15.67:0/2393144680 learned_addr learned my addr 172.21.15.67:0/2393144680 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff185ffb700 1 -- 172.21.15.67:0/2393144680 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940035148 0 0) 0x7ff1880c4100 con 0x7ff1880ccba0 2023-10-09T11:35:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff1867fc700 1 -- 172.21.15.67:0/2393144680 >> v1:172.21.15.67:6789/0 conn(0x7ff1880ccba0 legacy=0x7ff1880c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.757+0000 7ff1867fc700 1 -- 172.21.15.67:0/2393144680 >> v1:172.21.15.26:6789/0 conn(0x7ff188157930 legacy=0x7ff1880ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff1867fc700 1 -- 172.21.15.67:0/2393144680 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880c34f0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff1867fc700 1 --2- 172.21.15.67:0/2393144680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ca730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff178009910 tx=0x7ff1780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15e54024a44f779 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff185ffb700 1 -- 172.21.15.67:0/2393144680 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800b860 con 0x7ff1880ca2c0 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff185ffb700 1 -- 172.21.15.67:0/2393144680 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17800b9c0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff185ffb700 1 -- 172.21.15.67:0/2393144680 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800bd60 con 0x7ff1880ca2c0 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 -- 172.21.15.67:0/2393144680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 msgr2=0x7ff1880ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/2393144680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ca730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff178009910 tx=0x7ff1780091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 -- 172.21.15.67:0/2393144680 shutdown_connections 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/2393144680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ca730 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 -- 172.21.15.67:0/2393144680 >> 172.21.15.67:0/2393144680 conn(0x7ff188088000 msgr2=0x7ff1880883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 -- 172.21.15.67:0/2393144680 shutdown_connections 2023-10-09T11:35:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.758+0000 7ff18d4ee700 1 -- 172.21.15.67:0/2393144680 wait complete. 2023-10-09T11:35:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 Processor -- start 2023-10-09T11:35:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 -- start start 2023-10-09T11:35:00.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1880ccba0 0x7ff188151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff188157930 0x7ff188068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880ac1e0 con 0x7ff1880ccba0 2023-10-09T11:35:00.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880ad7c0 con 0x7ff188157930 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.760+0000 7ff18d4ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881521d0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:50980/0 (socket says 172.21.15.67:50980) 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 -- 172.21.15.67:0/1029759312 learned_addr learned my addr 172.21.15.67:0/1029759312 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff1877fe700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff188157930 0x7ff188068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff1867fc700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1880ccba0 0x7ff188151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 -- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff188157930 msgr2=0x7ff188068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff188157930 0x7ff188068df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 -- 172.21.15.67:0/1029759312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1880ccba0 msgr2=0x7ff188151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1880ccba0 0x7ff188151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 -- 172.21.15.67:0/1029759312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178009420 con 0x7ff1880ca2c0 2023-10-09T11:35:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff186ffd700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c4e0 tx=0x7ff17c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011590 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c011710 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1880ada20 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011ad0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1880ab8b0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.761+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff17c01c6c0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.762+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7ff17c012420 con 0x7ff1880ca2c0 2023-10-09T11:35:00.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.762+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1880ac4c0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.764+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff17c017070 con 0x7ff1880ca2c0 2023-10-09T11:35:00.800 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:00.800+0000 7fbc4fca6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:35:00.807 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:00.806+0000 7f4947903180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:35:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.849+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cceea557-fc4b-4629-982a-78161536c447", "id": 3} v 0) v1 -- 0x7ff18804c3c0 con 0x7ff1880ca2c0 2023-10-09T11:35:00.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.852+0000 7ff16effd700 1 -- 172.21.15.67:0/1029759312 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cceea557-fc4b-4629-982a-78161536c447", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff17c01c970 con 0x7ff1880ca2c0 2023-10-09T11:35:00.854 INFO:teuthology.orchestra.run.smithi067.stdout:3 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 msgr2=0x7ff1880ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c4e0 tx=0x7ff17c00c7f0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 shutdown_connections 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff188157930 0x7ff188068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1880ca2c0 0x7ff1880ad280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 --2- 172.21.15.67:0/1029759312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1880ccba0 0x7ff188151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 >> 172.21.15.67:0/1029759312 conn(0x7ff188088000 msgr2=0x7ff188155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 shutdown_connections 2023-10-09T11:35:00.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.853+0000 7ff18d4ee700 1 -- 172.21.15.67:0/1029759312 wait complete. 2023-10-09T11:35:00.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 6e560165-3cb4-41d7-8593-96eaee1c3ebf 4 2023-10-09T11:35:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.984+0000 7f76642fe700 1 Processor -- start 2023-10-09T11:35:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.984+0000 7f76642fe700 1 -- start start 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f76642fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f76642fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f765c06dc70 0x7f765c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f76642fe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0ccfd0 con 0x7f765c06e0e0 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f76642fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0cf0e0 con 0x7f765c06dc70 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f76642fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c15a3d0 con 0x7f765c159530 2023-10-09T11:35:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:50984/0 (socket says 172.21.15.67:50984) 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 -- 172.21.15.67:0/2010120443 learned_addr learned my addr 172.21.15.67:0/2010120443 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f7661899700 1 --2- 172.21.15.67:0/2010120443 >> v2:172.21.15.26:3300/0 conn(0x7f765c06dc70 0x7f765c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 -- 172.21.15.67:0/2010120443 >> v2:172.21.15.26:3300/0 conn(0x7f765c06dc70 msgr2=0x7f765c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 --2- 172.21.15.67:0/2010120443 >> v2:172.21.15.26:3300/0 conn(0x7f765c06dc70 0x7f765c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 -- 172.21.15.67:0/2010120443 >> v1:172.21.15.26:6789/0 conn(0x7f765c06e0e0 legacy=0x7f765c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 -- 172.21.15.67:0/2010120443 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c15a6b0 con 0x7f765c159530 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f766209a700 1 --2- 172.21.15.67:0/2010120443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76580099b0 tx=0x7f7658009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf4e703e7033814 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f7661098700 1 -- 172.21.15.67:0/2010120443 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658009ea0 con 0x7f765c159530 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f7661098700 1 -- 172.21.15.67:0/2010120443 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800b860 con 0x7f765c159530 2023-10-09T11:35:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.985+0000 7f7661098700 1 -- 172.21.15.67:0/2010120443 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800bc00 con 0x7f765c159530 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 -- 172.21.15.67:0/2010120443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 msgr2=0x7f765c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 --2- 172.21.15.67:0/2010120443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76580099b0 tx=0x7f7658009250 comp rx=0 tx=0).stop 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 -- 172.21.15.67:0/2010120443 shutdown_connections 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 --2- 172.21.15.67:0/2010120443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c159530 0x7f765c0ceba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 --2- 172.21.15.67:0/2010120443 >> v2:172.21.15.26:3300/0 conn(0x7f765c06dc70 0x7f765c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 -- 172.21.15.67:0/2010120443 >> 172.21.15.67:0/2010120443 conn(0x7f765c0703a0 msgr2=0x7f765c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 -- 172.21.15.67:0/2010120443 shutdown_connections 2023-10-09T11:35:00.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.986+0000 7f76642fe700 1 -- 172.21.15.67:0/2010120443 wait complete. 2023-10-09T11:35:00.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.987+0000 7f76642fe700 1 Processor -- start 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.987+0000 7f76642fe700 1 -- start start 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 0x7f765c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 0x7f765c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c156b50 con 0x7f765c06dc70 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c154320 con 0x7f765c159530 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f76642fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c155f40 con 0x7f765c06e0e0 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f7661899700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 0x7f765c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f7661899700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:50988/0 (socket says 172.21.15.67:50988) 2023-10-09T11:35:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f7661899700 1 -- 172.21.15.67:0/3590977877 learned_addr learned my addr 172.21.15.67:0/3590977877 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766209a700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 0x7f765c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 -- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 msgr2=0x7f765c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 -- 172.21.15.67:0/3590977877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 msgr2=0x7f765c153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 0x7f765c153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766289b700 1 -- 172.21.15.67:0/3590977877 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580094f0 con 0x7f765c159530 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f7661899700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.988+0000 7f766209a700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 0x7f765c153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f766289b700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 0x7f765c0cb9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f765c0cacd0 tx=0x7f7654001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654012630 con 0x7f765c159530 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654012790 con 0x7f765c159530 2023-10-09T11:35:00.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c156220 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654012b50 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.989+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c1567e0 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.990+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f765401b400 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.990+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f7654011890 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.990+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c156cc0 con 0x7f765c159530 2023-10-09T11:35:00.994 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:00.992+0000 7fbc4fca6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:00.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:00.992+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f765401b840 con 0x7f765c159530 2023-10-09T11:35:01.004 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:01.003+0000 7f4947903180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:01.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.076+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e560165-3cb4-41d7-8593-96eaee1c3ebf", "id": 4} v 0) v1 -- 0x7f765c04c3c0 con 0x7f765c159530 2023-10-09T11:35:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.079+0000 7f76527fc700 1 -- 172.21.15.67:0/3590977877 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e560165-3cb4-41d7-8593-96eaee1c3ebf", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f765401b9e0 con 0x7f765c159530 2023-10-09T11:35:01.080 INFO:teuthology.orchestra.run.smithi067.stdout:4 2023-10-09T11:35:01.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 msgr2=0x7f765c0cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 0x7f765c0cb9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f765c0cacd0 tx=0x7f7654001690 comp rx=0 tx=0).stop 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 shutdown_connections 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c159530 0x7f765c0cb9f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c06dc70 0x7f765c153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 --2- 172.21.15.67:0/3590977877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c06e0e0 0x7f765c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 >> 172.21.15.67:0/3590977877 conn(0x7f765c0703a0 msgr2=0x7f765c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 shutdown_connections 2023-10-09T11:35:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.080+0000 7f76642fe700 1 -- 172.21.15.67:0/3590977877 wait complete. 2023-10-09T11:35:01.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61 5 2023-10-09T11:35:01.174 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:01.174+0000 7fbc4fca6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:35:01.187 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:01.186+0000 7f4947903180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:35:01.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.210+0000 7f3705080700 1 Processor -- start 2023-10-09T11:35:01.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.210+0000 7f3705080700 1 -- start start 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f3705080700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3700153dd0 0x7f370015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f3705080700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 0x7f37000ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f3705080700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370015ac50 con 0x7f3700153a00 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f3705080700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370015d010 con 0x7f3700153dd0 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f3705080700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000cf3e0 con 0x7f37000cea00 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3700153dd0 0x7f370015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f370487f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 0x7f37000ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3700153dd0 0x7f370015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54180/0 (socket says 172.21.15.67:54180) 2023-10-09T11:35:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 -- 172.21.15.67:0/1755742921 learned_addr learned my addr 172.21.15.67:0/1755742921 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 -- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 msgr2=0x7f37000ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 0x7f37000ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 -- 172.21.15.67:0/1755742921 >> v1:172.21.15.67:6789/0 conn(0x7f3700153a00 legacy=0x7f370015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36feffd700 1 -- 172.21.15.67:0/1755742921 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836355518 0 0) 0x7f370015ac50 con 0x7f3700153a00 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.211+0000 7f36ff7fe700 1 -- 172.21.15.67:0/1755742921 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370015af60 con 0x7f3700153dd0 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f370487f700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 0x7f37000ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f36ff7fe700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3700153dd0 0x7f370015de50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f36e80099b0 tx=0x7f36e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f107b3f0a0cf4e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f36feffd700 1 -- 172.21.15.67:0/1755742921 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8009ea0 con 0x7f3700153dd0 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f36feffd700 1 -- 172.21.15.67:0/1755742921 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800b860 con 0x7f3700153dd0 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f36feffd700 1 -- 172.21.15.67:0/1755742921 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800bc00 con 0x7f3700153dd0 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 -- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3700153dd0 msgr2=0x7f370015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3700153dd0 0x7f370015de50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f36e80099b0 tx=0x7f36e8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 -- 172.21.15.67:0/1755742921 shutdown_connections 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37000cea00 0x7f37000ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 --2- 172.21.15.67:0/1755742921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3700153dd0 0x7f370015de50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.212+0000 7f3705080700 1 -- 172.21.15.67:0/1755742921 >> 172.21.15.67:0/1755742921 conn(0x7f37000703a0 msgr2=0x7f37000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.213+0000 7f3705080700 1 -- 172.21.15.67:0/1755742921 shutdown_connections 2023-10-09T11:35:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.213+0000 7f3705080700 1 -- 172.21.15.67:0/1755742921 wait complete. 2023-10-09T11:35:01.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 Processor -- start 2023-10-09T11:35:01.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 -- start start 2023-10-09T11:35:01.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3700153a00 0x7f3700145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 0x7f3700169820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000c75e0 con 0x7f3700153a00 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370016a290 con 0x7f37000cea00 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.214+0000 7f3705080700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370016a570 con 0x7f3700153dd0 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f370487f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 0x7f3700169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54190/0 (socket says 172.21.15.67:54190) 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 -- 172.21.15.67:0/2581694599 learned_addr learned my addr 172.21.15.67:0/2581694599 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36ff7fe700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3700153a00 0x7f3700145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 -- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 msgr2=0x7f3700169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 0x7f3700169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 -- 172.21.15.67:0/2581694599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3700153a00 msgr2=0x7f3700145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3700153a00 0x7f3700145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 -- 172.21.15.67:0/2581694599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009a20 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f370487f700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 0x7f3700169820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36fffff700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7e0 tx=0x7f36f0007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0011590 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0011710 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80094f0 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0011ad0 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37000c77f0 con 0x7f37000cea00 2023-10-09T11:35:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.215+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f36f001c6c0 con 0x7f37000cea00 2023-10-09T11:35:01.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.216+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f36f0011e40 con 0x7f37000cea00 2023-10-09T11:35:01.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.216+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37000c7a10 con 0x7f37000cea00 2023-10-09T11:35:01.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.218+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f36f0017070 con 0x7f37000cea00 2023-10-09T11:35:01.255 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:01.255+0000 7fbc4fca6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:35:01.269 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:01.268+0000 7f4947903180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:35:01.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.304+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61", "id": 5} v 0) v1 -- 0x7f370004c3c0 con 0x7f37000cea00 2023-10-09T11:35:01.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.307+0000 7f36f7fff700 1 -- 172.21.15.67:0/2581694599 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36f001cb00 con 0x7f37000cea00 2023-10-09T11:35:01.308 INFO:teuthology.orchestra.run.smithi067.stdout:5 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 msgr2=0x7f370016ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7e0 tx=0x7f36f0007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 shutdown_connections 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3700153dd0 0x7f3700169820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37000cea00 0x7f370016ace0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 --2- 172.21.15.67:0/2581694599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3700153a00 0x7f3700145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 >> 172.21.15.67:0/2581694599 conn(0x7f37000703a0 msgr2=0x7f370015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 shutdown_connections 2023-10-09T11:35:01.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.308+0000 7f3705080700 1 -- 172.21.15.67:0/2581694599 wait complete. 2023-10-09T11:35:01.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new b359f877-48d3-43a3-9727-de1b4d331ce9 6 2023-10-09T11:35:01.402 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:01.402+0000 7fbc4fca6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:35:01.412 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:01.411+0000 7f4947903180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:35:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.439+0000 7fbf53b45700 1 Processor -- start 2023-10-09T11:35:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.440+0000 7fbf53b45700 1 -- start start 2023-10-09T11:35:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.440+0000 7fbf53b45700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.440+0000 7fbf53b45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf53b45700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c0c32a0 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf53b45700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c9730 con 0x7fbf4c157930 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf53b45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c4100 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf518e1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:51018/0 (socket says 172.21.15.67:51018) 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf518e1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54204/0 (socket says 172.21.15.67:54204) 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 -- 172.21.15.67:0/4009677538 learned_addr learned my addr 172.21.15.67:0/4009677538 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 -- 172.21.15.67:0/4009677538 >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 msgr2=0x7fbf4c0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 --2- 172.21.15.67:0/4009677538 >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 -- 172.21.15.67:0/4009677538 >> v1:172.21.15.67:6789/0 conn(0x7fbf4c0ca2c0 legacy=0x7fbf4c0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 -- 172.21.15.67:0/4009677538 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0c34f0 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf508df700 1 -- 172.21.15.67:0/4009677538 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658710188 0 0) 0x7fbf4c0c32a0 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf518e1700 1 --2- 172.21.15.67:0/4009677538 >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf520e2700 1 --2- 172.21.15.67:0/4009677538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009f20 tx=0x7fbf44009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7bdbbcb3425b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf508df700 1 -- 172.21.15.67:0/4009677538 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400e070 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf508df700 1 -- 172.21.15.67:0/4009677538 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4400b9d0 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.441+0000 7fbf508df700 1 -- 172.21.15.67:0/4009677538 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440092e0 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 -- 172.21.15.67:0/4009677538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 msgr2=0x7fbf4c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 --2- 172.21.15.67:0/4009677538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009f20 tx=0x7fbf44009840 comp rx=0 tx=0).stop 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 -- 172.21.15.67:0/4009677538 shutdown_connections 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 --2- 172.21.15.67:0/4009677538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0ca730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 --2- 172.21.15.67:0/4009677538 >> v2:172.21.15.67:3300/0 conn(0x7fbf4c157930 0x7fbf4c0ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 -- 172.21.15.67:0/4009677538 >> 172.21.15.67:0/4009677538 conn(0x7fbf4c088000 msgr2=0x7fbf4c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 -- 172.21.15.67:0/4009677538 shutdown_connections 2023-10-09T11:35:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.442+0000 7fbf53b45700 1 -- 172.21.15.67:0/4009677538 wait complete. 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.443+0000 7fbf53b45700 1 Processor -- start 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.443+0000 7fbf53b45700 1 -- start start 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 0x7fbf4c154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c8560 con 0x7fbf4c0cd2b0 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c154860 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf53b45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c7fa0 con 0x7fbf4c157930 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54212/0 (socket says 172.21.15.67:54212) 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf520e2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 0x7fbf4c154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 -- 172.21.15.67:0/3098012234 learned_addr learned my addr 172.21.15.67:0/3098012234 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 -- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 msgr2=0x7fbf4c154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 0x7fbf4c154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 -- 172.21.15.67:0/3098012234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf4c0cd2b0 msgr2=0x7fbf4c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 -- 172.21.15.67:0/3098012234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48009420 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf520e2700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 0x7fbf4c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.444+0000 7fbf518e1700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800ec80 tx=0x7fbf480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800c850 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4800c9b0 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44009ae0 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800cd30 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c0b1440 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbf48005c80 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.445+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fbf48013c20 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.446+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c04c3c0 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.448+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbf48021060 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.502 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:01.501+0000 7fbc4fca6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:01.513 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:01.512+0000 7f4947903180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:01.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.532+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b359f877-48d3-43a3-9727-de1b4d331ce9", "id": 6} v 0) v1 -- 0x7fbf4c0cc820 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.538+0000 7fbf41ffb700 1 -- 172.21.15.67:0/3098012234 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b359f877-48d3-43a3-9727-de1b4d331ce9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf48017070 con 0x7fbf4c0ca2c0 2023-10-09T11:35:01.539 INFO:teuthology.orchestra.run.smithi067.stdout:6 2023-10-09T11:35:01.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 msgr2=0x7fbf4c154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800ec80 tx=0x7fbf480091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 shutdown_connections 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf4c157930 0x7fbf4c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf4c0ca2c0 0x7fbf4c154320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 --2- 172.21.15.67:0/3098012234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf4c0cd2b0 0x7fbf4c0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 >> 172.21.15.67:0/3098012234 conn(0x7fbf4c088000 msgr2=0x7fbf4c069390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 shutdown_connections 2023-10-09T11:35:01.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.539+0000 7fbf53b45700 1 -- 172.21.15.67:0/3098012234 wait complete. 2023-10-09T11:35:01.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 48641f8c-deaa-498f-8d8a-f695baf0d5f5 7 2023-10-09T11:35:01.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.669+0000 7f6a71698700 1 Processor -- start 2023-10-09T11:35:01.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.669+0000 7f6a71698700 1 -- start start 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a71698700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a71698700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a6c159c90 0x7f6a6c0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a71698700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0c9310 con 0x7f6a6c0cd460 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a71698700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c0ad990 con 0x7f6a6c159c90 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a71698700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c0ce090 con 0x7f6a6c1598c0 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a6affd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a6affd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54220/0 (socket says 172.21.15.67:54220) 2023-10-09T11:35:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a6affd700 1 -- 172.21.15.67:0/76614257 learned_addr learned my addr 172.21.15.67:0/76614257 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.670+0000 7f6a6a7fc700 1 --2- 172.21.15.67:0/76614257 >> v2:172.21.15.26:3300/0 conn(0x7f6a6c159c90 0x7f6a6c0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a6affd700 1 -- 172.21.15.67:0/76614257 >> v2:172.21.15.26:3300/0 conn(0x7f6a6c159c90 msgr2=0x7f6a6c0c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a6affd700 1 --2- 172.21.15.67:0/76614257 >> v2:172.21.15.26:3300/0 conn(0x7f6a6c159c90 0x7f6a6c0c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a6affd700 1 -- 172.21.15.67:0/76614257 >> v1:172.21.15.26:6789/0 conn(0x7f6a6c0cd460 legacy=0x7f6a6c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a6affd700 1 -- 172.21.15.67:0/76614257 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0c8cc0 con 0x7f6a6c1598c0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a6affd700 1 --2- 172.21.15.67:0/76614257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c06ab90 tx=0x7f6a5c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3b09a97504e1db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a69ffb700 1 -- 172.21.15.67:0/76614257 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c009e70 con 0x7f6a6c1598c0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a69ffb700 1 -- 172.21.15.67:0/76614257 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00b860 con 0x7f6a6c1598c0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a69ffb700 1 -- 172.21.15.67:0/76614257 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00bc00 con 0x7f6a6c1598c0 2023-10-09T11:35:01.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a71698700 1 -- 172.21.15.67:0/76614257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c1598c0 msgr2=0x7f6a6c0c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.671+0000 7f6a71698700 1 --2- 172.21.15.67:0/76614257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c06ab90 tx=0x7f6a5c009250 comp rx=0 tx=0).stop 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 -- 172.21.15.67:0/76614257 shutdown_connections 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 --2- 172.21.15.67:0/76614257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c1598c0 0x7f6a6c0c3e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 --2- 172.21.15.67:0/76614257 >> v2:172.21.15.26:3300/0 conn(0x7f6a6c159c90 0x7f6a6c0c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 -- 172.21.15.67:0/76614257 >> 172.21.15.67:0/76614257 conn(0x7f6a6c088000 msgr2=0x7f6a6c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 -- 172.21.15.67:0/76614257 shutdown_connections 2023-10-09T11:35:01.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.672+0000 7f6a71698700 1 -- 172.21.15.67:0/76614257 wait complete. 2023-10-09T11:35:01.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.673+0000 7f6a71698700 1 Processor -- start 2023-10-09T11:35:01.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.673+0000 7f6a71698700 1 -- start start 2023-10-09T11:35:01.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 0x7f6a6c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a6c1598c0 0x7f6a6c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b1f10 con 0x7f6a6c0cd460 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b1340 con 0x7f6a6c159c90 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b15e0 con 0x7f6a6c1598c0 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6a7fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a6c1598c0 0x7f6a6c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 0x7f6a6c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54236/0 (socket says 172.21.15.67:54236) 2023-10-09T11:35:01.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 -- 172.21.15.67:0/1742867980 learned_addr learned my addr 172.21.15.67:0/1742867980 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 0x7f6a6c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.67:37284/0 (socket says 172.21.15.67:37284) 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 -- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a6c1598c0 msgr2=0x7f6a6c0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a6c1598c0 0x7f6a6c0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 -- 172.21.15.67:0/1742867980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 msgr2=0x7f6a6c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 0x7f6a6c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 -- 172.21.15.67:0/1742867980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0094f0 con 0x7f6a6c159c90 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a6b7fe700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c840 tx=0x7f6a64001670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64012630 con 0x7f6a6c159c90 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640127b0 con 0x7f6a6c159c90 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c0b18c0 con 0x7f6a6c159c90 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64012b70 con 0x7f6a6c159c90 2023-10-09T11:35:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.674+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c0aedb0 con 0x7f6a6c159c90 2023-10-09T11:35:01.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.675+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6a6401b400 con 0x7f6a6c159c90 2023-10-09T11:35:01.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.675+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f6a6401aa10 con 0x7f6a6c159c90 2023-10-09T11:35:01.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.675+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c0b2080 con 0x7f6a6c159c90 2023-10-09T11:35:01.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.677+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6a6401acf0 con 0x7f6a6c159c90 2023-10-09T11:35:01.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.761+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "48641f8c-deaa-498f-8d8a-f695baf0d5f5", "id": 7} v 0) v1 -- 0x7f6a6c04c3c0 con 0x7f6a6c159c90 2023-10-09T11:35:01.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.770+0000 7f6a52ffd700 1 -- 172.21.15.67:0/1742867980 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48641f8c-deaa-498f-8d8a-f695baf0d5f5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a6401ae90 con 0x7f6a6c159c90 2023-10-09T11:35:01.771 INFO:teuthology.orchestra.run.smithi067.stdout:7 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.770+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 msgr2=0x7f6a6c0c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.770+0000 7f6a71698700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c840 tx=0x7f6a64001670 comp rx=0 tx=0).stop 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.770+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 shutdown_connections 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a6c159c90 0x7f6a6c0c74e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a6c0cd460 0x7f6a6c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 --2- 172.21.15.67:0/1742867980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a6c1598c0 0x7f6a6c0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 >> 172.21.15.67:0/1742867980 conn(0x7f6a6c088000 msgr2=0x7f6a6c0cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 shutdown_connections 2023-10-09T11:35:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-09T11:35:01.771+0000 7f6a71698700 1 -- 172.21.15.67:0/1742867980 wait complete. 2023-10-09T11:35:01.783 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T11:35:01.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T11:35:01.786 INFO:tasks.ceph.osd.0:Started 2023-10-09T11:35:01.787 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T11:35:01.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T11:35:01.789 INFO:tasks.ceph.osd.1:Started 2023-10-09T11:35:01.789 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T11:35:01.789 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T11:35:01.791 INFO:tasks.ceph.osd.2:Started 2023-10-09T11:35:01.791 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T11:35:01.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T11:35:01.793 INFO:tasks.ceph.osd.3:Started 2023-10-09T11:35:01.793 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T11:35:01.794 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T11:35:01.796 INFO:tasks.ceph.osd.4:Started 2023-10-09T11:35:01.796 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T11:35:01.796 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T11:35:01.798 INFO:tasks.ceph.osd.5:Started 2023-10-09T11:35:01.798 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T11:35:01.798 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T11:35:01.800 INFO:tasks.ceph.osd.6:Started 2023-10-09T11:35:01.800 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T11:35:01.800 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T11:35:01.802 INFO:tasks.ceph.osd.7:Started 2023-10-09T11:35:01.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.952+0000 7f0df0a9f700 1 Processor -- start 2023-10-09T11:35:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.952+0000 7f0df0a9f700 1 -- start start 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0df0a9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0dec06dc70 0x7f0dec164440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0df0a9f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec06c7d0 con 0x7f0dec143200 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0df0a9f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec0c37a0 con 0x7f0dec0c3250 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0df0a9f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dec1171e0 con 0x7f0dec06dc70 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0dead9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0dec06dc70 0x7f0dec164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0dea59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0dec143200 0x7f0dec159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47956/0 (socket says 172.21.15.26:47956) 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.953+0000 7f0dea59c700 1 -- 172.21.15.26:0/1286884911 learned_addr learned my addr 172.21.15.26:0/1286884911 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0dead9d700 1 -- 172.21.15.26:0/1286884911 >> v1:172.21.15.67:6789/0 conn(0x7f0dec0c3250 legacy=0x7f0dec15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0dead9d700 1 -- 172.21.15.26:0/1286884911 >> v1:172.21.15.26:6789/0 conn(0x7f0dec143200 legacy=0x7f0dec159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0dead9d700 1 -- 172.21.15.26:0/1286884911 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0cc090 con 0x7f0dec06dc70 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0de959a700 1 -- 172.21.15.26:0/1286884911 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993608637 0 0) 0x7f0dec06c7d0 con 0x7f0dec143200 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0dead9d700 1 --2- 172.21.15.26:0/1286884911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec06dc70 0x7f0dec164440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009e60 tx=0x7f0de4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704169eaec1d9a52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0de959a700 1 -- 172.21.15.26:0/1286884911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400e070 con 0x7f0dec06dc70 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0de959a700 1 -- 172.21.15.26:0/1286884911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de400bc30 con 0x7f0dec06dc70 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.954+0000 7f0de959a700 1 -- 172.21.15.26:0/1286884911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4012430 con 0x7f0dec06dc70 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 -- 172.21.15.26:0/1286884911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec06dc70 msgr2=0x7f0dec164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/1286884911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec06dc70 0x7f0dec164440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009e60 tx=0x7f0de4009780 comp rx=0 tx=0).stop 2023-10-09T11:35:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 -- 172.21.15.26:0/1286884911 shutdown_connections 2023-10-09T11:35:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/1286884911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec06dc70 0x7f0dec164440 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 -- 172.21.15.26:0/1286884911 >> 172.21.15.26:0/1286884911 conn(0x7f0dec0ccb60 msgr2=0x7f0dec0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 -- 172.21.15.26:0/1286884911 shutdown_connections 2023-10-09T11:35:01.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.955+0000 7f0df0a9f700 1 -- 172.21.15.26:0/1286884911 wait complete. 2023-10-09T11:35:01.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.956+0000 7f0df0a9f700 1 Processor -- start 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.956+0000 7f0df0a9f700 1 -- start start 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dec06dc70 0x7f0dec159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dec0c3250 0x7f0dec13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec169840 con 0x7f0dec143200 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec12b0e0 con 0x7f0dec0c3250 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0df0a9f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec12a4d0 con 0x7f0dec06dc70 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55208/0 (socket says 172.21.15.26:55208) 2023-10-09T11:35:01.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 -- 172.21.15.26:0/2776419365 learned_addr learned my addr 172.21.15.26:0/2776419365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dea59c700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dec06dc70 0x7f0dec159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0de9d9b700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dec0c3250 0x7f0dec13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 -- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dec06dc70 msgr2=0x7f0dec159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dec06dc70 0x7f0dec159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 -- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dec0c3250 msgr2=0x7f0dec13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dec0c3250 0x7f0dec13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 -- 172.21.15.26:0/2776419365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4009a20 con 0x7f0dec143200 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dead9d700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0de40099f0 tx=0x7f0de4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.957+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4012e10 con 0x7f0dec143200 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de401d630 con 0x7f0dec143200 2023-10-09T11:35:01.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec12a7b0 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de401d9f0 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec12ad70 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec04c3c0 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0de4024070 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.958+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f0de4027dd0 con 0x7f0dec143200 2023-10-09T11:35:01.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:01.961+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0de402c020 con 0x7f0dec143200 2023-10-09T11:35:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.030+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dec0cc370 con 0x7f0dec143200 2023-10-09T11:35:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.031+0000 7f0dda7fc700 1 -- 172.21.15.26:0/2776419365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0de401dd60 con 0x7f0dec143200 2023-10-09T11:35:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:02.032 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:01.763965+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 msgr2=0x7f0dec13fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0de40099f0 tx=0x7f0de4019000 comp rx=0 tx=0).stop 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 shutdown_connections 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dec143200 0x7f0dec13fb90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dec06dc70 0x7f0dec159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 --2- 172.21.15.26:0/2776419365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dec0c3250 0x7f0dec13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 >> 172.21.15.26:0/2776419365 conn(0x7f0dec0ccb60 msgr2=0x7f0dec141020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 shutdown_connections 2023-10-09T11:35:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:02.032+0000 7f0df0a9f700 1 -- 172.21.15.26:0/2776419365 wait complete. 2023-10-09T11:35:02.045 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T11:35:02.045 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T11:35:02.065 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:02.064+0000 7f4947903180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:35:02.072 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:02.072+0000 7fbc4fca6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:35:02.145 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:02.144+0000 7f4947903180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:35:02.155 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:02.154+0000 7fbc4fca6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:35:02.226 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:02.225+0000 7f4947903180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:35:02.236 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:02.236+0000 7fbc4fca6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:35:02.393 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-10-09T11:35:02.392+0000 7ff268f9d540 -1 Falling back to public interface 2023-10-09T11:35:02.398 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-10-09T11:35:02.398+0000 7ff269714540 -1 Falling back to public interface 2023-10-09T11:35:02.402 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-09T11:35:02.402+0000 7ff0d40c4540 -1 Falling back to public interface 2023-10-09T11:35:02.403 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-09T11:35:02.402+0000 7f5c5ee2f540 -1 Falling back to public interface 2023-10-09T11:35:02.403 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-09T11:35:02.402+0000 7f5c59258700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-09T11:35:02.403 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-09T11:35:02.403+0000 7ff0ce4ed700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-10-09T11:35:02.406 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-09T11:35:02.406+0000 7fc192a7b540 -1 Falling back to public interface 2023-10-09T11:35:02.408 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-09T11:35:02.408+0000 7f99d3ab0540 -1 Falling back to public interface 2023-10-09T11:35:02.424 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-10-09T11:35:02.423+0000 7fcc6694b540 -1 Falling back to public interface 2023-10-09T11:35:02.429 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-10-09T11:35:02.428+0000 7fa0f934e540 -1 Falling back to public interface 2023-10-09T11:35:02.826 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:02.825+0000 7f4947903180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:35:02.845 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:02.845+0000 7fbc4fca6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:35:02.850 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:02.960 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.959+0000 7f5640d96700 1 Processor -- start 2023-10-09T11:35:02.960 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.959+0000 7f5640d96700 1 -- start start 2023-10-09T11:35:02.962 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5640d96700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 0x7f563c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:02.962 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5640d96700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 0x7f563c0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5640d96700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c15a3f0 con 0x7f563c143020 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5640d96700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0b22f0 con 0x7f563c159dc0 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5640d96700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c068910 con 0x7f563c067f50 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f563a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f563c143020 0x7f563c0b1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47966/0 (socket says 172.21.15.26:47966) 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f563a59c700 1 -- 172.21.15.26:0/2421707202 learned_addr learned my addr 172.21.15.26:0/2421707202 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f5639d9b700 1 --2- 172.21.15.26:0/2421707202 >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 0x7f563c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.960+0000 7f563ad9d700 1 --2- 172.21.15.26:0/2421707202 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 0x7f563c0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563959a700 1 -- 172.21.15.26:0/2421707202 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575255498 0 0) 0x7f563c15a3f0 con 0x7f563c143020 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563959a700 1 -- 172.21.15.26:0/2421707202 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5624003570 con 0x7f563c143020 2023-10-09T11:35:02.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563ad9d700 1 -- 172.21.15.26:0/2421707202 >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 msgr2=0x7f563c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563ad9d700 1 --2- 172.21.15.26:0/2421707202 >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 0x7f563c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563ad9d700 1 -- 172.21.15.26:0/2421707202 >> v1:172.21.15.26:6789/0 conn(0x7f563c143020 legacy=0x7f563c0b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563ad9d700 1 -- 172.21.15.26:0/2421707202 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c15a6d0 con 0x7f563c067f50 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f5639d9b700 1 --2- 172.21.15.26:0/2421707202 >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 0x7f563c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563ad9d700 1 --2- 172.21.15.26:0/2421707202 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 0x7f563c0683d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5634009e60 tx=0x7f5634009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc1e12f2646d5cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563959a700 1 -- 172.21.15.26:0/2421707202 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400e070 con 0x7f563c067f50 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563959a700 1 -- 172.21.15.26:0/2421707202 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563400bab0 con 0x7f563c067f50 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.961+0000 7f563959a700 1 -- 172.21.15.26:0/2421707202 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400be70 con 0x7f563c067f50 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 -- 172.21.15.26:0/2421707202 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 msgr2=0x7f563c0683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:02.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 --2- 172.21.15.26:0/2421707202 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 0x7f563c0683d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5634009e60 tx=0x7f5634009780 comp rx=0 tx=0).stop 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 -- 172.21.15.26:0/2421707202 shutdown_connections 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 --2- 172.21.15.26:0/2421707202 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c067f50 0x7f563c0683d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 --2- 172.21.15.26:0/2421707202 >> v2:172.21.15.67:3300/0 conn(0x7f563c159dc0 0x7f563c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 -- 172.21.15.26:0/2421707202 >> 172.21.15.26:0/2421707202 conn(0x7f563c0ce520 msgr2=0x7f563c0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 -- 172.21.15.26:0/2421707202 shutdown_connections 2023-10-09T11:35:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.962+0000 7f5640d96700 1 -- 172.21.15.26:0/2421707202 wait complete. 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.963+0000 7f5640d96700 1 Processor -- start 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.963+0000 7f5640d96700 1 -- start start 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 0x7f563c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 0x7f563c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c8de0 con 0x7f563c159dc0 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c9c00 con 0x7f563c067f50 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5640d96700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1593d0 con 0x7f563c143020 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55210/0 (socket says 172.21.15.26:55210) 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 0x7f563c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563ad9d700 1 -- 172.21.15.26:0/926641055 learned_addr learned my addr 172.21.15.26:0/926641055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5639d9b700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 0x7f563c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 -- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 msgr2=0x7f563c0af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 0x7f563c0af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 -- 172.21.15.26:0/926641055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 msgr2=0x7f563c13ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563a59c700 1 -- 172.21.15.26:0/926641055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009420 con 0x7f563c067f50 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f5639d9b700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 0x7f563c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.964+0000 7f563ad9d700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f563a59c700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 0x7f563c158e90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c580 tx=0x7f562c007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c005b30 con 0x7f563c067f50 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c005cb0 con 0x7f563c067f50 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634009a20 con 0x7f563c067f50 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c007320 con 0x7f563c067f50 2023-10-09T11:35:02.970 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0c8ff0 con 0x7f563c067f50 2023-10-09T11:35:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f562c01c6c0 con 0x7f563c067f50 2023-10-09T11:35:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.965+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f562c005e20 con 0x7f563c067f50 2023-10-09T11:35:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.966+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0b30e0 con 0x7f563c067f50 2023-10-09T11:35:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:02.968+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f562c017070 con 0x7f563c067f50 2023-10-09T11:35:02.971 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:02.968+0000 7f4947903180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:02.993 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:02.993+0000 7fbc4fca6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:03.038 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.038+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f563c04c3c0 con 0x7f563c067f50 2023-10-09T11:35:03.039 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.039+0000 7f562a7fc700 1 -- 172.21.15.26:0/926641055 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f562c01c970 con 0x7f563c067f50 2023-10-09T11:35:03.039 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-09T11:35:03.039 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:01.763965+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:03.040 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 msgr2=0x7f563c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 0x7f563c158e90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c580 tx=0x7f562c007d50 comp rx=0 tx=0).stop 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 shutdown_connections 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c159dc0 0x7f563c13ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c067f50 0x7f563c158e90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 --2- 172.21.15.26:0/926641055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f563c143020 0x7f563c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 >> 172.21.15.26:0/926641055 conn(0x7f563c0ce520 msgr2=0x7f563c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 shutdown_connections 2023-10-09T11:35:03.041 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:03.040+0000 7f5640d96700 1 -- 172.21.15.26:0/926641055 wait complete. 2023-10-09T11:35:03.051 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T11:35:03.069 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:03.068+0000 7f4947903180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:35:03.092 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:03.092+0000 7fbc4fca6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:35:03.325 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:03.324+0000 7f4947903180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:35:03.350 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:03.350+0000 7fbc4fca6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:35:03.408 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:03.407+0000 7f4947903180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:35:03.431 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:03.431+0000 7fbc4fca6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:35:04.271 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.270+0000 7f4947903180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:35:04.296 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.296+0000 7fbc4fca6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:35:04.348 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.346+0000 7f4947903180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:35:04.375 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.375+0000 7fbc4fca6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:35:04.424 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.423+0000 7f4947903180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:35:04.452 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.452+0000 7fbc4fca6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:35:04.563 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.562+0000 7f4947903180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:35:04.592 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.592+0000 7fbc4fca6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:35:04.665 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.664+0000 7f4947903180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:35:04.700 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.700+0000 7fbc4fca6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:35:04.822 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.821+0000 7f4947903180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:35:04.866 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.866+0000 7fbc4fca6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:35:04.905 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.904+0000 7f4947903180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:35:04.961 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:04.961+0000 7fbc4fca6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:35:05.000 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:04.999+0000 7f4947903180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:35:05.048 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:05.047+0000 7fbc4fca6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:35:05.080 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:05.078+0000 7f4947903180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:35:05.129 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-10-09T11:35:05.129+0000 7fbc4fca6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:35:05.419 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-09T11:35:05.419+0000 7f99d3ab0540 -1 osd.0 0 log_to_monitors true 2023-10-09T11:35:05.658 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-09T11:35:05.658+0000 7f5c5ee2f540 -1 osd.3 0 log_to_monitors true 2023-10-09T11:35:05.662 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-10-09T11:35:05.661+0000 7ff268f9d540 -1 osd.4 0 log_to_monitors true 2023-10-09T11:35:05.665 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-09T11:35:05.665+0000 7ff0d40c4540 -1 osd.2 0 log_to_monitors true 2023-10-09T11:35:05.694 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-10-09T11:35:05.693+0000 7fa0f934e540 -1 osd.7 0 log_to_monitors true 2023-10-09T11:35:05.880 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-10-09T11:35:05.879+0000 7ff269714540 -1 osd.5 0 log_to_monitors true 2023-10-09T11:35:05.922 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-09T11:35:05.922+0000 7fc192a7b540 -1 osd.1 0 log_to_monitors true 2023-10-09T11:35:05.960 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-10-09T11:35:05.959+0000 7fcc6694b540 -1 osd.6 0 log_to_monitors true 2023-10-09T11:35:06.106 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:06.105+0000 7f4900d04700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T11:35:06.106 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:35:06.105+0000 7f4900d04700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T11:35:08.470 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-09T11:35:08.470+0000 7f5c55a51700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T11:35:08.475 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-09T11:35:08.475+0000 7f5c4e848700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:08.527 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-09T11:35:08.527+0000 7f99ca6d2700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T11:35:08.532 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-09T11:35:08.532+0000 7f99c34c9700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:08.544 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-09T11:35:08.544+0000 7fc18969d700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T11:35:08.547 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-09T11:35:08.547+0000 7fc182494700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:08.569 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-09T11:35:08.568+0000 7ff0cace6700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T11:35:08.571 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-09T11:35:08.571+0000 7ff0c3add700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:09.282 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-10-09T11:35:09.281+0000 7ff25fbbf700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T11:35:09.287 INFO:tasks.ceph.osd.4.smithi067.stderr:2023-10-09T11:35:09.286+0000 7ff2589b6700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:09.289 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-10-09T11:35:09.288+0000 7fa0eff70700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T11:35:09.294 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-10-09T11:35:09.293+0000 7fcc5d56d700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T11:35:09.295 INFO:tasks.ceph.osd.7.smithi067.stderr:2023-10-09T11:35:09.294+0000 7fa0e8d67700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:09.295 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-10-09T11:35:09.294+0000 7ff260336700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T11:35:09.299 INFO:tasks.ceph.osd.6.smithi067.stderr:2023-10-09T11:35:09.298+0000 7fcc56364700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:09.301 INFO:tasks.ceph.osd.5.smithi067.stderr:2023-10-09T11:35:09.300+0000 7ff25912d700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:09.858 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:09.981 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.980+0000 7f514adaf700 1 Processor -- start 2023-10-09T11:35:09.981 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.980+0000 7f514adaf700 1 -- start start 2023-10-09T11:35:09.983 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.980+0000 7f514adaf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5144157530 0x7f51440af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.983 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.980+0000 7f514adaf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51440abd50 0x7f51440ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.980+0000 7f514adaf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406d3e0 con 0x7f5144157900 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f514adaf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440ac6f0 con 0x7f5144157530 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f514adaf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440c78a0 con 0x7f51440abd50 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5144157530 0x7f51440af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5144157530 0x7f51440af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44450/0 (socket says 172.21.15.26:44450) 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 -- 172.21.15.26:0/1204084864 learned_addr learned my addr 172.21.15.26:0/1204084864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5143fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5144157900 0x7f514406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48814/0 (socket says 172.21.15.26:48814) 2023-10-09T11:35:09.984 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f514934c700 1 --2- 172.21.15.26:0/1204084864 >> v2:172.21.15.67:3300/0 conn(0x7f51440abd50 0x7f51440ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 -- 172.21.15.26:0/1204084864 >> v2:172.21.15.67:3300/0 conn(0x7f51440abd50 msgr2=0x7f51440ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 --2- 172.21.15.26:0/1204084864 >> v2:172.21.15.67:3300/0 conn(0x7f51440abd50 0x7f51440ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 -- 172.21.15.26:0/1204084864 >> v1:172.21.15.26:6789/0 conn(0x7f5144157900 legacy=0x7f514406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 -- 172.21.15.26:0/1204084864 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440c6c90 con 0x7f5144157530 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f5148b4b700 1 --2- 172.21.15.26:0/1204084864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157530 0x7f51440af210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51440c32b0 tx=0x7f512c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9ce5af0ee59f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f51437fe700 1 -- 172.21.15.26:0/1204084864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00b860 con 0x7f5144157530 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f51437fe700 1 -- 172.21.15.26:0/1204084864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00b9c0 con 0x7f5144157530 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.981+0000 7f51437fe700 1 -- 172.21.15.26:0/1204084864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00bd60 con 0x7f5144157530 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 -- 172.21.15.26:0/1204084864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157530 msgr2=0x7f51440af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 --2- 172.21.15.26:0/1204084864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157530 0x7f51440af210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51440c32b0 tx=0x7f512c009250 comp rx=0 tx=0).stop 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 -- 172.21.15.26:0/1204084864 shutdown_connections 2023-10-09T11:35:09.985 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 --2- 172.21.15.26:0/1204084864 >> v2:172.21.15.67:3300/0 conn(0x7f51440abd50 0x7f51440ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:09.986 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 --2- 172.21.15.26:0/1204084864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157530 0x7f51440af210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:09.986 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 -- 172.21.15.26:0/1204084864 >> 172.21.15.26:0/1204084864 conn(0x7f514406f1a0 msgr2=0x7f514406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:09.986 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 -- 172.21.15.26:0/1204084864 shutdown_connections 2023-10-09T11:35:09.986 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.982+0000 7f514adaf700 1 -- 172.21.15.26:0/1204084864 wait complete. 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.983+0000 7f514adaf700 1 Processor -- start 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.983+0000 7f514adaf700 1 -- start start 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51440abd50 0x7f5144156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 0x7f5144158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514415aaf0 con 0x7f5144157900 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514415a380 con 0x7f51440abd50 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514adaf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51441592d0 con 0x7f5144157530 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44464/0 (socket says 172.21.15.26:44464) 2023-10-09T11:35:09.989 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 -- 172.21.15.26:0/3460839401 learned_addr learned my addr 172.21.15.26:0/3460839401 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f5143fff700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 0x7f5144158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f5148b4b700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51440abd50 0x7f5144156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 -- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 msgr2=0x7f5144158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 0x7f5144158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 -- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51440abd50 msgr2=0x7f5144156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51440abd50 0x7f5144156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f514934c700 1 -- 172.21.15.26:0/3460839401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0094f0 con 0x7f5144157900 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.984+0000 7f5143fff700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 0x7f5144158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f514934c700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f513c009fa0 tx=0x7f513c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00ec70 con 0x7f5144157900 2023-10-09T11:35:09.990 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00edd0 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51441595b0 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c014670 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.985+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514415a780 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.986+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514404c3c0 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.986+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f513c0149e0 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.987+0000 7f5140ff9700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 0x7f5124069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.987+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3347+0+0 (secure 0 0 0) 0x7f513c084290 con 0x7f5144157900 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.987+0000 7f5148b4b700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 0x7f5124069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:09.991 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.987+0000 7f5148b4b700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 0x7f5124069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51440c32b0 tx=0x7f512c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:09.993 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:09.991+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f513c051f10 con 0x7f5144157900 2023-10-09T11:35:10.187 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.186+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f514415ac30 con 0x7f5144157900 2023-10-09T11:35:10.188 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.187+0000 7f5140ff9700 1 -- 172.21.15.26:0/3460839401 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8692 (secure 0 0 0) 0x7f513c055530 con 0x7f5144157900 2023-10-09T11:35:10.188 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-09T11:35:10.188 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":13,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:09.242712+0000","last_up_change":"2023-10-09T11:35:09.242712+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:10.190 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 msgr2=0x7f5124069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:10.190 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 0x7f5124069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51440c32b0 tx=0x7f512c017000 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 msgr2=0x7f514415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f513c009fa0 tx=0x7f513c009900 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 shutdown_connections 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5144157900 0x7f514415c9e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51440abd50 0x7f5144156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5124066ea0 0x7f5124069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 --2- 172.21.15.26:0/3460839401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5144157530 0x7f5144158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 >> 172.21.15.26:0/3460839401 conn(0x7f514406f1a0 msgr2=0x7f51440c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 shutdown_connections 2023-10-09T11:35:10.191 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:10.189+0000 7f514adaf700 1 -- 172.21.15.26:0/3460839401 wait complete. 2023-10-09T11:35:10.201 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-09T11:35:17.007 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:17.129 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.128+0000 7fdf81656700 1 Processor -- start 2023-10-09T11:35:17.130 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.128+0000 7fdf81656700 1 -- start start 2023-10-09T11:35:17.133 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf81656700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdf7c0cd350 0x7fdf7c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.133 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf81656700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0caf50 0x7fdf7c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf81656700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0cc2b0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf81656700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cb6a0 con 0x7fdf7c0caf50 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf81656700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cb980 con 0x7fdf7c0cd350 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0caf50 0x7fdf7c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf7c0caf50 0x7fdf7c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44470/0 (socket says 172.21.15.26:44470) 2023-10-09T11:35:17.134 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/1110326194 learned_addr learned my addr 172.21.15.26:0/1110326194 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.135 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7a7fc700 1 --1- 172.21.15.26:0/1110326194 >> v1:172.21.15.26:6789/0 conn(0x7fdf7c0cd720 0x7fdf7c0ce580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48830/0 (socket says 172.21.15.26:48830) 2023-10-09T11:35:17.135 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7affd700 1 --2- 172.21.15.26:0/1110326194 >> v2:172.21.15.67:3300/0 conn(0x7fdf7c0cd350 0x7fdf7c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.135 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/1110326194 >> v2:172.21.15.67:3300/0 conn(0x7fdf7c0cd350 msgr2=0x7fdf7c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:17.135 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 --2- 172.21.15.26:0/1110326194 >> v2:172.21.15.67:3300/0 conn(0x7fdf7c0cd350 0x7fdf7c15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.135 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/1110326194 >> v1:172.21.15.26:6789/0 conn(0x7fdf7c0cd720 legacy=0x7fdf7c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/1110326194 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0cbc60 con 0x7fdf7c0caf50 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.129+0000 7fdf79ffb700 1 -- 172.21.15.26:0/1110326194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046811667 0 0) 0x7fdf7c0cc2b0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf7b7fe700 1 --2- 172.21.15.26:0/1110326194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0caf50 0x7fdf7c15a360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c06be10 tx=0x7fdf74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b101c57e1295532d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf79ffb700 1 -- 172.21.15.26:0/1110326194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400e070 con 0x7fdf7c0caf50 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf79ffb700 1 -- 172.21.15.26:0/1110326194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400ba50 con 0x7fdf7c0caf50 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf79ffb700 1 -- 172.21.15.26:0/1110326194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740092e0 con 0x7fdf7c0caf50 2023-10-09T11:35:17.136 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 -- 172.21.15.26:0/1110326194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0caf50 msgr2=0x7fdf7c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.137 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 --2- 172.21.15.26:0/1110326194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0caf50 0x7fdf7c15a360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c06be10 tx=0x7fdf74009840 comp rx=0 tx=0).stop 2023-10-09T11:35:17.137 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 -- 172.21.15.26:0/1110326194 shutdown_connections 2023-10-09T11:35:17.137 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 --2- 172.21.15.26:0/1110326194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0caf50 0x7fdf7c15a360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.137 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 --2- 172.21.15.26:0/1110326194 >> v2:172.21.15.67:3300/0 conn(0x7fdf7c0cd350 0x7fdf7c15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.137 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 -- 172.21.15.26:0/1110326194 >> 172.21.15.26:0/1110326194 conn(0x7fdf7c099a70 msgr2=0x7fdf7c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:17.138 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 -- 172.21.15.26:0/1110326194 shutdown_connections 2023-10-09T11:35:17.138 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.130+0000 7fdf81656700 1 -- 172.21.15.26:0/1110326194 wait complete. 2023-10-09T11:35:17.138 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 Processor -- start 2023-10-09T11:35:17.138 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 -- start start 2023-10-09T11:35:17.142 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf7c0caf50 0x7fdf7c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.142 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7c0cd350 0x7fdf7c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.142 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.142 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b0630 con 0x7fdf7c0cd720 2023-10-09T11:35:17.143 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b1430 con 0x7fdf7c0cd350 2023-10-09T11:35:17.143 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.132+0000 7fdf81656700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c1581e0 con 0x7fdf7c0caf50 2023-10-09T11:35:17.143 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.143 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44486/0 (socket says 172.21.15.26:44486) 2023-10-09T11:35:17.143 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/2726698032 learned_addr learned my addr 172.21.15.26:0/2726698032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7a7fc700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7c0cd350 0x7fdf7c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7affd700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf7c0caf50 0x7fdf7c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf7c0caf50 msgr2=0x7fdf7c0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf7c0caf50 0x7fdf7c0b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7c0cd350 msgr2=0x7fdf7c0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7c0cd350 0x7fdf7c0b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.144 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 -- 172.21.15.26:0/2726698032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009ae0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf7b7fe700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009ab0 tx=0x7fdf74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740094e0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400be60 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c0b0820 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74026460 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.133+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c0b0de0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.145 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.134+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c0b15e0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.135+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf74003040 con 0x7fdf7c0cd720 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.135+0000 7fdf62ffd700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.135+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdf74085ff0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.135+0000 7fdf7affd700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.136+0000 7fdf7affd700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c006aa0 tx=0x7fdf6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.146 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.140+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf7c0b15e0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.337 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.336+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf7c0b15e0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.338 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.336+0000 7fdf62ffd700 1 -- 172.21.15.26:0/2726698032 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fdf7c0b15e0 con 0x7fdf7c0cd720 2023-10-09T11:35:17.339 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-09T11:35:17.339 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":17,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:13.298795+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:17.340 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 msgr2=0x7fdf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.340 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c006aa0 tx=0x7fdf6c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:17.340 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 msgr2=0x7fdf7c157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.340 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009ab0 tx=0x7fdf74018000 comp rx=0 tx=0).stop 2023-10-09T11:35:17.340 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 shutdown_connections 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7c0cd720 0x7fdf7c157ca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf7c0caf50 0x7fdf7c0b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 --2- 172.21.15.26:0/2726698032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7c0cd350 0x7fdf7c0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.338+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 >> 172.21.15.26:0/2726698032 conn(0x7fdf7c099a70 msgr2=0x7fdf7c15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.339+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 shutdown_connections 2023-10-09T11:35:17.341 INFO:teuthology.misc.health.smithi026.stderr:2023-10-09T11:35:17.339+0000 7fdf81656700 1 -- 172.21.15.26:0/2726698032 wait complete. 2023-10-09T11:35:17.351 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T11:35:17.351 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T11:35:17.352 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:35:17.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:35:17.354 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:35:17.354 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:35:17.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:35:17.356 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:35:17.357 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:35:17.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:35:17.359 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:35:17.360 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:35:17.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:35:17.362 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:35:17.362 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T11:35:17.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:17.430 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:35:17.430 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:35:17.446 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:35:17.446 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:35:17.447 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-10-09T11:35:17.446+0000 7f4337aaf700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T11:35:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.487+0000 7f2704e18700 1 Processor -- start 2023-10-09T11:35:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.487+0000 7f2704e18700 1 -- start start 2023-10-09T11:35:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27000b05a0 0x7f27000b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 0x7f27000c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f27000c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000c4490 con 0x7f27000b05a0 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270006e560 con 0x7f27000cec90 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f2704e18700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270006e260 con 0x7f27000c3ad0 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f26ff7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27000b05a0 0x7f27000b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f26ff7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27000b05a0 0x7f27000b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44538/0 (socket says 172.21.15.26:44538) 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.488+0000 7f26ff7fe700 1 -- 172.21.15.26:0/439982720 learned_addr learned my addr 172.21.15.26:0/439982720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26feffd700 1 --2- 172.21.15.26:0/439982720 >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 0x7f27000c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26fffff700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f27000c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 -- 172.21.15.26:0/439982720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 msgr2=0x7f27000c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f27000c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 -- 172.21.15.26:0/439982720 >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 msgr2=0x7f27000c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/439982720 >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 0x7f27000c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 -- 172.21.15.26:0/439982720 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000c8ef0 con 0x7f27000b05a0 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26feffd700 1 --2- 172.21.15.26:0/439982720 >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 0x7f27000c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000b05a0 0x7f27000b0970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27000b0eb0 tx=0x7f26f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeea1068562954f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26fe7fc700 1 -- 172.21.15.26:0/439982720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0005c10 con 0x7f27000b05a0 2023-10-09T11:35:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26fe7fc700 1 -- 172.21.15.26:0/439982720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0005d70 con 0x7f27000b05a0 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f26fe7fc700 1 -- 172.21.15.26:0/439982720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000b880 con 0x7f27000b05a0 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f2704e18700 1 -- 172.21.15.26:0/439982720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000b05a0 msgr2=0x7f27000b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.489+0000 7f2704e18700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000b05a0 0x7f27000b0970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27000b0eb0 tx=0x7f26f0009220 comp rx=0 tx=0).stop 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 -- 172.21.15.26:0/439982720 shutdown_connections 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f27000c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 --2- 172.21.15.26:0/439982720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000b05a0 0x7f27000b0970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 --2- 172.21.15.26:0/439982720 >> v2:172.21.15.67:3300/0 conn(0x7f27000cec90 0x7f27000c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 -- 172.21.15.26:0/439982720 >> 172.21.15.26:0/439982720 conn(0x7f2700088000 msgr2=0x7f27000ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 -- 172.21.15.26:0/439982720 shutdown_connections 2023-10-09T11:35:17.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.490+0000 7f2704e18700 1 -- 172.21.15.26:0/439982720 wait complete. 2023-10-09T11:35:17.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.491+0000 7f2704e18700 1 Processor -- start 2023-10-09T11:35:17.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.491+0000 7f2704e18700 1 -- start start 2023-10-09T11:35:17.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27000b05a0 0x7f2700156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f270006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270015a4a0 con 0x7f27000cec90 2023-10-09T11:35:17.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b33f0 con 0x7f27000b05a0 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b27e0 con 0x7f27000c3ad0 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44552/0 (socket says 172.21.15.26:44552) 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 -- 172.21.15.26:0/799325973 learned_addr learned my addr 172.21.15.26:0/799325973 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27000b05a0 0x7f2700156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26feffd700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f270006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 -- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 msgr2=0x7f270006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f270006e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 -- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27000b05a0 msgr2=0x7f2700156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27000b05a0 0x7f2700156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 -- 172.21.15.26:0/799325973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009480 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26feffd700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f270006e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26fffff700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009fa0 tx=0x7f26f8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800ed20 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f800ee80 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27000b2ac0 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8014670 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.492+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27000b3080 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.493+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270015a610 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.494+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26f80149e0 con 0x7f27000cec90 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.494+0000 7f26e77fe700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.494+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f26f80849d0 con 0x7f27000cec90 2023-10-09T11:35:17.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.494+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.495+0000 7f26ff7fe700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 0x7f26ec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009260 tx=0x7f26f0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.498+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f270015a610 con 0x7f27000cec90 2023-10-09T11:35:17.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.693+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f270015a5e0 con 0x7f27000cec90 2023-10-09T11:35:17.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.693+0000 7f26e77fe700 1 -- 172.21.15.26:0/799325973 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f26f8051f90 con 0x7f27000cec90 2023-10-09T11:35:17.695 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:17.695 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:13.298795+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:17.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 msgr2=0x7f26ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 0x7f26ec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009260 tx=0x7f26f0016000 comp rx=0 tx=0).stop 2023-10-09T11:35:17.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 msgr2=0x7f270006ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009fa0 tx=0x7f26f8009900 comp rx=0 tx=0).stop 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 shutdown_connections 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27000cec90 0x7f270006ef30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27000b05a0 0x7f2700156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 --2- 172.21.15.26:0/799325973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27000c3ad0 0x7f270006e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 >> 172.21.15.26:0/799325973 conn(0x7f2700088000 msgr2=0x7f2700158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.695+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 shutdown_connections 2023-10-09T11:35:17.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.696+0000 7f2704e18700 1 -- 172.21.15.26:0/799325973 wait complete. 2023-10-09T11:35:17.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:35:17.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.829+0000 7ff6034b2700 1 Processor -- start 2023-10-09T11:35:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.829+0000 7ff6034b2700 1 -- start start 2023-10-09T11:35:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff6034b2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5fc06dc70 0x7ff5fc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff6034b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff6034b2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0ccfd0 con 0x7ff5fc159530 2023-10-09T11:35:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff6034b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc15a3d0 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff6034b2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc15a6b0 con 0x7ff5fc06dc70 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff601a4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff601a4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44564/0 (socket says 172.21.15.26:44564) 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff601a4f700 1 -- 172.21.15.26:0/1120295422 learned_addr learned my addr 172.21.15.26:0/1120295422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.830+0000 7ff600a4d700 1 --2- 172.21.15.26:0/1120295422 >> v2:172.21.15.67:3300/0 conn(0x7ff5fc06dc70 0x7ff5fc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff601a4f700 1 -- 172.21.15.26:0/1120295422 >> v2:172.21.15.67:3300/0 conn(0x7ff5fc06dc70 msgr2=0x7ff5fc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff601a4f700 1 --2- 172.21.15.26:0/1120295422 >> v2:172.21.15.67:3300/0 conn(0x7ff5fc06dc70 0x7ff5fc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff601a4f700 1 -- 172.21.15.26:0/1120295422 >> v1:172.21.15.67:6789/0 conn(0x7ff5fc159530 legacy=0x7ff5fc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff601a4f700 1 -- 172.21.15.26:0/1120295422 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc15a990 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff601a4f700 1 --2- 172.21.15.26:0/1120295422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0b66e0 tx=0x7ff5ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da7cbccafcc9965 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff5fbfff700 1 -- 172.21.15.26:0/1120295422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00e070 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff5fbfff700 1 -- 172.21.15.26:0/1120295422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec00ba50 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff5fbfff700 1 -- 172.21.15.26:0/1120295422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0092e0 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 -- 172.21.15.26:0/1120295422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc06e0e0 msgr2=0x7ff5fc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1120295422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0b66e0 tx=0x7ff5ec009840 comp rx=0 tx=0).stop 2023-10-09T11:35:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 -- 172.21.15.26:0/1120295422 shutdown_connections 2023-10-09T11:35:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1120295422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc0cb6f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1120295422 >> v2:172.21.15.67:3300/0 conn(0x7ff5fc06dc70 0x7ff5fc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.831+0000 7ff6034b2700 1 -- 172.21.15.26:0/1120295422 >> 172.21.15.26:0/1120295422 conn(0x7ff5fc0703a0 msgr2=0x7ff5fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.832+0000 7ff6034b2700 1 -- 172.21.15.26:0/1120295422 shutdown_connections 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.832+0000 7ff6034b2700 1 -- 172.21.15.26:0/1120295422 wait complete. 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.833+0000 7ff6034b2700 1 Processor -- start 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.833+0000 7ff6034b2700 1 -- start start 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.833+0000 7ff6034b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5fc06dc70 0x7ff5fc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0b3480 con 0x7ff5fc159530 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0b3760 con 0x7ff5fc06e0e0 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc157120 con 0x7ff5fc06dc70 2023-10-09T11:35:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44566/0 (socket says 172.21.15.26:44566) 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 -- 172.21.15.26:0/1632729212 learned_addr learned my addr 172.21.15.26:0/1632729212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff600a4d700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff60124e700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5fc06dc70 0x7ff5fc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 -- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5fc06dc70 msgr2=0x7ff5fc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5fc06dc70 0x7ff5fc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 -- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc06e0e0 msgr2=0x7ff5fc149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 -- 172.21.15.26:0/1632729212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009ae0 con 0x7ff5fc159530 2023-10-09T11:35:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff601a4f700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc089650 tx=0x7ff5ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00be60 con 0x7ff5fc159530 2023-10-09T11:35:17.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec008ce0 con 0x7ff5fc159530 2023-10-09T11:35:17.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc157400 con 0x7ff5fc159530 2023-10-09T11:35:17.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0266b0 con 0x7ff5fc159530 2023-10-09T11:35:17.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.834+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc156e10 con 0x7ff5fc159530 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.835+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc0b3910 con 0x7ff5fc159530 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.836+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5ec003040 con 0x7ff5fc159530 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.836+0000 7ff5f97fa700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 0x7ff5e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.836+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff5ec085a80 con 0x7ff5fc159530 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.836+0000 7ff60124e700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 0x7ff5e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.837+0000 7ff60124e700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 0x7ff5e80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4000c00 tx=0x7ff5f4007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:17.840+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5fc0b3910 con 0x7ff5fc159530 2023-10-09T11:35:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.033+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5fc0b38d0 con 0x7ff5fc159530 2023-10-09T11:35:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.033+0000 7ff5f97fa700 1 -- 172.21.15.26:0/1632729212 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5ec053040 con 0x7ff5fc159530 2023-10-09T11:35:18.035 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 msgr2=0x7ff5e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 0x7ff5e80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4000c00 tx=0x7ff5f4007ea0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 msgr2=0x7ff5fc0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc089650 tx=0x7ff5ec018000 comp rx=0 tx=0).stop 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 shutdown_connections 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5fc159530 0x7ff5fc0c8170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5e8066f30 0x7ff5e80693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5fc06dc70 0x7ff5fc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 --2- 172.21.15.26:0/1632729212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc06e0e0 0x7ff5fc149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 >> 172.21.15.26:0/1632729212 conn(0x7ff5fc0703a0 msgr2=0x7ff5fc153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 shutdown_connections 2023-10-09T11:35:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.036+0000 7ff6034b2700 1 -- 172.21.15.26:0/1632729212 wait complete. 2023-10-09T11:35:18.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:18.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.166+0000 7f6334f2e700 1 Processor -- start 2023-10-09T11:35:18.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.166+0000 7f6334f2e700 1 -- start start 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f6334f2e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63300cb5a0 0x7f63300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f6334f2e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f633015a5d0 0x7f6330156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f6334f2e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633015ae40 con 0x7f63300cd9e0 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f6334f2e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300d13f0 con 0x7f63300cb5a0 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f6334f2e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633015ab60 con 0x7f633015a5d0 2023-10-09T11:35:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f632e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63300cb5a0 0x7f63300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f632e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63300cb5a0 0x7f63300cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44582/0 (socket says 172.21.15.26:44582) 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.167+0000 7f632e59c700 1 -- 172.21.15.26:0/1409724798 learned_addr learned my addr 172.21.15.26:0/1409724798 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632ed9d700 1 --2- 172.21.15.26:0/1409724798 >> v2:172.21.15.67:3300/0 conn(0x7f633015a5d0 0x7f6330156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632e59c700 1 -- 172.21.15.26:0/1409724798 >> v2:172.21.15.67:3300/0 conn(0x7f633015a5d0 msgr2=0x7f6330156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632e59c700 1 --2- 172.21.15.26:0/1409724798 >> v2:172.21.15.67:3300/0 conn(0x7f633015a5d0 0x7f6330156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632e59c700 1 -- 172.21.15.26:0/1409724798 >> v1:172.21.15.67:6789/0 conn(0x7f63300cd9e0 legacy=0x7f6330159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632e59c700 1 -- 172.21.15.26:0/1409724798 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300ccf00 con 0x7f63300cb5a0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632e59c700 1 --2- 172.21.15.26:0/1409724798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cb5a0 0x7f63300cb970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63280099b0 tx=0x7f6328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a489a57400d8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632d59a700 1 -- 172.21.15.26:0/1409724798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800b820 con 0x7f63300cb5a0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632d59a700 1 -- 172.21.15.26:0/1409724798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800b980 con 0x7f63300cb5a0 2023-10-09T11:35:18.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f632d59a700 1 -- 172.21.15.26:0/1409724798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800bd20 con 0x7f63300cb5a0 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f6334f2e700 1 -- 172.21.15.26:0/1409724798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cb5a0 msgr2=0x7f63300cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.168+0000 7f6334f2e700 1 --2- 172.21.15.26:0/1409724798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cb5a0 0x7f63300cb970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63280099b0 tx=0x7f6328009250 comp rx=0 tx=0).stop 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 -- 172.21.15.26:0/1409724798 shutdown_connections 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 --2- 172.21.15.26:0/1409724798 >> v2:172.21.15.67:3300/0 conn(0x7f633015a5d0 0x7f6330156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 --2- 172.21.15.26:0/1409724798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cb5a0 0x7f63300cb970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 -- 172.21.15.26:0/1409724798 >> 172.21.15.26:0/1409724798 conn(0x7f6330070e30 msgr2=0x7f63300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 -- 172.21.15.26:0/1409724798 shutdown_connections 2023-10-09T11:35:18.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.169+0000 7f6334f2e700 1 -- 172.21.15.26:0/1409724798 wait complete. 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 Processor -- start 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 -- start start 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63300cb5a0 0x7f6330153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 0x7f633016a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330159b90 con 0x7f63300cd9e0 2023-10-09T11:35:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633016ab40 con 0x7f633015a5d0 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.170+0000 7f6334f2e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633016ae20 con 0x7f63300cb5a0 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44590/0 (socket says 172.21.15.26:44590) 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 -- 172.21.15.26:0/3051770819 learned_addr learned my addr 172.21.15.26:0/3051770819 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632ed9d700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 0x7f633016a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632e59c700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63300cb5a0 0x7f6330153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 -- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63300cb5a0 msgr2=0x7f6330153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63300cb5a0 0x7f6330153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 -- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 msgr2=0x7f633016a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 0x7f633016a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 -- 172.21.15.26:0/3051770819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280094f0 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632ed9d700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 0x7f633016a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f632dd9b700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631800c590 tx=0x7f631800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318011590 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180116f0 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63300b4860 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318011ab0 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.171+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63300b4e20 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.172+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63300b5040 con 0x7f63300cd9e0 2023-10-09T11:35:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.173+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f631801b3b0 con 0x7f63300cd9e0 2023-10-09T11:35:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.173+0000 7f63267fc700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.173+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6318083710 con 0x7f63300cd9e0 2023-10-09T11:35:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.173+0000 7f632e59c700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.174+0000 7f632e59c700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 0x7f63100693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63280099b0 tx=0x7f6328017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.177+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6318050cd0 con 0x7f63300cd9e0 2023-10-09T11:35:18.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.418+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f633004c3c0 con 0x7f63300cd9e0 2023-10-09T11:35:18.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.418+0000 7f63267fc700 1 -- 172.21.15.26:0/3051770819 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f6318017020 con 0x7f63300cd9e0 2023-10-09T11:35:18.420 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:18.420 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 msgr2=0x7f63100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 0x7f63100693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63280099b0 tx=0x7f6328017000 comp rx=0 tx=0).stop 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 msgr2=0x7f6330169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f631800c590 tx=0x7f631800c950 comp rx=0 tx=0).stop 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 shutdown_connections 2023-10-09T11:35:18.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633015a5d0 0x7f633016a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63300cb5a0 0x7f6330153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 --2- 172.21.15.26:0/3051770819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63300cd9e0 0x7f6330169f60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 >> 172.21.15.26:0/3051770819 conn(0x7f6330070e30 msgr2=0x7f63300c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 shutdown_connections 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:18.420+0000 7f6334f2e700 1 -- 172.21.15.26:0/3051770819 wait complete. 2023-10-09T11:35:18.423 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2023-10-09T11:35:20.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.565+0000 7f2016055700 1 Processor -- start 2023-10-09T11:35:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.565+0000 7f2016055700 1 -- start start 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f2016055700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20100cb5a0 0x7f20100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f2016055700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f2010156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f2016055700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201015ae40 con 0x7f20100cd9e0 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f2016055700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20100d13f0 con 0x7f20100cb5a0 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f2016055700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201015ab60 con 0x7f201015a5d0 2023-10-09T11:35:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f200f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20100cb5a0 0x7f20100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f200effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f20100cd9e0 0x7f2010159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56984/0 (socket says 172.21.15.26:56984) 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f200f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20100cb5a0 0x7f20100cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49730/0 (socket says 172.21.15.26:49730) 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.566+0000 7f200effd700 1 -- 172.21.15.26:0/955977266 learned_addr learned my addr 172.21.15.26:0/955977266 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200ffff700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f2010156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200f7fe700 1 -- 172.21.15.26:0/955977266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 msgr2=0x7f2010156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200f7fe700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f2010156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200f7fe700 1 -- 172.21.15.26:0/955977266 >> v1:172.21.15.26:6789/0 conn(0x7f20100cd9e0 legacy=0x7f2010159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200f7fe700 1 -- 172.21.15.26:0/955977266 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20100ccf00 con 0x7f20100cb5a0 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200e7fc700 1 -- 172.21.15.26:0/955977266 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008166117 0 0) 0x7f201015ae40 con 0x7f20100cd9e0 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200ffff700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f2010156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200f7fe700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cb5a0 0x7f20100cb970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2000009910 tx=0x7f20000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e069b74ef761edc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200e7fc700 1 -- 172.21.15.26:0/955977266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000b820 con 0x7f20100cb5a0 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200e7fc700 1 -- 172.21.15.26:0/955977266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000b980 con 0x7f20100cb5a0 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.567+0000 7f200e7fc700 1 -- 172.21.15.26:0/955977266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000bd20 con 0x7f20100cb5a0 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 -- 172.21.15.26:0/955977266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cb5a0 msgr2=0x7f20100cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cb5a0 0x7f20100cb970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2000009910 tx=0x7f20000091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 -- 172.21.15.26:0/955977266 shutdown_connections 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f2010156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 --2- 172.21.15.26:0/955977266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cb5a0 0x7f20100cb970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 -- 172.21.15.26:0/955977266 >> 172.21.15.26:0/955977266 conn(0x7f2010070e30 msgr2=0x7f20100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 -- 172.21.15.26:0/955977266 shutdown_connections 2023-10-09T11:35:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.568+0000 7f2016055700 1 -- 172.21.15.26:0/955977266 wait complete. 2023-10-09T11:35:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.569+0000 7f2016055700 1 Processor -- start 2023-10-09T11:35:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.569+0000 7f2016055700 1 -- start start 2023-10-09T11:35:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20100cb5a0 0x7f201015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f20100b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201015cee0 con 0x7f20100cd9e0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201015dfc0 con 0x7f20100cb5a0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f2016055700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2010151a20 con 0x7f201015a5d0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49740/0 (socket says 172.21.15.26:49740) 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 -- 172.21.15.26:0/1520388528 learned_addr learned my addr 172.21.15.26:0/1520388528 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200ffff700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f20100b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200f7fe700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20100cb5a0 0x7f201015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 -- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 msgr2=0x7f20100b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f20100b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 -- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20100cb5a0 msgr2=0x7f201015da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20100cb5a0 0x7f201015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 -- 172.21.15.26:0/1520388528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009420 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f200effd700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f200400c810 tx=0x7f2004007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.570+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004005b30 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.571+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2004005c90 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.571+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20100b3d00 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.571+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004007300 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.571+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20100b42c0 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.571+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201004c3c0 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.572+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f200401b400 con 0x7f20100cd9e0 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.572+0000 7f1ff77fe700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 0x7f1ffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.572+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2004083cb0 con 0x7f20100cd9e0 2023-10-09T11:35:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.573+0000 7f200f7fe700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 0x7f1ffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.573+0000 7f200f7fe700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 0x7f1ffc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20000093a0 tx=0x7f2000017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.577+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20040512f0 con 0x7f20100cd9e0 2023-10-09T11:35:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.813+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20100cd1e0 con 0x7f20100cd9e0 2023-10-09T11:35:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.814+0000 7f1ff77fe700 1 -- 172.21.15.26:0/1520388528 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f2004054910 con 0x7f20100cd9e0 2023-10-09T11:35:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:20.815 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 msgr2=0x7f1ffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 0x7f1ffc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20000093a0 tx=0x7f2000017000 comp rx=0 tx=0).stop 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 msgr2=0x7f20101514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f200400c810 tx=0x7f2004007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 shutdown_connections 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1ffc066f30 0x7f1ffc0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f201015a5d0 0x7f20100b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20100cb5a0 0x7f201015da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 --2- 172.21.15.26:0/1520388528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100cd9e0 0x7f20101514e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.815+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 >> 172.21.15.26:0/1520388528 conn(0x7f2010070e30 msgr2=0x7f20100cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.816+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 shutdown_connections 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.816+0000 7f2016055700 1 -- 172.21.15.26:0/1520388528 wait complete. 2023-10-09T11:35:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2023-10-09T11:35:20.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:20.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.945+0000 7febb0986700 1 Processor -- start 2023-10-09T11:35:20.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 -- start start 2023-10-09T11:35:20.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febac0cb5a0 0x7febac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac0cd9e0 0x7febac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac0cde50 0x7febac15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0d13f0 con 0x7febac0cde50 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac15a940 con 0x7febac0cb5a0 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.946+0000 7febb0986700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac15ae40 con 0x7febac0cd9e0 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac0cde50 0x7febac15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac0cde50 0x7febac15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49754/0 (socket says 172.21.15.26:49754) 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 -- 172.21.15.26:0/2882067981 learned_addr learned my addr 172.21.15.26:0/2882067981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7feba9d9b700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac0cd9e0 0x7febac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaa59c700 1 --2- 172.21.15.26:0/2882067981 >> v2:172.21.15.67:3300/0 conn(0x7febac0cb5a0 0x7febac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 -- 172.21.15.26:0/2882067981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac0cd9e0 msgr2=0x7febac159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:20.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac0cd9e0 0x7febac159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 -- 172.21.15.26:0/2882067981 >> v2:172.21.15.67:3300/0 conn(0x7febac0cb5a0 msgr2=0x7febac0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 --2- 172.21.15.26:0/2882067981 >> v2:172.21.15.67:3300/0 conn(0x7febac0cb5a0 0x7febac0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 -- 172.21.15.26:0/2882067981 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac15ab60 con 0x7febac0cde50 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7febaad9d700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cde50 0x7febac15a400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febac065120 tx=0x7feba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc051137714bbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7feba959a700 1 -- 172.21.15.26:0/2882067981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400e070 con 0x7febac0cde50 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7feba959a700 1 -- 172.21.15.26:0/2882067981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400b930 con 0x7febac0cde50 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.947+0000 7feba959a700 1 -- 172.21.15.26:0/2882067981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba40092e0 con 0x7febac0cde50 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 -- 172.21.15.26:0/2882067981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cde50 msgr2=0x7febac15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cde50 0x7febac15a400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febac065120 tx=0x7feba4009840 comp rx=0 tx=0).stop 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 -- 172.21.15.26:0/2882067981 shutdown_connections 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 --2- 172.21.15.26:0/2882067981 >> v2:172.21.15.67:3300/0 conn(0x7febac0cb5a0 0x7febac0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cde50 0x7febac15a400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 --2- 172.21.15.26:0/2882067981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac0cd9e0 0x7febac159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 -- 172.21.15.26:0/2882067981 >> 172.21.15.26:0/2882067981 conn(0x7febac070e30 msgr2=0x7febac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:20.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 -- 172.21.15.26:0/2882067981 shutdown_connections 2023-10-09T11:35:20.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.948+0000 7febb0986700 1 -- 172.21.15.26:0/2882067981 wait complete. 2023-10-09T11:35:20.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.949+0000 7febb0986700 1 Processor -- start 2023-10-09T11:35:20.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.949+0000 7febb0986700 1 -- start start 2023-10-09T11:35:20.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febac0cd9e0 0x7febac0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac16cb60 0x7febac16cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac156c60 con 0x7febac0cb5a0 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac15dc70 con 0x7febac0cd9e0 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c9020 con 0x7febac16cb60 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49766/0 (socket says 172.21.15.26:49766) 2023-10-09T11:35:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 -- 172.21.15.26:0/1799294881 learned_addr learned my addr 172.21.15.26:0/1799294881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaad9d700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac16cb60 0x7febac16cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7feba9d9b700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febac0cd9e0 0x7febac0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 -- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac16cb60 msgr2=0x7febac16cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac16cb60 0x7febac16cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 -- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febac0cd9e0 msgr2=0x7febac0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febac0cd9e0 0x7febac0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 -- 172.21.15.26:0/1799294881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4009ae0 con 0x7febac0cb5a0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febaa59c700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00ec80 tx=0x7feb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00c9d0 con 0x7febac0cb5a0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00cb30 con 0x7febac0cb5a0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac15dea0 con 0x7febac0cb5a0 2023-10-09T11:35:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c013470 con 0x7febac0cb5a0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.950+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac157150 con 0x7febac0cb5a0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.951+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac04c3c0 con 0x7febac0cb5a0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.952+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb9c013820 con 0x7febac0cb5a0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.952+0000 7feba27fc700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.952+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feb9c0845a0 con 0x7febac0cb5a0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.952+0000 7feba9d9b700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.953+0000 7feba9d9b700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 0x7feb8c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb94009d40 tx=0x7feb94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:20.956+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb9c051b60 con 0x7febac0cb5a0 2023-10-09T11:35:21.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.151+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febac0b5bc0 con 0x7febac0cb5a0 2023-10-09T11:35:21.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.152+0000 7feba27fc700 1 -- 172.21.15.26:0/1799294881 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7feb9c055180 con 0x7febac0cb5a0 2023-10-09T11:35:21.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:21.154 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:13.298795+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 msgr2=0x7feb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 0x7feb8c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb94009d40 tx=0x7feb94008040 comp rx=0 tx=0).stop 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 msgr2=0x7febac15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00ec80 tx=0x7feb9c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 shutdown_connections 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febac16cb60 0x7febac16cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0cb5a0 0x7febac15d730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 --2- 172.21.15.26:0/1799294881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febac0cd9e0 0x7febac0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 >> 172.21.15.26:0/1799294881 conn(0x7febac070e30 msgr2=0x7febac0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 shutdown_connections 2023-10-09T11:35:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.154+0000 7febb0986700 1 -- 172.21.15.26:0/1799294881 wait complete. 2023-10-09T11:35:21.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:35:21.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:21.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.288+0000 7f443a23b700 1 Processor -- start 2023-10-09T11:35:21.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.288+0000 7f443a23b700 1 -- start start 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f443a23b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4434153a00 0x7f4434153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f443a23b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443415ac50 con 0x7f44340cea00 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f443a23b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443415d010 con 0x7f443415de50 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f443a23b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443415af60 con 0x7f4434153a00 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f4439a3a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f44340cea00 0x7f44340cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56996/0 (socket says 172.21.15.26:56996) 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f4439a3a700 1 -- 172.21.15.26:0/3662786848 learned_addr learned my addr 172.21.15.26:0/3662786848 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f4439239700 1 --2- 172.21.15.26:0/3662786848 >> v2:172.21.15.67:3300/0 conn(0x7f4434153a00 0x7f4434153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134116083 0 0) 0x7f443415ac50 con 0x7f44340cea00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.289+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f441c003570 con 0x7f44340cea00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484761841 0 0) 0x7f443415d010 con 0x7f443415de50 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443415ac50 con 0x7f443415de50 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4439239700 1 -- 172.21.15.26:0/3662786848 >> v1:172.21.15.67:6789/0 conn(0x7f443415de50 legacy=0x7f443415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4439239700 1 -- 172.21.15.26:0/3662786848 >> v1:172.21.15.26:6789/0 conn(0x7f44340cea00 legacy=0x7f44340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591556626 0 0) 0x7f441c003570 con 0x7f44340cea00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4439239700 1 -- 172.21.15.26:0/3662786848 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443415b240 con 0x7f4434153a00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4439239700 1 --2- 172.21.15.26:0/3662786848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f4434153dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4424009e60 tx=0x7f4424009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c7146e4b02e908 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442400e070 con 0x7f4434153a00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442400b7a0 con 0x7f4434153a00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f4433fff700 1 -- 172.21.15.26:0/3662786848 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c001470 con 0x7f4434153a00 2023-10-09T11:35:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f443a23b700 1 -- 172.21.15.26:0/3662786848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 msgr2=0x7f4434153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f443a23b700 1 --2- 172.21.15.26:0/3662786848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f4434153dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4424009e60 tx=0x7f4424009780 comp rx=0 tx=0).stop 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f443a23b700 1 -- 172.21.15.26:0/3662786848 shutdown_connections 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f443a23b700 1 --2- 172.21.15.26:0/3662786848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f4434153dd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.290+0000 7f443a23b700 1 -- 172.21.15.26:0/3662786848 >> 172.21.15.26:0/3662786848 conn(0x7f44340703a0 msgr2=0x7f44340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.291+0000 7f443a23b700 1 -- 172.21.15.26:0/3662786848 shutdown_connections 2023-10-09T11:35:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.291+0000 7f443a23b700 1 -- 172.21.15.26:0/3662786848 wait complete. 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 Processor -- start 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 -- start start 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f44340b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 0x7f443414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.292+0000 7f443a23b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44340b0340 con 0x7f44340cea00 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f443a23b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44340b0620 con 0x7f4434153a00 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f443a23b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44341590e0 con 0x7f443415de50 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49770/0 (socket says 172.21.15.26:49770) 2023-10-09T11:35:21.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 -- 172.21.15.26:0/2902214339 learned_addr learned my addr 172.21.15.26:0/2902214339 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439a3a700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 0x7f443414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4438a38700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f44340b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 -- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 msgr2=0x7f443414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 0x7f443414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 -- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 msgr2=0x7f44340b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f44340b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 -- 172.21.15.26:0/2902214339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424009a20 con 0x7f44340cea00 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439a3a700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 0x7f443414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f4439239700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f443406eb00 tx=0x7f4424017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240129b0 con 0x7f44340cea00 2023-10-09T11:35:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424012b10 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442401e450 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44340b27e0 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.293+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4434159330 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.294+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443404c3c0 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.295+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f442401e800 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.295+0000 7f44317fa700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.295+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4424086080 con 0x7f44340cea00 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.295+0000 7f4438a38700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.296+0000 7f4438a38700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4428007fd0 tx=0x7f4428007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.300+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4424053640 con 0x7f44340cea00 2023-10-09T11:35:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.491+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44340b2ea0 con 0x7f44340cea00 2023-10-09T11:35:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.491+0000 7f44317fa700 1 -- 172.21.15.26:0/2902214339 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4424056c60 con 0x7f44340cea00 2023-10-09T11:35:21.493 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 msgr2=0x7f44200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4428007fd0 tx=0x7f4428007d10 comp rx=0 tx=0).stop 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 msgr2=0x7f4434158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f443406eb00 tx=0x7f4424017000 comp rx=0 tx=0).stop 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 shutdown_connections 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f443415de50 0x7f443414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44340cea00 0x7f4434158ba0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 --2- 172.21.15.26:0/2902214339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4434153a00 0x7f44340b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 >> 172.21.15.26:0/2902214339 conn(0x7f44340703a0 msgr2=0x7f44340c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 shutdown_connections 2023-10-09T11:35:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.493+0000 7f443a23b700 1 -- 172.21.15.26:0/2902214339 wait complete. 2023-10-09T11:35:21.506 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:35:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 Processor -- start 2023-10-09T11:35:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 -- start start 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f679c0c83e0 0x7f679c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c0c7f50 con 0x7f679c1599a0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c06b740 con 0x7f679c1595d0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.624+0000 7f67a20ee700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679c06bd00 con 0x7f679c0c83e0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f679c1599a0 0x7f679c06acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57000/0 (socket says 172.21.15.26:57000) 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679affd700 1 -- 172.21.15.26:0/3829705243 learned_addr learned my addr 172.21.15.26:0/3829705243 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679bfff700 1 --2- 172.21.15.26:0/3829705243 >> v2:172.21.15.67:3300/0 conn(0x7f679c0c83e0 0x7f679c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047708983 0 0) 0x7f679c0c7f50 con 0x7f679c1599a0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6784003570 con 0x7f679c1599a0 2023-10-09T11:35:21.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803036512 0 0) 0x7f6784003570 con 0x7f679c1599a0 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 >> v2:172.21.15.67:3300/0 conn(0x7f679c0c83e0 msgr2=0x7f679c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 --2- 172.21.15.26:0/3829705243 >> v2:172.21.15.67:3300/0 conn(0x7f679c0c83e0 0x7f679c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 >> v1:172.21.15.67:6789/0 conn(0x7f679c1595d0 legacy=0x7f679c0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c06ba20 con 0x7f679c1599a0 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f6790001470 con 0x7f679c1599a0 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 >> v1:172.21.15.26:6789/0 conn(0x7f679c1599a0 legacy=0x7f679c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 0x7f6784003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784004810 0x7f6784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67840051c0 0x7f678400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678400c0a0 con 0x7f6784003a60 2023-10-09T11:35:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678400c210 con 0x7f67840051c0 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678400c3d0 con 0x7f6784004810 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 0x7f6784003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679bfff700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67840051c0 0x7f678400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.625+0000 7f679affd700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784004810 0x7f6784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 -- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784004810 msgr2=0x7f6784004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784004810 0x7f6784004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 -- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67840051c0 msgr2=0x7f678400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67840051c0 0x7f678400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 -- 172.21.15.26:0/3829705243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784003570 con 0x7f6784003a60 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679bfff700 1 -- 172.21.15.26:0/3829705243 reap_dead start 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679affd700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784004810 0x7f6784004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 0x7f6784003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f678c0018b0 tx=0x7f678c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc6bc92cdf32248 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c012420 con 0x7f6784003a60 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c0125a0 con 0x7f6784003a60 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f679a7fc700 1 -- 172.21.15.26:0/3829705243 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c012960 con 0x7f6784003a60 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f67a20ee700 1 -- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 msgr2=0x7f6784003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 0x7f6784003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f678c0018b0 tx=0x7f678c007d30 comp rx=0 tx=0).stop 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f67a20ee700 1 -- 172.21.15.26:0/3829705243 shutdown_connections 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3829705243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6784003a60 0x7f6784003e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.626+0000 7f67a20ee700 1 -- 172.21.15.26:0/3829705243 >> 172.21.15.26:0/3829705243 conn(0x7f679c0cd400 msgr2=0x7f679c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.627+0000 7f67a20ee700 1 -- 172.21.15.26:0/3829705243 shutdown_connections 2023-10-09T11:35:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.627+0000 7f67a20ee700 1 -- 172.21.15.26:0/3829705243 wait complete. 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.628+0000 7f67a20ee700 1 Processor -- start 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.628+0000 7f67a20ee700 1 -- start start 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 0x7f679c15fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679c0b01a0 0x7f679c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1565c0 con 0x7f679c0b0610 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c0b2890 con 0x7f679c0b01a0 2023-10-09T11:35:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c160250 con 0x7f6784003a60 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49792/0 (socket says 172.21.15.26:49792) 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 -- 172.21.15.26:0/3254277582 learned_addr learned my addr 172.21.15.26:0/3254277582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679affd700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679c0b01a0 0x7f679c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 0x7f679c15fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 -- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 msgr2=0x7f679c15fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 0x7f679c15fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 -- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679c0b01a0 msgr2=0x7f679c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679c0b01a0 0x7f679c0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 -- 172.21.15.26:0/3254277582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c1559b0 con 0x7f679c0b0610 2023-10-09T11:35:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 0x7f679c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f679bfff700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67940094d0 tx=0x7f679400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400e040 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679400f040 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400fe50 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c155c90 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.629+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c156250 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.630+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c04c3c0 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.631+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6794015640 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.631+0000 7f67837fe700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 0x7f67880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.631+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6794084a40 con 0x7f679c0b0610 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.631+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 0x7f67880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.632+0000 7f679b7fe700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 0x7f67880693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f678c0018b0 tx=0x7f678c015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.635+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6794086e60 con 0x7f679c0b0610 2023-10-09T11:35:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.829+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f679c156700 con 0x7f679c0b0610 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.829+0000 7f67837fe700 1 -- 172.21.15.26:0/3254277582 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6794055b50 con 0x7f679c0b0610 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:35:21.831 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:35:21.832 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:35:21.832 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 msgr2=0x7f67880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 0x7f67880693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f678c0018b0 tx=0x7f678c015000 comp rx=0 tx=0).stop 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 msgr2=0x7f679c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67940094d0 tx=0x7f679400b040 comp rx=0 tx=0).stop 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 shutdown_connections 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f679c0b0610 0x7f679c0b2350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6788066f30 0x7f67880693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6784003a60 0x7f679c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 --2- 172.21.15.26:0/3254277582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679c0b01a0 0x7f679c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 >> 172.21.15.26:0/3254277582 conn(0x7f679c0cd400 msgr2=0x7f679c0689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 shutdown_connections 2023-10-09T11:35:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.831+0000 7f67a20ee700 1 -- 172.21.15.26:0/3254277582 wait complete. 2023-10-09T11:35:21.844 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:35:21.845 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:35:21.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.965+0000 7fc6b3525700 1 Processor -- start 2023-10-09T11:35:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.965+0000 7fc6b3525700 1 -- start start 2023-10-09T11:35:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b3525700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6ac067e50 0x7fc6ac15de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b3525700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 0x7fc6ac0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b3525700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac15d9f0 con 0x7fc6ac068220 2023-10-09T11:35:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b3525700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac15d3c0 con 0x7fc6ac067e50 2023-10-09T11:35:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b3525700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac15a8f0 con 0x7fc6ac0c8c70 2023-10-09T11:35:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b0ac0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc6ac068220 0x7fc6ac159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57006/0 (socket says 172.21.15.26:57006) 2023-10-09T11:35:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b0ac0700 1 -- 172.21.15.26:0/1691282293 learned_addr learned my addr 172.21.15.26:0/1691282293 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b1ac2700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 0x7fc6ac0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1691282293 >> v2:172.21.15.67:3300/0 conn(0x7fc6ac067e50 0x7fc6ac15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6abfff700 1 -- 172.21.15.26:0/1691282293 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477425112 0 0) 0x7fc6ac15d9f0 con 0x7fc6ac068220 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.966+0000 7fc6abfff700 1 -- 172.21.15.26:0/1691282293 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc694003570 con 0x7fc6ac068220 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 msgr2=0x7fc6ac0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 0x7fc6ac0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1691282293 >> v1:172.21.15.26:6789/0 conn(0x7fc6ac068220 legacy=0x7fc6ac159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1691282293 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac15abd0 con 0x7fc6ac067e50 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b1ac2700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 0x7fc6ac0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac067e50 0x7fc6ac15de80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40098e0 tx=0x7fc6a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=120dfa845f3c8bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6abfff700 1 -- 172.21.15.26:0/1691282293 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011630 con 0x7fc6ac067e50 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6abfff700 1 -- 172.21.15.26:0/1691282293 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4011790 con 0x7fc6ac067e50 2023-10-09T11:35:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6abfff700 1 -- 172.21.15.26:0/1691282293 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011b30 con 0x7fc6ac067e50 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b3525700 1 -- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac067e50 msgr2=0x7fc6ac15de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.967+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac067e50 0x7fc6ac15de80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40098e0 tx=0x7fc6a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 -- 172.21.15.26:0/1691282293 shutdown_connections 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac0c8c70 0x7fc6ac0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1691282293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac067e50 0x7fc6ac15de80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 -- 172.21.15.26:0/1691282293 >> 172.21.15.26:0/1691282293 conn(0x7fc6ac0ce4a0 msgr2=0x7fc6ac0ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 -- 172.21.15.26:0/1691282293 shutdown_connections 2023-10-09T11:35:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.968+0000 7fc6b3525700 1 -- 172.21.15.26:0/1691282293 wait complete. 2023-10-09T11:35:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.969+0000 7fc6b3525700 1 Processor -- start 2023-10-09T11:35:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.969+0000 7fc6b3525700 1 -- start start 2023-10-09T11:35:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac068220 0x7fc6ac16c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac0c8c70 0x7fc6ac069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0b1790 con 0x7fc6ac067e50 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac16cbb0 con 0x7fc6ac0c8c70 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c4b90 con 0x7fc6ac068220 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49800/0 (socket says 172.21.15.26:49800) 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1269033470 learned_addr learned my addr 172.21.15.26:0/1269033470 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b0ac0700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac068220 0x7fc6ac16c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b1ac2700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac0c8c70 0x7fc6ac069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac068220 msgr2=0x7fc6ac16c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac068220 0x7fc6ac16c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac0c8c70 msgr2=0x7fc6ac069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac0c8c70 0x7fc6ac069580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 -- 172.21.15.26:0/1269033470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009a20 con 0x7fc6ac067e50 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b12c1700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac067b90 tx=0x7fc6a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011b10 con 0x7fc6ac067e50 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4000cc0 con 0x7fc6ac067e50 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4025620 con 0x7fc6ac067e50 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4009420 con 0x7fc6ac067e50 2023-10-09T11:35:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.970+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac0b3c80 con 0x7fc6ac067e50 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.971+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac04c3c0 con 0x7fc6ac067e50 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.972+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6a4025a10 con 0x7fc6ac067e50 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.972+0000 7fc6a97fa700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.972+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6a4085890 con 0x7fc6ac067e50 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.972+0000 7fc6b0ac0700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.973+0000 7fc6b0ac0700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 0x7fc6980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0007fd0 tx=0x7fc6a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:21.976+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6a4052f10 con 0x7fc6ac067e50 2023-10-09T11:35:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.167+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc6ac15d680 con 0x7fc6ac067e50 2023-10-09T11:35:22.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.331+0000 7fc6a97fa700 1 -- 172.21.15.26:0/1269033470 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc6a4056530 con 0x7fc6ac067e50 2023-10-09T11:35:22.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 msgr2=0x7fc6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 0x7fc6980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0007fd0 tx=0x7fc6a0009040 comp rx=0 tx=0).stop 2023-10-09T11:35:22.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 msgr2=0x7fc6ac0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac067b90 tx=0x7fc6a4017000 comp rx=0 tx=0).stop 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 shutdown_connections 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6ac0c8c70 0x7fc6ac069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac067e50 0x7fc6ac0b1250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 --2- 172.21.15.26:0/1269033470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc6ac068220 0x7fc6ac16c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 >> 172.21.15.26:0/1269033470 conn(0x7fc6ac0ce4a0 msgr2=0x7fc6ac0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 shutdown_connections 2023-10-09T11:35:22.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.334+0000 7fc6b3525700 1 -- 172.21.15.26:0/1269033470 wait complete. 2023-10-09T11:35:22.338 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:35:22.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:35:22.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.476+0000 7f49b37fe700 1 Processor -- start 2023-10-09T11:35:22.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.476+0000 7f49b37fe700 1 -- start start 2023-10-09T11:35:22.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 0x7f49ac0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 0x7f49ac0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b37fe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0adbc0 con 0x7f49ac0b0f80 2023-10-09T11:35:22.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b37fe700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0b1400 con 0x7f49ac0c8800 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b37fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c9d30 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f49ac0b0f80 0x7f49ac0ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57020/0 (socket says 172.21.15.26:57020) 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b1d9b700 1 -- 172.21.15.26:0/959103185 learned_addr learned my addr 172.21.15.26:0/959103185 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b159a700 1 --2- 172.21.15.26:0/959103185 >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 0x7f49ac0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b0d99700 1 --2- 172.21.15.26:0/959103185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 0x7f49ac0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175644824 0 0) 0x7f49ac0adbc0 con 0x7f49ac0b0f80 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4994003570 con 0x7f49ac0b0f80 2023-10-09T11:35:22.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b0d99700 1 -- 172.21.15.26:0/959103185 >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 msgr2=0x7f49ac0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b0d99700 1 --2- 172.21.15.26:0/959103185 >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 0x7f49ac0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330248964 0 0) 0x7f4994003570 con 0x7f49ac0b0f80 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b0d99700 1 -- 172.21.15.26:0/959103185 >> v1:172.21.15.26:6789/0 conn(0x7f49ac0b0f80 legacy=0x7f49ac0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b0d99700 1 -- 172.21.15.26:0/959103185 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0acfb0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.477+0000 7f49b159a700 1 --2- 172.21.15.26:0/959103185 >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 0x7f49ac0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b0d99700 1 --2- 172.21.15.26:0/959103185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 0x7f49ac0b0a40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a95b10e68e048ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4001470 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0011420 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49abfff700 1 -- 172.21.15.26:0/959103185 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a00117a0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 -- 172.21.15.26:0/959103185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 msgr2=0x7f49ac0b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 --2- 172.21.15.26:0/959103185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 0x7f49ac0b0a40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 -- 172.21.15.26:0/959103185 shutdown_connections 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 --2- 172.21.15.26:0/959103185 >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c8800 0x7f49ac0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 --2- 172.21.15.26:0/959103185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8bd0 0x7f49ac0b0a40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 -- 172.21.15.26:0/959103185 >> 172.21.15.26:0/959103185 conn(0x7f49ac06d170 msgr2=0x7f49ac0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.478+0000 7f49b37fe700 1 -- 172.21.15.26:0/959103185 shutdown_connections 2023-10-09T11:35:22.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.479+0000 7f49b37fe700 1 -- 172.21.15.26:0/959103185 wait complete. 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.480+0000 7f49b37fe700 1 Processor -- start 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.480+0000 7f49b37fe700 1 -- start start 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.480+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0b0f80 0x7f49ac158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.480+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8800 0x7f49ac157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac1547f0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac150270 con 0x7f49ac0b0f80 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac153be0 con 0x7f49ac0c8800 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49802/0 (socket says 172.21.15.26:49802) 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 -- 172.21.15.26:0/1259661575 learned_addr learned my addr 172.21.15.26:0/1259661575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:22.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b0d99700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8800 0x7f49ac157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b159a700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0b0f80 0x7f49ac158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 -- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8800 msgr2=0x7f49ac157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8800 0x7f49ac157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 -- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0b0f80 msgr2=0x7f49ac158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0b0f80 0x7f49ac158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 -- 172.21.15.26:0/1259661575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009a20 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b1d9b700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c810 tx=0x7f49a4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4007360 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a40074e0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0009420 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4004830 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.481+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac1541a0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.482+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac154960 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.483+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49a4004c00 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.483+0000 7f49a97fa700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 0x7f49980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.483+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f49a4083970 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.483+0000 7f49b159a700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 0x7f49980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:22.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.484+0000 7f49b159a700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 0x7f49980693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f499c00f650 tx=0x7f499c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:22.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.488+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49a4050da0 con 0x7f49ac0c8bd0 2023-10-09T11:35:22.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:22.680+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49ac04c3c0 con 0x7f49ac0c8bd0 2023-10-09T11:35:23.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.340+0000 7f49a97fa700 1 -- 172.21.15.26:0/1259661575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49a4018020 con 0x7f49ac0c8bd0 2023-10-09T11:35:23.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.345+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 msgr2=0x7f49980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.345+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 0x7f49980693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f499c00f650 tx=0x7f499c00b040 comp rx=0 tx=0).stop 2023-10-09T11:35:23.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.345+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 msgr2=0x7f49ac158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.345+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c810 tx=0x7f49a4001970 comp rx=0 tx=0).stop 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 shutdown_connections 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49ac0c8bd0 0x7f49ac158220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0b0f80 0x7f49ac158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4998066f30 0x7f49980693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1259661575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c8800 0x7f49ac157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.346+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 >> 172.21.15.26:0/1259661575 conn(0x7f49ac06d170 msgr2=0x7f49ac0c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.349+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 shutdown_connections 2023-10-09T11:35:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.349+0000 7f49b37fe700 1 -- 172.21.15.26:0/1259661575 wait complete. 2023-10-09T11:35:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:35:23.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:35:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.496+0000 7f1c8d245700 1 Processor -- start 2023-10-09T11:35:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.496+0000 7f1c8d245700 1 -- start start 2023-10-09T11:35:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8d245700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1c880cf110 0x7f1c8815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8d245700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8815ac50 con 0x7f1c88153dd0 2023-10-09T11:35:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8d245700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8815d010 con 0x7f1c88153a00 2023-10-09T11:35:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8d245700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8815af60 con 0x7f1c880cf110 2023-10-09T11:35:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c877fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c88153dd0 0x7f1c880cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57026/0 (socket says 172.21.15.26:57026) 2023-10-09T11:35:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c877fe700 1 -- 172.21.15.26:0/4051298947 learned_addr learned my addr 172.21.15.26:0/4051298947 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8ca44700 1 --2- 172.21.15.26:0/4051298947 >> v2:172.21.15.67:3300/0 conn(0x7f1c880cf110 0x7f1c8815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626506060 0 0) 0x7f1c8815ac50 con 0x7f1c88153dd0 2023-10-09T11:35:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c74003570 con 0x7f1c88153dd0 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709541120 0 0) 0x7f1c8815d010 con 0x7f1c88153a00 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8815ac50 con 0x7f1c88153a00 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8ca44700 1 -- 172.21.15.26:0/4051298947 >> v1:172.21.15.67:6789/0 conn(0x7f1c88153a00 legacy=0x7f1c8815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8ca44700 1 -- 172.21.15.26:0/4051298947 >> v1:172.21.15.26:6789/0 conn(0x7f1c88153dd0 legacy=0x7f1c880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.497+0000 7f1c8ca44700 1 -- 172.21.15.26:0/4051298947 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8815b240 con 0x7f1c880cf110 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8ca44700 1 --2- 172.21.15.26:0/4051298947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c8815de50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009e60 tx=0x7f1c80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d562d687426efa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000e070 con 0x7f1c880cf110 2023-10-09T11:35:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8000bab0 con 0x7f1c880cf110 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c86ffd700 1 -- 172.21.15.26:0/4051298947 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000be70 con 0x7f1c880cf110 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 -- 172.21.15.26:0/4051298947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 msgr2=0x7f1c8815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 --2- 172.21.15.26:0/4051298947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c8815de50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009e60 tx=0x7f1c80009780 comp rx=0 tx=0).stop 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 -- 172.21.15.26:0/4051298947 shutdown_connections 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 --2- 172.21.15.26:0/4051298947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c8815de50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 -- 172.21.15.26:0/4051298947 >> 172.21.15.26:0/4051298947 conn(0x7f1c880703a0 msgr2=0x7f1c880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 -- 172.21.15.26:0/4051298947 shutdown_connections 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.498+0000 7f1c8d245700 1 -- 172.21.15.26:0/4051298947 wait complete. 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.499+0000 7f1c8d245700 1 Processor -- start 2023-10-09T11:35:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 -- start start 2023-10-09T11:35:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c880cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c88153a00 0x7f1c880c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c8a20 con 0x7f1c88153dd0 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c7e10 con 0x7f1c880cf110 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8d245700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c80f0 con 0x7f1c88153a00 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.500+0000 7f1c8ca44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49818/0 (socket says 172.21.15.26:49818) 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 -- 172.21.15.26:0/3961410052 learned_addr learned my addr 172.21.15.26:0/3961410052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c87fff700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c880cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c877fe700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c88153a00 0x7f1c880c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 -- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c88153a00 msgr2=0x7f1c880c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c88153a00 0x7f1c880c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 -- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 msgr2=0x7f1c880cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c880cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 -- 172.21.15.26:0/3961410052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80009a20 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8ca44700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c80013000 tx=0x7f1c80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80012db0 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c80026480 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c880c83d0 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80026840 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.501+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c880c7b20 con 0x7f1c88153dd0 2023-10-09T11:35:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.502+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8804c3c0 con 0x7f1c88153dd0 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.503+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c8001c400 con 0x7f1c88153dd0 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.503+0000 7f1c7ffff700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.503+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f1c80086360 con 0x7f1c88153dd0 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.503+0000 7f1c87fff700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.504+0000 7f1c87fff700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 0x7f1c680693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c78007fd0 tx=0x7f1c78007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.508+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c80053630 con 0x7f1c88153dd0 2023-10-09T11:35:23.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:23.747+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1c8815b520 con 0x7f1c88153dd0 2023-10-09T11:35:24.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.342+0000 7f1c7ffff700 1 -- 172.21.15.26:0/3961410052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1c80056c50 con 0x7f1c88153dd0 2023-10-09T11:35:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.350+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 msgr2=0x7f1c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.350+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 0x7f1c680693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c78007fd0 tx=0x7f1c78007d50 comp rx=0 tx=0).stop 2023-10-09T11:35:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.350+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 msgr2=0x7f1c88145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.350+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c80013000 tx=0x7f1c80019000 comp rx=0 tx=0).stop 2023-10-09T11:35:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 shutdown_connections 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c88153dd0 0x7f1c88145e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c880cf110 0x7f1c880cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 --2- 172.21.15.26:0/3961410052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c88153a00 0x7f1c880c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.351+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 >> 172.21.15.26:0/3961410052 conn(0x7f1c880703a0 msgr2=0x7f1c880b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.352+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 shutdown_connections 2023-10-09T11:35:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.352+0000 7f1c8d245700 1 -- 172.21.15.26:0/3961410052 wait complete. 2023-10-09T11:35:24.354 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T11:35:24.368 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:24.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.490+0000 7f951d961700 1 Processor -- start 2023-10-09T11:35:24.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.490+0000 7f951d961700 1 -- start start 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95181594d0 0x7f95180cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f95180cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95181598a0 0x7f95180ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951815e010 con 0x7f95181598a0 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951815d420 con 0x7f95181594d0 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f951d961700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951815d6e0 con 0x7f95180cb1a0 2023-10-09T11:35:24.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95181598a0 0x7f95180ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95181598a0 0x7f95180ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49826/0 (socket says 172.21.15.26:49826) 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 -- 172.21.15.26:0/3650953091 learned_addr learned my addr 172.21.15.26:0/3650953091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95167fc700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f95180cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f9516ffd700 1 --2- 172.21.15.26:0/3650953091 >> v2:172.21.15.67:3300/0 conn(0x7f95181594d0 0x7f95180cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 -- 172.21.15.26:0/3650953091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 msgr2=0x7f95180cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f95180cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 -- 172.21.15.26:0/3650953091 >> v2:172.21.15.67:3300/0 conn(0x7f95181594d0 msgr2=0x7f95180cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 --2- 172.21.15.26:0/3650953091 >> v2:172.21.15.67:3300/0 conn(0x7f95181594d0 0x7f95180cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 -- 172.21.15.26:0/3650953091 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951815d9c0 con 0x7f95181598a0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.491+0000 7f95177fe700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181598a0 0x7f95180ccfc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9518089440 tx=0x7f9510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0b7c0d07cd312f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f9515ffb700 1 -- 172.21.15.26:0/3650953091 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000e070 con 0x7f95181598a0 2023-10-09T11:35:24.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f9515ffb700 1 -- 172.21.15.26:0/3650953091 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b970 con 0x7f95181598a0 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f9515ffb700 1 -- 172.21.15.26:0/3650953091 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100092e0 con 0x7f95181598a0 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 -- 172.21.15.26:0/3650953091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181598a0 msgr2=0x7f95180ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181598a0 0x7f95180ccfc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9518089440 tx=0x7f9510009840 comp rx=0 tx=0).stop 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 -- 172.21.15.26:0/3650953091 shutdown_connections 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 --2- 172.21.15.26:0/3650953091 >> v2:172.21.15.67:3300/0 conn(0x7f95181594d0 0x7f95180cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181598a0 0x7f95180ccfc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 --2- 172.21.15.26:0/3650953091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f95180cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 -- 172.21.15.26:0/3650953091 >> 172.21.15.26:0/3650953091 conn(0x7f95180703a0 msgr2=0x7f9518070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 -- 172.21.15.26:0/3650953091 shutdown_connections 2023-10-09T11:35:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.492+0000 7f951d961700 1 -- 172.21.15.26:0/3650953091 wait complete. 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 Processor -- start 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 -- start start 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f9518149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95181598a0 0x7f95180c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180b4450 con 0x7f95181594d0 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180b3840 con 0x7f95181598a0 2023-10-09T11:35:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f951d961700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180b3b20 con 0x7f95180cb1a0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f95167fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f95167fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49838/0 (socket says 172.21.15.26:49838) 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.494+0000 7f95167fc700 1 -- 172.21.15.26:0/237029657 learned_addr learned my addr 172.21.15.26:0/237029657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f9516ffd700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f9518149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95177fe700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95181598a0 0x7f95180c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 -- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 msgr2=0x7f9518149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f9518149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 -- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95181598a0 msgr2=0x7f95180c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95181598a0 0x7f95180c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 -- 172.21.15.26:0/237029657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009ae0 con 0x7f95181594d0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f95167fc700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f950000ec80 tx=0x7f95000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000c850 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950000c9b0 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95180b3e00 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000cd50 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.495+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95180b4e20 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.496+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951804c3c0 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.496+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9500013680 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.497+0000 7f950effd700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 0x7f94f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.497+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95000847b0 con 0x7f95181594d0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.497+0000 7f9516ffd700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 0x7f94f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.498+0000 7f9516ffd700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 0x7f94f80693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95180b61f0 tx=0x7f95080091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.501+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9500051a20 con 0x7f95181594d0 2023-10-09T11:35:24.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.695+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f951815dca0 con 0x7f95181594d0 2023-10-09T11:35:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.696+0000 7f950effd700 1 -- 172.21.15.26:0/237029657 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9500055040 con 0x7f95181594d0 2023-10-09T11:35:24.698 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:24.698 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:23.748823+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 msgr2=0x7f94f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 0x7f94f80693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95180b61f0 tx=0x7f95080091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 msgr2=0x7f95180b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f950000ec80 tx=0x7f95000091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 shutdown_connections 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95181598a0 0x7f95180c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f94f8066f30 0x7f94f80693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95180cb1a0 0x7f9518149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 --2- 172.21.15.26:0/237029657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95181594d0 0x7f95180b48e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.698+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 >> 172.21.15.26:0/237029657 conn(0x7f95180703a0 msgr2=0x7f95181539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.699+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 shutdown_connections 2023-10-09T11:35:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.699+0000 7f951d961700 1 -- 172.21.15.26:0/237029657 wait complete. 2023-10-09T11:35:24.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.829+0000 7f9e54742700 1 Processor -- start 2023-10-09T11:35:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.829+0000 7f9e54742700 1 -- start start 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e54742700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c0cb5a0 0x7f9e4c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e54742700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e4c0cde50 0x7f9e4c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e54742700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c15ae40 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e54742700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c0d13f0 con 0x7f9e4c0cde50 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e54742700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c15ab60 con 0x7f9e4c0cb5a0 2023-10-09T11:35:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e52cdf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e4c0cde50 0x7f9e4c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e51cdd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e4c0cd9e0 0x7f9e4c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57042/0 (socket says 172.21.15.26:57042) 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e52cdf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e4c0cde50 0x7f9e4c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49848/0 (socket says 172.21.15.26:49848) 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.830+0000 7f9e51cdd700 1 -- 172.21.15.26:0/2876159756 learned_addr learned my addr 172.21.15.26:0/2876159756 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e524de700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c0cb5a0 0x7f9e4c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e52cdf700 1 -- 172.21.15.26:0/2876159756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c0cb5a0 msgr2=0x7f9e4c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e52cdf700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c0cb5a0 0x7f9e4c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e52cdf700 1 -- 172.21.15.26:0/2876159756 >> v1:172.21.15.26:6789/0 conn(0x7f9e4c0cd9e0 legacy=0x7f9e4c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e52cdf700 1 -- 172.21.15.26:0/2876159756 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0ccf00 con 0x7f9e4c0cde50 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e514dc700 1 -- 172.21.15.26:0/2876159756 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296702891 0 0) 0x7f9e4c15ae40 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e52cdf700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cde50 0x7f9e4c156e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009e60 tx=0x7f9e44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8693fc7720fa34fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e514dc700 1 -- 172.21.15.26:0/2876159756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400e070 con 0x7f9e4c0cde50 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e514dc700 1 -- 172.21.15.26:0/2876159756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4400bc30 con 0x7f9e4c0cde50 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e514dc700 1 -- 172.21.15.26:0/2876159756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44012430 con 0x7f9e4c0cde50 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e54742700 1 -- 172.21.15.26:0/2876159756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cde50 msgr2=0x7f9e4c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.831+0000 7f9e54742700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cde50 0x7f9e4c156e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009e60 tx=0x7f9e44009780 comp rx=0 tx=0).stop 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 -- 172.21.15.26:0/2876159756 shutdown_connections 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cde50 0x7f9e4c156e90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 --2- 172.21.15.26:0/2876159756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c0cb5a0 0x7f9e4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 -- 172.21.15.26:0/2876159756 >> 172.21.15.26:0/2876159756 conn(0x7f9e4c070e30 msgr2=0x7f9e4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 -- 172.21.15.26:0/2876159756 shutdown_connections 2023-10-09T11:35:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.832+0000 7f9e54742700 1 -- 172.21.15.26:0/2876159756 wait complete. 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 Processor -- start 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 -- start start 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e4c0cb5a0 0x7f9e4c15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c1589f0 0x7f9e4c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0c7cc0 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c15cdd0 con 0x7f9e4c0cb5a0 2023-10-09T11:35:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.833+0000 7f9e54742700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1691b0 con 0x7f9e4c1589f0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49864/0 (socket says 172.21.15.26:49864) 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 -- 172.21.15.26:0/2649877652 learned_addr learned my addr 172.21.15.26:0/2649877652 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 -- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c1589f0 msgr2=0x7f9e4c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e524de700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e4c0cb5a0 0x7f9e4c15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e52cdf700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c1589f0 0x7f9e4c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c1589f0 0x7f9e4c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 -- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e4c0cb5a0 msgr2=0x7f9e4c15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e4c0cb5a0 0x7f9e4c15c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 -- 172.21.15.26:0/2649877652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009a20 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e51cdd700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c7e0 tx=0x7f9e40007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40005b30 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40005c90 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c15d080 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40007300 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.834+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c15d640 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.835+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c0c7e70 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.835+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e4001b400 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.836+0000 7f9e4a7fc700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.836+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e40083fe0 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.836+0000 7f9e524de700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.836+0000 7f9e524de700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c006fd0 tx=0x7f9e3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:24.840+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e4c0c7e70 con 0x7f9e4c0cd9e0 2023-10-09T11:35:24.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:24.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.037+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e4c04c3c0 con 0x7f9e4c0cd9e0 2023-10-09T11:35:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.038+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/2649877652 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9e40054d60 con 0x7f9e4c0cd9e0 2023-10-09T11:35:25.040 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:25.040 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:23.748823+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 msgr2=0x7f9e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c006fd0 tx=0x7f9e3c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 msgr2=0x7f9e4c15c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c7e0 tx=0x7f9e40007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 shutdown_connections 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e4c1589f0 0x7f9e4c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e4c0cb5a0 0x7f9e4c15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 --2- 172.21.15.26:0/2649877652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4c0cd9e0 0x7f9e4c15c890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 >> 172.21.15.26:0/2649877652 conn(0x7f9e4c070e30 msgr2=0x7f9e4c0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 shutdown_connections 2023-10-09T11:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.040+0000 7f9e54742700 1 -- 172.21.15.26:0/2649877652 wait complete. 2023-10-09T11:35:25.054 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:35:25.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.175+0000 7f7589449700 1 Processor -- start 2023-10-09T11:35:25.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 -- start start 2023-10-09T11:35:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f75840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f758406dc70 0x7f7584159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f758406e0e0 0x7f75840cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840ccfd0 con 0x7f758406e0e0 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840cf0e0 con 0x7f758406dc70 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f7589449700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758415a3d0 con 0x7f7584159530 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.176+0000 7f75837fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f758406e0e0 0x7f75840cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f758406e0e0 0x7f75840cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49872/0 (socket says 172.21.15.26:49872) 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 -- 172.21.15.26:0/2351129185 learned_addr learned my addr 172.21.15.26:0/2351129185 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f7582ffd700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f75840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75827fc700 1 --2- 172.21.15.26:0/2351129185 >> v2:172.21.15.67:3300/0 conn(0x7f758406dc70 0x7f7584159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 -- 172.21.15.26:0/2351129185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 msgr2=0x7f75840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f75840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 -- 172.21.15.26:0/2351129185 >> v2:172.21.15.67:3300/0 conn(0x7f758406dc70 msgr2=0x7f7584159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 --2- 172.21.15.26:0/2351129185 >> v2:172.21.15.67:3300/0 conn(0x7f758406dc70 0x7f7584159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 -- 172.21.15.26:0/2351129185 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758415a6b0 con 0x7f758406e0e0 2023-10-09T11:35:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f75837fe700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406e0e0 0x7f75840cb6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75840713a0 tx=0x7f757c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941db40a03b98c5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f7581ffb700 1 -- 172.21.15.26:0/2351129185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00e070 con 0x7f758406e0e0 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f7581ffb700 1 -- 172.21.15.26:0/2351129185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00b970 con 0x7f758406e0e0 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.177+0000 7f7581ffb700 1 -- 172.21.15.26:0/2351129185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0092e0 con 0x7f758406e0e0 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 -- 172.21.15.26:0/2351129185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406e0e0 msgr2=0x7f75840cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406e0e0 0x7f75840cb6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75840713a0 tx=0x7f757c009840 comp rx=0 tx=0).stop 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 -- 172.21.15.26:0/2351129185 shutdown_connections 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406e0e0 0x7f75840cb6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 --2- 172.21.15.26:0/2351129185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f75840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 --2- 172.21.15.26:0/2351129185 >> v2:172.21.15.67:3300/0 conn(0x7f758406dc70 0x7f7584159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 -- 172.21.15.26:0/2351129185 >> 172.21.15.26:0/2351129185 conn(0x7f75840703a0 msgr2=0x7f75840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 -- 172.21.15.26:0/2351129185 shutdown_connections 2023-10-09T11:35:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.178+0000 7f7589449700 1 -- 172.21.15.26:0/2351129185 wait complete. 2023-10-09T11:35:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.179+0000 7f7589449700 1 Processor -- start 2023-10-09T11:35:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.179+0000 7f7589449700 1 -- start start 2023-10-09T11:35:25.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 0x7f758415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f758415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b4c40 con 0x7f758406dc70 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b5a50 con 0x7f758406e0e0 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7589449700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b4e40 con 0x7f7584159530 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49878/0 (socket says 172.21.15.26:49878) 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 -- 172.21.15.26:0/2329833620 learned_addr learned my addr 172.21.15.26:0/2329833620 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:25.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f75837fe700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f758415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f75827fc700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 0x7f758415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 -- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 msgr2=0x7f758415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f758415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 -- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 msgr2=0x7f758415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 0x7f758415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 -- 172.21.15.26:0/2329833620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009ae0 con 0x7f758406dc70 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f75827fc700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 0x7f758415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.180+0000 7f7582ffd700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f757400e950 tx=0x7f75740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574013680 con 0x7f758406dc70 2023-10-09T11:35:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740137e0 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574013ba0 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75840b5120 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75840b56e0 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.181+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840b6420 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.182+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f757400c490 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.182+0000 7f757affd700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 0x7f75640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.183+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7574084750 con 0x7f758406dc70 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.183+0000 7f75827fc700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 0x7f75640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.183+0000 7f75827fc700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 0x7f75640693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75840caca0 tx=0x7f756c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:25.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.187+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7574051920 con 0x7f758406dc70 2023-10-09T11:35:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:25.425+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f758404c3c0 con 0x7f758406dc70 2023-10-09T11:35:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.356+0000 7f757affd700 1 -- 172.21.15.26:0/2329833620 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7574054f40 con 0x7f758406dc70 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 msgr2=0x7f75640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 0x7f75640693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75840caca0 tx=0x7f756c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 msgr2=0x7f75840b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f757400e950 tx=0x7f75740091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 shutdown_connections 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7564066f30 0x7f75640693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7584159530 0x7f758415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f758406dc70 0x7f75840b5ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 --2- 172.21.15.26:0/2329833620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758406e0e0 0x7f758415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 >> 172.21.15.26:0/2329833620 conn(0x7f75840703a0 msgr2=0x7f75840d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 shutdown_connections 2023-10-09T11:35:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.359+0000 7f7589449700 1 -- 172.21.15.26:0/2329833620 wait complete. 2023-10-09T11:35:26.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:35:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.502+0000 7ff61605e700 1 Processor -- start 2023-10-09T11:35:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.502+0000 7ff61605e700 1 -- start start 2023-10-09T11:35:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff61605e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff61006dc70 0x7ff610159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff61605e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff61006e0e0 0x7ff6100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff61605e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100ccfd0 con 0x7ff610159530 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff61605e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61015a3d0 con 0x7ff61006dc70 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff61605e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61015a6b0 con 0x7ff61006e0e0 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff60effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff61006dc70 0x7ff610159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff60f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff610159530 0x7ff6100ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57058/0 (socket says 172.21.15.26:57058) 2023-10-09T11:35:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.503+0000 7ff60f7fe700 1 -- 172.21.15.26:0/2689941403 learned_addr learned my addr 172.21.15.26:0/2689941403 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60ffff700 1 --2- 172.21.15.26:0/2689941403 >> v2:172.21.15.67:3300/0 conn(0x7ff61006e0e0 0x7ff6100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60effd700 1 -- 172.21.15.26:0/2689941403 >> v2:172.21.15.67:3300/0 conn(0x7ff61006e0e0 msgr2=0x7ff6100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60effd700 1 --2- 172.21.15.26:0/2689941403 >> v2:172.21.15.67:3300/0 conn(0x7ff61006e0e0 0x7ff6100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60effd700 1 -- 172.21.15.26:0/2689941403 >> v1:172.21.15.26:6789/0 conn(0x7ff610159530 legacy=0x7ff6100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60effd700 1 -- 172.21.15.26:0/2689941403 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61015a990 con 0x7ff61006dc70 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60e7fc700 1 -- 172.21.15.26:0/2689941403 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627969558 0 0) 0x7ff6100ccfd0 con 0x7ff610159530 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60effd700 1 --2- 172.21.15.26:0/2689941403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006dc70 0x7ff610159900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6100cf2b0 tx=0x7ff6040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593812ba7bcc3b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60e7fc700 1 -- 172.21.15.26:0/2689941403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400b6b0 con 0x7ff61006dc70 2023-10-09T11:35:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60e7fc700 1 -- 172.21.15.26:0/2689941403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400b810 con 0x7ff61006dc70 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.504+0000 7ff60e7fc700 1 -- 172.21.15.26:0/2689941403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400bbb0 con 0x7ff61006dc70 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 -- 172.21.15.26:0/2689941403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006dc70 msgr2=0x7ff610159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 --2- 172.21.15.26:0/2689941403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006dc70 0x7ff610159900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6100cf2b0 tx=0x7ff6040091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 -- 172.21.15.26:0/2689941403 shutdown_connections 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 --2- 172.21.15.26:0/2689941403 >> v2:172.21.15.67:3300/0 conn(0x7ff61006e0e0 0x7ff6100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 --2- 172.21.15.26:0/2689941403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006dc70 0x7ff610159900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 -- 172.21.15.26:0/2689941403 >> 172.21.15.26:0/2689941403 conn(0x7ff6100703a0 msgr2=0x7ff6100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 -- 172.21.15.26:0/2689941403 shutdown_connections 2023-10-09T11:35:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.505+0000 7ff61605e700 1 -- 172.21.15.26:0/2689941403 wait complete. 2023-10-09T11:35:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.506+0000 7ff61605e700 1 Processor -- start 2023-10-09T11:35:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.506+0000 7ff61605e700 1 -- start start 2023-10-09T11:35:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 0x7ff61014c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610159530 0x7ff610153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610152e80 con 0x7ff61006e0e0 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610155760 con 0x7ff610159530 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff610152270 con 0x7ff61006dc70 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49896/0 (socket says 172.21.15.26:49896) 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 -- 172.21.15.26:0/2551030566 learned_addr learned my addr 172.21.15.26:0/2551030566 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60f7fe700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 0x7ff61014c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60ffff700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610159530 0x7ff610153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 -- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 msgr2=0x7ff61014c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 0x7ff61014c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 -- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610159530 msgr2=0x7ff610153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610159530 0x7ff610153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 -- 172.21.15.26:0/2551030566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009420 con 0x7ff61006e0e0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60f7fe700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 0x7ff61014c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff60effd700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff610089650 tx=0x7ff604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400b980 con 0x7ff61006e0e0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400bb00 con 0x7ff61006e0e0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff610152550 con 0x7ff61006e0e0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604025670 con 0x7ff61006e0e0 2023-10-09T11:35:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.507+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff610152b10 con 0x7ff61006e0e0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.508+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61004c3c0 con 0x7ff61006e0e0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.509+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff604023070 con 0x7ff61006e0e0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.509+0000 7ff5f77fe700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 0x7ff5fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.509+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff604085bd0 con 0x7ff61006e0e0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.509+0000 7ff60f7fe700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 0x7ff5fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.510+0000 7ff60f7fe700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 0x7ff5fc0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff600001810 tx=0x7ff600009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.513+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff604052e40 con 0x7ff61006e0e0 2023-10-09T11:35:26.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:26.753+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff61015ac70 con 0x7ff61006e0e0 2023-10-09T11:35:27.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.362+0000 7ff5f77fe700 1 -- 172.21.15.26:0/2551030566 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6040150c0 con 0x7ff61006e0e0 2023-10-09T11:35:27.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 msgr2=0x7ff5fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 0x7ff5fc0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff600001810 tx=0x7ff600009040 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 msgr2=0x7ff610153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff610089650 tx=0x7ff604017000 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 shutdown_connections 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610159530 0x7ff610153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff5fc066f30 0x7ff5fc0693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff61006dc70 0x7ff61014c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 --2- 172.21.15.26:0/2551030566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61006e0e0 0x7ff610153620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 >> 172.21.15.26:0/2551030566 conn(0x7ff6100703a0 msgr2=0x7ff61014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 shutdown_connections 2023-10-09T11:35:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.365+0000 7ff61605e700 1 -- 172.21.15.26:0/2551030566 wait complete. 2023-10-09T11:35:27.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:27.441 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-10-09T11:35:27.439+0000 7fb854ae8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:35:27.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.505+0000 7f0dce4b9700 1 Processor -- start 2023-10-09T11:35:27.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.505+0000 7f0dce4b9700 1 -- start start 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dce4b9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815a5d0 0x7f0dc8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dce4b9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815ae40 con 0x7f0dc80cb970 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dce4b9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815ab60 con 0x7f0dc80cb5a0 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dce4b9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ce0f0 con 0x7f0dc815a5d0 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0dc80cb970 0x7f0dc8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57060/0 (socket says 172.21.15.26:57060) 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc77fe700 1 -- 172.21.15.26:0/543045480 learned_addr learned my addr 172.21.15.26:0/543045480 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815a5d0 0x7f0dc8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878237215 0 0) 0x7f0dc815ae40 con 0x7f0dc80cb970 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db0003570 con 0x7f0dc80cb970 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448684062 0 0) 0x7f0dc815ab60 con 0x7f0dc80cb5a0 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc815ae40 con 0x7f0dc80cb5a0 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2831969216 0 0) 0x7f0db0003570 con 0x7f0dc80cb970 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815a5d0 msgr2=0x7f0dc8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815a5d0 0x7f0dc8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 >> v1:172.21.15.67:6789/0 conn(0x7f0dc80cb5a0 legacy=0x7f0dc80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80ccf00 con 0x7f0dc80cb970 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.506+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f0db8001470 con 0x7f0dc80cb970 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 >> v1:172.21.15.26:6789/0 conn(0x7f0dc80cb970 legacy=0x7f0dc8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0003c20 0x7f0db0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0db0004810 0x7f0db0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db00051c0 0x7f0db000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ce0f0 con 0x7f0db00051c0 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db000c020 con 0x7f0db0003c20 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db000c1e0 con 0x7f0db0004810 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815a5d0 0x7f0dc8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db00051c0 0x7f0db000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc7fff700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0003c20 0x7f0db0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc77fe700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0db0004810 0x7f0db0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 -- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0db0004810 msgr2=0x7f0db0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0db0004810 0x7f0db0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 -- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0003c20 msgr2=0x7f0db0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:27.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0003c20 0x7f0db0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 -- 172.21.15.26:0/543045480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0003570 con 0x7f0db00051c0 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dcca56700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db00051c0 0x7f0db000ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dc815a9a0 tx=0x7f0dc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4768a4ab30bd59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000eaa0 con 0x7f0db00051c0 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000f040 con 0x7f0db00051c0 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.507+0000 7f0dc6ffd700 1 -- 172.21.15.26:0/543045480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000ee30 con 0x7f0db00051c0 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 -- 172.21.15.26:0/543045480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db00051c0 msgr2=0x7f0db000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/543045480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db00051c0 0x7f0db000ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dc815a9a0 tx=0x7f0dc000b040 comp rx=0 tx=0).stop 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dcca56700 1 -- 172.21.15.26:0/543045480 reap_dead start 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 -- 172.21.15.26:0/543045480 shutdown_connections 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 -- 172.21.15.26:0/543045480 >> 172.21.15.26:0/543045480 conn(0x7f0dc8070e30 msgr2=0x7f0dc80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 -- 172.21.15.26:0/543045480 shutdown_connections 2023-10-09T11:35:27.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.508+0000 7f0dce4b9700 1 -- 172.21.15.26:0/543045480 wait complete. 2023-10-09T11:35:27.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.509+0000 7f0dce4b9700 1 Processor -- start 2023-10-09T11:35:27.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.509+0000 7f0dce4b9700 1 -- start start 2023-10-09T11:35:27.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815ccd0 0x7f0dc80c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 0x7f0dc80c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8169b40 con 0x7f0dc8156190 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8169d30 con 0x7f0dc8156560 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dce4b9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8158860 con 0x7f0dc815ccd0 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49904/0 (socket says 172.21.15.26:49904) 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 -- 172.21.15.26:0/2370671331 learned_addr learned my addr 172.21.15.26:0/2370671331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc77fe700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815ccd0 0x7f0dc80c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dcca56700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 0x7f0dc80c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 -- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815ccd0 msgr2=0x7f0dc80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815ccd0 0x7f0dc80c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 -- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 msgr2=0x7f0dc80c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 0x7f0dc80c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 -- 172.21.15.26:0/2370671331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8157fc0 con 0x7f0dc8156190 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dcca56700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 0x7f0dc80c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.510+0000 7f0dc7fff700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00f930 tx=0x7f0dbc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.511+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00d610 con 0x7f0dc8156190 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.511+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00d770 con 0x7f0dc8156190 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.511+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00db30 con 0x7f0dc8156190 2023-10-09T11:35:27.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.511+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc81582a0 con 0x7f0dc8156190 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.511+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc8157b60 con 0x7f0dc8156190 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.512+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8169f30 con 0x7f0dc8156190 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.512+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dbc01c400 con 0x7f0dc8156190 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.512+0000 7f0daffff700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 0x7f0db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.512+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0dbc0848c0 con 0x7f0dc8156190 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.513+0000 7f0dc77fe700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 0x7f0db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.513+0000 7f0dc77fe700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 0x7f0db40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dc815d0a0 tx=0x7f0db8001df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.517+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dc8169f30 con 0x7f0dc8156190 2023-10-09T11:35:27.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.755+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc804c3c0 con 0x7f0dc8156190 2023-10-09T11:35:27.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.755+0000 7f0daffff700 1 -- 172.21.15.26:0/2370671331 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f0dbc017020 con 0x7f0dc8156190 2023-10-09T11:35:27.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:27.757 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:27.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 msgr2=0x7f0db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 0x7f0db40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dc815d0a0 tx=0x7f0db8001df0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 msgr2=0x7f0dc8157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00f930 tx=0x7f0dbc007d10 comp rx=0 tx=0).stop 2023-10-09T11:35:27.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 shutdown_connections 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc8156560 0x7f0dc80c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc8156190 0x7f0dc8157620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0db4066f30 0x7f0db40693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 --2- 172.21.15.26:0/2370671331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc815ccd0 0x7f0dc80c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 >> 172.21.15.26:0/2370671331 conn(0x7f0dc8070e30 msgr2=0x7f0dc80c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 shutdown_connections 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.757+0000 7f0dce4b9700 1 -- 172.21.15.26:0/2370671331 wait complete. 2023-10-09T11:35:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:27.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:27.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.888+0000 7f154f25f700 1 Processor -- start 2023-10-09T11:35:27.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.888+0000 7f154f25f700 1 -- start start 2023-10-09T11:35:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154f25f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 0x7f1548156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154f25f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154815ae40 con 0x7f15480cb5a0 2023-10-09T11:35:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154f25f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154815ab60 con 0x7f15480cb970 2023-10-09T11:35:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154f25f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480ce0f0 con 0x7f154815a5d0 2023-10-09T11:35:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154cffb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f15480cb5a0 0x7f15480cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57072/0 (socket says 172.21.15.26:57072) 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154cffb700 1 -- 172.21.15.26:0/1756697022 learned_addr learned my addr 172.21.15.26:0/1756697022 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f154d7fc700 1 --2- 172.21.15.26:0/1756697022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 0x7f1548156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.889+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105573004 0 0) 0x7f154815ae40 con 0x7f15480cb5a0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1534003570 con 0x7f15480cb5a0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314703220 0 0) 0x7f154815ab60 con 0x7f15480cb970 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f154d7fc700 1 -- 172.21.15.26:0/1756697022 >> v1:172.21.15.67:6789/0 conn(0x7f15480cb970 legacy=0x7f1548159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f154d7fc700 1 -- 172.21.15.26:0/1756697022 >> v1:172.21.15.26:6789/0 conn(0x7f15480cb5a0 legacy=0x7f15480cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f154d7fc700 1 -- 172.21.15.26:0/1756697022 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480ccf00 con 0x7f154815a5d0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f154d7fc700 1 --2- 172.21.15.26:0/1756697022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 0x7f1548156e90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1538009910 tx=0x7f15380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa2356eb43ca2a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800b680 con 0x7f154815a5d0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800b7e0 con 0x7f154815a5d0 2023-10-09T11:35:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.890+0000 7f15477fe700 1 -- 172.21.15.26:0/1756697022 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800bb60 con 0x7f154815a5d0 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 -- 172.21.15.26:0/1756697022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 msgr2=0x7f1548156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 --2- 172.21.15.26:0/1756697022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 0x7f1548156e90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1538009910 tx=0x7f15380091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 -- 172.21.15.26:0/1756697022 shutdown_connections 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 --2- 172.21.15.26:0/1756697022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f154815a5d0 0x7f1548156e90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 -- 172.21.15.26:0/1756697022 >> 172.21.15.26:0/1756697022 conn(0x7f1548070e30 msgr2=0x7f15480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 -- 172.21.15.26:0/1756697022 shutdown_connections 2023-10-09T11:35:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.891+0000 7f154f25f700 1 -- 172.21.15.26:0/1756697022 wait complete. 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.892+0000 7f154f25f700 1 Processor -- start 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.892+0000 7f154f25f700 1 -- start start 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15480cb5a0 0x7f1548169340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f154815a5d0 0x7f15480b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c80c0 con 0x7f15480cb970 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548169b70 con 0x7f154815a5d0 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1548169e50 con 0x7f15480cb5a0 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49920/0 (socket says 172.21.15.26:49920) 2023-10-09T11:35:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 -- 172.21.15.26:0/1565281219 learned_addr learned my addr 172.21.15.26:0/1565281219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154cffb700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15480cb5a0 0x7f1548169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154d7fc700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f154815a5d0 0x7f15480b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 -- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15480cb5a0 msgr2=0x7f1548169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15480cb5a0 0x7f1548169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 -- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f154815a5d0 msgr2=0x7f15480b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f154815a5d0 0x7f15480b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 -- 172.21.15.26:0/1565281219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009420 con 0x7f15480cb970 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1547fff700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f153000c7e0 tx=0x7f1530007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300105c0 con 0x7f15480cb970 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530010740 con 0x7f15480cb970 2023-10-09T11:35:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480c8330 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530010b00 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.893+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154816a130 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.895+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154804c3c0 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.895+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f153001b3b0 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.895+0000 7f1544ff9700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 0x7f15280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.895+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1530083ae0 con 0x7f15480cb970 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.895+0000 7f154cffb700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 0x7f15280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.896+0000 7f154cffb700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 0x7f15280693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f154815dd90 tx=0x7f1540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:27.900+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1530050d50 con 0x7f15480cb970 2023-10-09T11:35:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.093+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15480d0e90 con 0x7f15480cb970 2023-10-09T11:35:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.094+0000 7f1544ff9700 1 -- 172.21.15.26:0/1565281219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f1530017070 con 0x7f15480cb970 2023-10-09T11:35:28.095 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:28.095 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 msgr2=0x7f15280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 0x7f15280693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f154815dd90 tx=0x7f1540009040 comp rx=0 tx=0).stop 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 msgr2=0x7f15480b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f153000c7e0 tx=0x7f1530007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 shutdown_connections 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f154815a5d0 0x7f15480b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1528066f30 0x7f15280693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15480cb5a0 0x7f1548169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 --2- 172.21.15.26:0/1565281219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15480cb970 0x7f15480b5a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 >> 172.21.15.26:0/1565281219 conn(0x7f1548070e30 msgr2=0x7f15480b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 shutdown_connections 2023-10-09T11:35:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.096+0000 7f154f25f700 1 -- 172.21.15.26:0/1565281219 wait complete. 2023-10-09T11:35:28.110 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:35:28.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:35:28.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.227+0000 7f9aab759700 1 Processor -- start 2023-10-09T11:35:28.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.227+0000 7f9aab759700 1 -- start start 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aab759700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9aa415cb50 0x7f9aa40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aab759700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa415ad50 con 0x7f9aa415cf20 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aab759700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa415a140 con 0x7f9aa40b0710 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aab759700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa415a420 con 0x7f9aa415cb50 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9aa415cb50 0x7f9aa40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9aa415cb50 0x7f9aa40b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49924/0 (socket says 172.21.15.26:49924) 2023-10-09T11:35:28.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa8cf4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9aa415cf20 0x7f9aa40b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57086/0 (socket says 172.21.15.26:57086) 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 -- 172.21.15.26:0/2643755394 learned_addr learned my addr 172.21.15.26:0/2643755394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 -- 172.21.15.26:0/2643755394 >> v1:172.21.15.67:6789/0 conn(0x7f9aa40b0710 legacy=0x7f9aa41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 -- 172.21.15.26:0/2643755394 >> v1:172.21.15.26:6789/0 conn(0x7f9aa415cf20 legacy=0x7f9aa40b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 -- 172.21.15.26:0/2643755394 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa415a700 con 0x7f9aa415cb50 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa3fff700 1 -- 172.21.15.26:0/2643755394 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613594130 0 0) 0x7f9aa415ad50 con 0x7f9aa415cf20 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa94f5700 1 --2- 172.21.15.26:0/2643755394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa40b01d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009f20 tx=0x7f9a94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2f6ae3676803f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa3fff700 1 -- 172.21.15.26:0/2643755394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400e070 con 0x7f9aa415cb50 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa3fff700 1 -- 172.21.15.26:0/2643755394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9400ba80 con 0x7f9aa415cb50 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.228+0000 7f9aa3fff700 1 -- 172.21.15.26:0/2643755394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940092e0 con 0x7f9aa415cb50 2023-10-09T11:35:28.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 -- 172.21.15.26:0/2643755394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 msgr2=0x7f9aa40b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 --2- 172.21.15.26:0/2643755394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa40b01d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009f20 tx=0x7f9a94009840 comp rx=0 tx=0).stop 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 -- 172.21.15.26:0/2643755394 shutdown_connections 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 --2- 172.21.15.26:0/2643755394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa40b01d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 -- 172.21.15.26:0/2643755394 >> 172.21.15.26:0/2643755394 conn(0x7f9aa40cded0 msgr2=0x7f9aa406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 -- 172.21.15.26:0/2643755394 shutdown_connections 2023-10-09T11:35:28.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.229+0000 7f9aab759700 1 -- 172.21.15.26:0/2643755394 wait complete. 2023-10-09T11:35:28.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.230+0000 7f9aab759700 1 Processor -- start 2023-10-09T11:35:28.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.230+0000 7f9aab759700 1 -- start start 2023-10-09T11:35:28.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aa40b0710 0x7f9aa416ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aa415cf20 0x7f9aa416a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa416cfc0 con 0x7f9aa415cb50 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c2590 con 0x7f9aa40b0710 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aab759700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c2870 con 0x7f9aa415cf20 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aa8cf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aa8cf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49938/0 (socket says 172.21.15.26:49938) 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aa8cf4700 1 -- 172.21.15.26:0/1620480612 learned_addr learned my addr 172.21.15.26:0/1620480612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aa94f5700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aa40b0710 0x7f9aa416ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.231+0000 7f9aa9cf6700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aa415cf20 0x7f9aa416a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 -- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aa415cf20 msgr2=0x7f9aa416a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aa415cf20 0x7f9aa416a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 -- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aa40b0710 msgr2=0x7f9aa416ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aa40b0710 0x7f9aa416ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 -- 172.21.15.26:0/1620480612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009ae0 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa8cf4700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c5e0 tx=0x7f9a98007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98005a70 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98005bd0 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa40c2b50 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980070d0 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.232+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa40c3110 con 0x7f9aa415cb50 2023-10-09T11:35:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.233+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa40c3330 con 0x7f9aa415cb50 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.233+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a98007440 con 0x7f9aa415cb50 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.234+0000 7f9aa17fa700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.234+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a98083920 con 0x7f9aa415cb50 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.234+0000 7f9aa94f5700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.235+0000 7f9aa94f5700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009880 tx=0x7f9a94018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.238+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a98050b90 con 0x7f9aa415cb50 2023-10-09T11:35:28.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.429+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9aa404c3c0 con 0x7f9a90066f30 2023-10-09T11:35:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.438+0000 7f9aa17fa700 1 -- 172.21.15.26:0/1620480612 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264597 (secure 0 0 0) 0x7f9aa404c3c0 con 0x7f9a90066f30 2023-10-09T11:35:28.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:28.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 msgr2=0x7f9a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009880 tx=0x7f9a94018000 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 msgr2=0x7f9aa416ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c5e0 tx=0x7f9a98007d60 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 shutdown_connections 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aa415cf20 0x7f9aa416a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aa40b0710 0x7f9aa416ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 --2- 172.21.15.26:0/1620480612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9aa415cb50 0x7f9aa416ca80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 >> 172.21.15.26:0/1620480612 conn(0x7f9aa40cded0 msgr2=0x7f9aa40cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 shutdown_connections 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.441+0000 7f9aab759700 1 -- 172.21.15.26:0/1620480612 wait complete. 2023-10-09T11:35:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:35:28.454 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:35:27.104011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381108,"kb_used_data":2804,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593612,"statfs":{"total":773094113280,"available":770655858688,"internally_reserved":0,"allocated":2871296,"data_stored":1740554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.768808"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148676+0000","last_change":"2023-10-09T11:35:24.145841+0000","last_active":"2023-10-09T11:35:24.148676+0000","last_peered":"2023-10-09T11:35:24.148676+0000","last_clean":"2023-10-09T11:35:24.148676+0000","last_became_active":"2023-10-09T11:35:24.145528+0000","last_became_peered":"2023-10-09T11:35:24.145528+0000","last_unstale":"2023-10-09T11:35:24.148676+0000","last_undegraded":"2023-10-09T11:35:24.148676+0000","last_fullsized":"2023-10-09T11:35:24.148676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:40.514361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143745+0000","last_change":"2023-10-09T11:35:24.139730+0000","last_active":"2023-10-09T11:35:24.143745+0000","last_peered":"2023-10-09T11:35:24.143745+0000","last_clean":"2023-10-09T11:35:24.143745+0000","last_became_active":"2023-10-09T11:35:24.139211+0000","last_became_peered":"2023-10-09T11:35:24.139211+0000","last_unstale":"2023-10-09T11:35:24.143745+0000","last_undegraded":"2023-10-09T11:35:24.143745+0000","last_fullsized":"2023-10-09T11:35:24.143745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139500+0000","last_change":"2023-10-09T11:35:24.139500+0000","last_active":"2023-10-09T11:35:24.139500+0000","last_peered":"2023-10-09T11:35:24.139500+0000","last_clean":"2023-10-09T11:35:24.139500+0000","last_became_active":"2023-10-09T11:35:24.139214+0000","last_became_peered":"2023-10-09T11:35:24.139214+0000","last_unstale":"2023-10-09T11:35:24.139500+0000","last_undegraded":"2023-10-09T11:35:24.139500+0000","last_fullsized":"2023-10-09T11:35:24.139500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:02.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151581+0000","last_change":"2023-10-09T11:35:24.148624+0000","last_active":"2023-10-09T11:35:24.151581+0000","last_peered":"2023-10-09T11:35:24.151581+0000","last_clean":"2023-10-09T11:35:24.151581+0000","last_became_active":"2023-10-09T11:35:24.147894+0000","last_became_peered":"2023-10-09T11:35:24.147894+0000","last_unstale":"2023-10-09T11:35:24.151581+0000","last_undegraded":"2023-10-09T11:35:24.151581+0000","last_fullsized":"2023-10-09T11:35:24.151581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146448+0000","last_change":"2023-10-09T11:35:24.141089+0000","last_active":"2023-10-09T11:35:24.146448+0000","last_peered":"2023-10-09T11:35:24.146448+0000","last_clean":"2023-10-09T11:35:24.146448+0000","last_became_active":"2023-10-09T11:35:24.140515+0000","last_became_peered":"2023-10-09T11:35:24.140515+0000","last_unstale":"2023-10-09T11:35:24.146448+0000","last_undegraded":"2023-10-09T11:35:24.146448+0000","last_fullsized":"2023-10-09T11:35:24.146448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153346+0000","last_change":"2023-10-09T11:35:24.149144+0000","last_active":"2023-10-09T11:35:24.153346+0000","last_peered":"2023-10-09T11:35:24.153346+0000","last_clean":"2023-10-09T11:35:24.153346+0000","last_became_active":"2023-10-09T11:35:24.147370+0000","last_became_peered":"2023-10-09T11:35:24.147370+0000","last_unstale":"2023-10-09T11:35:24.153346+0000","last_undegraded":"2023-10-09T11:35:24.153346+0000","last_fullsized":"2023-10-09T11:35:24.153346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145820+0000","last_change":"2023-10-09T11:35:24.139629+0000","last_active":"2023-10-09T11:35:24.145820+0000","last_peered":"2023-10-09T11:35:24.145820+0000","last_clean":"2023-10-09T11:35:24.145820+0000","last_became_active":"2023-10-09T11:35:24.139350+0000","last_became_peered":"2023-10-09T11:35:24.139350+0000","last_unstale":"2023-10-09T11:35:24.145820+0000","last_undegraded":"2023-10-09T11:35:24.145820+0000","last_fullsized":"2023-10-09T11:35:24.145820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152399+0000","last_change":"2023-10-09T11:35:24.152399+0000","last_active":"2023-10-09T11:35:24.152399+0000","last_peered":"2023-10-09T11:35:24.152399+0000","last_clean":"2023-10-09T11:35:24.152399+0000","last_became_active":"2023-10-09T11:35:24.152168+0000","last_became_peered":"2023-10-09T11:35:24.152168+0000","last_unstale":"2023-10-09T11:35:24.152399+0000","last_undegraded":"2023-10-09T11:35:24.152399+0000","last_fullsized":"2023-10-09T11:35:24.152399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152351+0000","last_change":"2023-10-09T11:35:24.150386+0000","last_active":"2023-10-09T11:35:24.152351+0000","last_peered":"2023-10-09T11:35:24.152351+0000","last_clean":"2023-10-09T11:35:24.152351+0000","last_became_active":"2023-10-09T11:35:24.150091+0000","last_became_peered":"2023-10-09T11:35:24.150091+0000","last_unstale":"2023-10-09T11:35:24.152351+0000","last_undegraded":"2023-10-09T11:35:24.152351+0000","last_fullsized":"2023-10-09T11:35:24.152351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149850+0000","last_change":"2023-10-09T11:35:24.148228+0000","last_active":"2023-10-09T11:35:24.149850+0000","last_peered":"2023-10-09T11:35:24.149850+0000","last_clean":"2023-10-09T11:35:24.149850+0000","last_became_active":"2023-10-09T11:35:24.147941+0000","last_became_peered":"2023-10-09T11:35:24.147941+0000","last_unstale":"2023-10-09T11:35:24.149850+0000","last_undegraded":"2023-10-09T11:35:24.149850+0000","last_fullsized":"2023-10-09T11:35:24.149850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152972+0000","last_change":"2023-10-09T11:35:24.152453+0000","last_active":"2023-10-09T11:35:24.152972+0000","last_peered":"2023-10-09T11:35:24.152972+0000","last_clean":"2023-10-09T11:35:24.152972+0000","last_became_active":"2023-10-09T11:35:24.152174+0000","last_became_peered":"2023-10-09T11:35:24.152174+0000","last_unstale":"2023-10-09T11:35:24.152972+0000","last_undegraded":"2023-10-09T11:35:24.152972+0000","last_fullsized":"2023-10-09T11:35:24.152972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145082+0000","last_change":"2023-10-09T11:35:24.138179+0000","last_active":"2023-10-09T11:35:24.145082+0000","last_peered":"2023-10-09T11:35:24.145082+0000","last_clean":"2023-10-09T11:35:24.145082+0000","last_became_active":"2023-10-09T11:35:24.137705+0000","last_became_peered":"2023-10-09T11:35:24.137705+0000","last_unstale":"2023-10-09T11:35:24.145082+0000","last_undegraded":"2023-10-09T11:35:24.145082+0000","last_fullsized":"2023-10-09T11:35:24.145082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.137044+0000","last_change":"2023-10-09T11:35:24.137044+0000","last_active":"2023-10-09T11:35:24.137044+0000","last_peered":"2023-10-09T11:35:24.137044+0000","last_clean":"2023-10-09T11:35:24.137044+0000","last_became_active":"2023-10-09T11:35:24.136733+0000","last_became_peered":"2023-10-09T11:35:24.136733+0000","last_unstale":"2023-10-09T11:35:24.137044+0000","last_undegraded":"2023-10-09T11:35:24.137044+0000","last_fullsized":"2023-10-09T11:35:24.137044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138471+0000","last_change":"2023-10-09T11:35:24.138471+0000","last_active":"2023-10-09T11:35:24.138471+0000","last_peered":"2023-10-09T11:35:24.138471+0000","last_clean":"2023-10-09T11:35:24.138471+0000","last_became_active":"2023-10-09T11:35:24.138180+0000","last_became_peered":"2023-10-09T11:35:24.138180+0000","last_unstale":"2023-10-09T11:35:24.138471+0000","last_undegraded":"2023-10-09T11:35:24.138471+0000","last_fullsized":"2023-10-09T11:35:24.138471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138655+0000","last_change":"2023-10-09T11:35:24.135966+0000","last_active":"2023-10-09T11:35:24.138655+0000","last_peered":"2023-10-09T11:35:24.138655+0000","last_clean":"2023-10-09T11:35:24.138655+0000","last_became_active":"2023-10-09T11:35:24.135698+0000","last_became_peered":"2023-10-09T11:35:24.135698+0000","last_unstale":"2023-10-09T11:35:24.138655+0000","last_undegraded":"2023-10-09T11:35:24.138655+0000","last_fullsized":"2023-10-09T11:35:24.138655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151783+0000","last_change":"2023-10-09T11:35:24.149400+0000","last_active":"2023-10-09T11:35:24.151783+0000","last_peered":"2023-10-09T11:35:24.151783+0000","last_clean":"2023-10-09T11:35:24.151783+0000","last_became_active":"2023-10-09T11:35:24.146746+0000","last_became_peered":"2023-10-09T11:35:24.146746+0000","last_unstale":"2023-10-09T11:35:24.151783+0000","last_undegraded":"2023-10-09T11:35:24.151783+0000","last_fullsized":"2023-10-09T11:35:24.151783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153950+0000","last_change":"2023-10-09T11:35:24.151212+0000","last_active":"2023-10-09T11:35:24.153950+0000","last_peered":"2023-10-09T11:35:24.153950+0000","last_clean":"2023-10-09T11:35:24.153950+0000","last_became_active":"2023-10-09T11:35:24.150896+0000","last_became_peered":"2023-10-09T11:35:24.150896+0000","last_unstale":"2023-10-09T11:35:24.153950+0000","last_undegraded":"2023-10-09T11:35:24.153950+0000","last_fullsized":"2023-10-09T11:35:24.153950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140434+0000","last_change":"2023-10-09T11:35:24.140434+0000","last_active":"2023-10-09T11:35:24.140434+0000","last_peered":"2023-10-09T11:35:24.140434+0000","last_clean":"2023-10-09T11:35:24.140434+0000","last_became_active":"2023-10-09T11:35:24.140143+0000","last_became_peered":"2023-10-09T11:35:24.140143+0000","last_unstale":"2023-10-09T11:35:24.140434+0000","last_undegraded":"2023-10-09T11:35:24.140434+0000","last_fullsized":"2023-10-09T11:35:24.140434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145914+0000","last_change":"2023-10-09T11:35:24.139525+0000","last_active":"2023-10-09T11:35:24.145914+0000","last_peered":"2023-10-09T11:35:24.145914+0000","last_clean":"2023-10-09T11:35:24.145914+0000","last_became_active":"2023-10-09T11:35:24.139231+0000","last_became_peered":"2023-10-09T11:35:24.139231+0000","last_unstale":"2023-10-09T11:35:24.145914+0000","last_undegraded":"2023-10-09T11:35:24.145914+0000","last_fullsized":"2023-10-09T11:35:24.145914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356581+0000","last_change":"2023-10-09T11:35:23.362882+0000","last_active":"2023-10-09T11:35:24.356581+0000","last_peered":"2023-10-09T11:35:24.356581+0000","last_clean":"2023-10-09T11:35:24.356581+0000","last_became_active":"2023-10-09T11:35:23.362595+0000","last_became_peered":"2023-10-09T11:35:23.362595+0000","last_unstale":"2023-10-09T11:35:24.356581+0000","last_undegraded":"2023-10-09T11:35:24.356581+0000","last_fullsized":"2023-10-09T11:35:24.356581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.137972+0000","last_change":"2023-10-09T11:35:24.137972+0000","last_active":"2023-10-09T11:35:24.137972+0000","last_peered":"2023-10-09T11:35:24.137972+0000","last_clean":"2023-10-09T11:35:24.137972+0000","last_became_active":"2023-10-09T11:35:24.137704+0000","last_became_peered":"2023-10-09T11:35:24.137704+0000","last_unstale":"2023-10-09T11:35:24.137972+0000","last_undegraded":"2023-10-09T11:35:24.137972+0000","last_fullsized":"2023-10-09T11:35:24.137972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128942+0000","last_change":"2023-10-09T11:35:23.358839+0000","last_active":"2023-10-09T11:35:24.128942+0000","last_peered":"2023-10-09T11:35:24.128942+0000","last_clean":"2023-10-09T11:35:24.128942+0000","last_became_active":"2023-10-09T11:35:23.358555+0000","last_became_peered":"2023-10-09T11:35:23.358555+0000","last_unstale":"2023-10-09T11:35:24.128942+0000","last_undegraded":"2023-10-09T11:35:24.128942+0000","last_fullsized":"2023-10-09T11:35:24.128942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146933+0000","last_change":"2023-10-09T11:35:24.146933+0000","last_active":"2023-10-09T11:35:24.146933+0000","last_peered":"2023-10-09T11:35:24.146933+0000","last_clean":"2023-10-09T11:35:24.146933+0000","last_became_active":"2023-10-09T11:35:24.146693+0000","last_became_peered":"2023-10-09T11:35:24.146693+0000","last_unstale":"2023-10-09T11:35:24.146933+0000","last_undegraded":"2023-10-09T11:35:24.146933+0000","last_fullsized":"2023-10-09T11:35:24.146933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354056+0000","last_change":"2023-10-09T11:35:23.367495+0000","last_active":"2023-10-09T11:35:24.354056+0000","last_peered":"2023-10-09T11:35:24.354056+0000","last_clean":"2023-10-09T11:35:24.354056+0000","last_became_active":"2023-10-09T11:35:23.367189+0000","last_became_peered":"2023-10-09T11:35:23.367189+0000","last_unstale":"2023-10-09T11:35:24.354056+0000","last_undegraded":"2023-10-09T11:35:24.354056+0000","last_fullsized":"2023-10-09T11:35:24.354056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153981+0000","last_change":"2023-10-09T11:35:24.151258+0000","last_active":"2023-10-09T11:35:24.153981+0000","last_peered":"2023-10-09T11:35:24.153981+0000","last_clean":"2023-10-09T11:35:24.153981+0000","last_became_active":"2023-10-09T11:35:24.150987+0000","last_became_peered":"2023-10-09T11:35:24.150987+0000","last_unstale":"2023-10-09T11:35:24.153981+0000","last_undegraded":"2023-10-09T11:35:24.153981+0000","last_fullsized":"2023-10-09T11:35:24.153981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354452+0000","last_change":"2023-10-09T11:35:23.366425+0000","last_active":"2023-10-09T11:35:24.354452+0000","last_peered":"2023-10-09T11:35:24.354452+0000","last_clean":"2023-10-09T11:35:24.354452+0000","last_became_active":"2023-10-09T11:35:23.366115+0000","last_became_peered":"2023-10-09T11:35:23.366115+0000","last_unstale":"2023-10-09T11:35:24.354452+0000","last_undegraded":"2023-10-09T11:35:24.354452+0000","last_fullsized":"2023-10-09T11:35:24.354452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153731+0000","last_change":"2023-10-09T11:35:24.149747+0000","last_active":"2023-10-09T11:35:24.153731+0000","last_peered":"2023-10-09T11:35:24.153731+0000","last_clean":"2023-10-09T11:35:24.153731+0000","last_became_active":"2023-10-09T11:35:24.149466+0000","last_became_peered":"2023-10-09T11:35:24.149466+0000","last_unstale":"2023-10-09T11:35:24.153731+0000","last_undegraded":"2023-10-09T11:35:24.153731+0000","last_fullsized":"2023-10-09T11:35:24.153731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128763+0000","last_change":"2023-10-09T11:35:23.364018+0000","last_active":"2023-10-09T11:35:24.128763+0000","last_peered":"2023-10-09T11:35:24.128763+0000","last_clean":"2023-10-09T11:35:24.128763+0000","last_became_active":"2023-10-09T11:35:23.363736+0000","last_became_peered":"2023-10-09T11:35:23.363736+0000","last_unstale":"2023-10-09T11:35:24.128763+0000","last_undegraded":"2023-10-09T11:35:24.128763+0000","last_fullsized":"2023-10-09T11:35:24.128763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144566+0000","last_change":"2023-10-09T11:35:24.138177+0000","last_active":"2023-10-09T11:35:24.144566+0000","last_peered":"2023-10-09T11:35:24.144566+0000","last_clean":"2023-10-09T11:35:24.144566+0000","last_became_active":"2023-10-09T11:35:24.137865+0000","last_became_peered":"2023-10-09T11:35:24.137865+0000","last_unstale":"2023-10-09T11:35:24.144566+0000","last_undegraded":"2023-10-09T11:35:24.144566+0000","last_fullsized":"2023-10-09T11:35:24.144566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:30.412408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349191+0000","last_change":"2023-10-09T11:35:23.357930+0000","last_active":"2023-10-09T11:35:24.349191+0000","last_peered":"2023-10-09T11:35:24.349191+0000","last_clean":"2023-10-09T11:35:24.349191+0000","last_became_active":"2023-10-09T11:35:23.357528+0000","last_became_peered":"2023-10-09T11:35:23.357528+0000","last_unstale":"2023-10-09T11:35:24.349191+0000","last_undegraded":"2023-10-09T11:35:24.349191+0000","last_fullsized":"2023-10-09T11:35:24.349191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145192+0000","last_change":"2023-10-09T11:35:24.145192+0000","last_active":"2023-10-09T11:35:24.145192+0000","last_peered":"2023-10-09T11:35:24.145192+0000","last_clean":"2023-10-09T11:35:24.145192+0000","last_became_active":"2023-10-09T11:35:24.144928+0000","last_became_peered":"2023-10-09T11:35:24.144928+0000","last_unstale":"2023-10-09T11:35:24.145192+0000","last_undegraded":"2023-10-09T11:35:24.145192+0000","last_fullsized":"2023-10-09T11:35:24.145192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.364246+0000","last_change":"2023-10-09T11:35:23.362782+0000","last_active":"2023-10-09T11:35:23.364246+0000","last_peered":"2023-10-09T11:35:23.364246+0000","last_clean":"2023-10-09T11:35:23.364246+0000","last_became_active":"2023-10-09T11:35:23.362488+0000","last_became_peered":"2023-10-09T11:35:23.362488+0000","last_unstale":"2023-10-09T11:35:23.364246+0000","last_undegraded":"2023-10-09T11:35:23.364246+0000","last_fullsized":"2023-10-09T11:35:23.364246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140502+0000","last_change":"2023-10-09T11:35:24.140502+0000","last_active":"2023-10-09T11:35:24.140502+0000","last_peered":"2023-10-09T11:35:24.140502+0000","last_clean":"2023-10-09T11:35:24.140502+0000","last_became_active":"2023-10-09T11:35:24.140108+0000","last_became_peered":"2023-10-09T11:35:24.140108+0000","last_unstale":"2023-10-09T11:35:24.140502+0000","last_undegraded":"2023-10-09T11:35:24.140502+0000","last_fullsized":"2023-10-09T11:35:24.140502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144662+0000","last_change":"2023-10-09T11:35:23.356945+0000","last_active":"2023-10-09T11:35:24.144662+0000","last_peered":"2023-10-09T11:35:24.144662+0000","last_clean":"2023-10-09T11:35:24.144662+0000","last_became_active":"2023-10-09T11:35:23.356634+0000","last_became_peered":"2023-10-09T11:35:23.356634+0000","last_unstale":"2023-10-09T11:35:24.144662+0000","last_undegraded":"2023-10-09T11:35:24.144662+0000","last_fullsized":"2023-10-09T11:35:24.144662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142287+0000","last_change":"2023-10-09T11:35:24.137880+0000","last_active":"2023-10-09T11:35:24.142287+0000","last_peered":"2023-10-09T11:35:24.142287+0000","last_clean":"2023-10-09T11:35:24.142287+0000","last_became_active":"2023-10-09T11:35:24.137629+0000","last_became_peered":"2023-10-09T11:35:24.137629+0000","last_unstale":"2023-10-09T11:35:24.142287+0000","last_undegraded":"2023-10-09T11:35:24.142287+0000","last_fullsized":"2023-10-09T11:35:24.142287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.130245+0000","last_change":"2023-10-09T11:35:23.362809+0000","last_active":"2023-10-09T11:35:24.130245+0000","last_peered":"2023-10-09T11:35:24.130245+0000","last_clean":"2023-10-09T11:35:24.130245+0000","last_became_active":"2023-10-09T11:35:23.362496+0000","last_became_peered":"2023-10-09T11:35:23.362496+0000","last_unstale":"2023-10-09T11:35:24.130245+0000","last_undegraded":"2023-10-09T11:35:24.130245+0000","last_fullsized":"2023-10-09T11:35:24.130245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153973+0000","last_change":"2023-10-09T11:35:24.151289+0000","last_active":"2023-10-09T11:35:24.153973+0000","last_peered":"2023-10-09T11:35:24.153973+0000","last_clean":"2023-10-09T11:35:24.153973+0000","last_became_active":"2023-10-09T11:35:24.150977+0000","last_became_peered":"2023-10-09T11:35:24.150977+0000","last_unstale":"2023-10-09T11:35:24.153973+0000","last_undegraded":"2023-10-09T11:35:24.153973+0000","last_fullsized":"2023-10-09T11:35:24.153973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145743+0000","last_change":"2023-10-09T11:35:23.364359+0000","last_active":"2023-10-09T11:35:24.145743+0000","last_peered":"2023-10-09T11:35:24.145743+0000","last_clean":"2023-10-09T11:35:24.145743+0000","last_became_active":"2023-10-09T11:35:23.364054+0000","last_became_peered":"2023-10-09T11:35:23.364054+0000","last_unstale":"2023-10-09T11:35:24.145743+0000","last_undegraded":"2023-10-09T11:35:24.145743+0000","last_fullsized":"2023-10-09T11:35:24.145743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146931+0000","last_change":"2023-10-09T11:35:24.146931+0000","last_active":"2023-10-09T11:35:24.146931+0000","last_peered":"2023-10-09T11:35:24.146931+0000","last_clean":"2023-10-09T11:35:24.146931+0000","last_became_active":"2023-10-09T11:35:24.146657+0000","last_became_peered":"2023-10-09T11:35:24.146657+0000","last_unstale":"2023-10-09T11:35:24.146931+0000","last_undegraded":"2023-10-09T11:35:24.146931+0000","last_fullsized":"2023-10-09T11:35:24.146931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353815+0000","last_change":"2023-10-09T11:35:23.356704+0000","last_active":"2023-10-09T11:35:24.353815+0000","last_peered":"2023-10-09T11:35:24.353815+0000","last_clean":"2023-10-09T11:35:24.353815+0000","last_became_active":"2023-10-09T11:35:23.356414+0000","last_became_peered":"2023-10-09T11:35:23.356414+0000","last_unstale":"2023-10-09T11:35:24.353815+0000","last_undegraded":"2023-10-09T11:35:24.353815+0000","last_fullsized":"2023-10-09T11:35:24.353815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145391+0000","last_change":"2023-10-09T11:35:24.140247+0000","last_active":"2023-10-09T11:35:24.145391+0000","last_peered":"2023-10-09T11:35:24.145391+0000","last_clean":"2023-10-09T11:35:24.145391+0000","last_became_active":"2023-10-09T11:35:24.139935+0000","last_became_peered":"2023-10-09T11:35:24.139935+0000","last_unstale":"2023-10-09T11:35:24.145391+0000","last_undegraded":"2023-10-09T11:35:24.145391+0000","last_fullsized":"2023-10-09T11:35:24.145391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:29.365580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356605+0000","last_change":"2023-10-09T11:35:23.358506+0000","last_active":"2023-10-09T11:35:24.356605+0000","last_peered":"2023-10-09T11:35:24.356605+0000","last_clean":"2023-10-09T11:35:24.356605+0000","last_became_active":"2023-10-09T11:35:23.358190+0000","last_became_peered":"2023-10-09T11:35:23.358190+0000","last_unstale":"2023-10-09T11:35:24.356605+0000","last_undegraded":"2023-10-09T11:35:24.356605+0000","last_fullsized":"2023-10-09T11:35:24.356605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146454+0000","last_change":"2023-10-09T11:35:24.142761+0000","last_active":"2023-10-09T11:35:24.146454+0000","last_peered":"2023-10-09T11:35:24.146454+0000","last_clean":"2023-10-09T11:35:24.146454+0000","last_became_active":"2023-10-09T11:35:24.142487+0000","last_became_peered":"2023-10-09T11:35:24.142487+0000","last_unstale":"2023-10-09T11:35:24.146454+0000","last_undegraded":"2023-10-09T11:35:24.146454+0000","last_fullsized":"2023-10-09T11:35:24.146454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353995+0000","last_change":"2023-10-09T11:35:23.356502+0000","last_active":"2023-10-09T11:35:24.353995+0000","last_peered":"2023-10-09T11:35:24.353995+0000","last_clean":"2023-10-09T11:35:24.353995+0000","last_became_active":"2023-10-09T11:35:23.356248+0000","last_became_peered":"2023-10-09T11:35:23.356248+0000","last_unstale":"2023-10-09T11:35:24.353995+0000","last_undegraded":"2023-10-09T11:35:24.353995+0000","last_fullsized":"2023-10-09T11:35:24.353995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139623+0000","last_change":"2023-10-09T11:35:24.139623+0000","last_active":"2023-10-09T11:35:24.139623+0000","last_peered":"2023-10-09T11:35:24.139623+0000","last_clean":"2023-10-09T11:35:24.139623+0000","last_became_active":"2023-10-09T11:35:24.139334+0000","last_became_peered":"2023-10-09T11:35:24.139334+0000","last_unstale":"2023-10-09T11:35:24.139623+0000","last_undegraded":"2023-10-09T11:35:24.139623+0000","last_fullsized":"2023-10-09T11:35:24.139623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145593+0000","last_change":"2023-10-09T11:35:23.356511+0000","last_active":"2023-10-09T11:35:24.145593+0000","last_peered":"2023-10-09T11:35:24.145593+0000","last_clean":"2023-10-09T11:35:24.145593+0000","last_became_active":"2023-10-09T11:35:23.356139+0000","last_became_peered":"2023-10-09T11:35:23.356139+0000","last_unstale":"2023-10-09T11:35:24.145593+0000","last_undegraded":"2023-10-09T11:35:24.145593+0000","last_fullsized":"2023-10-09T11:35:24.145593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146469+0000","last_change":"2023-10-09T11:35:24.141301+0000","last_active":"2023-10-09T11:35:24.146469+0000","last_peered":"2023-10-09T11:35:24.146469+0000","last_clean":"2023-10-09T11:35:24.146469+0000","last_became_active":"2023-10-09T11:35:24.140824+0000","last_became_peered":"2023-10-09T11:35:24.140824+0000","last_unstale":"2023-10-09T11:35:24.146469+0000","last_undegraded":"2023-10-09T11:35:24.146469+0000","last_fullsized":"2023-10-09T11:35:24.146469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.129945+0000","last_change":"2023-10-09T11:35:23.362904+0000","last_active":"2023-10-09T11:35:24.129945+0000","last_peered":"2023-10-09T11:35:24.129945+0000","last_clean":"2023-10-09T11:35:24.129945+0000","last_became_active":"2023-10-09T11:35:23.362072+0000","last_became_peered":"2023-10-09T11:35:23.362072+0000","last_unstale":"2023-10-09T11:35:24.129945+0000","last_undegraded":"2023-10-09T11:35:24.129945+0000","last_fullsized":"2023-10-09T11:35:24.129945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145146+0000","last_change":"2023-10-09T11:35:24.139443+0000","last_active":"2023-10-09T11:35:24.145146+0000","last_peered":"2023-10-09T11:35:24.145146+0000","last_clean":"2023-10-09T11:35:24.145146+0000","last_became_active":"2023-10-09T11:35:24.139154+0000","last_became_peered":"2023-10-09T11:35:24.139154+0000","last_unstale":"2023-10-09T11:35:24.145146+0000","last_undegraded":"2023-10-09T11:35:24.145146+0000","last_fullsized":"2023-10-09T11:35:24.145146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353239+0000","last_change":"2023-10-09T11:35:23.354006+0000","last_active":"2023-10-09T11:35:24.353239+0000","last_peered":"2023-10-09T11:35:24.353239+0000","last_clean":"2023-10-09T11:35:24.353239+0000","last_became_active":"2023-10-09T11:35:23.353652+0000","last_became_peered":"2023-10-09T11:35:23.353652+0000","last_unstale":"2023-10-09T11:35:24.353239+0000","last_undegraded":"2023-10-09T11:35:24.353239+0000","last_fullsized":"2023-10-09T11:35:24.353239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148316+0000","last_change":"2023-10-09T11:35:24.145734+0000","last_active":"2023-10-09T11:35:24.148316+0000","last_peered":"2023-10-09T11:35:24.148316+0000","last_clean":"2023-10-09T11:35:24.148316+0000","last_became_active":"2023-10-09T11:35:24.145428+0000","last_became_peered":"2023-10-09T11:35:24.145428+0000","last_unstale":"2023-10-09T11:35:24.148316+0000","last_undegraded":"2023-10-09T11:35:24.148316+0000","last_fullsized":"2023-10-09T11:35:24.148316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349142+0000","last_change":"2023-10-09T11:35:23.359612+0000","last_active":"2023-10-09T11:35:24.349142+0000","last_peered":"2023-10-09T11:35:24.349142+0000","last_clean":"2023-10-09T11:35:24.349142+0000","last_became_active":"2023-10-09T11:35:23.359281+0000","last_became_peered":"2023-10-09T11:35:23.359281+0000","last_unstale":"2023-10-09T11:35:24.349142+0000","last_undegraded":"2023-10-09T11:35:24.349142+0000","last_fullsized":"2023-10-09T11:35:24.349142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146099+0000","last_change":"2023-10-09T11:35:24.140692+0000","last_active":"2023-10-09T11:35:24.146099+0000","last_peered":"2023-10-09T11:35:24.146099+0000","last_clean":"2023-10-09T11:35:24.146099+0000","last_became_active":"2023-10-09T11:35:24.140410+0000","last_became_peered":"2023-10-09T11:35:24.140410+0000","last_unstale":"2023-10-09T11:35:24.146099+0000","last_undegraded":"2023-10-09T11:35:24.146099+0000","last_fullsized":"2023-10-09T11:35:24.146099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131273+0000","last_change":"2023-10-09T11:35:23.357092+0000","last_active":"2023-10-09T11:35:24.131273+0000","last_peered":"2023-10-09T11:35:24.131273+0000","last_clean":"2023-10-09T11:35:24.131273+0000","last_became_active":"2023-10-09T11:35:23.356770+0000","last_became_peered":"2023-10-09T11:35:23.356770+0000","last_unstale":"2023-10-09T11:35:24.131273+0000","last_undegraded":"2023-10-09T11:35:24.131273+0000","last_fullsized":"2023-10-09T11:35:24.131273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151640+0000","last_change":"2023-10-09T11:35:24.148899+0000","last_active":"2023-10-09T11:35:24.151640+0000","last_peered":"2023-10-09T11:35:24.151640+0000","last_clean":"2023-10-09T11:35:24.151640+0000","last_became_active":"2023-10-09T11:35:24.148606+0000","last_became_peered":"2023-10-09T11:35:24.148606+0000","last_unstale":"2023-10-09T11:35:24.151640+0000","last_undegraded":"2023-10-09T11:35:24.151640+0000","last_fullsized":"2023-10-09T11:35:24.151640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145363+0000","last_change":"2023-10-09T11:35:23.357012+0000","last_active":"2023-10-09T11:35:24.145363+0000","last_peered":"2023-10-09T11:35:24.145363+0000","last_clean":"2023-10-09T11:35:24.145363+0000","last_became_active":"2023-10-09T11:35:23.356520+0000","last_became_peered":"2023-10-09T11:35:23.356520+0000","last_unstale":"2023-10-09T11:35:24.145363+0000","last_undegraded":"2023-10-09T11:35:24.145363+0000","last_fullsized":"2023-10-09T11:35:24.145363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145418+0000","last_change":"2023-10-09T11:35:24.141088+0000","last_active":"2023-10-09T11:35:24.145418+0000","last_peered":"2023-10-09T11:35:24.145418+0000","last_clean":"2023-10-09T11:35:24.145418+0000","last_became_active":"2023-10-09T11:35:24.139862+0000","last_became_peered":"2023-10-09T11:35:24.139862+0000","last_unstale":"2023-10-09T11:35:24.145418+0000","last_undegraded":"2023-10-09T11:35:24.145418+0000","last_fullsized":"2023-10-09T11:35:24.145418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143692+0000","last_change":"2023-10-09T11:35:24.139287+0000","last_active":"2023-10-09T11:35:24.143692+0000","last_peered":"2023-10-09T11:35:24.143692+0000","last_clean":"2023-10-09T11:35:24.143692+0000","last_became_active":"2023-10-09T11:35:24.139008+0000","last_became_peered":"2023-10-09T11:35:24.139008+0000","last_unstale":"2023-10-09T11:35:24.143692+0000","last_undegraded":"2023-10-09T11:35:24.143692+0000","last_fullsized":"2023-10-09T11:35:24.143692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.358339+0000","last_change":"2023-10-09T11:35:23.355919+0000","last_active":"2023-10-09T11:35:23.358339+0000","last_peered":"2023-10-09T11:35:23.358339+0000","last_clean":"2023-10-09T11:35:23.358339+0000","last_became_active":"2023-10-09T11:35:23.355614+0000","last_became_peered":"2023-10-09T11:35:23.355614+0000","last_unstale":"2023-10-09T11:35:23.358339+0000","last_undegraded":"2023-10-09T11:35:23.358339+0000","last_fullsized":"2023-10-09T11:35:23.358339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148543+0000","last_change":"2023-10-09T11:35:24.148543+0000","last_active":"2023-10-09T11:35:24.148543+0000","last_peered":"2023-10-09T11:35:24.148543+0000","last_clean":"2023-10-09T11:35:24.148543+0000","last_became_active":"2023-10-09T11:35:24.148262+0000","last_became_peered":"2023-10-09T11:35:24.148262+0000","last_unstale":"2023-10-09T11:35:24.148543+0000","last_undegraded":"2023-10-09T11:35:24.148543+0000","last_fullsized":"2023-10-09T11:35:24.148543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145673+0000","last_change":"2023-10-09T11:35:23.354956+0000","last_active":"2023-10-09T11:35:24.145673+0000","last_peered":"2023-10-09T11:35:24.145673+0000","last_clean":"2023-10-09T11:35:24.145673+0000","last_became_active":"2023-10-09T11:35:23.354649+0000","last_became_peered":"2023-10-09T11:35:23.354649+0000","last_unstale":"2023-10-09T11:35:24.145673+0000","last_undegraded":"2023-10-09T11:35:24.145673+0000","last_fullsized":"2023-10-09T11:35:24.145673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133968+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:35:24.133968+0000","last_peered":"2023-10-09T11:35:24.133968+0000","last_clean":"2023-10-09T11:35:24.133968+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:35:24.133968+0000","last_undegraded":"2023-10-09T11:35:24.133968+0000","last_fullsized":"2023-10-09T11:35:24.133968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142197+0000","last_change":"2023-10-09T11:35:24.142197+0000","last_active":"2023-10-09T11:35:24.142197+0000","last_peered":"2023-10-09T11:35:24.142197+0000","last_clean":"2023-10-09T11:35:24.142197+0000","last_became_active":"2023-10-09T11:35:24.141909+0000","last_became_peered":"2023-10-09T11:35:24.141909+0000","last_unstale":"2023-10-09T11:35:24.142197+0000","last_undegraded":"2023-10-09T11:35:24.142197+0000","last_fullsized":"2023-10-09T11:35:24.142197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:52.262280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134030+0000","last_change":"2023-10-09T11:35:23.363461+0000","last_active":"2023-10-09T11:35:24.134030+0000","last_peered":"2023-10-09T11:35:24.134030+0000","last_clean":"2023-10-09T11:35:24.134030+0000","last_became_active":"2023-10-09T11:35:23.363036+0000","last_became_peered":"2023-10-09T11:35:23.363036+0000","last_unstale":"2023-10-09T11:35:24.134030+0000","last_undegraded":"2023-10-09T11:35:24.134030+0000","last_fullsized":"2023-10-09T11:35:24.134030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134515+0000","last_change":"2023-10-09T11:35:23.363062+0000","last_active":"2023-10-09T11:35:24.134515+0000","last_peered":"2023-10-09T11:35:24.134515+0000","last_clean":"2023-10-09T11:35:24.134515+0000","last_became_active":"2023-10-09T11:35:23.362764+0000","last_became_peered":"2023-10-09T11:35:23.362764+0000","last_unstale":"2023-10-09T11:35:24.134515+0000","last_undegraded":"2023-10-09T11:35:24.134515+0000","last_fullsized":"2023-10-09T11:35:24.134515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142257+0000","last_change":"2023-10-09T11:35:24.138344+0000","last_active":"2023-10-09T11:35:24.142257+0000","last_peered":"2023-10-09T11:35:24.142257+0000","last_clean":"2023-10-09T11:35:24.142257+0000","last_became_active":"2023-10-09T11:35:24.138049+0000","last_became_peered":"2023-10-09T11:35:24.138049+0000","last_unstale":"2023-10-09T11:35:24.142257+0000","last_undegraded":"2023-10-09T11:35:24.142257+0000","last_fullsized":"2023-10-09T11:35:24.142257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131924+0000","last_change":"2023-10-09T11:35:23.364933+0000","last_active":"2023-10-09T11:35:24.131924+0000","last_peered":"2023-10-09T11:35:24.131924+0000","last_clean":"2023-10-09T11:35:24.131924+0000","last_became_active":"2023-10-09T11:35:23.364638+0000","last_became_peered":"2023-10-09T11:35:23.364638+0000","last_unstale":"2023-10-09T11:35:24.131924+0000","last_undegraded":"2023-10-09T11:35:24.131924+0000","last_fullsized":"2023-10-09T11:35:24.131924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141685+0000","last_change":"2023-10-09T11:35:24.141685+0000","last_active":"2023-10-09T11:35:24.141685+0000","last_peered":"2023-10-09T11:35:24.141685+0000","last_clean":"2023-10-09T11:35:24.141685+0000","last_became_active":"2023-10-09T11:35:24.141344+0000","last_became_peered":"2023-10-09T11:35:24.141344+0000","last_unstale":"2023-10-09T11:35:24.141685+0000","last_undegraded":"2023-10-09T11:35:24.141685+0000","last_fullsized":"2023-10-09T11:35:24.141685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.350153+0000","last_change":"2023-10-09T11:35:23.365419+0000","last_active":"2023-10-09T11:35:24.350153+0000","last_peered":"2023-10-09T11:35:24.350153+0000","last_clean":"2023-10-09T11:35:24.350153+0000","last_became_active":"2023-10-09T11:35:23.364707+0000","last_became_peered":"2023-10-09T11:35:23.364707+0000","last_unstale":"2023-10-09T11:35:24.350153+0000","last_undegraded":"2023-10-09T11:35:24.350153+0000","last_fullsized":"2023-10-09T11:35:24.350153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138684+0000","last_change":"2023-10-09T11:35:24.138684+0000","last_active":"2023-10-09T11:35:24.138684+0000","last_peered":"2023-10-09T11:35:24.138684+0000","last_clean":"2023-10-09T11:35:24.138684+0000","last_became_active":"2023-10-09T11:35:24.138267+0000","last_became_peered":"2023-10-09T11:35:24.138267+0000","last_unstale":"2023-10-09T11:35:24.138684+0000","last_undegraded":"2023-10-09T11:35:24.138684+0000","last_fullsized":"2023-10-09T11:35:24.138684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:47.119116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133887+0000","last_change":"2023-10-09T11:35:23.363287+0000","last_active":"2023-10-09T11:35:24.133887+0000","last_peered":"2023-10-09T11:35:24.133887+0000","last_clean":"2023-10-09T11:35:24.133887+0000","last_became_active":"2023-10-09T11:35:23.362704+0000","last_became_peered":"2023-10-09T11:35:23.362704+0000","last_unstale":"2023-10-09T11:35:24.133887+0000","last_undegraded":"2023-10-09T11:35:24.133887+0000","last_fullsized":"2023-10-09T11:35:24.133887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144593+0000","last_change":"2023-10-09T11:35:24.137239+0000","last_active":"2023-10-09T11:35:24.144593+0000","last_peered":"2023-10-09T11:35:24.144593+0000","last_clean":"2023-10-09T11:35:24.144593+0000","last_became_active":"2023-10-09T11:35:24.136716+0000","last_became_peered":"2023-10-09T11:35:24.136716+0000","last_unstale":"2023-10-09T11:35:24.144593+0000","last_undegraded":"2023-10-09T11:35:24.144593+0000","last_fullsized":"2023-10-09T11:35:24.144593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:42.856264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131929+0000","last_change":"2023-10-09T11:35:23.362437+0000","last_active":"2023-10-09T11:35:24.131929+0000","last_peered":"2023-10-09T11:35:24.131929+0000","last_clean":"2023-10-09T11:35:24.131929+0000","last_became_active":"2023-10-09T11:35:23.362098+0000","last_became_peered":"2023-10-09T11:35:23.362098+0000","last_unstale":"2023-10-09T11:35:24.131929+0000","last_undegraded":"2023-10-09T11:35:24.131929+0000","last_fullsized":"2023-10-09T11:35:24.131929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.136802+0000","last_change":"2023-10-09T11:35:24.136802+0000","last_active":"2023-10-09T11:35:24.136802+0000","last_peered":"2023-10-09T11:35:24.136802+0000","last_clean":"2023-10-09T11:35:24.136802+0000","last_became_active":"2023-10-09T11:35:24.136552+0000","last_became_peered":"2023-10-09T11:35:24.136552+0000","last_unstale":"2023-10-09T11:35:24.136802+0000","last_undegraded":"2023-10-09T11:35:24.136802+0000","last_fullsized":"2023-10-09T11:35:24.136802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131028+0000","last_change":"2023-10-09T11:35:23.354482+0000","last_active":"2023-10-09T11:35:24.131028+0000","last_peered":"2023-10-09T11:35:24.131028+0000","last_clean":"2023-10-09T11:35:24.131028+0000","last_became_active":"2023-10-09T11:35:23.354145+0000","last_became_peered":"2023-10-09T11:35:23.354145+0000","last_unstale":"2023-10-09T11:35:24.131028+0000","last_undegraded":"2023-10-09T11:35:24.131028+0000","last_fullsized":"2023-10-09T11:35:24.131028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142780+0000","last_change":"2023-10-09T11:35:24.142780+0000","last_active":"2023-10-09T11:35:24.142780+0000","last_peered":"2023-10-09T11:35:24.142780+0000","last_clean":"2023-10-09T11:35:24.142780+0000","last_became_active":"2023-10-09T11:35:24.142495+0000","last_became_peered":"2023-10-09T11:35:24.142495+0000","last_unstale":"2023-10-09T11:35:24.142780+0000","last_undegraded":"2023-10-09T11:35:24.142780+0000","last_fullsized":"2023-10-09T11:35:24.142780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354147+0000","last_change":"2023-10-09T11:35:23.363974+0000","last_active":"2023-10-09T11:35:24.354147+0000","last_peered":"2023-10-09T11:35:24.354147+0000","last_clean":"2023-10-09T11:35:24.354147+0000","last_became_active":"2023-10-09T11:35:23.363542+0000","last_became_peered":"2023-10-09T11:35:23.363542+0000","last_unstale":"2023-10-09T11:35:24.354147+0000","last_undegraded":"2023-10-09T11:35:24.354147+0000","last_fullsized":"2023-10-09T11:35:24.354147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140368+0000","last_change":"2023-10-09T11:35:24.136470+0000","last_active":"2023-10-09T11:35:24.140368+0000","last_peered":"2023-10-09T11:35:24.140368+0000","last_clean":"2023-10-09T11:35:24.140368+0000","last_became_active":"2023-10-09T11:35:24.136165+0000","last_became_peered":"2023-10-09T11:35:24.136165+0000","last_unstale":"2023-10-09T11:35:24.140368+0000","last_undegraded":"2023-10-09T11:35:24.140368+0000","last_fullsized":"2023-10-09T11:35:24.140368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.360238+0000","last_change":"2023-10-09T11:35:23.358941+0000","last_active":"2023-10-09T11:35:23.360238+0000","last_peered":"2023-10-09T11:35:23.360238+0000","last_clean":"2023-10-09T11:35:23.360238+0000","last_became_active":"2023-10-09T11:35:23.358644+0000","last_became_peered":"2023-10-09T11:35:23.358644+0000","last_unstale":"2023-10-09T11:35:23.360238+0000","last_undegraded":"2023-10-09T11:35:23.360238+0000","last_fullsized":"2023-10-09T11:35:23.360238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151207+0000","last_change":"2023-10-09T11:35:24.150106+0000","last_active":"2023-10-09T11:35:24.151207+0000","last_peered":"2023-10-09T11:35:24.151207+0000","last_clean":"2023-10-09T11:35:24.151207+0000","last_became_active":"2023-10-09T11:35:24.149822+0000","last_became_peered":"2023-10-09T11:35:24.149822+0000","last_unstale":"2023-10-09T11:35:24.151207+0000","last_undegraded":"2023-10-09T11:35:24.151207+0000","last_fullsized":"2023-10-09T11:35:24.151207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.351118+0000","last_change":"2023-10-09T11:35:23.355543+0000","last_active":"2023-10-09T11:35:24.351118+0000","last_peered":"2023-10-09T11:35:24.351118+0000","last_clean":"2023-10-09T11:35:24.351118+0000","last_became_active":"2023-10-09T11:35:23.355209+0000","last_became_peered":"2023-10-09T11:35:23.355209+0000","last_unstale":"2023-10-09T11:35:24.351118+0000","last_undegraded":"2023-10-09T11:35:24.351118+0000","last_fullsized":"2023-10-09T11:35:24.351118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151598+0000","last_change":"2023-10-09T11:35:24.148840+0000","last_active":"2023-10-09T11:35:24.151598+0000","last_peered":"2023-10-09T11:35:24.151598+0000","last_clean":"2023-10-09T11:35:24.151598+0000","last_became_active":"2023-10-09T11:35:24.148295+0000","last_became_peered":"2023-10-09T11:35:24.148295+0000","last_unstale":"2023-10-09T11:35:24.151598+0000","last_undegraded":"2023-10-09T11:35:24.151598+0000","last_fullsized":"2023-10-09T11:35:24.151598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353445+0000","last_change":"2023-10-09T11:35:23.356087+0000","last_active":"2023-10-09T11:35:24.353445+0000","last_peered":"2023-10-09T11:35:24.353445+0000","last_clean":"2023-10-09T11:35:24.353445+0000","last_became_active":"2023-10-09T11:35:23.355642+0000","last_became_peered":"2023-10-09T11:35:23.355642+0000","last_unstale":"2023-10-09T11:35:24.353445+0000","last_undegraded":"2023-10-09T11:35:24.353445+0000","last_fullsized":"2023-10-09T11:35:24.353445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.150321+0000","last_change":"2023-10-09T11:35:24.149254+0000","last_active":"2023-10-09T11:35:24.150321+0000","last_peered":"2023-10-09T11:35:24.150321+0000","last_clean":"2023-10-09T11:35:24.150321+0000","last_became_active":"2023-10-09T11:35:24.148931+0000","last_became_peered":"2023-10-09T11:35:24.148931+0000","last_unstale":"2023-10-09T11:35:24.150321+0000","last_undegraded":"2023-10-09T11:35:24.150321+0000","last_fullsized":"2023-10-09T11:35:24.150321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146536+0000","last_change":"2023-10-09T11:35:24.144407+0000","last_active":"2023-10-09T11:35:24.146536+0000","last_peered":"2023-10-09T11:35:24.146536+0000","last_clean":"2023-10-09T11:35:24.146536+0000","last_became_active":"2023-10-09T11:35:24.144120+0000","last_became_peered":"2023-10-09T11:35:24.144120+0000","last_unstale":"2023-10-09T11:35:24.146536+0000","last_undegraded":"2023-10-09T11:35:24.146536+0000","last_fullsized":"2023-10-09T11:35:24.146536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148542+0000","last_change":"2023-10-09T11:35:24.148542+0000","last_active":"2023-10-09T11:35:24.148542+0000","last_peered":"2023-10-09T11:35:24.148542+0000","last_clean":"2023-10-09T11:35:24.148542+0000","last_became_active":"2023-10-09T11:35:24.148205+0000","last_became_peered":"2023-10-09T11:35:24.148205+0000","last_unstale":"2023-10-09T11:35:24.148542+0000","last_undegraded":"2023-10-09T11:35:24.148542+0000","last_fullsized":"2023-10-09T11:35:24.148542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151809+0000","last_change":"2023-10-09T11:35:24.147669+0000","last_active":"2023-10-09T11:35:24.151809+0000","last_peered":"2023-10-09T11:35:24.151809+0000","last_clean":"2023-10-09T11:35:24.151809+0000","last_became_active":"2023-10-09T11:35:24.147088+0000","last_became_peered":"2023-10-09T11:35:24.147088+0000","last_unstale":"2023-10-09T11:35:24.151809+0000","last_undegraded":"2023-10-09T11:35:24.151809+0000","last_fullsized":"2023-10-09T11:35:24.151809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142634+0000","last_change":"2023-10-09T11:35:24.142634+0000","last_active":"2023-10-09T11:35:24.142634+0000","last_peered":"2023-10-09T11:35:24.142634+0000","last_clean":"2023-10-09T11:35:24.142634+0000","last_became_active":"2023-10-09T11:35:24.142365+0000","last_became_peered":"2023-10-09T11:35:24.142365+0000","last_unstale":"2023-10-09T11:35:24.142634+0000","last_undegraded":"2023-10-09T11:35:24.142634+0000","last_fullsized":"2023-10-09T11:35:24.142634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.135282+0000","last_change":"2023-10-09T11:35:24.135282+0000","last_active":"2023-10-09T11:35:24.135282+0000","last_peered":"2023-10-09T11:35:24.135282+0000","last_clean":"2023-10-09T11:35:24.135282+0000","last_became_active":"2023-10-09T11:35:24.135029+0000","last_became_peered":"2023-10-09T11:35:24.135029+0000","last_unstale":"2023-10-09T11:35:24.135282+0000","last_undegraded":"2023-10-09T11:35:24.135282+0000","last_fullsized":"2023-10-09T11:35:24.135282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143840+0000","last_change":"2023-10-09T11:35:24.140956+0000","last_active":"2023-10-09T11:35:24.143840+0000","last_peered":"2023-10-09T11:35:24.143840+0000","last_clean":"2023-10-09T11:35:24.143840+0000","last_became_active":"2023-10-09T11:35:24.140678+0000","last_became_peered":"2023-10-09T11:35:24.140678+0000","last_unstale":"2023-10-09T11:35:24.143840+0000","last_undegraded":"2023-10-09T11:35:24.143840+0000","last_fullsized":"2023-10-09T11:35:24.143840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146433+0000","last_change":"2023-10-09T11:35:24.140260+0000","last_active":"2023-10-09T11:35:24.146433+0000","last_peered":"2023-10-09T11:35:24.146433+0000","last_clean":"2023-10-09T11:35:24.146433+0000","last_became_active":"2023-10-09T11:35:24.139938+0000","last_became_peered":"2023-10-09T11:35:24.139938+0000","last_unstale":"2023-10-09T11:35:24.146433+0000","last_undegraded":"2023-10-09T11:35:24.146433+0000","last_fullsized":"2023-10-09T11:35:24.146433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.135797+0000","last_change":"2023-10-09T11:35:24.135797+0000","last_active":"2023-10-09T11:35:24.135797+0000","last_peered":"2023-10-09T11:35:24.135797+0000","last_clean":"2023-10-09T11:35:24.135797+0000","last_became_active":"2023-10-09T11:35:24.135530+0000","last_became_peered":"2023-10-09T11:35:24.135530+0000","last_unstale":"2023-10-09T11:35:24.135797+0000","last_undegraded":"2023-10-09T11:35:24.135797+0000","last_fullsized":"2023-10-09T11:35:24.135797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154030+0000","last_change":"2023-10-09T11:35:24.151526+0000","last_active":"2023-10-09T11:35:24.154030+0000","last_peered":"2023-10-09T11:35:24.154030+0000","last_clean":"2023-10-09T11:35:24.154030+0000","last_became_active":"2023-10-09T11:35:24.147333+0000","last_became_peered":"2023-10-09T11:35:24.147333+0000","last_unstale":"2023-10-09T11:35:24.154030+0000","last_undegraded":"2023-10-09T11:35:24.154030+0000","last_fullsized":"2023-10-09T11:35:24.154030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134614+0000","last_change":"2023-10-09T11:35:24.134614+0000","last_active":"2023-10-09T11:35:24.134614+0000","last_peered":"2023-10-09T11:35:24.134614+0000","last_clean":"2023-10-09T11:35:24.134614+0000","last_became_active":"2023-10-09T11:35:24.134362+0000","last_became_peered":"2023-10-09T11:35:24.134362+0000","last_unstale":"2023-10-09T11:35:24.134614+0000","last_undegraded":"2023-10-09T11:35:24.134614+0000","last_fullsized":"2023-10-09T11:35:24.134614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154083+0000","last_change":"2023-10-09T11:35:24.151676+0000","last_active":"2023-10-09T11:35:24.154083+0000","last_peered":"2023-10-09T11:35:24.154083+0000","last_clean":"2023-10-09T11:35:24.154083+0000","last_became_active":"2023-10-09T11:35:24.150853+0000","last_became_peered":"2023-10-09T11:35:24.150853+0000","last_unstale":"2023-10-09T11:35:24.154083+0000","last_undegraded":"2023-10-09T11:35:24.154083+0000","last_fullsized":"2023-10-09T11:35:24.154083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145336+0000","last_change":"2023-10-09T11:35:24.145336+0000","last_active":"2023-10-09T11:35:24.145336+0000","last_peered":"2023-10-09T11:35:24.145336+0000","last_clean":"2023-10-09T11:35:24.145336+0000","last_became_active":"2023-10-09T11:35:24.145009+0000","last_became_peered":"2023-10-09T11:35:24.145009+0000","last_unstale":"2023-10-09T11:35:24.145336+0000","last_undegraded":"2023-10-09T11:35:24.145336+0000","last_fullsized":"2023-10-09T11:35:24.145336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140506+0000","last_change":"2023-10-09T11:35:24.137045+0000","last_active":"2023-10-09T11:35:24.140506+0000","last_peered":"2023-10-09T11:35:24.140506+0000","last_clean":"2023-10-09T11:35:24.140506+0000","last_became_active":"2023-10-09T11:35:24.136734+0000","last_became_peered":"2023-10-09T11:35:24.136734+0000","last_unstale":"2023-10-09T11:35:24.140506+0000","last_undegraded":"2023-10-09T11:35:24.140506+0000","last_fullsized":"2023-10-09T11:35:24.140506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":68065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298064,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073776,"statfs":{"total":96636764160,"available":96331546624,"internally_reserved":0,"allocated":794624,"data_stored":658273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":67905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":68031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:35:28.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:35:28.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.611+0000 7f7c1210e700 1 Processor -- start 2023-10-09T11:35:28.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.611+0000 7f7c1210e700 1 -- start start 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1210e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7c0c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1210e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c15afd0 con 0x7f7c0c0cf110 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1210e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c15b2b0 con 0x7f7c0c15de50 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1210e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15b590 con 0x7f7c0c153c30 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1190d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7c0c0cf110 0x7f7c0c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57100/0 (socket says 172.21.15.26:57100) 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.612+0000 7f7c1190d700 1 -- 172.21.15.26:0/4073508229 learned_addr learned my addr 172.21.15.26:0/4073508229 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7c0c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58860346 0 0) 0x7f7c0c15afd0 con 0x7f7c0c0cf110 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf4003570 con 0x7f7c0c0cf110 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3173996336 0 0) 0x7f7bf4003570 con 0x7f7c0c0cf110 2023-10-09T11:35:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 msgr2=0x7f7c0c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7c0c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 >> v1:172.21.15.67:6789/0 conn(0x7f7c0c15de50 legacy=0x7f7c0c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c15b870 con 0x7f7c0c0cf110 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f7c040017f0 con 0x7f7c0c0cf110 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 >> v1:172.21.15.26:6789/0 conn(0x7f7c0c0cf110 legacy=0x7f7c0c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4003a90 0x7f7bf4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4004810 0x7f7bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7bf40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15b590 con 0x7f7bf4003a90 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400bb60 con 0x7f7bf4004810 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400bd20 con 0x7f7c0c153c30 2023-10-09T11:35:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4003a90 0x7f7bf4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1090b700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4004810 0x7f7bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1190d700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7bf40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 -- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 msgr2=0x7f7bf40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7bf40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 -- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4004810 msgr2=0x7f7bf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4004810 0x7f7bf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 -- 172.21.15.26:0/4073508229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4003570 con 0x7f7bf4003a90 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1190d700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c153c30 0x7f7bf40051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1090b700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4004810 0x7f7bf4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.613+0000 7f7c1110c700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4003a90 0x7f7bf4003ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009c00 tx=0x7f7bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09fa3edff0e23d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00e710 con 0x7f7bf4003a90 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00e870 con 0x7f7bf4003a90 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c0bfff700 1 -- 172.21.15.26:0/4073508229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00ec30 con 0x7f7bf4003a90 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 -- 172.21.15.26:0/4073508229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4003a90 msgr2=0x7f7bf4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 --2- 172.21.15.26:0/4073508229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4003a90 0x7f7bf4003ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009c00 tx=0x7f7bfc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1190d700 1 -- 172.21.15.26:0/4073508229 reap_dead start 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 -- 172.21.15.26:0/4073508229 shutdown_connections 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 -- 172.21.15.26:0/4073508229 >> 172.21.15.26:0/4073508229 conn(0x7f7c0c0703a0 msgr2=0x7f7c0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 -- 172.21.15.26:0/4073508229 shutdown_connections 2023-10-09T11:35:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.614+0000 7f7c1210e700 1 -- 172.21.15.26:0/4073508229 wait complete. 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.615+0000 7f7c1210e700 1 Processor -- start 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.615+0000 7f7c1210e700 1 -- start start 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4003a90 0x7f7c0c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c0c9e30 0x7f7c0c16cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b3b70 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c16d940 con 0x7f7bf4003a90 2023-10-09T11:35:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1210e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c92f0 con 0x7f7c0c0c9e30 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49948/0 (socket says 172.21.15.26:49948) 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 -- 172.21.15.26:0/3173830697 learned_addr learned my addr 172.21.15.26:0/3173830697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1110c700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4003a90 0x7f7c0c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1090b700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c0c9e30 0x7f7c0c16cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 -- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c0c9e30 msgr2=0x7f7c0c16cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c0c9e30 0x7f7c0c16cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 -- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4003a90 msgr2=0x7f7c0c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4003a90 0x7f7c0c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.616+0000 7f7c1190d700 1 -- 172.21.15.26:0/3173830697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0c8880 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c1190d700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06ead0 tx=0x7f7c040013e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04017070 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04007b40 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c0b32d0 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400ed60 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.617+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c0b3890 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.618+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c04c3c0 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.618+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c04013630 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.619+0000 7f7c097fa700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.619+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c040843c0 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.619+0000 7f7c1110c700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.619+0000 7f7c1110c700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 0x7f7bf80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0091e0 tx=0x7f7bfc01a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.623+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c04051590 con 0x7f7c0c16d4d0 2023-10-09T11:35:28.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.812+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c0c15bbf0 con 0x7f7bf8066f30 2023-10-09T11:35:28.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.821+0000 7f7c097fa700 1 -- 172.21.15.26:0/3173830697 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264597 (secure 0 0 0) 0x7f7bfc023040 con 0x7f7bf8066f30 2023-10-09T11:35:28.825 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:28.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 msgr2=0x7f7bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 0x7f7bf80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0091e0 tx=0x7f7bfc01a000 comp rx=0 tx=0).stop 2023-10-09T11:35:28.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 msgr2=0x7f7c0c0b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06ead0 tx=0x7f7c040013e0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 shutdown_connections 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c0c16d4d0 0x7f7c0c0b4f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4003a90 0x7f7c0c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 --2- 172.21.15.26:0/3173830697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c0c0c9e30 0x7f7c0c16cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 >> 172.21.15.26:0/3173830697 conn(0x7f7c0c0703a0 msgr2=0x7f7c0c0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 shutdown_connections 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.824+0000 7f7c1210e700 1 -- 172.21.15.26:0/3173830697 wait complete. 2023-10-09T11:35:28.828 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:35:28.837 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:35:27.104011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381108,"kb_used_data":2804,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593612,"statfs":{"total":773094113280,"available":770655858688,"internally_reserved":0,"allocated":2871296,"data_stored":1740554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.768808"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148676+0000","last_change":"2023-10-09T11:35:24.145841+0000","last_active":"2023-10-09T11:35:24.148676+0000","last_peered":"2023-10-09T11:35:24.148676+0000","last_clean":"2023-10-09T11:35:24.148676+0000","last_became_active":"2023-10-09T11:35:24.145528+0000","last_became_peered":"2023-10-09T11:35:24.145528+0000","last_unstale":"2023-10-09T11:35:24.148676+0000","last_undegraded":"2023-10-09T11:35:24.148676+0000","last_fullsized":"2023-10-09T11:35:24.148676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:40.514361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143745+0000","last_change":"2023-10-09T11:35:24.139730+0000","last_active":"2023-10-09T11:35:24.143745+0000","last_peered":"2023-10-09T11:35:24.143745+0000","last_clean":"2023-10-09T11:35:24.143745+0000","last_became_active":"2023-10-09T11:35:24.139211+0000","last_became_peered":"2023-10-09T11:35:24.139211+0000","last_unstale":"2023-10-09T11:35:24.143745+0000","last_undegraded":"2023-10-09T11:35:24.143745+0000","last_fullsized":"2023-10-09T11:35:24.143745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139500+0000","last_change":"2023-10-09T11:35:24.139500+0000","last_active":"2023-10-09T11:35:24.139500+0000","last_peered":"2023-10-09T11:35:24.139500+0000","last_clean":"2023-10-09T11:35:24.139500+0000","last_became_active":"2023-10-09T11:35:24.139214+0000","last_became_peered":"2023-10-09T11:35:24.139214+0000","last_unstale":"2023-10-09T11:35:24.139500+0000","last_undegraded":"2023-10-09T11:35:24.139500+0000","last_fullsized":"2023-10-09T11:35:24.139500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:02.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151581+0000","last_change":"2023-10-09T11:35:24.148624+0000","last_active":"2023-10-09T11:35:24.151581+0000","last_peered":"2023-10-09T11:35:24.151581+0000","last_clean":"2023-10-09T11:35:24.151581+0000","last_became_active":"2023-10-09T11:35:24.147894+0000","last_became_peered":"2023-10-09T11:35:24.147894+0000","last_unstale":"2023-10-09T11:35:24.151581+0000","last_undegraded":"2023-10-09T11:35:24.151581+0000","last_fullsized":"2023-10-09T11:35:24.151581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146448+0000","last_change":"2023-10-09T11:35:24.141089+0000","last_active":"2023-10-09T11:35:24.146448+0000","last_peered":"2023-10-09T11:35:24.146448+0000","last_clean":"2023-10-09T11:35:24.146448+0000","last_became_active":"2023-10-09T11:35:24.140515+0000","last_became_peered":"2023-10-09T11:35:24.140515+0000","last_unstale":"2023-10-09T11:35:24.146448+0000","last_undegraded":"2023-10-09T11:35:24.146448+0000","last_fullsized":"2023-10-09T11:35:24.146448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153346+0000","last_change":"2023-10-09T11:35:24.149144+0000","last_active":"2023-10-09T11:35:24.153346+0000","last_peered":"2023-10-09T11:35:24.153346+0000","last_clean":"2023-10-09T11:35:24.153346+0000","last_became_active":"2023-10-09T11:35:24.147370+0000","last_became_peered":"2023-10-09T11:35:24.147370+0000","last_unstale":"2023-10-09T11:35:24.153346+0000","last_undegraded":"2023-10-09T11:35:24.153346+0000","last_fullsized":"2023-10-09T11:35:24.153346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145820+0000","last_change":"2023-10-09T11:35:24.139629+0000","last_active":"2023-10-09T11:35:24.145820+0000","last_peered":"2023-10-09T11:35:24.145820+0000","last_clean":"2023-10-09T11:35:24.145820+0000","last_became_active":"2023-10-09T11:35:24.139350+0000","last_became_peered":"2023-10-09T11:35:24.139350+0000","last_unstale":"2023-10-09T11:35:24.145820+0000","last_undegraded":"2023-10-09T11:35:24.145820+0000","last_fullsized":"2023-10-09T11:35:24.145820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152399+0000","last_change":"2023-10-09T11:35:24.152399+0000","last_active":"2023-10-09T11:35:24.152399+0000","last_peered":"2023-10-09T11:35:24.152399+0000","last_clean":"2023-10-09T11:35:24.152399+0000","last_became_active":"2023-10-09T11:35:24.152168+0000","last_became_peered":"2023-10-09T11:35:24.152168+0000","last_unstale":"2023-10-09T11:35:24.152399+0000","last_undegraded":"2023-10-09T11:35:24.152399+0000","last_fullsized":"2023-10-09T11:35:24.152399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152351+0000","last_change":"2023-10-09T11:35:24.150386+0000","last_active":"2023-10-09T11:35:24.152351+0000","last_peered":"2023-10-09T11:35:24.152351+0000","last_clean":"2023-10-09T11:35:24.152351+0000","last_became_active":"2023-10-09T11:35:24.150091+0000","last_became_peered":"2023-10-09T11:35:24.150091+0000","last_unstale":"2023-10-09T11:35:24.152351+0000","last_undegraded":"2023-10-09T11:35:24.152351+0000","last_fullsized":"2023-10-09T11:35:24.152351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149850+0000","last_change":"2023-10-09T11:35:24.148228+0000","last_active":"2023-10-09T11:35:24.149850+0000","last_peered":"2023-10-09T11:35:24.149850+0000","last_clean":"2023-10-09T11:35:24.149850+0000","last_became_active":"2023-10-09T11:35:24.147941+0000","last_became_peered":"2023-10-09T11:35:24.147941+0000","last_unstale":"2023-10-09T11:35:24.149850+0000","last_undegraded":"2023-10-09T11:35:24.149850+0000","last_fullsized":"2023-10-09T11:35:24.149850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152972+0000","last_change":"2023-10-09T11:35:24.152453+0000","last_active":"2023-10-09T11:35:24.152972+0000","last_peered":"2023-10-09T11:35:24.152972+0000","last_clean":"2023-10-09T11:35:24.152972+0000","last_became_active":"2023-10-09T11:35:24.152174+0000","last_became_peered":"2023-10-09T11:35:24.152174+0000","last_unstale":"2023-10-09T11:35:24.152972+0000","last_undegraded":"2023-10-09T11:35:24.152972+0000","last_fullsized":"2023-10-09T11:35:24.152972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145082+0000","last_change":"2023-10-09T11:35:24.138179+0000","last_active":"2023-10-09T11:35:24.145082+0000","last_peered":"2023-10-09T11:35:24.145082+0000","last_clean":"2023-10-09T11:35:24.145082+0000","last_became_active":"2023-10-09T11:35:24.137705+0000","last_became_peered":"2023-10-09T11:35:24.137705+0000","last_unstale":"2023-10-09T11:35:24.145082+0000","last_undegraded":"2023-10-09T11:35:24.145082+0000","last_fullsized":"2023-10-09T11:35:24.145082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.137044+0000","last_change":"2023-10-09T11:35:24.137044+0000","last_active":"2023-10-09T11:35:24.137044+0000","last_peered":"2023-10-09T11:35:24.137044+0000","last_clean":"2023-10-09T11:35:24.137044+0000","last_became_active":"2023-10-09T11:35:24.136733+0000","last_became_peered":"2023-10-09T11:35:24.136733+0000","last_unstale":"2023-10-09T11:35:24.137044+0000","last_undegraded":"2023-10-09T11:35:24.137044+0000","last_fullsized":"2023-10-09T11:35:24.137044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138471+0000","last_change":"2023-10-09T11:35:24.138471+0000","last_active":"2023-10-09T11:35:24.138471+0000","last_peered":"2023-10-09T11:35:24.138471+0000","last_clean":"2023-10-09T11:35:24.138471+0000","last_became_active":"2023-10-09T11:35:24.138180+0000","last_became_peered":"2023-10-09T11:35:24.138180+0000","last_unstale":"2023-10-09T11:35:24.138471+0000","last_undegraded":"2023-10-09T11:35:24.138471+0000","last_fullsized":"2023-10-09T11:35:24.138471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138655+0000","last_change":"2023-10-09T11:35:24.135966+0000","last_active":"2023-10-09T11:35:24.138655+0000","last_peered":"2023-10-09T11:35:24.138655+0000","last_clean":"2023-10-09T11:35:24.138655+0000","last_became_active":"2023-10-09T11:35:24.135698+0000","last_became_peered":"2023-10-09T11:35:24.135698+0000","last_unstale":"2023-10-09T11:35:24.138655+0000","last_undegraded":"2023-10-09T11:35:24.138655+0000","last_fullsized":"2023-10-09T11:35:24.138655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151783+0000","last_change":"2023-10-09T11:35:24.149400+0000","last_active":"2023-10-09T11:35:24.151783+0000","last_peered":"2023-10-09T11:35:24.151783+0000","last_clean":"2023-10-09T11:35:24.151783+0000","last_became_active":"2023-10-09T11:35:24.146746+0000","last_became_peered":"2023-10-09T11:35:24.146746+0000","last_unstale":"2023-10-09T11:35:24.151783+0000","last_undegraded":"2023-10-09T11:35:24.151783+0000","last_fullsized":"2023-10-09T11:35:24.151783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153950+0000","last_change":"2023-10-09T11:35:24.151212+0000","last_active":"2023-10-09T11:35:24.153950+0000","last_peered":"2023-10-09T11:35:24.153950+0000","last_clean":"2023-10-09T11:35:24.153950+0000","last_became_active":"2023-10-09T11:35:24.150896+0000","last_became_peered":"2023-10-09T11:35:24.150896+0000","last_unstale":"2023-10-09T11:35:24.153950+0000","last_undegraded":"2023-10-09T11:35:24.153950+0000","last_fullsized":"2023-10-09T11:35:24.153950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140434+0000","last_change":"2023-10-09T11:35:24.140434+0000","last_active":"2023-10-09T11:35:24.140434+0000","last_peered":"2023-10-09T11:35:24.140434+0000","last_clean":"2023-10-09T11:35:24.140434+0000","last_became_active":"2023-10-09T11:35:24.140143+0000","last_became_peered":"2023-10-09T11:35:24.140143+0000","last_unstale":"2023-10-09T11:35:24.140434+0000","last_undegraded":"2023-10-09T11:35:24.140434+0000","last_fullsized":"2023-10-09T11:35:24.140434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145914+0000","last_change":"2023-10-09T11:35:24.139525+0000","last_active":"2023-10-09T11:35:24.145914+0000","last_peered":"2023-10-09T11:35:24.145914+0000","last_clean":"2023-10-09T11:35:24.145914+0000","last_became_active":"2023-10-09T11:35:24.139231+0000","last_became_peered":"2023-10-09T11:35:24.139231+0000","last_unstale":"2023-10-09T11:35:24.145914+0000","last_undegraded":"2023-10-09T11:35:24.145914+0000","last_fullsized":"2023-10-09T11:35:24.145914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356581+0000","last_change":"2023-10-09T11:35:23.362882+0000","last_active":"2023-10-09T11:35:24.356581+0000","last_peered":"2023-10-09T11:35:24.356581+0000","last_clean":"2023-10-09T11:35:24.356581+0000","last_became_active":"2023-10-09T11:35:23.362595+0000","last_became_peered":"2023-10-09T11:35:23.362595+0000","last_unstale":"2023-10-09T11:35:24.356581+0000","last_undegraded":"2023-10-09T11:35:24.356581+0000","last_fullsized":"2023-10-09T11:35:24.356581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.137972+0000","last_change":"2023-10-09T11:35:24.137972+0000","last_active":"2023-10-09T11:35:24.137972+0000","last_peered":"2023-10-09T11:35:24.137972+0000","last_clean":"2023-10-09T11:35:24.137972+0000","last_became_active":"2023-10-09T11:35:24.137704+0000","last_became_peered":"2023-10-09T11:35:24.137704+0000","last_unstale":"2023-10-09T11:35:24.137972+0000","last_undegraded":"2023-10-09T11:35:24.137972+0000","last_fullsized":"2023-10-09T11:35:24.137972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128942+0000","last_change":"2023-10-09T11:35:23.358839+0000","last_active":"2023-10-09T11:35:24.128942+0000","last_peered":"2023-10-09T11:35:24.128942+0000","last_clean":"2023-10-09T11:35:24.128942+0000","last_became_active":"2023-10-09T11:35:23.358555+0000","last_became_peered":"2023-10-09T11:35:23.358555+0000","last_unstale":"2023-10-09T11:35:24.128942+0000","last_undegraded":"2023-10-09T11:35:24.128942+0000","last_fullsized":"2023-10-09T11:35:24.128942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146933+0000","last_change":"2023-10-09T11:35:24.146933+0000","last_active":"2023-10-09T11:35:24.146933+0000","last_peered":"2023-10-09T11:35:24.146933+0000","last_clean":"2023-10-09T11:35:24.146933+0000","last_became_active":"2023-10-09T11:35:24.146693+0000","last_became_peered":"2023-10-09T11:35:24.146693+0000","last_unstale":"2023-10-09T11:35:24.146933+0000","last_undegraded":"2023-10-09T11:35:24.146933+0000","last_fullsized":"2023-10-09T11:35:24.146933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354056+0000","last_change":"2023-10-09T11:35:23.367495+0000","last_active":"2023-10-09T11:35:24.354056+0000","last_peered":"2023-10-09T11:35:24.354056+0000","last_clean":"2023-10-09T11:35:24.354056+0000","last_became_active":"2023-10-09T11:35:23.367189+0000","last_became_peered":"2023-10-09T11:35:23.367189+0000","last_unstale":"2023-10-09T11:35:24.354056+0000","last_undegraded":"2023-10-09T11:35:24.354056+0000","last_fullsized":"2023-10-09T11:35:24.354056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153981+0000","last_change":"2023-10-09T11:35:24.151258+0000","last_active":"2023-10-09T11:35:24.153981+0000","last_peered":"2023-10-09T11:35:24.153981+0000","last_clean":"2023-10-09T11:35:24.153981+0000","last_became_active":"2023-10-09T11:35:24.150987+0000","last_became_peered":"2023-10-09T11:35:24.150987+0000","last_unstale":"2023-10-09T11:35:24.153981+0000","last_undegraded":"2023-10-09T11:35:24.153981+0000","last_fullsized":"2023-10-09T11:35:24.153981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354452+0000","last_change":"2023-10-09T11:35:23.366425+0000","last_active":"2023-10-09T11:35:24.354452+0000","last_peered":"2023-10-09T11:35:24.354452+0000","last_clean":"2023-10-09T11:35:24.354452+0000","last_became_active":"2023-10-09T11:35:23.366115+0000","last_became_peered":"2023-10-09T11:35:23.366115+0000","last_unstale":"2023-10-09T11:35:24.354452+0000","last_undegraded":"2023-10-09T11:35:24.354452+0000","last_fullsized":"2023-10-09T11:35:24.354452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153731+0000","last_change":"2023-10-09T11:35:24.149747+0000","last_active":"2023-10-09T11:35:24.153731+0000","last_peered":"2023-10-09T11:35:24.153731+0000","last_clean":"2023-10-09T11:35:24.153731+0000","last_became_active":"2023-10-09T11:35:24.149466+0000","last_became_peered":"2023-10-09T11:35:24.149466+0000","last_unstale":"2023-10-09T11:35:24.153731+0000","last_undegraded":"2023-10-09T11:35:24.153731+0000","last_fullsized":"2023-10-09T11:35:24.153731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128763+0000","last_change":"2023-10-09T11:35:23.364018+0000","last_active":"2023-10-09T11:35:24.128763+0000","last_peered":"2023-10-09T11:35:24.128763+0000","last_clean":"2023-10-09T11:35:24.128763+0000","last_became_active":"2023-10-09T11:35:23.363736+0000","last_became_peered":"2023-10-09T11:35:23.363736+0000","last_unstale":"2023-10-09T11:35:24.128763+0000","last_undegraded":"2023-10-09T11:35:24.128763+0000","last_fullsized":"2023-10-09T11:35:24.128763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144566+0000","last_change":"2023-10-09T11:35:24.138177+0000","last_active":"2023-10-09T11:35:24.144566+0000","last_peered":"2023-10-09T11:35:24.144566+0000","last_clean":"2023-10-09T11:35:24.144566+0000","last_became_active":"2023-10-09T11:35:24.137865+0000","last_became_peered":"2023-10-09T11:35:24.137865+0000","last_unstale":"2023-10-09T11:35:24.144566+0000","last_undegraded":"2023-10-09T11:35:24.144566+0000","last_fullsized":"2023-10-09T11:35:24.144566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:30.412408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349191+0000","last_change":"2023-10-09T11:35:23.357930+0000","last_active":"2023-10-09T11:35:24.349191+0000","last_peered":"2023-10-09T11:35:24.349191+0000","last_clean":"2023-10-09T11:35:24.349191+0000","last_became_active":"2023-10-09T11:35:23.357528+0000","last_became_peered":"2023-10-09T11:35:23.357528+0000","last_unstale":"2023-10-09T11:35:24.349191+0000","last_undegraded":"2023-10-09T11:35:24.349191+0000","last_fullsized":"2023-10-09T11:35:24.349191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145192+0000","last_change":"2023-10-09T11:35:24.145192+0000","last_active":"2023-10-09T11:35:24.145192+0000","last_peered":"2023-10-09T11:35:24.145192+0000","last_clean":"2023-10-09T11:35:24.145192+0000","last_became_active":"2023-10-09T11:35:24.144928+0000","last_became_peered":"2023-10-09T11:35:24.144928+0000","last_unstale":"2023-10-09T11:35:24.145192+0000","last_undegraded":"2023-10-09T11:35:24.145192+0000","last_fullsized":"2023-10-09T11:35:24.145192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.364246+0000","last_change":"2023-10-09T11:35:23.362782+0000","last_active":"2023-10-09T11:35:23.364246+0000","last_peered":"2023-10-09T11:35:23.364246+0000","last_clean":"2023-10-09T11:35:23.364246+0000","last_became_active":"2023-10-09T11:35:23.362488+0000","last_became_peered":"2023-10-09T11:35:23.362488+0000","last_unstale":"2023-10-09T11:35:23.364246+0000","last_undegraded":"2023-10-09T11:35:23.364246+0000","last_fullsized":"2023-10-09T11:35:23.364246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140502+0000","last_change":"2023-10-09T11:35:24.140502+0000","last_active":"2023-10-09T11:35:24.140502+0000","last_peered":"2023-10-09T11:35:24.140502+0000","last_clean":"2023-10-09T11:35:24.140502+0000","last_became_active":"2023-10-09T11:35:24.140108+0000","last_became_peered":"2023-10-09T11:35:24.140108+0000","last_unstale":"2023-10-09T11:35:24.140502+0000","last_undegraded":"2023-10-09T11:35:24.140502+0000","last_fullsized":"2023-10-09T11:35:24.140502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144662+0000","last_change":"2023-10-09T11:35:23.356945+0000","last_active":"2023-10-09T11:35:24.144662+0000","last_peered":"2023-10-09T11:35:24.144662+0000","last_clean":"2023-10-09T11:35:24.144662+0000","last_became_active":"2023-10-09T11:35:23.356634+0000","last_became_peered":"2023-10-09T11:35:23.356634+0000","last_unstale":"2023-10-09T11:35:24.144662+0000","last_undegraded":"2023-10-09T11:35:24.144662+0000","last_fullsized":"2023-10-09T11:35:24.144662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142287+0000","last_change":"2023-10-09T11:35:24.137880+0000","last_active":"2023-10-09T11:35:24.142287+0000","last_peered":"2023-10-09T11:35:24.142287+0000","last_clean":"2023-10-09T11:35:24.142287+0000","last_became_active":"2023-10-09T11:35:24.137629+0000","last_became_peered":"2023-10-09T11:35:24.137629+0000","last_unstale":"2023-10-09T11:35:24.142287+0000","last_undegraded":"2023-10-09T11:35:24.142287+0000","last_fullsized":"2023-10-09T11:35:24.142287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.130245+0000","last_change":"2023-10-09T11:35:23.362809+0000","last_active":"2023-10-09T11:35:24.130245+0000","last_peered":"2023-10-09T11:35:24.130245+0000","last_clean":"2023-10-09T11:35:24.130245+0000","last_became_active":"2023-10-09T11:35:23.362496+0000","last_became_peered":"2023-10-09T11:35:23.362496+0000","last_unstale":"2023-10-09T11:35:24.130245+0000","last_undegraded":"2023-10-09T11:35:24.130245+0000","last_fullsized":"2023-10-09T11:35:24.130245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153973+0000","last_change":"2023-10-09T11:35:24.151289+0000","last_active":"2023-10-09T11:35:24.153973+0000","last_peered":"2023-10-09T11:35:24.153973+0000","last_clean":"2023-10-09T11:35:24.153973+0000","last_became_active":"2023-10-09T11:35:24.150977+0000","last_became_peered":"2023-10-09T11:35:24.150977+0000","last_unstale":"2023-10-09T11:35:24.153973+0000","last_undegraded":"2023-10-09T11:35:24.153973+0000","last_fullsized":"2023-10-09T11:35:24.153973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145743+0000","last_change":"2023-10-09T11:35:23.364359+0000","last_active":"2023-10-09T11:35:24.145743+0000","last_peered":"2023-10-09T11:35:24.145743+0000","last_clean":"2023-10-09T11:35:24.145743+0000","last_became_active":"2023-10-09T11:35:23.364054+0000","last_became_peered":"2023-10-09T11:35:23.364054+0000","last_unstale":"2023-10-09T11:35:24.145743+0000","last_undegraded":"2023-10-09T11:35:24.145743+0000","last_fullsized":"2023-10-09T11:35:24.145743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146931+0000","last_change":"2023-10-09T11:35:24.146931+0000","last_active":"2023-10-09T11:35:24.146931+0000","last_peered":"2023-10-09T11:35:24.146931+0000","last_clean":"2023-10-09T11:35:24.146931+0000","last_became_active":"2023-10-09T11:35:24.146657+0000","last_became_peered":"2023-10-09T11:35:24.146657+0000","last_unstale":"2023-10-09T11:35:24.146931+0000","last_undegraded":"2023-10-09T11:35:24.146931+0000","last_fullsized":"2023-10-09T11:35:24.146931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353815+0000","last_change":"2023-10-09T11:35:23.356704+0000","last_active":"2023-10-09T11:35:24.353815+0000","last_peered":"2023-10-09T11:35:24.353815+0000","last_clean":"2023-10-09T11:35:24.353815+0000","last_became_active":"2023-10-09T11:35:23.356414+0000","last_became_peered":"2023-10-09T11:35:23.356414+0000","last_unstale":"2023-10-09T11:35:24.353815+0000","last_undegraded":"2023-10-09T11:35:24.353815+0000","last_fullsized":"2023-10-09T11:35:24.353815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145391+0000","last_change":"2023-10-09T11:35:24.140247+0000","last_active":"2023-10-09T11:35:24.145391+0000","last_peered":"2023-10-09T11:35:24.145391+0000","last_clean":"2023-10-09T11:35:24.145391+0000","last_became_active":"2023-10-09T11:35:24.139935+0000","last_became_peered":"2023-10-09T11:35:24.139935+0000","last_unstale":"2023-10-09T11:35:24.145391+0000","last_undegraded":"2023-10-09T11:35:24.145391+0000","last_fullsized":"2023-10-09T11:35:24.145391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:29.365580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356605+0000","last_change":"2023-10-09T11:35:23.358506+0000","last_active":"2023-10-09T11:35:24.356605+0000","last_peered":"2023-10-09T11:35:24.356605+0000","last_clean":"2023-10-09T11:35:24.356605+0000","last_became_active":"2023-10-09T11:35:23.358190+0000","last_became_peered":"2023-10-09T11:35:23.358190+0000","last_unstale":"2023-10-09T11:35:24.356605+0000","last_undegraded":"2023-10-09T11:35:24.356605+0000","last_fullsized":"2023-10-09T11:35:24.356605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146454+0000","last_change":"2023-10-09T11:35:24.142761+0000","last_active":"2023-10-09T11:35:24.146454+0000","last_peered":"2023-10-09T11:35:24.146454+0000","last_clean":"2023-10-09T11:35:24.146454+0000","last_became_active":"2023-10-09T11:35:24.142487+0000","last_became_peered":"2023-10-09T11:35:24.142487+0000","last_unstale":"2023-10-09T11:35:24.146454+0000","last_undegraded":"2023-10-09T11:35:24.146454+0000","last_fullsized":"2023-10-09T11:35:24.146454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353995+0000","last_change":"2023-10-09T11:35:23.356502+0000","last_active":"2023-10-09T11:35:24.353995+0000","last_peered":"2023-10-09T11:35:24.353995+0000","last_clean":"2023-10-09T11:35:24.353995+0000","last_became_active":"2023-10-09T11:35:23.356248+0000","last_became_peered":"2023-10-09T11:35:23.356248+0000","last_unstale":"2023-10-09T11:35:24.353995+0000","last_undegraded":"2023-10-09T11:35:24.353995+0000","last_fullsized":"2023-10-09T11:35:24.353995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139623+0000","last_change":"2023-10-09T11:35:24.139623+0000","last_active":"2023-10-09T11:35:24.139623+0000","last_peered":"2023-10-09T11:35:24.139623+0000","last_clean":"2023-10-09T11:35:24.139623+0000","last_became_active":"2023-10-09T11:35:24.139334+0000","last_became_peered":"2023-10-09T11:35:24.139334+0000","last_unstale":"2023-10-09T11:35:24.139623+0000","last_undegraded":"2023-10-09T11:35:24.139623+0000","last_fullsized":"2023-10-09T11:35:24.139623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145593+0000","last_change":"2023-10-09T11:35:23.356511+0000","last_active":"2023-10-09T11:35:24.145593+0000","last_peered":"2023-10-09T11:35:24.145593+0000","last_clean":"2023-10-09T11:35:24.145593+0000","last_became_active":"2023-10-09T11:35:23.356139+0000","last_became_peered":"2023-10-09T11:35:23.356139+0000","last_unstale":"2023-10-09T11:35:24.145593+0000","last_undegraded":"2023-10-09T11:35:24.145593+0000","last_fullsized":"2023-10-09T11:35:24.145593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146469+0000","last_change":"2023-10-09T11:35:24.141301+0000","last_active":"2023-10-09T11:35:24.146469+0000","last_peered":"2023-10-09T11:35:24.146469+0000","last_clean":"2023-10-09T11:35:24.146469+0000","last_became_active":"2023-10-09T11:35:24.140824+0000","last_became_peered":"2023-10-09T11:35:24.140824+0000","last_unstale":"2023-10-09T11:35:24.146469+0000","last_undegraded":"2023-10-09T11:35:24.146469+0000","last_fullsized":"2023-10-09T11:35:24.146469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.129945+0000","last_change":"2023-10-09T11:35:23.362904+0000","last_active":"2023-10-09T11:35:24.129945+0000","last_peered":"2023-10-09T11:35:24.129945+0000","last_clean":"2023-10-09T11:35:24.129945+0000","last_became_active":"2023-10-09T11:35:23.362072+0000","last_became_peered":"2023-10-09T11:35:23.362072+0000","last_unstale":"2023-10-09T11:35:24.129945+0000","last_undegraded":"2023-10-09T11:35:24.129945+0000","last_fullsized":"2023-10-09T11:35:24.129945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145146+0000","last_change":"2023-10-09T11:35:24.139443+0000","last_active":"2023-10-09T11:35:24.145146+0000","last_peered":"2023-10-09T11:35:24.145146+0000","last_clean":"2023-10-09T11:35:24.145146+0000","last_became_active":"2023-10-09T11:35:24.139154+0000","last_became_peered":"2023-10-09T11:35:24.139154+0000","last_unstale":"2023-10-09T11:35:24.145146+0000","last_undegraded":"2023-10-09T11:35:24.145146+0000","last_fullsized":"2023-10-09T11:35:24.145146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353239+0000","last_change":"2023-10-09T11:35:23.354006+0000","last_active":"2023-10-09T11:35:24.353239+0000","last_peered":"2023-10-09T11:35:24.353239+0000","last_clean":"2023-10-09T11:35:24.353239+0000","last_became_active":"2023-10-09T11:35:23.353652+0000","last_became_peered":"2023-10-09T11:35:23.353652+0000","last_unstale":"2023-10-09T11:35:24.353239+0000","last_undegraded":"2023-10-09T11:35:24.353239+0000","last_fullsized":"2023-10-09T11:35:24.353239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148316+0000","last_change":"2023-10-09T11:35:24.145734+0000","last_active":"2023-10-09T11:35:24.148316+0000","last_peered":"2023-10-09T11:35:24.148316+0000","last_clean":"2023-10-09T11:35:24.148316+0000","last_became_active":"2023-10-09T11:35:24.145428+0000","last_became_peered":"2023-10-09T11:35:24.145428+0000","last_unstale":"2023-10-09T11:35:24.148316+0000","last_undegraded":"2023-10-09T11:35:24.148316+0000","last_fullsized":"2023-10-09T11:35:24.148316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349142+0000","last_change":"2023-10-09T11:35:23.359612+0000","last_active":"2023-10-09T11:35:24.349142+0000","last_peered":"2023-10-09T11:35:24.349142+0000","last_clean":"2023-10-09T11:35:24.349142+0000","last_became_active":"2023-10-09T11:35:23.359281+0000","last_became_peered":"2023-10-09T11:35:23.359281+0000","last_unstale":"2023-10-09T11:35:24.349142+0000","last_undegraded":"2023-10-09T11:35:24.349142+0000","last_fullsized":"2023-10-09T11:35:24.349142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146099+0000","last_change":"2023-10-09T11:35:24.140692+0000","last_active":"2023-10-09T11:35:24.146099+0000","last_peered":"2023-10-09T11:35:24.146099+0000","last_clean":"2023-10-09T11:35:24.146099+0000","last_became_active":"2023-10-09T11:35:24.140410+0000","last_became_peered":"2023-10-09T11:35:24.140410+0000","last_unstale":"2023-10-09T11:35:24.146099+0000","last_undegraded":"2023-10-09T11:35:24.146099+0000","last_fullsized":"2023-10-09T11:35:24.146099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131273+0000","last_change":"2023-10-09T11:35:23.357092+0000","last_active":"2023-10-09T11:35:24.131273+0000","last_peered":"2023-10-09T11:35:24.131273+0000","last_clean":"2023-10-09T11:35:24.131273+0000","last_became_active":"2023-10-09T11:35:23.356770+0000","last_became_peered":"2023-10-09T11:35:23.356770+0000","last_unstale":"2023-10-09T11:35:24.131273+0000","last_undegraded":"2023-10-09T11:35:24.131273+0000","last_fullsized":"2023-10-09T11:35:24.131273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151640+0000","last_change":"2023-10-09T11:35:24.148899+0000","last_active":"2023-10-09T11:35:24.151640+0000","last_peered":"2023-10-09T11:35:24.151640+0000","last_clean":"2023-10-09T11:35:24.151640+0000","last_became_active":"2023-10-09T11:35:24.148606+0000","last_became_peered":"2023-10-09T11:35:24.148606+0000","last_unstale":"2023-10-09T11:35:24.151640+0000","last_undegraded":"2023-10-09T11:35:24.151640+0000","last_fullsized":"2023-10-09T11:35:24.151640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145363+0000","last_change":"2023-10-09T11:35:23.357012+0000","last_active":"2023-10-09T11:35:24.145363+0000","last_peered":"2023-10-09T11:35:24.145363+0000","last_clean":"2023-10-09T11:35:24.145363+0000","last_became_active":"2023-10-09T11:35:23.356520+0000","last_became_peered":"2023-10-09T11:35:23.356520+0000","last_unstale":"2023-10-09T11:35:24.145363+0000","last_undegraded":"2023-10-09T11:35:24.145363+0000","last_fullsized":"2023-10-09T11:35:24.145363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145418+0000","last_change":"2023-10-09T11:35:24.141088+0000","last_active":"2023-10-09T11:35:24.145418+0000","last_peered":"2023-10-09T11:35:24.145418+0000","last_clean":"2023-10-09T11:35:24.145418+0000","last_became_active":"2023-10-09T11:35:24.139862+0000","last_became_peered":"2023-10-09T11:35:24.139862+0000","last_unstale":"2023-10-09T11:35:24.145418+0000","last_undegraded":"2023-10-09T11:35:24.145418+0000","last_fullsized":"2023-10-09T11:35:24.145418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143692+0000","last_change":"2023-10-09T11:35:24.139287+0000","last_active":"2023-10-09T11:35:24.143692+0000","last_peered":"2023-10-09T11:35:24.143692+0000","last_clean":"2023-10-09T11:35:24.143692+0000","last_became_active":"2023-10-09T11:35:24.139008+0000","last_became_peered":"2023-10-09T11:35:24.139008+0000","last_unstale":"2023-10-09T11:35:24.143692+0000","last_undegraded":"2023-10-09T11:35:24.143692+0000","last_fullsized":"2023-10-09T11:35:24.143692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.358339+0000","last_change":"2023-10-09T11:35:23.355919+0000","last_active":"2023-10-09T11:35:23.358339+0000","last_peered":"2023-10-09T11:35:23.358339+0000","last_clean":"2023-10-09T11:35:23.358339+0000","last_became_active":"2023-10-09T11:35:23.355614+0000","last_became_peered":"2023-10-09T11:35:23.355614+0000","last_unstale":"2023-10-09T11:35:23.358339+0000","last_undegraded":"2023-10-09T11:35:23.358339+0000","last_fullsized":"2023-10-09T11:35:23.358339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148543+0000","last_change":"2023-10-09T11:35:24.148543+0000","last_active":"2023-10-09T11:35:24.148543+0000","last_peered":"2023-10-09T11:35:24.148543+0000","last_clean":"2023-10-09T11:35:24.148543+0000","last_became_active":"2023-10-09T11:35:24.148262+0000","last_became_peered":"2023-10-09T11:35:24.148262+0000","last_unstale":"2023-10-09T11:35:24.148543+0000","last_undegraded":"2023-10-09T11:35:24.148543+0000","last_fullsized":"2023-10-09T11:35:24.148543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145673+0000","last_change":"2023-10-09T11:35:23.354956+0000","last_active":"2023-10-09T11:35:24.145673+0000","last_peered":"2023-10-09T11:35:24.145673+0000","last_clean":"2023-10-09T11:35:24.145673+0000","last_became_active":"2023-10-09T11:35:23.354649+0000","last_became_peered":"2023-10-09T11:35:23.354649+0000","last_unstale":"2023-10-09T11:35:24.145673+0000","last_undegraded":"2023-10-09T11:35:24.145673+0000","last_fullsized":"2023-10-09T11:35:24.145673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133968+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:35:24.133968+0000","last_peered":"2023-10-09T11:35:24.133968+0000","last_clean":"2023-10-09T11:35:24.133968+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:35:24.133968+0000","last_undegraded":"2023-10-09T11:35:24.133968+0000","last_fullsized":"2023-10-09T11:35:24.133968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142197+0000","last_change":"2023-10-09T11:35:24.142197+0000","last_active":"2023-10-09T11:35:24.142197+0000","last_peered":"2023-10-09T11:35:24.142197+0000","last_clean":"2023-10-09T11:35:24.142197+0000","last_became_active":"2023-10-09T11:35:24.141909+0000","last_became_peered":"2023-10-09T11:35:24.141909+0000","last_unstale":"2023-10-09T11:35:24.142197+0000","last_undegraded":"2023-10-09T11:35:24.142197+0000","last_fullsized":"2023-10-09T11:35:24.142197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:52.262280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134030+0000","last_change":"2023-10-09T11:35:23.363461+0000","last_active":"2023-10-09T11:35:24.134030+0000","last_peered":"2023-10-09T11:35:24.134030+0000","last_clean":"2023-10-09T11:35:24.134030+0000","last_became_active":"2023-10-09T11:35:23.363036+0000","last_became_peered":"2023-10-09T11:35:23.363036+0000","last_unstale":"2023-10-09T11:35:24.134030+0000","last_undegraded":"2023-10-09T11:35:24.134030+0000","last_fullsized":"2023-10-09T11:35:24.134030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134515+0000","last_change":"2023-10-09T11:35:23.363062+0000","last_active":"2023-10-09T11:35:24.134515+0000","last_peered":"2023-10-09T11:35:24.134515+0000","last_clean":"2023-10-09T11:35:24.134515+0000","last_became_active":"2023-10-09T11:35:23.362764+0000","last_became_peered":"2023-10-09T11:35:23.362764+0000","last_unstale":"2023-10-09T11:35:24.134515+0000","last_undegraded":"2023-10-09T11:35:24.134515+0000","last_fullsized":"2023-10-09T11:35:24.134515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142257+0000","last_change":"2023-10-09T11:35:24.138344+0000","last_active":"2023-10-09T11:35:24.142257+0000","last_peered":"2023-10-09T11:35:24.142257+0000","last_clean":"2023-10-09T11:35:24.142257+0000","last_became_active":"2023-10-09T11:35:24.138049+0000","last_became_peered":"2023-10-09T11:35:24.138049+0000","last_unstale":"2023-10-09T11:35:24.142257+0000","last_undegraded":"2023-10-09T11:35:24.142257+0000","last_fullsized":"2023-10-09T11:35:24.142257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131924+0000","last_change":"2023-10-09T11:35:23.364933+0000","last_active":"2023-10-09T11:35:24.131924+0000","last_peered":"2023-10-09T11:35:24.131924+0000","last_clean":"2023-10-09T11:35:24.131924+0000","last_became_active":"2023-10-09T11:35:23.364638+0000","last_became_peered":"2023-10-09T11:35:23.364638+0000","last_unstale":"2023-10-09T11:35:24.131924+0000","last_undegraded":"2023-10-09T11:35:24.131924+0000","last_fullsized":"2023-10-09T11:35:24.131924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141685+0000","last_change":"2023-10-09T11:35:24.141685+0000","last_active":"2023-10-09T11:35:24.141685+0000","last_peered":"2023-10-09T11:35:24.141685+0000","last_clean":"2023-10-09T11:35:24.141685+0000","last_became_active":"2023-10-09T11:35:24.141344+0000","last_became_peered":"2023-10-09T11:35:24.141344+0000","last_unstale":"2023-10-09T11:35:24.141685+0000","last_undegraded":"2023-10-09T11:35:24.141685+0000","last_fullsized":"2023-10-09T11:35:24.141685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.350153+0000","last_change":"2023-10-09T11:35:23.365419+0000","last_active":"2023-10-09T11:35:24.350153+0000","last_peered":"2023-10-09T11:35:24.350153+0000","last_clean":"2023-10-09T11:35:24.350153+0000","last_became_active":"2023-10-09T11:35:23.364707+0000","last_became_peered":"2023-10-09T11:35:23.364707+0000","last_unstale":"2023-10-09T11:35:24.350153+0000","last_undegraded":"2023-10-09T11:35:24.350153+0000","last_fullsized":"2023-10-09T11:35:24.350153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138684+0000","last_change":"2023-10-09T11:35:24.138684+0000","last_active":"2023-10-09T11:35:24.138684+0000","last_peered":"2023-10-09T11:35:24.138684+0000","last_clean":"2023-10-09T11:35:24.138684+0000","last_became_active":"2023-10-09T11:35:24.138267+0000","last_became_peered":"2023-10-09T11:35:24.138267+0000","last_unstale":"2023-10-09T11:35:24.138684+0000","last_undegraded":"2023-10-09T11:35:24.138684+0000","last_fullsized":"2023-10-09T11:35:24.138684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:47.119116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133887+0000","last_change":"2023-10-09T11:35:23.363287+0000","last_active":"2023-10-09T11:35:24.133887+0000","last_peered":"2023-10-09T11:35:24.133887+0000","last_clean":"2023-10-09T11:35:24.133887+0000","last_became_active":"2023-10-09T11:35:23.362704+0000","last_became_peered":"2023-10-09T11:35:23.362704+0000","last_unstale":"2023-10-09T11:35:24.133887+0000","last_undegraded":"2023-10-09T11:35:24.133887+0000","last_fullsized":"2023-10-09T11:35:24.133887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144593+0000","last_change":"2023-10-09T11:35:24.137239+0000","last_active":"2023-10-09T11:35:24.144593+0000","last_peered":"2023-10-09T11:35:24.144593+0000","last_clean":"2023-10-09T11:35:24.144593+0000","last_became_active":"2023-10-09T11:35:24.136716+0000","last_became_peered":"2023-10-09T11:35:24.136716+0000","last_unstale":"2023-10-09T11:35:24.144593+0000","last_undegraded":"2023-10-09T11:35:24.144593+0000","last_fullsized":"2023-10-09T11:35:24.144593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:42.856264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131929+0000","last_change":"2023-10-09T11:35:23.362437+0000","last_active":"2023-10-09T11:35:24.131929+0000","last_peered":"2023-10-09T11:35:24.131929+0000","last_clean":"2023-10-09T11:35:24.131929+0000","last_became_active":"2023-10-09T11:35:23.362098+0000","last_became_peered":"2023-10-09T11:35:23.362098+0000","last_unstale":"2023-10-09T11:35:24.131929+0000","last_undegraded":"2023-10-09T11:35:24.131929+0000","last_fullsized":"2023-10-09T11:35:24.131929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.136802+0000","last_change":"2023-10-09T11:35:24.136802+0000","last_active":"2023-10-09T11:35:24.136802+0000","last_peered":"2023-10-09T11:35:24.136802+0000","last_clean":"2023-10-09T11:35:24.136802+0000","last_became_active":"2023-10-09T11:35:24.136552+0000","last_became_peered":"2023-10-09T11:35:24.136552+0000","last_unstale":"2023-10-09T11:35:24.136802+0000","last_undegraded":"2023-10-09T11:35:24.136802+0000","last_fullsized":"2023-10-09T11:35:24.136802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131028+0000","last_change":"2023-10-09T11:35:23.354482+0000","last_active":"2023-10-09T11:35:24.131028+0000","last_peered":"2023-10-09T11:35:24.131028+0000","last_clean":"2023-10-09T11:35:24.131028+0000","last_became_active":"2023-10-09T11:35:23.354145+0000","last_became_peered":"2023-10-09T11:35:23.354145+0000","last_unstale":"2023-10-09T11:35:24.131028+0000","last_undegraded":"2023-10-09T11:35:24.131028+0000","last_fullsized":"2023-10-09T11:35:24.131028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142780+0000","last_change":"2023-10-09T11:35:24.142780+0000","last_active":"2023-10-09T11:35:24.142780+0000","last_peered":"2023-10-09T11:35:24.142780+0000","last_clean":"2023-10-09T11:35:24.142780+0000","last_became_active":"2023-10-09T11:35:24.142495+0000","last_became_peered":"2023-10-09T11:35:24.142495+0000","last_unstale":"2023-10-09T11:35:24.142780+0000","last_undegraded":"2023-10-09T11:35:24.142780+0000","last_fullsized":"2023-10-09T11:35:24.142780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354147+0000","last_change":"2023-10-09T11:35:23.363974+0000","last_active":"2023-10-09T11:35:24.354147+0000","last_peered":"2023-10-09T11:35:24.354147+0000","last_clean":"2023-10-09T11:35:24.354147+0000","last_became_active":"2023-10-09T11:35:23.363542+0000","last_became_peered":"2023-10-09T11:35:23.363542+0000","last_unstale":"2023-10-09T11:35:24.354147+0000","last_undegraded":"2023-10-09T11:35:24.354147+0000","last_fullsized":"2023-10-09T11:35:24.354147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140368+0000","last_change":"2023-10-09T11:35:24.136470+0000","last_active":"2023-10-09T11:35:24.140368+0000","last_peered":"2023-10-09T11:35:24.140368+0000","last_clean":"2023-10-09T11:35:24.140368+0000","last_became_active":"2023-10-09T11:35:24.136165+0000","last_became_peered":"2023-10-09T11:35:24.136165+0000","last_unstale":"2023-10-09T11:35:24.140368+0000","last_undegraded":"2023-10-09T11:35:24.140368+0000","last_fullsized":"2023-10-09T11:35:24.140368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:35:23.360238+0000","last_change":"2023-10-09T11:35:23.358941+0000","last_active":"2023-10-09T11:35:23.360238+0000","last_peered":"2023-10-09T11:35:23.360238+0000","last_clean":"2023-10-09T11:35:23.360238+0000","last_became_active":"2023-10-09T11:35:23.358644+0000","last_became_peered":"2023-10-09T11:35:23.358644+0000","last_unstale":"2023-10-09T11:35:23.360238+0000","last_undegraded":"2023-10-09T11:35:23.360238+0000","last_fullsized":"2023-10-09T11:35:23.360238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151207+0000","last_change":"2023-10-09T11:35:24.150106+0000","last_active":"2023-10-09T11:35:24.151207+0000","last_peered":"2023-10-09T11:35:24.151207+0000","last_clean":"2023-10-09T11:35:24.151207+0000","last_became_active":"2023-10-09T11:35:24.149822+0000","last_became_peered":"2023-10-09T11:35:24.149822+0000","last_unstale":"2023-10-09T11:35:24.151207+0000","last_undegraded":"2023-10-09T11:35:24.151207+0000","last_fullsized":"2023-10-09T11:35:24.151207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.351118+0000","last_change":"2023-10-09T11:35:23.355543+0000","last_active":"2023-10-09T11:35:24.351118+0000","last_peered":"2023-10-09T11:35:24.351118+0000","last_clean":"2023-10-09T11:35:24.351118+0000","last_became_active":"2023-10-09T11:35:23.355209+0000","last_became_peered":"2023-10-09T11:35:23.355209+0000","last_unstale":"2023-10-09T11:35:24.351118+0000","last_undegraded":"2023-10-09T11:35:24.351118+0000","last_fullsized":"2023-10-09T11:35:24.351118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151598+0000","last_change":"2023-10-09T11:35:24.148840+0000","last_active":"2023-10-09T11:35:24.151598+0000","last_peered":"2023-10-09T11:35:24.151598+0000","last_clean":"2023-10-09T11:35:24.151598+0000","last_became_active":"2023-10-09T11:35:24.148295+0000","last_became_peered":"2023-10-09T11:35:24.148295+0000","last_unstale":"2023-10-09T11:35:24.151598+0000","last_undegraded":"2023-10-09T11:35:24.151598+0000","last_fullsized":"2023-10-09T11:35:24.151598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353445+0000","last_change":"2023-10-09T11:35:23.356087+0000","last_active":"2023-10-09T11:35:24.353445+0000","last_peered":"2023-10-09T11:35:24.353445+0000","last_clean":"2023-10-09T11:35:24.353445+0000","last_became_active":"2023-10-09T11:35:23.355642+0000","last_became_peered":"2023-10-09T11:35:23.355642+0000","last_unstale":"2023-10-09T11:35:24.353445+0000","last_undegraded":"2023-10-09T11:35:24.353445+0000","last_fullsized":"2023-10-09T11:35:24.353445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.150321+0000","last_change":"2023-10-09T11:35:24.149254+0000","last_active":"2023-10-09T11:35:24.150321+0000","last_peered":"2023-10-09T11:35:24.150321+0000","last_clean":"2023-10-09T11:35:24.150321+0000","last_became_active":"2023-10-09T11:35:24.148931+0000","last_became_peered":"2023-10-09T11:35:24.148931+0000","last_unstale":"2023-10-09T11:35:24.150321+0000","last_undegraded":"2023-10-09T11:35:24.150321+0000","last_fullsized":"2023-10-09T11:35:24.150321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146536+0000","last_change":"2023-10-09T11:35:24.144407+0000","last_active":"2023-10-09T11:35:24.146536+0000","last_peered":"2023-10-09T11:35:24.146536+0000","last_clean":"2023-10-09T11:35:24.146536+0000","last_became_active":"2023-10-09T11:35:24.144120+0000","last_became_peered":"2023-10-09T11:35:24.144120+0000","last_unstale":"2023-10-09T11:35:24.146536+0000","last_undegraded":"2023-10-09T11:35:24.146536+0000","last_fullsized":"2023-10-09T11:35:24.146536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148542+0000","last_change":"2023-10-09T11:35:24.148542+0000","last_active":"2023-10-09T11:35:24.148542+0000","last_peered":"2023-10-09T11:35:24.148542+0000","last_clean":"2023-10-09T11:35:24.148542+0000","last_became_active":"2023-10-09T11:35:24.148205+0000","last_became_peered":"2023-10-09T11:35:24.148205+0000","last_unstale":"2023-10-09T11:35:24.148542+0000","last_undegraded":"2023-10-09T11:35:24.148542+0000","last_fullsized":"2023-10-09T11:35:24.148542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151809+0000","last_change":"2023-10-09T11:35:24.147669+0000","last_active":"2023-10-09T11:35:24.151809+0000","last_peered":"2023-10-09T11:35:24.151809+0000","last_clean":"2023-10-09T11:35:24.151809+0000","last_became_active":"2023-10-09T11:35:24.147088+0000","last_became_peered":"2023-10-09T11:35:24.147088+0000","last_unstale":"2023-10-09T11:35:24.151809+0000","last_undegraded":"2023-10-09T11:35:24.151809+0000","last_fullsized":"2023-10-09T11:35:24.151809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142634+0000","last_change":"2023-10-09T11:35:24.142634+0000","last_active":"2023-10-09T11:35:24.142634+0000","last_peered":"2023-10-09T11:35:24.142634+0000","last_clean":"2023-10-09T11:35:24.142634+0000","last_became_active":"2023-10-09T11:35:24.142365+0000","last_became_peered":"2023-10-09T11:35:24.142365+0000","last_unstale":"2023-10-09T11:35:24.142634+0000","last_undegraded":"2023-10-09T11:35:24.142634+0000","last_fullsized":"2023-10-09T11:35:24.142634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.135282+0000","last_change":"2023-10-09T11:35:24.135282+0000","last_active":"2023-10-09T11:35:24.135282+0000","last_peered":"2023-10-09T11:35:24.135282+0000","last_clean":"2023-10-09T11:35:24.135282+0000","last_became_active":"2023-10-09T11:35:24.135029+0000","last_became_peered":"2023-10-09T11:35:24.135029+0000","last_unstale":"2023-10-09T11:35:24.135282+0000","last_undegraded":"2023-10-09T11:35:24.135282+0000","last_fullsized":"2023-10-09T11:35:24.135282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143840+0000","last_change":"2023-10-09T11:35:24.140956+0000","last_active":"2023-10-09T11:35:24.143840+0000","last_peered":"2023-10-09T11:35:24.143840+0000","last_clean":"2023-10-09T11:35:24.143840+0000","last_became_active":"2023-10-09T11:35:24.140678+0000","last_became_peered":"2023-10-09T11:35:24.140678+0000","last_unstale":"2023-10-09T11:35:24.143840+0000","last_undegraded":"2023-10-09T11:35:24.143840+0000","last_fullsized":"2023-10-09T11:35:24.143840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146433+0000","last_change":"2023-10-09T11:35:24.140260+0000","last_active":"2023-10-09T11:35:24.146433+0000","last_peered":"2023-10-09T11:35:24.146433+0000","last_clean":"2023-10-09T11:35:24.146433+0000","last_became_active":"2023-10-09T11:35:24.139938+0000","last_became_peered":"2023-10-09T11:35:24.139938+0000","last_unstale":"2023-10-09T11:35:24.146433+0000","last_undegraded":"2023-10-09T11:35:24.146433+0000","last_fullsized":"2023-10-09T11:35:24.146433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.135797+0000","last_change":"2023-10-09T11:35:24.135797+0000","last_active":"2023-10-09T11:35:24.135797+0000","last_peered":"2023-10-09T11:35:24.135797+0000","last_clean":"2023-10-09T11:35:24.135797+0000","last_became_active":"2023-10-09T11:35:24.135530+0000","last_became_peered":"2023-10-09T11:35:24.135530+0000","last_unstale":"2023-10-09T11:35:24.135797+0000","last_undegraded":"2023-10-09T11:35:24.135797+0000","last_fullsized":"2023-10-09T11:35:24.135797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154030+0000","last_change":"2023-10-09T11:35:24.151526+0000","last_active":"2023-10-09T11:35:24.154030+0000","last_peered":"2023-10-09T11:35:24.154030+0000","last_clean":"2023-10-09T11:35:24.154030+0000","last_became_active":"2023-10-09T11:35:24.147333+0000","last_became_peered":"2023-10-09T11:35:24.147333+0000","last_unstale":"2023-10-09T11:35:24.154030+0000","last_undegraded":"2023-10-09T11:35:24.154030+0000","last_fullsized":"2023-10-09T11:35:24.154030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134614+0000","last_change":"2023-10-09T11:35:24.134614+0000","last_active":"2023-10-09T11:35:24.134614+0000","last_peered":"2023-10-09T11:35:24.134614+0000","last_clean":"2023-10-09T11:35:24.134614+0000","last_became_active":"2023-10-09T11:35:24.134362+0000","last_became_peered":"2023-10-09T11:35:24.134362+0000","last_unstale":"2023-10-09T11:35:24.134614+0000","last_undegraded":"2023-10-09T11:35:24.134614+0000","last_fullsized":"2023-10-09T11:35:24.134614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154083+0000","last_change":"2023-10-09T11:35:24.151676+0000","last_active":"2023-10-09T11:35:24.154083+0000","last_peered":"2023-10-09T11:35:24.154083+0000","last_clean":"2023-10-09T11:35:24.154083+0000","last_became_active":"2023-10-09T11:35:24.150853+0000","last_became_peered":"2023-10-09T11:35:24.150853+0000","last_unstale":"2023-10-09T11:35:24.154083+0000","last_undegraded":"2023-10-09T11:35:24.154083+0000","last_fullsized":"2023-10-09T11:35:24.154083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145336+0000","last_change":"2023-10-09T11:35:24.145336+0000","last_active":"2023-10-09T11:35:24.145336+0000","last_peered":"2023-10-09T11:35:24.145336+0000","last_clean":"2023-10-09T11:35:24.145336+0000","last_became_active":"2023-10-09T11:35:24.145009+0000","last_became_peered":"2023-10-09T11:35:24.145009+0000","last_unstale":"2023-10-09T11:35:24.145336+0000","last_undegraded":"2023-10-09T11:35:24.145336+0000","last_fullsized":"2023-10-09T11:35:24.145336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140506+0000","last_change":"2023-10-09T11:35:24.137045+0000","last_active":"2023-10-09T11:35:24.140506+0000","last_peered":"2023-10-09T11:35:24.140506+0000","last_clean":"2023-10-09T11:35:24.140506+0000","last_became_active":"2023-10-09T11:35:24.136734+0000","last_became_peered":"2023-10-09T11:35:24.136734+0000","last_unstale":"2023-10-09T11:35:24.140506+0000","last_undegraded":"2023-10-09T11:35:24.140506+0000","last_fullsized":"2023-10-09T11:35:24.140506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":68065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298064,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073776,"statfs":{"total":96636764160,"available":96331546624,"internally_reserved":0,"allocated":794624,"data_stored":658273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":67905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":68031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:35:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:35:28.842 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T11:35:28.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T11:35:28.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T11:35:28.843 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T11:35:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.994+0000 7f6a83b92700 1 Processor -- start 2023-10-09T11:35:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 -- start start 2023-10-09T11:35:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a7c15d440 0x7f6a7c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c06c6a0 0x7f6a7c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c06d050 con 0x7f6a7c15d810 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c15a750 con 0x7f6a7c15d440 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.995+0000 7f6a83b92700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c15e3a0 con 0x7f6a7c06c6a0 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a7c15d440 0x7f6a7c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8212f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6a7c15d810 0x7f6a7c15dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57102/0 (socket says 172.21.15.26:57102) 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8212f700 1 -- 172.21.15.26:0/3723752344 learned_addr learned my addr 172.21.15.26:0/3723752344 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8112d700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c06c6a0 0x7f6a7c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 -- 172.21.15.26:0/3723752344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c06c6a0 msgr2=0x7f6a7c06cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c06c6a0 0x7f6a7c06cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 -- 172.21.15.26:0/3723752344 >> v1:172.21.15.26:6789/0 conn(0x7f6a7c15d810 legacy=0x7f6a7c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:28.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 -- 172.21.15.26:0/3723752344 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c159e40 con 0x7f6a7c15d440 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8092c700 1 -- 172.21.15.26:0/3723752344 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316883604 0 0) 0x7f6a7c06d050 con 0x7f6a7c15d810 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8192e700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0aec90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009e60 tx=0x7f6a6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d695bcb6a77468 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8092c700 1 -- 172.21.15.26:0/3723752344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00e070 con 0x7f6a7c15d440 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8092c700 1 -- 172.21.15.26:0/3723752344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00bb60 con 0x7f6a7c15d440 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.996+0000 7f6a8092c700 1 -- 172.21.15.26:0/3723752344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c012430 con 0x7f6a7c15d440 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 -- 172.21.15.26:0/3723752344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c15d440 msgr2=0x7f6a7c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0aec90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009e60 tx=0x7f6a6c009780 comp rx=0 tx=0).stop 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 -- 172.21.15.26:0/3723752344 shutdown_connections 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0aec90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 --2- 172.21.15.26:0/3723752344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c06c6a0 0x7f6a7c06cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 -- 172.21.15.26:0/3723752344 >> 172.21.15.26:0/3723752344 conn(0x7f6a7c06f190 msgr2=0x7f6a7c0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 -- 172.21.15.26:0/3723752344 shutdown_connections 2023-10-09T11:35:29.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.997+0000 7f6a83b92700 1 -- 172.21.15.26:0/3723752344 wait complete. 2023-10-09T11:35:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.998+0000 7f6a83b92700 1 Processor -- start 2023-10-09T11:35:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.998+0000 7f6a83b92700 1 -- start start 2023-10-09T11:35:29.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c15d810 0x7f6a7c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c14c330 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b2890 con 0x7f6a7c15d440 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a83b92700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c14c8b0 con 0x7f6a7c15d810 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49956/0 (socket says 172.21.15.26:49956) 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 -- 172.21.15.26:0/801855254 learned_addr learned my addr 172.21.15.26:0/801855254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8112d700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8212f700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c15d810 0x7f6a7c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 -- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c15d810 msgr2=0x7f6a7c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c15d810 0x7f6a7c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 -- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c15d440 msgr2=0x7f6a7c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 -- 172.21.15.26:0/801855254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009a20 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:28.999+0000 7f6a8192e700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06f590 tx=0x7f6a6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.000+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c012c80 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.000+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c012e00 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.000+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0276c0 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.000+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c14aaa0 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.000+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c16a6f0 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.001+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c16a8b0 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.001+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a6c024070 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.001+0000 7f6a79ffb700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.001+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a6c086a70 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.002+0000 7f6a8112d700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.002+0000 7f6a8112d700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 0x7f6a680693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c14f200 tx=0x7f6a700091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.006+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a6c053c40 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.255+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6a7c04c3c0 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.258+0000 7f6a79ffb700 1 -- 172.21.15.26:0/801855254 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163697 (secure 0 0 0) 0x7f6a6c02c020 con 0x7f6a7c06c6a0 2023-10-09T11:35:29.262 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:29.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 msgr2=0x7f6a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 0x7f6a680693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c14f200 tx=0x7f6a700091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 msgr2=0x7f6a7c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06f590 tx=0x7f6a6c019000 comp rx=0 tx=0).stop 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 shutdown_connections 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a7c15d810 0x7f6a7c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a7c06c6a0 0x7f6a7c0b2350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 --2- 172.21.15.26:0/801855254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7c15d440 0x7f6a7c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 >> 172.21.15.26:0/801855254 conn(0x7f6a7c06f190 msgr2=0x7f6a7c15dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 shutdown_connections 2023-10-09T11:35:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.261+0000 7f6a83b92700 1 -- 172.21.15.26:0/801855254 wait complete. 2023-10-09T11:35:29.275 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":90511},{"type":"v1","addr":"172.21.15.67:6833","nonce":90511}]},"active_addr":"172.21.15.67:6833/90511","active_change":"2023-10-09T11:35:05.093781+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":104484601}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1460061512}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3416759691}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":616892814}]}]} 2023-10-09T11:35:29.279 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T11:35:29.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T11:35:29.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.398+0000 7f8dbbd56700 1 Processor -- start 2023-10-09T11:35:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.398+0000 7f8dbbd56700 1 -- start start 2023-10-09T11:35:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8dbbd56700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8db40cb5a0 0x7f8db40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8dbbd56700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db415ae40 con 0x7f8db40cd9e0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8dbbd56700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db415ab60 con 0x7f8db415a5d0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8dbbd56700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db40d13f0 con 0x7f8db40cb5a0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8db40cb5a0 0x7f8db40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8db40cb5a0 0x7f8db40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49964/0 (socket says 172.21.15.26:49964) 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db92f1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8db40cd9e0 0x7f8db4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57110/0 (socket says 172.21.15.26:57110) 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 -- 172.21.15.26:0/2901934975 learned_addr learned my addr 172.21.15.26:0/2901934975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 -- 172.21.15.26:0/2901934975 >> v1:172.21.15.67:6789/0 conn(0x7f8db415a5d0 legacy=0x7f8db4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 -- 172.21.15.26:0/2901934975 >> v1:172.21.15.26:6789/0 conn(0x7f8db40cd9e0 legacy=0x7f8db4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 -- 172.21.15.26:0/2901934975 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40ccf00 con 0x7f8db40cb5a0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db9af2700 1 --2- 172.21.15.26:0/2901934975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cb5a0 0x7f8db40cb970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8db00099e0 tx=0x7f8db0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809f9e3cdc1f0277 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db8af0700 1 -- 172.21.15.26:0/2901934975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000b820 con 0x7f8db40cb5a0 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db8af0700 1 -- 172.21.15.26:0/2901934975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000b980 con 0x7f8db40cb5a0 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.399+0000 7f8db8af0700 1 -- 172.21.15.26:0/2901934975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000bd20 con 0x7f8db40cb5a0 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 -- 172.21.15.26:0/2901934975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cb5a0 msgr2=0x7f8db40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/2901934975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cb5a0 0x7f8db40cb970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8db00099e0 tx=0x7f8db0009250 comp rx=0 tx=0).stop 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 -- 172.21.15.26:0/2901934975 shutdown_connections 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/2901934975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cb5a0 0x7f8db40cb970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 -- 172.21.15.26:0/2901934975 >> 172.21.15.26:0/2901934975 conn(0x7f8db4070e30 msgr2=0x7f8db40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 -- 172.21.15.26:0/2901934975 shutdown_connections 2023-10-09T11:35:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.400+0000 7f8dbbd56700 1 -- 172.21.15.26:0/2901934975 wait complete. 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.401+0000 7f8dbbd56700 1 Processor -- start 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.401+0000 7f8dbbd56700 1 -- start start 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8db40cb5a0 0x7f8db4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415a5d0 0x7f8db4169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db415bf60 con 0x7f8db40cd9e0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db415b070 con 0x7f8db415a5d0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dbbd56700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db415b350 con 0x7f8db40cb5a0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49980/0 (socket says 172.21.15.26:49980) 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 -- 172.21.15.26:0/3092013229 learned_addr learned my addr 172.21.15.26:0/3092013229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8dba2f3700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415a5d0 0x7f8db4169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db9af2700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8db40cb5a0 0x7f8db4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 -- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8db40cb5a0 msgr2=0x7f8db4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8db40cb5a0 0x7f8db4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 -- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415a5d0 msgr2=0x7f8db4169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415a5d0 0x7f8db4169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 -- 172.21.15.26:0/3092013229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00094f0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8db92f1700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c7c0 tx=0x7f8da4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.402+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4005a70 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.403+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4005bd0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.403+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40070d0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.403+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db415b630 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.403+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db415bbf0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.404+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db415c0d0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.404+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8da4007480 con 0x7f8db40cd9e0 2023-10-09T11:35:29.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.405+0000 7f8da9ffb700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 0x7f8d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.405+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8da4083920 con 0x7f8db40cd9e0 2023-10-09T11:35:29.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.405+0000 7f8db9af2700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 0x7f8d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.405+0000 7f8db9af2700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 0x7f8d980693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8db00099e0 tx=0x7f8db0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.409+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8da4050b90 con 0x7f8db40cd9e0 2023-10-09T11:35:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.604+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8db404c3c0 con 0x7f8db40cd9e0 2023-10-09T11:35:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.605+0000 7f8da9ffb700 1 -- 172.21.15.26:0/3092013229 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8da4017020 con 0x7f8db40cd9e0 2023-10-09T11:35:29.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:29.607 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 msgr2=0x7f8d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 0x7f8d980693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8db00099e0 tx=0x7f8db0017000 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 msgr2=0x7f8db4156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c7c0 tx=0x7f8da4007f70 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 shutdown_connections 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415a5d0 0x7f8db4169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d98066f30 0x7f8d980693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8db40cb5a0 0x7f8db4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 --2- 172.21.15.26:0/3092013229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8db40cd9e0 0x7f8db4156200 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 >> 172.21.15.26:0/3092013229 conn(0x7f8db4070e30 msgr2=0x7f8db40b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 shutdown_connections 2023-10-09T11:35:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.607+0000 7f8dbbd56700 1 -- 172.21.15.26:0/3092013229 wait complete. 2023-10-09T11:35:29.622 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T11:35:29.622 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:29.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.740+0000 7f987d71d700 1 Processor -- start 2023-10-09T11:35:29.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.740+0000 7f987d71d700 1 -- start start 2023-10-09T11:35:29.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f987d71d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9878153c30 0x7f987815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f987d71d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987815de50 0x7f98780cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f987d71d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98780cf3c0 con 0x7f98780cef40 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f987d71d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987815afd0 con 0x7f9878153c30 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f987d71d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987815b2b0 con 0x7f987815de50 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9878153c30 0x7f987815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9878153c30 0x7f987815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35430/0 (socket says 172.21.15.26:35430) 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 -- 172.21.15.26:0/2764602703 learned_addr learned my addr 172.21.15.26:0/2764602703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f98777fe700 1 --2- 172.21.15.26:0/2764602703 >> v2:172.21.15.67:3300/0 conn(0x7f987815de50 0x7f98780cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 -- 172.21.15.26:0/2764602703 >> v2:172.21.15.67:3300/0 conn(0x7f987815de50 msgr2=0x7f98780cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 --2- 172.21.15.26:0/2764602703 >> v2:172.21.15.67:3300/0 conn(0x7f987815de50 0x7f98780cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.741+0000 7f9877fff700 1 -- 172.21.15.26:0/2764602703 >> v1:172.21.15.67:6789/0 conn(0x7f98780cef40 legacy=0x7f987806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f9877fff700 1 -- 172.21.15.26:0/2764602703 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987815b590 con 0x7f9878153c30 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f9877fff700 1 --2- 172.21.15.26:0/2764602703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f987815a5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98780713a0 tx=0x7f986c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc6dab7bd6a831b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f9876ffd700 1 -- 172.21.15.26:0/2764602703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00b820 con 0x7f9878153c30 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f9876ffd700 1 -- 172.21.15.26:0/2764602703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00b980 con 0x7f9878153c30 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f9876ffd700 1 -- 172.21.15.26:0/2764602703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00bd20 con 0x7f9878153c30 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 -- 172.21.15.26:0/2764602703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 msgr2=0x7f987815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 --2- 172.21.15.26:0/2764602703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f987815a5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98780713a0 tx=0x7f986c009250 comp rx=0 tx=0).stop 2023-10-09T11:35:29.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 -- 172.21.15.26:0/2764602703 shutdown_connections 2023-10-09T11:35:29.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 --2- 172.21.15.26:0/2764602703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f987815a5e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 --2- 172.21.15.26:0/2764602703 >> v2:172.21.15.67:3300/0 conn(0x7f987815de50 0x7f98780cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 -- 172.21.15.26:0/2764602703 >> 172.21.15.26:0/2764602703 conn(0x7f98780703a0 msgr2=0x7f98780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 -- 172.21.15.26:0/2764602703 shutdown_connections 2023-10-09T11:35:29.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.742+0000 7f987d71d700 1 -- 172.21.15.26:0/2764602703 wait complete. 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.743+0000 7f987d71d700 1 Processor -- start 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 -- start start 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98780cef40 0x7f9878150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f987815de50 0x7f9878152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b1490 con 0x7f9878153c30 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780c7880 con 0x7f98780cef40 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f987d71d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98781454e0 con 0x7f987815de50 2023-10-09T11:35:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.744+0000 7f98777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35444/0 (socket says 172.21.15.26:35444) 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 -- 172.21.15.26:0/4026013844 learned_addr learned my addr 172.21.15.26:0/4026013844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f9877fff700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98780cef40 0x7f9878150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f987cf1c700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f987815de50 0x7f9878152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 -- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f987815de50 msgr2=0x7f9878152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f987815de50 0x7f9878152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 -- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98780cef40 msgr2=0x7f9878150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98780cef40 0x7f9878150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 -- 172.21.15.26:0/4026013844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0094f0 con 0x7f9878153c30 2023-10-09T11:35:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f98777fe700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f986800c800 tx=0x7f9868008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868011600 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868011760 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780b16a0 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868011b20 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.745+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98780b1c60 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.746+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987804c3c0 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.747+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98680193f0 con 0x7f9878153c30 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.747+0000 7f985ffff700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 0x7f98640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.747+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98680847f0 con 0x7f9878153c30 2023-10-09T11:35:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.747+0000 7f9877fff700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 0x7f98640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.748+0000 7f9877fff700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 0x7f98640693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98780713a0 tx=0x7f986c016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.751+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9868051a60 con 0x7f9878153c30 2023-10-09T11:35:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.946+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98780b6300 con 0x7f9878153c30 2023-10-09T11:35:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.947+0000 7f985ffff700 1 -- 172.21.15.26:0/4026013844 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9868055080 con 0x7f9878153c30 2023-10-09T11:35:29.948 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:29.948 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 msgr2=0x7f98640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 0x7f98640693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98780713a0 tx=0x7f986c016000 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 msgr2=0x7f9878144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f986800c800 tx=0x7f9868008040 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 shutdown_connections 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9864066f30 0x7f98640693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f987815de50 0x7f9878152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98780cef40 0x7f9878150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 --2- 172.21.15.26:0/4026013844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9878153c30 0x7f9878144fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 >> 172.21.15.26:0/4026013844 conn(0x7f98780703a0 msgr2=0x7f9878150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:29.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 shutdown_connections 2023-10-09T11:35:29.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:29.949+0000 7f987d71d700 1 -- 172.21.15.26:0/4026013844 wait complete. 2023-10-09T11:35:29.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T11:35:29.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T11:35:29.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T11:35:29.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T11:35:29.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T11:35:29.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T11:35:29.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T11:35:29.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T11:35:30.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.171+0000 7f10d566d700 1 Processor -- start 2023-10-09T11:35:30.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.171+0000 7f6756d3b700 1 Processor -- start 2023-10-09T11:35:30.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.172+0000 7f6756d3b700 1 -- start start 2023-10-09T11:35:30.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.172+0000 7f10d566d700 1 -- start start 2023-10-09T11:35:30.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f6756d3b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f6756d3b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 0x7f67500b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f6756d3b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675015ef50 con 0x7f675015b5e0 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f6756d3b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675015e180 con 0x7f67500b0470 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f6756d3b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b13d0 con 0x7f675015b9b0 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f72d4a99700 1 Processor -- start 2023-10-09T11:35:30.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f72d4a99700 1 -- start start 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f674ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f674ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50470/0 (socket says 172.21.15.26:50470) 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.173+0000 7f674ffff700 1 -- 172.21.15.26:0/3935576696 learned_addr learned my addr 172.21.15.26:0/3935576696 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10d00cb720 0x7f10d00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10d006e3f0 0x7f10d006e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d00b20a0 con 0x7f10d006e3f0 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d0156ee0 con 0x7f10d00cb720 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10d566d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00cc0d0 con 0x7f10d006bc20 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f67552d8700 1 --2- 172.21.15.26:0/3935576696 >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 0x7f67500b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f674ffff700 1 -- 172.21.15.26:0/3935576696 >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 msgr2=0x7f67500b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f674ffff700 1 --2- 172.21.15.26:0/3935576696 >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 0x7f67500b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f674ffff700 1 -- 172.21.15.26:0/3935576696 >> v1:172.21.15.26:6789/0 conn(0x7f675015b5e0 legacy=0x7f67500b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f674ffff700 1 -- 172.21.15.26:0/3935576696 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500b3250 con 0x7f675015b9b0 2023-10-09T11:35:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f67552d8700 1 --2- 172.21.15.26:0/3935576696 >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 0x7f67500b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10ceffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10ceffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50484/0 (socket says 172.21.15.26:50484) 2023-10-09T11:35:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10ceffd700 1 -- 172.21.15.26:0/3091021636 learned_addr learned my addr 172.21.15.26:0/3091021636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10ce7fc700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.67:3300/0 conn(0x7f10d00cb720 0x7f10d00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f10cf7fe700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.26:3300/0 conn(0x7f10d006e3f0 0x7f10d006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f674ffff700 1 --2- 172.21.15.26:0/3935576696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f67440099b0 tx=0x7f6744009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf5bb41b3daef3ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7fc0c417e700 1 Processor -- start 2023-10-09T11:35:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 -- 172.21.15.26:0/3091021636 >> v2:172.21.15.67:3300/0 conn(0x7f10d00cb720 msgr2=0x7f10d00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.67:3300/0 conn(0x7f10d00cb720 0x7f10d00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 -- 172.21.15.26:0/3091021636 >> v2:172.21.15.26:3300/0 conn(0x7f10d006e3f0 msgr2=0x7f10d006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.26:3300/0 conn(0x7f10d006e3f0 0x7f10d006e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f674f7fe700 1 -- 172.21.15.26:0/3935576696 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400b820 con 0x7f675015b9b0 2023-10-09T11:35:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 -- 172.21.15.26:0/3091021636 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d006ed80 con 0x7f10d006bc20 2023-10-09T11:35:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3091021636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10d0064990 tx=0x7f10c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b891d431f9e6b19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f3417b90700 1 Processor -- start 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72d4a99700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72d006ace0 0x7f72d0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72d4a99700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d006a290 con 0x7f72d0156310 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72d4a99700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d0068580 con 0x7f72d00677b0 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72d4a99700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d00c8c20 con 0x7f72d006ace0 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72ce59c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f72d00677b0 0x7f72d0067b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:46900/0 (socket says 172.21.15.26:46900) 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.174+0000 7f72ce59c700 1 -- 172.21.15.26:0/317513881 learned_addr learned my addr 172.21.15.26:0/317513881 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/317513881 >> v2:172.21.15.67:3300/0 conn(0x7f72d006ace0 0x7f72d0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454445008 0 0) 0x7f72d0068580 con 0x7f72d00677b0 2023-10-09T11:35:30.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b8003570 con 0x7f72d00677b0 2023-10-09T11:35:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10cdffb700 1 -- 172.21.15.26:0/3091021636 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4009e70 con 0x7f10d006bc20 2023-10-09T11:35:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10cdffb700 1 -- 172.21.15.26:0/3091021636 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400b860 con 0x7f10d006bc20 2023-10-09T11:35:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f10cdffb700 1 -- 172.21.15.26:0/3091021636 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400bc00 con 0x7f10d006bc20 2023-10-09T11:35:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f3417b90700 1 -- start start 2023-10-09T11:35:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7fc0c417e700 1 -- start start 2023-10-09T11:35:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f721f7ff700 1 Processor -- start 2023-10-09T11:35:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f674f7fe700 1 -- 172.21.15.26:0/3935576696 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674400b980 con 0x7f675015b9b0 2023-10-09T11:35:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f674f7fe700 1 -- 172.21.15.26:0/3935576696 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400bd20 con 0x7f675015b9b0 2023-10-09T11:35:30.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f721f7ff700 1 -- start start 2023-10-09T11:35:30.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f5388e90700 1 Processor -- start 2023-10-09T11:35:30.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 -- 172.21.15.26:0/3935576696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 msgr2=0x7f67500b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 --2- 172.21.15.26:0/3935576696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f67440099b0 tx=0x7f6744009250 comp rx=0 tx=0).stop 2023-10-09T11:35:30.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 -- 172.21.15.26:0/3935576696 shutdown_connections 2023-10-09T11:35:30.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 --2- 172.21.15.26:0/3935576696 >> v2:172.21.15.26:3300/0 conn(0x7f67500b0470 0x7f67500b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 --2- 172.21.15.26:0/3935576696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b9b0 0x7f67500b27d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f6756d3b700 1 -- 172.21.15.26:0/3935576696 >> 172.21.15.26:0/3935576696 conn(0x7f67500cded0 msgr2=0x7f675006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f10d566d700 1 -- 172.21.15.26:0/3091021636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 msgr2=0x7f10d00ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f10d566d700 1 --2- 172.21.15.26:0/3091021636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10d0064990 tx=0x7f10c4009250 comp rx=0 tx=0).stop 2023-10-09T11:35:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7fc0c417e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0bc0cb510 0x7fc0bc168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7fc0c417e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc0ce930 con 0x7fc0bc15db90 2023-10-09T11:35:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7fc0c417e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc0cd740 con 0x7fc0bc15df60 2023-10-09T11:35:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7fc0c417e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0cda20 con 0x7fc0bc0cb510 2023-10-09T11:35:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7fc0c1719700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc0bc15df60 0x7fc0bc0cae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:46910/0 (socket says 172.21.15.26:46910) 2023-10-09T11:35:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7fc0c1719700 1 -- 172.21.15.26:0/3170110130 learned_addr learned my addr 172.21.15.26:0/3170110130 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7fc0c271b700 1 --2- 172.21.15.26:0/3170110130 >> v2:172.21.15.26:3300/0 conn(0x7fc0bc0cb510 0x7fc0bc168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f3417b90700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f3417b90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f341006e930 0x7f34100ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f3417b90700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34100acf40 con 0x7f34100cb8e0 2023-10-09T11:35:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f3417b90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34100b20a0 con 0x7f341006e930 2023-10-09T11:35:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f3417b90700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3410156ee0 con 0x7f34100cbcb0 2023-10-09T11:35:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 -- 172.21.15.26:0/3091021636 shutdown_connections 2023-10-09T11:35:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.26:3300/0 conn(0x7f10d006e3f0 0x7f10d006e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 --2- 172.21.15.26:0/3091021636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d00ac830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 --2- 172.21.15.26:0/3091021636 >> v2:172.21.15.67:3300/0 conn(0x7f10d00cb720 0x7f10d00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 -- 172.21.15.26:0/3091021636 >> 172.21.15.26:0/3091021636 conn(0x7f10d00cc300 msgr2=0x7f10d00cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570001403 0 0) 0x7f72d006a290 con 0x7f72d0156310 2023-10-09T11:35:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.175+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d0068580 con 0x7f72d0156310 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637922068 0 0) 0x7f72b8003570 con 0x7f72d00677b0 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 >> v2:172.21.15.67:3300/0 conn(0x7f72d006ace0 msgr2=0x7f72d0155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 --2- 172.21.15.26:0/317513881 >> v2:172.21.15.67:3300/0 conn(0x7f72d006ace0 0x7f72d0155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 >> v1:172.21.15.26:6789/0 conn(0x7f72d0156310 legacy=0x7f72d00c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0156900 con 0x7f72d00677b0 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f72c4001470 con 0x7f72d00677b0 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 >> v1:172.21.15.67:6789/0 conn(0x7f72d00677b0 legacy=0x7f72d0067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 0x7f72b8005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b80037b0 0x7f72b8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72b8004160 0x7f72b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800c150 con 0x7f72b8004c50 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800c2c0 con 0x7f72b8004160 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800c480 con 0x7f72b80037b0 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f72ce59c700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 0x7f72b8005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ced9d700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72b8004160 0x7f72b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 -- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b80037b0 msgr2=0x7f72b8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b80037b0 0x7f72b8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 -- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72b8004160 msgr2=0x7f72b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72b8004160 0x7f72b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ced9d700 1 -- 172.21.15.26:0/317513881 reap_dead start 2023-10-09T11:35:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f341512b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 -- 172.21.15.26:0/317513881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0156900 con 0x7f72b8004c50 2023-10-09T11:35:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72ce59c700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 0x7f72b8005020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c320 tx=0x7f72c400c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9de09c2b9311bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f341512b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50494/0 (socket says 172.21.15.26:50494) 2023-10-09T11:35:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f341512b700 1 -- 172.21.15.26:0/3431978778 learned_addr learned my addr 172.21.15.26:0/3431978778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400cc40 con 0x7f72b8004c50 2023-10-09T11:35:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400cda0 con 0x7f72b8004c50 2023-10-09T11:35:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f72cd59a700 1 -- 172.21.15.26:0/317513881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4005b70 con 0x7f72b8004c50 2023-10-09T11:35:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f341612d700 1 --2- 172.21.15.26:0/3431978778 >> v2:172.21.15.26:3300/0 conn(0x7f341006e930 0x7f34100ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f10d566d700 1 -- 172.21.15.26:0/3091021636 shutdown_connections 2023-10-09T11:35:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721f7ff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 0x7f72180c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721f7ff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 0x7f72180ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721f7ff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180c72a0 con 0x7f7218159a80 2023-10-09T11:35:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721f7ff700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72180caee0 con 0x7f72181596b0 2023-10-09T11:35:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721f7ff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721806a4e0 con 0x7f72180ca500 2023-10-09T11:35:30.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.177+0000 7f721d59b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 0x7f72180c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721d59b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 0x7f72180c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39630/0 (socket says 172.21.15.26:39630) 2023-10-09T11:35:30.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721d59b700 1 -- 172.21.15.26:0/2007591689 learned_addr learned my addr 172.21.15.26:0/2007591689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 --2- 172.21.15.26:0/2007591689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 0x7f72180ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f341512b700 1 -- 172.21.15.26:0/3431978778 >> v2:172.21.15.26:3300/0 conn(0x7f341006e930 msgr2=0x7f34100ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f341512b700 1 --2- 172.21.15.26:0/3431978778 >> v2:172.21.15.26:3300/0 conn(0x7f341006e930 0x7f34100ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f341512b700 1 -- 172.21.15.26:0/3431978778 >> v1:172.21.15.26:6789/0 conn(0x7f34100cb8e0 legacy=0x7f34100ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f720ffff700 1 -- 172.21.15.26:0/2007591689 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551715888 0 0) 0x7f72180c72a0 con 0x7f7218159a80 2023-10-09T11:35:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f720ffff700 1 -- 172.21.15.26:0/2007591689 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7204003570 con 0x7f7218159a80 2023-10-09T11:35:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 -- 172.21.15.26:0/2007591689 >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 msgr2=0x7f72180c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 --2- 172.21.15.26:0/2007591689 >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 0x7f72180c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 -- 172.21.15.26:0/2007591689 >> v1:172.21.15.67:6789/0 conn(0x7f7218159a80 legacy=0x7f721806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 -- 172.21.15.26:0/2007591689 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721806a1b0 con 0x7f72180ca500 2023-10-09T11:35:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f10d566d700 1 -- 172.21.15.26:0/3091021636 wait complete. 2023-10-09T11:35:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.176+0000 7f5388e90700 1 -- start start 2023-10-09T11:35:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5388e90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538415dad0 0x7f538406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5388e90700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53840cac10 0x7f53840c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5388e90700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538406b230 con 0x7f538415dea0 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5388e90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538406a620 con 0x7f538415dad0 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5388e90700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538406a900 con 0x7f53840cac10 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538415dad0 0x7f538406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538415dad0 0x7f538406f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35486/0 (socket says 172.21.15.26:35486) 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 -- 172.21.15.26:0/1494625787 learned_addr learned my addr 172.21.15.26:0/1494625787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7fc0c271b700 1 -- 172.21.15.26:0/3170110130 >> v1:172.21.15.67:6789/0 conn(0x7fc0bc15df60 legacy=0x7fc0bc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7fc0c271b700 1 -- 172.21.15.26:0/3170110130 >> v1:172.21.15.26:6789/0 conn(0x7fc0bc15db90 legacy=0x7fc0bc0cce60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:35:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7fc0c271b700 1 -- 172.21.15.26:0/3170110130 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0ce2e0 con 0x7fc0bc0cb510 2023-10-09T11:35:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f341512b700 1 -- 172.21.15.26:0/3431978778 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341006ed80 con 0x7f34100cbcb0 2023-10-09T11:35:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f341512b700 1 --2- 172.21.15.26:0/3431978778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34000091e0 tx=0x7f3400009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b87062ccd31905e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f72d4a99700 1 -- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 msgr2=0x7f72b8005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f72d4a99700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 0x7f72b8005020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c320 tx=0x7f72c400c630 comp rx=0 tx=0).stop 2023-10-09T11:35:30.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7fc0c271b700 1 --2- 172.21.15.26:0/3170110130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc0cb510 0x7fc0bc168930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00098e0 tx=0x7fc0b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ebe861221d7810 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f5382d9d700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53840cac10 0x7f53840c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f6756d3b700 1 -- 172.21.15.26:0/3935576696 shutdown_connections 2023-10-09T11:35:30.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f72d4a99700 1 -- 172.21.15.26:0/317513881 shutdown_connections 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f72d4a99700 1 --2- 172.21.15.26:0/317513881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b8004c50 0x7f72b8005020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f72d4a99700 1 -- 172.21.15.26:0/317513881 >> 172.21.15.26:0/317513881 conn(0x7f72d00cc720 msgr2=0x7f72d00ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f721dd9c700 1 --2- 172.21.15.26:0/2007591689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 0x7f72180ca9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7214009e60 tx=0x7f7214009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11d1f96799795cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f720ffff700 1 -- 172.21.15.26:0/2007591689 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e070 con 0x7f72180ca500 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f720ffff700 1 -- 172.21.15.26:0/2007591689 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400bb60 con 0x7f72180ca500 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f720ffff700 1 -- 172.21.15.26:0/2007591689 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214012430 con 0x7f72180ca500 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 -- 172.21.15.26:0/2007591689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 msgr2=0x7f72180ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 --2- 172.21.15.26:0/2007591689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 0x7f72180ca9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7214009e60 tx=0x7f7214009780 comp rx=0 tx=0).stop 2023-10-09T11:35:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 -- 172.21.15.26:0/2007591689 shutdown_connections 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 --2- 172.21.15.26:0/2007591689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72180ca500 0x7f72180ca9a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 --2- 172.21.15.26:0/2007591689 >> v2:172.21.15.67:3300/0 conn(0x7f72181596b0 0x7f72180c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 -- 172.21.15.26:0/2007591689 >> 172.21.15.26:0/2007591689 conn(0x7f72180cc720 msgr2=0x7f72180ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 -- 172.21.15.26:0/1494625787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53840cac10 msgr2=0x7f53840c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53840cac10 0x7f53840c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f538259c700 1 -- 172.21.15.26:0/1494625787 >> v1:172.21.15.26:6789/0 conn(0x7f538415dea0 legacy=0x7f53840ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f538259c700 1 -- 172.21.15.26:0/1494625787 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538406abe0 con 0x7f538415dad0 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f538259c700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538415dad0 0x7f538406f3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53780099b0 tx=0x7f5378009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed419452a3dedcd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f538159a700 1 -- 172.21.15.26:0/1494625787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378009ea0 con 0x7f538415dad0 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f538159a700 1 -- 172.21.15.26:0/1494625787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800b860 con 0x7f538415dad0 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f538159a700 1 -- 172.21.15.26:0/1494625787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800bc00 con 0x7f538415dad0 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7fc0c0f18700 1 -- 172.21.15.26:0/3170110130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0009e80 con 0x7fc0bc0cb510 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7fc0c0f18700 1 -- 172.21.15.26:0/3170110130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b000b820 con 0x7fc0bc0cb510 2023-10-09T11:35:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7fc0c0f18700 1 -- 172.21.15.26:0/3170110130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000bbe0 con 0x7fc0bc0cb510 2023-10-09T11:35:30.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f341492a700 1 -- 172.21.15.26:0/3431978778 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000b740 con 0x7f34100cbcb0 2023-10-09T11:35:30.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f341492a700 1 -- 172.21.15.26:0/3431978778 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000b8a0 con 0x7f34100cbcb0 2023-10-09T11:35:30.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.179+0000 7f341492a700 1 -- 172.21.15.26:0/3431978778 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000bc40 con 0x7f34100cbcb0 2023-10-09T11:35:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 -- 172.21.15.26:0/1494625787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538415dad0 msgr2=0x7f538406f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538415dad0 0x7f538406f3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53780099b0 tx=0x7f5378009250 comp rx=0 tx=0).stop 2023-10-09T11:35:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7fc0c417e700 1 -- 172.21.15.26:0/3170110130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc0cb510 msgr2=0x7fc0bc168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7fc0c417e700 1 --2- 172.21.15.26:0/3170110130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc0cb510 0x7fc0bc168930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00098e0 tx=0x7fc0b00091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7fc0c417e700 1 -- 172.21.15.26:0/3170110130 shutdown_connections 2023-10-09T11:35:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7fc0c417e700 1 --2- 172.21.15.26:0/3170110130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc0cb510 0x7fc0bc168930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7fc0c417e700 1 -- 172.21.15.26:0/3170110130 >> 172.21.15.26:0/3170110130 conn(0x7fc0bc070e30 msgr2=0x7fc0bc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.178+0000 7f6756d3b700 1 -- 172.21.15.26:0/3935576696 wait complete. 2023-10-09T11:35:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f10d566d700 1 Processor -- start 2023-10-09T11:35:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f6756d3b700 1 Processor -- start 2023-10-09T11:35:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 -- 172.21.15.26:0/2007591689 shutdown_connections 2023-10-09T11:35:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f721f7ff700 1 -- 172.21.15.26:0/2007591689 wait complete. 2023-10-09T11:35:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 -- 172.21.15.26:0/1494625787 shutdown_connections 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53840cac10 0x7f53840c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 --2- 172.21.15.26:0/1494625787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538415dad0 0x7f538406f3d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f5388e90700 1 -- 172.21.15.26:0/1494625787 >> 172.21.15.26:0/1494625787 conn(0x7f53840cc720 msgr2=0x7f53840ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f3417b90700 1 -- 172.21.15.26:0/3431978778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 msgr2=0x7f341006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f3417b90700 1 --2- 172.21.15.26:0/3431978778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34000091e0 tx=0x7f3400009ae0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.180+0000 7f6756d3b700 1 -- start start 2023-10-09T11:35:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 -- 172.21.15.26:0/3431978778 shutdown_connections 2023-10-09T11:35:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 --2- 172.21.15.26:0/3431978778 >> v2:172.21.15.26:3300/0 conn(0x7f341006e930 0x7f34100ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 --2- 172.21.15.26:0/3431978778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34100cbcb0 0x7f341006e3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 -- 172.21.15.26:0/3431978778 >> 172.21.15.26:0/3431978778 conn(0x7f34100cc300 msgr2=0x7f34100cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 -- 172.21.15.26:0/3431978778 shutdown_connections 2023-10-09T11:35:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f3417b90700 1 -- 172.21.15.26:0/3431978778 wait complete. 2023-10-09T11:35:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67500b0470 0x7f675014e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 0x7f6750067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f675015b9b0 0x7f6750163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750153160 con 0x7f675015b9b0 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750069600 con 0x7f67500b0470 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.181+0000 7f6756d3b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6750156380 con 0x7f675015b5e0 2023-10-09T11:35:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f721f7ff700 1 Processor -- start 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f67552d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f675015b9b0 0x7f6750163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 0x7f6750067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f6754ad7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67500b0470 0x7f675014e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 0x7f6750067ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50518/0 (socket says 172.21.15.26:50518) 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 -- 172.21.15.26:0/295339930 learned_addr learned my addr 172.21.15.26:0/295339930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f67552d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f675015b9b0 0x7f6750163ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35498/0 (socket says 172.21.15.26:35498) 2023-10-09T11:35:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f5388e90700 1 -- 172.21.15.26:0/1494625787 shutdown_connections 2023-10-09T11:35:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f721f7ff700 1 -- start start 2023-10-09T11:35:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7fc0c417e700 1 -- 172.21.15.26:0/3170110130 shutdown_connections 2023-10-09T11:35:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 -- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67500b0470 msgr2=0x7f675014e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67500b0470 0x7f675014e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 -- 172.21.15.26:0/295339930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f675015b9b0 msgr2=0x7f6750163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f675015b9b0 0x7f6750163ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440094f0 con 0x7f675015b5e0 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f72d4a99700 1 -- 172.21.15.26:0/317513881 shutdown_connections 2023-10-09T11:35:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f3417b90700 1 Processor -- start 2023-10-09T11:35:30.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f3417b90700 1 -- start start 2023-10-09T11:35:30.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674ffff700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 0x7f6750067ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6744009290 tx=0x7f6744016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011e40 con 0x7f675015b5e0 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674401c460 con 0x7f675015b5e0 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674401c820 con 0x7f675015b5e0 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f10d566d700 1 -- start start 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d01538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10d006e3f0 0x7f10d00a9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 0x7f10d00a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0153430 con 0x7f10d006e3f0 2023-10-09T11:35:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01525d0 con 0x7f10d00cb720 2023-10-09T11:35:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10d566d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00a9b90 con 0x7f10d006bc20 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72180ca500 0x7f721814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72181596b0 0x7f72180b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 0x7f7218145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180b1ae0 con 0x7f7218159a80 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180b1f70 con 0x7f72180ca500 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721f7ff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180b0ed0 con 0x7f72181596b0 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721d59b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72180ca500 0x7f721814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10cf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 0x7f10d00a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6750068980 con 0x7f675015b5e0 2023-10-09T11:35:30.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6750068f40 con 0x7f675015b5e0 2023-10-09T11:35:30.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721dd9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 0x7f7218145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721dd9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 0x7f7218145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35524/0 (socket says 172.21.15.26:35524) 2023-10-09T11:35:30.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721dd9c700 1 -- 172.21.15.26:0/1484463976 learned_addr learned my addr 172.21.15.26:0/1484463976 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f721cd9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72181596b0 0x7f72180b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10cf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 0x7f10d00a9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39642/0 (socket says 172.21.15.26:39642) 2023-10-09T11:35:30.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10cf7fe700 1 -- 172.21.15.26:0/3587131077 learned_addr learned my addr 172.21.15.26:0/3587131077 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.182+0000 7f5388e90700 1 -- 172.21.15.26:0/1494625787 wait complete. 2023-10-09T11:35:30.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f10ce7fc700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10d006e3f0 0x7f10d00a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f5388e90700 1 Processor -- start 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341006e930 0x7f341015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 0x7f341014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34100cbcb0 0x7f34101594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3410161940 con 0x7f34100cb8e0 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341015ba40 con 0x7f34100cbcb0 2023-10-09T11:35:30.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7f3417b90700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341015bd10 con 0x7f341006e930 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f72d4a99700 1 -- 172.21.15.26:0/317513881 wait complete. 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 -- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72181596b0 msgr2=0x7f72180b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72181596b0 0x7f72180b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 -- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 msgr2=0x7f7218145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 0x7f7218145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009a20 con 0x7f72180ca500 2023-10-09T11:35:30.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721cd9a700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72181596b0 0x7f72180b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:30.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721dd9c700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7218159a80 0x7f7218145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:30.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d01538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10cf7fe700 1 -- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 msgr2=0x7f10d01538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10cf7fe700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d006bc20 0x7f10d01538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10cf7fe700 1 -- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10d006e3f0 msgr2=0x7f10d00a9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10cf7fe700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10d006e3f0 0x7f10d00a9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f10cf7fe700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40094f0 con 0x7f10d00cb720 2023-10-09T11:35:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.183+0000 7fc0c417e700 1 -- 172.21.15.26:0/3170110130 wait complete. 2023-10-09T11:35:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 0x7f341014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 0x7f341014f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35526/0 (socket says 172.21.15.26:35526) 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 -- 172.21.15.26:0/700374374 learned_addr learned my addr 172.21.15.26:0/700374374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 -- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341006e930 msgr2=0x7f341015b500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341006e930 0x7f341015b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 -- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34100cbcb0 msgr2=0x7f34101594a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34100cbcb0 0x7f34101594a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f341512b700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009d80 con 0x7f34100cb8e0 2023-10-09T11:35:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f721d59b700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72180ca500 0x7f721814d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f721000e870 tx=0x7f7210008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000c070 con 0x7f72180ca500 2023-10-09T11:35:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210013410 con 0x7f72180ca500 2023-10-09T11:35:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100137b0 con 0x7f72180ca500 2023-10-09T11:35:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180b11b0 con 0x7f72180ca500 2023-10-09T11:35:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72180b1770 con 0x7f72180ca500 2023-10-09T11:35:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f341512b700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 0x7f341014f900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3400009b20 tx=0x7f3400018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.184+0000 7f5388e90700 1 -- start start 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53840cac10 0x7f53840a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f538415dad0 0x7f5384147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538415dea0 0x7f53841480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53841499d0 con 0x7f53840cac10 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a5a10 con 0x7f538415dea0 2023-10-09T11:35:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5388e90700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5384148dc0 con 0x7f538415dad0 2023-10-09T11:35:30.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f675004c3c0 con 0x7f675015b5e0 2023-10-09T11:35:30.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f538259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53840cac10 0x7f53840a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f538259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53840cac10 0x7f53840a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35528/0 (socket says 172.21.15.26:35528) 2023-10-09T11:35:30.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f538259c700 1 -- 172.21.15.26:0/2175530369 learned_addr learned my addr 172.21.15.26:0/2175530369 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538415dea0 0x7f53841480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f72d4a99700 1 Processor -- start 2023-10-09T11:35:30.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f674401cb90 con 0x7f675015b5e0 2023-10-09T11:35:30.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340001d070 con 0x7f34100cb8e0 2023-10-09T11:35:30.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7fc0c417e700 1 Processor -- start 2023-10-09T11:35:30.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7fc0c417e700 1 -- start start 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000bc20 con 0x7f34100cb8e0 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400021620 con 0x7f34100cb8e0 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341015bff0 con 0x7f34100cb8e0 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3410161b90 con 0x7f34100cb8e0 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f674cff9700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f673c066f30 0x7f673c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67440869e0 con 0x7f675015b5e0 2023-10-09T11:35:30.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f674cff9700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7f673c06f0c0 0x7f673c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f673c071b80 con 0x7f673c06f0c0 2023-10-09T11:35:30.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f72d4a99700 1 -- start start 2023-10-09T11:35:30.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f72d4a99700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 0x7f72d01663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f72d4a99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d0140db0 0x7f72d015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f72d4a99700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d015ae40 0x7f72d006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f72d4a99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d00a55e0 con 0x7f72d0140db0 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72d4a99700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d01585e0 con 0x7f72d015ae40 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72d4a99700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d01588c0 con 0x7f72b8004c50 2023-10-09T11:35:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71f8000fd0 con 0x7f72180ca500 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f10cf7fe700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 0x7f10d00a9650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009e90 tx=0x7f10c800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0bc0cb510 0x7fc0bc0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc15db90 0x7fc0bc16e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 0x7fc0bc0b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0c8fc0 con 0x7fc0bc15db90 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0ca560 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7fc0c417e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc1606b0 con 0x7fc0bc0cb510 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f6754ad7700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f673c066f30 0x7f673c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 -- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f538415dad0 msgr2=0x7f5384147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f538415dad0 0x7f5384147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 -- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53840cac10 msgr2=0x7f53840a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53840cac10 0x7f53840a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.185+0000 7f5382d9d700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53780094f0 con 0x7f538415dea0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f5382d9d700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538415dea0 0x7f53841480b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f537c009e20 tx=0x7f537c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cc20 con 0x7f538415dea0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00f040 con 0x7f538415dea0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.186+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c014480 con 0x7f538415dea0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33f0000fd0 con 0x7f34100cb8e0 2023-10-09T11:35:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72ce59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 0x7f72d01663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800cc20 con 0x7f10d00cb720 2023-10-09T11:35:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800f040 con 0x7f10d00cb720 2023-10-09T11:35:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8014480 con 0x7f10d00cb720 2023-10-09T11:35:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d0152820 con 0x7f10d00cb720 2023-10-09T11:35:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d0152de0 con 0x7f10d00cb720 2023-10-09T11:35:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6744053bb0 con 0x7f675015b5e0 2023-10-09T11:35:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72ce59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 0x7f72d01663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50558/0 (socket says 172.21.15.26:50558) 2023-10-09T11:35:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72ce59c700 1 -- 172.21.15.26:0/3813771896 learned_addr learned my addr 172.21.15.26:0/3813771896 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f6754ad7700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f673c066f30 0x7f673c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67480075c0 tx=0x7f6748009780 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72ced9d700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d015ae40 0x7f72d006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f61bd6d5700 1 Processor -- start 2023-10-09T11:35:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7210013b20 con 0x7f72180ca500 2023-10-09T11:35:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f61bd6d5700 1 -- start start 2023-10-09T11:35:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f72ce59c700 1 -- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d015ae40 msgr2=0x7f72d006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72ce59c700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72d015ae40 0x7f72d006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72ce59c700 1 -- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d0140db0 msgr2=0x7f72d015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72ce59c700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d0140db0 0x7f72d015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72ce59c700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0158ba0 con 0x7f72b8004c50 2023-10-09T11:35:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7fc0c1f1a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0bc0cb510 0x7fc0bc0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7fc0c271b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 0x7fc0bc0b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7fc0c271b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 0x7fc0bc0b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39692/0 (socket says 172.21.15.26:39692) 2023-10-09T11:35:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7fc0c271b700 1 -- 172.21.15.26:0/322052499 learned_addr learned my addr 172.21.15.26:0/322052499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53841490a0 con 0x7f538415dea0 2023-10-09T11:35:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.187+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5384149660 con 0x7f538415dea0 2023-10-09T11:35:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f538404c3c0 con 0x7f538415dea0 2023-10-09T11:35:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f67552d8700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7f673c06f0c0 0x7f673c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72ce59c700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 0x7f72d01663b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c290 tx=0x7f72c4015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f720d7fa700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f71fc066f30 0x7f71fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72100842e0 con 0x7f72180ca500 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c1719700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc15db90 0x7fc0bc16e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c271b700 1 -- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0bc0cb510 msgr2=0x7fc0bc0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c271b700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0bc0cb510 0x7fc0bc0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c271b700 1 -- 172.21.15.26:0/322052499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc15db90 msgr2=0x7fc0bc16e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c271b700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0bc15db90 0x7fc0bc16e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c271b700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009420 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7fc0c1f1a700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0bc0cb510 0x7fc0bc0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:30.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f720d7fa700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f71fc06f0c0 0x7f71fc0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71fc071b80 con 0x7f71fc06f0c0 2023-10-09T11:35:30.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10d004c3c0 con 0x7f10d00cb720 2023-10-09T11:35:30.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40070d0 con 0x7f72b8004c50 2023-10-09T11:35:30.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d0158e80 con 0x7f72b8004c50 2023-10-09T11:35:30.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d0141200 con 0x7f72b8004c50 2023-10-09T11:35:30.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4007230 con 0x7f72b8004c50 2023-10-09T11:35:30.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4007670 con 0x7f72b8004c50 2023-10-09T11:35:30.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f67552d8700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7f673c06f0c0 0x7f673c0714d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.188+0000 7f721dd9c700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f71fc06f0c0 0x7f71fc0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bd6d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 0x7f61b80ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bd6d5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61b81599e0 0x7f61b80ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bd6d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b80ab620 con 0x7f61b80c7780 2023-10-09T11:35:30.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bd6d5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80c6ca0 con 0x7f61b81599e0 2023-10-09T11:35:30.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bd6d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80c6f80 con 0x7f61b8159610 2023-10-09T11:35:30.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7210051550 con 0x7f72180ca500 2023-10-09T11:35:30.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f721dd9c700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f71fc06f0c0 0x7f71fc0714d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10c8014830 con 0x7f10d00cb720 2023-10-09T11:35:30.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72b4000fd0 con 0x7f72b8004c50 2023-10-09T11:35:30.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7fc0c271b700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 0x7fc0bc0b2510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b3c0 tx=0x7fc0b0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bced4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61b80c7780 0x7f61b80c7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33426/0 (socket says 172.21.15.26:33426) 2023-10-09T11:35:30.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f61bced4700 1 -- 172.21.15.26:0/2208754274 learned_addr learned my addr 172.21.15.26:0/2208754274 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10b6ffd700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10bc067000 0x7f10bc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0009e80 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b001c660 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc16e6e0 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10c8084ed0 con 0x7f10d00cb720 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076347489 0 0) 0x7f61b80ab620 con 0x7f61b80c7780 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f721cd9a700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f71fc066f30 0x7f71fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10b6ffd700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f10bc06f210 0x7f10bc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10bc071cd0 con 0x7f10bc06f210 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c8087510 con 0x7f10d00cb720 2023-10-09T11:35:30.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f10ce7fc700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f10bc06f210 0x7f10bc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.189+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== osd.6 v2:172.21.15.67:6816/91126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f673c071b80 con 0x7f673c06f0c0 2023-10-09T11:35:30.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a0003570 con 0x7f61b80c7780 2023-10-09T11:35:30.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc0c9fa0 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b001ca00 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72c401e640 con 0x7f72b8004c50 2023-10-09T11:35:30.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023567038 0 0) 0x7f61a0003570 con 0x7f61b80c7780 2023-10-09T11:35:30.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 msgr2=0x7f61b80ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 0x7f61b80ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 >> v2:172.21.15.67:3300/0 conn(0x7f61b81599e0 msgr2=0x7f61b80ca920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 --2- 172.21.15.26:0/2208754274 >> v2:172.21.15.67:3300/0 conn(0x7f61b81599e0 0x7f61b80ca920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b80c7260 con 0x7f61b80c7780 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.190+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f61a8001470 con 0x7f61b80c7780 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 >> v1:172.21.15.26:6789/0 conn(0x7f61b80c7780 legacy=0x7f61b80c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61a0003ae0 0x7f61a0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 0x7f61a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a0004f50 0x7f61a0014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80c6ca0 con 0x7f61a0004f50 2023-10-09T11:35:30.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80c6f80 con 0x7f61a0003ae0 2023-10-09T11:35:30.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0005640 con 0x7f61b8159610 2023-10-09T11:35:30.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f537c014810 con 0x7f538415dea0 2023-10-09T11:35:30.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f10ce7fc700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f10bc06f210 0x7f10bc071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34000103f0 con 0x7f34100cb8e0 2023-10-09T11:35:30.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f72b0066fb0 0x7f72b0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5364066fb0 0x7f5364069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72c4085ea0 con 0x7f72b8004c50 2023-10-09T11:35:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f537c085ba0 con 0x7f538415dea0 2023-10-09T11:35:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f61bced4700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a0004f50 0x7f61a0014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f72b006f1c0 0x7f72b00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b0071c80 con 0x7f72b006f1c0 2023-10-09T11:35:30.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72c40861d0 con 0x7f72b8004c50 2023-10-09T11:35:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f536406f1c0 0x7f53640715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5364071c80 con 0x7f536406f1c0 2023-10-09T11:35:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f537c085ed0 con 0x7f538415dea0 2023-10-09T11:35:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc09c000fd0 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f3405ffb700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33f4067080 0x7f33f4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3400085f40 con 0x7f34100cb8e0 2023-10-09T11:35:30.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.191+0000 7f721cd9a700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f71fc066f30 0x7f71fc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f721814e8c0 tx=0x7f7208007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10bc067000 0x7f10bc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== osd.2 v2:172.21.15.26:6800/90837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f10bc071cd0 con 0x7f10bc06f210 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f3405ffb700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7f33f406f290 0x7f33f40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33f4071d50 con 0x7f33f406f290 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3400086270 con 0x7f34100cb8e0 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 -- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 msgr2=0x7f61a0004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b8159610 0x7f61a0004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 -- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61a0003ae0 msgr2=0x7f61a0003ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61a0003ae0 0x7f61a0003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 -- 172.21.15.26:0/2208754274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b80c7260 con 0x7f61a0004f50 2023-10-09T11:35:30.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f5381d9b700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f536406f1c0 0x7f53640715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f341592c700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33f4067080 0x7f33f4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f538259c700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5364066fb0 0x7f5364069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f72b0066fb0 0x7f72b0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f341612d700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7f33f406f290 0x7f33f40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f72ced9d700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f72b006f1c0 0x7f72b00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7f61bced4700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a0004f50 0x7f61a0014270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c410 tx=0x7f61a8007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cffabdc36dbefe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.192+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0b001b470 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8007b90 con 0x7f61a0004f50 2023-10-09T11:35:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800cca0 con 0x7f61a0004f50 2023-10-09T11:35:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f61b6ffd700 1 -- 172.21.15.26:0/2208754274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8005b30 con 0x7f61a0004f50 2023-10-09T11:35:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f5381d9b700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f536406f1c0 0x7f53640715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f538259c700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5364066fb0 0x7f5364069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5378009290 tx=0x7f5378017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f341592c700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33f4067080 0x7f33f4069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f340c001050 tx=0x7f340c007ae0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0adffb700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0067000 0x7fc0a00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f72b0066fb0 0x7f72b0069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72d004d1b0 tx=0x7f72c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0b0086450 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f72ced9d700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f72b006f1c0 0x7f72b00715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0c1f1a700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0067000 0x7fc0a00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0adffb700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7fc0a006f190 0x7fc0a00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0a0071c50 con 0x7fc0a006f190 2023-10-09T11:35:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f10ceffd700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10bc067000 0x7f10bc0694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10d0064990 tx=0x7f10c4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0b00536a0 con 0x7fc0bc0b4a40 2023-10-09T11:35:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7fc0c1719700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7fc0a006f190 0x7fc0a00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.193+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== osd.1 v2:172.21.15.26:6816/90835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f71fc071b80 con 0x7f71fc06f0c0 2023-10-09T11:35:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2208754274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a0004f50 msgr2=0x7f61a0014270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 --2- 172.21.15.26:0/2208754274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a0004f50 0x7f61a0014270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c410 tx=0x7f61a8007940 comp rx=0 tx=0).stop 2023-10-09T11:35:30.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f341612d700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7f33f406f290 0x7f33f40716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bced4700 1 -- 172.21.15.26:0/2208754274 reap_dead start 2023-10-09T11:35:30.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== osd.3 v2:172.21.15.26:6801/90834 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5364071c80 con 0x7f536406f1c0 2023-10-09T11:35:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2208754274 shutdown_connections 2023-10-09T11:35:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2208754274 >> 172.21.15.26:0/2208754274 conn(0x7f61b806d130 msgr2=0x7f61b80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7fc0c1719700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7fc0a006f190 0x7fc0a00715a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2208754274 shutdown_connections 2023-10-09T11:35:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2208754274 wait complete. 2023-10-09T11:35:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== osd.0 v2:172.21.15.26:6821/90836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f72b0071c80 con 0x7f72b006f1c0 2023-10-09T11:35:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.194+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== osd.5 v2:172.21.15.67:6808/91096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f33f4071d50 con 0x7f33f406f290 2023-10-09T11:35:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.195+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== osd.4 v2:172.21.15.67:6800/91097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc0a0071c50 con 0x7fc0a006f190 2023-10-09T11:35:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.195+0000 7f61bd6d5700 1 Processor -- start 2023-10-09T11:35:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 -- start start 2023-10-09T11:35:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 0x7f61b80c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b80c1410 0x7f61b815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b815b6d0 0x7f61b815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80c1880 con 0x7f61b815b6d0 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b815ad00 con 0x7f61b8149fd0 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.196+0000 7f61bd6d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8153b20 con 0x7f61b80c1410 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 0x7f61b80c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 0x7f61b80c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39718/0 (socket says 172.21.15.26:39718) 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 -- 172.21.15.26:0/2625427926 learned_addr learned my addr 172.21.15.26:0/2625427926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61bced4700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b815b6d0 0x7f61b815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b77fe700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b80c1410 0x7f61b815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 -- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b80c1410 msgr2=0x7f61b815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b80c1410 0x7f61b815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 -- 172.21.15.26:0/2625427926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b815b6d0 msgr2=0x7f61b815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b815b6d0 0x7f61b815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8153e00 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f61b7fff700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 0x7f61b80c0ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00b5e0 tx=0x7f61ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.197+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00f510 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.198+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac00f670 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.198+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b81540e0 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.198+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b814a3a0 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.199+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61b804c3c0 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.200+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00fa10 con 0x7f61b8149fd0 2023-10-09T11:35:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.201+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61ac024430 con 0x7f61b8149fd0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f619ffff700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a4066f30 0x7f61a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61ac084a90 con 0x7f61b8149fd0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f61b77fe700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a4066f30 0x7f61a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f619ffff700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f61a406f0c0 0x7f61a40714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61a4071b80 con 0x7f61a406f0c0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.202+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61ac084e30 con 0x7f61b8149fd0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.203+0000 7f61b77fe700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a4066f30 0x7f61a40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f61b8063f70 tx=0x7f61b0009620 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.204+0000 7f61bced4700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f61a406f0c0 0x7f61a40714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.204+0000 7fc0c1f1a700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0067000 0x7fc0a00694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001380 tx=0x7fc0b40096f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.204+0000 7f61bced4700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f61a406f0c0 0x7f61a40714d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.205+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== osd.7 v2:172.21.15.67:6824/91127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f61a4071b80 con 0x7f61a406f0c0 2023-10-09T11:35:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.221+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 --> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f538406aec0 con 0x7f536406f1c0 2023-10-09T11:35:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.222+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 --> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f675006d0c0 con 0x7f673c06f0c0 2023-10-09T11:35:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.222+0000 7f53727fc700 1 -- 172.21.15.26:0/2175530369 <== osd.3 v2:172.21.15.26:6801/90834 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f538406aec0 con 0x7f536406f1c0 2023-10-09T11:35:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.222+0000 7f674cff9700 1 -- 172.21.15.26:0/295339930 <== osd.6 v2:172.21.15.67:6816/91126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f675006d0c0 con 0x7f673c06f0c0 2023-10-09T11:35:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f536406f1c0 msgr2=0x7f53640715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f536406f1c0 0x7f53640715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5364066fb0 msgr2=0x7f5364069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5364066fb0 0x7f5364069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5378009290 tx=0x7f5378017000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538415dea0 msgr2=0x7f53841480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 --2- 172.21.15.26:0/2175530369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538415dea0 0x7f53841480b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f537c009e20 tx=0x7f537c00b040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5382d9d700 1 -- 172.21.15.26:0/2175530369 reap_dead start 2023-10-09T11:35:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7f673c06f0c0 msgr2=0x7f673c0714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7f673c06f0c0 0x7f673c0714d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 shutdown_connections 2023-10-09T11:35:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 >> 172.21.15.26:0/2175530369 conn(0x7f53840cc720 msgr2=0x7f538414f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f673c066f30 msgr2=0x7f673c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f673c066f30 0x7f673c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67480075c0 tx=0x7f6748009780 comp rx=0 tx=0).stop 2023-10-09T11:35:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 msgr2=0x7f6750067ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 --2- 172.21.15.26:0/295339930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f675015b5e0 0x7f6750067ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6744009290 tx=0x7f6744016000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f67552d8700 1 -- 172.21.15.26:0/295339930 reap_dead start 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 shutdown_connections 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.223+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 >> 172.21.15.26:0/295339930 conn(0x7f67500cded0 msgr2=0x7f675015a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.224+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 shutdown_connections 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.224+0000 7f5388e90700 1 -- 172.21.15.26:0/2175530369 wait complete. 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.224+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 shutdown_connections 2023-10-09T11:35:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.224+0000 7f6756d3b700 1 -- 172.21.15.26:0/295339930 wait complete. 2023-10-09T11:35:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.225+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 --> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71f8002d30 con 0x7f71fc06f0c0 2023-10-09T11:35:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.226+0000 7f720d7fa700 1 -- 172.21.15.26:0/1484463976 <== osd.1 v2:172.21.15.26:6816/90835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71f8002d30 con 0x7f71fc06f0c0 2023-10-09T11:35:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.226+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 --> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09c002d30 con 0x7fc0a006f190 2023-10-09T11:35:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.226+0000 7fc0adffb700 1 -- 172.21.15.26:0/322052499 <== osd.4 v2:172.21.15.67:6800/91097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc09c002d30 con 0x7fc0a006f190 2023-10-09T11:35:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.227+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 --> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f72b4002d30 con 0x7f72b006f1c0 2023-10-09T11:35:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.227+0000 7f72be7fc700 1 -- 172.21.15.26:0/3813771896 <== osd.0 v2:172.21.15.26:6821/90836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f72b4002d30 con 0x7f72b006f1c0 2023-10-09T11:35:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.227+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f72b006f1c0 msgr2=0x7f72b00715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.227+0000 7f72d4a99700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f72b006f1c0 0x7f72b00715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 --> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10d00abd50 con 0x7f10bc06f210 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f72b0066fb0 msgr2=0x7f72b0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f72b0066fb0 0x7f72b0069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72d004d1b0 tx=0x7f72c0008040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 msgr2=0x7f72d01663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 --2- 172.21.15.26:0/3813771896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72b8004c50 0x7f72d01663b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c290 tx=0x7f72c4015000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72ced9d700 1 -- 172.21.15.26:0/3813771896 reap_dead start 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 shutdown_connections 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 >> 172.21.15.26:0/3813771896 conn(0x7f72d00cc720 msgr2=0x7f72d00c57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 shutdown_connections 2023-10-09T11:35:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7f72d4a99700 1 -- 172.21.15.26:0/3813771896 wait complete. 2023-10-09T11:35:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7fc0a006f190 msgr2=0x7fc0a00715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7fc0a006f190 0x7fc0a00715a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0067000 msgr2=0x7fc0a00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0067000 0x7fc0a00694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001380 tx=0x7fc0b40096f0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 msgr2=0x7fc0bc0b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 --2- 172.21.15.26:0/322052499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0bc0b4a40 0x7fc0bc0b2510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b3c0 tx=0x7fc0b0016000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c271b700 1 -- 172.21.15.26:0/322052499 reap_dead start 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.230+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 shutdown_connections 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.231+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 >> 172.21.15.26:0/322052499 conn(0x7fc0bc070e30 msgr2=0x7fc0bc0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.231+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 shutdown_connections 2023-10-09T11:35:30.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.231+0000 7fc0c417e700 1 -- 172.21.15.26:0/322052499 wait complete. 2023-10-09T11:35:30.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.232+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f71fc06f0c0 msgr2=0x7f71fc0714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.232+0000 7f721f7ff700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f71fc06f0c0 0x7f71fc0714d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.232+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 --> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61b80c2470 con 0x7f61a406f0c0 2023-10-09T11:35:30.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 --> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33f0002d30 con 0x7f33f406f290 2023-10-09T11:35:30.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f10b6ffd700 1 -- 172.21.15.26:0/3587131077 <== osd.2 v2:172.21.15.26:6800/90837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10d00abd50 con 0x7f10bc06f210 2023-10-09T11:35:30.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f619ffff700 1 -- 172.21.15.26:0/2625427926 <== osd.7 v2:172.21.15.67:6824/91127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61b80c2470 con 0x7f61a406f0c0 2023-10-09T11:35:30.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f3405ffb700 1 -- 172.21.15.26:0/700374374 <== osd.5 v2:172.21.15.67:6808/91096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33f0002d30 con 0x7f33f406f290 2023-10-09T11:35:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f61a406f0c0 msgr2=0x7f61a40714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.233+0000 7f61bd6d5700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f61a406f0c0 0x7f61a40714d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a4066f30 msgr2=0x7f61a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a4066f30 0x7f61a40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f61b8063f70 tx=0x7f61b0009620 comp rx=0 tx=0).stop 2023-10-09T11:35:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 msgr2=0x7f61b80c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 --2- 172.21.15.26:0/2625427926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b8149fd0 0x7f61b80c0ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00b5e0 tx=0x7f61ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bced4700 1 -- 172.21.15.26:0/2625427926 reap_dead start 2023-10-09T11:35:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 shutdown_connections 2023-10-09T11:35:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.234+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 >> 172.21.15.26:0/2625427926 conn(0x7f61b806d130 msgr2=0x7f61b80c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.235+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f71fc066f30 msgr2=0x7f71fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.235+0000 7f721f7ff700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f71fc066f30 0x7f71fc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f721814e8c0 tx=0x7f7208007d50 comp rx=0 tx=0).stop 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.235+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72180ca500 msgr2=0x7f721814d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.235+0000 7f721f7ff700 1 --2- 172.21.15.26:0/1484463976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72180ca500 0x7f721814d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f721000e870 tx=0x7f7210008040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.235+0000 7f721dd9c700 1 -- 172.21.15.26:0/1484463976 reap_dead start 2023-10-09T11:35:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.236+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f10bc06f210 msgr2=0x7f10bc071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.236+0000 7f10d566d700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f10bc06f210 0x7f10bc071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 shutdown_connections 2023-10-09T11:35:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 >> 172.21.15.26:0/1484463976 conn(0x7f72180cc720 msgr2=0x7f72180c19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 shutdown_connections 2023-10-09T11:35:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f721f7ff700 1 -- 172.21.15.26:0/1484463976 wait complete. 2023-10-09T11:35:30.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 shutdown_connections 2023-10-09T11:35:30.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.237+0000 7f61bd6d5700 1 -- 172.21.15.26:0/2625427926 wait complete. 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7f33f406f290 msgr2=0x7f33f40716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7f33f406f290 0x7f33f40716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33f4067080 msgr2=0x7f33f4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33f4067080 0x7f33f4069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f340c001050 tx=0x7f340c007ae0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 msgr2=0x7f341014f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 --2- 172.21.15.26:0/700374374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34100cb8e0 0x7f341014f900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3400009b20 tx=0x7f3400018000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f341612d700 1 -- 172.21.15.26:0/700374374 reap_dead start 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 shutdown_connections 2023-10-09T11:35:30.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 >> 172.21.15.26:0/700374374 conn(0x7f34100cc300 msgr2=0x7f3410155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 shutdown_connections 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.239+0000 7f3417b90700 1 -- 172.21.15.26:0/700374374 wait complete. 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10bc067000 msgr2=0x7f10bc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10bc067000 0x7f10bc0694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10d0064990 tx=0x7f10c4017000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 msgr2=0x7f10d00a9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 --2- 172.21.15.26:0/3587131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d00cb720 0x7f10d00a9650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009e90 tx=0x7f10c800b040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10cf7fe700 1 -- 172.21.15.26:0/3587131077 reap_dead start 2023-10-09T11:35:30.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 shutdown_connections 2023-10-09T11:35:30.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.240+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 >> 172.21.15.26:0/3587131077 conn(0x7f10d00cc300 msgr2=0x7f10d00ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.312 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:30.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:35:30.314 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:30.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T11:35:30.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.248+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 shutdown_connections 2023-10-09T11:35:30.315 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:30.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T11:35:30.317 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-10-09T11:35:30.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T11:35:30.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.252+0000 7f10d566d700 1 -- 172.21.15.26:0/3587131077 wait complete. 2023-10-09T11:35:30.318 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:30.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T11:35:30.319 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-10-09T11:35:30.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T11:35:30.320 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-10-09T11:35:30.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T11:35:30.321 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:30.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:35:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.540+0000 7f675c558700 1 Processor -- start 2023-10-09T11:35:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.540+0000 7f675c558700 1 -- start start 2023-10-09T11:35:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675c558700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67540b1f90 0x7f67540aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675c558700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540cb2d0 0x7f67540cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675c558700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6754167a60 con 0x7f67540afb30 2023-10-09T11:35:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675c558700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6754166e50 con 0x7f67540b1f90 2023-10-09T11:35:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675c558700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754167130 con 0x7f67540cb2d0 2023-10-09T11:35:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675a2f4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f67540afb30 0x7f67540b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33430/0 (socket says 172.21.15.26:33430) 2023-10-09T11:35:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.542+0000 7f675a2f4700 1 -- 172.21.15.26:0/1213660448 learned_addr learned my addr 172.21.15.26:0/1213660448 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.543+0000 7f675aaf5700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540cb2d0 0x7f67540cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.543+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584863722 0 0) 0x7f6754167a60 con 0x7f67540afb30 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.543+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6740003550 con 0x7f67540afb30 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708420499 0 0) 0x7f6740003550 con 0x7f67540afb30 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540cb2d0 msgr2=0x7f67540cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540cb2d0 0x7f67540cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 >> v2:172.21.15.26:3300/0 conn(0x7f67540b1f90 msgr2=0x7f67540aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 --2- 172.21.15.26:0/1213660448 >> v2:172.21.15.26:3300/0 conn(0x7f67540b1f90 0x7f67540aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754167410 con 0x7f67540afb30 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f6750001470 con 0x7f67540afb30 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 >> v1:172.21.15.26:6789/0 conn(0x7f67540afb30 legacy=0x7f67540b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740003d20 0x7f6740004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740004670 0x7f6740011660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740011bf0 0x7f6740014050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754166e50 con 0x7f6740011bf0 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754167130 con 0x7f6740004670 2023-10-09T11:35:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740004f10 con 0x7f6740003d20 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.544+0000 7f6759af3700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740004670 0x7f6740011660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740003d20 0x7f6740004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675aaf5700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740011bf0 0x7f6740014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 -- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740004670 msgr2=0x7f6740011660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740004670 0x7f6740011660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 -- 172.21.15.26:0/1213660448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740011bf0 msgr2=0x7f6740014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740011bf0 0x7f6740014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.545+0000 7f675a2f4700 1 -- 172.21.15.26:0/1213660448 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754167410 con 0x7f6740003d20 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.546+0000 7f675a2f4700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740003d20 0x7f6740004130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f675000c410 tx=0x7f6750007940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c74e6e143f036ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.546+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000ccc0 con 0x7f6740003d20 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.546+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000ce20 con 0x7f6740003d20 2023-10-09T11:35:30.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.546+0000 7f67592f2700 1 -- 172.21.15.26:0/1213660448 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750005b70 con 0x7f6740003d20 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 -- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740003d20 msgr2=0x7f6740004130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 --2- 172.21.15.26:0/1213660448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740003d20 0x7f6740004130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f675000c410 tx=0x7f6750007940 comp rx=0 tx=0).stop 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675aaf5700 1 -- 172.21.15.26:0/1213660448 reap_dead start 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 -- 172.21.15.26:0/1213660448 shutdown_connections 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 -- 172.21.15.26:0/1213660448 >> 172.21.15.26:0/1213660448 conn(0x7f67540cc300 msgr2=0x7f67540cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 -- 172.21.15.26:0/1213660448 shutdown_connections 2023-10-09T11:35:30.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.547+0000 7f675c558700 1 -- 172.21.15.26:0/1213660448 wait complete. 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.549+0000 7f675c558700 1 Processor -- start 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.549+0000 7f675c558700 1 -- start start 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540a54d0 0x7f67540a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67540aa5d0 0x7f67540aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754087030 con 0x7f6740003d20 2023-10-09T11:35:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540aaf80 con 0x7f67540aa5d0 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675c558700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540a6ba0 con 0x7f67540a54d0 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35602/0 (socket says 172.21.15.26:35602) 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 -- 172.21.15.26:0/3295850164 learned_addr learned my addr 172.21.15.26:0/3295850164 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 -- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540a54d0 msgr2=0x7f67540a5940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540a54d0 0x7f67540a5940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 -- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67540aa5d0 msgr2=0x7f67540aaa40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67540aa5d0 0x7f67540aaa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.551+0000 7f675a2f4700 1 -- 172.21.15.26:0/3295850164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540a7030 con 0x7f6740003d20 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f675a2f4700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6750033000 tx=0x7f6750037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500072e0 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6750007440 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67540a5f90 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500077e0 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.552+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67540a6550 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.554+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f675003b030 con 0x7f6740003d20 2023-10-09T11:35:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.555+0000 7f674a7fc700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 0x7f674006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.555+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67500a7e90 con 0x7f6740003d20 2023-10-09T11:35:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.555+0000 7f6759af3700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 0x7f674006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.555+0000 7f6759af3700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 0x7f674006ad10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f675416a0a0 tx=0x7f674c0095f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.556+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0052b0 con 0x7f6740003d20 2023-10-09T11:35:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.559+0000 7fe30bb59700 1 Processor -- start 2023-10-09T11:35:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.560+0000 7fe30bb59700 1 -- start start 2023-10-09T11:35:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fe30bb59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fe30bb59700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3040cbcf0 0x7fe3040c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fe30bb59700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040c3380 con 0x7fe3041393f0 2023-10-09T11:35:30.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fe30bb59700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30406e010 con 0x7fe3040cbcf0 2023-10-09T11:35:30.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fe30bb59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040c2a50 con 0x7fe304138bc0 2023-10-09T11:35:30.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50614/0 (socket says 172.21.15.26:50614) 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 -- 172.21.15.26:0/2501434599 learned_addr learned my addr 172.21.15.26:0/2501434599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 -- 172.21.15.26:0/2501434599 >> v2:172.21.15.26:3300/0 conn(0x7fe3040cbcf0 msgr2=0x7fe3040c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 --2- 172.21.15.26:0/2501434599 >> v2:172.21.15.26:3300/0 conn(0x7fe3040cbcf0 0x7fe3040c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 -- 172.21.15.26:0/2501434599 >> v1:172.21.15.26:6789/0 conn(0x7fe3041393f0 legacy=0x7fe3040cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 -- 172.21.15.26:0/2501434599 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040c2d30 con 0x7fe304138bc0 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3098f5700 1 --2- 172.21.15.26:0/2501434599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3000099b0 tx=0x7fe300009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f12e4a0468ed20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3088f3700 1 -- 172.21.15.26:0/2501434599 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000b820 con 0x7fe304138bc0 2023-10-09T11:35:30.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3088f3700 1 -- 172.21.15.26:0/2501434599 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000b980 con 0x7fe304138bc0 2023-10-09T11:35:30.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.562+0000 7fe3088f3700 1 -- 172.21.15.26:0/2501434599 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000bd20 con 0x7fe304138bc0 2023-10-09T11:35:30.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 -- 172.21.15.26:0/2501434599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 msgr2=0x7fe30406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 --2- 172.21.15.26:0/2501434599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3000099b0 tx=0x7fe300009250 comp rx=0 tx=0).stop 2023-10-09T11:35:30.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 -- 172.21.15.26:0/2501434599 shutdown_connections 2023-10-09T11:35:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 --2- 172.21.15.26:0/2501434599 >> v2:172.21.15.26:3300/0 conn(0x7fe3040cbcf0 0x7fe3040c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 --2- 172.21.15.26:0/2501434599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe304138bc0 0x7fe30406d570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fe30bb59700 1 -- 172.21.15.26:0/2501434599 >> 172.21.15.26:0/2501434599 conn(0x7fe3040ccb60 msgr2=0x7fe3040ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.564+0000 7fe30bb59700 1 -- 172.21.15.26:0/2501434599 shutdown_connections 2023-10-09T11:35:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.564+0000 7fe30bb59700 1 -- 172.21.15.26:0/2501434599 wait complete. 2023-10-09T11:35:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6750075100 con 0x7f6740003d20 2023-10-09T11:35:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fc23003d700 1 Processor -- start 2023-10-09T11:35:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.561+0000 7fc23003d700 1 -- start start 2023-10-09T11:35:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc23003d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc228168f00 0x7fc2280aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc23003d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc228167a60 con 0x7fc2280b1f90 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc23003d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc228166e50 con 0x7fc2280afb30 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc23003d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc228167130 con 0x7fc228168f00 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc22d5d8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc2280b1f90 0x7fc2280cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33440/0 (socket says 172.21.15.26:33440) 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc22d5d8700 1 -- 172.21.15.26:0/1167100808 learned_addr learned my addr 172.21.15.26:0/1167100808 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.563+0000 7fc22e5da700 1 --2- 172.21.15.26:0/1167100808 >> v2:172.21.15.26:3300/0 conn(0x7fc228168f00 0x7fc2280aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245453434 0 0) 0x7fc228167a60 con 0x7fc2280b1f90 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc214004680 con 0x7fc2280b1f90 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026898312 0 0) 0x7fc228166e50 con 0x7fc2280afb30 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc228167a60 con 0x7fc2280afb30 2023-10-09T11:35:30.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22e5da700 1 -- 172.21.15.26:0/1167100808 >> v1:172.21.15.67:6789/0 conn(0x7fc2280afb30 legacy=0x7fc2280b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22e5da700 1 -- 172.21.15.26:0/1167100808 >> v1:172.21.15.26:6789/0 conn(0x7fc2280b1f90 legacy=0x7fc2280cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.565+0000 7fc22e5da700 1 -- 172.21.15.26:0/1167100808 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228167410 con 0x7fc228168f00 2023-10-09T11:35:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 Processor -- start 2023-10-09T11:35:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 -- start start 2023-10-09T11:35:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe304138bc0 0x7fe304130110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3041393f0 0x7fe304137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30412f480 con 0x7fe3040cbcf0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304132960 con 0x7fe304138bc0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.566+0000 7fe30bb59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041376d0 con 0x7fe3041393f0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35632/0 (socket says 172.21.15.26:35632) 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 -- 172.21.15.26:0/1322824377 learned_addr learned my addr 172.21.15.26:0/1322824377 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3090f4700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe304138bc0 0x7fe304130110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe30a0f6700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3041393f0 0x7fe304137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 -- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3041393f0 msgr2=0x7fe304137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3041393f0 0x7fe304137b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 -- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe304138bc0 msgr2=0x7fe304130110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe304138bc0 0x7fe304130110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 -- 172.21.15.26:0/1322824377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000094f0 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe3098f5700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe300009290 tx=0x7fe300016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30001f070 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300011d90 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.567+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30001a790 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.568+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe304136ac0 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.568+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304137080 con 0x7fe3040cbcf0 2023-10-09T11:35:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.568+0000 7f9acbae1700 1 Processor -- start 2023-10-09T11:35:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.569+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30404c3c0 con 0x7fe3040cbcf0 2023-10-09T11:35:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.568+0000 7f9acbae1700 1 -- start start 2023-10-09T11:35:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9acbae1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9ac40cbcb0 0x7f9ac406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9acbae1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40acf40 con 0x7f9ac406e930 2023-10-09T11:35:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9acbae1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac4156c00 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9acbae1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40b20a0 con 0x7f9ac40cbcb0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9ac907c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9ac40cbcb0 0x7f9ac406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9ac907c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9ac40cbcb0 0x7f9ac406e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39750/0 (socket says 172.21.15.26:39750) 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9ac907c700 1 -- 172.21.15.26:0/3150186878 learned_addr learned my addr 172.21.15.26:0/3150186878 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113870031 0 0) 0x7f9ac4156c00 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab0003570 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637837005 0 0) 0x7f9ab0003570 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 >> v2:172.21.15.67:3300/0 conn(0x7f9ac40cbcb0 msgr2=0x7f9ac406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 --2- 172.21.15.26:0/3150186878 >> v2:172.21.15.67:3300/0 conn(0x7f9ac40cbcb0 0x7f9ac406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 >> v1:172.21.15.26:6789/0 conn(0x7f9ac406e930 legacy=0x7f9ac40ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40abd50 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f9ab4001470 con 0x7f9ac40cb8e0 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 >> v1:172.21.15.67:6789/0 conn(0x7f9ac40cb8e0 legacy=0x7f9ac40ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ab0003cc0 0x7f9ab00040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ab0004780 0x7f9ab0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ab0005890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab000e2e0 con 0x7f9ab00053f0 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab000e450 con 0x7f9ab0004780 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab000e610 con 0x7f9ab0003cc0 2023-10-09T11:35:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9aca07e700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ab0005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.570+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe300023070 con 0x7fe3040cbcf0 2023-10-09T11:35:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7fe2f9ffb700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 0x7fe2e806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe300085710 con 0x7fe3040cbcf0 2023-10-09T11:35:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.569+0000 7f95d9302700 1 Processor -- start 2023-10-09T11:35:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.569+0000 7f95d9302700 1 -- start start 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d9302700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95d40b1250 0x7f95d40ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d9302700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40c9310 0x7f95d406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d9302700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d40ca6b0 con 0x7f95d40b0e80 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d9302700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d4156b80 con 0x7f95d40b1250 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d9302700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40adf10 con 0x7f95d40c9310 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d2ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f95d40b0e80 0x7f95d40af100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:46940/0 (socket says 172.21.15.26:46940) 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d2ffd700 1 -- 172.21.15.26:0/3544069252 learned_addr learned my addr 172.21.15.26:0/3544069252 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3544069252 >> v2:172.21.15.67:3300/0 conn(0x7f95d40b1250 0x7f95d40ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9ac907c700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ab0004780 0x7f9ab0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f9aca07e700 1 -- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ab0003cc0 msgr2=0x7f9ab00040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ab0003cc0 0x7f9ab00040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 -- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ab0004780 msgr2=0x7f9ab0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ab0004780 0x7f9ab0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.571+0000 7f95d1ffb700 1 -- 172.21.15.26:0/3544069252 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37622151 0 0) 0x7f95d40ca6b0 con 0x7f95d40b0e80 2023-10-09T11:35:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d1ffb700 1 -- 172.21.15.26:0/3544069252 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95bc003570 con 0x7f95d40b0e80 2023-10-09T11:35:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 -- 172.21.15.26:0/3150186878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40abd50 con 0x7f9ab00053f0 2023-10-09T11:35:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 -- 172.21.15.26:0/3150186878 reap_dead start 2023-10-09T11:35:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f9aca07e700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ab0005890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001ec0 tx=0x7f9abc0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8aba5b517a25b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d27fc700 1 -- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40c9310 msgr2=0x7f95d406e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40c9310 0x7f95d406e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d27fc700 1 -- 172.21.15.26:0/3544069252 >> v1:172.21.15.67:6789/0 conn(0x7f95d40b0e80 legacy=0x7f95d40af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d27fc700 1 -- 172.21.15.26:0/3544069252 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40c9aa0 con 0x7f95d40b1250 2023-10-09T11:35:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b1250 0x7f95d40ad9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95c80098e0 tx=0x7f95c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffcd0fa7604d1571 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d1ffb700 1 -- 172.21.15.26:0/3544069252 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001470 con 0x7f95d40b1250 2023-10-09T11:35:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d1ffb700 1 -- 172.21.15.26:0/3544069252 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8011420 con 0x7f95d40b1250 2023-10-09T11:35:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.572+0000 7f95d1ffb700 1 -- 172.21.15.26:0/3544069252 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80117c0 con 0x7f95d40b1250 2023-10-09T11:35:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7fe3090f4700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 0x7fe2e806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f1df8c3a700 1 Processor -- start 2023-10-09T11:35:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f1df8c3a700 1 -- start start 2023-10-09T11:35:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7fe3090f4700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 0x7fe2e806d7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4006fd0 tx=0x7fe2f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 -- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b1250 msgr2=0x7f95d40ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 --2- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b1250 0x7f95d40ad9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95c80098e0 tx=0x7f95c80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7fc22e5da700 1 --2- 172.21.15.26:0/1167100808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280aff00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc220009940 tx=0x7fc220009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c56d0ccfdf983b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 -- 172.21.15.26:0/3544069252 shutdown_connections 2023-10-09T11:35:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 --2- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40c9310 0x7f95d406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 --2- 172.21.15.26:0/3544069252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b1250 0x7f95d40ad9d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.573+0000 7f95d9302700 1 -- 172.21.15.26:0/3544069252 >> 172.21.15.26:0/3544069252 conn(0x7f95d40cc300 msgr2=0x7f95d40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f95d9302700 1 -- 172.21.15.26:0/3544069252 shutdown_connections 2023-10-09T11:35:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f95d9302700 1 -- 172.21.15.26:0/3544069252 wait complete. 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df8c3a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1df4143200 0x7f1df4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df8c3a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df415aa20 0x7f1df4163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df8c3a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df406c7d0 con 0x7f1df40c3250 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df8c3a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df41171e0 con 0x7f1df4143200 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df8c3a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c37a0 con 0x7f1df415aa20 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1df40c3250 0x7f1df415a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33456/0 (socket says 172.21.15.26:33456) 2023-10-09T11:35:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df1d9b700 1 -- 172.21.15.26:0/1628948143 learned_addr learned my addr 172.21.15.26:0/1628948143 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.574+0000 7f1df259c700 1 --2- 172.21.15.26:0/1628948143 >> v2:172.21.15.67:3300/0 conn(0x7f1df4143200 0x7f1df4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df2d9d700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df415aa20 0x7f1df4163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df259c700 1 -- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df415aa20 msgr2=0x7f1df4163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df259c700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df415aa20 0x7f1df4163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df259c700 1 -- 172.21.15.26:0/1628948143 >> v1:172.21.15.26:6789/0 conn(0x7f1df40c3250 legacy=0x7f1df415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df259c700 1 -- 172.21.15.26:0/1628948143 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40cc090 con 0x7f1df4143200 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df259c700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df4143200 0x7f1df4159dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098e0 tx=0x7f1de80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8104f5ead57aa85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df159a700 1 -- 172.21.15.26:0/1628948143 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de800b640 con 0x7f1df4143200 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df159a700 1 -- 172.21.15.26:0/1628948143 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de800b7a0 con 0x7f1df4143200 2023-10-09T11:35:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.575+0000 7f1df159a700 1 -- 172.21.15.26:0/1628948143 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de800bb40 con 0x7f1df4143200 2023-10-09T11:35:30.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f95d9302700 1 Processor -- start 2023-10-09T11:35:30.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f95d9302700 1 -- start start 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 -- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df4143200 msgr2=0x7f1df4159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df4143200 0x7f1df4159dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098e0 tx=0x7f1de80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 -- 172.21.15.26:0/1628948143 shutdown_connections 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df415aa20 0x7f1df4163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/1628948143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df4143200 0x7f1df4159dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 -- 172.21.15.26:0/1628948143 >> 172.21.15.26:0/1628948143 conn(0x7f1df40ccb60 msgr2=0x7f1df40ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 -- 172.21.15.26:0/1628948143 shutdown_connections 2023-10-09T11:35:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.576+0000 7f1df8c3a700 1 -- 172.21.15.26:0/1628948143 wait complete. 2023-10-09T11:35:30.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40b1250 0x7f95d406acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d40c9310 0x7f95d406b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40a6a90 con 0x7f95d40c9310 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d416f690 con 0x7f95d40b0e80 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d9302700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4156280 con 0x7f95d40b1250 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39796/0 (socket says 172.21.15.26:39796) 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 -- 172.21.15.26:0/3709373992 learned_addr learned my addr 172.21.15.26:0/3709373992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40b1250 0x7f95d406acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 -- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40b1250 msgr2=0x7f95d406acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40b1250 0x7f95d406acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 -- 172.21.15.26:0/3709373992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d40c9310 msgr2=0x7f95d406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d40c9310 0x7f95d406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 -- 172.21.15.26:0/3709373992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8009420 con 0x7f95d40b0e80 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f95d2ffd700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95c400cb60 tx=0x7f95c4001bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.577+0000 7f1df8c3a700 1 Processor -- start 2023-10-09T11:35:30.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f1df8c3a700 1 -- start start 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007360 con 0x7f95d40b0e80 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40074e0 con 0x7f95d40b0e80 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d416ed60 con 0x7f95d40b0e80 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4004830 con 0x7f95d40b0e80 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.578+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d416f320 con 0x7f95d40b0e80 2023-10-09T11:35:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40052b0 con 0x7f95d40b0e80 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 0x7f1df413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df4143200 0x7f1df416e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 0x7f1df415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df413e420 con 0x7f1df415aa20 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c6900 con 0x7f1df40c3250 2023-10-09T11:35:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df8c3a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c5ab0 con 0x7f1df4143200 2023-10-09T11:35:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 0x7f1df415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 0x7f1df415df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35662/0 (socket says 172.21.15.26:35662) 2023-10-09T11:35:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df2d9d700 1 -- 172.21.15.26:0/255244572 learned_addr learned my addr 172.21.15.26:0/255244572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc001800 con 0x7f9ab00053f0 2023-10-09T11:35:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000bb80 con 0x7fc228168f00 2023-10-09T11:35:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000bce0 con 0x7fc228168f00 2023-10-09T11:35:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7fc22cdd7700 1 -- 172.21.15.26:0/1167100808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200126d0 con 0x7fc228168f00 2023-10-09T11:35:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df259c700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 0x7f1df413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f1df1d9b700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df4143200 0x7f1df416e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95c4004c00 con 0x7f95d40b0e80 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f95baffd700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 0x7f95c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95c4083e90 con 0x7f95d40b0e80 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 -- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df4143200 msgr2=0x7f1df416e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df4143200 0x7f1df416e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 -- 172.21.15.26:0/255244572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 msgr2=0x7f1df415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 0x7f1df415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 -- 172.21.15.26:0/255244572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009420 con 0x7f1df40c3250 2023-10-09T11:35:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f1df259c700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 0x7f1df413dee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1de8016000 tx=0x7f1de8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 0x7f95c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc006b80 con 0x7f9ab00053f0 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.579+0000 7f9ac887b700 1 -- 172.21.15.26:0/3150186878 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00c6a0 con 0x7f9ab00053f0 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f9acbae1700 1 -- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 msgr2=0x7f9ab0005890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ab0005890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001ec0 tx=0x7f9abc0014d0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f9acbae1700 1 -- 172.21.15.26:0/3150186878 shutdown_connections 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3150186878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ab0005890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7f9acbae1700 1 -- 172.21.15.26:0/3150186878 >> 172.21.15.26:0/3150186878 conn(0x7f9ac40cc300 msgr2=0x7f9ac40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7fc23003d700 1 -- 172.21.15.26:0/1167100808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 msgr2=0x7fc2280aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.580+0000 7fc23003d700 1 --2- 172.21.15.26:0/1167100808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280aff00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc220009940 tx=0x7fc220009bd0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7f9acbae1700 1 -- 172.21.15.26:0/3150186878 shutdown_connections 2023-10-09T11:35:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7f9acbae1700 1 -- 172.21.15.26:0/3150186878 wait complete. 2023-10-09T11:35:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7f95d27fc700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 0x7f95c00693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95c80098e0 tx=0x7f95c8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fc23003d700 1 -- 172.21.15.26:0/1167100808 shutdown_connections 2023-10-09T11:35:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fc23003d700 1 --2- 172.21.15.26:0/1167100808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280aff00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3000529a0 con 0x7fe3040cbcf0 2023-10-09T11:35:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fc23003d700 1 -- 172.21.15.26:0/1167100808 >> 172.21.15.26:0/1167100808 conn(0x7fc2280cc300 msgr2=0x7fc2280cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fc23003d700 1 -- 172.21.15.26:0/1167100808 shutdown_connections 2023-10-09T11:35:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.581+0000 7fc23003d700 1 -- 172.21.15.26:0/1167100808 wait complete. 2023-10-09T11:35:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.582+0000 7f9acbae1700 1 Processor -- start 2023-10-09T11:35:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.583+0000 7f9acbae1700 1 -- start start 2023-10-09T11:35:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.583+0000 7fc23003d700 1 Processor -- start 2023-10-09T11:35:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.583+0000 7fc23003d700 1 -- start start 2023-10-09T11:35:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ac406b4c0 0x7f9ac416a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac4153f40 0x7f9ac41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac414c710 con 0x7f9ab00053f0 2023-10-09T11:35:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4153290 con 0x7f9ac4153f40 2023-10-09T11:35:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9acbae1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41548f0 con 0x7f9ac406b4c0 2023-10-09T11:35:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f5d86b13700 1 Processor -- start 2023-10-09T11:35:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35672/0 (socket says 172.21.15.26:35672) 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 -- 172.21.15.26:0/3418098176 learned_addr learned my addr 172.21.15.26:0/3418098176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac907c700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ac406b4c0 0x7f9ac416a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 -- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ac406b4c0 msgr2=0x7f9ac416a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ac406b4c0 0x7f9ac416a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 -- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac4153f40 msgr2=0x7f9ac41543b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac4153f40 0x7f9ac41543b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f9ac987d700 1 -- 172.21.15.26:0/3418098176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4154e70 con 0x7f9ab00053f0 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2280afb30 0x7fc228165670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280a5cc0 con 0x7fc228168f00 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22816bf90 con 0x7fc2280afb30 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc23003d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280a5670 con 0x7fc2280b1f90 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc22d5d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc22d5d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50676/0 (socket says 172.21.15.26:50676) 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc22d5d8700 1 -- 172.21.15.26:0/4148934441 learned_addr learned my addr 172.21.15.26:0/4148934441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc22ddd9700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2280afb30 0x7fc228165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7fc22e5da700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9ac987d700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400ce90 tx=0x7f9ab400a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 -- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2280afb30 msgr2=0x7fc228165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2280afb30 0x7fc228165670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 -- 172.21.15.26:0/4148934441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 msgr2=0x7fc2280a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 -- 172.21.15.26:0/4148934441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009e70 con 0x7fc2280b1f90 2023-10-09T11:35:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22e5da700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4007ea0 con 0x7f9ab00053f0 2023-10-09T11:35:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc22d5d8700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c790 tx=0x7fc224007e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4001a10 con 0x7f9ab00053f0 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4001dd0 con 0x7f9ab00053f0 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac416aa90 con 0x7f9ab00053f0 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de801bc40 con 0x7f1df40c3250 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de801bde0 con 0x7f1df40c3250 2023-10-09T11:35:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8011670 con 0x7f1df40c3250 2023-10-09T11:35:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224005b30 con 0x7fc2280b1f90 2023-10-09T11:35:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.584+0000 7f5d86b13700 1 -- start start 2023-10-09T11:35:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d86b13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 0x7f5d800c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d86b13700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800c3380 con 0x7f5d801393f0 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d86b13700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8006e010 con 0x7f5d80138bc0 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d86b13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800c2a50 con 0x7f5d800cbcf0 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d848af700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5d80138bc0 0x7f5d8006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:46954/0 (socket says 172.21.15.26:46954) 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d848af700 1 -- 172.21.15.26:0/4200683919 learned_addr learned my addr 172.21.15.26:0/4200683919 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d850b0700 1 --2- 172.21.15.26:0/4200683919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 0x7f5d800c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac4152960 con 0x7f9ab00053f0 2023-10-09T11:35:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d7f7fe700 1 -- 172.21.15.26:0/4200683919 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262483369 0 0) 0x7f5d8006e010 con 0x7f5d80138bc0 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7f5d7f7fe700 1 -- 172.21.15.26:0/4200683919 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d70003570 con 0x7f5d80138bc0 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224005cd0 con 0x7fc2280b1f90 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2280a5950 con 0x7fc2280b1f90 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.585+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224007320 con 0x7fc2280b1f90 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.586+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc228165d70 con 0x7fc2280b1f90 2023-10-09T11:35:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc224012400 con 0x7fc2280b1f90 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d850b0700 1 -- 172.21.15.26:0/4200683919 >> v1:172.21.15.67:6789/0 conn(0x7f5d80138bc0 legacy=0x7f5d8006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d850b0700 1 -- 172.21.15.26:0/4200683919 >> v1:172.21.15.26:6789/0 conn(0x7f5d801393f0 legacy=0x7f5d800cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d850b0700 1 -- 172.21.15.26:0/4200683919 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800c2d30 con 0x7f5d800cbcf0 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d850b0700 1 --2- 172.21.15.26:0/4200683919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 0x7f5d800c3810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ad30 tx=0x7f5d7800a5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8163eeb40a0b6c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d7f7fe700 1 -- 172.21.15.26:0/4200683919 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ae90 con 0x7f5d800cbcf0 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d7f7fe700 1 -- 172.21.15.26:0/4200683919 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800be80 con 0x7f5d800cbcf0 2023-10-09T11:35:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.587+0000 7f5d7f7fe700 1 -- 172.21.15.26:0/4200683919 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78014670 con 0x7f5d800cbcf0 2023-10-09T11:35:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7fc21dffb700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2240838f0 con 0x7fc2280b1f90 2023-10-09T11:35:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7fc22ddd9700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7f5d86b13700 1 -- 172.21.15.26:0/4200683919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 msgr2=0x7f5d800c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7f5d86b13700 1 --2- 172.21.15.26:0/4200683919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 0x7f5d800c3810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ad30 tx=0x7f5d7800a5e0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7f5d86b13700 1 -- 172.21.15.26:0/4200683919 shutdown_connections 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7f5d86b13700 1 --2- 172.21.15.26:0/4200683919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d800cbcf0 0x7f5d800c3810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7f5d86b13700 1 -- 172.21.15.26:0/4200683919 >> 172.21.15.26:0/4200683919 conn(0x7f5d800ccb60 msgr2=0x7f5d800ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.588+0000 7fc22ddd9700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 0x7fc20c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2281689d0 tx=0x7fc218009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7f5d86b13700 1 -- 172.21.15.26:0/4200683919 shutdown_connections 2023-10-09T11:35:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7f5d86b13700 1 -- 172.21.15.26:0/4200683919 wait complete. 2023-10-09T11:35:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40c5fd0 con 0x7f1df40c3250 2023-10-09T11:35:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2280a54d0 con 0x7fc2280b1f90 2023-10-09T11:35:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df40c6590 con 0x7f1df40c3250 2023-10-09T11:35:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.589+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab40032e0 con 0x7f9ab00053f0 2023-10-09T11:35:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.590+0000 7f9ab9ffb700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.590+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ab4084ac0 con 0x7f9ab00053f0 2023-10-09T11:35:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.590+0000 7f9ac907c700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.590+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95c4051180 con 0x7f95d40b0e80 2023-10-09T11:35:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.591+0000 7f5d86b13700 1 Processor -- start 2023-10-09T11:35:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.591+0000 7f9ac907c700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406e770 tx=0x7f9ac0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.591+0000 7f5d86b13700 1 -- start start 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d80138bc0 0x7f5d8016f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d801393f0 0x7f5d801321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80132d60 con 0x7f5d800cbcf0 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801336e0 con 0x7f5d801393f0 2023-10-09T11:35:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d86b13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80132a80 con 0x7f5d80138bc0 2023-10-09T11:35:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1de80119e0 con 0x7f1df40c3250 2023-10-09T11:35:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35694/0 (socket says 172.21.15.26:35694) 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 -- 172.21.15.26:0/1693664288 learned_addr learned my addr 172.21.15.26:0/1693664288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d850b0700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d801393f0 0x7f5d801321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d7ffff700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d80138bc0 0x7f5d8016f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 -- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d80138bc0 msgr2=0x7f5d8016f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d80138bc0 0x7f5d8016f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 -- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d801393f0 msgr2=0x7f5d801321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d801393f0 0x7f5d801321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 -- 172.21.15.26:0/1693664288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7800a840 con 0x7f5d800cbcf0 2023-10-09T11:35:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f1de27fc700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 0x7f1dd40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f5d848af700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400c790 tx=0x7f5d74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.592+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1de80859d0 con 0x7f1df40c3250 2023-10-09T11:35:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74005b30 con 0x7f5d800cbcf0 2023-10-09T11:35:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d74005c90 con 0x7f5d800cbcf0 2023-10-09T11:35:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007300 con 0x7f5d800cbcf0 2023-10-09T11:35:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d80133090 con 0x7f5d800cbcf0 2023-10-09T11:35:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d80132700 con 0x7f5d800cbcf0 2023-10-09T11:35:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f1df1d9b700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 0x7f1dd40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df404c3c0 con 0x7f1df40c3250 2023-10-09T11:35:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f1df1d9b700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 0x7f1dd40694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1df40c9bb0 tx=0x7f1de4007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.595+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc22404b5a0 con 0x7fc2280b1f90 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.595+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d740076b0 con 0x7f5d800cbcf0 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.596+0000 7f5d7cff9700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.596+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d740838c0 con 0x7f5d800cbcf0 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.596+0000 7f5d7ffff700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.596+0000 7f5d7ffff700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 0x7f5d640693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.593+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa40052b0 con 0x7f9ab00053f0 2023-10-09T11:35:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.598+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1de8052cc0 con 0x7f1df40c3250 2023-10-09T11:35:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.599+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab4051cb0 con 0x7f9ab00053f0 2023-10-09T11:35:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.602+0000 7f092cee4700 1 Processor -- start 2023-10-09T11:35:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.602+0000 7f092cee4700 1 -- start start 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f092cee4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f092815b5e0 0x7f09280b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f092cee4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092815ef50 con 0x7f09280b0470 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f092cee4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092815e380 con 0x7f092815b9b0 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f092cee4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092815e180 con 0x7f092815b5e0 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f0926d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f09280b0470 0x7f0928167810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33468/0 (socket says 172.21.15.26:33468) 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.604+0000 7f0926d9d700 1 -- 172.21.15.26:0/2898238866 learned_addr learned my addr 172.21.15.26:0/2898238866 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549612521 0 0) 0x7f092815e380 con 0x7f092815b9b0 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0910003570 con 0x7f092815b9b0 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212449626 0 0) 0x7f092815ef50 con 0x7f09280b0470 2023-10-09T11:35:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f092815e380 con 0x7f09280b0470 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369189361 0 0) 0x7f0910003570 con 0x7f092815b9b0 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 >> v2:172.21.15.26:3300/0 conn(0x7f092815b5e0 msgr2=0x7f09280b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 --2- 172.21.15.26:0/2898238866 >> v2:172.21.15.26:3300/0 conn(0x7f092815b5e0 0x7f09280b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 >> v1:172.21.15.26:6789/0 conn(0x7f09280b0470 legacy=0x7f0928167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092815e620 con 0x7f092815b9b0 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f091c0013a0 con 0x7f092815b9b0 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 >> v1:172.21.15.67:6789/0 conn(0x7f092815b9b0 legacy=0x7f09280b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 0x7f0910005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f09100037b0 0x7f0910003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09100043b0 0x7f091000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092815e180 con 0x7f09100043b0 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091000c300 con 0x7f0910004d20 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.605+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091000c4c0 con 0x7f09100037b0 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f0926d9d700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09100043b0 0x7f091000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f0925d9b700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f09100037b0 0x7f0910003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 0x7f0910005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 -- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f09100037b0 msgr2=0x7f0910003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f09100037b0 0x7f0910003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 -- 172.21.15.26:0/2898238866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09100043b0 msgr2=0x7f091000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09100043b0 0x7f091000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f092659c700 1 -- 172.21.15.26:0/2898238866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092815e620 con 0x7f0910004d20 2023-10-09T11:35:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.606+0000 7f0926d9d700 1 -- 172.21.15.26:0/2898238866 reap_dead start 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.607+0000 7f092659c700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 0x7f0910005110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09180099c0 tx=0x7f0918009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e58ac2e05bea65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.607+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918011400 con 0x7f0910004d20 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.607+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0918011560 con 0x7f0910004d20 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.607+0000 7f092559a700 1 -- 172.21.15.26:0/2898238866 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918011920 con 0x7f0910004d20 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 -- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 msgr2=0x7f0910005110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 0x7f0910005110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09180099c0 tx=0x7f0918009060 comp rx=0 tx=0).stop 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 -- 172.21.15.26:0/2898238866 shutdown_connections 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 --2- 172.21.15.26:0/2898238866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910004d20 0x7f0910005110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 -- 172.21.15.26:0/2898238866 >> 172.21.15.26:0/2898238866 conn(0x7f09280cded0 msgr2=0x7f092806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 -- 172.21.15.26:0/2898238866 shutdown_connections 2023-10-09T11:35:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.608+0000 7f092cee4700 1 -- 172.21.15.26:0/2898238866 wait complete. 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.610+0000 7f092cee4700 1 Processor -- start 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.610+0000 7f092cee4700 1 -- start start 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0910004d20 0x7f0928161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 0x7f092816e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 0x7f092816f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092816f560 con 0x7f0910004d20 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928163300 con 0x7f0928161f40 2023-10-09T11:35:30.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f092cee4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09281626f0 con 0x7f092816eb80 2023-10-09T11:35:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.611+0000 7f0926d9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 0x7f092816f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.612+0000 7f0926d9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 0x7f092816f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50714/0 (socket says 172.21.15.26:50714) 2023-10-09T11:35:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.612+0000 7f0926d9d700 1 -- 172.21.15.26:0/3406004651 learned_addr learned my addr 172.21.15.26:0/3406004651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.612+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d600052b0 con 0x7f5d800cbcf0 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 0x7f092816e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 -- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 msgr2=0x7f092816f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 0x7f092816f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 -- 172.21.15.26:0/3406004651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0910004d20 msgr2=0x7f0928161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0910004d20 0x7f0928161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.615+0000 7f0925d9b700 1 -- 172.21.15.26:0/3406004651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09281629d0 con 0x7f0928161f40 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.616+0000 7f0925d9b700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 0x7f092816e640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0928066f30 tx=0x7f091c009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.616+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0135f0 con 0x7f0928161f40 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.616+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c013750 con 0x7f0928161f40 2023-10-09T11:35:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.616+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c013b10 con 0x7f0928161f40 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.621+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928162cb0 con 0x7f0928161f40 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.621+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0928147b30 con 0x7f0928161f40 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.622+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092804c3c0 con 0x7f0928161f40 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.621+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d7404b5a0 con 0x7f5d800cbcf0 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.624+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f091c014480 con 0x7f0928161f40 2023-10-09T11:35:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.625+0000 7f09167fc700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 0x7f0908069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:30.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.625+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f091c085270 con 0x7f0928161f40 2023-10-09T11:35:30.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.625+0000 7f092659c700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 0x7f0908069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:30.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.626+0000 7f092659c700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 0x7f0908069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0918009780 tx=0x7f0918015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:30.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.628+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f091c0526b0 con 0x7f0928161f40 2023-10-09T11:35:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.959+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe3040c3010 con 0x7fe3040cbcf0 2023-10-09T11:35:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.959+0000 7fe2f9ffb700 1 -- 172.21.15.26:0/1322824377 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe300055fc0 con 0x7fe3040cbcf0 2023-10-09T11:35:30.961 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 msgr2=0x7fe2e806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 0x7fe2e806d7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4006fd0 tx=0x7fe2f4008040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 msgr2=0x7fe304132420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe300009290 tx=0x7fe300016000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 shutdown_connections 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e806b340 0x7fe2e806d7f0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4006fd0 tx=0x7fe2f4008040 comp rx=0 tx=0).stop 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3041393f0 0x7fe304137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040cbcf0 0x7fe304132420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 --2- 172.21.15.26:0/1322824377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe304138bc0 0x7fe304130110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 >> 172.21.15.26:0/1322824377 conn(0x7fe3040ccb60 msgr2=0x7fe30413a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 shutdown_connections 2023-10-09T11:35:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.963+0000 7fe30bb59700 1 -- 172.21.15.26:0/1322824377 wait complete. 2023-10-09T11:35:30.975 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-10-09T11:35:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.970+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f673c005830 con 0x7f6740003d20 2023-10-09T11:35:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.971+0000 7f674a7fc700 1 -- 172.21.15.26:0/3295850164 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6750039020 con 0x7f6740003d20 2023-10-09T11:35:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 msgr2=0x7f674006ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 0x7f674006ad10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f675416a0a0 tx=0x7f674c0095f0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 msgr2=0x7f6754086af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6750033000 tx=0x7f6750037000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 shutdown_connections 2023-10-09T11:35:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67540aa5d0 0x7f67540aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6740003d20 0x7f6754086af0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6740068860 0x7f674006ad10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 --2- 172.21.15.26:0/3295850164 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67540a54d0 0x7f67540a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.978+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 >> 172.21.15.26:0/3295850164 conn(0x7f67540cc300 msgr2=0x7f6754069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.979+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 shutdown_connections 2023-10-09T11:35:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.979+0000 7f675c558700 1 -- 172.21.15.26:0/3295850164 wait complete. 2023-10-09T11:35:30.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-10-09T11:35:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.987+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f95b4005830 con 0x7f95d40b0e80 2023-10-09T11:35:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.987+0000 7f95baffd700 1 -- 172.21.15.26:0/3709373992 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95c4018020 con 0x7f95d40b0e80 2023-10-09T11:35:30.989 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.992+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 msgr2=0x7f95c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.992+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 0x7f95c00693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95c80098e0 tx=0x7f95c8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.992+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 msgr2=0x7f95d4155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.992+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95c400cb60 tx=0x7f95c4001bf0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.994+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1df40cc370 con 0x7f1df40c3250 2023-10-09T11:35:30.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.994+0000 7f1de27fc700 1 -- 172.21.15.26:0/255244572 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1de8029090 con 0x7f1df40c3250 2023-10-09T11:35:30.996 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 shutdown_connections 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d40c9310 0x7f95d406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d40b0e80 0x7f95d4155d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95c0066f30 0x7f95c00693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 --2- 172.21.15.26:0/3709373992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95d40b1250 0x7f95d406acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.996+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 >> 172.21.15.26:0/3709373992 conn(0x7f95d40cc300 msgr2=0x7f95d40af100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 shutdown_connections 2023-10-09T11:35:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 msgr2=0x7f1dd40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 0x7f1dd40694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1df40c9bb0 tx=0x7f1de4007eb0 comp rx=0 tx=0).stop 2023-10-09T11:35:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 msgr2=0x7f1df413dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 0x7f1df413dee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1de8016000 tx=0x7f1de8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:30.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2023-10-09T11:35:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.997+0000 7f95d9302700 1 -- 172.21.15.26:0/3709373992 wait complete. 2023-10-09T11:35:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.999+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9aa4005560 con 0x7f9ab00053f0 2023-10-09T11:35:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:30.999+0000 7f9ab9ffb700 1 -- 172.21.15.26:0/3418098176 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ab40552d0 con 0x7f9ab00053f0 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 shutdown_connections 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df415aa20 0x7f1df415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1df40c3250 0x7f1df413dee0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dd4067000 0x7f1dd40694b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 --2- 172.21.15.26:0/255244572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1df4143200 0x7f1df416e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.000+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 >> 172.21.15.26:0/255244572 conn(0x7f1df40ccb60 msgr2=0x7f1df406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc2280a5e30 con 0x7fc2280b1f90 2023-10-09T11:35:31.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 msgr2=0x7f9aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406e770 tx=0x7f9ac0008040 comp rx=0 tx=0).stop 2023-10-09T11:35:31.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 msgr2=0x7f9ac40ab300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400ce90 tx=0x7f9ab400a6b0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 shutdown_connections 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac4153f40 0x7f9ac41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ab00053f0 0x7f9ac40ab300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 --2- 172.21.15.26:0/3418098176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ac406b4c0 0x7f9ac416a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 >> 172.21.15.26:0/3418098176 conn(0x7f9ac40cc300 msgr2=0x7f9ac40cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 shutdown_connections 2023-10-09T11:35:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.002+0000 7f9acbae1700 1 -- 172.21.15.26:0/3418098176 wait complete. 2023-10-09T11:35:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.003+0000 7fc21dffb700 1 -- 172.21.15.26:0/4148934441 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc224017030 con 0x7fc2280b1f90 2023-10-09T11:35:31.006 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-10-09T11:35:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 shutdown_connections 2023-10-09T11:35:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7f1df8c3a700 1 -- 172.21.15.26:0/255244572 wait complete. 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 msgr2=0x7fc20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 0x7fc20c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2281689d0 tx=0x7fc218009040 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 msgr2=0x7fc2280a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c790 tx=0x7fc224007e80 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 shutdown_connections 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc228168f00 0x7fc2280a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2280afb30 0x7fc228165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc20c066f30 0x7fc20c0693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 --2- 172.21.15.26:0/4148934441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2280b1f90 0x7fc2280a96e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 >> 172.21.15.26:0/4148934441 conn(0x7fc2280cc300 msgr2=0x7fc22806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 shutdown_connections 2023-10-09T11:35:31.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.005+0000 7fc23003d700 1 -- 172.21.15.26:0/4148934441 wait complete. 2023-10-09T11:35:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.015+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d60005830 con 0x7f5d800cbcf0 2023-10-09T11:35:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.016+0000 7f5d7cff9700 1 -- 172.21.15.26:0/1693664288 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d74017080 con 0x7f5d800cbcf0 2023-10-09T11:35:31.017 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-10-09T11:35:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 msgr2=0x7f5d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 0x7f5d640693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 msgr2=0x7f5d8012fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400c790 tx=0x7f5d74007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 shutdown_connections 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d801393f0 0x7f5d801321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d800cbcf0 0x7f5d8012fea0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 --2- 172.21.15.26:0/1693664288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d80138bc0 0x7f5d8016f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.018+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 >> 172.21.15.26:0/1693664288 conn(0x7f5d800ccb60 msgr2=0x7f5d80137a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:31.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2023-10-09T11:35:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.019+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 shutdown_connections 2023-10-09T11:35:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.019+0000 7f5d86b13700 1 -- 172.21.15.26:0/1693664288 wait complete. 2023-10-09T11:35:31.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2023-10-09T11:35:31.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2023-10-09T11:35:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.028+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0928163440 con 0x7f0928161f40 2023-10-09T11:35:31.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2023-10-09T11:35:31.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.029+0000 7f09167fc700 1 -- 172.21.15.26:0/3406004651 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f091c055cd0 con 0x7f0928161f40 2023-10-09T11:35:31.031 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2023-10-09T11:35:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 msgr2=0x7f0908069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 0x7f0908069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0918009780 tx=0x7f0918015000 comp rx=0 tx=0).stop 2023-10-09T11:35:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 msgr2=0x7f092816e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 0x7f092816e640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0928066f30 tx=0x7f091c009040 comp rx=0 tx=0).stop 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 shutdown_connections 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0908067080 0x7f0908069530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f092816eb80 0x7f092816f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0910004d20 0x7f0928161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 --2- 172.21.15.26:0/3406004651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0928161f40 0x7f092816e640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 >> 172.21.15.26:0/3406004651 conn(0x7f09280cded0 msgr2=0x7f092815a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:31.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 shutdown_connections 2023-10-09T11:35:31.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:31.032+0000 7f092cee4700 1 -- 172.21.15.26:0/3406004651 wait complete. 2023-10-09T11:35:31.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-10-09T11:35:31.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2023-10-09T11:35:31.984 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T11:35:32.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T11:35:32.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T11:35:32.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T11:35:32.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:35:32.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T11:35:32.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T11:35:32.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:35:32.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.173+0000 7f4d10c39700 1 Processor -- start 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.173+0000 7f4d10c39700 1 -- start start 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.174+0000 7f4d10c39700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d0c138bc0 0x7f4d0c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.174+0000 7f4d10c39700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4d0c1393f0 0x7f4d0c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.174+0000 7f4d10c39700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0c3380 con 0x7f4d0c06dab0 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.174+0000 7f4d10c39700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c06e010 con 0x7f4d0c138bc0 2023-10-09T11:35:32.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.174+0000 7f4d10c39700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c2a50 con 0x7f4d0c1393f0 2023-10-09T11:35:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.175+0000 7f4d0a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d0c138bc0 0x7f4d0c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.175+0000 7f4d0a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d0c138bc0 0x7f4d0c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35744/0 (socket says 172.21.15.26:35744) 2023-10-09T11:35:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.175+0000 7f4d0a59c700 1 -- 172.21.15.26:0/482487765 learned_addr learned my addr 172.21.15.26:0/482487765 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.176+0000 7f4d0a59c700 1 -- 172.21.15.26:0/482487765 >> v2:172.21.15.67:3300/0 conn(0x7f4d0c1393f0 msgr2=0x7f4d0c0cb5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.176+0000 7f4d0a59c700 1 --2- 172.21.15.26:0/482487765 >> v2:172.21.15.67:3300/0 conn(0x7f4d0c1393f0 0x7f4d0c0cb5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.176+0000 7f4d0a59c700 1 -- 172.21.15.26:0/482487765 >> v1:172.21.15.67:6789/0 conn(0x7f4d0c06dab0 legacy=0x7f4d0c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.176+0000 7f4d0a59c700 1 -- 172.21.15.26:0/482487765 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0c2d30 con 0x7f4d0c138bc0 2023-10-09T11:35:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.176+0000 7f4d0a59c700 1 --2- 172.21.15.26:0/482487765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c138bc0 0x7f4d0c06d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c1597d0 tx=0x7f4cfc00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b41afe35e009ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.177+0000 7f4d09d9b700 1 -- 172.21.15.26:0/482487765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00dad0 con 0x7f4d0c138bc0 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.177+0000 7f4d09d9b700 1 -- 172.21.15.26:0/482487765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00dc30 con 0x7f4d0c138bc0 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.177+0000 7f4d09d9b700 1 -- 172.21.15.26:0/482487765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc017410 con 0x7f4d0c138bc0 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 -- 172.21.15.26:0/482487765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c138bc0 msgr2=0x7f4d0c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 --2- 172.21.15.26:0/482487765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c138bc0 0x7f4d0c06d570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c1597d0 tx=0x7f4cfc00b4e0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 -- 172.21.15.26:0/482487765 shutdown_connections 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 --2- 172.21.15.26:0/482487765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c138bc0 0x7f4d0c06d570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 --2- 172.21.15.26:0/482487765 >> v2:172.21.15.67:3300/0 conn(0x7f4d0c1393f0 0x7f4d0c0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 -- 172.21.15.26:0/482487765 >> 172.21.15.26:0/482487765 conn(0x7f4d0c0ccb60 msgr2=0x7f4d0c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.178+0000 7f4d10c39700 1 -- 172.21.15.26:0/482487765 shutdown_connections 2023-10-09T11:35:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.179+0000 7f4d10c39700 1 -- 172.21.15.26:0/482487765 wait complete. 2023-10-09T11:35:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.181+0000 7f4d10c39700 1 Processor -- start 2023-10-09T11:35:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.181+0000 7f4d10c39700 1 -- start start 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d0c138bc0 0x7f4d0c132450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d0c1393f0 0x7f4d0c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c171f30 con 0x7f4d0c06dab0 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c171320 con 0x7f4d0c1393f0 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d10c39700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c171600 con 0x7f4d0c138bc0 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35752/0 (socket says 172.21.15.26:35752) 2023-10-09T11:35:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.182+0000 7f4d0a59c700 1 -- 172.21.15.26:0/2899016745 learned_addr learned my addr 172.21.15.26:0/2899016745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d01d9b700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d0c138bc0 0x7f4d0c132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0ad9d700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d0c1393f0 0x7f4d0c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 -- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d0c138bc0 msgr2=0x7f4d0c132450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d0c138bc0 0x7f4d0c132450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 -- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d0c1393f0 msgr2=0x7f4d0c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d0c1393f0 0x7f4d0c159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 -- 172.21.15.26:0/2899016745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc00b780 con 0x7f4d0c06dab0 2023-10-09T11:35:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.183+0000 7f4d0a59c700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc002000 tx=0x7f4cfc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.187+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc009040 con 0x7f4d0c06dab0 2023-10-09T11:35:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.187+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc020470 con 0x7f4d0c06dab0 2023-10-09T11:35:32.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.187+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc020850 con 0x7f4d0c06dab0 2023-10-09T11:35:32.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.187+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c1718e0 con 0x7f4d0c06dab0 2023-10-09T11:35:32.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.187+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c132990 con 0x7f4d0c06dab0 2023-10-09T11:35:32.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.191+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cfc015070 con 0x7f4d0c06dab0 2023-10-09T11:35:32.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.191+0000 7f4d02ffd700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 0x7f4cec069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.191+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cfc085930 con 0x7f4d0c06dab0 2023-10-09T11:35:32.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.192+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c04c3c0 con 0x7f4d0c06dab0 2023-10-09T11:35:32.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.194+0000 7f4d01d9b700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 0x7f4cec069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.200+0000 7f4d01d9b700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 0x7f4cec069500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c135110 tx=0x7f4cf401a100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.202+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cfc052b80 con 0x7f4d0c06dab0 2023-10-09T11:35:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.218+0000 7f9855594700 1 Processor -- start 2023-10-09T11:35:32.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.219+0000 7f9855594700 1 -- start start 2023-10-09T11:35:32.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f9855594700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f9855594700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f985015a7d0 0x7f98500af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f9855594700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9850158c80 con 0x7f9850150c90 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f9855594700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985015afc0 con 0x7f985015a7d0 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f9855594700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98500af820 con 0x7f98501508c0 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f984effd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f984effd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50740/0 (socket says 172.21.15.26:50740) 2023-10-09T11:35:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f984effd700 1 -- 172.21.15.26:0/2532509054 learned_addr learned my addr 172.21.15.26:0/2532509054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f984f7fe700 1 --2- 172.21.15.26:0/2532509054 >> v2:172.21.15.26:3300/0 conn(0x7f985015a7d0 0x7f98500af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.220+0000 7f5f6ad2e700 1 Processor -- start 2023-10-09T11:35:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984effd700 1 -- 172.21.15.26:0/2532509054 >> v2:172.21.15.26:3300/0 conn(0x7f985015a7d0 msgr2=0x7f98500af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984effd700 1 --2- 172.21.15.26:0/2532509054 >> v2:172.21.15.26:3300/0 conn(0x7f985015a7d0 0x7f98500af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984effd700 1 -- 172.21.15.26:0/2532509054 >> v1:172.21.15.67:6789/0 conn(0x7f9850150c90 legacy=0x7f985015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984effd700 1 -- 172.21.15.26:0/2532509054 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850155710 con 0x7f98501508c0 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984effd700 1 --2- 172.21.15.26:0/2532509054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98440099b0 tx=0x7f9844009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536ece48519816a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984dffb700 1 -- 172.21.15.26:0/2532509054 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844009ea0 con 0x7f98501508c0 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984dffb700 1 -- 172.21.15.26:0/2532509054 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984400b860 con 0x7f98501508c0 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f984dffb700 1 -- 172.21.15.26:0/2532509054 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400bc00 con 0x7f98501508c0 2023-10-09T11:35:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.221+0000 7f5f6ad2e700 1 -- start start 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f6ad2e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640cb8e0 0x7f5f640cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f6ad2e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f6406eb00 0x7f5f640ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f6ad2e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f64156c00 con 0x7f5f640ac830 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f6ad2e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640b20a0 con 0x7f5f6406eb00 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f6ad2e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64156ee0 con 0x7f5f640cb8e0 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f9855594700 1 -- 172.21.15.26:0/2532509054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 msgr2=0x7f9850158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f9855594700 1 --2- 172.21.15.26:0/2532509054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98440099b0 tx=0x7f9844009250 comp rx=0 tx=0).stop 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f692cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f6406eb00 0x7f5f640ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f692cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f6406eb00 0x7f5f640ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35764/0 (socket says 172.21.15.26:35764) 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.222+0000 7f5f692cb700 1 -- 172.21.15.26:0/3861415538 learned_addr learned my addr 172.21.15.26:0/3861415538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 -- 172.21.15.26:0/2532509054 shutdown_connections 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 --2- 172.21.15.26:0/2532509054 >> v2:172.21.15.26:3300/0 conn(0x7f985015a7d0 0x7f98500af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 --2- 172.21.15.26:0/2532509054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850158650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 -- 172.21.15.26:0/2532509054 >> 172.21.15.26:0/2532509054 conn(0x7f98500cded0 msgr2=0x7f985006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f5f692cb700 1 -- 172.21.15.26:0/3861415538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640cb8e0 msgr2=0x7f5f640cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f5f692cb700 1 --2- 172.21.15.26:0/3861415538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640cb8e0 0x7f5f640cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f5f692cb700 1 -- 172.21.15.26:0/3861415538 >> v1:172.21.15.67:6789/0 conn(0x7f5f640ac830 legacy=0x7f5f6406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f5f692cb700 1 -- 172.21.15.26:0/3861415538 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640abd50 con 0x7f5f6406eb00 2023-10-09T11:35:32.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 -- 172.21.15.26:0/2532509054 shutdown_connections 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.223+0000 7f9855594700 1 -- 172.21.15.26:0/2532509054 wait complete. 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.224+0000 7f9855594700 1 Processor -- start 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.224+0000 7f9855594700 1 -- start start 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850171790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985015a7d0 0x7f98500c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985016e3a0 con 0x7f9850150c90 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850172660 con 0x7f985015a7d0 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f9855594700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9850171dc0 con 0x7f98501508c0 2023-10-09T11:35:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f984e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f984e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35780/0 (socket says 172.21.15.26:35780) 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f984e7fc700 1 -- 172.21.15.26:0/2428877647 learned_addr learned my addr 172.21.15.26:0/2428877647 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.225+0000 7f984f7fe700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985015a7d0 0x7f98500c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 -- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 msgr2=0x7f9850171790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850171790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 -- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985015a7d0 msgr2=0x7f98500c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985015a7d0 0x7f98500c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 -- 172.21.15.26:0/2428877647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98440094f0 con 0x7f9850150c90 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f984e7fc700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f984000c510 tx=0x7f984000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.226+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840011590 con 0x7f9850150c90 2023-10-09T11:35:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.227+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840011710 con 0x7f9850150c90 2023-10-09T11:35:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.227+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840011ad0 con 0x7f9850150c90 2023-10-09T11:35:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.227+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98501720a0 con 0x7f9850150c90 2023-10-09T11:35:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.227+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98500c8cd0 con 0x7f9850150c90 2023-10-09T11:35:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.229+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985004c3c0 con 0x7f9850150c90 2023-10-09T11:35:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.229+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f984001b3b0 con 0x7f9850150c90 2023-10-09T11:35:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.230+0000 7f9836ffd700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 0x7f983c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.230+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9840083a20 con 0x7f9850150c90 2023-10-09T11:35:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.232+0000 7f984effd700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 0x7f983c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.232+0000 7f984effd700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 0x7f983c069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98440099b0 tx=0x7f9844017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.235+0000 7f500f82f700 1 Processor -- start 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.235+0000 7f500f82f700 1 -- start start 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500f82f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f500815b5e0 0x7f50080b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500f82f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500f82f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500815ef50 con 0x7f500815b9b0 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500f82f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500815e180 con 0x7f500815b5e0 2023-10-09T11:35:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500f82f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500815e380 con 0x7f50080b0470 2023-10-09T11:35:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500ddcc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500ddcc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50754/0 (socket says 172.21.15.26:50754) 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.236+0000 7f500ddcc700 1 -- 172.21.15.26:0/1460686222 learned_addr learned my addr 172.21.15.26:0/1460686222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f500ddcc700 1 -- 172.21.15.26:0/1460686222 >> v2:172.21.15.67:3300/0 conn(0x7f500815b5e0 msgr2=0x7f50080b0cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f500ddcc700 1 --2- 172.21.15.26:0/1460686222 >> v2:172.21.15.67:3300/0 conn(0x7f500815b5e0 0x7f50080b0cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f500ddcc700 1 -- 172.21.15.26:0/1460686222 >> v1:172.21.15.26:6789/0 conn(0x7f500815b9b0 legacy=0x7f50080b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f500ddcc700 1 -- 172.21.15.26:0/1460686222 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500815e620 con 0x7f50080b0470 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f500ddcc700 1 --2- 172.21.15.26:0/1460686222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5000009f20 tx=0x7f5000009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d5d824db6f3b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f4ffffff700 1 -- 172.21.15.26:0/1460686222 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e070 con 0x7f50080b0470 2023-10-09T11:35:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f4ffffff700 1 -- 172.21.15.26:0/1460686222 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000ba40 con 0x7f50080b0470 2023-10-09T11:35:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.237+0000 7f4ffffff700 1 -- 172.21.15.26:0/1460686222 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000092e0 con 0x7f50080b0470 2023-10-09T11:35:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.238+0000 7f500f82f700 1 -- 172.21.15.26:0/1460686222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 msgr2=0x7f5008167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.238+0000 7f500f82f700 1 --2- 172.21.15.26:0/1460686222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5000009f20 tx=0x7f5000009840 comp rx=0 tx=0).stop 2023-10-09T11:35:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.239+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9840050c70 con 0x7f9850150c90 2023-10-09T11:35:32.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.239+0000 7f5b7feb7700 1 Processor -- start 2023-10-09T11:35:32.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 -- 172.21.15.26:0/1460686222 shutdown_connections 2023-10-09T11:35:32.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 --2- 172.21.15.26:0/1460686222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f5008167810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 --2- 172.21.15.26:0/1460686222 >> v2:172.21.15.67:3300/0 conn(0x7f500815b5e0 0x7f50080b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 -- 172.21.15.26:0/1460686222 >> 172.21.15.26:0/1460686222 conn(0x7f50080cded0 msgr2=0x7f500806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f5b7feb7700 1 -- start start 2023-10-09T11:35:32.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 -- 172.21.15.26:0/1460686222 shutdown_connections 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.241+0000 7f5b7feb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b780cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.241+0000 7f5b7feb7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b780cbb20 0x7f5b780c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.241+0000 7f5b7feb7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780c3380 con 0x7f5b78138bc0 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.241+0000 7f5b7feb7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780cbfc0 con 0x7f5b780cbb20 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.241+0000 7f5b7feb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7806e010 con 0x7f5b781393f0 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f500f82f700 1 -- 172.21.15.26:0/1460686222 wait complete. 2023-10-09T11:35:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.242+0000 7f500f82f700 1 Processor -- start 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.240+0000 7f5f692cb700 1 --2- 172.21.15.26:0/3861415538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f6406eb00 0x7f5f640ad6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f580089b0 tx=0x7f5f580082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ea72d0e686d9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.242+0000 7f5f637fe700 1 -- 172.21.15.26:0/3861415538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58010070 con 0x7f5f6406eb00 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.242+0000 7f5f637fe700 1 -- 172.21.15.26:0/3861415538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800daf0 con 0x7f5f6406eb00 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.242+0000 7f5f637fe700 1 -- 172.21.15.26:0/3861415538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800de90 con 0x7f5f6406eb00 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/3861415538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f6406eb00 msgr2=0x7f5f640ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/3861415538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f6406eb00 0x7f5f640ad6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f580089b0 tx=0x7f5f580082d0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.242+0000 7f500f82f700 1 -- start start 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f500814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f500815b9b0 0x7f50081499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008148910 con 0x7f500814ab10 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008148bf0 con 0x7f500815b9b0 2023-10-09T11:35:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.243+0000 7f500f82f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008148ed0 con 0x7f50080b0470 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5b7e454700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b780cbb20 0x7f5b780c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5b7e454700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b780cbb20 0x7f5b780c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35796/0 (socket says 172.21.15.26:35796) 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5b7e454700 1 -- 172.21.15.26:0/461546645 learned_addr learned my addr 172.21.15.26:0/461546645 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35798/0 (socket says 172.21.15.26:35798) 2023-10-09T11:35:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 -- 172.21.15.26:0/492740039 learned_addr learned my addr 172.21.15.26:0/492740039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500cdca700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f500815b9b0 0x7f50081499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 -- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 msgr2=0x7f500814a5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f500814a5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 -- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f500815b9b0 msgr2=0x7f50081499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f500815b9b0 0x7f50081499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f500ddcc700 1 -- 172.21.15.26:0/492740039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009ae0 con 0x7f500814ab10 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/3861415538 shutdown_connections 2023-10-09T11:35:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/3861415538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f6406eb00 0x7f5f640ad6b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/3861415538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640cb8e0 0x7f5f640cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.244+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/3861415538 >> 172.21.15.26:0/3861415538 conn(0x7f5f640cc300 msgr2=0x7f5f640cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5b7e454700 1 -- 172.21.15.26:0/461546645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 msgr2=0x7f5b780cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5b7d452700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b780cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5b7e454700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b780cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5b7e454700 1 -- 172.21.15.26:0/461546645 >> v1:172.21.15.26:6789/0 conn(0x7f5b78138bc0 legacy=0x7f5b7806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5b7e454700 1 -- 172.21.15.26:0/461546645 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780c2a50 con 0x7f5b780cbb20 2023-10-09T11:35:32.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f500ddcc700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5000003000 tx=0x7f5000017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/3861415538 shutdown_connections 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000012db0 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500001e430 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500001e7b0 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50081491b0 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.245+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5008162260 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.247+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804c3c0 con 0x7f500814ab10 2023-10-09T11:35:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.247+0000 7f5b7e454700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780cbb20 0x7f5b780c3810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000d1a0 tx=0x7f5b7000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23f7da903aa91e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.248+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f500001eb60 con 0x7f500814ab10 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.249+0000 7f4ffd7fa700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 0x7f4fec069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.249+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5000086b20 con 0x7f500814ab10 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.249+0000 7f500d5cb700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 0x7f4fec069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.250+0000 7f500d5cb700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 0x7f4fec069480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f500806a880 tx=0x7f4ff8006c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.251+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/3861415538 wait complete. 2023-10-09T11:35:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.253+0000 7f5f6ad2e700 1 Processor -- start 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.253+0000 7f5f6ad2e700 1 -- start start 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f6406eb00 0x7f5f6414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 0x7f5f64146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 0x7f5f6406a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641526c0 con 0x7f5f640cb8e0 2023-10-09T11:35:32.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64152b50 con 0x7f5f6406eb00 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.254+0000 7f5f6ad2e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64151ab0 con 0x7f5f640ac830 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f692cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 0x7f5f6406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f692cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 0x7f5f6406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35800/0 (socket says 172.21.15.26:35800) 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f692cb700 1 -- 172.21.15.26:0/1448595824 learned_addr learned my addr 172.21.15.26:0/1448595824 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 0x7f5f64146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f68aca700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f6406eb00 0x7f5f6414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 -- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f6406eb00 msgr2=0x7f5f6414fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f6406eb00 0x7f5f6414fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 -- 172.21.15.26:0/1448595824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 msgr2=0x7f5f6406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 0x7f5f6406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 -- 172.21.15.26:0/1448595824 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58008570 con 0x7f5f640ac830 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.255+0000 7f5f63fff700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 0x7f5f64146a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c4e0 tx=0x7f5f54007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5b7cc51700 1 -- 172.21.15.26:0/461546645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70010070 con 0x7f5b780cbb20 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400ce90 con 0x7f5f640ac830 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54011590 con 0x7f5f640ac830 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011950 con 0x7f5f640ac830 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5b7cc51700 1 -- 172.21.15.26:0/461546645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000dcb0 con 0x7f5b780cbb20 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5b7cc51700 1 -- 172.21.15.26:0/461546645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70016630 con 0x7f5b780cbb20 2023-10-09T11:35:32.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f64151d90 con 0x7f5f640ac830 2023-10-09T11:35:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f64152350 con 0x7f5f640ac830 2023-10-09T11:35:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.256+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5000053ef0 con 0x7f500814ab10 2023-10-09T11:35:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 -- 172.21.15.26:0/461546645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780cbb20 msgr2=0x7f5b780c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780cbb20 0x7f5b780c3810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000d1a0 tx=0x7f5b7000ba50 comp rx=0 tx=0).stop 2023-10-09T11:35:32.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 -- 172.21.15.26:0/461546645 shutdown_connections 2023-10-09T11:35:32.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780cbb20 0x7f5b780c3810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/461546645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b780cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5b7feb7700 1 -- 172.21.15.26:0/461546645 >> 172.21.15.26:0/461546645 conn(0x7f5b780ccb60 msgr2=0x7f5b780ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f5401c460 con 0x7f5f640ac830 2023-10-09T11:35:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5f60ff9700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 0x7f5f50069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.258+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f54084070 con 0x7f5f640ac830 2023-10-09T11:35:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.259+0000 7f5b7feb7700 1 -- 172.21.15.26:0/461546645 shutdown_connections 2023-10-09T11:35:32.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.259+0000 7f5f68aca700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 0x7f5f50069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.259+0000 7f5f68aca700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 0x7f5f50069430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007580 tx=0x7f5f5c009780 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.262+0000 7f5b7feb7700 1 -- 172.21.15.26:0/461546645 wait complete. 2023-10-09T11:35:32.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.263+0000 7f5b7feb7700 1 Processor -- start 2023-10-09T11:35:32.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.264+0000 7f5b7feb7700 1 -- start start 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 0x7f5b78149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 0x7f5b781170d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b78117610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78117b50 con 0x7f5b78138bc0 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c79c0 con 0x7f5b780cbb20 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7feb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c6db0 con 0x7f5b781393f0 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7d452700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 0x7f5b781170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7d452700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 0x7f5b781170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35810/0 (socket says 172.21.15.26:35810) 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7d452700 1 -- 172.21.15.26:0/4063148549 learned_addr learned my addr 172.21.15.26:0/4063148549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7e454700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b78117610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.265+0000 7f5b7dc53700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 0x7f5b78149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 -- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 msgr2=0x7f5b78117610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b78117610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 -- 172.21.15.26:0/4063148549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 msgr2=0x7f5b781170d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 0x7f5b781170d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 -- 172.21.15.26:0/4063148549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7000bcf0 con 0x7f5b780cbb20 2023-10-09T11:35:32.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5b7dc53700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 0x7f5b78149a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c510 tx=0x7f5b6c007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.266+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440052b0 con 0x7f5f640ac830 2023-10-09T11:35:32.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.270+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c011770 con 0x7f5b780cbb20 2023-10-09T11:35:32.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.270+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0118d0 con 0x7f5b780cbb20 2023-10-09T11:35:32.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.270+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c011c90 con 0x7f5b780cbb20 2023-10-09T11:35:32.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.270+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780c7090 con 0x7f5b780cbb20 2023-10-09T11:35:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.270+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780c7650 con 0x7f5b780cbb20 2023-10-09T11:35:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.272+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7804c3c0 con 0x7f5b780cbb20 2023-10-09T11:35:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.272+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f540512c0 con 0x7f5f640ac830 2023-10-09T11:35:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.272+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b6c0172f0 con 0x7f5b780cbb20 2023-10-09T11:35:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.273+0000 7f5b69ffb700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 0x7f5b5c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.273+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b6c0835c0 con 0x7f5b780cbb20 2023-10-09T11:35:32.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.274+0000 7f5b7d452700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 0x7f5b5c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.274+0000 7f5b7d452700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 0x7f5b5c0694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b780c6cc0 tx=0x7f5b74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.277+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b6c0508b0 con 0x7f5b780cbb20 2023-10-09T11:35:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.299+0000 7fbeee469700 1 Processor -- start 2023-10-09T11:35:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.299+0000 7fbeee469700 1 -- start start 2023-10-09T11:35:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.300+0000 7fbeee469700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbee806d280 0x7fbee80ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.300+0000 7fbeee469700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815e2b0 0x7fbee80cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.300+0000 7fbeee469700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80cdfb0 con 0x7fbee815dee0 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.300+0000 7fbeee469700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee80cd680 con 0x7fbee806d280 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.300+0000 7fbeee469700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80cd960 con 0x7fbee815e2b0 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.301+0000 7fbee77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbee806d280 0x7fbee80ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.301+0000 7fbee77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbee806d280 0x7fbee80ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35812/0 (socket says 172.21.15.26:35812) 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.301+0000 7fbee77fe700 1 -- 172.21.15.26:0/1199885246 learned_addr learned my addr 172.21.15.26:0/1199885246 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.301+0000 7fbeeca06700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815e2b0 0x7fbee80cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee77fe700 1 -- 172.21.15.26:0/1199885246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815e2b0 msgr2=0x7fbee80cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee77fe700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815e2b0 0x7fbee80cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee77fe700 1 -- 172.21.15.26:0/1199885246 >> v1:172.21.15.67:6789/0 conn(0x7fbee815dee0 legacy=0x7fbee80cc420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:35:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee77fe700 1 -- 172.21.15.26:0/1199885246 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80cdc40 con 0x7fbee806d280 2023-10-09T11:35:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee77fe700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee806d280 0x7fbee80ccb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009990 tx=0x7fbed8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8be9c2ed10bc5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.302+0000 7fbee6ffd700 1 -- 172.21.15.26:0/1199885246 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8005c10 con 0x7fbee806d280 2023-10-09T11:35:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.303+0000 7fbee6ffd700 1 -- 172.21.15.26:0/1199885246 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8005d70 con 0x7fbee806d280 2023-10-09T11:35:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.303+0000 7fbee6ffd700 1 -- 172.21.15.26:0/1199885246 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed800b840 con 0x7fbee806d280 2023-10-09T11:35:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.304+0000 7fbeee469700 1 -- 172.21.15.26:0/1199885246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee806d280 msgr2=0x7fbee80ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.304+0000 7fbeee469700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee806d280 0x7fbee80ccb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009990 tx=0x7fbed8009220 comp rx=0 tx=0).stop 2023-10-09T11:35:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.307+0000 7f774c0f1700 1 Processor -- start 2023-10-09T11:35:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 -- 172.21.15.26:0/1199885246 shutdown_connections 2023-10-09T11:35:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815e2b0 0x7fbee80cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 --2- 172.21.15.26:0/1199885246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee806d280 0x7fbee80ccb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 -- 172.21.15.26:0/1199885246 >> 172.21.15.26:0/1199885246 conn(0x7fbee806ce80 msgr2=0x7fbee80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7f774c0f1700 1 -- start start 2023-10-09T11:35:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 -- 172.21.15.26:0/1199885246 shutdown_connections 2023-10-09T11:35:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.308+0000 7fbeee469700 1 -- 172.21.15.26:0/1199885246 wait complete. 2023-10-09T11:35:32.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7fbeee469700 1 Processor -- start 2023-10-09T11:35:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.309+0000 7f774c0f1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7744070410 0x7f7744156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.309+0000 7f774c0f1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440c3a30 con 0x7f77440c4ab0 2023-10-09T11:35:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.309+0000 7f774c0f1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440c2e20 con 0x7f77440c29b0 2023-10-09T11:35:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.309+0000 7f774c0f1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774415c110 con 0x7f7744070410 2023-10-09T11:35:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f774a68e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f77440c4ab0 0x7f77440cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33508/0 (socket says 172.21.15.26:33508) 2023-10-09T11:35:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f774a68e700 1 -- 172.21.15.26:0/3155752276 learned_addr learned my addr 172.21.15.26:0/3155752276 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056411658 0 0) 0x7f77440c3a30 con 0x7f77440c4ab0 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7730003570 con 0x7f77440c4ab0 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278420344 0 0) 0x7f7730003570 con 0x7f77440c4ab0 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 >> v2:172.21.15.67:3300/0 conn(0x7f7744070410 msgr2=0x7f7744156af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 --2- 172.21.15.26:0/3155752276 >> v2:172.21.15.67:3300/0 conn(0x7f7744070410 0x7f7744156af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 >> v1:172.21.15.67:6789/0 conn(0x7f77440c29b0 legacy=0x7f77440c43a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440c3100 con 0x7f77440c4ab0 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f773c0017f0 con 0x7f77440c4ab0 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 >> v1:172.21.15.26:6789/0 conn(0x7f77440c4ab0 legacy=0x7f77440cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7730003ae0 0x7f7730003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7730004810 0x7f7730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 0x7f773000ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774415c110 con 0x7f7730004810 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773000c2c0 con 0x7f7730003ae0 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773000c480 con 0x7f77300053c0 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f774968c700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7730004810 0x7f7730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f774a68e700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 0x7f773000ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.310+0000 7fbeee469700 1 -- start start 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.311+0000 7f26746ae700 1 Processor -- start 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee806d280 0x7fbee814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 0x7fbee814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 0x7fbee80a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee814a0f0 con 0x7fbee815e2b0 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee814bf00 con 0x7fbee806d280 2023-10-09T11:35:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeee469700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee81497c0 con 0x7fbee815dee0 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbee77fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 0x7fbee814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbee77fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 0x7fbee814a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50810/0 (socket says 172.21.15.26:50810) 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbee77fe700 1 -- 172.21.15.26:0/312010875 learned_addr learned my addr 172.21.15.26:0/312010875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 -- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7730003ae0 msgr2=0x7f7730003ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7730003ae0 0x7f7730003ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 -- 172.21.15.26:0/3155752276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7730004810 msgr2=0x7f7730004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7730004810 0x7f7730004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 -- 172.21.15.26:0/3155752276 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440c3100 con 0x7f77300053c0 2023-10-09T11:35:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 -- 172.21.15.26:0/3155752276 reap_dead start 2023-10-09T11:35:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774968c700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7730004810 0x7f7730004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 0x7fbee80a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f26746ae700 1 -- start start 2023-10-09T11:35:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 -- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 msgr2=0x7fbee814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 0x7fbee814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 -- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee806d280 msgr2=0x7fbee814e9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee806d280 0x7fbee814e9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7fbeeca06700 1 -- 172.21.15.26:0/312010875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed8009480 con 0x7fbee815e2b0 2023-10-09T11:35:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.312+0000 7f774a68e700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 0x7f773000ba80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77440c4ed0 tx=0x7f773c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11e9bf9dcadcdbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7fbeeca06700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 0x7fbee80a8a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007e40 tx=0x7fbee00097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0070f0 con 0x7f77300053c0 2023-10-09T11:35:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c007250 con 0x7f77300053c0 2023-10-09T11:35:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f7748e8b700 1 -- 172.21.15.26:0/3155752276 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c007610 con 0x7f77300053c0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0018070 con 0x7fbee815e2b0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000eb70 con 0x7fbee815e2b0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0014420 con 0x7fbee815e2b0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee8149aa0 con 0x7fbee815e2b0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee80a8f70 con 0x7fbee815e2b0 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f774c0f1700 1 -- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 msgr2=0x7f773000ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f774c0f1700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 0x7f773000ba80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77440c4ed0 tx=0x7f773c00a060 comp rx=0 tx=0).stop 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f774c0f1700 1 -- 172.21.15.26:0/3155752276 shutdown_connections 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f774c0f1700 1 --2- 172.21.15.26:0/3155752276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77300053c0 0x7f773000ba80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f774c0f1700 1 -- 172.21.15.26:0/3155752276 >> 172.21.15.26:0/3155752276 conn(0x7f77440ccb60 msgr2=0x7f77440ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f26746ae700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f26746ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c156c00 con 0x7f266c06bc20 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f26746ae700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c0abd50 con 0x7f266c06eb00 2023-10-09T11:35:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.313+0000 7f26746ae700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0b20a0 con 0x7f266c0cb8e0 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f267244a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f267244a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:50818/0 (socket says 172.21.15.26:50818) 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.314+0000 7f267244a700 1 -- 172.21.15.26:0/2680323081 learned_addr learned my addr 172.21.15.26:0/2680323081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f2671448700 1 -- 172.21.15.26:0/2680323081 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763055831 0 0) 0x7f266c156c00 con 0x7f266c06bc20 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f2671448700 1 -- 172.21.15.26:0/2680323081 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003570 con 0x7f266c06bc20 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f774c0f1700 1 -- 172.21.15.26:0/3155752276 shutdown_connections 2023-10-09T11:35:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f267244a700 1 -- 172.21.15.26:0/2680323081 >> v1:172.21.15.67:6789/0 conn(0x7f266c06eb00 legacy=0x7f266c0ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f267244a700 1 -- 172.21.15.26:0/2680323081 >> v1:172.21.15.26:6789/0 conn(0x7f266c06bc20 legacy=0x7f266c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f267244a700 1 -- 172.21.15.26:0/2680323081 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0ac030 con 0x7f266c0cb8e0 2023-10-09T11:35:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f267244a700 1 --2- 172.21.15.26:0/2680323081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2668013290 tx=0x7f2668011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efddfe23ef3ae5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.315+0000 7f774c0f1700 1 -- 172.21.15.26:0/3155752276 wait complete. 2023-10-09T11:35:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.317+0000 7f774c0f1700 1 Processor -- start 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.317+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbee0003020 con 0x7fbee815e2b0 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7fbedffff700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 0x7fbec8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbee0084610 con 0x7fbee815e2b0 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.316+0000 7f2671448700 1 -- 172.21.15.26:0/2680323081 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668016070 con 0x7f266c0cb8e0 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.316+0000 7f2671448700 1 -- 172.21.15.26:0/2680323081 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680110d0 con 0x7f266c0cb8e0 2023-10-09T11:35:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.316+0000 7f2671448700 1 -- 172.21.15.26:0/2680323081 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668011470 con 0x7f266c0cb8e0 2023-10-09T11:35:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.317+0000 7f26746ae700 1 -- 172.21.15.26:0/2680323081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 msgr2=0x7f266c0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.317+0000 7f26746ae700 1 --2- 172.21.15.26:0/2680323081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2668013290 tx=0x7f2668011af0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.317+0000 7f774c0f1700 1 -- start start 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77300053c0 0x7f77441562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77440cb670 0x7f7744136600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77441567e0 con 0x7f77440ca8e0 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77440c9840 con 0x7f77300053c0 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.318+0000 7f774c0f1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77440c9b20 con 0x7f77440cb670 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35848/0 (socket says 172.21.15.26:35848) 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 -- 172.21.15.26:0/2019943718 learned_addr learned my addr 172.21.15.26:0/2019943718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774a68e700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77440cb670 0x7f7744136600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 -- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77440cb670 msgr2=0x7f7744136600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77440cb670 0x7f7744136600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 -- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77300053c0 msgr2=0x7f77441562a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77300053c0 0x7f77441562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 -- 172.21.15.26:0/2019943718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440c9e00 con 0x7f77440ca8e0 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.319+0000 7f774968c700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f774000e900 tx=0x7f7740006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7fbee7fff700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 0x7fbec8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740012600 con 0x7f77440ca8e0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77440ca0e0 con 0x7f77440ca8e0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740012760 con 0x7f77440ca8e0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740012b00 con 0x7f77440ca8e0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.320+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77440c9550 con 0x7f77440ca8e0 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.321+0000 7f26746ae700 1 -- 172.21.15.26:0/2680323081 shutdown_connections 2023-10-09T11:35:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.321+0000 7f26746ae700 1 --2- 172.21.15.26:0/2680323081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0cb8e0 0x7f266c0cbcb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.321+0000 7f26746ae700 1 -- 172.21.15.26:0/2680323081 >> 172.21.15.26:0/2680323081 conn(0x7f266c0cc300 msgr2=0x7f266c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.321+0000 7fbee7fff700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 0x7fbec8069500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009740 tx=0x7fbed0006c50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.322+0000 7f26746ae700 1 -- 172.21.15.26:0/2680323081 shutdown_connections 2023-10-09T11:35:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.322+0000 7f26746ae700 1 -- 172.21.15.26:0/2680323081 wait complete. 2023-10-09T11:35:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.322+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f774001b400 con 0x7f77440ca8e0 2023-10-09T11:35:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.322+0000 7f7739ffb700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 0x7f773006af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.323+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77400843c0 con 0x7f77440ca8e0 2023-10-09T11:35:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.324+0000 7f26746ae700 1 Processor -- start 2023-10-09T11:35:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.324+0000 7f26746ae700 1 -- start start 2023-10-09T11:35:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f7749e8d700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 0x7f773006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f7749e8d700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 0x7f773006af10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f774404cc40 tx=0x7f7734006c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c06eb00 0x7f266c149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f266c0cb8e0 0x7f266c0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c158f20 con 0x7f266c0cb8e0 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c159b60 con 0x7f266c06bc20 2023-10-09T11:35:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.325+0000 7f26746ae700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c159230 con 0x7f266c06eb00 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39958/0 (socket says 172.21.15.26:39958) 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 -- 172.21.15.26:0/3542780927 learned_addr learned my addr 172.21.15.26:0/3542780927 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f2672c4b700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f266c0cb8e0 0x7f266c0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 -- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c06eb00 msgr2=0x7f266c149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c06eb00 0x7f266c149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 -- 172.21.15.26:0/3542780927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f266c0cb8e0 msgr2=0x7f266c0ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f266c0cb8e0 0x7f266c0ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.326+0000 7f267244a700 1 -- 172.21.15.26:0/3542780927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668011d90 con 0x7f266c06bc20 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f267244a700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2668011d60 tx=0x7f2668020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800fd60 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668024410 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c159510 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680247b0 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.327+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c149660 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.328+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c04c3c0 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.329+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2668024ba0 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.329+0000 7f26627fc700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 0x7f26500693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.329+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f266808dec0 con 0x7f266c06bc20 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.332+0000 7f2671c49700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 0x7f26500693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.332+0000 7f2671c49700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 0x7f26500693b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2664001390 tx=0x7f2664007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.334+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f266805b1b0 con 0x7f266c06bc20 2023-10-09T11:35:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.339+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240052b0 con 0x7f77440ca8e0 2023-10-09T11:35:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.339+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee804c3c0 con 0x7fbee815e2b0 2023-10-09T11:35:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.352+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77400516b0 con 0x7f77440ca8e0 2023-10-09T11:35:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.357+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbee0051860 con 0x7fbee815e2b0 2023-10-09T11:35:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.595+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4d0c0c9330 con 0x7f4d0c06dab0 2023-10-09T11:35:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.595+0000 7f4d02ffd700 1 -- 172.21.15.26:0/2899016745 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cfc025030 con 0x7f4d0c06dab0 2023-10-09T11:35:32.599 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-10-09T11:35:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.598+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 msgr2=0x7f4cec069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.598+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 0x7f4cec069500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c135110 tx=0x7f4cf401a100 comp rx=0 tx=0).stop 2023-10-09T11:35:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.598+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 msgr2=0x7f4d0c0c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.598+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc002000 tx=0x7f4cfc019000 comp rx=0 tx=0).stop 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 shutdown_connections 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d0c1393f0 0x7f4d0c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c06dab0 0x7f4d0c0c5bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cec067050 0x7f4cec069500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 --2- 172.21.15.26:0/2899016745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d0c138bc0 0x7f4d0c132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 >> 172.21.15.26:0/2899016745 conn(0x7f4d0c0ccb60 msgr2=0x7f4d0c139a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 shutdown_connections 2023-10-09T11:35:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.599+0000 7f4d10c39700 1 -- 172.21.15.26:0/2899016745 wait complete. 2023-10-09T11:35:32.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2023-10-09T11:35:32.619 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.638+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f985016e550 con 0x7f9850150c90 2023-10-09T11:35:32.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.639+0000 7f9836ffd700 1 -- 172.21.15.26:0/2428877647 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f985016e550 con 0x7f9850150c90 2023-10-09T11:35:32.641 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-10-09T11:35:32.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5b780c2d30 con 0x7f5b780cbb20 2023-10-09T11:35:32.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 msgr2=0x7f983c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 0x7f983c069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98440099b0 tx=0x7f9844017000 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 msgr2=0x7f98500cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f984000c510 tx=0x7f984000c820 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 shutdown_connections 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985015a7d0 0x7f98500c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f983c067080 0x7f983c069530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98501508c0 0x7f9850171790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 --2- 172.21.15.26:0/2428877647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9850150c90 0x7f98500cadb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 >> 172.21.15.26:0/2428877647 conn(0x7f98500cded0 msgr2=0x7f98500b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 shutdown_connections 2023-10-09T11:35:32.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f9855594700 1 -- 172.21.15.26:0/2428877647 wait complete. 2023-10-09T11:35:32.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.643+0000 7f5b69ffb700 1 -- 172.21.15.26:0/4063148549 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b6c053ed0 con 0x7f5b780cbb20 2023-10-09T11:35:32.646 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:32.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.646+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 msgr2=0x7f5b5c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.646+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 0x7f5b5c0694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b780c6cc0 tx=0x7f5b74008040 comp rx=0 tx=0).stop 2023-10-09T11:35:32.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.646+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 msgr2=0x7f5b78149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.646+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 0x7f5b78149a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c510 tx=0x7f5b6c007e80 comp rx=0 tx=0).stop 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 shutdown_connections 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b5c067000 0x7f5b5c0694b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b781393f0 0x7f5b78117610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b780cbb20 0x7f5b78149a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 --2- 172.21.15.26:0/4063148549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b78138bc0 0x7f5b781170d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 >> 172.21.15.26:0/4063148549 conn(0x7f5b780ccb60 msgr2=0x7f5b780caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 shutdown_connections 2023-10-09T11:35:32.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.649+0000 7f5b7feb7700 1 -- 172.21.15.26:0/4063148549 wait complete. 2023-10-09T11:35:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.656+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f500815e900 con 0x7f500814ab10 2023-10-09T11:35:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.662+0000 7f4ffd7fa700 1 -- 172.21.15.26:0/492740039 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5000057510 con 0x7f500814ab10 2023-10-09T11:35:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.662+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f44005830 con 0x7f5f640ac830 2023-10-09T11:35:32.664 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.663+0000 7f5f60ff9700 1 -- 172.21.15.26:0/1448595824 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f540548e0 con 0x7f5f640ac830 2023-10-09T11:35:32.665 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-10-09T11:35:32.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.665+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 msgr2=0x7f4fec069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.665+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 0x7f4fec069480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f500806a880 tx=0x7f4ff8006c60 comp rx=0 tx=0).stop 2023-10-09T11:35:32.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.665+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 msgr2=0x7f5008149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.665+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5000003000 tx=0x7f5000017000 comp rx=0 tx=0).stop 2023-10-09T11:35:32.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 shutdown_connections 2023-10-09T11:35:32.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500814ab10 0x7f5008149ef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4fec066fd0 0x7f4fec069480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50080b0470 0x7f500814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 --2- 172.21.15.26:0/492740039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f500815b9b0 0x7f50081499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 >> 172.21.15.26:0/492740039 conn(0x7f50080cded0 msgr2=0x7f5008160620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 msgr2=0x7f5f50069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 0x7f5f50069430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007580 tx=0x7f5f5c009780 comp rx=0 tx=0).stop 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 msgr2=0x7f5f64146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 0x7f5f64146a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c4e0 tx=0x7f5f54007ea0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 shutdown_connections 2023-10-09T11:35:32.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2023-10-09T11:35:32.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.666+0000 7f500f82f700 1 -- 172.21.15.26:0/492740039 wait complete. 2023-10-09T11:35:32.671 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2023-10-09T11:35:32.672 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 shutdown_connections 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f640cb8e0 0x7f5f6406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f6406eb00 0x7f5f6414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5f50066f80 0x7f5f50069430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 --2- 172.21.15.26:0/1448595824 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5f640ac830 0x7f5f64146a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 >> 172.21.15.26:0/1448595824 conn(0x7f5f640cc300 msgr2=0x7f5f640ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 shutdown_connections 2023-10-09T11:35:32.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.667+0000 7f5f6ad2e700 1 -- 172.21.15.26:0/1448595824 wait complete. 2023-10-09T11:35:32.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-09T11:35:32.681 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.681+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f266c0af620 con 0x7f266c06bc20 2023-10-09T11:35:32.682 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:32.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.681+0000 7f26627fc700 1 -- 172.21.15.26:0/3542780927 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f266805e7d0 con 0x7f266c06bc20 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 msgr2=0x7f26500693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 0x7f26500693b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2664001390 tx=0x7f2664007de0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 msgr2=0x7f266c152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2668011d60 tx=0x7f2668020000 comp rx=0 tx=0).stop 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 shutdown_connections 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f266c0cb8e0 0x7f266c0ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06bc20 0x7f266c152f80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2650066f00 0x7f26500693b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 --2- 172.21.15.26:0/3542780927 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c06eb00 0x7f266c149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 >> 172.21.15.26:0/3542780927 conn(0x7f266c0cc300 msgr2=0x7f266c14b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 shutdown_connections 2023-10-09T11:35:32.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.683+0000 7f26746ae700 1 -- 172.21.15.26:0/3542780927 wait complete. 2023-10-09T11:35:32.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2023-10-09T11:35:32.687 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-09T11:35:32.698 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.714+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbee8067b20 con 0x7fbee815e2b0 2023-10-09T11:35:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.714+0000 7fbedffff700 1 -- 172.21.15.26:0/312010875 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbee0054e80 con 0x7fbee815e2b0 2023-10-09T11:35:32.716 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 msgr2=0x7fbec8069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 0x7fbec8069500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009740 tx=0x7fbed0006c50 comp rx=0 tx=0).stop 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 msgr2=0x7fbee80a8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 0x7fbee80a8a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007e40 tx=0x7fbee00097b0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 shutdown_connections 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbee815e2b0 0x7fbee80a8a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee806d280 0x7fbee814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbec8067050 0x7fbec8069500 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 --2- 172.21.15.26:0/312010875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbee815dee0 0x7fbee814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 >> 172.21.15.26:0/312010875 conn(0x7fbee806ce80 msgr2=0x7fbee815c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 shutdown_connections 2023-10-09T11:35:32.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.716+0000 7fbeee469700 1 -- 172.21.15.26:0/312010875 wait complete. 2023-10-09T11:35:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.720+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7724005830 con 0x7f77440ca8e0 2023-10-09T11:35:32.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.720+0000 7f7739ffb700 1 -- 172.21.15.26:0/2019943718 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7740054cd0 con 0x7f77440ca8e0 2023-10-09T11:35:32.721 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 msgr2=0x7f773006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 0x7f773006af10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f774404cc40 tx=0x7f7734006c60 comp rx=0 tx=0).stop 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 msgr2=0x7f77440c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f774000e900 tx=0x7f7740006f10 comp rx=0 tx=0).stop 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 shutdown_connections 2023-10-09T11:35:32.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7730068a60 0x7f773006af10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f77440cb670 0x7f7744136600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77300053c0 0x7f77441562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 --2- 172.21.15.26:0/2019943718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77440ca8e0 0x7f77440c9010 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 >> 172.21.15.26:0/2019943718 conn(0x7f77440ccb60 msgr2=0x7f774415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 shutdown_connections 2023-10-09T11:35:32.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.722+0000 7f774c0f1700 1 -- 172.21.15.26:0/2019943718 wait complete. 2023-10-09T11:35:32.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-09T11:35:32.731 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-09T11:35:32.736 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T11:35:32.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:35:32.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.893+0000 7fc3070af700 1 Processor -- start 2023-10-09T11:35:32.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.893+0000 7fc3070af700 1 -- start start 2023-10-09T11:35:32.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc3070af700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 0x7fc3000ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc3070af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3000cf200 0x7fc3000cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc3070af700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30015a280 con 0x7fc3000b0ba0 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc3070af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30006e180 con 0x7fc3000cf200 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc3070af700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3000cd540 con 0x7fc3000b07d0 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc2fffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3000cf200 0x7fc3000cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc2fffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3000cf200 0x7fc3000cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35868/0 (socket says 172.21.15.26:35868) 2023-10-09T11:35:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc2fffff700 1 -- 172.21.15.26:0/2173886372 learned_addr learned my addr 172.21.15.26:0/2173886372 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.894+0000 7fc304e4b700 1 --2- 172.21.15.26:0/2173886372 >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 0x7fc3000ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2fffff700 1 -- 172.21.15.26:0/2173886372 >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 msgr2=0x7fc3000ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2fffff700 1 --2- 172.21.15.26:0/2173886372 >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 0x7fc3000ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2fffff700 1 -- 172.21.15.26:0/2173886372 >> v1:172.21.15.67:6789/0 conn(0x7fc3000b0ba0 legacy=0x7fc30006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2fffff700 1 -- 172.21.15.26:0/2173886372 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30006d850 con 0x7fc3000cf200 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc304e4b700 1 --2- 172.21.15.26:0/2173886372 >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 0x7fc3000ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2fffff700 1 --2- 172.21.15.26:0/2173886372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc3000cd000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc300064720 tx=0x7fc2f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24ca8d164c781e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2ff7fe700 1 -- 172.21.15.26:0/2173886372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400b8b0 con 0x7fc3000cf200 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2ff7fe700 1 -- 172.21.15.26:0/2173886372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400ba10 con 0x7fc3000cf200 2023-10-09T11:35:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc2ff7fe700 1 -- 172.21.15.26:0/2173886372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bdb0 con 0x7fc3000cf200 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 -- 172.21.15.26:0/2173886372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 msgr2=0x7fc3000cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 --2- 172.21.15.26:0/2173886372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc3000cd000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc300064720 tx=0x7fc2f4009250 comp rx=0 tx=0).stop 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 -- 172.21.15.26:0/2173886372 shutdown_connections 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 --2- 172.21.15.26:0/2173886372 >> v2:172.21.15.67:3300/0 conn(0x7fc3000b07d0 0x7fc3000ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 --2- 172.21.15.26:0/2173886372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc3000cd000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 -- 172.21.15.26:0/2173886372 >> 172.21.15.26:0/2173886372 conn(0x7fc30006ce80 msgr2=0x7fc3000ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 -- 172.21.15.26:0/2173886372 shutdown_connections 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.895+0000 7fc3070af700 1 -- 172.21.15.26:0/2173886372 wait complete. 2023-10-09T11:35:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.896+0000 7fc3070af700 1 Processor -- start 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 -- start start 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3000b07d0 0x7fc30009aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 0x7fc30015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300099a60 con 0x7fc3000cf200 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300098e50 con 0x7fc3000b07d0 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.897+0000 7fc3070af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc300099130 con 0x7fc3000b0ba0 2023-10-09T11:35:32.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35880/0 (socket says 172.21.15.26:35880) 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 -- 172.21.15.26:0/4191839437 learned_addr learned my addr 172.21.15.26:0/4191839437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc304e4b700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3000b07d0 0x7fc30009aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc2fffff700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 0x7fc30015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 -- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 msgr2=0x7fc30015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 0x7fc30015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 -- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3000b07d0 msgr2=0x7fc30009aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3000b07d0 0x7fc30009aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 -- 172.21.15.26:0/4191839437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40094f0 con 0x7fc3000cf200 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc2fffff700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 0x7fc30015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:32.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc30564c700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000c5b0 tx=0x7fc2f0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011590 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0011710 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc300099410 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011ad0 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.898+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3001572c0 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.899+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30004c3c0 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.899+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2f001c460 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.900+0000 7fc2fcff9700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.900+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2f0084170 con 0x7fc3000cf200 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.900+0000 7fc304e4b700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:32.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.901+0000 7fc304e4b700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 0x7fc2ec0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8007fd0 tx=0x7fc2f800e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:32.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:32.904+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f00513e0 con 0x7fc3000cf200 2023-10-09T11:35:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.092+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc30006db30 con 0x7fc2ec066f30 2023-10-09T11:35:33.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.101+0000 7fc2fcff9700 1 -- 172.21.15.26:0/4191839437 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7fc30006db30 con 0x7fc2ec066f30 2023-10-09T11:35:33.105 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 msgr2=0x7fc2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 0x7fc2ec0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8007fd0 tx=0x7fc2f800e040 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 msgr2=0x7fc30015de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000c5b0 tx=0x7fc2f0007f60 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 shutdown_connections 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3000cf200 0x7fc30015de90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3000b07d0 0x7fc30009aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 --2- 172.21.15.26:0/4191839437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3000b0ba0 0x7fc30015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 >> 172.21.15.26:0/4191839437 conn(0x7fc30006ce80 msgr2=0x7fc300158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 shutdown_connections 2023-10-09T11:35:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.104+0000 7fc3070af700 1 -- 172.21.15.26:0/4191839437 wait complete. 2023-10-09T11:35:33.110 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:35:33.117 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T11:35:31.105168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381192,"kb_used_data":2888,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593528,"statfs":{"total":773094113280,"available":770655772672,"internally_reserved":0,"allocated":2957312,"data_stored":1778892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.761095"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148676+0000","last_change":"2023-10-09T11:35:24.145841+0000","last_active":"2023-10-09T11:35:24.148676+0000","last_peered":"2023-10-09T11:35:24.148676+0000","last_clean":"2023-10-09T11:35:24.148676+0000","last_became_active":"2023-10-09T11:35:24.145528+0000","last_became_peered":"2023-10-09T11:35:24.145528+0000","last_unstale":"2023-10-09T11:35:24.148676+0000","last_undegraded":"2023-10-09T11:35:24.148676+0000","last_fullsized":"2023-10-09T11:35:24.148676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:40.514361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143745+0000","last_change":"2023-10-09T11:35:24.139730+0000","last_active":"2023-10-09T11:35:24.143745+0000","last_peered":"2023-10-09T11:35:24.143745+0000","last_clean":"2023-10-09T11:35:24.143745+0000","last_became_active":"2023-10-09T11:35:24.139211+0000","last_became_peered":"2023-10-09T11:35:24.139211+0000","last_unstale":"2023-10-09T11:35:24.143745+0000","last_undegraded":"2023-10-09T11:35:24.143745+0000","last_fullsized":"2023-10-09T11:35:24.143745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143202+0000","last_change":"2023-10-09T11:35:24.139500+0000","last_active":"2023-10-09T11:35:24.143202+0000","last_peered":"2023-10-09T11:35:24.143202+0000","last_clean":"2023-10-09T11:35:24.143202+0000","last_became_active":"2023-10-09T11:35:24.139214+0000","last_became_peered":"2023-10-09T11:35:24.139214+0000","last_unstale":"2023-10-09T11:35:24.143202+0000","last_undegraded":"2023-10-09T11:35:24.143202+0000","last_fullsized":"2023-10-09T11:35:24.143202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:02.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151581+0000","last_change":"2023-10-09T11:35:24.148624+0000","last_active":"2023-10-09T11:35:24.151581+0000","last_peered":"2023-10-09T11:35:24.151581+0000","last_clean":"2023-10-09T11:35:24.151581+0000","last_became_active":"2023-10-09T11:35:24.147894+0000","last_became_peered":"2023-10-09T11:35:24.147894+0000","last_unstale":"2023-10-09T11:35:24.151581+0000","last_undegraded":"2023-10-09T11:35:24.151581+0000","last_fullsized":"2023-10-09T11:35:24.151581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146448+0000","last_change":"2023-10-09T11:35:24.141089+0000","last_active":"2023-10-09T11:35:24.146448+0000","last_peered":"2023-10-09T11:35:24.146448+0000","last_clean":"2023-10-09T11:35:24.146448+0000","last_became_active":"2023-10-09T11:35:24.140515+0000","last_became_peered":"2023-10-09T11:35:24.140515+0000","last_unstale":"2023-10-09T11:35:24.146448+0000","last_undegraded":"2023-10-09T11:35:24.146448+0000","last_fullsized":"2023-10-09T11:35:24.146448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153346+0000","last_change":"2023-10-09T11:35:24.149144+0000","last_active":"2023-10-09T11:35:24.153346+0000","last_peered":"2023-10-09T11:35:24.153346+0000","last_clean":"2023-10-09T11:35:24.153346+0000","last_became_active":"2023-10-09T11:35:24.147370+0000","last_became_peered":"2023-10-09T11:35:24.147370+0000","last_unstale":"2023-10-09T11:35:24.153346+0000","last_undegraded":"2023-10-09T11:35:24.153346+0000","last_fullsized":"2023-10-09T11:35:24.153346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145820+0000","last_change":"2023-10-09T11:35:24.139629+0000","last_active":"2023-10-09T11:35:24.145820+0000","last_peered":"2023-10-09T11:35:24.145820+0000","last_clean":"2023-10-09T11:35:24.145820+0000","last_became_active":"2023-10-09T11:35:24.139350+0000","last_became_peered":"2023-10-09T11:35:24.139350+0000","last_unstale":"2023-10-09T11:35:24.145820+0000","last_undegraded":"2023-10-09T11:35:24.145820+0000","last_fullsized":"2023-10-09T11:35:24.145820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152960+0000","last_change":"2023-10-09T11:35:24.152399+0000","last_active":"2023-10-09T11:35:24.152960+0000","last_peered":"2023-10-09T11:35:24.152960+0000","last_clean":"2023-10-09T11:35:24.152960+0000","last_became_active":"2023-10-09T11:35:24.152168+0000","last_became_peered":"2023-10-09T11:35:24.152168+0000","last_unstale":"2023-10-09T11:35:24.152960+0000","last_undegraded":"2023-10-09T11:35:24.152960+0000","last_fullsized":"2023-10-09T11:35:24.152960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152351+0000","last_change":"2023-10-09T11:35:24.150386+0000","last_active":"2023-10-09T11:35:24.152351+0000","last_peered":"2023-10-09T11:35:24.152351+0000","last_clean":"2023-10-09T11:35:24.152351+0000","last_became_active":"2023-10-09T11:35:24.150091+0000","last_became_peered":"2023-10-09T11:35:24.150091+0000","last_unstale":"2023-10-09T11:35:24.152351+0000","last_undegraded":"2023-10-09T11:35:24.152351+0000","last_fullsized":"2023-10-09T11:35:24.152351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149850+0000","last_change":"2023-10-09T11:35:24.148228+0000","last_active":"2023-10-09T11:35:24.149850+0000","last_peered":"2023-10-09T11:35:24.149850+0000","last_clean":"2023-10-09T11:35:24.149850+0000","last_became_active":"2023-10-09T11:35:24.147941+0000","last_became_peered":"2023-10-09T11:35:24.147941+0000","last_unstale":"2023-10-09T11:35:24.149850+0000","last_undegraded":"2023-10-09T11:35:24.149850+0000","last_fullsized":"2023-10-09T11:35:24.149850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152972+0000","last_change":"2023-10-09T11:35:24.152453+0000","last_active":"2023-10-09T11:35:24.152972+0000","last_peered":"2023-10-09T11:35:24.152972+0000","last_clean":"2023-10-09T11:35:24.152972+0000","last_became_active":"2023-10-09T11:35:24.152174+0000","last_became_peered":"2023-10-09T11:35:24.152174+0000","last_unstale":"2023-10-09T11:35:24.152972+0000","last_undegraded":"2023-10-09T11:35:24.152972+0000","last_fullsized":"2023-10-09T11:35:24.152972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145082+0000","last_change":"2023-10-09T11:35:24.138179+0000","last_active":"2023-10-09T11:35:24.145082+0000","last_peered":"2023-10-09T11:35:24.145082+0000","last_clean":"2023-10-09T11:35:24.145082+0000","last_became_active":"2023-10-09T11:35:24.137705+0000","last_became_peered":"2023-10-09T11:35:24.137705+0000","last_unstale":"2023-10-09T11:35:24.145082+0000","last_undegraded":"2023-10-09T11:35:24.145082+0000","last_fullsized":"2023-10-09T11:35:24.145082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140917+0000","last_change":"2023-10-09T11:35:24.137044+0000","last_active":"2023-10-09T11:35:24.140917+0000","last_peered":"2023-10-09T11:35:24.140917+0000","last_clean":"2023-10-09T11:35:24.140917+0000","last_became_active":"2023-10-09T11:35:24.136733+0000","last_became_peered":"2023-10-09T11:35:24.136733+0000","last_unstale":"2023-10-09T11:35:24.140917+0000","last_undegraded":"2023-10-09T11:35:24.140917+0000","last_fullsized":"2023-10-09T11:35:24.140917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143306+0000","last_change":"2023-10-09T11:35:24.138471+0000","last_active":"2023-10-09T11:35:24.143306+0000","last_peered":"2023-10-09T11:35:24.143306+0000","last_clean":"2023-10-09T11:35:24.143306+0000","last_became_active":"2023-10-09T11:35:24.138180+0000","last_became_peered":"2023-10-09T11:35:24.138180+0000","last_unstale":"2023-10-09T11:35:24.143306+0000","last_undegraded":"2023-10-09T11:35:24.143306+0000","last_fullsized":"2023-10-09T11:35:24.143306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138655+0000","last_change":"2023-10-09T11:35:24.135966+0000","last_active":"2023-10-09T11:35:24.138655+0000","last_peered":"2023-10-09T11:35:24.138655+0000","last_clean":"2023-10-09T11:35:24.138655+0000","last_became_active":"2023-10-09T11:35:24.135698+0000","last_became_peered":"2023-10-09T11:35:24.135698+0000","last_unstale":"2023-10-09T11:35:24.138655+0000","last_undegraded":"2023-10-09T11:35:24.138655+0000","last_fullsized":"2023-10-09T11:35:24.138655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151783+0000","last_change":"2023-10-09T11:35:24.149400+0000","last_active":"2023-10-09T11:35:24.151783+0000","last_peered":"2023-10-09T11:35:24.151783+0000","last_clean":"2023-10-09T11:35:24.151783+0000","last_became_active":"2023-10-09T11:35:24.146746+0000","last_became_peered":"2023-10-09T11:35:24.146746+0000","last_unstale":"2023-10-09T11:35:24.151783+0000","last_undegraded":"2023-10-09T11:35:24.151783+0000","last_fullsized":"2023-10-09T11:35:24.151783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153950+0000","last_change":"2023-10-09T11:35:24.151212+0000","last_active":"2023-10-09T11:35:24.153950+0000","last_peered":"2023-10-09T11:35:24.153950+0000","last_clean":"2023-10-09T11:35:24.153950+0000","last_became_active":"2023-10-09T11:35:24.150896+0000","last_became_peered":"2023-10-09T11:35:24.150896+0000","last_unstale":"2023-10-09T11:35:24.153950+0000","last_undegraded":"2023-10-09T11:35:24.153950+0000","last_fullsized":"2023-10-09T11:35:24.153950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141864+0000","last_change":"2023-10-09T11:35:24.140434+0000","last_active":"2023-10-09T11:35:24.141864+0000","last_peered":"2023-10-09T11:35:24.141864+0000","last_clean":"2023-10-09T11:35:24.141864+0000","last_became_active":"2023-10-09T11:35:24.140143+0000","last_became_peered":"2023-10-09T11:35:24.140143+0000","last_unstale":"2023-10-09T11:35:24.141864+0000","last_undegraded":"2023-10-09T11:35:24.141864+0000","last_fullsized":"2023-10-09T11:35:24.141864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145914+0000","last_change":"2023-10-09T11:35:24.139525+0000","last_active":"2023-10-09T11:35:24.145914+0000","last_peered":"2023-10-09T11:35:24.145914+0000","last_clean":"2023-10-09T11:35:24.145914+0000","last_became_active":"2023-10-09T11:35:24.139231+0000","last_became_peered":"2023-10-09T11:35:24.139231+0000","last_unstale":"2023-10-09T11:35:24.145914+0000","last_undegraded":"2023-10-09T11:35:24.145914+0000","last_fullsized":"2023-10-09T11:35:24.145914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356664+0000","last_change":"2023-10-09T11:35:23.362882+0000","last_active":"2023-10-09T11:35:24.356664+0000","last_peered":"2023-10-09T11:35:24.356664+0000","last_clean":"2023-10-09T11:35:24.356664+0000","last_became_active":"2023-10-09T11:35:23.362595+0000","last_became_peered":"2023-10-09T11:35:23.362595+0000","last_unstale":"2023-10-09T11:35:24.356664+0000","last_undegraded":"2023-10-09T11:35:24.356664+0000","last_fullsized":"2023-10-09T11:35:24.356664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141053+0000","last_change":"2023-10-09T11:35:24.137972+0000","last_active":"2023-10-09T11:35:24.141053+0000","last_peered":"2023-10-09T11:35:24.141053+0000","last_clean":"2023-10-09T11:35:24.141053+0000","last_became_active":"2023-10-09T11:35:24.137704+0000","last_became_peered":"2023-10-09T11:35:24.137704+0000","last_unstale":"2023-10-09T11:35:24.141053+0000","last_undegraded":"2023-10-09T11:35:24.141053+0000","last_fullsized":"2023-10-09T11:35:24.141053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.352225+0000","last_change":"2023-10-09T11:35:23.358839+0000","last_active":"2023-10-09T11:35:24.352225+0000","last_peered":"2023-10-09T11:35:24.352225+0000","last_clean":"2023-10-09T11:35:24.352225+0000","last_became_active":"2023-10-09T11:35:23.358555+0000","last_became_peered":"2023-10-09T11:35:23.358555+0000","last_unstale":"2023-10-09T11:35:24.352225+0000","last_undegraded":"2023-10-09T11:35:24.352225+0000","last_fullsized":"2023-10-09T11:35:24.352225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.147342+0000","last_change":"2023-10-09T11:35:24.146933+0000","last_active":"2023-10-09T11:35:24.147342+0000","last_peered":"2023-10-09T11:35:24.147342+0000","last_clean":"2023-10-09T11:35:24.147342+0000","last_became_active":"2023-10-09T11:35:24.146693+0000","last_became_peered":"2023-10-09T11:35:24.146693+0000","last_unstale":"2023-10-09T11:35:24.147342+0000","last_undegraded":"2023-10-09T11:35:24.147342+0000","last_fullsized":"2023-10-09T11:35:24.147342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354056+0000","last_change":"2023-10-09T11:35:23.367495+0000","last_active":"2023-10-09T11:35:24.354056+0000","last_peered":"2023-10-09T11:35:24.354056+0000","last_clean":"2023-10-09T11:35:24.354056+0000","last_became_active":"2023-10-09T11:35:23.367189+0000","last_became_peered":"2023-10-09T11:35:23.367189+0000","last_unstale":"2023-10-09T11:35:24.354056+0000","last_undegraded":"2023-10-09T11:35:24.354056+0000","last_fullsized":"2023-10-09T11:35:24.354056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153981+0000","last_change":"2023-10-09T11:35:24.151258+0000","last_active":"2023-10-09T11:35:24.153981+0000","last_peered":"2023-10-09T11:35:24.153981+0000","last_clean":"2023-10-09T11:35:24.153981+0000","last_became_active":"2023-10-09T11:35:24.150987+0000","last_became_peered":"2023-10-09T11:35:24.150987+0000","last_unstale":"2023-10-09T11:35:24.153981+0000","last_undegraded":"2023-10-09T11:35:24.153981+0000","last_fullsized":"2023-10-09T11:35:24.153981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354452+0000","last_change":"2023-10-09T11:35:23.366425+0000","last_active":"2023-10-09T11:35:24.354452+0000","last_peered":"2023-10-09T11:35:24.354452+0000","last_clean":"2023-10-09T11:35:24.354452+0000","last_became_active":"2023-10-09T11:35:23.366115+0000","last_became_peered":"2023-10-09T11:35:23.366115+0000","last_unstale":"2023-10-09T11:35:24.354452+0000","last_undegraded":"2023-10-09T11:35:24.354452+0000","last_fullsized":"2023-10-09T11:35:24.354452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153731+0000","last_change":"2023-10-09T11:35:24.149747+0000","last_active":"2023-10-09T11:35:24.153731+0000","last_peered":"2023-10-09T11:35:24.153731+0000","last_clean":"2023-10-09T11:35:24.153731+0000","last_became_active":"2023-10-09T11:35:24.149466+0000","last_became_peered":"2023-10-09T11:35:24.149466+0000","last_unstale":"2023-10-09T11:35:24.153731+0000","last_undegraded":"2023-10-09T11:35:24.153731+0000","last_fullsized":"2023-10-09T11:35:24.153731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.352933+0000","last_change":"2023-10-09T11:35:23.364018+0000","last_active":"2023-10-09T11:35:24.352933+0000","last_peered":"2023-10-09T11:35:24.352933+0000","last_clean":"2023-10-09T11:35:24.352933+0000","last_became_active":"2023-10-09T11:35:23.363736+0000","last_became_peered":"2023-10-09T11:35:23.363736+0000","last_unstale":"2023-10-09T11:35:24.352933+0000","last_undegraded":"2023-10-09T11:35:24.352933+0000","last_fullsized":"2023-10-09T11:35:24.352933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144566+0000","last_change":"2023-10-09T11:35:24.138177+0000","last_active":"2023-10-09T11:35:24.144566+0000","last_peered":"2023-10-09T11:35:24.144566+0000","last_clean":"2023-10-09T11:35:24.144566+0000","last_became_active":"2023-10-09T11:35:24.137865+0000","last_became_peered":"2023-10-09T11:35:24.137865+0000","last_unstale":"2023-10-09T11:35:24.144566+0000","last_undegraded":"2023-10-09T11:35:24.144566+0000","last_fullsized":"2023-10-09T11:35:24.144566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:30.412408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349191+0000","last_change":"2023-10-09T11:35:23.357930+0000","last_active":"2023-10-09T11:35:24.349191+0000","last_peered":"2023-10-09T11:35:24.349191+0000","last_clean":"2023-10-09T11:35:24.349191+0000","last_became_active":"2023-10-09T11:35:23.357528+0000","last_became_peered":"2023-10-09T11:35:23.357528+0000","last_unstale":"2023-10-09T11:35:24.349191+0000","last_undegraded":"2023-10-09T11:35:24.349191+0000","last_fullsized":"2023-10-09T11:35:24.349191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146067+0000","last_change":"2023-10-09T11:35:24.145192+0000","last_active":"2023-10-09T11:35:24.146067+0000","last_peered":"2023-10-09T11:35:24.146067+0000","last_clean":"2023-10-09T11:35:24.146067+0000","last_became_active":"2023-10-09T11:35:24.144928+0000","last_became_peered":"2023-10-09T11:35:24.144928+0000","last_unstale":"2023-10-09T11:35:24.146067+0000","last_undegraded":"2023-10-09T11:35:24.146067+0000","last_fullsized":"2023-10-09T11:35:24.146067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128157+0000","last_change":"2023-10-09T11:35:23.362782+0000","last_active":"2023-10-09T11:35:24.128157+0000","last_peered":"2023-10-09T11:35:24.128157+0000","last_clean":"2023-10-09T11:35:24.128157+0000","last_became_active":"2023-10-09T11:35:23.362488+0000","last_became_peered":"2023-10-09T11:35:23.362488+0000","last_unstale":"2023-10-09T11:35:24.128157+0000","last_undegraded":"2023-10-09T11:35:24.128157+0000","last_fullsized":"2023-10-09T11:35:24.128157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141589+0000","last_change":"2023-10-09T11:35:24.140502+0000","last_active":"2023-10-09T11:35:24.141589+0000","last_peered":"2023-10-09T11:35:24.141589+0000","last_clean":"2023-10-09T11:35:24.141589+0000","last_became_active":"2023-10-09T11:35:24.140108+0000","last_became_peered":"2023-10-09T11:35:24.140108+0000","last_unstale":"2023-10-09T11:35:24.141589+0000","last_undegraded":"2023-10-09T11:35:24.141589+0000","last_fullsized":"2023-10-09T11:35:24.141589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144662+0000","last_change":"2023-10-09T11:35:23.356945+0000","last_active":"2023-10-09T11:35:24.144662+0000","last_peered":"2023-10-09T11:35:24.144662+0000","last_clean":"2023-10-09T11:35:24.144662+0000","last_became_active":"2023-10-09T11:35:23.356634+0000","last_became_peered":"2023-10-09T11:35:23.356634+0000","last_unstale":"2023-10-09T11:35:24.144662+0000","last_undegraded":"2023-10-09T11:35:24.144662+0000","last_fullsized":"2023-10-09T11:35:24.144662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142287+0000","last_change":"2023-10-09T11:35:24.137880+0000","last_active":"2023-10-09T11:35:24.142287+0000","last_peered":"2023-10-09T11:35:24.142287+0000","last_clean":"2023-10-09T11:35:24.142287+0000","last_became_active":"2023-10-09T11:35:24.137629+0000","last_became_peered":"2023-10-09T11:35:24.137629+0000","last_unstale":"2023-10-09T11:35:24.142287+0000","last_undegraded":"2023-10-09T11:35:24.142287+0000","last_fullsized":"2023-10-09T11:35:24.142287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.130245+0000","last_change":"2023-10-09T11:35:23.362809+0000","last_active":"2023-10-09T11:35:24.130245+0000","last_peered":"2023-10-09T11:35:24.130245+0000","last_clean":"2023-10-09T11:35:24.130245+0000","last_became_active":"2023-10-09T11:35:23.362496+0000","last_became_peered":"2023-10-09T11:35:23.362496+0000","last_unstale":"2023-10-09T11:35:24.130245+0000","last_undegraded":"2023-10-09T11:35:24.130245+0000","last_fullsized":"2023-10-09T11:35:24.130245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153973+0000","last_change":"2023-10-09T11:35:24.151289+0000","last_active":"2023-10-09T11:35:24.153973+0000","last_peered":"2023-10-09T11:35:24.153973+0000","last_clean":"2023-10-09T11:35:24.153973+0000","last_became_active":"2023-10-09T11:35:24.150977+0000","last_became_peered":"2023-10-09T11:35:24.150977+0000","last_unstale":"2023-10-09T11:35:24.153973+0000","last_undegraded":"2023-10-09T11:35:24.153973+0000","last_fullsized":"2023-10-09T11:35:24.153973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145743+0000","last_change":"2023-10-09T11:35:23.364359+0000","last_active":"2023-10-09T11:35:24.145743+0000","last_peered":"2023-10-09T11:35:24.145743+0000","last_clean":"2023-10-09T11:35:24.145743+0000","last_became_active":"2023-10-09T11:35:23.364054+0000","last_became_peered":"2023-10-09T11:35:23.364054+0000","last_unstale":"2023-10-09T11:35:24.145743+0000","last_undegraded":"2023-10-09T11:35:24.145743+0000","last_fullsized":"2023-10-09T11:35:24.145743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.147362+0000","last_change":"2023-10-09T11:35:24.146931+0000","last_active":"2023-10-09T11:35:24.147362+0000","last_peered":"2023-10-09T11:35:24.147362+0000","last_clean":"2023-10-09T11:35:24.147362+0000","last_became_active":"2023-10-09T11:35:24.146657+0000","last_became_peered":"2023-10-09T11:35:24.146657+0000","last_unstale":"2023-10-09T11:35:24.147362+0000","last_undegraded":"2023-10-09T11:35:24.147362+0000","last_fullsized":"2023-10-09T11:35:24.147362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353815+0000","last_change":"2023-10-09T11:35:23.356704+0000","last_active":"2023-10-09T11:35:24.353815+0000","last_peered":"2023-10-09T11:35:24.353815+0000","last_clean":"2023-10-09T11:35:24.353815+0000","last_became_active":"2023-10-09T11:35:23.356414+0000","last_became_peered":"2023-10-09T11:35:23.356414+0000","last_unstale":"2023-10-09T11:35:24.353815+0000","last_undegraded":"2023-10-09T11:35:24.353815+0000","last_fullsized":"2023-10-09T11:35:24.353815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145391+0000","last_change":"2023-10-09T11:35:24.140247+0000","last_active":"2023-10-09T11:35:24.145391+0000","last_peered":"2023-10-09T11:35:24.145391+0000","last_clean":"2023-10-09T11:35:24.145391+0000","last_became_active":"2023-10-09T11:35:24.139935+0000","last_became_peered":"2023-10-09T11:35:24.139935+0000","last_unstale":"2023-10-09T11:35:24.145391+0000","last_undegraded":"2023-10-09T11:35:24.145391+0000","last_fullsized":"2023-10-09T11:35:24.145391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:29.365580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356605+0000","last_change":"2023-10-09T11:35:23.358506+0000","last_active":"2023-10-09T11:35:24.356605+0000","last_peered":"2023-10-09T11:35:24.356605+0000","last_clean":"2023-10-09T11:35:24.356605+0000","last_became_active":"2023-10-09T11:35:23.358190+0000","last_became_peered":"2023-10-09T11:35:23.358190+0000","last_unstale":"2023-10-09T11:35:24.356605+0000","last_undegraded":"2023-10-09T11:35:24.356605+0000","last_fullsized":"2023-10-09T11:35:24.356605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146454+0000","last_change":"2023-10-09T11:35:24.142761+0000","last_active":"2023-10-09T11:35:24.146454+0000","last_peered":"2023-10-09T11:35:24.146454+0000","last_clean":"2023-10-09T11:35:24.146454+0000","last_became_active":"2023-10-09T11:35:24.142487+0000","last_became_peered":"2023-10-09T11:35:24.142487+0000","last_unstale":"2023-10-09T11:35:24.146454+0000","last_undegraded":"2023-10-09T11:35:24.146454+0000","last_fullsized":"2023-10-09T11:35:24.146454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356449+0000","last_change":"2023-10-09T11:35:23.356502+0000","last_active":"2023-10-09T11:35:24.356449+0000","last_peered":"2023-10-09T11:35:24.356449+0000","last_clean":"2023-10-09T11:35:24.356449+0000","last_became_active":"2023-10-09T11:35:23.356248+0000","last_became_peered":"2023-10-09T11:35:23.356248+0000","last_unstale":"2023-10-09T11:35:24.356449+0000","last_undegraded":"2023-10-09T11:35:24.356449+0000","last_fullsized":"2023-10-09T11:35:24.356449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143324+0000","last_change":"2023-10-09T11:35:24.139623+0000","last_active":"2023-10-09T11:35:24.143324+0000","last_peered":"2023-10-09T11:35:24.143324+0000","last_clean":"2023-10-09T11:35:24.143324+0000","last_became_active":"2023-10-09T11:35:24.139334+0000","last_became_peered":"2023-10-09T11:35:24.139334+0000","last_unstale":"2023-10-09T11:35:24.143324+0000","last_undegraded":"2023-10-09T11:35:24.143324+0000","last_fullsized":"2023-10-09T11:35:24.143324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145593+0000","last_change":"2023-10-09T11:35:23.356511+0000","last_active":"2023-10-09T11:35:24.145593+0000","last_peered":"2023-10-09T11:35:24.145593+0000","last_clean":"2023-10-09T11:35:24.145593+0000","last_became_active":"2023-10-09T11:35:23.356139+0000","last_became_peered":"2023-10-09T11:35:23.356139+0000","last_unstale":"2023-10-09T11:35:24.145593+0000","last_undegraded":"2023-10-09T11:35:24.145593+0000","last_fullsized":"2023-10-09T11:35:24.145593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146469+0000","last_change":"2023-10-09T11:35:24.141301+0000","last_active":"2023-10-09T11:35:24.146469+0000","last_peered":"2023-10-09T11:35:24.146469+0000","last_clean":"2023-10-09T11:35:24.146469+0000","last_became_active":"2023-10-09T11:35:24.140824+0000","last_became_peered":"2023-10-09T11:35:24.140824+0000","last_unstale":"2023-10-09T11:35:24.146469+0000","last_undegraded":"2023-10-09T11:35:24.146469+0000","last_fullsized":"2023-10-09T11:35:24.146469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.129945+0000","last_change":"2023-10-09T11:35:23.362904+0000","last_active":"2023-10-09T11:35:24.129945+0000","last_peered":"2023-10-09T11:35:24.129945+0000","last_clean":"2023-10-09T11:35:24.129945+0000","last_became_active":"2023-10-09T11:35:23.362072+0000","last_became_peered":"2023-10-09T11:35:23.362072+0000","last_unstale":"2023-10-09T11:35:24.129945+0000","last_undegraded":"2023-10-09T11:35:24.129945+0000","last_fullsized":"2023-10-09T11:35:24.129945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145146+0000","last_change":"2023-10-09T11:35:24.139443+0000","last_active":"2023-10-09T11:35:24.145146+0000","last_peered":"2023-10-09T11:35:24.145146+0000","last_clean":"2023-10-09T11:35:24.145146+0000","last_became_active":"2023-10-09T11:35:24.139154+0000","last_became_peered":"2023-10-09T11:35:24.139154+0000","last_unstale":"2023-10-09T11:35:24.145146+0000","last_undegraded":"2023-10-09T11:35:24.145146+0000","last_fullsized":"2023-10-09T11:35:24.145146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353309+0000","last_change":"2023-10-09T11:35:23.354006+0000","last_active":"2023-10-09T11:35:24.353309+0000","last_peered":"2023-10-09T11:35:24.353309+0000","last_clean":"2023-10-09T11:35:24.353309+0000","last_became_active":"2023-10-09T11:35:23.353652+0000","last_became_peered":"2023-10-09T11:35:23.353652+0000","last_unstale":"2023-10-09T11:35:24.353309+0000","last_undegraded":"2023-10-09T11:35:24.353309+0000","last_fullsized":"2023-10-09T11:35:24.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148316+0000","last_change":"2023-10-09T11:35:24.145734+0000","last_active":"2023-10-09T11:35:24.148316+0000","last_peered":"2023-10-09T11:35:24.148316+0000","last_clean":"2023-10-09T11:35:24.148316+0000","last_became_active":"2023-10-09T11:35:24.145428+0000","last_became_peered":"2023-10-09T11:35:24.145428+0000","last_unstale":"2023-10-09T11:35:24.148316+0000","last_undegraded":"2023-10-09T11:35:24.148316+0000","last_fullsized":"2023-10-09T11:35:24.148316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349142+0000","last_change":"2023-10-09T11:35:23.359612+0000","last_active":"2023-10-09T11:35:24.349142+0000","last_peered":"2023-10-09T11:35:24.349142+0000","last_clean":"2023-10-09T11:35:24.349142+0000","last_became_active":"2023-10-09T11:35:23.359281+0000","last_became_peered":"2023-10-09T11:35:23.359281+0000","last_unstale":"2023-10-09T11:35:24.349142+0000","last_undegraded":"2023-10-09T11:35:24.349142+0000","last_fullsized":"2023-10-09T11:35:24.349142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146099+0000","last_change":"2023-10-09T11:35:24.140692+0000","last_active":"2023-10-09T11:35:24.146099+0000","last_peered":"2023-10-09T11:35:24.146099+0000","last_clean":"2023-10-09T11:35:24.146099+0000","last_became_active":"2023-10-09T11:35:24.140410+0000","last_became_peered":"2023-10-09T11:35:24.140410+0000","last_unstale":"2023-10-09T11:35:24.146099+0000","last_undegraded":"2023-10-09T11:35:24.146099+0000","last_fullsized":"2023-10-09T11:35:24.146099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131273+0000","last_change":"2023-10-09T11:35:23.357092+0000","last_active":"2023-10-09T11:35:24.131273+0000","last_peered":"2023-10-09T11:35:24.131273+0000","last_clean":"2023-10-09T11:35:24.131273+0000","last_became_active":"2023-10-09T11:35:23.356770+0000","last_became_peered":"2023-10-09T11:35:23.356770+0000","last_unstale":"2023-10-09T11:35:24.131273+0000","last_undegraded":"2023-10-09T11:35:24.131273+0000","last_fullsized":"2023-10-09T11:35:24.131273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151640+0000","last_change":"2023-10-09T11:35:24.148899+0000","last_active":"2023-10-09T11:35:24.151640+0000","last_peered":"2023-10-09T11:35:24.151640+0000","last_clean":"2023-10-09T11:35:24.151640+0000","last_became_active":"2023-10-09T11:35:24.148606+0000","last_became_peered":"2023-10-09T11:35:24.148606+0000","last_unstale":"2023-10-09T11:35:24.151640+0000","last_undegraded":"2023-10-09T11:35:24.151640+0000","last_fullsized":"2023-10-09T11:35:24.151640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145363+0000","last_change":"2023-10-09T11:35:23.357012+0000","last_active":"2023-10-09T11:35:24.145363+0000","last_peered":"2023-10-09T11:35:24.145363+0000","last_clean":"2023-10-09T11:35:24.145363+0000","last_became_active":"2023-10-09T11:35:23.356520+0000","last_became_peered":"2023-10-09T11:35:23.356520+0000","last_unstale":"2023-10-09T11:35:24.145363+0000","last_undegraded":"2023-10-09T11:35:24.145363+0000","last_fullsized":"2023-10-09T11:35:24.145363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145418+0000","last_change":"2023-10-09T11:35:24.141088+0000","last_active":"2023-10-09T11:35:24.145418+0000","last_peered":"2023-10-09T11:35:24.145418+0000","last_clean":"2023-10-09T11:35:24.145418+0000","last_became_active":"2023-10-09T11:35:24.139862+0000","last_became_peered":"2023-10-09T11:35:24.139862+0000","last_unstale":"2023-10-09T11:35:24.145418+0000","last_undegraded":"2023-10-09T11:35:24.145418+0000","last_fullsized":"2023-10-09T11:35:24.145418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143692+0000","last_change":"2023-10-09T11:35:24.139287+0000","last_active":"2023-10-09T11:35:24.143692+0000","last_peered":"2023-10-09T11:35:24.143692+0000","last_clean":"2023-10-09T11:35:24.143692+0000","last_became_active":"2023-10-09T11:35:24.139008+0000","last_became_peered":"2023-10-09T11:35:24.139008+0000","last_unstale":"2023-10-09T11:35:24.143692+0000","last_undegraded":"2023-10-09T11:35:24.143692+0000","last_fullsized":"2023-10-09T11:35:24.143692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133043+0000","last_change":"2023-10-09T11:35:23.355919+0000","last_active":"2023-10-09T11:35:24.133043+0000","last_peered":"2023-10-09T11:35:24.133043+0000","last_clean":"2023-10-09T11:35:24.133043+0000","last_became_active":"2023-10-09T11:35:23.355614+0000","last_became_peered":"2023-10-09T11:35:23.355614+0000","last_unstale":"2023-10-09T11:35:24.133043+0000","last_undegraded":"2023-10-09T11:35:24.133043+0000","last_fullsized":"2023-10-09T11:35:24.133043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149233+0000","last_change":"2023-10-09T11:35:24.148543+0000","last_active":"2023-10-09T11:35:24.149233+0000","last_peered":"2023-10-09T11:35:24.149233+0000","last_clean":"2023-10-09T11:35:24.149233+0000","last_became_active":"2023-10-09T11:35:24.148262+0000","last_became_peered":"2023-10-09T11:35:24.148262+0000","last_unstale":"2023-10-09T11:35:24.149233+0000","last_undegraded":"2023-10-09T11:35:24.149233+0000","last_fullsized":"2023-10-09T11:35:24.149233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145673+0000","last_change":"2023-10-09T11:35:23.354956+0000","last_active":"2023-10-09T11:35:24.145673+0000","last_peered":"2023-10-09T11:35:24.145673+0000","last_clean":"2023-10-09T11:35:24.145673+0000","last_became_active":"2023-10-09T11:35:23.354649+0000","last_became_peered":"2023-10-09T11:35:23.354649+0000","last_unstale":"2023-10-09T11:35:24.145673+0000","last_undegraded":"2023-10-09T11:35:24.145673+0000","last_fullsized":"2023-10-09T11:35:24.145673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133968+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:35:24.133968+0000","last_peered":"2023-10-09T11:35:24.133968+0000","last_clean":"2023-10-09T11:35:24.133968+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:35:24.133968+0000","last_undegraded":"2023-10-09T11:35:24.133968+0000","last_fullsized":"2023-10-09T11:35:24.133968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143590+0000","last_change":"2023-10-09T11:35:24.142197+0000","last_active":"2023-10-09T11:35:24.143590+0000","last_peered":"2023-10-09T11:35:24.143590+0000","last_clean":"2023-10-09T11:35:24.143590+0000","last_became_active":"2023-10-09T11:35:24.141909+0000","last_became_peered":"2023-10-09T11:35:24.141909+0000","last_unstale":"2023-10-09T11:35:24.143590+0000","last_undegraded":"2023-10-09T11:35:24.143590+0000","last_fullsized":"2023-10-09T11:35:24.143590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:52.262280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134030+0000","last_change":"2023-10-09T11:35:23.363461+0000","last_active":"2023-10-09T11:35:24.134030+0000","last_peered":"2023-10-09T11:35:24.134030+0000","last_clean":"2023-10-09T11:35:24.134030+0000","last_became_active":"2023-10-09T11:35:23.363036+0000","last_became_peered":"2023-10-09T11:35:23.363036+0000","last_unstale":"2023-10-09T11:35:24.134030+0000","last_undegraded":"2023-10-09T11:35:24.134030+0000","last_fullsized":"2023-10-09T11:35:24.134030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134515+0000","last_change":"2023-10-09T11:35:23.363062+0000","last_active":"2023-10-09T11:35:24.134515+0000","last_peered":"2023-10-09T11:35:24.134515+0000","last_clean":"2023-10-09T11:35:24.134515+0000","last_became_active":"2023-10-09T11:35:23.362764+0000","last_became_peered":"2023-10-09T11:35:23.362764+0000","last_unstale":"2023-10-09T11:35:24.134515+0000","last_undegraded":"2023-10-09T11:35:24.134515+0000","last_fullsized":"2023-10-09T11:35:24.134515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142257+0000","last_change":"2023-10-09T11:35:24.138344+0000","last_active":"2023-10-09T11:35:24.142257+0000","last_peered":"2023-10-09T11:35:24.142257+0000","last_clean":"2023-10-09T11:35:24.142257+0000","last_became_active":"2023-10-09T11:35:24.138049+0000","last_became_peered":"2023-10-09T11:35:24.138049+0000","last_unstale":"2023-10-09T11:35:24.142257+0000","last_undegraded":"2023-10-09T11:35:24.142257+0000","last_fullsized":"2023-10-09T11:35:24.142257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:35:25.129253+0000","last_change":"2023-10-09T11:35:23.364933+0000","last_active":"2023-10-09T11:35:25.129253+0000","last_peered":"2023-10-09T11:35:25.129253+0000","last_clean":"2023-10-09T11:35:25.129253+0000","last_became_active":"2023-10-09T11:35:23.364638+0000","last_became_peered":"2023-10-09T11:35:23.364638+0000","last_unstale":"2023-10-09T11:35:25.129253+0000","last_undegraded":"2023-10-09T11:35:25.129253+0000","last_fullsized":"2023-10-09T11:35:25.129253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143022+0000","last_change":"2023-10-09T11:35:24.141685+0000","last_active":"2023-10-09T11:35:24.143022+0000","last_peered":"2023-10-09T11:35:24.143022+0000","last_clean":"2023-10-09T11:35:24.143022+0000","last_became_active":"2023-10-09T11:35:24.141344+0000","last_became_peered":"2023-10-09T11:35:24.141344+0000","last_unstale":"2023-10-09T11:35:24.143022+0000","last_undegraded":"2023-10-09T11:35:24.143022+0000","last_fullsized":"2023-10-09T11:35:24.143022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.350153+0000","last_change":"2023-10-09T11:35:23.365419+0000","last_active":"2023-10-09T11:35:24.350153+0000","last_peered":"2023-10-09T11:35:24.350153+0000","last_clean":"2023-10-09T11:35:24.350153+0000","last_became_active":"2023-10-09T11:35:23.364707+0000","last_became_peered":"2023-10-09T11:35:23.364707+0000","last_unstale":"2023-10-09T11:35:24.350153+0000","last_undegraded":"2023-10-09T11:35:24.350153+0000","last_fullsized":"2023-10-09T11:35:24.350153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143260+0000","last_change":"2023-10-09T11:35:24.138684+0000","last_active":"2023-10-09T11:35:24.143260+0000","last_peered":"2023-10-09T11:35:24.143260+0000","last_clean":"2023-10-09T11:35:24.143260+0000","last_became_active":"2023-10-09T11:35:24.138267+0000","last_became_peered":"2023-10-09T11:35:24.138267+0000","last_unstale":"2023-10-09T11:35:24.143260+0000","last_undegraded":"2023-10-09T11:35:24.143260+0000","last_fullsized":"2023-10-09T11:35:24.143260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:47.119116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133887+0000","last_change":"2023-10-09T11:35:23.363287+0000","last_active":"2023-10-09T11:35:24.133887+0000","last_peered":"2023-10-09T11:35:24.133887+0000","last_clean":"2023-10-09T11:35:24.133887+0000","last_became_active":"2023-10-09T11:35:23.362704+0000","last_became_peered":"2023-10-09T11:35:23.362704+0000","last_unstale":"2023-10-09T11:35:24.133887+0000","last_undegraded":"2023-10-09T11:35:24.133887+0000","last_fullsized":"2023-10-09T11:35:24.133887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144593+0000","last_change":"2023-10-09T11:35:24.137239+0000","last_active":"2023-10-09T11:35:24.144593+0000","last_peered":"2023-10-09T11:35:24.144593+0000","last_clean":"2023-10-09T11:35:24.144593+0000","last_became_active":"2023-10-09T11:35:24.136716+0000","last_became_peered":"2023-10-09T11:35:24.136716+0000","last_unstale":"2023-10-09T11:35:24.144593+0000","last_undegraded":"2023-10-09T11:35:24.144593+0000","last_fullsized":"2023-10-09T11:35:24.144593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:42.856264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131929+0000","last_change":"2023-10-09T11:35:23.362437+0000","last_active":"2023-10-09T11:35:24.131929+0000","last_peered":"2023-10-09T11:35:24.131929+0000","last_clean":"2023-10-09T11:35:24.131929+0000","last_became_active":"2023-10-09T11:35:23.362098+0000","last_became_peered":"2023-10-09T11:35:23.362098+0000","last_unstale":"2023-10-09T11:35:24.131929+0000","last_undegraded":"2023-10-09T11:35:24.131929+0000","last_fullsized":"2023-10-09T11:35:24.131929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140904+0000","last_change":"2023-10-09T11:35:24.136802+0000","last_active":"2023-10-09T11:35:24.140904+0000","last_peered":"2023-10-09T11:35:24.140904+0000","last_clean":"2023-10-09T11:35:24.140904+0000","last_became_active":"2023-10-09T11:35:24.136552+0000","last_became_peered":"2023-10-09T11:35:24.136552+0000","last_unstale":"2023-10-09T11:35:24.140904+0000","last_undegraded":"2023-10-09T11:35:24.140904+0000","last_fullsized":"2023-10-09T11:35:24.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131028+0000","last_change":"2023-10-09T11:35:23.354482+0000","last_active":"2023-10-09T11:35:24.131028+0000","last_peered":"2023-10-09T11:35:24.131028+0000","last_clean":"2023-10-09T11:35:24.131028+0000","last_became_active":"2023-10-09T11:35:23.354145+0000","last_became_peered":"2023-10-09T11:35:23.354145+0000","last_unstale":"2023-10-09T11:35:24.131028+0000","last_undegraded":"2023-10-09T11:35:24.131028+0000","last_fullsized":"2023-10-09T11:35:24.131028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143583+0000","last_change":"2023-10-09T11:35:24.142780+0000","last_active":"2023-10-09T11:35:24.143583+0000","last_peered":"2023-10-09T11:35:24.143583+0000","last_clean":"2023-10-09T11:35:24.143583+0000","last_became_active":"2023-10-09T11:35:24.142495+0000","last_became_peered":"2023-10-09T11:35:24.142495+0000","last_unstale":"2023-10-09T11:35:24.143583+0000","last_undegraded":"2023-10-09T11:35:24.143583+0000","last_fullsized":"2023-10-09T11:35:24.143583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354147+0000","last_change":"2023-10-09T11:35:23.363974+0000","last_active":"2023-10-09T11:35:24.354147+0000","last_peered":"2023-10-09T11:35:24.354147+0000","last_clean":"2023-10-09T11:35:24.354147+0000","last_became_active":"2023-10-09T11:35:23.363542+0000","last_became_peered":"2023-10-09T11:35:23.363542+0000","last_unstale":"2023-10-09T11:35:24.354147+0000","last_undegraded":"2023-10-09T11:35:24.354147+0000","last_fullsized":"2023-10-09T11:35:24.354147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140368+0000","last_change":"2023-10-09T11:35:24.136470+0000","last_active":"2023-10-09T11:35:24.140368+0000","last_peered":"2023-10-09T11:35:24.140368+0000","last_clean":"2023-10-09T11:35:24.140368+0000","last_became_active":"2023-10-09T11:35:24.136165+0000","last_became_peered":"2023-10-09T11:35:24.136165+0000","last_unstale":"2023-10-09T11:35:24.140368+0000","last_undegraded":"2023-10-09T11:35:24.140368+0000","last_fullsized":"2023-10-09T11:35:24.140368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.132920+0000","last_change":"2023-10-09T11:35:23.358941+0000","last_active":"2023-10-09T11:35:24.132920+0000","last_peered":"2023-10-09T11:35:24.132920+0000","last_clean":"2023-10-09T11:35:24.132920+0000","last_became_active":"2023-10-09T11:35:23.358644+0000","last_became_peered":"2023-10-09T11:35:23.358644+0000","last_unstale":"2023-10-09T11:35:24.132920+0000","last_undegraded":"2023-10-09T11:35:24.132920+0000","last_fullsized":"2023-10-09T11:35:24.132920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151207+0000","last_change":"2023-10-09T11:35:24.150106+0000","last_active":"2023-10-09T11:35:24.151207+0000","last_peered":"2023-10-09T11:35:24.151207+0000","last_clean":"2023-10-09T11:35:24.151207+0000","last_became_active":"2023-10-09T11:35:24.149822+0000","last_became_peered":"2023-10-09T11:35:24.149822+0000","last_unstale":"2023-10-09T11:35:24.151207+0000","last_undegraded":"2023-10-09T11:35:24.151207+0000","last_fullsized":"2023-10-09T11:35:24.151207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.351118+0000","last_change":"2023-10-09T11:35:23.355543+0000","last_active":"2023-10-09T11:35:24.351118+0000","last_peered":"2023-10-09T11:35:24.351118+0000","last_clean":"2023-10-09T11:35:24.351118+0000","last_became_active":"2023-10-09T11:35:23.355209+0000","last_became_peered":"2023-10-09T11:35:23.355209+0000","last_unstale":"2023-10-09T11:35:24.351118+0000","last_undegraded":"2023-10-09T11:35:24.351118+0000","last_fullsized":"2023-10-09T11:35:24.351118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151598+0000","last_change":"2023-10-09T11:35:24.148840+0000","last_active":"2023-10-09T11:35:24.151598+0000","last_peered":"2023-10-09T11:35:24.151598+0000","last_clean":"2023-10-09T11:35:24.151598+0000","last_became_active":"2023-10-09T11:35:24.148295+0000","last_became_peered":"2023-10-09T11:35:24.148295+0000","last_unstale":"2023-10-09T11:35:24.151598+0000","last_undegraded":"2023-10-09T11:35:24.151598+0000","last_fullsized":"2023-10-09T11:35:24.151598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353514+0000","last_change":"2023-10-09T11:35:23.356087+0000","last_active":"2023-10-09T11:35:24.353514+0000","last_peered":"2023-10-09T11:35:24.353514+0000","last_clean":"2023-10-09T11:35:24.353514+0000","last_became_active":"2023-10-09T11:35:23.355642+0000","last_became_peered":"2023-10-09T11:35:23.355642+0000","last_unstale":"2023-10-09T11:35:24.353514+0000","last_undegraded":"2023-10-09T11:35:24.353514+0000","last_fullsized":"2023-10-09T11:35:24.353514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.150321+0000","last_change":"2023-10-09T11:35:24.149254+0000","last_active":"2023-10-09T11:35:24.150321+0000","last_peered":"2023-10-09T11:35:24.150321+0000","last_clean":"2023-10-09T11:35:24.150321+0000","last_became_active":"2023-10-09T11:35:24.148931+0000","last_became_peered":"2023-10-09T11:35:24.148931+0000","last_unstale":"2023-10-09T11:35:24.150321+0000","last_undegraded":"2023-10-09T11:35:24.150321+0000","last_fullsized":"2023-10-09T11:35:24.150321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146536+0000","last_change":"2023-10-09T11:35:24.144407+0000","last_active":"2023-10-09T11:35:24.146536+0000","last_peered":"2023-10-09T11:35:24.146536+0000","last_clean":"2023-10-09T11:35:24.146536+0000","last_became_active":"2023-10-09T11:35:24.144120+0000","last_became_peered":"2023-10-09T11:35:24.144120+0000","last_unstale":"2023-10-09T11:35:24.146536+0000","last_undegraded":"2023-10-09T11:35:24.146536+0000","last_fullsized":"2023-10-09T11:35:24.146536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149262+0000","last_change":"2023-10-09T11:35:24.148542+0000","last_active":"2023-10-09T11:35:24.149262+0000","last_peered":"2023-10-09T11:35:24.149262+0000","last_clean":"2023-10-09T11:35:24.149262+0000","last_became_active":"2023-10-09T11:35:24.148205+0000","last_became_peered":"2023-10-09T11:35:24.148205+0000","last_unstale":"2023-10-09T11:35:24.149262+0000","last_undegraded":"2023-10-09T11:35:24.149262+0000","last_fullsized":"2023-10-09T11:35:24.149262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151809+0000","last_change":"2023-10-09T11:35:24.147669+0000","last_active":"2023-10-09T11:35:24.151809+0000","last_peered":"2023-10-09T11:35:24.151809+0000","last_clean":"2023-10-09T11:35:24.151809+0000","last_became_active":"2023-10-09T11:35:24.147088+0000","last_became_peered":"2023-10-09T11:35:24.147088+0000","last_unstale":"2023-10-09T11:35:24.151809+0000","last_undegraded":"2023-10-09T11:35:24.151809+0000","last_fullsized":"2023-10-09T11:35:24.151809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143602+0000","last_change":"2023-10-09T11:35:24.142634+0000","last_active":"2023-10-09T11:35:24.143602+0000","last_peered":"2023-10-09T11:35:24.143602+0000","last_clean":"2023-10-09T11:35:24.143602+0000","last_became_active":"2023-10-09T11:35:24.142365+0000","last_became_peered":"2023-10-09T11:35:24.142365+0000","last_unstale":"2023-10-09T11:35:24.143602+0000","last_undegraded":"2023-10-09T11:35:24.143602+0000","last_fullsized":"2023-10-09T11:35:24.143602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139958+0000","last_change":"2023-10-09T11:35:24.135282+0000","last_active":"2023-10-09T11:35:24.139958+0000","last_peered":"2023-10-09T11:35:24.139958+0000","last_clean":"2023-10-09T11:35:24.139958+0000","last_became_active":"2023-10-09T11:35:24.135029+0000","last_became_peered":"2023-10-09T11:35:24.135029+0000","last_unstale":"2023-10-09T11:35:24.139958+0000","last_undegraded":"2023-10-09T11:35:24.139958+0000","last_fullsized":"2023-10-09T11:35:24.139958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143840+0000","last_change":"2023-10-09T11:35:24.140956+0000","last_active":"2023-10-09T11:35:24.143840+0000","last_peered":"2023-10-09T11:35:24.143840+0000","last_clean":"2023-10-09T11:35:24.143840+0000","last_became_active":"2023-10-09T11:35:24.140678+0000","last_became_peered":"2023-10-09T11:35:24.140678+0000","last_unstale":"2023-10-09T11:35:24.143840+0000","last_undegraded":"2023-10-09T11:35:24.143840+0000","last_fullsized":"2023-10-09T11:35:24.143840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146433+0000","last_change":"2023-10-09T11:35:24.140260+0000","last_active":"2023-10-09T11:35:24.146433+0000","last_peered":"2023-10-09T11:35:24.146433+0000","last_clean":"2023-10-09T11:35:24.146433+0000","last_became_active":"2023-10-09T11:35:24.139938+0000","last_became_peered":"2023-10-09T11:35:24.139938+0000","last_unstale":"2023-10-09T11:35:24.146433+0000","last_undegraded":"2023-10-09T11:35:24.146433+0000","last_fullsized":"2023-10-09T11:35:24.146433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141552+0000","last_change":"2023-10-09T11:35:24.135797+0000","last_active":"2023-10-09T11:35:24.141552+0000","last_peered":"2023-10-09T11:35:24.141552+0000","last_clean":"2023-10-09T11:35:24.141552+0000","last_became_active":"2023-10-09T11:35:24.135530+0000","last_became_peered":"2023-10-09T11:35:24.135530+0000","last_unstale":"2023-10-09T11:35:24.141552+0000","last_undegraded":"2023-10-09T11:35:24.141552+0000","last_fullsized":"2023-10-09T11:35:24.141552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154030+0000","last_change":"2023-10-09T11:35:24.151526+0000","last_active":"2023-10-09T11:35:24.154030+0000","last_peered":"2023-10-09T11:35:24.154030+0000","last_clean":"2023-10-09T11:35:24.154030+0000","last_became_active":"2023-10-09T11:35:24.147333+0000","last_became_peered":"2023-10-09T11:35:24.147333+0000","last_unstale":"2023-10-09T11:35:24.154030+0000","last_undegraded":"2023-10-09T11:35:24.154030+0000","last_fullsized":"2023-10-09T11:35:24.154030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139938+0000","last_change":"2023-10-09T11:35:24.134614+0000","last_active":"2023-10-09T11:35:24.139938+0000","last_peered":"2023-10-09T11:35:24.139938+0000","last_clean":"2023-10-09T11:35:24.139938+0000","last_became_active":"2023-10-09T11:35:24.134362+0000","last_became_peered":"2023-10-09T11:35:24.134362+0000","last_unstale":"2023-10-09T11:35:24.139938+0000","last_undegraded":"2023-10-09T11:35:24.139938+0000","last_fullsized":"2023-10-09T11:35:24.139938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154083+0000","last_change":"2023-10-09T11:35:24.151676+0000","last_active":"2023-10-09T11:35:24.154083+0000","last_peered":"2023-10-09T11:35:24.154083+0000","last_clean":"2023-10-09T11:35:24.154083+0000","last_became_active":"2023-10-09T11:35:24.150853+0000","last_became_peered":"2023-10-09T11:35:24.150853+0000","last_unstale":"2023-10-09T11:35:24.154083+0000","last_undegraded":"2023-10-09T11:35:24.154083+0000","last_fullsized":"2023-10-09T11:35:24.154083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146082+0000","last_change":"2023-10-09T11:35:24.145336+0000","last_active":"2023-10-09T11:35:24.146082+0000","last_peered":"2023-10-09T11:35:24.146082+0000","last_clean":"2023-10-09T11:35:24.146082+0000","last_became_active":"2023-10-09T11:35:24.145009+0000","last_became_peered":"2023-10-09T11:35:24.145009+0000","last_unstale":"2023-10-09T11:35:24.146082+0000","last_undegraded":"2023-10-09T11:35:24.146082+0000","last_fullsized":"2023-10-09T11:35:24.146082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140506+0000","last_change":"2023-10-09T11:35:24.137045+0000","last_active":"2023-10-09T11:35:24.140506+0000","last_peered":"2023-10-09T11:35:24.140506+0000","last_clean":"2023-10-09T11:35:24.140506+0000","last_became_active":"2023-10-09T11:35:24.136734+0000","last_became_peered":"2023-10-09T11:35:24.136734+0000","last_unstale":"2023-10-09T11:35:24.140506+0000","last_undegraded":"2023-10-09T11:35:24.140506+0000","last_fullsized":"2023-10-09T11:35:24.140506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9450000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":74353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":665171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":74319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":74283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:35:33.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:35:33.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.275+0000 7f361a3a2700 1 Processor -- start 2023-10-09T11:35:33.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.275+0000 7f361a3a2700 1 -- start start 2023-10-09T11:35:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361a3a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36140cb5a0 0x7f36140cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361a3a2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f361415a5d0 0x7f3614156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361a3a2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361415ae40 con 0x7f36140cd9e0 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361a3a2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36140d13f0 con 0x7f36140cb5a0 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361a3a2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361415ab60 con 0x7f361415a5d0 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36140cb5a0 0x7f36140cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36140cb5a0 0x7f36140cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35884/0 (socket says 172.21.15.26:35884) 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 -- 172.21.15.26:0/2006232493 learned_addr learned my addr 172.21.15.26:0/2006232493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f361893f700 1 --2- 172.21.15.26:0/2006232493 >> v2:172.21.15.67:3300/0 conn(0x7f361415a5d0 0x7f3614156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 -- 172.21.15.26:0/2006232493 >> v2:172.21.15.67:3300/0 conn(0x7f361415a5d0 msgr2=0x7f3614156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 --2- 172.21.15.26:0/2006232493 >> v2:172.21.15.67:3300/0 conn(0x7f361415a5d0 0x7f3614156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 -- 172.21.15.26:0/2006232493 >> v1:172.21.15.67:6789/0 conn(0x7f36140cd9e0 legacy=0x7f3614159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 -- 172.21.15.26:0/2006232493 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140ccf00 con 0x7f36140cb5a0 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3613fff700 1 --2- 172.21.15.26:0/2006232493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36140cb5a0 0x7f36140cb970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36040099b0 tx=0x7f3604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f8b6336d2ecf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3612ffd700 1 -- 172.21.15.26:0/2006232493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604009ea0 con 0x7f36140cb5a0 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3612ffd700 1 -- 172.21.15.26:0/2006232493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400b820 con 0x7f36140cb5a0 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.276+0000 7f3612ffd700 1 -- 172.21.15.26:0/2006232493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400bbc0 con 0x7f36140cb5a0 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 -- 172.21.15.26:0/2006232493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36140cb5a0 msgr2=0x7f36140cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 --2- 172.21.15.26:0/2006232493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36140cb5a0 0x7f36140cb970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36040099b0 tx=0x7f3604009250 comp rx=0 tx=0).stop 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 -- 172.21.15.26:0/2006232493 shutdown_connections 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 --2- 172.21.15.26:0/2006232493 >> v2:172.21.15.67:3300/0 conn(0x7f361415a5d0 0x7f3614156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 --2- 172.21.15.26:0/2006232493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36140cb5a0 0x7f36140cb970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 -- 172.21.15.26:0/2006232493 >> 172.21.15.26:0/2006232493 conn(0x7f3614070e30 msgr2=0x7f36140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:33.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 -- 172.21.15.26:0/2006232493 shutdown_connections 2023-10-09T11:35:33.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.277+0000 7f361a3a2700 1 -- 172.21.15.26:0/2006232493 wait complete. 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.278+0000 7f361a3a2700 1 Processor -- start 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.278+0000 7f361a3a2700 1 -- start start 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36140cb5a0 0x7f3614156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 0x7f361415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361415d780 con 0x7f361415a5d0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36141566c0 con 0x7f36140cb5a0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361a3a2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361415cb70 con 0x7f36140cd9e0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35892/0 (socket says 172.21.15.26:35892) 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 -- 172.21.15.26:0/3683700087 learned_addr learned my addr 172.21.15.26:0/3683700087 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f3613fff700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36140cb5a0 0x7f3614156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f36137fe700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 0x7f361415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 -- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 msgr2=0x7f361415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 0x7f361415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 -- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36140cb5a0 msgr2=0x7f3614156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36140cb5a0 0x7f3614156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 -- 172.21.15.26:0/3683700087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040094f0 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f36137fe700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 0x7f361415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.279+0000 7f361893f700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f360c009df0 tx=0x7f360c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.280+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00cb50 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.280+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c00f040 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.280+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361415ce50 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.280+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c014480 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.280+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361415d410 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.281+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361404c3c0 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.281+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f360c014830 con 0x7f361415a5d0 2023-10-09T11:35:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.281+0000 7f360bfff700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.282+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f360c084eb0 con 0x7f361415a5d0 2023-10-09T11:35:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.282+0000 7f3613fff700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.282+0000 7f3613fff700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 0x7f35f40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36040099b0 tx=0x7f3604017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.286+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f360c052120 con 0x7f361415a5d0 2023-10-09T11:35:33.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.474+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36140cd1e0 con 0x7f35f4066f30 2023-10-09T11:35:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.483+0000 7f360bfff700 1 -- 172.21.15.26:0/3683700087 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f36140cd1e0 con 0x7f35f4066f30 2023-10-09T11:35:33.487 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 msgr2=0x7f35f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 0x7f35f40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36040099b0 tx=0x7f3604017000 comp rx=0 tx=0).stop 2023-10-09T11:35:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 msgr2=0x7f36140b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f360c009df0 tx=0x7f360c00b040 comp rx=0 tx=0).stop 2023-10-09T11:35:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 shutdown_connections 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f361415a5d0 0x7f36140b4ee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36140cb5a0 0x7f3614156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 --2- 172.21.15.26:0/3683700087 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36140cd9e0 0x7f361415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 >> 172.21.15.26:0/3683700087 conn(0x7f3614070e30 msgr2=0x7f36140c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 shutdown_connections 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.486+0000 7f361a3a2700 1 -- 172.21.15.26:0/3683700087 wait complete. 2023-10-09T11:35:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:35:33.499 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-09T11:35:33.105790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381192,"kb_used_data":2888,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593528,"statfs":{"total":773094113280,"available":770655772672,"internally_reserved":0,"allocated":2957312,"data_stored":1778892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.978475"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148676+0000","last_change":"2023-10-09T11:35:24.145841+0000","last_active":"2023-10-09T11:35:24.148676+0000","last_peered":"2023-10-09T11:35:24.148676+0000","last_clean":"2023-10-09T11:35:24.148676+0000","last_became_active":"2023-10-09T11:35:24.145528+0000","last_became_peered":"2023-10-09T11:35:24.145528+0000","last_unstale":"2023-10-09T11:35:24.148676+0000","last_undegraded":"2023-10-09T11:35:24.148676+0000","last_fullsized":"2023-10-09T11:35:24.148676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:40.514361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143745+0000","last_change":"2023-10-09T11:35:24.139730+0000","last_active":"2023-10-09T11:35:24.143745+0000","last_peered":"2023-10-09T11:35:24.143745+0000","last_clean":"2023-10-09T11:35:24.143745+0000","last_became_active":"2023-10-09T11:35:24.139211+0000","last_became_peered":"2023-10-09T11:35:24.139211+0000","last_unstale":"2023-10-09T11:35:24.143745+0000","last_undegraded":"2023-10-09T11:35:24.143745+0000","last_fullsized":"2023-10-09T11:35:24.143745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143202+0000","last_change":"2023-10-09T11:35:24.139500+0000","last_active":"2023-10-09T11:35:24.143202+0000","last_peered":"2023-10-09T11:35:24.143202+0000","last_clean":"2023-10-09T11:35:24.143202+0000","last_became_active":"2023-10-09T11:35:24.139214+0000","last_became_peered":"2023-10-09T11:35:24.139214+0000","last_unstale":"2023-10-09T11:35:24.143202+0000","last_undegraded":"2023-10-09T11:35:24.143202+0000","last_fullsized":"2023-10-09T11:35:24.143202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:02.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151581+0000","last_change":"2023-10-09T11:35:24.148624+0000","last_active":"2023-10-09T11:35:24.151581+0000","last_peered":"2023-10-09T11:35:24.151581+0000","last_clean":"2023-10-09T11:35:24.151581+0000","last_became_active":"2023-10-09T11:35:24.147894+0000","last_became_peered":"2023-10-09T11:35:24.147894+0000","last_unstale":"2023-10-09T11:35:24.151581+0000","last_undegraded":"2023-10-09T11:35:24.151581+0000","last_fullsized":"2023-10-09T11:35:24.151581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146448+0000","last_change":"2023-10-09T11:35:24.141089+0000","last_active":"2023-10-09T11:35:24.146448+0000","last_peered":"2023-10-09T11:35:24.146448+0000","last_clean":"2023-10-09T11:35:24.146448+0000","last_became_active":"2023-10-09T11:35:24.140515+0000","last_became_peered":"2023-10-09T11:35:24.140515+0000","last_unstale":"2023-10-09T11:35:24.146448+0000","last_undegraded":"2023-10-09T11:35:24.146448+0000","last_fullsized":"2023-10-09T11:35:24.146448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153346+0000","last_change":"2023-10-09T11:35:24.149144+0000","last_active":"2023-10-09T11:35:24.153346+0000","last_peered":"2023-10-09T11:35:24.153346+0000","last_clean":"2023-10-09T11:35:24.153346+0000","last_became_active":"2023-10-09T11:35:24.147370+0000","last_became_peered":"2023-10-09T11:35:24.147370+0000","last_unstale":"2023-10-09T11:35:24.153346+0000","last_undegraded":"2023-10-09T11:35:24.153346+0000","last_fullsized":"2023-10-09T11:35:24.153346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145820+0000","last_change":"2023-10-09T11:35:24.139629+0000","last_active":"2023-10-09T11:35:24.145820+0000","last_peered":"2023-10-09T11:35:24.145820+0000","last_clean":"2023-10-09T11:35:24.145820+0000","last_became_active":"2023-10-09T11:35:24.139350+0000","last_became_peered":"2023-10-09T11:35:24.139350+0000","last_unstale":"2023-10-09T11:35:24.145820+0000","last_undegraded":"2023-10-09T11:35:24.145820+0000","last_fullsized":"2023-10-09T11:35:24.145820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152960+0000","last_change":"2023-10-09T11:35:24.152399+0000","last_active":"2023-10-09T11:35:24.152960+0000","last_peered":"2023-10-09T11:35:24.152960+0000","last_clean":"2023-10-09T11:35:24.152960+0000","last_became_active":"2023-10-09T11:35:24.152168+0000","last_became_peered":"2023-10-09T11:35:24.152168+0000","last_unstale":"2023-10-09T11:35:24.152960+0000","last_undegraded":"2023-10-09T11:35:24.152960+0000","last_fullsized":"2023-10-09T11:35:24.152960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152351+0000","last_change":"2023-10-09T11:35:24.150386+0000","last_active":"2023-10-09T11:35:24.152351+0000","last_peered":"2023-10-09T11:35:24.152351+0000","last_clean":"2023-10-09T11:35:24.152351+0000","last_became_active":"2023-10-09T11:35:24.150091+0000","last_became_peered":"2023-10-09T11:35:24.150091+0000","last_unstale":"2023-10-09T11:35:24.152351+0000","last_undegraded":"2023-10-09T11:35:24.152351+0000","last_fullsized":"2023-10-09T11:35:24.152351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149850+0000","last_change":"2023-10-09T11:35:24.148228+0000","last_active":"2023-10-09T11:35:24.149850+0000","last_peered":"2023-10-09T11:35:24.149850+0000","last_clean":"2023-10-09T11:35:24.149850+0000","last_became_active":"2023-10-09T11:35:24.147941+0000","last_became_peered":"2023-10-09T11:35:24.147941+0000","last_unstale":"2023-10-09T11:35:24.149850+0000","last_undegraded":"2023-10-09T11:35:24.149850+0000","last_fullsized":"2023-10-09T11:35:24.149850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.152972+0000","last_change":"2023-10-09T11:35:24.152453+0000","last_active":"2023-10-09T11:35:24.152972+0000","last_peered":"2023-10-09T11:35:24.152972+0000","last_clean":"2023-10-09T11:35:24.152972+0000","last_became_active":"2023-10-09T11:35:24.152174+0000","last_became_peered":"2023-10-09T11:35:24.152174+0000","last_unstale":"2023-10-09T11:35:24.152972+0000","last_undegraded":"2023-10-09T11:35:24.152972+0000","last_fullsized":"2023-10-09T11:35:24.152972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145082+0000","last_change":"2023-10-09T11:35:24.138179+0000","last_active":"2023-10-09T11:35:24.145082+0000","last_peered":"2023-10-09T11:35:24.145082+0000","last_clean":"2023-10-09T11:35:24.145082+0000","last_became_active":"2023-10-09T11:35:24.137705+0000","last_became_peered":"2023-10-09T11:35:24.137705+0000","last_unstale":"2023-10-09T11:35:24.145082+0000","last_undegraded":"2023-10-09T11:35:24.145082+0000","last_fullsized":"2023-10-09T11:35:24.145082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140917+0000","last_change":"2023-10-09T11:35:24.137044+0000","last_active":"2023-10-09T11:35:24.140917+0000","last_peered":"2023-10-09T11:35:24.140917+0000","last_clean":"2023-10-09T11:35:24.140917+0000","last_became_active":"2023-10-09T11:35:24.136733+0000","last_became_peered":"2023-10-09T11:35:24.136733+0000","last_unstale":"2023-10-09T11:35:24.140917+0000","last_undegraded":"2023-10-09T11:35:24.140917+0000","last_fullsized":"2023-10-09T11:35:24.140917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143306+0000","last_change":"2023-10-09T11:35:24.138471+0000","last_active":"2023-10-09T11:35:24.143306+0000","last_peered":"2023-10-09T11:35:24.143306+0000","last_clean":"2023-10-09T11:35:24.143306+0000","last_became_active":"2023-10-09T11:35:24.138180+0000","last_became_peered":"2023-10-09T11:35:24.138180+0000","last_unstale":"2023-10-09T11:35:24.143306+0000","last_undegraded":"2023-10-09T11:35:24.143306+0000","last_fullsized":"2023-10-09T11:35:24.143306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.138655+0000","last_change":"2023-10-09T11:35:24.135966+0000","last_active":"2023-10-09T11:35:24.138655+0000","last_peered":"2023-10-09T11:35:24.138655+0000","last_clean":"2023-10-09T11:35:24.138655+0000","last_became_active":"2023-10-09T11:35:24.135698+0000","last_became_peered":"2023-10-09T11:35:24.135698+0000","last_unstale":"2023-10-09T11:35:24.138655+0000","last_undegraded":"2023-10-09T11:35:24.138655+0000","last_fullsized":"2023-10-09T11:35:24.138655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151783+0000","last_change":"2023-10-09T11:35:24.149400+0000","last_active":"2023-10-09T11:35:24.151783+0000","last_peered":"2023-10-09T11:35:24.151783+0000","last_clean":"2023-10-09T11:35:24.151783+0000","last_became_active":"2023-10-09T11:35:24.146746+0000","last_became_peered":"2023-10-09T11:35:24.146746+0000","last_unstale":"2023-10-09T11:35:24.151783+0000","last_undegraded":"2023-10-09T11:35:24.151783+0000","last_fullsized":"2023-10-09T11:35:24.151783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153950+0000","last_change":"2023-10-09T11:35:24.151212+0000","last_active":"2023-10-09T11:35:24.153950+0000","last_peered":"2023-10-09T11:35:24.153950+0000","last_clean":"2023-10-09T11:35:24.153950+0000","last_became_active":"2023-10-09T11:35:24.150896+0000","last_became_peered":"2023-10-09T11:35:24.150896+0000","last_unstale":"2023-10-09T11:35:24.153950+0000","last_undegraded":"2023-10-09T11:35:24.153950+0000","last_fullsized":"2023-10-09T11:35:24.153950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:19.755675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141864+0000","last_change":"2023-10-09T11:35:24.140434+0000","last_active":"2023-10-09T11:35:24.141864+0000","last_peered":"2023-10-09T11:35:24.141864+0000","last_clean":"2023-10-09T11:35:24.141864+0000","last_became_active":"2023-10-09T11:35:24.140143+0000","last_became_peered":"2023-10-09T11:35:24.140143+0000","last_unstale":"2023-10-09T11:35:24.141864+0000","last_undegraded":"2023-10-09T11:35:24.141864+0000","last_fullsized":"2023-10-09T11:35:24.141864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145914+0000","last_change":"2023-10-09T11:35:24.139525+0000","last_active":"2023-10-09T11:35:24.145914+0000","last_peered":"2023-10-09T11:35:24.145914+0000","last_clean":"2023-10-09T11:35:24.145914+0000","last_became_active":"2023-10-09T11:35:24.139231+0000","last_became_peered":"2023-10-09T11:35:24.139231+0000","last_unstale":"2023-10-09T11:35:24.145914+0000","last_undegraded":"2023-10-09T11:35:24.145914+0000","last_fullsized":"2023-10-09T11:35:24.145914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356664+0000","last_change":"2023-10-09T11:35:23.362882+0000","last_active":"2023-10-09T11:35:24.356664+0000","last_peered":"2023-10-09T11:35:24.356664+0000","last_clean":"2023-10-09T11:35:24.356664+0000","last_became_active":"2023-10-09T11:35:23.362595+0000","last_became_peered":"2023-10-09T11:35:23.362595+0000","last_unstale":"2023-10-09T11:35:24.356664+0000","last_undegraded":"2023-10-09T11:35:24.356664+0000","last_fullsized":"2023-10-09T11:35:24.356664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141053+0000","last_change":"2023-10-09T11:35:24.137972+0000","last_active":"2023-10-09T11:35:24.141053+0000","last_peered":"2023-10-09T11:35:24.141053+0000","last_clean":"2023-10-09T11:35:24.141053+0000","last_became_active":"2023-10-09T11:35:24.137704+0000","last_became_peered":"2023-10-09T11:35:24.137704+0000","last_unstale":"2023-10-09T11:35:24.141053+0000","last_undegraded":"2023-10-09T11:35:24.141053+0000","last_fullsized":"2023-10-09T11:35:24.141053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.352225+0000","last_change":"2023-10-09T11:35:23.358839+0000","last_active":"2023-10-09T11:35:24.352225+0000","last_peered":"2023-10-09T11:35:24.352225+0000","last_clean":"2023-10-09T11:35:24.352225+0000","last_became_active":"2023-10-09T11:35:23.358555+0000","last_became_peered":"2023-10-09T11:35:23.358555+0000","last_unstale":"2023-10-09T11:35:24.352225+0000","last_undegraded":"2023-10-09T11:35:24.352225+0000","last_fullsized":"2023-10-09T11:35:24.352225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.147342+0000","last_change":"2023-10-09T11:35:24.146933+0000","last_active":"2023-10-09T11:35:24.147342+0000","last_peered":"2023-10-09T11:35:24.147342+0000","last_clean":"2023-10-09T11:35:24.147342+0000","last_became_active":"2023-10-09T11:35:24.146693+0000","last_became_peered":"2023-10-09T11:35:24.146693+0000","last_unstale":"2023-10-09T11:35:24.147342+0000","last_undegraded":"2023-10-09T11:35:24.147342+0000","last_fullsized":"2023-10-09T11:35:24.147342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354056+0000","last_change":"2023-10-09T11:35:23.367495+0000","last_active":"2023-10-09T11:35:24.354056+0000","last_peered":"2023-10-09T11:35:24.354056+0000","last_clean":"2023-10-09T11:35:24.354056+0000","last_became_active":"2023-10-09T11:35:23.367189+0000","last_became_peered":"2023-10-09T11:35:23.367189+0000","last_unstale":"2023-10-09T11:35:24.354056+0000","last_undegraded":"2023-10-09T11:35:24.354056+0000","last_fullsized":"2023-10-09T11:35:24.354056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153981+0000","last_change":"2023-10-09T11:35:24.151258+0000","last_active":"2023-10-09T11:35:24.153981+0000","last_peered":"2023-10-09T11:35:24.153981+0000","last_clean":"2023-10-09T11:35:24.153981+0000","last_became_active":"2023-10-09T11:35:24.150987+0000","last_became_peered":"2023-10-09T11:35:24.150987+0000","last_unstale":"2023-10-09T11:35:24.153981+0000","last_undegraded":"2023-10-09T11:35:24.153981+0000","last_fullsized":"2023-10-09T11:35:24.153981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354452+0000","last_change":"2023-10-09T11:35:23.366425+0000","last_active":"2023-10-09T11:35:24.354452+0000","last_peered":"2023-10-09T11:35:24.354452+0000","last_clean":"2023-10-09T11:35:24.354452+0000","last_became_active":"2023-10-09T11:35:23.366115+0000","last_became_peered":"2023-10-09T11:35:23.366115+0000","last_unstale":"2023-10-09T11:35:24.354452+0000","last_undegraded":"2023-10-09T11:35:24.354452+0000","last_fullsized":"2023-10-09T11:35:24.354452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153731+0000","last_change":"2023-10-09T11:35:24.149747+0000","last_active":"2023-10-09T11:35:24.153731+0000","last_peered":"2023-10-09T11:35:24.153731+0000","last_clean":"2023-10-09T11:35:24.153731+0000","last_became_active":"2023-10-09T11:35:24.149466+0000","last_became_peered":"2023-10-09T11:35:24.149466+0000","last_unstale":"2023-10-09T11:35:24.153731+0000","last_undegraded":"2023-10-09T11:35:24.153731+0000","last_fullsized":"2023-10-09T11:35:24.153731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.352933+0000","last_change":"2023-10-09T11:35:23.364018+0000","last_active":"2023-10-09T11:35:24.352933+0000","last_peered":"2023-10-09T11:35:24.352933+0000","last_clean":"2023-10-09T11:35:24.352933+0000","last_became_active":"2023-10-09T11:35:23.363736+0000","last_became_peered":"2023-10-09T11:35:23.363736+0000","last_unstale":"2023-10-09T11:35:24.352933+0000","last_undegraded":"2023-10-09T11:35:24.352933+0000","last_fullsized":"2023-10-09T11:35:24.352933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144566+0000","last_change":"2023-10-09T11:35:24.138177+0000","last_active":"2023-10-09T11:35:24.144566+0000","last_peered":"2023-10-09T11:35:24.144566+0000","last_clean":"2023-10-09T11:35:24.144566+0000","last_became_active":"2023-10-09T11:35:24.137865+0000","last_became_peered":"2023-10-09T11:35:24.137865+0000","last_unstale":"2023-10-09T11:35:24.144566+0000","last_undegraded":"2023-10-09T11:35:24.144566+0000","last_fullsized":"2023-10-09T11:35:24.144566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:30.412408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349191+0000","last_change":"2023-10-09T11:35:23.357930+0000","last_active":"2023-10-09T11:35:24.349191+0000","last_peered":"2023-10-09T11:35:24.349191+0000","last_clean":"2023-10-09T11:35:24.349191+0000","last_became_active":"2023-10-09T11:35:23.357528+0000","last_became_peered":"2023-10-09T11:35:23.357528+0000","last_unstale":"2023-10-09T11:35:24.349191+0000","last_undegraded":"2023-10-09T11:35:24.349191+0000","last_fullsized":"2023-10-09T11:35:24.349191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146067+0000","last_change":"2023-10-09T11:35:24.145192+0000","last_active":"2023-10-09T11:35:24.146067+0000","last_peered":"2023-10-09T11:35:24.146067+0000","last_clean":"2023-10-09T11:35:24.146067+0000","last_became_active":"2023-10-09T11:35:24.144928+0000","last_became_peered":"2023-10-09T11:35:24.144928+0000","last_unstale":"2023-10-09T11:35:24.146067+0000","last_undegraded":"2023-10-09T11:35:24.146067+0000","last_fullsized":"2023-10-09T11:35:24.146067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.128157+0000","last_change":"2023-10-09T11:35:23.362782+0000","last_active":"2023-10-09T11:35:24.128157+0000","last_peered":"2023-10-09T11:35:24.128157+0000","last_clean":"2023-10-09T11:35:24.128157+0000","last_became_active":"2023-10-09T11:35:23.362488+0000","last_became_peered":"2023-10-09T11:35:23.362488+0000","last_unstale":"2023-10-09T11:35:24.128157+0000","last_undegraded":"2023-10-09T11:35:24.128157+0000","last_fullsized":"2023-10-09T11:35:24.128157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:50.285919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141589+0000","last_change":"2023-10-09T11:35:24.140502+0000","last_active":"2023-10-09T11:35:24.141589+0000","last_peered":"2023-10-09T11:35:24.141589+0000","last_clean":"2023-10-09T11:35:24.141589+0000","last_became_active":"2023-10-09T11:35:24.140108+0000","last_became_peered":"2023-10-09T11:35:24.140108+0000","last_unstale":"2023-10-09T11:35:24.141589+0000","last_undegraded":"2023-10-09T11:35:24.141589+0000","last_fullsized":"2023-10-09T11:35:24.141589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144662+0000","last_change":"2023-10-09T11:35:23.356945+0000","last_active":"2023-10-09T11:35:24.144662+0000","last_peered":"2023-10-09T11:35:24.144662+0000","last_clean":"2023-10-09T11:35:24.144662+0000","last_became_active":"2023-10-09T11:35:23.356634+0000","last_became_peered":"2023-10-09T11:35:23.356634+0000","last_unstale":"2023-10-09T11:35:24.144662+0000","last_undegraded":"2023-10-09T11:35:24.144662+0000","last_fullsized":"2023-10-09T11:35:24.144662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142287+0000","last_change":"2023-10-09T11:35:24.137880+0000","last_active":"2023-10-09T11:35:24.142287+0000","last_peered":"2023-10-09T11:35:24.142287+0000","last_clean":"2023-10-09T11:35:24.142287+0000","last_became_active":"2023-10-09T11:35:24.137629+0000","last_became_peered":"2023-10-09T11:35:24.137629+0000","last_unstale":"2023-10-09T11:35:24.142287+0000","last_undegraded":"2023-10-09T11:35:24.142287+0000","last_fullsized":"2023-10-09T11:35:24.142287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.130245+0000","last_change":"2023-10-09T11:35:23.362809+0000","last_active":"2023-10-09T11:35:24.130245+0000","last_peered":"2023-10-09T11:35:24.130245+0000","last_clean":"2023-10-09T11:35:24.130245+0000","last_became_active":"2023-10-09T11:35:23.362496+0000","last_became_peered":"2023-10-09T11:35:23.362496+0000","last_unstale":"2023-10-09T11:35:24.130245+0000","last_undegraded":"2023-10-09T11:35:24.130245+0000","last_fullsized":"2023-10-09T11:35:24.130245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.153973+0000","last_change":"2023-10-09T11:35:24.151289+0000","last_active":"2023-10-09T11:35:24.153973+0000","last_peered":"2023-10-09T11:35:24.153973+0000","last_clean":"2023-10-09T11:35:24.153973+0000","last_became_active":"2023-10-09T11:35:24.150977+0000","last_became_peered":"2023-10-09T11:35:24.150977+0000","last_unstale":"2023-10-09T11:35:24.153973+0000","last_undegraded":"2023-10-09T11:35:24.153973+0000","last_fullsized":"2023-10-09T11:35:24.153973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:09.546901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145743+0000","last_change":"2023-10-09T11:35:23.364359+0000","last_active":"2023-10-09T11:35:24.145743+0000","last_peered":"2023-10-09T11:35:24.145743+0000","last_clean":"2023-10-09T11:35:24.145743+0000","last_became_active":"2023-10-09T11:35:23.364054+0000","last_became_peered":"2023-10-09T11:35:23.364054+0000","last_unstale":"2023-10-09T11:35:24.145743+0000","last_undegraded":"2023-10-09T11:35:24.145743+0000","last_fullsized":"2023-10-09T11:35:24.145743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.147362+0000","last_change":"2023-10-09T11:35:24.146931+0000","last_active":"2023-10-09T11:35:24.147362+0000","last_peered":"2023-10-09T11:35:24.147362+0000","last_clean":"2023-10-09T11:35:24.147362+0000","last_became_active":"2023-10-09T11:35:24.146657+0000","last_became_peered":"2023-10-09T11:35:24.146657+0000","last_unstale":"2023-10-09T11:35:24.147362+0000","last_undegraded":"2023-10-09T11:35:24.147362+0000","last_fullsized":"2023-10-09T11:35:24.147362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353815+0000","last_change":"2023-10-09T11:35:23.356704+0000","last_active":"2023-10-09T11:35:24.353815+0000","last_peered":"2023-10-09T11:35:24.353815+0000","last_clean":"2023-10-09T11:35:24.353815+0000","last_became_active":"2023-10-09T11:35:23.356414+0000","last_became_peered":"2023-10-09T11:35:23.356414+0000","last_unstale":"2023-10-09T11:35:24.353815+0000","last_undegraded":"2023-10-09T11:35:24.353815+0000","last_fullsized":"2023-10-09T11:35:24.353815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145391+0000","last_change":"2023-10-09T11:35:24.140247+0000","last_active":"2023-10-09T11:35:24.145391+0000","last_peered":"2023-10-09T11:35:24.145391+0000","last_clean":"2023-10-09T11:35:24.145391+0000","last_became_active":"2023-10-09T11:35:24.139935+0000","last_became_peered":"2023-10-09T11:35:24.139935+0000","last_unstale":"2023-10-09T11:35:24.145391+0000","last_undegraded":"2023-10-09T11:35:24.145391+0000","last_fullsized":"2023-10-09T11:35:24.145391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:29.365580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356605+0000","last_change":"2023-10-09T11:35:23.358506+0000","last_active":"2023-10-09T11:35:24.356605+0000","last_peered":"2023-10-09T11:35:24.356605+0000","last_clean":"2023-10-09T11:35:24.356605+0000","last_became_active":"2023-10-09T11:35:23.358190+0000","last_became_peered":"2023-10-09T11:35:23.358190+0000","last_unstale":"2023-10-09T11:35:24.356605+0000","last_undegraded":"2023-10-09T11:35:24.356605+0000","last_fullsized":"2023-10-09T11:35:24.356605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:45.630997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146454+0000","last_change":"2023-10-09T11:35:24.142761+0000","last_active":"2023-10-09T11:35:24.146454+0000","last_peered":"2023-10-09T11:35:24.146454+0000","last_clean":"2023-10-09T11:35:24.146454+0000","last_became_active":"2023-10-09T11:35:24.142487+0000","last_became_peered":"2023-10-09T11:35:24.142487+0000","last_unstale":"2023-10-09T11:35:24.146454+0000","last_undegraded":"2023-10-09T11:35:24.146454+0000","last_fullsized":"2023-10-09T11:35:24.146454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.356449+0000","last_change":"2023-10-09T11:35:23.356502+0000","last_active":"2023-10-09T11:35:24.356449+0000","last_peered":"2023-10-09T11:35:24.356449+0000","last_clean":"2023-10-09T11:35:24.356449+0000","last_became_active":"2023-10-09T11:35:23.356248+0000","last_became_peered":"2023-10-09T11:35:23.356248+0000","last_unstale":"2023-10-09T11:35:24.356449+0000","last_undegraded":"2023-10-09T11:35:24.356449+0000","last_fullsized":"2023-10-09T11:35:24.356449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143324+0000","last_change":"2023-10-09T11:35:24.139623+0000","last_active":"2023-10-09T11:35:24.143324+0000","last_peered":"2023-10-09T11:35:24.143324+0000","last_clean":"2023-10-09T11:35:24.143324+0000","last_became_active":"2023-10-09T11:35:24.139334+0000","last_became_peered":"2023-10-09T11:35:24.139334+0000","last_unstale":"2023-10-09T11:35:24.143324+0000","last_undegraded":"2023-10-09T11:35:24.143324+0000","last_fullsized":"2023-10-09T11:35:24.143324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145593+0000","last_change":"2023-10-09T11:35:23.356511+0000","last_active":"2023-10-09T11:35:24.145593+0000","last_peered":"2023-10-09T11:35:24.145593+0000","last_clean":"2023-10-09T11:35:24.145593+0000","last_became_active":"2023-10-09T11:35:23.356139+0000","last_became_peered":"2023-10-09T11:35:23.356139+0000","last_unstale":"2023-10-09T11:35:24.145593+0000","last_undegraded":"2023-10-09T11:35:24.145593+0000","last_fullsized":"2023-10-09T11:35:24.145593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146469+0000","last_change":"2023-10-09T11:35:24.141301+0000","last_active":"2023-10-09T11:35:24.146469+0000","last_peered":"2023-10-09T11:35:24.146469+0000","last_clean":"2023-10-09T11:35:24.146469+0000","last_became_active":"2023-10-09T11:35:24.140824+0000","last_became_peered":"2023-10-09T11:35:24.140824+0000","last_unstale":"2023-10-09T11:35:24.146469+0000","last_undegraded":"2023-10-09T11:35:24.146469+0000","last_fullsized":"2023-10-09T11:35:24.146469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:02.064330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.129945+0000","last_change":"2023-10-09T11:35:23.362904+0000","last_active":"2023-10-09T11:35:24.129945+0000","last_peered":"2023-10-09T11:35:24.129945+0000","last_clean":"2023-10-09T11:35:24.129945+0000","last_became_active":"2023-10-09T11:35:23.362072+0000","last_became_peered":"2023-10-09T11:35:23.362072+0000","last_unstale":"2023-10-09T11:35:24.129945+0000","last_undegraded":"2023-10-09T11:35:24.129945+0000","last_fullsized":"2023-10-09T11:35:24.129945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145146+0000","last_change":"2023-10-09T11:35:24.139443+0000","last_active":"2023-10-09T11:35:24.145146+0000","last_peered":"2023-10-09T11:35:24.145146+0000","last_clean":"2023-10-09T11:35:24.145146+0000","last_became_active":"2023-10-09T11:35:24.139154+0000","last_became_peered":"2023-10-09T11:35:24.139154+0000","last_unstale":"2023-10-09T11:35:24.145146+0000","last_undegraded":"2023-10-09T11:35:24.145146+0000","last_fullsized":"2023-10-09T11:35:24.145146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353309+0000","last_change":"2023-10-09T11:35:23.354006+0000","last_active":"2023-10-09T11:35:24.353309+0000","last_peered":"2023-10-09T11:35:24.353309+0000","last_clean":"2023-10-09T11:35:24.353309+0000","last_became_active":"2023-10-09T11:35:23.353652+0000","last_became_peered":"2023-10-09T11:35:23.353652+0000","last_unstale":"2023-10-09T11:35:24.353309+0000","last_undegraded":"2023-10-09T11:35:24.353309+0000","last_fullsized":"2023-10-09T11:35:24.353309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.148316+0000","last_change":"2023-10-09T11:35:24.145734+0000","last_active":"2023-10-09T11:35:24.148316+0000","last_peered":"2023-10-09T11:35:24.148316+0000","last_clean":"2023-10-09T11:35:24.148316+0000","last_became_active":"2023-10-09T11:35:24.145428+0000","last_became_peered":"2023-10-09T11:35:24.145428+0000","last_unstale":"2023-10-09T11:35:24.148316+0000","last_undegraded":"2023-10-09T11:35:24.148316+0000","last_fullsized":"2023-10-09T11:35:24.148316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.349142+0000","last_change":"2023-10-09T11:35:23.359612+0000","last_active":"2023-10-09T11:35:24.349142+0000","last_peered":"2023-10-09T11:35:24.349142+0000","last_clean":"2023-10-09T11:35:24.349142+0000","last_became_active":"2023-10-09T11:35:23.359281+0000","last_became_peered":"2023-10-09T11:35:23.359281+0000","last_unstale":"2023-10-09T11:35:24.349142+0000","last_undegraded":"2023-10-09T11:35:24.349142+0000","last_fullsized":"2023-10-09T11:35:24.349142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:43.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146099+0000","last_change":"2023-10-09T11:35:24.140692+0000","last_active":"2023-10-09T11:35:24.146099+0000","last_peered":"2023-10-09T11:35:24.146099+0000","last_clean":"2023-10-09T11:35:24.146099+0000","last_became_active":"2023-10-09T11:35:24.140410+0000","last_became_peered":"2023-10-09T11:35:24.140410+0000","last_unstale":"2023-10-09T11:35:24.146099+0000","last_undegraded":"2023-10-09T11:35:24.146099+0000","last_fullsized":"2023-10-09T11:35:24.146099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131273+0000","last_change":"2023-10-09T11:35:23.357092+0000","last_active":"2023-10-09T11:35:24.131273+0000","last_peered":"2023-10-09T11:35:24.131273+0000","last_clean":"2023-10-09T11:35:24.131273+0000","last_became_active":"2023-10-09T11:35:23.356770+0000","last_became_peered":"2023-10-09T11:35:23.356770+0000","last_unstale":"2023-10-09T11:35:24.131273+0000","last_undegraded":"2023-10-09T11:35:24.131273+0000","last_fullsized":"2023-10-09T11:35:24.131273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:13.158735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151640+0000","last_change":"2023-10-09T11:35:24.148899+0000","last_active":"2023-10-09T11:35:24.151640+0000","last_peered":"2023-10-09T11:35:24.151640+0000","last_clean":"2023-10-09T11:35:24.151640+0000","last_became_active":"2023-10-09T11:35:24.148606+0000","last_became_peered":"2023-10-09T11:35:24.148606+0000","last_unstale":"2023-10-09T11:35:24.151640+0000","last_undegraded":"2023-10-09T11:35:24.151640+0000","last_fullsized":"2023-10-09T11:35:24.151640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:28.723254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145363+0000","last_change":"2023-10-09T11:35:23.357012+0000","last_active":"2023-10-09T11:35:24.145363+0000","last_peered":"2023-10-09T11:35:24.145363+0000","last_clean":"2023-10-09T11:35:24.145363+0000","last_became_active":"2023-10-09T11:35:23.356520+0000","last_became_peered":"2023-10-09T11:35:23.356520+0000","last_unstale":"2023-10-09T11:35:24.145363+0000","last_undegraded":"2023-10-09T11:35:24.145363+0000","last_fullsized":"2023-10-09T11:35:24.145363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:44.480406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145418+0000","last_change":"2023-10-09T11:35:24.141088+0000","last_active":"2023-10-09T11:35:24.145418+0000","last_peered":"2023-10-09T11:35:24.145418+0000","last_clean":"2023-10-09T11:35:24.145418+0000","last_became_active":"2023-10-09T11:35:24.139862+0000","last_became_peered":"2023-10-09T11:35:24.139862+0000","last_unstale":"2023-10-09T11:35:24.145418+0000","last_undegraded":"2023-10-09T11:35:24.145418+0000","last_fullsized":"2023-10-09T11:35:24.145418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:46.638412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143692+0000","last_change":"2023-10-09T11:35:24.139287+0000","last_active":"2023-10-09T11:35:24.143692+0000","last_peered":"2023-10-09T11:35:24.143692+0000","last_clean":"2023-10-09T11:35:24.143692+0000","last_became_active":"2023-10-09T11:35:24.139008+0000","last_became_peered":"2023-10-09T11:35:24.139008+0000","last_unstale":"2023-10-09T11:35:24.143692+0000","last_undegraded":"2023-10-09T11:35:24.143692+0000","last_fullsized":"2023-10-09T11:35:24.143692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133043+0000","last_change":"2023-10-09T11:35:23.355919+0000","last_active":"2023-10-09T11:35:24.133043+0000","last_peered":"2023-10-09T11:35:24.133043+0000","last_clean":"2023-10-09T11:35:24.133043+0000","last_became_active":"2023-10-09T11:35:23.355614+0000","last_became_peered":"2023-10-09T11:35:23.355614+0000","last_unstale":"2023-10-09T11:35:24.133043+0000","last_undegraded":"2023-10-09T11:35:24.133043+0000","last_fullsized":"2023-10-09T11:35:24.133043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:12.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149233+0000","last_change":"2023-10-09T11:35:24.148543+0000","last_active":"2023-10-09T11:35:24.149233+0000","last_peered":"2023-10-09T11:35:24.149233+0000","last_clean":"2023-10-09T11:35:24.149233+0000","last_became_active":"2023-10-09T11:35:24.148262+0000","last_became_peered":"2023-10-09T11:35:24.148262+0000","last_unstale":"2023-10-09T11:35:24.149233+0000","last_undegraded":"2023-10-09T11:35:24.149233+0000","last_fullsized":"2023-10-09T11:35:24.149233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.145673+0000","last_change":"2023-10-09T11:35:23.354956+0000","last_active":"2023-10-09T11:35:24.145673+0000","last_peered":"2023-10-09T11:35:24.145673+0000","last_clean":"2023-10-09T11:35:24.145673+0000","last_became_active":"2023-10-09T11:35:23.354649+0000","last_became_peered":"2023-10-09T11:35:23.354649+0000","last_unstale":"2023-10-09T11:35:24.145673+0000","last_undegraded":"2023-10-09T11:35:24.145673+0000","last_fullsized":"2023-10-09T11:35:24.145673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133968+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:35:24.133968+0000","last_peered":"2023-10-09T11:35:24.133968+0000","last_clean":"2023-10-09T11:35:24.133968+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:35:24.133968+0000","last_undegraded":"2023-10-09T11:35:24.133968+0000","last_fullsized":"2023-10-09T11:35:24.133968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143590+0000","last_change":"2023-10-09T11:35:24.142197+0000","last_active":"2023-10-09T11:35:24.143590+0000","last_peered":"2023-10-09T11:35:24.143590+0000","last_clean":"2023-10-09T11:35:24.143590+0000","last_became_active":"2023-10-09T11:35:24.141909+0000","last_became_peered":"2023-10-09T11:35:24.141909+0000","last_unstale":"2023-10-09T11:35:24.143590+0000","last_undegraded":"2023-10-09T11:35:24.143590+0000","last_fullsized":"2023-10-09T11:35:24.143590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:52.262280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134030+0000","last_change":"2023-10-09T11:35:23.363461+0000","last_active":"2023-10-09T11:35:24.134030+0000","last_peered":"2023-10-09T11:35:24.134030+0000","last_clean":"2023-10-09T11:35:24.134030+0000","last_became_active":"2023-10-09T11:35:23.363036+0000","last_became_peered":"2023-10-09T11:35:23.363036+0000","last_unstale":"2023-10-09T11:35:24.134030+0000","last_undegraded":"2023-10-09T11:35:24.134030+0000","last_fullsized":"2023-10-09T11:35:24.134030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.134515+0000","last_change":"2023-10-09T11:35:23.363062+0000","last_active":"2023-10-09T11:35:24.134515+0000","last_peered":"2023-10-09T11:35:24.134515+0000","last_clean":"2023-10-09T11:35:24.134515+0000","last_became_active":"2023-10-09T11:35:23.362764+0000","last_became_peered":"2023-10-09T11:35:23.362764+0000","last_unstale":"2023-10-09T11:35:24.134515+0000","last_undegraded":"2023-10-09T11:35:24.134515+0000","last_fullsized":"2023-10-09T11:35:24.134515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.142257+0000","last_change":"2023-10-09T11:35:24.138344+0000","last_active":"2023-10-09T11:35:24.142257+0000","last_peered":"2023-10-09T11:35:24.142257+0000","last_clean":"2023-10-09T11:35:24.142257+0000","last_became_active":"2023-10-09T11:35:24.138049+0000","last_became_peered":"2023-10-09T11:35:24.138049+0000","last_unstale":"2023-10-09T11:35:24.142257+0000","last_undegraded":"2023-10-09T11:35:24.142257+0000","last_fullsized":"2023-10-09T11:35:24.142257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:35:25.129253+0000","last_change":"2023-10-09T11:35:23.364933+0000","last_active":"2023-10-09T11:35:25.129253+0000","last_peered":"2023-10-09T11:35:25.129253+0000","last_clean":"2023-10-09T11:35:25.129253+0000","last_became_active":"2023-10-09T11:35:23.364638+0000","last_became_peered":"2023-10-09T11:35:23.364638+0000","last_unstale":"2023-10-09T11:35:25.129253+0000","last_undegraded":"2023-10-09T11:35:25.129253+0000","last_fullsized":"2023-10-09T11:35:25.129253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143022+0000","last_change":"2023-10-09T11:35:24.141685+0000","last_active":"2023-10-09T11:35:24.143022+0000","last_peered":"2023-10-09T11:35:24.143022+0000","last_clean":"2023-10-09T11:35:24.143022+0000","last_became_active":"2023-10-09T11:35:24.141344+0000","last_became_peered":"2023-10-09T11:35:24.141344+0000","last_unstale":"2023-10-09T11:35:24.143022+0000","last_undegraded":"2023-10-09T11:35:24.143022+0000","last_fullsized":"2023-10-09T11:35:24.143022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.350153+0000","last_change":"2023-10-09T11:35:23.365419+0000","last_active":"2023-10-09T11:35:24.350153+0000","last_peered":"2023-10-09T11:35:24.350153+0000","last_clean":"2023-10-09T11:35:24.350153+0000","last_became_active":"2023-10-09T11:35:23.364707+0000","last_became_peered":"2023-10-09T11:35:23.364707+0000","last_unstale":"2023-10-09T11:35:24.350153+0000","last_undegraded":"2023-10-09T11:35:24.350153+0000","last_fullsized":"2023-10-09T11:35:24.350153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143260+0000","last_change":"2023-10-09T11:35:24.138684+0000","last_active":"2023-10-09T11:35:24.143260+0000","last_peered":"2023-10-09T11:35:24.143260+0000","last_clean":"2023-10-09T11:35:24.143260+0000","last_became_active":"2023-10-09T11:35:24.138267+0000","last_became_peered":"2023-10-09T11:35:24.138267+0000","last_unstale":"2023-10-09T11:35:24.143260+0000","last_undegraded":"2023-10-09T11:35:24.143260+0000","last_fullsized":"2023-10-09T11:35:24.143260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:47.119116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.133887+0000","last_change":"2023-10-09T11:35:23.363287+0000","last_active":"2023-10-09T11:35:24.133887+0000","last_peered":"2023-10-09T11:35:24.133887+0000","last_clean":"2023-10-09T11:35:24.133887+0000","last_became_active":"2023-10-09T11:35:23.362704+0000","last_became_peered":"2023-10-09T11:35:23.362704+0000","last_unstale":"2023-10-09T11:35:24.133887+0000","last_undegraded":"2023-10-09T11:35:24.133887+0000","last_fullsized":"2023-10-09T11:35:24.133887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.144593+0000","last_change":"2023-10-09T11:35:24.137239+0000","last_active":"2023-10-09T11:35:24.144593+0000","last_peered":"2023-10-09T11:35:24.144593+0000","last_clean":"2023-10-09T11:35:24.144593+0000","last_became_active":"2023-10-09T11:35:24.136716+0000","last_became_peered":"2023-10-09T11:35:24.136716+0000","last_unstale":"2023-10-09T11:35:24.144593+0000","last_undegraded":"2023-10-09T11:35:24.144593+0000","last_fullsized":"2023-10-09T11:35:24.144593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:42.856264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131929+0000","last_change":"2023-10-09T11:35:23.362437+0000","last_active":"2023-10-09T11:35:24.131929+0000","last_peered":"2023-10-09T11:35:24.131929+0000","last_clean":"2023-10-09T11:35:24.131929+0000","last_became_active":"2023-10-09T11:35:23.362098+0000","last_became_peered":"2023-10-09T11:35:23.362098+0000","last_unstale":"2023-10-09T11:35:24.131929+0000","last_undegraded":"2023-10-09T11:35:24.131929+0000","last_fullsized":"2023-10-09T11:35:24.131929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:28.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140904+0000","last_change":"2023-10-09T11:35:24.136802+0000","last_active":"2023-10-09T11:35:24.140904+0000","last_peered":"2023-10-09T11:35:24.140904+0000","last_clean":"2023-10-09T11:35:24.140904+0000","last_became_active":"2023-10-09T11:35:24.136552+0000","last_became_peered":"2023-10-09T11:35:24.136552+0000","last_unstale":"2023-10-09T11:35:24.140904+0000","last_undegraded":"2023-10-09T11:35:24.140904+0000","last_fullsized":"2023-10-09T11:35:24.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.131028+0000","last_change":"2023-10-09T11:35:23.354482+0000","last_active":"2023-10-09T11:35:24.131028+0000","last_peered":"2023-10-09T11:35:24.131028+0000","last_clean":"2023-10-09T11:35:24.131028+0000","last_became_active":"2023-10-09T11:35:23.354145+0000","last_became_peered":"2023-10-09T11:35:23.354145+0000","last_unstale":"2023-10-09T11:35:24.131028+0000","last_undegraded":"2023-10-09T11:35:24.131028+0000","last_fullsized":"2023-10-09T11:35:24.131028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143583+0000","last_change":"2023-10-09T11:35:24.142780+0000","last_active":"2023-10-09T11:35:24.143583+0000","last_peered":"2023-10-09T11:35:24.143583+0000","last_clean":"2023-10-09T11:35:24.143583+0000","last_became_active":"2023-10-09T11:35:24.142495+0000","last_became_peered":"2023-10-09T11:35:24.142495+0000","last_unstale":"2023-10-09T11:35:24.143583+0000","last_undegraded":"2023-10-09T11:35:24.143583+0000","last_fullsized":"2023-10-09T11:35:24.143583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:27.681723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.354147+0000","last_change":"2023-10-09T11:35:23.363974+0000","last_active":"2023-10-09T11:35:24.354147+0000","last_peered":"2023-10-09T11:35:24.354147+0000","last_clean":"2023-10-09T11:35:24.354147+0000","last_became_active":"2023-10-09T11:35:23.363542+0000","last_became_peered":"2023-10-09T11:35:23.363542+0000","last_unstale":"2023-10-09T11:35:24.354147+0000","last_undegraded":"2023-10-09T11:35:24.354147+0000","last_fullsized":"2023-10-09T11:35:24.354147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:17.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140368+0000","last_change":"2023-10-09T11:35:24.136470+0000","last_active":"2023-10-09T11:35:24.140368+0000","last_peered":"2023-10-09T11:35:24.140368+0000","last_clean":"2023-10-09T11:35:24.140368+0000","last_became_active":"2023-10-09T11:35:24.136165+0000","last_became_peered":"2023-10-09T11:35:24.136165+0000","last_unstale":"2023-10-09T11:35:24.140368+0000","last_undegraded":"2023-10-09T11:35:24.140368+0000","last_fullsized":"2023-10-09T11:35:24.140368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:03.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.132920+0000","last_change":"2023-10-09T11:35:23.358941+0000","last_active":"2023-10-09T11:35:24.132920+0000","last_peered":"2023-10-09T11:35:24.132920+0000","last_clean":"2023-10-09T11:35:24.132920+0000","last_became_active":"2023-10-09T11:35:23.358644+0000","last_became_peered":"2023-10-09T11:35:23.358644+0000","last_unstale":"2023-10-09T11:35:24.132920+0000","last_undegraded":"2023-10-09T11:35:24.132920+0000","last_fullsized":"2023-10-09T11:35:24.132920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:03.148627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151207+0000","last_change":"2023-10-09T11:35:24.150106+0000","last_active":"2023-10-09T11:35:24.151207+0000","last_peered":"2023-10-09T11:35:24.151207+0000","last_clean":"2023-10-09T11:35:24.151207+0000","last_became_active":"2023-10-09T11:35:24.149822+0000","last_became_peered":"2023-10-09T11:35:24.149822+0000","last_unstale":"2023-10-09T11:35:24.151207+0000","last_undegraded":"2023-10-09T11:35:24.151207+0000","last_fullsized":"2023-10-09T11:35:24.151207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:52.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.351118+0000","last_change":"2023-10-09T11:35:23.355543+0000","last_active":"2023-10-09T11:35:24.351118+0000","last_peered":"2023-10-09T11:35:24.351118+0000","last_clean":"2023-10-09T11:35:24.351118+0000","last_became_active":"2023-10-09T11:35:23.355209+0000","last_became_peered":"2023-10-09T11:35:23.355209+0000","last_unstale":"2023-10-09T11:35:24.351118+0000","last_undegraded":"2023-10-09T11:35:24.351118+0000","last_fullsized":"2023-10-09T11:35:24.351118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:41.848849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151598+0000","last_change":"2023-10-09T11:35:24.148840+0000","last_active":"2023-10-09T11:35:24.151598+0000","last_peered":"2023-10-09T11:35:24.151598+0000","last_clean":"2023-10-09T11:35:24.151598+0000","last_became_active":"2023-10-09T11:35:24.148295+0000","last_became_peered":"2023-10-09T11:35:24.148295+0000","last_unstale":"2023-10-09T11:35:24.151598+0000","last_undegraded":"2023-10-09T11:35:24.151598+0000","last_fullsized":"2023-10-09T11:35:24.151598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:59.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.353514+0000","last_change":"2023-10-09T11:35:23.356087+0000","last_active":"2023-10-09T11:35:24.353514+0000","last_peered":"2023-10-09T11:35:24.353514+0000","last_clean":"2023-10-09T11:35:24.353514+0000","last_became_active":"2023-10-09T11:35:23.355642+0000","last_became_peered":"2023-10-09T11:35:23.355642+0000","last_unstale":"2023-10-09T11:35:24.353514+0000","last_undegraded":"2023-10-09T11:35:24.353514+0000","last_fullsized":"2023-10-09T11:35:24.353514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:22.324960+0000","last_clean_scrub_stamp":"2023-10-09T11:35:22.324960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.150321+0000","last_change":"2023-10-09T11:35:24.149254+0000","last_active":"2023-10-09T11:35:24.150321+0000","last_peered":"2023-10-09T11:35:24.150321+0000","last_clean":"2023-10-09T11:35:24.150321+0000","last_became_active":"2023-10-09T11:35:24.148931+0000","last_became_peered":"2023-10-09T11:35:24.148931+0000","last_unstale":"2023-10-09T11:35:24.150321+0000","last_undegraded":"2023-10-09T11:35:24.150321+0000","last_fullsized":"2023-10-09T11:35:24.150321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146536+0000","last_change":"2023-10-09T11:35:24.144407+0000","last_active":"2023-10-09T11:35:24.146536+0000","last_peered":"2023-10-09T11:35:24.146536+0000","last_clean":"2023-10-09T11:35:24.146536+0000","last_became_active":"2023-10-09T11:35:24.144120+0000","last_became_peered":"2023-10-09T11:35:24.144120+0000","last_unstale":"2023-10-09T11:35:24.146536+0000","last_undegraded":"2023-10-09T11:35:24.146536+0000","last_fullsized":"2023-10-09T11:35:24.146536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.149262+0000","last_change":"2023-10-09T11:35:24.148542+0000","last_active":"2023-10-09T11:35:24.149262+0000","last_peered":"2023-10-09T11:35:24.149262+0000","last_clean":"2023-10-09T11:35:24.149262+0000","last_became_active":"2023-10-09T11:35:24.148205+0000","last_became_peered":"2023-10-09T11:35:24.148205+0000","last_unstale":"2023-10-09T11:35:24.149262+0000","last_undegraded":"2023-10-09T11:35:24.149262+0000","last_fullsized":"2023-10-09T11:35:24.149262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:14.166150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.151809+0000","last_change":"2023-10-09T11:35:24.147669+0000","last_active":"2023-10-09T11:35:24.151809+0000","last_peered":"2023-10-09T11:35:24.151809+0000","last_clean":"2023-10-09T11:35:24.151809+0000","last_became_active":"2023-10-09T11:35:24.147088+0000","last_became_peered":"2023-10-09T11:35:24.147088+0000","last_unstale":"2023-10-09T11:35:24.151809+0000","last_undegraded":"2023-10-09T11:35:24.151809+0000","last_fullsized":"2023-10-09T11:35:24.151809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.388592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143602+0000","last_change":"2023-10-09T11:35:24.142634+0000","last_active":"2023-10-09T11:35:24.143602+0000","last_peered":"2023-10-09T11:35:24.143602+0000","last_clean":"2023-10-09T11:35:24.143602+0000","last_became_active":"2023-10-09T11:35:24.142365+0000","last_became_peered":"2023-10-09T11:35:24.142365+0000","last_unstale":"2023-10-09T11:35:24.143602+0000","last_undegraded":"2023-10-09T11:35:24.143602+0000","last_fullsized":"2023-10-09T11:35:24.143602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.509006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139958+0000","last_change":"2023-10-09T11:35:24.135282+0000","last_active":"2023-10-09T11:35:24.139958+0000","last_peered":"2023-10-09T11:35:24.139958+0000","last_clean":"2023-10-09T11:35:24.139958+0000","last_became_active":"2023-10-09T11:35:24.135029+0000","last_became_peered":"2023-10-09T11:35:24.135029+0000","last_unstale":"2023-10-09T11:35:24.139958+0000","last_undegraded":"2023-10-09T11:35:24.139958+0000","last_fullsized":"2023-10-09T11:35:24.139958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.143840+0000","last_change":"2023-10-09T11:35:24.140956+0000","last_active":"2023-10-09T11:35:24.143840+0000","last_peered":"2023-10-09T11:35:24.143840+0000","last_clean":"2023-10-09T11:35:24.143840+0000","last_became_active":"2023-10-09T11:35:24.140678+0000","last_became_peered":"2023-10-09T11:35:24.140678+0000","last_unstale":"2023-10-09T11:35:24.143840+0000","last_undegraded":"2023-10-09T11:35:24.143840+0000","last_fullsized":"2023-10-09T11:35:24.143840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146433+0000","last_change":"2023-10-09T11:35:24.140260+0000","last_active":"2023-10-09T11:35:24.146433+0000","last_peered":"2023-10-09T11:35:24.146433+0000","last_clean":"2023-10-09T11:35:24.146433+0000","last_became_active":"2023-10-09T11:35:24.139938+0000","last_became_peered":"2023-10-09T11:35:24.139938+0000","last_unstale":"2023-10-09T11:35:24.146433+0000","last_undegraded":"2023-10-09T11:35:24.146433+0000","last_fullsized":"2023-10-09T11:35:24.146433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.141552+0000","last_change":"2023-10-09T11:35:24.135797+0000","last_active":"2023-10-09T11:35:24.141552+0000","last_peered":"2023-10-09T11:35:24.141552+0000","last_clean":"2023-10-09T11:35:24.141552+0000","last_became_active":"2023-10-09T11:35:24.135530+0000","last_became_peered":"2023-10-09T11:35:24.135530+0000","last_unstale":"2023-10-09T11:35:24.141552+0000","last_undegraded":"2023-10-09T11:35:24.141552+0000","last_fullsized":"2023-10-09T11:35:24.141552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:41.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154030+0000","last_change":"2023-10-09T11:35:24.151526+0000","last_active":"2023-10-09T11:35:24.154030+0000","last_peered":"2023-10-09T11:35:24.154030+0000","last_clean":"2023-10-09T11:35:24.154030+0000","last_became_active":"2023-10-09T11:35:24.147333+0000","last_became_peered":"2023-10-09T11:35:24.147333+0000","last_unstale":"2023-10-09T11:35:24.154030+0000","last_undegraded":"2023-10-09T11:35:24.154030+0000","last_fullsized":"2023-10-09T11:35:24.154030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:11.048511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.139938+0000","last_change":"2023-10-09T11:35:24.134614+0000","last_active":"2023-10-09T11:35:24.139938+0000","last_peered":"2023-10-09T11:35:24.139938+0000","last_clean":"2023-10-09T11:35:24.139938+0000","last_became_active":"2023-10-09T11:35:24.134362+0000","last_became_peered":"2023-10-09T11:35:24.134362+0000","last_unstale":"2023-10-09T11:35:24.139938+0000","last_undegraded":"2023-10-09T11:35:24.139938+0000","last_fullsized":"2023-10-09T11:35:24.139938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:56.854955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.154083+0000","last_change":"2023-10-09T11:35:24.151676+0000","last_active":"2023-10-09T11:35:24.154083+0000","last_peered":"2023-10-09T11:35:24.154083+0000","last_clean":"2023-10-09T11:35:24.154083+0000","last_became_active":"2023-10-09T11:35:24.150853+0000","last_became_peered":"2023-10-09T11:35:24.150853+0000","last_unstale":"2023-10-09T11:35:24.154083+0000","last_undegraded":"2023-10-09T11:35:24.154083+0000","last_fullsized":"2023-10-09T11:35:24.154083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:12.553403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.146082+0000","last_change":"2023-10-09T11:35:24.145336+0000","last_active":"2023-10-09T11:35:24.146082+0000","last_peered":"2023-10-09T11:35:24.146082+0000","last_clean":"2023-10-09T11:35:24.146082+0000","last_became_active":"2023-10-09T11:35:24.145009+0000","last_became_peered":"2023-10-09T11:35:24.145009+0000","last_unstale":"2023-10-09T11:35:24.146082+0000","last_undegraded":"2023-10-09T11:35:24.146082+0000","last_fullsized":"2023-10-09T11:35:24.146082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:03.987292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:35:24.140506+0000","last_change":"2023-10-09T11:35:24.137045+0000","last_active":"2023-10-09T11:35:24.140506+0000","last_peered":"2023-10-09T11:35:24.140506+0000","last_clean":"2023-10-09T11:35:24.140506+0000","last_became_active":"2023-10-09T11:35:24.136734+0000","last_became_peered":"2023-10-09T11:35:24.136734+0000","last_unstale":"2023-10-09T11:35:24.140506+0000","last_undegraded":"2023-10-09T11:35:24.140506+0000","last_fullsized":"2023-10-09T11:35:24.140506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:23.332375+0000","last_clean_scrub_stamp":"2023-10-09T11:35:23.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9450000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":74353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":665171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":74319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":74283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:35:33.509 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T11:35:33.509 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T11:35:33.509 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T11:35:33.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T11:35:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.656+0000 7ff228322700 1 Processor -- start 2023-10-09T11:35:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.656+0000 7ff228322700 1 -- start start 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff228322700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2200cb970 0x7ff220159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff228322700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22015ae40 con 0x7ff22015a400 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff228322700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22015ab60 con 0x7ff2200cb5a0 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff228322700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200ce0f0 con 0x7ff2200cb970 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff2258bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2200cb970 0x7ff220159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff2268bf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff22015a400 0x7ff220156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33526/0 (socket says 172.21.15.26:33526) 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff2268bf700 1 -- 172.21.15.26:0/1679139428 learned_addr learned my addr 172.21.15.26:0/1679139428 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.657+0000 7ff2258bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2200cb970 0x7ff220159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35904/0 (socket says 172.21.15.26:35904) 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2258bd700 1 -- 172.21.15.26:0/1679139428 >> v1:172.21.15.67:6789/0 conn(0x7ff2200cb5a0 legacy=0x7ff2200cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2258bd700 1 -- 172.21.15.26:0/1679139428 >> v1:172.21.15.26:6789/0 conn(0x7ff22015a400 legacy=0x7ff220156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2258bd700 1 -- 172.21.15.26:0/1679139428 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200ccf00 con 0x7ff2200cb970 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2258bd700 1 --2- 172.21.15.26:0/1679139428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb970 0x7ff220159ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff2140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4772542aa81f63ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2250bc700 1 -- 172.21.15.26:0/1679139428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214009e80 con 0x7ff2200cb970 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2250bc700 1 -- 172.21.15.26:0/1679139428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400b860 con 0x7ff2200cb970 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff2250bc700 1 -- 172.21.15.26:0/1679139428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400bbe0 con 0x7ff2200cb970 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff228322700 1 -- 172.21.15.26:0/1679139428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb970 msgr2=0x7ff220159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.658+0000 7ff228322700 1 --2- 172.21.15.26:0/1679139428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb970 0x7ff220159ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff2140091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.659+0000 7ff228322700 1 -- 172.21.15.26:0/1679139428 shutdown_connections 2023-10-09T11:35:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.659+0000 7ff228322700 1 --2- 172.21.15.26:0/1679139428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb970 0x7ff220159ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.659+0000 7ff228322700 1 -- 172.21.15.26:0/1679139428 >> 172.21.15.26:0/1679139428 conn(0x7ff220070e30 msgr2=0x7ff2200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.659+0000 7ff228322700 1 -- 172.21.15.26:0/1679139428 shutdown_connections 2023-10-09T11:35:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.659+0000 7ff228322700 1 -- 172.21.15.26:0/1679139428 wait complete. 2023-10-09T11:35:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 Processor -- start 2023-10-09T11:35:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 -- start start 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200cb970 0x7ff22015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 0x7ff22015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220154260 con 0x7ff2200cb5a0 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.660+0000 7ff228322700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220156de0 con 0x7ff22015a400 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff228322700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201570c0 con 0x7ff2200cb970 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35918/0 (socket says 172.21.15.26:35918) 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 -- 172.21.15.26:0/4183879204 learned_addr learned my addr 172.21.15.26:0/4183879204 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2258bd700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200cb970 0x7ff22015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2268bf700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 0x7ff22015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 -- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200cb970 msgr2=0x7ff22015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200cb970 0x7ff22015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 -- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 msgr2=0x7ff22015d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 0x7ff22015d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 -- 172.21.15.26:0/4183879204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009420 con 0x7ff2200cb5a0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2268bf700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 0x7ff22015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff2260be700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c590 tx=0x7ff21800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218011590 con 0x7ff2200cb5a0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2180116f0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2201573a0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218011ab0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.661+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff220157ba0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.662+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220157dc0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.663+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff21801b3b0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.663+0000 7ff21e7fc700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.663+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff218083b80 con 0x7ff2200cb5a0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.663+0000 7ff2258bd700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.664+0000 7ff2258bd700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b3930 tx=0x7ff214017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.667+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff218050d50 con 0x7ff2200cb5a0 2023-10-09T11:35:33.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.904+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff22004c3c0 con 0x7ff2200cb5a0 2023-10-09T11:35:33.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.905+0000 7ff21e7fc700 1 -- 172.21.15.26:0/4183879204 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff218017020 con 0x7ff2200cb5a0 2023-10-09T11:35:33.906 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:33.907 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T11:35:33.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.906+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 msgr2=0x7ff20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.906+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b3930 tx=0x7ff214017000 comp rx=0 tx=0).stop 2023-10-09T11:35:33.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.906+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 msgr2=0x7ff220153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:33.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.906+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c590 tx=0x7ff21800c950 comp rx=0 tx=0).stop 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 shutdown_connections 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22015a400 0x7ff22015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2200cb5a0 0x7ff220153d20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 --2- 172.21.15.26:0/4183879204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200cb970 0x7ff22015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 >> 172.21.15.26:0/4183879204 conn(0x7ff220070e30 msgr2=0x7ff2200b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 shutdown_connections 2023-10-09T11:35:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:33.907+0000 7ff228322700 1 -- 172.21.15.26:0/4183879204 wait complete. 2023-10-09T11:35:33.920 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T11:35:33.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.037+0000 7f530f923700 1 Processor -- start 2023-10-09T11:35:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.038+0000 7f530f923700 1 -- start start 2023-10-09T11:35:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.038+0000 7f530f923700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53080cb970 0x7f5308159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530f923700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530815ae40 con 0x7f53080cb5a0 2023-10-09T11:35:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530f923700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530815ab60 con 0x7f530815a400 2023-10-09T11:35:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530f923700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080ce0f0 con 0x7f53080cb970 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530d6bf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f53080cb5a0 0x7f53080cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33540/0 (socket says 172.21.15.26:33540) 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530d6bf700 1 -- 172.21.15.26:0/1073739084 learned_addr learned my addr 172.21.15.26:0/1073739084 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530cebe700 1 --2- 172.21.15.26:0/1073739084 >> v2:172.21.15.67:3300/0 conn(0x7f53080cb970 0x7f5308159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959912476 0 0) 0x7f530815ae40 con 0x7f53080cb5a0 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003570 con 0x7f53080cb5a0 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3721391978 0 0) 0x7f52f0003570 con 0x7f53080cb5a0 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 >> v2:172.21.15.67:3300/0 conn(0x7f53080cb970 msgr2=0x7f5308159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 --2- 172.21.15.26:0/1073739084 >> v2:172.21.15.67:3300/0 conn(0x7f53080cb970 0x7f5308159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 >> v1:172.21.15.67:6789/0 conn(0x7f530815a400 legacy=0x7f5308156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080ccf00 con 0x7f53080cb5a0 2023-10-09T11:35:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f53000017f0 con 0x7f53080cb5a0 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 >> v1:172.21.15.26:6789/0 conn(0x7f53080cb5a0 legacy=0x7f53080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080ce0f0 con 0x7f52f00051c0 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000c0d0 con 0x7f52f0003a60 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000c290 con 0x7f52f0004810 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530dec0700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530d6bf700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.039+0000 7f530cebe700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 -- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52f0004810 msgr2=0x7f52f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 -- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52f0003a60 msgr2=0x7f52f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 -- 172.21.15.26:0/1073739084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0003570 con 0x7f52f00051c0 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 -- 172.21.15.26:0/1073739084 reap_dead start 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530dec0700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f52f000ba60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52f80018b0 tx=0x7f52f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a857adf0075cd13e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8012420 con 0x7f52f00051c0 2023-10-09T11:35:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8012580 con 0x7f52f00051c0 2023-10-09T11:35:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f5307fff700 1 -- 172.21.15.26:0/1073739084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8012920 con 0x7f52f00051c0 2023-10-09T11:35:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530f923700 1 -- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 msgr2=0x7f52f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.040+0000 7f530f923700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f52f000ba60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52f80018b0 tx=0x7f52f8007d30 comp rx=0 tx=0).stop 2023-10-09T11:35:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.041+0000 7f530f923700 1 -- 172.21.15.26:0/1073739084 shutdown_connections 2023-10-09T11:35:34.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.041+0000 7f530f923700 1 --2- 172.21.15.26:0/1073739084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.041+0000 7f530f923700 1 -- 172.21.15.26:0/1073739084 >> 172.21.15.26:0/1073739084 conn(0x7f5308070e30 msgr2=0x7f53080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.041+0000 7f530f923700 1 -- 172.21.15.26:0/1073739084 shutdown_connections 2023-10-09T11:35:34.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.041+0000 7f530f923700 1 -- 172.21.15.26:0/1073739084 wait complete. 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.042+0000 7f530f923700 1 Processor -- start 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.042+0000 7f530f923700 1 -- start start 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 0x7f530816d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 0x7f530815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308153320 con 0x7f52f00051c0 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530816e010 con 0x7f530816caf0 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080c9550 con 0x7f530816ac60 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35944/0 (socket says 172.21.15.26:35944) 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 -- 172.21.15.26:0/397585166 learned_addr learned my addr 172.21.15.26:0/397585166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530cebe700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 0x7f530816d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530dec0700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 0x7f530815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 -- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 msgr2=0x7f530815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 0x7f530815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 -- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 msgr2=0x7f530816d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 0x7f530816d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 -- 172.21.15.26:0/397585166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080c9810 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530cebe700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 0x7f530816d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530dec0700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 0x7f530815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530d6bf700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53000012e0 tx=0x7f53000021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300007b40 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000ad70 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300013620 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530816d770 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.043+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530816dd30 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.044+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53080895b0 con 0x7f52f00051c0 2023-10-09T11:35:34.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.045+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5300013a50 con 0x7f52f00051c0 2023-10-09T11:35:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.045+0000 7f53057fa700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.045+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5300085230 con 0x7f52f00051c0 2023-10-09T11:35:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.045+0000 7f530cebe700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.046+0000 7f530cebe700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52fc006f00 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.050+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53000524a0 con 0x7f52f00051c0 2023-10-09T11:35:34.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.247+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f530804c3c0 con 0x7f52f00051c0 2023-10-09T11:35:34.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.248+0000 7f53057fa700 1 -- 172.21.15.26:0/397585166 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5300055ac0 con 0x7f52f00051c0 2023-10-09T11:35:34.249 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:34.249 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:34.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 msgr2=0x7f52f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52fc006f00 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 msgr2=0x7f53080b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53000012e0 tx=0x7f53000021d0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 shutdown_connections 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f530816ac60 0x7f530815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00051c0 0x7f53080b0f00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 --2- 172.21.15.26:0/397585166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530816caf0 0x7f530816d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 >> 172.21.15.26:0/397585166 conn(0x7f5308070e30 msgr2=0x7f53080c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 shutdown_connections 2023-10-09T11:35:34.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.250+0000 7f530f923700 1 -- 172.21.15.26:0/397585166 wait complete. 2023-10-09T11:35:34.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:34.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:34.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.384+0000 7f529a7ba700 1 Processor -- start 2023-10-09T11:35:34.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.384+0000 7f529a7ba700 1 -- start start 2023-10-09T11:35:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.384+0000 7f529a7ba700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 0x7f52940ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f529a7ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f529406dc70 0x7f5294159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f529a7ba700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406e0e0 0x7f52940cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f529a7ba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940ccfd0 con 0x7f529406dc70 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f529a7ba700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940cf0e0 con 0x7f5294159530 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f529a7ba700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415a3d0 con 0x7f529406e0e0 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f529406dc70 0x7f5294159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f529406dc70 0x7f5294159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35956/0 (socket says 172.21.15.26:35956) 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 -- 172.21.15.26:0/3984316485 learned_addr learned my addr 172.21.15.26:0/3984316485 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5298d57700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406e0e0 0x7f52940cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5293fff700 1 --2- 172.21.15.26:0/3984316485 >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 0x7f52940ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 -- 172.21.15.26:0/3984316485 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406e0e0 msgr2=0x7f52940cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406e0e0 0x7f52940cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 -- 172.21.15.26:0/3984316485 >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 msgr2=0x7f52940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 --2- 172.21.15.26:0/3984316485 >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 0x7f52940ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 -- 172.21.15.26:0/3984316485 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529415a6b0 con 0x7f529406dc70 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5293fff700 1 --2- 172.21.15.26:0/3984316485 >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 0x7f52940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f52937fe700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406dc70 0x7f5294159900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f529406d630 tx=0x7f5284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f8c113f2b8d518 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5292ffd700 1 -- 172.21.15.26:0/3984316485 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400b860 con 0x7f529406dc70 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5292ffd700 1 -- 172.21.15.26:0/3984316485 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400b9c0 con 0x7f529406dc70 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.385+0000 7f5292ffd700 1 -- 172.21.15.26:0/3984316485 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400bd60 con 0x7f529406dc70 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 -- 172.21.15.26:0/3984316485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406dc70 msgr2=0x7f5294159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406dc70 0x7f5294159900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f529406d630 tx=0x7f5284009250 comp rx=0 tx=0).stop 2023-10-09T11:35:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 -- 172.21.15.26:0/3984316485 shutdown_connections 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 --2- 172.21.15.26:0/3984316485 >> v2:172.21.15.67:3300/0 conn(0x7f5294159530 0x7f52940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406e0e0 0x7f52940cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 --2- 172.21.15.26:0/3984316485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406dc70 0x7f5294159900 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 -- 172.21.15.26:0/3984316485 >> 172.21.15.26:0/3984316485 conn(0x7f52940703a0 msgr2=0x7f52940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 -- 172.21.15.26:0/3984316485 shutdown_connections 2023-10-09T11:35:34.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.386+0000 7f529a7ba700 1 -- 172.21.15.26:0/3984316485 wait complete. 2023-10-09T11:35:34.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.387+0000 7f529a7ba700 1 Processor -- start 2023-10-09T11:35:34.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.387+0000 7f529a7ba700 1 -- start start 2023-10-09T11:35:34.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406dc70 0x7f529416a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294159530 0x7f52940c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c8750 con 0x7f529406e0e0 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c8470 con 0x7f5294159530 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f529a7ba700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940b40f0 con 0x7f529406dc70 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35964/0 (socket says 172.21.15.26:35964) 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 -- 172.21.15.26:0/613583579 learned_addr learned my addr 172.21.15.26:0/613583579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 -- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406dc70 msgr2=0x7f529416a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406dc70 0x7f529416a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 -- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294159530 msgr2=0x7f52940c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294159530 0x7f52940c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 -- 172.21.15.26:0/613583579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840094f0 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.388+0000 7f52937fe700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5294089650 tx=0x7f5284017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.389+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284024440 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.389+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52840245a0 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.389+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940b43d0 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.389+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284024960 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.389+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940c8100 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.390+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52940b3f50 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.390+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f528401a420 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.390+0000 7f528bfff700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 0x7f52740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.390+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52840863f0 con 0x7f529406e0e0 2023-10-09T11:35:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.391+0000 7f5293fff700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 0x7f52740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.391+0000 7f5293fff700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 0x7f52740693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f527c006fd0 tx=0x7f527c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.395+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52940b3f50 con 0x7f529406e0e0 2023-10-09T11:35:34.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.586+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52940b3f50 con 0x7f529406e0e0 2023-10-09T11:35:34.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.586+0000 7f528bfff700 1 -- 172.21.15.26:0/613583579 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52940b3f50 con 0x7f529406e0e0 2023-10-09T11:35:34.588 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 msgr2=0x7f52740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 0x7f52740693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f527c006fd0 tx=0x7f527c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 msgr2=0x7f529416cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5294089650 tx=0x7f5284017000 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 shutdown_connections 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294159530 0x7f52940c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5274066f30 0x7f52740693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f529406dc70 0x7f529416a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 --2- 172.21.15.26:0/613583579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f529406e0e0 0x7f529416cdf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 >> 172.21.15.26:0/613583579 conn(0x7f52940703a0 msgr2=0x7f5294153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 shutdown_connections 2023-10-09T11:35:34.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.588+0000 7f529a7ba700 1 -- 172.21.15.26:0/613583579 wait complete. 2023-10-09T11:35:34.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.721+0000 7f5b8fc1c700 1 Processor -- start 2023-10-09T11:35:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 -- start start 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b880ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b880ccba0 0x7f5b880cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880c32a0 con 0x7f5b88157930 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880c9730 con 0x7f5b880ccba0 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8fc1c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880cd560 con 0x7f5b880ca2c0 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.722+0000 7f5b8d9b8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5b88157930 0x7f5b880ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33546/0 (socket says 172.21.15.26:33546) 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8d9b8700 1 -- 172.21.15.26:0/1370197374 learned_addr learned my addr 172.21.15.26:0/1370197374 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8e1b9700 1 --2- 172.21.15.26:0/1370197374 >> v2:172.21.15.67:3300/0 conn(0x7f5b880ccba0 0x7f5b880cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8d1b7700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b880ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392315972 0 0) 0x7f5b880c32a0 con 0x7f5b88157930 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70003570 con 0x7f5b88157930 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263602023 0 0) 0x7f5b70003570 con 0x7f5b88157930 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 msgr2=0x7f5b880ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b880ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 >> v2:172.21.15.67:3300/0 conn(0x7f5b880ccba0 msgr2=0x7f5b880cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 --2- 172.21.15.26:0/1370197374 >> v2:172.21.15.67:3300/0 conn(0x7f5b880ccba0 0x7f5b880cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880c4100 con 0x7f5b88157930 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f5b800017f0 con 0x7f5b88157930 2023-10-09T11:35:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 >> v1:172.21.15.26:6789/0 conn(0x7f5b88157930 legacy=0x7f5b880ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b70003a90 0x7f5b70003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b70004810 0x7f5b70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c9730 con 0x7f5b70003a90 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880cd560 con 0x7f5b70004810 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000ba60 con 0x7f5b880ca2c0 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b70003a90 0x7f5b70003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8d1b7700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b70004810 0x7f5b70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.723+0000 7f5b8e1b9700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 -- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 msgr2=0x7f5b700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b880ca2c0 0x7f5b700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 -- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b70004810 msgr2=0x7f5b70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b70004810 0x7f5b70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 -- 172.21.15.26:0/1370197374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70003570 con 0x7f5b70003a90 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b70003a90 0x7f5b70003ea0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000a960 tx=0x7f5b800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973784019e9b5396 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800070d0 con 0x7f5b70003a90 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80007230 con 0x7f5b70003a90 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8c9b6700 1 -- 172.21.15.26:0/1370197374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800075d0 con 0x7f5b70003a90 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/1370197374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b70003a90 msgr2=0x7f5b70003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/1370197374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b70003a90 0x7f5b70003ea0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000a960 tx=0x7f5b800021d0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8e1b9700 1 -- 172.21.15.26:0/1370197374 reap_dead start 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/1370197374 shutdown_connections 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.724+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/1370197374 >> 172.21.15.26:0/1370197374 conn(0x7f5b88088000 msgr2=0x7f5b880883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.725+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/1370197374 shutdown_connections 2023-10-09T11:35:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.725+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/1370197374 wait complete. 2023-10-09T11:35:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 Processor -- start 2023-10-09T11:35:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 -- start start 2023-10-09T11:35:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b70003a90 0x7f5b880c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 0x7f5b880abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c84e0 con 0x7f5b880c7b00 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88153680 con 0x7f5b880ab810 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8fc1c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880ac380 con 0x7f5b70003a90 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8e1b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8e1b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35986/0 (socket says 172.21.15.26:35986) 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8e1b9700 1 -- 172.21.15.26:0/4166977065 learned_addr learned my addr 172.21.15.26:0/4166977065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b70003a90 0x7f5b880c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.726+0000 7f5b8d1b7700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 0x7f5b880abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 -- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b70003a90 msgr2=0x7f5b880c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b70003a90 0x7f5b880c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 -- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 msgr2=0x7f5b880abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 0x7f5b880abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 -- 172.21.15.26:0/4166977065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880ac660 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8d1b7700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 0x7f5b880abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8e1b9700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b4500 tx=0x7f5b780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800f7d0 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800f930 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880ac940 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800fcd0 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.727+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b880acf00 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.728+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880ad120 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.728+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b78014650 con 0x7f5b880c7b00 2023-10-09T11:35:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.729+0000 7f5b85ffb700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:34.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.729+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b78084a30 con 0x7f5b880c7b00 2023-10-09T11:35:34.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.729+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:34.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.730+0000 7f5b8d9b8700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000a900 tx=0x7f5b80016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:34.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.733+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b78051d20 con 0x7f5b880c7b00 2023-10-09T11:35:34.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.924+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b8804c3c0 con 0x7f5b880c7b00 2023-10-09T11:35:34.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.924+0000 7f5b85ffb700 1 -- 172.21.15.26:0/4166977065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b78055340 con 0x7f5b880c7b00 2023-10-09T11:35:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 msgr2=0x7f5b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000a900 tx=0x7f5b80016000 comp rx=0 tx=0).stop 2023-10-09T11:35:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 msgr2=0x7f5b880c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b4500 tx=0x7f5b780091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 shutdown_connections 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880c7b00 0x7f5b880c7fa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b70003a90 0x7f5b880c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 --2- 172.21.15.26:0/4166977065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b880ab810 0x7f5b880abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.926+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 >> 172.21.15.26:0/4166977065 conn(0x7f5b88088000 msgr2=0x7f5b880caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.927+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 shutdown_connections 2023-10-09T11:35:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:34.927+0000 7f5b8fc1c700 1 -- 172.21.15.26:0/4166977065 wait complete. 2023-10-09T11:35:34.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.071+0000 7fc714d3b700 1 Processor -- start 2023-10-09T11:35:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.071+0000 7fc714d3b700 1 -- start start 2023-10-09T11:35:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc714d3b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc710159530 0x7fc7100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc714d3b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006dc70 0x7fc710159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc714d3b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7100ccfd0 con 0x7fc71006e0e0 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc714d3b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100cf0e0 con 0x7fc710159530 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc714d3b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71015a3d0 con 0x7fc71006dc70 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc710159530 0x7fc7100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc710159530 0x7fc7100ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35998/0 (socket says 172.21.15.26:35998) 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70e59c700 1 -- 172.21.15.26:0/749490739 learned_addr learned my addr 172.21.15.26:0/749490739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70dd9b700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006dc70 0x7fc710159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70e59c700 1 -- 172.21.15.26:0/749490739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006dc70 msgr2=0x7fc710159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.072+0000 7fc70e59c700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006dc70 0x7fc710159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70e59c700 1 -- 172.21.15.26:0/749490739 >> v1:172.21.15.67:6789/0 conn(0x7fc71006e0e0 legacy=0x7fc7100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70e59c700 1 -- 172.21.15.26:0/749490739 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71015a6b0 con 0x7fc710159530 2023-10-09T11:35:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70e59c700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc710159530 0x7fc7100ceba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7080099b0 tx=0x7fc708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e58eac3a5e8ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70d59a700 1 -- 172.21.15.26:0/749490739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708009ea0 con 0x7fc710159530 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70d59a700 1 -- 172.21.15.26:0/749490739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70800b860 con 0x7fc710159530 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc70d59a700 1 -- 172.21.15.26:0/749490739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800bc00 con 0x7fc710159530 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 -- 172.21.15.26:0/749490739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc710159530 msgr2=0x7fc7100ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc710159530 0x7fc7100ceba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7080099b0 tx=0x7fc708009250 comp rx=0 tx=0).stop 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 -- 172.21.15.26:0/749490739 shutdown_connections 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc710159530 0x7fc7100ceba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 --2- 172.21.15.26:0/749490739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006dc70 0x7fc710159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 -- 172.21.15.26:0/749490739 >> 172.21.15.26:0/749490739 conn(0x7fc7100703a0 msgr2=0x7fc7100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 -- 172.21.15.26:0/749490739 shutdown_connections 2023-10-09T11:35:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.073+0000 7fc714d3b700 1 -- 172.21.15.26:0/749490739 wait complete. 2023-10-09T11:35:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.074+0000 7fc714d3b700 1 Processor -- start 2023-10-09T11:35:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 -- start start 2023-10-09T11:35:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006e0e0 0x7fc71016a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc710159530 0x7fc7100d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100d0670 con 0x7fc71006dc70 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100d1060 con 0x7fc710159530 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc714d3b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100d0d80 con 0x7fc71006e0e0 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36006/0 (socket says 172.21.15.26:36006) 2023-10-09T11:35:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc70e59c700 1 -- 172.21.15.26:0/3484497415 learned_addr learned my addr 172.21.15.26:0/3484497415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc70dd9b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006e0e0 0x7fc71016a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.075+0000 7fc70ed9d700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc710159530 0x7fc7100d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 -- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006e0e0 msgr2=0x7fc71016a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006e0e0 0x7fc71016a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 -- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc710159530 msgr2=0x7fc7100d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc710159530 0x7fc7100d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 -- 172.21.15.26:0/3484497415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080094f0 con 0x7fc71006dc70 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc70e59c700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc710089650 tx=0x7fc708017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708000d10 con 0x7fc71006dc70 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70800bbe0 con 0x7fc71006dc70 2023-10-09T11:35:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708011670 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7100b3520 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.076+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100b3b70 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.077+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71004c3c0 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.077+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc708011a60 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.078+0000 7fc7067fc700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 0x7fc6f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.078+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc708085d90 con 0x7fc71006dc70 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.078+0000 7fc70dd9b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 0x7fc6f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.078+0000 7fc70dd9b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 0x7fc6f00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc71015ee70 tx=0x7fc6f80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.082+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc708052f60 con 0x7fc71006dc70 2023-10-09T11:35:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.277+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7100b39c0 con 0x7fc71006dc70 2023-10-09T11:35:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.277+0000 7fc7067fc700 1 -- 172.21.15.26:0/3484497415 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc708056580 con 0x7fc71006dc70 2023-10-09T11:35:35.280 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 msgr2=0x7fc6f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 0x7fc6f00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc71015ee70 tx=0x7fc6f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 msgr2=0x7fc7100cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc710089650 tx=0x7fc708017000 comp rx=0 tx=0).stop 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 shutdown_connections 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc710159530 0x7fc7100d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71006dc70 0x7fc7100cf2b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6f0066f30 0x7fc6f00693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 --2- 172.21.15.26:0/3484497415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71006e0e0 0x7fc71016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 >> 172.21.15.26:0/3484497415 conn(0x7fc7100703a0 msgr2=0x7fc710070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 shutdown_connections 2023-10-09T11:35:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.279+0000 7fc714d3b700 1 -- 172.21.15.26:0/3484497415 wait complete. 2023-10-09T11:35:35.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.416+0000 7f10a312b700 1 Processor -- start 2023-10-09T11:35:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.416+0000 7f10a312b700 1 -- start start 2023-10-09T11:35:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a312b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f109c0cb5a0 0x7f109c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a312b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f109c15a5d0 0x7f109c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a312b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c15ae40 con 0x7f109c0cd9e0 2023-10-09T11:35:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a312b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c0d13f0 con 0x7f109c15a5d0 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a312b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c15ab60 con 0x7f109c0cb5a0 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a16c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f109c15a5d0 0x7f109c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a16c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f109c15a5d0 0x7f109c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36022/0 (socket says 172.21.15.26:36022) 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.417+0000 7f10a16c8700 1 -- 172.21.15.26:0/2004323415 learned_addr learned my addr 172.21.15.26:0/2004323415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a0ec7700 1 --2- 172.21.15.26:0/2004323415 >> v2:172.21.15.67:3300/0 conn(0x7f109c0cb5a0 0x7f109c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a16c8700 1 -- 172.21.15.26:0/2004323415 >> v2:172.21.15.67:3300/0 conn(0x7f109c0cb5a0 msgr2=0x7f109c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a16c8700 1 --2- 172.21.15.26:0/2004323415 >> v2:172.21.15.67:3300/0 conn(0x7f109c0cb5a0 0x7f109c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a16c8700 1 -- 172.21.15.26:0/2004323415 >> v1:172.21.15.67:6789/0 conn(0x7f109c0cd9e0 legacy=0x7f109c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a16c8700 1 -- 172.21.15.26:0/2004323415 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0ccf00 con 0x7f109c15a5d0 2023-10-09T11:35:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f10a16c8700 1 --2- 172.21.15.26:0/2004323415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c15a5d0 0x7f109c156e90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10840099b0 tx=0x7f1084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7ddb3aa194164 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f109b7fe700 1 -- 172.21.15.26:0/2004323415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400b820 con 0x7f109c15a5d0 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f109b7fe700 1 -- 172.21.15.26:0/2004323415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108400b980 con 0x7f109c15a5d0 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.418+0000 7f109b7fe700 1 -- 172.21.15.26:0/2004323415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400bd20 con 0x7f109c15a5d0 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 -- 172.21.15.26:0/2004323415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c15a5d0 msgr2=0x7f109c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 --2- 172.21.15.26:0/2004323415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c15a5d0 0x7f109c156e90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10840099b0 tx=0x7f1084009250 comp rx=0 tx=0).stop 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 -- 172.21.15.26:0/2004323415 shutdown_connections 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 --2- 172.21.15.26:0/2004323415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c15a5d0 0x7f109c156e90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 --2- 172.21.15.26:0/2004323415 >> v2:172.21.15.67:3300/0 conn(0x7f109c0cb5a0 0x7f109c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 -- 172.21.15.26:0/2004323415 >> 172.21.15.26:0/2004323415 conn(0x7f109c070e30 msgr2=0x7f109c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 -- 172.21.15.26:0/2004323415 shutdown_connections 2023-10-09T11:35:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.419+0000 7f10a312b700 1 -- 172.21.15.26:0/2004323415 wait complete. 2023-10-09T11:35:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.420+0000 7f10a312b700 1 Processor -- start 2023-10-09T11:35:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.420+0000 7f10a312b700 1 -- start start 2023-10-09T11:35:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 0x7f109c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 0x7f109c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0cfd80 con 0x7f109c0cd9e0 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0b5370 con 0x7f109c15a5d0 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0b5650 con 0x7f109c0cb5a0 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36024/0 (socket says 172.21.15.26:36024) 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 -- 172.21.15.26:0/4210580035 learned_addr learned my addr 172.21.15.26:0/4210580035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a0ec7700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 0x7f109c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a16c8700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 0x7f109c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 -- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 msgr2=0x7f109c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 0x7f109c0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 -- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 msgr2=0x7f109c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 0x7f109c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 -- 172.21.15.26:0/4210580035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840094f0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a0ec7700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 0x7f109c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a16c8700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 0x7f109c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f109bfff700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f108c00cb10 tx=0x7f108c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00a7f0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00a970 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c0c77c0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00ad30 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.421+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c0c7d80 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.422+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c04c3c0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.423+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f108c003030 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.423+0000 7f1098ff9700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 0x7f107c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.423+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f108c0846c0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.423+0000 7f10a0ec7700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 0x7f107c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.424+0000 7f10a0ec7700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 0x7f107c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1094006fd0 tx=0x7f1094008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.427+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f108c051930 con 0x7f109c0cd9e0 2023-10-09T11:35:35.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.670+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f109c0cd1e0 con 0x7f109c0cd9e0 2023-10-09T11:35:35.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.670+0000 7f1098ff9700 1 -- 172.21.15.26:0/4210580035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f108c054f50 con 0x7f109c0cd9e0 2023-10-09T11:35:35.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:35.672 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:35.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 msgr2=0x7f107c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 0x7f107c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1094006fd0 tx=0x7f1094008040 comp rx=0 tx=0).stop 2023-10-09T11:35:35.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 msgr2=0x7f109c15f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f108c00cb10 tx=0x7f108c0017b0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 shutdown_connections 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109c15a5d0 0x7f109c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f107c066f30 0x7f107c0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f109c0cb5a0 0x7f109c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 --2- 172.21.15.26:0/4210580035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109c0cd9e0 0x7f109c15f820 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 >> 172.21.15.26:0/4210580035 conn(0x7f109c070e30 msgr2=0x7f109c1551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:35.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 shutdown_connections 2023-10-09T11:35:35.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.673+0000 7f10a312b700 1 -- 172.21.15.26:0/4210580035 wait complete. 2023-10-09T11:35:35.677 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:35.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.804+0000 7f02beb58700 1 Processor -- start 2023-10-09T11:35:35.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.804+0000 7f02beb58700 1 -- start start 2023-10-09T11:35:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02b80cb5a0 0x7f02b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cd9e0 0x7f02b8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 0x7f02b815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b80d13f0 con 0x7f02b80cb5a0 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b815a940 con 0x7f02b80cde50 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02beb58700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815ae40 con 0x7f02b80cd9e0 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02bc8f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02b80cb5a0 0x7f02b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02bc8f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02b80cb5a0 0x7f02b80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36038/0 (socket says 172.21.15.26:36038) 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.805+0000 7f02bc8f4700 1 -- 172.21.15.26:0/589231089 learned_addr learned my addr 172.21.15.26:0/589231089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bd0f5700 1 --2- 172.21.15.26:0/589231089 >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 0x7f02b815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02b7fff700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cd9e0 0x7f02b8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 -- 172.21.15.26:0/589231089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cd9e0 msgr2=0x7f02b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cd9e0 0x7f02b8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 -- 172.21.15.26:0/589231089 >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 msgr2=0x7f02b815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/589231089 >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 0x7f02b815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 -- 172.21.15.26:0/589231089 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b815ab60 con 0x7f02b80cb5a0 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bd0f5700 1 --2- 172.21.15.26:0/589231089 >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 0x7f02b815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cb5a0 0x7f02b80cb970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cbeb0 tx=0x7f02b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6727930711b21c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02b77fe700 1 -- 172.21.15.26:0/589231089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000b820 con 0x7f02b80cb5a0 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02b77fe700 1 -- 172.21.15.26:0/589231089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000b980 con 0x7f02b80cb5a0 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02b77fe700 1 -- 172.21.15.26:0/589231089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000bd20 con 0x7f02b80cb5a0 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02beb58700 1 -- 172.21.15.26:0/589231089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cb5a0 msgr2=0x7f02b80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.806+0000 7f02beb58700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cb5a0 0x7f02b80cb970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cbeb0 tx=0x7f02b0009250 comp rx=0 tx=0).stop 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 -- 172.21.15.26:0/589231089 shutdown_connections 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 --2- 172.21.15.26:0/589231089 >> v2:172.21.15.67:3300/0 conn(0x7f02b80cde50 0x7f02b815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cb5a0 0x7f02b80cb970 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 --2- 172.21.15.26:0/589231089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cd9e0 0x7f02b8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 -- 172.21.15.26:0/589231089 >> 172.21.15.26:0/589231089 conn(0x7f02b8070e30 msgr2=0x7f02b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 -- 172.21.15.26:0/589231089 shutdown_connections 2023-10-09T11:35:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.807+0000 7f02beb58700 1 -- 172.21.15.26:0/589231089 wait complete. 2023-10-09T11:35:35.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.808+0000 7f02beb58700 1 Processor -- start 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.808+0000 7f02beb58700 1 -- start start 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.808+0000 7f02beb58700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cb5a0 0x7f02b815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 0x7f02b80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80c7fa0 con 0x7f02b80cd9e0 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815c7b0 con 0x7f02b815cc40 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815bba0 con 0x7f02b80cb5a0 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36050/0 (socket says 172.21.15.26:36050) 2023-10-09T11:35:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 -- 172.21.15.26:0/2829402840 learned_addr learned my addr 172.21.15.26:0/2829402840 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02bd0f5700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 0x7f02b80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cb5a0 0x7f02b815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 -- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cb5a0 msgr2=0x7f02b815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cb5a0 0x7f02b815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 -- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 msgr2=0x7f02b80c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 0x7f02b80c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 -- 172.21.15.26:0/2829402840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00094f0 con 0x7f02b80cd9e0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02bd0f5700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 0x7f02b80c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b7fff700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e190 tx=0x7f02a8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800ed20 con 0x7f02b80cd9e0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800ee80 con 0x7f02b80cd9e0 2023-10-09T11:35:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b815be80 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8014670 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.809+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b815c440 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.810+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b815c960 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.811+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02a8014a20 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.811+0000 7f02b4ff9700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 0x7f02980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.811+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02a8084bf0 con 0x7f02b80cd9e0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.811+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 0x7f02980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.812+0000 7f02bc8f4700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 0x7f02980693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cbeb0 tx=0x7f02b0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:35.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:35.815+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02b815c960 con 0x7f02b80cd9e0 2023-10-09T11:35:36.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.011+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02b815c920 con 0x7f02b80cd9e0 2023-10-09T11:35:36.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.011+0000 7f02b4ff9700 1 -- 172.21.15.26:0/2829402840 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f02a8051e60 con 0x7f02b80cd9e0 2023-10-09T11:35:36.013 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:36.013 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:36.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 msgr2=0x7f02980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 0x7f02980693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cbeb0 tx=0x7f02b0017000 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 msgr2=0x7f02b80c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e190 tx=0x7f02a8009920 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 shutdown_connections 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02b815cc40 0x7f02b80c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0298066f30 0x7f02980693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02b80cb5a0 0x7f02b815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 --2- 172.21.15.26:0/2829402840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02b80cd9e0 0x7f02b80c7a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 >> 172.21.15.26:0/2829402840 conn(0x7f02b8070e30 msgr2=0x7f02b80b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 shutdown_connections 2023-10-09T11:35:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.014+0000 7f02beb58700 1 -- 172.21.15.26:0/2829402840 wait complete. 2023-10-09T11:35:36.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:36.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:36.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.148+0000 7f84fb6b8700 1 Processor -- start 2023-10-09T11:35:36.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.148+0000 7f84fb6b8700 1 -- start start 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84fb6b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f406dc70 0x7f84f4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84fb6b8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84f406e0e0 0x7f84f40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84fb6b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40ccfd0 con 0x7f84f4159530 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84fb6b8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f415a3d0 con 0x7f84f406dc70 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84fb6b8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f415a6b0 con 0x7f84f406e0e0 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84f8c53700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f406dc70 0x7f84f4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84f8c53700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f406dc70 0x7f84f4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36058/0 (socket says 172.21.15.26:36058) 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84f9454700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84f4159530 0x7f84f40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33560/0 (socket says 172.21.15.26:33560) 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84f8c53700 1 -- 172.21.15.26:0/1002982931 learned_addr learned my addr 172.21.15.26:0/1002982931 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.149+0000 7f84f9c55700 1 --2- 172.21.15.26:0/1002982931 >> v2:172.21.15.67:3300/0 conn(0x7f84f406e0e0 0x7f84f40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f8c53700 1 -- 172.21.15.26:0/1002982931 >> v2:172.21.15.67:3300/0 conn(0x7f84f406e0e0 msgr2=0x7f84f40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f8c53700 1 --2- 172.21.15.26:0/1002982931 >> v2:172.21.15.67:3300/0 conn(0x7f84f406e0e0 0x7f84f40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f8c53700 1 -- 172.21.15.26:0/1002982931 >> v1:172.21.15.26:6789/0 conn(0x7f84f4159530 legacy=0x7f84f40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f8c53700 1 -- 172.21.15.26:0/1002982931 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f415a990 con 0x7f84f406dc70 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f3fff700 1 -- 172.21.15.26:0/1002982931 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235631518 0 0) 0x7f84f40ccfd0 con 0x7f84f4159530 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f8c53700 1 --2- 172.21.15.26:0/1002982931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f4159900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84f40cf2b0 tx=0x7f84e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e05cf0806d5df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f3fff700 1 -- 172.21.15.26:0/1002982931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8009e70 con 0x7f84f406dc70 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f3fff700 1 -- 172.21.15.26:0/1002982931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800b860 con 0x7f84f406dc70 2023-10-09T11:35:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84f3fff700 1 -- 172.21.15.26:0/1002982931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800bc00 con 0x7f84f406dc70 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 -- 172.21.15.26:0/1002982931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 msgr2=0x7f84f4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/1002982931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f4159900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84f40cf2b0 tx=0x7f84e8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 -- 172.21.15.26:0/1002982931 shutdown_connections 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/1002982931 >> v2:172.21.15.67:3300/0 conn(0x7f84f406e0e0 0x7f84f40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/1002982931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f4159900 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 -- 172.21.15.26:0/1002982931 >> 172.21.15.26:0/1002982931 conn(0x7f84f40703a0 msgr2=0x7f84f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.150+0000 7f84fb6b8700 1 -- 172.21.15.26:0/1002982931 shutdown_connections 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.151+0000 7f84fb6b8700 1 -- 172.21.15.26:0/1002982931 wait complete. 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 Processor -- start 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 -- start start 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f406e0e0 0x7f84f40c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f4159530 0x7f84f40b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40b4720 con 0x7f84f406dc70 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40b3b10 con 0x7f84f406e0e0 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.152+0000 7f84fb6b8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40b3df0 con 0x7f84f4159530 2023-10-09T11:35:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36064/0 (socket says 172.21.15.26:36064) 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 -- 172.21.15.26:0/431089835 learned_addr learned my addr 172.21.15.26:0/431089835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f8c53700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f406e0e0 0x7f84f40c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9c55700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f4159530 0x7f84f40b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 -- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f4159530 msgr2=0x7f84f40b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f4159530 0x7f84f40b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 -- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f406e0e0 msgr2=0x7f84f40c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f406e0e0 0x7f84f40c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 -- 172.21.15.26:0/431089835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80094f0 con 0x7f84f406dc70 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f9454700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec005a70 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec005bd0 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f40b40d0 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0070d0 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.153+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f40c88a0 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.154+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f404c3c0 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.154+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84ec007480 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.155+0000 7f84f17fa700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.155+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84ec083a20 con 0x7f84f406dc70 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.155+0000 7f84f8c53700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.155+0000 7f84f8c53700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 0x7f84e00693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84f40cf2b0 tx=0x7f84e8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.159+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84ec050c90 con 0x7f84f406dc70 2023-10-09T11:35:36.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.350+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84f415ac70 con 0x7f84f406dc70 2023-10-09T11:35:36.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.351+0000 7f84f17fa700 1 -- 172.21.15.26:0/431089835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84ec017020 con 0x7f84f406dc70 2023-10-09T11:35:36.352 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.352+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 msgr2=0x7f84e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.352+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 0x7f84e00693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84f40cf2b0 tx=0x7f84e8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.352+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 msgr2=0x7f84f40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.352+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec001040 comp rx=0 tx=0).stop 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 shutdown_connections 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f4159530 0x7f84f40b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f406dc70 0x7f84f40b3480 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 --2- 172.21.15.26:0/431089835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f406e0e0 0x7f84f40c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 >> 172.21.15.26:0/431089835 conn(0x7f84f40703a0 msgr2=0x7f84f40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 shutdown_connections 2023-10-09T11:35:36.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.353+0000 7f84fb6b8700 1 -- 172.21.15.26:0/431089835 wait complete. 2023-10-09T11:35:36.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:36.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.486+0000 7f4952ee3700 1 Processor -- start 2023-10-09T11:35:36.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.486+0000 7f4952ee3700 1 -- start start 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4952ee3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f494c06e0e0 0x7f494c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4952ee3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0ccfd0 con 0x7f494c159530 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4952ee3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c15a3d0 con 0x7f494c06dc70 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4952ee3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c15a6b0 con 0x7f494c06e0e0 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4951480700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f494c06e0e0 0x7f494c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4950c7f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f494c159530 0x7f494c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33576/0 (socket says 172.21.15.26:33576) 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.487+0000 7f4950c7f700 1 -- 172.21.15.26:0/2879312710 learned_addr learned my addr 172.21.15.26:0/2879312710 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4951480700 1 -- 172.21.15.26:0/2879312710 >> v1:172.21.15.67:6789/0 conn(0x7f494c06dc70 legacy=0x7f494c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f494b7fe700 1 -- 172.21.15.26:0/2879312710 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235727513 0 0) 0x7f494c0ccfd0 con 0x7f494c159530 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4951480700 1 -- 172.21.15.26:0/2879312710 >> v1:172.21.15.26:6789/0 conn(0x7f494c159530 legacy=0x7f494c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4951480700 1 -- 172.21.15.26:0/2879312710 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c15a990 con 0x7f494c06e0e0 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4951480700 1 --2- 172.21.15.26:0/2879312710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06e0e0 0x7f494c0cb6f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4944009de0 tx=0x7f4944009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785dd5ea4f9898ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f494b7fe700 1 -- 172.21.15.26:0/2879312710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400e070 con 0x7f494c06e0e0 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f494b7fe700 1 -- 172.21.15.26:0/2879312710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400bbb0 con 0x7f494c06e0e0 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f494b7fe700 1 -- 172.21.15.26:0/2879312710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944012430 con 0x7f494c06e0e0 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 -- 172.21.15.26:0/2879312710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06e0e0 msgr2=0x7f494c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 --2- 172.21.15.26:0/2879312710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06e0e0 0x7f494c0cb6f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4944009de0 tx=0x7f4944009780 comp rx=0 tx=0).stop 2023-10-09T11:35:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 -- 172.21.15.26:0/2879312710 shutdown_connections 2023-10-09T11:35:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 --2- 172.21.15.26:0/2879312710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06e0e0 0x7f494c0cb6f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 -- 172.21.15.26:0/2879312710 >> 172.21.15.26:0/2879312710 conn(0x7f494c0703a0 msgr2=0x7f494c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 -- 172.21.15.26:0/2879312710 shutdown_connections 2023-10-09T11:35:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.488+0000 7f4952ee3700 1 -- 172.21.15.26:0/2879312710 wait complete. 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 Processor -- start 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 -- start start 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c06e0e0 0x7f494c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f494c159530 0x7f494c0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c80c0 con 0x7f494c06dc70 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c157540 con 0x7f494c06e0e0 2023-10-09T11:35:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.490+0000 7f4952ee3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0ca7c0 con 0x7f494c159530 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36084/0 (socket says 172.21.15.26:36084) 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 -- 172.21.15.26:0/872248456 learned_addr learned my addr 172.21.15.26:0/872248456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4951480700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f494c159530 0x7f494c0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f494bfff700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c06e0e0 0x7f494c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 -- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f494c159530 msgr2=0x7f494c0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f494c159530 0x7f494c0c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 -- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c06e0e0 msgr2=0x7f494c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c06e0e0 0x7f494c15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 -- 172.21.15.26:0/872248456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009a20 con 0x7f494c06dc70 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4950c7f700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c560 tx=0x7f493c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c005b30 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c005c90 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0c7790 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c007320 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.491+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c16aa60 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.492+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c0c7f10 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.493+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f493c01b3b0 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.493+0000 7f4948ff9700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 0x7f49380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.493+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f493c083950 con 0x7f494c06dc70 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.493+0000 7f494bfff700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 0x7f49380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.494+0000 7f494bfff700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 0x7f49380693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f494c1542f0 tx=0x7f4940007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.497+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f493c050bc0 con 0x7f494c06dc70 2023-10-09T11:35:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.688+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f494c04c3c0 con 0x7f494c06dc70 2023-10-09T11:35:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.689+0000 7f4948ff9700 1 -- 172.21.15.26:0/872248456 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f493c017020 con 0x7f494c06dc70 2023-10-09T11:35:36.690 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:36.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 msgr2=0x7f49380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 0x7f49380693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f494c1542f0 tx=0x7f4940007ea0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 msgr2=0x7f494c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c560 tx=0x7f493c000fe0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 shutdown_connections 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4938066f30 0x7f49380693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f494c159530 0x7f494c0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c06dc70 0x7f494c157000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 --2- 172.21.15.26:0/872248456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c06e0e0 0x7f494c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 >> 172.21.15.26:0/872248456 conn(0x7f494c0703a0 msgr2=0x7f494c0ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 shutdown_connections 2023-10-09T11:35:36.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.691+0000 7f4952ee3700 1 -- 172.21.15.26:0/872248456 wait complete. 2023-10-09T11:35:36.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.825+0000 7f544594a700 1 Processor -- start 2023-10-09T11:35:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.825+0000 7f544594a700 1 -- start start 2023-10-09T11:35:36.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f544594a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f544594a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 0x7f544006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f544594a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400ca2b0 con 0x7f5440156690 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f544594a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400c96e0 con 0x7f54401562c0 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f544594a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544006bb30 con 0x7f54400af5c0 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f543effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f543e7fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 0x7f544006b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f543f7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5440156690 0x7f544006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:47050/0 (socket says 172.21.15.26:47050) 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f543effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:40166/0 (socket says 172.21.15.26:40166) 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.826+0000 7f543f7fe700 1 -- 172.21.15.26:0/2075617601 learned_addr learned my addr 172.21.15.26:0/2075617601 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543dffb700 1 -- 172.21.15.26:0/2075617601 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153539824 0 0) 0x7f54400ca2b0 con 0x7f5440156690 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543dffb700 1 -- 172.21.15.26:0/2075617601 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f542c003570 con 0x7f5440156690 2023-10-09T11:35:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543e7fc700 1 -- 172.21.15.26:0/2075617601 >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 msgr2=0x7f54400ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543e7fc700 1 --2- 172.21.15.26:0/2075617601 >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543e7fc700 1 -- 172.21.15.26:0/2075617601 >> v1:172.21.15.67:6789/0 conn(0x7f5440156690 legacy=0x7f544006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543e7fc700 1 -- 172.21.15.26:0/2075617601 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544006be10 con 0x7f54400af5c0 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543effd700 1 --2- 172.21.15.26:0/2075617601 >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543e7fc700 1 --2- 172.21.15.26:0/2075617601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 0x7f544006b1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54280098e0 tx=0x7f54280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d74d81aae964b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543dffb700 1 -- 172.21.15.26:0/2075617601 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428011630 con 0x7f54400af5c0 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543dffb700 1 -- 172.21.15.26:0/2075617601 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428011790 con 0x7f54400af5c0 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.827+0000 7f543dffb700 1 -- 172.21.15.26:0/2075617601 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428011b10 con 0x7f54400af5c0 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 -- 172.21.15.26:0/2075617601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 msgr2=0x7f544006b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 --2- 172.21.15.26:0/2075617601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 0x7f544006b1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54280098e0 tx=0x7f54280091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 -- 172.21.15.26:0/2075617601 shutdown_connections 2023-10-09T11:35:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 --2- 172.21.15.26:0/2075617601 >> v2:172.21.15.67:3300/0 conn(0x7f54401562c0 0x7f54400ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 --2- 172.21.15.26:0/2075617601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54400af5c0 0x7f544006b1c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 -- 172.21.15.26:0/2075617601 >> 172.21.15.26:0/2075617601 conn(0x7f54400675a0 msgr2=0x7f54400679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 -- 172.21.15.26:0/2075617601 shutdown_connections 2023-10-09T11:35:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.828+0000 7f544594a700 1 -- 172.21.15.26:0/2075617601 wait complete. 2023-10-09T11:35:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.829+0000 7f544594a700 1 Processor -- start 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.829+0000 7f544594a700 1 -- start start 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54401562c0 0x7f544014be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 0x7f544014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544014c350 con 0x7f54400af5c0 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440157900 con 0x7f54401562c0 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5440157be0 con 0x7f5440156690 2023-10-09T11:35:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36086/0 (socket says 172.21.15.26:36086) 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 -- 172.21.15.26:0/1864122476 learned_addr learned my addr 172.21.15.26:0/1864122476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543e7fc700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54401562c0 0x7f544014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543f7fe700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 0x7f544014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 -- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 msgr2=0x7f544014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 0x7f544014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 -- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54401562c0 msgr2=0x7f544014be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54401562c0 0x7f544014be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 -- 172.21.15.26:0/1864122476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009420 con 0x7f54400af5c0 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543f7fe700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 0x7f544014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f543effd700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f543800ec80 tx=0x7f54380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800c9d0 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800cb30 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5428009420 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.830+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800ceb0 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.831+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54401581a0 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.831+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54400c57e0 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.832+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5438013680 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.832+0000 7f5436ffd700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.832+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5438084990 con 0x7f54400af5c0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.832+0000 7f543e7fc700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.833+0000 7f543e7fc700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 0x7f54200693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54400af990 tx=0x7f5428017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:36.837+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5438051c00 con 0x7f54400af5c0 2023-10-09T11:35:37.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.028+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5440158510 con 0x7f54400af5c0 2023-10-09T11:35:37.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.029+0000 7f5436ffd700 1 -- 172.21.15.26:0/1864122476 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5438055220 con 0x7f54400af5c0 2023-10-09T11:35:37.031 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:37.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.030+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 msgr2=0x7f54200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.030+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 0x7f54200693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54400af990 tx=0x7f5428017000 comp rx=0 tx=0).stop 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 msgr2=0x7f544014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f543800ec80 tx=0x7f54380091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 shutdown_connections 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5440156690 0x7f544014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400af5c0 0x7f544014c730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 --2- 172.21.15.26:0/1864122476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54401562c0 0x7f544014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 >> 172.21.15.26:0/1864122476 conn(0x7f54400675a0 msgr2=0x7f54400aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 shutdown_connections 2023-10-09T11:35:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.031+0000 7f544594a700 1 -- 172.21.15.26:0/1864122476 wait complete. 2023-10-09T11:35:37.044 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.161+0000 7fa32c8cc700 1 Processor -- start 2023-10-09T11:35:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.161+0000 7fa32c8cc700 1 -- start start 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32c8cc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 0x7fa328164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32c8cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32815afd0 con 0x7fa328153c30 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32c8cc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32815b2b0 con 0x7fa32815de50 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32c8cc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32815b590 con 0x7fa3280cf110 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa326d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa328153c30 0x7fa32815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33586/0 (socket says 172.21.15.26:33586) 2023-10-09T11:35:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa326d9d700 1 -- 172.21.15.26:0/804834180 learned_addr learned my addr 172.21.15.26:0/804834180 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32759e700 1 --2- 172.21.15.26:0/804834180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 0x7fa328164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829354367 0 0) 0x7fa32815afd0 con 0x7fa328153c30 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa314003570 con 0x7fa328153c30 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753912704 0 0) 0x7fa32815b2b0 con 0x7fa32815de50 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32815afd0 con 0x7fa32815de50 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32759e700 1 -- 172.21.15.26:0/804834180 >> v1:172.21.15.67:6789/0 conn(0x7fa32815de50 legacy=0x7fa3280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32759e700 1 -- 172.21.15.26:0/804834180 >> v1:172.21.15.26:6789/0 conn(0x7fa328153c30 legacy=0x7fa32815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.162+0000 7fa32759e700 1 -- 172.21.15.26:0/804834180 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32815b870 con 0x7fa3280cf110 2023-10-09T11:35:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32759e700 1 --2- 172.21.15.26:0/804834180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 0x7fa328164600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e90 tx=0x7fa318009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1282f21c5bfcf55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800e070 con 0x7fa3280cf110 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800bb80 con 0x7fa3280cf110 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa325d9b700 1 -- 172.21.15.26:0/804834180 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318012430 con 0x7fa3280cf110 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 -- 172.21.15.26:0/804834180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 msgr2=0x7fa328164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/804834180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 0x7fa328164600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e90 tx=0x7fa318009780 comp rx=0 tx=0).stop 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 -- 172.21.15.26:0/804834180 shutdown_connections 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/804834180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3280cf110 0x7fa328164600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 -- 172.21.15.26:0/804834180 >> 172.21.15.26:0/804834180 conn(0x7fa3280703a0 msgr2=0x7fa3280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 -- 172.21.15.26:0/804834180 shutdown_connections 2023-10-09T11:35:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.163+0000 7fa32c8cc700 1 -- 172.21.15.26:0/804834180 wait complete. 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 Processor -- start 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 -- start start 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280cf110 0x7fa3280cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa32815de50 0x7fa3280cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280cc330 con 0x7fa328153c30 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280cc610 con 0x7fa3280cf110 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32c8cc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280cc8f0 con 0x7fa32815de50 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36096/0 (socket says 172.21.15.26:36096) 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32659c700 1 -- 172.21.15.26:0/245776842 learned_addr learned my addr 172.21.15.26:0/245776842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa326d9d700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280cf110 0x7fa3280cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.165+0000 7fa32759e700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa32815de50 0x7fa3280cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 -- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa32815de50 msgr2=0x7fa3280cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa32815de50 0x7fa3280cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 -- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280cf110 msgr2=0x7fa3280cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280cf110 0x7fa3280cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 -- 172.21.15.26:0/245776842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009a20 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32659c700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c580 tx=0x7fa310007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310010510 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310010670 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310010a30 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280ccbd0 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.166+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32813f350 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.167+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32804c3c0 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.167+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa31001b400 con 0x7fa328153c30 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.168+0000 7fa31effd700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.168+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3100840a0 con 0x7fa328153c30 2023-10-09T11:35:37.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.168+0000 7fa326d9d700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.168+0000 7fa326d9d700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa320007fd0 tx=0x7fa320009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.172+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa310051310 con 0x7fa328153c30 2023-10-09T11:35:37.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.409+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3280caef0 con 0x7fa328153c30 2023-10-09T11:35:37.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.409+0000 7fa31effd700 1 -- 172.21.15.26:0/245776842 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fa310054930 con 0x7fa328153c30 2023-10-09T11:35:37.411 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:37.411 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 msgr2=0x7fa3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa320007fd0 tx=0x7fa320009040 comp rx=0 tx=0).stop 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 msgr2=0x7fa32813ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c580 tx=0x7fa310007e10 comp rx=0 tx=0).stop 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 shutdown_connections 2023-10-09T11:35:37.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa32815de50 0x7fa3280cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280cf110 0x7fa3280cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 --2- 172.21.15.26:0/245776842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa328153c30 0x7fa32813ee10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 >> 172.21.15.26:0/245776842 conn(0x7fa3280703a0 msgr2=0x7fa328070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 shutdown_connections 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.411+0000 7fa32c8cc700 1 -- 172.21.15.26:0/245776842 wait complete. 2023-10-09T11:35:37.414 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:37.425 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.542+0000 7f9fe7cec700 1 Processor -- start 2023-10-09T11:35:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.542+0000 7f9fe7cec700 1 -- start start 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe7cec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe00cb5a0 0x7f9fe00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe7cec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fe015a5d0 0x7f9fe0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe7cec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe015ae40 con 0x7f9fe00cd9e0 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe7cec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe00d13f0 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe7cec700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe015ab60 con 0x7f9fe015a5d0 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe5a88700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe00cb5a0 0x7f9fe00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe5a88700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe00cb5a0 0x7f9fe00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36100/0 (socket says 172.21.15.26:36100) 2023-10-09T11:35:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe5287700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9fe00cd9e0 0x7f9fe0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33590/0 (socket says 172.21.15.26:33590) 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe5a88700 1 -- 172.21.15.26:0/3529282528 learned_addr learned my addr 172.21.15.26:0/3529282528 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.543+0000 7f9fe6289700 1 --2- 172.21.15.26:0/3529282528 >> v2:172.21.15.67:3300/0 conn(0x7f9fe015a5d0 0x7f9fe0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe5a88700 1 -- 172.21.15.26:0/3529282528 >> v2:172.21.15.67:3300/0 conn(0x7f9fe015a5d0 msgr2=0x7f9fe0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe5a88700 1 --2- 172.21.15.26:0/3529282528 >> v2:172.21.15.67:3300/0 conn(0x7f9fe015a5d0 0x7f9fe0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe5a88700 1 -- 172.21.15.26:0/3529282528 >> v1:172.21.15.26:6789/0 conn(0x7f9fe00cd9e0 legacy=0x7f9fe0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe4a86700 1 -- 172.21.15.26:0/3529282528 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177910878 0 0) 0x7f9fe015ae40 con 0x7f9fe00cd9e0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe5a88700 1 -- 172.21.15.26:0/3529282528 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00ccf00 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe5a88700 1 --2- 172.21.15.26:0/3529282528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe00cb5a0 0x7f9fe00cb970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80099b0 tx=0x7f9fd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40f0f1f611a958e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe4a86700 1 -- 172.21.15.26:0/3529282528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800b820 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe4a86700 1 -- 172.21.15.26:0/3529282528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800b980 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe4a86700 1 -- 172.21.15.26:0/3529282528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800bd20 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 -- 172.21.15.26:0/3529282528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe00cb5a0 msgr2=0x7f9fe00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/3529282528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe00cb5a0 0x7f9fe00cb970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80099b0 tx=0x7f9fd8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 -- 172.21.15.26:0/3529282528 shutdown_connections 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/3529282528 >> v2:172.21.15.67:3300/0 conn(0x7f9fe015a5d0 0x7f9fe0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/3529282528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe00cb5a0 0x7f9fe00cb970 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.544+0000 7f9fe7cec700 1 -- 172.21.15.26:0/3529282528 >> 172.21.15.26:0/3529282528 conn(0x7f9fe0070e30 msgr2=0x7f9fe00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.545+0000 7f9fe7cec700 1 -- 172.21.15.26:0/3529282528 shutdown_connections 2023-10-09T11:35:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.545+0000 7f9fe7cec700 1 -- 172.21.15.26:0/3529282528 wait complete. 2023-10-09T11:35:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 Processor -- start 2023-10-09T11:35:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 -- start start 2023-10-09T11:35:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fe00cb5a0 0x7f9fe0151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe00cd9e0 0x7f9fe0159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0158fb0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0151b40 con 0x7f9fe00cd9e0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe7cec700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01583e0 con 0x7f9fe00cb5a0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe6289700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe6289700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36104/0 (socket says 172.21.15.26:36104) 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe6289700 1 -- 172.21.15.26:0/805484261 learned_addr learned my addr 172.21.15.26:0/805484261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.546+0000 7f9fe5a88700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fe00cb5a0 0x7f9fe0151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe5287700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe00cd9e0 0x7f9fe0159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 -- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fe00cb5a0 msgr2=0x7f9fe0151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fe00cb5a0 0x7f9fe0151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 -- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe00cd9e0 msgr2=0x7f9fe0159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe00cd9e0 0x7f9fe0159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 -- 172.21.15.26:0/805484261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80094f0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe6289700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007f20 tx=0x7f9fd0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000eb90 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000ed10 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe0158680 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0014670 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.547+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe0158c40 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.548+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe004c3c0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.548+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd00149e0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.549+0000 7f9fddffb700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.549+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fd0084ae0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.549+0000 7f9fe5a88700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.550+0000 7f9fe5a88700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80099b0 tx=0x7f9fd8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.553+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd0051d50 con 0x7f9fe015a5d0 2023-10-09T11:35:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.748+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fe01590f0 con 0x7f9fe015a5d0 2023-10-09T11:35:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.749+0000 7f9fddffb700 1 -- 172.21.15.26:0/805484261 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9fd0055370 con 0x7f9fe015a5d0 2023-10-09T11:35:37.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:37.751 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 msgr2=0x7f9fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80099b0 tx=0x7f9fd8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:37.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 msgr2=0x7f9fe0152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007f20 tx=0x7f9fd0009860 comp rx=0 tx=0).stop 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 shutdown_connections 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe015a5d0 0x7f9fe0152da0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fe00cb5a0 0x7f9fe0151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 --2- 172.21.15.26:0/805484261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe00cd9e0 0x7f9fe0159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.751+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 >> 172.21.15.26:0/805484261 conn(0x7f9fe0070e30 msgr2=0x7f9fe0155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.752+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 shutdown_connections 2023-10-09T11:35:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.752+0000 7f9fe7cec700 1 -- 172.21.15.26:0/805484261 wait complete. 2023-10-09T11:35:37.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.882+0000 7f2096302700 1 Processor -- start 2023-10-09T11:35:37.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.882+0000 7f2096302700 1 -- start start 2023-10-09T11:35:37.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2096302700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2090164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2096302700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209015afd0 con 0x7f2090153c30 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2096302700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209015b2b0 con 0x7f209015de50 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2096302700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209015b590 con 0x7f20900cf110 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2095300700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2090153c30 0x7f209015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33594/0 (socket says 172.21.15.26:33594) 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2095300700 1 -- 172.21.15.26:0/1187379286 learned_addr learned my addr 172.21.15.26:0/1187379286 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2090164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263491772 0 0) 0x7f209015afd0 con 0x7f2090153c30 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.883+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2078003570 con 0x7f2090153c30 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1417023124 0 0) 0x7f2078003570 con 0x7f2090153c30 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 msgr2=0x7f2090164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2090164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 >> v1:172.21.15.67:6789/0 conn(0x7f209015de50 legacy=0x7f20900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209015b870 con 0x7f2090153c30 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f2088001470 con 0x7f2090153c30 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2090164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 >> v1:172.21.15.26:6789/0 conn(0x7f2090153c30 legacy=0x7f209015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2078003a90 0x7f2078003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2078004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2078004d50 0x7f20780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209015b590 con 0x7f2078004d50 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207800bb10 con 0x7f2078003a90 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207800bca0 con 0x7f20900cf110 2023-10-09T11:35:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2078004d50 0x7f20780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095300700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2078003a90 0x7f2078003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2094aff700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2078004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 -- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 msgr2=0x7f2078004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900cf110 0x7f2078004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 -- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2078003a90 msgr2=0x7f2078003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2078003a90 0x7f2078003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 -- 172.21.15.26:0/1187379286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080009a20 con 0x7f2078004d50 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f2095b01700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2078004d50 0x7f20780051c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f208000e3f0 tx=0x7f208000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148a0ac8136bcc88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080009c50 con 0x7f2078004d50 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208000f040 con 0x7f2078004d50 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.884+0000 7f208ffff700 1 -- 172.21.15.26:0/1187379286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000eed0 con 0x7f2078004d50 2023-10-09T11:35:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 -- 172.21.15.26:0/1187379286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2078004d50 msgr2=0x7f20780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 --2- 172.21.15.26:0/1187379286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2078004d50 0x7f20780051c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f208000e3f0 tx=0x7f208000b040 comp rx=0 tx=0).stop 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2095b01700 1 -- 172.21.15.26:0/1187379286 reap_dead start 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 -- 172.21.15.26:0/1187379286 shutdown_connections 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 -- 172.21.15.26:0/1187379286 >> 172.21.15.26:0/1187379286 conn(0x7f20900703a0 msgr2=0x7f20900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 -- 172.21.15.26:0/1187379286 shutdown_connections 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.885+0000 7f2096302700 1 -- 172.21.15.26:0/1187379286 wait complete. 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.886+0000 7f2096302700 1 Processor -- start 2023-10-09T11:35:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.886+0000 7f2096302700 1 -- start start 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901524d0 0x7f20900c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900c75e0 0x7f20900c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900b46c0 con 0x7f2090169690 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c7f90 con 0x7f20900c75e0 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2096302700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c97a0 con 0x7f20901524d0 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36134/0 (socket says 172.21.15.26:36134) 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 -- 172.21.15.26:0/2373466184 learned_addr learned my addr 172.21.15.26:0/2373466184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095300700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901524d0 0x7f20900c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2094aff700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900c75e0 0x7f20900c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 -- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901524d0 msgr2=0x7f20900c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901524d0 0x7f20900c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 -- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900c75e0 msgr2=0x7f20900c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900c75e0 0x7f20900c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.887+0000 7f2095b01700 1 -- 172.21.15.26:0/2373466184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900c81c0 con 0x7f2090169690 2023-10-09T11:35:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f2095b01700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2078004750 tx=0x7f208001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080009c50 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208001d630 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900c84a0 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208001d9f0 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.888+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20900c8a60 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.889+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209004c3c0 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.889+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2080003040 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.890+0000 7f208d7fa700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 0x7f207c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.890+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2080085d10 con 0x7f2090169690 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.890+0000 7f2095300700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 0x7f207c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.891+0000 7f2095300700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 0x7f207c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2088004890 tx=0x7f2090159c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:37.894+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2080053000 con 0x7f2090169690 2023-10-09T11:35:38.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.129+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20900caef0 con 0x7f2090169690 2023-10-09T11:35:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.130+0000 7f208d7fa700 1 -- 172.21.15.26:0/2373466184 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f2080056620 con 0x7f2090169690 2023-10-09T11:35:38.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:38.131 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:38.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 msgr2=0x7f207c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 0x7f207c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2088004890 tx=0x7f2090159c60 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 msgr2=0x7f2090169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2078004750 tx=0x7f208001a000 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 shutdown_connections 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2090169690 0x7f2090169b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f207c066f30 0x7f207c0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901524d0 0x7f20900c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 --2- 172.21.15.26:0/2373466184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900c75e0 0x7f20900c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 >> 172.21.15.26:0/2373466184 conn(0x7f20900703a0 msgr2=0x7f2090152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 shutdown_connections 2023-10-09T11:35:38.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.132+0000 7f2096302700 1 -- 172.21.15.26:0/2373466184 wait complete. 2023-10-09T11:35:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:38.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:35:23.749143+0000', 'modified': '2023-10-09T11:35:27.357164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/1658898397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 1658898397}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 1658898397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:35:38.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:35:38.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:35:38.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.669+0000 7f8636214700 1 Processor -- start 2023-10-09T11:35:38.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.669+0000 7f8636214700 1 -- start start 2023-10-09T11:35:38.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f8636214700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86300cb5a0 0x7f86300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f8636214700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f8630159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f8636214700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863015ae40 con 0x7f86300cde50 2023-10-09T11:35:38.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f8636214700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300d13f0 con 0x7f86300cb5a0 2023-10-09T11:35:38.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f8636214700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863015ab60 con 0x7f86300cd9e0 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f862f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86300cb5a0 0x7f86300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f862f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86300cb5a0 0x7f86300cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36136/0 (socket says 172.21.15.26:36136) 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.670+0000 7f862f7fe700 1 -- 172.21.15.26:0/3035687116 learned_addr learned my addr 172.21.15.26:0/3035687116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862effd700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f8630159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862f7fe700 1 -- 172.21.15.26:0/3035687116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 msgr2=0x7f8630159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f8630159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862f7fe700 1 -- 172.21.15.26:0/3035687116 >> v1:172.21.15.67:6789/0 conn(0x7f86300cde50 legacy=0x7f8630156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862f7fe700 1 -- 172.21.15.26:0/3035687116 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300ccf00 con 0x7f86300cb5a0 2023-10-09T11:35:38.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862effd700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f8630159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86300cb5a0 0x7f86300cb970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86200099b0 tx=0x7f8620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc6cfd92bd52617 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862e7fc700 1 -- 172.21.15.26:0/3035687116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000b820 con 0x7f86300cb5a0 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862e7fc700 1 -- 172.21.15.26:0/3035687116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862000b980 con 0x7f86300cb5a0 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f862e7fc700 1 -- 172.21.15.26:0/3035687116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000bd20 con 0x7f86300cb5a0 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 -- 172.21.15.26:0/3035687116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86300cb5a0 msgr2=0x7f86300cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86300cb5a0 0x7f86300cb970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86200099b0 tx=0x7f8620009250 comp rx=0 tx=0).stop 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 -- 172.21.15.26:0/3035687116 shutdown_connections 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86300cb5a0 0x7f86300cb970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 --2- 172.21.15.26:0/3035687116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f8630159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 -- 172.21.15.26:0/3035687116 >> 172.21.15.26:0/3035687116 conn(0x7f8630070e30 msgr2=0x7f86300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 -- 172.21.15.26:0/3035687116 shutdown_connections 2023-10-09T11:35:38.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.671+0000 7f8636214700 1 -- 172.21.15.26:0/3035687116 wait complete. 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 Processor -- start 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 -- start start 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86300cb5a0 0x7f86300b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f86300c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c8fc0 con 0x7f86301699e0 2023-10-09T11:35:38.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c8260 con 0x7f86300cb5a0 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.673+0000 7f8636214700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c8540 con 0x7f86300cd9e0 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36138/0 (socket says 172.21.15.26:36138) 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 -- 172.21.15.26:0/3892180950 learned_addr learned my addr 172.21.15.26:0/3892180950 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86300cb5a0 0x7f86300b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862effd700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f86300c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 -- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 msgr2=0x7f86300c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f86300c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 -- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86300cb5a0 msgr2=0x7f86300b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86300cb5a0 0x7f86300b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 -- 172.21.15.26:0/3892180950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200094f0 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f862ffff700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f862800bc30 tx=0x7f8628009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f86177fe700 1 -- 172.21.15.26:0/3892180950 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800c840 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f86177fe700 1 -- 172.21.15.26:0/3892180950 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800c9e0 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300c9210 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f86177fe700 1 -- 172.21.15.26:0/3892180950 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800cda0 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.674+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8630159e00 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.676+0000 7f86177fe700 1 -- 172.21.15.26:0/3892180950 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8628014620 con 0x7f86301699e0 2023-10-09T11:35:38.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.676+0000 7f86177fe700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.676+0000 7f86177fe700 1 -- 172.21.15.26:0/3892180950 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8628084460 con 0x7f86301699e0 2023-10-09T11:35:38.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.677+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.677+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86200099b0 tx=0x7f8620016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.678+0000 7f863f50cb80 1 Processor -- start 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.678+0000 7f863f50cb80 1 -- start start 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864c0f60 0x55b686493cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6863eea70 con 0x55b686497a50 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6863ec270 con 0x55b6864c0f60 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6863e8060 con 0x55b6864e1d00 2023-10-09T11:35:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36146/0 (socket says 172.21.15.26:36146) 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 -- 172.21.15.26:0/1995564401 learned_addr learned my addr 172.21.15.26:0/1995564401 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862effd700 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862ffff700 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864c0f60 0x55b686493cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 -- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 msgr2=0x55b6864c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 -- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864c0f60 msgr2=0x55b686493cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864c0f60 0x55b686493cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.679+0000 7f862f7fe700 1 -- 172.21.15.26:0/1995564401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b686282270 con 0x55b686497a50 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f862f7fe700 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f862000bd80 tx=0x7f8620021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb68c49cc918b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f8614ff9700 1 -- 172.21.15.26:0/1995564401 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620021070 con 0x55b686497a50 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f8614ff9700 1 -- 172.21.15.26:0/1995564401 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862000be80 con 0x55b686497a50 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f8614ff9700 1 -- 172.21.15.26:0/1995564401 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011ac0 con 0x55b686497a50 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 -- 172.21.15.26:0/1995564401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 msgr2=0x55b686497e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f862000bd80 tx=0x7f8620021000 comp rx=0 tx=0).stop 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 -- 172.21.15.26:0/1995564401 shutdown_connections 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864c0f60 0x55b686493cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b686497e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.680+0000 7f863f50cb80 1 --2- 172.21.15.26:0/1995564401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.681+0000 7f863f50cb80 1 -- 172.21.15.26:0/1995564401 >> 172.21.15.26:0/1995564401 conn(0x55b686499370 msgr2=0x55b686499740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.681+0000 7f863f50cb80 1 -- 172.21.15.26:0/1995564401 shutdown_connections 2023-10-09T11:35:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.681+0000 7f863f50cb80 1 -- 172.21.15.26:0/1995564401 wait complete. 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.681+0000 7f863f50cb80 1 -- start start 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.681+0000 7f863f50cb80 1 Processor -- start 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864e1d00 0x55b6864e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b686393890 con 0x55b686497a50 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6863aeea0 con 0x55b6864e1d00 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b68626ae30 con 0x55b6864c0f60 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f863f50cb80 10 client.0 _ll_register_callbacks cb 0x55b68645b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36150/0 (socket says 172.21.15.26:36150) 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 -- 172.21.15.26:0/3960955541 learned_addr learned my addr 172.21.15.26:0/3960955541 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862effd700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862ffff700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864e1d00 0x55b6864e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 -- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 msgr2=0x55b6864d9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 -- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864e1d00 msgr2=0x55b6864e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864e1d00 0x55b6864e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.682+0000 7f862f7fe700 1 -- 172.21.15.26:0/3960955541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300ccf00 con 0x55b686497a50 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f862f7fe700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8620003010 tx=0x7f862002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668a4dc1e9c67181 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620021040 con 0x55b686497a50 2023-10-09T11:35:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f862003db00 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b68648cb70 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8620033940 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 10 client.4683 fetch_fsmap learned FSMap version 8 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b686224fe0 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b68648cb70 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8620033aa0 con 0x55b686497a50 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 10 client.4683 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 20 client.4683 populate_metadata read hostname 'smithi026' 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864d5f00 0x55b6864d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 4 client.4683 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:35:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 --> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b686469aa0 con 0x55b6864d5f00 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.683+0000 7f862effd700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864d5f00 0x55b6864d62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f862effd700 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864d5f00 0x55b6864d62d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22b48541e85fb054 server_cookie=6a954e053616d204 in_seq=0 out_seq=0 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f860dffb700 10 client.4683 ms_handle_connect on v2:172.21.15.26:6833/1658898397 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f860dffb700 1 -- 172.21.15.26:0/3960955541 <== mds.0 v2:172.21.15.26:6833/1658898397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b686469aa0 con 0x55b6864d5f00 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f860dffb700 10 client.4683 handle_command_reply: tid=0 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 client.4683 shutdown 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 msgr2=0x55b6864e1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8620003010 tx=0x7f862002c040 comp rx=0 tx=0).stop 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 shutdown_connections 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6864e1d00 0x55b6864e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b686497a50 0x55b6864e1780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864d5f00 0x55b6864d62d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 --2- 172.21.15.26:0/3960955541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f860dffb700 0 client.4683 ms_handle_reset on v2:172.21.15.26:6833/1658898397 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 >> 172.21.15.26:0/3960955541 conn(0x55b686499370 msgr2=0x55b6864dd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 shutdown_connections 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.684+0000 7f863f50cb80 1 -- 172.21.15.26:0/3960955541 wait complete. 2023-10-09T11:35:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.685+0000 7f863f50cb80 20 client.4683 trim_cache size 0 max 16384 2023-10-09T11:35:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.701+0000 7f863f50cb80 1 Processor -- start 2023-10-09T11:35:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.701+0000 7f863f50cb80 1 -- start start 2023-10-09T11:35:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b6864dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6864970f0 con 0x55b6864e1d00 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68649b290 con 0x55b686497a50 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b686493760 con 0x55b6864c0f60 2023-10-09T11:35:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36160/0 (socket says 172.21.15.26:36160) 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 -- 172.21.15.26:0/2628252015 learned_addr learned my addr 172.21.15.26:0/2628252015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862effd700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862f7fe700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b6864dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 -- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 msgr2=0x55b6864d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 -- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 msgr2=0x55b6864dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b6864dda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862ffff700 1 -- 172.21.15.26:0/2628252015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6863b6780 con 0x55b6864e1d00 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.702+0000 7f862f7fe700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b6864dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f862ffff700 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8628009ab0 tx=0x7f8628016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9926db2da7664df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f86157fa700 1 -- 172.21.15.26:0/2628252015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280585e0 con 0x55b6864e1d00 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f86157fa700 1 -- 172.21.15.26:0/2628252015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862805c330 con 0x55b6864e1d00 2023-10-09T11:35:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f86157fa700 1 -- 172.21.15.26:0/2628252015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628053730 con 0x55b6864e1d00 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 -- 172.21.15.26:0/2628252015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 msgr2=0x55b68653dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8628009ab0 tx=0x7f8628016040 comp rx=0 tx=0).stop 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 -- 172.21.15.26:0/2628252015 shutdown_connections 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864e1d00 0x55b68653dcb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b6864dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 --2- 172.21.15.26:0/2628252015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864c0f60 0x55b6864d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 -- 172.21.15.26:0/2628252015 >> 172.21.15.26:0/2628252015 conn(0x55b686499370 msgr2=0x55b6864beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 -- 172.21.15.26:0/2628252015 shutdown_connections 2023-10-09T11:35:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.703+0000 7f863f50cb80 1 -- 172.21.15.26:0/2628252015 wait complete. 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.704+0000 7f863f50cb80 1 -- start start 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.704+0000 7f863f50cb80 1 Processor -- start 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b68653a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6864e18f0 con 0x55b6864c0f60 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6864c09e0 con 0x55b686497a50 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6864f7cc0 con 0x55b6864e1d00 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 10 client.0 _ll_register_callbacks cb 0x55b68645b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:35:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36170/0 (socket says 172.21.15.26:36170) 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 -- 172.21.15.26:0/54429682 learned_addr learned my addr 172.21.15.26:0/54429682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862ffff700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862f7fe700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b68653a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 -- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 msgr2=0x55b6864e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864e1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 -- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 msgr2=0x55b68653a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b68653a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 -- 172.21.15.26:0/54429682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8630159e00 con 0x55b6864c0f60 2023-10-09T11:35:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f862effd700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86300883c0 tx=0x7f8624017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ab15dc1ba73eca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f860dffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624026440 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f862401a050 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f862000be80 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8624027e70 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 10 client.4689 fetch_fsmap learned FSMap version 8 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.705+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b68639d470 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862000be80 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f86240265a0 con 0x55b6864c0f60 2023-10-09T11:35:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 10 client.4689 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 20 client.4689 populate_metadata read hostname 'smithi026' 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864bd990 0x55b6864bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 4 client.4689 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 --> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b68638ae00 con 0x55b6864bd990 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f862f7fe700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864bd990 0x55b6864bdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f862f7fe700 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864bd990 0x55b6864bdd60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a0a6f0b3dd80cb9 server_cookie=d0e19a3dd327b6ac in_seq=0 out_seq=0 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 10 client.4689 ms_handle_connect on v2:172.21.15.26:6833/1658898397 2023-10-09T11:35:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 1 -- 172.21.15.26:0/54429682 <== mds.0 v2:172.21.15.26:6833/1658898397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55b68638ae00 con 0x55b6864bd990 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 10 client.4689 handle_command_reply: tid=0 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 client.4689 shutdown 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 msgr2=0x55b6864e0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86300883c0 tx=0x7f8624017040 comp rx=0 tx=0).stop 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 shutdown_connections 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:6833/1658898397,v1:172.21.15.26:6835/1658898397] conn(0x55b6864bd990 0x55b6864bdd60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6864e1d00 0x55b6864e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b686497a50 0x55b68653a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f860dffb700 0 client.4689 ms_handle_reset on v2:172.21.15.26:6833/1658898397 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 --2- 172.21.15.26:0/54429682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6864c0f60 0x55b6864e0af0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.706+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 >> 172.21.15.26:0/54429682 conn(0x55b686499370 msgr2=0x55b68653da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 shutdown_connections 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f863f50cb80 1 -- 172.21.15.26:0/54429682 wait complete. 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f863f50cb80 20 client.4689 trim_cache size 0 max 16384 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:35:38.720 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4293, 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 14.366892496, 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-10-09T11:35:38.721 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 21, 2023-10-09T11:35:38.722 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 21, 2023-10-09T11:35:38.722 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 21.275667322 2023-10-09T11:35:38.722 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:35:38.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 msgr2=0x7f861c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86200099b0 tx=0x7f8620016000 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 msgr2=0x7f8630155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f862800bc30 tx=0x7f8628009820 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 shutdown_connections 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86301699e0 0x7f8630155e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86300cb5a0 0x7f86300b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 --2- 172.21.15.26:0/3892180950 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86300cd9e0 0x7f86300c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 >> 172.21.15.26:0/3892180950 conn(0x7f8630070e30 msgr2=0x7f86300b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:38.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 shutdown_connections 2023-10-09T11:35:38.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:38.707+0000 7f8636214700 1 -- 172.21.15.26:0/3892180950 wait complete. 2023-10-09T11:35:38.725 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T11:35:38.792 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T11:35:38.793 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T11:35:38.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:38.793 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:35:38.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:38.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-09T11:35:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-10-09T11:35:38.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:35:38.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:38.878 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:35:38.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:38.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-09T11:35:38.999 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-10-09T11:35:39.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:35:39.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.001 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:35:39.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-09T11:35:39.092 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-09T11:35:39.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:35:39.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.095 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:35:39.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-09T11:35:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-09T11:35:39.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:35:39.225 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-09T11:35:39.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:35:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.344+0000 7f8d8e280700 1 Processor -- start 2023-10-09T11:35:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.344+0000 7f8d8e280700 1 -- start start 2023-10-09T11:35:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d8e280700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d881580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d8e280700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88157510 con 0x7f8d880b0910 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d8e280700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d880ae2f0 con 0x7f8d88155b70 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d8e280700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880ae5d0 con 0x7f8d88156f50 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d877fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d880b0910 0x7f8d881579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33600/0 (socket says 172.21.15.26:33600) 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.345+0000 7f8d877fe700 1 -- 172.21.15.26:0/2771033540 learned_addr learned my addr 172.21.15.26:0/2771033540 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d8c81d700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d881580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532263236 0 0) 0x7f8d88157510 con 0x7f8d880b0910 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d70003570 con 0x7f8d880b0910 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056054915 0 0) 0x7f8d880ae2f0 con 0x7f8d88155b70 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d88157510 con 0x7f8d88155b70 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214605401 0 0) 0x7f8d70003570 con 0x7f8d880b0910 2023-10-09T11:35:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 msgr2=0x7f8d881580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d881580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 >> v1:172.21.15.67:6789/0 conn(0x7f8d88155b70 legacy=0x7f8d880b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880ae8b0 con 0x7f8d880b0910 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f8d7c001470 con 0x7f8d880b0910 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d8c81d700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d881580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 >> v1:172.21.15.26:6789/0 conn(0x7f8d880b0910 legacy=0x7f8d881579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d70003c20 0x7f8d70004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d70004d50 0x7f8d700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880ae5d0 con 0x7f8d70003c20 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7000cc80 con 0x7f8d70004d50 2023-10-09T11:35:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7000ce40 con 0x7f8d88156f50 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d70003c20 0x7f8d70004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d877fe700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d8c81d700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d70004d50 0x7f8d700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 -- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 msgr2=0x7f8d70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 -- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d70004d50 msgr2=0x7f8d700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d70004d50 0x7f8d700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d87fff700 1 -- 172.21.15.26:0/2771033540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009a20 con 0x7f8d70003c20 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.346+0000 7f8d877fe700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d88156f50 0x7f8d70004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d87fff700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d70003c20 0x7f8d70004010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001a10 tx=0x7f8d78007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ced3b7cc20b750 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800c5d0 con 0x7f8d70003c20 2023-10-09T11:35:39.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800c730 con 0x7f8d70003c20 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d86ffd700 1 -- 172.21.15.26:0/2771033540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800cad0 con 0x7f8d70003c20 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 -- 172.21.15.26:0/2771033540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d70003c20 msgr2=0x7f8d70004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 --2- 172.21.15.26:0/2771033540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d70003c20 0x7f8d70004010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001a10 tx=0x7f8d78007d30 comp rx=0 tx=0).stop 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8c81d700 1 -- 172.21.15.26:0/2771033540 reap_dead start 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 -- 172.21.15.26:0/2771033540 shutdown_connections 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 -- 172.21.15.26:0/2771033540 >> 172.21.15.26:0/2771033540 conn(0x7f8d8806d170 msgr2=0x7f8d880cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 -- 172.21.15.26:0/2771033540 shutdown_connections 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.347+0000 7f8d8e280700 1 -- 172.21.15.26:0/2771033540 wait complete. 2023-10-09T11:35:39.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.348+0000 7f8d8e280700 1 Processor -- start 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 -- start start 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d70003c20 0x7f8d8813dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d88165e00 0x7f8d8814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8814e230 con 0x7f8d8814ca40 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8814a460 con 0x7f8d88165e00 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d8e280700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88149b30 con 0x7f8d70003c20 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d87fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d70003c20 0x7f8d8813dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.349+0000 7f8d877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36202/0 (socket says 172.21.15.26:36202) 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 -- 172.21.15.26:0/1753912689 learned_addr learned my addr 172.21.15.26:0/1753912689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d8c81d700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d88165e00 0x7f8d8814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 -- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d70003c20 msgr2=0x7f8d8813dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d70003c20 0x7f8d8813dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 -- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d88165e00 msgr2=0x7f8d8814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d88165e00 0x7f8d8814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 -- 172.21.15.26:0/1753912689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88149e10 con 0x7f8d8814ca40 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d877fe700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e7f0 tx=0x7f8d7c0011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c000cd0 con 0x7f8d8814ca40 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c010520 con 0x7f8d8814ca40 2023-10-09T11:35:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8814a0f0 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0108c0 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.350+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8814de40 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.351+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8804c3c0 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.351+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d7c010c70 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.352+0000 7f8d6ffff700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 0x7f8d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.352+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d7c083ca0 con 0x7f8d8814ca40 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.352+0000 7f8d87fff700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 0x7f8d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.353+0000 7f8d87fff700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 0x7f8d740693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d78008fd0 tx=0x7f8d78015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:39.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.357+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d7c04d5a0 con 0x7f8d8814ca40 2023-10-09T11:35:39.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.598+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d8814a5a0 con 0x7f8d8814ca40 2023-10-09T11:35:39.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.598+0000 7f8d6ffff700 1 -- 172.21.15.26:0/1753912689 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d7c019070 con 0x7f8d8814ca40 2023-10-09T11:35:39.600 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:35:39.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 msgr2=0x7f8d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 0x7f8d740693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d78008fd0 tx=0x7f8d78015000 comp rx=0 tx=0).stop 2023-10-09T11:35:39.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 msgr2=0x7f8d8814d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e7f0 tx=0x7f8d7c0011a0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 shutdown_connections 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d88165e00 0x7f8d8814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d74066f30 0x7f8d740693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d70003c20 0x7f8d8813dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 --2- 172.21.15.26:0/1753912689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d8814ca40 0x7f8d8814d900 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 >> 172.21.15.26:0/1753912689 conn(0x7f8d8806d170 msgr2=0x7f8d88154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 shutdown_connections 2023-10-09T11:35:39.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:39.600+0000 7f8d8e280700 1 -- 172.21.15.26:0/1753912689 wait complete. 2023-10-09T11:35:39.613 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:35:39.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:35:39.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:35:39.614 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:35:39.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.614 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:35:39.629 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:39.629 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:39.629 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:35:39.630 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42453sec preferred_lft 42453sec 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:39.631 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:35:39.631 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:35:39.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:35:39.632 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.796 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:35:39.837 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:35:39.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.838 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:35:39.906 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:35:39.907 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:35:39.907 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:35:39.907 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:35:39.907 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:35:39.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:35:39.908 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:40.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.165 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:35:40.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.180 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-10-09T11:35:40.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.236 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:40.236 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:40.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:35:40.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T11:35:40.236 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:40.327 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T11:35:40.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T11:35:40.328 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:40.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.521 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:40.521 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:40.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:35:40.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:35:40.521 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:40.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:40.615 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:35:40.630 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:35:40.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:40.630 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:35:40.684 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:35:40.685 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:35:40.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:40.784 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:40.784 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:40.890 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:40.891 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:40.891 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:40.891 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:35:40.891 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:35:40.891 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:35:40.893 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:35:40.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:40.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:35:40.919 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-09T11:35:40.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:35:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.077+0000 7fa7a0f2f700 1 Processor -- start 2023-10-09T11:35:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.077+0000 7fa7a0f2f700 1 -- start start 2023-10-09T11:35:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa7a0f2f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 0x7fa79c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa7a0f2f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa79c15de50 0x7fa79c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa7a0f2f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0cf3c0 con 0x7fa79c0cef40 2023-10-09T11:35:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa7a0f2f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c15afd0 con 0x7fa79c15de50 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa7a0f2f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c15b2b0 con 0x7fa79c153c30 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa79c15de50 0x7fa79c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa79c0cef40 0x7fa79c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46312/0 (socket says 172.21.15.26:46312) 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79bfff700 1 -- 172.21.15.26:0/262687610 learned_addr learned my addr 172.21.15.26:0/262687610 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/262687610 >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 0x7fa79c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 -- 172.21.15.26:0/262687610 >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 msgr2=0x7fa79c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 --2- 172.21.15.26:0/262687610 >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 0x7fa79c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 -- 172.21.15.26:0/262687610 >> v1:172.21.15.26:6789/0 conn(0x7fa79c0cef40 legacy=0x7fa79c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 -- 172.21.15.26:0/262687610 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c15b590 con 0x7fa79c15de50 2023-10-09T11:35:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79a7fc700 1 -- 172.21.15.26:0/262687610 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922328034 0 0) 0x7fa79c0cf3c0 con 0x7fa79c0cef40 2023-10-09T11:35:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/262687610 >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 0x7fa79c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.078+0000 7fa79affd700 1 --2- 172.21.15.26:0/262687610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c15de50 0x7fa79c0cea00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa79c06ead0 tx=0x7fa7900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b2d4edd2a81234 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa79a7fc700 1 -- 172.21.15.26:0/262687610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79000b6b0 con 0x7fa79c15de50 2023-10-09T11:35:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa79a7fc700 1 -- 172.21.15.26:0/262687610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79000b810 con 0x7fa79c15de50 2023-10-09T11:35:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa79a7fc700 1 -- 172.21.15.26:0/262687610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79000bbb0 con 0x7fa79c15de50 2023-10-09T11:35:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/262687610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c15de50 msgr2=0x7fa79c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/262687610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c15de50 0x7fa79c0cea00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa79c06ead0 tx=0x7fa7900091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/262687610 shutdown_connections 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/262687610 >> v2:172.21.15.67:3300/0 conn(0x7fa79c153c30 0x7fa79c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/262687610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c15de50 0x7fa79c0cea00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/262687610 >> 172.21.15.26:0/262687610 conn(0x7fa79c0703a0 msgr2=0x7fa79c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/262687610 shutdown_connections 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.079+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/262687610 wait complete. 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.080+0000 7fa7a0f2f700 1 Processor -- start 2023-10-09T11:35:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 -- start start 2023-10-09T11:35:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 0x7fa79c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa79c15de50 0x7fa79c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b4870 con 0x7fa79c153c30 2023-10-09T11:35:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b56b0 con 0x7fa79c15de50 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa7a0f2f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c13e810 con 0x7fa79c0cef40 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa79affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa79affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47964/0 (socket says 172.21.15.26:47964) 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa79affd700 1 -- 172.21.15.26:0/886194831 learned_addr learned my addr 172.21.15.26:0/886194831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa79bfff700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa79c15de50 0x7fa79c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.081+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 0x7fa79c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 -- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 msgr2=0x7fa79c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 0x7fa79c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 -- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa79c15de50 msgr2=0x7fa79c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa79c15de50 0x7fa79c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 -- 172.21.15.26:0/886194831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790009420 con 0x7fa79c153c30 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 0x7fa79c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa79affd700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa79000b0e0 tx=0x7fa790017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790011420 con 0x7fa79c153c30 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900115a0 con 0x7fa79c153c30 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c0b4aa0 con 0x7fa79c153c30 2023-10-09T11:35:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790011960 con 0x7fa79c153c30 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.082+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c0b5060 con 0x7fa79c153c30 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.083+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c0b5860 con 0x7fa79c153c30 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.084+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa790011cd0 con 0x7fa79c153c30 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.084+0000 7fa7837fe700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.084+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa790085f90 con 0x7fa79c153c30 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.084+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:41.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.085+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa78c006fd0 tx=0x7fa78c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:41.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.088+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7900b75a0 con 0x7fa79c153c30 2023-10-09T11:35:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.328+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa79c04c3c0 con 0x7fa79c153c30 2023-10-09T11:35:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.329+0000 7fa7837fe700 1 -- 172.21.15.26:0/886194831 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa790015070 con 0x7fa79c153c30 2023-10-09T11:35:41.330 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:35:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.330+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 msgr2=0x7fa7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.330+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa78c006fd0 tx=0x7fa78c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.330+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 msgr2=0x7fa79c0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.330+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa79000b0e0 tx=0x7fa790017000 comp rx=0 tx=0).stop 2023-10-09T11:35:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 shutdown_connections 2023-10-09T11:35:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa79c15de50 0x7fa79c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa79c0cef40 0x7fa79c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 --2- 172.21.15.26:0/886194831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c153c30 0x7fa79c0b5b40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 >> 172.21.15.26:0/886194831 conn(0x7fa79c0703a0 msgr2=0x7fa79c0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 shutdown_connections 2023-10-09T11:35:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:41.331+0000 7fa7a0f2f700 1 -- 172.21.15.26:0/886194831 wait complete. 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:35:41.344 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:35:41.345 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:35:41.345 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:35:41.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.345 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:35:41.361 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:41.361 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:41.361 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:41.362 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:35:41.363 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:41.364 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:35:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:35:41.366 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link tentative 2023-10-09T11:35:41.366 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.366 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:35:41.425 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:35:41.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.427 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:35:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:35:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:35:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:35:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:35:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:35:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:41.484 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:41.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:35:41.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:35:41.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:35:41.485 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:41.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.585 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:35:41.600 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:35:41.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.602 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-10-09T11:35:41.656 INFO:teuthology.orchestra.run.smithi026.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T11:35:41.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:41.656 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:41.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:35:41.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T11:35:41.657 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:41.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:35:41.779 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:41.779 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:41.779 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:41.779 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ea:87:10:51:02:8e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::e887:10ff:fe51:28e/64 scope link tentative 2023-10-09T11:35:41.780 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:35:41.869 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:41.869 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:41.869 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:41.869 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.869 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ea:87:10:51:02:8e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::e887:10ff:fe51:28e/64 scope link 2023-10-09T11:35:41.870 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:41.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T11:35:41.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T11:35:41.880 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:42.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:42.098 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:35:42.098 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:35:42.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.1 up 2023-10-09T11:35:42.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:35:42.098 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:35:42.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:42.180 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T11:35:42.195 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:35:42.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:42.195 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:35:42.250 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-09T11:35:42.250 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:35:42.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:42.331 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:42.331 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:42.350 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:42.350 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:42.350 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:42.350 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 2@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:42.350 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:42.351 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:42.351 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:42.351 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 2@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:42.372 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:42.373 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:42.373 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:42.373 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:35:42.373 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:35:42.373 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:35:42.375 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:35:42.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:42.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:35:42.440 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-09T11:35:42.441 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:35:42.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.599+0000 7f61bf861700 1 Processor -- start 2023-10-09T11:35:42.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.599+0000 7f61bf861700 1 -- start start 2023-10-09T11:35:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bf861700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61b806c860 0x7f61b806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bf861700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61b81409d0 0x7f61b8140e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bf861700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b80c86e0 con 0x7f61b80c7a40 2023-10-09T11:35:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bf861700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b815c1c0 con 0x7f61b81409d0 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bf861700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b8141380 con 0x7f61b806c860 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61b81409d0 0x7f61b8140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bddfe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61b80c7a40 0x7f61b80c7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46326/0 (socket says 172.21.15.26:46326) 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bddfe700 1 -- 172.21.15.26:0/4040653808 learned_addr learned my addr 172.21.15.26:0/4040653808 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bd5fd700 1 --2- 172.21.15.26:0/4040653808 >> v2:172.21.15.67:3300/0 conn(0x7f61b806c860 0x7f61b806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 -- 172.21.15.26:0/4040653808 >> v2:172.21.15.67:3300/0 conn(0x7f61b806c860 msgr2=0x7f61b806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 --2- 172.21.15.26:0/4040653808 >> v2:172.21.15.67:3300/0 conn(0x7f61b806c860 0x7f61b806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 -- 172.21.15.26:0/4040653808 >> v1:172.21.15.26:6789/0 conn(0x7f61b80c7a40 legacy=0x7f61b80c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61affff700 1 -- 172.21.15.26:0/4040653808 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672432107 0 0) 0x7f61b80c86e0 con 0x7f61b80c7a40 2023-10-09T11:35:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 -- 172.21.15.26:0/4040653808 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b815b400 con 0x7f61b81409d0 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.600+0000 7f61bcdfc700 1 --2- 172.21.15.26:0/4040653808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8140e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f61b80ce490 tx=0x7f61a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5507f089a49dfb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61affff700 1 -- 172.21.15.26:0/4040653808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800b6b0 con 0x7f61b81409d0 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61affff700 1 -- 172.21.15.26:0/4040653808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800b810 con 0x7f61b81409d0 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61affff700 1 -- 172.21.15.26:0/4040653808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bbb0 con 0x7f61b81409d0 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 -- 172.21.15.26:0/4040653808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 msgr2=0x7f61b8140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 --2- 172.21.15.26:0/4040653808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8140e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f61b80ce490 tx=0x7f61a80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 -- 172.21.15.26:0/4040653808 shutdown_connections 2023-10-09T11:35:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 --2- 172.21.15.26:0/4040653808 >> v2:172.21.15.67:3300/0 conn(0x7f61b806c860 0x7f61b806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 --2- 172.21.15.26:0/4040653808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8140e40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 -- 172.21.15.26:0/4040653808 >> 172.21.15.26:0/4040653808 conn(0x7f61b80cd400 msgr2=0x7f61b80cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 -- 172.21.15.26:0/4040653808 shutdown_connections 2023-10-09T11:35:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.601+0000 7f61bf861700 1 -- 172.21.15.26:0/4040653808 wait complete. 2023-10-09T11:35:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.602+0000 7f61bf861700 1 Processor -- start 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.602+0000 7f61bf861700 1 -- start start 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b806c860 0x7f61b8158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 0x7f61b813ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8159f90 con 0x7f61b81409d0 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8140460 con 0x7f61b80c7a40 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bf861700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8159380 con 0x7f61b806c860 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.603+0000 7f61bddfe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47984/0 (socket says 172.21.15.26:47984) 2023-10-09T11:35:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bcdfc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 0x7f61b813ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 -- 172.21.15.26:0/821933851 learned_addr learned my addr 172.21.15.26:0/821933851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bd5fd700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b806c860 0x7f61b8158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 -- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b806c860 msgr2=0x7f61b8158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b806c860 0x7f61b8158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 -- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 msgr2=0x7f61b813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 0x7f61b813ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 -- 172.21.15.26:0/821933851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009420 con 0x7f61b81409d0 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bcdfc700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 0x7f61b813ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bddfe700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61b000cc90 tx=0x7f61b0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000a8b0 con 0x7f61b81409d0 2023-10-09T11:35:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b000aa10 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b8159660 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000add0 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.604+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b8159c20 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.605+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b815a100 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.606+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b0007300 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.606+0000 7f61ad7fa700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.606+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61b0084850 con 0x7f61b81409d0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.606+0000 7f61bd5fd700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.607+0000 7f61bd5fd700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 0x7f619c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f61b4006fd0 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.610+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b0051b40 con 0x7f61b81409d0 2023-10-09T11:35:42.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.848+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f61b804c3c0 con 0x7f61b81409d0 2023-10-09T11:35:42.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.849+0000 7f61ad7fa700 1 -- 172.21.15.26:0/821933851 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f61b0055160 con 0x7f61b81409d0 2023-10-09T11:35:42.850 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:35:42.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 msgr2=0x7f619c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 0x7f619c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f61b4006fd0 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2023-10-09T11:35:42.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 msgr2=0x7f61b8155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:42.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61b000cc90 tx=0x7f61b0001a80 comp rx=0 tx=0).stop 2023-10-09T11:35:42.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 shutdown_connections 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61b81409d0 0x7f61b8155e50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b806c860 0x7f61b8158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 --2- 172.21.15.26:0/821933851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b80c7a40 0x7f61b813ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 >> 172.21.15.26:0/821933851 conn(0x7f61b80cd400 msgr2=0x7f61b80c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 shutdown_connections 2023-10-09T11:35:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:42.851+0000 7f61bf861700 1 -- 172.21.15.26:0/821933851 wait complete. 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:35:42.864 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:35:42.865 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:35:42.865 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:35:42.865 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:35:42.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:42.865 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:35:42.884 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:42.885 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42464sec preferred_lft 42464sec 2023-10-09T11:35:42.886 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:35:42.887 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:42.888 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:35:42.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2023-10-09T11:35:42.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:35:42.889 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:43.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.062 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:35:43.106 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:35:43.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.107 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:35:43.180 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:35:43.180 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:35:43.180 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:35:43.181 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:35:43.181 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:35:43.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.181 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:43.181 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:43.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:35:43.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:35:43.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:35:43.182 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:43.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.435 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:35:43.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.450 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2023-10-09T11:35:43.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.505 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:43.505 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:43.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:35:43.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T11:35:43.505 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:43.595 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T11:35:43.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.595 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:43.595 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:43.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T11:35:43.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:35:43.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T11:35:43.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T11:35:43.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T11:35:43.596 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:43.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:43.782 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:43.782 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:43.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:35:43.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:35:43.782 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:43.875 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:43.876 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:35:43.890 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:35:43.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:43.891 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:35:43.945 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:35:43.946 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:35:43.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:44.039 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:44.039 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:44.127 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:44.127 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:44.127 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:44.127 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:44.149 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:44.149 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:35:44.150 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:35:44.151 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:35:44.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:35:44.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:35:44.178 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-09T11:35:44.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:35:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 Processor -- start 2023-10-09T11:35:44.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 -- start start 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2e740cb5a0 0x7f2e740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e740cd9e0 0x7f2e74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7415ae40 con 0x7f2e7415a400 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740d13f0 con 0x7f2e740cd9e0 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.310+0000 7f2e79f28700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7415ab60 con 0x7f2e740cb5a0 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e740cd9e0 0x7f2e74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e73fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e7415a400 0x7f2e74156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46334/0 (socket says 172.21.15.26:46334) 2023-10-09T11:35:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e73fff700 1 -- 172.21.15.26:0/3908445600 learned_addr learned my addr 172.21.15.26:0/3908445600 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e737fe700 1 --2- 172.21.15.26:0/3908445600 >> v2:172.21.15.67:3300/0 conn(0x7f2e740cb5a0 0x7f2e740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3908445600 >> v2:172.21.15.67:3300/0 conn(0x7f2e740cb5a0 msgr2=0x7f2e740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 --2- 172.21.15.26:0/3908445600 >> v2:172.21.15.67:3300/0 conn(0x7f2e740cb5a0 0x7f2e740cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3908445600 >> v1:172.21.15.26:6789/0 conn(0x7f2e7415a400 legacy=0x7f2e74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3908445600 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740ccf00 con 0x7f2e740cd9e0 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e727fc700 1 -- 172.21.15.26:0/3908445600 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993257343 0 0) 0x7f2e7415ae40 con 0x7f2e7415a400 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e72ffd700 1 --2- 172.21.15.26:0/3908445600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74159ec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93537226498b154b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e727fc700 1 -- 172.21.15.26:0/3908445600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011630 con 0x7f2e740cd9e0 2023-10-09T11:35:44.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e727fc700 1 -- 172.21.15.26:0/3908445600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011790 con 0x7f2e740cd9e0 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.311+0000 7f2e727fc700 1 -- 172.21.15.26:0/3908445600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011b30 con 0x7f2e740cd9e0 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 -- 172.21.15.26:0/3908445600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 msgr2=0x7f2e74159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3908445600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74159ec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 -- 172.21.15.26:0/3908445600 shutdown_connections 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3908445600 >> v2:172.21.15.67:3300/0 conn(0x7f2e740cb5a0 0x7f2e740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3908445600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74159ec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 -- 172.21.15.26:0/3908445600 >> 172.21.15.26:0/3908445600 conn(0x7f2e74070e30 msgr2=0x7f2e740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 -- 172.21.15.26:0/3908445600 shutdown_connections 2023-10-09T11:35:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.312+0000 7f2e79f28700 1 -- 172.21.15.26:0/3908445600 wait complete. 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.313+0000 7f2e79f28700 1 Processor -- start 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.313+0000 7f2e79f28700 1 -- start start 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e740cb5a0 0x7f2e740b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e7415a400 0x7f2e740c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415c7f0 con 0x7f2e740cd9e0 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740b44f0 con 0x7f2e7415a400 2023-10-09T11:35:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e79f28700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74169f00 con 0x7f2e740cb5a0 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48006/0 (socket says 172.21.15.26:48006) 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3442296022 learned_addr learned my addr 172.21.15.26:0/3442296022 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e73fff700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e7415a400 0x7f2e740c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.314+0000 7f2e737fe700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e740cb5a0 0x7f2e740b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e740cb5a0 msgr2=0x7f2e740b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e740cb5a0 0x7f2e740b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e7415a400 msgr2=0x7f2e740c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e7415a400 0x7f2e740c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 -- 172.21.15.26:0/3442296022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009420 con 0x7f2e740cd9e0 2023-10-09T11:35:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e72ffd700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e7406ea60 tx=0x7f2e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68000d10 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011900 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7416a1e0 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68025670 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.315+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740c7950 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.316+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7416a420 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.317+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e68023070 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.317+0000 7f2e5b7fe700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 0x7f2e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.317+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e68085a10 con 0x7f2e740cd9e0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.317+0000 7f2e737fe700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 0x7f2e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:44.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.318+0000 7f2e737fe700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 0x7f2e600693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e7415e050 tx=0x7f2e640091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:44.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.321+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e7416a420 con 0x7f2e740cd9e0 2023-10-09T11:35:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.563+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e7416a420 con 0x7f2e740cd9e0 2023-10-09T11:35:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.563+0000 7f2e5b7fe700 1 -- 172.21.15.26:0/3442296022 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e7416a420 con 0x7f2e740cd9e0 2023-10-09T11:35:44.565 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:35:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 msgr2=0x7f2e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 0x7f2e600693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e7415e050 tx=0x7f2e640091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 msgr2=0x7f2e74169440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e7406ea60 tx=0x7f2e68017000 comp rx=0 tx=0).stop 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 shutdown_connections 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e7415a400 0x7f2e740c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e60066f30 0x7f2e600693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e740cb5a0 0x7f2e740b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 --2- 172.21.15.26:0/3442296022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e740cd9e0 0x7f2e74169440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 >> 172.21.15.26:0/3442296022 conn(0x7f2e74070e30 msgr2=0x7f2e740b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 shutdown_connections 2023-10-09T11:35:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:44.566+0000 7f2e79f28700 1 -- 172.21.15.26:0/3442296022 wait complete. 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T11:35:44.579 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:35:44.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:35:44.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:35:44.580 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:35:44.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.580 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:44.597 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42462sec preferred_lft 42462sec 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:35:44.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link tentative 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link tentative 2023-10-09T11:35:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:44.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.600 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:35:44.661 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:35:44.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.663 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:35:44.719 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:35:44.719 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:35:44.720 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:35:44.720 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:35:44.720 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:35:44.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.720 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:44.720 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:44.720 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:35:44.720 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:35:44.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:35:44.721 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:44.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.823 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:35:44.838 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:35:44.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.839 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2023-10-09T11:35:44.894 INFO:teuthology.orchestra.run.smithi067.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T11:35:44.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.894 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:44.895 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:44.895 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:35:44.895 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T11:35:44.895 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:44.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:44.985 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.024 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:35:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:03:b0:ef:9c:97 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:35:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:35:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c03:b0ff:feef:9c97/64 scope link tentative 2023-10-09T11:35:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:45.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:03:b0:ef:9c:97 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:35:45.116 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.117 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c03:b0ff:feef:9c97/64 scope link tentative 2023-10-09T11:35:45.117 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:35:45.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T11:35:45.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T11:35:45.133 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:45.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:45.362 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:35:45.362 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:35:45.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.1 up 2023-10-09T11:35:45.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:35:45.362 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:35:45.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:45.443 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T11:35:45.458 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:35:45.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:35:45.458 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:35:45.513 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-09T11:35:45.513 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:35:45.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:45.594 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:45.594 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 3@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:45.614 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:45.614 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:45.635 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 3@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:35:45.636 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:35:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:35:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:35:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:35:45.637 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:35:45.638 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:35:45.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:45.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:35:45.704 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T11:35:45.808 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 Processor -- start 2023-10-09T11:35:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 -- start start 2023-10-09T11:35:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 0x7f7140159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 0x7f7140156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714015ae40 con 0x7f71400cb5a0 2023-10-09T11:35:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400ce0f0 con 0x7f71400cb970 2023-10-09T11:35:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.942+0000 7f71450a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400d13f0 con 0x7f714015a400 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f71400cb5a0 0x7f71400cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46338/0 (socket says 172.21.15.26:46338) 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713ed9d700 1 -- 172.21.15.26:0/2094306430 learned_addr learned my addr 172.21.15.26:0/2094306430 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 --2- 172.21.15.26:0/2094306430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 0x7f7140156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713e59c700 1 --2- 172.21.15.26:0/2094306430 >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 0x7f7140159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713dd9b700 1 -- 172.21.15.26:0/2094306430 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383517918 0 0) 0x7f714015ae40 con 0x7f71400cb5a0 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713dd9b700 1 -- 172.21.15.26:0/2094306430 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003570 con 0x7f71400cb5a0 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 -- 172.21.15.26:0/2094306430 >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 msgr2=0x7f7140159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 --2- 172.21.15.26:0/2094306430 >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 0x7f7140159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 -- 172.21.15.26:0/2094306430 >> v1:172.21.15.26:6789/0 conn(0x7f71400cb5a0 legacy=0x7f71400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 -- 172.21.15.26:0/2094306430 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714015ab60 con 0x7f714015a400 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713e59c700 1 --2- 172.21.15.26:0/2094306430 >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 0x7f7140159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.943+0000 7f713f59e700 1 --2- 172.21.15.26:0/2094306430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 0x7f7140156e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7138009e60 tx=0x7f7138009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4513f2d22d06f428 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f713dd9b700 1 -- 172.21.15.26:0/2094306430 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800e070 con 0x7f714015a400 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f713dd9b700 1 -- 172.21.15.26:0/2094306430 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713800bab0 con 0x7f714015a400 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f713dd9b700 1 -- 172.21.15.26:0/2094306430 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800be70 con 0x7f714015a400 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 -- 172.21.15.26:0/2094306430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 msgr2=0x7f7140156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 --2- 172.21.15.26:0/2094306430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 0x7f7140156e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7138009e60 tx=0x7f7138009780 comp rx=0 tx=0).stop 2023-10-09T11:35:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 -- 172.21.15.26:0/2094306430 shutdown_connections 2023-10-09T11:35:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 --2- 172.21.15.26:0/2094306430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f714015a400 0x7f7140156e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 --2- 172.21.15.26:0/2094306430 >> v2:172.21.15.67:3300/0 conn(0x7f71400cb970 0x7f7140159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 -- 172.21.15.26:0/2094306430 >> 172.21.15.26:0/2094306430 conn(0x7f7140070e30 msgr2=0x7f71400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 -- 172.21.15.26:0/2094306430 shutdown_connections 2023-10-09T11:35:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.944+0000 7f71450a0700 1 -- 172.21.15.26:0/2094306430 wait complete. 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.945+0000 7f71450a0700 1 Processor -- start 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 -- start start 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714015a400 0x7f7140154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400b4840 con 0x7f71400cb970 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71401523d0 con 0x7f714015a400 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f71450a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400b3c30 con 0x7f71400cb5a0 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713ed9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713ed9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:54634/0 (socket says 172.21.15.26:54634) 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713ed9d700 1 -- 172.21.15.26:0/2740773035 learned_addr learned my addr 172.21.15.26:0/2740773035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714015a400 0x7f7140154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.946+0000 7f713e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48018/0 (socket says 172.21.15.26:48018) 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 -- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714015a400 msgr2=0x7f7140154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714015a400 0x7f7140154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 -- 172.21.15.26:0/2740773035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 msgr2=0x7f714015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 -- 172.21.15.26:0/2740773035 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009420 con 0x7f71400cb5a0 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713e59c700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f713ed9d700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f7130007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130005cd0 con 0x7f71400cb5a0 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130005e30 con 0x7f71400cb5a0 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7138009a20 con 0x7f71400cb5a0 2023-10-09T11:35:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130007320 con 0x7f71400cb5a0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.947+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71400b41f0 con 0x7f71400cb5a0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.948+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714004c3c0 con 0x7f71400cb5a0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.949+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f713001b3b0 con 0x7f71400cb5a0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.949+0000 7f7136ffd700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.949+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7130083bd0 con 0x7f71400cb5a0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.949+0000 7f713e59c700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.950+0000 7f713e59c700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f714016c590 tx=0x7f71280091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:45.954+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7130050e40 con 0x7f71400cb5a0 2023-10-09T11:35:46.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.146+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f714015df20 con 0x7f71400cb5a0 2023-10-09T11:35:46.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.147+0000 7f7136ffd700 1 -- 172.21.15.26:0/2740773035 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7130017020 con 0x7f71400cb5a0 2023-10-09T11:35:46.149 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:46.149 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:46.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 msgr2=0x7f71200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f714016c590 tx=0x7f71280091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 msgr2=0x7f7140151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f7130007e00 comp rx=0 tx=0).stop 2023-10-09T11:35:46.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 shutdown_connections 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714015a400 0x7f7140154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71400cb5a0 0x7f7140151e90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 --2- 172.21.15.26:0/2740773035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71400cb970 0x7f714015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.149+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 >> 172.21.15.26:0/2740773035 conn(0x7f7140070e30 msgr2=0x7f71400b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.150+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 shutdown_connections 2023-10-09T11:35:46.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.150+0000 7f71450a0700 1 -- 172.21.15.26:0/2740773035 wait complete. 2023-10-09T11:35:46.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:46.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:46.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.284+0000 7fa7ab8dd700 1 Processor -- start 2023-10-09T11:35:46.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.284+0000 7fa7ab8dd700 1 -- start start 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7ab8dd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 0x7fa7a406a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7ab8dd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a406f7d0 con 0x7fa7a40cc320 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7ab8dd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a406d7b0 con 0x7fa7a413c9b0 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7ab8dd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a406e330 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9679700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa7a40cc320 0x7fa7a413c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46352/0 (socket says 172.21.15.26:46352) 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9679700 1 -- 172.21.15.26:0/1736269040 learned_addr learned my addr 172.21.15.26:0/1736269040 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9e7a700 1 --2- 172.21.15.26:0/1736269040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 0x7fa7a406a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057867838 0 0) 0x7fa7a406f7d0 con 0x7fa7a40cc320 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003570 con 0x7fa7a40cc320 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139080187 0 0) 0x7fa7a406d7b0 con 0x7fa7a413c9b0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a406f7d0 con 0x7fa7a413c9b0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9e7a700 1 -- 172.21.15.26:0/1736269040 >> v1:172.21.15.67:6789/0 conn(0x7fa7a413c9b0 legacy=0x7fa7a4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9e7a700 1 -- 172.21.15.26:0/1736269040 >> v1:172.21.15.26:6789/0 conn(0x7fa7a40cc320 legacy=0x7fa7a413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.285+0000 7fa7a9e7a700 1 -- 172.21.15.26:0/1736269040 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a406da00 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7a9e7a700 1 --2- 172.21.15.26:0/1736269040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 0x7fa7a406a110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009e90 tx=0x7fa79c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940c60d0a121112c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00e070 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00bb80 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa79bfff700 1 -- 172.21.15.26:0/1736269040 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c012430 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/1736269040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 msgr2=0x7fa7a406a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/1736269040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 0x7fa7a406a110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009e90 tx=0x7fa79c009780 comp rx=0 tx=0).stop 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/1736269040 shutdown_connections 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/1736269040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc6f0 0x7fa7a406a110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/1736269040 >> 172.21.15.26:0/1736269040 conn(0x7fa7a4067f00 msgr2=0x7fa7a4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/1736269040 shutdown_connections 2023-10-09T11:35:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.286+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/1736269040 wait complete. 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.287+0000 7fa7ab8dd700 1 Processor -- start 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.287+0000 7fa7ab8dd700 1 -- start start 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 0x7fa7a40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7a413c9b0 0x7fa7a4169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40aca40 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b0b50 con 0x7fa7a413c9b0 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7ab8dd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40ac1a0 con 0x7fa7a40cc320 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.288+0000 7fa7a8e78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48024/0 (socket says 172.21.15.26:48024) 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 -- 172.21.15.26:0/2356270129 learned_addr learned my addr 172.21.15.26:0/2356270129 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a9679700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 0x7fa7a40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a9e7a700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7a413c9b0 0x7fa7a4169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 -- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 msgr2=0x7fa7a40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 0x7fa7a40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 -- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7a413c9b0 msgr2=0x7fa7a4169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7a413c9b0 0x7fa7a4169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 -- 172.21.15.26:0/2356270129 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009a20 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a9679700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 0x7fa7a40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7a8e78700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c5c0 tx=0x7fa794007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794010510 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794010690 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794010a50 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a40ac480 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.289+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a40c9e20 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.290+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a40c9c80 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.290+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa79401b3b0 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.291+0000 7fa7997fa700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.291+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa794083d30 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.291+0000 7fa7a9679700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.292+0000 7fa7a9679700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00058d0 tx=0x7fa7a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.295+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a40c9c80 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.486+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7a40c9c80 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.486+0000 7fa7997fa700 1 -- 172.21.15.26:0/2356270129 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7a40c9c80 con 0x7fa7a40cc6f0 2023-10-09T11:35:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 msgr2=0x7fa7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00058d0 tx=0x7fa7a0009040 comp rx=0 tx=0).stop 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 msgr2=0x7fa7a4169920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c5c0 tx=0x7fa794007de0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 shutdown_connections 2023-10-09T11:35:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7a413c9b0 0x7fa7a4169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa788066f30 0x7fa7880693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7a40cc320 0x7fa7a40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 --2- 172.21.15.26:0/2356270129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a40cc6f0 0x7fa7a4169920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 >> 172.21.15.26:0/2356270129 conn(0x7fa7a4067f00 msgr2=0x7fa7a40b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 shutdown_connections 2023-10-09T11:35:46.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.488+0000 7fa7ab8dd700 1 -- 172.21.15.26:0/2356270129 wait complete. 2023-10-09T11:35:46.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:46.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.622+0000 7f6af6c9f700 1 Processor -- start 2023-10-09T11:35:46.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.622+0000 7f6af6c9f700 1 -- start start 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af6c9f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6af006dc70 0x7f6af0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af6c9f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af00ccfd0 con 0x7f6af006e0e0 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af6c9f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af015a3d0 con 0x7f6af0159530 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af6c9f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af015a6b0 con 0x7f6af006dc70 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af523c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6af006e0e0 0x7f6af00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46356/0 (socket says 172.21.15.26:46356) 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6af523c700 1 -- 172.21.15.26:0/3544527359 learned_addr learned my addr 172.21.15.26:0/3544527359 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aeffff700 1 --2- 172.21.15.26:0/3544527359 >> v2:172.21.15.67:3300/0 conn(0x7f6af006dc70 0x7f6af0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040446008 0 0) 0x7f6af00ccfd0 con 0x7f6af006e0e0 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003570 con 0x7f6af006e0e0 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025065904 0 0) 0x7f6af015a3d0 con 0x7f6af0159530 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aeffff700 1 -- 172.21.15.26:0/3544527359 >> v1:172.21.15.67:6789/0 conn(0x7f6af0159530 legacy=0x7f6af00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aeffff700 1 -- 172.21.15.26:0/3544527359 >> v1:172.21.15.26:6789/0 conn(0x7f6af006e0e0 legacy=0x7f6af00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.623+0000 7f6aeffff700 1 -- 172.21.15.26:0/3544527359 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af015a990 con 0x7f6af006dc70 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6aeffff700 1 --2- 172.21.15.26:0/3544527359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af0159900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00098e0 tx=0x7f6ae00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9536070cc73c155b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000b640 con 0x7f6af006dc70 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000b7a0 con 0x7f6af006dc70 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6aef7fe700 1 -- 172.21.15.26:0/3544527359 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000bb40 con 0x7f6af006dc70 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 -- 172.21.15.26:0/3544527359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 msgr2=0x7f6af0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/3544527359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af0159900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00098e0 tx=0x7f6ae00091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 -- 172.21.15.26:0/3544527359 shutdown_connections 2023-10-09T11:35:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/3544527359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af0159900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 -- 172.21.15.26:0/3544527359 >> 172.21.15.26:0/3544527359 conn(0x7f6af00703a0 msgr2=0x7f6af00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 -- 172.21.15.26:0/3544527359 shutdown_connections 2023-10-09T11:35:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.624+0000 7f6af6c9f700 1 -- 172.21.15.26:0/3544527359 wait complete. 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.625+0000 7f6af6c9f700 1 Processor -- start 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 -- start start 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af016cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6af0159530 0x7f6af015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af016cff0 con 0x7f6af006e0e0 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00c8680 con 0x7f6af006dc70 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.626+0000 7f6af6c9f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00c90c0 con 0x7f6af0159530 2023-10-09T11:35:46.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48040/0 (socket says 172.21.15.26:48040) 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aeffff700 1 -- 172.21.15.26:0/1320905522 learned_addr learned my addr 172.21.15.26:0/1320905522 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af016cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af523c700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6af0159530 0x7f6af015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 -- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6af0159530 msgr2=0x7f6af015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6af0159530 0x7f6af015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 -- 172.21.15.26:0/1320905522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 msgr2=0x7f6af00c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 -- 172.21.15.26:0/1320905522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009420 con 0x7f6af006dc70 2023-10-09T11:35:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aeffff700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af4a3b700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af016cab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8002230 tx=0x7f6ae80016f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8012630 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80127b0 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00c7790 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8012b70 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.627+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af00c7d50 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.628+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af004c3c0 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.629+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae8003030 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.629+0000 7f6aecff9700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 0x7f6ad0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.629+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ae80844b0 con 0x7f6af006dc70 2023-10-09T11:35:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.629+0000 7f6aeffff700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 0x7f6ad0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.630+0000 7f6aeffff700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 0x7f6ad0069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c74d0 tx=0x7f6ae0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.634+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae8051720 con 0x7f6af006dc70 2023-10-09T11:35:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.824+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6af015ac70 con 0x7f6af006dc70 2023-10-09T11:35:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.825+0000 7f6aecff9700 1 -- 172.21.15.26:0/1320905522 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ae8054d40 con 0x7f6af006dc70 2023-10-09T11:35:46.827 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 msgr2=0x7f6ad0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 0x7f6ad0069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c74d0 tx=0x7f6ae0017000 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 msgr2=0x7f6af016cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af016cab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8002230 tx=0x7f6ae80016f0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 shutdown_connections 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ad0066f60 0x7f6ad0069410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6af0159530 0x7f6af015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6af006dc70 0x7f6af016cab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 --2- 172.21.15.26:0/1320905522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af006e0e0 0x7f6af00c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 >> 172.21.15.26:0/1320905522 conn(0x7f6af00703a0 msgr2=0x7f6af0153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 shutdown_connections 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.827+0000 7f6af6c9f700 1 -- 172.21.15.26:0/1320905522 wait complete. 2023-10-09T11:35:46.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:46.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.961+0000 7fdb912b2700 1 Processor -- start 2023-10-09T11:35:46.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.961+0000 7fdb912b2700 1 -- start start 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb912b2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb8c0c9ab0 0x7fdb8c1645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb912b2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c068350 con 0x7fdb8c0cbbc0 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb912b2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c068db0 con 0x7fdb8c159970 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb912b2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c067740 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb8a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdb8c0cbbc0 0x7fdb8c0c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46366/0 (socket says 172.21.15.26:46366) 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb8a7fc700 1 -- 172.21.15.26:0/3290550422 learned_addr learned my addr 172.21.15.26:0/3290550422 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.962+0000 7fdb8b7fe700 1 --2- 172.21.15.26:0/3290550422 >> v2:172.21.15.67:3300/0 conn(0x7fdb8c0c9ab0 0x7fdb8c1645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976772455 0 0) 0x7fdb8c068350 con 0x7fdb8c0cbbc0 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb78003570 con 0x7fdb8c0cbbc0 2023-10-09T11:35:46.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822329040 0 0) 0x7fdb8c068db0 con 0x7fdb8c159970 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb8c068350 con 0x7fdb8c159970 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/3290550422 >> v1:172.21.15.67:6789/0 conn(0x7fdb8c159970 legacy=0x7fdb8c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/3290550422 >> v1:172.21.15.26:6789/0 conn(0x7fdb8c0cbbc0 legacy=0x7fdb8c0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/3290550422 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c067a20 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb8b7fe700 1 --2- 172.21.15.26:0/3290550422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c1645b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098e0 tx=0x7fdb7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92de7df9cec9ba76 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011630 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c011790 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.963+0000 7fdb89ffb700 1 -- 172.21.15.26:0/3290550422 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011b30 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 -- 172.21.15.26:0/3290550422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 msgr2=0x7fdb8c1645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 --2- 172.21.15.26:0/3290550422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c1645b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098e0 tx=0x7fdb7c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 -- 172.21.15.26:0/3290550422 shutdown_connections 2023-10-09T11:35:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 --2- 172.21.15.26:0/3290550422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c1645b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 -- 172.21.15.26:0/3290550422 >> 172.21.15.26:0/3290550422 conn(0x7fdb8c06e250 msgr2=0x7fdb8c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 -- 172.21.15.26:0/3290550422 shutdown_connections 2023-10-09T11:35:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.964+0000 7fdb912b2700 1 -- 172.21.15.26:0/3290550422 wait complete. 2023-10-09T11:35:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.965+0000 7fdb912b2700 1 Processor -- start 2023-10-09T11:35:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.965+0000 7fdb912b2700 1 -- start start 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb8c0cbbc0 0x7fdb8c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c14f6f0 con 0x7fdb8c159970 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c15ac30 con 0x7fdb8c0c9ab0 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb912b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c15bcc0 con 0x7fdb8c0cbbc0 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48050/0 (socket says 172.21.15.26:48050) 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/1700573540 learned_addr learned my addr 172.21.15.26:0/1700573540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8affd700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb8c0cbbc0 msgr2=0x7fdb8c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8a7fc700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb8c0cbbc0 0x7fdb8c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb8c0cbbc0 0x7fdb8c15d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 msgr2=0x7fdb8c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8b7fe700 1 -- 172.21.15.26:0/1700573540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009420 con 0x7fdb8c159970 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.966+0000 7fdb8affd700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb8b7fe700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c06e6b0 tx=0x7fdb7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c01f070 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c011900 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c15a950 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c025420 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.967+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c15b950 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.968+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c15be30 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.968+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb7c023070 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.968+0000 7fdb82ffd700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.968+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb7c085b90 con 0x7fdb8c159970 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.969+0000 7fdb8affd700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.969+0000 7fdb8affd700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 0x7fdb6c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb84002f20 tx=0x7fdb84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:46.973+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb7c052e00 con 0x7fdb8c159970 2023-10-09T11:35:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.167+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb8c04c3c0 con 0x7fdb8c159970 2023-10-09T11:35:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.167+0000 7fdb82ffd700 1 -- 172.21.15.26:0/1700573540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb7c02a0a0 con 0x7fdb8c159970 2023-10-09T11:35:47.169 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 msgr2=0x7fdb6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 0x7fdb6c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb84002f20 tx=0x7fdb84009040 comp rx=0 tx=0).stop 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 msgr2=0x7fdb8c0c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c06e6b0 tx=0x7fdb7c017000 comp rx=0 tx=0).stop 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 shutdown_connections 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb8c159970 0x7fdb8c0c3270 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb8c0c9ab0 0x7fdb8c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 --2- 172.21.15.26:0/1700573540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb8c0cbbc0 0x7fdb8c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 >> 172.21.15.26:0/1700573540 conn(0x7fdb8c06e250 msgr2=0x7fdb8c0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 shutdown_connections 2023-10-09T11:35:47.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.169+0000 7fdb912b2700 1 -- 172.21.15.26:0/1700573540 wait complete. 2023-10-09T11:35:47.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.301+0000 7fa9db2da700 1 Processor -- start 2023-10-09T11:35:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.301+0000 7fa9db2da700 1 -- start start 2023-10-09T11:35:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9db2da700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cb5a0 0x7fa9d40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9db2da700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa9d40cde50 0x7fa9d4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9db2da700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d415ae40 con 0x7fa9d40cd9e0 2023-10-09T11:35:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9db2da700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40d13f0 con 0x7fa9d40cde50 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9db2da700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415ab60 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9877700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa9d40cde50 0x7fa9d4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d8875700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa9d40cd9e0 0x7fa9d4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:37576/0 (socket says 172.21.15.26:37576) 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d8875700 1 -- 172.21.15.26:0/1773355488 learned_addr learned my addr 172.21.15.26:0/1773355488 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9076700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cb5a0 0x7fa9d40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9877700 1 -- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cb5a0 msgr2=0x7fa9d40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9877700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cb5a0 0x7fa9d40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9877700 1 -- 172.21.15.26:0/1773355488 >> v1:172.21.15.67:6789/0 conn(0x7fa9d40cd9e0 legacy=0x7fa9d4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d9877700 1 -- 172.21.15.26:0/1773355488 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40ccf00 con 0x7fa9d40cde50 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.302+0000 7fa9d3fff700 1 -- 172.21.15.26:0/1773355488 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100041115 0 0) 0x7fa9d415ae40 con 0x7fa9d40cd9e0 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9d9877700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d40cde50 0x7fa9d4156e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40098e0 tx=0x7fa9c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef274c5c3daeae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9d3fff700 1 -- 172.21.15.26:0/1773355488 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400b640 con 0x7fa9d40cde50 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9d3fff700 1 -- 172.21.15.26:0/1773355488 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400b7a0 con 0x7fa9d40cde50 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9d3fff700 1 -- 172.21.15.26:0/1773355488 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400bb40 con 0x7fa9d40cde50 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 -- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d40cde50 msgr2=0x7fa9d4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d40cde50 0x7fa9d4156e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40098e0 tx=0x7fa9c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 -- 172.21.15.26:0/1773355488 shutdown_connections 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d40cde50 0x7fa9d4156e90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1773355488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cb5a0 0x7fa9d40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 -- 172.21.15.26:0/1773355488 >> 172.21.15.26:0/1773355488 conn(0x7fa9d4070e30 msgr2=0x7fa9d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.303+0000 7fa9db2da700 1 -- 172.21.15.26:0/1773355488 shutdown_connections 2023-10-09T11:35:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.304+0000 7fa9db2da700 1 -- 172.21.15.26:0/1773355488 wait complete. 2023-10-09T11:35:47.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.305+0000 7fa9db2da700 1 Processor -- start 2023-10-09T11:35:47.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.305+0000 7fa9db2da700 1 -- start start 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.305+0000 7fa9db2da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.305+0000 7fa9db2da700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 0x7fa9d415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 0x7fa9d40b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40ca7a0 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415da20 con 0x7fa9d415deb0 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415cb70 con 0x7fa9d40cd9e0 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48066/0 (socket says 172.21.15.26:48066) 2023-10-09T11:35:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 -- 172.21.15.26:0/1873785580 learned_addr learned my addr 172.21.15.26:0/1873785580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9877700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 0x7fa9d40b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d8875700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 0x7fa9d415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 -- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 msgr2=0x7fa9d415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 0x7fa9d415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 -- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 msgr2=0x7fa9d40b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 0x7fa9d40b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 -- 172.21.15.26:0/1873785580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009420 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d8875700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 0x7fa9d415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9877700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 0x7fa9d40b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d9076700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e50 tx=0x7fa9cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00cc20 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00f040 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc014480 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d415ce10 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.306+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d415d3d0 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.307+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d415dd00 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.308+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc0147f0 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.308+0000 7fa9d17fa700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.308+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9cc0851f0 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.308+0000 7fa9d8875700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.309+0000 7fa9d8875700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 0x7fa9c00693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40b6170 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.312+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9cc052460 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.509+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9d4089590 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.510+0000 7fa9d17fa700 1 -- 172.21.15.26:0/1873785580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa9cc055a80 con 0x7fa9d40cb5a0 2023-10-09T11:35:47.511 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:47.512 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 msgr2=0x7fa9c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 0x7fa9c00693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40b6170 tx=0x7fa9c8009040 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 msgr2=0x7fa9d40ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e50 tx=0x7fa9cc00b040 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 shutdown_connections 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9d415deb0 0x7fa9d40b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d40cb5a0 0x7fa9d40ca260 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 --2- 172.21.15.26:0/1873785580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9d40cd9e0 0x7fa9d415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 >> 172.21.15.26:0/1873785580 conn(0x7fa9d4070e30 msgr2=0x7fa9d40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 shutdown_connections 2023-10-09T11:35:47.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.512+0000 7fa9db2da700 1 -- 172.21.15.26:0/1873785580 wait complete. 2023-10-09T11:35:47.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:47.526 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:47.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.646+0000 7fb1b3948700 1 Processor -- start 2023-10-09T11:35:47.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 -- start start 2023-10-09T11:35:47.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb1ac13c9b0 0x7fb1ac069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac06d7b0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac06f7d0 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.647+0000 7fb1b3948700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac06e330 con 0x7fb1ac0cc6f0 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b16e4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb1ac0cc320 0x7fb1ac13c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46378/0 (socket says 172.21.15.26:46378) 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b16e4700 1 -- 172.21.15.26:0/2270484891 learned_addr learned my addr 172.21.15.26:0/2270484891 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/2270484891 >> v2:172.21.15.26:3300/0 conn(0x7fb1ac13c9b0 0x7fb1ac069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b1ee5700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1abfff700 1 -- 172.21.15.26:0/2270484891 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629151863 0 0) 0x7fb1ac06d7b0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1abfff700 1 -- 172.21.15.26:0/2270484891 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb194003570 con 0x7fb1ac0cc320 2023-10-09T11:35:47.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 -- 172.21.15.26:0/2270484891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 msgr2=0x7fb1ac069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac069f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 -- 172.21.15.26:0/2270484891 >> v1:172.21.15.26:6789/0 conn(0x7fb1ac0cc320 legacy=0x7fb1ac13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 -- 172.21.15.26:0/2270484891 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac06da00 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac069a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00098e0 tx=0x7fb1a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28da23af6f8d094 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1abfff700 1 -- 172.21.15.26:0/2270484891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011630 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1abfff700 1 -- 172.21.15.26:0/2270484891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a0011790 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.648+0000 7fb1abfff700 1 -- 172.21.15.26:0/2270484891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011b30 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 -- 172.21.15.26:0/2270484891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac13c9b0 msgr2=0x7fb1ac069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac069a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00098e0 tx=0x7fb1a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 -- 172.21.15.26:0/2270484891 shutdown_connections 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac069f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 --2- 172.21.15.26:0/2270484891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac069a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 -- 172.21.15.26:0/2270484891 >> 172.21.15.26:0/2270484891 conn(0x7fb1ac067f00 msgr2=0x7fb1ac068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 -- 172.21.15.26:0/2270484891 shutdown_connections 2023-10-09T11:35:47.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.649+0000 7fb1b3948700 1 -- 172.21.15.26:0/2270484891 wait complete. 2023-10-09T11:35:47.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.650+0000 7fb1b3948700 1 Processor -- start 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.650+0000 7fb1b3948700 1 -- start start 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac13a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac13b7e0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac157a30 con 0x7fb1ac13c9b0 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b3948700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac13abd0 con 0x7fb1ac0cc6f0 2023-10-09T11:35:47.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48086/0 (socket says 172.21.15.26:48086) 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 -- 172.21.15.26:0/148988046 learned_addr learned my addr 172.21.15.26:0/148988046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b1ee5700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac13a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 -- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 msgr2=0x7fb1ac13a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac13a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 -- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 msgr2=0x7fb1ac0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b16e4700 1 -- 172.21.15.26:0/148988046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0009420 con 0x7fb1ac0cc320 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac13a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.651+0000 7fb1b1ee5700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1b16e4700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00cd30 tx=0x7fb19c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00ab70 con 0x7fb1ac0cc320 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00acf0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac13aeb0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007340 con 0x7fb1ac0cc320 2023-10-09T11:35:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.652+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac13b470 con 0x7fb1ac0cc320 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.653+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac04c3c0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.653+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb19c007770 con 0x7fb1ac0cc320 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.653+0000 7fb1a97fa700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.654+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb19c084ab0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.654+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.654+0000 7fb1b0ee3700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 0x7fb1980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac13cde0 tx=0x7fb1a0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.658+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb19c051d00 con 0x7fb1ac0cc320 2023-10-09T11:35:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.848+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1ac06dce0 con 0x7fb1ac0cc320 2023-10-09T11:35:47.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.848+0000 7fb1a97fa700 1 -- 172.21.15.26:0/148988046 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb19c00ae60 con 0x7fb1ac0cc320 2023-10-09T11:35:47.850 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 msgr2=0x7fb1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 0x7fb1980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac13cde0 tx=0x7fb1a0017000 comp rx=0 tx=0).stop 2023-10-09T11:35:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 msgr2=0x7fb1ac0c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00cd30 tx=0x7fb19c001b10 comp rx=0 tx=0).stop 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 shutdown_connections 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ac13c9b0 0x7fb1ac0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1ac0cc320 0x7fb1ac0c8ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 --2- 172.21.15.26:0/148988046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1ac0cc6f0 0x7fb1ac13a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 >> 172.21.15.26:0/148988046 conn(0x7fb1ac067f00 msgr2=0x7fb1ac0c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 shutdown_connections 2023-10-09T11:35:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.851+0000 7fb1b3948700 1 -- 172.21.15.26:0/148988046 wait complete. 2023-10-09T11:35:47.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.984+0000 7f963e8b0700 1 Processor -- start 2023-10-09T11:35:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.984+0000 7f963e8b0700 1 -- start start 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f963e8b0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 0x7f96380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f963e8b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f963806dc70 0x7f9638159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f963e8b0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96380ccfd0 con 0x7f963806e0e0 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f963e8b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380cf0e0 con 0x7f963806dc70 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f963e8b0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963815a3d0 con 0x7f9638159530 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f963806dc70 0x7f9638159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f963806dc70 0x7f9638159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48102/0 (socket says 172.21.15.26:48102) 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 -- 172.21.15.26:0/3925379365 learned_addr learned my addr 172.21.15.26:0/3925379365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f9637fff700 1 --2- 172.21.15.26:0/3925379365 >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 0x7f96380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 -- 172.21.15.26:0/3925379365 >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 msgr2=0x7f96380ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 --2- 172.21.15.26:0/3925379365 >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 0x7f96380ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 -- 172.21.15.26:0/3925379365 >> v1:172.21.15.67:6789/0 conn(0x7f963806e0e0 legacy=0x7f96380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 -- 172.21.15.26:0/3925379365 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963815a6b0 con 0x7f963806dc70 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f9637fff700 1 --2- 172.21.15.26:0/3925379365 >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 0x7f96380ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.985+0000 7f96377fe700 1 --2- 172.21.15.26:0/3925379365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806dc70 0x7f9638159900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f963806d630 tx=0x7f9620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f5a58c02b93817 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f9636ffd700 1 -- 172.21.15.26:0/3925379365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000b860 con 0x7f963806dc70 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f9636ffd700 1 -- 172.21.15.26:0/3925379365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000b9c0 con 0x7f963806dc70 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f9636ffd700 1 -- 172.21.15.26:0/3925379365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000bd60 con 0x7f963806dc70 2023-10-09T11:35:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 -- 172.21.15.26:0/3925379365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806dc70 msgr2=0x7f9638159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3925379365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806dc70 0x7f9638159900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f963806d630 tx=0x7f9620009250 comp rx=0 tx=0).stop 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 -- 172.21.15.26:0/3925379365 shutdown_connections 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3925379365 >> v2:172.21.15.67:3300/0 conn(0x7f9638159530 0x7f96380ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3925379365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806dc70 0x7f9638159900 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 -- 172.21.15.26:0/3925379365 >> 172.21.15.26:0/3925379365 conn(0x7f96380703a0 msgr2=0x7f96380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 -- 172.21.15.26:0/3925379365 shutdown_connections 2023-10-09T11:35:47.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.986+0000 7f963e8b0700 1 -- 172.21.15.26:0/3925379365 wait complete. 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.987+0000 7f963e8b0700 1 Processor -- start 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.987+0000 7f963e8b0700 1 -- start start 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f963806dc70 0x7f963815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9638159530 0x7f963814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b3d20 con 0x7f963806e0e0 2023-10-09T11:35:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b1450 con 0x7f963806dc70 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963e8b0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963816d6d0 con 0x7f9638159530 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f96377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f96377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48108/0 (socket says 172.21.15.26:48108) 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f96377fe700 1 -- 172.21.15.26:0/3257520934 learned_addr learned my addr 172.21.15.26:0/3257520934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f9637fff700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f963806dc70 0x7f963815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f963ce4d700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9638159530 0x7f963814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f96377fe700 1 -- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9638159530 msgr2=0x7f963814df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.988+0000 7f96377fe700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9638159530 0x7f963814df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f96377fe700 1 -- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f963806dc70 msgr2=0x7f963815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f96377fe700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f963806dc70 0x7f963815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f96377fe700 1 -- 172.21.15.26:0/3257520934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200094f0 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f96377fe700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9620009290 tx=0x7f9620017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620011e40 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962001f070 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963816d9b0 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200266d0 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.989+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963816df70 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.990+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9638088410 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.990+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9620026a80 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.991+0000 7f962ffff700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.991+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9620021070 con 0x7f963806e0e0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.991+0000 7f9637fff700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.991+0000 7f9637fff700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9628006f00 tx=0x7f9628008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:47.995+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96200535e0 con 0x7f963806e0e0 2023-10-09T11:35:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.189+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f963804c3c0 con 0x7f963806e0e0 2023-10-09T11:35:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.190+0000 7f962ffff700 1 -- 172.21.15.26:0/3257520934 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9620056c00 con 0x7f963806e0e0 2023-10-09T11:35:48.192 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:48.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 msgr2=0x7f96180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9628006f00 tx=0x7f9628008040 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 msgr2=0x7f96380b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9620009290 tx=0x7f9620017000 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 shutdown_connections 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9638159530 0x7f963814df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f963806dc70 0x7f963815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 --2- 172.21.15.26:0/3257520934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f963806e0e0 0x7f96380b22e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 >> 172.21.15.26:0/3257520934 conn(0x7f96380703a0 msgr2=0x7f963815bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 shutdown_connections 2023-10-09T11:35:48.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.192+0000 7f963e8b0700 1 -- 172.21.15.26:0/3257520934 wait complete. 2023-10-09T11:35:48.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:48.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.326+0000 7f4e6a764700 1 Processor -- start 2023-10-09T11:35:48.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.326+0000 7f4e6a764700 1 -- start start 2023-10-09T11:35:48.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e6a764700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e64159b10 0x7f4e640af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e6a764700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e64159ee0 0x7f4e6406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e6a764700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6406d070 con 0x7f4e640afe60 2023-10-09T11:35:48.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e6a764700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640c9270 con 0x7f4e64159b10 2023-10-09T11:35:48.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e6a764700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6406c740 con 0x7f4e64159ee0 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e63fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e64159b10 0x7f4e640af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e63fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e64159b10 0x7f4e640af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48118/0 (socket says 172.21.15.26:48118) 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.327+0000 7f4e63fff700 1 -- 172.21.15.26:0/866118095 learned_addr learned my addr 172.21.15.26:0/866118095 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e68d01700 1 --2- 172.21.15.26:0/866118095 >> v2:172.21.15.67:3300/0 conn(0x7f4e64159ee0 0x7f4e6406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e63fff700 1 -- 172.21.15.26:0/866118095 >> v2:172.21.15.67:3300/0 conn(0x7f4e64159ee0 msgr2=0x7f4e6406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e63fff700 1 --2- 172.21.15.26:0/866118095 >> v2:172.21.15.67:3300/0 conn(0x7f4e64159ee0 0x7f4e6406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e63fff700 1 -- 172.21.15.26:0/866118095 >> v1:172.21.15.67:6789/0 conn(0x7f4e640afe60 legacy=0x7f4e6406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e63fff700 1 -- 172.21.15.26:0/866118095 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6406ca20 con 0x7f4e64159b10 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e63fff700 1 --2- 172.21.15.26:0/866118095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159b10 0x7f4e640af920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e6406a3a0 tx=0x7f4e5800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81088356a7ad8a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e62ffd700 1 -- 172.21.15.26:0/866118095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005c10 con 0x7f4e64159b10 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e62ffd700 1 -- 172.21.15.26:0/866118095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58005d70 con 0x7f4e64159b10 2023-10-09T11:35:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.328+0000 7f4e62ffd700 1 -- 172.21.15.26:0/866118095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800db80 con 0x7f4e64159b10 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 -- 172.21.15.26:0/866118095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159b10 msgr2=0x7f4e640af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 --2- 172.21.15.26:0/866118095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159b10 0x7f4e640af920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e6406a3a0 tx=0x7f4e5800b4c0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 -- 172.21.15.26:0/866118095 shutdown_connections 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 --2- 172.21.15.26:0/866118095 >> v2:172.21.15.67:3300/0 conn(0x7f4e64159ee0 0x7f4e6406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 --2- 172.21.15.26:0/866118095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159b10 0x7f4e640af920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 -- 172.21.15.26:0/866118095 >> 172.21.15.26:0/866118095 conn(0x7f4e640ccb60 msgr2=0x7f4e640ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 -- 172.21.15.26:0/866118095 shutdown_connections 2023-10-09T11:35:48.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.329+0000 7f4e6a764700 1 -- 172.21.15.26:0/866118095 wait complete. 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.330+0000 7f4e6a764700 1 Processor -- start 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.330+0000 7f4e6a764700 1 -- start start 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e640afe60 0x7f4e641424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 0x7f4e640c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64157e00 con 0x7f4e64159ee0 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640c4690 con 0x7f4e64159b10 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e6a764700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64152590 con 0x7f4e640afe60 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48130/0 (socket says 172.21.15.26:48130) 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 -- 172.21.15.26:0/3121145833 learned_addr learned my addr 172.21.15.26:0/3121145833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e637fe700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 0x7f4e640c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e63fff700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e640afe60 0x7f4e641424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 -- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e640afe60 msgr2=0x7f4e641424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e640afe60 0x7f4e641424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 -- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 msgr2=0x7f4e640c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 0x7f4e640c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 -- 172.21.15.26:0/3121145833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5800b720 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e637fe700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 0x7f4e640c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e68d01700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009ef0 tx=0x7f4e5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.331+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00cc50 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.332+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e640c6760 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.332+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00f040 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.332+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c014480 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.332+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e640c6d20 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.332+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6404c3c0 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.333+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e5c014830 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.333+0000 7f4e4bfff700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.333+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e5c0853e0 con 0x7f4e64159ee0 2023-10-09T11:35:48.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.333+0000 7f4e63fff700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.334+0000 7f4e63fff700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 0x7f4e500693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e6406a3a0 tx=0x7f4e5801a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.338+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e5c052650 con 0x7f4e64159ee0 2023-10-09T11:35:48.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.531+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e6406f320 con 0x7f4e64159ee0 2023-10-09T11:35:48.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.531+0000 7f4e4bfff700 1 -- 172.21.15.26:0/3121145833 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e5c055c70 con 0x7f4e64159ee0 2023-10-09T11:35:48.533 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 msgr2=0x7f4e500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 0x7f4e500693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e6406a3a0 tx=0x7f4e5801a000 comp rx=0 tx=0).stop 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 msgr2=0x7f4e640c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009ef0 tx=0x7f4e5c00b040 comp rx=0 tx=0).stop 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 shutdown_connections 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e64159ee0 0x7f4e640c4150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e640afe60 0x7f4e641424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 --2- 172.21.15.26:0/3121145833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e64159b10 0x7f4e640c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 >> 172.21.15.26:0/3121145833 conn(0x7f4e640ccb60 msgr2=0x7f4e640c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 shutdown_connections 2023-10-09T11:35:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.533+0000 7f4e6a764700 1 -- 172.21.15.26:0/3121145833 wait complete. 2023-10-09T11:35:48.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.664+0000 7fb581dee700 1 Processor -- start 2023-10-09T11:35:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb581dee700 1 -- start start 2023-10-09T11:35:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb581dee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 0x7fb57c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb581dee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c15ae40 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb581dee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c15ab60 con 0x7fb57c0cde50 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb581dee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0d13f0 con 0x7fb57c0cb5a0 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb57affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb57c0cd9e0 0x7fb57c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46382/0 (socket says 172.21.15.26:46382) 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.665+0000 7fb57affd700 1 -- 172.21.15.26:0/4065051176 learned_addr learned my addr 172.21.15.26:0/4065051176 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515204810 0 0) 0x7fb57c15ae40 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb564003570 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851770635 0 0) 0x7fb564003570 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 msgr2=0x7fb57c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 0x7fb57c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 >> v1:172.21.15.67:6789/0 conn(0x7fb57c0cde50 legacy=0x7fb57c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0ccf00 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb570001470 con 0x7fb57c0cd9e0 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 >> v1:172.21.15.26:6789/0 conn(0x7fb57c0cd9e0 legacy=0x7fb57c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb564003a90 0x7fb564003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb564004810 0x7fb564004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 0x7fb56400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564005540 con 0x7fb564003a90 2023-10-09T11:35:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640056b0 con 0x7fb564004810 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56400bff0 con 0x7fb57c0cb5a0 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb564003a90 0x7fb564003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57affd700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb564004810 0x7fb564004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.666+0000 7fb57bfff700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 0x7fb56400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 -- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 msgr2=0x7fb56400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c0cb5a0 0x7fb56400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 -- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb564004810 msgr2=0x7fb564004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb564004810 0x7fb564004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 -- 172.21.15.26:0/4065051176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564003570 con 0x7fb564003a90 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb564003a90 0x7fb564003ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0099c0 tx=0x7fb56c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8090ebe0529a1e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c011400 con 0x7fb564003a90 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c011560 con 0x7fb564003a90 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57a7fc700 1 -- 172.21.15.26:0/4065051176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c011920 con 0x7fb564003a90 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb581dee700 1 -- 172.21.15.26:0/4065051176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb564003a90 msgr2=0x7fb564003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb581dee700 1 --2- 172.21.15.26:0/4065051176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb564003a90 0x7fb564003ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0099c0 tx=0x7fb56c009060 comp rx=0 tx=0).stop 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.667+0000 7fb57bfff700 1 -- 172.21.15.26:0/4065051176 reap_dead start 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.668+0000 7fb581dee700 1 -- 172.21.15.26:0/4065051176 shutdown_connections 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.668+0000 7fb581dee700 1 -- 172.21.15.26:0/4065051176 >> 172.21.15.26:0/4065051176 conn(0x7fb57c070e30 msgr2=0x7fb57c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.668+0000 7fb581dee700 1 -- 172.21.15.26:0/4065051176 shutdown_connections 2023-10-09T11:35:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.668+0000 7fb581dee700 1 -- 172.21.15.26:0/4065051176 wait complete. 2023-10-09T11:35:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.669+0000 7fb581dee700 1 Processor -- start 2023-10-09T11:35:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.669+0000 7fb581dee700 1 -- start start 2023-10-09T11:35:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.669+0000 7fb581dee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.669+0000 7fb581dee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c156540 0x7fb57c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.669+0000 7fb581dee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 0x7fb57c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb581dee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c16a980 con 0x7fb57c156170 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb581dee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c16a050 con 0x7fb57c15c4b0 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb581dee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c16a330 con 0x7fb57c156540 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48136/0 (socket says 172.21.15.26:48136) 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 -- 172.21.15.26:0/1199063469 learned_addr learned my addr 172.21.15.26:0/1199063469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57bfff700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 0x7fb57c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57affd700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c156540 0x7fb57c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 -- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c156540 msgr2=0x7fb57c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c156540 0x7fb57c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 -- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 msgr2=0x7fb57c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 0x7fb57c15c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 -- 172.21.15.26:0/1199063469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c16a610 con 0x7fb57c156170 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57bfff700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 0x7fb57c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb57b7fe700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009150 tx=0x7fb56c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c011ea0 con 0x7fb57c156170 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c000c40 con 0x7fb57c156170 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c169d50 con 0x7fb57c156170 2023-10-09T11:35:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c011920 con 0x7fb57c156170 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.670+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c15b070 con 0x7fb57c156170 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.671+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c04c3c0 con 0x7fb57c156170 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.672+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb56c01d640 con 0x7fb57c156170 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.672+0000 7fb5637fe700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 0x7fb5680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.672+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb56c086210 con 0x7fb57c156170 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.672+0000 7fb57affd700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 0x7fb5680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.673+0000 7fb57affd700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 0x7fb5680693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb570001ce0 tx=0x7fb570009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.676+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb56c053480 con 0x7fb57c156170 2023-10-09T11:35:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.869+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb57c0cd1e0 con 0x7fb57c156170 2023-10-09T11:35:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.870+0000 7fb5637fe700 1 -- 172.21.15.26:0/1199063469 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb56c056aa0 con 0x7fb57c156170 2023-10-09T11:35:48.871 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:48.872 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:48.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 msgr2=0x7fb5680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 0x7fb5680693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb570001ce0 tx=0x7fb570009040 comp rx=0 tx=0).stop 2023-10-09T11:35:48.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 msgr2=0x7fb57c0b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009150 tx=0x7fb56c015000 comp rx=0 tx=0).stop 2023-10-09T11:35:48.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 shutdown_connections 2023-10-09T11:35:48.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb57c15c4b0 0x7fb57c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c156170 0x7fb57c0b4bd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb568066f30 0x7fb5680693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 --2- 172.21.15.26:0/1199063469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb57c156540 0x7fb57c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 >> 172.21.15.26:0/1199063469 conn(0x7fb57c070e30 msgr2=0x7fb57c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 shutdown_connections 2023-10-09T11:35:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:48.872+0000 7fb581dee700 1 -- 172.21.15.26:0/1199063469 wait complete. 2023-10-09T11:35:48.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:48.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.007+0000 7f9938344700 1 Processor -- start 2023-10-09T11:35:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.007+0000 7f9938344700 1 -- start start 2023-10-09T11:35:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f9938344700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f993006dc70 0x7f9930159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f9938344700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f993006e0e0 0x7f99300cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f9938344700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99300ccfd0 con 0x7f9930159530 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f9938344700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993015a3d0 con 0x7f993006e0e0 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f9938344700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993015a6b0 con 0x7f993006dc70 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f99368e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f993006e0e0 0x7f99300cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f99360e0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9930159530 0x7f99300ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46386/0 (socket says 172.21.15.26:46386) 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.008+0000 7f99360e0700 1 -- 172.21.15.26:0/314442885 learned_addr learned my addr 172.21.15.26:0/314442885 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99358df700 1 --2- 172.21.15.26:0/314442885 >> v2:172.21.15.67:3300/0 conn(0x7f993006dc70 0x7f9930159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99368e1700 1 -- 172.21.15.26:0/314442885 >> v2:172.21.15.67:3300/0 conn(0x7f993006dc70 msgr2=0x7f9930159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99368e1700 1 --2- 172.21.15.26:0/314442885 >> v2:172.21.15.67:3300/0 conn(0x7f993006dc70 0x7f9930159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99368e1700 1 -- 172.21.15.26:0/314442885 >> v1:172.21.15.26:6789/0 conn(0x7f9930159530 legacy=0x7f99300ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99368e1700 1 -- 172.21.15.26:0/314442885 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993015a990 con 0x7f993006e0e0 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99350de700 1 -- 172.21.15.26:0/314442885 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182244918 0 0) 0x7f99300ccfd0 con 0x7f9930159530 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99368e1700 1 --2- 172.21.15.26:0/314442885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993006e0e0 0x7f99300cb6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99300b66e0 tx=0x7f9920009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395367b0402c089f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99350de700 1 -- 172.21.15.26:0/314442885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000e070 con 0x7f993006e0e0 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99350de700 1 -- 172.21.15.26:0/314442885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000bc30 con 0x7f993006e0e0 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f99350de700 1 -- 172.21.15.26:0/314442885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920012430 con 0x7f993006e0e0 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f9938344700 1 -- 172.21.15.26:0/314442885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993006e0e0 msgr2=0x7f99300cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f9938344700 1 --2- 172.21.15.26:0/314442885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993006e0e0 0x7f99300cb6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99300b66e0 tx=0x7f9920009780 comp rx=0 tx=0).stop 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.009+0000 7f9938344700 1 -- 172.21.15.26:0/314442885 shutdown_connections 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.010+0000 7f9938344700 1 --2- 172.21.15.26:0/314442885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f993006e0e0 0x7f99300cb6f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.010+0000 7f9938344700 1 --2- 172.21.15.26:0/314442885 >> v2:172.21.15.67:3300/0 conn(0x7f993006dc70 0x7f9930159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.010+0000 7f9938344700 1 -- 172.21.15.26:0/314442885 >> 172.21.15.26:0/314442885 conn(0x7f99300703a0 msgr2=0x7f99300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.010+0000 7f9938344700 1 -- 172.21.15.26:0/314442885 shutdown_connections 2023-10-09T11:35:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.010+0000 7f9938344700 1 -- 172.21.15.26:0/314442885 wait complete. 2023-10-09T11:35:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 Processor -- start 2023-10-09T11:35:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 -- start start 2023-10-09T11:35:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f993006dc70 0x7f99300b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993006e0e0 0x7f993013db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300b47d0 con 0x7f9930159530 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300b4ab0 con 0x7f993006e0e0 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f9938344700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99300b4d90 con 0x7f993006dc70 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f99368e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f99368e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48158/0 (socket says 172.21.15.26:48158) 2023-10-09T11:35:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.011+0000 7f99368e1700 1 -- 172.21.15.26:0/1881856162 learned_addr learned my addr 172.21.15.26:0/1881856162 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99358df700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993006e0e0 0x7f993013db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99360e0700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f993006dc70 0x7f99300b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 -- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f993006dc70 msgr2=0x7f99300b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f993006dc70 0x7f99300b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 -- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993006e0e0 msgr2=0x7f993013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993006e0e0 0x7f993013db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 -- 172.21.15.26:0/1881856162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009a20 con 0x7f9930159530 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f99368e1700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9930089650 tx=0x7f9920019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992001d630 con 0x7f9930159530 2023-10-09T11:35:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992001d790 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99300b5070 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992001db50 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.012+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993013e070 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.013+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99300b5590 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.013+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9920024070 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.014+0000 7f992e7fc700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.014+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9920086e60 con 0x7f9930159530 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.014+0000 7f99360e0700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.014+0000 7f99360e0700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f992800c8f0 tx=0x7f9928009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.018+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99300b5590 con 0x7f9930159530 2023-10-09T11:35:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.213+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99300b5590 con 0x7f9930159530 2023-10-09T11:35:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.213+0000 7f992e7fc700 1 -- 172.21.15.26:0/1881856162 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99300b5590 con 0x7f9930159530 2023-10-09T11:35:49.215 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.215+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 msgr2=0x7f991c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.215+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f992800c8f0 tx=0x7f9928009040 comp rx=0 tx=0).stop 2023-10-09T11:35:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.215+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 msgr2=0x7f993015d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.215+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9930089650 tx=0x7f9920019000 comp rx=0 tx=0).stop 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 shutdown_connections 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9930159530 0x7f993015d5f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f993006dc70 0x7f99300b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 --2- 172.21.15.26:0/1881856162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993006e0e0 0x7f993013db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 >> 172.21.15.26:0/1881856162 conn(0x7f99300703a0 msgr2=0x7f99300ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 shutdown_connections 2023-10-09T11:35:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.216+0000 7f9938344700 1 -- 172.21.15.26:0/1881856162 wait complete. 2023-10-09T11:35:49.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.351+0000 7fb9c918e700 1 Processor -- start 2023-10-09T11:35:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.351+0000 7fb9c918e700 1 -- start start 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c918e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9c4153dd0 0x7fb9c415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c918e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 0x7fb9c40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c918e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c415ac50 con 0x7fb9c4153a00 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c918e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c415d010 con 0x7fb9c4153dd0 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c918e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40cf3e0 con 0x7fb9c40cea00 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9c4153dd0 0x7fb9c415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb9c4153a00 0x7fb9c415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46394/0 (socket says 172.21.15.26:46394) 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c3fff700 1 -- 172.21.15.26:0/832099364 learned_addr learned my addr 172.21.15.26:0/832099364 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c898d700 1 --2- 172.21.15.26:0/832099364 >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 0x7fb9c40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c37fe700 1 -- 172.21.15.26:0/832099364 >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 msgr2=0x7fb9c40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c37fe700 1 --2- 172.21.15.26:0/832099364 >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 0x7fb9c40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c37fe700 1 -- 172.21.15.26:0/832099364 >> v1:172.21.15.26:6789/0 conn(0x7fb9c4153a00 legacy=0x7fb9c415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c37fe700 1 -- 172.21.15.26:0/832099364 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c415af60 con 0x7fb9c4153dd0 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.352+0000 7fb9c2ffd700 1 -- 172.21.15.26:0/832099364 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477102399 0 0) 0x7fb9c415ac50 con 0x7fb9c4153a00 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c898d700 1 --2- 172.21.15.26:0/832099364 >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 0x7fb9c40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c37fe700 1 --2- 172.21.15.26:0/832099364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c415de50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40d03b0 tx=0x7fb9b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f49dac8d64e7ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c2ffd700 1 -- 172.21.15.26:0/832099364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400b6b0 con 0x7fb9c4153dd0 2023-10-09T11:35:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c2ffd700 1 -- 172.21.15.26:0/832099364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400b810 con 0x7fb9c4153dd0 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c2ffd700 1 -- 172.21.15.26:0/832099364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400bbb0 con 0x7fb9c4153dd0 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 -- 172.21.15.26:0/832099364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 msgr2=0x7fb9c415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 --2- 172.21.15.26:0/832099364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c415de50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40d03b0 tx=0x7fb9b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 -- 172.21.15.26:0/832099364 shutdown_connections 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 --2- 172.21.15.26:0/832099364 >> v2:172.21.15.67:3300/0 conn(0x7fb9c40cea00 0x7fb9c40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 --2- 172.21.15.26:0/832099364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c415de50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 -- 172.21.15.26:0/832099364 >> 172.21.15.26:0/832099364 conn(0x7fb9c40703a0 msgr2=0x7fb9c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 -- 172.21.15.26:0/832099364 shutdown_connections 2023-10-09T11:35:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.353+0000 7fb9c918e700 1 -- 172.21.15.26:0/832099364 wait complete. 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.354+0000 7fb9c918e700 1 Processor -- start 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 -- start start 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c40cea00 0x7fb9c414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4153a00 0x7fb9c40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c414c980 con 0x7fb9c4153dd0 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40c7c90 con 0x7fb9c4153a00 2023-10-09T11:35:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c918e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40c71e0 con 0x7fb9c40cea00 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c898d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c898d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48182/0 (socket says 172.21.15.26:48182) 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.355+0000 7fb9c898d700 1 -- 172.21.15.26:0/977164597 learned_addr learned my addr 172.21.15.26:0/977164597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c37fe700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4153a00 0x7fb9c40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c3fff700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c40cea00 0x7fb9c414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 -- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c40cea00 msgr2=0x7fb9c414c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c40cea00 0x7fb9c414c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 -- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4153a00 msgr2=0x7fb9c40c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4153a00 0x7fb9c40c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 -- 172.21.15.26:0/977164597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009420 con 0x7fb9c4153dd0 2023-10-09T11:35:49.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c898d700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00a380 tx=0x7fb9bc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc015440 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0155a0 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c40c7680 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc015960 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.356+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c40c7920 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.357+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c40cef10 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.358+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9bc015d50 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.358+0000 7fb9bbfff700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.358+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9bc084dc0 con 0x7fb9c4153dd0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.358+0000 7fb9c3fff700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.359+0000 7fb9c3fff700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 0x7fb9a40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac007fd0 tx=0x7fb9ac007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.362+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9bc052030 con 0x7fb9c4153dd0 2023-10-09T11:35:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.555+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9c40c7e00 con 0x7fb9c4153dd0 2023-10-09T11:35:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.555+0000 7fb9bbfff700 1 -- 172.21.15.26:0/977164597 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9bc01a020 con 0x7fb9c4153dd0 2023-10-09T11:35:49.556 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 msgr2=0x7fb9a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 0x7fb9a40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac007fd0 tx=0x7fb9ac007d30 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 msgr2=0x7fb9c40cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00a380 tx=0x7fb9bc007900 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 shutdown_connections 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9c4153dd0 0x7fb9c40cc290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c40cea00 0x7fb9c414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 --2- 172.21.15.26:0/977164597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4153a00 0x7fb9c40c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 >> 172.21.15.26:0/977164597 conn(0x7fb9c40703a0 msgr2=0x7fb9c415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 shutdown_connections 2023-10-09T11:35:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.557+0000 7fb9c918e700 1 -- 172.21.15.26:0/977164597 wait complete. 2023-10-09T11:35:49.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 Processor -- start 2023-10-09T11:35:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 -- start start 2023-10-09T11:35:49.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34800cdb70 0x7f3480164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800c9310 con 0x7f34801598c0 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800ce090 con 0x7f34800c4580 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.691+0000 7f3485ceb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34800ad990 con 0x7f34800cdb70 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34800cdb70 0x7f3480164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34801598c0 0x7f34800c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52148/0 (socket says 172.21.15.26:52148) 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347f7fe700 1 -- 172.21.15.26:0/1413750180 learned_addr learned my addr 172.21.15.26:0/1413750180 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347ffff700 1 -- 172.21.15.26:0/1413750180 >> v1:172.21.15.67:6789/0 conn(0x7f34800c4580 legacy=0x7f34800cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347ffff700 1 -- 172.21.15.26:0/1413750180 >> v1:172.21.15.26:6789/0 conn(0x7f34801598c0 legacy=0x7f34800c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347ffff700 1 -- 172.21.15.26:0/1413750180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800c8cc0 con 0x7f34800cdb70 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347e7fc700 1 -- 172.21.15.26:0/1413750180 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678929770 0 0) 0x7f34800c9310 con 0x7f34801598c0 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347ffff700 1 --2- 172.21.15.26:0/1413750180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f3480164660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f34780098e0 tx=0x7f34780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414a9e868eb1eff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347e7fc700 1 -- 172.21.15.26:0/1413750180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478009e80 con 0x7f34800cdb70 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347e7fc700 1 -- 172.21.15.26:0/1413750180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347800b860 con 0x7f34800cdb70 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.692+0000 7f347e7fc700 1 -- 172.21.15.26:0/1413750180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800bbe0 con 0x7f34800cdb70 2023-10-09T11:35:49.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 -- 172.21.15.26:0/1413750180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 msgr2=0x7f3480164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 --2- 172.21.15.26:0/1413750180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f3480164660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f34780098e0 tx=0x7f34780091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 -- 172.21.15.26:0/1413750180 shutdown_connections 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 --2- 172.21.15.26:0/1413750180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f3480164660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 -- 172.21.15.26:0/1413750180 >> 172.21.15.26:0/1413750180 conn(0x7f3480088000 msgr2=0x7f34800883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 -- 172.21.15.26:0/1413750180 shutdown_connections 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.693+0000 7f3485ceb700 1 -- 172.21.15.26:0/1413750180 wait complete. 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.694+0000 7f3485ceb700 1 Processor -- start 2023-10-09T11:35:49.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.694+0000 7f3485ceb700 1 -- start start 2023-10-09T11:35:49.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 0x7f3480154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 0x7f3480157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b35b0 con 0x7f34800cdb70 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b3890 con 0x7f34801598c0 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f3485ceb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b3b70 con 0x7f34800c4580 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52796/0 (socket says 172.21.15.26:52796) 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 -- 172.21.15.26:0/4140576943 learned_addr learned my addr 172.21.15.26:0/4140576943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347ffff700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 0x7f3480157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347f7fe700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 0x7f3480154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 -- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 msgr2=0x7f3480154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 0x7f3480154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 -- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 msgr2=0x7f3480157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 0x7f3480157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 -- 172.21.15.26:0/4140576943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478009420 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347ffff700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 0x7f3480157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347f7fe700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 0x7f3480154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.695+0000 7f347effd700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f346800c7c0 tx=0x7f3468007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.696+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011590 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.696+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34680116f0 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.696+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34800b3e50 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.696+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011ab0 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.696+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3480154a80 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.697+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34800b3fe0 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.697+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f346801b3b0 con 0x7f34800cdb70 2023-10-09T11:35:49.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.697+0000 7f34777fe700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 0x7f34600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.698+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3468083a50 con 0x7f34800cdb70 2023-10-09T11:35:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.698+0000 7f347f7fe700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 0x7f34600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.698+0000 7f347f7fe700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 0x7f34600693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3470000f80 tx=0x7f3470009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.702+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3468050cc0 con 0x7f34800cdb70 2023-10-09T11:35:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.895+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34800b1330 con 0x7f34800cdb70 2023-10-09T11:35:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.895+0000 7f34777fe700 1 -- 172.21.15.26:0/4140576943 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34800b1330 con 0x7f34800cdb70 2023-10-09T11:35:49.897 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 msgr2=0x7f34600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 0x7f34600693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3470000f80 tx=0x7f3470009040 comp rx=0 tx=0).stop 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 msgr2=0x7f34800b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f346800c7c0 tx=0x7f3468007f50 comp rx=0 tx=0).stop 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 shutdown_connections 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34801598c0 0x7f3480157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3460066f30 0x7f34600693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34800c4580 0x7f3480154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 --2- 172.21.15.26:0/4140576943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800cdb70 0x7f34800b2c40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 >> 172.21.15.26:0/4140576943 conn(0x7f3480088000 msgr2=0x7f3480156380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 shutdown_connections 2023-10-09T11:35:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:49.897+0000 7f3485ceb700 1 -- 172.21.15.26:0/4140576943 wait complete. 2023-10-09T11:35:49.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.030+0000 7fed5df6b700 1 Processor -- start 2023-10-09T11:35:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.030+0000 7fed5df6b700 1 -- start start 2023-10-09T11:35:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed5df6b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cb5a0 0x7fed580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed5df6b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed580cde50 0x7fed58156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed5df6b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5815ae40 con 0x7fed580cd9e0 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed5df6b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580d13f0 con 0x7fed580cde50 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed5df6b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5815ab60 con 0x7fed580cb5a0 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed57fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed580cde50 0x7fed58156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed577fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cb5a0 0x7fed580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed56ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fed580cd9e0 0x7fed58159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51648/0 (socket says 172.21.15.26:51648) 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.031+0000 7fed56ffd700 1 -- 172.21.15.26:0/858564627 learned_addr learned my addr 172.21.15.26:0/858564627 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed57fff700 1 -- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cb5a0 msgr2=0x7fed580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed57fff700 1 --2- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cb5a0 0x7fed580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed57fff700 1 -- 172.21.15.26:0/858564627 >> v1:172.21.15.67:6789/0 conn(0x7fed580cd9e0 legacy=0x7fed58159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed57fff700 1 -- 172.21.15.26:0/858564627 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580ccf00 con 0x7fed580cde50 2023-10-09T11:35:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed567fc700 1 -- 172.21.15.26:0/858564627 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046384767 0 0) 0x7fed5815ae40 con 0x7fed580cd9e0 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed57fff700 1 --2- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed580cde50 0x7fed58156e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed50009e60 tx=0x7fed50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e4d3641654a369 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed567fc700 1 -- 172.21.15.26:0/858564627 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000e070 con 0x7fed580cde50 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed567fc700 1 -- 172.21.15.26:0/858564627 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000bb60 con 0x7fed580cde50 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.032+0000 7fed567fc700 1 -- 172.21.15.26:0/858564627 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50012430 con 0x7fed580cde50 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 -- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed580cde50 msgr2=0x7fed58156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 --2- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed580cde50 0x7fed58156e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed50009e60 tx=0x7fed50009780 comp rx=0 tx=0).stop 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 -- 172.21.15.26:0/858564627 shutdown_connections 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 --2- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed580cde50 0x7fed58156e90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 --2- 172.21.15.26:0/858564627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cb5a0 0x7fed580cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 -- 172.21.15.26:0/858564627 >> 172.21.15.26:0/858564627 conn(0x7fed58070e30 msgr2=0x7fed580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 -- 172.21.15.26:0/858564627 shutdown_connections 2023-10-09T11:35:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.033+0000 7fed5df6b700 1 -- 172.21.15.26:0/858564627 wait complete. 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.034+0000 7fed5df6b700 1 Processor -- start 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.034+0000 7fed5df6b700 1 -- start start 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cd9e0 0x7fed5815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5816ca70 0x7fed5816cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5815b690 con 0x7fed580cb5a0 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5816d450 con 0x7fed5816ca70 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed5df6b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5815e2c0 con 0x7fed580cd9e0 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52802/0 (socket says 172.21.15.26:52802) 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 -- 172.21.15.26:0/591661148 learned_addr learned my addr 172.21.15.26:0/591661148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed57fff700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5816ca70 0x7fed5816cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed56ffd700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cd9e0 0x7fed5815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 -- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cd9e0 msgr2=0x7fed5815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cd9e0 0x7fed5815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 -- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5816ca70 msgr2=0x7fed5816cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5816ca70 0x7fed5816cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 -- 172.21.15.26:0/591661148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009a20 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.035+0000 7fed577fe700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed4800e960 tx=0x7fed480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.036+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48013680 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.036+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed480137e0 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.036+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed580c8930 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.036+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48013b80 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.036+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5815dfe0 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.037+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed580c8790 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.037+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed480123d0 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.037+0000 7fed3f7fe700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.038+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed480845b0 con 0x7fed580cb5a0 2023-10-09T11:35:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.038+0000 7fed56ffd700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.038+0000 7fed56ffd700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fed580b36f0 tx=0x7fed4c007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.042+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed580c8790 con 0x7fed580cb5a0 2023-10-09T11:35:50.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.235+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed580c8790 con 0x7fed580cb5a0 2023-10-09T11:35:50.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.236+0000 7fed3f7fe700 1 -- 172.21.15.26:0/591661148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fed580c8790 con 0x7fed580cb5a0 2023-10-09T11:35:50.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:50.238 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:50.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 msgr2=0x7fed440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fed580b36f0 tx=0x7fed4c007d30 comp rx=0 tx=0).stop 2023-10-09T11:35:50.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 msgr2=0x7fed5815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed4800e960 tx=0x7fed480091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 shutdown_connections 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5816ca70 0x7fed5816cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed580cb5a0 0x7fed5815d610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 --2- 172.21.15.26:0/591661148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed580cd9e0 0x7fed5815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 >> 172.21.15.26:0/591661148 conn(0x7fed58070e30 msgr2=0x7fed580b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 shutdown_connections 2023-10-09T11:35:50.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.238+0000 7fed5df6b700 1 -- 172.21.15.26:0/591661148 wait complete. 2023-10-09T11:35:50.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:50.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:50.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.372+0000 7f970e361700 1 Processor -- start 2023-10-09T11:35:50.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 -- start start 2023-10-09T11:35:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97080ca2c0 0x7f97080ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97080ccba0 0x7f97080cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080c32a0 con 0x7f9708157930 2023-10-09T11:35:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080c9730 con 0x7f97080ccba0 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.373+0000 7f970e361700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080cd560 con 0x7f97080ca2c0 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97080ccba0 0x7f97080cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9707fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9708157930 0x7f97080ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52158/0 (socket says 172.21.15.26:52158) 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9707fff700 1 -- 172.21.15.26:0/2005693931 learned_addr learned my addr 172.21.15.26:0/2005693931 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f97077fe700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97080ca2c0 0x7f97080ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 -- 172.21.15.26:0/2005693931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97080ca2c0 msgr2=0x7f97080ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97080ca2c0 0x7f97080ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 -- 172.21.15.26:0/2005693931 >> v1:172.21.15.26:6789/0 conn(0x7f9708157930 legacy=0x7f97080ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 -- 172.21.15.26:0/2005693931 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080c4100 con 0x7f97080ccba0 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9706ffd700 1 -- 172.21.15.26:0/2005693931 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934071847 0 0) 0x7f97080c32a0 con 0x7f9708157930 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f970c8fe700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ccba0 0x7f97080cd020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9700009e90 tx=0x7f9700009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeee253eedf2c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9706ffd700 1 -- 172.21.15.26:0/2005693931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000e070 con 0x7f97080ccba0 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9706ffd700 1 -- 172.21.15.26:0/2005693931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000bbf0 con 0x7f97080ccba0 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.374+0000 7f9706ffd700 1 -- 172.21.15.26:0/2005693931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700012430 con 0x7f97080ccba0 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 -- 172.21.15.26:0/2005693931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ccba0 msgr2=0x7f97080cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ccba0 0x7f97080cd020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9700009e90 tx=0x7f9700009780 comp rx=0 tx=0).stop 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 -- 172.21.15.26:0/2005693931 shutdown_connections 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ccba0 0x7f97080cd020 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 --2- 172.21.15.26:0/2005693931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97080ca2c0 0x7f97080ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 -- 172.21.15.26:0/2005693931 >> 172.21.15.26:0/2005693931 conn(0x7f9708088000 msgr2=0x7f97080883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 -- 172.21.15.26:0/2005693931 shutdown_connections 2023-10-09T11:35:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.375+0000 7f970e361700 1 -- 172.21.15.26:0/2005693931 wait complete. 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.376+0000 7f970e361700 1 Processor -- start 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.376+0000 7f970e361700 1 -- start start 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97080ccba0 0x7f9708145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9708157930 0x7f9708155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b17e0 con 0x7f97080ca2c0 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97081528a0 con 0x7f97080ccba0 2023-10-09T11:35:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f970e361700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b2860 con 0x7f9708157930 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52818/0 (socket says 172.21.15.26:52818) 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 -- 172.21.15.26:0/3583378162 learned_addr learned my addr 172.21.15.26:0/3583378162 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 -- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9708157930 msgr2=0x7f9708155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9708157930 0x7f9708155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 -- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97080ccba0 msgr2=0x7f9708145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f97077fe700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97080ccba0 0x7f9708145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97080ccba0 0x7f9708145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 -- 172.21.15.26:0/3583378162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700009a20 con 0x7f97080ca2c0 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.377+0000 7f9707fff700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96f800c810 tx=0x7f96f8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8005b30 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8005c90 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97080b2290 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8007300 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97080b1cd0 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.378+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970804c3c0 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.379+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96f801b400 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.379+0000 7f96effff700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.379+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96f80840b0 con 0x7f97080ca2c0 2023-10-09T11:35:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.380+0000 7f97077fe700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.380+0000 7f97077fe700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f970816a9b0 tx=0x7f96fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.384+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96f80513a0 con 0x7f97080ca2c0 2023-10-09T11:35:50.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.575+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97080b2070 con 0x7f97080ca2c0 2023-10-09T11:35:50.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.575+0000 7f96effff700 1 -- 172.21.15.26:0/3583378162 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96f80549c0 con 0x7f97080ca2c0 2023-10-09T11:35:50.577 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 msgr2=0x7f96f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f970816a9b0 tx=0x7f96fc008040 comp rx=0 tx=0).stop 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 msgr2=0x7f97080b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96f800c810 tx=0x7f96f8007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 shutdown_connections 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9708157930 0x7f9708155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080ca2c0 0x7f97080b12a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 --2- 172.21.15.26:0/3583378162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97080ccba0 0x7f9708145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 >> 172.21.15.26:0/3583378162 conn(0x7f9708088000 msgr2=0x7f97080ab070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 shutdown_connections 2023-10-09T11:35:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.577+0000 7f970e361700 1 -- 172.21.15.26:0/3583378162 wait complete. 2023-10-09T11:35:50.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:50.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.711+0000 7eff5fa45700 1 Processor -- start 2023-10-09T11:35:50.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.712+0000 7eff5fa45700 1 -- start start 2023-10-09T11:35:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.712+0000 7eff5fa45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff5806dc70 0x7eff58159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.712+0000 7eff5fa45700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff5806e0e0 0x7eff580cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.712+0000 7eff5fa45700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff580ccfd0 con 0x7eff58159530 2023-10-09T11:35:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.712+0000 7eff5fa45700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5815a3d0 con 0x7eff5806e0e0 2023-10-09T11:35:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5fa45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5815a6b0 con 0x7eff5806dc70 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5d7e1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7eff58159530 0x7eff580ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52168/0 (socket says 172.21.15.26:52168) 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5d7e1700 1 -- 172.21.15.26:0/3839698847 learned_addr learned my addr 172.21.15.26:0/3839698847 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 --2- 172.21.15.26:0/3839698847 >> v2:172.21.15.67:3300/0 conn(0x7eff5806e0e0 0x7eff580cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5cfe0700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff5806dc70 0x7eff58159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff57fff700 1 -- 172.21.15.26:0/3839698847 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826046146 0 0) 0x7eff580ccfd0 con 0x7eff58159530 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff57fff700 1 -- 172.21.15.26:0/3839698847 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff40003570 con 0x7eff58159530 2023-10-09T11:35:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 -- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff5806dc70 msgr2=0x7eff58159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff5806dc70 0x7eff58159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 -- 172.21.15.26:0/3839698847 >> v1:172.21.15.26:6789/0 conn(0x7eff58159530 legacy=0x7eff580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 -- 172.21.15.26:0/3839698847 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5815a990 con 0x7eff5806e0e0 2023-10-09T11:35:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff5dfe2700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff580cb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff480098e0 tx=0x7eff480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb8a938a1fc97c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.713+0000 7eff57fff700 1 -- 172.21.15.26:0/3839698847 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48011630 con 0x7eff5806e0e0 2023-10-09T11:35:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff57fff700 1 -- 172.21.15.26:0/3839698847 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48011790 con 0x7eff5806e0e0 2023-10-09T11:35:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff57fff700 1 -- 172.21.15.26:0/3839698847 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48011b10 con 0x7eff5806e0e0 2023-10-09T11:35:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 -- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 msgr2=0x7eff580cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff580cb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff480098e0 tx=0x7eff480091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 -- 172.21.15.26:0/3839698847 shutdown_connections 2023-10-09T11:35:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff580cb6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 --2- 172.21.15.26:0/3839698847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff5806dc70 0x7eff58159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 -- 172.21.15.26:0/3839698847 >> 172.21.15.26:0/3839698847 conn(0x7eff580703a0 msgr2=0x7eff580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 -- 172.21.15.26:0/3839698847 shutdown_connections 2023-10-09T11:35:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.714+0000 7eff5fa45700 1 -- 172.21.15.26:0/3839698847 wait complete. 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.715+0000 7eff5fa45700 1 Processor -- start 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.715+0000 7eff5fa45700 1 -- start start 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff58169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff58159530 0x7eff58169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff58156f60 con 0x7eff5806dc70 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff58157140 con 0x7eff5806e0e0 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5fa45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff58157400 con 0x7eff58159530 2023-10-09T11:35:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5d7e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5d7e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52834/0 (socket says 172.21.15.26:52834) 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5d7e1700 1 -- 172.21.15.26:0/231228265 learned_addr learned my addr 172.21.15.26:0/231228265 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.716+0000 7eff5cfe0700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff58169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5dfe2700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff58159530 0x7eff58169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 -- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff58159530 msgr2=0x7eff58169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff58159530 0x7eff58169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 -- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 msgr2=0x7eff58169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff58169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 -- 172.21.15.26:0/231228265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48009420 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5d7e1700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff5000cc40 tx=0x7eff50001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000a980 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5000aae0 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff581576e0 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000ae80 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.717+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff58157ca0 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.718+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff580c88d0 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.719+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff50007300 con 0x7eff5806dc70 2023-10-09T11:35:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.719+0000 7eff557fa700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.719+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff50084940 con 0x7eff5806dc70 2023-10-09T11:35:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.719+0000 7eff5cfe0700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.720+0000 7eff5cfe0700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff5816a500 tx=0x7eff4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.723+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff50051c30 con 0x7eff5806dc70 2023-10-09T11:35:50.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.913+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff5804c3c0 con 0x7eff5806dc70 2023-10-09T11:35:50.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.914+0000 7eff557fa700 1 -- 172.21.15.26:0/231228265 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff50055250 con 0x7eff5806dc70 2023-10-09T11:35:50.916 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.915+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 msgr2=0x7eff440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.915+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff5816a500 tx=0x7eff4c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 msgr2=0x7eff5815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff5000cc40 tx=0x7eff50001a60 comp rx=0 tx=0).stop 2023-10-09T11:35:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 shutdown_connections 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff58159530 0x7eff58169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5806dc70 0x7eff5815d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 --2- 172.21.15.26:0/231228265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5806e0e0 0x7eff58169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 >> 172.21.15.26:0/231228265 conn(0x7eff580703a0 msgr2=0x7eff580d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 shutdown_connections 2023-10-09T11:35:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:50.916+0000 7eff5fa45700 1 -- 172.21.15.26:0/231228265 wait complete. 2023-10-09T11:35:50.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.053+0000 7fbdcb4cc700 1 Processor -- start 2023-10-09T11:35:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.053+0000 7fbdcb4cc700 1 -- start start 2023-10-09T11:35:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdcb4cc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc4153a00 0x7fbdc4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdcb4cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc415ac50 con 0x7fbdc415de50 2023-10-09T11:35:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdcb4cc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc415d010 con 0x7fbdc40cea00 2023-10-09T11:35:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdcb4cc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc415af60 con 0x7fbdc4153a00 2023-10-09T11:35:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdc9cc9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbdc415de50 0x7fbdc415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52172/0 (socket says 172.21.15.26:52172) 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdca4ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc4153a00 0x7fbdc4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdc9cc9700 1 -- 172.21.15.26:0/2795969065 learned_addr learned my addr 172.21.15.26:0/2795969065 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdc94c8700 1 -- 172.21.15.26:0/2795969065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057314462 0 0) 0x7fbdc415ac50 con 0x7fbdc415de50 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdc94c8700 1 -- 172.21.15.26:0/2795969065 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdac003570 con 0x7fbdc415de50 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdca4ca700 1 -- 172.21.15.26:0/2795969065 >> v1:172.21.15.67:6789/0 conn(0x7fbdc40cea00 legacy=0x7fbdc40cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdca4ca700 1 -- 172.21.15.26:0/2795969065 >> v1:172.21.15.26:6789/0 conn(0x7fbdc415de50 legacy=0x7fbdc415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.054+0000 7fbdca4ca700 1 -- 172.21.15.26:0/2795969065 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc415b240 con 0x7fbdc4153a00 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdca4ca700 1 --2- 172.21.15.26:0/2795969065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc4153a00 0x7fbdc4153dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009e60 tx=0x7fbdbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323923dcc1df2bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdc94c8700 1 -- 172.21.15.26:0/2795969065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00e070 con 0x7fbdc4153a00 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdc94c8700 1 -- 172.21.15.26:0/2795969065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00bb60 con 0x7fbdc4153a00 2023-10-09T11:35:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdc94c8700 1 -- 172.21.15.26:0/2795969065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc012430 con 0x7fbdc4153a00 2023-10-09T11:35:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2795969065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc4153a00 msgr2=0x7fbdc4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2795969065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc4153a00 0x7fbdc4153dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009e60 tx=0x7fbdbc009780 comp rx=0 tx=0).stop 2023-10-09T11:35:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2795969065 shutdown_connections 2023-10-09T11:35:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2795969065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc4153a00 0x7fbdc4153dd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2795969065 >> 172.21.15.26:0/2795969065 conn(0x7fbdc40703a0 msgr2=0x7fbdc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2795969065 shutdown_connections 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.055+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2795969065 wait complete. 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.056+0000 7fbdcb4cc700 1 Processor -- start 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 -- start start 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbdc40cea00 0x7fbdc41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc4153a00 0x7fbdc40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc4140e10 con 0x7fbdc415de50 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40c7b30 con 0x7fbdc4153a00 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcb4cc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40c7e10 con 0x7fbdc40cea00 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcaccb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcaccb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52862/0 (socket says 172.21.15.26:52862) 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdcaccb700 1 -- 172.21.15.26:0/2018322887 learned_addr learned my addr 172.21.15.26:0/2018322887 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdc9cc9700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc4153a00 0x7fbdc40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.057+0000 7fbdca4ca700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbdc40cea00 0x7fbdc41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 -- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbdc40cea00 msgr2=0x7fbdc41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbdc40cea00 0x7fbdc41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 -- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc4153a00 msgr2=0x7fbdc40b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc4153a00 0x7fbdc40b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 -- 172.21.15.26:0/2018322887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc009a20 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcaccb700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c590 tx=0x7fbdb4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4011590 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4011730 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc40c80f0 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4011af0 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.058+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc40c86b0 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.059+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc4159780 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.059+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdb4012420 con 0x7fbdc415de50 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.060+0000 7fbdc27fc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 0x7fbdb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.060+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdb4083720 con 0x7fbdc415de50 2023-10-09T11:35:51.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.060+0000 7fbdca4ca700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 0x7fbdb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.061+0000 7fbdca4ca700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 0x7fbdb00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097c0 tx=0x7fbdbc019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.064+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdb404b5a0 con 0x7fbdc415de50 2023-10-09T11:35:51.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.256+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdc40c88d0 con 0x7fbdc415de50 2023-10-09T11:35:51.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.257+0000 7fbdc27fc700 1 -- 172.21.15.26:0/2018322887 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdb4017020 con 0x7fbdc415de50 2023-10-09T11:35:51.258 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:51.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 msgr2=0x7fbdb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 0x7fbdb00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097c0 tx=0x7fbdbc019000 comp rx=0 tx=0).stop 2023-10-09T11:35:51.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 msgr2=0x7fbdc41586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c590 tx=0x7fbdb4007f30 comp rx=0 tx=0).stop 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 shutdown_connections 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc415de50 0x7fbdc41586d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbdb0066f30 0x7fbdb00693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbdc40cea00 0x7fbdc41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 --2- 172.21.15.26:0/2018322887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc4153a00 0x7fbdc40b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 >> 172.21.15.26:0/2018322887 conn(0x7fbdc40703a0 msgr2=0x7fbdc4152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 shutdown_connections 2023-10-09T11:35:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.259+0000 7fbdcb4cc700 1 -- 172.21.15.26:0/2018322887 wait complete. 2023-10-09T11:35:51.439 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-09T11:35:51.439 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:35:51.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-09T11:35:51.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.558+0000 7f22af45d700 1 Processor -- start 2023-10-09T11:35:51.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.558+0000 7f22af45d700 1 -- start start 2023-10-09T11:35:51.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22af45d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 0x7f22a815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22af45d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 0x7f22a815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22af45d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a815afd0 con 0x7f22a815de50 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22af45d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a815b2b0 con 0x7f22a80cf110 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22af45d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a815b590 con 0x7f22a8153c30 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22adc5a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f22a815de50 0x7f22a80cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52180/0 (socket says 172.21.15.26:52180) 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22adc5a700 1 -- 172.21.15.26:0/2777298961 learned_addr learned my addr 172.21.15.26:0/2777298961 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2777298961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 0x7f22a815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.559+0000 7f22aec5c700 1 --2- 172.21.15.26:0/2777298961 >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 0x7f22a815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337605213 0 0) 0x7f22a815afd0 con 0x7f22a815de50 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2290003570 con 0x7f22a815de50 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175825632 0 0) 0x7f2290003570 con 0x7f22a815de50 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ae45b700 1 -- 172.21.15.26:0/2777298961 >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 msgr2=0x7f22a815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2777298961 >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 0x7f22a815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ae45b700 1 -- 172.21.15.26:0/2777298961 >> v1:172.21.15.26:6789/0 conn(0x7f22a815de50 legacy=0x7f22a80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ae45b700 1 -- 172.21.15.26:0/2777298961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a815b870 con 0x7f22a8153c30 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22aec5c700 1 --2- 172.21.15.26:0/2777298961 >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 0x7f22a815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2777298961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 0x7f22a815a5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22a00098e0 tx=0x7f22a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0127212b5b7223b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c001470 con 0x7f22a8153c30 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0011420 con 0x7f22a8153c30 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.560+0000 7f22ad459700 1 -- 172.21.15.26:0/2777298961 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00117a0 con 0x7f22a8153c30 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 -- 172.21.15.26:0/2777298961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 msgr2=0x7f22a815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 --2- 172.21.15.26:0/2777298961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 0x7f22a815a5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22a00098e0 tx=0x7f22a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 -- 172.21.15.26:0/2777298961 shutdown_connections 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 --2- 172.21.15.26:0/2777298961 >> v2:172.21.15.67:3300/0 conn(0x7f22a80cf110 0x7f22a815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 --2- 172.21.15.26:0/2777298961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a8153c30 0x7f22a815a5e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 -- 172.21.15.26:0/2777298961 >> 172.21.15.26:0/2777298961 conn(0x7f22a80703a0 msgr2=0x7f22a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 -- 172.21.15.26:0/2777298961 shutdown_connections 2023-10-09T11:35:51.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.561+0000 7f22af45d700 1 -- 172.21.15.26:0/2777298961 wait complete. 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.562+0000 7f22af45d700 1 Processor -- start 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.562+0000 7f22af45d700 1 -- start start 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22a8153c30 0x7f22a8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a815de50 0x7f22a80cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80ca470 con 0x7f22a80cf110 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8153000 con 0x7f22a8153c30 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22af45d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80c9eb0 con 0x7f22a815de50 2023-10-09T11:35:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52870/0 (socket says 172.21.15.26:52870) 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 -- 172.21.15.26:0/2129273109 learned_addr learned my addr 172.21.15.26:0/2129273109 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22adc5a700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22a8153c30 0x7f22a8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22aec5c700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a815de50 0x7f22a80cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 -- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a815de50 msgr2=0x7f22a80cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a815de50 0x7f22a80cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 -- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22a8153c30 msgr2=0x7f22a8152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22a8153c30 0x7f22a8152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:51.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 -- 172.21.15.26:0/2129273109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298009a20 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22ae45b700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22a8159ca0 tx=0x7f22a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.563+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a001cba0 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.564+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a001cd20 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.564+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a001a6a0 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.564+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0009420 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.564+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a80c7780 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.564+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80c75e0 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.565+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22a001aa10 con 0x7f22a80cf110 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.565+0000 7f22a67fc700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.565+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22a0085e20 con 0x7f22a80cf110 2023-10-09T11:35:51.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.566+0000 7f22adc5a700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:51.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.566+0000 7f22adc5a700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f229c001620 tx=0x7f229c0014c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:51.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.570+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a80c75e0 con 0x7f22a80cf110 2023-10-09T11:35:51.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:51.842+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f22a80c75e0 con 0x7f22a80cf110 2023-10-09T11:35:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.209+0000 7f22a67fc700 1 -- 172.21.15.26:0/2129273109 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f22a80c75e0 con 0x7f22a80cf110 2023-10-09T11:35:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 msgr2=0x7f22940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f229c001620 tx=0x7f229c0014c0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 msgr2=0x7f22a80b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22a8159ca0 tx=0x7f22a0016000 comp rx=0 tx=0).stop 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 shutdown_connections 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a815de50 0x7f22a80cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22a80cf110 0x7f22a80b3ce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 --2- 172.21.15.26:0/2129273109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22a8153c30 0x7f22a8152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 >> 172.21.15.26:0/2129273109 conn(0x7f22a80703a0 msgr2=0x7f22a80c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 shutdown_connections 2023-10-09T11:35:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.211+0000 7f22af45d700 1 -- 172.21.15.26:0/2129273109 wait complete. 2023-10-09T11:35:52.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:35:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.348+0000 7f2acde39700 1 Processor -- start 2023-10-09T11:35:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.348+0000 7f2acde39700 1 -- start start 2023-10-09T11:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acde39700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ac8153a00 0x7f2ac8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acde39700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac815ac50 con 0x7f2ac80cea00 2023-10-09T11:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acde39700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac815d010 con 0x7f2ac815de50 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acde39700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac815af60 con 0x7f2ac8153a00 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acce37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ac8153a00 0x7f2ac8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acd638700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2ac80cea00 0x7f2ac80cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52196/0 (socket says 172.21.15.26:52196) 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.349+0000 7f2acd638700 1 -- 172.21.15.26:0/2989757330 learned_addr learned my addr 172.21.15.26:0/2989757330 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acce37700 1 -- 172.21.15.26:0/2989757330 >> v1:172.21.15.67:6789/0 conn(0x7f2ac815de50 legacy=0x7f2ac815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acce37700 1 -- 172.21.15.26:0/2989757330 >> v1:172.21.15.26:6789/0 conn(0x7f2ac80cea00 legacy=0x7f2ac80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2ac77fe700 1 -- 172.21.15.26:0/2989757330 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214566483 0 0) 0x7f2ac815ac50 con 0x7f2ac80cea00 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acce37700 1 -- 172.21.15.26:0/2989757330 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac815b240 con 0x7f2ac8153a00 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acce37700 1 --2- 172.21.15.26:0/2989757330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac8153a00 0x7f2ac8153dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de473933b2df9986 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2ac77fe700 1 -- 172.21.15.26:0/2989757330 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8009e80 con 0x7f2ac8153a00 2023-10-09T11:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2ac77fe700 1 -- 172.21.15.26:0/2989757330 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800b860 con 0x7f2ac8153a00 2023-10-09T11:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2ac77fe700 1 -- 172.21.15.26:0/2989757330 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bbe0 con 0x7f2ac8153a00 2023-10-09T11:35:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acde39700 1 -- 172.21.15.26:0/2989757330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac8153a00 msgr2=0x7f2ac8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acde39700 1 --2- 172.21.15.26:0/2989757330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac8153a00 0x7f2ac8153dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acde39700 1 -- 172.21.15.26:0/2989757330 shutdown_connections 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acde39700 1 --2- 172.21.15.26:0/2989757330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac8153a00 0x7f2ac8153dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.350+0000 7f2acde39700 1 -- 172.21.15.26:0/2989757330 >> 172.21.15.26:0/2989757330 conn(0x7f2ac80703a0 msgr2=0x7f2ac80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.351+0000 7f2acde39700 1 -- 172.21.15.26:0/2989757330 shutdown_connections 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.351+0000 7f2acde39700 1 -- 172.21.15.26:0/2989757330 wait complete. 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.352+0000 7f2acde39700 1 Processor -- start 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.352+0000 7f2acde39700 1 -- start start 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac80cea00 0x7f2ac80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 0x7f2ac80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80c9240 con 0x7f2ac815de50 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80b3bb0 con 0x7f2ac80cea00 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80b12e0 con 0x7f2ac8153a00 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52888/0 (socket says 172.21.15.26:52888) 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 -- 172.21.15.26:0/3381792188 learned_addr learned my addr 172.21.15.26:0/3381792188 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2ac7fff700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 0x7f2ac80c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acce37700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac80cea00 0x7f2ac80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 -- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 msgr2=0x7f2ac80c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 0x7f2ac80c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 -- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac80cea00 msgr2=0x7f2ac80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac80cea00 0x7f2ac80b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 -- 172.21.15.26:0/3381792188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009420 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2ac7fff700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 0x7f2ac80c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acd638700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000cbf0 tx=0x7f2ac00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000a9c0 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000ab20 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac80b0aa0 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00070f0 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.353+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac80b3de0 con 0x7f2ac815de50 2023-10-09T11:35:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.354+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac804c3c0 con 0x7f2ac815de50 2023-10-09T11:35:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.355+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac0007520 con 0x7f2ac815de50 2023-10-09T11:35:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.355+0000 7f2ac4ff9700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.355+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ac0084910 con 0x7f2ac815de50 2023-10-09T11:35:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.355+0000 7f2acce37700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.356+0000 7f2acce37700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 0x7f2ab40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.359+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac0051c00 con 0x7f2ac815de50 2023-10-09T11:35:52.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.551+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2ac80caef0 con 0x7f2ac815de50 2023-10-09T11:35:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.555+0000 7f2ac4ff9700 1 -- 172.21.15.26:0/3381792188 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ac0055220 con 0x7f2ac815de50 2023-10-09T11:35:52.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 msgr2=0x7f2ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 0x7f2ab40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 msgr2=0x7f2ac815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000cbf0 tx=0x7f2ac00019b0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 shutdown_connections 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac815de50 0x7f2ac815c150 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac80cea00 0x7f2ac80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ab4066f30 0x7f2ab40693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 --2- 172.21.15.26:0/3381792188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ac8153a00 0x7f2ac80c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 >> 172.21.15.26:0/3381792188 conn(0x7f2ac80703a0 msgr2=0x7f2ac80c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 shutdown_connections 2023-10-09T11:35:52.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:52.557+0000 7f2acde39700 1 -- 172.21.15.26:0/3381792188 wait complete. 2023-10-09T11:35:52.570 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:35:52.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:35:52.611 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:35:52.655 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:35:52.656 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:35:52.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:35:52.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T11:35:52.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:35:52.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:52.690 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:35:52.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:35:52.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:35:52.746 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T11:35:52.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:35:52.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:52.798 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:35:52.815 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T11:35:52.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:35:52.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T11:35:52.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:35:52.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:52.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:35:52.906 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T11:35:52.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:35:52.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T11:35:52.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:35:52.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:35:52.943 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:35:53.000 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:35:53.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:53.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.117+0000 7f461c9f7700 1 Processor -- start 2023-10-09T11:35:53.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.117+0000 7f461c9f7700 1 -- start start 2023-10-09T11:35:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.118+0000 7f461c9f7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cb5a0 0x7f46180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.118+0000 7f461c9f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46180cde50 0x7f4618156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.118+0000 7f461c9f7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461815ae40 con 0x7f46180cd9e0 2023-10-09T11:35:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.118+0000 7f461c9f7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180d13f0 con 0x7f46180cde50 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.118+0000 7f461c9f7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461815ab60 con 0x7f46180cb5a0 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46180cde50 0x7f4618156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46180cde50 0x7f4618156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52898/0 (socket says 172.21.15.26:52898) 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 -- 172.21.15.26:0/4284248006 learned_addr learned my addr 172.21.15.26:0/4284248006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f461659c700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cb5a0 0x7f46180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 -- 172.21.15.26:0/4284248006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cb5a0 msgr2=0x7f46180cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cb5a0 0x7f46180cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 -- 172.21.15.26:0/4284248006 >> v1:172.21.15.67:6789/0 conn(0x7f46180cd9e0 legacy=0x7f4618159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 -- 172.21.15.26:0/4284248006 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180ccf00 con 0x7f46180cde50 2023-10-09T11:35:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f4616d9d700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46180cde50 0x7f4618156e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4608009f20 tx=0x7f4608009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494a78d04b5aade6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f461559a700 1 -- 172.21.15.26:0/4284248006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460800e070 con 0x7f46180cde50 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f461559a700 1 -- 172.21.15.26:0/4284248006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460800ba80 con 0x7f46180cde50 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.119+0000 7f461559a700 1 -- 172.21.15.26:0/4284248006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080092e0 con 0x7f46180cde50 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 -- 172.21.15.26:0/4284248006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46180cde50 msgr2=0x7f4618156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46180cde50 0x7f4618156e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4608009f20 tx=0x7f4608009840 comp rx=0 tx=0).stop 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 -- 172.21.15.26:0/4284248006 shutdown_connections 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46180cde50 0x7f4618156e90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 --2- 172.21.15.26:0/4284248006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cb5a0 0x7f46180cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 -- 172.21.15.26:0/4284248006 >> 172.21.15.26:0/4284248006 conn(0x7f4618070e30 msgr2=0x7f46180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 -- 172.21.15.26:0/4284248006 shutdown_connections 2023-10-09T11:35:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.120+0000 7f461c9f7700 1 -- 172.21.15.26:0/4284248006 wait complete. 2023-10-09T11:35:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.121+0000 7f461c9f7700 1 Processor -- start 2023-10-09T11:35:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.121+0000 7f461c9f7700 1 -- start start 2023-10-09T11:35:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 0x7f4618169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 0x7f4618156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b4a40 con 0x7f461816ca40 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461816a3a0 con 0x7f46180cb5a0 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461c9f7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180c6740 con 0x7f46180cd9e0 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52914/0 (socket says 172.21.15.26:52914) 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 -- 172.21.15.26:0/3538669505 learned_addr learned my addr 172.21.15.26:0/3538669505 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4615d9b700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 0x7f4618156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461659c700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 0x7f4618169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 -- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 msgr2=0x7f4618156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 0x7f4618156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 -- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 msgr2=0x7f4618169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 0x7f4618169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 -- 172.21.15.26:0/3538669505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009ae0 con 0x7f461816ca40 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4615d9b700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 0x7f4618156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f461659c700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 0x7f4618169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f4616d9d700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4608009430 tx=0x7f4608018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.122+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080032f0 con 0x7f461816ca40 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.123+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4608008e70 con 0x7f461816ca40 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.123+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461816cf20 con 0x7f461816ca40 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.123+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460801c620 con 0x7f461816ca40 2023-10-09T11:35:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.123+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461816d4e0 con 0x7f461816ca40 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.124+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461804c3c0 con 0x7f461816ca40 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.124+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4608003040 con 0x7f461816ca40 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.124+0000 7f460e7fc700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 0x7f45f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.124+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4608085f00 con 0x7f461816ca40 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.125+0000 7f461659c700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 0x7f45f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.125+0000 7f461659c700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 0x7f45f80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4610006fd0 tx=0x7f4610008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.129+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46080530d0 con 0x7f461816ca40 2023-10-09T11:35:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.365+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46180b4b80 con 0x7f461816ca40 2023-10-09T11:35:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.365+0000 7f460e7fc700 1 -- 172.21.15.26:0/3538669505 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f46080566f0 con 0x7f461816ca40 2023-10-09T11:35:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:53.367 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 msgr2=0x7f45f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 0x7f45f80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4610006fd0 tx=0x7f4610008040 comp rx=0 tx=0).stop 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 msgr2=0x7f4618158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4608009430 tx=0x7f4608018000 comp rx=0 tx=0).stop 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 shutdown_connections 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f461816ca40 0x7f4618158400 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46180cb5a0 0x7f4618169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f45f8066f30 0x7f45f80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 --2- 172.21.15.26:0/3538669505 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46180cd9e0 0x7f4618156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 >> 172.21.15.26:0/3538669505 conn(0x7f4618070e30 msgr2=0x7f46180d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 shutdown_connections 2023-10-09T11:35:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.367+0000 7f461c9f7700 1 -- 172.21.15.26:0/3538669505 wait complete. 2023-10-09T11:35:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:53.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.499+0000 7f9ca1716700 1 Processor -- start 2023-10-09T11:35:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.499+0000 7f9ca1716700 1 -- start start 2023-10-09T11:35:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9ca1716700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c9c0cb5a0 0x7f9c9c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9ca1716700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9ca1716700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c15ae40 con 0x7f9c9c0cd9e0 2023-10-09T11:35:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9ca1716700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0d13f0 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9ca1716700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c15ab60 con 0x7f9c9c15a5d0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9c9affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c9c0cb5a0 0x7f9c9c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9c9a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9c9c0cd9e0 0x7f9c9c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52208/0 (socket says 172.21.15.26:52208) 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.500+0000 7f9c9a7fc700 1 -- 172.21.15.26:0/1344865913 learned_addr learned my addr 172.21.15.26:0/1344865913 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9b7fe700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9affd700 1 -- 172.21.15.26:0/1344865913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 msgr2=0x7f9c9c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9affd700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9affd700 1 -- 172.21.15.26:0/1344865913 >> v1:172.21.15.26:6789/0 conn(0x7f9c9c0cd9e0 legacy=0x7f9c9c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9affd700 1 -- 172.21.15.26:0/1344865913 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0ccf00 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c99ffb700 1 -- 172.21.15.26:0/1344865913 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240117626 0 0) 0x7f9c9c15ae40 con 0x7f9c9c0cd9e0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c9affd700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c0cb970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009910 tx=0x7f9c940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348c0a11d9a2d867 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c99ffb700 1 -- 172.21.15.26:0/1344865913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400b820 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c99ffb700 1 -- 172.21.15.26:0/1344865913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9400b980 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.501+0000 7f9c99ffb700 1 -- 172.21.15.26:0/1344865913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400bd20 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 -- 172.21.15.26:0/1344865913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 msgr2=0x7f9c9c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c0cb970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009910 tx=0x7f9c940091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 -- 172.21.15.26:0/1344865913 shutdown_connections 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 --2- 172.21.15.26:0/1344865913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c0cb970 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 -- 172.21.15.26:0/1344865913 >> 172.21.15.26:0/1344865913 conn(0x7f9c9c070e30 msgr2=0x7f9c9c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 -- 172.21.15.26:0/1344865913 shutdown_connections 2023-10-09T11:35:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.502+0000 7f9ca1716700 1 -- 172.21.15.26:0/1344865913 wait complete. 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.503+0000 7f9ca1716700 1 Processor -- start 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.503+0000 7f9ca1716700 1 -- start start 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 0x7f9c9c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c152100 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c151820 con 0x7f9c9c0cd9e0 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c8640 con 0x7f9c9c15a5d0 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52928/0 (socket says 172.21.15.26:52928) 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 -- 172.21.15.26:0/3650858336 learned_addr learned my addr 172.21.15.26:0/3650858336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 -- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 msgr2=0x7f9c9c1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 -- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 msgr2=0x7f9c9c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9a7fc700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 0x7f9c9c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 0x7f9c9c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 -- 172.21.15.26:0/3650858336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009420 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9a7fc700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 0x7f9c9c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c9affd700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b3c0 tx=0x7f9c94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94024440 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940245a0 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c0c8920 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.504+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94024960 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.505+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c1532a0 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.506+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c04c3c0 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.506+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c94024d50 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.506+0000 7f9c92ffd700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 0x7f9c7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.506+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c94086150 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.507+0000 7f9c9a7fc700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 0x7f9c7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.507+0000 7f9c9a7fc700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 0x7f9c7c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06fd20 tx=0x7f9c84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.511+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c940533c0 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.706+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9c15e140 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.707+0000 7f9c92ffd700 1 -- 172.21.15.26:0/3650858336 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9c9402b340 con 0x7f9c9c0cb5a0 2023-10-09T11:35:53.709 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:53.709 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 msgr2=0x7f9c7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 0x7f9c7c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06fd20 tx=0x7f9c84009040 comp rx=0 tx=0).stop 2023-10-09T11:35:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 msgr2=0x7f9c9c1512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b3c0 tx=0x7f9c94017000 comp rx=0 tx=0).stop 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 shutdown_connections 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c7c066f30 0x7f9c7c0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c9c15a5d0 0x7f9c9c1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9c0cb5a0 0x7f9c9c1512e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 --2- 172.21.15.26:0/3650858336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9c0cd9e0 0x7f9c9c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 >> 172.21.15.26:0/3650858336 conn(0x7f9c9c070e30 msgr2=0x7f9c9c0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.709+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 shutdown_connections 2023-10-09T11:35:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.710+0000 7f9ca1716700 1 -- 172.21.15.26:0/3650858336 wait complete. 2023-10-09T11:35:53.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:35:22.198484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:35:22.711064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:35:53.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:53.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.845+0000 7f612696d700 1 Processor -- start 2023-10-09T11:35:53.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.845+0000 7f612696d700 1 -- start start 2023-10-09T11:35:53.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.846+0000 7f612696d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.846+0000 7f612696d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f612006e0e0 0x7f61200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.846+0000 7f612696d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61200ccfd0 con 0x7f6120159530 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.846+0000 7f612696d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612015a3d0 con 0x7f612006e0e0 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.846+0000 7f612696d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015a6b0 con 0x7f612006dc70 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f612006e0e0 0x7f61200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f611ffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6120159530 0x7f61200ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51704/0 (socket says 172.21.15.26:51704) 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f611ffff700 1 -- 172.21.15.26:0/873844620 learned_addr learned my addr 172.21.15.26:0/873844620 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:59308/0 (socket says 172.21.15.26:59308) 2023-10-09T11:35:53.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 -- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 msgr2=0x7f6120159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 --2- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 -- 172.21.15.26:0/873844620 >> v1:172.21.15.67:6789/0 conn(0x7f6120159530 legacy=0x7f61200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 -- 172.21.15.26:0/873844620 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612015a990 con 0x7f612006e0e0 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f611effd700 1 -- 172.21.15.26:0/873844620 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677359290 0 0) 0x7f61200ccfd0 con 0x7f6120159530 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.847+0000 7f6124f0a700 1 --2- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f612006e0e0 0x7f61200cb6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6118009e60 tx=0x7f6118009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29f141be9489672 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f611effd700 1 -- 172.21.15.26:0/873844620 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800e070 con 0x7f612006e0e0 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f611effd700 1 -- 172.21.15.26:0/873844620 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800bb60 con 0x7f612006e0e0 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f611effd700 1 -- 172.21.15.26:0/873844620 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118012430 con 0x7f612006e0e0 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 -- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f612006e0e0 msgr2=0x7f61200cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 --2- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f612006e0e0 0x7f61200cb6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6118009e60 tx=0x7f6118009780 comp rx=0 tx=0).stop 2023-10-09T11:35:53.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 -- 172.21.15.26:0/873844620 shutdown_connections 2023-10-09T11:35:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 --2- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f612006e0e0 0x7f61200cb6f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 --2- 172.21.15.26:0/873844620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 -- 172.21.15.26:0/873844620 >> 172.21.15.26:0/873844620 conn(0x7f61200703a0 msgr2=0x7f61200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 -- 172.21.15.26:0/873844620 shutdown_connections 2023-10-09T11:35:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.848+0000 7f612696d700 1 -- 172.21.15.26:0/873844620 wait complete. 2023-10-09T11:35:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.849+0000 7f612696d700 1 Processor -- start 2023-10-09T11:35:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.849+0000 7f612696d700 1 -- start start 2023-10-09T11:35:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6120159530 0x7f61200c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200c8bc0 con 0x7f612006e0e0 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200b6500 con 0x7f6120159530 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f612696d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015ebd0 con 0x7f612006dc70 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52944/0 (socket says 172.21.15.26:52944) 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f611f7fe700 1 -- 172.21.15.26:0/1712004937 learned_addr learned my addr 172.21.15.26:0/1712004937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.850+0000 7f6124f0a700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6120159530 0x7f61200c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611ffff700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 -- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 msgr2=0x7f6120154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 -- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6120159530 msgr2=0x7f61200c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6120159530 0x7f61200c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 -- 172.21.15.26:0/1712004937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118009a20 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611ffff700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f611f7fe700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f611400ec80 tx=0x7f61140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400c970 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400cad0 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61200c7a20 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400ce70 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.851+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61200b6220 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.852+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612015ed40 con 0x7f612006e0e0 2023-10-09T11:35:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.852+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6114013680 con 0x7f612006e0e0 2023-10-09T11:35:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.853+0000 7f6107fff700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 0x7f610c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.853+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6114084820 con 0x7f612006e0e0 2023-10-09T11:35:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.853+0000 7f611ffff700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 0x7f610c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.853+0000 7f611ffff700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 0x7f610c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6110001810 tx=0x7f6110009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:53.857+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6114051a90 con 0x7f612006e0e0 2023-10-09T11:35:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.047+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f612004c3c0 con 0x7f612006e0e0 2023-10-09T11:35:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.048+0000 7f6107fff700 1 -- 172.21.15.26:0/1712004937 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61140550b0 con 0x7f612006e0e0 2023-10-09T11:35:54.050 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 msgr2=0x7f610c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 0x7f610c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6110001810 tx=0x7f6110009040 comp rx=0 tx=0).stop 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 msgr2=0x7f61200c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f611400ec80 tx=0x7f61140091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 shutdown_connections 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6120159530 0x7f61200c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f610c066f30 0x7f610c0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f612006dc70 0x7f6120154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 --2- 172.21.15.26:0/1712004937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f612006e0e0 0x7f61200c8140 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 >> 172.21.15.26:0/1712004937 conn(0x7f61200703a0 msgr2=0x7f612015ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 shutdown_connections 2023-10-09T11:35:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.050+0000 7f612696d700 1 -- 172.21.15.26:0/1712004937 wait complete. 2023-10-09T11:35:54.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:35:54.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.184+0000 7fe4b6b26700 1 Processor -- start 2023-10-09T11:35:54.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.184+0000 7fe4b6b26700 1 -- start start 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4b0157930 0x7fe4b00ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 0x7fe4b00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 0x7fe4b00cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b00c9730 con 0x7fe4b0157930 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b00cd560 con 0x7fe4b00ccba0 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b6b26700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00c32a0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b48c2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4b0157930 0x7fe4b00ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b48c2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4b0157930 0x7fe4b00ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52958/0 (socket says 172.21.15.26:52958) 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.185+0000 7fe4b48c2700 1 -- 172.21.15.26:0/3615382035 learned_addr learned my addr 172.21.15.26:0/3615382035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b50c3700 1 --2- 172.21.15.26:0/3615382035 >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 0x7fe4b00cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4affff700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 0x7fe4b00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 -- 172.21.15.26:0/3615382035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 msgr2=0x7fe4b00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 0x7fe4b00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 -- 172.21.15.26:0/3615382035 >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 msgr2=0x7fe4b00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/3615382035 >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 0x7fe4b00cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 -- 172.21.15.26:0/3615382035 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00c4100 con 0x7fe4b0157930 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b50c3700 1 --2- 172.21.15.26:0/3615382035 >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 0x7fe4b00cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4affff700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 0x7fe4b00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b0157930 0x7fe4b00ab070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe4b006af00 tx=0x7fe4a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea068f79018c4f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4af7fe700 1 -- 172.21.15.26:0/3615382035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800b820 con 0x7fe4b0157930 2023-10-09T11:35:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4af7fe700 1 -- 172.21.15.26:0/3615382035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800b980 con 0x7fe4b0157930 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.186+0000 7fe4af7fe700 1 -- 172.21.15.26:0/3615382035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800bd20 con 0x7fe4b0157930 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 -- 172.21.15.26:0/3615382035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b0157930 msgr2=0x7fe4b00ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b0157930 0x7fe4b00ab070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe4b006af00 tx=0x7fe4a8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 -- 172.21.15.26:0/3615382035 shutdown_connections 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/3615382035 >> v2:172.21.15.67:3300/0 conn(0x7fe4b00ccba0 0x7fe4b00cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b0157930 0x7fe4b00ab070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/3615382035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ca2c0 0x7fe4b00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 -- 172.21.15.26:0/3615382035 >> 172.21.15.26:0/3615382035 conn(0x7fe4b0088000 msgr2=0x7fe4b00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 -- 172.21.15.26:0/3615382035 shutdown_connections 2023-10-09T11:35:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.187+0000 7fe4b6b26700 1 -- 172.21.15.26:0/3615382035 wait complete. 2023-10-09T11:35:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.188+0000 7fe4b6b26700 1 Processor -- start 2023-10-09T11:35:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.188+0000 7fe4b6b26700 1 -- start start 2023-10-09T11:35:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ccba0 0x7fe4b00c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0157930 0x7fe4b00b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00c88e0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00b23a0 con 0x7fe4b0157930 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00c8600 con 0x7fe4b00ccba0 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52974/0 (socket says 172.21.15.26:52974) 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 -- 172.21.15.26:0/220442104 learned_addr learned my addr 172.21.15.26:0/220442104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 -- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ccba0 msgr2=0x7fe4b00c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ccba0 0x7fe4b00c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 -- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0157930 msgr2=0x7fe4b00b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0157930 0x7fe4b00b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 -- 172.21.15.26:0/220442104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80094f0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b48c2700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80094c0 tx=0x7fe4a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8024440 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a80245c0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b00b2640 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.189+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8024980 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.190+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b00b0c60 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.191+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b00b2c90 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.191+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4a801a420 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.191+0000 7fe4acff9700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 0x7fe4900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.191+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4a8086370 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.192+0000 7fe4affff700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 0x7fe4900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.192+0000 7fe4affff700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 0x7fe4900693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0007f50 tx=0x7fe4a0007440 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.196+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4a80535e0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.388+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4b004c3c0 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.389+0000 7fe4acff9700 1 -- 172.21.15.26:0/220442104 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4a8056c00 con 0x7fe4b00ca2c0 2023-10-09T11:35:54.391 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 msgr2=0x7fe4900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 0x7fe4900693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0007f50 tx=0x7fe4a0007440 comp rx=0 tx=0).stop 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 msgr2=0x7fe4b00adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80094c0 tx=0x7fe4a8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 shutdown_connections 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0157930 0x7fe4b00b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b00ca2c0 0x7fe4b00adfb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe490066f30 0x7fe4900693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 --2- 172.21.15.26:0/220442104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4b00ccba0 0x7fe4b00c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 >> 172.21.15.26:0/220442104 conn(0x7fe4b0088000 msgr2=0x7fe4b0154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 shutdown_connections 2023-10-09T11:35:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.391+0000 7fe4b6b26700 1 -- 172.21.15.26:0/220442104 wait complete. 2023-10-09T11:35:54.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:35:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.525+0000 7f79ad905700 1 Processor -- start 2023-10-09T11:35:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.525+0000 7f79ad905700 1 -- start start 2023-10-09T11:35:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79ad905700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 0x7f79a80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79ad905700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 0x7f79a80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79ad905700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80ccfd0 con 0x7f79a806dc70 2023-10-09T11:35:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79ad905700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80cf0e0 con 0x7f79a806e0e0 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79ad905700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a815a3d0 con 0x7f79a8159530 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79a806dc70 0x7f79a8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52222/0 (socket says 172.21.15.26:52222) 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a67fc700 1 -- 172.21.15.26:0/3176550358 learned_addr learned my addr 172.21.15.26:0/3176550358 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/3176550358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 0x7f79a80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a77fe700 1 --2- 172.21.15.26:0/3176550358 >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 0x7f79a80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a5ffb700 1 -- 172.21.15.26:0/3176550358 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010069273 0 0) 0x7f79a80ccfd0 con 0x7f79a806dc70 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a5ffb700 1 -- 172.21.15.26:0/3176550358 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7990003570 con 0x7f79a806dc70 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a6ffd700 1 -- 172.21.15.26:0/3176550358 >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 msgr2=0x7f79a80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/3176550358 >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 0x7f79a80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a6ffd700 1 -- 172.21.15.26:0/3176550358 >> v1:172.21.15.26:6789/0 conn(0x7f79a806dc70 legacy=0x7f79a8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a6ffd700 1 -- 172.21.15.26:0/3176550358 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a815a6b0 con 0x7f79a8159530 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.526+0000 7f79a77fe700 1 --2- 172.21.15.26:0/3176550358 >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 0x7f79a80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/3176550358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 0x7f79a80ceba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79980098e0 tx=0x7f79980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c74daa065a7794a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79a5ffb700 1 -- 172.21.15.26:0/3176550358 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998011630 con 0x7f79a8159530 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79a5ffb700 1 -- 172.21.15.26:0/3176550358 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998011790 con 0x7f79a8159530 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79a5ffb700 1 -- 172.21.15.26:0/3176550358 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998011b10 con 0x7f79a8159530 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 -- 172.21.15.26:0/3176550358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 msgr2=0x7f79a80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 --2- 172.21.15.26:0/3176550358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 0x7f79a80ceba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79980098e0 tx=0x7f79980091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 -- 172.21.15.26:0/3176550358 shutdown_connections 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 --2- 172.21.15.26:0/3176550358 >> v2:172.21.15.67:3300/0 conn(0x7f79a806e0e0 0x7f79a80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 --2- 172.21.15.26:0/3176550358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a8159530 0x7f79a80ceba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 -- 172.21.15.26:0/3176550358 >> 172.21.15.26:0/3176550358 conn(0x7f79a80703a0 msgr2=0x7f79a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 -- 172.21.15.26:0/3176550358 shutdown_connections 2023-10-09T11:35:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.527+0000 7f79ad905700 1 -- 172.21.15.26:0/3176550358 wait complete. 2023-10-09T11:35:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 Processor -- start 2023-10-09T11:35:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 -- start start 2023-10-09T11:35:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a806dc70 0x7f79a814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79a806e0e0 0x7f79a80b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a814d810 con 0x7f79a8159530 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80ca660 con 0x7f79a806e0e0 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79ad905700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80c9d30 con 0x7f79a806dc70 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52982/0 (socket says 172.21.15.26:52982) 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.529+0000 7f79a77fe700 1 -- 172.21.15.26:0/2607318956 learned_addr learned my addr 172.21.15.26:0/2607318956 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a67fc700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79a806e0e0 0x7f79a80b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a806dc70 0x7f79a814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 -- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a806dc70 msgr2=0x7f79a814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a806dc70 0x7f79a814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 -- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79a806e0e0 msgr2=0x7f79a80b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79a806e0e0 0x7f79a80b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 -- 172.21.15.26:0/2607318956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0009a20 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79a77fe700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ef90 tx=0x7f79a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000cbd0 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000f040 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7998009420 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0014480 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.530+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a80ca2f0 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.531+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a80ca7f0 con 0x7f79a8159530 2023-10-09T11:35:54.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.531+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79a00148b0 con 0x7f79a8159530 2023-10-09T11:35:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.532+0000 7f798effd700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 0x7f79940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.532+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79a0085300 con 0x7f79a8159530 2023-10-09T11:35:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.532+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 0x7f79940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.533+0000 7f79a6ffd700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 0x7f79940693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79980091e0 tx=0x7f7998017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.536+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79a00524d0 con 0x7f79a8159530 2023-10-09T11:35:54.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.728+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79a804c3c0 con 0x7f79a8159530 2023-10-09T11:35:54.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.728+0000 7f798effd700 1 -- 172.21.15.26:0/2607318956 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79a0055af0 con 0x7f79a8159530 2023-10-09T11:35:54.730 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:35:54.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 msgr2=0x7f79940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 0x7f79940693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79980091e0 tx=0x7f7998017000 comp rx=0 tx=0).stop 2023-10-09T11:35:54.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 msgr2=0x7f79a80b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ef90 tx=0x7f79a000b040 comp rx=0 tx=0).stop 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 shutdown_connections 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79a8159530 0x7f79a80b5530 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7994066f30 0x7f79940693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79a806dc70 0x7f79a814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 --2- 172.21.15.26:0/2607318956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79a806e0e0 0x7f79a80b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 >> 172.21.15.26:0/2607318956 conn(0x7f79a80703a0 msgr2=0x7f79a815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 shutdown_connections 2023-10-09T11:35:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.730+0000 7f79ad905700 1 -- 172.21.15.26:0/2607318956 wait complete. 2023-10-09T11:35:54.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.861+0000 7fed2cca8700 1 Processor -- start 2023-10-09T11:35:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.861+0000 7fed2cca8700 1 -- start start 2023-10-09T11:35:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed2cca8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed2815de50 0x7fed280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed2cca8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed2815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed2cca8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280cf3c0 con 0x7fed28153c30 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed2cca8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2815afd0 con 0x7fed2815de50 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed2cca8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815b2b0 con 0x7fed280cef40 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed277fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fed28153c30 0x7fed2815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52232/0 (socket says 172.21.15.26:52232) 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.862+0000 7fed277fe700 1 -- 172.21.15.26:0/1548147720 learned_addr learned my addr 172.21.15.26:0/1548147720 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed27fff700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed2815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 --2- 172.21.15.26:0/1548147720 >> v2:172.21.15.67:3300/0 conn(0x7fed2815de50 0x7fed280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811214177 0 0) 0x7fed280cf3c0 con 0x7fed28153c30 2023-10-09T11:35:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed10003570 con 0x7fed28153c30 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977600084 0 0) 0x7fed10003570 con 0x7fed28153c30 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 msgr2=0x7fed2815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed2815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 >> v2:172.21.15.67:3300/0 conn(0x7fed2815de50 msgr2=0x7fed280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 --2- 172.21.15.26:0/1548147720 >> v2:172.21.15.67:3300/0 conn(0x7fed2815de50 0x7fed280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2815b590 con 0x7fed28153c30 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fed18001470 con 0x7fed28153c30 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 >> v1:172.21.15.26:6789/0 conn(0x7fed28153c30 legacy=0x7fed2815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10003a60 0x7fed10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed10004810 0x7fed10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815afd0 con 0x7fed10004810 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815b2b0 con 0x7fed10003a60 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1000ba60 con 0x7fed280cef40 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed10004810 0x7fed10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed277fe700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10003a60 0x7fed10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed27fff700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 -- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 msgr2=0x7fed100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280cef40 0x7fed100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 -- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10003a60 msgr2=0x7fed10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10003a60 0x7fed10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.863+0000 7fed26ffd700 1 -- 172.21.15.26:0/1548147720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10003570 con 0x7fed10004810 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed26ffd700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed10004810 0x7fed10004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009c30 tx=0x7fed1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1793d5e378f708 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00e710 con 0x7fed10004810 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c00e870 con 0x7fed10004810 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed267fc700 1 -- 172.21.15.26:0/1548147720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00ec30 con 0x7fed10004810 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 -- 172.21.15.26:0/1548147720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed10004810 msgr2=0x7fed10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 --2- 172.21.15.26:0/1548147720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed10004810 0x7fed10004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009c30 tx=0x7fed1c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed27fff700 1 -- 172.21.15.26:0/1548147720 reap_dead start 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 -- 172.21.15.26:0/1548147720 shutdown_connections 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 -- 172.21.15.26:0/1548147720 >> 172.21.15.26:0/1548147720 conn(0x7fed280703a0 msgr2=0x7fed280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 -- 172.21.15.26:0/1548147720 shutdown_connections 2023-10-09T11:35:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.864+0000 7fed2cca8700 1 -- 172.21.15.26:0/1548147720 wait complete. 2023-10-09T11:35:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.865+0000 7fed2cca8700 1 Processor -- start 2023-10-09T11:35:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.865+0000 7fed2cca8700 1 -- start start 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10004810 0x7fed28151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c8280 0x7fed280b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2816a080 con 0x7fed280cbdf0 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c86f0 con 0x7fed10004810 2023-10-09T11:35:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed2cca8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b32d0 con 0x7fed280c8280 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53008/0 (socket says 172.21.15.26:53008) 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed27fff700 1 -- 172.21.15.26:0/568858634 learned_addr learned my addr 172.21.15.26:0/568858634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed26ffd700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c8280 0x7fed280b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.866+0000 7fed277fe700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10004810 0x7fed28151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 -- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c8280 msgr2=0x7fed280b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c8280 0x7fed280b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 -- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10004810 msgr2=0x7fed28151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10004810 0x7fed28151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 -- 172.21.15.26:0/568858634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280cb960 con 0x7fed280cbdf0 2023-10-09T11:35:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed27fff700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fed28071370 tx=0x7fed2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e070 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed20011b80 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed280b3520 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20016470 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.867+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed280cb590 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.868+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed280cb7b0 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.868+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed20016860 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.869+0000 7fed0f7fe700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 0x7fed140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.869+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed20084ea0 con 0x7fed280cbdf0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.869+0000 7fed277fe700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 0x7fed140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.870+0000 7fed277fe700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 0x7fed140693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed180016e0 tx=0x7fed28159c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:54.873+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed20052110 con 0x7fed280cbdf0 2023-10-09T11:35:54.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:54.926 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.110+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed280cbaf0 con 0x7fed280cbdf0 2023-10-09T11:35:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.110+0000 7fed0f7fe700 1 -- 172.21.15.26:0/568858634 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fed20055730 con 0x7fed280cbdf0 2023-10-09T11:35:55.112 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:55.112 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 msgr2=0x7fed140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 0x7fed140693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed180016e0 tx=0x7fed28159c60 comp rx=0 tx=0).stop 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 msgr2=0x7fed280cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fed28071370 tx=0x7fed2000b040 comp rx=0 tx=0).stop 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 shutdown_connections 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed280cbdf0 0x7fed280cc270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed10004810 0x7fed28151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fed14066f30 0x7fed140693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 --2- 172.21.15.26:0/568858634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c8280 0x7fed280b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 >> 172.21.15.26:0/568858634 conn(0x7fed280703a0 msgr2=0x7fed281530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 shutdown_connections 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.112+0000 7fed2cca8700 1 -- 172.21.15.26:0/568858634 wait complete. 2023-10-09T11:35:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:55.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.245+0000 7fc062446700 1 Processor -- start 2023-10-09T11:35:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.245+0000 7fc062446700 1 -- start start 2023-10-09T11:35:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.245+0000 7fc062446700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc05c0cb970 0x7fc05c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.245+0000 7fc062446700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c15a400 0x7fc05c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc062446700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c15ae40 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc062446700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0ce0f0 con 0x7fc05c0cb970 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc062446700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0d13f0 con 0x7fc05c15a400 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc05c0cb970 0x7fc05c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc05c0cb970 0x7fc05c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53014/0 (socket says 172.21.15.26:53014) 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 -- 172.21.15.26:0/183787531 learned_addr learned my addr 172.21.15.26:0/183787531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc0609e3700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c15a400 0x7fc05c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 -- 172.21.15.26:0/183787531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c15a400 msgr2=0x7fc05c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c15a400 0x7fc05c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 -- 172.21.15.26:0/183787531 >> v1:172.21.15.67:6789/0 conn(0x7fc05c0cb5a0 legacy=0x7fc05c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 -- 172.21.15.26:0/183787531 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c15ab60 con 0x7fc05c0cb970 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05b7fe700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb970 0x7fc05c159ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099b0 tx=0x7fc050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bd072b2151192b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05affd700 1 -- 172.21.15.26:0/183787531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050009ea0 con 0x7fc05c0cb970 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05affd700 1 -- 172.21.15.26:0/183787531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000b860 con 0x7fc05c0cb970 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.246+0000 7fc05affd700 1 -- 172.21.15.26:0/183787531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000bc00 con 0x7fc05c0cb970 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 -- 172.21.15.26:0/183787531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb970 msgr2=0x7fc05c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb970 0x7fc05c159ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099b0 tx=0x7fc050009250 comp rx=0 tx=0).stop 2023-10-09T11:35:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 -- 172.21.15.26:0/183787531 shutdown_connections 2023-10-09T11:35:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c15a400 0x7fc05c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 --2- 172.21.15.26:0/183787531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb970 0x7fc05c159ec0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 -- 172.21.15.26:0/183787531 >> 172.21.15.26:0/183787531 conn(0x7fc05c070e30 msgr2=0x7fc05c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 -- 172.21.15.26:0/183787531 shutdown_connections 2023-10-09T11:35:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.247+0000 7fc062446700 1 -- 172.21.15.26:0/183787531 wait complete. 2023-10-09T11:35:55.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.248+0000 7fc062446700 1 Processor -- start 2023-10-09T11:35:55.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.248+0000 7fc062446700 1 -- start start 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c0cb970 0x7fc05c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc05c15a400 0x7fc05c1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c66f0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c5ae0 con 0x7fc05c15a400 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc062446700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c5dc0 con 0x7fc05c0cb970 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc05bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc05bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53018/0 (socket says 172.21.15.26:53018) 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc05bfff700 1 -- 172.21.15.26:0/3766290055 learned_addr learned my addr 172.21.15.26:0/3766290055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc0609e3700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc05c15a400 0x7fc05c1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.249+0000 7fc05b7fe700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c0cb970 0x7fc05c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 -- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c0cb970 msgr2=0x7fc05c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c0cb970 0x7fc05c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 -- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc05c15a400 msgr2=0x7fc05c1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc05c15a400 0x7fc05c1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 -- 172.21.15.26:0/3766290055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500094f0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc05bfff700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c590 tx=0x7fc04c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c011590 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c011710 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c0c60a0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c011ad0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.250+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c14e6c0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.251+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c0c69d0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.251+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc04c01b3b0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.252+0000 7fc043fff700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 0x7fc0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.252+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc04c083a60 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.252+0000 7fc05b7fe700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 0x7fc0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.253+0000 7fc05b7fe700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 0x7fc0480693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099b0 tx=0x7fc050017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.256+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc04c050cd0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.454+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc05c04c3c0 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.454+0000 7fc043fff700 1 -- 172.21.15.26:0/3766290055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc04c017070 con 0x7fc05c0cb5a0 2023-10-09T11:35:55.456 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:55.456 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:55.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 msgr2=0x7fc0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 0x7fc0480693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099b0 tx=0x7fc050017000 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 msgr2=0x7fc05c14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c590 tx=0x7fc04c00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 shutdown_connections 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc05c15a400 0x7fc05c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0cb5a0 0x7fc05c14e180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc048066f30 0x7fc0480693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 --2- 172.21.15.26:0/3766290055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc05c0cb970 0x7fc05c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 >> 172.21.15.26:0/3766290055 conn(0x7fc05c070e30 msgr2=0x7fc05c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 shutdown_connections 2023-10-09T11:35:55.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.457+0000 7fc062446700 1 -- 172.21.15.26:0/3766290055 wait complete. 2023-10-09T11:35:55.470 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:35:55.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:55.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.588+0000 7f4d59a59700 1 Processor -- start 2023-10-09T11:35:55.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.588+0000 7f4d59a59700 1 -- start start 2023-10-09T11:35:55.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d59a59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d540ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d59a59700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415e010 con 0x7f4d540cb1a0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d59a59700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415d420 con 0x7f4d541594d0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d59a59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415d6e0 con 0x7f4d540cf180 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d537fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d540cb1a0 0x7f4d54159e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52240/0 (socket says 172.21.15.26:52240) 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.589+0000 7f4d537fe700 1 -- 172.21.15.26:0/3267102929 learned_addr learned my addr 172.21.15.26:0/3267102929 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d527fc700 1 --2- 172.21.15.26:0/3267102929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d540ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685569770 0 0) 0x7f4d5415e010 con 0x7f4d540cb1a0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003570 con 0x7f4d540cb1a0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137189103 0 0) 0x7f4d5415d420 con 0x7f4d541594d0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5415e010 con 0x7f4d541594d0 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d527fc700 1 -- 172.21.15.26:0/3267102929 >> v1:172.21.15.67:6789/0 conn(0x7f4d541594d0 legacy=0x7f4d540cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d527fc700 1 -- 172.21.15.26:0/3267102929 >> v1:172.21.15.26:6789/0 conn(0x7f4d540cb1a0 legacy=0x7f4d54159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d527fc700 1 -- 172.21.15.26:0/3267102929 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5415d9c0 con 0x7f4d540cf180 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d527fc700 1 --2- 172.21.15.26:0/3267102929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d540ccfc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009910 tx=0x7f4d3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347a00f299c116b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c011630 con 0x7f4d540cf180 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c011790 con 0x7f4d540cf180 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.590+0000 7f4d51ffb700 1 -- 172.21.15.26:0/3267102929 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c011b10 con 0x7f4d540cf180 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 -- 172.21.15.26:0/3267102929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 msgr2=0x7f4d540ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 --2- 172.21.15.26:0/3267102929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d540ccfc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009910 tx=0x7f4d3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 -- 172.21.15.26:0/3267102929 shutdown_connections 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 --2- 172.21.15.26:0/3267102929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d540ccfc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 -- 172.21.15.26:0/3267102929 >> 172.21.15.26:0/3267102929 conn(0x7f4d540703a0 msgr2=0x7f4d54070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 -- 172.21.15.26:0/3267102929 shutdown_connections 2023-10-09T11:35:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.591+0000 7f4d59a59700 1 -- 172.21.15.26:0/3267102929 wait complete. 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.592+0000 7f4d59a59700 1 Processor -- start 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.592+0000 7f4d59a59700 1 -- start start 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d541697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d541594d0 0x7f4d540b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541680f0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c8500 con 0x7f4d541594d0 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d59a59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c7c40 con 0x7f4d540cf180 2023-10-09T11:35:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53022/0 (socket says 172.21.15.26:53022) 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 -- 172.21.15.26:0/1670205058 learned_addr learned my addr 172.21.15.26:0/1670205058 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d541697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d541594d0 0x7f4d540b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 -- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 msgr2=0x7f4d541697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d541697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 -- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d541594d0 msgr2=0x7f4d540b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.593+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d541594d0 0x7f4d540b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d52ffd700 1 -- 172.21.15.26:0/1670205058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009420 con 0x7f4d540cb1a0 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c970 tx=0x7f4d44002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400a760 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400a8c0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540c7eb0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400ac80 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.594+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540b6100 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.595+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5404c3c0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.595+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d44012630 con 0x7f4d540cb1a0 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.596+0000 7f4d4affd700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 0x7f4d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.596+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d440849a0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.596+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 0x7f4d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.596+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 0x7f4d340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d540c6330 tx=0x7f4d3c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.600+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d44051b70 con 0x7f4d540cb1a0 2023-10-09T11:35:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.834+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5415dca0 con 0x7f4d540cb1a0 2023-10-09T11:35:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.834+0000 7f4d4affd700 1 -- 172.21.15.26:0/1670205058 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f4d44055190 con 0x7f4d540cb1a0 2023-10-09T11:35:55.836 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:55.836 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:55.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 msgr2=0x7f4d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 0x7f4d340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d540c6330 tx=0x7f4d3c017000 comp rx=0 tx=0).stop 2023-10-09T11:35:55.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 msgr2=0x7f4d54167bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c970 tx=0x7f4d44002700 comp rx=0 tx=0).stop 2023-10-09T11:35:55.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 shutdown_connections 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d541594d0 0x7f4d540b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d540cb1a0 0x7f4d54167bb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d34066f30 0x7f4d340693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 --2- 172.21.15.26:0/1670205058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d540cf180 0x7f4d541697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 >> 172.21.15.26:0/1670205058 conn(0x7f4d540703a0 msgr2=0x7f4d54152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 shutdown_connections 2023-10-09T11:35:55.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.836+0000 7f4d59a59700 1 -- 172.21.15.26:0/1670205058 wait complete. 2023-10-09T11:35:55.840 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:55.850 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:55.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.967+0000 7f9d60eb8700 1 Processor -- start 2023-10-09T11:35:55.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.967+0000 7f9d60eb8700 1 -- start start 2023-10-09T11:35:55.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d60eb8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d5c15a5d0 0x7f9d5c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d60eb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c15ae40 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d60eb8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c15ab60 con 0x7f9d5c0cb970 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d60eb8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0ce0f0 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d5ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d5c15a5d0 0x7f9d5c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d5ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d5c15a5d0 0x7f9d5c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53038/0 (socket says 172.21.15.26:53038) 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d5ad9d700 1 -- 172.21.15.26:0/2021378890 learned_addr learned my addr 172.21.15.26:0/2021378890 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.968+0000 7f9d5a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d5c0cb5a0 0x7f9d5c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52246/0 (socket says 172.21.15.26:52246) 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5ad9d700 1 -- 172.21.15.26:0/2021378890 >> v1:172.21.15.67:6789/0 conn(0x7f9d5c0cb970 legacy=0x7f9d5c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5ad9d700 1 -- 172.21.15.26:0/2021378890 >> v1:172.21.15.26:6789/0 conn(0x7f9d5c0cb5a0 legacy=0x7f9d5c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5ad9d700 1 -- 172.21.15.26:0/2021378890 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0ccf00 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5ad9d700 1 --2- 172.21.15.26:0/2021378890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c156e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009f20 tx=0x7f9d54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f21455aa61d15e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5959a700 1 -- 172.21.15.26:0/2021378890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400e070 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5959a700 1 -- 172.21.15.26:0/2021378890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400ba80 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d5959a700 1 -- 172.21.15.26:0/2021378890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540092e0 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d60eb8700 1 -- 172.21.15.26:0/2021378890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c15a5d0 msgr2=0x7f9d5c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.969+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/2021378890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c156e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009f20 tx=0x7f9d54009840 comp rx=0 tx=0).stop 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.970+0000 7f9d60eb8700 1 -- 172.21.15.26:0/2021378890 shutdown_connections 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.970+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/2021378890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c156e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.970+0000 7f9d60eb8700 1 -- 172.21.15.26:0/2021378890 >> 172.21.15.26:0/2021378890 conn(0x7f9d5c070e30 msgr2=0x7f9d5c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.970+0000 7f9d60eb8700 1 -- 172.21.15.26:0/2021378890 shutdown_connections 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.970+0000 7f9d60eb8700 1 -- 172.21.15.26:0/2021378890 wait complete. 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 Processor -- start 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 -- start start 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d5c0cb970 0x7f9d5c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b3950 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c158c50 con 0x7f9d5c15a5d0 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.971+0000 7f9d60eb8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c158f30 con 0x7f9d5c0cb970 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53042/0 (socket says 172.21.15.26:53042) 2023-10-09T11:35:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 -- 172.21.15.26:0/407748437 learned_addr learned my addr 172.21.15.26:0/407748437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d59d9b700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d5c0cb970 0x7f9d5c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5ad9d700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 -- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d5c0cb970 msgr2=0x7f9d5c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d5c0cb970 0x7f9d5c1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 -- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d5c15a5d0 msgr2=0x7f9d5c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 -- 172.21.15.26:0/407748437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009ae0 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d5a59c700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c7c0 tx=0x7f9d4c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c005a70 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c005bf0 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0b35e0 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0070d0 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.972+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c151450 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.973+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c04c3c0 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.974+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d4c007480 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.974+0000 7f9d527fc700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 0x7f9d3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.974+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d4c083890 con 0x7f9d5c0cb5a0 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.974+0000 7f9d59d9b700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 0x7f9d3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.975+0000 7f9d59d9b700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 0x7f9d3c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c16cd80 tx=0x7f9d44007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:55.978+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d4c050b00 con 0x7f9d5c0cb5a0 2023-10-09T11:35:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.219+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d5c0afa00 con 0x7f9d5c0cb5a0 2023-10-09T11:35:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.220+0000 7f9d527fc700 1 -- 172.21.15.26:0/407748437 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f9d4c017020 con 0x7f9d5c0cb5a0 2023-10-09T11:35:56.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:56.221 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3104520163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3104520163},{"type":"v1","addr":"172.21.15.67:6836","nonce":3104520163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3224546836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3224546836},{"type":"v1","addr":"172.21.15.67:6837","nonce":3224546836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/522126152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":522126152},{"type":"v1","addr":"172.21.15.26:6834","nonce":522126152}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:35:23.749143+0000","modified":"2023-10-09T11:35:27.357164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1658898397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1658898397},{"type":"v1","addr":"172.21.15.26:6835","nonce":1658898397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:35:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 msgr2=0x7f9d3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 0x7f9d3c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c16cd80 tx=0x7f9d44007ec0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 msgr2=0x7f9d5c156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c7c0 tx=0x7f9d4c007f70 comp rx=0 tx=0).stop 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 shutdown_connections 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d5c15a5d0 0x7f9d5c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d5c0cb5a0 0x7f9d5c156c60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d3c066f30 0x7f9d3c0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 --2- 172.21.15.26:0/407748437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d5c0cb970 0x7f9d5c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 >> 172.21.15.26:0/407748437 conn(0x7f9d5c070e30 msgr2=0x7f9d5c0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 shutdown_connections 2023-10-09T11:35:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.222+0000 7f9d60eb8700 1 -- 172.21.15.26:0/407748437 wait complete. 2023-10-09T11:35:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-09T11:35:56.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:56.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.352+0000 7f3269abb700 1 Processor -- start 2023-10-09T11:35:56.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.352+0000 7f3269abb700 1 -- start start 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3269abb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32640aee90 0x7f32640a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3269abb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640ce1a0 con 0x7f326406d280 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3269abb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640cd5d0 con 0x7f32640a8be0 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3269abb700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cd870 con 0x7f32640aee90 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3263fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f326406d280 0x7f32640b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52256/0 (socket says 172.21.15.26:52256) 2023-10-09T11:35:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.353+0000 7f3263fff700 1 -- 172.21.15.26:0/39730543 learned_addr learned my addr 172.21.15.26:0/39730543 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f325affd700 1 --2- 172.21.15.26:0/39730543 >> v2:172.21.15.67:3300/0 conn(0x7f32640aee90 0x7f32640a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722495800 0 0) 0x7f32640ce1a0 con 0x7f326406d280 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3250003570 con 0x7f326406d280 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193578285 0 0) 0x7f3250003570 con 0x7f326406d280 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 >> v2:172.21.15.67:3300/0 conn(0x7f32640aee90 msgr2=0x7f32640a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 --2- 172.21.15.26:0/39730543 >> v2:172.21.15.67:3300/0 conn(0x7f32640aee90 0x7f32640a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 >> v1:172.21.15.67:6789/0 conn(0x7f32640a8be0 legacy=0x7f32640ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640cdb50 con 0x7f326406d280 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f325c0017f0 con 0x7f326406d280 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 >> v1:172.21.15.26:6789/0 conn(0x7f326406d280 legacy=0x7f32640b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3250003a60 0x7f3250003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3250004810 0x7f3250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 0x7f325000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640cd870 con 0x7f32500051c0 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325000c0d0 con 0x7f3250003a60 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325000c290 con 0x7f3250004810 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 0x7f325000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f325affd700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3250004810 0x7f3250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f32637fe700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3250003a60 0x7f3250003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 -- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3250004810 msgr2=0x7f3250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3250004810 0x7f3250004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 -- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3250003a60 msgr2=0x7f3250003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3250003a60 0x7f3250003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.354+0000 7f3263fff700 1 -- 172.21.15.26:0/39730543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250003570 con 0x7f32500051c0 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3263fff700 1 -- 172.21.15.26:0/39730543 reap_dead start 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3263fff700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 0x7f325000ba60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a900 tx=0x7f325c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd00ef541ccb41e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0070d0 con 0x7f32500051c0 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c007230 con 0x7f32500051c0 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3262ffd700 1 -- 172.21.15.26:0/39730543 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0075d0 con 0x7f32500051c0 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 -- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 msgr2=0x7f325000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 0x7f325000ba60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a900 tx=0x7f325c0021d0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 -- 172.21.15.26:0/39730543 shutdown_connections 2023-10-09T11:35:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 --2- 172.21.15.26:0/39730543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500051c0 0x7f325000ba60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 -- 172.21.15.26:0/39730543 >> 172.21.15.26:0/39730543 conn(0x7f326406ce80 msgr2=0x7f32640ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 -- 172.21.15.26:0/39730543 shutdown_connections 2023-10-09T11:35:56.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.355+0000 7f3269abb700 1 -- 172.21.15.26:0/39730543 wait complete. 2023-10-09T11:35:56.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.356+0000 7f3269abb700 1 Processor -- start 2023-10-09T11:35:56.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 -- start start 2023-10-09T11:35:56.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32500051c0 0x7f32640aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32640ac4a0 0x7f32640ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640ac010 con 0x7f326416da30 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640ab400 con 0x7f32640ac4a0 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.357+0000 7f3269abb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640ab6e0 con 0x7f32500051c0 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53066/0 (socket says 172.21.15.26:53066) 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 -- 172.21.15.26:0/2085548539 learned_addr learned my addr 172.21.15.26:0/2085548539 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f32637fe700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32500051c0 0x7f32640aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f3263fff700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32640ac4a0 0x7f32640ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 -- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32500051c0 msgr2=0x7f32640aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32500051c0 0x7f32640aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 -- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32640ac4a0 msgr2=0x7f32640ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32640ac4a0 0x7f32640ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 -- 172.21.15.26:0/2085548539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640ab9c0 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325affd700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f324c0116e0 tx=0x7f324c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c005c10 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c005d70 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32640abca0 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0062a0 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.358+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640b3d20 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.359+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640b3f40 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.360+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f324c006650 con 0x7f326416da30 2023-10-09T11:35:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.360+0000 7f325bfff700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.360+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f324c084d50 con 0x7f326416da30 2023-10-09T11:35:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.360+0000 7f32637fe700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.361+0000 7f32637fe700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 0x7f32440693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3254000c00 tx=0x7f3254007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.365+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f324c088030 con 0x7f326416da30 2023-10-09T11:35:56.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.558+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f326404c3c0 con 0x7f326416da30 2023-10-09T11:35:56.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.559+0000 7f325bfff700 1 -- 172.21.15.26:0/2085548539 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f324c051fc0 con 0x7f326416da30 2023-10-09T11:35:56.561 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:35:56.561 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:35:25.126320+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:35:22.198484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:35:22.711064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 msgr2=0x7f32440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 0x7f32440693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3254000c00 tx=0x7f3254007d80 comp rx=0 tx=0).stop 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 msgr2=0x7f32640b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f324c0116e0 tx=0x7f324c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 shutdown_connections 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32640ac4a0 0x7f32640ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32500051c0 0x7f32640aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 --2- 172.21.15.26:0/2085548539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326416da30 0x7f32640b37e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 >> 172.21.15.26:0/2085548539 conn(0x7f326406ce80 msgr2=0x7f32640b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 shutdown_connections 2023-10-09T11:35:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.561+0000 7f3269abb700 1 -- 172.21.15.26:0/2085548539 wait complete. 2023-10-09T11:35:56.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:35:56.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.696+0000 7fd36f59e700 1 Processor -- start 2023-10-09T11:35:56.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.696+0000 7fd36f59e700 1 -- start start 2023-10-09T11:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36f59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd370153c30 0x7fd37015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36f59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3700cf110 0x7fd37015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36f59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37015afd0 con 0x7fd37015de50 2023-10-09T11:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36f59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37015b2b0 con 0x7fd370153c30 2023-10-09T11:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36f59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37015b590 con 0x7fd3700cf110 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd370153c30 0x7fd37015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd370153c30 0x7fd37015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53070/0 (socket says 172.21.15.26:53070) 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.697+0000 7fd36e59c700 1 -- 172.21.15.26:0/1079143822 learned_addr learned my addr 172.21.15.26:0/1079143822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36ed9d700 1 --2- 172.21.15.26:0/1079143822 >> v2:172.21.15.67:3300/0 conn(0x7fd3700cf110 0x7fd37015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36e59c700 1 -- 172.21.15.26:0/1079143822 >> v2:172.21.15.67:3300/0 conn(0x7fd3700cf110 msgr2=0x7fd37015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36e59c700 1 --2- 172.21.15.26:0/1079143822 >> v2:172.21.15.67:3300/0 conn(0x7fd3700cf110 0x7fd37015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36e59c700 1 -- 172.21.15.26:0/1079143822 >> v1:172.21.15.67:6789/0 conn(0x7fd37015de50 legacy=0x7fd3700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36e59c700 1 -- 172.21.15.26:0/1079143822 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37015b870 con 0x7fd370153c30 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36e59c700 1 --2- 172.21.15.26:0/1079143822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd370153c30 0x7fd37015a5e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cdab0 tx=0x7fd368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34c13d642284b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36d59a700 1 -- 172.21.15.26:0/1079143822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800b820 con 0x7fd370153c30 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36d59a700 1 -- 172.21.15.26:0/1079143822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800b980 con 0x7fd370153c30 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.698+0000 7fd36d59a700 1 -- 172.21.15.26:0/1079143822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800bd20 con 0x7fd370153c30 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 -- 172.21.15.26:0/1079143822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd370153c30 msgr2=0x7fd37015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 --2- 172.21.15.26:0/1079143822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd370153c30 0x7fd37015a5e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cdab0 tx=0x7fd368009250 comp rx=0 tx=0).stop 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 -- 172.21.15.26:0/1079143822 shutdown_connections 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 --2- 172.21.15.26:0/1079143822 >> v2:172.21.15.67:3300/0 conn(0x7fd3700cf110 0x7fd37015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 --2- 172.21.15.26:0/1079143822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd370153c30 0x7fd37015a5e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 -- 172.21.15.26:0/1079143822 >> 172.21.15.26:0/1079143822 conn(0x7fd3700703a0 msgr2=0x7fd3700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 -- 172.21.15.26:0/1079143822 shutdown_connections 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.699+0000 7fd36f59e700 1 -- 172.21.15.26:0/1079143822 wait complete. 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 Processor -- start 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 -- start start 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3700cf110 0x7fd3700b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 0x7fd370144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700c8860 con 0x7fd37015de50 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700c7f70 con 0x7fd370153c30 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.700+0000 7fd36f59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700c8210 con 0x7fd3700cf110 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53086/0 (socket says 172.21.15.26:53086) 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 -- 172.21.15.26:0/59812438 learned_addr learned my addr 172.21.15.26:0/59812438 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36e59c700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3700cf110 0x7fd3700b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36dd9b700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 0x7fd370144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 -- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3700cf110 msgr2=0x7fd3700b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3700cf110 0x7fd3700b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 -- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 msgr2=0x7fd370144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 0x7fd370144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 -- 172.21.15.26:0/59812438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680094f0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36dd9b700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 0x7fd370144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36ed9d700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd360009fa0 tx=0x7fd360009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000ec70 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000edd0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700c84f0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360014670 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.701+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd370169cd0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.702+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3700c89d0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.703+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3600149e0 con 0x7fd37015de50 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.703+0000 7fd3667fc700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 0x7fd3500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.703+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd360084c70 con 0x7fd37015de50 2023-10-09T11:35:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.703+0000 7fd36e59c700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 0x7fd3500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.704+0000 7fd36e59c700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 0x7fd3500693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cdab0 tx=0x7fd368016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.708+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd360051ee0 con 0x7fd37015de50 2023-10-09T11:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.945+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd37004c3c0 con 0x7fd37015de50 2023-10-09T11:35:56.945 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:35:56.945+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:35:56.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.949+0000 7fd3667fc700 1 -- 172.21.15.26:0/59812438 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd360055500 con 0x7fd37015de50 2023-10-09T11:35:56.950 INFO:tasks.ceph.mds.a.smithi026.stderr: -1639> 2023-10-09T11:35:27.439+0000 7fb854ae8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 msgr2=0x7fd3500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 0x7fd3500693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cdab0 tx=0x7fd368016000 comp rx=0 tx=0).stop 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 msgr2=0x7fd370145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd360009fa0 tx=0x7fd360009900 comp rx=0 tx=0).stop 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 shutdown_connections 2023-10-09T11:35:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37015de50 0x7fd370145160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd350066f30 0x7fd3500693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3700cf110 0x7fd3700b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 --2- 172.21.15.26:0/59812438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd370153c30 0x7fd370144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 >> 172.21.15.26:0/59812438 conn(0x7fd3700703a0 msgr2=0x7fd3700b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 shutdown_connections 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:56.951+0000 7fd36f59e700 1 -- 172.21.15.26:0/59812438 wait complete. 2023-10-09T11:35:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:35:56.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:35:56.973 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:35:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.086+0000 7f9bf966c700 1 Processor -- start 2023-10-09T11:35:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.086+0000 7f9bf966c700 1 -- start start 2023-10-09T11:35:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.086+0000 7f9bf966c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bf4159530 0x7f9bf40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf966c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 0x7f9bf40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf966c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40ccfd0 con 0x7f9bf406dc70 2023-10-09T11:35:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf966c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40cf0e0 con 0x7f9bf4159530 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf966c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf415a3d0 con 0x7f9bf406e0e0 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bf4159530 0x7f9bf40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf27fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9bf406dc70 0x7f9bf4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52272/0 (socket says 172.21.15.26:52272) 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf27fc700 1 -- 172.21.15.26:0/3558711821 learned_addr learned my addr 172.21.15.26:0/3558711821 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bf4159530 0x7f9bf40ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53108/0 (socket says 172.21.15.26:53108) 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf37fe700 1 --2- 172.21.15.26:0/3558711821 >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 0x7f9bf40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 -- 172.21.15.26:0/3558711821 >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 msgr2=0x7f9bf40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/3558711821 >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 0x7f9bf40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 -- 172.21.15.26:0/3558711821 >> v1:172.21.15.26:6789/0 conn(0x7f9bf406dc70 legacy=0x7f9bf4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 -- 172.21.15.26:0/3558711821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf415a6b0 con 0x7f9bf4159530 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf1ffb700 1 -- 172.21.15.26:0/3558711821 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374400087 0 0) 0x7f9bf40ccfd0 con 0x7f9bf406dc70 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf37fe700 1 --2- 172.21.15.26:0/3558711821 >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 0x7f9bf40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/3558711821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf4159530 0x7f9bf40ceba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40caef0 tx=0x7f9be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc4720e8127ba0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf1ffb700 1 -- 172.21.15.26:0/3558711821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400b6b0 con 0x7f9bf4159530 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf1ffb700 1 -- 172.21.15.26:0/3558711821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400b810 con 0x7f9bf4159530 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.087+0000 7f9bf1ffb700 1 -- 172.21.15.26:0/3558711821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400bbb0 con 0x7f9bf4159530 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 -- 172.21.15.26:0/3558711821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf4159530 msgr2=0x7f9bf40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 --2- 172.21.15.26:0/3558711821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf4159530 0x7f9bf40ceba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40caef0 tx=0x7f9be40091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 -- 172.21.15.26:0/3558711821 shutdown_connections 2023-10-09T11:35:57.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 --2- 172.21.15.26:0/3558711821 >> v2:172.21.15.67:3300/0 conn(0x7f9bf406e0e0 0x7f9bf40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 --2- 172.21.15.26:0/3558711821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf4159530 0x7f9bf40ceba0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 -- 172.21.15.26:0/3558711821 >> 172.21.15.26:0/3558711821 conn(0x7f9bf40703a0 msgr2=0x7f9bf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 -- 172.21.15.26:0/3558711821 shutdown_connections 2023-10-09T11:35:57.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.088+0000 7f9bf966c700 1 -- 172.21.15.26:0/3558711821 wait complete. 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.089+0000 7f9bf966c700 1 Processor -- start 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.089+0000 7f9bf966c700 1 -- start start 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 0x7f9bf40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 0x7f9bf40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b39c0 con 0x7f9bf406e0e0 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4156bf0 con 0x7f9bf4159530 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf966c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4155f80 con 0x7f9bf406dc70 2023-10-09T11:35:57.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53114/0 (socket says 172.21.15.26:53114) 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 -- 172.21.15.26:0/1180955365 learned_addr learned my addr 172.21.15.26:0/1180955365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 0x7f9bf40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf37fe700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 0x7f9bf40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 -- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 msgr2=0x7f9bf40b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 0x7f9bf40b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 -- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 msgr2=0x7f9bf40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 0x7f9bf40cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 -- 172.21.15.26:0/1180955365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009420 con 0x7f9bf406e0e0 2023-10-09T11:35:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 0x7f9bf40b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf37fe700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 0x7f9bf40cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.090+0000 7f9bf27fc700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9be800c7e0 tx=0x7f9be8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.091+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8005b30 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.091+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8005c90 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.091+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8007300 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.091+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf4156260 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.091+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf4156820 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.092+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf4156d80 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.092+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9be801b400 con 0x7f9bf406e0e0 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.092+0000 7f9bdaffd700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.093+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9be8084030 con 0x7f9bf406e0e0 2023-10-09T11:35:57.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.093+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.093+0000 7f9bf2ffd700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097b0 tx=0x7f9be4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.097+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bf4156d80 con 0x7f9bf406e0e0 2023-10-09T11:35:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.333+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9bf4156d30 con 0x7f9bf406e0e0 2023-10-09T11:35:57.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.953+0000 7f9bdaffd700 1 -- 172.21.15.26:0/1180955365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9be80512d0 con 0x7f9bf406e0e0 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 msgr2=0x7f9be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097b0 tx=0x7f9be4017000 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 msgr2=0x7f9bf4144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9be800c7e0 tx=0x7f9be8007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 shutdown_connections 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bf4159530 0x7f9bf40cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9bf406dc70 0x7f9bf40b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 --2- 172.21.15.26:0/1180955365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bf406e0e0 0x7f9bf4144f90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 >> 172.21.15.26:0/1180955365 conn(0x7f9bf40703a0 msgr2=0x7f9bf40d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 shutdown_connections 2023-10-09T11:35:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:57.955+0000 7f9bf966c700 1 -- 172.21.15.26:0/1180955365 wait complete. 2023-10-09T11:35:57.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:35:58.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.136+0000 7ff0ba674700 1 Processor -- start 2023-10-09T11:35:58.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.136+0000 7ff0ba674700 1 -- start start 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0ba674700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0b4156480 0x7ff0b4157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0ba674700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b40ae140 0x7ff0b40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0ba674700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b406b2f0 con 0x7ff0b40c7b30 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0ba674700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b406ace0 con 0x7ff0b40ae140 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0ba674700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b40aea80 con 0x7ff0b4156480 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.137+0000 7ff0b8c11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b40ae140 0x7ff0b40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b40ae140 0x7ff0b40ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53120/0 (socket says 172.21.15.26:53120) 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0b40c7b30 0x7ff0b406b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52284/0 (socket says 172.21.15.26:52284) 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 -- 172.21.15.26:0/3928230047 learned_addr learned my addr 172.21.15.26:0/3928230047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b3fff700 1 --2- 172.21.15.26:0/3928230047 >> v2:172.21.15.67:3300/0 conn(0x7ff0b4156480 0x7ff0b4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 -- 172.21.15.26:0/3928230047 >> v2:172.21.15.67:3300/0 conn(0x7ff0b4156480 msgr2=0x7ff0b4157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 --2- 172.21.15.26:0/3928230047 >> v2:172.21.15.67:3300/0 conn(0x7ff0b4156480 0x7ff0b4157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 -- 172.21.15.26:0/3928230047 >> v1:172.21.15.26:6789/0 conn(0x7ff0b40c7b30 legacy=0x7ff0b406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 -- 172.21.15.26:0/3928230047 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40c8310 con 0x7ff0b40ae140 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/3928230047 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53057884 0 0) 0x7ff0b406b2f0 con 0x7ff0b40c7b30 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b8c11700 1 --2- 172.21.15.26:0/3928230047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b40ae540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4063280 tx=0x7ff0ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73be4d6fd6ce3e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/3928230047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00e070 con 0x7ff0b40ae140 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/3928230047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00ba50 con 0x7ff0b40ae140 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.138+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/3928230047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0092e0 con 0x7ff0b40ae140 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 -- 172.21.15.26:0/3928230047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 msgr2=0x7ff0b40ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 --2- 172.21.15.26:0/3928230047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b40ae540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4063280 tx=0x7ff0ac009840 comp rx=0 tx=0).stop 2023-10-09T11:35:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 -- 172.21.15.26:0/3928230047 shutdown_connections 2023-10-09T11:35:58.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 --2- 172.21.15.26:0/3928230047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b40ae540 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 --2- 172.21.15.26:0/3928230047 >> v2:172.21.15.67:3300/0 conn(0x7ff0b4156480 0x7ff0b4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 -- 172.21.15.26:0/3928230047 >> 172.21.15.26:0/3928230047 conn(0x7ff0b406d170 msgr2=0x7ff0b40cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:58.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 -- 172.21.15.26:0/3928230047 shutdown_connections 2023-10-09T11:35:58.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.139+0000 7ff0ba674700 1 -- 172.21.15.26:0/3928230047 wait complete. 2023-10-09T11:35:58.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.140+0000 7ff0ba674700 1 Processor -- start 2023-10-09T11:35:58.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.140+0000 7ff0ba674700 1 -- start start 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b40c7b30 0x7ff0b40b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b4156480 0x7ff0b4169430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b416a4a0 con 0x7ff0b40ae140 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4153860 con 0x7ff0b4156480 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0ba674700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4169970 con 0x7ff0b40c7b30 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53128/0 (socket says 172.21.15.26:53128) 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 -- 172.21.15.26:0/590134822 learned_addr learned my addr 172.21.15.26:0/590134822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b37fe700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b40c7b30 0x7ff0b40b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b8c11700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b4156480 0x7ff0b4169430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 -- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b40c7b30 msgr2=0x7ff0b40b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b40c7b30 0x7ff0b40b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 -- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b4156480 msgr2=0x7ff0b4169430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b4156480 0x7ff0b4169430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 -- 172.21.15.26:0/590134822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac009ae0 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff0b3fff700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400d860 tx=0x7ff0a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.141+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40125f0 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.142+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4012750 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.142+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b4169c00 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.142+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4012b10 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.142+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b416a1c0 con 0x7ff0b40ae140 2023-10-09T11:35:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.143+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b4153630 con 0x7ff0b40ae140 2023-10-09T11:35:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.143+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0a401e460 con 0x7ff0b40ae140 2023-10-09T11:35:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.143+0000 7ff09bfff700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 0x7ff0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.143+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff0a4084ab0 con 0x7ff0b40ae140 2023-10-09T11:35:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.144+0000 7ff0b37fe700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 0x7ff0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.144+0000 7ff0b37fe700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 0x7ff0a00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8007fd0 tx=0x7ff0a8007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:58.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.148+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0b4153630 con 0x7ff0b40ae140 2023-10-09T11:35:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:58.342+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0b4153630 con 0x7ff0b40ae140 2023-10-09T11:35:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.227+0000 7ff09bfff700 1 -- 172.21.15.26:0/590134822 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0b4153630 con 0x7ff0b40ae140 2023-10-09T11:35:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 msgr2=0x7ff0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 0x7ff0a00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8007fd0 tx=0x7ff0a8007d50 comp rx=0 tx=0).stop 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 msgr2=0x7ff0b4147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400d860 tx=0x7ff0a4008040 comp rx=0 tx=0).stop 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 shutdown_connections 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b4156480 0x7ff0b4169430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b40ae140 0x7ff0b4147eb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0a0066f30 0x7ff0a00693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 --2- 172.21.15.26:0/590134822 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b40c7b30 0x7ff0b40b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 >> 172.21.15.26:0/590134822 conn(0x7ff0b406d170 msgr2=0x7ff0b40c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 shutdown_connections 2023-10-09T11:35:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.231+0000 7ff0ba674700 1 -- 172.21.15.26:0/590134822 wait complete. 2023-10-09T11:35:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:35:59.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:35:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.377+0000 7fc0c490b700 1 Processor -- start 2023-10-09T11:35:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.377+0000 7fc0c490b700 1 -- start start 2023-10-09T11:35:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0c490b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c0159800 0x7fc0c00b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0c490b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c00b1d40 0x7fc0c00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0c490b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00b0c80 con 0x7fc0c00b24f0 2023-10-09T11:35:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0c490b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00d10d0 con 0x7fc0c0159800 2023-10-09T11:35:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0c490b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00b0f60 con 0x7fc0c00b1d40 2023-10-09T11:35:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c0159800 0x7fc0c00b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c0159800 0x7fc0c00b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53142/0 (socket says 172.21.15.26:53142) 2023-10-09T11:35:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 -- 172.21.15.26:0/1950962055 learned_addr learned my addr 172.21.15.26:0/1950962055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0bf59e700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c00b1d40 0x7fc0c00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 -- 172.21.15.26:0/1950962055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c00b1d40 msgr2=0x7fc0c00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c00b1d40 0x7fc0c00b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 -- 172.21.15.26:0/1950962055 >> v1:172.21.15.67:6789/0 conn(0x7fc0c00b24f0 legacy=0x7fc0c01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.378+0000 7fc0be59c700 1 -- 172.21.15.26:0/1950962055 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00b1240 con 0x7fc0c0159800 2023-10-09T11:35:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0be59c700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c0159800 0x7fc0c00b0580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80099b0 tx=0x7fc0a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd58dbebd46330a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0bdd9b700 1 -- 172.21.15.26:0/1950962055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8009ea0 con 0x7fc0c0159800 2023-10-09T11:35:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0bdd9b700 1 -- 172.21.15.26:0/1950962055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800b860 con 0x7fc0c0159800 2023-10-09T11:35:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0bdd9b700 1 -- 172.21.15.26:0/1950962055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800bc00 con 0x7fc0c0159800 2023-10-09T11:35:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 -- 172.21.15.26:0/1950962055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c0159800 msgr2=0x7fc0c00b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c0159800 0x7fc0c00b0580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80099b0 tx=0x7fc0a8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 -- 172.21.15.26:0/1950962055 shutdown_connections 2023-10-09T11:35:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c00b1d40 0x7fc0c00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 --2- 172.21.15.26:0/1950962055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c0159800 0x7fc0c00b0580 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 -- 172.21.15.26:0/1950962055 >> 172.21.15.26:0/1950962055 conn(0x7fc0c00703a0 msgr2=0x7fc0c00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 -- 172.21.15.26:0/1950962055 shutdown_connections 2023-10-09T11:35:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.379+0000 7fc0c490b700 1 -- 172.21.15.26:0/1950962055 wait complete. 2023-10-09T11:35:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 Processor -- start 2023-10-09T11:35:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 -- start start 2023-10-09T11:35:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c00b24f0 0x7fc0c0142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 0x7fc0c0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c015b3a0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c015a790 con 0x7fc0c00b24f0 2023-10-09T11:35:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.381+0000 7fc0c490b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c015aa70 con 0x7fc0c0159800 2023-10-09T11:35:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53144/0 (socket says 172.21.15.26:53144) 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 -- 172.21.15.26:0/3966188833 learned_addr learned my addr 172.21.15.26:0/3966188833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0be59c700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c00b24f0 0x7fc0c0142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bf59e700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 0x7fc0c0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 -- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 msgr2=0x7fc0c0159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 0x7fc0c0159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 -- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c00b24f0 msgr2=0x7fc0c0142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c00b24f0 0x7fc0c0142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 -- 172.21.15.26:0/3966188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80094f0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bf59e700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 0x7fc0c0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0bed9d700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c590 tx=0x7fc0b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011590 con 0x7fc0c00b1d40 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0011710 con 0x7fc0c00b1d40 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011ad0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c015ad50 con 0x7fc0c00b1d40 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.382+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0153240 con 0x7fc0c00b1d40 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.383+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c004c3c0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.384+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0b001b3b0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.384+0000 7fc0b6ffd700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 0x7fc0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.384+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fc0b0083900 con 0x7fc0c00b1d40 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.384+0000 7fc0be59c700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 0x7fc0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.385+0000 7fc0be59c700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 0x7fc0a00693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80099b0 tx=0x7fc0a8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.389+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0b0050cd0 con 0x7fc0c00b1d40 2023-10-09T11:35:59.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:35:59.580+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0c00b5e10 con 0x7fc0c00b1d40 2023-10-09T11:36:00.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.231+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3966188833 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc0b0017070 con 0x7fc0c00b1d40 2023-10-09T11:36:00.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 msgr2=0x7fc0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 0x7fc0a00693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80099b0 tx=0x7fc0a8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:00.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 msgr2=0x7fc0c013f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c590 tx=0x7fc0b000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 shutdown_connections 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0a0066f30 0x7fc0a00693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c0159800 0x7fc0c0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c00b1d40 0x7fc0c013f9d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 --2- 172.21.15.26:0/3966188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c00b24f0 0x7fc0c0142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 >> 172.21.15.26:0/3966188833 conn(0x7fc0c00703a0 msgr2=0x7fc0c00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 shutdown_connections 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.235+0000 7fc0c490b700 1 -- 172.21.15.26:0/3966188833 wait complete. 2023-10-09T11:36:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:36:00.250 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:36:00.250 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:36:00.250 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:36:00.250 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:00.250 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:36:00.251 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:36:00.251 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:36:00.251 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:00.251 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:36:00.251 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:36:00.251 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:36:00.251 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:00.252 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:36:00.252 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:36:00.252 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:36:00.252 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:00.260 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:36:00.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:36:00.261 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:36:00.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:36:00.262 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:36:00.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:36:00.263 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:36:00.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:36:00.304 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:36:00.304 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:00.305 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:36:00.305 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:00.306 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:36:00.306 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:00.306 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:36:00.307 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:00.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:36:00.382 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:36:00.383 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:36:00.390 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:36:00.390 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:36:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.433+0000 7f236ef3f700 1 Processor -- start 2023-10-09T11:36:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.433+0000 7f236ef3f700 1 -- start start 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236ef3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236ef3f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 0x7f23680c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236ef3f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680ad330 con 0x7f236806a410 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236ef3f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680ace30 con 0x7f2368159890 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236ef3f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236815a360 con 0x7f236806a880 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236df3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236df3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54376/0 (socket says 172.21.15.26:54376) 2023-10-09T11:36:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236df3d700 1 -- 172.21.15.26:0/3995012204 learned_addr learned my addr 172.21.15.26:0/3995012204 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236e73e700 1 --2- 172.21.15.26:0/3995012204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 0x7f23680c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236cf3b700 1 -- 172.21.15.26:0/3995012204 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996705983 0 0) 0x7f23680ad330 con 0x7f236806a410 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236e73e700 1 -- 172.21.15.26:0/3995012204 >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 msgr2=0x7f23680aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236e73e700 1 --2- 172.21.15.26:0/3995012204 >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236e73e700 1 -- 172.21.15.26:0/3995012204 >> v1:172.21.15.67:6789/0 conn(0x7f236806a410 legacy=0x7f23680c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236e73e700 1 -- 172.21.15.26:0/3995012204 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236815a640 con 0x7f236806a880 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.434+0000 7f236df3d700 1 --2- 172.21.15.26:0/3995012204 >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236e73e700 1 --2- 172.21.15.26:0/3995012204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 0x7f23680c7750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e60 tx=0x7f2358009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e2f8b5f0e16b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236cf3b700 1 -- 172.21.15.26:0/3995012204 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800e070 con 0x7f236806a880 2023-10-09T11:36:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236cf3b700 1 -- 172.21.15.26:0/3995012204 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800bb60 con 0x7f236806a880 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236cf3b700 1 -- 172.21.15.26:0/3995012204 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012430 con 0x7f236806a880 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 -- 172.21.15.26:0/3995012204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 msgr2=0x7f23680c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 --2- 172.21.15.26:0/3995012204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 0x7f23680c7750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e60 tx=0x7f2358009780 comp rx=0 tx=0).stop 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 -- 172.21.15.26:0/3995012204 shutdown_connections 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 --2- 172.21.15.26:0/3995012204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a880 0x7f23680c7750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 --2- 172.21.15.26:0/3995012204 >> v2:172.21.15.26:3300/0 conn(0x7f2368159890 0x7f23680aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 -- 172.21.15.26:0/3995012204 >> 172.21.15.26:0/3995012204 conn(0x7f23680cca00 msgr2=0x7f23680cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 -- 172.21.15.26:0/3995012204 shutdown_connections 2023-10-09T11:36:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.435+0000 7f236ef3f700 1 -- 172.21.15.26:0/3995012204 wait complete. 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 Processor -- start 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 -- start start 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a410 0x7f23680ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236806a880 0x7f2368068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680aa9d0 con 0x7f2368159890 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680c18f0 con 0x7f236806a880 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236ef3f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680a9dc0 con 0x7f236806a410 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236e73e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.437+0000 7f236e73e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54390/0 (socket says 172.21.15.26:54390) 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 -- 172.21.15.26:0/1141746695 learned_addr learned my addr 172.21.15.26:0/1141746695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236df3d700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a410 0x7f23680ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236d73c700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236806a880 0x7f2368068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 -- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a410 msgr2=0x7f23680ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a410 0x7f23680ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 -- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236806a880 msgr2=0x7f2368068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236806a880 0x7f2368068050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 -- 172.21.15.26:0/1141746695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600094f0 con 0x7f2368159890 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236e73e700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f236815a4a0 tx=0x7f2358019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012ea0 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358027470 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2358009a20 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358027830 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.438+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23680aa380 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.439+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236804c3c0 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.440+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2358024070 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.440+0000 7f2365ffb700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.440+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2358086950 con 0x7f2368159890 2023-10-09T11:36:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.440+0000 7f236df3d700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.441+0000 7f236df3d700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 0x7f23540693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2360006d20 tx=0x7f2360009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.445+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2358053ec0 con 0x7f2368159890 2023-10-09T11:36:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:00.652+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f23680ca680 con 0x7f2368159890 2023-10-09T11:36:01.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.241+0000 7f2365ffb700 1 -- 172.21.15.26:0/1141746695 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23580574e0 con 0x7f2368159890 2023-10-09T11:36:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.243+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 msgr2=0x7f23540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.243+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 0x7f23540693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2360006d20 tx=0x7f2360009250 comp rx=0 tx=0).stop 2023-10-09T11:36:01.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.243+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 msgr2=0x7f2368156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f236815a4a0 tx=0x7f2358019000 comp rx=0 tx=0).stop 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 shutdown_connections 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2368159890 0x7f2368156da0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f236806a410 0x7f23680ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 --2- 172.21.15.26:0/1141746695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236806a880 0x7f2368068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 >> 172.21.15.26:0/1141746695 conn(0x7f23680cca00 msgr2=0x7f23680aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 shutdown_connections 2023-10-09T11:36:01.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.244+0000 7f236ef3f700 1 -- 172.21.15.26:0/1141746695 wait complete. 2023-10-09T11:36:01.246 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:36:01.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:36:01.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.378+0000 7f8c19e18700 1 Processor -- start 2023-10-09T11:36:01.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.378+0000 7f8c19e18700 1 -- start start 2023-10-09T11:36:01.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c19e18700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c14153c30 0x7f8c1415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c19e18700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1415afd0 con 0x7f8c1415de50 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c19e18700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1415b2b0 con 0x7f8c140cf110 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c19e18700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1415b590 con 0x7f8c14153c30 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c18e16700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c14153c30 0x7f8c1415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c13fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8c1415de50 0x7f8c140cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45734/0 (socket says 172.21.15.26:45734) 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c13fff700 1 -- 172.21.15.26:0/1907008554 learned_addr learned my addr 172.21.15.26:0/1907008554 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c18e16700 1 -- 172.21.15.26:0/1907008554 >> v1:172.21.15.67:6789/0 conn(0x7f8c140cf110 legacy=0x7f8c1415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c18e16700 1 -- 172.21.15.26:0/1907008554 >> v1:172.21.15.26:6789/0 conn(0x7f8c1415de50 legacy=0x7f8c140cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c137fe700 1 -- 172.21.15.26:0/1907008554 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908512435 0 0) 0x7f8c1415afd0 con 0x7f8c1415de50 2023-10-09T11:36:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.379+0000 7f8c18e16700 1 -- 172.21.15.26:0/1907008554 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1415b870 con 0x7f8c14153c30 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c18e16700 1 --2- 172.21.15.26:0/1907008554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c14153c30 0x7f8c1415a5e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009e60 tx=0x7f8c0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117648b29364aea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c137fe700 1 -- 172.21.15.26:0/1907008554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00e070 con 0x7f8c14153c30 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c137fe700 1 -- 172.21.15.26:0/1907008554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00bc30 con 0x7f8c14153c30 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c137fe700 1 -- 172.21.15.26:0/1907008554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c012430 con 0x7f8c14153c30 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 -- 172.21.15.26:0/1907008554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c14153c30 msgr2=0x7f8c1415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 --2- 172.21.15.26:0/1907008554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c14153c30 0x7f8c1415a5e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009e60 tx=0x7f8c0c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 -- 172.21.15.26:0/1907008554 shutdown_connections 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 --2- 172.21.15.26:0/1907008554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c14153c30 0x7f8c1415a5e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 -- 172.21.15.26:0/1907008554 >> 172.21.15.26:0/1907008554 conn(0x7f8c140703a0 msgr2=0x7f8c140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 -- 172.21.15.26:0/1907008554 shutdown_connections 2023-10-09T11:36:01.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.380+0000 7f8c19e18700 1 -- 172.21.15.26:0/1907008554 wait complete. 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.381+0000 7f8c19e18700 1 Processor -- start 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 -- start start 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c14153c30 0x7f8c140b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1415de50 0x7f8c140b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140c8350 con 0x7f8c140cf110 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140c9dc0 con 0x7f8c1415de50 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c19e18700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140c7780 con 0x7f8c14153c30 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c18e16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c18e16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54418/0 (socket says 172.21.15.26:54418) 2023-10-09T11:36:01.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.382+0000 7f8c18e16700 1 -- 172.21.15.26:0/2781807176 learned_addr learned my addr 172.21.15.26:0/2781807176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c13fff700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c14153c30 0x7f8c140b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c19617700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1415de50 0x7f8c140b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 -- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c14153c30 msgr2=0x7f8c140b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c14153c30 0x7f8c140b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 -- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1415de50 msgr2=0x7f8c140b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1415de50 0x7f8c140b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 -- 172.21.15.26:0/2781807176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009a20 con 0x7f8c140cf110 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c18e16700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0099f0 tx=0x7f8c0c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c01b420 con 0x7f8c140cf110 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c01b5c0 con 0x7f8c140cf110 2023-10-09T11:36:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c140c7a20 con 0x7f8c140cf110 2023-10-09T11:36:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c01b980 con 0x7f8c140cf110 2023-10-09T11:36:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.383+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c140c7fe0 con 0x7f8c140cf110 2023-10-09T11:36:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.384+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140c8630 con 0x7f8c140cf110 2023-10-09T11:36:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.385+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c0c01bcf0 con 0x7f8c140cf110 2023-10-09T11:36:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.385+0000 7f8c10ff9700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.385+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8c0c085d80 con 0x7f8c140cf110 2023-10-09T11:36:01.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.385+0000 7f8c13fff700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.386+0000 7f8c13fff700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 0x7f8bf40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c1416c860 tx=0x7f8c04007f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.389+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c0c0533f0 con 0x7f8c140cf110 2023-10-09T11:36:01.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.663+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8c1404c3c0 con 0x7f8c140cf110 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.663+0000 7f8c10ff9700 1 -- 172.21.15.26:0/2781807176 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8c0c056a10 con 0x7f8c140cf110 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:36:01.664 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:01.666 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.667 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:36:01.668 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.670 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.671 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.672 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:36:01.673 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:01.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:01.676 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.677 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mds", 2023-10-09T11:36:01.678 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNlfKCnFBAA6FizxfPxRB5zDGKXbhSZAw==", 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNl6KqnFBAAl2Pa7ufQ/WRJnRbmp901Qw==", 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-osd", 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNl8rSnFBAAaPEtEf7Eut77jJcYA6kOPA==", 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNlUb2nFBAABR51twYMpajnU0jIVvdfIQ==", 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T11:36:01.680 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNlrsWnFBAA51F2nw4D7iCvQUiNYtm5xA==", 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBj5SNlMM6nFBAAV3qpkKvxegImoiNRMKuNeQ==", 2023-10-09T11:36:01.681 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.682 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:36:01.683 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 msgr2=0x7f8bf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 0x7f8bf40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c1416c860 tx=0x7f8c04007f50 comp rx=0 tx=0).stop 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 msgr2=0x7f8c140c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0099f0 tx=0x7f8c0c019000 comp rx=0 tx=0).stop 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 shutdown_connections 2023-10-09T11:36:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1415de50 0x7f8c140b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c140cf110 0x7f8c140c87e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 --2- 172.21.15.26:0/2781807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c14153c30 0x7f8c140b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 >> 172.21.15.26:0/2781807176 conn(0x7f8c140703a0 msgr2=0x7f8c14152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 shutdown_connections 2023-10-09T11:36:01.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.665+0000 7f8c19e18700 1 -- 172.21.15.26:0/2781807176 wait complete. 2023-10-09T11:36:01.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T11:36:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.806+0000 7fcad73f4700 1 Processor -- start 2023-10-09T11:36:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.806+0000 7fcad73f4700 1 -- start start 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcad00cb5a0 0x7fcad00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcad00cde50 0x7fcad015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00d13f0 con 0x7fcad00cb5a0 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad015a940 con 0x7fcad00cde50 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad73f4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad015ae40 con 0x7fcad00cd9e0 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcad00cb5a0 0x7fcad00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcad00cb5a0 0x7fcad00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54422/0 (socket says 172.21.15.26:54422) 2023-10-09T11:36:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 -- 172.21.15.26:0/315612483 learned_addr learned my addr 172.21.15.26:0/315612483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad498f700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5991700 1 --2- 172.21.15.26:0/315612483 >> v2:172.21.15.67:3300/0 conn(0x7fcad00cde50 0x7fcad015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 -- 172.21.15.26:0/315612483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 msgr2=0x7fcad0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 -- 172.21.15.26:0/315612483 >> v2:172.21.15.67:3300/0 conn(0x7fcad00cde50 msgr2=0x7fcad015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 --2- 172.21.15.26:0/315612483 >> v2:172.21.15.67:3300/0 conn(0x7fcad00cde50 0x7fcad015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 -- 172.21.15.26:0/315612483 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad015ab60 con 0x7fcad00cb5a0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcad5190700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad00cb5a0 0x7fcad00cb970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cbeb0 tx=0x7fcacc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84937651c82e3b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.807+0000 7fcac7fff700 1 -- 172.21.15.26:0/315612483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00b820 con 0x7fcad00cb5a0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcac7fff700 1 -- 172.21.15.26:0/315612483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00b980 con 0x7fcad00cb5a0 2023-10-09T11:36:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcac7fff700 1 -- 172.21.15.26:0/315612483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00bd20 con 0x7fcad00cb5a0 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 -- 172.21.15.26:0/315612483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad00cb5a0 msgr2=0x7fcad00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad00cb5a0 0x7fcad00cb970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cbeb0 tx=0x7fcacc009250 comp rx=0 tx=0).stop 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 -- 172.21.15.26:0/315612483 shutdown_connections 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 --2- 172.21.15.26:0/315612483 >> v2:172.21.15.67:3300/0 conn(0x7fcad00cde50 0x7fcad015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad00cb5a0 0x7fcad00cb970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 --2- 172.21.15.26:0/315612483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 -- 172.21.15.26:0/315612483 >> 172.21.15.26:0/315612483 conn(0x7fcad0070e30 msgr2=0x7fcad00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 -- 172.21.15.26:0/315612483 shutdown_connections 2023-10-09T11:36:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.808+0000 7fcad73f4700 1 -- 172.21.15.26:0/315612483 wait complete. 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.809+0000 7fcad73f4700 1 Processor -- start 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.809+0000 7fcad73f4700 1 -- start start 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcad00cb5a0 0x7fcad015f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad00c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c7db0 con 0x7fcad015fbe0 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad015ec80 con 0x7fcad00cb5a0 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad73f4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad015e6a0 con 0x7fcad00cd9e0 2023-10-09T11:36:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54436/0 (socket says 172.21.15.26:54436) 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 -- 172.21.15.26:0/2850816620 learned_addr learned my addr 172.21.15.26:0/2850816620 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5190700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcad00cb5a0 0x7fcad015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad498f700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad00c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 -- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 msgr2=0x7fcad00c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad00c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 -- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcad00cb5a0 msgr2=0x7fcad015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.810+0000 7fcad5991700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcad00cb5a0 0x7fcad015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcad5991700 1 -- 172.21.15.26:0/2850816620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0094f0 con 0x7fcad015fbe0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcad5991700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcac800cde0 tx=0x7fcac80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800ab50 con 0x7fcad015fbe0 2023-10-09T11:36:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800acb0 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0160380 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8017660 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.811+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0160080 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.812+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad004c3c0 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.812+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcac8003020 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.813+0000 7fcac57fa700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 0x7fcab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.813+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcac8013070 con 0x7fcad015fbe0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.813+0000 7fcad5190700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 0x7fcab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.813+0000 7fcad5190700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 0x7fcab40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cbeb0 tx=0x7fcacc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:01.817+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcac8051a20 con 0x7fcad015fbe0 2023-10-09T11:36:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.087+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fcad00ccf00 con 0x7fcad015fbe0 2023-10-09T11:36:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.090+0000 7fcac57fa700 1 -- 172.21.15.26:0/2850816620 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcac8055040 con 0x7fcad015fbe0 2023-10-09T11:36:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 msgr2=0x7fcab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 0x7fcab40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcad00cbeb0 tx=0x7fcacc017000 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 msgr2=0x7fcad014f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcac800cde0 tx=0x7fcac80077d0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 shutdown_connections 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcad015fbe0 0x7fcad014f890 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcad00cb5a0 0x7fcad015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcab4066f30 0x7fcab40693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 --2- 172.21.15.26:0/2850816620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcad00cd9e0 0x7fcad00c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 >> 172.21.15.26:0/2850816620 conn(0x7fcad0070e30 msgr2=0x7fcad00b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 shutdown_connections 2023-10-09T11:36:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.093+0000 7fcad73f4700 1 -- 172.21.15.26:0/2850816620 wait complete. 2023-10-09T11:36:02.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T11:36:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.226+0000 7f8521609700 1 Processor -- start 2023-10-09T11:36:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 -- start start 2023-10-09T11:36:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f851c0cd9e0 0x7f851c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f851c0cde50 0x7f851c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0d13f0 con 0x7f851c0cde50 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c15a940 con 0x7f851c0cd9e0 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f8521609700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c15ae40 con 0x7f851c0cb5a0 2023-10-09T11:36:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.227+0000 7f851b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f851c0cde50 0x7f851c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f851c0cde50 0x7f851c15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54438/0 (socket says 172.21.15.26:54438) 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 -- 172.21.15.26:0/2108306943 learned_addr learned my addr 172.21.15.26:0/2108306943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851a7fc700 1 --2- 172.21.15.26:0/2108306943 >> v2:172.21.15.67:3300/0 conn(0x7f851c0cd9e0 0x7f851c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851affd700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 -- 172.21.15.26:0/2108306943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 msgr2=0x7f851c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 -- 172.21.15.26:0/2108306943 >> v2:172.21.15.67:3300/0 conn(0x7f851c0cd9e0 msgr2=0x7f851c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 --2- 172.21.15.26:0/2108306943 >> v2:172.21.15.67:3300/0 conn(0x7f851c0cd9e0 0x7f851c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 -- 172.21.15.26:0/2108306943 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c15ab60 con 0x7f851c0cde50 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f851b7fe700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c0cde50 0x7f851c15a400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f851c06ea90 tx=0x7f850c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298763744907c96d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f8519ffb700 1 -- 172.21.15.26:0/2108306943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e070 con 0x7f851c0cde50 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f8519ffb700 1 -- 172.21.15.26:0/2108306943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00ba40 con 0x7f851c0cde50 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.228+0000 7f8519ffb700 1 -- 172.21.15.26:0/2108306943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0092e0 con 0x7f851c0cde50 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 -- 172.21.15.26:0/2108306943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c0cde50 msgr2=0x7f851c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c0cde50 0x7f851c15a400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f851c06ea90 tx=0x7f850c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 -- 172.21.15.26:0/2108306943 shutdown_connections 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c0cde50 0x7f851c15a400 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 --2- 172.21.15.26:0/2108306943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 --2- 172.21.15.26:0/2108306943 >> v2:172.21.15.67:3300/0 conn(0x7f851c0cd9e0 0x7f851c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 -- 172.21.15.26:0/2108306943 >> 172.21.15.26:0/2108306943 conn(0x7f851c070e30 msgr2=0x7f851c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 -- 172.21.15.26:0/2108306943 shutdown_connections 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.229+0000 7f8521609700 1 -- 172.21.15.26:0/2108306943 wait complete. 2023-10-09T11:36:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.230+0000 7f8521609700 1 Processor -- start 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.230+0000 7f8521609700 1 -- start start 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 0x7f851c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1582a0 con 0x7f851c159ff0 2023-10-09T11:36:02.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c158580 con 0x7f851c0cd9e0 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8521609700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c158860 con 0x7f851c0cb5a0 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54448/0 (socket says 172.21.15.26:54448) 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 -- 172.21.15.26:0/1470434862 learned_addr learned my addr 172.21.15.26:0/1470434862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851affd700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851a7fc700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 0x7f851c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 -- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 msgr2=0x7f851c1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 -- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 msgr2=0x7f851c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 0x7f851c159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 -- 172.21.15.26:0/1470434862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009ae0 con 0x7f851c159ff0 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851a7fc700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 0x7f851c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f851b7fe700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f851c06ea60 tx=0x7f850c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c008e40 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.231+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c01c410 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.232+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c158b40 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.232+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c01c7b0 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.232+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c156630 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.233+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c156820 con 0x7f851c159ff0 2023-10-09T11:36:02.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.233+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f850c003040 con 0x7f851c159ff0 2023-10-09T11:36:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.233+0000 7f8512ffd700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.233+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f850c085bc0 con 0x7f851c159ff0 2023-10-09T11:36:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.233+0000 7f851affd700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.234+0000 7f851affd700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 0x7f84fc0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f85140089b0 tx=0x7f8514008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.237+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f851c156820 con 0x7f851c159ff0 2023-10-09T11:36:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.514+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f851c156820 con 0x7f851c159ff0 2023-10-09T11:36:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.518+0000 7f8512ffd700 1 -- 172.21.15.26:0/1470434862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f851c156820 con 0x7f851c159ff0 2023-10-09T11:36:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 msgr2=0x7f84fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 0x7f84fc0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f85140089b0 tx=0x7f8514008040 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 msgr2=0x7f851c0b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f851c06ea60 tx=0x7f850c018000 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 shutdown_connections 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f851c159ff0 0x7f851c0b2010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f851c0cb5a0 0x7f851c1560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 --2- 172.21.15.26:0/1470434862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f851c0cd9e0 0x7f851c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 >> 172.21.15.26:0/1470434862 conn(0x7f851c070e30 msgr2=0x7f851c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 shutdown_connections 2023-10-09T11:36:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.520+0000 7f8521609700 1 -- 172.21.15.26:0/1470434862 wait complete. 2023-10-09T11:36:02.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T11:36:02.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.651+0000 7f54f9ee5700 1 Processor -- start 2023-10-09T11:36:02.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.651+0000 7f54f9ee5700 1 -- start start 2023-10-09T11:36:02.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f9ee5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cb5a0 0x7f54f40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f9ee5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54f40cd9e0 0x7f54f4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f9ee5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f415ae40 con 0x7f54f40cde50 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f9ee5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40d13f0 con 0x7f54f40cd9e0 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f9ee5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415ab60 con 0x7f54f40cb5a0 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54f40cd9e0 0x7f54f4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54f40cd9e0 0x7f54f4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54464/0 (socket says 172.21.15.26:54464) 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 -- 172.21.15.26:0/4083516304 learned_addr learned my addr 172.21.15.26:0/4083516304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f37fe700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cb5a0 0x7f54f40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 -- 172.21.15.26:0/4083516304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cb5a0 msgr2=0x7f54f40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cb5a0 0x7f54f40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 -- 172.21.15.26:0/4083516304 >> v1:172.21.15.67:6789/0 conn(0x7f54f40cde50 legacy=0x7f54f4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.652+0000 7f54f2ffd700 1 -- 172.21.15.26:0/4083516304 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40ccf00 con 0x7f54f40cd9e0 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f2ffd700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40cd9e0 0x7f54f4159ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f54e80099b0 tx=0x7f54e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a15761785a492e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f27fc700 1 -- 172.21.15.26:0/4083516304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800b820 con 0x7f54f40cd9e0 2023-10-09T11:36:02.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f27fc700 1 -- 172.21.15.26:0/4083516304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e800b980 con 0x7f54f40cd9e0 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f27fc700 1 -- 172.21.15.26:0/4083516304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800bd20 con 0x7f54f40cd9e0 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 -- 172.21.15.26:0/4083516304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40cd9e0 msgr2=0x7f54f4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40cd9e0 0x7f54f4159ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f54e80099b0 tx=0x7f54e8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 -- 172.21.15.26:0/4083516304 shutdown_connections 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cb5a0 0x7f54f40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/4083516304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40cd9e0 0x7f54f4159ec0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 -- 172.21.15.26:0/4083516304 >> 172.21.15.26:0/4083516304 conn(0x7f54f4070e30 msgr2=0x7f54f40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 -- 172.21.15.26:0/4083516304 shutdown_connections 2023-10-09T11:36:02.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.653+0000 7f54f9ee5700 1 -- 172.21.15.26:0/4083516304 wait complete. 2023-10-09T11:36:02.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.654+0000 7f54f9ee5700 1 Processor -- start 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 -- start start 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54f40cb5a0 0x7f54f4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cd9e0 0x7f54f416a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40b1c70 con 0x7f54f40b12b0 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4151c70 con 0x7f54f40cb5a0 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f9ee5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c7860 con 0x7f54f40cd9e0 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54472/0 (socket says 172.21.15.26:54472) 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f3fff700 1 -- 172.21.15.26:0/2804131080 learned_addr learned my addr 172.21.15.26:0/2804131080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f37fe700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54f40cb5a0 0x7f54f4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.655+0000 7f54f2ffd700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cd9e0 0x7f54f416a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 -- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cd9e0 msgr2=0x7f54f416a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cd9e0 0x7f54f416a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 -- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54f40cb5a0 msgr2=0x7f54f4151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54f40cb5a0 0x7f54f4151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 -- 172.21.15.26:0/2804131080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80094f0 con 0x7f54f40b12b0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f3fff700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00bc60 tx=0x7f54ec009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00c840 con 0x7f54f40b12b0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00c9a0 con 0x7f54f40b12b0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00cd60 con 0x7f54f40b12b0 2023-10-09T11:36:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f40c7b40 con 0x7f54f40b12b0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.656+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f40c8100 con 0x7f54f40b12b0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.657+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f404c3c0 con 0x7f54f40b12b0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.658+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54ec014620 con 0x7f54f40b12b0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.658+0000 7f54db7fe700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 0x7f54e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.658+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f54ec084130 con 0x7f54f40b12b0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.658+0000 7f54f37fe700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 0x7f54e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.659+0000 7f54f37fe700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 0x7f54e00693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006fd0 tx=0x7f54e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.662+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54ec0516f0 con 0x7f54f40b12b0 2023-10-09T11:36:02.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.934+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f54f40cd1e0 con 0x7f54f40b12b0 2023-10-09T11:36:02.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.937+0000 7f54db7fe700 1 -- 172.21.15.26:0/2804131080 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f54ec054d10 con 0x7f54f40b12b0 2023-10-09T11:36:02.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 msgr2=0x7f54e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 0x7f54e00693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006fd0 tx=0x7f54e4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:02.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 msgr2=0x7f54f40b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00bc60 tx=0x7f54ec009820 comp rx=0 tx=0).stop 2023-10-09T11:36:02.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 shutdown_connections 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54f40b12b0 0x7f54f40b1730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54f40cb5a0 0x7f54f4151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f54e0066f30 0x7f54e00693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 --2- 172.21.15.26:0/2804131080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54f40cd9e0 0x7f54f416a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.939+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 >> 172.21.15.26:0/2804131080 conn(0x7f54f4070e30 msgr2=0x7f54f40b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.940+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 shutdown_connections 2023-10-09T11:36:02.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:02.940+0000 7f54f9ee5700 1 -- 172.21.15.26:0/2804131080 wait complete. 2023-10-09T11:36:02.952 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T11:36:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.071+0000 7f6cb88a1700 1 Processor -- start 2023-10-09T11:36:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.071+0000 7f6cb88a1700 1 -- start start 2023-10-09T11:36:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb88a1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb40cb5a0 0x7f6cb40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb88a1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cb40cde50 0x7f6cb4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb88a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb415ae40 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb88a1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40d13f0 con 0x7f6cb40cde50 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb88a1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb415ab60 con 0x7f6cb40cb5a0 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cb40cde50 0x7f6cb4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6cb40cd9e0 0x7f6cb4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45744/0 (socket says 172.21.15.26:45744) 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cb40cde50 0x7f6cb4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54488/0 (socket says 172.21.15.26:54488) 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb1d9b700 1 -- 172.21.15.26:0/676653954 learned_addr learned my addr 172.21.15.26:0/676653954 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb259c700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb40cb5a0 0x7f6cb40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 -- 172.21.15.26:0/676653954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb40cb5a0 msgr2=0x7f6cb40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb40cb5a0 0x7f6cb40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 -- 172.21.15.26:0/676653954 >> v1:172.21.15.26:6789/0 conn(0x7f6cb40cd9e0 legacy=0x7f6cb4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 -- 172.21.15.26:0/676653954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40ccf00 con 0x7f6cb40cde50 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb2d9d700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cde50 0x7f6cb4156e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0098e0 tx=0x7f6cac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941cda339401d0db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb159a700 1 -- 172.21.15.26:0/676653954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac009e80 con 0x7f6cb40cde50 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb159a700 1 -- 172.21.15.26:0/676653954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac00b860 con 0x7f6cb40cde50 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.072+0000 7f6cb159a700 1 -- 172.21.15.26:0/676653954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00bbe0 con 0x7f6cb40cde50 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 -- 172.21.15.26:0/676653954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cde50 msgr2=0x7f6cb4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cde50 0x7f6cb4156e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0098e0 tx=0x7f6cac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 -- 172.21.15.26:0/676653954 shutdown_connections 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cde50 0x7f6cb4156e90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/676653954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb40cb5a0 0x7f6cb40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 -- 172.21.15.26:0/676653954 >> 172.21.15.26:0/676653954 conn(0x7f6cb4070e30 msgr2=0x7f6cb40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 -- 172.21.15.26:0/676653954 shutdown_connections 2023-10-09T11:36:03.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.073+0000 7f6cb88a1700 1 -- 172.21.15.26:0/676653954 wait complete. 2023-10-09T11:36:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.074+0000 7f6cb88a1700 1 Processor -- start 2023-10-09T11:36:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.074+0000 7f6cb88a1700 1 -- start start 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cb40cb5a0 0x7f6cb4169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 0x7f6cb4158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40b4a40 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb416a3a0 con 0x7f6cb40cb5a0 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb88a1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40c6740 con 0x7f6cb416ca40 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54498/0 (socket says 172.21.15.26:54498) 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 -- 172.21.15.26:0/2991619229 learned_addr learned my addr 172.21.15.26:0/2991619229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb2d9d700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 0x7f6cb4158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb259c700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cb40cb5a0 0x7f6cb4169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 -- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 msgr2=0x7f6cb4158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 0x7f6cb4158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 -- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cb40cb5a0 msgr2=0x7f6cb4169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cb40cb5a0 0x7f6cb4169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 -- 172.21.15.26:0/2991619229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac009420 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb2d9d700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 0x7f6cb4158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.075+0000 7f6cb1d9b700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c7f0 tx=0x7f6c9c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c005b30 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c005cb0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb416cf20 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c004a80 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb416d4e0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.076+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb404c3c0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.077+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c9c0070d0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.077+0000 7f6caa7fc700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 0x7f6c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.077+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6c9c083540 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.078+0000 7f6cb259c700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 0x7f6c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.078+0000 7f6cb259c700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 0x7f6c940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009fd0 tx=0x7f6ca4009880 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.082+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c9c04b5a0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.353+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6cb40cd1e0 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.356+0000 7f6caa7fc700 1 -- 172.21.15.26:0/2991619229 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c9c050b00 con 0x7f6cb40cd9e0 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 msgr2=0x7f6c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 0x7f6c940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009fd0 tx=0x7f6ca4009880 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 msgr2=0x7f6cb4156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c7f0 tx=0x7f6c9c007f70 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 shutdown_connections 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c94066f30 0x7f6c940693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cb416ca40 0x7f6cb4158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cb40cb5a0 0x7f6cb4169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 --2- 172.21.15.26:0/2991619229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cb40cd9e0 0x7f6cb4156c60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 >> 172.21.15.26:0/2991619229 conn(0x7f6cb4070e30 msgr2=0x7f6cb40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 shutdown_connections 2023-10-09T11:36:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.358+0000 7f6cb88a1700 1 -- 172.21.15.26:0/2991619229 wait complete. 2023-10-09T11:36:03.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T11:36:03.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.491+0000 7fdd95d09700 1 Processor -- start 2023-10-09T11:36:03.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.491+0000 7fdd95d09700 1 -- start start 2023-10-09T11:36:03.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd95d09700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd90159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd95d09700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9015ae40 con 0x7fdd9015a400 2023-10-09T11:36:03.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd95d09700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9015ab60 con 0x7fdd900cb5a0 2023-10-09T11:36:03.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd95d09700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd900ce0f0 con 0x7fdd900cb970 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdd9015a400 0x7fdd90156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45746/0 (socket says 172.21.15.26:45746) 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8ffff700 1 -- 172.21.15.26:0/525714454 learned_addr learned my addr 172.21.15.26:0/525714454 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8effd700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd90159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309480567 0 0) 0x7fdd9015ae40 con 0x7fdd9015a400 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd78003570 con 0x7fdd9015a400 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227420361 0 0) 0x7fdd78003570 con 0x7fdd9015a400 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 msgr2=0x7fdd90159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd90159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 >> v1:172.21.15.67:6789/0 conn(0x7fdd900cb5a0 legacy=0x7fdd900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd900ccf00 con 0x7fdd9015a400 2023-10-09T11:36:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fdd880017f0 con 0x7fdd9015a400 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 >> v1:172.21.15.26:6789/0 conn(0x7fdd9015a400 legacy=0x7fdd90156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.492+0000 7fdd8e7fc700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd78003a90 0x7fdd78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd78004810 0x7fdd78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd780051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd900ce0f0 con 0x7fdd78003a90 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7800bb90 con 0x7fdd78004810 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7800bd50 con 0x7fdd900cb970 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd78003a90 0x7fdd78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8ffff700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd780051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8effd700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd78004810 0x7fdd78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 -- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 msgr2=0x7fdd780051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd900cb970 0x7fdd780051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 -- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd78004810 msgr2=0x7fdd78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd78004810 0x7fdd78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 -- 172.21.15.26:0/525714454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78003570 con 0x7fdd78003a90 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd78003a90 0x7fdd78003ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd800018b0 tx=0x7fdd80007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02d557c9fdd33fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80012420 con 0x7fdd78003a90 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd80012580 con 0x7fdd78003a90 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.493+0000 7fdd8e7fc700 1 -- 172.21.15.26:0/525714454 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80012920 con 0x7fdd78003a90 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 -- 172.21.15.26:0/525714454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd78003a90 msgr2=0x7fdd78003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 --2- 172.21.15.26:0/525714454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd78003a90 0x7fdd78003ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd800018b0 tx=0x7fdd80007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd8ffff700 1 -- 172.21.15.26:0/525714454 reap_dead start 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 -- 172.21.15.26:0/525714454 shutdown_connections 2023-10-09T11:36:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 -- 172.21.15.26:0/525714454 >> 172.21.15.26:0/525714454 conn(0x7fdd90070e30 msgr2=0x7fdd900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 -- 172.21.15.26:0/525714454 shutdown_connections 2023-10-09T11:36:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.494+0000 7fdd95d09700 1 -- 172.21.15.26:0/525714454 wait complete. 2023-10-09T11:36:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.495+0000 7fdd95d09700 1 Processor -- start 2023-10-09T11:36:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.495+0000 7fdd95d09700 1 -- start start 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd78003a90 0x7fdd901522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd90157d20 0x7fdd90158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd900cbde0 con 0x7fdd901586d0 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd90154b70 con 0x7fdd90157d20 2023-10-09T11:36:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd95d09700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd90155130 con 0x7fdd78003a90 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54506/0 (socket says 172.21.15.26:54506) 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 -- 172.21.15.26:0/135669745 learned_addr learned my addr 172.21.15.26:0/135669745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8effd700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd90157d20 0x7fdd90158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd78003a90 0x7fdd901522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 -- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd78003a90 msgr2=0x7fdd901522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd78003a90 0x7fdd901522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 -- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd90157d20 msgr2=0x7fdd90158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd90157d20 0x7fdd90158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 -- 172.21.15.26:0/135669745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90152820 con 0x7fdd901586d0 2023-10-09T11:36:03.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd8ffff700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdd900ccdf0 tx=0x7fdd880021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.496+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88001f10 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.497+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8800ad40 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.497+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd90158b40 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.497+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88013620 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.497+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd901590b0 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.498+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd901552a0 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.498+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd88013a10 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.498+0000 7fdd777fe700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.498+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdd88084d10 con 0x7fdd901586d0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.499+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.499+0000 7fdd8f7fe700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 0x7fdd7c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd800018b0 tx=0x7fdd80015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.503+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd88052230 con 0x7fdd901586d0 2023-10-09T11:36:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.777+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdd9004c3c0 con 0x7fdd901586d0 2023-10-09T11:36:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.781+0000 7fdd777fe700 1 -- 172.21.15.26:0/135669745 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd88055850 con 0x7fdd901586d0 2023-10-09T11:36:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 msgr2=0x7fdd7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 0x7fdd7c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd800018b0 tx=0x7fdd80015000 comp rx=0 tx=0).stop 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 msgr2=0x7fdd901555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdd900ccdf0 tx=0x7fdd880021d0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 shutdown_connections 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd901586d0 0x7fdd901555c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd78003a90 0x7fdd901522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 --2- 172.21.15.26:0/135669745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd90157d20 0x7fdd90158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 >> 172.21.15.26:0/135669745 conn(0x7fdd90070e30 msgr2=0x7fdd900d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 shutdown_connections 2023-10-09T11:36:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.783+0000 7fdd95d09700 1 -- 172.21.15.26:0/135669745 wait complete. 2023-10-09T11:36:03.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T11:36:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.915+0000 7fa2b93d2700 1 Processor -- start 2023-10-09T11:36:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 -- start start 2023-10-09T11:36:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2b4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2b415a400 0x7fa2b4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b415ae40 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b40ce0f0 con 0x7fa2b415a400 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b93d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40cbde0 con 0x7fa2b40cb970 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.916+0000 7fa2b2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa2b40cb5a0 0x7fa2b40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45762/0 (socket says 172.21.15.26:45762) 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b2ffd700 1 -- 172.21.15.26:0/4266901873 learned_addr learned my addr 172.21.15.26:0/4266901873 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b37fe700 1 --2- 172.21.15.26:0/4266901873 >> v2:172.21.15.67:3300/0 conn(0x7fa2b415a400 0x7fa2b4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2b4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134476804 0 0) 0x7fa2b415ae40 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a0003570 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062669342 0 0) 0x7fa2a0003570 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 msgr2=0x7fa2b4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2b4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 >> v2:172.21.15.67:3300/0 conn(0x7fa2b415a400 msgr2=0x7fa2b4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 --2- 172.21.15.26:0/4266901873 >> v2:172.21.15.67:3300/0 conn(0x7fa2b415a400 0x7fa2b4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b415ab60 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fa2ac001470 con 0x7fa2b40cb5a0 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 >> v1:172.21.15.26:6789/0 conn(0x7fa2b40cb5a0 legacy=0x7fa2b40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2a0003b10 0x7fa2a0003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2a0004810 0x7fa2a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40ce0f0 con 0x7fa2a0004810 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40cbde0 con 0x7fa2a0003b10 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a000bb90 con 0x7fa2b40cb970 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2a0004810 0x7fa2a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b2ffd700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2a0003b10 0x7fa2a0003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.917+0000 7fa2b37fe700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 -- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 msgr2=0x7fa2a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2b40cb970 0x7fa2a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 -- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2a0003b10 msgr2=0x7fa2a0003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2a0003b10 0x7fa2a0003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 -- 172.21.15.26:0/4266901873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0003570 con 0x7fa2a0004810 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2a0004810 0x7fa2a0004c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009c00 tx=0x7fa29c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cc6fc03e4b9f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00e710 con 0x7fa2a0004810 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00e870 con 0x7fa2a0004810 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b1ffb700 1 -- 172.21.15.26:0/4266901873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00ec30 con 0x7fa2a0004810 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b93d2700 1 -- 172.21.15.26:0/4266901873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2a0004810 msgr2=0x7fa2a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/4266901873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2a0004810 0x7fa2a0004c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009c00 tx=0x7fa29c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b37fe700 1 -- 172.21.15.26:0/4266901873 reap_dead start 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b93d2700 1 -- 172.21.15.26:0/4266901873 shutdown_connections 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b93d2700 1 -- 172.21.15.26:0/4266901873 >> 172.21.15.26:0/4266901873 conn(0x7fa2b4070e30 msgr2=0x7fa2b40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.918+0000 7fa2b93d2700 1 -- 172.21.15.26:0/4266901873 shutdown_connections 2023-10-09T11:36:03.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.919+0000 7fa2b93d2700 1 -- 172.21.15.26:0/4266901873 wait complete. 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 Processor -- start 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 -- start start 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2a0004810 0x7fa2b416da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4155500 0x7fa2b4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4155eb0 con 0x7fa2b414d7d0 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b416d590 con 0x7fa2b4155500 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.920+0000 7fa2b93d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c77c0 con 0x7fa2a0004810 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54538/0 (socket says 172.21.15.26:54538) 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 -- 172.21.15.26:0/501477155 learned_addr learned my addr 172.21.15.26:0/501477155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b37fe700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4155500 0x7fa2b4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b2ffd700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2a0004810 0x7fa2b416da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 -- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2a0004810 msgr2=0x7fa2b416da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2a0004810 0x7fa2b416da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 -- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4155500 msgr2=0x7fa2b4155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4155500 0x7fa2b4155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 -- 172.21.15.26:0/501477155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40c7aa0 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00e4b0 tx=0x7fa29c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c023070 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00e9e0 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b40c7d80 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00e710 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.921+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b416d220 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.922+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b404c3c0 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.923+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa29c013680 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.923+0000 7fa2aaffd700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 0x7fa2940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.923+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa29c0856d0 con 0x7fa2b414d7d0 2023-10-09T11:36:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.923+0000 7fa2b2ffd700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 0x7fa2940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.924+0000 7fa2b2ffd700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 0x7fa2940693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001660 tx=0x7fa2ac001d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:03.927+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa29c052c90 con 0x7fa2b414d7d0 2023-10-09T11:36:04.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.200+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa2b4155eb0 con 0x7fa2b414d7d0 2023-10-09T11:36:04.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.204+0000 7fa2aaffd700 1 -- 172.21.15.26:0/501477155 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa29c0170a0 con 0x7fa2b414d7d0 2023-10-09T11:36:04.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 msgr2=0x7fa2940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 0x7fa2940693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001660 tx=0x7fa2ac001d80 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 msgr2=0x7fa2b40c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00e4b0 tx=0x7fa29c01a000 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 shutdown_connections 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4155500 0x7fa2b4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa294066f30 0x7fa2940693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2a0004810 0x7fa2b416da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 --2- 172.21.15.26:0/501477155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b414d7d0 0x7fa2b40c9f40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 >> 172.21.15.26:0/501477155 conn(0x7fa2b4070e30 msgr2=0x7fa2b4154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 shutdown_connections 2023-10-09T11:36:04.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.206+0000 7fa2b93d2700 1 -- 172.21.15.26:0/501477155 wait complete. 2023-10-09T11:36:04.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.337+0000 7f4b86ff2700 1 Processor -- start 2023-10-09T11:36:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.337+0000 7f4b86ff2700 1 -- start start 2023-10-09T11:36:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b86ff2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 0x7f4b80159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b86ff2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8015ae40 con 0x7f4b8015a400 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b86ff2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8015ab60 con 0x7f4b800cb5a0 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b86ff2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800ce0f0 con 0x7f4b800cb970 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b8558f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b8015a400 0x7f4b80156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45778/0 (socket says 172.21.15.26:45778) 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.338+0000 7f4b8558f700 1 -- 172.21.15.26:0/1586566581 learned_addr learned my addr 172.21.15.26:0/1586566581 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7ffff700 1 --2- 172.21.15.26:0/1586566581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 0x7f4b80159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080496107 0 0) 0x7f4b8015ae40 con 0x7f4b8015a400 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b68003570 con 0x7f4b8015a400 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285698101 0 0) 0x7f4b8015ab60 con 0x7f4b800cb5a0 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8015ae40 con 0x7f4b800cb5a0 2023-10-09T11:36:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7ffff700 1 -- 172.21.15.26:0/1586566581 >> v1:172.21.15.67:6789/0 conn(0x7f4b800cb5a0 legacy=0x7f4b800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7ffff700 1 -- 172.21.15.26:0/1586566581 >> v1:172.21.15.26:6789/0 conn(0x7f4b8015a400 legacy=0x7f4b80156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7ffff700 1 -- 172.21.15.26:0/1586566581 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800ccf00 con 0x7f4b800cb970 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7ffff700 1 --2- 172.21.15.26:0/1586566581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 0x7f4b80159ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009910 tx=0x7f4b740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f14e1e26baed00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74011630 con 0x7f4b800cb970 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74011790 con 0x7f4b800cb970 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.339+0000 7f4b7f7fe700 1 -- 172.21.15.26:0/1586566581 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74011b30 con 0x7f4b800cb970 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 -- 172.21.15.26:0/1586566581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 msgr2=0x7f4b80159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/1586566581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 0x7f4b80159ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009910 tx=0x7f4b740091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 -- 172.21.15.26:0/1586566581 shutdown_connections 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/1586566581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b800cb970 0x7f4b80159ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 -- 172.21.15.26:0/1586566581 >> 172.21.15.26:0/1586566581 conn(0x7f4b80070e30 msgr2=0x7f4b800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 -- 172.21.15.26:0/1586566581 shutdown_connections 2023-10-09T11:36:04.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.340+0000 7f4b86ff2700 1 -- 172.21.15.26:0/1586566581 wait complete. 2023-10-09T11:36:04.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.341+0000 7f4b86ff2700 1 Processor -- start 2023-10-09T11:36:04.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.341+0000 7f4b86ff2700 1 -- start start 2023-10-09T11:36:04.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b800cb5a0 0x7f4b8016b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 0x7f4b800b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800cbde0 con 0x7f4b800cb970 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8015cf60 con 0x7f4b800cb5a0 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b86ff2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8016b750 con 0x7f4b8015a400 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54546/0 (socket says 172.21.15.26:54546) 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 -- 172.21.15.26:0/3983216678 learned_addr learned my addr 172.21.15.26:0/3983216678 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b8558f700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 0x7f4b800b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b84d8e700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b800cb5a0 0x7f4b8016b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 -- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 msgr2=0x7f4b800b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 0x7f4b800b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 -- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b800cb5a0 msgr2=0x7f4b8016b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b800cb5a0 0x7f4b8016b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b7ffff700 1 -- 172.21.15.26:0/3983216678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009420 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.342+0000 7f4b8558f700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 0x7f4b800b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b7ffff700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009f00 tx=0x7f4b74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7401f070 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74000bc0 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800b4c90 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74025420 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.343+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8015c6e0 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.344+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8015d0f0 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.344+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b74023070 con 0x7f4b800cb970 2023-10-09T11:36:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.344+0000 7f4b7cff9700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 0x7f4b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.345+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b740856b0 con 0x7f4b800cb970 2023-10-09T11:36:04.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.345+0000 7f4b84d8e700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 0x7f4b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.345+0000 7f4b84d8e700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 0x7f4b6c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b800b3950 tx=0x7f4b78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.349+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b74052c70 con 0x7f4b800cb970 2023-10-09T11:36:04.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.545+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b8004c3c0 con 0x7f4b800cb970 2023-10-09T11:36:04.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.545+0000 7f4b7cff9700 1 -- 172.21.15.26:0/3983216678 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f4b74015020 con 0x7f4b800cb970 2023-10-09T11:36:04.546 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:04.546 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":28,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:01.246494+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 msgr2=0x7f4b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 0x7f4b6c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b800b3950 tx=0x7f4b78009040 comp rx=0 tx=0).stop 2023-10-09T11:36:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 msgr2=0x7f4b80153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009f00 tx=0x7f4b74017000 comp rx=0 tx=0).stop 2023-10-09T11:36:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 shutdown_connections 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c066f30 0x7f4b6c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8015a400 0x7f4b800b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b800cb5a0 0x7f4b8016b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 --2- 172.21.15.26:0/3983216678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b800cb970 0x7f4b80153b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 >> 172.21.15.26:0/3983216678 conn(0x7f4b80070e30 msgr2=0x7f4b800cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 shutdown_connections 2023-10-09T11:36:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.547+0000 7f4b86ff2700 1 -- 172.21.15.26:0/3983216678 wait complete. 2023-10-09T11:36:04.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:36:04.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.682+0000 7f636427f700 1 Processor -- start 2023-10-09T11:36:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.682+0000 7f636427f700 1 -- start start 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636427f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636427f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c0ccfd0 con 0x7f635c06dc70 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636427f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c0cf0e0 con 0x7f635c06e0e0 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636427f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c15a3d0 con 0x7f635c159530 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636181a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f635c06dc70 0x7f635c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45790/0 (socket says 172.21.15.26:45790) 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636181a700 1 -- 172.21.15.26:0/2473787197 learned_addr learned my addr 172.21.15.26:0/2473787197 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f636201b700 1 --2- 172.21.15.26:0/2473787197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903301002 0 0) 0x7f635c0ccfd0 con 0x7f635c06dc70 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6344003570 con 0x7f635c06dc70 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.683+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739676397 0 0) 0x7f635c0cf0e0 con 0x7f635c06e0e0 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c0ccfd0 con 0x7f635c06e0e0 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636201b700 1 -- 172.21.15.26:0/2473787197 >> v1:172.21.15.67:6789/0 conn(0x7f635c06e0e0 legacy=0x7f635c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636201b700 1 -- 172.21.15.26:0/2473787197 >> v1:172.21.15.26:6789/0 conn(0x7f635c06dc70 legacy=0x7f635c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636201b700 1 -- 172.21.15.26:0/2473787197 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c15a6b0 con 0x7f635c159530 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636201b700 1 --2- 172.21.15.26:0/2473787197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0ceba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6354009910 tx=0x7f63540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4a2a5e2d211509 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354011630 con 0x7f635c159530 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6354011790 con 0x7f635c159530 2023-10-09T11:36:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f6361019700 1 -- 172.21.15.26:0/2473787197 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354011b30 con 0x7f635c159530 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636427f700 1 -- 172.21.15.26:0/2473787197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 msgr2=0x7f635c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.684+0000 7f636427f700 1 --2- 172.21.15.26:0/2473787197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0ceba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6354009910 tx=0x7f63540091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.685+0000 7f636427f700 1 -- 172.21.15.26:0/2473787197 shutdown_connections 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.685+0000 7f636427f700 1 --2- 172.21.15.26:0/2473787197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0ceba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.685+0000 7f636427f700 1 -- 172.21.15.26:0/2473787197 >> 172.21.15.26:0/2473787197 conn(0x7f635c0703a0 msgr2=0x7f635c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.685+0000 7f636427f700 1 -- 172.21.15.26:0/2473787197 shutdown_connections 2023-10-09T11:36:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.685+0000 7f636427f700 1 -- 172.21.15.26:0/2473787197 wait complete. 2023-10-09T11:36:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 Processor -- start 2023-10-09T11:36:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 -- start start 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f635c06dc70 0x7f635c16c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0c9650 con 0x7f635c06e0e0 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0c9930 con 0x7f635c06dc70 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.686+0000 7f636427f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0c9c10 con 0x7f635c159530 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54554/0 (socket says 172.21.15.26:54554) 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 -- 172.21.15.26:0/972077002 learned_addr learned my addr 172.21.15.26:0/972077002 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636201b700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f635c06dc70 0x7f635c16c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636281c700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 -- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 msgr2=0x7f635c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 -- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f635c06dc70 msgr2=0x7f635c16c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f635c06dc70 0x7f635c16c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 -- 172.21.15.26:0/972077002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354009420 con 0x7f635c06e0e0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636181a700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f635000c790 tx=0x7f6350007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350005b30 con 0x7f635c06e0e0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350005c90 con 0x7f635c06e0e0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c0c9ef0 con 0x7f635c06e0e0 2023-10-09T11:36:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350007300 con 0x7f635c06e0e0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.687+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c0b36c0 con 0x7f635c06e0e0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.688+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c04c3c0 con 0x7f635c06e0e0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.689+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f635001b3b0 con 0x7f635c06e0e0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.689+0000 7f635a7fc700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.689+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f63500837b0 con 0x7f635c06e0e0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.689+0000 7f636201b700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.690+0000 7f636201b700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 0x7f63480693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63540091e0 tx=0x7f6354017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.693+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6350050cd0 con 0x7f635c06e0e0 2023-10-09T11:36:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.884+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f635c15a990 con 0x7f635c06e0e0 2023-10-09T11:36:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.884+0000 7f635a7fc700 1 -- 172.21.15.26:0/972077002 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6350017020 con 0x7f635c06e0e0 2023-10-09T11:36:04.885 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 msgr2=0x7f63480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 0x7f63480693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63540091e0 tx=0x7f6354017000 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 msgr2=0x7f635c0c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f635000c790 tx=0x7f6350007ea0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 shutdown_connections 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6348066f30 0x7f63480693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f635c159530 0x7f635c0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f635c06dc70 0x7f635c16c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 --2- 172.21.15.26:0/972077002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f635c06e0e0 0x7f635c0c8b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 >> 172.21.15.26:0/972077002 conn(0x7f635c0703a0 msgr2=0x7f635c15e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 shutdown_connections 2023-10-09T11:36:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:04.886+0000 7f636427f700 1 -- 172.21.15.26:0/972077002 wait complete. 2023-10-09T11:36:04.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:36:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.017+0000 7fef41866700 1 Processor -- start 2023-10-09T11:36:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.017+0000 7fef41866700 1 -- start start 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef41866700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 0x7fef3c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef41866700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef3c0cb1a0 0x7fef3c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef41866700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c15e010 con 0x7fef3c1594d0 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef41866700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c15d420 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef41866700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c15d6e0 con 0x7fef3c0cf180 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef3c0cb1a0 0x7fef3c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef3c0cb1a0 0x7fef3c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54560/0 (socket says 172.21.15.26:54560) 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 -- 172.21.15.26:0/1972612592 learned_addr learned my addr 172.21.15.26:0/1972612592 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3a7fc700 1 --2- 172.21.15.26:0/1972612592 >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 0x7fef3c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 -- 172.21.15.26:0/1972612592 >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 msgr2=0x7fef3c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 --2- 172.21.15.26:0/1972612592 >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 0x7fef3c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 -- 172.21.15.26:0/1972612592 >> v1:172.21.15.67:6789/0 conn(0x7fef3c1594d0 legacy=0x7fef3c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 -- 172.21.15.26:0/1972612592 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c15d9c0 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3a7fc700 1 --2- 172.21.15.26:0/1972612592 >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 0x7fef3c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.018+0000 7fef3b7fe700 1 --2- 172.21.15.26:0/1972612592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cb1a0 0x7fef3c0cd500 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0633c0 tx=0x7fef2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbebd2aa9efb8672 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef39ffb700 1 -- 172.21.15.26:0/1972612592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00e070 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef39ffb700 1 -- 172.21.15.26:0/1972612592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00ba10 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef39ffb700 1 -- 172.21.15.26:0/1972612592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0092e0 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 -- 172.21.15.26:0/1972612592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cb1a0 msgr2=0x7fef3c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 --2- 172.21.15.26:0/1972612592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cb1a0 0x7fef3c0cd500 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0633c0 tx=0x7fef2c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 -- 172.21.15.26:0/1972612592 shutdown_connections 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 --2- 172.21.15.26:0/1972612592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cb1a0 0x7fef3c0cd500 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 --2- 172.21.15.26:0/1972612592 >> v2:172.21.15.67:3300/0 conn(0x7fef3c0cf180 0x7fef3c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 -- 172.21.15.26:0/1972612592 >> 172.21.15.26:0/1972612592 conn(0x7fef3c0703a0 msgr2=0x7fef3c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 -- 172.21.15.26:0/1972612592 shutdown_connections 2023-10-09T11:36:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.019+0000 7fef41866700 1 -- 172.21.15.26:0/1972612592 wait complete. 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.020+0000 7fef41866700 1 Processor -- start 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 -- start start 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef3c0cb1a0 0x7fef3c141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef3c1594d0 0x7fef3c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b0810 con 0x7fef3c0cf180 2023-10-09T11:36:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b16c0 con 0x7fef3c1594d0 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef41866700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b0ab0 con 0x7fef3c0cb1a0 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54574/0 (socket says 172.21.15.26:54574) 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef3a7fc700 1 -- 172.21.15.26:0/1262905944 learned_addr learned my addr 172.21.15.26:0/1262905944 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef3affd700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef3c0cb1a0 0x7fef3c141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.021+0000 7fef3b7fe700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef3c1594d0 0x7fef3c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 -- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef3c0cb1a0 msgr2=0x7fef3c141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef3c0cb1a0 0x7fef3c141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 -- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef3c1594d0 msgr2=0x7fef3c0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef3c1594d0 0x7fef3c0c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 -- 172.21.15.26:0/1262905944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009ae0 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef3a7fc700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c800 tx=0x7fef24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011600 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24011760 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c0b0d90 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011b00 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.022+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0b1350 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.023+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c04c3c0 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.023+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef24018360 con 0x7fef3c0cf180 2023-10-09T11:36:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.024+0000 7fef32ffd700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.024+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fef24083ed0 con 0x7fef3c0cf180 2023-10-09T11:36:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.024+0000 7fef3affd700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.025+0000 7fef3affd700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 0x7fef1c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef34009af0 tx=0x7fef34009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.028+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef24051490 con 0x7fef3c0cf180 2023-10-09T11:36:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.224+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef3c0b2ec0 con 0x7fef3c0cf180 2023-10-09T11:36:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.224+0000 7fef32ffd700 1 -- 172.21.15.26:0/1262905944 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fef2401e090 con 0x7fef3c0cf180 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:05.225 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 msgr2=0x7fef1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 0x7fef1c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef34009af0 tx=0x7fef34009060 comp rx=0 tx=0).stop 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 msgr2=0x7fef3c0cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c800 tx=0x7fef24008040 comp rx=0 tx=0).stop 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 shutdown_connections 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef3c1594d0 0x7fef3c0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fef1c066f30 0x7fef1c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef3c0cb1a0 0x7fef3c141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 --2- 172.21.15.26:0/1262905944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef3c0cf180 0x7fef3c0cbbd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 >> 172.21.15.26:0/1262905944 conn(0x7fef3c0703a0 msgr2=0x7fef3c0c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 shutdown_connections 2023-10-09T11:36:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.226+0000 7fef41866700 1 -- 172.21.15.26:0/1262905944 wait complete. 2023-10-09T11:36:05.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:36:05.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:36:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.361+0000 7f767b97e700 1 Processor -- start 2023-10-09T11:36:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.362+0000 7f767b97e700 1 -- start start 2023-10-09T11:36:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.362+0000 7f767b97e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f767406dcf0 0x7f7674159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.362+0000 7f767b97e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76740ccfd0 con 0x7f7674159e40 2023-10-09T11:36:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f767b97e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767415a410 con 0x7f7674159530 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f767b97e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767415a6f0 con 0x7f767406dcf0 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7679f1b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7674159e40 0x7f76740cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45804/0 (socket says 172.21.15.26:45804) 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7679f1b700 1 -- 172.21.15.26:0/2322801767 learned_addr learned my addr 172.21.15.26:0/2322801767 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7678f19700 1 --2- 172.21.15.26:0/2322801767 >> v2:172.21.15.67:3300/0 conn(0x7f767406dcf0 0x7f7674159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399934332 0 0) 0x7f76740ccfd0 con 0x7f7674159e40 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f765c003570 con 0x7f7674159e40 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920097636 0 0) 0x7f767415a410 con 0x7f7674159530 2023-10-09T11:36:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76740ccfd0 con 0x7f7674159530 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263293994 0 0) 0x7f765c003570 con 0x7f7674159e40 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 >> v2:172.21.15.67:3300/0 conn(0x7f767406dcf0 msgr2=0x7f7674159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 --2- 172.21.15.26:0/2322801767 >> v2:172.21.15.67:3300/0 conn(0x7f767406dcf0 0x7f7674159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 >> v1:172.21.15.67:6789/0 conn(0x7f7674159530 legacy=0x7f76740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767415a9d0 con 0x7f7674159e40 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f766c001470 con 0x7f7674159e40 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7678f19700 1 --2- 172.21.15.26:0/2322801767 >> v2:172.21.15.67:3300/0 conn(0x7f767406dcf0 0x7f7674159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 >> v1:172.21.15.26:6789/0 conn(0x7f7674159e40 legacy=0x7f76740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f765c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c004810 0x7f765c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c0051c0 0x7f765c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767415a6f0 con 0x7f765c003bf0 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c00c160 con 0x7f765c004810 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c00c320 con 0x7f765c0051c0 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.363+0000 7f767971a700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f765c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7678f19700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c004810 0x7f765c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7679f1b700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c0051c0 0x7f765c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 -- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c0051c0 msgr2=0x7f765c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c0051c0 0x7f765c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 -- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c004810 msgr2=0x7f765c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f765c004810 0x7f765c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 -- 172.21.15.26:0/2322801767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c003570 con 0x7f765c003bf0 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7679f1b700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f765c0051c0 0x7f765c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7679f1b700 1 -- 172.21.15.26:0/2322801767 reap_dead start 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f767971a700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f765c003fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f76640020f0 tx=0x7f76640017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf9613c1cda8df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400c8b0 con 0x7f765c003bf0 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400ca10 con 0x7f765c003bf0 2023-10-09T11:36:05.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.364+0000 7f7673fff700 1 -- 172.21.15.26:0/2322801767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400cdb0 con 0x7f765c003bf0 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 -- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 msgr2=0x7f765c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f765c003fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f76640020f0 tx=0x7f76640017a0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 -- 172.21.15.26:0/2322801767 shutdown_connections 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 --2- 172.21.15.26:0/2322801767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f765c003fe0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 -- 172.21.15.26:0/2322801767 >> 172.21.15.26:0/2322801767 conn(0x7f76740703a0 msgr2=0x7f76740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 -- 172.21.15.26:0/2322801767 shutdown_connections 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.365+0000 7f767b97e700 1 -- 172.21.15.26:0/2322801767 wait complete. 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.366+0000 7f767b97e700 1 Processor -- start 2023-10-09T11:36:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.366+0000 7f767b97e700 1 -- start start 2023-10-09T11:36:05.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76740b60c0 0x7f767416d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f767416a5a0 0x7f76740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c9210 con 0x7f765c003bf0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c88e0 con 0x7f76740b60c0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767b97e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c8bc0 con 0x7f767416a5a0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54596/0 (socket says 172.21.15.26:54596) 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 -- 172.21.15.26:0/4280309176 learned_addr learned my addr 172.21.15.26:0/4280309176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f7679f1b700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f767416a5a0 0x7f76740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f7678f19700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76740b60c0 0x7f767416d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 -- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f767416a5a0 msgr2=0x7f76740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f767416a5a0 0x7f76740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 -- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76740b60c0 msgr2=0x7f767416d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76740b60c0 0x7f767416d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 -- 172.21.15.26:0/4280309176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76740c8ea0 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f767971a700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c130 tx=0x7f7664016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.367+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400c6d0 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.368+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7664012e50 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.368+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76741411f0 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.368+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76640276a0 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.368+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767416aa40 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.369+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767404c3c0 con 0x7f765c003bf0 2023-10-09T11:36:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.369+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7664024070 con 0x7f765c003bf0 2023-10-09T11:36:05.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.369+0000 7f76717fa700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:05.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.369+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f76640867c0 con 0x7f765c003bf0 2023-10-09T11:36:05.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.369+0000 7f7678f19700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:05.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.370+0000 7f7678f19700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 0x7f76600693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f767416c9f0 tx=0x7f7668008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:05.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.374+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7664053d80 con 0x7f765c003bf0 2023-10-09T11:36:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:05.570+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f767416ac60 con 0x7f765c003bf0 2023-10-09T11:36:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.256+0000 7f76717fa700 1 -- 172.21.15.26:0/4280309176 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f76640573a0 con 0x7f765c003bf0 2023-10-09T11:36:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 msgr2=0x7f76600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 0x7f76600693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f767416c9f0 tx=0x7f7668008040 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 msgr2=0x7f7674140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c130 tx=0x7f7664016000 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 shutdown_connections 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f767416a5a0 0x7f76740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f765c003bf0 0x7f7674140cb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 --2- 172.21.15.26:0/4280309176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76740b60c0 0x7f767416d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.260+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 >> 172.21.15.26:0/4280309176 conn(0x7f76740703a0 msgr2=0x7f76740c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.261+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 shutdown_connections 2023-10-09T11:36:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.261+0000 7f767b97e700 1 -- 172.21.15.26:0/4280309176 wait complete. 2023-10-09T11:36:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:36:06.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:36:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.408+0000 7f7ab4a2d700 1 Processor -- start 2023-10-09T11:36:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.408+0000 7f7ab4a2d700 1 -- start start 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.409+0000 7f7ab4a2d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ab0159530 0x7f7ab00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.409+0000 7f7ab4a2d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.409+0000 7f7ab4a2d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab00ccfd0 con 0x7f7ab006e0e0 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.409+0000 7f7ab4a2d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00cf0e0 con 0x7f7ab0159530 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.409+0000 7f7ab4a2d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab015a3d0 con 0x7f7ab006dc70 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ab0159530 0x7f7ab00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ab0159530 0x7f7ab00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54606/0 (socket says 172.21.15.26:54606) 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 -- 172.21.15.26:0/1865293936 learned_addr learned my addr 172.21.15.26:0/1865293936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aaed9d700 1 --1- 172.21.15.26:0/1865293936 >> v1:172.21.15.26:6789/0 conn(0x7f7ab006e0e0 0x7f7ab00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45816/0 (socket says 172.21.15.26:45816) 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aadd9b700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 -- 172.21.15.26:0/1865293936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 msgr2=0x7f7ab0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 -- 172.21.15.26:0/1865293936 >> v1:172.21.15.26:6789/0 conn(0x7f7ab006e0e0 legacy=0x7f7ab00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 -- 172.21.15.26:0/1865293936 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab015a6b0 con 0x7f7ab0159530 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aad59a700 1 -- 172.21.15.26:0/1865293936 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508701244 0 0) 0x7f7ab00ccfd0 con 0x7f7ab006e0e0 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aae59c700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab00ceba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009f20 tx=0x7f7aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c13bc49b710b708 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aad59a700 1 -- 172.21.15.26:0/1865293936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000e070 con 0x7f7ab0159530 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aad59a700 1 -- 172.21.15.26:0/1865293936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000ba80 con 0x7f7ab0159530 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.410+0000 7f7aad59a700 1 -- 172.21.15.26:0/1865293936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00092e0 con 0x7f7ab0159530 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/1865293936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 msgr2=0x7f7ab00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab00ceba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009f20 tx=0x7f7aa0009840 comp rx=0 tx=0).stop 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/1865293936 shutdown_connections 2023-10-09T11:36:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab00ceba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/1865293936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/1865293936 >> 172.21.15.26:0/1865293936 conn(0x7f7ab00703a0 msgr2=0x7f7ab00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/1865293936 shutdown_connections 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.411+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/1865293936 wait complete. 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.412+0000 7f7ab4a2d700 1 Processor -- start 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.412+0000 7f7ab4a2d700 1 -- start start 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab00b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ab006e0e0 0x7f7ab0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab016cfd0 con 0x7f7ab0159530 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab016d2b0 con 0x7f7ab006e0e0 2023-10-09T11:36:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7ab4a2d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00b5b20 con 0x7f7ab006dc70 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54618/0 (socket says 172.21.15.26:54618) 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 -- 172.21.15.26:0/384092713 learned_addr learned my addr 172.21.15.26:0/384092713 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aae59c700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab00b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aadd9b700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ab006e0e0 0x7f7ab0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 -- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 msgr2=0x7f7ab00b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab00b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 -- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ab006e0e0 msgr2=0x7f7ab0153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ab006e0e0 0x7f7ab0153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 -- 172.21.15.26:0/384092713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0009ae0 con 0x7f7ab0159530 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aaed9d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c5e0 tx=0x7f7aa8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8005a70 con 0x7f7ab0159530 2023-10-09T11:36:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.413+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8005bd0 con 0x7f7ab0159530 2023-10-09T11:36:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.414+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab00b5e00 con 0x7f7ab0159530 2023-10-09T11:36:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.414+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80070d0 con 0x7f7ab0159530 2023-10-09T11:36:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.414+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab0158c60 con 0x7f7ab0159530 2023-10-09T11:36:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.415+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab00b62a0 con 0x7f7ab0159530 2023-10-09T11:36:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.415+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aa80074c0 con 0x7f7ab0159530 2023-10-09T11:36:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.416+0000 7f7aa67fc700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 0x7f7a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.416+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7aa80838f0 con 0x7f7ab0159530 2023-10-09T11:36:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.416+0000 7f7aae59c700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 0x7f7a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.416+0000 7f7aae59c700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 0x7f7a900693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009880 tx=0x7f7aa0018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.420+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aa8050d40 con 0x7f7ab0159530 2023-10-09T11:36:06.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:06.612+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ab004c3c0 con 0x7f7ab0159530 2023-10-09T11:36:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.262+0000 7f7aa67fc700 1 -- 172.21.15.26:0/384092713 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7aa8017020 con 0x7f7ab0159530 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 msgr2=0x7f7a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 0x7f7a900693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009880 tx=0x7f7aa0018000 comp rx=0 tx=0).stop 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 msgr2=0x7f7ab016d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c5e0 tx=0x7f7aa8007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 shutdown_connections 2023-10-09T11:36:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab0159530 0x7f7ab016d740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a90066f30 0x7f7a900693e0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009880 tx=0x7f7aa0018000 comp rx=0 tx=0).stop 2023-10-09T11:36:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ab006dc70 0x7f7ab00b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 --2- 172.21.15.26:0/384092713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ab006e0e0 0x7f7ab0153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.268+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 >> 172.21.15.26:0/384092713 conn(0x7f7ab00703a0 msgr2=0x7f7ab015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.269+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 shutdown_connections 2023-10-09T11:36:07.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.269+0000 7f7ab4a2d700 1 -- 172.21.15.26:0/384092713 wait complete. 2023-10-09T11:36:07.275 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:36:07.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:36:07.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.416+0000 7feffaf9a700 1 Processor -- start 2023-10-09T11:36:07.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.416+0000 7feffaf9a700 1 -- start start 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff41576d0 0x7feff40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 0x7feff40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feff40b1a10 0x7feff40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40b1e90 con 0x7feff40b1a10 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40cc060 con 0x7feff40aead0 2023-10-09T11:36:07.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feffaf9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff40cb450 con 0x7feff41576d0 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff9537700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feff40b1a10 0x7feff40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff9537700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feff40b1a10 0x7feff40abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54634/0 (socket says 172.21.15.26:54634) 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff9537700 1 -- 172.21.15.26:0/2161208370 learned_addr learned my addr 172.21.15.26:0/2161208370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff3fff700 1 --2- 172.21.15.26:0/2161208370 >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 0x7feff40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff8d36700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff41576d0 0x7feff40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff9537700 1 -- 172.21.15.26:0/2161208370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff41576d0 msgr2=0x7feff40ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.417+0000 7feff9537700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff41576d0 0x7feff40ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff9537700 1 -- 172.21.15.26:0/2161208370 >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 msgr2=0x7feff40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff9537700 1 --2- 172.21.15.26:0/2161208370 >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 0x7feff40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff9537700 1 -- 172.21.15.26:0/2161208370 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40cb730 con 0x7feff40b1a10 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff3fff700 1 --2- 172.21.15.26:0/2161208370 >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 0x7feff40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:07.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff9537700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff40b1a10 0x7feff40abdc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feff40633e0 tx=0x7fefe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120d383ffba65d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff37fe700 1 -- 172.21.15.26:0/2161208370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe400b860 con 0x7feff40b1a10 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff37fe700 1 -- 172.21.15.26:0/2161208370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe400b9c0 con 0x7feff40b1a10 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feff37fe700 1 -- 172.21.15.26:0/2161208370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe400bd60 con 0x7feff40b1a10 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 -- 172.21.15.26:0/2161208370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff40b1a10 msgr2=0x7feff40abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff40b1a10 0x7feff40abdc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feff40633e0 tx=0x7fefe4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 -- 172.21.15.26:0/2161208370 shutdown_connections 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff40b1a10 0x7feff40abdc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2161208370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff41576d0 0x7feff40ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2161208370 >> v2:172.21.15.67:3300/0 conn(0x7feff40aead0 0x7feff40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 -- 172.21.15.26:0/2161208370 >> 172.21.15.26:0/2161208370 conn(0x7feff406d170 msgr2=0x7feff40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 -- 172.21.15.26:0/2161208370 shutdown_connections 2023-10-09T11:36:07.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.418+0000 7feffaf9a700 1 -- 172.21.15.26:0/2161208370 wait complete. 2023-10-09T11:36:07.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.419+0000 7feffaf9a700 1 Processor -- start 2023-10-09T11:36:07.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 -- start start 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff40aead0 0x7feff4144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feff40b1a10 0x7feff415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff415cb50 con 0x7feff41576d0 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff415ce30 con 0x7feff40b1a10 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.420+0000 7feffaf9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff415d110 con 0x7feff40aead0 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54648/0 (socket says 172.21.15.26:54648) 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 -- 172.21.15.26:0/2241795628 learned_addr learned my addr 172.21.15.26:0/2241795628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff8d36700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff40aead0 0x7feff4144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff3fff700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feff40b1a10 0x7feff415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 -- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff40aead0 msgr2=0x7feff4144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff40aead0 0x7feff4144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 -- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feff40b1a10 msgr2=0x7feff415c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feff40b1a10 0x7feff415c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 -- 172.21.15.26:0/2241795628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40094f0 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff9537700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefe40090b0 tx=0x7fefe4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4011e60 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe401f070 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff415d3f0 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe401a870 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.421+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff4151c30 con 0x7feff41576d0 2023-10-09T11:36:07.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.422+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff404c3c0 con 0x7feff41576d0 2023-10-09T11:36:07.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.423+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefe401ac20 con 0x7feff41576d0 2023-10-09T11:36:07.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.423+0000 7feff0ff9700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.423+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fefe4021070 con 0x7feff41576d0 2023-10-09T11:36:07.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.423+0000 7feff8d36700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.424+0000 7feff8d36700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 0x7fefe00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefec0075a0 tx=0x7fefec0097e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.428+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefe4053700 con 0x7feff41576d0 2023-10-09T11:36:07.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:07.665+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feff40cba10 con 0x7feff41576d0 2023-10-09T11:36:08.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.273+0000 7feff0ff9700 1 -- 172.21.15.26:0/2241795628 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fefe40150c0 con 0x7feff41576d0 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 msgr2=0x7fefe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 0x7fefe00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefec0075a0 tx=0x7fefec0097e0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 msgr2=0x7feff41418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefe40090b0 tx=0x7fefe4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 shutdown_connections 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff41576d0 0x7feff41418d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feff40aead0 0x7feff4144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 --2- 172.21.15.26:0/2241795628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feff40b1a10 0x7feff415c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.281+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 >> 172.21.15.26:0/2241795628 conn(0x7feff406d170 msgr2=0x7feff40acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.283+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 shutdown_connections 2023-10-09T11:36:08.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.283+0000 7feffaf9a700 1 -- 172.21.15.26:0/2241795628 wait complete. 2023-10-09T11:36:08.291 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T11:36:08.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.426+0000 7f0515a85700 1 Processor -- start 2023-10-09T11:36:08.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.426+0000 7f0515a85700 1 -- start start 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05100cb5a0 0x7f05100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05100cd9e0 0x7f0510159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f051015a400 0x7f0510156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100d13f0 con 0x7f05100cd9e0 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051015ae40 con 0x7f05100cb5a0 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f0515a85700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051015ab60 con 0x7f051015a400 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05100cd9e0 0x7f0510159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05100cd9e0 0x7f0510159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54654/0 (socket says 172.21.15.26:54654) 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 -- 172.21.15.26:0/4213709340 learned_addr learned my addr 172.21.15.26:0/4213709340 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050f7fe700 1 --2- 172.21.15.26:0/4213709340 >> v2:172.21.15.67:3300/0 conn(0x7f05100cb5a0 0x7f05100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050ffff700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f051015a400 0x7f0510156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 -- 172.21.15.26:0/4213709340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f051015a400 msgr2=0x7f0510156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f051015a400 0x7f0510156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 -- 172.21.15.26:0/4213709340 >> v2:172.21.15.67:3300/0 conn(0x7f05100cb5a0 msgr2=0x7f05100cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 --2- 172.21.15.26:0/4213709340 >> v2:172.21.15.67:3300/0 conn(0x7f05100cb5a0 0x7f05100cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 -- 172.21.15.26:0/4213709340 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100ccf00 con 0x7f05100cd9e0 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.427+0000 7f050effd700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05100cd9e0 0x7f0510159ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f05040099b0 tx=0x7f0504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fcb0352137bb13 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f050e7fc700 1 -- 172.21.15.26:0/4213709340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400b640 con 0x7f05100cd9e0 2023-10-09T11:36:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f050e7fc700 1 -- 172.21.15.26:0/4213709340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050400b7a0 con 0x7f05100cd9e0 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f050e7fc700 1 -- 172.21.15.26:0/4213709340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400bb40 con 0x7f05100cd9e0 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 -- 172.21.15.26:0/4213709340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05100cd9e0 msgr2=0x7f0510159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05100cd9e0 0x7f0510159ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f05040099b0 tx=0x7f0504009250 comp rx=0 tx=0).stop 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 -- 172.21.15.26:0/4213709340 shutdown_connections 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 --2- 172.21.15.26:0/4213709340 >> v2:172.21.15.67:3300/0 conn(0x7f05100cb5a0 0x7f05100cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f051015a400 0x7f0510156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 --2- 172.21.15.26:0/4213709340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05100cd9e0 0x7f0510159ec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 -- 172.21.15.26:0/4213709340 >> 172.21.15.26:0/4213709340 conn(0x7f0510070e30 msgr2=0x7f05100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 -- 172.21.15.26:0/4213709340 shutdown_connections 2023-10-09T11:36:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.428+0000 7f0515a85700 1 -- 172.21.15.26:0/4213709340 wait complete. 2023-10-09T11:36:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.429+0000 7f0515a85700 1 Processor -- start 2023-10-09T11:36:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.429+0000 7f0515a85700 1 -- start start 2023-10-09T11:36:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05100cb5a0 0x7f0510169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 0x7f05100af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100b4d60 con 0x7f051015a400 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051015c150 con 0x7f05100cd9e0 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f0515a85700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100b4a30 con 0x7f05100cb5a0 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54656/0 (socket says 172.21.15.26:54656) 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 -- 172.21.15.26:0/3144988790 learned_addr learned my addr 172.21.15.26:0/3144988790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050f7fe700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05100cb5a0 0x7f0510169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050effd700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 0x7f05100af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 -- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05100cb5a0 msgr2=0x7f0510169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05100cb5a0 0x7f0510169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 -- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 msgr2=0x7f05100af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.430+0000 7f050ffff700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 0x7f05100af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f050ffff700 1 -- 172.21.15.26:0/3144988790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040094f0 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f050effd700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 0x7f05100af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f050ffff700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0508009e20 tx=0x7f050800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050800cb50 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050800f040 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05100c81d0 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508014480 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.431+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510166df0 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.432+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05100b4f10 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.432+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0508014830 con 0x7f051015a400 2023-10-09T11:36:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.433+0000 7f04f77fe700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.433+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0508084e60 con 0x7f051015a400 2023-10-09T11:36:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.433+0000 7f050f7fe700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.433+0000 7f050f7fe700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 0x7f04fc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d20 tx=0x7f05000091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.437+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05100b4f10 con 0x7f051015a400 2023-10-09T11:36:08.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.635+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05100b4f10 con 0x7f051015a400 2023-10-09T11:36:08.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.636+0000 7f04f77fe700 1 -- 172.21.15.26:0/3144988790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f05100b4f10 con 0x7f051015a400 2023-10-09T11:36:08.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:08.636 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:07.665794+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.637+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 msgr2=0x7f04fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.637+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 0x7f04fc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d20 tx=0x7f05000091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.637+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 msgr2=0x7f05101668b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.637+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0508009e20 tx=0x7f050800b040 comp rx=0 tx=0).stop 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 shutdown_connections 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f051015a400 0x7f05101668b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05100cb5a0 0x7f0510169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 --2- 172.21.15.26:0/3144988790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05100cd9e0 0x7f05100af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 >> 172.21.15.26:0/3144988790 conn(0x7f0510070e30 msgr2=0x7f05100b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 shutdown_connections 2023-10-09T11:36:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.638+0000 7f0515a85700 1 -- 172.21.15.26:0/3144988790 wait complete. 2023-10-09T11:36:08.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:08.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.770+0000 7f7a0e9a4700 1 Processor -- start 2023-10-09T11:36:08.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.770+0000 7f7a0e9a4700 1 -- start start 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0e9a4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 0x7f7a08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0e9a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a0815a400 0x7f7a08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0e9a4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0815ae40 con 0x7f7a080cb5a0 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0e9a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ce0f0 con 0x7f7a0815a400 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0e9a4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080d13f0 con 0x7f7a080cb970 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0cf41700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a0815a400 0x7f7a08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a07fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a080cb5a0 0x7f7a080cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45832/0 (socket says 172.21.15.26:45832) 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0cf41700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a0815a400 0x7f7a08156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54670/0 (socket says 172.21.15.26:54670) 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a07fff700 1 -- 172.21.15.26:0/312159094 learned_addr learned my addr 172.21.15.26:0/312159094 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a077fe700 1 --2- 172.21.15.26:0/312159094 >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 0x7f7a08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0cf41700 1 -- 172.21.15.26:0/312159094 >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 msgr2=0x7f7a08159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.771+0000 7f7a0cf41700 1 --2- 172.21.15.26:0/312159094 >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 0x7f7a08159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0cf41700 1 -- 172.21.15.26:0/312159094 >> v1:172.21.15.26:6789/0 conn(0x7f7a080cb5a0 legacy=0x7f7a080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a06ffd700 1 -- 172.21.15.26:0/312159094 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041782158 0 0) 0x7f7a0815ae40 con 0x7f7a080cb5a0 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0cf41700 1 -- 172.21.15.26:0/312159094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0815ab60 con 0x7f7a0815a400 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a077fe700 1 --2- 172.21.15.26:0/312159094 >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 0x7f7a08159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0cf41700 1 --2- 172.21.15.26:0/312159094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a08156e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a080d1780 tx=0x7f7a00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910600d77e2ce518 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a06ffd700 1 -- 172.21.15.26:0/312159094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000e070 con 0x7f7a0815a400 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a06ffd700 1 -- 172.21.15.26:0/312159094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000bc30 con 0x7f7a0815a400 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a06ffd700 1 -- 172.21.15.26:0/312159094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00012430 con 0x7f7a0815a400 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/312159094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 msgr2=0x7f7a08156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/312159094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a08156e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a080d1780 tx=0x7f7a00009780 comp rx=0 tx=0).stop 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/312159094 shutdown_connections 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/312159094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a08156e90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/312159094 >> v2:172.21.15.67:3300/0 conn(0x7f7a080cb970 0x7f7a08159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/312159094 >> 172.21.15.26:0/312159094 conn(0x7f7a08070e30 msgr2=0x7f7a080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/312159094 shutdown_connections 2023-10-09T11:36:08.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.772+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/312159094 wait complete. 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.773+0000 7f7a0e9a4700 1 Processor -- start 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 -- start start 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a080cb5a0 0x7f7a08153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a080cb970 0x7f7a080b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080b55b0 con 0x7f7a0815a400 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08153ad0 con 0x7f7a080cb970 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0e9a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080b49a0 con 0x7f7a080cb5a0 2023-10-09T11:36:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.774+0000 7f7a0cf41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54678/0 (socket says 172.21.15.26:54678) 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 -- 172.21.15.26:0/3288149003 learned_addr learned my addr 172.21.15.26:0/3288149003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a077fe700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a080cb970 0x7f7a080b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a07fff700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a080cb5a0 0x7f7a08153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 -- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a080cb5a0 msgr2=0x7f7a08153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a080cb5a0 0x7f7a08153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 -- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a080cb970 msgr2=0x7f7a080b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a080cb970 0x7f7a080b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 -- 172.21.15.26:0/3288149003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00009a20 con 0x7f7a0815a400 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0cf41700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806ea60 tx=0x7f7a00019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00012e10 con 0x7f7a0815a400 2023-10-09T11:36:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0001d630 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a080b4c80 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0001d9f0 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.775+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a080b5240 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.776+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a080b5720 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.777+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a00024070 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.777+0000 7f79effff700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.777+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a00086d50 con 0x7f7a0815a400 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.777+0000 7f7a07fff700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.778+0000 7f7a07fff700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 0x7f79f40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79fc007fd0 tx=0x7f79fc007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.781+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a0008a030 con 0x7f7a0815a400 2023-10-09T11:36:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.974+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0804c3c0 con 0x7f7a0815a400 2023-10-09T11:36:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.975+0000 7f79effff700 1 -- 172.21.15.26:0/3288149003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f7a00053fc0 con 0x7f7a0815a400 2023-10-09T11:36:08.976 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:08.976 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:07.665794+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 msgr2=0x7f79f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 0x7f79f40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79fc007fd0 tx=0x7f79fc007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 msgr2=0x7f7a0815bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806ea60 tx=0x7f7a00019000 comp rx=0 tx=0).stop 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 shutdown_connections 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0815a400 0x7f7a0815bb30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a080cb5a0 0x7f7a08153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 --2- 172.21.15.26:0/3288149003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a080cb970 0x7f7a080b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 >> 172.21.15.26:0/3288149003 conn(0x7f7a08070e30 msgr2=0x7f7a080b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 shutdown_connections 2023-10-09T11:36:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:08.977+0000 7f7a0e9a4700 1 -- 172.21.15.26:0/3288149003 wait complete. 2023-10-09T11:36:08.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:36:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.111+0000 7ff4c672d700 1 Processor -- start 2023-10-09T11:36:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.111+0000 7ff4c672d700 1 -- start start 2023-10-09T11:36:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4c672d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c0157930 0x7ff4c00ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4c672d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c00ca2c0 0x7ff4c00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4c672d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00c32a0 con 0x7ff4c00ccba0 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4c672d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00c9730 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4c672d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00c4100 con 0x7ff4c0157930 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.112+0000 7ff4bf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c00ca2c0 0x7ff4c00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c00ca2c0 0x7ff4c00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54684/0 (socket says 172.21.15.26:54684) 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 -- 172.21.15.26:0/1879579395 learned_addr learned my addr 172.21.15.26:0/1879579395 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bffff700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c0157930 0x7ff4c00ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 -- 172.21.15.26:0/1879579395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c0157930 msgr2=0x7ff4c00ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c0157930 0x7ff4c00ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 -- 172.21.15.26:0/1879579395 >> v1:172.21.15.67:6789/0 conn(0x7ff4c00ccba0 legacy=0x7ff4c00c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 -- 172.21.15.26:0/1879579395 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00c34f0 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4bf7fe700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00ca730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40099b0 tx=0x7ff4b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435e383fb0060c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4beffd700 1 -- 172.21.15.26:0/1879579395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4009ea0 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4beffd700 1 -- 172.21.15.26:0/1879579395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400b860 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.113+0000 7ff4beffd700 1 -- 172.21.15.26:0/1879579395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400bc00 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 -- 172.21.15.26:0/1879579395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c00ca2c0 msgr2=0x7ff4c00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00ca730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40099b0 tx=0x7ff4b4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 -- 172.21.15.26:0/1879579395 shutdown_connections 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c0157930 0x7ff4c00ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1879579395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00ca730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 -- 172.21.15.26:0/1879579395 >> 172.21.15.26:0/1879579395 conn(0x7ff4c0088000 msgr2=0x7ff4c00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 -- 172.21.15.26:0/1879579395 shutdown_connections 2023-10-09T11:36:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.114+0000 7ff4c672d700 1 -- 172.21.15.26:0/1879579395 wait complete. 2023-10-09T11:36:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.115+0000 7ff4c672d700 1 Processor -- start 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.115+0000 7ff4c672d700 1 -- start start 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c00ccba0 0x7ff4c0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00ae880 con 0x7ff4c0157930 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00af400 con 0x7ff4c00ca2c0 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c672d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b2530 con 0x7ff4c00ccba0 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54688/0 (socket says 172.21.15.26:54688) 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 -- 172.21.15.26:0/1753396125 learned_addr learned my addr 172.21.15.26:0/1753396125 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4bf7fe700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c00ccba0 0x7ff4c0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4bffff700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 -- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c00ccba0 msgr2=0x7ff4c0158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c00ccba0 0x7ff4c0158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 -- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4c00ca2c0 msgr2=0x7ff4c00c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.116+0000 7ff4c4cca700 1 -- 172.21.15.26:0/1753396125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40094f0 con 0x7ff4c0157930 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4c4cca700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c910 tx=0x7ff4b8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8012630 con 0x7ff4c0157930 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b80127b0 con 0x7ff4c0157930 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c00aead0 con 0x7ff4c0157930 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8012b70 con 0x7ff4c0157930 2023-10-09T11:36:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.117+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c00af090 con 0x7ff4c0157930 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.118+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c004c3c0 con 0x7ff4c0157930 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.118+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b8003030 con 0x7ff4c0157930 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.119+0000 7ff4a7fff700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.119+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4b8084450 con 0x7ff4c0157930 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.119+0000 7ff4bffff700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.119+0000 7ff4bffff700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009db0 tx=0x7ff4b00091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.123+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b80516c0 con 0x7ff4c0157930 2023-10-09T11:36:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:09.361+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff4c00cb7f0 con 0x7ff4c0157930 2023-10-09T11:36:10.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.278+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1753396125 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff4b8054ce0 con 0x7ff4c0157930 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 msgr2=0x7ff4ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009db0 tx=0x7ff4b00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 msgr2=0x7ff4c00b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c910 tx=0x7ff4b8001710 comp rx=0 tx=0).stop 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 shutdown_connections 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c0157930 0x7ff4c00b3140 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4c00ca2c0 0x7ff4c00c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 --2- 172.21.15.26:0/1753396125 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4c00ccba0 0x7ff4c0158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.281+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 >> 172.21.15.26:0/1753396125 conn(0x7ff4c0088000 msgr2=0x7ff4c00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:10.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.282+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 shutdown_connections 2023-10-09T11:36:10.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.282+0000 7ff4c672d700 1 -- 172.21.15.26:0/1753396125 wait complete. 2023-10-09T11:36:10.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:36:10.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.427+0000 7f5efcbe3700 1 Processor -- start 2023-10-09T11:36:10.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.427+0000 7f5efcbe3700 1 -- start start 2023-10-09T11:36:10.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5efcbe3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ef80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5efcbe3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ef806e0e0 0x7f5ef80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5efcbe3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef80ccfd0 con 0x7f5ef806dc70 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5efcbe3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80cf0e0 con 0x7f5ef806e0e0 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5efcbe3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815a3d0 con 0x7f5ef8159530 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5ef806dc70 0x7f5ef8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50334/0 (socket says 172.21.15.26:50334) 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef5d9b700 1 -- 172.21.15.26:0/3364196137 learned_addr learned my addr 172.21.15.26:0/3364196137 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:10.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef659c700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ef80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef6d9d700 1 --2- 172.21.15.26:0/3364196137 >> v2:172.21.15.67:3300/0 conn(0x7f5ef806e0e0 0x7f5ef80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907983694 0 0) 0x7f5ef80ccfd0 con 0x7f5ef806dc70 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee0003570 con 0x7f5ef806dc70 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3476312559 0 0) 0x7f5ee0003570 con 0x7f5ef806dc70 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 msgr2=0x7f5ef80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ef80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 >> v2:172.21.15.67:3300/0 conn(0x7f5ef806e0e0 msgr2=0x7f5ef80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 --2- 172.21.15.26:0/3364196137 >> v2:172.21.15.67:3300/0 conn(0x7f5ef806e0e0 0x7f5ef80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef815a6b0 con 0x7f5ef806dc70 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.428+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f5eec001470 con 0x7f5ef806dc70 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 >> v1:172.21.15.26:6789/0 conn(0x7f5ef806dc70 legacy=0x7f5ef8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ee0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ee0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee0004d50 0x7f5ee00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80cf0e0 con 0x7f5ee0003a60 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815a3d0 con 0x7f5ee0004d50 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee000ba60 con 0x7f5ef8159530 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef6d9d700 1 --2- 172.21.15.26:0/3364196137 >> v2:172.21.15.67:3300/0 conn(0x7f5ef806e0e0 0x7f5ef80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ee0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef5d9b700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ee0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef6d9d700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee0004d50 0x7f5ee00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 -- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 msgr2=0x7f5ee0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef8159530 0x7f5ee0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 -- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee0004d50 msgr2=0x7f5ee00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee0004d50 0x7f5ee00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 -- 172.21.15.26:0/3364196137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0003570 con 0x7f5ee0003a60 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef6d9d700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee0004d50 0x7f5ee00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef659c700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ee0003e70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009c00 tx=0x7f5ee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e506ea7abe1be60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:10.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800e6b0 con 0x7f5ee0003a60 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800e810 con 0x7f5ee0003a60 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.429+0000 7f5ef559a700 1 -- 172.21.15.26:0/3364196137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800ebd0 con 0x7f5ee0003a60 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 -- 172.21.15.26:0/3364196137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 msgr2=0x7f5ee0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/3364196137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ee0003e70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009c00 tx=0x7f5ee80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5ef6d9d700 1 -- 172.21.15.26:0/3364196137 reap_dead start 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 -- 172.21.15.26:0/3364196137 shutdown_connections 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 -- 172.21.15.26:0/3364196137 >> 172.21.15.26:0/3364196137 conn(0x7f5ef80703a0 msgr2=0x7f5ef80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 -- 172.21.15.26:0/3364196137 shutdown_connections 2023-10-09T11:36:10.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.430+0000 7f5efcbe3700 1 -- 172.21.15.26:0/3364196137 wait complete. 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.431+0000 7f5efcbe3700 1 Processor -- start 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.431+0000 7f5efcbe3700 1 -- start start 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815bf00 0x7f5ef815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef80b1670 0x7f5ef80b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80b2020 con 0x7f5ee0003a60 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef816a9d0 con 0x7f5ef815bf00 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5efcbe3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815ecd0 con 0x7f5ef80b1670 2023-10-09T11:36:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50532/0 (socket says 172.21.15.26:50532) 2023-10-09T11:36:10.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 -- 172.21.15.26:0/1007423070 learned_addr learned my addr 172.21.15.26:0/1007423070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:10.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef5d9b700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815bf00 0x7f5ef815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef6d9d700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef80b1670 0x7f5ef80b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 -- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef80b1670 msgr2=0x7f5ef80b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef80b1670 0x7f5ef80b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 -- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815bf00 msgr2=0x7f5ef815c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815bf00 0x7f5ef815c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 -- 172.21.15.26:0/1007423070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8169dc0 con 0x7f5ee0003a60 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ef659c700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800e4b0 tx=0x7f5ee801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.432+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8022070 con 0x7f5ee0003a60 2023-10-09T11:36:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.433+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800e980 con 0x7f5ee0003a60 2023-10-09T11:36:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.433+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800e6b0 con 0x7f5ee0003a60 2023-10-09T11:36:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.433+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef816a0a0 con 0x7f5ee0003a60 2023-10-09T11:36:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.433+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef816a660 con 0x7f5ee0003a60 2023-10-09T11:36:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.433+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef804c3c0 con 0x7f5ee0003a60 2023-10-09T11:36:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.434+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ee8027680 con 0x7f5ee0003a60 2023-10-09T11:36:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.434+0000 7f5ee67fc700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.434+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ee8085e40 con 0x7f5ee0003a60 2023-10-09T11:36:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.435+0000 7f5ef5d9b700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.435+0000 7f5ef5d9b700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 0x7f5ed80693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0010e0 tx=0x7f5eec007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.439+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee8053160 con 0x7f5ee0003a60 2023-10-09T11:36:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:10.676+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ef80b2020 con 0x7f5ee0003a60 2023-10-09T11:36:11.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.284+0000 7f5ee67fc700 1 -- 172.21.15.26:0/1007423070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ee80170c0 con 0x7f5ee0003a60 2023-10-09T11:36:11.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 msgr2=0x7f5ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 0x7f5ed80693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0010e0 tx=0x7f5eec007040 comp rx=0 tx=0).stop 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 msgr2=0x7f5ef814a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800e4b0 tx=0x7f5ee801a000 comp rx=0 tx=0).stop 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 shutdown_connections 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ef80b1670 0x7f5ef80b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee0003a60 0x7f5ef814a3d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 --2- 172.21.15.26:0/1007423070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815bf00 0x7f5ef815c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 >> 172.21.15.26:0/1007423070 conn(0x7f5ef80703a0 msgr2=0x7f5ef80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 shutdown_connections 2023-10-09T11:36:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.286+0000 7f5efcbe3700 1 -- 172.21.15.26:0/1007423070 wait complete. 2023-10-09T11:36:11.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.423+0000 7f983f220700 1 Processor -- start 2023-10-09T11:36:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.423+0000 7f983f220700 1 -- start start 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 0x7f98380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98380cde50 0x7f983815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98380d13f0 con 0x7f98380cde50 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983815a940 con 0x7f98380cb5a0 2023-10-09T11:36:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983f220700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983815ae40 con 0x7f98380cd9e0 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983d7bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98380cde50 0x7f983815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983d7bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98380cde50 0x7f983815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50542/0 (socket says 172.21.15.26:50542) 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983d7bd700 1 -- 172.21.15.26:0/2962680941 learned_addr learned my addr 172.21.15.26:0/2962680941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f9837fff700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.424+0000 7f983cfbc700 1 --2- 172.21.15.26:0/2962680941 >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 0x7f98380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 -- 172.21.15.26:0/2962680941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 msgr2=0x7f9838159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 -- 172.21.15.26:0/2962680941 >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 msgr2=0x7f98380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 --2- 172.21.15.26:0/2962680941 >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 0x7f98380cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 -- 172.21.15.26:0/2962680941 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983815ab60 con 0x7f98380cde50 2023-10-09T11:36:11.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983cfbc700 1 --2- 172.21.15.26:0/2962680941 >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 0x7f98380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f9837fff700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983d7bd700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380cde50 0x7f983815a400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9838065120 tx=0x7f9820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fba582c26fdbb91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f98377fe700 1 -- 172.21.15.26:0/2962680941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000b820 con 0x7f98380cde50 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f98377fe700 1 -- 172.21.15.26:0/2962680941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000b980 con 0x7f98380cde50 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f98377fe700 1 -- 172.21.15.26:0/2962680941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000bd20 con 0x7f98380cde50 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983f220700 1 -- 172.21.15.26:0/2962680941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380cde50 msgr2=0x7f983815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.425+0000 7f983f220700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380cde50 0x7f983815a400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9838065120 tx=0x7f9820009250 comp rx=0 tx=0).stop 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 -- 172.21.15.26:0/2962680941 shutdown_connections 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 --2- 172.21.15.26:0/2962680941 >> v2:172.21.15.67:3300/0 conn(0x7f98380cb5a0 0x7f98380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380cde50 0x7f983815a400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 --2- 172.21.15.26:0/2962680941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 -- 172.21.15.26:0/2962680941 >> 172.21.15.26:0/2962680941 conn(0x7f9838070e30 msgr2=0x7f98380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 -- 172.21.15.26:0/2962680941 shutdown_connections 2023-10-09T11:36:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.426+0000 7f983f220700 1 -- 172.21.15.26:0/2962680941 wait complete. 2023-10-09T11:36:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.427+0000 7f983f220700 1 Processor -- start 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.427+0000 7f983f220700 1 -- start start 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 0x7f9838158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98381583c0 con 0x7f98381592d0 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98380b3de0 con 0x7f98380cb5a0 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9838157820 con 0x7f98380cd9e0 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50558/0 (socket says 172.21.15.26:50558) 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 -- 172.21.15.26:0/3594309282 learned_addr learned my addr 172.21.15.26:0/3594309282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983cfbc700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 0x7f9838158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f9837fff700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 -- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 msgr2=0x7f9838158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 -- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 msgr2=0x7f9838158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 0x7f9838158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 -- 172.21.15.26:0/3594309282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200094f0 con 0x7f98381592d0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983cfbc700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 0x7f9838158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f9837fff700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983d7bd700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f98200099b0 tx=0x7f9820017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000b820 con 0x7f98381592d0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982001f070 con 0x7f98381592d0 2023-10-09T11:36:11.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98381518a0 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982001b890 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.428+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9838157d70 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.429+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983804c3c0 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.430+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f982001bc40 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.430+0000 7f9834ff9700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 0x7f98180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.430+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9820021070 con 0x7f98381592d0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.430+0000 7f983cfbc700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 0x7f98180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.431+0000 7f983cfbc700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 0x7f98180693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9830006f00 tx=0x7f9830008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.434+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98200536f0 con 0x7f98381592d0 2023-10-09T11:36:11.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.671+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9838158500 con 0x7f98381592d0 2023-10-09T11:36:11.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.672+0000 7f9834ff9700 1 -- 172.21.15.26:0/3594309282 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9820056d10 con 0x7f98381592d0 2023-10-09T11:36:11.673 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:11.674 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3752557440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3752557440},{"type":"v1","addr":"172.21.15.26:6834","nonce":3752557440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:11.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.673+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 msgr2=0x7f98180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.673+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 0x7f98180693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9830006f00 tx=0x7f9830008040 comp rx=0 tx=0).stop 2023-10-09T11:36:11.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.673+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 msgr2=0x7f98380ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.673+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f98200099b0 tx=0x7f9820017000 comp rx=0 tx=0).stop 2023-10-09T11:36:11.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 shutdown_connections 2023-10-09T11:36:11.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98381592d0 0x7f98380ce230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98380cb5a0 0x7f9838158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9818066f30 0x7f98180693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 --2- 172.21.15.26:0/3594309282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98380cd9e0 0x7f9838158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 >> 172.21.15.26:0/3594309282 conn(0x7f9838070e30 msgr2=0x7f98380af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 shutdown_connections 2023-10-09T11:36:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.674+0000 7f983f220700 1 -- 172.21.15.26:0/3594309282 wait complete. 2023-10-09T11:36:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 16 2023-10-09T11:36:11.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.805+0000 7fc0ccbe3700 1 Processor -- start 2023-10-09T11:36:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.805+0000 7fc0ccbe3700 1 -- start start 2023-10-09T11:36:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0ccbe3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c815de50 0x7fc0c80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0ccbe3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 0x7fc0c815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0ccbe3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c80cf3c0 con 0x7fc0c8153c30 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0ccbe3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c815afd0 con 0x7fc0c815de50 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0ccbe3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c815b2b0 con 0x7fc0c80cef40 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c815de50 0x7fc0c80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0c8153c30 0x7fc0c815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50340/0 (socket says 172.21.15.26:50340) 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c77fe700 1 -- 172.21.15.26:0/2106359885 learned_addr learned my addr 172.21.15.26:0/2106359885 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c7fff700 1 --2- 172.21.15.26:0/2106359885 >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 0x7fc0c815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c67fc700 1 -- 172.21.15.26:0/2106359885 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280410107 0 0) 0x7fc0c80cf3c0 con 0x7fc0c8153c30 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c67fc700 1 -- 172.21.15.26:0/2106359885 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b0003570 con 0x7fc0c8153c30 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c6ffd700 1 -- 172.21.15.26:0/2106359885 >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 msgr2=0x7fc0c815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c6ffd700 1 --2- 172.21.15.26:0/2106359885 >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 0x7fc0c815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c6ffd700 1 -- 172.21.15.26:0/2106359885 >> v1:172.21.15.26:6789/0 conn(0x7fc0c8153c30 legacy=0x7fc0c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c6ffd700 1 -- 172.21.15.26:0/2106359885 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c815b590 con 0x7fc0c815de50 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.806+0000 7fc0c7fff700 1 --2- 172.21.15.26:0/2106359885 >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 0x7fc0c815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0c6ffd700 1 --2- 172.21.15.26:0/2106359885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c815de50 0x7fc0c80cea00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80cdab0 tx=0x7fc0bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5708f9b940637bff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0c67fc700 1 -- 172.21.15.26:0/2106359885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc011630 con 0x7fc0c815de50 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0c67fc700 1 -- 172.21.15.26:0/2106359885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc011790 con 0x7fc0c815de50 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0c67fc700 1 -- 172.21.15.26:0/2106359885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc011b30 con 0x7fc0c815de50 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2106359885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c815de50 msgr2=0x7fc0c80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2106359885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c815de50 0x7fc0c80cea00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80cdab0 tx=0x7fc0bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2106359885 shutdown_connections 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2106359885 >> v2:172.21.15.67:3300/0 conn(0x7fc0c80cef40 0x7fc0c815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2106359885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c815de50 0x7fc0c80cea00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2106359885 >> 172.21.15.26:0/2106359885 conn(0x7fc0c80703a0 msgr2=0x7fc0c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2106359885 shutdown_connections 2023-10-09T11:36:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.807+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2106359885 wait complete. 2023-10-09T11:36:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 Processor -- start 2023-10-09T11:36:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 -- start start 2023-10-09T11:36:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c8153c30 0x7fc0c8152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 0x7fc0c816a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80cd5c0 con 0x7fc0c80cef40 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80cbb70 con 0x7fc0c815de50 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0ccbe3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c816a5e0 con 0x7fc0c8153c30 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50574/0 (socket says 172.21.15.26:50574) 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.809+0000 7fc0c77fe700 1 -- 172.21.15.26:0/2164802933 learned_addr learned my addr 172.21.15.26:0/2164802933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c7fff700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 0x7fc0c816a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c6ffd700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c8153c30 0x7fc0c8152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 -- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c8153c30 msgr2=0x7fc0c8152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c8153c30 0x7fc0c8152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 -- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 msgr2=0x7fc0c816a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 0x7fc0c816a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 -- 172.21.15.26:0/2164802933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc009420 con 0x7fc0c80cef40 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c7fff700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 0x7fc0c816a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0c77fe700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c5c0 tx=0x7fc0b8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8005b30 con 0x7fc0c80cef40 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8005c90 con 0x7fc0c80cef40 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c80cb240 con 0x7fc0c80cef40 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8007300 con 0x7fc0c80cef40 2023-10-09T11:36:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.810+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c80cb800 con 0x7fc0c80cef40 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.811+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c804c3c0 con 0x7fc0c80cef40 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.812+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0b801b3b0 con 0x7fc0c80cef40 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.812+0000 7fc0af7fe700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 0x7fc0b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.812+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0b8083960 con 0x7fc0c80cef40 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.812+0000 7fc0c6ffd700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 0x7fc0b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.813+0000 7fc0c6ffd700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 0x7fc0b40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0091e0 tx=0x7fc0bc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:11.817+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0b8050bd0 con 0x7fc0c80cef40 2023-10-09T11:36:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.010+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0c80caef0 con 0x7fc0c80cef40 2023-10-09T11:36:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.011+0000 7fc0af7fe700 1 -- 172.21.15.26:0/2164802933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc0b8017020 con 0x7fc0c80cef40 2023-10-09T11:36:12.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:12.011 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:09.270059+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 msgr2=0x7fc0b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 0x7fc0b40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0091e0 tx=0x7fc0bc017000 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 msgr2=0x7fc0c80ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c5c0 tx=0x7fc0b8007e00 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 shutdown_connections 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c815de50 0x7fc0c816a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c80cef40 0x7fc0c80ccf50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0b4066f30 0x7fc0b40693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 --2- 172.21.15.26:0/2164802933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0c8153c30 0x7fc0c8152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 >> 172.21.15.26:0/2164802933 conn(0x7fc0c80703a0 msgr2=0x7fc0c80c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 shutdown_connections 2023-10-09T11:36:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.013+0000 7fc0ccbe3700 1 -- 172.21.15.26:0/2164802933 wait complete. 2023-10-09T11:36:12.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:36:12.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 Processor -- start 2023-10-09T11:36:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 -- start start 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f55c40cb970 0x7f55c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 0x7f55c4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c415ae40 con 0x7f55c40cb5a0 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c40ce0f0 con 0x7f55c40cb970 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.145+0000 7f55c98a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40d13f0 con 0x7f55c415a400 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f55c40cb970 0x7f55c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f55c40cb970 0x7f55c4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50586/0 (socket says 172.21.15.26:50586) 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 -- 172.21.15.26:0/662303080 learned_addr learned my addr 172.21.15.26:0/662303080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c37fe700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 0x7f55c4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 -- 172.21.15.26:0/662303080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 msgr2=0x7f55c4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 0x7f55c4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 -- 172.21.15.26:0/662303080 >> v1:172.21.15.67:6789/0 conn(0x7f55c40cb5a0 legacy=0x7f55c40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 -- 172.21.15.26:0/662303080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c415ab60 con 0x7f55c40cb970 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c37fe700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 0x7f55c4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c27fc700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4159ec0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0099b0 tx=0x7f55ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dff1c9a3774aea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c1ffb700 1 -- 172.21.15.26:0/662303080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00b860 con 0x7f55c40cb970 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c1ffb700 1 -- 172.21.15.26:0/662303080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac00b9c0 con 0x7f55c40cb970 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.146+0000 7f55c1ffb700 1 -- 172.21.15.26:0/662303080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00bd60 con 0x7f55c40cb970 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 -- 172.21.15.26:0/662303080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 msgr2=0x7f55c4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4159ec0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0099b0 tx=0x7f55ac009250 comp rx=0 tx=0).stop 2023-10-09T11:36:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 -- 172.21.15.26:0/662303080 shutdown_connections 2023-10-09T11:36:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c415a400 0x7f55c4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 --2- 172.21.15.26:0/662303080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4159ec0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 -- 172.21.15.26:0/662303080 >> 172.21.15.26:0/662303080 conn(0x7f55c4070e30 msgr2=0x7f55c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 -- 172.21.15.26:0/662303080 shutdown_connections 2023-10-09T11:36:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.147+0000 7f55c98a0700 1 -- 172.21.15.26:0/662303080 wait complete. 2023-10-09T11:36:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.148+0000 7f55c98a0700 1 Processor -- start 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.148+0000 7f55c98a0700 1 -- start start 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 0x7f55c4154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c415a400 0x7f55c4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c41583b0 con 0x7f55c40cb970 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c41577a0 con 0x7f55c415a400 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c98a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4157a80 con 0x7f55c40cb5a0 2023-10-09T11:36:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50590/0 (socket says 172.21.15.26:50590) 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 -- 172.21.15.26:0/3431914336 learned_addr learned my addr 172.21.15.26:0/3431914336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c2ffd700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 0x7f55c4154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 -- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 msgr2=0x7f55c4154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 0x7f55c4154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c37fe700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c415a400 0x7f55c4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 -- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c415a400 msgr2=0x7f55c4155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c415a400 0x7f55c4155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 -- 172.21.15.26:0/3431914336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0094f0 con 0x7f55c40cb970 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c2ffd700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 0x7f55c4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55c27fc700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009290 tx=0x7f55ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.149+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac026480 con 0x7f55c40cb970 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.150+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac01f070 con 0x7f55c40cb970 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.150+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac026830 con 0x7f55c40cb970 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.150+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c4157d60 con 0x7f55c40cb970 2023-10-09T11:36:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.150+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c41504d0 con 0x7f55c40cb970 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.150+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4158560 con 0x7f55c40cb970 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.151+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55ac026ba0 con 0x7f55c40cb970 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.151+0000 7f55baffd700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.152+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55ac021070 con 0x7f55c40cb970 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.152+0000 7f55c2ffd700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.152+0000 7f55c2ffd700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 0x7f55a40693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f55bc007fd0 tx=0x7f55bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.156+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55c4158560 con 0x7f55c40cb970 2023-10-09T11:36:12.249 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-10-09T11:36:12.249+0000 7f9703c39700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.346+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55c404c3c0 con 0x7f55a4066f30 2023-10-09T11:36:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.355+0000 7f55baffd700 1 -- 172.21.15.26:0/3431914336 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257264 (secure 0 0 0) 0x7f55c404c3c0 con 0x7f55a4066f30 2023-10-09T11:36:12.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 msgr2=0x7f55a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 0x7f55a40693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f55bc007fd0 tx=0x7f55bc009040 comp rx=0 tx=0).stop 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 msgr2=0x7f55c4155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009290 tx=0x7f55ac017000 comp rx=0 tx=0).stop 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 shutdown_connections 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55c415a400 0x7f55c4155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55c40cb5a0 0x7f55c4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 --2- 172.21.15.26:0/3431914336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40cb970 0x7f55c4155580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 >> 172.21.15.26:0/3431914336 conn(0x7f55c4070e30 msgr2=0x7f55c40b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 shutdown_connections 2023-10-09T11:36:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.358+0000 7f55c98a0700 1 -- 172.21.15.26:0/3431914336 wait complete. 2023-10-09T11:36:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:12.371 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-09T11:36:11.115203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591926,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2386152,"kb_used_data":3752,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588568,"statfs":{"total":773094113280,"available":770650693632,"internally_reserved":0,"allocated":3842048,"data_stored":2162638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1558,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854316"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284791+0000","last_change":"2023-10-09T11:36:08.278687+0000","last_active":"2023-10-09T11:36:08.284791+0000","last_peered":"2023-10-09T11:36:08.284791+0000","last_clean":"2023-10-09T11:36:08.284791+0000","last_became_active":"2023-10-09T11:36:08.278178+0000","last_became_peered":"2023-10-09T11:36:08.278178+0000","last_unstale":"2023-10-09T11:36:08.284791+0000","last_undegraded":"2023-10-09T11:36:08.284791+0000","last_fullsized":"2023-10-09T11:36:08.284791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:20.367711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293502+0000","last_change":"2023-10-09T11:36:08.287587+0000","last_active":"2023-10-09T11:36:08.293502+0000","last_peered":"2023-10-09T11:36:08.293502+0000","last_clean":"2023-10-09T11:36:08.293502+0000","last_became_active":"2023-10-09T11:36:08.287318+0000","last_became_peered":"2023-10-09T11:36:08.287318+0000","last_unstale":"2023-10-09T11:36:08.293502+0000","last_undegraded":"2023-10-09T11:36:08.293502+0000","last_fullsized":"2023-10-09T11:36:08.293502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285522+0000","last_change":"2023-10-09T11:36:08.281401+0000","last_active":"2023-10-09T11:36:08.285522+0000","last_peered":"2023-10-09T11:36:08.285522+0000","last_clean":"2023-10-09T11:36:08.285522+0000","last_became_active":"2023-10-09T11:36:08.281182+0000","last_became_peered":"2023-10-09T11:36:08.281182+0000","last_unstale":"2023-10-09T11:36:08.285522+0000","last_undegraded":"2023-10-09T11:36:08.285522+0000","last_fullsized":"2023-10-09T11:36:08.285522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.995381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281091+0000","last_change":"2023-10-09T11:36:08.276410+0000","last_active":"2023-10-09T11:36:08.281091+0000","last_peered":"2023-10-09T11:36:08.281091+0000","last_clean":"2023-10-09T11:36:08.281091+0000","last_became_active":"2023-10-09T11:36:08.276128+0000","last_became_peered":"2023-10-09T11:36:08.276128+0000","last_unstale":"2023-10-09T11:36:08.281091+0000","last_undegraded":"2023-10-09T11:36:08.281091+0000","last_fullsized":"2023-10-09T11:36:08.281091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292827+0000","last_change":"2023-10-09T11:36:08.281785+0000","last_active":"2023-10-09T11:36:08.292827+0000","last_peered":"2023-10-09T11:36:08.292827+0000","last_clean":"2023-10-09T11:36:08.292827+0000","last_became_active":"2023-10-09T11:36:08.281520+0000","last_became_peered":"2023-10-09T11:36:08.281520+0000","last_unstale":"2023-10-09T11:36:08.292827+0000","last_undegraded":"2023-10-09T11:36:08.292827+0000","last_fullsized":"2023-10-09T11:36:08.292827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293117+0000","last_change":"2023-10-09T11:36:08.288046+0000","last_active":"2023-10-09T11:36:08.293117+0000","last_peered":"2023-10-09T11:36:08.293117+0000","last_clean":"2023-10-09T11:36:08.293117+0000","last_became_active":"2023-10-09T11:36:08.287767+0000","last_became_peered":"2023-10-09T11:36:08.287767+0000","last_unstale":"2023-10-09T11:36:08.293117+0000","last_undegraded":"2023-10-09T11:36:08.293117+0000","last_fullsized":"2023-10-09T11:36:08.293117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:19.830919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285647+0000","last_change":"2023-10-09T11:36:08.280935+0000","last_active":"2023-10-09T11:36:08.285647+0000","last_peered":"2023-10-09T11:36:08.285647+0000","last_clean":"2023-10-09T11:36:08.285647+0000","last_became_active":"2023-10-09T11:36:08.280551+0000","last_became_peered":"2023-10-09T11:36:08.280551+0000","last_unstale":"2023-10-09T11:36:08.285647+0000","last_undegraded":"2023-10-09T11:36:08.285647+0000","last_fullsized":"2023-10-09T11:36:08.285647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293161+0000","last_change":"2023-10-09T11:36:08.290167+0000","last_active":"2023-10-09T11:36:08.293161+0000","last_peered":"2023-10-09T11:36:08.293161+0000","last_clean":"2023-10-09T11:36:08.293161+0000","last_became_active":"2023-10-09T11:36:08.289904+0000","last_became_peered":"2023-10-09T11:36:08.289904+0000","last_unstale":"2023-10-09T11:36:08.293161+0000","last_undegraded":"2023-10-09T11:36:08.293161+0000","last_fullsized":"2023-10-09T11:36:08.293161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293115+0000","last_change":"2023-10-09T11:36:08.290062+0000","last_active":"2023-10-09T11:36:08.293115+0000","last_peered":"2023-10-09T11:36:08.293115+0000","last_clean":"2023-10-09T11:36:08.293115+0000","last_became_active":"2023-10-09T11:36:08.289712+0000","last_became_peered":"2023-10-09T11:36:08.289712+0000","last_unstale":"2023-10-09T11:36:08.293115+0000","last_undegraded":"2023-10-09T11:36:08.293115+0000","last_fullsized":"2023-10-09T11:36:08.293115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:29.618537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290792+0000","last_change":"2023-10-09T11:36:08.286490+0000","last_active":"2023-10-09T11:36:08.290792+0000","last_peered":"2023-10-09T11:36:08.290792+0000","last_clean":"2023-10-09T11:36:08.290792+0000","last_became_active":"2023-10-09T11:36:08.286235+0000","last_became_peered":"2023-10-09T11:36:08.286235+0000","last_unstale":"2023-10-09T11:36:08.290792+0000","last_undegraded":"2023-10-09T11:36:08.290792+0000","last_fullsized":"2023-10-09T11:36:08.290792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:54.131479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.280028+0000","last_change":"2023-10-09T11:36:08.275290+0000","last_active":"2023-10-09T11:36:08.280028+0000","last_peered":"2023-10-09T11:36:08.280028+0000","last_clean":"2023-10-09T11:36:08.280028+0000","last_became_active":"2023-10-09T11:36:08.275001+0000","last_became_peered":"2023-10-09T11:36:08.275001+0000","last_unstale":"2023-10-09T11:36:08.280028+0000","last_undegraded":"2023-10-09T11:36:08.280028+0000","last_fullsized":"2023-10-09T11:36:08.280028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292622+0000","last_change":"2023-10-09T11:36:08.279702+0000","last_active":"2023-10-09T11:36:08.292622+0000","last_peered":"2023-10-09T11:36:08.292622+0000","last_clean":"2023-10-09T11:36:08.292622+0000","last_became_active":"2023-10-09T11:36:08.279443+0000","last_became_peered":"2023-10-09T11:36:08.279443+0000","last_unstale":"2023-10-09T11:36:08.292622+0000","last_undegraded":"2023-10-09T11:36:08.292622+0000","last_fullsized":"2023-10-09T11:36:08.292622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284772+0000","last_change":"2023-10-09T11:36:08.278434+0000","last_active":"2023-10-09T11:36:08.284772+0000","last_peered":"2023-10-09T11:36:08.284772+0000","last_clean":"2023-10-09T11:36:08.284772+0000","last_became_active":"2023-10-09T11:36:08.277846+0000","last_became_peered":"2023-10-09T11:36:08.277846+0000","last_unstale":"2023-10-09T11:36:08.284772+0000","last_undegraded":"2023-10-09T11:36:08.284772+0000","last_fullsized":"2023-10-09T11:36:08.284772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:59.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293733+0000","last_change":"2023-10-09T11:36:08.288625+0000","last_active":"2023-10-09T11:36:08.293733+0000","last_peered":"2023-10-09T11:36:08.293733+0000","last_clean":"2023-10-09T11:36:08.293733+0000","last_became_active":"2023-10-09T11:36:08.287902+0000","last_became_peered":"2023-10-09T11:36:08.287902+0000","last_unstale":"2023-10-09T11:36:08.293733+0000","last_undegraded":"2023-10-09T11:36:08.293733+0000","last_fullsized":"2023-10-09T11:36:08.293733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284934+0000","last_change":"2023-10-09T11:36:08.280784+0000","last_active":"2023-10-09T11:36:08.284934+0000","last_peered":"2023-10-09T11:36:08.284934+0000","last_clean":"2023-10-09T11:36:08.284934+0000","last_became_active":"2023-10-09T11:36:08.280527+0000","last_became_peered":"2023-10-09T11:36:08.280527+0000","last_unstale":"2023-10-09T11:36:08.284934+0000","last_undegraded":"2023-10-09T11:36:08.284934+0000","last_fullsized":"2023-10-09T11:36:08.284934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284941+0000","last_change":"2023-10-09T11:36:07.282358+0000","last_active":"2023-10-09T11:36:08.284941+0000","last_peered":"2023-10-09T11:36:08.284941+0000","last_clean":"2023-10-09T11:36:08.284941+0000","last_became_active":"2023-10-09T11:36:07.282052+0000","last_became_peered":"2023-10-09T11:36:07.282052+0000","last_unstale":"2023-10-09T11:36:08.284941+0000","last_undegraded":"2023-10-09T11:36:08.284941+0000","last_fullsized":"2023-10-09T11:36:08.284941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294196+0000","last_change":"2023-10-09T11:36:07.277817+0000","last_active":"2023-10-09T11:36:08.294196+0000","last_peered":"2023-10-09T11:36:08.294196+0000","last_clean":"2023-10-09T11:36:08.294196+0000","last_became_active":"2023-10-09T11:36:07.277546+0000","last_became_peered":"2023-10-09T11:36:07.277546+0000","last_unstale":"2023-10-09T11:36:08.294196+0000","last_undegraded":"2023-10-09T11:36:08.294196+0000","last_fullsized":"2023-10-09T11:36:08.294196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293757+0000","last_change":"2023-10-09T11:36:08.288692+0000","last_active":"2023-10-09T11:36:08.293757+0000","last_peered":"2023-10-09T11:36:08.293757+0000","last_clean":"2023-10-09T11:36:08.293757+0000","last_became_active":"2023-10-09T11:36:08.288192+0000","last_became_peered":"2023-10-09T11:36:08.288192+0000","last_unstale":"2023-10-09T11:36:08.293757+0000","last_undegraded":"2023-10-09T11:36:08.293757+0000","last_fullsized":"2023-10-09T11:36:08.293757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293387+0000","last_change":"2023-10-09T11:36:07.274424+0000","last_active":"2023-10-09T11:36:08.293387+0000","last_peered":"2023-10-09T11:36:08.293387+0000","last_clean":"2023-10-09T11:36:08.293387+0000","last_became_active":"2023-10-09T11:36:07.274134+0000","last_became_peered":"2023-10-09T11:36:07.274134+0000","last_unstale":"2023-10-09T11:36:08.293387+0000","last_undegraded":"2023-10-09T11:36:08.293387+0000","last_fullsized":"2023-10-09T11:36:08.293387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:01.291196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.278182+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277722+0000","last_became_peered":"2023-10-09T11:36:07.277722+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:49.147228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292591+0000","last_change":"2023-10-09T11:36:08.279232+0000","last_active":"2023-10-09T11:36:08.292591+0000","last_peered":"2023-10-09T11:36:08.292591+0000","last_clean":"2023-10-09T11:36:08.292591+0000","last_became_active":"2023-10-09T11:36:08.278961+0000","last_became_peered":"2023-10-09T11:36:08.278961+0000","last_unstale":"2023-10-09T11:36:08.292591+0000","last_undegraded":"2023-10-09T11:36:08.292591+0000","last_fullsized":"2023-10-09T11:36:08.292591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270323+0000","last_change":"2023-10-09T11:36:07.284759+0000","last_active":"2023-10-09T11:36:08.270323+0000","last_peered":"2023-10-09T11:36:08.270323+0000","last_clean":"2023-10-09T11:36:08.270323+0000","last_became_active":"2023-10-09T11:36:07.284467+0000","last_became_peered":"2023-10-09T11:36:07.284467+0000","last_unstale":"2023-10-09T11:36:08.270323+0000","last_undegraded":"2023-10-09T11:36:08.270323+0000","last_fullsized":"2023-10-09T11:36:08.270323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:17.431372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293199+0000","last_change":"2023-10-09T11:36:08.290418+0000","last_active":"2023-10-09T11:36:08.293199+0000","last_peered":"2023-10-09T11:36:08.293199+0000","last_clean":"2023-10-09T11:36:08.293199+0000","last_became_active":"2023-10-09T11:36:08.289613+0000","last_became_peered":"2023-10-09T11:36:08.289613+0000","last_unstale":"2023-10-09T11:36:08.293199+0000","last_undegraded":"2023-10-09T11:36:08.293199+0000","last_fullsized":"2023-10-09T11:36:08.293199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269028+0000","last_change":"2023-10-09T11:36:07.274812+0000","last_active":"2023-10-09T11:36:08.269028+0000","last_peered":"2023-10-09T11:36:08.269028+0000","last_clean":"2023-10-09T11:36:08.269028+0000","last_became_active":"2023-10-09T11:36:07.274502+0000","last_became_peered":"2023-10-09T11:36:07.274502+0000","last_unstale":"2023-10-09T11:36:08.269028+0000","last_undegraded":"2023-10-09T11:36:08.269028+0000","last_fullsized":"2023-10-09T11:36:08.269028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291889+0000","last_change":"2023-10-09T11:36:08.277583+0000","last_active":"2023-10-09T11:36:08.291889+0000","last_peered":"2023-10-09T11:36:08.291889+0000","last_clean":"2023-10-09T11:36:08.291889+0000","last_became_active":"2023-10-09T11:36:08.277284+0000","last_became_peered":"2023-10-09T11:36:08.277284+0000","last_unstale":"2023-10-09T11:36:08.291889+0000","last_undegraded":"2023-10-09T11:36:08.291889+0000","last_fullsized":"2023-10-09T11:36:08.291889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:06.511358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.296058+0000","last_change":"2023-10-09T11:36:07.278932+0000","last_active":"2023-10-09T11:36:08.296058+0000","last_peered":"2023-10-09T11:36:08.296058+0000","last_clean":"2023-10-09T11:36:08.296058+0000","last_became_active":"2023-10-09T11:36:07.278663+0000","last_became_peered":"2023-10-09T11:36:07.278663+0000","last_unstale":"2023-10-09T11:36:08.296058+0000","last_undegraded":"2023-10-09T11:36:08.296058+0000","last_fullsized":"2023-10-09T11:36:08.296058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:12.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292177+0000","last_change":"2023-10-09T11:36:08.276944+0000","last_active":"2023-10-09T11:36:08.292177+0000","last_peered":"2023-10-09T11:36:08.292177+0000","last_clean":"2023-10-09T11:36:08.292177+0000","last_became_active":"2023-10-09T11:36:08.276663+0000","last_became_peered":"2023-10-09T11:36:08.276663+0000","last_unstale":"2023-10-09T11:36:08.292177+0000","last_undegraded":"2023-10-09T11:36:08.292177+0000","last_fullsized":"2023-10-09T11:36:08.292177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285785+0000","last_change":"2023-10-09T11:36:08.280498+0000","last_active":"2023-10-09T11:36:08.285785+0000","last_peered":"2023-10-09T11:36:08.285785+0000","last_clean":"2023-10-09T11:36:08.285785+0000","last_became_active":"2023-10-09T11:36:08.280194+0000","last_became_peered":"2023-10-09T11:36:08.280194+0000","last_unstale":"2023-10-09T11:36:08.285785+0000","last_undegraded":"2023-10-09T11:36:08.285785+0000","last_fullsized":"2023-10-09T11:36:08.285785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.267965+0000","last_change":"2023-10-09T11:36:07.277846+0000","last_active":"2023-10-09T11:36:08.267965+0000","last_peered":"2023-10-09T11:36:08.267965+0000","last_clean":"2023-10-09T11:36:08.267965+0000","last_became_active":"2023-10-09T11:36:07.277548+0000","last_became_peered":"2023-10-09T11:36:07.277548+0000","last_unstale":"2023-10-09T11:36:08.267965+0000","last_undegraded":"2023-10-09T11:36:08.267965+0000","last_fullsized":"2023-10-09T11:36:08.267965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270091+0000","last_change":"2023-10-09T11:36:07.284865+0000","last_active":"2023-10-09T11:36:08.270091+0000","last_peered":"2023-10-09T11:36:08.270091+0000","last_clean":"2023-10-09T11:36:08.270091+0000","last_became_active":"2023-10-09T11:36:07.284588+0000","last_became_peered":"2023-10-09T11:36:07.284588+0000","last_unstale":"2023-10-09T11:36:08.270091+0000","last_undegraded":"2023-10-09T11:36:08.270091+0000","last_fullsized":"2023-10-09T11:36:08.270091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.090633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294798+0000","last_change":"2023-10-09T11:36:07.276787+0000","last_active":"2023-10-09T11:36:08.294798+0000","last_peered":"2023-10-09T11:36:08.294798+0000","last_clean":"2023-10-09T11:36:08.294798+0000","last_became_active":"2023-10-09T11:36:07.276512+0000","last_became_peered":"2023-10-09T11:36:07.276512+0000","last_unstale":"2023-10-09T11:36:08.294798+0000","last_undegraded":"2023-10-09T11:36:08.294798+0000","last_fullsized":"2023-10-09T11:36:08.294798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294540+0000","last_change":"2023-10-09T11:36:07.279427+0000","last_active":"2023-10-09T11:36:08.294540+0000","last_peered":"2023-10-09T11:36:08.294540+0000","last_clean":"2023-10-09T11:36:08.294540+0000","last_became_active":"2023-10-09T11:36:07.278936+0000","last_became_peered":"2023-10-09T11:36:07.278936+0000","last_unstale":"2023-10-09T11:36:08.294540+0000","last_undegraded":"2023-10-09T11:36:08.294540+0000","last_fullsized":"2023-10-09T11:36:08.294540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293202+0000","last_change":"2023-10-09T11:36:08.285067+0000","last_active":"2023-10-09T11:36:08.293202+0000","last_peered":"2023-10-09T11:36:08.293202+0000","last_clean":"2023-10-09T11:36:08.293202+0000","last_became_active":"2023-10-09T11:36:08.284743+0000","last_became_peered":"2023-10-09T11:36:08.284743+0000","last_unstale":"2023-10-09T11:36:08.293202+0000","last_undegraded":"2023-10-09T11:36:08.293202+0000","last_fullsized":"2023-10-09T11:36:08.293202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285708+0000","last_change":"2023-10-09T11:36:08.279359+0000","last_active":"2023-10-09T11:36:08.285708+0000","last_peered":"2023-10-09T11:36:08.285708+0000","last_clean":"2023-10-09T11:36:08.285708+0000","last_became_active":"2023-10-09T11:36:08.279085+0000","last_became_peered":"2023-10-09T11:36:08.279085+0000","last_unstale":"2023-10-09T11:36:08.285708+0000","last_undegraded":"2023-10-09T11:36:08.285708+0000","last_fullsized":"2023-10-09T11:36:08.285708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.850239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285485+0000","last_change":"2023-10-09T11:36:08.282867+0000","last_active":"2023-10-09T11:36:08.285485+0000","last_peered":"2023-10-09T11:36:08.285485+0000","last_clean":"2023-10-09T11:36:08.285485+0000","last_became_active":"2023-10-09T11:36:08.282595+0000","last_became_peered":"2023-10-09T11:36:08.282595+0000","last_unstale":"2023-10-09T11:36:08.285485+0000","last_undegraded":"2023-10-09T11:36:08.285485+0000","last_fullsized":"2023-10-09T11:36:08.285485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.366025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292618+0000","last_change":"2023-10-09T11:36:07.275507+0000","last_active":"2023-10-09T11:36:08.292618+0000","last_peered":"2023-10-09T11:36:08.292618+0000","last_clean":"2023-10-09T11:36:08.292618+0000","last_became_active":"2023-10-09T11:36:07.273512+0000","last_became_peered":"2023-10-09T11:36:07.273512+0000","last_unstale":"2023-10-09T11:36:08.292618+0000","last_undegraded":"2023-10-09T11:36:08.292618+0000","last_fullsized":"2023-10-09T11:36:08.292618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285542+0000","last_change":"2023-10-09T11:36:08.282018+0000","last_active":"2023-10-09T11:36:08.285542+0000","last_peered":"2023-10-09T11:36:08.285542+0000","last_clean":"2023-10-09T11:36:08.285542+0000","last_became_active":"2023-10-09T11:36:08.281760+0000","last_became_peered":"2023-10-09T11:36:08.281760+0000","last_unstale":"2023-10-09T11:36:08.285542+0000","last_undegraded":"2023-10-09T11:36:08.285542+0000","last_fullsized":"2023-10-09T11:36:08.285542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:49.613786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285540+0000","last_change":"2023-10-09T11:36:08.277441+0000","last_active":"2023-10-09T11:36:08.285540+0000","last_peered":"2023-10-09T11:36:08.285540+0000","last_clean":"2023-10-09T11:36:08.285540+0000","last_became_active":"2023-10-09T11:36:08.277184+0000","last_became_peered":"2023-10-09T11:36:08.277184+0000","last_unstale":"2023-10-09T11:36:08.285540+0000","last_undegraded":"2023-10-09T11:36:08.285540+0000","last_fullsized":"2023-10-09T11:36:08.285540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:19.784715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287084+0000","last_change":"2023-10-09T11:36:08.284621+0000","last_active":"2023-10-09T11:36:08.287084+0000","last_peered":"2023-10-09T11:36:08.287084+0000","last_clean":"2023-10-09T11:36:08.287084+0000","last_became_active":"2023-10-09T11:36:08.284367+0000","last_became_peered":"2023-10-09T11:36:08.284367+0000","last_unstale":"2023-10-09T11:36:08.287084+0000","last_undegraded":"2023-10-09T11:36:08.287084+0000","last_fullsized":"2023-10-09T11:36:08.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:53.399703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293828+0000","last_change":"2023-10-09T11:36:07.278885+0000","last_active":"2023-10-09T11:36:08.293828+0000","last_peered":"2023-10-09T11:36:08.293828+0000","last_clean":"2023-10-09T11:36:08.293828+0000","last_became_active":"2023-10-09T11:36:07.278567+0000","last_became_peered":"2023-10-09T11:36:07.278567+0000","last_unstale":"2023-10-09T11:36:08.293828+0000","last_undegraded":"2023-10-09T11:36:08.293828+0000","last_fullsized":"2023-10-09T11:36:08.293828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269145+0000","last_change":"2023-10-09T11:36:07.273853+0000","last_active":"2023-10-09T11:36:08.269145+0000","last_peered":"2023-10-09T11:36:08.269145+0000","last_clean":"2023-10-09T11:36:08.269145+0000","last_became_active":"2023-10-09T11:36:07.273562+0000","last_became_peered":"2023-10-09T11:36:07.273562+0000","last_unstale":"2023-10-09T11:36:08.269145+0000","last_undegraded":"2023-10-09T11:36:08.269145+0000","last_fullsized":"2023-10-09T11:36:08.269145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290805+0000","last_change":"2023-10-09T11:36:08.289593+0000","last_active":"2023-10-09T11:36:08.290805+0000","last_peered":"2023-10-09T11:36:08.290805+0000","last_clean":"2023-10-09T11:36:08.290805+0000","last_became_active":"2023-10-09T11:36:08.289323+0000","last_became_peered":"2023-10-09T11:36:08.289323+0000","last_unstale":"2023-10-09T11:36:08.290805+0000","last_undegraded":"2023-10-09T11:36:08.290805+0000","last_fullsized":"2023-10-09T11:36:08.290805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.272883+0000","last_change":"2023-10-09T11:36:07.275895+0000","last_active":"2023-10-09T11:36:08.272883+0000","last_peered":"2023-10-09T11:36:08.272883+0000","last_clean":"2023-10-09T11:36:08.272883+0000","last_became_active":"2023-10-09T11:36:07.275394+0000","last_became_peered":"2023-10-09T11:36:07.275394+0000","last_unstale":"2023-10-09T11:36:08.272883+0000","last_undegraded":"2023-10-09T11:36:08.272883+0000","last_fullsized":"2023-10-09T11:36:08.272883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269401+0000","last_change":"2023-10-09T11:36:07.273764+0000","last_active":"2023-10-09T11:36:08.269401+0000","last_peered":"2023-10-09T11:36:08.269401+0000","last_clean":"2023-10-09T11:36:08.269401+0000","last_became_active":"2023-10-09T11:36:07.273471+0000","last_became_peered":"2023-10-09T11:36:07.273471+0000","last_unstale":"2023-10-09T11:36:08.269401+0000","last_undegraded":"2023-10-09T11:36:08.269401+0000","last_fullsized":"2023-10-09T11:36:08.269401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286251+0000","last_change":"2023-10-09T11:36:08.283848+0000","last_active":"2023-10-09T11:36:08.286251+0000","last_peered":"2023-10-09T11:36:08.286251+0000","last_clean":"2023-10-09T11:36:08.286251+0000","last_became_active":"2023-10-09T11:36:08.283566+0000","last_became_peered":"2023-10-09T11:36:08.283566+0000","last_unstale":"2023-10-09T11:36:08.286251+0000","last_undegraded":"2023-10-09T11:36:08.286251+0000","last_fullsized":"2023-10-09T11:36:08.286251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268004+0000","last_change":"2023-10-09T11:36:07.274431+0000","last_active":"2023-10-09T11:36:08.268004+0000","last_peered":"2023-10-09T11:36:08.268004+0000","last_clean":"2023-10-09T11:36:08.268004+0000","last_became_active":"2023-10-09T11:36:07.274154+0000","last_became_peered":"2023-10-09T11:36:07.274154+0000","last_unstale":"2023-10-09T11:36:08.268004+0000","last_undegraded":"2023-10-09T11:36:08.268004+0000","last_fullsized":"2023-10-09T11:36:08.268004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293193+0000","last_change":"2023-10-09T11:36:08.290591+0000","last_active":"2023-10-09T11:36:08.293193+0000","last_peered":"2023-10-09T11:36:08.293193+0000","last_clean":"2023-10-09T11:36:08.293193+0000","last_became_active":"2023-10-09T11:36:08.290327+0000","last_became_peered":"2023-10-09T11:36:08.290327+0000","last_unstale":"2023-10-09T11:36:08.293193+0000","last_undegraded":"2023-10-09T11:36:08.293193+0000","last_fullsized":"2023-10-09T11:36:08.293193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:28.125121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269124+0000","last_change":"2023-10-09T11:36:07.284950+0000","last_active":"2023-10-09T11:36:08.269124+0000","last_peered":"2023-10-09T11:36:08.269124+0000","last_clean":"2023-10-09T11:36:08.269124+0000","last_became_active":"2023-10-09T11:36:07.284605+0000","last_became_peered":"2023-10-09T11:36:07.284605+0000","last_unstale":"2023-10-09T11:36:08.269124+0000","last_undegraded":"2023-10-09T11:36:08.269124+0000","last_fullsized":"2023-10-09T11:36:08.269124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:10.864639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-09T11:36:01.253127+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:01.253127+0000","last_peered":"2023-10-09T11:36:01.253127+0000","last_clean":"2023-10-09T11:36:01.253127+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:01.253127+0000","last_undegraded":"2023-10-09T11:36:01.253127+0000","last_fullsized":"2023-10-09T11:36:01.253127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1558,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":702510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":721333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":137323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:12.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:12.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.529+0000 7fae2bbc6700 1 Processor -- start 2023-10-09T11:36:12.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.529+0000 7fae2bbc6700 1 -- start start 2023-10-09T11:36:12.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae2bbc6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae240cb970 0x7fae24159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae2bbc6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2415ae40 con 0x7fae240cb5a0 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae2bbc6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2415ab60 con 0x7fae2415a400 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae2bbc6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae240ce0f0 con 0x7fae240cb970 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae29962700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae240cb5a0 0x7fae240cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50350/0 (socket says 172.21.15.26:50350) 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae29962700 1 -- 172.21.15.26:0/1090337907 learned_addr learned my addr 172.21.15.26:0/1090337907 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.530+0000 7fae29161700 1 --2- 172.21.15.26:0/1090337907 >> v2:172.21.15.67:3300/0 conn(0x7fae240cb970 0x7fae24159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229992758 0 0) 0x7fae2415ae40 con 0x7fae240cb5a0 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae0c003570 con 0x7fae240cb5a0 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305641696 0 0) 0x7fae0c003570 con 0x7fae240cb5a0 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 >> v2:172.21.15.67:3300/0 conn(0x7fae240cb970 msgr2=0x7fae24159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 --2- 172.21.15.26:0/1090337907 >> v2:172.21.15.67:3300/0 conn(0x7fae240cb970 0x7fae24159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 >> v1:172.21.15.67:6789/0 conn(0x7fae2415a400 legacy=0x7fae24156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240ccf00 con 0x7fae240cb5a0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fae1c001470 con 0x7fae240cb5a0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 >> v1:172.21.15.26:6789/0 conn(0x7fae240cb5a0 legacy=0x7fae240cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae0c003a60 0x7fae0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c004810 0x7fae0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 0x7fae0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae240ce0f0 con 0x7fae0c0051c0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c00c0d0 con 0x7fae0c003a60 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c00c290 con 0x7fae0c004810 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae29962700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae0c003a60 0x7fae0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 0x7fae0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae29161700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c004810 0x7fae0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 -- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c004810 msgr2=0x7fae0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c004810 0x7fae0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 -- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae0c003a60 msgr2=0x7fae0c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae0c003a60 0x7fae0c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.531+0000 7fae2a163700 1 -- 172.21.15.26:0/1090337907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c003570 con 0x7fae0c0051c0 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2a163700 1 -- 172.21.15.26:0/1090337907 reap_dead start 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2a163700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 0x7fae0c00ba60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae14001fc0 tx=0x7fae14001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2622cef0d9702b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14001950 con 0x7fae0c0051c0 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1400c8b0 con 0x7fae0c0051c0 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae28960700 1 -- 172.21.15.26:0/1090337907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1400cc50 con 0x7fae0c0051c0 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 msgr2=0x7fae0c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 0x7fae0c00ba60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae14001fc0 tx=0x7fae14001640 comp rx=0 tx=0).stop 2023-10-09T11:36:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1090337907 shutdown_connections 2023-10-09T11:36:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1090337907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0c0051c0 0x7fae0c00ba60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1090337907 >> 172.21.15.26:0/1090337907 conn(0x7fae24070e30 msgr2=0x7fae240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1090337907 shutdown_connections 2023-10-09T11:36:12.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.532+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1090337907 wait complete. 2023-10-09T11:36:12.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 Processor -- start 2023-10-09T11:36:12.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 -- start start 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c0051c0 0x7fae240b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 0x7fae2415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae24153320 con 0x7fae2416caf0 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2416e010 con 0x7fae2416ac60 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae2bbc6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae240c9550 con 0x7fae0c0051c0 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae29161700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae29161700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50600/0 (socket says 172.21.15.26:50600) 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.534+0000 7fae29161700 1 -- 172.21.15.26:0/1497491871 learned_addr learned my addr 172.21.15.26:0/1497491871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29962700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c0051c0 0x7fae240b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae2a163700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 0x7fae2415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 -- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c0051c0 msgr2=0x7fae240b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c0051c0 0x7fae240b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 -- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 msgr2=0x7fae2415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 0x7fae2415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 -- 172.21.15.26:0/1497491871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240c9810 con 0x7fae2416caf0 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae2a163700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 0x7fae2415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae29161700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae18006ac0 tx=0x7fae180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800fa10 con 0x7fae2416caf0 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800fb70 con 0x7fae2416caf0 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2416d770 con 0x7fae2416caf0 2023-10-09T11:36:12.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18014440 con 0x7fae2416caf0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.535+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2416dd30 con 0x7fae2416caf0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.536+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae240c99a0 con 0x7fae2416caf0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.537+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae18014830 con 0x7fae2416caf0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.537+0000 7fae21ffb700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 0x7fae100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.537+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae18018030 con 0x7fae2416caf0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.537+0000 7fae29962700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 0x7fae100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.538+0000 7fae29962700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 0x7fae100693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0016e0 tx=0x7fae1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.541+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae18052230 con 0x7fae2416caf0 2023-10-09T11:36:12.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.730+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae24089590 con 0x7fae10066f30 2023-10-09T11:36:12.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.738+0000 7fae21ffb700 1 -- 172.21.15.26:0/1497491871 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257264 (secure 0 0 0) 0x7fae24089590 con 0x7fae10066f30 2023-10-09T11:36:12.742 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 msgr2=0x7fae100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 0x7fae100693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0016e0 tx=0x7fae1c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 msgr2=0x7fae2416d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae18006ac0 tx=0x7fae180091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 shutdown_connections 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2416ac60 0x7fae2415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae10066f30 0x7fae100693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0c0051c0 0x7fae240b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 --2- 172.21.15.26:0/1497491871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2416caf0 0x7fae2416d090 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 >> 172.21.15.26:0/1497491871 conn(0x7fae24070e30 msgr2=0x7fae240c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 shutdown_connections 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.742+0000 7fae2bbc6700 1 -- 172.21.15.26:0/1497491871 wait complete. 2023-10-09T11:36:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:12.754 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-09T11:36:11.115203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591926,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2386152,"kb_used_data":3752,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588568,"statfs":{"total":773094113280,"available":770650693632,"internally_reserved":0,"allocated":3842048,"data_stored":2162638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1558,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854316"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284791+0000","last_change":"2023-10-09T11:36:08.278687+0000","last_active":"2023-10-09T11:36:08.284791+0000","last_peered":"2023-10-09T11:36:08.284791+0000","last_clean":"2023-10-09T11:36:08.284791+0000","last_became_active":"2023-10-09T11:36:08.278178+0000","last_became_peered":"2023-10-09T11:36:08.278178+0000","last_unstale":"2023-10-09T11:36:08.284791+0000","last_undegraded":"2023-10-09T11:36:08.284791+0000","last_fullsized":"2023-10-09T11:36:08.284791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:20.367711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293502+0000","last_change":"2023-10-09T11:36:08.287587+0000","last_active":"2023-10-09T11:36:08.293502+0000","last_peered":"2023-10-09T11:36:08.293502+0000","last_clean":"2023-10-09T11:36:08.293502+0000","last_became_active":"2023-10-09T11:36:08.287318+0000","last_became_peered":"2023-10-09T11:36:08.287318+0000","last_unstale":"2023-10-09T11:36:08.293502+0000","last_undegraded":"2023-10-09T11:36:08.293502+0000","last_fullsized":"2023-10-09T11:36:08.293502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285522+0000","last_change":"2023-10-09T11:36:08.281401+0000","last_active":"2023-10-09T11:36:08.285522+0000","last_peered":"2023-10-09T11:36:08.285522+0000","last_clean":"2023-10-09T11:36:08.285522+0000","last_became_active":"2023-10-09T11:36:08.281182+0000","last_became_peered":"2023-10-09T11:36:08.281182+0000","last_unstale":"2023-10-09T11:36:08.285522+0000","last_undegraded":"2023-10-09T11:36:08.285522+0000","last_fullsized":"2023-10-09T11:36:08.285522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.995381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281091+0000","last_change":"2023-10-09T11:36:08.276410+0000","last_active":"2023-10-09T11:36:08.281091+0000","last_peered":"2023-10-09T11:36:08.281091+0000","last_clean":"2023-10-09T11:36:08.281091+0000","last_became_active":"2023-10-09T11:36:08.276128+0000","last_became_peered":"2023-10-09T11:36:08.276128+0000","last_unstale":"2023-10-09T11:36:08.281091+0000","last_undegraded":"2023-10-09T11:36:08.281091+0000","last_fullsized":"2023-10-09T11:36:08.281091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292827+0000","last_change":"2023-10-09T11:36:08.281785+0000","last_active":"2023-10-09T11:36:08.292827+0000","last_peered":"2023-10-09T11:36:08.292827+0000","last_clean":"2023-10-09T11:36:08.292827+0000","last_became_active":"2023-10-09T11:36:08.281520+0000","last_became_peered":"2023-10-09T11:36:08.281520+0000","last_unstale":"2023-10-09T11:36:08.292827+0000","last_undegraded":"2023-10-09T11:36:08.292827+0000","last_fullsized":"2023-10-09T11:36:08.292827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293117+0000","last_change":"2023-10-09T11:36:08.288046+0000","last_active":"2023-10-09T11:36:08.293117+0000","last_peered":"2023-10-09T11:36:08.293117+0000","last_clean":"2023-10-09T11:36:08.293117+0000","last_became_active":"2023-10-09T11:36:08.287767+0000","last_became_peered":"2023-10-09T11:36:08.287767+0000","last_unstale":"2023-10-09T11:36:08.293117+0000","last_undegraded":"2023-10-09T11:36:08.293117+0000","last_fullsized":"2023-10-09T11:36:08.293117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:19.830919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285647+0000","last_change":"2023-10-09T11:36:08.280935+0000","last_active":"2023-10-09T11:36:08.285647+0000","last_peered":"2023-10-09T11:36:08.285647+0000","last_clean":"2023-10-09T11:36:08.285647+0000","last_became_active":"2023-10-09T11:36:08.280551+0000","last_became_peered":"2023-10-09T11:36:08.280551+0000","last_unstale":"2023-10-09T11:36:08.285647+0000","last_undegraded":"2023-10-09T11:36:08.285647+0000","last_fullsized":"2023-10-09T11:36:08.285647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293161+0000","last_change":"2023-10-09T11:36:08.290167+0000","last_active":"2023-10-09T11:36:08.293161+0000","last_peered":"2023-10-09T11:36:08.293161+0000","last_clean":"2023-10-09T11:36:08.293161+0000","last_became_active":"2023-10-09T11:36:08.289904+0000","last_became_peered":"2023-10-09T11:36:08.289904+0000","last_unstale":"2023-10-09T11:36:08.293161+0000","last_undegraded":"2023-10-09T11:36:08.293161+0000","last_fullsized":"2023-10-09T11:36:08.293161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293115+0000","last_change":"2023-10-09T11:36:08.290062+0000","last_active":"2023-10-09T11:36:08.293115+0000","last_peered":"2023-10-09T11:36:08.293115+0000","last_clean":"2023-10-09T11:36:08.293115+0000","last_became_active":"2023-10-09T11:36:08.289712+0000","last_became_peered":"2023-10-09T11:36:08.289712+0000","last_unstale":"2023-10-09T11:36:08.293115+0000","last_undegraded":"2023-10-09T11:36:08.293115+0000","last_fullsized":"2023-10-09T11:36:08.293115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:29.618537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290792+0000","last_change":"2023-10-09T11:36:08.286490+0000","last_active":"2023-10-09T11:36:08.290792+0000","last_peered":"2023-10-09T11:36:08.290792+0000","last_clean":"2023-10-09T11:36:08.290792+0000","last_became_active":"2023-10-09T11:36:08.286235+0000","last_became_peered":"2023-10-09T11:36:08.286235+0000","last_unstale":"2023-10-09T11:36:08.290792+0000","last_undegraded":"2023-10-09T11:36:08.290792+0000","last_fullsized":"2023-10-09T11:36:08.290792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:54.131479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.280028+0000","last_change":"2023-10-09T11:36:08.275290+0000","last_active":"2023-10-09T11:36:08.280028+0000","last_peered":"2023-10-09T11:36:08.280028+0000","last_clean":"2023-10-09T11:36:08.280028+0000","last_became_active":"2023-10-09T11:36:08.275001+0000","last_became_peered":"2023-10-09T11:36:08.275001+0000","last_unstale":"2023-10-09T11:36:08.280028+0000","last_undegraded":"2023-10-09T11:36:08.280028+0000","last_fullsized":"2023-10-09T11:36:08.280028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292622+0000","last_change":"2023-10-09T11:36:08.279702+0000","last_active":"2023-10-09T11:36:08.292622+0000","last_peered":"2023-10-09T11:36:08.292622+0000","last_clean":"2023-10-09T11:36:08.292622+0000","last_became_active":"2023-10-09T11:36:08.279443+0000","last_became_peered":"2023-10-09T11:36:08.279443+0000","last_unstale":"2023-10-09T11:36:08.292622+0000","last_undegraded":"2023-10-09T11:36:08.292622+0000","last_fullsized":"2023-10-09T11:36:08.292622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284772+0000","last_change":"2023-10-09T11:36:08.278434+0000","last_active":"2023-10-09T11:36:08.284772+0000","last_peered":"2023-10-09T11:36:08.284772+0000","last_clean":"2023-10-09T11:36:08.284772+0000","last_became_active":"2023-10-09T11:36:08.277846+0000","last_became_peered":"2023-10-09T11:36:08.277846+0000","last_unstale":"2023-10-09T11:36:08.284772+0000","last_undegraded":"2023-10-09T11:36:08.284772+0000","last_fullsized":"2023-10-09T11:36:08.284772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:59.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293733+0000","last_change":"2023-10-09T11:36:08.288625+0000","last_active":"2023-10-09T11:36:08.293733+0000","last_peered":"2023-10-09T11:36:08.293733+0000","last_clean":"2023-10-09T11:36:08.293733+0000","last_became_active":"2023-10-09T11:36:08.287902+0000","last_became_peered":"2023-10-09T11:36:08.287902+0000","last_unstale":"2023-10-09T11:36:08.293733+0000","last_undegraded":"2023-10-09T11:36:08.293733+0000","last_fullsized":"2023-10-09T11:36:08.293733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284934+0000","last_change":"2023-10-09T11:36:08.280784+0000","last_active":"2023-10-09T11:36:08.284934+0000","last_peered":"2023-10-09T11:36:08.284934+0000","last_clean":"2023-10-09T11:36:08.284934+0000","last_became_active":"2023-10-09T11:36:08.280527+0000","last_became_peered":"2023-10-09T11:36:08.280527+0000","last_unstale":"2023-10-09T11:36:08.284934+0000","last_undegraded":"2023-10-09T11:36:08.284934+0000","last_fullsized":"2023-10-09T11:36:08.284934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284941+0000","last_change":"2023-10-09T11:36:07.282358+0000","last_active":"2023-10-09T11:36:08.284941+0000","last_peered":"2023-10-09T11:36:08.284941+0000","last_clean":"2023-10-09T11:36:08.284941+0000","last_became_active":"2023-10-09T11:36:07.282052+0000","last_became_peered":"2023-10-09T11:36:07.282052+0000","last_unstale":"2023-10-09T11:36:08.284941+0000","last_undegraded":"2023-10-09T11:36:08.284941+0000","last_fullsized":"2023-10-09T11:36:08.284941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294196+0000","last_change":"2023-10-09T11:36:07.277817+0000","last_active":"2023-10-09T11:36:08.294196+0000","last_peered":"2023-10-09T11:36:08.294196+0000","last_clean":"2023-10-09T11:36:08.294196+0000","last_became_active":"2023-10-09T11:36:07.277546+0000","last_became_peered":"2023-10-09T11:36:07.277546+0000","last_unstale":"2023-10-09T11:36:08.294196+0000","last_undegraded":"2023-10-09T11:36:08.294196+0000","last_fullsized":"2023-10-09T11:36:08.294196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293757+0000","last_change":"2023-10-09T11:36:08.288692+0000","last_active":"2023-10-09T11:36:08.293757+0000","last_peered":"2023-10-09T11:36:08.293757+0000","last_clean":"2023-10-09T11:36:08.293757+0000","last_became_active":"2023-10-09T11:36:08.288192+0000","last_became_peered":"2023-10-09T11:36:08.288192+0000","last_unstale":"2023-10-09T11:36:08.293757+0000","last_undegraded":"2023-10-09T11:36:08.293757+0000","last_fullsized":"2023-10-09T11:36:08.293757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293387+0000","last_change":"2023-10-09T11:36:07.274424+0000","last_active":"2023-10-09T11:36:08.293387+0000","last_peered":"2023-10-09T11:36:08.293387+0000","last_clean":"2023-10-09T11:36:08.293387+0000","last_became_active":"2023-10-09T11:36:07.274134+0000","last_became_peered":"2023-10-09T11:36:07.274134+0000","last_unstale":"2023-10-09T11:36:08.293387+0000","last_undegraded":"2023-10-09T11:36:08.293387+0000","last_fullsized":"2023-10-09T11:36:08.293387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:01.291196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.278182+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277722+0000","last_became_peered":"2023-10-09T11:36:07.277722+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:49.147228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292591+0000","last_change":"2023-10-09T11:36:08.279232+0000","last_active":"2023-10-09T11:36:08.292591+0000","last_peered":"2023-10-09T11:36:08.292591+0000","last_clean":"2023-10-09T11:36:08.292591+0000","last_became_active":"2023-10-09T11:36:08.278961+0000","last_became_peered":"2023-10-09T11:36:08.278961+0000","last_unstale":"2023-10-09T11:36:08.292591+0000","last_undegraded":"2023-10-09T11:36:08.292591+0000","last_fullsized":"2023-10-09T11:36:08.292591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270323+0000","last_change":"2023-10-09T11:36:07.284759+0000","last_active":"2023-10-09T11:36:08.270323+0000","last_peered":"2023-10-09T11:36:08.270323+0000","last_clean":"2023-10-09T11:36:08.270323+0000","last_became_active":"2023-10-09T11:36:07.284467+0000","last_became_peered":"2023-10-09T11:36:07.284467+0000","last_unstale":"2023-10-09T11:36:08.270323+0000","last_undegraded":"2023-10-09T11:36:08.270323+0000","last_fullsized":"2023-10-09T11:36:08.270323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:17.431372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293199+0000","last_change":"2023-10-09T11:36:08.290418+0000","last_active":"2023-10-09T11:36:08.293199+0000","last_peered":"2023-10-09T11:36:08.293199+0000","last_clean":"2023-10-09T11:36:08.293199+0000","last_became_active":"2023-10-09T11:36:08.289613+0000","last_became_peered":"2023-10-09T11:36:08.289613+0000","last_unstale":"2023-10-09T11:36:08.293199+0000","last_undegraded":"2023-10-09T11:36:08.293199+0000","last_fullsized":"2023-10-09T11:36:08.293199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269028+0000","last_change":"2023-10-09T11:36:07.274812+0000","last_active":"2023-10-09T11:36:08.269028+0000","last_peered":"2023-10-09T11:36:08.269028+0000","last_clean":"2023-10-09T11:36:08.269028+0000","last_became_active":"2023-10-09T11:36:07.274502+0000","last_became_peered":"2023-10-09T11:36:07.274502+0000","last_unstale":"2023-10-09T11:36:08.269028+0000","last_undegraded":"2023-10-09T11:36:08.269028+0000","last_fullsized":"2023-10-09T11:36:08.269028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291889+0000","last_change":"2023-10-09T11:36:08.277583+0000","last_active":"2023-10-09T11:36:08.291889+0000","last_peered":"2023-10-09T11:36:08.291889+0000","last_clean":"2023-10-09T11:36:08.291889+0000","last_became_active":"2023-10-09T11:36:08.277284+0000","last_became_peered":"2023-10-09T11:36:08.277284+0000","last_unstale":"2023-10-09T11:36:08.291889+0000","last_undegraded":"2023-10-09T11:36:08.291889+0000","last_fullsized":"2023-10-09T11:36:08.291889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:06.511358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.296058+0000","last_change":"2023-10-09T11:36:07.278932+0000","last_active":"2023-10-09T11:36:08.296058+0000","last_peered":"2023-10-09T11:36:08.296058+0000","last_clean":"2023-10-09T11:36:08.296058+0000","last_became_active":"2023-10-09T11:36:07.278663+0000","last_became_peered":"2023-10-09T11:36:07.278663+0000","last_unstale":"2023-10-09T11:36:08.296058+0000","last_undegraded":"2023-10-09T11:36:08.296058+0000","last_fullsized":"2023-10-09T11:36:08.296058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:12.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292177+0000","last_change":"2023-10-09T11:36:08.276944+0000","last_active":"2023-10-09T11:36:08.292177+0000","last_peered":"2023-10-09T11:36:08.292177+0000","last_clean":"2023-10-09T11:36:08.292177+0000","last_became_active":"2023-10-09T11:36:08.276663+0000","last_became_peered":"2023-10-09T11:36:08.276663+0000","last_unstale":"2023-10-09T11:36:08.292177+0000","last_undegraded":"2023-10-09T11:36:08.292177+0000","last_fullsized":"2023-10-09T11:36:08.292177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285785+0000","last_change":"2023-10-09T11:36:08.280498+0000","last_active":"2023-10-09T11:36:08.285785+0000","last_peered":"2023-10-09T11:36:08.285785+0000","last_clean":"2023-10-09T11:36:08.285785+0000","last_became_active":"2023-10-09T11:36:08.280194+0000","last_became_peered":"2023-10-09T11:36:08.280194+0000","last_unstale":"2023-10-09T11:36:08.285785+0000","last_undegraded":"2023-10-09T11:36:08.285785+0000","last_fullsized":"2023-10-09T11:36:08.285785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.267965+0000","last_change":"2023-10-09T11:36:07.277846+0000","last_active":"2023-10-09T11:36:08.267965+0000","last_peered":"2023-10-09T11:36:08.267965+0000","last_clean":"2023-10-09T11:36:08.267965+0000","last_became_active":"2023-10-09T11:36:07.277548+0000","last_became_peered":"2023-10-09T11:36:07.277548+0000","last_unstale":"2023-10-09T11:36:08.267965+0000","last_undegraded":"2023-10-09T11:36:08.267965+0000","last_fullsized":"2023-10-09T11:36:08.267965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270091+0000","last_change":"2023-10-09T11:36:07.284865+0000","last_active":"2023-10-09T11:36:08.270091+0000","last_peered":"2023-10-09T11:36:08.270091+0000","last_clean":"2023-10-09T11:36:08.270091+0000","last_became_active":"2023-10-09T11:36:07.284588+0000","last_became_peered":"2023-10-09T11:36:07.284588+0000","last_unstale":"2023-10-09T11:36:08.270091+0000","last_undegraded":"2023-10-09T11:36:08.270091+0000","last_fullsized":"2023-10-09T11:36:08.270091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.090633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294798+0000","last_change":"2023-10-09T11:36:07.276787+0000","last_active":"2023-10-09T11:36:08.294798+0000","last_peered":"2023-10-09T11:36:08.294798+0000","last_clean":"2023-10-09T11:36:08.294798+0000","last_became_active":"2023-10-09T11:36:07.276512+0000","last_became_peered":"2023-10-09T11:36:07.276512+0000","last_unstale":"2023-10-09T11:36:08.294798+0000","last_undegraded":"2023-10-09T11:36:08.294798+0000","last_fullsized":"2023-10-09T11:36:08.294798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294540+0000","last_change":"2023-10-09T11:36:07.279427+0000","last_active":"2023-10-09T11:36:08.294540+0000","last_peered":"2023-10-09T11:36:08.294540+0000","last_clean":"2023-10-09T11:36:08.294540+0000","last_became_active":"2023-10-09T11:36:07.278936+0000","last_became_peered":"2023-10-09T11:36:07.278936+0000","last_unstale":"2023-10-09T11:36:08.294540+0000","last_undegraded":"2023-10-09T11:36:08.294540+0000","last_fullsized":"2023-10-09T11:36:08.294540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293202+0000","last_change":"2023-10-09T11:36:08.285067+0000","last_active":"2023-10-09T11:36:08.293202+0000","last_peered":"2023-10-09T11:36:08.293202+0000","last_clean":"2023-10-09T11:36:08.293202+0000","last_became_active":"2023-10-09T11:36:08.284743+0000","last_became_peered":"2023-10-09T11:36:08.284743+0000","last_unstale":"2023-10-09T11:36:08.293202+0000","last_undegraded":"2023-10-09T11:36:08.293202+0000","last_fullsized":"2023-10-09T11:36:08.293202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285708+0000","last_change":"2023-10-09T11:36:08.279359+0000","last_active":"2023-10-09T11:36:08.285708+0000","last_peered":"2023-10-09T11:36:08.285708+0000","last_clean":"2023-10-09T11:36:08.285708+0000","last_became_active":"2023-10-09T11:36:08.279085+0000","last_became_peered":"2023-10-09T11:36:08.279085+0000","last_unstale":"2023-10-09T11:36:08.285708+0000","last_undegraded":"2023-10-09T11:36:08.285708+0000","last_fullsized":"2023-10-09T11:36:08.285708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.850239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285485+0000","last_change":"2023-10-09T11:36:08.282867+0000","last_active":"2023-10-09T11:36:08.285485+0000","last_peered":"2023-10-09T11:36:08.285485+0000","last_clean":"2023-10-09T11:36:08.285485+0000","last_became_active":"2023-10-09T11:36:08.282595+0000","last_became_peered":"2023-10-09T11:36:08.282595+0000","last_unstale":"2023-10-09T11:36:08.285485+0000","last_undegraded":"2023-10-09T11:36:08.285485+0000","last_fullsized":"2023-10-09T11:36:08.285485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.366025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292618+0000","last_change":"2023-10-09T11:36:07.275507+0000","last_active":"2023-10-09T11:36:08.292618+0000","last_peered":"2023-10-09T11:36:08.292618+0000","last_clean":"2023-10-09T11:36:08.292618+0000","last_became_active":"2023-10-09T11:36:07.273512+0000","last_became_peered":"2023-10-09T11:36:07.273512+0000","last_unstale":"2023-10-09T11:36:08.292618+0000","last_undegraded":"2023-10-09T11:36:08.292618+0000","last_fullsized":"2023-10-09T11:36:08.292618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285542+0000","last_change":"2023-10-09T11:36:08.282018+0000","last_active":"2023-10-09T11:36:08.285542+0000","last_peered":"2023-10-09T11:36:08.285542+0000","last_clean":"2023-10-09T11:36:08.285542+0000","last_became_active":"2023-10-09T11:36:08.281760+0000","last_became_peered":"2023-10-09T11:36:08.281760+0000","last_unstale":"2023-10-09T11:36:08.285542+0000","last_undegraded":"2023-10-09T11:36:08.285542+0000","last_fullsized":"2023-10-09T11:36:08.285542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:49.613786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285540+0000","last_change":"2023-10-09T11:36:08.277441+0000","last_active":"2023-10-09T11:36:08.285540+0000","last_peered":"2023-10-09T11:36:08.285540+0000","last_clean":"2023-10-09T11:36:08.285540+0000","last_became_active":"2023-10-09T11:36:08.277184+0000","last_became_peered":"2023-10-09T11:36:08.277184+0000","last_unstale":"2023-10-09T11:36:08.285540+0000","last_undegraded":"2023-10-09T11:36:08.285540+0000","last_fullsized":"2023-10-09T11:36:08.285540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:19.784715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287084+0000","last_change":"2023-10-09T11:36:08.284621+0000","last_active":"2023-10-09T11:36:08.287084+0000","last_peered":"2023-10-09T11:36:08.287084+0000","last_clean":"2023-10-09T11:36:08.287084+0000","last_became_active":"2023-10-09T11:36:08.284367+0000","last_became_peered":"2023-10-09T11:36:08.284367+0000","last_unstale":"2023-10-09T11:36:08.287084+0000","last_undegraded":"2023-10-09T11:36:08.287084+0000","last_fullsized":"2023-10-09T11:36:08.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:53.399703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293828+0000","last_change":"2023-10-09T11:36:07.278885+0000","last_active":"2023-10-09T11:36:08.293828+0000","last_peered":"2023-10-09T11:36:08.293828+0000","last_clean":"2023-10-09T11:36:08.293828+0000","last_became_active":"2023-10-09T11:36:07.278567+0000","last_became_peered":"2023-10-09T11:36:07.278567+0000","last_unstale":"2023-10-09T11:36:08.293828+0000","last_undegraded":"2023-10-09T11:36:08.293828+0000","last_fullsized":"2023-10-09T11:36:08.293828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269145+0000","last_change":"2023-10-09T11:36:07.273853+0000","last_active":"2023-10-09T11:36:08.269145+0000","last_peered":"2023-10-09T11:36:08.269145+0000","last_clean":"2023-10-09T11:36:08.269145+0000","last_became_active":"2023-10-09T11:36:07.273562+0000","last_became_peered":"2023-10-09T11:36:07.273562+0000","last_unstale":"2023-10-09T11:36:08.269145+0000","last_undegraded":"2023-10-09T11:36:08.269145+0000","last_fullsized":"2023-10-09T11:36:08.269145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290805+0000","last_change":"2023-10-09T11:36:08.289593+0000","last_active":"2023-10-09T11:36:08.290805+0000","last_peered":"2023-10-09T11:36:08.290805+0000","last_clean":"2023-10-09T11:36:08.290805+0000","last_became_active":"2023-10-09T11:36:08.289323+0000","last_became_peered":"2023-10-09T11:36:08.289323+0000","last_unstale":"2023-10-09T11:36:08.290805+0000","last_undegraded":"2023-10-09T11:36:08.290805+0000","last_fullsized":"2023-10-09T11:36:08.290805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.272883+0000","last_change":"2023-10-09T11:36:07.275895+0000","last_active":"2023-10-09T11:36:08.272883+0000","last_peered":"2023-10-09T11:36:08.272883+0000","last_clean":"2023-10-09T11:36:08.272883+0000","last_became_active":"2023-10-09T11:36:07.275394+0000","last_became_peered":"2023-10-09T11:36:07.275394+0000","last_unstale":"2023-10-09T11:36:08.272883+0000","last_undegraded":"2023-10-09T11:36:08.272883+0000","last_fullsized":"2023-10-09T11:36:08.272883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269401+0000","last_change":"2023-10-09T11:36:07.273764+0000","last_active":"2023-10-09T11:36:08.269401+0000","last_peered":"2023-10-09T11:36:08.269401+0000","last_clean":"2023-10-09T11:36:08.269401+0000","last_became_active":"2023-10-09T11:36:07.273471+0000","last_became_peered":"2023-10-09T11:36:07.273471+0000","last_unstale":"2023-10-09T11:36:08.269401+0000","last_undegraded":"2023-10-09T11:36:08.269401+0000","last_fullsized":"2023-10-09T11:36:08.269401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286251+0000","last_change":"2023-10-09T11:36:08.283848+0000","last_active":"2023-10-09T11:36:08.286251+0000","last_peered":"2023-10-09T11:36:08.286251+0000","last_clean":"2023-10-09T11:36:08.286251+0000","last_became_active":"2023-10-09T11:36:08.283566+0000","last_became_peered":"2023-10-09T11:36:08.283566+0000","last_unstale":"2023-10-09T11:36:08.286251+0000","last_undegraded":"2023-10-09T11:36:08.286251+0000","last_fullsized":"2023-10-09T11:36:08.286251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268004+0000","last_change":"2023-10-09T11:36:07.274431+0000","last_active":"2023-10-09T11:36:08.268004+0000","last_peered":"2023-10-09T11:36:08.268004+0000","last_clean":"2023-10-09T11:36:08.268004+0000","last_became_active":"2023-10-09T11:36:07.274154+0000","last_became_peered":"2023-10-09T11:36:07.274154+0000","last_unstale":"2023-10-09T11:36:08.268004+0000","last_undegraded":"2023-10-09T11:36:08.268004+0000","last_fullsized":"2023-10-09T11:36:08.268004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293193+0000","last_change":"2023-10-09T11:36:08.290591+0000","last_active":"2023-10-09T11:36:08.293193+0000","last_peered":"2023-10-09T11:36:08.293193+0000","last_clean":"2023-10-09T11:36:08.293193+0000","last_became_active":"2023-10-09T11:36:08.290327+0000","last_became_peered":"2023-10-09T11:36:08.290327+0000","last_unstale":"2023-10-09T11:36:08.293193+0000","last_undegraded":"2023-10-09T11:36:08.293193+0000","last_fullsized":"2023-10-09T11:36:08.293193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:28.125121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269124+0000","last_change":"2023-10-09T11:36:07.284950+0000","last_active":"2023-10-09T11:36:08.269124+0000","last_peered":"2023-10-09T11:36:08.269124+0000","last_clean":"2023-10-09T11:36:08.269124+0000","last_became_active":"2023-10-09T11:36:07.284605+0000","last_became_peered":"2023-10-09T11:36:07.284605+0000","last_unstale":"2023-10-09T11:36:08.269124+0000","last_undegraded":"2023-10-09T11:36:08.269124+0000","last_fullsized":"2023-10-09T11:36:08.269124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:10.864639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:07.256055+0000","last_change":"2023-10-09T11:36:07.256055+0000","last_active":"2023-10-09T11:36:07.256055+0000","last_peered":"2023-10-09T11:36:07.256055+0000","last_clean":"2023-10-09T11:36:07.256055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:07.256055+0000","last_undegraded":"2023-10-09T11:36:07.256055+0000","last_fullsized":"2023-10-09T11:36:07.256055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:36:06.251196+0000","last_change":"2023-10-09T11:36:06.251196+0000","last_active":"2023-10-09T11:36:06.251196+0000","last_peered":"2023-10-09T11:36:06.251196+0000","last_clean":"2023-10-09T11:36:06.251196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:06.251196+0000","last_undegraded":"2023-10-09T11:36:06.251196+0000","last_fullsized":"2023-10-09T11:36:06.251196+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-09T11:36:01.253127+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:01.253127+0000","last_peered":"2023-10-09T11:36:01.253127+0000","last_clean":"2023-10-09T11:36:01.253127+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:01.253127+0000","last_undegraded":"2023-10-09T11:36:01.253127+0000","last_fullsized":"2023-10-09T11:36:01.253127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1558,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":702510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":721333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":137323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":112142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:12.759 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.913+0000 7f8e92bce700 1 Processor -- start 2023-10-09T11:36:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.913+0000 7f8e92bce700 1 -- start start 2023-10-09T11:36:12.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e92bce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e8c0cf110 0x7f8e8c164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e92bce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c15afd0 con 0x7f8e8c15de50 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e92bce700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c15b2b0 con 0x7f8e8c153c30 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e92bce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c15b590 con 0x7f8e8c0cf110 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e923cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e8c0cf110 0x7f8e8c164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e913cb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8e8c15de50 0x7f8e8c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50362/0 (socket says 172.21.15.26:50362) 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e913cb700 1 -- 172.21.15.26:0/1924292892 learned_addr learned my addr 172.21.15.26:0/1924292892 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e923cd700 1 -- 172.21.15.26:0/1924292892 >> v1:172.21.15.67:6789/0 conn(0x7f8e8c153c30 legacy=0x7f8e8c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e923cd700 1 -- 172.21.15.26:0/1924292892 >> v1:172.21.15.26:6789/0 conn(0x7f8e8c15de50 legacy=0x7f8e8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e923cd700 1 -- 172.21.15.26:0/1924292892 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c15b870 con 0x7f8e8c0cf110 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e90bca700 1 -- 172.21.15.26:0/1924292892 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586199121 0 0) 0x7f8e8c15afd0 con 0x7f8e8c15de50 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.914+0000 7f8e923cd700 1 --2- 172.21.15.26:0/1924292892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c164600 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009e60 tx=0x7f8e84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbb3ae253445eda server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e90bca700 1 -- 172.21.15.26:0/1924292892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400e070 con 0x7f8e8c0cf110 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e90bca700 1 -- 172.21.15.26:0/1924292892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400bbf0 con 0x7f8e8c0cf110 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e90bca700 1 -- 172.21.15.26:0/1924292892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012430 con 0x7f8e8c0cf110 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 -- 172.21.15.26:0/1924292892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0cf110 msgr2=0x7f8e8c164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1924292892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c164600 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009e60 tx=0x7f8e84009780 comp rx=0 tx=0).stop 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 -- 172.21.15.26:0/1924292892 shutdown_connections 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1924292892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c164600 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 -- 172.21.15.26:0/1924292892 >> 172.21.15.26:0/1924292892 conn(0x7f8e8c0703a0 msgr2=0x7f8e8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 -- 172.21.15.26:0/1924292892 shutdown_connections 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.915+0000 7f8e92bce700 1 -- 172.21.15.26:0/1924292892 wait complete. 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.916+0000 7f8e92bce700 1 Processor -- start 2023-10-09T11:36:12.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.916+0000 7f8e92bce700 1 -- start start 2023-10-09T11:36:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 0x7f8e8c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0cc190 con 0x7f8e8c15de50 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c7810 con 0x7f8e8c0cf110 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e92bce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0cb650 con 0x7f8e8c153c30 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50614/0 (socket says 172.21.15.26:50614) 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 -- 172.21.15.26:0/1817008001 learned_addr learned my addr 172.21.15.26:0/1817008001 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e913cb700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 0x7f8e8c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e91bcc700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 -- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 msgr2=0x7f8e8c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 0x7f8e8c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 -- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 msgr2=0x7f8e8c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.917+0000 7f8e923cd700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e923cd700 1 -- 172.21.15.26:0/1817008001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84009a20 con 0x7f8e8c15de50 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e913cb700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 0x7f8e8c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e91bcc700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e923cd700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c06eb00 tx=0x7f8e84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8401e710 con 0x7f8e8c15de50 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8401e870 con 0x7f8e8c15de50 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c0cb8f0 con 0x7f8e8c15de50 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8401ec30 con 0x7f8e8c15de50 2023-10-09T11:36:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.918+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c0cbf30 con 0x7f8e8c15de50 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.919+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c0c75e0 con 0x7f8e8c15de50 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.919+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e84024070 con 0x7f8e8c15de50 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.920+0000 7f8e81ffb700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.920+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e84087040 con 0x7f8e8c15de50 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.920+0000 7f8e91bcc700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.921+0000 7f8e91bcc700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:12.924+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e8c0c75e0 con 0x7f8e8c15de50 2023-10-09T11:36:13.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.115+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e8c0c75e0 con 0x7f8e70066f30 2023-10-09T11:36:13.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.124+0000 7f8e81ffb700 1 -- 172.21.15.26:0/1817008001 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273918 (secure 0 0 0) 0x7f8e8c0c75e0 con 0x7f8e70066f30 2023-10-09T11:36:13.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:13.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 msgr2=0x7f8e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 msgr2=0x7f8e8c15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c06eb00 tx=0x7f8e84018000 comp rx=0 tx=0).stop 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 shutdown_connections 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c15de50 0x7f8e8c15f5e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e8c0cf110 0x7f8e8c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 --2- 172.21.15.26:0/1817008001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e8c153c30 0x7f8e8c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 >> 172.21.15.26:0/1817008001 conn(0x7f8e8c0703a0 msgr2=0x7f8e8c0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 shutdown_connections 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.127+0000 7f8e92bce700 1 -- 172.21.15.26:0/1817008001 wait complete. 2023-10-09T11:36:13.131 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:13.139 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-09T11:36:13.115756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386372,"kb_used_data":3972,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588348,"statfs":{"total":773094113280,"available":770650468352,"internally_reserved":0,"allocated":4067328,"data_stored":2264508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001466"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.279758+0000","last_change":"2023-10-09T11:36:08.273677+0000","last_active":"2023-10-09T11:36:08.279758+0000","last_peered":"2023-10-09T11:36:08.279758+0000","last_clean":"2023-10-09T11:36:08.279758+0000","last_became_active":"2023-10-09T11:36:08.273392+0000","last_became_peered":"2023-10-09T11:36:08.273392+0000","last_unstale":"2023-10-09T11:36:08.279758+0000","last_undegraded":"2023-10-09T11:36:08.279758+0000","last_fullsized":"2023-10-09T11:36:08.279758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284791+0000","last_change":"2023-10-09T11:36:08.278687+0000","last_active":"2023-10-09T11:36:08.284791+0000","last_peered":"2023-10-09T11:36:08.284791+0000","last_clean":"2023-10-09T11:36:08.284791+0000","last_became_active":"2023-10-09T11:36:08.278178+0000","last_became_peered":"2023-10-09T11:36:08.278178+0000","last_unstale":"2023-10-09T11:36:08.284791+0000","last_undegraded":"2023-10-09T11:36:08.284791+0000","last_fullsized":"2023-10-09T11:36:08.284791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:20.367711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292372+0000","last_change":"2023-10-09T11:36:08.290862+0000","last_active":"2023-10-09T11:36:08.292372+0000","last_peered":"2023-10-09T11:36:08.292372+0000","last_clean":"2023-10-09T11:36:08.292372+0000","last_became_active":"2023-10-09T11:36:08.290568+0000","last_became_peered":"2023-10-09T11:36:08.290568+0000","last_unstale":"2023-10-09T11:36:08.292372+0000","last_undegraded":"2023-10-09T11:36:08.292372+0000","last_fullsized":"2023-10-09T11:36:08.292372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293502+0000","last_change":"2023-10-09T11:36:08.287587+0000","last_active":"2023-10-09T11:36:08.293502+0000","last_peered":"2023-10-09T11:36:08.293502+0000","last_clean":"2023-10-09T11:36:08.293502+0000","last_became_active":"2023-10-09T11:36:08.287318+0000","last_became_peered":"2023-10-09T11:36:08.287318+0000","last_unstale":"2023-10-09T11:36:08.293502+0000","last_undegraded":"2023-10-09T11:36:08.293502+0000","last_fullsized":"2023-10-09T11:36:08.293502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285522+0000","last_change":"2023-10-09T11:36:08.281401+0000","last_active":"2023-10-09T11:36:08.285522+0000","last_peered":"2023-10-09T11:36:08.285522+0000","last_clean":"2023-10-09T11:36:08.285522+0000","last_became_active":"2023-10-09T11:36:08.281182+0000","last_became_peered":"2023-10-09T11:36:08.281182+0000","last_unstale":"2023-10-09T11:36:08.285522+0000","last_undegraded":"2023-10-09T11:36:08.285522+0000","last_fullsized":"2023-10-09T11:36:08.285522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.995381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281091+0000","last_change":"2023-10-09T11:36:08.276410+0000","last_active":"2023-10-09T11:36:08.281091+0000","last_peered":"2023-10-09T11:36:08.281091+0000","last_clean":"2023-10-09T11:36:08.281091+0000","last_became_active":"2023-10-09T11:36:08.276128+0000","last_became_peered":"2023-10-09T11:36:08.276128+0000","last_unstale":"2023-10-09T11:36:08.281091+0000","last_undegraded":"2023-10-09T11:36:08.281091+0000","last_fullsized":"2023-10-09T11:36:08.281091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290594+0000","last_change":"2023-10-09T11:36:08.287500+0000","last_active":"2023-10-09T11:36:08.290594+0000","last_peered":"2023-10-09T11:36:08.290594+0000","last_clean":"2023-10-09T11:36:08.290594+0000","last_became_active":"2023-10-09T11:36:08.287094+0000","last_became_peered":"2023-10-09T11:36:08.287094+0000","last_unstale":"2023-10-09T11:36:08.290594+0000","last_undegraded":"2023-10-09T11:36:08.290594+0000","last_fullsized":"2023-10-09T11:36:08.290594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290545+0000","last_change":"2023-10-09T11:36:08.287006+0000","last_active":"2023-10-09T11:36:08.290545+0000","last_peered":"2023-10-09T11:36:08.290545+0000","last_clean":"2023-10-09T11:36:08.290545+0000","last_became_active":"2023-10-09T11:36:08.286723+0000","last_became_peered":"2023-10-09T11:36:08.286723+0000","last_unstale":"2023-10-09T11:36:08.290545+0000","last_undegraded":"2023-10-09T11:36:08.290545+0000","last_fullsized":"2023-10-09T11:36:08.290545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294957+0000","last_change":"2023-10-09T11:36:08.291813+0000","last_active":"2023-10-09T11:36:08.294957+0000","last_peered":"2023-10-09T11:36:08.294957+0000","last_clean":"2023-10-09T11:36:08.294957+0000","last_became_active":"2023-10-09T11:36:08.291537+0000","last_became_peered":"2023-10-09T11:36:08.291537+0000","last_unstale":"2023-10-09T11:36:08.294957+0000","last_undegraded":"2023-10-09T11:36:08.294957+0000","last_fullsized":"2023-10-09T11:36:08.294957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292827+0000","last_change":"2023-10-09T11:36:08.281785+0000","last_active":"2023-10-09T11:36:08.292827+0000","last_peered":"2023-10-09T11:36:08.292827+0000","last_clean":"2023-10-09T11:36:08.292827+0000","last_became_active":"2023-10-09T11:36:08.281520+0000","last_became_peered":"2023-10-09T11:36:08.281520+0000","last_unstale":"2023-10-09T11:36:08.292827+0000","last_undegraded":"2023-10-09T11:36:08.292827+0000","last_fullsized":"2023-10-09T11:36:08.292827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291939+0000","last_change":"2023-10-09T11:36:08.290214+0000","last_active":"2023-10-09T11:36:08.291939+0000","last_peered":"2023-10-09T11:36:08.291939+0000","last_clean":"2023-10-09T11:36:08.291939+0000","last_became_active":"2023-10-09T11:36:08.289825+0000","last_became_peered":"2023-10-09T11:36:08.289825+0000","last_unstale":"2023-10-09T11:36:08.291939+0000","last_undegraded":"2023-10-09T11:36:08.291939+0000","last_fullsized":"2023-10-09T11:36:08.291939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291512+0000","last_change":"2023-10-09T11:36:08.284600+0000","last_active":"2023-10-09T11:36:08.291512+0000","last_peered":"2023-10-09T11:36:08.291512+0000","last_clean":"2023-10-09T11:36:08.291512+0000","last_became_active":"2023-10-09T11:36:08.278637+0000","last_became_peered":"2023-10-09T11:36:08.278637+0000","last_unstale":"2023-10-09T11:36:08.291512+0000","last_undegraded":"2023-10-09T11:36:08.291512+0000","last_fullsized":"2023-10-09T11:36:08.291512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293117+0000","last_change":"2023-10-09T11:36:08.288046+0000","last_active":"2023-10-09T11:36:08.293117+0000","last_peered":"2023-10-09T11:36:08.293117+0000","last_clean":"2023-10-09T11:36:08.293117+0000","last_became_active":"2023-10-09T11:36:08.287767+0000","last_became_peered":"2023-10-09T11:36:08.287767+0000","last_unstale":"2023-10-09T11:36:08.293117+0000","last_undegraded":"2023-10-09T11:36:08.293117+0000","last_fullsized":"2023-10-09T11:36:08.293117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:19.830919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285647+0000","last_change":"2023-10-09T11:36:08.280935+0000","last_active":"2023-10-09T11:36:08.285647+0000","last_peered":"2023-10-09T11:36:08.285647+0000","last_clean":"2023-10-09T11:36:08.285647+0000","last_became_active":"2023-10-09T11:36:08.280551+0000","last_became_peered":"2023-10-09T11:36:08.280551+0000","last_unstale":"2023-10-09T11:36:08.285647+0000","last_undegraded":"2023-10-09T11:36:08.285647+0000","last_fullsized":"2023-10-09T11:36:08.285647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283730+0000","last_change":"2023-10-09T11:36:08.277342+0000","last_active":"2023-10-09T11:36:08.283730+0000","last_peered":"2023-10-09T11:36:08.283730+0000","last_clean":"2023-10-09T11:36:08.283730+0000","last_became_active":"2023-10-09T11:36:08.277060+0000","last_became_peered":"2023-10-09T11:36:08.277060+0000","last_unstale":"2023-10-09T11:36:08.283730+0000","last_undegraded":"2023-10-09T11:36:08.283730+0000","last_fullsized":"2023-10-09T11:36:08.283730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291618+0000","last_change":"2023-10-09T11:36:08.288090+0000","last_active":"2023-10-09T11:36:08.291618+0000","last_peered":"2023-10-09T11:36:08.291618+0000","last_clean":"2023-10-09T11:36:08.291618+0000","last_became_active":"2023-10-09T11:36:08.287801+0000","last_became_peered":"2023-10-09T11:36:08.287801+0000","last_unstale":"2023-10-09T11:36:08.291618+0000","last_undegraded":"2023-10-09T11:36:08.291618+0000","last_fullsized":"2023-10-09T11:36:08.291618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290555+0000","last_change":"2023-10-09T11:36:08.286992+0000","last_active":"2023-10-09T11:36:08.290555+0000","last_peered":"2023-10-09T11:36:08.290555+0000","last_clean":"2023-10-09T11:36:08.290555+0000","last_became_active":"2023-10-09T11:36:08.286412+0000","last_became_peered":"2023-10-09T11:36:08.286412+0000","last_unstale":"2023-10-09T11:36:08.290555+0000","last_undegraded":"2023-10-09T11:36:08.290555+0000","last_fullsized":"2023-10-09T11:36:08.290555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293161+0000","last_change":"2023-10-09T11:36:08.290167+0000","last_active":"2023-10-09T11:36:08.293161+0000","last_peered":"2023-10-09T11:36:08.293161+0000","last_clean":"2023-10-09T11:36:08.293161+0000","last_became_active":"2023-10-09T11:36:08.289904+0000","last_became_peered":"2023-10-09T11:36:08.289904+0000","last_unstale":"2023-10-09T11:36:08.293161+0000","last_undegraded":"2023-10-09T11:36:08.293161+0000","last_fullsized":"2023-10-09T11:36:08.293161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293115+0000","last_change":"2023-10-09T11:36:08.290062+0000","last_active":"2023-10-09T11:36:08.293115+0000","last_peered":"2023-10-09T11:36:08.293115+0000","last_clean":"2023-10-09T11:36:08.293115+0000","last_became_active":"2023-10-09T11:36:08.289712+0000","last_became_peered":"2023-10-09T11:36:08.289712+0000","last_unstale":"2023-10-09T11:36:08.293115+0000","last_undegraded":"2023-10-09T11:36:08.293115+0000","last_fullsized":"2023-10-09T11:36:08.293115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:29.618537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290792+0000","last_change":"2023-10-09T11:36:08.286490+0000","last_active":"2023-10-09T11:36:08.290792+0000","last_peered":"2023-10-09T11:36:08.290792+0000","last_clean":"2023-10-09T11:36:08.290792+0000","last_became_active":"2023-10-09T11:36:08.286235+0000","last_became_peered":"2023-10-09T11:36:08.286235+0000","last_unstale":"2023-10-09T11:36:08.290792+0000","last_undegraded":"2023-10-09T11:36:08.290792+0000","last_fullsized":"2023-10-09T11:36:08.290792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:54.131479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285298+0000","last_change":"2023-10-09T11:36:08.279912+0000","last_active":"2023-10-09T11:36:08.285298+0000","last_peered":"2023-10-09T11:36:08.285298+0000","last_clean":"2023-10-09T11:36:08.285298+0000","last_became_active":"2023-10-09T11:36:08.279612+0000","last_became_peered":"2023-10-09T11:36:08.279612+0000","last_unstale":"2023-10-09T11:36:08.285298+0000","last_undegraded":"2023-10-09T11:36:08.285298+0000","last_fullsized":"2023-10-09T11:36:08.285298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290153+0000","last_change":"2023-10-09T11:36:08.284955+0000","last_active":"2023-10-09T11:36:08.290153+0000","last_peered":"2023-10-09T11:36:08.290153+0000","last_clean":"2023-10-09T11:36:08.290153+0000","last_became_active":"2023-10-09T11:36:08.284035+0000","last_became_peered":"2023-10-09T11:36:08.284035+0000","last_unstale":"2023-10-09T11:36:08.290153+0000","last_undegraded":"2023-10-09T11:36:08.290153+0000","last_fullsized":"2023-10-09T11:36:08.290153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.280028+0000","last_change":"2023-10-09T11:36:08.275290+0000","last_active":"2023-10-09T11:36:08.280028+0000","last_peered":"2023-10-09T11:36:08.280028+0000","last_clean":"2023-10-09T11:36:08.280028+0000","last_became_active":"2023-10-09T11:36:08.275001+0000","last_became_peered":"2023-10-09T11:36:08.275001+0000","last_unstale":"2023-10-09T11:36:08.280028+0000","last_undegraded":"2023-10-09T11:36:08.280028+0000","last_fullsized":"2023-10-09T11:36:08.280028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281852+0000","last_change":"2023-10-09T11:36:08.273715+0000","last_active":"2023-10-09T11:36:08.281852+0000","last_peered":"2023-10-09T11:36:08.281852+0000","last_clean":"2023-10-09T11:36:08.281852+0000","last_became_active":"2023-10-09T11:36:08.273287+0000","last_became_peered":"2023-10-09T11:36:08.273287+0000","last_unstale":"2023-10-09T11:36:08.281852+0000","last_undegraded":"2023-10-09T11:36:08.281852+0000","last_fullsized":"2023-10-09T11:36:08.281852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292622+0000","last_change":"2023-10-09T11:36:08.279702+0000","last_active":"2023-10-09T11:36:08.292622+0000","last_peered":"2023-10-09T11:36:08.292622+0000","last_clean":"2023-10-09T11:36:08.292622+0000","last_became_active":"2023-10-09T11:36:08.279443+0000","last_became_peered":"2023-10-09T11:36:08.279443+0000","last_unstale":"2023-10-09T11:36:08.292622+0000","last_undegraded":"2023-10-09T11:36:08.292622+0000","last_fullsized":"2023-10-09T11:36:08.292622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284772+0000","last_change":"2023-10-09T11:36:08.278434+0000","last_active":"2023-10-09T11:36:08.284772+0000","last_peered":"2023-10-09T11:36:08.284772+0000","last_clean":"2023-10-09T11:36:08.284772+0000","last_became_active":"2023-10-09T11:36:08.277846+0000","last_became_peered":"2023-10-09T11:36:08.277846+0000","last_unstale":"2023-10-09T11:36:08.284772+0000","last_undegraded":"2023-10-09T11:36:08.284772+0000","last_fullsized":"2023-10-09T11:36:08.284772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:59.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293733+0000","last_change":"2023-10-09T11:36:08.288625+0000","last_active":"2023-10-09T11:36:08.293733+0000","last_peered":"2023-10-09T11:36:08.293733+0000","last_clean":"2023-10-09T11:36:08.293733+0000","last_became_active":"2023-10-09T11:36:08.287902+0000","last_became_peered":"2023-10-09T11:36:08.287902+0000","last_unstale":"2023-10-09T11:36:08.293733+0000","last_undegraded":"2023-10-09T11:36:08.293733+0000","last_fullsized":"2023-10-09T11:36:08.293733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284821+0000","last_change":"2023-10-09T11:36:08.276526+0000","last_active":"2023-10-09T11:36:08.284821+0000","last_peered":"2023-10-09T11:36:08.284821+0000","last_clean":"2023-10-09T11:36:08.284821+0000","last_became_active":"2023-10-09T11:36:08.276261+0000","last_became_peered":"2023-10-09T11:36:08.276261+0000","last_unstale":"2023-10-09T11:36:08.284821+0000","last_undegraded":"2023-10-09T11:36:08.284821+0000","last_fullsized":"2023-10-09T11:36:08.284821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288093+0000","last_change":"2023-10-09T11:36:08.283000+0000","last_active":"2023-10-09T11:36:08.288093+0000","last_peered":"2023-10-09T11:36:08.288093+0000","last_clean":"2023-10-09T11:36:08.288093+0000","last_became_active":"2023-10-09T11:36:08.282712+0000","last_became_peered":"2023-10-09T11:36:08.282712+0000","last_unstale":"2023-10-09T11:36:08.288093+0000","last_undegraded":"2023-10-09T11:36:08.288093+0000","last_fullsized":"2023-10-09T11:36:08.288093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290609+0000","last_change":"2023-10-09T11:36:08.287215+0000","last_active":"2023-10-09T11:36:08.290609+0000","last_peered":"2023-10-09T11:36:08.290609+0000","last_clean":"2023-10-09T11:36:08.290609+0000","last_became_active":"2023-10-09T11:36:08.286880+0000","last_became_peered":"2023-10-09T11:36:08.286880+0000","last_unstale":"2023-10-09T11:36:08.290609+0000","last_undegraded":"2023-10-09T11:36:08.290609+0000","last_fullsized":"2023-10-09T11:36:08.290609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288539+0000","last_change":"2023-10-09T11:36:08.285992+0000","last_active":"2023-10-09T11:36:08.288539+0000","last_peered":"2023-10-09T11:36:08.288539+0000","last_clean":"2023-10-09T11:36:08.288539+0000","last_became_active":"2023-10-09T11:36:08.285693+0000","last_became_peered":"2023-10-09T11:36:08.285693+0000","last_unstale":"2023-10-09T11:36:08.288539+0000","last_undegraded":"2023-10-09T11:36:08.288539+0000","last_fullsized":"2023-10-09T11:36:08.288539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:18.436232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288904+0000","last_change":"2023-10-09T11:36:08.286011+0000","last_active":"2023-10-09T11:36:08.288904+0000","last_peered":"2023-10-09T11:36:08.288904+0000","last_clean":"2023-10-09T11:36:08.288904+0000","last_became_active":"2023-10-09T11:36:08.285540+0000","last_became_peered":"2023-10-09T11:36:08.285540+0000","last_unstale":"2023-10-09T11:36:08.288904+0000","last_undegraded":"2023-10-09T11:36:08.288904+0000","last_fullsized":"2023-10-09T11:36:08.288904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284934+0000","last_change":"2023-10-09T11:36:08.280784+0000","last_active":"2023-10-09T11:36:08.284934+0000","last_peered":"2023-10-09T11:36:08.284934+0000","last_clean":"2023-10-09T11:36:08.284934+0000","last_became_active":"2023-10-09T11:36:08.280527+0000","last_became_peered":"2023-10-09T11:36:08.280527+0000","last_unstale":"2023-10-09T11:36:08.284934+0000","last_undegraded":"2023-10-09T11:36:08.284934+0000","last_fullsized":"2023-10-09T11:36:08.284934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292413+0000","last_change":"2023-10-09T11:36:07.282121+0000","last_active":"2023-10-09T11:36:08.292413+0000","last_peered":"2023-10-09T11:36:08.292413+0000","last_clean":"2023-10-09T11:36:08.292413+0000","last_became_active":"2023-10-09T11:36:07.281861+0000","last_became_peered":"2023-10-09T11:36:07.281861+0000","last_unstale":"2023-10-09T11:36:08.292413+0000","last_undegraded":"2023-10-09T11:36:08.292413+0000","last_fullsized":"2023-10-09T11:36:08.292413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285116+0000","last_change":"2023-10-09T11:36:08.280847+0000","last_active":"2023-10-09T11:36:08.285116+0000","last_peered":"2023-10-09T11:36:08.285116+0000","last_clean":"2023-10-09T11:36:08.285116+0000","last_became_active":"2023-10-09T11:36:08.280341+0000","last_became_peered":"2023-10-09T11:36:08.280341+0000","last_unstale":"2023-10-09T11:36:08.285116+0000","last_undegraded":"2023-10-09T11:36:08.285116+0000","last_fullsized":"2023-10-09T11:36:08.285116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284941+0000","last_change":"2023-10-09T11:36:07.282358+0000","last_active":"2023-10-09T11:36:08.284941+0000","last_peered":"2023-10-09T11:36:08.284941+0000","last_clean":"2023-10-09T11:36:08.284941+0000","last_became_active":"2023-10-09T11:36:07.282052+0000","last_became_peered":"2023-10-09T11:36:07.282052+0000","last_unstale":"2023-10-09T11:36:08.284941+0000","last_undegraded":"2023-10-09T11:36:08.284941+0000","last_fullsized":"2023-10-09T11:36:08.284941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287844+0000","last_change":"2023-10-09T11:36:08.282472+0000","last_active":"2023-10-09T11:36:08.287844+0000","last_peered":"2023-10-09T11:36:08.287844+0000","last_clean":"2023-10-09T11:36:08.287844+0000","last_became_active":"2023-10-09T11:36:08.282176+0000","last_became_peered":"2023-10-09T11:36:08.282176+0000","last_unstale":"2023-10-09T11:36:08.287844+0000","last_undegraded":"2023-10-09T11:36:08.287844+0000","last_fullsized":"2023-10-09T11:36:08.287844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294196+0000","last_change":"2023-10-09T11:36:07.277817+0000","last_active":"2023-10-09T11:36:08.294196+0000","last_peered":"2023-10-09T11:36:08.294196+0000","last_clean":"2023-10-09T11:36:08.294196+0000","last_became_active":"2023-10-09T11:36:07.277546+0000","last_became_peered":"2023-10-09T11:36:07.277546+0000","last_unstale":"2023-10-09T11:36:08.294196+0000","last_undegraded":"2023-10-09T11:36:08.294196+0000","last_fullsized":"2023-10-09T11:36:08.294196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293757+0000","last_change":"2023-10-09T11:36:08.288692+0000","last_active":"2023-10-09T11:36:08.293757+0000","last_peered":"2023-10-09T11:36:08.293757+0000","last_clean":"2023-10-09T11:36:08.293757+0000","last_became_active":"2023-10-09T11:36:08.288192+0000","last_became_peered":"2023-10-09T11:36:08.288192+0000","last_unstale":"2023-10-09T11:36:08.293757+0000","last_undegraded":"2023-10-09T11:36:08.293757+0000","last_fullsized":"2023-10-09T11:36:08.293757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293387+0000","last_change":"2023-10-09T11:36:07.274424+0000","last_active":"2023-10-09T11:36:08.293387+0000","last_peered":"2023-10-09T11:36:08.293387+0000","last_clean":"2023-10-09T11:36:08.293387+0000","last_became_active":"2023-10-09T11:36:07.274134+0000","last_became_peered":"2023-10-09T11:36:07.274134+0000","last_unstale":"2023-10-09T11:36:08.293387+0000","last_undegraded":"2023-10-09T11:36:08.293387+0000","last_fullsized":"2023-10-09T11:36:08.293387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:01.291196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286073+0000","last_change":"2023-10-09T11:36:08.285240+0000","last_active":"2023-10-09T11:36:08.286073+0000","last_peered":"2023-10-09T11:36:08.286073+0000","last_clean":"2023-10-09T11:36:08.286073+0000","last_became_active":"2023-10-09T11:36:08.284949+0000","last_became_peered":"2023-10-09T11:36:08.284949+0000","last_unstale":"2023-10-09T11:36:08.286073+0000","last_undegraded":"2023-10-09T11:36:08.286073+0000","last_fullsized":"2023-10-09T11:36:08.286073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293182+0000","last_change":"2023-10-09T11:36:07.279426+0000","last_active":"2023-10-09T11:36:08.293182+0000","last_peered":"2023-10-09T11:36:08.293182+0000","last_clean":"2023-10-09T11:36:08.293182+0000","last_became_active":"2023-10-09T11:36:07.279113+0000","last_became_peered":"2023-10-09T11:36:07.279113+0000","last_unstale":"2023-10-09T11:36:08.293182+0000","last_undegraded":"2023-10-09T11:36:08.293182+0000","last_fullsized":"2023-10-09T11:36:08.293182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284709+0000","last_change":"2023-10-09T11:36:08.282166+0000","last_active":"2023-10-09T11:36:08.284709+0000","last_peered":"2023-10-09T11:36:08.284709+0000","last_clean":"2023-10-09T11:36:08.284709+0000","last_became_active":"2023-10-09T11:36:08.281862+0000","last_became_peered":"2023-10-09T11:36:08.281862+0000","last_unstale":"2023-10-09T11:36:08.284709+0000","last_undegraded":"2023-10-09T11:36:08.284709+0000","last_fullsized":"2023-10-09T11:36:08.284709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287053+0000","last_change":"2023-10-09T11:36:07.278415+0000","last_active":"2023-10-09T11:36:08.287053+0000","last_peered":"2023-10-09T11:36:08.287053+0000","last_clean":"2023-10-09T11:36:08.287053+0000","last_became_active":"2023-10-09T11:36:07.278088+0000","last_became_peered":"2023-10-09T11:36:07.278088+0000","last_unstale":"2023-10-09T11:36:08.287053+0000","last_undegraded":"2023-10-09T11:36:08.287053+0000","last_fullsized":"2023-10-09T11:36:08.287053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:03.205996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283150+0000","last_change":"2023-10-09T11:36:08.277760+0000","last_active":"2023-10-09T11:36:08.283150+0000","last_peered":"2023-10-09T11:36:08.283150+0000","last_clean":"2023-10-09T11:36:08.283150+0000","last_became_active":"2023-10-09T11:36:08.277480+0000","last_became_peered":"2023-10-09T11:36:08.277480+0000","last_unstale":"2023-10-09T11:36:08.283150+0000","last_undegraded":"2023-10-09T11:36:08.283150+0000","last_fullsized":"2023-10-09T11:36:08.283150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.278182+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277722+0000","last_became_peered":"2023-10-09T11:36:07.277722+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:49.147228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292591+0000","last_change":"2023-10-09T11:36:08.279232+0000","last_active":"2023-10-09T11:36:08.292591+0000","last_peered":"2023-10-09T11:36:08.292591+0000","last_clean":"2023-10-09T11:36:08.292591+0000","last_became_active":"2023-10-09T11:36:08.278961+0000","last_became_peered":"2023-10-09T11:36:08.278961+0000","last_unstale":"2023-10-09T11:36:08.292591+0000","last_undegraded":"2023-10-09T11:36:08.292591+0000","last_fullsized":"2023-10-09T11:36:08.292591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.277553+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277237+0000","last_became_peered":"2023-10-09T11:36:07.277237+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:18.826059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284628+0000","last_change":"2023-10-09T11:36:08.280688+0000","last_active":"2023-10-09T11:36:08.284628+0000","last_peered":"2023-10-09T11:36:08.284628+0000","last_clean":"2023-10-09T11:36:08.284628+0000","last_became_active":"2023-10-09T11:36:08.280292+0000","last_became_peered":"2023-10-09T11:36:08.280292+0000","last_unstale":"2023-10-09T11:36:08.284628+0000","last_undegraded":"2023-10-09T11:36:08.284628+0000","last_fullsized":"2023-10-09T11:36:08.284628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270323+0000","last_change":"2023-10-09T11:36:07.284759+0000","last_active":"2023-10-09T11:36:08.270323+0000","last_peered":"2023-10-09T11:36:08.270323+0000","last_clean":"2023-10-09T11:36:08.270323+0000","last_became_active":"2023-10-09T11:36:07.284467+0000","last_became_peered":"2023-10-09T11:36:07.284467+0000","last_unstale":"2023-10-09T11:36:08.270323+0000","last_undegraded":"2023-10-09T11:36:08.270323+0000","last_fullsized":"2023-10-09T11:36:08.270323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:17.431372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293199+0000","last_change":"2023-10-09T11:36:08.290418+0000","last_active":"2023-10-09T11:36:08.293199+0000","last_peered":"2023-10-09T11:36:08.293199+0000","last_clean":"2023-10-09T11:36:08.293199+0000","last_became_active":"2023-10-09T11:36:08.289613+0000","last_became_peered":"2023-10-09T11:36:08.289613+0000","last_unstale":"2023-10-09T11:36:08.293199+0000","last_undegraded":"2023-10-09T11:36:08.293199+0000","last_fullsized":"2023-10-09T11:36:08.293199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269028+0000","last_change":"2023-10-09T11:36:07.274812+0000","last_active":"2023-10-09T11:36:08.269028+0000","last_peered":"2023-10-09T11:36:08.269028+0000","last_clean":"2023-10-09T11:36:08.269028+0000","last_became_active":"2023-10-09T11:36:07.274502+0000","last_became_peered":"2023-10-09T11:36:07.274502+0000","last_unstale":"2023-10-09T11:36:08.269028+0000","last_undegraded":"2023-10-09T11:36:08.269028+0000","last_fullsized":"2023-10-09T11:36:08.269028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291889+0000","last_change":"2023-10-09T11:36:08.277583+0000","last_active":"2023-10-09T11:36:08.291889+0000","last_peered":"2023-10-09T11:36:08.291889+0000","last_clean":"2023-10-09T11:36:08.291889+0000","last_became_active":"2023-10-09T11:36:08.277284+0000","last_became_peered":"2023-10-09T11:36:08.277284+0000","last_unstale":"2023-10-09T11:36:08.291889+0000","last_undegraded":"2023-10-09T11:36:08.291889+0000","last_fullsized":"2023-10-09T11:36:08.291889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:06.511358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292516+0000","last_change":"2023-10-09T11:36:07.283964+0000","last_active":"2023-10-09T11:36:08.292516+0000","last_peered":"2023-10-09T11:36:08.292516+0000","last_clean":"2023-10-09T11:36:08.292516+0000","last_became_active":"2023-10-09T11:36:07.283626+0000","last_became_peered":"2023-10-09T11:36:07.283626+0000","last_unstale":"2023-10-09T11:36:08.292516+0000","last_undegraded":"2023-10-09T11:36:08.292516+0000","last_fullsized":"2023-10-09T11:36:08.292516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:03.385790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284674+0000","last_change":"2023-10-09T11:36:08.281129+0000","last_active":"2023-10-09T11:36:08.284674+0000","last_peered":"2023-10-09T11:36:08.284674+0000","last_clean":"2023-10-09T11:36:08.284674+0000","last_became_active":"2023-10-09T11:36:08.280848+0000","last_became_peered":"2023-10-09T11:36:08.280848+0000","last_unstale":"2023-10-09T11:36:08.284674+0000","last_undegraded":"2023-10-09T11:36:08.284674+0000","last_fullsized":"2023-10-09T11:36:08.284674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.296058+0000","last_change":"2023-10-09T11:36:07.278932+0000","last_active":"2023-10-09T11:36:08.296058+0000","last_peered":"2023-10-09T11:36:08.296058+0000","last_clean":"2023-10-09T11:36:08.296058+0000","last_became_active":"2023-10-09T11:36:07.278663+0000","last_became_peered":"2023-10-09T11:36:07.278663+0000","last_unstale":"2023-10-09T11:36:08.296058+0000","last_undegraded":"2023-10-09T11:36:08.296058+0000","last_fullsized":"2023-10-09T11:36:08.296058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:12.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292177+0000","last_change":"2023-10-09T11:36:08.276944+0000","last_active":"2023-10-09T11:36:08.292177+0000","last_peered":"2023-10-09T11:36:08.292177+0000","last_clean":"2023-10-09T11:36:08.292177+0000","last_became_active":"2023-10-09T11:36:08.276663+0000","last_became_peered":"2023-10-09T11:36:08.276663+0000","last_unstale":"2023-10-09T11:36:08.292177+0000","last_undegraded":"2023-10-09T11:36:08.292177+0000","last_fullsized":"2023-10-09T11:36:08.292177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291233+0000","last_change":"2023-10-09T11:36:07.277618+0000","last_active":"2023-10-09T11:36:08.291233+0000","last_peered":"2023-10-09T11:36:08.291233+0000","last_clean":"2023-10-09T11:36:08.291233+0000","last_became_active":"2023-10-09T11:36:07.277333+0000","last_became_peered":"2023-10-09T11:36:07.277333+0000","last_unstale":"2023-10-09T11:36:08.291233+0000","last_undegraded":"2023-10-09T11:36:08.291233+0000","last_fullsized":"2023-10-09T11:36:08.291233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:18.779855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285785+0000","last_change":"2023-10-09T11:36:08.280498+0000","last_active":"2023-10-09T11:36:08.285785+0000","last_peered":"2023-10-09T11:36:08.285785+0000","last_clean":"2023-10-09T11:36:08.285785+0000","last_became_active":"2023-10-09T11:36:08.280194+0000","last_became_peered":"2023-10-09T11:36:08.280194+0000","last_unstale":"2023-10-09T11:36:08.285785+0000","last_undegraded":"2023-10-09T11:36:08.285785+0000","last_fullsized":"2023-10-09T11:36:08.285785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.267965+0000","last_change":"2023-10-09T11:36:07.277846+0000","last_active":"2023-10-09T11:36:08.267965+0000","last_peered":"2023-10-09T11:36:08.267965+0000","last_clean":"2023-10-09T11:36:08.267965+0000","last_became_active":"2023-10-09T11:36:07.277548+0000","last_became_peered":"2023-10-09T11:36:07.277548+0000","last_unstale":"2023-10-09T11:36:08.267965+0000","last_undegraded":"2023-10-09T11:36:08.267965+0000","last_fullsized":"2023-10-09T11:36:08.267965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288885+0000","last_change":"2023-10-09T11:36:08.285822+0000","last_active":"2023-10-09T11:36:08.288885+0000","last_peered":"2023-10-09T11:36:08.288885+0000","last_clean":"2023-10-09T11:36:08.288885+0000","last_became_active":"2023-10-09T11:36:08.285175+0000","last_became_peered":"2023-10-09T11:36:08.285175+0000","last_unstale":"2023-10-09T11:36:08.288885+0000","last_undegraded":"2023-10-09T11:36:08.288885+0000","last_fullsized":"2023-10-09T11:36:08.288885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270091+0000","last_change":"2023-10-09T11:36:07.284865+0000","last_active":"2023-10-09T11:36:08.270091+0000","last_peered":"2023-10-09T11:36:08.270091+0000","last_clean":"2023-10-09T11:36:08.270091+0000","last_became_active":"2023-10-09T11:36:07.284588+0000","last_became_peered":"2023-10-09T11:36:07.284588+0000","last_unstale":"2023-10-09T11:36:08.270091+0000","last_undegraded":"2023-10-09T11:36:08.270091+0000","last_fullsized":"2023-10-09T11:36:08.270091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.090633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288557+0000","last_change":"2023-10-09T11:36:08.286252+0000","last_active":"2023-10-09T11:36:08.288557+0000","last_peered":"2023-10-09T11:36:08.288557+0000","last_clean":"2023-10-09T11:36:08.288557+0000","last_became_active":"2023-10-09T11:36:08.285691+0000","last_became_peered":"2023-10-09T11:36:08.285691+0000","last_unstale":"2023-10-09T11:36:08.288557+0000","last_undegraded":"2023-10-09T11:36:08.288557+0000","last_fullsized":"2023-10-09T11:36:08.288557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294798+0000","last_change":"2023-10-09T11:36:07.276787+0000","last_active":"2023-10-09T11:36:08.294798+0000","last_peered":"2023-10-09T11:36:08.294798+0000","last_clean":"2023-10-09T11:36:08.294798+0000","last_became_active":"2023-10-09T11:36:07.276512+0000","last_became_peered":"2023-10-09T11:36:07.276512+0000","last_unstale":"2023-10-09T11:36:08.294798+0000","last_undegraded":"2023-10-09T11:36:08.294798+0000","last_fullsized":"2023-10-09T11:36:08.294798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282895+0000","last_change":"2023-10-09T11:36:08.275830+0000","last_active":"2023-10-09T11:36:08.282895+0000","last_peered":"2023-10-09T11:36:08.282895+0000","last_clean":"2023-10-09T11:36:08.282895+0000","last_became_active":"2023-10-09T11:36:08.275540+0000","last_became_peered":"2023-10-09T11:36:08.275540+0000","last_unstale":"2023-10-09T11:36:08.282895+0000","last_undegraded":"2023-10-09T11:36:08.282895+0000","last_fullsized":"2023-10-09T11:36:08.282895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294540+0000","last_change":"2023-10-09T11:36:07.279427+0000","last_active":"2023-10-09T11:36:08.294540+0000","last_peered":"2023-10-09T11:36:08.294540+0000","last_clean":"2023-10-09T11:36:08.294540+0000","last_became_active":"2023-10-09T11:36:07.278936+0000","last_became_peered":"2023-10-09T11:36:07.278936+0000","last_unstale":"2023-10-09T11:36:08.294540+0000","last_undegraded":"2023-10-09T11:36:08.294540+0000","last_fullsized":"2023-10-09T11:36:08.294540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289951+0000","last_change":"2023-10-09T11:36:08.283247+0000","last_active":"2023-10-09T11:36:08.289951+0000","last_peered":"2023-10-09T11:36:08.289951+0000","last_clean":"2023-10-09T11:36:08.289951+0000","last_became_active":"2023-10-09T11:36:08.282938+0000","last_became_peered":"2023-10-09T11:36:08.282938+0000","last_unstale":"2023-10-09T11:36:08.289951+0000","last_undegraded":"2023-10-09T11:36:08.289951+0000","last_fullsized":"2023-10-09T11:36:08.289951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287415+0000","last_change":"2023-10-09T11:36:07.280068+0000","last_active":"2023-10-09T11:36:08.287415+0000","last_peered":"2023-10-09T11:36:08.287415+0000","last_clean":"2023-10-09T11:36:08.287415+0000","last_became_active":"2023-10-09T11:36:07.279789+0000","last_became_peered":"2023-10-09T11:36:07.279789+0000","last_unstale":"2023-10-09T11:36:08.287415+0000","last_undegraded":"2023-10-09T11:36:08.287415+0000","last_fullsized":"2023-10-09T11:36:08.287415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:48.608927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293202+0000","last_change":"2023-10-09T11:36:08.285067+0000","last_active":"2023-10-09T11:36:08.293202+0000","last_peered":"2023-10-09T11:36:08.293202+0000","last_clean":"2023-10-09T11:36:08.293202+0000","last_became_active":"2023-10-09T11:36:08.284743+0000","last_became_peered":"2023-10-09T11:36:08.284743+0000","last_unstale":"2023-10-09T11:36:08.293202+0000","last_undegraded":"2023-10-09T11:36:08.293202+0000","last_fullsized":"2023-10-09T11:36:08.293202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286630+0000","last_change":"2023-10-09T11:36:07.279785+0000","last_active":"2023-10-09T11:36:08.286630+0000","last_peered":"2023-10-09T11:36:08.286630+0000","last_clean":"2023-10-09T11:36:08.286630+0000","last_became_active":"2023-10-09T11:36:07.279196+0000","last_became_peered":"2023-10-09T11:36:07.279196+0000","last_unstale":"2023-10-09T11:36:08.286630+0000","last_undegraded":"2023-10-09T11:36:08.286630+0000","last_fullsized":"2023-10-09T11:36:08.286630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:58.492719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285708+0000","last_change":"2023-10-09T11:36:08.279359+0000","last_active":"2023-10-09T11:36:08.285708+0000","last_peered":"2023-10-09T11:36:08.285708+0000","last_clean":"2023-10-09T11:36:08.285708+0000","last_became_active":"2023-10-09T11:36:08.279085+0000","last_became_peered":"2023-10-09T11:36:08.279085+0000","last_unstale":"2023-10-09T11:36:08.285708+0000","last_undegraded":"2023-10-09T11:36:08.285708+0000","last_fullsized":"2023-10-09T11:36:08.285708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.850239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271052+0000","last_change":"2023-10-09T11:36:07.280371+0000","last_active":"2023-10-09T11:36:08.271052+0000","last_peered":"2023-10-09T11:36:08.271052+0000","last_clean":"2023-10-09T11:36:08.271052+0000","last_became_active":"2023-10-09T11:36:07.280080+0000","last_became_peered":"2023-10-09T11:36:07.280080+0000","last_unstale":"2023-10-09T11:36:08.271052+0000","last_undegraded":"2023-10-09T11:36:08.271052+0000","last_fullsized":"2023-10-09T11:36:08.271052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285485+0000","last_change":"2023-10-09T11:36:08.282867+0000","last_active":"2023-10-09T11:36:08.285485+0000","last_peered":"2023-10-09T11:36:08.285485+0000","last_clean":"2023-10-09T11:36:08.285485+0000","last_became_active":"2023-10-09T11:36:08.282595+0000","last_became_peered":"2023-10-09T11:36:08.282595+0000","last_unstale":"2023-10-09T11:36:08.285485+0000","last_undegraded":"2023-10-09T11:36:08.285485+0000","last_fullsized":"2023-10-09T11:36:08.285485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.366025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292618+0000","last_change":"2023-10-09T11:36:07.275507+0000","last_active":"2023-10-09T11:36:08.292618+0000","last_peered":"2023-10-09T11:36:08.292618+0000","last_clean":"2023-10-09T11:36:08.292618+0000","last_became_active":"2023-10-09T11:36:07.273512+0000","last_became_peered":"2023-10-09T11:36:07.273512+0000","last_unstale":"2023-10-09T11:36:08.292618+0000","last_undegraded":"2023-10-09T11:36:08.292618+0000","last_fullsized":"2023-10-09T11:36:08.292618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285542+0000","last_change":"2023-10-09T11:36:08.282018+0000","last_active":"2023-10-09T11:36:08.285542+0000","last_peered":"2023-10-09T11:36:08.285542+0000","last_clean":"2023-10-09T11:36:08.285542+0000","last_became_active":"2023-10-09T11:36:08.281760+0000","last_became_peered":"2023-10-09T11:36:08.281760+0000","last_unstale":"2023-10-09T11:36:08.285542+0000","last_undegraded":"2023-10-09T11:36:08.285542+0000","last_fullsized":"2023-10-09T11:36:08.285542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:49.613786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.265705+0000","last_change":"2023-10-09T11:36:07.281451+0000","last_active":"2023-10-09T11:36:08.265705+0000","last_peered":"2023-10-09T11:36:08.265705+0000","last_clean":"2023-10-09T11:36:08.265705+0000","last_became_active":"2023-10-09T11:36:07.281196+0000","last_became_peered":"2023-10-09T11:36:07.281196+0000","last_unstale":"2023-10-09T11:36:08.265705+0000","last_undegraded":"2023-10-09T11:36:08.265705+0000","last_fullsized":"2023-10-09T11:36:08.265705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285540+0000","last_change":"2023-10-09T11:36:08.277441+0000","last_active":"2023-10-09T11:36:08.285540+0000","last_peered":"2023-10-09T11:36:08.285540+0000","last_clean":"2023-10-09T11:36:08.285540+0000","last_became_active":"2023-10-09T11:36:08.277184+0000","last_became_peered":"2023-10-09T11:36:08.277184+0000","last_unstale":"2023-10-09T11:36:08.285540+0000","last_undegraded":"2023-10-09T11:36:08.285540+0000","last_fullsized":"2023-10-09T11:36:08.285540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:19.784715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270615+0000","last_change":"2023-10-09T11:36:07.278628+0000","last_active":"2023-10-09T11:36:08.270615+0000","last_peered":"2023-10-09T11:36:08.270615+0000","last_clean":"2023-10-09T11:36:08.270615+0000","last_became_active":"2023-10-09T11:36:07.278359+0000","last_became_peered":"2023-10-09T11:36:07.278359+0000","last_unstale":"2023-10-09T11:36:08.270615+0000","last_undegraded":"2023-10-09T11:36:08.270615+0000","last_fullsized":"2023-10-09T11:36:08.270615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.917615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291747+0000","last_change":"2023-10-09T11:36:08.287971+0000","last_active":"2023-10-09T11:36:08.291747+0000","last_peered":"2023-10-09T11:36:08.291747+0000","last_clean":"2023-10-09T11:36:08.291747+0000","last_became_active":"2023-10-09T11:36:08.287474+0000","last_became_peered":"2023-10-09T11:36:08.287474+0000","last_unstale":"2023-10-09T11:36:08.291747+0000","last_undegraded":"2023-10-09T11:36:08.291747+0000","last_fullsized":"2023-10-09T11:36:08.291747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.264777+0000","last_change":"2023-10-09T11:36:07.276933+0000","last_active":"2023-10-09T11:36:08.264777+0000","last_peered":"2023-10-09T11:36:08.264777+0000","last_clean":"2023-10-09T11:36:08.264777+0000","last_became_active":"2023-10-09T11:36:07.276691+0000","last_became_peered":"2023-10-09T11:36:07.276691+0000","last_unstale":"2023-10-09T11:36:08.264777+0000","last_undegraded":"2023-10-09T11:36:08.264777+0000","last_fullsized":"2023-10-09T11:36:08.264777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287084+0000","last_change":"2023-10-09T11:36:08.284621+0000","last_active":"2023-10-09T11:36:08.287084+0000","last_peered":"2023-10-09T11:36:08.287084+0000","last_clean":"2023-10-09T11:36:08.287084+0000","last_became_active":"2023-10-09T11:36:08.284367+0000","last_became_peered":"2023-10-09T11:36:08.284367+0000","last_unstale":"2023-10-09T11:36:08.287084+0000","last_undegraded":"2023-10-09T11:36:08.287084+0000","last_fullsized":"2023-10-09T11:36:08.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:53.399703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293828+0000","last_change":"2023-10-09T11:36:07.278885+0000","last_active":"2023-10-09T11:36:08.293828+0000","last_peered":"2023-10-09T11:36:08.293828+0000","last_clean":"2023-10-09T11:36:08.293828+0000","last_became_active":"2023-10-09T11:36:07.278567+0000","last_became_peered":"2023-10-09T11:36:07.278567+0000","last_unstale":"2023-10-09T11:36:08.293828+0000","last_undegraded":"2023-10-09T11:36:08.293828+0000","last_fullsized":"2023-10-09T11:36:08.293828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284922+0000","last_change":"2023-10-09T11:36:08.278250+0000","last_active":"2023-10-09T11:36:08.284922+0000","last_peered":"2023-10-09T11:36:08.284922+0000","last_clean":"2023-10-09T11:36:08.284922+0000","last_became_active":"2023-10-09T11:36:08.277933+0000","last_became_peered":"2023-10-09T11:36:08.277933+0000","last_unstale":"2023-10-09T11:36:08.284922+0000","last_undegraded":"2023-10-09T11:36:08.284922+0000","last_fullsized":"2023-10-09T11:36:08.284922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269145+0000","last_change":"2023-10-09T11:36:07.273853+0000","last_active":"2023-10-09T11:36:08.269145+0000","last_peered":"2023-10-09T11:36:08.269145+0000","last_clean":"2023-10-09T11:36:08.269145+0000","last_became_active":"2023-10-09T11:36:07.273562+0000","last_became_peered":"2023-10-09T11:36:07.273562+0000","last_unstale":"2023-10-09T11:36:08.269145+0000","last_undegraded":"2023-10-09T11:36:08.269145+0000","last_fullsized":"2023-10-09T11:36:08.269145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290805+0000","last_change":"2023-10-09T11:36:08.289593+0000","last_active":"2023-10-09T11:36:08.290805+0000","last_peered":"2023-10-09T11:36:08.290805+0000","last_clean":"2023-10-09T11:36:08.290805+0000","last_became_active":"2023-10-09T11:36:08.289323+0000","last_became_peered":"2023-10-09T11:36:08.289323+0000","last_unstale":"2023-10-09T11:36:08.290805+0000","last_undegraded":"2023-10-09T11:36:08.290805+0000","last_fullsized":"2023-10-09T11:36:08.290805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.272883+0000","last_change":"2023-10-09T11:36:07.275895+0000","last_active":"2023-10-09T11:36:08.272883+0000","last_peered":"2023-10-09T11:36:08.272883+0000","last_clean":"2023-10-09T11:36:08.272883+0000","last_became_active":"2023-10-09T11:36:07.275394+0000","last_became_peered":"2023-10-09T11:36:07.275394+0000","last_unstale":"2023-10-09T11:36:08.272883+0000","last_undegraded":"2023-10-09T11:36:08.272883+0000","last_fullsized":"2023-10-09T11:36:08.272883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282593+0000","last_change":"2023-10-09T11:36:08.277172+0000","last_active":"2023-10-09T11:36:08.282593+0000","last_peered":"2023-10-09T11:36:08.282593+0000","last_clean":"2023-10-09T11:36:08.282593+0000","last_became_active":"2023-10-09T11:36:08.276808+0000","last_became_peered":"2023-10-09T11:36:08.276808+0000","last_unstale":"2023-10-09T11:36:08.282593+0000","last_undegraded":"2023-10-09T11:36:08.282593+0000","last_fullsized":"2023-10-09T11:36:08.282593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:13.510818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269401+0000","last_change":"2023-10-09T11:36:07.273764+0000","last_active":"2023-10-09T11:36:08.269401+0000","last_peered":"2023-10-09T11:36:08.269401+0000","last_clean":"2023-10-09T11:36:08.269401+0000","last_became_active":"2023-10-09T11:36:07.273471+0000","last_became_peered":"2023-10-09T11:36:07.273471+0000","last_unstale":"2023-10-09T11:36:08.269401+0000","last_undegraded":"2023-10-09T11:36:08.269401+0000","last_fullsized":"2023-10-09T11:36:08.269401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286251+0000","last_change":"2023-10-09T11:36:08.283848+0000","last_active":"2023-10-09T11:36:08.286251+0000","last_peered":"2023-10-09T11:36:08.286251+0000","last_clean":"2023-10-09T11:36:08.286251+0000","last_became_active":"2023-10-09T11:36:08.283566+0000","last_became_peered":"2023-10-09T11:36:08.283566+0000","last_unstale":"2023-10-09T11:36:08.286251+0000","last_undegraded":"2023-10-09T11:36:08.286251+0000","last_fullsized":"2023-10-09T11:36:08.286251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268004+0000","last_change":"2023-10-09T11:36:07.274431+0000","last_active":"2023-10-09T11:36:08.268004+0000","last_peered":"2023-10-09T11:36:08.268004+0000","last_clean":"2023-10-09T11:36:08.268004+0000","last_became_active":"2023-10-09T11:36:07.274154+0000","last_became_peered":"2023-10-09T11:36:07.274154+0000","last_unstale":"2023-10-09T11:36:08.268004+0000","last_undegraded":"2023-10-09T11:36:08.268004+0000","last_fullsized":"2023-10-09T11:36:08.268004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293193+0000","last_change":"2023-10-09T11:36:08.290591+0000","last_active":"2023-10-09T11:36:08.293193+0000","last_peered":"2023-10-09T11:36:08.293193+0000","last_clean":"2023-10-09T11:36:08.293193+0000","last_became_active":"2023-10-09T11:36:08.290327+0000","last_became_peered":"2023-10-09T11:36:08.290327+0000","last_unstale":"2023-10-09T11:36:08.293193+0000","last_undegraded":"2023-10-09T11:36:08.293193+0000","last_fullsized":"2023-10-09T11:36:08.293193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:28.125121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270730+0000","last_change":"2023-10-09T11:36:07.281909+0000","last_active":"2023-10-09T11:36:08.270730+0000","last_peered":"2023-10-09T11:36:08.270730+0000","last_clean":"2023-10-09T11:36:08.270730+0000","last_became_active":"2023-10-09T11:36:07.281638+0000","last_became_peered":"2023-10-09T11:36:07.281638+0000","last_unstale":"2023-10-09T11:36:08.270730+0000","last_undegraded":"2023-10-09T11:36:08.270730+0000","last_fullsized":"2023-10-09T11:36:08.270730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:13.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288045+0000","last_change":"2023-10-09T11:36:08.282914+0000","last_active":"2023-10-09T11:36:08.288045+0000","last_peered":"2023-10-09T11:36:08.288045+0000","last_clean":"2023-10-09T11:36:08.288045+0000","last_became_active":"2023-10-09T11:36:08.282382+0000","last_became_peered":"2023-10-09T11:36:08.282382+0000","last_unstale":"2023-10-09T11:36:08.288045+0000","last_undegraded":"2023-10-09T11:36:08.288045+0000","last_fullsized":"2023-10-09T11:36:08.288045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269124+0000","last_change":"2023-10-09T11:36:07.284950+0000","last_active":"2023-10-09T11:36:08.269124+0000","last_peered":"2023-10-09T11:36:08.269124+0000","last_clean":"2023-10-09T11:36:08.269124+0000","last_became_active":"2023-10-09T11:36:07.284605+0000","last_became_peered":"2023-10-09T11:36:07.284605+0000","last_unstale":"2023-10-09T11:36:08.269124+0000","last_undegraded":"2023-10-09T11:36:08.269124+0000","last_fullsized":"2023-10-09T11:36:08.269124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:10.864639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289337+0000","last_change":"2023-10-09T11:36:08.286177+0000","last_active":"2023-10-09T11:36:08.289337+0000","last_peered":"2023-10-09T11:36:08.289337+0000","last_clean":"2023-10-09T11:36:08.289337+0000","last_became_active":"2023-10-09T11:36:08.285873+0000","last_became_peered":"2023-10-09T11:36:08.285873+0000","last_unstale":"2023-10-09T11:36:08.289337+0000","last_undegraded":"2023-10-09T11:36:08.289337+0000","last_fullsized":"2023-10-09T11:36:08.289337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268607+0000","last_change":"2023-10-09T11:36:07.278836+0000","last_active":"2023-10-09T11:36:08.268607+0000","last_peered":"2023-10-09T11:36:08.268607+0000","last_clean":"2023-10-09T11:36:08.268607+0000","last_became_active":"2023-10-09T11:36:07.278541+0000","last_became_peered":"2023-10-09T11:36:07.278541+0000","last_unstale":"2023-10-09T11:36:08.268607+0000","last_undegraded":"2023-10-09T11:36:08.268607+0000","last_fullsized":"2023-10-09T11:36:08.268607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271243+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:08.271243+0000","last_peered":"2023-10-09T11:36:08.271243+0000","last_clean":"2023-10-09T11:36:08.271243+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:08.271243+0000","last_undegraded":"2023-10-09T11:36:08.271243+0000","last_fullsized":"2023-10-09T11:36:08.271243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":727711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.626}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.745}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":721333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":137323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.624},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60499999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.378},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.45800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:13.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:36:13.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.297+0000 7f496d073700 1 Processor -- start 2023-10-09T11:36:13.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.297+0000 7f496d073700 1 -- start start 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496d073700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 0x7f4968159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496d073700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f496815a400 0x7f4968156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496d073700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496815ae40 con 0x7f49680cb5a0 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496d073700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680ce0f0 con 0x7f496815a400 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496d073700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680d13f0 con 0x7f49680cb970 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f496815a400 0x7f4968156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f4966d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f49680cb5a0 0x7f49680cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50368/0 (socket says 172.21.15.26:50368) 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f496815a400 0x7f4968156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50618/0 (socket says 172.21.15.26:50618) 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f4966d9d700 1 -- 172.21.15.26:0/1486724581 learned_addr learned my addr 172.21.15.26:0/1486724581 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496659c700 1 --2- 172.21.15.26:0/1486724581 >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 0x7f4968159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 -- 172.21.15.26:0/1486724581 >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 msgr2=0x7f4968159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 --2- 172.21.15.26:0/1486724581 >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 0x7f4968159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 -- 172.21.15.26:0/1486724581 >> v1:172.21.15.26:6789/0 conn(0x7f49680cb5a0 legacy=0x7f49680cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496759e700 1 -- 172.21.15.26:0/1486724581 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496815ab60 con 0x7f496815a400 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f4965d9b700 1 -- 172.21.15.26:0/1486724581 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580223750 0 0) 0x7f496815ae40 con 0x7f49680cb5a0 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.298+0000 7f496659c700 1 --2- 172.21.15.26:0/1486724581 >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 0x7f4968159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:13.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496759e700 1 --2- 172.21.15.26:0/1486724581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496815a400 0x7f4968156e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f49680d1780 tx=0x7f49600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a3118a29207cf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f4965d9b700 1 -- 172.21.15.26:0/1486724581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000b6b0 con 0x7f496815a400 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f4965d9b700 1 -- 172.21.15.26:0/1486724581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000b810 con 0x7f496815a400 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f4965d9b700 1 -- 172.21.15.26:0/1486724581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000bbb0 con 0x7f496815a400 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 -- 172.21.15.26:0/1486724581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496815a400 msgr2=0x7f4968156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 --2- 172.21.15.26:0/1486724581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496815a400 0x7f4968156e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f49680d1780 tx=0x7f49600091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 -- 172.21.15.26:0/1486724581 shutdown_connections 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 --2- 172.21.15.26:0/1486724581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f496815a400 0x7f4968156e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 --2- 172.21.15.26:0/1486724581 >> v2:172.21.15.67:3300/0 conn(0x7f49680cb970 0x7f4968159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 -- 172.21.15.26:0/1486724581 >> 172.21.15.26:0/1486724581 conn(0x7f4968070e30 msgr2=0x7f49680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 -- 172.21.15.26:0/1486724581 shutdown_connections 2023-10-09T11:36:13.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.299+0000 7f496d073700 1 -- 172.21.15.26:0/1486724581 wait complete. 2023-10-09T11:36:13.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 Processor -- start 2023-10-09T11:36:13.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 -- start start 2023-10-09T11:36:13.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49680cb5a0 0x7f496816a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496815a400 0x7f4968156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496816c530 con 0x7f49680cb970 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c8e80 con 0x7f496815a400 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496d073700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4968159f10 con 0x7f49680cb5a0 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50620/0 (socket says 172.21.15.26:50620) 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.301+0000 7f496659c700 1 -- 172.21.15.26:0/758906741 learned_addr learned my addr 172.21.15.26:0/758906741 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f4966d9d700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49680cb5a0 0x7f496816a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496759e700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496815a400 0x7f4968156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 -- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49680cb5a0 msgr2=0x7f496816a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49680cb5a0 0x7f496816a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 -- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496815a400 msgr2=0x7f4968156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496815a400 0x7f4968156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 -- 172.21.15.26:0/758906741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009420 con 0x7f49680cb970 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496659c700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f495000c830 tx=0x7f4950008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950011600 con 0x7f49680cb970 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950011760 con 0x7f49680cb970 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4968159c30 con 0x7f49680cb970 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950011b20 con 0x7f49680cb970 2023-10-09T11:36:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.302+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680c8b10 con 0x7f49680cb970 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.303+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496804c3c0 con 0x7f49680cb970 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.303+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49500193b0 con 0x7f49680cb970 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.304+0000 7f495effd700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.304+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4950084980 con 0x7f49680cb970 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.304+0000 7f4966d9d700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.304+0000 7f4966d9d700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4958001560 tx=0x7f4958009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.308+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4950051bf0 con 0x7f49680cb970 2023-10-09T11:36:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.579+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f49680c8fc0 con 0x7f49680cb970 2023-10-09T11:36:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.579+0000 7f495effd700 1 -- 172.21.15.26:0/758906741 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1562 (secure 0 0 0) 0x7f4950015630 con 0x7f49680cb970 2023-10-09T11:36:13.580 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:13.580 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2443644928,"bytes_avail":770650468352,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4962}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-09T11:36:13.115941+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:36:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 msgr2=0x7f49480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4958001560 tx=0x7f4958009040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 msgr2=0x7f496816bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f495000c830 tx=0x7f4950008040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 shutdown_connections 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496815a400 0x7f4968156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49680cb5a0 0x7f496816a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 --2- 172.21.15.26:0/758906741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49680cb970 0x7f496816bff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 >> 172.21.15.26:0/758906741 conn(0x7f4968070e30 msgr2=0x7f49680b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 shutdown_connections 2023-10-09T11:36:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.582+0000 7f496d073700 1 -- 172.21.15.26:0/758906741 wait complete. 2023-10-09T11:36:13.594 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:36:13.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 Processor -- start 2023-10-09T11:36:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 -- start start 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee741508c0 0x7fee74158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 0x7fee740af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee74158c80 con 0x7fee7415a0c0 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7415afc0 con 0x7fee741508c0 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.713+0000 7fee7a1c8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740af820 con 0x7fee74150c90 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee741508c0 0x7fee74158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee741508c0 0x7fee74158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50622/0 (socket says 172.21.15.26:50622) 2023-10-09T11:36:13.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 -- 172.21.15.26:0/1765509116 learned_addr learned my addr 172.21.15.26:0/1765509116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee72ffd700 1 --2- 172.21.15.26:0/1765509116 >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 0x7fee740af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 -- 172.21.15.26:0/1765509116 >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 msgr2=0x7fee740af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 --2- 172.21.15.26:0/1765509116 >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 0x7fee740af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 -- 172.21.15.26:0/1765509116 >> v1:172.21.15.67:6789/0 conn(0x7fee7415a0c0 legacy=0x7fee7415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 -- 172.21.15.26:0/1765509116 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74155710 con 0x7fee741508c0 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee72ffd700 1 --2- 172.21.15.26:0/1765509116 >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 0x7fee740af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee737fe700 1 --2- 172.21.15.26:0/1765509116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee741508c0 0x7fee74158650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee7406a500 tx=0x7fee64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459f9958cb9beb18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee727fc700 1 -- 172.21.15.26:0/1765509116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400b7e0 con 0x7fee741508c0 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee727fc700 1 -- 172.21.15.26:0/1765509116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400b940 con 0x7fee741508c0 2023-10-09T11:36:13.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.714+0000 7fee727fc700 1 -- 172.21.15.26:0/1765509116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400bce0 con 0x7fee741508c0 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 -- 172.21.15.26:0/1765509116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee741508c0 msgr2=0x7fee74158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/1765509116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee741508c0 0x7fee74158650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee7406a500 tx=0x7fee64009250 comp rx=0 tx=0).stop 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 -- 172.21.15.26:0/1765509116 shutdown_connections 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/1765509116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee741508c0 0x7fee74158650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/1765509116 >> v2:172.21.15.67:3300/0 conn(0x7fee74150c90 0x7fee740af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 -- 172.21.15.26:0/1765509116 >> 172.21.15.26:0/1765509116 conn(0x7fee740cded0 msgr2=0x7fee7406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 -- 172.21.15.26:0/1765509116 shutdown_connections 2023-10-09T11:36:13.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.715+0000 7fee7a1c8700 1 -- 172.21.15.26:0/1765509116 wait complete. 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.716+0000 7fee7a1c8700 1 Processor -- start 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.716+0000 7fee7a1c8700 1 -- start start 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 0x7fee7414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 0x7fee740c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74154010 con 0x7fee74150c90 2023-10-09T11:36:13.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74155ef0 con 0x7fee7415a0c0 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee7a1c8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7414ddf0 con 0x7fee741508c0 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50636/0 (socket says 172.21.15.26:50636) 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 -- 172.21.15.26:0/357840197 learned_addr learned my addr 172.21.15.26:0/357840197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee73fff700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 0x7fee740c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee737fe700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 0x7fee7414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 -- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 msgr2=0x7fee7414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 0x7fee7414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 -- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 msgr2=0x7fee740c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 0x7fee740c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 -- 172.21.15.26:0/357840197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640094f0 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee73fff700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 0x7fee740c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee737fe700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 0x7fee7414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee72ffd700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c830 tx=0x7fee68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.717+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68011600 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.718+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68011760 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.718+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7414efa0 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.718+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68011b20 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.718+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee741558a0 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.718+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee741560a0 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.719+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee6801a450 con 0x7fee74150c90 2023-10-09T11:36:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.719+0000 7fee5b7fe700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.719+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee68084990 con 0x7fee74150c90 2023-10-09T11:36:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.720+0000 7fee737fe700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.720+0000 7fee737fe700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 0x7fee600693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee7406a500 tx=0x7fee64016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.724+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee741560a0 con 0x7fee74150c90 2023-10-09T11:36:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.911+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee74156060 con 0x7fee60066f30 2023-10-09T11:36:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.919+0000 7fee5b7fe700 1 -- 172.21.15.26:0/357840197 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273918 (secure 0 0 0) 0x7fee74156060 con 0x7fee60066f30 2023-10-09T11:36:13.923 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 msgr2=0x7fee600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 0x7fee600693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee7406a500 tx=0x7fee64016000 comp rx=0 tx=0).stop 2023-10-09T11:36:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 msgr2=0x7fee740c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c830 tx=0x7fee68008040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 shutdown_connections 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7415a0c0 0x7fee740c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee741508c0 0x7fee7414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 --2- 172.21.15.26:0/357840197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee74150c90 0x7fee740c21b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 >> 172.21.15.26:0/357840197 conn(0x7fee740cded0 msgr2=0x7fee7406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 shutdown_connections 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:13.923+0000 7fee7a1c8700 1 -- 172.21.15.26:0/357840197 wait complete. 2023-10-09T11:36:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:13.935 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-09T11:36:13.115756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386372,"kb_used_data":3972,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588348,"statfs":{"total":773094113280,"available":770650468352,"internally_reserved":0,"allocated":4067328,"data_stored":2264508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001466"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.279758+0000","last_change":"2023-10-09T11:36:08.273677+0000","last_active":"2023-10-09T11:36:08.279758+0000","last_peered":"2023-10-09T11:36:08.279758+0000","last_clean":"2023-10-09T11:36:08.279758+0000","last_became_active":"2023-10-09T11:36:08.273392+0000","last_became_peered":"2023-10-09T11:36:08.273392+0000","last_unstale":"2023-10-09T11:36:08.279758+0000","last_undegraded":"2023-10-09T11:36:08.279758+0000","last_fullsized":"2023-10-09T11:36:08.279758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284791+0000","last_change":"2023-10-09T11:36:08.278687+0000","last_active":"2023-10-09T11:36:08.284791+0000","last_peered":"2023-10-09T11:36:08.284791+0000","last_clean":"2023-10-09T11:36:08.284791+0000","last_became_active":"2023-10-09T11:36:08.278178+0000","last_became_peered":"2023-10-09T11:36:08.278178+0000","last_unstale":"2023-10-09T11:36:08.284791+0000","last_undegraded":"2023-10-09T11:36:08.284791+0000","last_fullsized":"2023-10-09T11:36:08.284791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:20.367711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292372+0000","last_change":"2023-10-09T11:36:08.290862+0000","last_active":"2023-10-09T11:36:08.292372+0000","last_peered":"2023-10-09T11:36:08.292372+0000","last_clean":"2023-10-09T11:36:08.292372+0000","last_became_active":"2023-10-09T11:36:08.290568+0000","last_became_peered":"2023-10-09T11:36:08.290568+0000","last_unstale":"2023-10-09T11:36:08.292372+0000","last_undegraded":"2023-10-09T11:36:08.292372+0000","last_fullsized":"2023-10-09T11:36:08.292372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293502+0000","last_change":"2023-10-09T11:36:08.287587+0000","last_active":"2023-10-09T11:36:08.293502+0000","last_peered":"2023-10-09T11:36:08.293502+0000","last_clean":"2023-10-09T11:36:08.293502+0000","last_became_active":"2023-10-09T11:36:08.287318+0000","last_became_peered":"2023-10-09T11:36:08.287318+0000","last_unstale":"2023-10-09T11:36:08.293502+0000","last_undegraded":"2023-10-09T11:36:08.293502+0000","last_fullsized":"2023-10-09T11:36:08.293502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285522+0000","last_change":"2023-10-09T11:36:08.281401+0000","last_active":"2023-10-09T11:36:08.285522+0000","last_peered":"2023-10-09T11:36:08.285522+0000","last_clean":"2023-10-09T11:36:08.285522+0000","last_became_active":"2023-10-09T11:36:08.281182+0000","last_became_peered":"2023-10-09T11:36:08.281182+0000","last_unstale":"2023-10-09T11:36:08.285522+0000","last_undegraded":"2023-10-09T11:36:08.285522+0000","last_fullsized":"2023-10-09T11:36:08.285522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.995381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281091+0000","last_change":"2023-10-09T11:36:08.276410+0000","last_active":"2023-10-09T11:36:08.281091+0000","last_peered":"2023-10-09T11:36:08.281091+0000","last_clean":"2023-10-09T11:36:08.281091+0000","last_became_active":"2023-10-09T11:36:08.276128+0000","last_became_peered":"2023-10-09T11:36:08.276128+0000","last_unstale":"2023-10-09T11:36:08.281091+0000","last_undegraded":"2023-10-09T11:36:08.281091+0000","last_fullsized":"2023-10-09T11:36:08.281091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290594+0000","last_change":"2023-10-09T11:36:08.287500+0000","last_active":"2023-10-09T11:36:08.290594+0000","last_peered":"2023-10-09T11:36:08.290594+0000","last_clean":"2023-10-09T11:36:08.290594+0000","last_became_active":"2023-10-09T11:36:08.287094+0000","last_became_peered":"2023-10-09T11:36:08.287094+0000","last_unstale":"2023-10-09T11:36:08.290594+0000","last_undegraded":"2023-10-09T11:36:08.290594+0000","last_fullsized":"2023-10-09T11:36:08.290594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290545+0000","last_change":"2023-10-09T11:36:08.287006+0000","last_active":"2023-10-09T11:36:08.290545+0000","last_peered":"2023-10-09T11:36:08.290545+0000","last_clean":"2023-10-09T11:36:08.290545+0000","last_became_active":"2023-10-09T11:36:08.286723+0000","last_became_peered":"2023-10-09T11:36:08.286723+0000","last_unstale":"2023-10-09T11:36:08.290545+0000","last_undegraded":"2023-10-09T11:36:08.290545+0000","last_fullsized":"2023-10-09T11:36:08.290545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294957+0000","last_change":"2023-10-09T11:36:08.291813+0000","last_active":"2023-10-09T11:36:08.294957+0000","last_peered":"2023-10-09T11:36:08.294957+0000","last_clean":"2023-10-09T11:36:08.294957+0000","last_became_active":"2023-10-09T11:36:08.291537+0000","last_became_peered":"2023-10-09T11:36:08.291537+0000","last_unstale":"2023-10-09T11:36:08.294957+0000","last_undegraded":"2023-10-09T11:36:08.294957+0000","last_fullsized":"2023-10-09T11:36:08.294957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292827+0000","last_change":"2023-10-09T11:36:08.281785+0000","last_active":"2023-10-09T11:36:08.292827+0000","last_peered":"2023-10-09T11:36:08.292827+0000","last_clean":"2023-10-09T11:36:08.292827+0000","last_became_active":"2023-10-09T11:36:08.281520+0000","last_became_peered":"2023-10-09T11:36:08.281520+0000","last_unstale":"2023-10-09T11:36:08.292827+0000","last_undegraded":"2023-10-09T11:36:08.292827+0000","last_fullsized":"2023-10-09T11:36:08.292827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291939+0000","last_change":"2023-10-09T11:36:08.290214+0000","last_active":"2023-10-09T11:36:08.291939+0000","last_peered":"2023-10-09T11:36:08.291939+0000","last_clean":"2023-10-09T11:36:08.291939+0000","last_became_active":"2023-10-09T11:36:08.289825+0000","last_became_peered":"2023-10-09T11:36:08.289825+0000","last_unstale":"2023-10-09T11:36:08.291939+0000","last_undegraded":"2023-10-09T11:36:08.291939+0000","last_fullsized":"2023-10-09T11:36:08.291939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291512+0000","last_change":"2023-10-09T11:36:08.284600+0000","last_active":"2023-10-09T11:36:08.291512+0000","last_peered":"2023-10-09T11:36:08.291512+0000","last_clean":"2023-10-09T11:36:08.291512+0000","last_became_active":"2023-10-09T11:36:08.278637+0000","last_became_peered":"2023-10-09T11:36:08.278637+0000","last_unstale":"2023-10-09T11:36:08.291512+0000","last_undegraded":"2023-10-09T11:36:08.291512+0000","last_fullsized":"2023-10-09T11:36:08.291512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293117+0000","last_change":"2023-10-09T11:36:08.288046+0000","last_active":"2023-10-09T11:36:08.293117+0000","last_peered":"2023-10-09T11:36:08.293117+0000","last_clean":"2023-10-09T11:36:08.293117+0000","last_became_active":"2023-10-09T11:36:08.287767+0000","last_became_peered":"2023-10-09T11:36:08.287767+0000","last_unstale":"2023-10-09T11:36:08.293117+0000","last_undegraded":"2023-10-09T11:36:08.293117+0000","last_fullsized":"2023-10-09T11:36:08.293117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:19.830919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285647+0000","last_change":"2023-10-09T11:36:08.280935+0000","last_active":"2023-10-09T11:36:08.285647+0000","last_peered":"2023-10-09T11:36:08.285647+0000","last_clean":"2023-10-09T11:36:08.285647+0000","last_became_active":"2023-10-09T11:36:08.280551+0000","last_became_peered":"2023-10-09T11:36:08.280551+0000","last_unstale":"2023-10-09T11:36:08.285647+0000","last_undegraded":"2023-10-09T11:36:08.285647+0000","last_fullsized":"2023-10-09T11:36:08.285647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283730+0000","last_change":"2023-10-09T11:36:08.277342+0000","last_active":"2023-10-09T11:36:08.283730+0000","last_peered":"2023-10-09T11:36:08.283730+0000","last_clean":"2023-10-09T11:36:08.283730+0000","last_became_active":"2023-10-09T11:36:08.277060+0000","last_became_peered":"2023-10-09T11:36:08.277060+0000","last_unstale":"2023-10-09T11:36:08.283730+0000","last_undegraded":"2023-10-09T11:36:08.283730+0000","last_fullsized":"2023-10-09T11:36:08.283730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291618+0000","last_change":"2023-10-09T11:36:08.288090+0000","last_active":"2023-10-09T11:36:08.291618+0000","last_peered":"2023-10-09T11:36:08.291618+0000","last_clean":"2023-10-09T11:36:08.291618+0000","last_became_active":"2023-10-09T11:36:08.287801+0000","last_became_peered":"2023-10-09T11:36:08.287801+0000","last_unstale":"2023-10-09T11:36:08.291618+0000","last_undegraded":"2023-10-09T11:36:08.291618+0000","last_fullsized":"2023-10-09T11:36:08.291618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290555+0000","last_change":"2023-10-09T11:36:08.286992+0000","last_active":"2023-10-09T11:36:08.290555+0000","last_peered":"2023-10-09T11:36:08.290555+0000","last_clean":"2023-10-09T11:36:08.290555+0000","last_became_active":"2023-10-09T11:36:08.286412+0000","last_became_peered":"2023-10-09T11:36:08.286412+0000","last_unstale":"2023-10-09T11:36:08.290555+0000","last_undegraded":"2023-10-09T11:36:08.290555+0000","last_fullsized":"2023-10-09T11:36:08.290555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293161+0000","last_change":"2023-10-09T11:36:08.290167+0000","last_active":"2023-10-09T11:36:08.293161+0000","last_peered":"2023-10-09T11:36:08.293161+0000","last_clean":"2023-10-09T11:36:08.293161+0000","last_became_active":"2023-10-09T11:36:08.289904+0000","last_became_peered":"2023-10-09T11:36:08.289904+0000","last_unstale":"2023-10-09T11:36:08.293161+0000","last_undegraded":"2023-10-09T11:36:08.293161+0000","last_fullsized":"2023-10-09T11:36:08.293161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293115+0000","last_change":"2023-10-09T11:36:08.290062+0000","last_active":"2023-10-09T11:36:08.293115+0000","last_peered":"2023-10-09T11:36:08.293115+0000","last_clean":"2023-10-09T11:36:08.293115+0000","last_became_active":"2023-10-09T11:36:08.289712+0000","last_became_peered":"2023-10-09T11:36:08.289712+0000","last_unstale":"2023-10-09T11:36:08.293115+0000","last_undegraded":"2023-10-09T11:36:08.293115+0000","last_fullsized":"2023-10-09T11:36:08.293115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:29.618537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290792+0000","last_change":"2023-10-09T11:36:08.286490+0000","last_active":"2023-10-09T11:36:08.290792+0000","last_peered":"2023-10-09T11:36:08.290792+0000","last_clean":"2023-10-09T11:36:08.290792+0000","last_became_active":"2023-10-09T11:36:08.286235+0000","last_became_peered":"2023-10-09T11:36:08.286235+0000","last_unstale":"2023-10-09T11:36:08.290792+0000","last_undegraded":"2023-10-09T11:36:08.290792+0000","last_fullsized":"2023-10-09T11:36:08.290792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:54.131479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285298+0000","last_change":"2023-10-09T11:36:08.279912+0000","last_active":"2023-10-09T11:36:08.285298+0000","last_peered":"2023-10-09T11:36:08.285298+0000","last_clean":"2023-10-09T11:36:08.285298+0000","last_became_active":"2023-10-09T11:36:08.279612+0000","last_became_peered":"2023-10-09T11:36:08.279612+0000","last_unstale":"2023-10-09T11:36:08.285298+0000","last_undegraded":"2023-10-09T11:36:08.285298+0000","last_fullsized":"2023-10-09T11:36:08.285298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290153+0000","last_change":"2023-10-09T11:36:08.284955+0000","last_active":"2023-10-09T11:36:08.290153+0000","last_peered":"2023-10-09T11:36:08.290153+0000","last_clean":"2023-10-09T11:36:08.290153+0000","last_became_active":"2023-10-09T11:36:08.284035+0000","last_became_peered":"2023-10-09T11:36:08.284035+0000","last_unstale":"2023-10-09T11:36:08.290153+0000","last_undegraded":"2023-10-09T11:36:08.290153+0000","last_fullsized":"2023-10-09T11:36:08.290153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.280028+0000","last_change":"2023-10-09T11:36:08.275290+0000","last_active":"2023-10-09T11:36:08.280028+0000","last_peered":"2023-10-09T11:36:08.280028+0000","last_clean":"2023-10-09T11:36:08.280028+0000","last_became_active":"2023-10-09T11:36:08.275001+0000","last_became_peered":"2023-10-09T11:36:08.275001+0000","last_unstale":"2023-10-09T11:36:08.280028+0000","last_undegraded":"2023-10-09T11:36:08.280028+0000","last_fullsized":"2023-10-09T11:36:08.280028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281852+0000","last_change":"2023-10-09T11:36:08.273715+0000","last_active":"2023-10-09T11:36:08.281852+0000","last_peered":"2023-10-09T11:36:08.281852+0000","last_clean":"2023-10-09T11:36:08.281852+0000","last_became_active":"2023-10-09T11:36:08.273287+0000","last_became_peered":"2023-10-09T11:36:08.273287+0000","last_unstale":"2023-10-09T11:36:08.281852+0000","last_undegraded":"2023-10-09T11:36:08.281852+0000","last_fullsized":"2023-10-09T11:36:08.281852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292622+0000","last_change":"2023-10-09T11:36:08.279702+0000","last_active":"2023-10-09T11:36:08.292622+0000","last_peered":"2023-10-09T11:36:08.292622+0000","last_clean":"2023-10-09T11:36:08.292622+0000","last_became_active":"2023-10-09T11:36:08.279443+0000","last_became_peered":"2023-10-09T11:36:08.279443+0000","last_unstale":"2023-10-09T11:36:08.292622+0000","last_undegraded":"2023-10-09T11:36:08.292622+0000","last_fullsized":"2023-10-09T11:36:08.292622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284772+0000","last_change":"2023-10-09T11:36:08.278434+0000","last_active":"2023-10-09T11:36:08.284772+0000","last_peered":"2023-10-09T11:36:08.284772+0000","last_clean":"2023-10-09T11:36:08.284772+0000","last_became_active":"2023-10-09T11:36:08.277846+0000","last_became_peered":"2023-10-09T11:36:08.277846+0000","last_unstale":"2023-10-09T11:36:08.284772+0000","last_undegraded":"2023-10-09T11:36:08.284772+0000","last_fullsized":"2023-10-09T11:36:08.284772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:59.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293733+0000","last_change":"2023-10-09T11:36:08.288625+0000","last_active":"2023-10-09T11:36:08.293733+0000","last_peered":"2023-10-09T11:36:08.293733+0000","last_clean":"2023-10-09T11:36:08.293733+0000","last_became_active":"2023-10-09T11:36:08.287902+0000","last_became_peered":"2023-10-09T11:36:08.287902+0000","last_unstale":"2023-10-09T11:36:08.293733+0000","last_undegraded":"2023-10-09T11:36:08.293733+0000","last_fullsized":"2023-10-09T11:36:08.293733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284821+0000","last_change":"2023-10-09T11:36:08.276526+0000","last_active":"2023-10-09T11:36:08.284821+0000","last_peered":"2023-10-09T11:36:08.284821+0000","last_clean":"2023-10-09T11:36:08.284821+0000","last_became_active":"2023-10-09T11:36:08.276261+0000","last_became_peered":"2023-10-09T11:36:08.276261+0000","last_unstale":"2023-10-09T11:36:08.284821+0000","last_undegraded":"2023-10-09T11:36:08.284821+0000","last_fullsized":"2023-10-09T11:36:08.284821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288093+0000","last_change":"2023-10-09T11:36:08.283000+0000","last_active":"2023-10-09T11:36:08.288093+0000","last_peered":"2023-10-09T11:36:08.288093+0000","last_clean":"2023-10-09T11:36:08.288093+0000","last_became_active":"2023-10-09T11:36:08.282712+0000","last_became_peered":"2023-10-09T11:36:08.282712+0000","last_unstale":"2023-10-09T11:36:08.288093+0000","last_undegraded":"2023-10-09T11:36:08.288093+0000","last_fullsized":"2023-10-09T11:36:08.288093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290609+0000","last_change":"2023-10-09T11:36:08.287215+0000","last_active":"2023-10-09T11:36:08.290609+0000","last_peered":"2023-10-09T11:36:08.290609+0000","last_clean":"2023-10-09T11:36:08.290609+0000","last_became_active":"2023-10-09T11:36:08.286880+0000","last_became_peered":"2023-10-09T11:36:08.286880+0000","last_unstale":"2023-10-09T11:36:08.290609+0000","last_undegraded":"2023-10-09T11:36:08.290609+0000","last_fullsized":"2023-10-09T11:36:08.290609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288539+0000","last_change":"2023-10-09T11:36:08.285992+0000","last_active":"2023-10-09T11:36:08.288539+0000","last_peered":"2023-10-09T11:36:08.288539+0000","last_clean":"2023-10-09T11:36:08.288539+0000","last_became_active":"2023-10-09T11:36:08.285693+0000","last_became_peered":"2023-10-09T11:36:08.285693+0000","last_unstale":"2023-10-09T11:36:08.288539+0000","last_undegraded":"2023-10-09T11:36:08.288539+0000","last_fullsized":"2023-10-09T11:36:08.288539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:18.436232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288904+0000","last_change":"2023-10-09T11:36:08.286011+0000","last_active":"2023-10-09T11:36:08.288904+0000","last_peered":"2023-10-09T11:36:08.288904+0000","last_clean":"2023-10-09T11:36:08.288904+0000","last_became_active":"2023-10-09T11:36:08.285540+0000","last_became_peered":"2023-10-09T11:36:08.285540+0000","last_unstale":"2023-10-09T11:36:08.288904+0000","last_undegraded":"2023-10-09T11:36:08.288904+0000","last_fullsized":"2023-10-09T11:36:08.288904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284934+0000","last_change":"2023-10-09T11:36:08.280784+0000","last_active":"2023-10-09T11:36:08.284934+0000","last_peered":"2023-10-09T11:36:08.284934+0000","last_clean":"2023-10-09T11:36:08.284934+0000","last_became_active":"2023-10-09T11:36:08.280527+0000","last_became_peered":"2023-10-09T11:36:08.280527+0000","last_unstale":"2023-10-09T11:36:08.284934+0000","last_undegraded":"2023-10-09T11:36:08.284934+0000","last_fullsized":"2023-10-09T11:36:08.284934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292413+0000","last_change":"2023-10-09T11:36:07.282121+0000","last_active":"2023-10-09T11:36:08.292413+0000","last_peered":"2023-10-09T11:36:08.292413+0000","last_clean":"2023-10-09T11:36:08.292413+0000","last_became_active":"2023-10-09T11:36:07.281861+0000","last_became_peered":"2023-10-09T11:36:07.281861+0000","last_unstale":"2023-10-09T11:36:08.292413+0000","last_undegraded":"2023-10-09T11:36:08.292413+0000","last_fullsized":"2023-10-09T11:36:08.292413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285116+0000","last_change":"2023-10-09T11:36:08.280847+0000","last_active":"2023-10-09T11:36:08.285116+0000","last_peered":"2023-10-09T11:36:08.285116+0000","last_clean":"2023-10-09T11:36:08.285116+0000","last_became_active":"2023-10-09T11:36:08.280341+0000","last_became_peered":"2023-10-09T11:36:08.280341+0000","last_unstale":"2023-10-09T11:36:08.285116+0000","last_undegraded":"2023-10-09T11:36:08.285116+0000","last_fullsized":"2023-10-09T11:36:08.285116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284941+0000","last_change":"2023-10-09T11:36:07.282358+0000","last_active":"2023-10-09T11:36:08.284941+0000","last_peered":"2023-10-09T11:36:08.284941+0000","last_clean":"2023-10-09T11:36:08.284941+0000","last_became_active":"2023-10-09T11:36:07.282052+0000","last_became_peered":"2023-10-09T11:36:07.282052+0000","last_unstale":"2023-10-09T11:36:08.284941+0000","last_undegraded":"2023-10-09T11:36:08.284941+0000","last_fullsized":"2023-10-09T11:36:08.284941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287844+0000","last_change":"2023-10-09T11:36:08.282472+0000","last_active":"2023-10-09T11:36:08.287844+0000","last_peered":"2023-10-09T11:36:08.287844+0000","last_clean":"2023-10-09T11:36:08.287844+0000","last_became_active":"2023-10-09T11:36:08.282176+0000","last_became_peered":"2023-10-09T11:36:08.282176+0000","last_unstale":"2023-10-09T11:36:08.287844+0000","last_undegraded":"2023-10-09T11:36:08.287844+0000","last_fullsized":"2023-10-09T11:36:08.287844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294196+0000","last_change":"2023-10-09T11:36:07.277817+0000","last_active":"2023-10-09T11:36:08.294196+0000","last_peered":"2023-10-09T11:36:08.294196+0000","last_clean":"2023-10-09T11:36:08.294196+0000","last_became_active":"2023-10-09T11:36:07.277546+0000","last_became_peered":"2023-10-09T11:36:07.277546+0000","last_unstale":"2023-10-09T11:36:08.294196+0000","last_undegraded":"2023-10-09T11:36:08.294196+0000","last_fullsized":"2023-10-09T11:36:08.294196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293757+0000","last_change":"2023-10-09T11:36:08.288692+0000","last_active":"2023-10-09T11:36:08.293757+0000","last_peered":"2023-10-09T11:36:08.293757+0000","last_clean":"2023-10-09T11:36:08.293757+0000","last_became_active":"2023-10-09T11:36:08.288192+0000","last_became_peered":"2023-10-09T11:36:08.288192+0000","last_unstale":"2023-10-09T11:36:08.293757+0000","last_undegraded":"2023-10-09T11:36:08.293757+0000","last_fullsized":"2023-10-09T11:36:08.293757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293387+0000","last_change":"2023-10-09T11:36:07.274424+0000","last_active":"2023-10-09T11:36:08.293387+0000","last_peered":"2023-10-09T11:36:08.293387+0000","last_clean":"2023-10-09T11:36:08.293387+0000","last_became_active":"2023-10-09T11:36:07.274134+0000","last_became_peered":"2023-10-09T11:36:07.274134+0000","last_unstale":"2023-10-09T11:36:08.293387+0000","last_undegraded":"2023-10-09T11:36:08.293387+0000","last_fullsized":"2023-10-09T11:36:08.293387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:01.291196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286073+0000","last_change":"2023-10-09T11:36:08.285240+0000","last_active":"2023-10-09T11:36:08.286073+0000","last_peered":"2023-10-09T11:36:08.286073+0000","last_clean":"2023-10-09T11:36:08.286073+0000","last_became_active":"2023-10-09T11:36:08.284949+0000","last_became_peered":"2023-10-09T11:36:08.284949+0000","last_unstale":"2023-10-09T11:36:08.286073+0000","last_undegraded":"2023-10-09T11:36:08.286073+0000","last_fullsized":"2023-10-09T11:36:08.286073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293182+0000","last_change":"2023-10-09T11:36:07.279426+0000","last_active":"2023-10-09T11:36:08.293182+0000","last_peered":"2023-10-09T11:36:08.293182+0000","last_clean":"2023-10-09T11:36:08.293182+0000","last_became_active":"2023-10-09T11:36:07.279113+0000","last_became_peered":"2023-10-09T11:36:07.279113+0000","last_unstale":"2023-10-09T11:36:08.293182+0000","last_undegraded":"2023-10-09T11:36:08.293182+0000","last_fullsized":"2023-10-09T11:36:08.293182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284709+0000","last_change":"2023-10-09T11:36:08.282166+0000","last_active":"2023-10-09T11:36:08.284709+0000","last_peered":"2023-10-09T11:36:08.284709+0000","last_clean":"2023-10-09T11:36:08.284709+0000","last_became_active":"2023-10-09T11:36:08.281862+0000","last_became_peered":"2023-10-09T11:36:08.281862+0000","last_unstale":"2023-10-09T11:36:08.284709+0000","last_undegraded":"2023-10-09T11:36:08.284709+0000","last_fullsized":"2023-10-09T11:36:08.284709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287053+0000","last_change":"2023-10-09T11:36:07.278415+0000","last_active":"2023-10-09T11:36:08.287053+0000","last_peered":"2023-10-09T11:36:08.287053+0000","last_clean":"2023-10-09T11:36:08.287053+0000","last_became_active":"2023-10-09T11:36:07.278088+0000","last_became_peered":"2023-10-09T11:36:07.278088+0000","last_unstale":"2023-10-09T11:36:08.287053+0000","last_undegraded":"2023-10-09T11:36:08.287053+0000","last_fullsized":"2023-10-09T11:36:08.287053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:03.205996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283150+0000","last_change":"2023-10-09T11:36:08.277760+0000","last_active":"2023-10-09T11:36:08.283150+0000","last_peered":"2023-10-09T11:36:08.283150+0000","last_clean":"2023-10-09T11:36:08.283150+0000","last_became_active":"2023-10-09T11:36:08.277480+0000","last_became_peered":"2023-10-09T11:36:08.277480+0000","last_unstale":"2023-10-09T11:36:08.283150+0000","last_undegraded":"2023-10-09T11:36:08.283150+0000","last_fullsized":"2023-10-09T11:36:08.283150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.278182+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277722+0000","last_became_peered":"2023-10-09T11:36:07.277722+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:49.147228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292591+0000","last_change":"2023-10-09T11:36:08.279232+0000","last_active":"2023-10-09T11:36:08.292591+0000","last_peered":"2023-10-09T11:36:08.292591+0000","last_clean":"2023-10-09T11:36:08.292591+0000","last_became_active":"2023-10-09T11:36:08.278961+0000","last_became_peered":"2023-10-09T11:36:08.278961+0000","last_unstale":"2023-10-09T11:36:08.292591+0000","last_undegraded":"2023-10-09T11:36:08.292591+0000","last_fullsized":"2023-10-09T11:36:08.292591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.277553+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277237+0000","last_became_peered":"2023-10-09T11:36:07.277237+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:18.826059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284628+0000","last_change":"2023-10-09T11:36:08.280688+0000","last_active":"2023-10-09T11:36:08.284628+0000","last_peered":"2023-10-09T11:36:08.284628+0000","last_clean":"2023-10-09T11:36:08.284628+0000","last_became_active":"2023-10-09T11:36:08.280292+0000","last_became_peered":"2023-10-09T11:36:08.280292+0000","last_unstale":"2023-10-09T11:36:08.284628+0000","last_undegraded":"2023-10-09T11:36:08.284628+0000","last_fullsized":"2023-10-09T11:36:08.284628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270323+0000","last_change":"2023-10-09T11:36:07.284759+0000","last_active":"2023-10-09T11:36:08.270323+0000","last_peered":"2023-10-09T11:36:08.270323+0000","last_clean":"2023-10-09T11:36:08.270323+0000","last_became_active":"2023-10-09T11:36:07.284467+0000","last_became_peered":"2023-10-09T11:36:07.284467+0000","last_unstale":"2023-10-09T11:36:08.270323+0000","last_undegraded":"2023-10-09T11:36:08.270323+0000","last_fullsized":"2023-10-09T11:36:08.270323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:17.431372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293199+0000","last_change":"2023-10-09T11:36:08.290418+0000","last_active":"2023-10-09T11:36:08.293199+0000","last_peered":"2023-10-09T11:36:08.293199+0000","last_clean":"2023-10-09T11:36:08.293199+0000","last_became_active":"2023-10-09T11:36:08.289613+0000","last_became_peered":"2023-10-09T11:36:08.289613+0000","last_unstale":"2023-10-09T11:36:08.293199+0000","last_undegraded":"2023-10-09T11:36:08.293199+0000","last_fullsized":"2023-10-09T11:36:08.293199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269028+0000","last_change":"2023-10-09T11:36:07.274812+0000","last_active":"2023-10-09T11:36:08.269028+0000","last_peered":"2023-10-09T11:36:08.269028+0000","last_clean":"2023-10-09T11:36:08.269028+0000","last_became_active":"2023-10-09T11:36:07.274502+0000","last_became_peered":"2023-10-09T11:36:07.274502+0000","last_unstale":"2023-10-09T11:36:08.269028+0000","last_undegraded":"2023-10-09T11:36:08.269028+0000","last_fullsized":"2023-10-09T11:36:08.269028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291889+0000","last_change":"2023-10-09T11:36:08.277583+0000","last_active":"2023-10-09T11:36:08.291889+0000","last_peered":"2023-10-09T11:36:08.291889+0000","last_clean":"2023-10-09T11:36:08.291889+0000","last_became_active":"2023-10-09T11:36:08.277284+0000","last_became_peered":"2023-10-09T11:36:08.277284+0000","last_unstale":"2023-10-09T11:36:08.291889+0000","last_undegraded":"2023-10-09T11:36:08.291889+0000","last_fullsized":"2023-10-09T11:36:08.291889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:06.511358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292516+0000","last_change":"2023-10-09T11:36:07.283964+0000","last_active":"2023-10-09T11:36:08.292516+0000","last_peered":"2023-10-09T11:36:08.292516+0000","last_clean":"2023-10-09T11:36:08.292516+0000","last_became_active":"2023-10-09T11:36:07.283626+0000","last_became_peered":"2023-10-09T11:36:07.283626+0000","last_unstale":"2023-10-09T11:36:08.292516+0000","last_undegraded":"2023-10-09T11:36:08.292516+0000","last_fullsized":"2023-10-09T11:36:08.292516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:03.385790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284674+0000","last_change":"2023-10-09T11:36:08.281129+0000","last_active":"2023-10-09T11:36:08.284674+0000","last_peered":"2023-10-09T11:36:08.284674+0000","last_clean":"2023-10-09T11:36:08.284674+0000","last_became_active":"2023-10-09T11:36:08.280848+0000","last_became_peered":"2023-10-09T11:36:08.280848+0000","last_unstale":"2023-10-09T11:36:08.284674+0000","last_undegraded":"2023-10-09T11:36:08.284674+0000","last_fullsized":"2023-10-09T11:36:08.284674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.296058+0000","last_change":"2023-10-09T11:36:07.278932+0000","last_active":"2023-10-09T11:36:08.296058+0000","last_peered":"2023-10-09T11:36:08.296058+0000","last_clean":"2023-10-09T11:36:08.296058+0000","last_became_active":"2023-10-09T11:36:07.278663+0000","last_became_peered":"2023-10-09T11:36:07.278663+0000","last_unstale":"2023-10-09T11:36:08.296058+0000","last_undegraded":"2023-10-09T11:36:08.296058+0000","last_fullsized":"2023-10-09T11:36:08.296058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:12.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292177+0000","last_change":"2023-10-09T11:36:08.276944+0000","last_active":"2023-10-09T11:36:08.292177+0000","last_peered":"2023-10-09T11:36:08.292177+0000","last_clean":"2023-10-09T11:36:08.292177+0000","last_became_active":"2023-10-09T11:36:08.276663+0000","last_became_peered":"2023-10-09T11:36:08.276663+0000","last_unstale":"2023-10-09T11:36:08.292177+0000","last_undegraded":"2023-10-09T11:36:08.292177+0000","last_fullsized":"2023-10-09T11:36:08.292177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291233+0000","last_change":"2023-10-09T11:36:07.277618+0000","last_active":"2023-10-09T11:36:08.291233+0000","last_peered":"2023-10-09T11:36:08.291233+0000","last_clean":"2023-10-09T11:36:08.291233+0000","last_became_active":"2023-10-09T11:36:07.277333+0000","last_became_peered":"2023-10-09T11:36:07.277333+0000","last_unstale":"2023-10-09T11:36:08.291233+0000","last_undegraded":"2023-10-09T11:36:08.291233+0000","last_fullsized":"2023-10-09T11:36:08.291233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:18.779855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285785+0000","last_change":"2023-10-09T11:36:08.280498+0000","last_active":"2023-10-09T11:36:08.285785+0000","last_peered":"2023-10-09T11:36:08.285785+0000","last_clean":"2023-10-09T11:36:08.285785+0000","last_became_active":"2023-10-09T11:36:08.280194+0000","last_became_peered":"2023-10-09T11:36:08.280194+0000","last_unstale":"2023-10-09T11:36:08.285785+0000","last_undegraded":"2023-10-09T11:36:08.285785+0000","last_fullsized":"2023-10-09T11:36:08.285785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.267965+0000","last_change":"2023-10-09T11:36:07.277846+0000","last_active":"2023-10-09T11:36:08.267965+0000","last_peered":"2023-10-09T11:36:08.267965+0000","last_clean":"2023-10-09T11:36:08.267965+0000","last_became_active":"2023-10-09T11:36:07.277548+0000","last_became_peered":"2023-10-09T11:36:07.277548+0000","last_unstale":"2023-10-09T11:36:08.267965+0000","last_undegraded":"2023-10-09T11:36:08.267965+0000","last_fullsized":"2023-10-09T11:36:08.267965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288885+0000","last_change":"2023-10-09T11:36:08.285822+0000","last_active":"2023-10-09T11:36:08.288885+0000","last_peered":"2023-10-09T11:36:08.288885+0000","last_clean":"2023-10-09T11:36:08.288885+0000","last_became_active":"2023-10-09T11:36:08.285175+0000","last_became_peered":"2023-10-09T11:36:08.285175+0000","last_unstale":"2023-10-09T11:36:08.288885+0000","last_undegraded":"2023-10-09T11:36:08.288885+0000","last_fullsized":"2023-10-09T11:36:08.288885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270091+0000","last_change":"2023-10-09T11:36:07.284865+0000","last_active":"2023-10-09T11:36:08.270091+0000","last_peered":"2023-10-09T11:36:08.270091+0000","last_clean":"2023-10-09T11:36:08.270091+0000","last_became_active":"2023-10-09T11:36:07.284588+0000","last_became_peered":"2023-10-09T11:36:07.284588+0000","last_unstale":"2023-10-09T11:36:08.270091+0000","last_undegraded":"2023-10-09T11:36:08.270091+0000","last_fullsized":"2023-10-09T11:36:08.270091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.090633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288557+0000","last_change":"2023-10-09T11:36:08.286252+0000","last_active":"2023-10-09T11:36:08.288557+0000","last_peered":"2023-10-09T11:36:08.288557+0000","last_clean":"2023-10-09T11:36:08.288557+0000","last_became_active":"2023-10-09T11:36:08.285691+0000","last_became_peered":"2023-10-09T11:36:08.285691+0000","last_unstale":"2023-10-09T11:36:08.288557+0000","last_undegraded":"2023-10-09T11:36:08.288557+0000","last_fullsized":"2023-10-09T11:36:08.288557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294798+0000","last_change":"2023-10-09T11:36:07.276787+0000","last_active":"2023-10-09T11:36:08.294798+0000","last_peered":"2023-10-09T11:36:08.294798+0000","last_clean":"2023-10-09T11:36:08.294798+0000","last_became_active":"2023-10-09T11:36:07.276512+0000","last_became_peered":"2023-10-09T11:36:07.276512+0000","last_unstale":"2023-10-09T11:36:08.294798+0000","last_undegraded":"2023-10-09T11:36:08.294798+0000","last_fullsized":"2023-10-09T11:36:08.294798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282895+0000","last_change":"2023-10-09T11:36:08.275830+0000","last_active":"2023-10-09T11:36:08.282895+0000","last_peered":"2023-10-09T11:36:08.282895+0000","last_clean":"2023-10-09T11:36:08.282895+0000","last_became_active":"2023-10-09T11:36:08.275540+0000","last_became_peered":"2023-10-09T11:36:08.275540+0000","last_unstale":"2023-10-09T11:36:08.282895+0000","last_undegraded":"2023-10-09T11:36:08.282895+0000","last_fullsized":"2023-10-09T11:36:08.282895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294540+0000","last_change":"2023-10-09T11:36:07.279427+0000","last_active":"2023-10-09T11:36:08.294540+0000","last_peered":"2023-10-09T11:36:08.294540+0000","last_clean":"2023-10-09T11:36:08.294540+0000","last_became_active":"2023-10-09T11:36:07.278936+0000","last_became_peered":"2023-10-09T11:36:07.278936+0000","last_unstale":"2023-10-09T11:36:08.294540+0000","last_undegraded":"2023-10-09T11:36:08.294540+0000","last_fullsized":"2023-10-09T11:36:08.294540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289951+0000","last_change":"2023-10-09T11:36:08.283247+0000","last_active":"2023-10-09T11:36:08.289951+0000","last_peered":"2023-10-09T11:36:08.289951+0000","last_clean":"2023-10-09T11:36:08.289951+0000","last_became_active":"2023-10-09T11:36:08.282938+0000","last_became_peered":"2023-10-09T11:36:08.282938+0000","last_unstale":"2023-10-09T11:36:08.289951+0000","last_undegraded":"2023-10-09T11:36:08.289951+0000","last_fullsized":"2023-10-09T11:36:08.289951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287415+0000","last_change":"2023-10-09T11:36:07.280068+0000","last_active":"2023-10-09T11:36:08.287415+0000","last_peered":"2023-10-09T11:36:08.287415+0000","last_clean":"2023-10-09T11:36:08.287415+0000","last_became_active":"2023-10-09T11:36:07.279789+0000","last_became_peered":"2023-10-09T11:36:07.279789+0000","last_unstale":"2023-10-09T11:36:08.287415+0000","last_undegraded":"2023-10-09T11:36:08.287415+0000","last_fullsized":"2023-10-09T11:36:08.287415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:48.608927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293202+0000","last_change":"2023-10-09T11:36:08.285067+0000","last_active":"2023-10-09T11:36:08.293202+0000","last_peered":"2023-10-09T11:36:08.293202+0000","last_clean":"2023-10-09T11:36:08.293202+0000","last_became_active":"2023-10-09T11:36:08.284743+0000","last_became_peered":"2023-10-09T11:36:08.284743+0000","last_unstale":"2023-10-09T11:36:08.293202+0000","last_undegraded":"2023-10-09T11:36:08.293202+0000","last_fullsized":"2023-10-09T11:36:08.293202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286630+0000","last_change":"2023-10-09T11:36:07.279785+0000","last_active":"2023-10-09T11:36:08.286630+0000","last_peered":"2023-10-09T11:36:08.286630+0000","last_clean":"2023-10-09T11:36:08.286630+0000","last_became_active":"2023-10-09T11:36:07.279196+0000","last_became_peered":"2023-10-09T11:36:07.279196+0000","last_unstale":"2023-10-09T11:36:08.286630+0000","last_undegraded":"2023-10-09T11:36:08.286630+0000","last_fullsized":"2023-10-09T11:36:08.286630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:58.492719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285708+0000","last_change":"2023-10-09T11:36:08.279359+0000","last_active":"2023-10-09T11:36:08.285708+0000","last_peered":"2023-10-09T11:36:08.285708+0000","last_clean":"2023-10-09T11:36:08.285708+0000","last_became_active":"2023-10-09T11:36:08.279085+0000","last_became_peered":"2023-10-09T11:36:08.279085+0000","last_unstale":"2023-10-09T11:36:08.285708+0000","last_undegraded":"2023-10-09T11:36:08.285708+0000","last_fullsized":"2023-10-09T11:36:08.285708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.850239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271052+0000","last_change":"2023-10-09T11:36:07.280371+0000","last_active":"2023-10-09T11:36:08.271052+0000","last_peered":"2023-10-09T11:36:08.271052+0000","last_clean":"2023-10-09T11:36:08.271052+0000","last_became_active":"2023-10-09T11:36:07.280080+0000","last_became_peered":"2023-10-09T11:36:07.280080+0000","last_unstale":"2023-10-09T11:36:08.271052+0000","last_undegraded":"2023-10-09T11:36:08.271052+0000","last_fullsized":"2023-10-09T11:36:08.271052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285485+0000","last_change":"2023-10-09T11:36:08.282867+0000","last_active":"2023-10-09T11:36:08.285485+0000","last_peered":"2023-10-09T11:36:08.285485+0000","last_clean":"2023-10-09T11:36:08.285485+0000","last_became_active":"2023-10-09T11:36:08.282595+0000","last_became_peered":"2023-10-09T11:36:08.282595+0000","last_unstale":"2023-10-09T11:36:08.285485+0000","last_undegraded":"2023-10-09T11:36:08.285485+0000","last_fullsized":"2023-10-09T11:36:08.285485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.366025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292618+0000","last_change":"2023-10-09T11:36:07.275507+0000","last_active":"2023-10-09T11:36:08.292618+0000","last_peered":"2023-10-09T11:36:08.292618+0000","last_clean":"2023-10-09T11:36:08.292618+0000","last_became_active":"2023-10-09T11:36:07.273512+0000","last_became_peered":"2023-10-09T11:36:07.273512+0000","last_unstale":"2023-10-09T11:36:08.292618+0000","last_undegraded":"2023-10-09T11:36:08.292618+0000","last_fullsized":"2023-10-09T11:36:08.292618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285542+0000","last_change":"2023-10-09T11:36:08.282018+0000","last_active":"2023-10-09T11:36:08.285542+0000","last_peered":"2023-10-09T11:36:08.285542+0000","last_clean":"2023-10-09T11:36:08.285542+0000","last_became_active":"2023-10-09T11:36:08.281760+0000","last_became_peered":"2023-10-09T11:36:08.281760+0000","last_unstale":"2023-10-09T11:36:08.285542+0000","last_undegraded":"2023-10-09T11:36:08.285542+0000","last_fullsized":"2023-10-09T11:36:08.285542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:49.613786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.265705+0000","last_change":"2023-10-09T11:36:07.281451+0000","last_active":"2023-10-09T11:36:08.265705+0000","last_peered":"2023-10-09T11:36:08.265705+0000","last_clean":"2023-10-09T11:36:08.265705+0000","last_became_active":"2023-10-09T11:36:07.281196+0000","last_became_peered":"2023-10-09T11:36:07.281196+0000","last_unstale":"2023-10-09T11:36:08.265705+0000","last_undegraded":"2023-10-09T11:36:08.265705+0000","last_fullsized":"2023-10-09T11:36:08.265705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285540+0000","last_change":"2023-10-09T11:36:08.277441+0000","last_active":"2023-10-09T11:36:08.285540+0000","last_peered":"2023-10-09T11:36:08.285540+0000","last_clean":"2023-10-09T11:36:08.285540+0000","last_became_active":"2023-10-09T11:36:08.277184+0000","last_became_peered":"2023-10-09T11:36:08.277184+0000","last_unstale":"2023-10-09T11:36:08.285540+0000","last_undegraded":"2023-10-09T11:36:08.285540+0000","last_fullsized":"2023-10-09T11:36:08.285540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:19.784715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270615+0000","last_change":"2023-10-09T11:36:07.278628+0000","last_active":"2023-10-09T11:36:08.270615+0000","last_peered":"2023-10-09T11:36:08.270615+0000","last_clean":"2023-10-09T11:36:08.270615+0000","last_became_active":"2023-10-09T11:36:07.278359+0000","last_became_peered":"2023-10-09T11:36:07.278359+0000","last_unstale":"2023-10-09T11:36:08.270615+0000","last_undegraded":"2023-10-09T11:36:08.270615+0000","last_fullsized":"2023-10-09T11:36:08.270615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.917615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291747+0000","last_change":"2023-10-09T11:36:08.287971+0000","last_active":"2023-10-09T11:36:08.291747+0000","last_peered":"2023-10-09T11:36:08.291747+0000","last_clean":"2023-10-09T11:36:08.291747+0000","last_became_active":"2023-10-09T11:36:08.287474+0000","last_became_peered":"2023-10-09T11:36:08.287474+0000","last_unstale":"2023-10-09T11:36:08.291747+0000","last_undegraded":"2023-10-09T11:36:08.291747+0000","last_fullsized":"2023-10-09T11:36:08.291747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.264777+0000","last_change":"2023-10-09T11:36:07.276933+0000","last_active":"2023-10-09T11:36:08.264777+0000","last_peered":"2023-10-09T11:36:08.264777+0000","last_clean":"2023-10-09T11:36:08.264777+0000","last_became_active":"2023-10-09T11:36:07.276691+0000","last_became_peered":"2023-10-09T11:36:07.276691+0000","last_unstale":"2023-10-09T11:36:08.264777+0000","last_undegraded":"2023-10-09T11:36:08.264777+0000","last_fullsized":"2023-10-09T11:36:08.264777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287084+0000","last_change":"2023-10-09T11:36:08.284621+0000","last_active":"2023-10-09T11:36:08.287084+0000","last_peered":"2023-10-09T11:36:08.287084+0000","last_clean":"2023-10-09T11:36:08.287084+0000","last_became_active":"2023-10-09T11:36:08.284367+0000","last_became_peered":"2023-10-09T11:36:08.284367+0000","last_unstale":"2023-10-09T11:36:08.287084+0000","last_undegraded":"2023-10-09T11:36:08.287084+0000","last_fullsized":"2023-10-09T11:36:08.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:53.399703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293828+0000","last_change":"2023-10-09T11:36:07.278885+0000","last_active":"2023-10-09T11:36:08.293828+0000","last_peered":"2023-10-09T11:36:08.293828+0000","last_clean":"2023-10-09T11:36:08.293828+0000","last_became_active":"2023-10-09T11:36:07.278567+0000","last_became_peered":"2023-10-09T11:36:07.278567+0000","last_unstale":"2023-10-09T11:36:08.293828+0000","last_undegraded":"2023-10-09T11:36:08.293828+0000","last_fullsized":"2023-10-09T11:36:08.293828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284922+0000","last_change":"2023-10-09T11:36:08.278250+0000","last_active":"2023-10-09T11:36:08.284922+0000","last_peered":"2023-10-09T11:36:08.284922+0000","last_clean":"2023-10-09T11:36:08.284922+0000","last_became_active":"2023-10-09T11:36:08.277933+0000","last_became_peered":"2023-10-09T11:36:08.277933+0000","last_unstale":"2023-10-09T11:36:08.284922+0000","last_undegraded":"2023-10-09T11:36:08.284922+0000","last_fullsized":"2023-10-09T11:36:08.284922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269145+0000","last_change":"2023-10-09T11:36:07.273853+0000","last_active":"2023-10-09T11:36:08.269145+0000","last_peered":"2023-10-09T11:36:08.269145+0000","last_clean":"2023-10-09T11:36:08.269145+0000","last_became_active":"2023-10-09T11:36:07.273562+0000","last_became_peered":"2023-10-09T11:36:07.273562+0000","last_unstale":"2023-10-09T11:36:08.269145+0000","last_undegraded":"2023-10-09T11:36:08.269145+0000","last_fullsized":"2023-10-09T11:36:08.269145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290805+0000","last_change":"2023-10-09T11:36:08.289593+0000","last_active":"2023-10-09T11:36:08.290805+0000","last_peered":"2023-10-09T11:36:08.290805+0000","last_clean":"2023-10-09T11:36:08.290805+0000","last_became_active":"2023-10-09T11:36:08.289323+0000","last_became_peered":"2023-10-09T11:36:08.289323+0000","last_unstale":"2023-10-09T11:36:08.290805+0000","last_undegraded":"2023-10-09T11:36:08.290805+0000","last_fullsized":"2023-10-09T11:36:08.290805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.272883+0000","last_change":"2023-10-09T11:36:07.275895+0000","last_active":"2023-10-09T11:36:08.272883+0000","last_peered":"2023-10-09T11:36:08.272883+0000","last_clean":"2023-10-09T11:36:08.272883+0000","last_became_active":"2023-10-09T11:36:07.275394+0000","last_became_peered":"2023-10-09T11:36:07.275394+0000","last_unstale":"2023-10-09T11:36:08.272883+0000","last_undegraded":"2023-10-09T11:36:08.272883+0000","last_fullsized":"2023-10-09T11:36:08.272883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282593+0000","last_change":"2023-10-09T11:36:08.277172+0000","last_active":"2023-10-09T11:36:08.282593+0000","last_peered":"2023-10-09T11:36:08.282593+0000","last_clean":"2023-10-09T11:36:08.282593+0000","last_became_active":"2023-10-09T11:36:08.276808+0000","last_became_peered":"2023-10-09T11:36:08.276808+0000","last_unstale":"2023-10-09T11:36:08.282593+0000","last_undegraded":"2023-10-09T11:36:08.282593+0000","last_fullsized":"2023-10-09T11:36:08.282593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:13.510818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269401+0000","last_change":"2023-10-09T11:36:07.273764+0000","last_active":"2023-10-09T11:36:08.269401+0000","last_peered":"2023-10-09T11:36:08.269401+0000","last_clean":"2023-10-09T11:36:08.269401+0000","last_became_active":"2023-10-09T11:36:07.273471+0000","last_became_peered":"2023-10-09T11:36:07.273471+0000","last_unstale":"2023-10-09T11:36:08.269401+0000","last_undegraded":"2023-10-09T11:36:08.269401+0000","last_fullsized":"2023-10-09T11:36:08.269401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286251+0000","last_change":"2023-10-09T11:36:08.283848+0000","last_active":"2023-10-09T11:36:08.286251+0000","last_peered":"2023-10-09T11:36:08.286251+0000","last_clean":"2023-10-09T11:36:08.286251+0000","last_became_active":"2023-10-09T11:36:08.283566+0000","last_became_peered":"2023-10-09T11:36:08.283566+0000","last_unstale":"2023-10-09T11:36:08.286251+0000","last_undegraded":"2023-10-09T11:36:08.286251+0000","last_fullsized":"2023-10-09T11:36:08.286251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268004+0000","last_change":"2023-10-09T11:36:07.274431+0000","last_active":"2023-10-09T11:36:08.268004+0000","last_peered":"2023-10-09T11:36:08.268004+0000","last_clean":"2023-10-09T11:36:08.268004+0000","last_became_active":"2023-10-09T11:36:07.274154+0000","last_became_peered":"2023-10-09T11:36:07.274154+0000","last_unstale":"2023-10-09T11:36:08.268004+0000","last_undegraded":"2023-10-09T11:36:08.268004+0000","last_fullsized":"2023-10-09T11:36:08.268004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293193+0000","last_change":"2023-10-09T11:36:08.290591+0000","last_active":"2023-10-09T11:36:08.293193+0000","last_peered":"2023-10-09T11:36:08.293193+0000","last_clean":"2023-10-09T11:36:08.293193+0000","last_became_active":"2023-10-09T11:36:08.290327+0000","last_became_peered":"2023-10-09T11:36:08.290327+0000","last_unstale":"2023-10-09T11:36:08.293193+0000","last_undegraded":"2023-10-09T11:36:08.293193+0000","last_fullsized":"2023-10-09T11:36:08.293193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:28.125121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270730+0000","last_change":"2023-10-09T11:36:07.281909+0000","last_active":"2023-10-09T11:36:08.270730+0000","last_peered":"2023-10-09T11:36:08.270730+0000","last_clean":"2023-10-09T11:36:08.270730+0000","last_became_active":"2023-10-09T11:36:07.281638+0000","last_became_peered":"2023-10-09T11:36:07.281638+0000","last_unstale":"2023-10-09T11:36:08.270730+0000","last_undegraded":"2023-10-09T11:36:08.270730+0000","last_fullsized":"2023-10-09T11:36:08.270730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:13.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288045+0000","last_change":"2023-10-09T11:36:08.282914+0000","last_active":"2023-10-09T11:36:08.288045+0000","last_peered":"2023-10-09T11:36:08.288045+0000","last_clean":"2023-10-09T11:36:08.288045+0000","last_became_active":"2023-10-09T11:36:08.282382+0000","last_became_peered":"2023-10-09T11:36:08.282382+0000","last_unstale":"2023-10-09T11:36:08.288045+0000","last_undegraded":"2023-10-09T11:36:08.288045+0000","last_fullsized":"2023-10-09T11:36:08.288045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269124+0000","last_change":"2023-10-09T11:36:07.284950+0000","last_active":"2023-10-09T11:36:08.269124+0000","last_peered":"2023-10-09T11:36:08.269124+0000","last_clean":"2023-10-09T11:36:08.269124+0000","last_became_active":"2023-10-09T11:36:07.284605+0000","last_became_peered":"2023-10-09T11:36:07.284605+0000","last_unstale":"2023-10-09T11:36:08.269124+0000","last_undegraded":"2023-10-09T11:36:08.269124+0000","last_fullsized":"2023-10-09T11:36:08.269124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:10.864639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289337+0000","last_change":"2023-10-09T11:36:08.286177+0000","last_active":"2023-10-09T11:36:08.289337+0000","last_peered":"2023-10-09T11:36:08.289337+0000","last_clean":"2023-10-09T11:36:08.289337+0000","last_became_active":"2023-10-09T11:36:08.285873+0000","last_became_peered":"2023-10-09T11:36:08.285873+0000","last_unstale":"2023-10-09T11:36:08.289337+0000","last_undegraded":"2023-10-09T11:36:08.289337+0000","last_fullsized":"2023-10-09T11:36:08.289337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268607+0000","last_change":"2023-10-09T11:36:07.278836+0000","last_active":"2023-10-09T11:36:08.268607+0000","last_peered":"2023-10-09T11:36:08.268607+0000","last_clean":"2023-10-09T11:36:08.268607+0000","last_became_active":"2023-10-09T11:36:07.278541+0000","last_became_peered":"2023-10-09T11:36:07.278541+0000","last_unstale":"2023-10-09T11:36:08.268607+0000","last_undegraded":"2023-10-09T11:36:08.268607+0000","last_fullsized":"2023-10-09T11:36:08.268607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271243+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:08.271243+0000","last_peered":"2023-10-09T11:36:08.271243+0000","last_clean":"2023-10-09T11:36:08.271243+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:08.271243+0000","last_undegraded":"2023-10-09T11:36:08.271243+0000","last_fullsized":"2023-10-09T11:36:08.271243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":727711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.626}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.745}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":721333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":137323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":132523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.624},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60499999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.378},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.45800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:16.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.074+0000 7fd6fb7bc700 1 Processor -- start 2023-10-09T11:36:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.075+0000 7fd6fb7bc700 1 -- start start 2023-10-09T11:36:17.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.075+0000 7fd6fb7bc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6f40af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.075+0000 7fd6fb7bc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40ce9d0 con 0x7fd6f4159c80 2023-10-09T11:36:17.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.075+0000 7fd6fb7bc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40afc30 con 0x7fd6f40af790 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.075+0000 7fd6fb7bc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40aff10 con 0x7fd6f41598b0 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f8d57700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6f4159c80 0x7fd6f40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50374/0 (socket says 172.21.15.26:50374) 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f8d57700 1 -- 172.21.15.26:0/2563040232 learned_addr learned my addr 172.21.15.26:0/2563040232 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208836851 0 0) 0x7fd6f40ce9d0 con 0x7fd6f4159c80 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6f40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6dc003570 con 0x7fd6f4159c80 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106525742 0 0) 0x7fd6dc003570 con 0x7fd6f4159c80 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 msgr2=0x7fd6f40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6f40af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 >> v1:172.21.15.67:6789/0 conn(0x7fd6f40af790 legacy=0x7fd6f4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40ce380 con 0x7fd6f4159c80 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd6e8001470 con 0x7fd6f4159c80 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 >> v1:172.21.15.26:6789/0 conn(0x7fd6f4159c80 legacy=0x7fd6f40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6dc004d50 0x7fd6dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40aff10 con 0x7fd6dc003a90 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc00bb70 con 0x7fd6dc004d50 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc00bd30 con 0x7fd6f41598b0 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.076+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f8d57700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9d59700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6dc004d50 0x7fd6dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 -- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 msgr2=0x7fd6dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f41598b0 0x7fd6dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 -- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6dc004d50 msgr2=0x7fd6dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6dc004d50 0x7fd6dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 -- 172.21.15.26:0/2563040232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc003570 con 0x7fd6dc003a90 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9d59700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6dc004d50 0x7fd6dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6dc003ea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009c00 tx=0x7fd6ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e66324b5548f639 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e710 con 0x7fd6dc003a90 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00e870 con 0x7fd6dc003a90 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.077+0000 7fd6f3fff700 1 -- 172.21.15.26:0/2563040232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00ec30 con 0x7fd6dc003a90 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2563040232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 msgr2=0x7fd6dc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2563040232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6dc003ea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009c00 tx=0x7fd6ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6f9d59700 1 -- 172.21.15.26:0/2563040232 reap_dead start 2023-10-09T11:36:17.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2563040232 shutdown_connections 2023-10-09T11:36:17.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2563040232 >> 172.21.15.26:0/2563040232 conn(0x7fd6f4070e30 msgr2=0x7fd6f40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:17.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2563040232 shutdown_connections 2023-10-09T11:36:17.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.078+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2563040232 wait complete. 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.079+0000 7fd6fb7bc700 1 Processor -- start 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.079+0000 7fd6fb7bc700 1 -- start start 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f40c7d00 0x7fd6f40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 0x7fd6f40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40ca2f0 con 0x7fd6dc003a90 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40b5250 con 0x7fd6f40c7d00 2023-10-09T11:36:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6fb7bc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40b5530 con 0x7fd6f40c9930 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50666/0 (socket says 172.21.15.26:50666) 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 -- 172.21.15.26:0/2645547056 learned_addr learned my addr 172.21.15.26:0/2645547056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f8d57700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f40c7d00 0x7fd6f40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9d59700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 0x7fd6f40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 -- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 msgr2=0x7fd6f40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 0x7fd6f40c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 -- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f40c7d00 msgr2=0x7fd6f40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f40c7d00 0x7fd6f40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 -- 172.21.15.26:0/2645547056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40b5810 con 0x7fd6dc003a90 2023-10-09T11:36:17.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9d59700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 0x7fd6f40c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f9558700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00bb40 tx=0x7fd6ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.080+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec022070 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.081+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00e9e0 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.081+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec01c450 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.081+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f40ca2f0 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.081+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f414b3f0 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.081+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f404c3c0 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.082+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6ec01c8a0 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.082+0000 7fd6f17fa700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.082+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6ec085b90 con 0x7fd6dc003a90 2023-10-09T11:36:17.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.082+0000 7fd6f8d57700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.083+0000 7fd6f8d57700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 0x7fd6e00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8001120 tx=0x7fd6e8001e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.087+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6ec052e80 con 0x7fd6dc003a90 2023-10-09T11:36:17.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.276+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6f40ce660 con 0x7fd6e0066f30 2023-10-09T11:36:17.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.285+0000 7fd6f17fa700 1 -- 172.21.15.26:0/2645547056 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288785 (secure 0 0 0) 0x7fd6f40ce660 con 0x7fd6e0066f30 2023-10-09T11:36:17.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:17.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 msgr2=0x7fd6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 0x7fd6e00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8001120 tx=0x7fd6e8001e50 comp rx=0 tx=0).stop 2023-10-09T11:36:17.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 msgr2=0x7fd6f40c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00bb40 tx=0x7fd6ec01a000 comp rx=0 tx=0).stop 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 shutdown_connections 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f40c9930 0x7fd6f40c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc003a90 0x7fd6f40c77c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 --2- 172.21.15.26:0/2645547056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f40c7d00 0x7fd6f40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 >> 172.21.15.26:0/2645547056 conn(0x7fd6f4070e30 msgr2=0x7fd6f40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 shutdown_connections 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.288+0000 7fd6fb7bc700 1 -- 172.21.15.26:0/2645547056 wait complete. 2023-10-09T11:36:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:17.301 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-09T11:36:17.116647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386408,"kb_used_data":4008,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588312,"statfs":{"total":773094113280,"available":770650431488,"internally_reserved":0,"allocated":4104192,"data_stored":2283372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.853640"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.279758+0000","last_change":"2023-10-09T11:36:08.273677+0000","last_active":"2023-10-09T11:36:08.279758+0000","last_peered":"2023-10-09T11:36:08.279758+0000","last_clean":"2023-10-09T11:36:08.279758+0000","last_became_active":"2023-10-09T11:36:08.273392+0000","last_became_peered":"2023-10-09T11:36:08.273392+0000","last_unstale":"2023-10-09T11:36:08.279758+0000","last_undegraded":"2023-10-09T11:36:08.279758+0000","last_fullsized":"2023-10-09T11:36:08.279758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284791+0000","last_change":"2023-10-09T11:36:08.278687+0000","last_active":"2023-10-09T11:36:08.284791+0000","last_peered":"2023-10-09T11:36:08.284791+0000","last_clean":"2023-10-09T11:36:08.284791+0000","last_became_active":"2023-10-09T11:36:08.278178+0000","last_became_peered":"2023-10-09T11:36:08.278178+0000","last_unstale":"2023-10-09T11:36:08.284791+0000","last_undegraded":"2023-10-09T11:36:08.284791+0000","last_fullsized":"2023-10-09T11:36:08.284791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:20.367711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292372+0000","last_change":"2023-10-09T11:36:08.290862+0000","last_active":"2023-10-09T11:36:08.292372+0000","last_peered":"2023-10-09T11:36:08.292372+0000","last_clean":"2023-10-09T11:36:08.292372+0000","last_became_active":"2023-10-09T11:36:08.290568+0000","last_became_peered":"2023-10-09T11:36:08.290568+0000","last_unstale":"2023-10-09T11:36:08.292372+0000","last_undegraded":"2023-10-09T11:36:08.292372+0000","last_fullsized":"2023-10-09T11:36:08.292372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293502+0000","last_change":"2023-10-09T11:36:08.287587+0000","last_active":"2023-10-09T11:36:08.293502+0000","last_peered":"2023-10-09T11:36:08.293502+0000","last_clean":"2023-10-09T11:36:08.293502+0000","last_became_active":"2023-10-09T11:36:08.287318+0000","last_became_peered":"2023-10-09T11:36:08.287318+0000","last_unstale":"2023-10-09T11:36:08.293502+0000","last_undegraded":"2023-10-09T11:36:08.293502+0000","last_fullsized":"2023-10-09T11:36:08.293502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285522+0000","last_change":"2023-10-09T11:36:08.281401+0000","last_active":"2023-10-09T11:36:08.285522+0000","last_peered":"2023-10-09T11:36:08.285522+0000","last_clean":"2023-10-09T11:36:08.285522+0000","last_became_active":"2023-10-09T11:36:08.281182+0000","last_became_peered":"2023-10-09T11:36:08.281182+0000","last_unstale":"2023-10-09T11:36:08.285522+0000","last_undegraded":"2023-10-09T11:36:08.285522+0000","last_fullsized":"2023-10-09T11:36:08.285522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.995381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281091+0000","last_change":"2023-10-09T11:36:08.276410+0000","last_active":"2023-10-09T11:36:08.281091+0000","last_peered":"2023-10-09T11:36:08.281091+0000","last_clean":"2023-10-09T11:36:08.281091+0000","last_became_active":"2023-10-09T11:36:08.276128+0000","last_became_peered":"2023-10-09T11:36:08.276128+0000","last_unstale":"2023-10-09T11:36:08.281091+0000","last_undegraded":"2023-10-09T11:36:08.281091+0000","last_fullsized":"2023-10-09T11:36:08.281091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290594+0000","last_change":"2023-10-09T11:36:08.287500+0000","last_active":"2023-10-09T11:36:08.290594+0000","last_peered":"2023-10-09T11:36:08.290594+0000","last_clean":"2023-10-09T11:36:08.290594+0000","last_became_active":"2023-10-09T11:36:08.287094+0000","last_became_peered":"2023-10-09T11:36:08.287094+0000","last_unstale":"2023-10-09T11:36:08.290594+0000","last_undegraded":"2023-10-09T11:36:08.290594+0000","last_fullsized":"2023-10-09T11:36:08.290594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290545+0000","last_change":"2023-10-09T11:36:08.287006+0000","last_active":"2023-10-09T11:36:08.290545+0000","last_peered":"2023-10-09T11:36:08.290545+0000","last_clean":"2023-10-09T11:36:08.290545+0000","last_became_active":"2023-10-09T11:36:08.286723+0000","last_became_peered":"2023-10-09T11:36:08.286723+0000","last_unstale":"2023-10-09T11:36:08.290545+0000","last_undegraded":"2023-10-09T11:36:08.290545+0000","last_fullsized":"2023-10-09T11:36:08.290545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294957+0000","last_change":"2023-10-09T11:36:08.291813+0000","last_active":"2023-10-09T11:36:08.294957+0000","last_peered":"2023-10-09T11:36:08.294957+0000","last_clean":"2023-10-09T11:36:08.294957+0000","last_became_active":"2023-10-09T11:36:08.291537+0000","last_became_peered":"2023-10-09T11:36:08.291537+0000","last_unstale":"2023-10-09T11:36:08.294957+0000","last_undegraded":"2023-10-09T11:36:08.294957+0000","last_fullsized":"2023-10-09T11:36:08.294957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292827+0000","last_change":"2023-10-09T11:36:08.281785+0000","last_active":"2023-10-09T11:36:08.292827+0000","last_peered":"2023-10-09T11:36:08.292827+0000","last_clean":"2023-10-09T11:36:08.292827+0000","last_became_active":"2023-10-09T11:36:08.281520+0000","last_became_peered":"2023-10-09T11:36:08.281520+0000","last_unstale":"2023-10-09T11:36:08.292827+0000","last_undegraded":"2023-10-09T11:36:08.292827+0000","last_fullsized":"2023-10-09T11:36:08.292827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291939+0000","last_change":"2023-10-09T11:36:08.290214+0000","last_active":"2023-10-09T11:36:08.291939+0000","last_peered":"2023-10-09T11:36:08.291939+0000","last_clean":"2023-10-09T11:36:08.291939+0000","last_became_active":"2023-10-09T11:36:08.289825+0000","last_became_peered":"2023-10-09T11:36:08.289825+0000","last_unstale":"2023-10-09T11:36:08.291939+0000","last_undegraded":"2023-10-09T11:36:08.291939+0000","last_fullsized":"2023-10-09T11:36:08.291939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291512+0000","last_change":"2023-10-09T11:36:08.284600+0000","last_active":"2023-10-09T11:36:08.291512+0000","last_peered":"2023-10-09T11:36:08.291512+0000","last_clean":"2023-10-09T11:36:08.291512+0000","last_became_active":"2023-10-09T11:36:08.278637+0000","last_became_peered":"2023-10-09T11:36:08.278637+0000","last_unstale":"2023-10-09T11:36:08.291512+0000","last_undegraded":"2023-10-09T11:36:08.291512+0000","last_fullsized":"2023-10-09T11:36:08.291512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293117+0000","last_change":"2023-10-09T11:36:08.288046+0000","last_active":"2023-10-09T11:36:08.293117+0000","last_peered":"2023-10-09T11:36:08.293117+0000","last_clean":"2023-10-09T11:36:08.293117+0000","last_became_active":"2023-10-09T11:36:08.287767+0000","last_became_peered":"2023-10-09T11:36:08.287767+0000","last_unstale":"2023-10-09T11:36:08.293117+0000","last_undegraded":"2023-10-09T11:36:08.293117+0000","last_fullsized":"2023-10-09T11:36:08.293117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:19.830919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285647+0000","last_change":"2023-10-09T11:36:08.280935+0000","last_active":"2023-10-09T11:36:08.285647+0000","last_peered":"2023-10-09T11:36:08.285647+0000","last_clean":"2023-10-09T11:36:08.285647+0000","last_became_active":"2023-10-09T11:36:08.280551+0000","last_became_peered":"2023-10-09T11:36:08.280551+0000","last_unstale":"2023-10-09T11:36:08.285647+0000","last_undegraded":"2023-10-09T11:36:08.285647+0000","last_fullsized":"2023-10-09T11:36:08.285647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:57.508567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283730+0000","last_change":"2023-10-09T11:36:08.277342+0000","last_active":"2023-10-09T11:36:08.283730+0000","last_peered":"2023-10-09T11:36:08.283730+0000","last_clean":"2023-10-09T11:36:08.283730+0000","last_became_active":"2023-10-09T11:36:08.277060+0000","last_became_peered":"2023-10-09T11:36:08.277060+0000","last_unstale":"2023-10-09T11:36:08.283730+0000","last_undegraded":"2023-10-09T11:36:08.283730+0000","last_fullsized":"2023-10-09T11:36:08.283730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291618+0000","last_change":"2023-10-09T11:36:08.288090+0000","last_active":"2023-10-09T11:36:08.291618+0000","last_peered":"2023-10-09T11:36:08.291618+0000","last_clean":"2023-10-09T11:36:08.291618+0000","last_became_active":"2023-10-09T11:36:08.287801+0000","last_became_peered":"2023-10-09T11:36:08.287801+0000","last_unstale":"2023-10-09T11:36:08.291618+0000","last_undegraded":"2023-10-09T11:36:08.291618+0000","last_fullsized":"2023-10-09T11:36:08.291618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290555+0000","last_change":"2023-10-09T11:36:08.286992+0000","last_active":"2023-10-09T11:36:08.290555+0000","last_peered":"2023-10-09T11:36:08.290555+0000","last_clean":"2023-10-09T11:36:08.290555+0000","last_became_active":"2023-10-09T11:36:08.286412+0000","last_became_peered":"2023-10-09T11:36:08.286412+0000","last_unstale":"2023-10-09T11:36:08.290555+0000","last_undegraded":"2023-10-09T11:36:08.290555+0000","last_fullsized":"2023-10-09T11:36:08.290555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293161+0000","last_change":"2023-10-09T11:36:08.290167+0000","last_active":"2023-10-09T11:36:08.293161+0000","last_peered":"2023-10-09T11:36:08.293161+0000","last_clean":"2023-10-09T11:36:08.293161+0000","last_became_active":"2023-10-09T11:36:08.289904+0000","last_became_peered":"2023-10-09T11:36:08.289904+0000","last_unstale":"2023-10-09T11:36:08.293161+0000","last_undegraded":"2023-10-09T11:36:08.293161+0000","last_fullsized":"2023-10-09T11:36:08.293161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293115+0000","last_change":"2023-10-09T11:36:08.290062+0000","last_active":"2023-10-09T11:36:08.293115+0000","last_peered":"2023-10-09T11:36:08.293115+0000","last_clean":"2023-10-09T11:36:08.293115+0000","last_became_active":"2023-10-09T11:36:08.289712+0000","last_became_peered":"2023-10-09T11:36:08.289712+0000","last_unstale":"2023-10-09T11:36:08.293115+0000","last_undegraded":"2023-10-09T11:36:08.293115+0000","last_fullsized":"2023-10-09T11:36:08.293115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:29.618537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290792+0000","last_change":"2023-10-09T11:36:08.286490+0000","last_active":"2023-10-09T11:36:08.290792+0000","last_peered":"2023-10-09T11:36:08.290792+0000","last_clean":"2023-10-09T11:36:08.290792+0000","last_became_active":"2023-10-09T11:36:08.286235+0000","last_became_peered":"2023-10-09T11:36:08.286235+0000","last_unstale":"2023-10-09T11:36:08.290792+0000","last_undegraded":"2023-10-09T11:36:08.290792+0000","last_fullsized":"2023-10-09T11:36:08.290792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:54.131479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285298+0000","last_change":"2023-10-09T11:36:08.279912+0000","last_active":"2023-10-09T11:36:08.285298+0000","last_peered":"2023-10-09T11:36:08.285298+0000","last_clean":"2023-10-09T11:36:08.285298+0000","last_became_active":"2023-10-09T11:36:08.279612+0000","last_became_peered":"2023-10-09T11:36:08.279612+0000","last_unstale":"2023-10-09T11:36:08.285298+0000","last_undegraded":"2023-10-09T11:36:08.285298+0000","last_fullsized":"2023-10-09T11:36:08.285298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290153+0000","last_change":"2023-10-09T11:36:08.284955+0000","last_active":"2023-10-09T11:36:08.290153+0000","last_peered":"2023-10-09T11:36:08.290153+0000","last_clean":"2023-10-09T11:36:08.290153+0000","last_became_active":"2023-10-09T11:36:08.284035+0000","last_became_peered":"2023-10-09T11:36:08.284035+0000","last_unstale":"2023-10-09T11:36:08.290153+0000","last_undegraded":"2023-10-09T11:36:08.290153+0000","last_fullsized":"2023-10-09T11:36:08.290153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.280028+0000","last_change":"2023-10-09T11:36:08.275290+0000","last_active":"2023-10-09T11:36:08.280028+0000","last_peered":"2023-10-09T11:36:08.280028+0000","last_clean":"2023-10-09T11:36:08.280028+0000","last_became_active":"2023-10-09T11:36:08.275001+0000","last_became_peered":"2023-10-09T11:36:08.275001+0000","last_unstale":"2023-10-09T11:36:08.280028+0000","last_undegraded":"2023-10-09T11:36:08.280028+0000","last_fullsized":"2023-10-09T11:36:08.280028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.281852+0000","last_change":"2023-10-09T11:36:08.273715+0000","last_active":"2023-10-09T11:36:08.281852+0000","last_peered":"2023-10-09T11:36:08.281852+0000","last_clean":"2023-10-09T11:36:08.281852+0000","last_became_active":"2023-10-09T11:36:08.273287+0000","last_became_peered":"2023-10-09T11:36:08.273287+0000","last_unstale":"2023-10-09T11:36:08.281852+0000","last_undegraded":"2023-10-09T11:36:08.281852+0000","last_fullsized":"2023-10-09T11:36:08.281852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292622+0000","last_change":"2023-10-09T11:36:08.279702+0000","last_active":"2023-10-09T11:36:08.292622+0000","last_peered":"2023-10-09T11:36:08.292622+0000","last_clean":"2023-10-09T11:36:08.292622+0000","last_became_active":"2023-10-09T11:36:08.279443+0000","last_became_peered":"2023-10-09T11:36:08.279443+0000","last_unstale":"2023-10-09T11:36:08.292622+0000","last_undegraded":"2023-10-09T11:36:08.292622+0000","last_fullsized":"2023-10-09T11:36:08.292622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:18.196056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284772+0000","last_change":"2023-10-09T11:36:08.278434+0000","last_active":"2023-10-09T11:36:08.284772+0000","last_peered":"2023-10-09T11:36:08.284772+0000","last_clean":"2023-10-09T11:36:08.284772+0000","last_became_active":"2023-10-09T11:36:08.277846+0000","last_became_peered":"2023-10-09T11:36:08.277846+0000","last_unstale":"2023-10-09T11:36:08.284772+0000","last_undegraded":"2023-10-09T11:36:08.284772+0000","last_fullsized":"2023-10-09T11:36:08.284772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:59.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293733+0000","last_change":"2023-10-09T11:36:08.288625+0000","last_active":"2023-10-09T11:36:08.293733+0000","last_peered":"2023-10-09T11:36:08.293733+0000","last_clean":"2023-10-09T11:36:08.293733+0000","last_became_active":"2023-10-09T11:36:08.287902+0000","last_became_peered":"2023-10-09T11:36:08.287902+0000","last_unstale":"2023-10-09T11:36:08.293733+0000","last_undegraded":"2023-10-09T11:36:08.293733+0000","last_fullsized":"2023-10-09T11:36:08.293733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284821+0000","last_change":"2023-10-09T11:36:08.276526+0000","last_active":"2023-10-09T11:36:08.284821+0000","last_peered":"2023-10-09T11:36:08.284821+0000","last_clean":"2023-10-09T11:36:08.284821+0000","last_became_active":"2023-10-09T11:36:08.276261+0000","last_became_peered":"2023-10-09T11:36:08.276261+0000","last_unstale":"2023-10-09T11:36:08.284821+0000","last_undegraded":"2023-10-09T11:36:08.284821+0000","last_fullsized":"2023-10-09T11:36:08.284821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288093+0000","last_change":"2023-10-09T11:36:08.283000+0000","last_active":"2023-10-09T11:36:08.288093+0000","last_peered":"2023-10-09T11:36:08.288093+0000","last_clean":"2023-10-09T11:36:08.288093+0000","last_became_active":"2023-10-09T11:36:08.282712+0000","last_became_peered":"2023-10-09T11:36:08.282712+0000","last_unstale":"2023-10-09T11:36:08.288093+0000","last_undegraded":"2023-10-09T11:36:08.288093+0000","last_fullsized":"2023-10-09T11:36:08.288093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290609+0000","last_change":"2023-10-09T11:36:08.287215+0000","last_active":"2023-10-09T11:36:08.290609+0000","last_peered":"2023-10-09T11:36:08.290609+0000","last_clean":"2023-10-09T11:36:08.290609+0000","last_became_active":"2023-10-09T11:36:08.286880+0000","last_became_peered":"2023-10-09T11:36:08.286880+0000","last_unstale":"2023-10-09T11:36:08.290609+0000","last_undegraded":"2023-10-09T11:36:08.290609+0000","last_fullsized":"2023-10-09T11:36:08.290609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288539+0000","last_change":"2023-10-09T11:36:08.285992+0000","last_active":"2023-10-09T11:36:08.288539+0000","last_peered":"2023-10-09T11:36:08.288539+0000","last_clean":"2023-10-09T11:36:08.288539+0000","last_became_active":"2023-10-09T11:36:08.285693+0000","last_became_peered":"2023-10-09T11:36:08.285693+0000","last_unstale":"2023-10-09T11:36:08.288539+0000","last_undegraded":"2023-10-09T11:36:08.288539+0000","last_fullsized":"2023-10-09T11:36:08.288539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:18.436232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288904+0000","last_change":"2023-10-09T11:36:08.286011+0000","last_active":"2023-10-09T11:36:08.288904+0000","last_peered":"2023-10-09T11:36:08.288904+0000","last_clean":"2023-10-09T11:36:08.288904+0000","last_became_active":"2023-10-09T11:36:08.285540+0000","last_became_peered":"2023-10-09T11:36:08.285540+0000","last_unstale":"2023-10-09T11:36:08.288904+0000","last_undegraded":"2023-10-09T11:36:08.288904+0000","last_fullsized":"2023-10-09T11:36:08.288904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284934+0000","last_change":"2023-10-09T11:36:08.280784+0000","last_active":"2023-10-09T11:36:08.284934+0000","last_peered":"2023-10-09T11:36:08.284934+0000","last_clean":"2023-10-09T11:36:08.284934+0000","last_became_active":"2023-10-09T11:36:08.280527+0000","last_became_peered":"2023-10-09T11:36:08.280527+0000","last_unstale":"2023-10-09T11:36:08.284934+0000","last_undegraded":"2023-10-09T11:36:08.284934+0000","last_fullsized":"2023-10-09T11:36:08.284934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:28.806865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292413+0000","last_change":"2023-10-09T11:36:07.282121+0000","last_active":"2023-10-09T11:36:08.292413+0000","last_peered":"2023-10-09T11:36:08.292413+0000","last_clean":"2023-10-09T11:36:08.292413+0000","last_became_active":"2023-10-09T11:36:07.281861+0000","last_became_peered":"2023-10-09T11:36:07.281861+0000","last_unstale":"2023-10-09T11:36:08.292413+0000","last_undegraded":"2023-10-09T11:36:08.292413+0000","last_fullsized":"2023-10-09T11:36:08.292413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285116+0000","last_change":"2023-10-09T11:36:08.280847+0000","last_active":"2023-10-09T11:36:08.285116+0000","last_peered":"2023-10-09T11:36:08.285116+0000","last_clean":"2023-10-09T11:36:08.285116+0000","last_became_active":"2023-10-09T11:36:08.280341+0000","last_became_peered":"2023-10-09T11:36:08.280341+0000","last_unstale":"2023-10-09T11:36:08.285116+0000","last_undegraded":"2023-10-09T11:36:08.285116+0000","last_fullsized":"2023-10-09T11:36:08.285116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284941+0000","last_change":"2023-10-09T11:36:07.282358+0000","last_active":"2023-10-09T11:36:08.284941+0000","last_peered":"2023-10-09T11:36:08.284941+0000","last_clean":"2023-10-09T11:36:08.284941+0000","last_became_active":"2023-10-09T11:36:07.282052+0000","last_became_peered":"2023-10-09T11:36:07.282052+0000","last_unstale":"2023-10-09T11:36:08.284941+0000","last_undegraded":"2023-10-09T11:36:08.284941+0000","last_fullsized":"2023-10-09T11:36:08.284941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287844+0000","last_change":"2023-10-09T11:36:08.282472+0000","last_active":"2023-10-09T11:36:08.287844+0000","last_peered":"2023-10-09T11:36:08.287844+0000","last_clean":"2023-10-09T11:36:08.287844+0000","last_became_active":"2023-10-09T11:36:08.282176+0000","last_became_peered":"2023-10-09T11:36:08.282176+0000","last_unstale":"2023-10-09T11:36:08.287844+0000","last_undegraded":"2023-10-09T11:36:08.287844+0000","last_fullsized":"2023-10-09T11:36:08.287844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:55.771141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294196+0000","last_change":"2023-10-09T11:36:07.277817+0000","last_active":"2023-10-09T11:36:08.294196+0000","last_peered":"2023-10-09T11:36:08.294196+0000","last_clean":"2023-10-09T11:36:08.294196+0000","last_became_active":"2023-10-09T11:36:07.277546+0000","last_became_peered":"2023-10-09T11:36:07.277546+0000","last_unstale":"2023-10-09T11:36:08.294196+0000","last_undegraded":"2023-10-09T11:36:08.294196+0000","last_fullsized":"2023-10-09T11:36:08.294196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293757+0000","last_change":"2023-10-09T11:36:08.288692+0000","last_active":"2023-10-09T11:36:08.293757+0000","last_peered":"2023-10-09T11:36:08.293757+0000","last_clean":"2023-10-09T11:36:08.293757+0000","last_became_active":"2023-10-09T11:36:08.288192+0000","last_became_peered":"2023-10-09T11:36:08.288192+0000","last_unstale":"2023-10-09T11:36:08.293757+0000","last_undegraded":"2023-10-09T11:36:08.293757+0000","last_fullsized":"2023-10-09T11:36:08.293757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:11.663042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293387+0000","last_change":"2023-10-09T11:36:07.274424+0000","last_active":"2023-10-09T11:36:08.293387+0000","last_peered":"2023-10-09T11:36:08.293387+0000","last_clean":"2023-10-09T11:36:08.293387+0000","last_became_active":"2023-10-09T11:36:07.274134+0000","last_became_peered":"2023-10-09T11:36:07.274134+0000","last_unstale":"2023-10-09T11:36:08.293387+0000","last_undegraded":"2023-10-09T11:36:08.293387+0000","last_fullsized":"2023-10-09T11:36:08.293387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:01.291196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286073+0000","last_change":"2023-10-09T11:36:08.285240+0000","last_active":"2023-10-09T11:36:08.286073+0000","last_peered":"2023-10-09T11:36:08.286073+0000","last_clean":"2023-10-09T11:36:08.286073+0000","last_became_active":"2023-10-09T11:36:08.284949+0000","last_became_peered":"2023-10-09T11:36:08.284949+0000","last_unstale":"2023-10-09T11:36:08.286073+0000","last_undegraded":"2023-10-09T11:36:08.286073+0000","last_fullsized":"2023-10-09T11:36:08.286073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293182+0000","last_change":"2023-10-09T11:36:07.279426+0000","last_active":"2023-10-09T11:36:08.293182+0000","last_peered":"2023-10-09T11:36:08.293182+0000","last_clean":"2023-10-09T11:36:08.293182+0000","last_became_active":"2023-10-09T11:36:07.279113+0000","last_became_peered":"2023-10-09T11:36:07.279113+0000","last_unstale":"2023-10-09T11:36:08.293182+0000","last_undegraded":"2023-10-09T11:36:08.293182+0000","last_fullsized":"2023-10-09T11:36:08.293182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284709+0000","last_change":"2023-10-09T11:36:08.282166+0000","last_active":"2023-10-09T11:36:08.284709+0000","last_peered":"2023-10-09T11:36:08.284709+0000","last_clean":"2023-10-09T11:36:08.284709+0000","last_became_active":"2023-10-09T11:36:08.281862+0000","last_became_peered":"2023-10-09T11:36:08.281862+0000","last_unstale":"2023-10-09T11:36:08.284709+0000","last_undegraded":"2023-10-09T11:36:08.284709+0000","last_fullsized":"2023-10-09T11:36:08.284709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:03.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287053+0000","last_change":"2023-10-09T11:36:07.278415+0000","last_active":"2023-10-09T11:36:08.287053+0000","last_peered":"2023-10-09T11:36:08.287053+0000","last_clean":"2023-10-09T11:36:08.287053+0000","last_became_active":"2023-10-09T11:36:07.278088+0000","last_became_peered":"2023-10-09T11:36:07.278088+0000","last_unstale":"2023-10-09T11:36:08.287053+0000","last_undegraded":"2023-10-09T11:36:08.287053+0000","last_fullsized":"2023-10-09T11:36:08.287053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:03.205996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.283150+0000","last_change":"2023-10-09T11:36:08.277760+0000","last_active":"2023-10-09T11:36:08.283150+0000","last_peered":"2023-10-09T11:36:08.283150+0000","last_clean":"2023-10-09T11:36:08.283150+0000","last_became_active":"2023-10-09T11:36:08.277480+0000","last_became_peered":"2023-10-09T11:36:08.277480+0000","last_unstale":"2023-10-09T11:36:08.283150+0000","last_undegraded":"2023-10-09T11:36:08.283150+0000","last_fullsized":"2023-10-09T11:36:08.283150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.278182+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277722+0000","last_became_peered":"2023-10-09T11:36:07.277722+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:49.147228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292591+0000","last_change":"2023-10-09T11:36:08.279232+0000","last_active":"2023-10-09T11:36:08.292591+0000","last_peered":"2023-10-09T11:36:08.292591+0000","last_clean":"2023-10-09T11:36:08.292591+0000","last_became_active":"2023-10-09T11:36:08.278961+0000","last_became_peered":"2023-10-09T11:36:08.278961+0000","last_unstale":"2023-10-09T11:36:08.292591+0000","last_undegraded":"2023-10-09T11:36:08.292591+0000","last_fullsized":"2023-10-09T11:36:08.292591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269983+0000","last_change":"2023-10-09T11:36:07.277553+0000","last_active":"2023-10-09T11:36:08.269983+0000","last_peered":"2023-10-09T11:36:08.269983+0000","last_clean":"2023-10-09T11:36:08.269983+0000","last_became_active":"2023-10-09T11:36:07.277237+0000","last_became_peered":"2023-10-09T11:36:07.277237+0000","last_unstale":"2023-10-09T11:36:08.269983+0000","last_undegraded":"2023-10-09T11:36:08.269983+0000","last_fullsized":"2023-10-09T11:36:08.269983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:18.826059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284628+0000","last_change":"2023-10-09T11:36:08.280688+0000","last_active":"2023-10-09T11:36:08.284628+0000","last_peered":"2023-10-09T11:36:08.284628+0000","last_clean":"2023-10-09T11:36:08.284628+0000","last_became_active":"2023-10-09T11:36:08.280292+0000","last_became_peered":"2023-10-09T11:36:08.280292+0000","last_unstale":"2023-10-09T11:36:08.284628+0000","last_undegraded":"2023-10-09T11:36:08.284628+0000","last_fullsized":"2023-10-09T11:36:08.284628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270323+0000","last_change":"2023-10-09T11:36:07.284759+0000","last_active":"2023-10-09T11:36:08.270323+0000","last_peered":"2023-10-09T11:36:08.270323+0000","last_clean":"2023-10-09T11:36:08.270323+0000","last_became_active":"2023-10-09T11:36:07.284467+0000","last_became_peered":"2023-10-09T11:36:07.284467+0000","last_unstale":"2023-10-09T11:36:08.270323+0000","last_undegraded":"2023-10-09T11:36:08.270323+0000","last_fullsized":"2023-10-09T11:36:08.270323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:17.431372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293199+0000","last_change":"2023-10-09T11:36:08.290418+0000","last_active":"2023-10-09T11:36:08.293199+0000","last_peered":"2023-10-09T11:36:08.293199+0000","last_clean":"2023-10-09T11:36:08.293199+0000","last_became_active":"2023-10-09T11:36:08.289613+0000","last_became_peered":"2023-10-09T11:36:08.289613+0000","last_unstale":"2023-10-09T11:36:08.293199+0000","last_undegraded":"2023-10-09T11:36:08.293199+0000","last_fullsized":"2023-10-09T11:36:08.293199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.792848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269028+0000","last_change":"2023-10-09T11:36:07.274812+0000","last_active":"2023-10-09T11:36:08.269028+0000","last_peered":"2023-10-09T11:36:08.269028+0000","last_clean":"2023-10-09T11:36:08.269028+0000","last_became_active":"2023-10-09T11:36:07.274502+0000","last_became_peered":"2023-10-09T11:36:07.274502+0000","last_unstale":"2023-10-09T11:36:08.269028+0000","last_undegraded":"2023-10-09T11:36:08.269028+0000","last_fullsized":"2023-10-09T11:36:08.269028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291889+0000","last_change":"2023-10-09T11:36:08.277583+0000","last_active":"2023-10-09T11:36:08.291889+0000","last_peered":"2023-10-09T11:36:08.291889+0000","last_clean":"2023-10-09T11:36:08.291889+0000","last_became_active":"2023-10-09T11:36:08.277284+0000","last_became_peered":"2023-10-09T11:36:08.277284+0000","last_unstale":"2023-10-09T11:36:08.291889+0000","last_undegraded":"2023-10-09T11:36:08.291889+0000","last_fullsized":"2023-10-09T11:36:08.291889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:06.511358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292516+0000","last_change":"2023-10-09T11:36:07.283964+0000","last_active":"2023-10-09T11:36:08.292516+0000","last_peered":"2023-10-09T11:36:08.292516+0000","last_clean":"2023-10-09T11:36:08.292516+0000","last_became_active":"2023-10-09T11:36:07.283626+0000","last_became_peered":"2023-10-09T11:36:07.283626+0000","last_unstale":"2023-10-09T11:36:08.292516+0000","last_undegraded":"2023-10-09T11:36:08.292516+0000","last_fullsized":"2023-10-09T11:36:08.292516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:03.385790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284674+0000","last_change":"2023-10-09T11:36:08.281129+0000","last_active":"2023-10-09T11:36:08.284674+0000","last_peered":"2023-10-09T11:36:08.284674+0000","last_clean":"2023-10-09T11:36:08.284674+0000","last_became_active":"2023-10-09T11:36:08.280848+0000","last_became_peered":"2023-10-09T11:36:08.280848+0000","last_unstale":"2023-10-09T11:36:08.284674+0000","last_undegraded":"2023-10-09T11:36:08.284674+0000","last_fullsized":"2023-10-09T11:36:08.284674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:50.949232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.296058+0000","last_change":"2023-10-09T11:36:07.278932+0000","last_active":"2023-10-09T11:36:08.296058+0000","last_peered":"2023-10-09T11:36:08.296058+0000","last_clean":"2023-10-09T11:36:08.296058+0000","last_became_active":"2023-10-09T11:36:07.278663+0000","last_became_peered":"2023-10-09T11:36:07.278663+0000","last_unstale":"2023-10-09T11:36:08.296058+0000","last_undegraded":"2023-10-09T11:36:08.296058+0000","last_fullsized":"2023-10-09T11:36:08.296058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:12.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292177+0000","last_change":"2023-10-09T11:36:08.276944+0000","last_active":"2023-10-09T11:36:08.292177+0000","last_peered":"2023-10-09T11:36:08.292177+0000","last_clean":"2023-10-09T11:36:08.292177+0000","last_became_active":"2023-10-09T11:36:08.276663+0000","last_became_peered":"2023-10-09T11:36:08.276663+0000","last_unstale":"2023-10-09T11:36:08.292177+0000","last_undegraded":"2023-10-09T11:36:08.292177+0000","last_fullsized":"2023-10-09T11:36:08.292177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:16.568826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291233+0000","last_change":"2023-10-09T11:36:07.277618+0000","last_active":"2023-10-09T11:36:08.291233+0000","last_peered":"2023-10-09T11:36:08.291233+0000","last_clean":"2023-10-09T11:36:08.291233+0000","last_became_active":"2023-10-09T11:36:07.277333+0000","last_became_peered":"2023-10-09T11:36:07.277333+0000","last_unstale":"2023-10-09T11:36:08.291233+0000","last_undegraded":"2023-10-09T11:36:08.291233+0000","last_fullsized":"2023-10-09T11:36:08.291233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:18.779855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285785+0000","last_change":"2023-10-09T11:36:08.280498+0000","last_active":"2023-10-09T11:36:08.285785+0000","last_peered":"2023-10-09T11:36:08.285785+0000","last_clean":"2023-10-09T11:36:08.285785+0000","last_became_active":"2023-10-09T11:36:08.280194+0000","last_became_peered":"2023-10-09T11:36:08.280194+0000","last_unstale":"2023-10-09T11:36:08.285785+0000","last_undegraded":"2023-10-09T11:36:08.285785+0000","last_fullsized":"2023-10-09T11:36:08.285785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:58.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.267965+0000","last_change":"2023-10-09T11:36:07.277846+0000","last_active":"2023-10-09T11:36:08.267965+0000","last_peered":"2023-10-09T11:36:08.267965+0000","last_clean":"2023-10-09T11:36:08.267965+0000","last_became_active":"2023-10-09T11:36:07.277548+0000","last_became_peered":"2023-10-09T11:36:07.277548+0000","last_unstale":"2023-10-09T11:36:08.267965+0000","last_undegraded":"2023-10-09T11:36:08.267965+0000","last_fullsized":"2023-10-09T11:36:08.267965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288885+0000","last_change":"2023-10-09T11:36:08.285822+0000","last_active":"2023-10-09T11:36:08.288885+0000","last_peered":"2023-10-09T11:36:08.288885+0000","last_clean":"2023-10-09T11:36:08.288885+0000","last_became_active":"2023-10-09T11:36:08.285175+0000","last_became_peered":"2023-10-09T11:36:08.285175+0000","last_unstale":"2023-10-09T11:36:08.288885+0000","last_undegraded":"2023-10-09T11:36:08.288885+0000","last_fullsized":"2023-10-09T11:36:08.288885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:41.249717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270091+0000","last_change":"2023-10-09T11:36:07.284865+0000","last_active":"2023-10-09T11:36:08.270091+0000","last_peered":"2023-10-09T11:36:08.270091+0000","last_clean":"2023-10-09T11:36:08.270091+0000","last_became_active":"2023-10-09T11:36:07.284588+0000","last_became_peered":"2023-10-09T11:36:07.284588+0000","last_unstale":"2023-10-09T11:36:08.270091+0000","last_undegraded":"2023-10-09T11:36:08.270091+0000","last_fullsized":"2023-10-09T11:36:08.270091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.090633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288557+0000","last_change":"2023-10-09T11:36:08.286252+0000","last_active":"2023-10-09T11:36:08.288557+0000","last_peered":"2023-10-09T11:36:08.288557+0000","last_clean":"2023-10-09T11:36:08.288557+0000","last_became_active":"2023-10-09T11:36:08.285691+0000","last_became_peered":"2023-10-09T11:36:08.285691+0000","last_unstale":"2023-10-09T11:36:08.288557+0000","last_undegraded":"2023-10-09T11:36:08.288557+0000","last_fullsized":"2023-10-09T11:36:08.288557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294798+0000","last_change":"2023-10-09T11:36:07.276787+0000","last_active":"2023-10-09T11:36:08.294798+0000","last_peered":"2023-10-09T11:36:08.294798+0000","last_clean":"2023-10-09T11:36:08.294798+0000","last_became_active":"2023-10-09T11:36:07.276512+0000","last_became_peered":"2023-10-09T11:36:07.276512+0000","last_unstale":"2023-10-09T11:36:08.294798+0000","last_undegraded":"2023-10-09T11:36:08.294798+0000","last_fullsized":"2023-10-09T11:36:08.294798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.570578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282895+0000","last_change":"2023-10-09T11:36:08.275830+0000","last_active":"2023-10-09T11:36:08.282895+0000","last_peered":"2023-10-09T11:36:08.282895+0000","last_clean":"2023-10-09T11:36:08.282895+0000","last_became_active":"2023-10-09T11:36:08.275540+0000","last_became_peered":"2023-10-09T11:36:08.275540+0000","last_unstale":"2023-10-09T11:36:08.282895+0000","last_undegraded":"2023-10-09T11:36:08.282895+0000","last_fullsized":"2023-10-09T11:36:08.282895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:50.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.294540+0000","last_change":"2023-10-09T11:36:07.279427+0000","last_active":"2023-10-09T11:36:08.294540+0000","last_peered":"2023-10-09T11:36:08.294540+0000","last_clean":"2023-10-09T11:36:08.294540+0000","last_became_active":"2023-10-09T11:36:07.278936+0000","last_became_peered":"2023-10-09T11:36:07.278936+0000","last_unstale":"2023-10-09T11:36:08.294540+0000","last_undegraded":"2023-10-09T11:36:08.294540+0000","last_fullsized":"2023-10-09T11:36:08.294540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289951+0000","last_change":"2023-10-09T11:36:08.283247+0000","last_active":"2023-10-09T11:36:08.289951+0000","last_peered":"2023-10-09T11:36:08.289951+0000","last_clean":"2023-10-09T11:36:08.289951+0000","last_became_active":"2023-10-09T11:36:08.282938+0000","last_became_peered":"2023-10-09T11:36:08.282938+0000","last_unstale":"2023-10-09T11:36:08.289951+0000","last_undegraded":"2023-10-09T11:36:08.289951+0000","last_fullsized":"2023-10-09T11:36:08.289951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:15.150856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287415+0000","last_change":"2023-10-09T11:36:07.280068+0000","last_active":"2023-10-09T11:36:08.287415+0000","last_peered":"2023-10-09T11:36:08.287415+0000","last_clean":"2023-10-09T11:36:08.287415+0000","last_became_active":"2023-10-09T11:36:07.279789+0000","last_became_peered":"2023-10-09T11:36:07.279789+0000","last_unstale":"2023-10-09T11:36:08.287415+0000","last_undegraded":"2023-10-09T11:36:08.287415+0000","last_fullsized":"2023-10-09T11:36:08.287415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:48.608927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293202+0000","last_change":"2023-10-09T11:36:08.285067+0000","last_active":"2023-10-09T11:36:08.293202+0000","last_peered":"2023-10-09T11:36:08.293202+0000","last_clean":"2023-10-09T11:36:08.293202+0000","last_became_active":"2023-10-09T11:36:08.284743+0000","last_became_peered":"2023-10-09T11:36:08.284743+0000","last_unstale":"2023-10-09T11:36:08.293202+0000","last_undegraded":"2023-10-09T11:36:08.293202+0000","last_fullsized":"2023-10-09T11:36:08.293202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:23.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286630+0000","last_change":"2023-10-09T11:36:07.279785+0000","last_active":"2023-10-09T11:36:08.286630+0000","last_peered":"2023-10-09T11:36:08.286630+0000","last_clean":"2023-10-09T11:36:08.286630+0000","last_became_active":"2023-10-09T11:36:07.279196+0000","last_became_peered":"2023-10-09T11:36:07.279196+0000","last_unstale":"2023-10-09T11:36:08.286630+0000","last_undegraded":"2023-10-09T11:36:08.286630+0000","last_fullsized":"2023-10-09T11:36:08.286630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:58.492719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285708+0000","last_change":"2023-10-09T11:36:08.279359+0000","last_active":"2023-10-09T11:36:08.285708+0000","last_peered":"2023-10-09T11:36:08.285708+0000","last_clean":"2023-10-09T11:36:08.285708+0000","last_became_active":"2023-10-09T11:36:08.279085+0000","last_became_peered":"2023-10-09T11:36:08.279085+0000","last_unstale":"2023-10-09T11:36:08.285708+0000","last_undegraded":"2023-10-09T11:36:08.285708+0000","last_fullsized":"2023-10-09T11:36:08.285708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.850239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271052+0000","last_change":"2023-10-09T11:36:07.280371+0000","last_active":"2023-10-09T11:36:08.271052+0000","last_peered":"2023-10-09T11:36:08.271052+0000","last_clean":"2023-10-09T11:36:08.271052+0000","last_became_active":"2023-10-09T11:36:07.280080+0000","last_became_peered":"2023-10-09T11:36:07.280080+0000","last_unstale":"2023-10-09T11:36:08.271052+0000","last_undegraded":"2023-10-09T11:36:08.271052+0000","last_fullsized":"2023-10-09T11:36:08.271052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285485+0000","last_change":"2023-10-09T11:36:08.282867+0000","last_active":"2023-10-09T11:36:08.285485+0000","last_peered":"2023-10-09T11:36:08.285485+0000","last_clean":"2023-10-09T11:36:08.285485+0000","last_became_active":"2023-10-09T11:36:08.282595+0000","last_became_peered":"2023-10-09T11:36:08.282595+0000","last_unstale":"2023-10-09T11:36:08.285485+0000","last_undegraded":"2023-10-09T11:36:08.285485+0000","last_fullsized":"2023-10-09T11:36:08.285485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.366025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.292618+0000","last_change":"2023-10-09T11:36:07.275507+0000","last_active":"2023-10-09T11:36:08.292618+0000","last_peered":"2023-10-09T11:36:08.292618+0000","last_clean":"2023-10-09T11:36:08.292618+0000","last_became_active":"2023-10-09T11:36:07.273512+0000","last_became_peered":"2023-10-09T11:36:07.273512+0000","last_unstale":"2023-10-09T11:36:08.292618+0000","last_undegraded":"2023-10-09T11:36:08.292618+0000","last_fullsized":"2023-10-09T11:36:08.292618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285542+0000","last_change":"2023-10-09T11:36:08.282018+0000","last_active":"2023-10-09T11:36:08.285542+0000","last_peered":"2023-10-09T11:36:08.285542+0000","last_clean":"2023-10-09T11:36:08.285542+0000","last_became_active":"2023-10-09T11:36:08.281760+0000","last_became_peered":"2023-10-09T11:36:08.281760+0000","last_unstale":"2023-10-09T11:36:08.285542+0000","last_undegraded":"2023-10-09T11:36:08.285542+0000","last_fullsized":"2023-10-09T11:36:08.285542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:49.613786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.265705+0000","last_change":"2023-10-09T11:36:07.281451+0000","last_active":"2023-10-09T11:36:08.265705+0000","last_peered":"2023-10-09T11:36:08.265705+0000","last_clean":"2023-10-09T11:36:08.265705+0000","last_became_active":"2023-10-09T11:36:07.281196+0000","last_became_peered":"2023-10-09T11:36:07.281196+0000","last_unstale":"2023-10-09T11:36:08.265705+0000","last_undegraded":"2023-10-09T11:36:08.265705+0000","last_fullsized":"2023-10-09T11:36:08.265705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:53.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.285540+0000","last_change":"2023-10-09T11:36:08.277441+0000","last_active":"2023-10-09T11:36:08.285540+0000","last_peered":"2023-10-09T11:36:08.285540+0000","last_clean":"2023-10-09T11:36:08.285540+0000","last_became_active":"2023-10-09T11:36:08.277184+0000","last_became_peered":"2023-10-09T11:36:08.277184+0000","last_unstale":"2023-10-09T11:36:08.285540+0000","last_undegraded":"2023-10-09T11:36:08.285540+0000","last_fullsized":"2023-10-09T11:36:08.285540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:19.784715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270615+0000","last_change":"2023-10-09T11:36:07.278628+0000","last_active":"2023-10-09T11:36:08.270615+0000","last_peered":"2023-10-09T11:36:08.270615+0000","last_clean":"2023-10-09T11:36:08.270615+0000","last_became_active":"2023-10-09T11:36:07.278359+0000","last_became_peered":"2023-10-09T11:36:07.278359+0000","last_unstale":"2023-10-09T11:36:08.270615+0000","last_undegraded":"2023-10-09T11:36:08.270615+0000","last_fullsized":"2023-10-09T11:36:08.270615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.917615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.291747+0000","last_change":"2023-10-09T11:36:08.287971+0000","last_active":"2023-10-09T11:36:08.291747+0000","last_peered":"2023-10-09T11:36:08.291747+0000","last_clean":"2023-10-09T11:36:08.291747+0000","last_became_active":"2023-10-09T11:36:08.287474+0000","last_became_peered":"2023-10-09T11:36:08.287474+0000","last_unstale":"2023-10-09T11:36:08.291747+0000","last_undegraded":"2023-10-09T11:36:08.291747+0000","last_fullsized":"2023-10-09T11:36:08.291747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:59.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.264777+0000","last_change":"2023-10-09T11:36:07.276933+0000","last_active":"2023-10-09T11:36:08.264777+0000","last_peered":"2023-10-09T11:36:08.264777+0000","last_clean":"2023-10-09T11:36:08.264777+0000","last_became_active":"2023-10-09T11:36:07.276691+0000","last_became_peered":"2023-10-09T11:36:07.276691+0000","last_unstale":"2023-10-09T11:36:08.264777+0000","last_undegraded":"2023-10-09T11:36:08.264777+0000","last_fullsized":"2023-10-09T11:36:08.264777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:16.479226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.287084+0000","last_change":"2023-10-09T11:36:08.284621+0000","last_active":"2023-10-09T11:36:08.287084+0000","last_peered":"2023-10-09T11:36:08.287084+0000","last_clean":"2023-10-09T11:36:08.287084+0000","last_became_active":"2023-10-09T11:36:08.284367+0000","last_became_peered":"2023-10-09T11:36:08.284367+0000","last_unstale":"2023-10-09T11:36:08.287084+0000","last_undegraded":"2023-10-09T11:36:08.287084+0000","last_fullsized":"2023-10-09T11:36:08.287084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:53.399703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293828+0000","last_change":"2023-10-09T11:36:07.278885+0000","last_active":"2023-10-09T11:36:08.293828+0000","last_peered":"2023-10-09T11:36:08.293828+0000","last_clean":"2023-10-09T11:36:08.293828+0000","last_became_active":"2023-10-09T11:36:07.278567+0000","last_became_peered":"2023-10-09T11:36:07.278567+0000","last_unstale":"2023-10-09T11:36:08.293828+0000","last_undegraded":"2023-10-09T11:36:08.293828+0000","last_fullsized":"2023-10-09T11:36:08.293828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.284922+0000","last_change":"2023-10-09T11:36:08.278250+0000","last_active":"2023-10-09T11:36:08.284922+0000","last_peered":"2023-10-09T11:36:08.284922+0000","last_clean":"2023-10-09T11:36:08.284922+0000","last_became_active":"2023-10-09T11:36:08.277933+0000","last_became_peered":"2023-10-09T11:36:08.277933+0000","last_unstale":"2023-10-09T11:36:08.284922+0000","last_undegraded":"2023-10-09T11:36:08.284922+0000","last_fullsized":"2023-10-09T11:36:08.284922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-09T11:36:09.774458+0000","last_change":"2023-10-09T11:36:07.273853+0000","last_active":"2023-10-09T11:36:09.774458+0000","last_peered":"2023-10-09T11:36:09.774458+0000","last_clean":"2023-10-09T11:36:09.774458+0000","last_became_active":"2023-10-09T11:36:07.273562+0000","last_became_peered":"2023-10-09T11:36:07.273562+0000","last_unstale":"2023-10-09T11:36:09.774458+0000","last_undegraded":"2023-10-09T11:36:09.774458+0000","last_fullsized":"2023-10-09T11:36:09.774458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.290805+0000","last_change":"2023-10-09T11:36:08.289593+0000","last_active":"2023-10-09T11:36:08.290805+0000","last_peered":"2023-10-09T11:36:08.290805+0000","last_clean":"2023-10-09T11:36:08.290805+0000","last_became_active":"2023-10-09T11:36:08.289323+0000","last_became_peered":"2023-10-09T11:36:08.289323+0000","last_unstale":"2023-10-09T11:36:08.290805+0000","last_undegraded":"2023-10-09T11:36:08.290805+0000","last_fullsized":"2023-10-09T11:36:08.290805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:11.869499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.272883+0000","last_change":"2023-10-09T11:36:07.275895+0000","last_active":"2023-10-09T11:36:08.272883+0000","last_peered":"2023-10-09T11:36:08.272883+0000","last_clean":"2023-10-09T11:36:08.272883+0000","last_became_active":"2023-10-09T11:36:07.275394+0000","last_became_peered":"2023-10-09T11:36:07.275394+0000","last_unstale":"2023-10-09T11:36:08.272883+0000","last_undegraded":"2023-10-09T11:36:08.272883+0000","last_fullsized":"2023-10-09T11:36:08.272883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:01.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.282593+0000","last_change":"2023-10-09T11:36:08.277172+0000","last_active":"2023-10-09T11:36:08.282593+0000","last_peered":"2023-10-09T11:36:08.282593+0000","last_clean":"2023-10-09T11:36:08.282593+0000","last_became_active":"2023-10-09T11:36:08.276808+0000","last_became_peered":"2023-10-09T11:36:08.276808+0000","last_unstale":"2023-10-09T11:36:08.282593+0000","last_undegraded":"2023-10-09T11:36:08.282593+0000","last_fullsized":"2023-10-09T11:36:08.282593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:13.510818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269401+0000","last_change":"2023-10-09T11:36:07.273764+0000","last_active":"2023-10-09T11:36:08.269401+0000","last_peered":"2023-10-09T11:36:08.269401+0000","last_clean":"2023-10-09T11:36:08.269401+0000","last_became_active":"2023-10-09T11:36:07.273471+0000","last_became_peered":"2023-10-09T11:36:07.273471+0000","last_unstale":"2023-10-09T11:36:08.269401+0000","last_undegraded":"2023-10-09T11:36:08.269401+0000","last_fullsized":"2023-10-09T11:36:08.269401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:37.990521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.286251+0000","last_change":"2023-10-09T11:36:08.283848+0000","last_active":"2023-10-09T11:36:08.286251+0000","last_peered":"2023-10-09T11:36:08.286251+0000","last_clean":"2023-10-09T11:36:08.286251+0000","last_became_active":"2023-10-09T11:36:08.283566+0000","last_became_peered":"2023-10-09T11:36:08.283566+0000","last_unstale":"2023-10-09T11:36:08.286251+0000","last_undegraded":"2023-10-09T11:36:08.286251+0000","last_fullsized":"2023-10-09T11:36:08.286251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:53.095492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268004+0000","last_change":"2023-10-09T11:36:07.274431+0000","last_active":"2023-10-09T11:36:08.268004+0000","last_peered":"2023-10-09T11:36:08.268004+0000","last_clean":"2023-10-09T11:36:08.268004+0000","last_became_active":"2023-10-09T11:36:07.274154+0000","last_became_peered":"2023-10-09T11:36:07.274154+0000","last_unstale":"2023-10-09T11:36:08.268004+0000","last_undegraded":"2023-10-09T11:36:08.268004+0000","last_fullsized":"2023-10-09T11:36:08.268004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:06.845380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.293193+0000","last_change":"2023-10-09T11:36:08.290591+0000","last_active":"2023-10-09T11:36:08.293193+0000","last_peered":"2023-10-09T11:36:08.293193+0000","last_clean":"2023-10-09T11:36:08.293193+0000","last_became_active":"2023-10-09T11:36:08.290327+0000","last_became_peered":"2023-10-09T11:36:08.290327+0000","last_unstale":"2023-10-09T11:36:08.293193+0000","last_undegraded":"2023-10-09T11:36:08.293193+0000","last_fullsized":"2023-10-09T11:36:08.293193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:28.125121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.270730+0000","last_change":"2023-10-09T11:36:07.281909+0000","last_active":"2023-10-09T11:36:08.270730+0000","last_peered":"2023-10-09T11:36:08.270730+0000","last_clean":"2023-10-09T11:36:08.270730+0000","last_became_active":"2023-10-09T11:36:07.281638+0000","last_became_peered":"2023-10-09T11:36:07.281638+0000","last_unstale":"2023-10-09T11:36:08.270730+0000","last_undegraded":"2023-10-09T11:36:08.270730+0000","last_fullsized":"2023-10-09T11:36:08.270730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:13.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.288045+0000","last_change":"2023-10-09T11:36:08.282914+0000","last_active":"2023-10-09T11:36:08.288045+0000","last_peered":"2023-10-09T11:36:08.288045+0000","last_clean":"2023-10-09T11:36:08.288045+0000","last_became_active":"2023-10-09T11:36:08.282382+0000","last_became_peered":"2023-10-09T11:36:08.282382+0000","last_unstale":"2023-10-09T11:36:08.288045+0000","last_undegraded":"2023-10-09T11:36:08.288045+0000","last_fullsized":"2023-10-09T11:36:08.288045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:08.592019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.269124+0000","last_change":"2023-10-09T11:36:07.284950+0000","last_active":"2023-10-09T11:36:08.269124+0000","last_peered":"2023-10-09T11:36:08.269124+0000","last_clean":"2023-10-09T11:36:08.269124+0000","last_became_active":"2023-10-09T11:36:07.284605+0000","last_became_peered":"2023-10-09T11:36:07.284605+0000","last_unstale":"2023-10-09T11:36:08.269124+0000","last_undegraded":"2023-10-09T11:36:08.269124+0000","last_fullsized":"2023-10-09T11:36:08.269124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:10.864639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.289337+0000","last_change":"2023-10-09T11:36:08.286177+0000","last_active":"2023-10-09T11:36:08.289337+0000","last_peered":"2023-10-09T11:36:08.289337+0000","last_clean":"2023-10-09T11:36:08.289337+0000","last_became_active":"2023-10-09T11:36:08.285873+0000","last_became_peered":"2023-10-09T11:36:08.285873+0000","last_unstale":"2023-10-09T11:36:08.289337+0000","last_undegraded":"2023-10-09T11:36:08.289337+0000","last_fullsized":"2023-10-09T11:36:08.289337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:07.256055+0000","last_clean_scrub_stamp":"2023-10-09T11:36:07.256055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:55.264188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.268607+0000","last_change":"2023-10-09T11:36:07.278836+0000","last_active":"2023-10-09T11:36:08.268607+0000","last_peered":"2023-10-09T11:36:08.268607+0000","last_clean":"2023-10-09T11:36:08.268607+0000","last_became_active":"2023-10-09T11:36:07.278541+0000","last_became_peered":"2023-10-09T11:36:07.278541+0000","last_unstale":"2023-10-09T11:36:08.268607+0000","last_undegraded":"2023-10-09T11:36:08.268607+0000","last_fullsized":"2023-10-09T11:36:08.268607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:06.251196+0000","last_clean_scrub_stamp":"2023-10-09T11:36:06.251196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:52.394843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:08.271243+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:08.271243+0000","last_peered":"2023-10-09T11:36:08.271243+0000","last_clean":"2023-10-09T11:36:08.271243+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:08.271243+0000","last_undegraded":"2023-10-09T11:36:08.271243+0000","last_fullsized":"2023-10-09T11:36:08.271243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":727711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.625},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.745}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.77500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.81200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.623},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53500000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":138811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.441}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.54800000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.627},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":727621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.442}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.374},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.27600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.60099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":137323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.497},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.745},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73599999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.85599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":138811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.372},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.502}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.438}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.64000000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":137897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:17.306 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:36:17.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:36:17.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.467+0000 7fdd1fad3700 1 Processor -- start 2023-10-09T11:36:17.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.467+0000 7fdd1fad3700 1 -- start start 2023-10-09T11:36:17.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1fad3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd18159970 0x7fdd180686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1fad3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd180cbbc0 0x7fdd180c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1fad3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18068350 con 0x7fdd180c98e0 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1fad3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180c9d30 con 0x7fdd18159970 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1fad3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18067740 con 0x7fdd180cbbc0 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd18159970 0x7fdd180686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1e070700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdd180c98e0 0x7fdd1806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50378/0 (socket says 172.21.15.26:50378) 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1e070700 1 -- 172.21.15.26:0/3412762683 learned_addr learned my addr 172.21.15.26:0/3412762683 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d06e700 1 --2- 172.21.15.26:0/3412762683 >> v2:172.21.15.67:3300/0 conn(0x7fdd180cbbc0 0x7fdd180c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 -- 172.21.15.26:0/3412762683 >> v2:172.21.15.67:3300/0 conn(0x7fdd180cbbc0 msgr2=0x7fdd180c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 --2- 172.21.15.26:0/3412762683 >> v2:172.21.15.67:3300/0 conn(0x7fdd180cbbc0 0x7fdd180c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 -- 172.21.15.26:0/3412762683 >> v1:172.21.15.26:6789/0 conn(0x7fdd180c98e0 legacy=0x7fdd1806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1c86d700 1 -- 172.21.15.26:0/3412762683 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638799849 0 0) 0x7fdd18068350 con 0x7fdd180c98e0 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 -- 172.21.15.26:0/3412762683 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18067a20 con 0x7fdd18159970 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1d86f700 1 --2- 172.21.15.26:0/3412762683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd180686a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ce370 tx=0x7fdd08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e0f611f0f3b5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.468+0000 7fdd1c86d700 1 -- 172.21.15.26:0/3412762683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0800e070 con 0x7fdd18159970 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1c86d700 1 -- 172.21.15.26:0/3412762683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0800bc30 con 0x7fdd18159970 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1c86d700 1 -- 172.21.15.26:0/3412762683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08012430 con 0x7fdd18159970 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 -- 172.21.15.26:0/3412762683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 msgr2=0x7fdd180686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/3412762683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd180686a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ce370 tx=0x7fdd08009780 comp rx=0 tx=0).stop 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 -- 172.21.15.26:0/3412762683 shutdown_connections 2023-10-09T11:36:17.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/3412762683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd180686a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/3412762683 >> v2:172.21.15.67:3300/0 conn(0x7fdd180cbbc0 0x7fdd180c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 -- 172.21.15.26:0/3412762683 >> 172.21.15.26:0/3412762683 conn(0x7fdd1806e250 msgr2=0x7fdd180cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:17.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 -- 172.21.15.26:0/3412762683 shutdown_connections 2023-10-09T11:36:17.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.469+0000 7fdd1fad3700 1 -- 172.21.15.26:0/3412762683 wait complete. 2023-10-09T11:36:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.470+0000 7fdd1fad3700 1 Processor -- start 2023-10-09T11:36:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.470+0000 7fdd1fad3700 1 -- start start 2023-10-09T11:36:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd180c98e0 0x7fdd1816da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd180cbbc0 0x7fdd18159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1816dfd0 con 0x7fdd18159970 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1815a280 con 0x7fdd180cbbc0 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1fad3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180c45b0 con 0x7fdd180c98e0 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50690/0 (socket says 172.21.15.26:50690) 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 -- 172.21.15.26:0/2854695580 learned_addr learned my addr 172.21.15.26:0/2854695580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1d86f700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd180c98e0 0x7fdd1816da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1d06e700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd180cbbc0 0x7fdd18159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 -- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd180c98e0 msgr2=0x7fdd1816da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd180c98e0 0x7fdd1816da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 -- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd180cbbc0 msgr2=0x7fdd18159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd180cbbc0 0x7fdd18159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.471+0000 7fdd1e070700 1 -- 172.21.15.26:0/2854695580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009a20 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd1e070700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c7e0 tx=0x7fdd10007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10005c00 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10005d80 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18154550 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10007320 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.472+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1816a0b0 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.473+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1804c3c0 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.473+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd10007690 con 0x7fdd18159970 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.473+0000 7fdd15ffb700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 0x7fdd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.474+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd10083930 con 0x7fdd18159970 2023-10-09T11:36:17.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.474+0000 7fdd1d86f700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 0x7fdd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.474+0000 7fdd1d86f700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 0x7fdd040693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ce370 tx=0x7fdd08019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.478+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd10050ba0 con 0x7fdd18159970 2023-10-09T11:36:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.752+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdd18067d00 con 0x7fdd18159970 2023-10-09T11:36:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.755+0000 7fdd15ffb700 1 -- 172.21.15.26:0/2854695580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdd100170e0 con 0x7fdd18159970 2023-10-09T11:36:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 msgr2=0x7fdd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 0x7fdd040693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ce370 tx=0x7fdd08019000 comp rx=0 tx=0).stop 2023-10-09T11:36:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 msgr2=0x7fdd181539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c7e0 tx=0x7fdd10007d90 comp rx=0 tx=0).stop 2023-10-09T11:36:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 shutdown_connections 2023-10-09T11:36:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd18159970 0x7fdd181539e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdd04066f30 0x7fdd040693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd180c98e0 0x7fdd1816da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 --2- 172.21.15.26:0/2854695580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd180cbbc0 0x7fdd18159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.757+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 >> 172.21.15.26:0/2854695580 conn(0x7fdd1806e250 msgr2=0x7fdd180c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.758+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 shutdown_connections 2023-10-09T11:36:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.758+0000 7fdd1fad3700 1 -- 172.21.15.26:0/2854695580 wait complete. 2023-10-09T11:36:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:36:17.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:17.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.889+0000 7f6e80bdb700 1 Processor -- start 2023-10-09T11:36:17.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.889+0000 7f6e80bdb700 1 -- start start 2023-10-09T11:36:17.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e80bdb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7c153c30 0x7f6e7c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e80bdb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e80bdb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7c15afd0 con 0x7f6e7c15de50 2023-10-09T11:36:17.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e80bdb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7c15b2b0 con 0x7f6e7c153c30 2023-10-09T11:36:17.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e80bdb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c15b590 con 0x7f6e7c0cf110 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7c153c30 0x7f6e7c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7c153c30 0x7f6e7c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50704/0 (socket says 172.21.15.26:50704) 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 -- 172.21.15.26:0/908020074 learned_addr learned my addr 172.21.15.26:0/908020074 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7bfff700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 -- 172.21.15.26:0/908020074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 msgr2=0x7f6e7c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 -- 172.21.15.26:0/908020074 >> v1:172.21.15.67:6789/0 conn(0x7f6e7c15de50 legacy=0x7f6e7c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.890+0000 7f6e7b7fe700 1 -- 172.21.15.26:0/908020074 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c15b870 con 0x7f6e7c153c30 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e7b7fe700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c153c30 0x7f6e7c15a5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0099b0 tx=0x7f6e6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63bc65a23cb2250 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e7a7fc700 1 -- 172.21.15.26:0/908020074 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00b860 con 0x7f6e7c153c30 2023-10-09T11:36:17.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e7a7fc700 1 -- 172.21.15.26:0/908020074 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00b9c0 con 0x7f6e7c153c30 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e7a7fc700 1 -- 172.21.15.26:0/908020074 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00bd60 con 0x7f6e7c153c30 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 -- 172.21.15.26:0/908020074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c153c30 msgr2=0x7f6e7c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c153c30 0x7f6e7c15a5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0099b0 tx=0x7f6e6c009250 comp rx=0 tx=0).stop 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 -- 172.21.15.26:0/908020074 shutdown_connections 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/908020074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c153c30 0x7f6e7c15a5e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 -- 172.21.15.26:0/908020074 >> 172.21.15.26:0/908020074 conn(0x7f6e7c0703a0 msgr2=0x7f6e7c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 -- 172.21.15.26:0/908020074 shutdown_connections 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.891+0000 7f6e80bdb700 1 -- 172.21.15.26:0/908020074 wait complete. 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 Processor -- start 2023-10-09T11:36:17.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 -- start start 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e7c153c30 0x7f6e7c151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0cd910 con 0x7f6e7c15de50 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0b3d30 con 0x7f6e7c153c30 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.893+0000 7f6e80bdb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c1518d0 con 0x7f6e7c0cf110 2023-10-09T11:36:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50718/0 (socket says 172.21.15.26:50718) 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 -- 172.21.15.26:0/135543316 learned_addr learned my addr 172.21.15.26:0/135543316 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7b7fe700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7affd700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e7c153c30 0x7f6e7c151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 -- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 msgr2=0x7f6e7c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 -- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e7c153c30 msgr2=0x7f6e7c151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e7c153c30 0x7f6e7c151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 -- 172.21.15.26:0/135543316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0094f0 con 0x7f6e7c15de50 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e7bfff700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009fd0 tx=0x7f6e74009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400ebf0 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7400ed50 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c0b3400 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74014670 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.894+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c0b39c0 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.895+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c0b3ec0 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.896+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e740149e0 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.896+0000 7f6e637fe700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 0x7f6e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.896+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e74084b80 con 0x7f6e7c15de50 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.896+0000 7f6e7b7fe700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 0x7f6e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:17.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.897+0000 7f6e7b7fe700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 0x7f6e680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0099b0 tx=0x7f6e6c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:17.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:17.900+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e74051df0 con 0x7f6e7c15de50 2023-10-09T11:36:18.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.135+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e7c04c3c0 con 0x7f6e7c15de50 2023-10-09T11:36:18.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.136+0000 7f6e637fe700 1 -- 172.21.15.26:0/135543316 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f6e74055410 con 0x7f6e7c15de50 2023-10-09T11:36:18.138 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:18.138 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3752557440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3752557440},{"type":"v1","addr":"172.21.15.26:6834","nonce":3752557440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 msgr2=0x7f6e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 0x7f6e680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0099b0 tx=0x7f6e6c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 msgr2=0x7f6e7c151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009fd0 tx=0x7f6e74009900 comp rx=0 tx=0).stop 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 shutdown_connections 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e7c15de50 0x7f6e7c151390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e68066f30 0x7f6e680693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e7c0cf110 0x7f6e7c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 --2- 172.21.15.26:0/135543316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e7c153c30 0x7f6e7c151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 >> 172.21.15.26:0/135543316 conn(0x7f6e7c0703a0 msgr2=0x7f6e7c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 shutdown_connections 2023-10-09T11:36:18.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.138+0000 7f6e80bdb700 1 -- 172.21.15.26:0/135543316 wait complete. 2023-10-09T11:36:18.141 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 16 2023-10-09T11:36:18.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:36:07.666099+0000', 'modified': '2023-10-09T11:36:11.277940+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4962}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4962': {'gid': 4962, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/1332078689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 1332078689}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 1332078689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:36:18.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:36:18.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:36:18.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.682+0000 7f4988af5700 1 Processor -- start 2023-10-09T11:36:18.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.683+0000 7f4988af5700 1 -- start start 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.683+0000 7f4988af5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49840a8d00 0x7f49840cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.683+0000 7f4988af5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f498406e550 0x7f49840af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.683+0000 7f4988af5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49840aeee0 con 0x7f49840a90d0 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4988af5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49840ae680 con 0x7f498406e550 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4988af5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49840cf490 con 0x7f49840a8d00 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f498406e550 0x7f49840af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4981d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f49840a90d0 0x7f498406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50382/0 (socket says 172.21.15.26:50382) 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4981d9b700 1 -- 172.21.15.26:0/785727695 learned_addr learned my addr 172.21.15.26:0/785727695 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f498259c700 1 --2- 172.21.15.26:0/785727695 >> v2:172.21.15.67:3300/0 conn(0x7f49840a8d00 0x7f49840cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 -- 172.21.15.26:0/785727695 >> v2:172.21.15.67:3300/0 conn(0x7f49840a8d00 msgr2=0x7f49840cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 --2- 172.21.15.26:0/785727695 >> v2:172.21.15.67:3300/0 conn(0x7f49840a8d00 0x7f49840cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 -- 172.21.15.26:0/785727695 >> v1:172.21.15.26:6789/0 conn(0x7f49840a90d0 legacy=0x7f498406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 -- 172.21.15.26:0/785727695 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840ce330 con 0x7f498406e550 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f498159a700 1 -- 172.21.15.26:0/785727695 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269875853 0 0) 0x7f49840aeee0 con 0x7f49840a90d0 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f4982d9d700 1 --2- 172.21.15.26:0/785727695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f498406e550 0x7f49840af370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4984088a00 tx=0x7f497c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fda9e79348527e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f498159a700 1 -- 172.21.15.26:0/785727695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00e070 con 0x7f498406e550 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f498159a700 1 -- 172.21.15.26:0/785727695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c00bb60 con 0x7f498406e550 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.684+0000 7f498159a700 1 -- 172.21.15.26:0/785727695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c012430 con 0x7f498406e550 2023-10-09T11:36:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 -- 172.21.15.26:0/785727695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f498406e550 msgr2=0x7f49840af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 --2- 172.21.15.26:0/785727695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f498406e550 0x7f49840af370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4984088a00 tx=0x7f497c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 -- 172.21.15.26:0/785727695 shutdown_connections 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 --2- 172.21.15.26:0/785727695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f498406e550 0x7f49840af370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 --2- 172.21.15.26:0/785727695 >> v2:172.21.15.67:3300/0 conn(0x7f49840a8d00 0x7f49840cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 -- 172.21.15.26:0/785727695 >> 172.21.15.26:0/785727695 conn(0x7f498406ce80 msgr2=0x7f49840ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 -- 172.21.15.26:0/785727695 shutdown_connections 2023-10-09T11:36:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.685+0000 7f4988af5700 1 -- 172.21.15.26:0/785727695 wait complete. 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.686+0000 7f4988af5700 1 Processor -- start 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.686+0000 7f4988af5700 1 -- start start 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f498406e550 0x7f49840b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49840a8d00 0x7f4984156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984099b10 con 0x7f49840a90d0 2023-10-09T11:36:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984099df0 con 0x7f498406e550 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4988af5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4984156770 con 0x7f49840a8d00 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50726/0 (socket says 172.21.15.26:50726) 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 -- 172.21.15.26:0/3970264648 learned_addr learned my addr 172.21.15.26:0/3970264648 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f498259c700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f498406e550 0x7f49840b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4981d9b700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49840a8d00 0x7f4984156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 -- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49840a8d00 msgr2=0x7f4984156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49840a8d00 0x7f4984156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 -- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f498406e550 msgr2=0x7f49840b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f498406e550 0x7f49840b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.687+0000 7f4982d9d700 1 -- 172.21.15.26:0/3970264648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009a20 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f4982d9d700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f497c013000 tx=0x7f497c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f49727fc700 1 -- 172.21.15.26:0/3970264648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c012e80 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f49727fc700 1 -- 172.21.15.26:0/3970264648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c01d630 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498416a520 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f49727fc700 1 -- 172.21.15.26:0/3970264648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c01d9d0 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.688+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498416aae0 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.689+0000 7f49727fc700 1 -- 172.21.15.26:0/3970264648 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f497c024070 con 0x7f49840a90d0 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.689+0000 7f49727fc700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 0x7f49640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.690+0000 7f49727fc700 1 -- 172.21.15.26:0/3970264648 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f497c086dc0 con 0x7f49840a90d0 2023-10-09T11:36:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.690+0000 7f498259c700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 0x7f49640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.690+0000 7f498259c700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 0x7f49640693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49840cdcb0 tx=0x7f4974008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 Processor -- start 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 -- start start 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f61e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f8aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329eb8a70 con 0x55c329f8af60 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329eb6270 con 0x55c329fabd00 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.692+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c329eb2060 con 0x55c329f61a50 2023-10-09T11:36:18.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50736/0 (socket says 172.21.15.26:50736) 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 -- 172.21.15.26:0/1992756388 learned_addr learned my addr 172.21.15.26:0/1992756388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f498259c700 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f61e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4981d9b700 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f8aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 -- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 msgr2=0x55c329f61e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f61e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 -- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 msgr2=0x55c329f8aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f8aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 -- 172.21.15.26:0/1992756388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c329d4c270 con 0x55c329f8af60 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f4982d9d700 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f497c003400 tx=0x7f497c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d76450b69862de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f49637fe700 1 -- 172.21.15.26:0/1992756388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00e040 con 0x55c329f8af60 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f49637fe700 1 -- 172.21.15.26:0/1992756388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c009880 con 0x55c329f8af60 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.693+0000 7f49637fe700 1 -- 172.21.15.26:0/1992756388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c058350 con 0x55c329f8af60 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 -- 172.21.15.26:0/1992756388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 msgr2=0x55c329f5dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f497c003400 tx=0x7f497c020040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 -- 172.21.15.26:0/1992756388 shutdown_connections 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f5dcf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f61e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 --2- 172.21.15.26:0/1992756388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f8aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 -- 172.21.15.26:0/1992756388 >> 172.21.15.26:0/1992756388 conn(0x55c329f63370 msgr2=0x55c329f63740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 -- 172.21.15.26:0/1992756388 shutdown_connections 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.694+0000 7f4991dedb80 1 -- 172.21.15.26:0/1992756388 wait complete. 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.695+0000 7f4991dedb80 1 -- start start 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.695+0000 7f4991dedb80 1 Processor -- start 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 0x55c329fa31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329e5d890 con 0x55c329f61a50 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329e78ea0 con 0x55c329fabd00 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c329d34e30 con 0x55c329f8af60 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 10 client.0 _ll_register_callbacks cb 0x55c329f25110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50746/0 (socket says 172.21.15.26:50746) 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 -- 172.21.15.26:0/2265374981 learned_addr learned my addr 172.21.15.26:0/2265374981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 0x55c329fa31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4982d9d700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 -- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 msgr2=0x55c329fa31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 0x55c329fa31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 -- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 msgr2=0x55c329f877e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f877e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 -- 172.21.15.26:0/2265374981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498416aae0 con 0x55c329f61a50 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 0x55c329fa31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4982d9d700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f498259c700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4974015840 tx=0x7f4974018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85286184a79551ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974014560 con 0x55c329f61a50 2023-10-09T11:36:18.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49740146c0 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.696+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c329f56b70 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4974014a90 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 10 client.5178 fetch_fsmap learned FSMap version 16 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c329ceefe0 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c329f56b70 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4974028020 con 0x55c329f61a50 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 10 client.5178 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 10 client.5178 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 20 client.5178 populate_metadata read hostname 'smithi026' 2023-10-09T11:36:18.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa2290 0x55c329fa2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 4 client.5178 mds_command: new command op to 4962 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 --> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c329f33aa0 con 0x55c329fa2290 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa2290 0x55c329fa2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4960ff9700 10 client.5178 ms_handle_connect on v2:172.21.15.26:6833/1332078689 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.697+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa2290 0x55c329fa2660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448634bdfbc9c5cf server_cookie=7ead88b96b223c4e in_seq=0 out_seq=0 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4960ff9700 1 -- 172.21.15.26:0/2265374981 <== mds.0 v2:172.21.15.26:6833/1332078689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c329f33aa0 con 0x55c329fa2290 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4960ff9700 10 client.5178 handle_command_reply: tid=0 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 client.5178 shutdown 2023-10-09T11:36:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 msgr2=0x55c329fab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4974015840 tx=0x7f4974018000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 shutdown_connections 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa2290 0x55c329fa2660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f61a50 0x55c329fab720 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2265374981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f8af60 0x55c329fa31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4960ff9700 0 client.5178 ms_handle_reset on v2:172.21.15.26:6833/1332078689 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 >> 172.21.15.26:0/2265374981 conn(0x55c329f63370 msgr2=0x55c329fa7520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 shutdown_connections 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 1 -- 172.21.15.26:0/2265374981 wait complete. 2023-10-09T11:36:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.698+0000 7f4991dedb80 20 client.5178 trim_cache size 0 max 16384 2023-10-09T11:36:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.715+0000 7f4991dedb80 1 Processor -- start 2023-10-09T11:36:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.715+0000 7f4991dedb80 1 -- start start 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f86580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f63c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329f613a0 con 0x55c329f8af60 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329f5ef40 con 0x55c329fabd00 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c329f5c5a0 con 0x55c329f61a50 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50752/0 (socket says 172.21.15.26:50752) 2023-10-09T11:36:18.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 -- 172.21.15.26:0/2312823673 learned_addr learned my addr 172.21.15.26:0/2312823673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f498259c700 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f86580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4982d9d700 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f63c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 -- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 msgr2=0x55c329f86580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f86580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 -- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 msgr2=0x55c329f63c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f63c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.716+0000 7f4981d9b700 1 -- 172.21.15.26:0/2312823673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c329e80780 con 0x55c329f8af60 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4981d9b700 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49780071f0 tx=0x7f4978009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5347df625a1755ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4963fff700 1 -- 172.21.15.26:0/2312823673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497801e070 con 0x55c329f8af60 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4963fff700 1 -- 172.21.15.26:0/2312823673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49780195c0 con 0x55c329f8af60 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4963fff700 1 -- 172.21.15.26:0/2312823673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978019750 con 0x55c329f8af60 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 -- 172.21.15.26:0/2312823673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 msgr2=0x55c329f63740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49780071f0 tx=0x7f4978009040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 -- 172.21.15.26:0/2312823673 shutdown_connections 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329fabd00 0x55c329f63c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329f61a50 0x55c329f86580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 --2- 172.21.15.26:0/2312823673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f63740 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 -- 172.21.15.26:0/2312823673 >> 172.21.15.26:0/2312823673 conn(0x55c329f63370 msgr2=0x55c329f5a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 -- 172.21.15.26:0/2312823673 shutdown_connections 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.717+0000 7f4991dedb80 1 -- 172.21.15.26:0/2312823673 wait complete. 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.718+0000 7f4991dedb80 1 -- start start 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.718+0000 7f4991dedb80 1 Processor -- start 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329f61a50 0x55c32a007ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329fabd00 0x55c329f8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329fab160 con 0x55c329f8af60 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c329fa4370 con 0x55c329f61a50 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c32a00e0b0 con 0x55c329fabd00 2023-10-09T11:36:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4991dedb80 10 client.0 _ll_register_callbacks cb 0x55c329f25110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50760/0 (socket says 172.21.15.26:50760) 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 -- 172.21.15.26:0/608565381 learned_addr learned my addr 172.21.15.26:0/608565381 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f498259c700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329f61a50 0x55c32a007ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4982d9d700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329fabd00 0x55c329f8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 -- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329fabd00 msgr2=0x55c329f8d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329fabd00 0x55c329f8d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 -- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329f61a50 msgr2=0x55c32a007ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329f61a50 0x55c32a007ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 -- 172.21.15.26:0/608565381 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497800f040 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4981d9b700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55c329f8ec00 tx=0x7f4978024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f94a1878fa47a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.719+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978016730 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f497802b070 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f497c009880 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4978016aa0 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 10 client.5184 fetch_fsmap learned FSMap version 16 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c329e67470 con 0x55c329f8af60 2023-10-09T11:36:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978032080 con 0x55c329f8af60 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4978016c00 con 0x55c329f8af60 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 10 client.5184 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 10 client.5184 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 20 client.5184 populate_metadata read hostname 'smithi026' 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa31b0 0x55c329fa3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 4 client.5184 mds_command: new command op to 4962 tid=0[{"prefix": "status"}] 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 --> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c329e54e00 con 0x55c329fa31b0 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f498259c700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa31b0 0x55c329fa3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 10 client.5184 ms_handle_connect on v2:172.21.15.26:6833/1332078689 2023-10-09T11:36:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f498259c700 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa31b0 0x55c329fa3580 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f1f90ff866eab9 server_cookie=d713250c77818837 in_seq=0 out_seq=0 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.720+0000 7f4960ff9700 1 -- 172.21.15.26:0/608565381 <== mds.0 v2:172.21.15.26:6833/1332078689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c329e54e00 con 0x55c329fa31b0 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4960ff9700 10 client.5184 handle_command_reply: tid=0 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 client.5184 shutdown 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 msgr2=0x55c329f8d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55c329f8ec00 tx=0x7f4978024000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 shutdown_connections 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:6833/1332078689,v1:172.21.15.26:6835/1332078689] conn(0x55c329fa31b0 0x55c329fa3580 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c329fabd00 0x55c329f8d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c329f61a50 0x55c32a007ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 --2- 172.21.15.26:0/608565381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c329f8af60 0x55c329f8d340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4960ff9700 0 client.5184 ms_handle_reset on v2:172.21.15.26:6833/1332078689 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 >> 172.21.15.26:0/608565381 conn(0x55c329f63370 msgr2=0x55c329f63740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 shutdown_connections 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 1 -- 172.21.15.26:0/608565381 wait complete. 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4991dedb80 20 client.5184 trim_cache size 0 max 16384 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:36:18.732 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4962, 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.451055735000001, 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 16, 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 32, 2023-10-09T11:36:18.733 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 32, 2023-10-09T11:36:18.734 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 18.337419370999999 2023-10-09T11:36:18.734 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:36:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 msgr2=0x7f49640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 0x7f49640693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49840cdcb0 tx=0x7f4974008040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 msgr2=0x7f4984169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f497c013000 tx=0x7f497c019000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 shutdown_connections 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49840a90d0 0x7f4984169cd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f498406e550 0x7f49840b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4964066f30 0x7f49640693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 --2- 172.21.15.26:0/3970264648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49840a8d00 0x7f4984156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 >> 172.21.15.26:0/3970264648 conn(0x7f498406ce80 msgr2=0x7f49840cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.721+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 shutdown_connections 2023-10-09T11:36:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.722+0000 7f4988af5700 1 -- 172.21.15.26:0/3970264648 wait complete. 2023-10-09T11:36:18.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:18.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.854+0000 7fae0c143700 1 Processor -- start 2023-10-09T11:36:18.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 -- start start 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae040cb5a0 0x7fae040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae040cd9e0 0x7fae04159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0415ae40 con 0x7fae0415a400 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040d13f0 con 0x7fae040cd9e0 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.855+0000 7fae0c143700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0415ab60 con 0x7fae040cb5a0 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae040cd9e0 0x7fae04159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae040cd9e0 0x7fae04159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50776/0 (socket says 172.21.15.26:50776) 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 -- 172.21.15.26:0/1801860758 learned_addr learned my addr 172.21.15.26:0/1801860758 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae09edf700 1 --2- 172.21.15.26:0/1801860758 >> v2:172.21.15.67:3300/0 conn(0x7fae040cb5a0 0x7fae040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 -- 172.21.15.26:0/1801860758 >> v2:172.21.15.67:3300/0 conn(0x7fae040cb5a0 msgr2=0x7fae040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 --2- 172.21.15.26:0/1801860758 >> v2:172.21.15.67:3300/0 conn(0x7fae040cb5a0 0x7fae040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 -- 172.21.15.26:0/1801860758 >> v1:172.21.15.67:6789/0 conn(0x7fae0415a400 legacy=0x7fae04156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 -- 172.21.15.26:0/1801860758 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040ccf00 con 0x7fae040cd9e0 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae096de700 1 --2- 172.21.15.26:0/1801860758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040cd9e0 0x7fae04159ec0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fadf80099b0 tx=0x7fadf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619998eccfa8e638 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae08edd700 1 -- 172.21.15.26:0/1801860758 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8009ea0 con 0x7fae040cd9e0 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae08edd700 1 -- 172.21.15.26:0/1801860758 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800b820 con 0x7fae040cd9e0 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.856+0000 7fae08edd700 1 -- 172.21.15.26:0/1801860758 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800bbc0 con 0x7fae040cd9e0 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 -- 172.21.15.26:0/1801860758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040cd9e0 msgr2=0x7fae04159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 --2- 172.21.15.26:0/1801860758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040cd9e0 0x7fae04159ec0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fadf80099b0 tx=0x7fadf8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 -- 172.21.15.26:0/1801860758 shutdown_connections 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 --2- 172.21.15.26:0/1801860758 >> v2:172.21.15.67:3300/0 conn(0x7fae040cb5a0 0x7fae040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 --2- 172.21.15.26:0/1801860758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040cd9e0 0x7fae04159ec0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 -- 172.21.15.26:0/1801860758 >> 172.21.15.26:0/1801860758 conn(0x7fae04070e30 msgr2=0x7fae040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 -- 172.21.15.26:0/1801860758 shutdown_connections 2023-10-09T11:36:18.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.857+0000 7fae0c143700 1 -- 172.21.15.26:0/1801860758 wait complete. 2023-10-09T11:36:18.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.858+0000 7fae0c143700 1 Processor -- start 2023-10-09T11:36:18.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.858+0000 7fae0c143700 1 -- start start 2023-10-09T11:36:18.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040cb5a0 0x7fae04150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040cd9e0 0x7fae0415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04151ae0 con 0x7fae0415a400 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0415fdd0 con 0x7fae040cb5a0 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0c143700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae04150aa0 con 0x7fae040cd9e0 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50784/0 (socket says 172.21.15.26:50784) 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 -- 172.21.15.26:0/958104248 learned_addr learned my addr 172.21.15.26:0/958104248 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae09edf700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040cb5a0 0x7fae04150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae096de700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040cd9e0 0x7fae0415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 -- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040cd9e0 msgr2=0x7fae0415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040cd9e0 0x7fae0415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 -- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040cb5a0 msgr2=0x7fae04150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040cb5a0 0x7fae04150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 -- 172.21.15.26:0/958104248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80094f0 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.859+0000 7fae0a6e0700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c4c0 tx=0x7fadf4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.860+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400ce70 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.860+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf4011590 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.860+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0415f1c0 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.860+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4011970 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.860+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0415f780 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.861+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0415ff40 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.861+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadf4011ce0 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.861+0000 7fae01ffb700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 0x7fadf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.861+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadf4083810 con 0x7fae0415a400 2023-10-09T11:36:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.861+0000 7fae09edf700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 0x7fadf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.862+0000 7fae09edf700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 0x7fadf00693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00f570 tx=0x7fadfc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:18.866+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf4050a80 con 0x7fae0415a400 2023-10-09T11:36:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.106+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae0404c3c0 con 0x7fae0415a400 2023-10-09T11:36:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.107+0000 7fae01ffb700 1 -- 172.21.15.26:0/958104248 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fadf4017020 con 0x7fae0415a400 2023-10-09T11:36:19.108 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:19.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 msgr2=0x7fadf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 0x7fadf00693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00f570 tx=0x7fadfc00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 msgr2=0x7fae0415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c4c0 tx=0x7fadf4007f50 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 shutdown_connections 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0415a400 0x7fae0415eb40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040cb5a0 0x7fae04150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fadf0066f30 0x7fadf00693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 --2- 172.21.15.26:0/958104248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040cd9e0 0x7fae0415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 >> 172.21.15.26:0/958104248 conn(0x7fae04070e30 msgr2=0x7fae040b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 shutdown_connections 2023-10-09T11:36:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.109+0000 7fae0c143700 1 -- 172.21.15.26:0/958104248 wait complete. 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:19.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:36:19.123 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:36:19.123 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:19.123 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:19.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.123 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:19.139 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-10-09T11:36:19.140 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:36:19.141 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.141 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:19.141 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:19.141 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:36:19.141 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:19.142 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:36:19.143 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:36:19.143 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:19.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.143 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:19.203 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:36:19.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.205 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:36:19.261 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:36:19.261 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:19.262 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:36:19.262 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:36:19.262 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:19.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.262 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:36:19.262 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:36:19.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:36:19.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:36:19.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:36:19.263 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:36:19.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.365 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:36:19.380 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:36:19.380 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:36:19.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:19.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:36:19.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:19.446 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:19.501 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:19.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:19.502 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:19.556 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:36:19.556 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:19.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:19.637 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:19.638 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:19.658 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:19.678 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:19.679 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:19.679 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:19.679 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:19.679 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:19.679 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:19.680 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:19.680 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:19.680 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:36:19.680 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:36:19.680 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:36:19.681 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:19.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:19.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:19.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:19.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.905+0000 7ff84dbc3700 1 Processor -- start 2023-10-09T11:36:19.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.905+0000 7ff84dbc3700 1 -- start start 2023-10-09T11:36:19.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff84dbc3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff848159c80 0x7ff8480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff84dbc3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff8480cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff84dbc3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480ce9d0 con 0x7ff8481598b0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff84dbc3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480af960 con 0x7ff848159c80 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff84dbc3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480afc30 con 0x7ff8480cfe70 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff8477fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff8481598b0 0x7ff8480af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50544/0 (socket says 172.21.15.26:50544) 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.906+0000 7ff8477fe700 1 -- 172.21.15.26:0/1177189312 learned_addr learned my addr 172.21.15.26:0/1177189312 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367112617 0 0) 0x7ff8480ce9d0 con 0x7ff8481598b0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1177189312 >> v2:172.21.15.67:3300/0 conn(0x7ff848159c80 0x7ff8480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff847fff700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff8480cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff830003570 con 0x7ff8481598b0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1854091530 0 0) 0x7ff830003570 con 0x7ff8481598b0 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 msgr2=0x7ff8480cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff8480cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 >> v2:172.21.15.67:3300/0 conn(0x7ff848159c80 msgr2=0x7ff8480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 --2- 172.21.15.26:0/1177189312 >> v2:172.21.15.67:3300/0 conn(0x7ff848159c80 0x7ff8480cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480aff10 con 0x7ff8481598b0 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ff838001470 con 0x7ff8481598b0 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 >> v1:172.21.15.26:6789/0 conn(0x7ff8481598b0 legacy=0x7ff8480af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff830003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff830003fe0 0x7ff830004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480af960 con 0x7ff830003fe0 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480afc30 con 0x7ff830004d50 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83000ba90 con 0x7ff8480cfe70 2023-10-09T11:36:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff830003fe0 0x7ff830004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff8477fe700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff830003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff847fff700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 -- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 msgr2=0x7ff830003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8480cfe70 0x7ff830003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 -- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830004d50 msgr2=0x7ff8300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.907+0000 7ff846ffd700 1 -- 172.21.15.26:0/1177189312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830003570 con 0x7ff830003fe0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff830003fe0 0x7ff830004810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009c00 tx=0x7ff83c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8c8b54d7ef921d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e6b0 con 0x7ff830003fe0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00e810 con 0x7ff830003fe0 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff8467fc700 1 -- 172.21.15.26:0/1177189312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00ebd0 con 0x7ff830003fe0 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1177189312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff830003fe0 msgr2=0x7ff830004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1177189312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff830003fe0 0x7ff830004810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009c00 tx=0x7ff83c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff847fff700 1 -- 172.21.15.26:0/1177189312 reap_dead start 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1177189312 shutdown_connections 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1177189312 >> 172.21.15.26:0/1177189312 conn(0x7ff848070e30 msgr2=0x7ff8480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1177189312 shutdown_connections 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.908+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1177189312 wait complete. 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 Processor -- start 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 -- start start 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 0x7ff848154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff848152fd0 0x7ff848153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c95d0 con 0x7ff848155de0 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848154e80 con 0x7ff830003fe0 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.910+0000 7ff84dbc3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c89c0 con 0x7ff848152fd0 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52170/0 (socket says 172.21.15.26:52170) 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 -- 172.21.15.26:0/1289097681 learned_addr learned my addr 172.21.15.26:0/1289097681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff8477fe700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 0x7ff848154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff847fff700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff848152fd0 0x7ff848153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 -- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff848152fd0 msgr2=0x7ff848153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff848152fd0 0x7ff848153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 -- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 msgr2=0x7ff848154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 0x7ff848154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 -- 172.21.15.26:0/1289097681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480c8ca0 con 0x7ff848155de0 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff8477fe700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 0x7ff848154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff846ffd700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff830004730 tx=0x7ff83c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c022070 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00e980 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8480c8f80 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c027470 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.911+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff848152b80 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.912+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84804c3c0 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.913+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff83c01c450 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.913+0000 7ff82f7fe700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.913+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff83c086090 con 0x7ff848155de0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.913+0000 7ff8477fe700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.914+0000 7ff8477fe700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 0x7ff8340693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff838000e10 tx=0x7ff838009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:19.918+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff83c053300 con 0x7ff848155de0 2023-10-09T11:36:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.156+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8480ce380 con 0x7ff848155de0 2023-10-09T11:36:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.156+0000 7ff82f7fe700 1 -- 172.21.15.26:0/1289097681 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff83c056920 con 0x7ff848155de0 2023-10-09T11:36:20.158 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 msgr2=0x7ff8340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 0x7ff8340693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff838000e10 tx=0x7ff838009040 comp rx=0 tx=0).stop 2023-10-09T11:36:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 msgr2=0x7ff848152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff830004730 tx=0x7ff83c01a000 comp rx=0 tx=0).stop 2023-10-09T11:36:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 shutdown_connections 2023-10-09T11:36:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff848152fd0 0x7ff848153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff830003fe0 0x7ff848154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 --2- 172.21.15.26:0/1289097681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff848155de0 0x7ff848152640 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 >> 172.21.15.26:0/1289097681 conn(0x7ff848070e30 msgr2=0x7ff8480b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 shutdown_connections 2023-10-09T11:36:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.158+0000 7ff84dbc3700 1 -- 172.21.15.26:0/1289097681 wait complete. 2023-10-09T11:36:20.172 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:36:20.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:20.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:36:20.173 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:36:20.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:20.173 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:36:20.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:36:20.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:20.174 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:20.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.175 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:36:20.194 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:20.195 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:20.195 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:20.195 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.195 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:20.196 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:20.197 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:36:20.197 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:20.197 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:20.197 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42427sec preferred_lft 42427sec 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.198 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.199 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:20.200 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:36:20.200 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:36:20.200 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.200 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:20.200 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:36:20.201 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:36:20.201 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:20.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.201 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:20.265 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:36:20.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.267 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:36:20.325 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:36:20.326 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:20.326 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:36:20.326 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:36:20.326 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:20.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.326 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:36:20.326 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:36:20.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:36:20.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:36:20.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:36:20.327 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:36:20.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.438 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:36:20.454 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:36:20.455 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:36:20.522 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:20.522 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:20.577 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:20.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:20.578 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:20.633 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:36:20.633 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:20.633 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:20.714 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:20.714 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:20.733 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:20.734 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:20.735 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:20.758 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:20.758 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:20.758 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:20.759 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:36:20.760 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:36:20.760 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:36:20.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:20.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:20.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:36:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.955+0000 7f631ce41700 1 Processor -- start 2023-10-09T11:36:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.955+0000 7f631ce41700 1 -- start start 2023-10-09T11:36:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631ce41700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 0x7f631815b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631ce41700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 0x7f63180b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631ce41700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63180b0090 con 0x7f63180c8f50 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631ce41700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63180b4480 con 0x7f6318157570 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631ce41700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180afd80 con 0x7f6318157940 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f6315d9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 0x7f63180b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f631659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 0x7f631815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f6316d9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f63180c8f50 0x7f63180b0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53802/0 (socket says 172.21.15.26:53802) 2023-10-09T11:36:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.956+0000 7f6316d9d700 1 -- 172.21.15.26:0/2023404726 learned_addr learned my addr 172.21.15.26:0/2023404726 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631559a700 1 -- 172.21.15.26:0/2023404726 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892321011 0 0) 0x7f63180b0090 con 0x7f63180c8f50 2023-10-09T11:36:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631559a700 1 -- 172.21.15.26:0/2023404726 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003570 con 0x7f63180c8f50 2023-10-09T11:36:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f6315d9b700 1 -- 172.21.15.26:0/2023404726 >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 msgr2=0x7f631815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f6315d9b700 1 --2- 172.21.15.26:0/2023404726 >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 0x7f631815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f6315d9b700 1 -- 172.21.15.26:0/2023404726 >> v1:172.21.15.67:6789/0 conn(0x7f63180c8f50 legacy=0x7f63180b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f6315d9b700 1 -- 172.21.15.26:0/2023404726 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631815b950 con 0x7f6318157940 2023-10-09T11:36:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631659c700 1 --2- 172.21.15.26:0/2023404726 >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 0x7f631815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f6315d9b700 1 --2- 172.21.15.26:0/2023404726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 0x7f63180b3f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63000098e0 tx=0x7f63000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76f49ccd8f2ba24 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631559a700 1 -- 172.21.15.26:0/2023404726 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011630 con 0x7f6318157940 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631559a700 1 -- 172.21.15.26:0/2023404726 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300011790 con 0x7f6318157940 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.957+0000 7f631559a700 1 -- 172.21.15.26:0/2023404726 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011b30 con 0x7f6318157940 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 -- 172.21.15.26:0/2023404726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 msgr2=0x7f63180b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 --2- 172.21.15.26:0/2023404726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 0x7f63180b3f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63000098e0 tx=0x7f63000091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 -- 172.21.15.26:0/2023404726 shutdown_connections 2023-10-09T11:36:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 --2- 172.21.15.26:0/2023404726 >> v2:172.21.15.67:3300/0 conn(0x7f6318157570 0x7f631815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 --2- 172.21.15.26:0/2023404726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157940 0x7f63180b3f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 -- 172.21.15.26:0/2023404726 >> 172.21.15.26:0/2023404726 conn(0x7f63180ce4a0 msgr2=0x7f63180ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 -- 172.21.15.26:0/2023404726 shutdown_connections 2023-10-09T11:36:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.958+0000 7f631ce41700 1 -- 172.21.15.26:0/2023404726 wait complete. 2023-10-09T11:36:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.959+0000 7f631ce41700 1 Processor -- start 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.959+0000 7f631ce41700 1 -- start start 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157570 0x7f63180c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6318157940 0x7f63180c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180ad460 con 0x7f63180c8f50 2023-10-09T11:36:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631806f750 con 0x7f6318157940 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180c2420 con 0x7f6318157570 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52174/0 (socket says 172.21.15.26:52174) 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 -- 172.21.15.26:0/1258646814 learned_addr learned my addr 172.21.15.26:0/1258646814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f6315d9b700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157570 0x7f63180c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f6316d9d700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6318157940 0x7f63180c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 -- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157570 msgr2=0x7f63180c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157570 0x7f63180c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 -- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6318157940 msgr2=0x7f63180c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6318157940 0x7f63180c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 -- 172.21.15.26:0/1258646814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308009a20 con 0x7f63180c8f50 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631659c700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f630800c170 tx=0x7f630800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800ce10 con 0x7f63180c8f50 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800f040 con 0x7f63180c8f50 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.960+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300009420 con 0x7f63180c8f50 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.961+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308014690 con 0x7f63180c8f50 2023-10-09T11:36:20.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.961+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631806ef30 con 0x7f63180c8f50 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.962+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631804c3c0 con 0x7f63180c8f50 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.962+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6308014a00 con 0x7f63180c8f50 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.962+0000 7f630e7fc700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.963+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63080853f0 con 0x7f63180c8f50 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.963+0000 7f6315d9b700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.963+0000 7f6315d9b700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 0x7f62f80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63000091e0 tx=0x7f6300017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:20.967+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6308052660 con 0x7f63180c8f50 2023-10-09T11:36:21.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.203+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6318068770 con 0x7f63180c8f50 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.311+0000 7f630e7fc700 1 -- 172.21.15.26:0/1258646814 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6308014cb0 con 0x7f63180c8f50 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 msgr2=0x7f62f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 0x7f62f80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63000091e0 tx=0x7f6300017000 comp rx=0 tx=0).stop 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 msgr2=0x7f63180c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f630800c170 tx=0x7f630800b040 comp rx=0 tx=0).stop 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 shutdown_connections 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6318157940 0x7f63180c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63180c8f50 0x7f63180c1ee0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 --2- 172.21.15.26:0/1258646814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6318157570 0x7f63180c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 >> 172.21.15.26:0/1258646814 conn(0x7f63180ce4a0 msgr2=0x7f63180b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 shutdown_connections 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.313+0000 7f631ce41700 1 -- 172.21.15.26:0/1258646814 wait complete. 2023-10-09T11:36:21.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:36:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.445+0000 7f985ca53700 1 Processor -- start 2023-10-09T11:36:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.445+0000 7f985ca53700 1 -- start start 2023-10-09T11:36:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.446+0000 7f985ca53700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f985815a7d0 0x7f9858158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.446+0000 7f985ca53700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9858158c80 con 0x7f98581508c0 2023-10-09T11:36:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.446+0000 7f985ca53700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9858158f60 con 0x7f9858150c90 2023-10-09T11:36:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.446+0000 7f985ca53700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985815afc0 con 0x7f985815a7d0 2023-10-09T11:36:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f98581508c0 0x7f985815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50552/0 (socket says 172.21.15.26:50552) 2023-10-09T11:36:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985659c700 1 -- 172.21.15.26:0/961890759 learned_addr learned my addr 172.21.15.26:0/961890759 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f9855d9b700 1 --2- 172.21.15.26:0/961890759 >> v2:172.21.15.67:3300/0 conn(0x7f985815a7d0 0x7f9858158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262114643 0 0) 0x7f9858158c80 con 0x7f98581508c0 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844003570 con 0x7f98581508c0 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f9855d9b700 1 -- 172.21.15.26:0/961890759 >> v1:172.21.15.67:6789/0 conn(0x7f9858150c90 legacy=0x7f9858154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f9855d9b700 1 -- 172.21.15.26:0/961890759 >> v1:172.21.15.26:6789/0 conn(0x7f98581508c0 legacy=0x7f985815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445499321 0 0) 0x7f9858158f60 con 0x7f9858150c90 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f9855d9b700 1 -- 172.21.15.26:0/961890759 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858159240 con 0x7f985815a7d0 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f9855d9b700 1 --2- 172.21.15.26:0/961890759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985815a7d0 0x7f9858158650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98400098e0 tx=0x7f98400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca4b6b7911e5ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850001770 con 0x7f985815a7d0 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.447+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840011420 con 0x7f985815a7d0 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985559a700 1 -- 172.21.15.26:0/961890759 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400117c0 con 0x7f985815a7d0 2023-10-09T11:36:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 -- 172.21.15.26:0/961890759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985815a7d0 msgr2=0x7f9858158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 --2- 172.21.15.26:0/961890759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985815a7d0 0x7f9858158650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98400098e0 tx=0x7f98400091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 -- 172.21.15.26:0/961890759 shutdown_connections 2023-10-09T11:36:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 --2- 172.21.15.26:0/961890759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f985815a7d0 0x7f9858158650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 -- 172.21.15.26:0/961890759 >> 172.21.15.26:0/961890759 conn(0x7f98580cded0 msgr2=0x7f985806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 -- 172.21.15.26:0/961890759 shutdown_connections 2023-10-09T11:36:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.448+0000 7f985ca53700 1 -- 172.21.15.26:0/961890759 wait complete. 2023-10-09T11:36:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.449+0000 7f985ca53700 1 Processor -- start 2023-10-09T11:36:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.449+0000 7f985ca53700 1 -- start start 2023-10-09T11:36:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98581508c0 0x7f9858146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9858150c90 0x7f98581537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985816b220 con 0x7f985815a7d0 2023-10-09T11:36:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985816ba80 con 0x7f98581508c0 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985ca53700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858154270 con 0x7f9858150c90 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52176/0 (socket says 172.21.15.26:52176) 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 -- 172.21.15.26:0/4093068022 learned_addr learned my addr 172.21.15.26:0/4093068022 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f985659c700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98581508c0 0x7f9858146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9855d9b700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9858150c90 0x7f98581537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 -- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9858150c90 msgr2=0x7f98581537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9858150c90 0x7f98581537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 -- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98581508c0 msgr2=0x7f9858146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98581508c0 0x7f9858146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.450+0000 7f9856d9d700 1 -- 172.21.15.26:0/4093068022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009420 con 0x7f985815a7d0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f9856d9d700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f984800c810 tx=0x7f9848007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848012700 con 0x7f985815a7d0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848012880 con 0x7f985815a7d0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985816b430 con 0x7f985815a7d0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848012c40 con 0x7f985815a7d0 2023-10-09T11:36:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.451+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98581474a0 con 0x7f985815a7d0 2023-10-09T11:36:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.452+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985816bbf0 con 0x7f985815a7d0 2023-10-09T11:36:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.452+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9848011590 con 0x7f985815a7d0 2023-10-09T11:36:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.453+0000 7f984e7fc700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 0x7f98380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.453+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9848084160 con 0x7f985815a7d0 2023-10-09T11:36:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.453+0000 7f985659c700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 0x7f98380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.453+0000 7f985659c700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 0x7f98380693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9850001560 tx=0x7f9850005c50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.457+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98480513d0 con 0x7f985815a7d0 2023-10-09T11:36:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.679+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f985804c3c0 con 0x7f9838066f30 2023-10-09T11:36:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.681+0000 7f984e7fc700 1 -- 172.21.15.26:0/4093068022 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f985804c3c0 con 0x7f9838066f30 2023-10-09T11:36:21.683 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:36:21.683 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:21.684 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:36:21.684 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:21.684 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:36:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.683+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 msgr2=0x7f98380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.683+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 0x7f98380693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9850001560 tx=0x7f9850005c50 comp rx=0 tx=0).stop 2023-10-09T11:36:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.683+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 msgr2=0x7f985806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.683+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f984800c810 tx=0x7f9848007de0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 shutdown_connections 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f985815a7d0 0x7f985806c6a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98581508c0 0x7f9858146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9838066f30 0x7f98380693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 --2- 172.21.15.26:0/4093068022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9858150c90 0x7f98581537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 >> 172.21.15.26:0/4093068022 conn(0x7f98580cded0 msgr2=0x7f9858147e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 shutdown_connections 2023-10-09T11:36:21.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.684+0000 7f985ca53700 1 -- 172.21.15.26:0/4093068022 wait complete. 2023-10-09T11:36:21.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:36:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.818+0000 7f97def75700 1 Processor -- start 2023-10-09T11:36:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.818+0000 7f97def75700 1 -- start start 2023-10-09T11:36:21.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97def75700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97d8153a00 0x7f97d8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97def75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97d815de50 0x7f97d815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97def75700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d815af60 con 0x7f97d80cea00 2023-10-09T11:36:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97def75700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d815d010 con 0x7f97d815de50 2023-10-09T11:36:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97def75700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d815b240 con 0x7f97d8153a00 2023-10-09T11:36:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97d815de50 0x7f97d815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97d815de50 0x7f97d815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52190/0 (socket says 172.21.15.26:52190) 2023-10-09T11:36:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 -- 172.21.15.26:0/3907174749 learned_addr learned my addr 172.21.15.26:0/3907174749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97ddf73700 1 --2- 172.21.15.26:0/3907174749 >> v2:172.21.15.67:3300/0 conn(0x7f97d8153a00 0x7f97d8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 -- 172.21.15.26:0/3907174749 >> v2:172.21.15.67:3300/0 conn(0x7f97d8153a00 msgr2=0x7f97d8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 --2- 172.21.15.26:0/3907174749 >> v2:172.21.15.67:3300/0 conn(0x7f97d8153a00 0x7f97d8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 -- 172.21.15.26:0/3907174749 >> v1:172.21.15.67:6789/0 conn(0x7f97d80cea00 legacy=0x7f97d80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.819+0000 7f97dd772700 1 -- 172.21.15.26:0/3907174749 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d815b520 con 0x7f97d815de50 2023-10-09T11:36:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97dd772700 1 --2- 172.21.15.26:0/3907174749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d815a540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97d80cac20 tx=0x7f97cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df22a4193a05d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97dcf71700 1 -- 172.21.15.26:0/3907174749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00b820 con 0x7f97d815de50 2023-10-09T11:36:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97dcf71700 1 -- 172.21.15.26:0/3907174749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00b980 con 0x7f97d815de50 2023-10-09T11:36:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97dcf71700 1 -- 172.21.15.26:0/3907174749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00bd20 con 0x7f97d815de50 2023-10-09T11:36:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 -- 172.21.15.26:0/3907174749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 msgr2=0x7f97d815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 --2- 172.21.15.26:0/3907174749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d815a540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97d80cac20 tx=0x7f97cc009250 comp rx=0 tx=0).stop 2023-10-09T11:36:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 -- 172.21.15.26:0/3907174749 shutdown_connections 2023-10-09T11:36:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 --2- 172.21.15.26:0/3907174749 >> v2:172.21.15.67:3300/0 conn(0x7f97d8153a00 0x7f97d8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 --2- 172.21.15.26:0/3907174749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d815a540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 -- 172.21.15.26:0/3907174749 >> 172.21.15.26:0/3907174749 conn(0x7f97d80703a0 msgr2=0x7f97d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 -- 172.21.15.26:0/3907174749 shutdown_connections 2023-10-09T11:36:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.820+0000 7f97def75700 1 -- 172.21.15.26:0/3907174749 wait complete. 2023-10-09T11:36:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 Processor -- start 2023-10-09T11:36:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 -- start start 2023-10-09T11:36:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97d80cea00 0x7f97d80cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97d8153a00 0x7f97d80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80b41f0 con 0x7f97d815de50 2023-10-09T11:36:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80cb7a0 con 0x7f97d80cea00 2023-10-09T11:36:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.822+0000 7f97def75700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80cba80 con 0x7f97d8153a00 2023-10-09T11:36:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52204/0 (socket says 172.21.15.26:52204) 2023-10-09T11:36:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 -- 172.21.15.26:0/2245409992 learned_addr learned my addr 172.21.15.26:0/2245409992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97ddf73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97d80cea00 0x7f97d80cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97dd772700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97d8153a00 0x7f97d80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 -- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97d8153a00 msgr2=0x7f97d80cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97d8153a00 0x7f97d80cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 -- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97d80cea00 msgr2=0x7f97d80cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97d80cea00 0x7f97d80cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 -- 172.21.15.26:0/2245409992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0094f0 con 0x7f97d815de50 2023-10-09T11:36:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97de774700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97c800bc30 tx=0x7f97c8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c800c840 con 0x7f97d815de50 2023-10-09T11:36:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c800c9e0 con 0x7f97d815de50 2023-10-09T11:36:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d80cbd60 con 0x7f97d815de50 2023-10-09T11:36:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c800cda0 con 0x7f97d815de50 2023-10-09T11:36:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.823+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d80c75e0 con 0x7f97d815de50 2023-10-09T11:36:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.824+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d80c77d0 con 0x7f97d815de50 2023-10-09T11:36:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.825+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97c8014620 con 0x7f97d815de50 2023-10-09T11:36:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.825+0000 7f97d5ffb700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.825+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97c8084470 con 0x7f97d815de50 2023-10-09T11:36:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.826+0000 7f97ddf73700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.826+0000 7f97ddf73700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 0x7f97c40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97d0006fd0 tx=0x7f97d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:21.829+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97c804c5a0 con 0x7f97d815de50 2023-10-09T11:36:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.021+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f97d804c3c0 con 0x7f97d815de50 2023-10-09T11:36:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.022+0000 7f97d5ffb700 1 -- 172.21.15.26:0/2245409992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97c80516e0 con 0x7f97d815de50 2023-10-09T11:36:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 msgr2=0x7f97c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 0x7f97c40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97d0006fd0 tx=0x7f97d0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 msgr2=0x7f97d80b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97c800bc30 tx=0x7f97c8009820 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 shutdown_connections 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97d815de50 0x7f97d80b3cb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97d80cea00 0x7f97d80cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 --2- 172.21.15.26:0/2245409992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97d8153a00 0x7f97d80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 >> 172.21.15.26:0/2245409992 conn(0x7f97d80703a0 msgr2=0x7f97d80d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 shutdown_connections 2023-10-09T11:36:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.024+0000 7f97def75700 1 -- 172.21.15.26:0/2245409992 wait complete. 2023-10-09T11:36:22.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000210073 2023-10-09T11:36:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.157+0000 7f43f3db3700 1 Processor -- start 2023-10-09T11:36:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.157+0000 7f43f3db3700 1 -- start start 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f3db3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec1597e0 0x7f43ec159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f3db3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43ec06e950 0x7f43ec06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f3db3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec06f300 con 0x7f43ec06c6a0 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f3db3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0c71a0 con 0x7f43ec06e950 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f3db3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c7a40 con 0x7f43ec1597e0 2023-10-09T11:36:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f2350700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f43ec06c6a0 0x7f43ec06cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50558/0 (socket says 172.21.15.26:50558) 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f2350700 1 -- 172.21.15.26:0/3825715786 learned_addr learned my addr 172.21.15.26:0/3825715786 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f134e700 1 --2- 172.21.15.26:0/3825715786 >> v2:172.21.15.67:3300/0 conn(0x7f43ec06e950 0x7f43ec06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f1b4f700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec1597e0 0x7f43ec159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375675401 0 0) 0x7f43ec06f300 con 0x7f43ec06c6a0 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.158+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003570 con 0x7f43ec06c6a0 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 705662171 0 0) 0x7f43d4003570 con 0x7f43ec06c6a0 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f134e700 1 -- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec1597e0 msgr2=0x7f43ec159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f134e700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec1597e0 0x7f43ec159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f134e700 1 -- 172.21.15.26:0/3825715786 >> v1:172.21.15.26:6789/0 conn(0x7f43ec06c6a0 legacy=0x7f43ec06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f134e700 1 -- 172.21.15.26:0/3825715786 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec06d3d0 con 0x7f43ec06e950 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f134e700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec06e950 0x7f43ec06edc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43e00098e0 tx=0x7f43e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5305b26169eed071 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4001470 con 0x7f43ec06e950 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0011420 con 0x7f43ec06e950 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f0b4d700 1 -- 172.21.15.26:0/3825715786 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00117c0 con 0x7f43ec06e950 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f3db3700 1 -- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec06e950 msgr2=0x7f43ec06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.159+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec06e950 0x7f43ec06edc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43e00098e0 tx=0x7f43e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 -- 172.21.15.26:0/3825715786 shutdown_connections 2023-10-09T11:36:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec1597e0 0x7f43ec159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3825715786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec06e950 0x7f43ec06edc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 -- 172.21.15.26:0/3825715786 >> 172.21.15.26:0/3825715786 conn(0x7f43ec0ccb60 msgr2=0x7f43ec0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 -- 172.21.15.26:0/3825715786 shutdown_connections 2023-10-09T11:36:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.160+0000 7f43f3db3700 1 -- 172.21.15.26:0/3825715786 wait complete. 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 Processor -- start 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 -- start start 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec06e950 0x7f43ec0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 0x7f43ec168d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c6260 con 0x7f43ec06c6a0 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b0cd0 con 0x7f43ec1597e0 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.161+0000 7f43f3db3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c5650 con 0x7f43ec06e950 2023-10-09T11:36:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52212/0 (socket says 172.21.15.26:52212) 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 -- 172.21.15.26:0/3330965251 learned_addr learned my addr 172.21.15.26:0/3330965251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f134e700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec06e950 0x7f43ec0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f2350700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 0x7f43ec168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 -- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec06e950 msgr2=0x7f43ec0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec06e950 0x7f43ec0b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 -- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 msgr2=0x7f43ec168d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 0x7f43ec168d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 -- 172.21.15.26:0/3330965251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009420 con 0x7f43ec06c6a0 2023-10-09T11:36:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f2350700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 0x7f43ec168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f1b4f700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009f40 tx=0x7f43dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00ccd0 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00f040 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec0c5930 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0146b0 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.162+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0c5ef0 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.163+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec04c3c0 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.164+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43dc014a20 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.164+0000 7f43e9ffb700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 0x7f43d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.164+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43dc084d70 con 0x7f43ec06c6a0 2023-10-09T11:36:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.165+0000 7f43f134e700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 0x7f43d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.165+0000 7f43f134e700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 0x7f43d80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0abb40 tx=0x7f43e0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.169+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43dc055a70 con 0x7f43ec06c6a0 2023-10-09T11:36:22.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:22.390+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000210073", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ec0c63a0 con 0x7f43d8066f30 2023-10-09T11:36:24.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:24.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.338+0000 7f43e9ffb700 1 -- 172.21.15.26:0/3330965251 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f43e0011710 con 0x7f43d8066f30 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 msgr2=0x7f43d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 0x7f43d80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0abb40 tx=0x7f43e0016000 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 msgr2=0x7f43ec0c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009f40 tx=0x7f43dc00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 shutdown_connections 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43ec1597e0 0x7f43ec168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ec06c6a0 0x7f43ec0c5070 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f43d8066f30 0x7f43d80693e0 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0abb40 tx=0x7f43e0016000 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 --2- 172.21.15.26:0/3330965251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43ec06e950 0x7f43ec0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.343+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 >> 172.21.15.26:0/3330965251 conn(0x7f43ec0ccb60 msgr2=0x7f43ec0caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.344+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 shutdown_connections 2023-10-09T11:36:25.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.344+0000 7f43f3db3700 1 -- 172.21.15.26:0/3330965251 wait complete. 2023-10-09T11:36:25.348 INFO:teuthology.orchestra.run.smithi026.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T11:36:25.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:36:25.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.488+0000 7f6e99605700 1 Processor -- start 2023-10-09T11:36:25.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.488+0000 7f6e99605700 1 -- start start 2023-10-09T11:36:25.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e99605700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e99605700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e940c7fb0 0x7f6e941563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e99605700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9415a840 con 0x7f6e9406ae50 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e99605700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e94156930 con 0x7f6e940c7fb0 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e99605700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c8520 con 0x7f6e9415acd0 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e937fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e98e04700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e940c7fb0 0x7f6e941563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e937fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:54996/0 (socket says 172.21.15.26:54996) 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e937fe700 1 -- 172.21.15.26:0/2085860882 learned_addr learned my addr 172.21.15.26:0/2085860882 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.489+0000 7f6e93fff700 1 --1- 172.21.15.26:0/2085860882 >> v1:172.21.15.67:6789/0 conn(0x7f6e9406ae50 0x7f6e940c78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53814/0 (socket says 172.21.15.26:53814) 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e98e04700 1 -- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 msgr2=0x7f6e94155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e98e04700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e98e04700 1 -- 172.21.15.26:0/2085860882 >> v1:172.21.15.67:6789/0 conn(0x7f6e9406ae50 legacy=0x7f6e940c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e92ffd700 1 -- 172.21.15.26:0/2085860882 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961646460 0 0) 0x7f6e9415a840 con 0x7f6e9406ae50 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e98e04700 1 -- 172.21.15.26:0/2085860882 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9415a1f0 con 0x7f6e940c7fb0 2023-10-09T11:36:25.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e937fe700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e98e04700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e941563f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009e60 tx=0x7f6e8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc9c6e3331d6ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e92ffd700 1 -- 172.21.15.26:0/2085860882 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00e070 con 0x7f6e940c7fb0 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e92ffd700 1 -- 172.21.15.26:0/2085860882 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c00bb60 con 0x7f6e940c7fb0 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.490+0000 7f6e92ffd700 1 -- 172.21.15.26:0/2085860882 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c012430 con 0x7f6e940c7fb0 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 -- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 msgr2=0x7f6e941563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e941563f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009e60 tx=0x7f6e8c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 -- 172.21.15.26:0/2085860882 shutdown_connections 2023-10-09T11:36:25.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e941563f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 --2- 172.21.15.26:0/2085860882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e94155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 -- 172.21.15.26:0/2085860882 >> 172.21.15.26:0/2085860882 conn(0x7f6e9406e280 msgr2=0x7f6e940cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:25.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 -- 172.21.15.26:0/2085860882 shutdown_connections 2023-10-09T11:36:25.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.491+0000 7f6e99605700 1 -- 172.21.15.26:0/2085860882 wait complete. 2023-10-09T11:36:25.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.492+0000 7f6e99605700 1 Processor -- start 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.492+0000 7f6e99605700 1 -- start start 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e94152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e940c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941688f0 con 0x7f6e9406ae50 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94152570 con 0x7f6e940c7fb0 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e99605700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c5300 con 0x7f6e9415acd0 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52222/0 (socket says 172.21.15.26:52222) 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 -- 172.21.15.26:0/2762556344 learned_addr learned my addr 172.21.15.26:0/2762556344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e98e04700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e940c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e937fe700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e94152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 -- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 msgr2=0x7f6e940c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e940c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 -- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 msgr2=0x7f6e94152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e94152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 -- 172.21.15.26:0/2762556344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840094f0 con 0x7f6e9406ae50 2023-10-09T11:36:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.493+0000 7f6e93fff700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c560 tx=0x7f6e7c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.494+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c005a70 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.494+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c005bd0 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.494+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c009a20 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.494+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0070d0 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.494+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e940c49d0 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.495+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e940c55e0 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.495+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e7c007500 con 0x7f6e9406ae50 2023-10-09T11:36:25.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.496+0000 7f6e8bfff700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 0x7f6e740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.496+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6e7c083bd0 con 0x7f6e9406ae50 2023-10-09T11:36:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.496+0000 7f6e937fe700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 0x7f6e740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.497+0000 7f6e937fe700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 0x7f6e740693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e940c5df0 tx=0x7f6e84009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.500+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e7c050ac0 con 0x7f6e9406ae50 2023-10-09T11:36:25.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.724+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e9404c3c0 con 0x7f6e74066f30 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.726+0000 7f6e8bfff700 1 -- 172.21.15.26:0/2762556344 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f6e9404c3c0 con 0x7f6e74066f30 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:25.727 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000000210073" 2023-10-09T11:36:25.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:25.728 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:36:25.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 msgr2=0x7f6e740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 0x7f6e740693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e940c5df0 tx=0x7f6e84009250 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 msgr2=0x7f6e941683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c560 tx=0x7f6e7c007f60 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 shutdown_connections 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e74066f30 0x7f6e740693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e9415acd0 0x7f6e940c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e9406ae50 0x7f6e941683b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 --2- 172.21.15.26:0/2762556344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e940c7fb0 0x7f6e94152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 >> 172.21.15.26:0/2762556344 conn(0x7f6e9406e280 msgr2=0x7f6e94068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 shutdown_connections 2023-10-09T11:36:25.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.728+0000 7f6e99605700 1 -- 172.21.15.26:0/2762556344 wait complete. 2023-10-09T11:36:25.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-09T11:36:25.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.861+0000 7f7a39d32700 1 Processor -- start 2023-10-09T11:36:25.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.861+0000 7f7a39d32700 1 -- start start 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a39d32700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 0x7f7a340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a39d32700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a3406dc70 0x7f7a34159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a39d32700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340ccfd0 con 0x7f7a3406e0e0 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a39d32700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340cf0e0 con 0x7f7a3406dc70 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a39d32700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3415a3d0 con 0x7f7a34159530 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a33fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a3406e0e0 0x7f7a340cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50572/0 (socket says 172.21.15.26:50572) 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a33fff700 1 -- 172.21.15.26:0/1692786871 learned_addr learned my addr 172.21.15.26:0/1692786871 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:25.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1692786871 >> v2:172.21.15.67:3300/0 conn(0x7f7a3406dc70 0x7f7a34159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a337fe700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 0x7f7a340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a327fc700 1 -- 172.21.15.26:0/1692786871 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488765248 0 0) 0x7f7a340ccfd0 con 0x7f7a3406e0e0 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a327fc700 1 -- 172.21.15.26:0/1692786871 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c003570 con 0x7f7a3406e0e0 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 -- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 msgr2=0x7f7a340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 0x7f7a340ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 -- 172.21.15.26:0/1692786871 >> v1:172.21.15.26:6789/0 conn(0x7f7a3406e0e0 legacy=0x7f7a340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 -- 172.21.15.26:0/1692786871 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3415a6b0 con 0x7f7a3406dc70 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a337fe700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 0x7f7a340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.862+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3406dc70 0x7f7a34159900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098e0 tx=0x7f7a280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633219cfcfb25279 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a327fc700 1 -- 172.21.15.26:0/1692786871 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28011630 con 0x7f7a3406dc70 2023-10-09T11:36:25.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a327fc700 1 -- 172.21.15.26:0/1692786871 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28011790 con 0x7f7a3406dc70 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a327fc700 1 -- 172.21.15.26:0/1692786871 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28011b30 con 0x7f7a3406dc70 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 -- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3406dc70 msgr2=0x7f7a34159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3406dc70 0x7f7a34159900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098e0 tx=0x7f7a280091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 -- 172.21.15.26:0/1692786871 shutdown_connections 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a34159530 0x7f7a340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1692786871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3406dc70 0x7f7a34159900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 -- 172.21.15.26:0/1692786871 >> 172.21.15.26:0/1692786871 conn(0x7f7a340703a0 msgr2=0x7f7a340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 -- 172.21.15.26:0/1692786871 shutdown_connections 2023-10-09T11:36:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.863+0000 7f7a39d32700 1 -- 172.21.15.26:0/1692786871 wait complete. 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.864+0000 7f7a39d32700 1 Processor -- start 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 -- start start 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a3406e0e0 0x7f7a34155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 0x7f7a34157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c9130 con 0x7f7a3406dc70 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a341561a0 con 0x7f7a34159530 2023-10-09T11:36:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a39d32700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340ca9f0 con 0x7f7a3406e0e0 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52224/0 (socket says 172.21.15.26:52224) 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a337fe700 1 -- 172.21.15.26:0/1579253720 learned_addr learned my addr 172.21.15.26:0/1579253720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a33fff700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 0x7f7a34157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.865+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a3406e0e0 0x7f7a34155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 -- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a3406e0e0 msgr2=0x7f7a34155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a3406e0e0 0x7f7a34155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 -- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 msgr2=0x7f7a34157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 0x7f7a34157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 -- 172.21.15.26:0/1579253720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009420 con 0x7f7a3406dc70 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a33fff700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 0x7f7a34157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a337fe700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400ec80 tx=0x7f7a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400c850 con 0x7f7a3406dc70 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400c9b0 con 0x7f7a3406dc70 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a28009420 con 0x7f7a3406dc70 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400cd30 con 0x7f7a3406dc70 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.866+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a340c8ae0 con 0x7f7a3406dc70 2023-10-09T11:36:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.867+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a340c9410 con 0x7f7a3406dc70 2023-10-09T11:36:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.868+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a24013680 con 0x7f7a3406dc70 2023-10-09T11:36:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.868+0000 7f7a1b7fe700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.868+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7a24084ec0 con 0x7f7a3406dc70 2023-10-09T11:36:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.868+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.869+0000 7f7a32ffd700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 0x7f7a200693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a280091e0 tx=0x7f7a28017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:25.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:25.872+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a240557a0 con 0x7f7a3406dc70 2023-10-09T11:36:26.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.065+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f7a3404c3c0 con 0x7f7a3406dc70 2023-10-09T11:36:26.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.065+0000 7f7a1b7fe700 1 -- 172.21.15.26:0/1579253720 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f7a240170a0 con 0x7f7a3406dc70 2023-10-09T11:36:26.067 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 msgr2=0x7f7a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 0x7f7a200693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a280091e0 tx=0x7f7a28017000 comp rx=0 tx=0).stop 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 msgr2=0x7f7a340ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400ec80 tx=0x7f7a240091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 shutdown_connections 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a34159530 0x7f7a34157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a3406dc70 0x7f7a340ca360 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 --2- 172.21.15.26:0/1579253720 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a3406e0e0 0x7f7a34155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 >> 172.21.15.26:0/1579253720 conn(0x7f7a340703a0 msgr2=0x7f7a340b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 shutdown_connections 2023-10-09T11:36:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.067+0000 7f7a39d32700 1 -- 172.21.15.26:0/1579253720 wait complete. 2023-10-09T11:36:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000210073.meta","create_time":"2023-10-09T11:36:22.423196+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000210073"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000210073.data","create_time":"2023-10-09T11:36:23.358910+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000210073"}}}] 2023-10-09T11:36:26.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000210073 --format=json 2023-10-09T11:36:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.199+0000 7fa5195b0700 1 Processor -- start 2023-10-09T11:36:26.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.199+0000 7fa5195b0700 1 -- start start 2023-10-09T11:36:26.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5195b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa514153c30 0x7fa51415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5195b0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa51415de50 0x7fa5140cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5195b0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51415afd0 con 0x7fa5140cef40 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5195b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51415b2b0 con 0x7fa514153c30 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5195b0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51415b590 con 0x7fa51415de50 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa514153c30 0x7fa51415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa514153c30 0x7fa51415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52236/0 (socket says 172.21.15.26:52236) 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 -- 172.21.15.26:0/385213037 learned_addr learned my addr 172.21.15.26:0/385213037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa5137fe700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa51415de50 0x7fa5140cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 -- 172.21.15.26:0/385213037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa51415de50 msgr2=0x7fa5140cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa51415de50 0x7fa5140cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 -- 172.21.15.26:0/385213037 >> v1:172.21.15.67:6789/0 conn(0x7fa5140cef40 legacy=0x7fa51406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.200+0000 7fa513fff700 1 -- 172.21.15.26:0/385213037 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51415b870 con 0x7fa514153c30 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa513fff700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa514153c30 0x7fa51415a5e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0099b0 tx=0x7fa4fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb97a3ceb2b3fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa512ffd700 1 -- 172.21.15.26:0/385213037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00b860 con 0x7fa514153c30 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa512ffd700 1 -- 172.21.15.26:0/385213037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00b9c0 con 0x7fa514153c30 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa512ffd700 1 -- 172.21.15.26:0/385213037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00bd60 con 0x7fa514153c30 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 -- 172.21.15.26:0/385213037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa514153c30 msgr2=0x7fa51415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa514153c30 0x7fa51415a5e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0099b0 tx=0x7fa4fc009250 comp rx=0 tx=0).stop 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 -- 172.21.15.26:0/385213037 shutdown_connections 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa514153c30 0x7fa51415a5e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 --2- 172.21.15.26:0/385213037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa51415de50 0x7fa5140cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 -- 172.21.15.26:0/385213037 >> 172.21.15.26:0/385213037 conn(0x7fa5140703a0 msgr2=0x7fa5140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 -- 172.21.15.26:0/385213037 shutdown_connections 2023-10-09T11:36:26.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.201+0000 7fa5195b0700 1 -- 172.21.15.26:0/385213037 wait complete. 2023-10-09T11:36:26.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.202+0000 7fa5195b0700 1 Processor -- start 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 -- start start 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa514153c30 0x7fa514169bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa51415de50 0x7fa514144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140c85d0 con 0x7fa5140cef40 2023-10-09T11:36:26.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140c79c0 con 0x7fa51415de50 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa5195b0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140c7ca0 con 0x7fa514153c30 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa513fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa513fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52250/0 (socket says 172.21.15.26:52250) 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.203+0000 7fa513fff700 1 -- 172.21.15.26:0/2535119346 learned_addr learned my addr 172.21.15.26:0/2535119346 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa5137fe700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa514153c30 0x7fa514169bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa518daf700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa51415de50 0x7fa514144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 -- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa514153c30 msgr2=0x7fa514169bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa514153c30 0x7fa514169bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 -- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa51415de50 msgr2=0x7fa514144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa51415de50 0x7fa514144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 -- 172.21.15.26:0/2535119346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0094f0 con 0x7fa5140cef40 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa513fff700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa51406eb00 tx=0x7fa4fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc011e40 con 0x7fa5140cef40 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc024440 con 0x7fa5140cef40 2023-10-09T11:36:26.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140c7f80 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc024800 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.204+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51416a110 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.205+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51404c3c0 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.206+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4fc01a420 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.206+0000 7fa50bfff700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 0x7fa4f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.206+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa4fc086790 con 0x7fa5140cef40 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.206+0000 7fa5137fe700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 0x7fa4f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.207+0000 7fa5137fe700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 0x7fa4f40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b55c0 tx=0x7fa504008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.210+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4fc053680 con 0x7fa5140cef40 2023-10-09T11:36:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.452+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000210073", "format": "json"} v 0) v1 -- 0x7fa5140caef0 con 0x7fa5140cef40 2023-10-09T11:36:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.453+0000 7fa50bfff700 1 -- 172.21.15.26:0/2535119346 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000210073", "format": "json"}]=0 v20) v1 ==== 110+0+1844 (secure 0 0 0) 0x7fa4fc056ca0 con 0x7fa5140cef40 2023-10-09T11:36:26.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:26.454 INFO:teuthology.orchestra.run.smithi026.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:24.334599+0000","modified":"2023-10-09T11:36:26.330207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.26:6834/3752557440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3752557440},{"type":"v1","addr":"172.21.15.26:6834","nonce":3752557440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000210073","balancer":"","standby_count_wanted":1},"id":3} 2023-10-09T11:36:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 msgr2=0x7fa4f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 0x7fa4f40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b55c0 tx=0x7fa504008040 comp rx=0 tx=0).stop 2023-10-09T11:36:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 msgr2=0x7fa5140ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa51406eb00 tx=0x7fa4fc017000 comp rx=0 tx=0).stop 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 shutdown_connections 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa51415de50 0x7fa514144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5140cef40 0x7fa5140ca010 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4f4066f30 0x7fa4f40693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 --2- 172.21.15.26:0/2535119346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa514153c30 0x7fa514169bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 >> 172.21.15.26:0/2535119346 conn(0x7fa5140703a0 msgr2=0x7fa514152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 shutdown_connections 2023-10-09T11:36:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.455+0000 7fa5195b0700 1 -- 172.21.15.26:0/2535119346 wait complete. 2023-10-09T11:36:26.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000210073 --yes-i-really-mean-it 2023-10-09T11:36:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.591+0000 7f0792bef700 1 Processor -- start 2023-10-09T11:36:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.591+0000 7f0792bef700 1 -- start start 2023-10-09T11:36:26.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.591+0000 7f0792bef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f078c1598c0 0x7f078c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.591+0000 7f0792bef700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f078c0cdb70 0x7f078c0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.591+0000 7f0792bef700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0c9310 con 0x7f078c159c90 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f0792bef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c0ad990 con 0x7f078c1598c0 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f0792bef700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c0ce090 con 0x7f078c0cdb70 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f078c1598c0 0x7f078c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f078c159c90 0x7f078c0cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50586/0 (socket says 172.21.15.26:50586) 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078bfff700 1 -- 172.21.15.26:0/796873188 learned_addr learned my addr 172.21.15.26:0/796873188 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079118c700 1 --2- 172.21.15.26:0/796873188 >> v2:172.21.15.67:3300/0 conn(0x7f078c0cdb70 0x7f078c0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078b7fe700 1 -- 172.21.15.26:0/796873188 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14055445 0 0) 0x7f078c0c9310 con 0x7f078c159c90 2023-10-09T11:36:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078b7fe700 1 -- 172.21.15.26:0/796873188 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0778003570 con 0x7f078c159c90 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 -- 172.21.15.26:0/796873188 >> v2:172.21.15.67:3300/0 conn(0x7f078c0cdb70 msgr2=0x7f078c0c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 --2- 172.21.15.26:0/796873188 >> v2:172.21.15.67:3300/0 conn(0x7f078c0cdb70 0x7f078c0c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 -- 172.21.15.26:0/796873188 >> v1:172.21.15.26:6789/0 conn(0x7f078c159c90 legacy=0x7f078c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 -- 172.21.15.26:0/796873188 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0c8cc0 con 0x7f078c1598c0 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f079098b700 1 --2- 172.21.15.26:0/796873188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c0c3e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad580 tx=0x7f07740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63bd5c90bb51357 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078b7fe700 1 -- 172.21.15.26:0/796873188 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011630 con 0x7f078c1598c0 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078b7fe700 1 -- 172.21.15.26:0/796873188 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740117b0 con 0x7f078c1598c0 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.592+0000 7f078b7fe700 1 -- 172.21.15.26:0/796873188 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011b70 con 0x7f078c1598c0 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 -- 172.21.15.26:0/796873188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 msgr2=0x7f078c0c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 --2- 172.21.15.26:0/796873188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c0c3e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad580 tx=0x7f07740091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 -- 172.21.15.26:0/796873188 shutdown_connections 2023-10-09T11:36:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 --2- 172.21.15.26:0/796873188 >> v2:172.21.15.67:3300/0 conn(0x7f078c0cdb70 0x7f078c0c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 --2- 172.21.15.26:0/796873188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c0c3e70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 -- 172.21.15.26:0/796873188 >> 172.21.15.26:0/796873188 conn(0x7f078c088000 msgr2=0x7f078c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 -- 172.21.15.26:0/796873188 shutdown_connections 2023-10-09T11:36:26.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.593+0000 7f0792bef700 1 -- 172.21.15.26:0/796873188 wait complete. 2023-10-09T11:36:26.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.594+0000 7f0792bef700 1 Processor -- start 2023-10-09T11:36:26.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.594+0000 7f0792bef700 1 -- start start 2023-10-09T11:36:26.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 0x7f078c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f078c159c90 0x7f078c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c16d7b0 con 0x7f078c1598c0 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c16da90 con 0x7f078c0cdb70 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f0792bef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c16dd70 con 0x7f078c159c90 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52260/0 (socket says 172.21.15.26:52260) 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 -- 172.21.15.26:0/3078828740 learned_addr learned my addr 172.21.15.26:0/3078828740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f079098b700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 0x7f078c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f079118c700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f078c159c90 0x7f078c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 -- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f078c159c90 msgr2=0x7f078c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f078c159c90 0x7f078c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 -- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 msgr2=0x7f078c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 0x7f078c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f078bfff700 1 -- 172.21.15.26:0/3078828740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009420 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.595+0000 7f079098b700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 0x7f078c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f078bfff700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c7c0 tx=0x7f077c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c005b30 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c005c90 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c007340 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c0b1340 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.596+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c154a80 con 0x7f078c1598c0 2023-10-09T11:36:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.597+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c0b1860 con 0x7f078c1598c0 2023-10-09T11:36:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.597+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f077c01b400 con 0x7f078c1598c0 2023-10-09T11:36:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.598+0000 7f0788ff9700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.598+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f077c0843c0 con 0x7f078c1598c0 2023-10-09T11:36:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.598+0000 7f079098b700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.598+0000 7f079098b700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad580 tx=0x7f0774017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.602+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f078c0b1860 con 0x7f078c1598c0 2023-10-09T11:36:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:26.825+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000210073", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f078c0b1860 con 0x7f076c066f30 2023-10-09T11:36:26.831 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:36:26.830+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:36:26.856 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:36:29.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.852+0000 7f0788ff9700 1 -- 172.21.15.26:0/3078828740 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f078c0b1860 con 0x7f076c066f30 2023-10-09T11:36:29.854 INFO:teuthology.orchestra.run.smithi026.stdout:metadata pool: cephfs.volume_0000000000210073.meta data pool: ['cephfs.volume_0000000000210073.data'] removed 2023-10-09T11:36:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 msgr2=0x7f076c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad580 tx=0x7f0774017000 comp rx=0 tx=0).stop 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 msgr2=0x7f078c16cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c7c0 tx=0x7f077c007e00 comp rx=0 tx=0).stop 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 shutdown_connections 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f078c159c90 0x7f078c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0cdb70 0x7f078c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 --2- 172.21.15.26:0/3078828740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078c1598c0 0x7f078c16cf60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 >> 172.21.15.26:0/3078828740 conn(0x7f078c088000 msgr2=0x7f078c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:29.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 shutdown_connections 2023-10-09T11:36:29.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:29.855+0000 7f0792bef700 1 -- 172.21.15.26:0/3078828740 wait complete. 2023-10-09T11:36:29.870 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:36:29.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:29.910 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:29.954 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:36:29.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:36:29.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:29.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:30.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:36:30.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.007 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:36:30.023 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:36:30.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:30.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:30.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:36:30.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.072 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:36:30.088 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.210+0000 7fb2aa396700 1 Processor -- start 2023-10-09T11:36:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.210+0000 7fb2aa396700 1 -- start start 2023-10-09T11:36:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2aa396700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb2a4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2aa396700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a415ae40 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2aa396700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a415ab60 con 0x7fb2a40cb970 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2aa396700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40ce0f0 con 0x7fb2a415a5d0 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2a3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb2a40cb5a0 0x7fb2a40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49372/0 (socket says 172.21.15.26:49372) 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.211+0000 7fb2a3fff700 1 -- 172.21.15.26:0/3127639376 learned_addr learned my addr 172.21.15.26:0/3127639376 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165725562 0 0) 0x7fb2a415ae40 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a8933700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb2a4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb28c003570 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559031998 0 0) 0x7fb28c003570 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 msgr2=0x7fb2a4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb2a4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 >> v1:172.21.15.67:6789/0 conn(0x7fb2a40cb970 legacy=0x7fb2a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40ccf00 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb294001470 con 0x7fb2a40cb5a0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 >> v1:172.21.15.26:6789/0 conn(0x7fb2a40cb5a0 legacy=0x7fb2a40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb28c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28c0040c0 0x7fb28c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c004da0 0x7fb28c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40ce0f0 con 0x7fb28c0040c0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c00bc70 con 0x7fb28c004da0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c00be30 con 0x7fb2a415a5d0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28c0040c0 0x7fb28c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a3fff700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb28c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a8933700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c004da0 0x7fb28c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 -- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 msgr2=0x7fb28c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a415a5d0 0x7fb28c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 -- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c004da0 msgr2=0x7fb28c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c004da0 0x7fb28c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.212+0000 7fb2a37fe700 1 -- 172.21.15.26:0/3127639376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c003570 con 0x7fb28c0040c0 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2a37fe700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28c0040c0 0x7fb28c004810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb2980018b0 tx=0x7fb298007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a90c4a3a27adb70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298012420 con 0x7fb28c0040c0 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb298012580 con 0x7fb28c0040c0 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2a2ffd700 1 -- 172.21.15.26:0/3127639376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298012920 con 0x7fb28c0040c0 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 -- 172.21.15.26:0/3127639376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28c0040c0 msgr2=0x7fb28c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 --2- 172.21.15.26:0/3127639376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28c0040c0 0x7fb28c004810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb2980018b0 tx=0x7fb298007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2a8933700 1 -- 172.21.15.26:0/3127639376 reap_dead start 2023-10-09T11:36:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 -- 172.21.15.26:0/3127639376 shutdown_connections 2023-10-09T11:36:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 -- 172.21.15.26:0/3127639376 >> 172.21.15.26:0/3127639376 conn(0x7fb2a4070e30 msgr2=0x7fb2a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 -- 172.21.15.26:0/3127639376 shutdown_connections 2023-10-09T11:36:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.213+0000 7fb2aa396700 1 -- 172.21.15.26:0/3127639376 wait complete. 2023-10-09T11:36:30.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.214+0000 7fb2aa396700 1 Processor -- start 2023-10-09T11:36:30.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 -- start start 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c0040c0 0x7fb2a4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a40ca390 0x7fb2a416a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4155e10 con 0x7fb2a40b4900 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b52c0 con 0x7fb28c0040c0 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2aa396700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c9f00 con 0x7fb2a40ca390 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2a8933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2a8933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58990/0 (socket says 172.21.15.26:58990) 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.215+0000 7fb2a8933700 1 -- 172.21.15.26:0/1935187777 learned_addr learned my addr 172.21.15.26:0/1935187777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a37fe700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a40ca390 0x7fb2a416a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a3fff700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c0040c0 0x7fb2a4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 -- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a40ca390 msgr2=0x7fb2a416a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a40ca390 0x7fb2a416a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 -- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c0040c0 msgr2=0x7fb2a4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c0040c0 0x7fb2a4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 -- 172.21.15.26:0/1935187777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a41589a0 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2a8933700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4064ad0 tx=0x7fb29c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c002cd0 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c002e30 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a416ae30 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c015670 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.216+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40c9650 con 0x7fb2a40b4900 2023-10-09T11:36:30.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.217+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a40ca090 con 0x7fb2a40b4900 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.218+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb29c003040 con 0x7fb2a40b4900 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.218+0000 7fb28bfff700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.218+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb29c084e40 con 0x7fb2a40b4900 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.218+0000 7fb2a3fff700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.219+0000 7fb2a3fff700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 0x7fb2900693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40af940 tx=0x7fb294001e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.223+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb29c052060 con 0x7fb2a40b4900 2023-10-09T11:36:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.468+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2a404c3c0 con 0x7fb2a40b4900 2023-10-09T11:36:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.469+0000 7fb28bfff700 1 -- 172.21.15.26:0/1935187777 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fb29c055680 con 0x7fb2a40b4900 2023-10-09T11:36:30.470 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:30.470 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/890752364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":890752364},{"type":"v1","addr":"172.21.15.26:6834","nonce":890752364}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.470+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 msgr2=0x7fb2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.470+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 0x7fb2900693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40af940 tx=0x7fb294001e50 comp rx=0 tx=0).stop 2023-10-09T11:36:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.470+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 msgr2=0x7fb2a40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.470+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4064ad0 tx=0x7fb29c009710 comp rx=0 tx=0).stop 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 shutdown_connections 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a40b4900 0x7fb2a40b4d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb28c0040c0 0x7fb2a4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 --2- 172.21.15.26:0/1935187777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2a40ca390 0x7fb2a416a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 >> 172.21.15.26:0/1935187777 conn(0x7fb2a4070e30 msgr2=0x7fb2a40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 shutdown_connections 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.471+0000 7fb2aa396700 1 -- 172.21.15.26:0/1935187777 wait complete. 2023-10-09T11:36:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 22 2023-10-09T11:36:30.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.602+0000 7f51c3bce700 1 Processor -- start 2023-10-09T11:36:30.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.602+0000 7f51c3bce700 1 -- start start 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc1598b0 0x7f51bc0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51bc159c80 0x7f51bc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc0af790 0x7f51bc0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0ce9d0 con 0x7f51bc1598b0 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0afc30 con 0x7f51bc159c80 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c3bce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0aff10 con 0x7f51bc0af790 2023-10-09T11:36:30.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c196a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc1598b0 0x7f51bc0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c196a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc1598b0 0x7f51bc0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58994/0 (socket says 172.21.15.26:58994) 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.603+0000 7f51c196a700 1 -- 172.21.15.26:0/3734734663 learned_addr learned my addr 172.21.15.26:0/3734734663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c216b700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc0af790 0x7f51bc0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c1169700 1 --2- 172.21.15.26:0/3734734663 >> v2:172.21.15.67:3300/0 conn(0x7f51bc159c80 0x7f51bc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 -- 172.21.15.26:0/3734734663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc0af790 msgr2=0x7f51bc0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc0af790 0x7f51bc0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 -- 172.21.15.26:0/3734734663 >> v2:172.21.15.67:3300/0 conn(0x7f51bc159c80 msgr2=0x7f51bc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 --2- 172.21.15.26:0/3734734663 >> v2:172.21.15.67:3300/0 conn(0x7f51bc159c80 0x7f51bc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 -- 172.21.15.26:0/3734734663 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0ce380 con 0x7f51bc1598b0 2023-10-09T11:36:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c196a700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc0af250 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0642b0 tx=0x7f51b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227fa2894911bd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c0968700 1 -- 172.21.15.26:0/3734734663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400b860 con 0x7f51bc1598b0 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c0968700 1 -- 172.21.15.26:0/3734734663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b400b9c0 con 0x7f51bc1598b0 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c0968700 1 -- 172.21.15.26:0/3734734663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400bd60 con 0x7f51bc1598b0 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 -- 172.21.15.26:0/3734734663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 msgr2=0x7f51bc0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc0af250 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0642b0 tx=0x7f51b4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 -- 172.21.15.26:0/3734734663 shutdown_connections 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc0af790 0x7f51bc0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 --2- 172.21.15.26:0/3734734663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc0af250 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 --2- 172.21.15.26:0/3734734663 >> v2:172.21.15.67:3300/0 conn(0x7f51bc159c80 0x7f51bc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.604+0000 7f51c3bce700 1 -- 172.21.15.26:0/3734734663 >> 172.21.15.26:0/3734734663 conn(0x7f51bc070e30 msgr2=0x7f51bc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.605+0000 7f51c3bce700 1 -- 172.21.15.26:0/3734734663 shutdown_connections 2023-10-09T11:36:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.605+0000 7f51c3bce700 1 -- 172.21.15.26:0/3734734663 wait complete. 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 Processor -- start 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 -- start start 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 0x7f51bc15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc159c80 0x7f51bc15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15ec30 con 0x7f51bc1598b0 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15ef10 con 0x7f51bc0af790 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.606+0000 7f51c3bce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15f1f0 con 0x7f51bc159c80 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59000/0 (socket says 172.21.15.26:59000) 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 -- 172.21.15.26:0/2848964662 learned_addr learned my addr 172.21.15.26:0/2848964662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c196a700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 0x7f51bc15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 -- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc159c80 msgr2=0x7f51bc15b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c216b700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc159c80 0x7f51bc15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc159c80 0x7f51bc15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 -- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 msgr2=0x7f51bc15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 0x7f51bc15fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 -- 172.21.15.26:0/2848964662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40094f0 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c196a700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 0x7f51bc15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c1169700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d860 tx=0x7f51b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0009610 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0009770 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc15f4d0 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0009b30 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.607+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc15b590 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.608+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc15fb20 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.609+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51b001e460 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.609+0000 7f51b9ffb700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.609+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f51b0084ba0 con 0x7f51bc1598b0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.609+0000 7f51c196a700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.610+0000 7f51c196a700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0642b0 tx=0x7f51b4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.613+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51b0051dc0 con 0x7f51bc1598b0 2023-10-09T11:36:30.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.808+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51bc04c3c0 con 0x7f51bc1598b0 2023-10-09T11:36:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.809+0000 7f51b9ffb700 1 -- 172.21.15.26:0/2848964662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7f51b00553e0 con 0x7f51bc1598b0 2023-10-09T11:36:30.810 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:30.810 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:29.838907+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/3752557440":"2023-10-10T11:36:26.831410+0000","172.21.15.26:6832/3752557440":"2023-10-10T11:36:26.831410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.810+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 msgr2=0x7f51a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.810+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0642b0 tx=0x7f51b4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.810+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 msgr2=0x7f51bc15ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.810+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d860 tx=0x7f51b0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 shutdown_connections 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51bc159c80 0x7f51bc15b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51bc0af790 0x7f51bc15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 --2- 172.21.15.26:0/2848964662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc1598b0 0x7f51bc15ab10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 >> 172.21.15.26:0/2848964662 conn(0x7f51bc070e30 msgr2=0x7f51bc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 shutdown_connections 2023-10-09T11:36:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.811+0000 7f51c3bce700 1 -- 172.21.15.26:0/2848964662 wait complete. 2023-10-09T11:36:30.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:05.599607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:06.642071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:30.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.945+0000 7f572d794700 1 Processor -- start 2023-10-09T11:36:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.945+0000 7f572d794700 1 -- start start 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f572d794700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5728159530 0x7f57280ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f572d794700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f572806dc70 0x7f5728159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f572d794700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280ccfd0 con 0x7f572806e0e0 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f572d794700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280cf0e0 con 0x7f572806dc70 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f572d794700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572815a3d0 con 0x7f5728159530 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f57267fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f572806dc70 0x7f5728159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f57267fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f572806dc70 0x7f5728159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59010/0 (socket says 172.21.15.26:59010) 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f57267fc700 1 -- 172.21.15.26:0/747653081 learned_addr learned my addr 172.21.15.26:0/747653081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.946+0000 7f5726ffd700 1 --2- 172.21.15.26:0/747653081 >> v2:172.21.15.67:3300/0 conn(0x7f5728159530 0x7f57280ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f57267fc700 1 -- 172.21.15.26:0/747653081 >> v2:172.21.15.67:3300/0 conn(0x7f5728159530 msgr2=0x7f57280ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f57267fc700 1 --2- 172.21.15.26:0/747653081 >> v2:172.21.15.67:3300/0 conn(0x7f5728159530 0x7f57280ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f57267fc700 1 -- 172.21.15.26:0/747653081 >> v1:172.21.15.67:6789/0 conn(0x7f572806e0e0 legacy=0x7f57280cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f57267fc700 1 -- 172.21.15.26:0/747653081 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572815a6b0 con 0x7f572806dc70 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f57267fc700 1 --2- 172.21.15.26:0/747653081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572806dc70 0x7f5728159900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f572806d630 tx=0x7f5710009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a17815511fc4b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f5725ffb700 1 -- 172.21.15.26:0/747653081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000b820 con 0x7f572806dc70 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f5725ffb700 1 -- 172.21.15.26:0/747653081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000b980 con 0x7f572806dc70 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f5725ffb700 1 -- 172.21.15.26:0/747653081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000bd20 con 0x7f572806dc70 2023-10-09T11:36:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 -- 172.21.15.26:0/747653081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572806dc70 msgr2=0x7f5728159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 --2- 172.21.15.26:0/747653081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572806dc70 0x7f5728159900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f572806d630 tx=0x7f5710009250 comp rx=0 tx=0).stop 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 -- 172.21.15.26:0/747653081 shutdown_connections 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 --2- 172.21.15.26:0/747653081 >> v2:172.21.15.67:3300/0 conn(0x7f5728159530 0x7f57280ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 --2- 172.21.15.26:0/747653081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572806dc70 0x7f5728159900 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.947+0000 7f572d794700 1 -- 172.21.15.26:0/747653081 >> 172.21.15.26:0/747653081 conn(0x7f57280703a0 msgr2=0x7f57280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.948+0000 7f572d794700 1 -- 172.21.15.26:0/747653081 shutdown_connections 2023-10-09T11:36:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.948+0000 7f572d794700 1 -- 172.21.15.26:0/747653081 wait complete. 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 Processor -- start 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 -- start start 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f572806dc70 0x7f57280ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f572806e0e0 0x7f57280cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280ca680 con 0x7f5728159530 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.949+0000 7f572d794700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280b37e0 con 0x7f572806dc70 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f572d794700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572816b210 con 0x7f572806e0e0 2023-10-09T11:36:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59020/0 (socket says 172.21.15.26:59020) 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f5726ffd700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f572806dc70 0x7f57280ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 -- 172.21.15.26:0/2814198646 learned_addr learned my addr 172.21.15.26:0/2814198646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57267fc700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f572806e0e0 0x7f57280cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 -- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f572806e0e0 msgr2=0x7f57280cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f572806e0e0 0x7f57280cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 -- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f572806dc70 msgr2=0x7f57280ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f572806dc70 0x7f57280ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 -- 172.21.15.26:0/2814198646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100094f0 con 0x7f5728159530 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f57277fe700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f572000c5b0 tx=0x7f5720007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720011590 con 0x7f5728159530 2023-10-09T11:36:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720011710 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57280b5b80 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720011ad0 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.950+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280b6140 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.951+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572816b430 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.952+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f572001c460 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.952+0000 7f571effd700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 0x7f57080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.952+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f57200840c0 con 0x7f5728159530 2023-10-09T11:36:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.952+0000 7f5726ffd700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 0x7f57080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.953+0000 7f5726ffd700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 0x7f57080693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f57180075a0 tx=0x7f57180097e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:30.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:30.957+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f572816b430 con 0x7f5728159530 2023-10-09T11:36:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.149+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57280b6360 con 0x7f5728159530 2023-10-09T11:36:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.149+0000 7f571effd700 1 -- 172.21.15.26:0/2814198646 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57200512e0 con 0x7f5728159530 2023-10-09T11:36:31.151 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:36:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 msgr2=0x7f57080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 0x7f57080693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f57180075a0 tx=0x7f57180097e0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 msgr2=0x7f57280cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f572000c5b0 tx=0x7f5720007f60 comp rx=0 tx=0).stop 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 shutdown_connections 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5728159530 0x7f57280cba20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f572806dc70 0x7f57280ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5708066f30 0x7f57080693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 --2- 172.21.15.26:0/2814198646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f572806e0e0 0x7f57280cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 >> 172.21.15.26:0/2814198646 conn(0x7f57280703a0 msgr2=0x7f5728070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 shutdown_connections 2023-10-09T11:36:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.151+0000 7f572d794700 1 -- 172.21.15.26:0/2814198646 wait complete. 2023-10-09T11:36:31.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.287+0000 7f52cb47f700 1 Processor -- start 2023-10-09T11:36:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.287+0000 7f52cb47f700 1 -- start start 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cb47f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 0x7f52c415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cb47f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c415ac50 con 0x7f52c40cea00 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cb47f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c415d010 con 0x7f52c4153a00 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cb47f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c415af60 con 0x7f52c4153dd0 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cac7e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f52c40cea00 0x7f52c40cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49382/0 (socket says 172.21.15.26:49382) 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52cac7e700 1 -- 172.21.15.26:0/2286693668 learned_addr learned my addr 172.21.15.26:0/2286693668 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c9c7c700 1 --2- 172.21.15.26:0/2286693668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 0x7f52c415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397776175 0 0) 0x7f52c415ac50 con 0x7f52c40cea00 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003570 con 0x7f52c40cea00 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c9c7c700 1 -- 172.21.15.26:0/2286693668 >> v1:172.21.15.67:6789/0 conn(0x7f52c4153a00 legacy=0x7f52c415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 618980919 0 0) 0x7f52ac003570 con 0x7f52c40cea00 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c9c7c700 1 -- 172.21.15.26:0/2286693668 >> v1:172.21.15.26:6789/0 conn(0x7f52c40cea00 legacy=0x7f52c40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c9c7c700 1 -- 172.21.15.26:0/2286693668 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c415b240 con 0x7f52c4153dd0 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.288+0000 7f52c9c7c700 1 --2- 172.21.15.26:0/2286693668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 0x7f52c415de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009910 tx=0x7f52b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e001a40c976f8906 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0017f0 con 0x7f52c4153dd0 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011420 con 0x7f52c4153dd0 2023-10-09T11:36:31.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52c947b700 1 -- 172.21.15.26:0/2286693668 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80117a0 con 0x7f52c4153dd0 2023-10-09T11:36:31.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 -- 172.21.15.26:0/2286693668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 msgr2=0x7f52c415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 --2- 172.21.15.26:0/2286693668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 0x7f52c415de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009910 tx=0x7f52b80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 -- 172.21.15.26:0/2286693668 shutdown_connections 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 --2- 172.21.15.26:0/2286693668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153dd0 0x7f52c415de50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 -- 172.21.15.26:0/2286693668 >> 172.21.15.26:0/2286693668 conn(0x7f52c40703a0 msgr2=0x7f52c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 -- 172.21.15.26:0/2286693668 shutdown_connections 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.289+0000 7f52cb47f700 1 -- 172.21.15.26:0/2286693668 wait complete. 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.290+0000 7f52cb47f700 1 Processor -- start 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.290+0000 7f52cb47f700 1 -- start start 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c40cea00 0x7f52c41470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153a00 0x7f52c40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c8180 con 0x7f52c4153dd0 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c9f70 con 0x7f52c40cea00 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cb47f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40ca250 con 0x7f52c4153a00 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cac7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cac7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59030/0 (socket says 172.21.15.26:59030) 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52cac7e700 1 -- 172.21.15.26:0/460483038 learned_addr learned my addr 172.21.15.26:0/460483038 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52c9c7c700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153a00 0x7f52c40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.291+0000 7f52ca47d700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c40cea00 0x7f52c41470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 -- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153a00 msgr2=0x7f52c40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153a00 0x7f52c40ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 -- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c40cea00 msgr2=0x7f52c41470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c40cea00 0x7f52c41470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 -- 172.21.15.26:0/460483038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009420 con 0x7f52c4153dd0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cac7e700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00cc10 tx=0x7f52bc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc004dc0 con 0x7f52c4153dd0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00a590 con 0x7f52c4153dd0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c40c7b30 con 0x7f52c4153dd0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00a950 con 0x7f52c4153dd0 2023-10-09T11:36:31.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.292+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c40c9b50 con 0x7f52c4153dd0 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.293+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c40c82f0 con 0x7f52c4153dd0 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.293+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52bc00ad00 con 0x7f52c4153dd0 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.294+0000 7f52c27fc700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.294+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f52bc083bc0 con 0x7f52c4153dd0 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.294+0000 7f52ca47d700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.294+0000 7f52ca47d700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52b4003b20 tx=0x7f52b4007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.298+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52bc050de0 con 0x7f52c4153dd0 2023-10-09T11:36:31.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.491+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52c404c3c0 con 0x7f52c4153dd0 2023-10-09T11:36:31.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.491+0000 7f52c27fc700 1 -- 172.21.15.26:0/460483038 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52bc0180a0 con 0x7f52c4153dd0 2023-10-09T11:36:31.493 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 msgr2=0x7f52b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52b4003b20 tx=0x7f52b4007de0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 msgr2=0x7f52c4155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00cc10 tx=0x7f52bc007c70 comp rx=0 tx=0).stop 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 shutdown_connections 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52c4153dd0 0x7f52c4155820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52c40cea00 0x7f52c41470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 --2- 172.21.15.26:0/460483038 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52c4153a00 0x7f52c40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 >> 172.21.15.26:0/460483038 conn(0x7f52c40703a0 msgr2=0x7f52c4153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 shutdown_connections 2023-10-09T11:36:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.493+0000 7f52cb47f700 1 -- 172.21.15.26:0/460483038 wait complete. 2023-10-09T11:36:31.506 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:31.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.627+0000 7f0a3d664700 1 Processor -- start 2023-10-09T11:36:31.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.627+0000 7f0a3d664700 1 -- start start 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.627+0000 7f0a3d664700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.627+0000 7f0a3d664700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a3806dc70 0x7f0a38159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.627+0000 7f0a3d664700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380ccfd0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a3d664700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380cf0e0 con 0x7f0a3806dc70 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a3d664700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815a3d0 con 0x7f0a38159530 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a377fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0a3806e0e0 0x7f0a380cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49390/0 (socket says 172.21.15.26:49390) 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a377fe700 1 -- 172.21.15.26:0/3883795106 learned_addr learned my addr 172.21.15.26:0/3883795106 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/3883795106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a367fc700 1 --2- 172.21.15.26:0/3883795106 >> v2:172.21.15.67:3300/0 conn(0x7f0a3806dc70 0x7f0a38159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632525086 0 0) 0x7f0a380ccfd0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a24003570 con 0x7f0a3806e0e0 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468641892 0 0) 0x7f0a24003570 con 0x7f0a3806e0e0 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 -- 172.21.15.26:0/3883795106 >> v2:172.21.15.67:3300/0 conn(0x7f0a3806dc70 msgr2=0x7f0a38159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/3883795106 >> v2:172.21.15.67:3300/0 conn(0x7f0a3806dc70 0x7f0a38159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 -- 172.21.15.26:0/3883795106 >> v1:172.21.15.26:6789/0 conn(0x7f0a3806e0e0 legacy=0x7f0a380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 -- 172.21.15.26:0/3883795106 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3815a6b0 con 0x7f0a38159530 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.628+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/3883795106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ceba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a280098e0 tx=0x7f0a280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580e635150fccafb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011630 con 0x7f0a38159530 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28011790 con 0x7f0a38159530 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a35ffb700 1 -- 172.21.15.26:0/3883795106 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011b10 con 0x7f0a38159530 2023-10-09T11:36:31.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 -- 172.21.15.26:0/3883795106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 msgr2=0x7f0a380ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 --2- 172.21.15.26:0/3883795106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ceba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a280098e0 tx=0x7f0a280091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 -- 172.21.15.26:0/3883795106 shutdown_connections 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 --2- 172.21.15.26:0/3883795106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ceba0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 --2- 172.21.15.26:0/3883795106 >> v2:172.21.15.67:3300/0 conn(0x7f0a3806dc70 0x7f0a38159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 -- 172.21.15.26:0/3883795106 >> 172.21.15.26:0/3883795106 conn(0x7f0a380703a0 msgr2=0x7f0a380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 -- 172.21.15.26:0/3883795106 shutdown_connections 2023-10-09T11:36:31.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.629+0000 7f0a3d664700 1 -- 172.21.15.26:0/3883795106 wait complete. 2023-10-09T11:36:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 Processor -- start 2023-10-09T11:36:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 -- start start 2023-10-09T11:36:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a3806dc70 0x7f0a38143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38144220 con 0x7f0a3806e0e0 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38156960 con 0x7f0a3806dc70 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.631+0000 7f0a3d664700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815c7b0 con 0x7f0a38159530 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59046/0 (socket says 172.21.15.26:59046) 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 -- 172.21.15.26:0/2452012430 learned_addr learned my addr 172.21.15.26:0/2452012430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a3806dc70 0x7f0a38143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a377fe700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 -- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 msgr2=0x7f0a380ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 -- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a3806dc70 msgr2=0x7f0a38143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a3806dc70 0x7f0a38143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 -- 172.21.15.26:0/2452012430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009420 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a367fc700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000ec80 tx=0x7f0a200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000c850 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2000c9b0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3815d610 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000cd50 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.632+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3815cd60 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.633+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3815d7a0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.633+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a20013680 con 0x7f0a3806e0e0 2023-10-09T11:36:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.634+0000 7f0a2effd700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.634+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0a200847b0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.634+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.635+0000 7f0a36ffd700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 0x7f0a180693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a3816d210 tx=0x7f0a28017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.638+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a200519d0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.828+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a3804c3c0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.828+0000 7f0a2effd700 1 -- 172.21.15.26:0/2452012430 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a20054ff0 con 0x7f0a3806e0e0 2023-10-09T11:36:31.830 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:36:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.830+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 msgr2=0x7f0a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.830+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 0x7f0a180693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a3816d210 tx=0x7f0a28017000 comp rx=0 tx=0).stop 2023-10-09T11:36:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.830+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 msgr2=0x7f0a380ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.830+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000ec80 tx=0x7f0a200091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 shutdown_connections 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a38159530 0x7f0a380ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a3806dc70 0x7f0a38143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 --2- 172.21.15.26:0/2452012430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a3806e0e0 0x7f0a380ca140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 >> 172.21.15.26:0/2452012430 conn(0x7f0a380703a0 msgr2=0x7f0a380cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 shutdown_connections 2023-10-09T11:36:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.831+0000 7f0a3d664700 1 -- 172.21.15.26:0/2452012430 wait complete. 2023-10-09T11:36:31.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:31.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.962+0000 7f2f7fde0700 1 Processor -- start 2023-10-09T11:36:32.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.962+0000 7f2f7fde0700 1 -- start start 2023-10-09T11:36:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f781599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f780675a0 0x7f2f7806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f7806b230 0x7f2f780c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7806bd00 con 0x7f2f780675a0 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780c7f50 con 0x7f2f7806b230 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7fde0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806b740 con 0x7f2f781595d0 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f780675a0 0x7f2f7806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f780675a0 0x7f2f7806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59052/0 (socket says 172.21.15.26:59052) 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 -- 172.21.15.26:0/3137443870 learned_addr learned my addr 172.21.15.26:0/3137443870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7e37d700 1 --2- 172.21.15.26:0/3137443870 >> v2:172.21.15.67:3300/0 conn(0x7f2f7806b230 0x7f2f780c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 -- 172.21.15.26:0/3137443870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 msgr2=0x7f2f781599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7db7c700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f781599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f781599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 -- 172.21.15.26:0/3137443870 >> v2:172.21.15.67:3300/0 conn(0x7f2f7806b230 msgr2=0x7f2f780c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/3137443870 >> v2:172.21.15.67:3300/0 conn(0x7f2f7806b230 0x7f2f780c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 -- 172.21.15.26:0/3137443870 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7806ba20 con 0x7f2f780675a0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f7806acf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2f78064a20 tx=0x7f2f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd9818a4429c131 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.963+0000 7f2f7cb7a700 1 -- 172.21.15.26:0/3137443870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00b860 con 0x7f2f780675a0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7cb7a700 1 -- 172.21.15.26:0/3137443870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00b9c0 con 0x7f2f780675a0 2023-10-09T11:36:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7cb7a700 1 -- 172.21.15.26:0/3137443870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00bd60 con 0x7f2f780675a0 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 -- 172.21.15.26:0/3137443870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 msgr2=0x7f2f7806acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f7806acf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2f78064a20 tx=0x7f2f6c009250 comp rx=0 tx=0).stop 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 -- 172.21.15.26:0/3137443870 shutdown_connections 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/3137443870 >> v2:172.21.15.67:3300/0 conn(0x7f2f7806b230 0x7f2f780c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f781599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/3137443870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f7806acf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 -- 172.21.15.26:0/3137443870 >> 172.21.15.26:0/3137443870 conn(0x7f2f780cd400 msgr2=0x7f2f780cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 -- 172.21.15.26:0/3137443870 shutdown_connections 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.964+0000 7f2f7fde0700 1 -- 172.21.15.26:0/3137443870 wait complete. 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.965+0000 7f2f7fde0700 1 Processor -- start 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.965+0000 7f2f7fde0700 1 -- start start 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7806b230 0x7f2f780c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f780c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815c610 con 0x7f2f780675a0 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781588d0 con 0x7f2f7806b230 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7fde0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7816aaa0 con 0x7f2f781595d0 2023-10-09T11:36:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59068/0 (socket says 172.21.15.26:59068) 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 -- 172.21.15.26:0/2085087849 learned_addr learned my addr 172.21.15.26:0/2085087849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7e37d700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f780c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7806b230 0x7f2f780c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 -- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 msgr2=0x7f2f780c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f780c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 -- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7806b230 msgr2=0x7f2f780c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7806b230 0x7f2f780c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7db7c700 1 -- 172.21.15.26:0/2085087849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0094f0 con 0x7f2f780675a0 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.966+0000 7f2f7e37d700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f780c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f7db7c700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800ce40 tx=0x7f2f68007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800ab50 con 0x7f2f780675a0 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800acb0 con 0x7f2f780675a0 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f781537f0 con 0x7f2f780675a0 2023-10-09T11:36:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68017660 con 0x7f2f780675a0 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.967+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7816a170 con 0x7f2f780675a0 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.968+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7816ad80 con 0x7f2f780675a0 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.968+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f68003020 con 0x7f2f780675a0 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.969+0000 7f2f75ffb700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 0x7f2f640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.969+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2f68013070 con 0x7f2f780675a0 2023-10-09T11:36:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.969+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 0x7f2f640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.970+0000 7f2f7d37b700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 0x7f2f640693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f78064a20 tx=0x7f2f6c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:31.973+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f68051c50 con 0x7f2f780675a0 2023-10-09T11:36:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.211+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f7804c3c0 con 0x7f2f780675a0 2023-10-09T11:36:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.211+0000 7f2f75ffb700 1 -- 172.21.15.26:0/2085087849 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f2f68055270 con 0x7f2f780675a0 2023-10-09T11:36:32.213 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:32.213 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/890752364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":890752364},{"type":"v1","addr":"172.21.15.26:6834","nonce":890752364}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 msgr2=0x7f2f640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 0x7f2f640693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f78064a20 tx=0x7f2f6c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 msgr2=0x7f2f781532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800ce40 tx=0x7f2f68007810 comp rx=0 tx=0).stop 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 shutdown_connections 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f64066f30 0x7f2f640693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f781595d0 0x7f2f780c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f780675a0 0x7f2f781532b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 --2- 172.21.15.26:0/2085087849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7806b230 0x7f2f780c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 >> 172.21.15.26:0/2085087849 conn(0x7f2f780cd400 msgr2=0x7f2f781550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 shutdown_connections 2023-10-09T11:36:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.213+0000 7f2f7fde0700 1 -- 172.21.15.26:0/2085087849 wait complete. 2023-10-09T11:36:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 22 2023-10-09T11:36:32.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.348+0000 7f4cff4f1700 1 Processor -- start 2023-10-09T11:36:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.348+0000 7f4cff4f1700 1 -- start start 2023-10-09T11:36:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cff4f1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 0x7f4cf815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cff4f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4cf815de50 0x7f4cf80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cff4f1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80cf3c0 con 0x7f4cf80cef40 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cff4f1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf815afd0 con 0x7f4cf815de50 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cff4f1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf815b2b0 con 0x7f4cf8153c30 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4cf815de50 0x7f4cf80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4cf815de50 0x7f4cf80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59080/0 (socket says 172.21.15.26:59080) 2023-10-09T11:36:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 -- 172.21.15.26:0/4272909870 learned_addr learned my addr 172.21.15.26:0/4272909870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfe4ef700 1 --2- 172.21.15.26:0/4272909870 >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 0x7f4cf815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 -- 172.21.15.26:0/4272909870 >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 msgr2=0x7f4cf815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4272909870 >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 0x7f4cf815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 -- 172.21.15.26:0/4272909870 >> v1:172.21.15.67:6789/0 conn(0x7f4cf80cef40 legacy=0x7f4cf806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfdcee700 1 -- 172.21.15.26:0/4272909870 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf815b590 con 0x7f4cf815de50 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.349+0000 7f4cfe4ef700 1 --2- 172.21.15.26:0/4272909870 >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 0x7f4cf815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4272909870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf815de50 0x7f4cf80cea00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ead0 tx=0x7f4ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83888ec8e68c31eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cfd4ed700 1 -- 172.21.15.26:0/4272909870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800b820 con 0x7f4cf815de50 2023-10-09T11:36:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cfd4ed700 1 -- 172.21.15.26:0/4272909870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800b980 con 0x7f4cf815de50 2023-10-09T11:36:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cfd4ed700 1 -- 172.21.15.26:0/4272909870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800bd20 con 0x7f4cf815de50 2023-10-09T11:36:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4272909870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf815de50 msgr2=0x7f4cf80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4272909870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf815de50 0x7f4cf80cea00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ead0 tx=0x7f4ce8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4272909870 shutdown_connections 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4272909870 >> v2:172.21.15.67:3300/0 conn(0x7f4cf8153c30 0x7f4cf815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4272909870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf815de50 0x7f4cf80cea00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4272909870 >> 172.21.15.26:0/4272909870 conn(0x7f4cf80703a0 msgr2=0x7f4cf80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4272909870 shutdown_connections 2023-10-09T11:36:32.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.350+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4272909870 wait complete. 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.351+0000 7f4cff4f1700 1 Processor -- start 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.351+0000 7f4cff4f1700 1 -- start start 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 0x7f4cf80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf815de50 0x7f4cf80b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80b5ea0 con 0x7f4cf80cef40 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80b6330 con 0x7f4cf815de50 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cff4f1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80b3810 con 0x7f4cf8153c30 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cfe4ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cfe4ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59088/0 (socket says 172.21.15.26:59088) 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cfe4ef700 1 -- 172.21.15.26:0/4266717077 learned_addr learned my addr 172.21.15.26:0/4266717077 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cfecf0700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf815de50 0x7f4cf80b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.352+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 0x7f4cf80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 -- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 msgr2=0x7f4cf80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 0x7f4cf80b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 -- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf815de50 msgr2=0x7f4cf80b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf815de50 0x7f4cf80b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 -- 172.21.15.26:0/4266717077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80094f0 con 0x7f4cf80cef40 2023-10-09T11:36:32.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 0x7f4cf80b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cfe4ef700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c850 tx=0x7f4cf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4011600 con 0x7f4cf80cef40 2023-10-09T11:36:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4011760 con 0x7f4cf80cef40 2023-10-09T11:36:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf80c7780 con 0x7f4cf80cef40 2023-10-09T11:36:32.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4011b20 con 0x7f4cf80cef40 2023-10-09T11:36:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.353+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf80b5b30 con 0x7f4cf80cef40 2023-10-09T11:36:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.354+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf80b6180 con 0x7f4cf80cef40 2023-10-09T11:36:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.354+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cf4018350 con 0x7f4cf80cef40 2023-10-09T11:36:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.355+0000 7f4cee7fc700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 0x7f4cdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.355+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4cf4084430 con 0x7f4cf80cef40 2023-10-09T11:36:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.355+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 0x7f4cdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.356+0000 7f4cfdcee700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 0x7f4cdc0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ead0 tx=0x7f4ce8016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.359+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cf4051650 con 0x7f4cf80cef40 2023-10-09T11:36:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.553+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cf804c3c0 con 0x7f4cf80cef40 2023-10-09T11:36:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.554+0000 7f4cee7fc700 1 -- 172.21.15.26:0/4266717077 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7f4cf4054c70 con 0x7f4cf80cef40 2023-10-09T11:36:32.555 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:29.838907+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/3752557440":"2023-10-10T11:36:26.831410+0000","172.21.15.26:6832/3752557440":"2023-10-10T11:36:26.831410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:32.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 msgr2=0x7f4cdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 0x7f4cdc0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ead0 tx=0x7f4ce8016000 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 msgr2=0x7f4cf80c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c850 tx=0x7f4cf4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 shutdown_connections 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf815de50 0x7f4cf80b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf80cef40 0x7f4cf80c9940 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4cdc066f30 0x7f4cdc0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 --2- 172.21.15.26:0/4266717077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cf8153c30 0x7f4cf80b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 >> 172.21.15.26:0/4266717077 conn(0x7f4cf80703a0 msgr2=0x7f4cf8152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 shutdown_connections 2023-10-09T11:36:32.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.556+0000 7f4cff4f1700 1 -- 172.21.15.26:0/4266717077 wait complete. 2023-10-09T11:36:32.569 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:36:32.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.688+0000 7feb0b95f700 1 Processor -- start 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.688+0000 7feb0b95f700 1 -- start start 2023-10-09T11:36:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 0x7feb040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb040cde50 0x7feb0415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040d13f0 con 0x7feb040cde50 2023-10-09T11:36:32.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0415a940 con 0x7feb040cb5a0 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb0b95f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415ae40 con 0x7feb040cd9e0 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb09efc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb040cde50 0x7feb0415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb09efc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb040cde50 0x7feb0415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59094/0 (socket says 172.21.15.26:59094) 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb09efc700 1 -- 172.21.15.26:0/2620621877 learned_addr learned my addr 172.21.15.26:0/2620621877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb08efa700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.689+0000 7feb096fb700 1 --2- 172.21.15.26:0/2620621877 >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 0x7feb040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 -- 172.21.15.26:0/2620621877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 msgr2=0x7feb04159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 -- 172.21.15.26:0/2620621877 >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 msgr2=0x7feb040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 --2- 172.21.15.26:0/2620621877 >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 0x7feb040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 -- 172.21.15.26:0/2620621877 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0415ab60 con 0x7feb040cde50 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb096fb700 1 --2- 172.21.15.26:0/2620621877 >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 0x7feb040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb09efc700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cde50 0x7feb0415a400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb04065120 tx=0x7feaf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f4a4dd7316b261 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb03fff700 1 -- 172.21.15.26:0/2620621877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4009ea0 con 0x7feb040cde50 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb03fff700 1 -- 172.21.15.26:0/2620621877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400b820 con 0x7feb040cde50 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb03fff700 1 -- 172.21.15.26:0/2620621877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400bbc0 con 0x7feb040cde50 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 -- 172.21.15.26:0/2620621877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cde50 msgr2=0x7feb0415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cde50 0x7feb0415a400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb04065120 tx=0x7feaf4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 -- 172.21.15.26:0/2620621877 shutdown_connections 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 --2- 172.21.15.26:0/2620621877 >> v2:172.21.15.67:3300/0 conn(0x7feb040cb5a0 0x7feb040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cde50 0x7feb0415a400 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 --2- 172.21.15.26:0/2620621877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 -- 172.21.15.26:0/2620621877 >> 172.21.15.26:0/2620621877 conn(0x7feb04070e30 msgr2=0x7feb040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 -- 172.21.15.26:0/2620621877 shutdown_connections 2023-10-09T11:36:32.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.690+0000 7feb0b95f700 1 -- 172.21.15.26:0/2620621877 wait complete. 2023-10-09T11:36:32.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 Processor -- start 2023-10-09T11:36:32.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 -- start start 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 0x7feb04155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415a140 con 0x7feb040cb5a0 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415c050 con 0x7feb04156eb0 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb0b95f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415c330 con 0x7feb040cd9e0 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.692+0000 7feb096fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59106/0 (socket says 172.21.15.26:59106) 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 -- 172.21.15.26:0/3534004439 learned_addr learned my addr 172.21.15.26:0/3534004439 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:32.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb08efa700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb09efc700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 0x7feb04155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 -- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 msgr2=0x7feb04159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 -- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 msgr2=0x7feb04155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 0x7feb04155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 -- 172.21.15.26:0/3534004439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40094f0 con 0x7feb040cb5a0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb09efc700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 0x7feb04155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb096fb700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feafc00d1d0 tx=0x7feafc009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00de50 con 0x7feb040cb5a0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f040 con 0x7feb040cb5a0 2023-10-09T11:36:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0415c610 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc015670 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.693+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0415cbd0 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.694+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0415cdf0 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.695+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feafc015a20 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.695+0000 7feb017fa700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 0x7feaf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.695+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7feafc0849e0 con 0x7feb040cb5a0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.695+0000 7feb08efa700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 0x7feaf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.696+0000 7feb08efa700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 0x7feaf00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb040d1290 tx=0x7feaf80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.699+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feafc04e5a0 con 0x7feb040cb5a0 2023-10-09T11:36:32.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.937+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb0404c3c0 con 0x7feb040cb5a0 2023-10-09T11:36:32.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.938+0000 7feb017fa700 1 -- 172.21.15.26:0/3534004439 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4594 (secure 0 0 0) 0x7feafc01a090 con 0x7feb040cb5a0 2023-10-09T11:36:32.939 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:32.939 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/890752364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":890752364},{"type":"v1","addr":"172.21.15.26:6834","nonce":890752364}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 msgr2=0x7feaf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 0x7feaf00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb040d1290 tx=0x7feaf80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 msgr2=0x7feb0415b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feafc00d1d0 tx=0x7feafc009a90 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 shutdown_connections 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb04156eb0 0x7feb04155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb040cb5a0 0x7feb0415b9c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaf0066f30 0x7feaf00693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 --2- 172.21.15.26:0/3534004439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb040cd9e0 0x7feb04159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 >> 172.21.15.26:0/3534004439 conn(0x7feb04070e30 msgr2=0x7feb040b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 shutdown_connections 2023-10-09T11:36:32.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:32.940+0000 7feb0b95f700 1 -- 172.21.15.26:0/3534004439 wait complete. 2023-10-09T11:36:32.943 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 22 2023-10-09T11:36:32.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:33.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.070+0000 7f8cb3ccf700 1 Processor -- start 2023-10-09T11:36:33.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 -- start start 2023-10-09T11:36:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cac0cb970 0x7f8cac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 0x7f8cac156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac15ae40 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0ce0f0 con 0x7f8cac0cb970 2023-10-09T11:36:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.071+0000 7f8cb3ccf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0d13f0 con 0x7f8cac15a400 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cac0cb970 0x7f8cac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb226c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 0x7f8cac156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cac0cb970 0x7f8cac159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:55218/0 (socket says 172.21.15.26:55218) 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 -- 172.21.15.26:0/3758521049 learned_addr learned my addr 172.21.15.26:0/3758521049 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb1a6b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8cac0cb5a0 0x7f8cac0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:44190/0 (socket says 172.21.15.26:44190) 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 -- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 msgr2=0x7f8cac156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 0x7f8cac156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 -- 172.21.15.26:0/3758521049 >> v1:172.21.15.67:6789/0 conn(0x7f8cac0cb5a0 legacy=0x7f8cac0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 -- 172.21.15.26:0/3758521049 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac15ab60 con 0x7f8cac0cb970 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb0a69700 1 -- 172.21.15.26:0/3758521049 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871685638 0 0) 0x7f8cac15ae40 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb226c700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 0x7f8cac156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.072+0000 7f8cb126a700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac0cb970 0x7f8cac159ec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00099b0 tx=0x7f8ca0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1562e54fccd4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb0a69700 1 -- 172.21.15.26:0/3758521049 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0009ea0 con 0x7f8cac0cb970 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb0a69700 1 -- 172.21.15.26:0/3758521049 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000b860 con 0x7f8cac0cb970 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb0a69700 1 -- 172.21.15.26:0/3758521049 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000bc00 con 0x7f8cac0cb970 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac0cb970 msgr2=0x7f8cac159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac0cb970 0x7f8cac159ec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00099b0 tx=0x7f8ca0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/3758521049 shutdown_connections 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac15a400 0x7f8cac156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/3758521049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac0cb970 0x7f8cac159ec0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/3758521049 >> 172.21.15.26:0/3758521049 conn(0x7f8cac070e30 msgr2=0x7f8cac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/3758521049 shutdown_connections 2023-10-09T11:36:33.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.073+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/3758521049 wait complete. 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.074+0000 7f8cb3ccf700 1 Processor -- start 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.074+0000 7f8cb3ccf700 1 -- start start 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac0cb970 0x7f8cac156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac15a400 0x7f8cac1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac16e200 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac152b80 con 0x7f8cac15a400 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb3ccf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac16d440 con 0x7f8cac0cb970 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb1a6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb1a6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59122/0 (socket says 172.21.15.26:59122) 2023-10-09T11:36:33.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb1a6b700 1 -- 172.21.15.26:0/2017868630 learned_addr learned my addr 172.21.15.26:0/2017868630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb126a700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac0cb970 0x7f8cac156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.075+0000 7f8cb226c700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac15a400 0x7f8cac1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 -- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac0cb970 msgr2=0x7f8cac156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac0cb970 0x7f8cac156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 -- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac15a400 msgr2=0x7f8cac1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac15a400 0x7f8cac1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 -- 172.21.15.26:0/2017868630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009a20 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb1a6b700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40011e0 tx=0x7f8ca4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4005a70 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4005bd0 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca00094f0 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40070d0 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.076+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac16da00 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.077+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac04c3c0 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.078+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ca4007480 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.078+0000 7f8ca9ffb700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.078+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8ca4083910 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.078+0000 7f8cb126a700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.079+0000 7f8cb126a700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 0x7f8c980693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00099b0 tx=0x7f8ca0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.082+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ca404b5a0 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.321+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cac0afa90 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.321+0000 7f8ca9ffb700 1 -- 172.21.15.26:0/2017868630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f8ca4017070 con 0x7f8cac0cb5a0 2023-10-09T11:36:33.323 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:33.323 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/890752364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":890752364},{"type":"v1","addr":"172.21.15.26:6834","nonce":890752364}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:07.666099+0000","modified":"2023-10-09T11:36:11.277940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/1332078689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1332078689},{"type":"v1","addr":"172.21.15.26:6835","nonce":1332078689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 msgr2=0x7f8c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 0x7f8c980693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00099b0 tx=0x7f8ca0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 msgr2=0x7f8cac154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40011e0 tx=0x7f8ca4007e10 comp rx=0 tx=0).stop 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 shutdown_connections 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cac15a400 0x7f8cac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac0cb5a0 0x7f8cac154d00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c98066f30 0x7f8c980693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 --2- 172.21.15.26:0/2017868630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cac0cb970 0x7f8cac156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 >> 172.21.15.26:0/2017868630 conn(0x7f8cac070e30 msgr2=0x7f8cac0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 shutdown_connections 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.324+0000 7f8cb3ccf700 1 -- 172.21.15.26:0/2017868630 wait complete. 2023-10-09T11:36:33.326 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 22 2023-10-09T11:36:33.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.454+0000 7f91aeacc700 1 Processor -- start 2023-10-09T11:36:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 -- start start 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a8159600 0x7f91a80682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91a815e1a0 0x7f91a80c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a8067e20 con 0x7f91a80c8140 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a80c85e0 con 0x7f91a8159600 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.455+0000 7f91aeacc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a80677d0 con 0x7f91a815e1a0 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a8159600 0x7f91a80682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ad069700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f91a80c8140 0x7f91a8068db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49400/0 (socket says 172.21.15.26:49400) 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a8159600 0x7f91a80682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59124/0 (socket says 172.21.15.26:59124) 2023-10-09T11:36:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ad069700 1 -- 172.21.15.26:0/2804170155 learned_addr learned my addr 172.21.15.26:0/2804170155 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91a7fff700 1 --2- 172.21.15.26:0/2804170155 >> v2:172.21.15.67:3300/0 conn(0x7f91a815e1a0 0x7f91a80c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 -- 172.21.15.26:0/2804170155 >> v2:172.21.15.67:3300/0 conn(0x7f91a815e1a0 msgr2=0x7f91a80c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 --2- 172.21.15.26:0/2804170155 >> v2:172.21.15.67:3300/0 conn(0x7f91a815e1a0 0x7f91a80c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 -- 172.21.15.26:0/2804170155 >> v1:172.21.15.26:6789/0 conn(0x7f91a80c8140 legacy=0x7f91a8068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 -- 172.21.15.26:0/2804170155 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8067ab0 con 0x7f91a8159600 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91a77fe700 1 -- 172.21.15.26:0/2804170155 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202133946 0 0) 0x7f91a8067e20 con 0x7f91a80c8140 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91ac868700 1 --2- 172.21.15.26:0/2804170155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a80682b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ca7d0 tx=0x7f91a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea5345a458ed61e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91a77fe700 1 -- 172.21.15.26:0/2804170155 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000e070 con 0x7f91a8159600 2023-10-09T11:36:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91a77fe700 1 -- 172.21.15.26:0/2804170155 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000bc30 con 0x7f91a8159600 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.456+0000 7f91a77fe700 1 -- 172.21.15.26:0/2804170155 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0012430 con 0x7f91a8159600 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 -- 172.21.15.26:0/2804170155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 msgr2=0x7f91a80682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 --2- 172.21.15.26:0/2804170155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a80682b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ca7d0 tx=0x7f91a0009780 comp rx=0 tx=0).stop 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 -- 172.21.15.26:0/2804170155 shutdown_connections 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 --2- 172.21.15.26:0/2804170155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a80682b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 --2- 172.21.15.26:0/2804170155 >> v2:172.21.15.67:3300/0 conn(0x7f91a815e1a0 0x7f91a80c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 -- 172.21.15.26:0/2804170155 >> 172.21.15.26:0/2804170155 conn(0x7f91a80cde30 msgr2=0x7f91a80c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 -- 172.21.15.26:0/2804170155 shutdown_connections 2023-10-09T11:36:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.457+0000 7f91aeacc700 1 -- 172.21.15.26:0/2804170155 wait complete. 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.458+0000 7f91aeacc700 1 Processor -- start 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.458+0000 7f91aeacc700 1 -- start start 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91a80c8140 0x7f91a8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91a815e1a0 0x7f91a80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8153cd0 con 0x7f91a8159600 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8153fb0 con 0x7f91a815e1a0 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91aeacc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8154290 con 0x7f91a80c8140 2023-10-09T11:36:33.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59140/0 (socket says 172.21.15.26:59140) 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 -- 172.21.15.26:0/4133560999 learned_addr learned my addr 172.21.15.26:0/4133560999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 -- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91a80c8140 msgr2=0x7f91a8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91a80c8140 0x7f91a8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 -- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91a815e1a0 msgr2=0x7f91a80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91a815e1a0 0x7f91a80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 -- 172.21.15.26:0/4133560999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009a20 con 0x7f91a8159600 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a7fff700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c880 tx=0x7f919c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c011600 con 0x7f91a8159600 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.459+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c0117a0 con 0x7f91a8159600 2023-10-09T11:36:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.460+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a8154570 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.460+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c011b60 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.460+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a8151c50 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.460+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a804c3c0 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.461+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f919c010350 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.461+0000 7f91a4ff9700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.461+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f919c084520 con 0x7f91a8159600 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.462+0000 7f91ac868700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.462+0000 7f91ac868700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 0x7f91940693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ca7d0 tx=0x7f91a0019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.466+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f919c051740 con 0x7f91a8159600 2023-10-09T11:36:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.659+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91a80b0390 con 0x7f91a8159600 2023-10-09T11:36:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.659+0000 7f91a4ff9700 1 -- 172.21.15.26:0/4133560999 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7f919c054d60 con 0x7f91a8159600 2023-10-09T11:36:33.661 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:33.661 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:29.838907+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:05.599607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:06.642071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/3752557440":"2023-10-10T11:36:26.831410+0000","172.21.15.26:6832/3752557440":"2023-10-10T11:36:26.831410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.661+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 msgr2=0x7f91940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.661+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 0x7f91940693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ca7d0 tx=0x7f91a0019000 comp rx=0 tx=0).stop 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.661+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 msgr2=0x7f91a8153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.661+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c880 tx=0x7f919c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 shutdown_connections 2023-10-09T11:36:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91a815e1a0 0x7f91a80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9194066f30 0x7f91940693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91a80c8140 0x7f91a8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 --2- 172.21.15.26:0/4133560999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a8159600 0x7f91a8153310 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 >> 172.21.15.26:0/4133560999 conn(0x7f91a80cde30 msgr2=0x7f91a806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 shutdown_connections 2023-10-09T11:36:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.662+0000 7f91aeacc700 1 -- 172.21.15.26:0/4133560999 wait complete. 2023-10-09T11:36:33.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:36:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.793+0000 7fa9a3347700 1 Processor -- start 2023-10-09T11:36:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 -- start start 2023-10-09T11:36:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c15a280 con 0x7fa99c0cf200 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c06e180 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.794+0000 7fa9a3347700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c06d850 con 0x7fa99c0b07d0 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a08e2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa99c0cf200 0x7fa99c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49404/0 (socket says 172.21.15.26:49404) 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a08e2700 1 -- 172.21.15.26:0/515109302 learned_addr learned my addr 172.21.15.26:0/515109302 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59142/0 (socket says 172.21.15.26:59142) 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a10e3700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 -- 172.21.15.26:0/515109302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 msgr2=0x7fa99c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 -- 172.21.15.26:0/515109302 >> v1:172.21.15.26:6789/0 conn(0x7fa99c0cf200 legacy=0x7fa99c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 -- 172.21.15.26:0/515109302 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c06db30 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa99bfff700 1 -- 172.21.15.26:0/515109302 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513552817 0 0) 0x7fa99c15a280 con 0x7fa99c0cf200 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa9a18e4700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009e60 tx=0x7fa98c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fddc76613262e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa99bfff700 1 -- 172.21.15.26:0/515109302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00e070 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa99bfff700 1 -- 172.21.15.26:0/515109302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c00bb60 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.795+0000 7fa99bfff700 1 -- 172.21.15.26:0/515109302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c012430 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 -- 172.21.15.26:0/515109302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 msgr2=0x7fa99c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009e60 tx=0x7fa98c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 -- 172.21.15.26:0/515109302 shutdown_connections 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c0c42c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 --2- 172.21.15.26:0/515109302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 -- 172.21.15.26:0/515109302 >> 172.21.15.26:0/515109302 conn(0x7fa99c06ce80 msgr2=0x7fa99c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 -- 172.21.15.26:0/515109302 shutdown_connections 2023-10-09T11:36:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.796+0000 7fa9a3347700 1 -- 172.21.15.26:0/515109302 wait complete. 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.797+0000 7fa9a3347700 1 Processor -- start 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.797+0000 7fa9a3347700 1 -- start start 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 0x7fa99c0c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c6a40 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c65b0 con 0x7fa99c0cf200 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a3347700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c16a840 con 0x7fa99c0b07d0 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59146/0 (socket says 172.21.15.26:59146) 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 -- 172.21.15.26:0/2846150410 learned_addr learned my addr 172.21.15.26:0/2846150410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a18e4700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 0x7fa99c0c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a10e3700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 -- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 msgr2=0x7fa99c0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 -- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 msgr2=0x7fa99c0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 0x7fa99c0c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a08e2700 1 -- 172.21.15.26:0/2846150410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c009a20 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a18e4700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 0x7fa99c0c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.798+0000 7fa9a10e3700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9a08e2700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c810 tx=0x7fa990007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990005c00 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990005d60 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c0c59a0 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990007340 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.799+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0c5f60 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.800+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0c6720 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.800+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa99001b400 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.801+0000 7fa9997fa700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 0x7fa9880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.801+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa990084010 con 0x7fa99c0b0ba0 2023-10-09T11:36:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.801+0000 7fa9a10e3700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 0x7fa9880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.801+0000 7fa9a10e3700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 0x7fa9880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa994009cd0 tx=0x7fa994008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:33.805+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9900512b0 con 0x7fa99c0b0ba0 2023-10-09T11:36:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.041+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa99c04c3c0 con 0x7fa99c0b0ba0 2023-10-09T11:36:34.043 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:36:34.042+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:36:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.046+0000 7fa9997fa700 1 -- 172.21.15.26:0/2846150410 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa9900076f0 con 0x7fa99c0b0ba0 2023-10-09T11:36:34.047 INFO:tasks.ceph.mds.c.smithi026.stderr: -1170> 2023-10-09T11:36:12.249+0000 7f9703c39700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 msgr2=0x7fa9880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 0x7fa9880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa994009cd0 tx=0x7fa994008040 comp rx=0 tx=0).stop 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 msgr2=0x7fa99c16a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c810 tx=0x7fa990007d90 comp rx=0 tx=0).stop 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 shutdown_connections 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa99c0cf200 0x7fa99c0c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa988066f30 0x7fa9880693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa99c0b07d0 0x7fa99c0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 --2- 172.21.15.26:0/2846150410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa99c0b0ba0 0x7fa99c16a300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 >> 172.21.15.26:0/2846150410 conn(0x7fa99c06ce80 msgr2=0x7fa99c068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 shutdown_connections 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.048+0000 7fa9a3347700 1 -- 172.21.15.26:0/2846150410 wait complete. 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:36:34.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:36:34.070 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:36:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.182+0000 7f5b39ced700 1 Processor -- start 2023-10-09T11:36:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.182+0000 7f5b39ced700 1 -- start start 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b39ced700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc320 0x7f5b3413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b39ced700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3406a110 0x7f5b3413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b39ced700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3406d7b0 con 0x7f5b340cc6f0 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b39ced700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3406a590 con 0x7f5b3406a110 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b39ced700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3406f7d0 con 0x7f5b340cc320 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3406a110 0x7f5b3413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b32ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5b340cc6f0 0x7f5b34069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49412/0 (socket says 172.21.15.26:49412) 2023-10-09T11:36:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3406a110 0x7f5b3413c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59156/0 (socket says 172.21.15.26:59156) 2023-10-09T11:36:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.183+0000 7f5b32ffd700 1 -- 172.21.15.26:0/3264464994 learned_addr learned my addr 172.21.15.26:0/3264464994 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b337fe700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc320 0x7f5b3413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b33fff700 1 -- 172.21.15.26:0/3264464994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc320 msgr2=0x7f5b3413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b33fff700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc320 0x7f5b3413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b33fff700 1 -- 172.21.15.26:0/3264464994 >> v1:172.21.15.26:6789/0 conn(0x7f5b340cc6f0 legacy=0x7f5b34069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b33fff700 1 -- 172.21.15.26:0/3264464994 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3406e330 con 0x7f5b3406a110 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b327fc700 1 -- 172.21.15.26:0/3264464994 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803054406 0 0) 0x7f5b3406d7b0 con 0x7f5b340cc6f0 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b33fff700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3406a110 0x7f5b3413c7e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009e60 tx=0x7f5b2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692f2b010aa5a56d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b327fc700 1 -- 172.21.15.26:0/3264464994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00e070 con 0x7f5b3406a110 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b327fc700 1 -- 172.21.15.26:0/3264464994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00bc30 con 0x7f5b3406a110 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b327fc700 1 -- 172.21.15.26:0/3264464994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c012430 con 0x7f5b3406a110 2023-10-09T11:36:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b39ced700 1 -- 172.21.15.26:0/3264464994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3406a110 msgr2=0x7f5b3413c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b39ced700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3406a110 0x7f5b3413c7e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009e60 tx=0x7f5b2c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b39ced700 1 -- 172.21.15.26:0/3264464994 shutdown_connections 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b39ced700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3406a110 0x7f5b3413c7e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.184+0000 7f5b39ced700 1 --2- 172.21.15.26:0/3264464994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc320 0x7f5b3413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.185+0000 7f5b39ced700 1 -- 172.21.15.26:0/3264464994 >> 172.21.15.26:0/3264464994 conn(0x7f5b34067f00 msgr2=0x7f5b34068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.185+0000 7f5b39ced700 1 -- 172.21.15.26:0/3264464994 shutdown_connections 2023-10-09T11:36:34.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.185+0000 7f5b39ced700 1 -- 172.21.15.26:0/3264464994 wait complete. 2023-10-09T11:36:34.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.186+0000 7f5b39ced700 1 Processor -- start 2023-10-09T11:36:34.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.186+0000 7f5b39ced700 1 -- start start 2023-10-09T11:36:34.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b3406a110 0x7f5b34159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 0x7f5b3416d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b0a30 con 0x7f5b340cc320 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340afe20 con 0x7f5b3406a110 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b0100 con 0x7f5b340cc6f0 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59172/0 (socket says 172.21.15.26:59172) 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 -- 172.21.15.26:0/1209797632 learned_addr learned my addr 172.21.15.26:0/1209797632 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b33fff700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 0x7f5b3416d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b337fe700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b3406a110 0x7f5b34159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 -- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 msgr2=0x7f5b3416d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 0x7f5b3416d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 -- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b3406a110 msgr2=0x7f5b34159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b3406a110 0x7f5b34159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 -- 172.21.15.26:0/1209797632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c009a20 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b33fff700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 0x7f5b3416d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b32ffd700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800c5b0 tx=0x7f5b28001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28005b30 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b28005c90 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28007300 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b340b03e0 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.187+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b340ad620 con 0x7f5b340cc320 2023-10-09T11:36:34.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.188+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3404c3c0 con 0x7f5b340cc320 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.189+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b2801b3b0 con 0x7f5b340cc320 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.189+0000 7f5b1b7fe700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 0x7f5b200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.189+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f5b28083b10 con 0x7f5b340cc320 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.189+0000 7f5b337fe700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 0x7f5b200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.190+0000 7f5b337fe700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 0x7f5b200693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006fd0 tx=0x7f5b24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.194+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b28050cd0 con 0x7f5b340cc320 2023-10-09T11:36:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:34.431+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b3406da00 con 0x7f5b340cc320 2023-10-09T11:36:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.046+0000 7f5b1b7fe700 1 -- 172.21.15.26:0/1209797632 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5b280542f0 con 0x7f5b340cc320 2023-10-09T11:36:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 msgr2=0x7f5b200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 0x7f5b200693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006fd0 tx=0x7f5b24008040 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 msgr2=0x7f5b3416d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800c5b0 tx=0x7f5b28001070 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 shutdown_connections 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5b20066f30 0x7f5b200693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b340cc6f0 0x7f5b3416d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b3406a110 0x7f5b34159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 --2- 172.21.15.26:0/1209797632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b340cc320 0x7f5b3416d2c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 >> 172.21.15.26:0/1209797632 conn(0x7f5b34067f00 msgr2=0x7f5b340682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 shutdown_connections 2023-10-09T11:36:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.049+0000 7f5b39ced700 1 -- 172.21.15.26:0/1209797632 wait complete. 2023-10-09T11:36:35.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:36:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.235+0000 7f1127eff700 1 Processor -- start 2023-10-09T11:36:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.235+0000 7f1127eff700 1 -- start start 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1127eff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11200cd200 0x7f11200cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1127eff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f11200cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1127eff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11200ce360 con 0x7f11201502c0 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1127eff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1120150e00 con 0x7f11200cd200 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1127eff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11200cb970 con 0x7f11200caeb0 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11200cd200 0x7f11200cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11200cd200 0x7f11200cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59178/0 (socket says 172.21.15.26:59178) 2023-10-09T11:36:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 -- 172.21.15.26:0/1501433135 learned_addr learned my addr 172.21.15.26:0/1501433135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 -- 172.21.15.26:0/1501433135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 msgr2=0x7f11200cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 --2- 172.21.15.26:0/1501433135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f11200cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 -- 172.21.15.26:0/1501433135 >> v1:172.21.15.67:6789/0 conn(0x7f11201502c0 legacy=0x7f11201506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 -- 172.21.15.26:0/1501433135 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200cbc50 con 0x7f11200cd200 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.236+0000 7f1125c9b700 1 --2- 172.21.15.26:0/1501433135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11200cd200 0x7f11200cd5d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f111c009990 tx=0x7f111c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b7a7ca0df42a73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1124c99700 1 -- 172.21.15.26:0/1501433135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c005c10 con 0x7f11200cd200 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1124c99700 1 -- 172.21.15.26:0/1501433135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c005d70 con 0x7f11200cd200 2023-10-09T11:36:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1124c99700 1 -- 172.21.15.26:0/1501433135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c00b840 con 0x7f11200cd200 2023-10-09T11:36:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 -- 172.21.15.26:0/1501433135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11200cd200 msgr2=0x7f11200cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 --2- 172.21.15.26:0/1501433135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11200cd200 0x7f11200cd5d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f111c009990 tx=0x7f111c009220 comp rx=0 tx=0).stop 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 -- 172.21.15.26:0/1501433135 shutdown_connections 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 --2- 172.21.15.26:0/1501433135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11200cd200 0x7f11200cd5d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 --2- 172.21.15.26:0/1501433135 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f11200cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 -- 172.21.15.26:0/1501433135 >> 172.21.15.26:0/1501433135 conn(0x7f11200999c0 msgr2=0x7f1120070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 -- 172.21.15.26:0/1501433135 shutdown_connections 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.237+0000 7f1127eff700 1 -- 172.21.15.26:0/1501433135 wait complete. 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.238+0000 7f1127eff700 1 Processor -- start 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.238+0000 7f1127eff700 1 -- start start 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f112016b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200cd200 0x7f112006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11200c8450 con 0x7f11201502c0 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11200c95d0 con 0x7f11200cd200 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1127eff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112016af10 con 0x7f11200caeb0 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59192/0 (socket says 172.21.15.26:59192) 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 -- 172.21.15.26:0/461200409 learned_addr learned my addr 172.21.15.26:0/461200409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f1125c9b700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f112016b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112549a700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200cd200 0x7f112006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 -- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 msgr2=0x7f112016b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f112016b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 -- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200cd200 msgr2=0x7f112006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200cd200 0x7f112006dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.239+0000 7f112649c700 1 -- 172.21.15.26:0/461200409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c009480 con 0x7f11201502c0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f112649c700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f111800bbb0 tx=0x7f1118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180092e0 con 0x7f11201502c0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111800c630 con 0x7f11201502c0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11200c8f80 con 0x7f11201502c0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111800c9f0 con 0x7f11201502c0 2023-10-09T11:36:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.240+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11200c8c30 con 0x7f11201502c0 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.241+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11200c9780 con 0x7f11201502c0 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.241+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1118012070 con 0x7f11201502c0 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.242+0000 7f1115ffb700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 0x7f11040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.242+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f1118084120 con 0x7f11201502c0 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.242+0000 7f1125c9b700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 0x7f11040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.242+0000 7f1125c9b700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 0x7f11040693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f111c003080 tx=0x7f111c015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.246+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11200c9780 con 0x7f11201502c0 2023-10-09T11:36:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:35.439+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1120158b00 con 0x7f11201502c0 2023-10-09T11:36:36.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.052+0000 7f1115ffb700 1 -- 172.21.15.26:0/461200409 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1118054d70 con 0x7f11201502c0 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 msgr2=0x7f11040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 0x7f11040693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f111c003080 tx=0x7f111c015000 comp rx=0 tx=0).stop 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 msgr2=0x7f112006e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f111800bbb0 tx=0x7f1118009840 comp rx=0 tx=0).stop 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 shutdown_connections 2023-10-09T11:36:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11201502c0 0x7f112006e280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1104066f30 0x7f11040693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11200caeb0 0x7f112016b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 --2- 172.21.15.26:0/461200409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200cd200 0x7f112006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 >> 172.21.15.26:0/461200409 conn(0x7f11200999c0 msgr2=0x7f11201506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.056+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 shutdown_connections 2023-10-09T11:36:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.057+0000 7f1127eff700 1 -- 172.21.15.26:0/461200409 wait complete. 2023-10-09T11:36:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:36:36.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:36:36.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 Processor -- start 2023-10-09T11:36:36.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 -- start start 2023-10-09T11:36:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4067e50 0x7fc7b415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7b40c8c70 0x7fc7b40c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b415d9f0 con 0x7fc7b4068220 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b415d3c0 con 0x7fc7b40c8c70 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.202+0000 7fc7b98b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40c9630 con 0x7fc7b4067e50 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7b40c8c70 0x7fc7b40c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7b40c8c70 0x7fc7b40c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59198/0 (socket says 172.21.15.26:59198) 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 -- 172.21.15.26:0/2637035736 learned_addr learned my addr 172.21.15.26:0/2637035736 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b2ffd700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4067e50 0x7fc7b415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 -- 172.21.15.26:0/2637035736 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4067e50 msgr2=0x7fc7b415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4067e50 0x7fc7b415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 -- 172.21.15.26:0/2637035736 >> v1:172.21.15.67:6789/0 conn(0x7fc7b4068220 legacy=0x7fc7b4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 -- 172.21.15.26:0/2637035736 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b415a8f0 con 0x7fc7b40c8c70 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b37fe700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b40c8c70 0x7fc7b40c90f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009f20 tx=0x7fc7a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df15f750b9eb65bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b1ffb700 1 -- 172.21.15.26:0/2637035736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400e070 con 0x7fc7b40c8c70 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b1ffb700 1 -- 172.21.15.26:0/2637035736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400ba80 con 0x7fc7b40c8c70 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.203+0000 7fc7b1ffb700 1 -- 172.21.15.26:0/2637035736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40092e0 con 0x7fc7b40c8c70 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 -- 172.21.15.26:0/2637035736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b40c8c70 msgr2=0x7fc7b40c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b40c8c70 0x7fc7b40c90f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009f20 tx=0x7fc7a4009840 comp rx=0 tx=0).stop 2023-10-09T11:36:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 -- 172.21.15.26:0/2637035736 shutdown_connections 2023-10-09T11:36:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b40c8c70 0x7fc7b40c90f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/2637035736 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4067e50 0x7fc7b415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 -- 172.21.15.26:0/2637035736 >> 172.21.15.26:0/2637035736 conn(0x7fc7b40ce4a0 msgr2=0x7fc7b40ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 -- 172.21.15.26:0/2637035736 shutdown_connections 2023-10-09T11:36:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.204+0000 7fc7b98b2700 1 -- 172.21.15.26:0/2637035736 wait complete. 2023-10-09T11:36:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.205+0000 7fc7b98b2700 1 Processor -- start 2023-10-09T11:36:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.205+0000 7fc7b98b2700 1 -- start start 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4068220 0x7fc7b40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b40c8c70 0x7fc7b415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40c6790 con 0x7fc7b4067e50 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40c3110 con 0x7fc7b40c8c70 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b98b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40c33f0 con 0x7fc7b4068220 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59204/0 (socket says 172.21.15.26:59204) 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 -- 172.21.15.26:0/3020359840 learned_addr learned my addr 172.21.15.26:0/3020359840 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b27fc700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4068220 0x7fc7b40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b37fe700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b40c8c70 0x7fc7b415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 -- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4068220 msgr2=0x7fc7b40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4068220 0x7fc7b40c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 -- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b40c8c70 msgr2=0x7fc7b415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b40c8c70 0x7fc7b415ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 -- 172.21.15.26:0/3020359840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009ae0 con 0x7fc7b4067e50 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.206+0000 7fc7b2ffd700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d860 tx=0x7fc7ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.207+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac009610 con 0x7fc7b4067e50 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.207+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac009770 con 0x7fc7b4067e50 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.207+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b40c36d0 con 0x7fc7b4067e50 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.207+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac009b30 con 0x7fc7b4067e50 2023-10-09T11:36:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.207+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b40c7ff0 con 0x7fc7b4067e50 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.208+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40c3b70 con 0x7fc7b4067e50 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.208+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7ac01e460 con 0x7fc7b4067e50 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.208+0000 7fc7aaffd700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 0x7fc7940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.209+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5439+0+0 (secure 0 0 0) 0x7fc7ac084a20 con 0x7fc7b4067e50 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.209+0000 7fc7b27fc700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 0x7fc7940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.209+0000 7fc7b27fc700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 0x7fc7940693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40afbc0 tx=0x7fc79c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.213+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7ac051d00 con 0x7fc7b4067e50 2023-10-09T11:36:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:36.406+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7b404c3c0 con 0x7fc7b4067e50 2023-10-09T11:36:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.057+0000 7fc7aaffd700 1 -- 172.21.15.26:0/3020359840 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7ac055320 con 0x7fc7b4067e50 2023-10-09T11:36:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 msgr2=0x7fc7940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 0x7fc7940693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40afbc0 tx=0x7fc79c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 msgr2=0x7fc7b4152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d860 tx=0x7fc7ac008040 comp rx=0 tx=0).stop 2023-10-09T11:36:37.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 shutdown_connections 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b40c8c70 0x7fc7b415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b4067e50 0x7fc7b4152a30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc794066f30 0x7fc7940693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 --2- 172.21.15.26:0/3020359840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b4068220 0x7fc7b40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 >> 172.21.15.26:0/3020359840 conn(0x7fc7b40ce4a0 msgr2=0x7fc7b41538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 shutdown_connections 2023-10-09T11:36:37.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.060+0000 7fc7b98b2700 1 -- 172.21.15.26:0/3020359840 wait complete. 2023-10-09T11:36:37.064 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:36:37.076 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:36:37.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.201+0000 7f6ab5c65700 1 Processor -- start 2023-10-09T11:36:37.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.201+0000 7f6ab5c65700 1 -- start start 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6ab5c65700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ab00ca2c0 0x7f6ab00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6ab5c65700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00c32a0 con 0x7f6ab00ccba0 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6ab5c65700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00c4100 con 0x7f6ab0157930 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6ab5c65700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00c9730 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6aaeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ab00ca2c0 0x7f6ab00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6aaffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6ab00ccba0 0x7f6ab00c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49420/0 (socket says 172.21.15.26:49420) 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.202+0000 7f6aaffff700 1 -- 172.21.15.26:0/3893227124 learned_addr learned my addr 172.21.15.26:0/3893227124 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aaeffd700 1 -- 172.21.15.26:0/3893227124 >> v1:172.21.15.67:6789/0 conn(0x7f6ab0157930 legacy=0x7f6ab00ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aaeffd700 1 -- 172.21.15.26:0/3893227124 >> v1:172.21.15.26:6789/0 conn(0x7f6ab00ccba0 legacy=0x7f6ab00c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aaeffd700 1 -- 172.21.15.26:0/3893227124 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00c34f0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aae7fc700 1 -- 172.21.15.26:0/3893227124 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065937624 0 0) 0x7f6ab00c32a0 con 0x7f6ab00ccba0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aaeffd700 1 --2- 172.21.15.26:0/3893227124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00ca730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f77dce74eb2b020 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aae7fc700 1 -- 172.21.15.26:0/3893227124 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4009e80 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aae7fc700 1 -- 172.21.15.26:0/3893227124 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa400b860 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.203+0000 7f6aae7fc700 1 -- 172.21.15.26:0/3893227124 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa400bbe0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 -- 172.21.15.26:0/3893227124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 msgr2=0x7f6ab00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/3893227124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00ca730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 -- 172.21.15.26:0/3893227124 shutdown_connections 2023-10-09T11:36:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/3893227124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00ca730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 -- 172.21.15.26:0/3893227124 >> 172.21.15.26:0/3893227124 conn(0x7f6ab0088000 msgr2=0x7f6ab00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 -- 172.21.15.26:0/3893227124 shutdown_connections 2023-10-09T11:36:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.204+0000 7f6ab5c65700 1 -- 172.21.15.26:0/3893227124 wait complete. 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.205+0000 7f6ab5c65700 1 Processor -- start 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.205+0000 7f6ab5c65700 1 -- start start 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 0x7f6ab0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 0x7f6ab00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab006dc10 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab006d8e0 con 0x7f6ab0157930 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c5730 con 0x7f6ab00ccba0 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59224/0 (socket says 172.21.15.26:59224) 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 -- 172.21.15.26:0/1030998787 learned_addr learned my addr 172.21.15.26:0/1030998787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaffff700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 0x7f6ab00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaeffd700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 0x7f6ab0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 -- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 msgr2=0x7f6ab0068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 0x7f6ab0068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 -- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 msgr2=0x7f6ab00693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 0x7f6ab00693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 -- 172.21.15.26:0/1030998787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009420 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaffff700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 0x7f6ab00693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaeffd700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 0x7f6ab0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6aaf7fe700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c590 tx=0x7f6aa000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0011590 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa00116f0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00c5a10 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0011ab0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.206+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00ad330 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.208+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab004c3c0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.208+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6aa001b3b0 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.208+0000 7f6a977fe700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 0x7f6a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.208+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6aa0083840 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.209+0000 7f6aaeffd700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 0x7f6a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.209+0000 7f6aaeffd700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 0x7f6a9c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00b3b60 tx=0x7f6aa4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.213+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aa0050d50 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.420+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6ab00acf50 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.424+0000 7f6a977fe700 1 -- 172.21.15.26:0/1030998787 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6aa0017020 con 0x7f6ab00ca2c0 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 msgr2=0x7f6a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 0x7f6a9c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00b3b60 tx=0x7f6aa4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 msgr2=0x7f6ab00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c590 tx=0x7f6aa000c950 comp rx=0 tx=0).stop 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 shutdown_connections 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab0157930 0x7f6ab00693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab00ca2c0 0x7f6ab00c7cb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a9c066f30 0x7f6a9c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 --2- 172.21.15.26:0/1030998787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ab00ccba0 0x7f6ab0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 >> 172.21.15.26:0/1030998787 conn(0x7f6ab0088000 msgr2=0x7f6ab00c9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 shutdown_connections 2023-10-09T11:36:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.426+0000 7f6ab5c65700 1 -- 172.21.15.26:0/1030998787 wait complete. 2023-10-09T11:36:37.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-09T11:36:37.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.557+0000 7f4b527c3700 1 Processor -- start 2023-10-09T11:36:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.557+0000 7f4b527c3700 1 -- start start 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b527c3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b4c0cb970 0x7f4b4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b527c3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b527c3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c15ae40 con 0x7f4b4c0cb5a0 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b527c3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ce0f0 con 0x7f4b4c0cb970 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b527c3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0d13f0 con 0x7f4b4c15a400 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b4c0cb5a0 0x7f4b4c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49426/0 (socket says 172.21.15.26:49426) 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b4c0cb970 0x7f4b4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4bfff700 1 -- 172.21.15.26:0/1383683355 learned_addr learned my addr 172.21.15.26:0/1383683355 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b50d60700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4affd700 1 -- 172.21.15.26:0/1383683355 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055043761 0 0) 0x7f4b4c15ae40 con 0x7f4b4c0cb5a0 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4affd700 1 -- 172.21.15.26:0/1383683355 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b38003570 con 0x7f4b4c0cb5a0 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/1383683355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 msgr2=0x7f4b4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/1383683355 >> v1:172.21.15.26:6789/0 conn(0x7f4b4c0cb5a0 legacy=0x7f4b4c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/1383683355 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c15ab60 con 0x7f4b4c0cb970 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c159ec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098e0 tx=0x7f4b3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bad03c2a918d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.558+0000 7f4b4affd700 1 -- 172.21.15.26:0/1383683355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00b640 con 0x7f4b4c0cb970 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b4affd700 1 -- 172.21.15.26:0/1383683355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00b7a0 con 0x7f4b4c0cb970 2023-10-09T11:36:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b4affd700 1 -- 172.21.15.26:0/1383683355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00bb40 con 0x7f4b4c0cb970 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 -- 172.21.15.26:0/1383683355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 msgr2=0x7f4b4c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c159ec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098e0 tx=0x7f4b3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 -- 172.21.15.26:0/1383683355 shutdown_connections 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 --2- 172.21.15.26:0/1383683355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c159ec0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 -- 172.21.15.26:0/1383683355 >> 172.21.15.26:0/1383683355 conn(0x7f4b4c070e30 msgr2=0x7f4b4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 -- 172.21.15.26:0/1383683355 shutdown_connections 2023-10-09T11:36:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.559+0000 7f4b527c3700 1 -- 172.21.15.26:0/1383683355 wait complete. 2023-10-09T11:36:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.560+0000 7f4b527c3700 1 Processor -- start 2023-10-09T11:36:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.560+0000 7f4b527c3700 1 -- start start 2023-10-09T11:36:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 0x7f4b4c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1595b0 con 0x7f4b4c0cb970 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c159a40 con 0x7f4b4c0cb5a0 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b527c3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1589a0 con 0x7f4b4c15a400 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59244/0 (socket says 172.21.15.26:59244) 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/3730281345 learned_addr learned my addr 172.21.15.26:0/3730281345 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 0x7f4b4c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b50d60700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 msgr2=0x7f4b4c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c15d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 msgr2=0x7f4b4c0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 0x7f4b4c0b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/3730281345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009420 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.561+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 0x7f4b4c0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c06ea60 tx=0x7f4b3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c01bda0 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c011420 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c158c80 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0117e0 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.562+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c159240 con 0x7f4b4c0cb970 2023-10-09T11:36:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.563+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c159720 con 0x7f4b4c0cb970 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.563+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b3c011b90 con 0x7f4b4c0cb970 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.564+0000 7f4b43fff700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.564+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4b3c085980 con 0x7f4b4c0cb970 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.564+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.564+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 0x7f4b2c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b34007fd0 tx=0x7f4b34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.568+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b3c052e90 con 0x7f4b4c0cb970 2023-10-09T11:36:37.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:37.842+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f4b4c04c3c0 con 0x7f4b4c0cb970 2023-10-09T11:36:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.062+0000 7f4b43fff700 1 -- 172.21.15.26:0/3730281345 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v93) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4b3c0564b0 con 0x7f4b4c0cb970 2023-10-09T11:36:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 msgr2=0x7f4b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 0x7f4b2c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b34007fd0 tx=0x7f4b34009040 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 msgr2=0x7f4b4c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c06ea60 tx=0x7f4b3c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 shutdown_connections 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b2c066f30 0x7f4b2c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b4c15a400 0x7f4b4c15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b4c0cb5a0 0x7f4b4c0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 --2- 172.21.15.26:0/3730281345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c0cb970 0x7f4b4c158030 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 >> 172.21.15.26:0/3730281345 conn(0x7f4b4c070e30 msgr2=0x7f4b4c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 shutdown_connections 2023-10-09T11:36:38.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.065+0000 7f4b527c3700 1 -- 172.21.15.26:0/3730281345 wait complete. 2023-10-09T11:36:38.078 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-09T11:36:38.079 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-09T11:36:38.079 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:36:38.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-09T11:36:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.197+0000 7f58412c9700 1 Processor -- start 2023-10-09T11:36:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.197+0000 7f58412c9700 1 -- start start 2023-10-09T11:36:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f58412c9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f583c1595d0 0x7f583c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f58412c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f583c067a40 0x7f583c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f58412c9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0c7f50 con 0x7f583c0675a0 2023-10-09T11:36:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f58412c9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c06bd00 con 0x7f583c067a40 2023-10-09T11:36:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f58412c9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c06b740 con 0x7f583c1595d0 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f583c067a40 0x7f583c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f583c067a40 0x7f583c0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59256/0 (socket says 172.21.15.26:59256) 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 -- 172.21.15.26:0/2357541380 learned_addr learned my addr 172.21.15.26:0/2357541380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583affd700 1 --2- 172.21.15.26:0/2357541380 >> v2:172.21.15.67:3300/0 conn(0x7f583c1595d0 0x7f583c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 -- 172.21.15.26:0/2357541380 >> v2:172.21.15.67:3300/0 conn(0x7f583c1595d0 msgr2=0x7f583c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 --2- 172.21.15.26:0/2357541380 >> v2:172.21.15.67:3300/0 conn(0x7f583c1595d0 0x7f583c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.198+0000 7f583b7fe700 1 -- 172.21.15.26:0/2357541380 >> v1:172.21.15.67:6789/0 conn(0x7f583c0675a0 legacy=0x7f583c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f583b7fe700 1 -- 172.21.15.26:0/2357541380 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c06ba20 con 0x7f583c067a40 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f583b7fe700 1 --2- 172.21.15.26:0/2357541380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c0c83e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f583c06a700 tx=0x7f582c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23d3faedd4db99b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f5839ffb700 1 -- 172.21.15.26:0/2357541380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00b820 con 0x7f583c067a40 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f5839ffb700 1 -- 172.21.15.26:0/2357541380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00b980 con 0x7f583c067a40 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f5839ffb700 1 -- 172.21.15.26:0/2357541380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00bd20 con 0x7f583c067a40 2023-10-09T11:36:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 -- 172.21.15.26:0/2357541380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 msgr2=0x7f583c0c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 --2- 172.21.15.26:0/2357541380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c0c83e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f583c06a700 tx=0x7f582c009250 comp rx=0 tx=0).stop 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 -- 172.21.15.26:0/2357541380 shutdown_connections 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 --2- 172.21.15.26:0/2357541380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c0c83e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 --2- 172.21.15.26:0/2357541380 >> v2:172.21.15.67:3300/0 conn(0x7f583c1595d0 0x7f583c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 -- 172.21.15.26:0/2357541380 >> 172.21.15.26:0/2357541380 conn(0x7f583c0cd400 msgr2=0x7f583c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 -- 172.21.15.26:0/2357541380 shutdown_connections 2023-10-09T11:36:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.199+0000 7f58412c9700 1 -- 172.21.15.26:0/2357541380 wait complete. 2023-10-09T11:36:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.201+0000 7f58412c9700 1 Processor -- start 2023-10-09T11:36:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.201+0000 7f58412c9700 1 -- start start 2023-10-09T11:36:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.201+0000 7f58412c9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 0x7f583c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.201+0000 7f58412c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.201+0000 7f58412c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 0x7f583c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f58412c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c60b0 con 0x7f583c067a40 2023-10-09T11:36:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f58412c9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c15f990 con 0x7f583c1595d0 2023-10-09T11:36:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f58412c9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c54a0 con 0x7f583c0675a0 2023-10-09T11:36:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59264/0 (socket says 172.21.15.26:59264) 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 -- 172.21.15.26:0/1002810535 learned_addr learned my addr 172.21.15.26:0/1002810535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583affd700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 0x7f583c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583b7fe700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 0x7f583c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 -- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 msgr2=0x7f583c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 0x7f583c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 -- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 msgr2=0x7f583c15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 0x7f583c15f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 -- 172.21.15.26:0/1002810535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094f0 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583b7fe700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 0x7f583c15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583affd700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 0x7f583c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f583a7fc700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f582400c5d0 tx=0x7f5824007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011590 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824011710 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011ad0 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c0c5780 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.202+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c0c5d40 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.203+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c04c3c0 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.204+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f582401c460 con 0x7f583c067a40 2023-10-09T11:36:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.204+0000 7f5832ffd700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 0x7f581c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.204+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5824084090 con 0x7f583c067a40 2023-10-09T11:36:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.204+0000 7f583affd700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 0x7f581c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.205+0000 7f583affd700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 0x7f581c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5834007460 tx=0x7f583400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.208+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58240515a0 con 0x7f583c067a40 2023-10-09T11:36:38.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:38.481+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f583c0c7be0 con 0x7f583c067a40 2023-10-09T11:36:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.064+0000 7f5832ffd700 1 -- 172.21.15.26:0/1002810535 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v94) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5824054bc0 con 0x7f583c067a40 2023-10-09T11:36:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.066+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 msgr2=0x7f581c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.066+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 0x7f581c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5834007460 tx=0x7f583400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.066+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 msgr2=0x7f583c155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.066+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f582400c5d0 tx=0x7f5824007f60 comp rx=0 tx=0).stop 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 shutdown_connections 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f583c1595d0 0x7f583c15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f581c066f30 0x7f581c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f583c0675a0 0x7f583c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 --2- 172.21.15.26:0/1002810535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f583c067a40 0x7f583c155260 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 >> 172.21.15.26:0/1002810535 conn(0x7f583c0cd400 msgr2=0x7f583c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 shutdown_connections 2023-10-09T11:36:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.067+0000 7f58412c9700 1 -- 172.21.15.26:0/1002810535 wait complete. 2023-10-09T11:36:39.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:36:39.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.208+0000 7f351a1c4700 1 Processor -- start 2023-10-09T11:36:39.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.208+0000 7f351a1c4700 1 -- start start 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f351a1c4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f3514159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f351a1c4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f351406cdb0 0x7f351406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f351a1c4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351406f300 con 0x7f351406e950 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f351a1c4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140c71a0 con 0x7f351406cdb0 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f351a1c4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c7a40 con 0x7f35141597e0 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f3512ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f351406e950 0x7f351406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49432/0 (socket says 172.21.15.26:49432) 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f3512ffd700 1 -- 172.21.15.26:0/830217748 learned_addr learned my addr 172.21.15.26:0/830217748 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942704638 0 0) 0x7f351406f300 con 0x7f351406e950 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35137fe700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f3514159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3500003570 con 0x7f351406e950 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f3513fff700 1 --2- 172.21.15.26:0/830217748 >> v2:172.21.15.67:3300/0 conn(0x7f351406cdb0 0x7f351406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093184152 0 0) 0x7f3500003570 con 0x7f351406e950 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 msgr2=0x7f3514159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f3514159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 >> v2:172.21.15.67:3300/0 conn(0x7f351406cdb0 msgr2=0x7f351406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 --2- 172.21.15.26:0/830217748 >> v2:172.21.15.67:3300/0 conn(0x7f351406cdb0 0x7f351406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351406d3d0 con 0x7f351406e950 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f34fc001470 con 0x7f351406e950 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 >> v1:172.21.15.26:6789/0 conn(0x7f351406e950 legacy=0x7f351406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3500003a60 0x7f3500003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3500004810 0x7f3500004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f35000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c71a0 con 0x7f3500003a60 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c7a40 con 0x7f3500004810 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.209+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350000bae0 con 0x7f35141597e0 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f3513fff700 1 --2- 172.21.15.26:0/830217748 >> v2:172.21.15.67:3300/0 conn(0x7f351406cdb0 0x7f351406edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3500003a60 0x7f3500003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f3512ffd700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3500004810 0x7f3500004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f3513fff700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f35000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 -- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 msgr2=0x7f35000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35141597e0 0x7f35000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 -- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3500004810 msgr2=0x7f3500004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3500004810 0x7f3500004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 -- 172.21.15.26:0/830217748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500003570 con 0x7f3500003a60 2023-10-09T11:36:39.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35137fe700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3500003a60 0x7f3500003e70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f350400e2d0 tx=0x7f350400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e7d6a47fdd98a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400eb20 con 0x7f3500003a60 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400f040 con 0x7f3500003a60 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.210+0000 7f35127fc700 1 -- 172.21.15.26:0/830217748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400eed0 con 0x7f3500003a60 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 -- 172.21.15.26:0/830217748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3500003a60 msgr2=0x7f3500003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 --2- 172.21.15.26:0/830217748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3500003a60 0x7f3500003e70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f350400e2d0 tx=0x7f350400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f3513fff700 1 -- 172.21.15.26:0/830217748 reap_dead start 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 -- 172.21.15.26:0/830217748 shutdown_connections 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 -- 172.21.15.26:0/830217748 >> 172.21.15.26:0/830217748 conn(0x7f35140ccb60 msgr2=0x7f35140ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 -- 172.21.15.26:0/830217748 shutdown_connections 2023-10-09T11:36:39.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.211+0000 7f351a1c4700 1 -- 172.21.15.26:0/830217748 wait complete. 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.212+0000 7f351a1c4700 1 Processor -- start 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.212+0000 7f351a1c4700 1 -- start start 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 0x7f351414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f351416cc80 0x7f351416d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351416d630 con 0x7f351414f6f0 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140b1290 con 0x7f351416cc80 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f351a1c4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35140b0680 con 0x7f3500003a60 2023-10-09T11:36:39.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59282/0 (socket says 172.21.15.26:59282) 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 -- 172.21.15.26:0/2606979829 learned_addr learned my addr 172.21.15.26:0/2606979829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3512ffd700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f351416cc80 0x7f351416d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f35137fe700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 0x7f351414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 -- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 msgr2=0x7f351414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 0x7f351414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 -- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f351416cc80 msgr2=0x7f351416d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f351416cc80 0x7f351416d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 -- 172.21.15.26:0/2606979829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140b0960 con 0x7f351414f6f0 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f35137fe700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 0x7f351414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.213+0000 7f3513fff700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f35140af670 tx=0x7f350c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c01b070 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c015670 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35140b0c40 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00c070 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351414ece0 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.214+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351404c3c0 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.215+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f350c015cc0 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.215+0000 7f350b7fe700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 0x7f34f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.215+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f350c083e10 con 0x7f351414f6f0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.216+0000 7f35137fe700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 0x7f34f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.216+0000 7f35137fe700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 0x7f34f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f350400e2d0 tx=0x7f350401a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.220+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f350c051320 con 0x7f351414f6f0 2023-10-09T11:36:39.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.414+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f351414f3a0 con 0x7f351414f6f0 2023-10-09T11:36:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.417+0000 7f350b7fe700 1 -- 172.21.15.26:0/2606979829 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f350c054940 con 0x7f351414f6f0 2023-10-09T11:36:39.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 msgr2=0x7f34f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 0x7f34f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f350400e2d0 tx=0x7f350401a000 comp rx=0 tx=0).stop 2023-10-09T11:36:39.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 msgr2=0x7f351414fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f35140af670 tx=0x7f350c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 shutdown_connections 2023-10-09T11:36:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f351414f6f0 0x7f351414fb60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f34f4066f30 0x7f34f40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3500003a60 0x7f351414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 --2- 172.21.15.26:0/2606979829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f351416cc80 0x7f351416d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 >> 172.21.15.26:0/2606979829 conn(0x7f35140ccb60 msgr2=0x7f35140cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 shutdown_connections 2023-10-09T11:36:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.419+0000 7f351a1c4700 1 -- 172.21.15.26:0/2606979829 wait complete. 2023-10-09T11:36:39.433 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:36:39.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:39.477 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:39.529 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:36:39.529 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:36:39.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.647+0000 7fc35bdfa700 1 Processor -- start 2023-10-09T11:36:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.647+0000 7fc35bdfa700 1 -- start start 2023-10-09T11:36:39.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35bdfa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3540cb970 0x7fc354159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35bdfa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 0x7fc354156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35bdfa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35415ae40 con 0x7fc3540cb5a0 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35bdfa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3540ce0f0 con 0x7fc3540cb970 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35bdfa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540d13f0 con 0x7fc35415a400 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc359395700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3540cb970 0x7fc354159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc359395700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3540cb970 0x7fc354159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59286/0 (socket says 172.21.15.26:59286) 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc359395700 1 -- 172.21.15.26:0/1659410137 learned_addr learned my addr 172.21.15.26:0/1659410137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.648+0000 7fc35a397700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 0x7fc354156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc359395700 1 -- 172.21.15.26:0/1659410137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 msgr2=0x7fc354156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc359395700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 0x7fc354156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc359395700 1 -- 172.21.15.26:0/1659410137 >> v1:172.21.15.67:6789/0 conn(0x7fc3540cb5a0 legacy=0x7fc3540cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc359395700 1 -- 172.21.15.26:0/1659410137 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35415ab60 con 0x7fc3540cb970 2023-10-09T11:36:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc35a397700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 0x7fc354156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc359395700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3540cb970 0x7fc354159ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc3480099b0 tx=0x7fc348009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734a5b77e04e9731 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc358b94700 1 -- 172.21.15.26:0/1659410137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800b860 con 0x7fc3540cb970 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc358b94700 1 -- 172.21.15.26:0/1659410137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34800b9c0 con 0x7fc3540cb970 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc358b94700 1 -- 172.21.15.26:0/1659410137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800bd60 con 0x7fc3540cb970 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc35bdfa700 1 -- 172.21.15.26:0/1659410137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3540cb970 msgr2=0x7fc354159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3540cb970 0x7fc354159ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc3480099b0 tx=0x7fc348009250 comp rx=0 tx=0).stop 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.649+0000 7fc35bdfa700 1 -- 172.21.15.26:0/1659410137 shutdown_connections 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.650+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35415a400 0x7fc354156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.650+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/1659410137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3540cb970 0x7fc354159ec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.650+0000 7fc35bdfa700 1 -- 172.21.15.26:0/1659410137 >> 172.21.15.26:0/1659410137 conn(0x7fc354070e30 msgr2=0x7fc3540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.650+0000 7fc35bdfa700 1 -- 172.21.15.26:0/1659410137 shutdown_connections 2023-10-09T11:36:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.650+0000 7fc35bdfa700 1 -- 172.21.15.26:0/1659410137 wait complete. 2023-10-09T11:36:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 Processor -- start 2023-10-09T11:36:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 -- start start 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 0x7fc354154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3540cb970 0x7fc354155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541583b0 con 0x7fc35415a400 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541577a0 con 0x7fc3540cb970 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.651+0000 7fc35bdfa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc354157a80 con 0x7fc3540cb5a0 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51520/0 (socket says 172.21.15.26:51520) 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 -- 172.21.15.26:0/4101544923 learned_addr learned my addr 172.21.15.26:0/4101544923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc359395700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3540cb970 0x7fc354155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc359b96700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 0x7fc354154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 -- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 msgr2=0x7fc354154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 0x7fc354154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 -- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3540cb970 msgr2=0x7fc354155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3540cb970 0x7fc354155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 -- 172.21.15.26:0/4101544923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480094f0 con 0x7fc35415a400 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc359b96700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 0x7fc354154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35a397700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc344009fc0 tx=0x7fc3440099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400dc90 con 0x7fc35415a400 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400f040 con 0x7fc35415a400 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc354157d60 con 0x7fc35415a400 2023-10-09T11:36:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344015690 con 0x7fc35415a400 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.652+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3541504d0 con 0x7fc35415a400 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.653+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354158520 con 0x7fc35415a400 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.654+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc34401e3b0 con 0x7fc35415a400 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.654+0000 7fc351ffb700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.654+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc344084750 con 0x7fc35415a400 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.654+0000 7fc359b96700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.655+0000 7fc359b96700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 0x7fc3400693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007fd0 tx=0x7fc34c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.658+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc344051c60 con 0x7fc35415a400 2023-10-09T11:36:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.896+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc35404c3c0 con 0x7fc35415a400 2023-10-09T11:36:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.896+0000 7fc351ffb700 1 -- 172.21.15.26:0/4101544923 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fc34401ade0 con 0x7fc35415a400 2023-10-09T11:36:39.898 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:39.898 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3143021600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3143021600},{"type":"v1","addr":"172.21.15.67:6836","nonce":3143021600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4231914483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4231914483},{"type":"v1","addr":"172.21.15.67:6837","nonce":4231914483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/890752364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":890752364},{"type":"v1","addr":"172.21.15.26:6834","nonce":890752364}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1347580543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1347580543},{"type":"v1","addr":"172.21.15.26:6835","nonce":1347580543}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 msgr2=0x7fc3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 0x7fc3400693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007fd0 tx=0x7fc34c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 msgr2=0x7fc354155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc344009fc0 tx=0x7fc3440099b0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 shutdown_connections 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35415a400 0x7fc354155ac0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3540cb5a0 0x7fc354154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 --2- 172.21.15.26:0/4101544923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3540cb970 0x7fc354155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 >> 172.21.15.26:0/4101544923 conn(0x7fc354070e30 msgr2=0x7fc3540b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 shutdown_connections 2023-10-09T11:36:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:39.898+0000 7fc35bdfa700 1 -- 172.21.15.26:0/4101544923 wait complete. 2023-10-09T11:36:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 24 2023-10-09T11:36:39.912 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:36:39.912 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:36:39.912 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:36:39.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:39.913 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:36:39.913 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:36:39.913 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:36:39.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:39.913 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:36:39.913 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:36:39.913 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:36:39.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:39.914 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:36:39.914 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:36:39.914 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:36:39.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:39.921 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:36:39.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:36:39.922 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:36:39.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:36:39.925 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:36:39.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:36:39.926 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:36:39.926 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:36:39.963 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:36:39.964 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:39.964 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:36:39.964 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:39.967 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:36:39.967 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:39.968 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:36:39.968 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:39.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:36:40.040 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:36:40.040 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:36:40.051 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:36:40.051 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:36:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.096+0000 7f568cbab700 1 Processor -- start 2023-10-09T11:36:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.096+0000 7f568cbab700 1 -- start start 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568cbab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56880cb5a0 0x7f56880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568cbab700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f56880cd9e0 0x7f5688159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568cbab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568815ae40 con 0x7f568815a400 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568cbab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880d13f0 con 0x7f56880cb5a0 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568cbab700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568815ab60 con 0x7f56880cd9e0 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56880cb5a0 0x7f56880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f5686d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f568815a400 0x7f5688156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55340/0 (socket says 172.21.15.26:55340) 2023-10-09T11:36:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f5686d9d700 1 -- 172.21.15.26:0/2414492881 learned_addr learned my addr 172.21.15.26:0/2414492881 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f5685d9b700 1 --2- 172.21.15.26:0/2414492881 >> v2:172.21.15.67:3300/0 conn(0x7f56880cd9e0 0x7f5688159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 -- 172.21.15.26:0/2414492881 >> v2:172.21.15.67:3300/0 conn(0x7f56880cd9e0 msgr2=0x7f5688159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 --2- 172.21.15.26:0/2414492881 >> v2:172.21.15.67:3300/0 conn(0x7f56880cd9e0 0x7f5688159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 -- 172.21.15.26:0/2414492881 >> v1:172.21.15.26:6789/0 conn(0x7f568815a400 legacy=0x7f5688156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568559a700 1 -- 172.21.15.26:0/2414492881 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099828133 0 0) 0x7f568815ae40 con 0x7f568815a400 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 -- 172.21.15.26:0/2414492881 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880ccf00 con 0x7f56880cb5a0 2023-10-09T11:36:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568659c700 1 --2- 172.21.15.26:0/2414492881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f56880cb970 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f56780098e0 tx=0x7f56780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9626e8f15076d9d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.097+0000 7f568559a700 1 -- 172.21.15.26:0/2414492881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678011630 con 0x7f56880cb5a0 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568559a700 1 -- 172.21.15.26:0/2414492881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678011790 con 0x7f56880cb5a0 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568559a700 1 -- 172.21.15.26:0/2414492881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678011b30 con 0x7f56880cb5a0 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 -- 172.21.15.26:0/2414492881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 msgr2=0x7f56880cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 --2- 172.21.15.26:0/2414492881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f56880cb970 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f56780098e0 tx=0x7f56780091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 -- 172.21.15.26:0/2414492881 shutdown_connections 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 --2- 172.21.15.26:0/2414492881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f56880cb970 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 --2- 172.21.15.26:0/2414492881 >> v2:172.21.15.67:3300/0 conn(0x7f56880cd9e0 0x7f5688159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 -- 172.21.15.26:0/2414492881 >> 172.21.15.26:0/2414492881 conn(0x7f5688070e30 msgr2=0x7f56880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 -- 172.21.15.26:0/2414492881 shutdown_connections 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.098+0000 7f568cbab700 1 -- 172.21.15.26:0/2414492881 wait complete. 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.099+0000 7f568cbab700 1 Processor -- start 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.099+0000 7f568cbab700 1 -- start start 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56880cd9e0 0x7f56880b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f568815a400 0x7f56880b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880c77c0 con 0x7f56880cb5a0 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880c7aa0 con 0x7f56880cd9e0 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568cbab700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56880c7d80 con 0x7f568815a400 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51572/0 (socket says 172.21.15.26:51572) 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 -- 172.21.15.26:0/4239047858 learned_addr learned my addr 172.21.15.26:0/4239047858 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f5685d9b700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56880cd9e0 0x7f56880b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f5686d9d700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f568815a400 0x7f56880b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 -- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f568815a400 msgr2=0x7f56880b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f568815a400 0x7f56880b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 -- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56880cd9e0 msgr2=0x7f56880b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56880cd9e0 0x7f56880b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.100+0000 7f568659c700 1 -- 172.21.15.26:0/4239047858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678009420 con 0x7f56880cb5a0 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f568659c700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56780091e0 tx=0x7f5678017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678000d10 con 0x7f56880cb5a0 2023-10-09T11:36:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678011900 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56880c8060 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678025690 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.101+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56880c7380 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.102+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568804c3c0 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.102+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5678023070 con 0x7f56880cb5a0 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.102+0000 7f56767fc700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 0x7f56680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.103+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5678085770 con 0x7f56880cb5a0 2023-10-09T11:36:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.103+0000 7f5685d9b700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 0x7f56680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.103+0000 7f5685d9b700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 0x7f56680693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f567c009db0 tx=0x7f567c0091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.107+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5678052c80 con 0x7f56880cb5a0 2023-10-09T11:36:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:40.320+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f56880cd1e0 con 0x7f56880cb5a0 2023-10-09T11:36:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.075+0000 7f56767fc700 1 -- 172.21.15.26:0/4239047858 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56780562a0 con 0x7f56880cb5a0 2023-10-09T11:36:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 msgr2=0x7f56680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 0x7f56680693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f567c009db0 tx=0x7f567c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 msgr2=0x7f568815f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56780091e0 tx=0x7f5678017000 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 shutdown_connections 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5668066f30 0x7f56680693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f568815a400 0x7f56880b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56880cb5a0 0x7f568815f9d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 --2- 172.21.15.26:0/4239047858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56880cd9e0 0x7f56880b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 >> 172.21.15.26:0/4239047858 conn(0x7f5688070e30 msgr2=0x7f56880b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 shutdown_connections 2023-10-09T11:36:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.078+0000 7f568cbab700 1 -- 172.21.15.26:0/4239047858 wait complete. 2023-10-09T11:36:41.081 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:36:41.093 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:36:41.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.215+0000 7f2f0c22c700 1 Processor -- start 2023-10-09T11:36:41.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 -- start start 2023-10-09T11:36:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f040cb5a0 0x7f2f040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415a5d0 0x7f2f04156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0415ae40 con 0x7f2f040cd9e0 2023-10-09T11:36:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040d13f0 con 0x7f2f040cb5a0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.216+0000 7f2f0c22c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415ab60 con 0x7f2f0415a5d0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f040cb5a0 0x7f2f040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f040cb5a0 0x7f2f040cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51580/0 (socket says 172.21.15.26:51580) 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 -- 172.21.15.26:0/2218497604 learned_addr learned my addr 172.21.15.26:0/2218497604 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f0a7c9700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415a5d0 0x7f2f04156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 -- 172.21.15.26:0/2218497604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415a5d0 msgr2=0x7f2f04156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415a5d0 0x7f2f04156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 -- 172.21.15.26:0/2218497604 >> v1:172.21.15.67:6789/0 conn(0x7f2f040cd9e0 legacy=0x7f2f04159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 -- 172.21.15.26:0/2218497604 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040ccf00 con 0x7f2f040cb5a0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f09fc8700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f040cb5a0 0x7f2f040cb970 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009f50 tx=0x7f2efc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17c71c75c3571f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f08fc6700 1 -- 172.21.15.26:0/2218497604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00e070 con 0x7f2f040cb5a0 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f08fc6700 1 -- 172.21.15.26:0/2218497604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00ba70 con 0x7f2f040cb5a0 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.217+0000 7f2f08fc6700 1 -- 172.21.15.26:0/2218497604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0092e0 con 0x7f2f040cb5a0 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 -- 172.21.15.26:0/2218497604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f040cb5a0 msgr2=0x7f2f040cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f040cb5a0 0x7f2f040cb970 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009f50 tx=0x7f2efc009840 comp rx=0 tx=0).stop 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 -- 172.21.15.26:0/2218497604 shutdown_connections 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415a5d0 0x7f2f04156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/2218497604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f040cb5a0 0x7f2f040cb970 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 -- 172.21.15.26:0/2218497604 >> 172.21.15.26:0/2218497604 conn(0x7f2f04070e30 msgr2=0x7f2f040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 -- 172.21.15.26:0/2218497604 shutdown_connections 2023-10-09T11:36:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.218+0000 7f2f0c22c700 1 -- 172.21.15.26:0/2218497604 wait complete. 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.219+0000 7f2f0c22c700 1 Processor -- start 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.219+0000 7f2f0c22c700 1 -- start start 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f040cb5a0 0x7f2f04153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 0x7f2f040b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040b59b0 con 0x7f2f0415a5d0 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040b5110 con 0x7f2f040cb5a0 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0c22c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040b53f0 con 0x7f2f040cd9e0 2023-10-09T11:36:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51596/0 (socket says 172.21.15.26:51596) 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 -- 172.21.15.26:0/3419896210 learned_addr learned my addr 172.21.15.26:0/3419896210 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f09fc8700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f040cb5a0 0x7f2f04153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f097c7700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 0x7f2f040b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 -- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 msgr2=0x7f2f040b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 0x7f2f040b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 -- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f040cb5a0 msgr2=0x7f2f04153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f040cb5a0 0x7f2f04153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 -- 172.21.15.26:0/3419896210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009ae0 con 0x7f2f0415a5d0 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f097c7700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 0x7f2f040b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.220+0000 7f2f0a7c9700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d860 tx=0x7f2ef4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.221+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40125f0 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.221+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4012750 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.221+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f040b56d0 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.221+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012b10 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.221+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0415de20 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.222+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ef401e460 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.222+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0415b070 con 0x7f2f0415a5d0 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.223+0000 7f2f01ffb700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.223+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2ef40848e0 con 0x7f2f0415a5d0 2023-10-09T11:36:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.223+0000 7f2f09fc8700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.223+0000 7f2f09fc8700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 0x7f2ef00693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009880 tx=0x7f2efc018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.227+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f0415b070 con 0x7f2f0415a5d0 2023-10-09T11:36:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.497+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2f0415b450 con 0x7f2f0415a5d0 2023-10-09T11:36:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.497+0000 7f2f01ffb700 1 -- 172.21.15.26:0/3419896210 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2f0415b450 con 0x7f2f0415a5d0 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.499 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.503 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.504 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:36:41.505 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.506 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:36:41.508 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:36:41.509 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.510 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.511 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:36:41.512 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:41.513 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:41.514 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:36:41.515 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:36:41.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 msgr2=0x7f2ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 0x7f2ef00693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009880 tx=0x7f2efc018000 comp rx=0 tx=0).stop 2023-10-09T11:36:41.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 msgr2=0x7f2f04158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d860 tx=0x7f2ef4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:41.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 shutdown_connections 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f0415a5d0 0x7f2f04158db0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f040cb5a0 0x7f2f04153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 --2- 172.21.15.26:0/3419896210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f040cd9e0 0x7f2f040b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 >> 172.21.15.26:0/3419896210 conn(0x7f2f04070e30 msgr2=0x7f2f040b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 shutdown_connections 2023-10-09T11:36:41.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.499+0000 7f2f0c22c700 1 -- 172.21.15.26:0/3419896210 wait complete. 2023-10-09T11:36:41.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:41.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.634+0000 7fe0e92d6700 1 Processor -- start 2023-10-09T11:36:41.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 -- start start 2023-10-09T11:36:41.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0e40b07d0 0x7fe0e40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0e40b0ba0 0x7fe0e40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e415a280 con 0x7fe0e40cf200 2023-10-09T11:36:41.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e406e180 con 0x7fe0e40b07d0 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.635+0000 7fe0e92d6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e406d850 con 0x7fe0e40b0ba0 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0e40b07d0 0x7fe0e40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e27fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe0e40cf200 0x7fe0e406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55350/0 (socket says 172.21.15.26:55350) 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e27fc700 1 -- 172.21.15.26:0/3226355466 learned_addr learned my addr 172.21.15.26:0/3226355466 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e37fe700 1 --2- 172.21.15.26:0/3226355466 >> v2:172.21.15.67:3300/0 conn(0x7fe0e40b0ba0 0x7fe0e40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 -- 172.21.15.26:0/3226355466 >> v2:172.21.15.67:3300/0 conn(0x7fe0e40b0ba0 msgr2=0x7fe0e40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 --2- 172.21.15.26:0/3226355466 >> v2:172.21.15.67:3300/0 conn(0x7fe0e40b0ba0 0x7fe0e40c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 -- 172.21.15.26:0/3226355466 >> v1:172.21.15.26:6789/0 conn(0x7fe0e40cf200 legacy=0x7fe0e406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e1ffb700 1 -- 172.21.15.26:0/3226355466 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743042469 0 0) 0x7fe0e415a280 con 0x7fe0e40cf200 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 -- 172.21.15.26:0/3226355466 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e406db30 con 0x7fe0e40b07d0 2023-10-09T11:36:41.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e2ffd700 1 --2- 172.21.15.26:0/3226355466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40b07d0 0x7fe0e40ccac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40637a0 tx=0x7fe0d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7b75c468f70af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e1ffb700 1 -- 172.21.15.26:0/3226355466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4005c10 con 0x7fe0e40b07d0 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e1ffb700 1 -- 172.21.15.26:0/3226355466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d4005d70 con 0x7fe0e40b07d0 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.636+0000 7fe0e1ffb700 1 -- 172.21.15.26:0/3226355466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4006260 con 0x7fe0e40b07d0 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3226355466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40b07d0 msgr2=0x7fe0e40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3226355466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40b07d0 0x7fe0e40ccac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40637a0 tx=0x7fe0d4009120 comp rx=0 tx=0).stop 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3226355466 shutdown_connections 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3226355466 >> v2:172.21.15.67:3300/0 conn(0x7fe0e40b0ba0 0x7fe0e40c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3226355466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40b07d0 0x7fe0e40ccac0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3226355466 >> 172.21.15.26:0/3226355466 conn(0x7fe0e406ce80 msgr2=0x7fe0e40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3226355466 shutdown_connections 2023-10-09T11:36:41.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.637+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3226355466 wait complete. 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.638+0000 7fe0e92d6700 1 Processor -- start 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.638+0000 7fe0e92d6700 1 -- start start 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0e40b07d0 0x7fe0e41448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e40b0ba0 0x7fe0e4142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4144df0 con 0x7fe0e40cf200 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4155890 con 0x7fe0e40b0ba0 2023-10-09T11:36:41.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e92d6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4154c90 con 0x7fe0e40b07d0 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51612/0 (socket says 172.21.15.26:51612) 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 -- 172.21.15.26:0/3965507551 learned_addr learned my addr 172.21.15.26:0/3965507551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e27fc700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e40b0ba0 0x7fe0e4142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 -- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0e40b07d0 msgr2=0x7fe0e41448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0e40b07d0 0x7fe0e41448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 -- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e40b0ba0 msgr2=0x7fe0e4142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e40b0ba0 0x7fe0e4142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 -- 172.21.15.26:0/3965507551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40093c0 con 0x7fe0e40cf200 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0e37fe700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009e90 tx=0x7fe0dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.639+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00cc20 con 0x7fe0e40cf200 2023-10-09T11:36:41.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.640+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00f040 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.640+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4154f60 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.640+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc014480 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.640+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4155520 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.640+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e404c3c0 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.641+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0dc014830 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.641+0000 7fe0daffd700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 0x7fe0c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.641+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe0dc084ec0 con 0x7fe0e40cf200 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.642+0000 7fe0e2ffd700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 0x7fe0c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.642+0000 7fe0e2ffd700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 0x7fe0c40693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009160 tx=0x7fe0d4016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.646+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0dc055f10 con 0x7fe0e40cf200 2023-10-09T11:36:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.838+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0e4141db0 con 0x7fe0e40cf200 2023-10-09T11:36:41.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.839+0000 7fe0daffd700 1 -- 172.21.15.26:0/3965507551 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12086 (secure 0 0 0) 0x7fe0e4141db0 con 0x7fe0e40cf200 2023-10-09T11:36:41.840 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:41.840 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":47,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:41.074274+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 msgr2=0x7fe0c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 0x7fe0c40693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009160 tx=0x7fe0d4016000 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 msgr2=0x7fe0e41425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009e90 tx=0x7fe0dc00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 shutdown_connections 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0e40cf200 0x7fe0e41425d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe0c4066f30 0x7fe0c40693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0e40b07d0 0x7fe0e41448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 --2- 172.21.15.26:0/3965507551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e40b0ba0 0x7fe0e4142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 >> 172.21.15.26:0/3965507551 conn(0x7fe0e406ce80 msgr2=0x7fe0e4140fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 shutdown_connections 2023-10-09T11:36:41.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.841+0000 7fe0e92d6700 1 -- 172.21.15.26:0/3965507551 wait complete. 2023-10-09T11:36:41.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:36:41.855 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.974+0000 7f86db143700 1 Processor -- start 2023-10-09T11:36:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.974+0000 7f86db143700 1 -- start start 2023-10-09T11:36:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86db143700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86d40684e0 0x7f86d40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86db143700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d4068320 con 0x7f86d40cd780 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86db143700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d415ae00 con 0x7f86d40cc910 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86db143700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d415a560 con 0x7f86d40684e0 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86d96e0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f86d40cd780 0x7f86d415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55360/0 (socket says 172.21.15.26:55360) 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.975+0000 7f86d96e0700 1 -- 172.21.15.26:0/571382693 learned_addr learned my addr 172.21.15.26:0/571382693 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d3fff700 1 --2- 172.21.15.26:0/571382693 >> v2:172.21.15.67:3300/0 conn(0x7f86d40684e0 0x7f86d40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211055872 0 0) 0x7f86cc001490 con 0x7f86d40cd780 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86bc003570 con 0x7f86d40cd780 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d3fff700 1 -- 172.21.15.26:0/571382693 >> v1:172.21.15.67:6789/0 conn(0x7f86d40cc910 legacy=0x7f86d4159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d3fff700 1 -- 172.21.15.26:0/571382693 >> v1:172.21.15.26:6789/0 conn(0x7f86d40cd780 legacy=0x7f86d415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222114035 0 0) 0x7f86c4001110 con 0x7f86d40cc910 2023-10-09T11:36:41.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d3fff700 1 -- 172.21.15.26:0/571382693 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d415a840 con 0x7f86d40684e0 2023-10-09T11:36:41.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d3fff700 1 --2- 172.21.15.26:0/571382693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40684e0 0x7f86d40cd240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098e0 tx=0x7f86c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=837c0ef37d853f4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800b640 con 0x7f86d40684e0 2023-10-09T11:36:41.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800b7a0 con 0x7f86d40684e0 2023-10-09T11:36:41.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.976+0000 7f86d37fe700 1 -- 172.21.15.26:0/571382693 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800bb40 con 0x7f86d40684e0 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 -- 172.21.15.26:0/571382693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40684e0 msgr2=0x7f86d40cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 --2- 172.21.15.26:0/571382693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40684e0 0x7f86d40cd240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098e0 tx=0x7f86c80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 -- 172.21.15.26:0/571382693 shutdown_connections 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 --2- 172.21.15.26:0/571382693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40684e0 0x7f86d40cd240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 -- 172.21.15.26:0/571382693 >> 172.21.15.26:0/571382693 conn(0x7f86d406d7b0 msgr2=0x7f86d406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 -- 172.21.15.26:0/571382693 shutdown_connections 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.977+0000 7f86db143700 1 -- 172.21.15.26:0/571382693 wait complete. 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.978+0000 7f86db143700 1 Processor -- start 2023-10-09T11:36:41.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.978+0000 7f86db143700 1 -- start start 2023-10-09T11:36:41.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40cc910 0x7f86d40ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86d40cd780 0x7f86d4156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40ad860 con 0x7f86d40684e0 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40aaa10 con 0x7f86d40cc910 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86db143700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40aacd0 con 0x7f86d40cd780 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d8edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d8edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51626/0 (socket says 172.21.15.26:51626) 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d8edf700 1 -- 172.21.15.26:0/86936282 learned_addr learned my addr 172.21.15.26:0/86936282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d96e0700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86d40cd780 0x7f86d4156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d3fff700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40cc910 0x7f86d40ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d8edf700 1 -- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86d40cd780 msgr2=0x7f86d4156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.979+0000 7f86d8edf700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86d40cd780 0x7f86d4156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d8edf700 1 -- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40cc910 msgr2=0x7f86d40ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d8edf700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40cc910 0x7f86d40ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d8edf700 1 -- 172.21.15.26:0/86936282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009420 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d8edf700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c530 tx=0x7f86c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011590 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c40116f0 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d40aafb0 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011ab0 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.980+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d40ab570 con 0x7f86d40684e0 2023-10-09T11:36:41.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.981+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d404c3c0 con 0x7f86d40684e0 2023-10-09T11:36:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.982+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c401b3b0 con 0x7f86d40684e0 2023-10-09T11:36:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.982+0000 7f86d0ff9700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.982+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f86c40839b0 con 0x7f86d40684e0 2023-10-09T11:36:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.982+0000 7f86d3fff700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.983+0000 7f86d3fff700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 0x7f86c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86d40cc3f0 tx=0x7f86c8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:41.986+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86c4050ff0 con 0x7f86d40684e0 2023-10-09T11:36:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.177+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86d415ae00 con 0x7f86d40684e0 2023-10-09T11:36:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.178+0000 7f86d0ff9700 1 -- 172.21.15.26:0/86936282 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86d415ae00 con 0x7f86d40684e0 2023-10-09T11:36:42.180 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 msgr2=0x7f86c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 0x7f86c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86d40cc3f0 tx=0x7f86c8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 msgr2=0x7f86d4169520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c530 tx=0x7f86c400c8f0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 shutdown_connections 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86d40cd780 0x7f86d4156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86d40684e0 0x7f86d4169520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 --2- 172.21.15.26:0/86936282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d40cc910 0x7f86d40ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 >> 172.21.15.26:0/86936282 conn(0x7f86d406d7b0 msgr2=0x7f86d40cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 shutdown_connections 2023-10-09T11:36:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.180+0000 7f86db143700 1 -- 172.21.15.26:0/86936282 wait complete. 2023-10-09T11:36:42.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:36:42.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.328+0000 7f58f759e700 1 Processor -- start 2023-10-09T11:36:42.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.328+0000 7f58f759e700 1 -- start start 2023-10-09T11:36:42.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58f8157340 0x7f58f80af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f80ad2d0 0x7f58f815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f759e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f815bdd0 con 0x7f58f8157710 2023-10-09T11:36:42.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f759e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f80aee50 con 0x7f58f8157340 2023-10-09T11:36:42.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80af130 con 0x7f58f80ad2d0 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58f8157340 0x7f58f80af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f58f8157340 0x7f58f80af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51628/0 (socket says 172.21.15.26:51628) 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 -- 172.21.15.26:0/1410441750 learned_addr learned my addr 172.21.15.26:0/1410441750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f6d9d700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f80ad2d0 0x7f58f815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 -- 172.21.15.26:0/1410441750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f80ad2d0 msgr2=0x7f58f815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f80ad2d0 0x7f58f815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 -- 172.21.15.26:0/1410441750 >> v1:172.21.15.67:6789/0 conn(0x7f58f8157710 legacy=0x7f58f80acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.329+0000 7f58f659c700 1 -- 172.21.15.26:0/1410441750 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80af410 con 0x7f58f8157340 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f659c700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157340 0x7f58f80af930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009f20 tx=0x7f58e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2072836cfa5b2771 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f559a700 1 -- 172.21.15.26:0/1410441750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800e070 con 0x7f58f8157340 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f559a700 1 -- 172.21.15.26:0/1410441750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800b9d0 con 0x7f58f8157340 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f559a700 1 -- 172.21.15.26:0/1410441750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e80092e0 con 0x7f58f8157340 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 -- 172.21.15.26:0/1410441750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157340 msgr2=0x7f58f80af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157340 0x7f58f80af930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009f20 tx=0x7f58e8009840 comp rx=0 tx=0).stop 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 -- 172.21.15.26:0/1410441750 shutdown_connections 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f80ad2d0 0x7f58f815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 --2- 172.21.15.26:0/1410441750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157340 0x7f58f80af930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.330+0000 7f58f759e700 1 -- 172.21.15.26:0/1410441750 >> 172.21.15.26:0/1410441750 conn(0x7f58f806e280 msgr2=0x7f58f80cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.331+0000 7f58f759e700 1 -- 172.21.15.26:0/1410441750 shutdown_connections 2023-10-09T11:36:42.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.331+0000 7f58f759e700 1 -- 172.21.15.26:0/1410441750 wait complete. 2023-10-09T11:36:42.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 Processor -- start 2023-10-09T11:36:42.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 -- start start 2023-10-09T11:36:42.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58f80ad2d0 0x7f58f80b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f8157340 0x7f58f8168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80b2c70 con 0x7f58f8157710 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80b21b0 con 0x7f58f80ad2d0 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.332+0000 7f58f759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8169000 con 0x7f58f8157340 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51640/0 (socket says 172.21.15.26:51640) 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 -- 172.21.15.26:0/312735061 learned_addr learned my addr 172.21.15.26:0/312735061 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:42.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58f80ad2d0 0x7f58f80b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f5d9b700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f8157340 0x7f58f8168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 -- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f8157340 msgr2=0x7f58f8168710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f8157340 0x7f58f8168710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 -- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58f80ad2d0 msgr2=0x7f58f80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58f80ad2d0 0x7f58f80b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 -- 172.21.15.26:0/312735061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009ae0 con 0x7f58f8157710 2023-10-09T11:36:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f6d9d700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ea80 tx=0x7f58f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000eec0 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000c7f0 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f8168c50 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000cbb0 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.333+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f80b26b0 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.334+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f80ad110 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.335+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58f0013470 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.335+0000 7f58e67fc700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 0x7f58d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.335+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f58f00843e0 con 0x7f58f8157710 2023-10-09T11:36:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.335+0000 7f58f659c700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 0x7f58d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.336+0000 7f58f659c700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 0x7f58d80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009880 tx=0x7f58e8018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.340+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58f00519a0 con 0x7f58f8157710 2023-10-09T11:36:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.534+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58f804c3c0 con 0x7f58f8157710 2023-10-09T11:36:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.534+0000 7f58e67fc700 1 -- 172.21.15.26:0/312735061 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+65 (secure 0 0 0) 0x7f58f0054fc0 con 0x7f58f8157710 2023-10-09T11:36:42.536 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:42.536 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:36:42.536 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:42.537 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:36:42.537 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:36:42.537 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:42.537 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:36:42.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 msgr2=0x7f58d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 0x7f58d80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009880 tx=0x7f58e8018000 comp rx=0 tx=0).stop 2023-10-09T11:36:42.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 msgr2=0x7f58f80ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ea80 tx=0x7f58f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 shutdown_connections 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58f8157710 0x7f58f80ac6f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58f80ad2d0 0x7f58f80b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f58d8066f30 0x7f58d80693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 --2- 172.21.15.26:0/312735061 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58f8157340 0x7f58f8168710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 >> 172.21.15.26:0/312735061 conn(0x7f58f806e280 msgr2=0x7f58f806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 shutdown_connections 2023-10-09T11:36:42.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.536+0000 7f58f759e700 1 -- 172.21.15.26:0/312735061 wait complete. 2023-10-09T11:36:42.550 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:36:42.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:36:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.673+0000 7fbd712e2700 1 Processor -- start 2023-10-09T11:36:42.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.673+0000 7fbd712e2700 1 -- start start 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd712e2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd6c142f70 0x7fbd6c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd712e2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd712e2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0d0d10 con 0x7fbd6c0d08b0 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd712e2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b6500 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd712e2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b5610 con 0x7fbd6c142f70 2023-10-09T11:36:42.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd6c0d08b0 0x7fbd6c0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55370/0 (socket says 172.21.15.26:55370) 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6b7fe700 1 -- 172.21.15.26:0/842241165 learned_addr learned my addr 172.21.15.26:0/842241165 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51654/0 (socket says 172.21.15.26:51654) 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6affd700 1 --2- 172.21.15.26:0/842241165 >> v2:172.21.15.67:3300/0 conn(0x7fbd6c142f70 0x7fbd6c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6a7fc700 1 -- 172.21.15.26:0/842241165 >> v2:172.21.15.67:3300/0 conn(0x7fbd6c142f70 msgr2=0x7fbd6c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/842241165 >> v2:172.21.15.67:3300/0 conn(0x7fbd6c142f70 0x7fbd6c0cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.674+0000 7fbd6a7fc700 1 -- 172.21.15.26:0/842241165 >> v1:172.21.15.26:6789/0 conn(0x7fbd6c0d08b0 legacy=0x7fbd6c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd69ffb700 1 -- 172.21.15.26:0/842241165 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418043003 0 0) 0x7fbd64001110 con 0x7fbd6c0d08b0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd6a7fc700 1 -- 172.21.15.26:0/842241165 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0b58f0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/842241165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0891d0 tx=0x7fbd540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764caeab6f8f085 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd69ffb700 1 -- 172.21.15.26:0/842241165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400b6b0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd69ffb700 1 -- 172.21.15.26:0/842241165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400b810 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd69ffb700 1 -- 172.21.15.26:0/842241165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400bbb0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 -- 172.21.15.26:0/842241165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 msgr2=0x7fbd6c0d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 --2- 172.21.15.26:0/842241165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0891d0 tx=0x7fbd540091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 -- 172.21.15.26:0/842241165 shutdown_connections 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 --2- 172.21.15.26:0/842241165 >> v2:172.21.15.67:3300/0 conn(0x7fbd6c142f70 0x7fbd6c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 --2- 172.21.15.26:0/842241165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c0d0370 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 -- 172.21.15.26:0/842241165 >> 172.21.15.26:0/842241165 conn(0x7fbd6c0703a0 msgr2=0x7fbd6c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 -- 172.21.15.26:0/842241165 shutdown_connections 2023-10-09T11:36:42.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.675+0000 7fbd712e2700 1 -- 172.21.15.26:0/842241165 wait complete. 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 Processor -- start 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 -- start start 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 0x7fbd6c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6c142f70 0x7fbd6c15f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15c390 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15c670 con 0x7fbd6c142f70 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd712e2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15c950 con 0x7fbd6c0d08b0 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.677+0000 7fbd6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51664/0 (socket says 172.21.15.26:51664) 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 -- 172.21.15.26:0/2865891022 learned_addr learned my addr 172.21.15.26:0/2865891022 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 0x7fbd6c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6b7fe700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6c142f70 0x7fbd6c15f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 -- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 msgr2=0x7fbd6c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 0x7fbd6c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 -- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6c142f70 msgr2=0x7fbd6c15f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6c142f70 0x7fbd6c15f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 -- 172.21.15.26:0/2865891022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009420 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 0x7fbd6c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd6affd700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00ce10 tx=0x7fbd5c007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00ab90 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00acf0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c15cc30 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c017660 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.678+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c15ff10 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.679+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c1698e0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.680+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd5c003020 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.680+0000 7fbd62ffd700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 0x7fbd4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.680+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd5c013070 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.680+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 0x7fbd4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.681+0000 7fbd6a7fc700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 0x7fbd4c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd540093f0 tx=0x7fbd54017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.684+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd5c051d30 con 0x7fbd6c0cc9f0 2023-10-09T11:36:42.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:42.878+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd6c04c3c0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.083+0000 7fbd62ffd700 1 -- 172.21.15.26:0/2865891022 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd5c01c0b0 con 0x7fbd6c0cc9f0 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 msgr2=0x7fbd4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 0x7fbd4c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd540093f0 tx=0x7fbd54017000 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 msgr2=0x7fbd6c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00ce10 tx=0x7fbd5c007810 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 shutdown_connections 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6c142f70 0x7fbd6c15f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c0cc9f0 0x7fbd6c15b850 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c066f30 0x7fbd4c0693e0 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd540093f0 tx=0x7fbd54017000 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 --2- 172.21.15.26:0/2865891022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd6c0d08b0 0x7fbd6c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.088+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 >> 172.21.15.26:0/2865891022 conn(0x7fbd6c0703a0 msgr2=0x7fbd6c141d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:43.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.089+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 shutdown_connections 2023-10-09T11:36:43.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.089+0000 7fbd712e2700 1 -- 172.21.15.26:0/2865891022 wait complete. 2023-10-09T11:36:43.091 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:36:43.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:36:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.233+0000 7f49d45ed700 1 Processor -- start 2023-10-09T11:36:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.233+0000 7f49d45ed700 1 -- start start 2023-10-09T11:36:43.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d45ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49cc159860 0x7f49cc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d45ed700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 0x7f49cc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d45ed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0cf510 con 0x7f49cc0ccfa0 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d45ed700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0cc210 con 0x7f49cc159860 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d45ed700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0ce900 con 0x7f49cc0cbd90 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d2389700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49cc159860 0x7f49cc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d2b8a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f49cc0ccfa0 0x7f49cc0cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55374/0 (socket says 172.21.15.26:55374) 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.234+0000 7f49d2b8a700 1 -- 172.21.15.26:0/1571462582 learned_addr learned my addr 172.21.15.26:0/1571462582 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1b88700 1 --2- 172.21.15.26:0/1571462582 >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 0x7f49cc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d2389700 1 -- 172.21.15.26:0/1571462582 >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 msgr2=0x7f49cc0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d2389700 1 --2- 172.21.15.26:0/1571462582 >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 0x7f49cc0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d2389700 1 -- 172.21.15.26:0/1571462582 >> v1:172.21.15.26:6789/0 conn(0x7f49cc0ccfa0 legacy=0x7f49cc0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d2389700 1 -- 172.21.15.26:0/1571462582 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0cebe0 con 0x7f49cc159860 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1387700 1 -- 172.21.15.26:0/1571462582 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657589867 0 0) 0x7f49cc0cf510 con 0x7f49cc0ccfa0 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1b88700 1 --2- 172.21.15.26:0/1571462582 >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 0x7f49cc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d2389700 1 --2- 172.21.15.26:0/1571462582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc159860 0x7f49cc0ce220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49cc064890 tx=0x7f49c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75d1432a240775f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1387700 1 -- 172.21.15.26:0/1571462582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400e070 con 0x7f49cc159860 2023-10-09T11:36:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1387700 1 -- 172.21.15.26:0/1571462582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400bc30 con 0x7f49cc159860 2023-10-09T11:36:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d1387700 1 -- 172.21.15.26:0/1571462582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4012430 con 0x7f49cc159860 2023-10-09T11:36:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d45ed700 1 -- 172.21.15.26:0/1571462582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc159860 msgr2=0x7f49cc0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.235+0000 7f49d45ed700 1 --2- 172.21.15.26:0/1571462582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc159860 0x7f49cc0ce220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49cc064890 tx=0x7f49c4009780 comp rx=0 tx=0).stop 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 -- 172.21.15.26:0/1571462582 shutdown_connections 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 --2- 172.21.15.26:0/1571462582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc159860 0x7f49cc0ce220 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 --2- 172.21.15.26:0/1571462582 >> v2:172.21.15.67:3300/0 conn(0x7f49cc0cbd90 0x7f49cc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 -- 172.21.15.26:0/1571462582 >> 172.21.15.26:0/1571462582 conn(0x7f49cc0999b0 msgr2=0x7f49cc070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 -- 172.21.15.26:0/1571462582 shutdown_connections 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.236+0000 7f49d45ed700 1 -- 172.21.15.26:0/1571462582 wait complete. 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 Processor -- start 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 -- start start 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49cc0ccfa0 0x7f49cc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49cc159860 0x7f49cc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc15af70 con 0x7f49cc0cbd90 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc15b250 con 0x7f49cc159860 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.237+0000 7f49d45ed700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc15b530 con 0x7f49cc0ccfa0 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51680/0 (socket says 172.21.15.26:51680) 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 -- 172.21.15.26:0/120080620 learned_addr learned my addr 172.21.15.26:0/120080620 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2b8a700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49cc159860 0x7f49cc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d1b88700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49cc0ccfa0 0x7f49cc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 -- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49cc0ccfa0 msgr2=0x7f49cc15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49cc0ccfa0 0x7f49cc15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 -- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49cc159860 msgr2=0x7f49cc15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49cc159860 0x7f49cc15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 -- 172.21.15.26:0/120080620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4009a20 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d2389700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49c4013000 tx=0x7f49c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4012e60 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c401d630 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc15b810 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c401da10 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.238+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc169580 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.239+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc04c3c0 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.240+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49c4024070 con 0x7f49cc0cbd90 2023-10-09T11:36:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.240+0000 7f49ca7fc700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 0x7f49b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.240+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f49c4086d50 con 0x7f49cc0cbd90 2023-10-09T11:36:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.241+0000 7f49d1b88700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 0x7f49b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.241+0000 7f49d1b88700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 0x7f49b80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cfa10 tx=0x7f49c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.244+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49c4054180 con 0x7f49cc0cbd90 2023-10-09T11:36:43.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:43.436+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49cc15b0b0 con 0x7f49cc0cbd90 2023-10-09T11:36:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.093+0000 7f49ca7fc700 1 -- 172.21.15.26:0/120080620 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49cc15b0b0 con 0x7f49cc0cbd90 2023-10-09T11:36:44.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 msgr2=0x7f49b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 0x7f49b80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cfa10 tx=0x7f49c0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 msgr2=0x7f49cc157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49c4013000 tx=0x7f49c4019000 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 shutdown_connections 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49cc159860 0x7f49cc15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0cbd90 0x7f49cc157da0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f49b8066f30 0x7f49b80693e0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cfa10 tx=0x7f49c0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 --2- 172.21.15.26:0/120080620 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49cc0ccfa0 0x7f49cc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.099+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 >> 172.21.15.26:0/120080620 conn(0x7f49cc0999b0 msgr2=0x7f49cc158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:44.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.102+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 shutdown_connections 2023-10-09T11:36:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.102+0000 7f49d45ed700 1 -- 172.21.15.26:0/120080620 wait complete. 2023-10-09T11:36:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:36:44.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:36:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.250+0000 7fac67079700 1 Processor -- start 2023-10-09T11:36:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.250+0000 7fac67079700 1 -- start start 2023-10-09T11:36:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac60159530 0x7fac600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006dc70 0x7fac60159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac6006e0e0 0x7fac600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600ccfd0 con 0x7fac60159530 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600cf0e0 con 0x7fac6006e0e0 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac67079700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015a3d0 con 0x7fac6006dc70 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac64e15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac60159530 0x7fac600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac64e15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac60159530 0x7fac600ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51692/0 (socket says 172.21.15.26:51692) 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.251+0000 7fac64e15700 1 -- 172.21.15.26:0/61422883 learned_addr learned my addr 172.21.15.26:0/61422883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:44.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac5ffff700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006dc70 0x7fac60159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac65616700 1 --2- 172.21.15.26:0/61422883 >> v2:172.21.15.67:3300/0 conn(0x7fac6006e0e0 0x7fac600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 -- 172.21.15.26:0/61422883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006dc70 msgr2=0x7fac60159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006dc70 0x7fac60159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 -- 172.21.15.26:0/61422883 >> v2:172.21.15.67:3300/0 conn(0x7fac6006e0e0 msgr2=0x7fac600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 --2- 172.21.15.26:0/61422883 >> v2:172.21.15.67:3300/0 conn(0x7fac6006e0e0 0x7fac600cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 -- 172.21.15.26:0/61422883 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6015a6b0 con 0x7fac60159530 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac64e15700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac60159530 0x7fac600ceba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fac60089880 tx=0x7fac58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b73106ed0b7f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac5f7fe700 1 -- 172.21.15.26:0/61422883 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800b860 con 0x7fac60159530 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac5f7fe700 1 -- 172.21.15.26:0/61422883 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800b9c0 con 0x7fac60159530 2023-10-09T11:36:44.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac5f7fe700 1 -- 172.21.15.26:0/61422883 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800bd60 con 0x7fac60159530 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac67079700 1 -- 172.21.15.26:0/61422883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac60159530 msgr2=0x7fac600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.252+0000 7fac67079700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac60159530 0x7fac600ceba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fac60089880 tx=0x7fac58009250 comp rx=0 tx=0).stop 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 -- 172.21.15.26:0/61422883 shutdown_connections 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 --2- 172.21.15.26:0/61422883 >> v2:172.21.15.67:3300/0 conn(0x7fac6006e0e0 0x7fac600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac60159530 0x7fac600ceba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 --2- 172.21.15.26:0/61422883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006dc70 0x7fac60159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 -- 172.21.15.26:0/61422883 >> 172.21.15.26:0/61422883 conn(0x7fac600703a0 msgr2=0x7fac600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 -- 172.21.15.26:0/61422883 shutdown_connections 2023-10-09T11:36:44.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.253+0000 7fac67079700 1 -- 172.21.15.26:0/61422883 wait complete. 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.254+0000 7fac67079700 1 Processor -- start 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.254+0000 7fac67079700 1 -- start start 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac6006dc70 0x7fac600ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac60159530 0x7fac600b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60151ec0 con 0x7fac6006e0e0 2023-10-09T11:36:44.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600c7ba0 con 0x7fac6006dc70 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b5b20 con 0x7fac60159530 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51696/0 (socket says 172.21.15.26:51696) 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 -- 172.21.15.26:0/1684481609 learned_addr learned my addr 172.21.15.26:0/1684481609 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac64e15700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac6006dc70 0x7fac600ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac65616700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac60159530 0x7fac600b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 -- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac60159530 msgr2=0x7fac600b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac60159530 0x7fac600b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 -- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac6006dc70 msgr2=0x7fac600ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac6006dc70 0x7fac600ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 -- 172.21.15.26:0/1684481609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580094f0 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5ffff700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fac5000e190 tx=0x7fac50009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000ecd0 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5000ee30 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac600b5df0 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50014670 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.255+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac600c7830 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.256+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600c7d30 con 0x7fac6006e0e0 2023-10-09T11:36:44.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.257+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac50014a20 con 0x7fac6006e0e0 2023-10-09T11:36:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.257+0000 7fac5cff9700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 0x7fac400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.257+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fac50084b90 con 0x7fac6006e0e0 2023-10-09T11:36:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.257+0000 7fac64e15700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 0x7fac400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.258+0000 7fac64e15700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 0x7fac400693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fac60089880 tx=0x7fac58017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.262+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac50051e60 con 0x7fac6006e0e0 2023-10-09T11:36:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:44.498+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac6004c3c0 con 0x7fac6006e0e0 2023-10-09T11:36:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.141+0000 7fac5cff9700 1 -- 172.21.15.26:0/1684481609 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7fac50009a60 con 0x7fac6006e0e0 2023-10-09T11:36:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 msgr2=0x7fac400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 0x7fac400693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fac60089880 tx=0x7fac58017000 comp rx=0 tx=0).stop 2023-10-09T11:36:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 msgr2=0x7fac60151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fac5000e190 tx=0x7fac50009920 comp rx=0 tx=0).stop 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 shutdown_connections 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fac40066f30 0x7fac400693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac60159530 0x7fac600b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac6006dc70 0x7fac600ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 --2- 172.21.15.26:0/1684481609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac6006e0e0 0x7fac60151980 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.146+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 >> 172.21.15.26:0/1684481609 conn(0x7fac600703a0 msgr2=0x7fac6015abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.147+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 shutdown_connections 2023-10-09T11:36:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.147+0000 7fac67079700 1 -- 172.21.15.26:0/1684481609 wait complete. 2023-10-09T11:36:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T11:36:45.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.281+0000 7fc7315f6700 1 Processor -- start 2023-10-09T11:36:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 -- start start 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 0x7fc72c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc72c0cde50 0x7fc72c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c15ae40 con 0x7fc72c0cd9e0 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c0d13f0 con 0x7fc72c0cde50 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.282+0000 7fc7315f6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c15ab60 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc72c0cde50 0x7fc72c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc72c0cde50 0x7fc72c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:55936/0 (socket says 172.21.15.26:55936) 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72affd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 0x7fc72c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 -- 172.21.15.26:0/4181645109 learned_addr learned my addr 172.21.15.26:0/4181645109 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72a7fc700 1 --1- 172.21.15.26:0/4181645109 >> v1:172.21.15.67:6789/0 conn(0x7fc72c0cd9e0 0x7fc72c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51556/0 (socket says 172.21.15.26:51556) 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 -- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 msgr2=0x7fc72c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 0x7fc72c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 -- 172.21.15.26:0/4181645109 >> v1:172.21.15.67:6789/0 conn(0x7fc72c0cd9e0 legacy=0x7fc72c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 -- 172.21.15.26:0/4181645109 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0ccf00 con 0x7fc72c0cde50 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc729ffb700 1 -- 172.21.15.26:0/4181645109 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297221081 0 0) 0x7fc72c15ae40 con 0x7fc72c0cd9e0 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72affd700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 0x7fc72c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.283+0000 7fc72b7fe700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0cde50 0x7fc72c156e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009f20 tx=0x7fc71c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea21413331fdb409 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc729ffb700 1 -- 172.21.15.26:0/4181645109 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00e070 con 0x7fc72c0cde50 2023-10-09T11:36:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc729ffb700 1 -- 172.21.15.26:0/4181645109 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00b9d0 con 0x7fc72c0cde50 2023-10-09T11:36:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc729ffb700 1 -- 172.21.15.26:0/4181645109 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c0092e0 con 0x7fc72c0cde50 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 -- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0cde50 msgr2=0x7fc72c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0cde50 0x7fc72c156e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009f20 tx=0x7fc71c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 -- 172.21.15.26:0/4181645109 shutdown_connections 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0cde50 0x7fc72c156e90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 --2- 172.21.15.26:0/4181645109 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cb5a0 0x7fc72c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 -- 172.21.15.26:0/4181645109 >> 172.21.15.26:0/4181645109 conn(0x7fc72c070e30 msgr2=0x7fc72c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 -- 172.21.15.26:0/4181645109 shutdown_connections 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.284+0000 7fc7315f6700 1 -- 172.21.15.26:0/4181645109 wait complete. 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.285+0000 7fc7315f6700 1 Processor -- start 2023-10-09T11:36:45.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.285+0000 7fc7315f6700 1 -- start start 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 0x7fc72c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0b4450 0x7fc72c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0ca580 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b5b00 con 0x7fc72c0b4450 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc7315f6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b64d0 con 0x7fc72c0cd9e0 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc72affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc72affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51712/0 (socket says 172.21.15.26:51712) 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc72affd700 1 -- 172.21.15.26:0/2224285052 learned_addr learned my addr 172.21.15.26:0/2224285052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc72b7fe700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0b4450 0x7fc72c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.286+0000 7fc72a7fc700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 0x7fc72c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 -- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 msgr2=0x7fc72c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 0x7fc72c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 -- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0b4450 msgr2=0x7fc72c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0b4450 0x7fc72c15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 -- 172.21.15.26:0/2224285052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009420 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72a7fc700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 0x7fc72c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc72affd700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc72400ec80 tx=0x7fc7240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400c850 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400c9b0 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c009ae0 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400cd30 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.287+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c0b4f70 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.288+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c04c3c0 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.288+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc724013680 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.289+0000 7fc722ffd700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.289+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc724084850 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.289+0000 7fc72a7fc700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.289+0000 7fc72a7fc700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 0x7fc70c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc72c15d6e0 tx=0x7fc714007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.293+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc724055550 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.490+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc72c0cd1e0 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.491+0000 7fc722ffd700 1 -- 172.21.15.26:0/2224285052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fc7240550e0 con 0x7fc72c0cb5a0 2023-10-09T11:36:45.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:45.493 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":50,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:44.499841+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:45.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 msgr2=0x7fc70c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 0x7fc70c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc72c15d6e0 tx=0x7fc714007c90 comp rx=0 tx=0).stop 2023-10-09T11:36:45.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 msgr2=0x7fc72c0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc72400ec80 tx=0x7fc7240091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 shutdown_connections 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc72c0b4450 0x7fc72c15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc72c0cb5a0 0x7fc72c0ca040 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 --2- 172.21.15.26:0/2224285052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc72c0cd9e0 0x7fc72c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 >> 172.21.15.26:0/2224285052 conn(0x7fc72c070e30 msgr2=0x7fc72c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 shutdown_connections 2023-10-09T11:36:45.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.493+0000 7fc7315f6700 1 -- 172.21.15.26:0/2224285052 wait complete. 2023-10-09T11:36:45.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:45.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.625+0000 7f9e3599c700 1 Processor -- start 2023-10-09T11:36:45.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.625+0000 7f9e3599c700 1 -- start start 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3599c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300caa00 0x7f9e301579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3599c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e300aaec0 0x7f9e300c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3599c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300c3d00 con 0x7f9e300c95c0 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3599c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e300c3110 con 0x7f9e300aaec0 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3599c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c33d0 con 0x7f9e300caa00 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e300aaec0 0x7f9e300c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e300aaec0 0x7f9e300c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51724/0 (socket says 172.21.15.26:51724) 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 -- 172.21.15.26:0/477232026 learned_addr learned my addr 172.21.15.26:0/477232026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e2ffff700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300caa00 0x7f9e301579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 -- 172.21.15.26:0/477232026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300caa00 msgr2=0x7f9e301579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300caa00 0x7f9e301579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 -- 172.21.15.26:0/477232026 >> v1:172.21.15.67:6789/0 conn(0x7f9e300c95c0 legacy=0x7f9e30157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.626+0000 7f9e3519b700 1 -- 172.21.15.26:0/477232026 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300c36b0 con 0x7f9e300aaec0 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3519b700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300aaec0 0x7f9e300c9990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e280099b0 tx=0x7f9e28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd59427d08d69242 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e2f7fe700 1 -- 172.21.15.26:0/477232026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800b820 con 0x7f9e300aaec0 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e2f7fe700 1 -- 172.21.15.26:0/477232026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800b980 con 0x7f9e300aaec0 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e2f7fe700 1 -- 172.21.15.26:0/477232026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800bd20 con 0x7f9e300aaec0 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 -- 172.21.15.26:0/477232026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300aaec0 msgr2=0x7f9e300c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300aaec0 0x7f9e300c9990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e280099b0 tx=0x7f9e28009250 comp rx=0 tx=0).stop 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 -- 172.21.15.26:0/477232026 shutdown_connections 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300aaec0 0x7f9e300c9990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 --2- 172.21.15.26:0/477232026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300caa00 0x7f9e301579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 -- 172.21.15.26:0/477232026 >> 172.21.15.26:0/477232026 conn(0x7f9e30088000 msgr2=0x7f9e300ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 -- 172.21.15.26:0/477232026 shutdown_connections 2023-10-09T11:36:45.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.627+0000 7f9e3599c700 1 -- 172.21.15.26:0/477232026 wait complete. 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.628+0000 7f9e3599c700 1 Processor -- start 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 -- start start 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e300aaec0 0x7f9e301490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300c4920 0x7f9e300aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c4da0 con 0x7f9e300c95c0 2023-10-09T11:36:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3016a290 con 0x7f9e300aaec0 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3599c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e301696a0 con 0x7f9e300c4920 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51732/0 (socket says 172.21.15.26:51732) 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e2ffff700 1 -- 172.21.15.26:0/3358375118 learned_addr learned my addr 172.21.15.26:0/3358375118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.629+0000 7f9e3499a700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e300aaec0 0x7f9e301490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e3519b700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300c4920 0x7f9e300aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 -- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300c4920 msgr2=0x7f9e300aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300c4920 0x7f9e300aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 -- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e300aaec0 msgr2=0x7f9e301490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e300aaec0 0x7f9e301490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 -- 172.21.15.26:0/3358375118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280094f0 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2ffff700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000ce10 tx=0x7f9e20007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000aa10 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2000ab70 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20017430 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e30169960 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.630+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30169f20 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.631+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3004c3c0 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.631+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e20003020 con 0x7f9e300c95c0 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.632+0000 7f9e2cff9700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.632+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e20013070 con 0x7f9e300c95c0 2023-10-09T11:36:45.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.632+0000 7f9e3499a700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.633+0000 7f9e3499a700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 0x7f9e100693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e18003a70 tx=0x7f9e18007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.636+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e20051ad0 con 0x7f9e300c95c0 2023-10-09T11:36:45.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.831+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3016a620 con 0x7f9e300c95c0 2023-10-09T11:36:45.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.832+0000 7f9e2cff9700 1 -- 172.21.15.26:0/3358375118 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9e200550f0 con 0x7f9e300c95c0 2023-10-09T11:36:45.834 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:45.834 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":50,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:44.499841+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:45.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 msgr2=0x7f9e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 0x7f9e100693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e18003a70 tx=0x7f9e18007ef0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 msgr2=0x7f9e300c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000ce10 tx=0x7f9e20007810 comp rx=0 tx=0).stop 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 shutdown_connections 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e300c4920 0x7f9e300aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e300aaec0 0x7f9e301490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 --2- 172.21.15.26:0/3358375118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e300c95c0 0x7f9e300c43e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 >> 172.21.15.26:0/3358375118 conn(0x7f9e30088000 msgr2=0x7f9e30152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 shutdown_connections 2023-10-09T11:36:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.834+0000 7f9e3599c700 1 -- 172.21.15.26:0/3358375118 wait complete. 2023-10-09T11:36:45.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:36:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.970+0000 7f305a6cb700 1 Processor -- start 2023-10-09T11:36:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.970+0000 7f305a6cb700 1 -- start start 2023-10-09T11:36:45.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f305a6cb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f3054159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f305a6cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f305406e0e0 0x7f30540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f305a6cb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540ccfd0 con 0x7f3054159530 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f305a6cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305415a3d0 con 0x7f305406e0e0 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f305a6cb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305415a6b0 con 0x7f305406dc70 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f305406e0e0 0x7f30540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f305406e0e0 0x7f30540cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51740/0 (socket says 172.21.15.26:51740) 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 -- 172.21.15.26:0/1077250336 learned_addr learned my addr 172.21.15.26:0/1077250336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f30537fe700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f3054159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 -- 172.21.15.26:0/1077250336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 msgr2=0x7f3054159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f3054159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 -- 172.21.15.26:0/1077250336 >> v1:172.21.15.67:6789/0 conn(0x7f3054159530 legacy=0x7f30540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 -- 172.21.15.26:0/1077250336 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305415a990 con 0x7f305406e0e0 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.971+0000 7f3058c68700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540cb6f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f304c009f20 tx=0x7f304c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c0cbdc280fec50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f3052ffd700 1 -- 172.21.15.26:0/1077250336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00e070 con 0x7f305406e0e0 2023-10-09T11:36:45.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f3052ffd700 1 -- 172.21.15.26:0/1077250336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00b9d0 con 0x7f305406e0e0 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f3052ffd700 1 -- 172.21.15.26:0/1077250336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0092e0 con 0x7f305406e0e0 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 -- 172.21.15.26:0/1077250336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 msgr2=0x7f30540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540cb6f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f304c009f20 tx=0x7f304c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 -- 172.21.15.26:0/1077250336 shutdown_connections 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540cb6f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1077250336 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f3054159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 -- 172.21.15.26:0/1077250336 >> 172.21.15.26:0/1077250336 conn(0x7f30540703a0 msgr2=0x7f30540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 -- 172.21.15.26:0/1077250336 shutdown_connections 2023-10-09T11:36:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.972+0000 7f305a6cb700 1 -- 172.21.15.26:0/1077250336 wait complete. 2023-10-09T11:36:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.973+0000 7f305a6cb700 1 Processor -- start 2023-10-09T11:36:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.973+0000 7f305a6cb700 1 -- start start 2023-10-09T11:36:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f305415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 0x7f30540c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540b4fe0 con 0x7f305406e0e0 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540b40f0 con 0x7f3054159530 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f305a6cb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540b43d0 con 0x7f305406dc70 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51752/0 (socket says 172.21.15.26:51752) 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 -- 172.21.15.26:0/1898177911 learned_addr learned my addr 172.21.15.26:0/1898177911 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 -- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 msgr2=0x7f305415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f3058c68700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 0x7f30540c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f3053fff700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f305415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f305415dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 -- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 msgr2=0x7f30540c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 0x7f30540c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.974+0000 7f30537fe700 1 -- 172.21.15.26:0/1898177911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009ae0 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f3058c68700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 0x7f30540c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f30537fe700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f304800ec80 tx=0x7f30480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800c9d0 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800cb30 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30540b46b0 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048013470 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.975+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30540b4c70 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.976+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305404c3c0 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.976+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3048013820 con 0x7f305406e0e0 2023-10-09T11:36:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.977+0000 7f303bfff700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.977+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3048084920 con 0x7f305406e0e0 2023-10-09T11:36:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.977+0000 7f3053fff700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.977+0000 7f3053fff700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 0x7f30400693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f30440016c0 tx=0x7f3044009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:45.981+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3048051b90 con 0x7f305406e0e0 2023-10-09T11:36:46.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:46.223+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30540b5120 con 0x7f305406e0e0 2023-10-09T11:36:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.147+0000 7f303bfff700 1 -- 172.21.15.26:0/1898177911 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30480551b0 con 0x7f305406e0e0 2023-10-09T11:36:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 msgr2=0x7f30400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 0x7f30400693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f30440016c0 tx=0x7f3044009040 comp rx=0 tx=0).stop 2023-10-09T11:36:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 msgr2=0x7f30540c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f304800ec80 tx=0x7f30480091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 shutdown_connections 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3054159530 0x7f30540c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305406dc70 0x7f305415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 --2- 172.21.15.26:0/1898177911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305406e0e0 0x7f30540c8760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 >> 172.21.15.26:0/1898177911 conn(0x7f30540703a0 msgr2=0x7f3054070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 shutdown_connections 2023-10-09T11:36:47.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.150+0000 7f305a6cb700 1 -- 172.21.15.26:0/1898177911 wait complete. 2023-10-09T11:36:47.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:36:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 Processor -- start 2023-10-09T11:36:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 -- start start 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa400159530 0x7fa4000ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000ccfd0 con 0x7fa40006dc70 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000cf0e0 con 0x7fa40006e0e0 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.295+0000 7fa4063a5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40015a3d0 con 0x7fa400159530 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3ff7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa40006dc70 0x7fa400159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55390/0 (socket says 172.21.15.26:55390) 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/309489231 learned_addr learned my addr 172.21.15.26:0/309489231 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3fffff700 1 --2- 172.21.15.26:0/309489231 >> v2:172.21.15.67:3300/0 conn(0x7fa400159530 0x7fa4000ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211122293 0 0) 0x7fa4000ccfd0 con 0x7fa40006dc70 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e8003570 con 0x7fa40006dc70 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3fffff700 1 -- 172.21.15.26:0/309489231 >> v1:172.21.15.67:6789/0 conn(0x7fa40006e0e0 legacy=0x7fa4000cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691117755 0 0) 0x7fa4000cf0e0 con 0x7fa40006e0e0 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3fffff700 1 -- 172.21.15.26:0/309489231 >> v1:172.21.15.26:6789/0 conn(0x7fa40006dc70 legacy=0x7fa400159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3fffff700 1 -- 172.21.15.26:0/309489231 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40015a6b0 con 0x7fa400159530 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3fffff700 1 --2- 172.21.15.26:0/309489231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa4000ceba0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098e0 tx=0x7fa3f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8f437d30f63deb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.296+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4001470 con 0x7fa400159530 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0011420 con 0x7fa400159530 2023-10-09T11:36:47.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa3feffd700 1 -- 172.21.15.26:0/309489231 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00117c0 con 0x7fa400159530 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 -- 172.21.15.26:0/309489231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 msgr2=0x7fa4000ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 --2- 172.21.15.26:0/309489231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa4000ceba0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098e0 tx=0x7fa3f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 -- 172.21.15.26:0/309489231 shutdown_connections 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 --2- 172.21.15.26:0/309489231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa4000ceba0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 -- 172.21.15.26:0/309489231 >> 172.21.15.26:0/309489231 conn(0x7fa4000703a0 msgr2=0x7fa4000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 -- 172.21.15.26:0/309489231 shutdown_connections 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.297+0000 7fa4063a5700 1 -- 172.21.15.26:0/309489231 wait complete. 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.298+0000 7fa4063a5700 1 Processor -- start 2023-10-09T11:36:47.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.298+0000 7fa4063a5700 1 -- start start 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa40006dc70 0x7fa4000b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa400154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000b3a30 con 0x7fa40006e0e0 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000b61b0 con 0x7fa400159530 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa4063a5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000b2f50 con 0x7fa40006dc70 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51760/0 (socket says 172.21.15.26:51760) 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1132096597 learned_addr learned my addr 172.21.15.26:0/1132096597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa404942700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa400154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3fffff700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa40006dc70 0x7fa4000b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa40006dc70 msgr2=0x7fa4000b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa40006dc70 0x7fa4000b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 msgr2=0x7fa400154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa400154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1132096597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0009420 con 0x7fa40006e0e0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.299+0000 7fa404942700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa400154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa3ff7fe700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40015a0 tx=0x7fa3f4001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4007360 con 0x7fa40006e0e0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f40074e0 con 0x7fa40006e0e0 2023-10-09T11:36:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4004830 con 0x7fa40006e0e0 2023-10-09T11:36:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4000b6400 con 0x7fa40006e0e0 2023-10-09T11:36:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.300+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4000b2be0 con 0x7fa40006e0e0 2023-10-09T11:36:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.301+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4000c8610 con 0x7fa40006e0e0 2023-10-09T11:36:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.301+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3f4004bc0 con 0x7fa40006e0e0 2023-10-09T11:36:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.302+0000 7fa3e7fff700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.302+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3f4083b80 con 0x7fa40006e0e0 2023-10-09T11:36:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.302+0000 7fa3fffff700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.302+0000 7fa3fffff700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 0x7fa3ec0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000a010 tx=0x7fa3f0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.306+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4000c8610 con 0x7fa40006e0e0 2023-10-09T11:36:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:47.546+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4000c8610 con 0x7fa40006e0e0 2023-10-09T11:36:48.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.148+0000 7fa3e7fff700 1 -- 172.21.15.26:0/1132096597 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4000c8610 con 0x7fa40006e0e0 2023-10-09T11:36:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 msgr2=0x7fa3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 0x7fa3ec0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000a010 tx=0x7fa3f0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 msgr2=0x7fa4000b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40015a0 tx=0x7fa3f4001bf0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 shutdown_connections 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa400159530 0x7fa400154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa40006dc70 0x7fa4000b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.150+0000 7fa4063a5700 1 --2- 172.21.15.26:0/1132096597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40006e0e0 0x7fa4000b5c70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.151+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 >> 172.21.15.26:0/1132096597 conn(0x7fa4000703a0 msgr2=0x7fa4000cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.151+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 shutdown_connections 2023-10-09T11:36:48.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.151+0000 7fa4063a5700 1 -- 172.21.15.26:0/1132096597 wait complete. 2023-10-09T11:36:48.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.285+0000 7f2a43be9700 1 Processor -- start 2023-10-09T11:36:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.285+0000 7f2a43be9700 1 -- start start 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a3c0cd9e0 0x7f2a3c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 0x7f2a3c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d13f0 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c15ae40 con 0x7f2a3c0cd9e0 2023-10-09T11:36:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a43be9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c15ab60 con 0x7f2a3c15a400 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a41985700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a41985700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51768/0 (socket says 172.21.15.26:51768) 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.286+0000 7f2a41985700 1 -- 172.21.15.26:0/1211379492 learned_addr learned my addr 172.21.15.26:0/1211379492 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a42186700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 0x7f2a3c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41184700 1 --2- 172.21.15.26:0/1211379492 >> v2:172.21.15.67:3300/0 conn(0x7f2a3c0cd9e0 0x7f2a3c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 -- 172.21.15.26:0/1211379492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 msgr2=0x7f2a3c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 0x7f2a3c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 -- 172.21.15.26:0/1211379492 >> v2:172.21.15.67:3300/0 conn(0x7f2a3c0cd9e0 msgr2=0x7f2a3c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 --2- 172.21.15.26:0/1211379492 >> v2:172.21.15.67:3300/0 conn(0x7f2a3c0cd9e0 0x7f2a3c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 -- 172.21.15.26:0/1211379492 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0ccf00 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a42186700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 0x7f2a3c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a41985700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009f20 tx=0x7f2a2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4a09efd07e771c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a40983700 1 -- 172.21.15.26:0/1211379492 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00e070 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a40983700 1 -- 172.21.15.26:0/1211379492 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00ba40 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a40983700 1 -- 172.21.15.26:0/1211379492 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0092e0 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 -- 172.21.15.26:0/1211379492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c0cb5a0 msgr2=0x7f2a3c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009f20 tx=0x7f2a2c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 -- 172.21.15.26:0/1211379492 shutdown_connections 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c15a400 0x7f2a3c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1211379492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0cb970 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.287+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1211379492 >> v2:172.21.15.67:3300/0 conn(0x7f2a3c0cd9e0 0x7f2a3c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.288+0000 7f2a43be9700 1 -- 172.21.15.26:0/1211379492 >> 172.21.15.26:0/1211379492 conn(0x7f2a3c070e30 msgr2=0x7f2a3c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.288+0000 7f2a43be9700 1 -- 172.21.15.26:0/1211379492 shutdown_connections 2023-10-09T11:36:48.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.288+0000 7f2a43be9700 1 -- 172.21.15.26:0/1211379492 wait complete. 2023-10-09T11:36:48.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.289+0000 7f2a43be9700 1 Processor -- start 2023-10-09T11:36:48.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.289+0000 7f2a43be9700 1 -- start start 2023-10-09T11:36:48.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.289+0000 7f2a43be9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 0x7f2a3c150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1582e0 con 0x7f2a3c15a400 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c8890 con 0x7f2a3c0cb5a0 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c7c80 con 0x7f2a3c0cd9e0 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51772/0 (socket says 172.21.15.26:51772) 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 -- 172.21.15.26:0/1711678588 learned_addr learned my addr 172.21.15.26:0/1711678588 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a41985700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a41184700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 0x7f2a3c150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 -- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 msgr2=0x7f2a3c150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 0x7f2a3c150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 -- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0cb5a0 msgr2=0x7f2a3c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 -- 172.21.15.26:0/1711678588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009ae0 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a41184700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 0x7f2a3c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a42186700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c850 tx=0x7f2a34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011600 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34011760 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c0c7f60 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011b00 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.290+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0c8520 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.292+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0c9260 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.292+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a34018350 con 0x7f2a3c15a400 2023-10-09T11:36:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.292+0000 7f2a39ffb700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.292+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a340843a0 con 0x7f2a3c15a400 2023-10-09T11:36:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.292+0000 7f2a41985700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.293+0000 7f2a41985700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 0x7f2a280693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.296+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a340550a0 con 0x7f2a3c15a400 2023-10-09T11:36:48.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.532+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a3c0c8a00 con 0x7f2a3c15a400 2023-10-09T11:36:48.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.532+0000 7f2a39ffb700 1 -- 172.21.15.26:0/1711678588 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f2a34054c30 con 0x7f2a3c15a400 2023-10-09T11:36:48.534 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:48.534 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.534+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 msgr2=0x7f2a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.534+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 0x7f2a280693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c018000 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.534+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 msgr2=0x7f2a3c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.534+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c850 tx=0x7f2a34008040 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 shutdown_connections 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a3c15a400 0x7f2a3c158e90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0cb5a0 0x7f2a3c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 --2- 172.21.15.26:0/1711678588 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a3c0cd9e0 0x7f2a3c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 >> 172.21.15.26:0/1711678588 conn(0x7f2a3c070e30 msgr2=0x7f2a3c0b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 shutdown_connections 2023-10-09T11:36:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.535+0000 7f2a43be9700 1 -- 172.21.15.26:0/1711678588 wait complete. 2023-10-09T11:36:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 30 2023-10-09T11:36:48.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.665+0000 7f0087276700 1 Processor -- start 2023-10-09T11:36:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.665+0000 7f0087276700 1 -- start start 2023-10-09T11:36:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0087276700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f00800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0087276700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00800cd9e0 0x7f0080159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0087276700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008015ae40 con 0x7f00800cde50 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0087276700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800d13f0 con 0x7f00800cd9e0 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0087276700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008015ab60 con 0x7f00800cb5a0 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0085813700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f00800cde50 0x7f0080156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55394/0 (socket says 172.21.15.26:55394) 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.666+0000 7f0085813700 1 -- 172.21.15.26:0/3462704605 learned_addr learned my addr 172.21.15.26:0/3462704605 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 --2- 172.21.15.26:0/3462704605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f00800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0084811700 1 --2- 172.21.15.26:0/3462704605 >> v2:172.21.15.67:3300/0 conn(0x7f00800cd9e0 0x7f0080159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768528437 0 0) 0x7f008015ae40 con 0x7f00800cde50 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068003570 con 0x7f00800cde50 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 -- 172.21.15.26:0/3462704605 >> v2:172.21.15.67:3300/0 conn(0x7f00800cd9e0 msgr2=0x7f0080159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 --2- 172.21.15.26:0/3462704605 >> v2:172.21.15.67:3300/0 conn(0x7f00800cd9e0 0x7f0080159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 -- 172.21.15.26:0/3462704605 >> v1:172.21.15.26:6789/0 conn(0x7f00800cde50 legacy=0x7f0080156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449886900 0 0) 0x7f0068003570 con 0x7f00800cde50 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 -- 172.21.15.26:0/3462704605 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800ccf00 con 0x7f00800cb5a0 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f0085012700 1 --2- 172.21.15.26:0/3462704605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f00800cb970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e60 tx=0x7f0070009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca051763008434e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000e070 con 0x7f00800cb5a0 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000b7a0 con 0x7f00800cb5a0 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.667+0000 7f007ffff700 1 -- 172.21.15.26:0/3462704605 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078001470 con 0x7f00800cb5a0 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 -- 172.21.15.26:0/3462704605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 msgr2=0x7f00800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 --2- 172.21.15.26:0/3462704605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f00800cb970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e60 tx=0x7f0070009780 comp rx=0 tx=0).stop 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 -- 172.21.15.26:0/3462704605 shutdown_connections 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 --2- 172.21.15.26:0/3462704605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f00800cb970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 --2- 172.21.15.26:0/3462704605 >> v2:172.21.15.67:3300/0 conn(0x7f00800cd9e0 0x7f0080159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 -- 172.21.15.26:0/3462704605 >> 172.21.15.26:0/3462704605 conn(0x7f0080070e30 msgr2=0x7f00800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 -- 172.21.15.26:0/3462704605 shutdown_connections 2023-10-09T11:36:48.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.668+0000 7f0087276700 1 -- 172.21.15.26:0/3462704605 wait complete. 2023-10-09T11:36:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.669+0000 7f0087276700 1 Processor -- start 2023-10-09T11:36:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.669+0000 7f0087276700 1 -- start start 2023-10-09T11:36:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f008015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 0x7f008015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800c87c0 con 0x7f00800c8320 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008015b730 con 0x7f00800cd9e0 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0087276700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008015ba10 con 0x7f00800cb5a0 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51786/0 (socket says 172.21.15.26:51786) 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 -- 172.21.15.26:0/1978917614 learned_addr learned my addr 172.21.15.26:0/1978917614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0084811700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 0x7f008015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085012700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f008015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 -- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 msgr2=0x7f008015c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f008015c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 -- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 msgr2=0x7f008015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 0x7f008015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085813700 1 -- 172.21.15.26:0/1978917614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009a20 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0084811700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 0x7f008015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.670+0000 7f0085012700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f008015c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f0085813700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f007800cb90 tx=0x7f0078001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078007150 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780072b0 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008015bcf0 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078007670 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.671+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008015c2b0 con 0x7f00800c8320 2023-10-09T11:36:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.672+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008015c4d0 con 0x7f00800c8320 2023-10-09T11:36:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.672+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0078004a40 con 0x7f00800c8320 2023-10-09T11:36:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.672+0000 7f007d7fa700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.673+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0078083d90 con 0x7f00800c8320 2023-10-09T11:36:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.673+0000 7f0085012700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.673+0000 7f0085012700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00700099a0 tx=0x7f0070018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.677+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0078051080 con 0x7f00800c8320 2023-10-09T11:36:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.872+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f008004c3c0 con 0x7f00800c8320 2023-10-09T11:36:48.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.872+0000 7f007d7fa700 1 -- 172.21.15.26:0/1978917614 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0078018020 con 0x7f00800c8320 2023-10-09T11:36:48.874 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:48.874 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:46.093692+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.874+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 msgr2=0x7f006c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.874+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00700099a0 tx=0x7f0070018000 comp rx=0 tx=0).stop 2023-10-09T11:36:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.874+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 msgr2=0x7f00801531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.874+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f007800cb90 tx=0x7f0078001aa0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 shutdown_connections 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00800c8320 0x7f00801531d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00800cb5a0 0x7f008015c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 --2- 172.21.15.26:0/1978917614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00800cd9e0 0x7f008015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 >> 172.21.15.26:0/1978917614 conn(0x7f0080070e30 msgr2=0x7f00800d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 shutdown_connections 2023-10-09T11:36:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:48.875+0000 7f0087276700 1 -- 172.21.15.26:0/1978917614 wait complete. 2023-10-09T11:36:48.888 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:36:48.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.005+0000 7fa7bc32d700 1 Processor -- start 2023-10-09T11:36:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 -- start start 2023-10-09T11:36:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7b40cb5a0 0x7fa7b40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7b40cd9e0 0x7fa7b4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b415ae40 con 0x7fa7b415a400 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40d13f0 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.006+0000 7fa7bc32d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b415ab60 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7b40cb5a0 0x7fa7b40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7b40cb5a0 0x7fa7b40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51800/0 (socket says 172.21.15.26:51800) 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 -- 172.21.15.26:0/1786219151 learned_addr learned my addr 172.21.15.26:0/1786219151 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7b98c8700 1 --2- 172.21.15.26:0/1786219151 >> v2:172.21.15.67:3300/0 conn(0x7fa7b40cd9e0 0x7fa7b4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 -- 172.21.15.26:0/1786219151 >> v2:172.21.15.67:3300/0 conn(0x7fa7b40cd9e0 msgr2=0x7fa7b4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 --2- 172.21.15.26:0/1786219151 >> v2:172.21.15.67:3300/0 conn(0x7fa7b40cd9e0 0x7fa7b4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 -- 172.21.15.26:0/1786219151 >> v1:172.21.15.67:6789/0 conn(0x7fa7b415a400 legacy=0x7fa7b4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 -- 172.21.15.26:0/1786219151 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40ccf00 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7ba0c9700 1 --2- 172.21.15.26:0/1786219151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cb5a0 0x7fa7b40cb970 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009f20 tx=0x7fa7a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b018c88395c80255 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7b90c7700 1 -- 172.21.15.26:0/1786219151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400e070 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7b90c7700 1 -- 172.21.15.26:0/1786219151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a400ba00 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.007+0000 7fa7b90c7700 1 -- 172.21.15.26:0/1786219151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40092e0 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 -- 172.21.15.26:0/1786219151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cb5a0 msgr2=0x7fa7b40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/1786219151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cb5a0 0x7fa7b40cb970 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009f20 tx=0x7fa7a4009840 comp rx=0 tx=0).stop 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 -- 172.21.15.26:0/1786219151 shutdown_connections 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/1786219151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cb5a0 0x7fa7b40cb970 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/1786219151 >> v2:172.21.15.67:3300/0 conn(0x7fa7b40cd9e0 0x7fa7b4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 -- 172.21.15.26:0/1786219151 >> 172.21.15.26:0/1786219151 conn(0x7fa7b4070e30 msgr2=0x7fa7b40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 -- 172.21.15.26:0/1786219151 shutdown_connections 2023-10-09T11:36:49.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.008+0000 7fa7bc32d700 1 -- 172.21.15.26:0/1786219151 wait complete. 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.009+0000 7fa7bc32d700 1 Processor -- start 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.009+0000 7fa7bc32d700 1 -- start start 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b40cb5a0 0x7fa7b4154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b415a400 0x7fa7b40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40c9450 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b4155840 con 0x7fa7b415a400 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b4154990 con 0x7fa7b40cb5a0 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51816/0 (socket says 172.21.15.26:51816) 2023-10-09T11:36:49.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 -- 172.21.15.26:0/3893509088 learned_addr learned my addr 172.21.15.26:0/3893509088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7ba0c9700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b40cb5a0 0x7fa7b4154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7ba8ca700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b415a400 0x7fa7b40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 -- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b40cb5a0 msgr2=0x7fa7b4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b40cb5a0 0x7fa7b4154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 -- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b415a400 msgr2=0x7fa7b40c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b415a400 0x7fa7b40c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 -- 172.21.15.26:0/3893509088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4009ae0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b98c8700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d890 tx=0x7fa7a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80125f0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8012750 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.010+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b40b61c0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.011+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8012af0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.011+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b4154f10 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.011+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b41559f0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.012+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7a801e460 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.012+0000 7fa7b27fc700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 0x7fa7a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.012+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7a8084ab0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.012+0000 7fa7ba0c9700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 0x7fa7a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.013+0000 7fa7ba0c9700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 0x7fa7a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009880 tx=0x7fa7a4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.017+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7b41559f0 con 0x7fa7b40cd9e0 2023-10-09T11:36:49.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.206+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7b404c430 con 0x7fa7a0066f30 2023-10-09T11:36:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.215+0000 7fa7b27fc700 1 -- 172.21.15.26:0/3893509088 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288884 (secure 0 0 0) 0x7fa7b404c430 con 0x7fa7a0066f30 2023-10-09T11:36:49.220 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.218+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 msgr2=0x7fa7a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.218+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 0x7fa7a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009880 tx=0x7fa7a4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.218+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 msgr2=0x7fa7b40b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.218+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d890 tx=0x7fa7a8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 shutdown_connections 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b415a400 0x7fa7b40c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7a0066f30 0x7fa7a00693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b40cb5a0 0x7fa7b4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 --2- 172.21.15.26:0/3893509088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b40cd9e0 0x7fa7b40b5c80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 >> 172.21.15.26:0/3893509088 conn(0x7fa7b4070e30 msgr2=0x7fa7b40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 shutdown_connections 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.219+0000 7fa7bc32d700 1 -- 172.21.15.26:0/3893509088 wait complete. 2023-10-09T11:36:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:49.232 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-09T11:36:49.124705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392276,"kb_used_data":5780,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582444,"statfs":{"total":773094113280,"available":770644422656,"internally_reserved":0,"allocated":5918720,"data_stored":3150340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001471"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.107010+0000","last_change":"2023-10-09T11:36:45.107010+0000","last_active":"2023-10-09T11:36:45.107010+0000","last_peered":"2023-10-09T11:36:45.107010+0000","last_clean":"2023-10-09T11:36:45.107010+0000","last_became_active":"2023-10-09T11:36:45.106756+0000","last_became_peered":"2023-10-09T11:36:45.106756+0000","last_unstale":"2023-10-09T11:36:45.107010+0000","last_undegraded":"2023-10-09T11:36:45.107010+0000","last_fullsized":"2023-10-09T11:36:45.107010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:57.336009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.107224+0000","last_change":"2023-10-09T11:36:45.107224+0000","last_active":"2023-10-09T11:36:45.107224+0000","last_peered":"2023-10-09T11:36:45.107224+0000","last_clean":"2023-10-09T11:36:45.107224+0000","last_became_active":"2023-10-09T11:36:45.106962+0000","last_became_peered":"2023-10-09T11:36:45.106962+0000","last_unstale":"2023-10-09T11:36:45.107224+0000","last_undegraded":"2023-10-09T11:36:45.107224+0000","last_fullsized":"2023-10-09T11:36:45.107224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:34.038576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114286+0000","last_change":"2023-10-09T11:36:45.114286+0000","last_active":"2023-10-09T11:36:45.114286+0000","last_peered":"2023-10-09T11:36:45.114286+0000","last_clean":"2023-10-09T11:36:45.114286+0000","last_became_active":"2023-10-09T11:36:45.113548+0000","last_became_peered":"2023-10-09T11:36:45.113548+0000","last_unstale":"2023-10-09T11:36:45.114286+0000","last_undegraded":"2023-10-09T11:36:45.114286+0000","last_fullsized":"2023-10-09T11:36:45.114286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:38.430520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110820+0000","last_change":"2023-10-09T11:36:45.108771+0000","last_active":"2023-10-09T11:36:45.110820+0000","last_peered":"2023-10-09T11:36:45.110820+0000","last_clean":"2023-10-09T11:36:45.110820+0000","last_became_active":"2023-10-09T11:36:45.108309+0000","last_became_peered":"2023-10-09T11:36:45.108309+0000","last_unstale":"2023-10-09T11:36:45.110820+0000","last_undegraded":"2023-10-09T11:36:45.110820+0000","last_fullsized":"2023-10-09T11:36:45.110820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.111683+0000","last_change":"2023-10-09T11:36:45.111683+0000","last_active":"2023-10-09T11:36:45.111683+0000","last_peered":"2023-10-09T11:36:45.111683+0000","last_clean":"2023-10-09T11:36:45.111683+0000","last_became_active":"2023-10-09T11:36:45.111380+0000","last_became_peered":"2023-10-09T11:36:45.111380+0000","last_unstale":"2023-10-09T11:36:45.111683+0000","last_undegraded":"2023-10-09T11:36:45.111683+0000","last_fullsized":"2023-10-09T11:36:45.111683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:49.540029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110679+0000","last_change":"2023-10-09T11:36:45.110679+0000","last_active":"2023-10-09T11:36:45.110679+0000","last_peered":"2023-10-09T11:36:45.110679+0000","last_clean":"2023-10-09T11:36:45.110679+0000","last_became_active":"2023-10-09T11:36:45.110410+0000","last_became_peered":"2023-10-09T11:36:45.110410+0000","last_unstale":"2023-10-09T11:36:45.110679+0000","last_undegraded":"2023-10-09T11:36:45.110679+0000","last_fullsized":"2023-10-09T11:36:45.110679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112274+0000","last_change":"2023-10-09T11:36:45.103980+0000","last_active":"2023-10-09T11:36:45.112274+0000","last_peered":"2023-10-09T11:36:45.112274+0000","last_clean":"2023-10-09T11:36:45.112274+0000","last_became_active":"2023-10-09T11:36:45.103785+0000","last_became_peered":"2023-10-09T11:36:45.103785+0000","last_unstale":"2023-10-09T11:36:45.112274+0000","last_undegraded":"2023-10-09T11:36:45.112274+0000","last_fullsized":"2023-10-09T11:36:45.112274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:29.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.103973+0000","last_change":"2023-10-09T11:36:45.103973+0000","last_active":"2023-10-09T11:36:45.103973+0000","last_peered":"2023-10-09T11:36:45.103973+0000","last_clean":"2023-10-09T11:36:45.103973+0000","last_became_active":"2023-10-09T11:36:45.103698+0000","last_became_peered":"2023-10-09T11:36:45.103698+0000","last_unstale":"2023-10-09T11:36:45.103973+0000","last_undegraded":"2023-10-09T11:36:45.103973+0000","last_fullsized":"2023-10-09T11:36:45.103973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:34.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117256+0000","last_change":"2023-10-09T11:36:45.106617+0000","last_active":"2023-10-09T11:36:45.117256+0000","last_peered":"2023-10-09T11:36:45.117256+0000","last_clean":"2023-10-09T11:36:45.117256+0000","last_became_active":"2023-10-09T11:36:45.106324+0000","last_became_peered":"2023-10-09T11:36:45.106324+0000","last_unstale":"2023-10-09T11:36:45.117256+0000","last_undegraded":"2023-10-09T11:36:45.117256+0000","last_fullsized":"2023-10-09T11:36:45.117256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:05.034806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.101109+0000","last_change":"2023-10-09T11:36:45.101109+0000","last_active":"2023-10-09T11:36:45.101109+0000","last_peered":"2023-10-09T11:36:45.101109+0000","last_clean":"2023-10-09T11:36:45.101109+0000","last_became_active":"2023-10-09T11:36:45.100797+0000","last_became_peered":"2023-10-09T11:36:45.100797+0000","last_unstale":"2023-10-09T11:36:45.101109+0000","last_undegraded":"2023-10-09T11:36:45.101109+0000","last_fullsized":"2023-10-09T11:36:45.101109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:57.624583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104585+0000","last_change":"2023-10-09T11:36:45.104585+0000","last_active":"2023-10-09T11:36:45.104585+0000","last_peered":"2023-10-09T11:36:45.104585+0000","last_clean":"2023-10-09T11:36:45.104585+0000","last_became_active":"2023-10-09T11:36:45.104321+0000","last_became_peered":"2023-10-09T11:36:45.104321+0000","last_unstale":"2023-10-09T11:36:45.104585+0000","last_undegraded":"2023-10-09T11:36:45.104585+0000","last_fullsized":"2023-10-09T11:36:45.104585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:38.448827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110794+0000","last_change":"2023-10-09T11:36:45.108005+0000","last_active":"2023-10-09T11:36:45.110794+0000","last_peered":"2023-10-09T11:36:45.110794+0000","last_clean":"2023-10-09T11:36:45.110794+0000","last_became_active":"2023-10-09T11:36:45.107702+0000","last_became_peered":"2023-10-09T11:36:45.107702+0000","last_unstale":"2023-10-09T11:36:45.110794+0000","last_undegraded":"2023-10-09T11:36:45.110794+0000","last_fullsized":"2023-10-09T11:36:45.110794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:39.134199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114881+0000","last_change":"2023-10-09T11:36:45.108930+0000","last_active":"2023-10-09T11:36:45.114881+0000","last_peered":"2023-10-09T11:36:45.114881+0000","last_clean":"2023-10-09T11:36:45.114881+0000","last_became_active":"2023-10-09T11:36:45.108672+0000","last_became_peered":"2023-10-09T11:36:45.108672+0000","last_unstale":"2023-10-09T11:36:45.114881+0000","last_undegraded":"2023-10-09T11:36:45.114881+0000","last_fullsized":"2023-10-09T11:36:45.114881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:48.941452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112157+0000","last_change":"2023-10-09T11:36:45.105466+0000","last_active":"2023-10-09T11:36:45.112157+0000","last_peered":"2023-10-09T11:36:45.112157+0000","last_clean":"2023-10-09T11:36:45.112157+0000","last_became_active":"2023-10-09T11:36:45.105247+0000","last_became_peered":"2023-10-09T11:36:45.105247+0000","last_unstale":"2023-10-09T11:36:45.112157+0000","last_undegraded":"2023-10-09T11:36:45.112157+0000","last_fullsized":"2023-10-09T11:36:45.112157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:38.448827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112295+0000","last_change":"2023-10-09T11:36:45.105425+0000","last_active":"2023-10-09T11:36:45.112295+0000","last_peered":"2023-10-09T11:36:45.112295+0000","last_clean":"2023-10-09T11:36:45.112295+0000","last_became_active":"2023-10-09T11:36:45.105121+0000","last_became_peered":"2023-10-09T11:36:45.105121+0000","last_unstale":"2023-10-09T11:36:45.112295+0000","last_undegraded":"2023-10-09T11:36:45.112295+0000","last_fullsized":"2023-10-09T11:36:45.112295+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:43.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113470+0000","last_change":"2023-10-09T11:36:45.113470+0000","last_active":"2023-10-09T11:36:45.113470+0000","last_peered":"2023-10-09T11:36:45.113470+0000","last_clean":"2023-10-09T11:36:45.113470+0000","last_became_active":"2023-10-09T11:36:45.113191+0000","last_became_peered":"2023-10-09T11:36:45.113191+0000","last_unstale":"2023-10-09T11:36:45.113470+0000","last_undegraded":"2023-10-09T11:36:45.113470+0000","last_fullsized":"2023-10-09T11:36:45.113470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:42.315639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113902+0000","last_change":"2023-10-09T11:36:45.113902+0000","last_active":"2023-10-09T11:36:45.113902+0000","last_peered":"2023-10-09T11:36:45.113902+0000","last_clean":"2023-10-09T11:36:45.113902+0000","last_became_active":"2023-10-09T11:36:45.113627+0000","last_became_peered":"2023-10-09T11:36:45.113627+0000","last_unstale":"2023-10-09T11:36:45.113902+0000","last_undegraded":"2023-10-09T11:36:45.113902+0000","last_fullsized":"2023-10-09T11:36:45.113902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:04.496644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115742+0000","last_change":"2023-10-09T11:36:45.115742+0000","last_active":"2023-10-09T11:36:45.115742+0000","last_peered":"2023-10-09T11:36:45.115742+0000","last_clean":"2023-10-09T11:36:45.115742+0000","last_became_active":"2023-10-09T11:36:45.115273+0000","last_became_peered":"2023-10-09T11:36:45.115273+0000","last_unstale":"2023-10-09T11:36:45.115742+0000","last_undegraded":"2023-10-09T11:36:45.115742+0000","last_fullsized":"2023-10-09T11:36:45.115742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.106505+0000","last_change":"2023-10-09T11:36:45.106505+0000","last_active":"2023-10-09T11:36:45.106505+0000","last_peered":"2023-10-09T11:36:45.106505+0000","last_clean":"2023-10-09T11:36:45.106505+0000","last_became_active":"2023-10-09T11:36:45.106230+0000","last_became_peered":"2023-10-09T11:36:45.106230+0000","last_unstale":"2023-10-09T11:36:45.106505+0000","last_undegraded":"2023-10-09T11:36:45.106505+0000","last_fullsized":"2023-10-09T11:36:45.106505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:26.419304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110918+0000","last_change":"2023-10-09T11:36:45.110918+0000","last_active":"2023-10-09T11:36:45.110918+0000","last_peered":"2023-10-09T11:36:45.110918+0000","last_clean":"2023-10-09T11:36:45.110918+0000","last_became_active":"2023-10-09T11:36:45.107736+0000","last_became_peered":"2023-10-09T11:36:45.107736+0000","last_unstale":"2023-10-09T11:36:45.110918+0000","last_undegraded":"2023-10-09T11:36:45.110918+0000","last_fullsized":"2023-10-09T11:36:45.110918+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:08.824410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113046+0000","last_change":"2023-10-09T11:36:45.113046+0000","last_active":"2023-10-09T11:36:45.113046+0000","last_peered":"2023-10-09T11:36:45.113046+0000","last_clean":"2023-10-09T11:36:45.113046+0000","last_became_active":"2023-10-09T11:36:45.112733+0000","last_became_peered":"2023-10-09T11:36:45.112733+0000","last_unstale":"2023-10-09T11:36:45.113046+0000","last_undegraded":"2023-10-09T11:36:45.113046+0000","last_fullsized":"2023-10-09T11:36:45.113046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:01.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114610+0000","last_change":"2023-10-09T11:36:45.114610+0000","last_active":"2023-10-09T11:36:45.114610+0000","last_peered":"2023-10-09T11:36:45.114610+0000","last_clean":"2023-10-09T11:36:45.114610+0000","last_became_active":"2023-10-09T11:36:45.114279+0000","last_became_peered":"2023-10-09T11:36:45.114279+0000","last_unstale":"2023-10-09T11:36:45.114610+0000","last_undegraded":"2023-10-09T11:36:45.114610+0000","last_fullsized":"2023-10-09T11:36:45.114610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:32.784744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113807+0000","last_change":"2023-10-09T11:36:45.113807+0000","last_active":"2023-10-09T11:36:45.113807+0000","last_peered":"2023-10-09T11:36:45.113807+0000","last_clean":"2023-10-09T11:36:45.113807+0000","last_became_active":"2023-10-09T11:36:45.113488+0000","last_became_peered":"2023-10-09T11:36:45.113488+0000","last_unstale":"2023-10-09T11:36:45.113807+0000","last_undegraded":"2023-10-09T11:36:45.113807+0000","last_fullsized":"2023-10-09T11:36:45.113807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:22.728198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114911+0000","last_change":"2023-10-09T11:36:45.108436+0000","last_active":"2023-10-09T11:36:45.114911+0000","last_peered":"2023-10-09T11:36:45.114911+0000","last_clean":"2023-10-09T11:36:45.114911+0000","last_became_active":"2023-10-09T11:36:45.108163+0000","last_became_peered":"2023-10-09T11:36:45.108163+0000","last_unstale":"2023-10-09T11:36:45.114911+0000","last_undegraded":"2023-10-09T11:36:45.114911+0000","last_fullsized":"2023-10-09T11:36:45.114911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:08.348754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112382+0000","last_change":"2023-10-09T11:36:45.112382+0000","last_active":"2023-10-09T11:36:45.112382+0000","last_peered":"2023-10-09T11:36:45.112382+0000","last_clean":"2023-10-09T11:36:45.112382+0000","last_became_active":"2023-10-09T11:36:45.112065+0000","last_became_peered":"2023-10-09T11:36:45.112065+0000","last_unstale":"2023-10-09T11:36:45.112382+0000","last_undegraded":"2023-10-09T11:36:45.112382+0000","last_fullsized":"2023-10-09T11:36:45.112382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:16.970278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110938+0000","last_change":"2023-10-09T11:36:45.107132+0000","last_active":"2023-10-09T11:36:45.110938+0000","last_peered":"2023-10-09T11:36:45.110938+0000","last_clean":"2023-10-09T11:36:45.110938+0000","last_became_active":"2023-10-09T11:36:45.106796+0000","last_became_peered":"2023-10-09T11:36:45.106796+0000","last_unstale":"2023-10-09T11:36:45.110938+0000","last_undegraded":"2023-10-09T11:36:45.110938+0000","last_fullsized":"2023-10-09T11:36:45.110938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:21.215319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113392+0000","last_change":"2023-10-09T11:36:45.113392+0000","last_active":"2023-10-09T11:36:45.113392+0000","last_peered":"2023-10-09T11:36:45.113392+0000","last_clean":"2023-10-09T11:36:45.113392+0000","last_became_active":"2023-10-09T11:36:45.112974+0000","last_became_peered":"2023-10-09T11:36:45.112974+0000","last_unstale":"2023-10-09T11:36:45.113392+0000","last_undegraded":"2023-10-09T11:36:45.113392+0000","last_fullsized":"2023-10-09T11:36:45.113392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112048+0000","last_change":"2023-10-09T11:36:45.112048+0000","last_active":"2023-10-09T11:36:45.112048+0000","last_peered":"2023-10-09T11:36:45.112048+0000","last_clean":"2023-10-09T11:36:45.112048+0000","last_became_active":"2023-10-09T11:36:45.111336+0000","last_became_peered":"2023-10-09T11:36:45.111336+0000","last_unstale":"2023-10-09T11:36:45.112048+0000","last_undegraded":"2023-10-09T11:36:45.112048+0000","last_fullsized":"2023-10-09T11:36:45.112048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:42.573203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104145+0000","last_change":"2023-10-09T11:36:45.104145+0000","last_active":"2023-10-09T11:36:45.104145+0000","last_peered":"2023-10-09T11:36:45.104145+0000","last_clean":"2023-10-09T11:36:45.104145+0000","last_became_active":"2023-10-09T11:36:45.103884+0000","last_became_peered":"2023-10-09T11:36:45.103884+0000","last_unstale":"2023-10-09T11:36:45.104145+0000","last_undegraded":"2023-10-09T11:36:45.104145+0000","last_fullsized":"2023-10-09T11:36:45.104145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:28.705398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113196+0000","last_change":"2023-10-09T11:36:45.113196+0000","last_active":"2023-10-09T11:36:45.113196+0000","last_peered":"2023-10-09T11:36:45.113196+0000","last_clean":"2023-10-09T11:36:45.113196+0000","last_became_active":"2023-10-09T11:36:45.112898+0000","last_became_peered":"2023-10-09T11:36:45.112898+0000","last_unstale":"2023-10-09T11:36:45.113196+0000","last_undegraded":"2023-10-09T11:36:45.113196+0000","last_fullsized":"2023-10-09T11:36:45.113196+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:30.168166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109819+0000","last_change":"2023-10-09T11:36:45.109819+0000","last_active":"2023-10-09T11:36:45.109819+0000","last_peered":"2023-10-09T11:36:45.109819+0000","last_clean":"2023-10-09T11:36:45.109819+0000","last_became_active":"2023-10-09T11:36:45.109616+0000","last_became_peered":"2023-10-09T11:36:45.109616+0000","last_unstale":"2023-10-09T11:36:45.109819+0000","last_undegraded":"2023-10-09T11:36:45.109819+0000","last_fullsized":"2023-10-09T11:36:45.109819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:19.957530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110975+0000","last_change":"2023-10-09T11:36:45.110975+0000","last_active":"2023-10-09T11:36:45.110975+0000","last_peered":"2023-10-09T11:36:45.110975+0000","last_clean":"2023-10-09T11:36:45.110975+0000","last_became_active":"2023-10-09T11:36:45.109739+0000","last_became_peered":"2023-10-09T11:36:45.109739+0000","last_unstale":"2023-10-09T11:36:45.110975+0000","last_undegraded":"2023-10-09T11:36:45.110975+0000","last_fullsized":"2023-10-09T11:36:45.110975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:18.533359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112563+0000","last_change":"2023-10-09T11:36:45.112563+0000","last_active":"2023-10-09T11:36:45.112563+0000","last_peered":"2023-10-09T11:36:45.112563+0000","last_clean":"2023-10-09T11:36:45.112563+0000","last_became_active":"2023-10-09T11:36:45.112298+0000","last_became_peered":"2023-10-09T11:36:45.112298+0000","last_unstale":"2023-10-09T11:36:45.112563+0000","last_undegraded":"2023-10-09T11:36:45.112563+0000","last_fullsized":"2023-10-09T11:36:45.112563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.152549+0000","last_change":"2023-10-09T11:36:44.110433+0000","last_active":"2023-10-09T11:36:45.152549+0000","last_peered":"2023-10-09T11:36:45.152549+0000","last_clean":"2023-10-09T11:36:45.152549+0000","last_became_active":"2023-10-09T11:36:44.110168+0000","last_became_peered":"2023-10-09T11:36:44.110168+0000","last_unstale":"2023-10-09T11:36:45.152549+0000","last_undegraded":"2023-10-09T11:36:45.152549+0000","last_fullsized":"2023-10-09T11:36:45.152549+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:29.824885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108504+0000","last_change":"2023-10-09T11:36:45.108504+0000","last_active":"2023-10-09T11:36:45.108504+0000","last_peered":"2023-10-09T11:36:45.108504+0000","last_clean":"2023-10-09T11:36:45.108504+0000","last_became_active":"2023-10-09T11:36:45.108241+0000","last_became_peered":"2023-10-09T11:36:45.108241+0000","last_unstale":"2023-10-09T11:36:45.108504+0000","last_undegraded":"2023-10-09T11:36:45.108504+0000","last_fullsized":"2023-10-09T11:36:45.108504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:39.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100220+0000","last_change":"2023-10-09T11:36:44.111365+0000","last_active":"2023-10-09T11:36:45.100220+0000","last_peered":"2023-10-09T11:36:45.100220+0000","last_clean":"2023-10-09T11:36:45.100220+0000","last_became_active":"2023-10-09T11:36:44.111042+0000","last_became_peered":"2023-10-09T11:36:44.111042+0000","last_unstale":"2023-10-09T11:36:45.100220+0000","last_undegraded":"2023-10-09T11:36:45.100220+0000","last_fullsized":"2023-10-09T11:36:45.100220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:05.576112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110502+0000","last_change":"2023-10-09T11:36:45.110502+0000","last_active":"2023-10-09T11:36:45.110502+0000","last_peered":"2023-10-09T11:36:45.110502+0000","last_clean":"2023-10-09T11:36:45.110502+0000","last_became_active":"2023-10-09T11:36:45.110202+0000","last_became_peered":"2023-10-09T11:36:45.110202+0000","last_unstale":"2023-10-09T11:36:45.110502+0000","last_undegraded":"2023-10-09T11:36:45.110502+0000","last_fullsized":"2023-10-09T11:36:45.110502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:41.607707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149565+0000","last_change":"2023-10-09T11:36:44.108034+0000","last_active":"2023-10-09T11:36:45.149565+0000","last_peered":"2023-10-09T11:36:45.149565+0000","last_clean":"2023-10-09T11:36:45.149565+0000","last_became_active":"2023-10-09T11:36:44.107790+0000","last_became_peered":"2023-10-09T11:36:44.107790+0000","last_unstale":"2023-10-09T11:36:45.149565+0000","last_undegraded":"2023-10-09T11:36:45.149565+0000","last_fullsized":"2023-10-09T11:36:45.149565+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:36.642362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108010+0000","last_change":"2023-10-09T11:36:45.108010+0000","last_active":"2023-10-09T11:36:45.108010+0000","last_peered":"2023-10-09T11:36:45.108010+0000","last_clean":"2023-10-09T11:36:45.108010+0000","last_became_active":"2023-10-09T11:36:45.107723+0000","last_became_peered":"2023-10-09T11:36:45.107723+0000","last_unstale":"2023-10-09T11:36:45.108010+0000","last_undegraded":"2023-10-09T11:36:45.108010+0000","last_fullsized":"2023-10-09T11:36:45.108010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:08.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149927+0000","last_change":"2023-10-09T11:36:44.111783+0000","last_active":"2023-10-09T11:36:45.149927+0000","last_peered":"2023-10-09T11:36:45.149927+0000","last_clean":"2023-10-09T11:36:45.149927+0000","last_became_active":"2023-10-09T11:36:44.111442+0000","last_became_peered":"2023-10-09T11:36:44.111442+0000","last_unstale":"2023-10-09T11:36:45.149927+0000","last_undegraded":"2023-10-09T11:36:45.149927+0000","last_fullsized":"2023-10-09T11:36:45.149927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.955585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.105400+0000","last_change":"2023-10-09T11:36:45.105400+0000","last_active":"2023-10-09T11:36:45.105400+0000","last_peered":"2023-10-09T11:36:45.105400+0000","last_clean":"2023-10-09T11:36:45.105400+0000","last_became_active":"2023-10-09T11:36:45.105099+0000","last_became_peered":"2023-10-09T11:36:45.105099+0000","last_unstale":"2023-10-09T11:36:45.105400+0000","last_undegraded":"2023-10-09T11:36:45.105400+0000","last_fullsized":"2023-10-09T11:36:45.105400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:54.400704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149041+0000","last_change":"2023-10-09T11:36:44.113320+0000","last_active":"2023-10-09T11:36:45.149041+0000","last_peered":"2023-10-09T11:36:45.149041+0000","last_clean":"2023-10-09T11:36:45.149041+0000","last_became_active":"2023-10-09T11:36:44.113033+0000","last_became_peered":"2023-10-09T11:36:44.113033+0000","last_unstale":"2023-10-09T11:36:45.149041+0000","last_undegraded":"2023-10-09T11:36:45.149041+0000","last_fullsized":"2023-10-09T11:36:45.149041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:53.281594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110937+0000","last_change":"2023-10-09T11:36:45.110937+0000","last_active":"2023-10-09T11:36:45.110937+0000","last_peered":"2023-10-09T11:36:45.110937+0000","last_clean":"2023-10-09T11:36:45.110937+0000","last_became_active":"2023-10-09T11:36:45.108358+0000","last_became_peered":"2023-10-09T11:36:45.108358+0000","last_unstale":"2023-10-09T11:36:45.110937+0000","last_undegraded":"2023-10-09T11:36:45.110937+0000","last_fullsized":"2023-10-09T11:36:45.110937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:39.736766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100853+0000","last_change":"2023-10-09T11:36:44.110722+0000","last_active":"2023-10-09T11:36:45.100853+0000","last_peered":"2023-10-09T11:36:45.100853+0000","last_clean":"2023-10-09T11:36:45.100853+0000","last_became_active":"2023-10-09T11:36:44.110454+0000","last_became_peered":"2023-10-09T11:36:44.110454+0000","last_unstale":"2023-10-09T11:36:45.100853+0000","last_undegraded":"2023-10-09T11:36:45.100853+0000","last_fullsized":"2023-10-09T11:36:45.100853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:35.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112533+0000","last_change":"2023-10-09T11:36:45.107864+0000","last_active":"2023-10-09T11:36:45.112533+0000","last_peered":"2023-10-09T11:36:45.112533+0000","last_clean":"2023-10-09T11:36:45.112533+0000","last_became_active":"2023-10-09T11:36:45.107566+0000","last_became_peered":"2023-10-09T11:36:45.107566+0000","last_unstale":"2023-10-09T11:36:45.112533+0000","last_undegraded":"2023-10-09T11:36:45.112533+0000","last_fullsized":"2023-10-09T11:36:45.112533+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:54.324605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102533+0000","last_change":"2023-10-09T11:36:44.114509+0000","last_active":"2023-10-09T11:36:45.102533+0000","last_peered":"2023-10-09T11:36:45.102533+0000","last_clean":"2023-10-09T11:36:45.102533+0000","last_became_active":"2023-10-09T11:36:44.114252+0000","last_became_peered":"2023-10-09T11:36:44.114252+0000","last_unstale":"2023-10-09T11:36:45.102533+0000","last_undegraded":"2023-10-09T11:36:45.102533+0000","last_fullsized":"2023-10-09T11:36:45.102533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:55.270267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112242+0000","last_change":"2023-10-09T11:36:45.112242+0000","last_active":"2023-10-09T11:36:45.112242+0000","last_peered":"2023-10-09T11:36:45.112242+0000","last_clean":"2023-10-09T11:36:45.112242+0000","last_became_active":"2023-10-09T11:36:45.110623+0000","last_became_peered":"2023-10-09T11:36:45.110623+0000","last_unstale":"2023-10-09T11:36:45.112242+0000","last_undegraded":"2023-10-09T11:36:45.112242+0000","last_fullsized":"2023-10-09T11:36:45.112242+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:47.847398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.097435+0000","last_change":"2023-10-09T11:36:44.116285+0000","last_active":"2023-10-09T11:36:45.097435+0000","last_peered":"2023-10-09T11:36:45.097435+0000","last_clean":"2023-10-09T11:36:45.097435+0000","last_became_active":"2023-10-09T11:36:44.115973+0000","last_became_peered":"2023-10-09T11:36:44.115973+0000","last_unstale":"2023-10-09T11:36:45.097435+0000","last_undegraded":"2023-10-09T11:36:45.097435+0000","last_fullsized":"2023-10-09T11:36:45.097435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:17.087435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117162+0000","last_change":"2023-10-09T11:36:45.106296+0000","last_active":"2023-10-09T11:36:45.117162+0000","last_peered":"2023-10-09T11:36:45.117162+0000","last_clean":"2023-10-09T11:36:45.117162+0000","last_became_active":"2023-10-09T11:36:45.105991+0000","last_became_peered":"2023-10-09T11:36:45.105991+0000","last_unstale":"2023-10-09T11:36:45.117162+0000","last_undegraded":"2023-10-09T11:36:45.117162+0000","last_fullsized":"2023-10-09T11:36:45.117162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:57.624583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.119898+0000","last_change":"2023-10-09T11:36:44.116701+0000","last_active":"2023-10-09T11:36:44.119898+0000","last_peered":"2023-10-09T11:36:44.119898+0000","last_clean":"2023-10-09T11:36:44.119898+0000","last_became_active":"2023-10-09T11:36:44.116436+0000","last_became_peered":"2023-10-09T11:36:44.116436+0000","last_unstale":"2023-10-09T11:36:44.119898+0000","last_undegraded":"2023-10-09T11:36:44.119898+0000","last_fullsized":"2023-10-09T11:36:44.119898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:28.156688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115449+0000","last_change":"2023-10-09T11:36:45.115449+0000","last_active":"2023-10-09T11:36:45.115449+0000","last_peered":"2023-10-09T11:36:45.115449+0000","last_clean":"2023-10-09T11:36:45.115449+0000","last_became_active":"2023-10-09T11:36:45.115157+0000","last_became_peered":"2023-10-09T11:36:45.115157+0000","last_unstale":"2023-10-09T11:36:45.115449+0000","last_undegraded":"2023-10-09T11:36:45.115449+0000","last_fullsized":"2023-10-09T11:36:45.115449+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.113065+0000","last_change":"2023-10-09T11:36:44.111473+0000","last_active":"2023-10-09T11:36:44.113065+0000","last_peered":"2023-10-09T11:36:44.113065+0000","last_clean":"2023-10-09T11:36:44.113065+0000","last_became_active":"2023-10-09T11:36:44.111192+0000","last_became_peered":"2023-10-09T11:36:44.111192+0000","last_unstale":"2023-10-09T11:36:44.113065+0000","last_undegraded":"2023-10-09T11:36:44.113065+0000","last_fullsized":"2023-10-09T11:36:44.113065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:41.311195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109851+0000","last_change":"2023-10-09T11:36:45.109851+0000","last_active":"2023-10-09T11:36:45.109851+0000","last_peered":"2023-10-09T11:36:45.109851+0000","last_clean":"2023-10-09T11:36:45.109851+0000","last_became_active":"2023-10-09T11:36:45.109594+0000","last_became_peered":"2023-10-09T11:36:45.109594+0000","last_unstale":"2023-10-09T11:36:45.109851+0000","last_undegraded":"2023-10-09T11:36:45.109851+0000","last_fullsized":"2023-10-09T11:36:45.109851+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:05.034806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149998+0000","last_change":"2023-10-09T11:36:44.114322+0000","last_active":"2023-10-09T11:36:45.149998+0000","last_peered":"2023-10-09T11:36:45.149998+0000","last_clean":"2023-10-09T11:36:45.149998+0000","last_became_active":"2023-10-09T11:36:44.113944+0000","last_became_peered":"2023-10-09T11:36:44.113944+0000","last_unstale":"2023-10-09T11:36:45.149998+0000","last_undegraded":"2023-10-09T11:36:45.149998+0000","last_fullsized":"2023-10-09T11:36:45.149998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114488+0000","last_change":"2023-10-09T11:36:45.114488+0000","last_active":"2023-10-09T11:36:45.114488+0000","last_peered":"2023-10-09T11:36:45.114488+0000","last_clean":"2023-10-09T11:36:45.114488+0000","last_became_active":"2023-10-09T11:36:45.113963+0000","last_became_peered":"2023-10-09T11:36:45.113963+0000","last_unstale":"2023-10-09T11:36:45.114488+0000","last_undegraded":"2023-10-09T11:36:45.114488+0000","last_fullsized":"2023-10-09T11:36:45.114488+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:42.359020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154155+0000","last_change":"2023-10-09T11:36:44.115296+0000","last_active":"2023-10-09T11:36:45.154155+0000","last_peered":"2023-10-09T11:36:45.154155+0000","last_clean":"2023-10-09T11:36:45.154155+0000","last_became_active":"2023-10-09T11:36:44.115015+0000","last_became_peered":"2023-10-09T11:36:44.115015+0000","last_unstale":"2023-10-09T11:36:45.154155+0000","last_undegraded":"2023-10-09T11:36:45.154155+0000","last_fullsized":"2023-10-09T11:36:45.154155+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:25.219051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115912+0000","last_change":"2023-10-09T11:36:45.110549+0000","last_active":"2023-10-09T11:36:45.115912+0000","last_peered":"2023-10-09T11:36:45.115912+0000","last_clean":"2023-10-09T11:36:45.115912+0000","last_became_active":"2023-10-09T11:36:45.110256+0000","last_became_peered":"2023-10-09T11:36:45.110256+0000","last_unstale":"2023-10-09T11:36:45.115912+0000","last_undegraded":"2023-10-09T11:36:45.115912+0000","last_fullsized":"2023-10-09T11:36:45.115912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.276625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.148221+0000","last_change":"2023-10-09T11:36:44.108435+0000","last_active":"2023-10-09T11:36:45.148221+0000","last_peered":"2023-10-09T11:36:45.148221+0000","last_clean":"2023-10-09T11:36:45.148221+0000","last_became_active":"2023-10-09T11:36:44.108159+0000","last_became_peered":"2023-10-09T11:36:44.108159+0000","last_unstale":"2023-10-09T11:36:45.148221+0000","last_undegraded":"2023-10-09T11:36:45.148221+0000","last_fullsized":"2023-10-09T11:36:45.148221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:17.528914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113741+0000","last_change":"2023-10-09T11:36:45.113741+0000","last_active":"2023-10-09T11:36:45.113741+0000","last_peered":"2023-10-09T11:36:45.113741+0000","last_clean":"2023-10-09T11:36:45.113741+0000","last_became_active":"2023-10-09T11:36:45.113431+0000","last_became_peered":"2023-10-09T11:36:45.113431+0000","last_unstale":"2023-10-09T11:36:45.113741+0000","last_undegraded":"2023-10-09T11:36:45.113741+0000","last_fullsized":"2023-10-09T11:36:45.113741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:21.215319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098308+0000","last_change":"2023-10-09T11:36:44.114064+0000","last_active":"2023-10-09T11:36:45.098308+0000","last_peered":"2023-10-09T11:36:45.098308+0000","last_clean":"2023-10-09T11:36:45.098308+0000","last_became_active":"2023-10-09T11:36:44.113517+0000","last_became_peered":"2023-10-09T11:36:44.113517+0000","last_unstale":"2023-10-09T11:36:45.098308+0000","last_undegraded":"2023-10-09T11:36:45.098308+0000","last_fullsized":"2023-10-09T11:36:45.098308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:57.942487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117260+0000","last_change":"2023-10-09T11:36:45.108406+0000","last_active":"2023-10-09T11:36:45.117260+0000","last_peered":"2023-10-09T11:36:45.117260+0000","last_clean":"2023-10-09T11:36:45.117260+0000","last_became_active":"2023-10-09T11:36:45.108117+0000","last_became_peered":"2023-10-09T11:36:45.108117+0000","last_unstale":"2023-10-09T11:36:45.117260+0000","last_undegraded":"2023-10-09T11:36:45.117260+0000","last_fullsized":"2023-10-09T11:36:45.117260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:39.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102640+0000","last_change":"2023-10-09T11:36:44.111691+0000","last_active":"2023-10-09T11:36:45.102640+0000","last_peered":"2023-10-09T11:36:45.102640+0000","last_clean":"2023-10-09T11:36:45.102640+0000","last_became_active":"2023-10-09T11:36:44.111463+0000","last_became_peered":"2023-10-09T11:36:44.111463+0000","last_unstale":"2023-10-09T11:36:45.102640+0000","last_undegraded":"2023-10-09T11:36:45.102640+0000","last_fullsized":"2023-10-09T11:36:45.102640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:37.444382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115639+0000","last_change":"2023-10-09T11:36:45.115639+0000","last_active":"2023-10-09T11:36:45.115639+0000","last_peered":"2023-10-09T11:36:45.115639+0000","last_clean":"2023-10-09T11:36:45.115639+0000","last_became_active":"2023-10-09T11:36:45.115090+0000","last_became_peered":"2023-10-09T11:36:45.115090+0000","last_unstale":"2023-10-09T11:36:45.115639+0000","last_undegraded":"2023-10-09T11:36:45.115639+0000","last_fullsized":"2023-10-09T11:36:45.115639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:08.688589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154534+0000","last_change":"2023-10-09T11:36:44.116752+0000","last_active":"2023-10-09T11:36:45.154534+0000","last_peered":"2023-10-09T11:36:45.154534+0000","last_clean":"2023-10-09T11:36:45.154534+0000","last_became_active":"2023-10-09T11:36:44.116478+0000","last_became_peered":"2023-10-09T11:36:44.116478+0000","last_unstale":"2023-10-09T11:36:45.154534+0000","last_undegraded":"2023-10-09T11:36:45.154534+0000","last_fullsized":"2023-10-09T11:36:45.154534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117942+0000","last_change":"2023-10-09T11:36:45.117942+0000","last_active":"2023-10-09T11:36:45.117942+0000","last_peered":"2023-10-09T11:36:45.117942+0000","last_clean":"2023-10-09T11:36:45.117942+0000","last_became_active":"2023-10-09T11:36:45.117607+0000","last_became_peered":"2023-10-09T11:36:45.117607+0000","last_unstale":"2023-10-09T11:36:45.117942+0000","last_undegraded":"2023-10-09T11:36:45.117942+0000","last_fullsized":"2023-10-09T11:36:45.117942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:02.251519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100291+0000","last_change":"2023-10-09T11:36:44.111365+0000","last_active":"2023-10-09T11:36:45.100291+0000","last_peered":"2023-10-09T11:36:45.100291+0000","last_clean":"2023-10-09T11:36:45.100291+0000","last_became_active":"2023-10-09T11:36:44.111064+0000","last_became_peered":"2023-10-09T11:36:44.111064+0000","last_unstale":"2023-10-09T11:36:45.100291+0000","last_undegraded":"2023-10-09T11:36:45.100291+0000","last_fullsized":"2023-10-09T11:36:45.100291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.272180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115942+0000","last_change":"2023-10-09T11:36:45.111353+0000","last_active":"2023-10-09T11:36:45.115942+0000","last_peered":"2023-10-09T11:36:45.115942+0000","last_clean":"2023-10-09T11:36:45.115942+0000","last_became_active":"2023-10-09T11:36:45.111068+0000","last_became_peered":"2023-10-09T11:36:45.111068+0000","last_unstale":"2023-10-09T11:36:45.115942+0000","last_undegraded":"2023-10-09T11:36:45.115942+0000","last_fullsized":"2023-10-09T11:36:45.115942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:18.533359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149554+0000","last_change":"2023-10-09T11:36:44.114125+0000","last_active":"2023-10-09T11:36:45.149554+0000","last_peered":"2023-10-09T11:36:45.149554+0000","last_clean":"2023-10-09T11:36:45.149554+0000","last_became_active":"2023-10-09T11:36:44.111608+0000","last_became_peered":"2023-10-09T11:36:44.111608+0000","last_unstale":"2023-10-09T11:36:45.149554+0000","last_undegraded":"2023-10-09T11:36:45.149554+0000","last_fullsized":"2023-10-09T11:36:45.149554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:55.270267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112956+0000","last_change":"2023-10-09T11:36:45.112956+0000","last_active":"2023-10-09T11:36:45.112956+0000","last_peered":"2023-10-09T11:36:45.112956+0000","last_clean":"2023-10-09T11:36:45.112956+0000","last_became_active":"2023-10-09T11:36:45.112704+0000","last_became_peered":"2023-10-09T11:36:45.112704+0000","last_unstale":"2023-10-09T11:36:45.112956+0000","last_undegraded":"2023-10-09T11:36:45.112956+0000","last_fullsized":"2023-10-09T11:36:45.112956+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:44.593472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154156+0000","last_change":"2023-10-09T11:36:44.114162+0000","last_active":"2023-10-09T11:36:45.154156+0000","last_peered":"2023-10-09T11:36:45.154156+0000","last_clean":"2023-10-09T11:36:45.154156+0000","last_became_active":"2023-10-09T11:36:44.113762+0000","last_became_peered":"2023-10-09T11:36:44.113762+0000","last_unstale":"2023-10-09T11:36:45.154156+0000","last_undegraded":"2023-10-09T11:36:45.154156+0000","last_fullsized":"2023-10-09T11:36:45.154156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:28.156688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114494+0000","last_change":"2023-10-09T11:36:45.114494+0000","last_active":"2023-10-09T11:36:45.114494+0000","last_peered":"2023-10-09T11:36:45.114494+0000","last_clean":"2023-10-09T11:36:45.114494+0000","last_became_active":"2023-10-09T11:36:45.114282+0000","last_became_peered":"2023-10-09T11:36:45.114282+0000","last_unstale":"2023-10-09T11:36:45.114494+0000","last_undegraded":"2023-10-09T11:36:45.114494+0000","last_fullsized":"2023-10-09T11:36:45.114494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:09.473671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.115735+0000","last_change":"2023-10-09T11:36:44.114432+0000","last_active":"2023-10-09T11:36:44.115735+0000","last_peered":"2023-10-09T11:36:44.115735+0000","last_clean":"2023-10-09T11:36:44.115735+0000","last_became_active":"2023-10-09T11:36:44.114130+0000","last_became_peered":"2023-10-09T11:36:44.114130+0000","last_unstale":"2023-10-09T11:36:44.115735+0000","last_undegraded":"2023-10-09T11:36:44.115735+0000","last_fullsized":"2023-10-09T11:36:44.115735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:42.475105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115892+0000","last_change":"2023-10-09T11:36:45.110417+0000","last_active":"2023-10-09T11:36:45.115892+0000","last_peered":"2023-10-09T11:36:45.115892+0000","last_clean":"2023-10-09T11:36:45.115892+0000","last_became_active":"2023-10-09T11:36:45.109954+0000","last_became_peered":"2023-10-09T11:36:45.109954+0000","last_unstale":"2023-10-09T11:36:45.115892+0000","last_undegraded":"2023-10-09T11:36:45.115892+0000","last_fullsized":"2023-10-09T11:36:45.115892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:42.315639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149600+0000","last_change":"2023-10-09T11:36:44.114202+0000","last_active":"2023-10-09T11:36:45.149600+0000","last_peered":"2023-10-09T11:36:45.149600+0000","last_clean":"2023-10-09T11:36:45.149600+0000","last_became_active":"2023-10-09T11:36:44.113975+0000","last_became_peered":"2023-10-09T11:36:44.113975+0000","last_unstale":"2023-10-09T11:36:45.149600+0000","last_undegraded":"2023-10-09T11:36:45.149600+0000","last_fullsized":"2023-10-09T11:36:45.149600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:57.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.116192+0000","last_change":"2023-10-09T11:36:45.116192+0000","last_active":"2023-10-09T11:36:45.116192+0000","last_peered":"2023-10-09T11:36:45.116192+0000","last_clean":"2023-10-09T11:36:45.116192+0000","last_became_active":"2023-10-09T11:36:45.115917+0000","last_became_peered":"2023-10-09T11:36:45.115917+0000","last_unstale":"2023-10-09T11:36:45.116192+0000","last_undegraded":"2023-10-09T11:36:45.116192+0000","last_fullsized":"2023-10-09T11:36:45.116192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.276625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.107781+0000","last_change":"2023-10-09T11:36:44.106196+0000","last_active":"2023-10-09T11:36:44.107781+0000","last_peered":"2023-10-09T11:36:44.107781+0000","last_clean":"2023-10-09T11:36:44.107781+0000","last_became_active":"2023-10-09T11:36:44.105936+0000","last_became_peered":"2023-10-09T11:36:44.105936+0000","last_unstale":"2023-10-09T11:36:44.107781+0000","last_undegraded":"2023-10-09T11:36:44.107781+0000","last_fullsized":"2023-10-09T11:36:44.107781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:53.281594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108713+0000","last_change":"2023-10-09T11:36:45.108713+0000","last_active":"2023-10-09T11:36:45.108713+0000","last_peered":"2023-10-09T11:36:45.108713+0000","last_clean":"2023-10-09T11:36:45.108713+0000","last_became_active":"2023-10-09T11:36:45.108456+0000","last_became_peered":"2023-10-09T11:36:45.108456+0000","last_unstale":"2023-10-09T11:36:45.108713+0000","last_undegraded":"2023-10-09T11:36:45.108713+0000","last_fullsized":"2023-10-09T11:36:45.108713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:39.134199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102540+0000","last_change":"2023-10-09T11:36:44.112624+0000","last_active":"2023-10-09T11:36:45.102540+0000","last_peered":"2023-10-09T11:36:45.102540+0000","last_clean":"2023-10-09T11:36:45.102540+0000","last_became_active":"2023-10-09T11:36:44.112334+0000","last_became_peered":"2023-10-09T11:36:44.112334+0000","last_unstale":"2023-10-09T11:36:45.102540+0000","last_undegraded":"2023-10-09T11:36:45.102540+0000","last_fullsized":"2023-10-09T11:36:45.102540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:56.620138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112334+0000","last_change":"2023-10-09T11:36:45.109489+0000","last_active":"2023-10-09T11:36:45.112334+0000","last_peered":"2023-10-09T11:36:45.112334+0000","last_clean":"2023-10-09T11:36:45.112334+0000","last_became_active":"2023-10-09T11:36:45.109231+0000","last_became_peered":"2023-10-09T11:36:45.109231+0000","last_unstale":"2023-10-09T11:36:45.112334+0000","last_undegraded":"2023-10-09T11:36:45.112334+0000","last_fullsized":"2023-10-09T11:36:45.112334+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149160+0000","last_change":"2023-10-09T11:36:44.113028+0000","last_active":"2023-10-09T11:36:45.149160+0000","last_peered":"2023-10-09T11:36:45.149160+0000","last_clean":"2023-10-09T11:36:45.149160+0000","last_became_active":"2023-10-09T11:36:44.112742+0000","last_became_peered":"2023-10-09T11:36:44.112742+0000","last_unstale":"2023-10-09T11:36:45.149160+0000","last_undegraded":"2023-10-09T11:36:45.149160+0000","last_fullsized":"2023-10-09T11:36:45.149160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:17.087435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110845+0000","last_change":"2023-10-09T11:36:45.108817+0000","last_active":"2023-10-09T11:36:45.110845+0000","last_peered":"2023-10-09T11:36:45.110845+0000","last_clean":"2023-10-09T11:36:45.110845+0000","last_became_active":"2023-10-09T11:36:45.107915+0000","last_became_peered":"2023-10-09T11:36:45.107915+0000","last_unstale":"2023-10-09T11:36:45.110845+0000","last_undegraded":"2023-10-09T11:36:45.110845+0000","last_fullsized":"2023-10-09T11:36:45.110845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.114287+0000","last_change":"2023-10-09T11:36:44.111428+0000","last_active":"2023-10-09T11:36:44.114287+0000","last_peered":"2023-10-09T11:36:44.114287+0000","last_clean":"2023-10-09T11:36:44.114287+0000","last_became_active":"2023-10-09T11:36:44.111049+0000","last_became_peered":"2023-10-09T11:36:44.111049+0000","last_unstale":"2023-10-09T11:36:44.114287+0000","last_undegraded":"2023-10-09T11:36:44.114287+0000","last_fullsized":"2023-10-09T11:36:44.114287+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:19.258414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109834+0000","last_change":"2023-10-09T11:36:45.109834+0000","last_active":"2023-10-09T11:36:45.109834+0000","last_peered":"2023-10-09T11:36:45.109834+0000","last_clean":"2023-10-09T11:36:45.109834+0000","last_became_active":"2023-10-09T11:36:45.109573+0000","last_became_peered":"2023-10-09T11:36:45.109573+0000","last_unstale":"2023-10-09T11:36:45.109834+0000","last_undegraded":"2023-10-09T11:36:45.109834+0000","last_fullsized":"2023-10-09T11:36:45.109834+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:43.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098243+0000","last_change":"2023-10-09T11:36:44.113731+0000","last_active":"2023-10-09T11:36:45.098243+0000","last_peered":"2023-10-09T11:36:45.098243+0000","last_clean":"2023-10-09T11:36:45.098243+0000","last_became_active":"2023-10-09T11:36:44.113443+0000","last_became_peered":"2023-10-09T11:36:44.113443+0000","last_unstale":"2023-10-09T11:36:45.098243+0000","last_undegraded":"2023-10-09T11:36:45.098243+0000","last_fullsized":"2023-10-09T11:36:45.098243+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:46.237743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104976+0000","last_change":"2023-10-09T11:36:45.104976+0000","last_active":"2023-10-09T11:36:45.104976+0000","last_peered":"2023-10-09T11:36:45.104976+0000","last_clean":"2023-10-09T11:36:45.104976+0000","last_became_active":"2023-10-09T11:36:45.104717+0000","last_became_peered":"2023-10-09T11:36:45.104717+0000","last_unstale":"2023-10-09T11:36:45.104976+0000","last_undegraded":"2023-10-09T11:36:45.104976+0000","last_fullsized":"2023-10-09T11:36:45.104976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:58.747794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.103252+0000","last_change":"2023-10-09T11:36:44.113419+0000","last_active":"2023-10-09T11:36:45.103252+0000","last_peered":"2023-10-09T11:36:45.103252+0000","last_clean":"2023-10-09T11:36:45.103252+0000","last_became_active":"2023-10-09T11:36:44.113140+0000","last_became_peered":"2023-10-09T11:36:44.113140+0000","last_unstale":"2023-10-09T11:36:45.103252+0000","last_undegraded":"2023-10-09T11:36:45.103252+0000","last_fullsized":"2023-10-09T11:36:45.103252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:35.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110092+0000","last_change":"2023-10-09T11:36:45.110092+0000","last_active":"2023-10-09T11:36:45.110092+0000","last_peered":"2023-10-09T11:36:45.110092+0000","last_clean":"2023-10-09T11:36:45.110092+0000","last_became_active":"2023-10-09T11:36:45.109832+0000","last_became_peered":"2023-10-09T11:36:45.109832+0000","last_unstale":"2023-10-09T11:36:45.110092+0000","last_undegraded":"2023-10-09T11:36:45.110092+0000","last_fullsized":"2023-10-09T11:36:45.110092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:42.212937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.110513+0000","last_change":"2023-10-09T11:36:44.108572+0000","last_active":"2023-10-09T11:36:44.110513+0000","last_peered":"2023-10-09T11:36:44.110513+0000","last_clean":"2023-10-09T11:36:44.110513+0000","last_became_active":"2023-10-09T11:36:44.108308+0000","last_became_peered":"2023-10-09T11:36:44.108308+0000","last_unstale":"2023-10-09T11:36:44.110513+0000","last_undegraded":"2023-10-09T11:36:44.110513+0000","last_fullsized":"2023-10-09T11:36:44.110513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:25.160531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112598+0000","last_change":"2023-10-09T11:36:45.112598+0000","last_active":"2023-10-09T11:36:45.112598+0000","last_peered":"2023-10-09T11:36:45.112598+0000","last_clean":"2023-10-09T11:36:45.112598+0000","last_became_active":"2023-10-09T11:36:45.112348+0000","last_became_peered":"2023-10-09T11:36:45.112348+0000","last_unstale":"2023-10-09T11:36:45.112598+0000","last_undegraded":"2023-10-09T11:36:45.112598+0000","last_fullsized":"2023-10-09T11:36:45.112598+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.097398+0000","last_change":"2023-10-09T11:36:44.114970+0000","last_active":"2023-10-09T11:36:45.097398+0000","last_peered":"2023-10-09T11:36:45.097398+0000","last_clean":"2023-10-09T11:36:45.097398+0000","last_became_active":"2023-10-09T11:36:44.114603+0000","last_became_peered":"2023-10-09T11:36:44.114603+0000","last_unstale":"2023-10-09T11:36:45.097398+0000","last_undegraded":"2023-10-09T11:36:45.097398+0000","last_fullsized":"2023-10-09T11:36:45.097398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:25.160531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.101322+0000","last_change":"2023-10-09T11:36:45.101322+0000","last_active":"2023-10-09T11:36:45.101322+0000","last_peered":"2023-10-09T11:36:45.101322+0000","last_clean":"2023-10-09T11:36:45.101322+0000","last_became_active":"2023-10-09T11:36:45.101040+0000","last_became_peered":"2023-10-09T11:36:45.101040+0000","last_unstale":"2023-10-09T11:36:45.101322+0000","last_undegraded":"2023-10-09T11:36:45.101322+0000","last_fullsized":"2023-10-09T11:36:45.101322+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:29.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.107766+0000","last_change":"2023-10-09T11:36:44.103454+0000","last_active":"2023-10-09T11:36:44.107766+0000","last_peered":"2023-10-09T11:36:44.107766+0000","last_clean":"2023-10-09T11:36:44.107766+0000","last_became_active":"2023-10-09T11:36:44.103107+0000","last_became_peered":"2023-10-09T11:36:44.103107+0000","last_unstale":"2023-10-09T11:36:44.107766+0000","last_undegraded":"2023-10-09T11:36:44.107766+0000","last_fullsized":"2023-10-09T11:36:44.107766+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:25.219051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112051+0000","last_change":"2023-10-09T11:36:45.112051+0000","last_active":"2023-10-09T11:36:45.112051+0000","last_peered":"2023-10-09T11:36:45.112051+0000","last_clean":"2023-10-09T11:36:45.112051+0000","last_became_active":"2023-10-09T11:36:45.110593+0000","last_became_peered":"2023-10-09T11:36:45.110593+0000","last_unstale":"2023-10-09T11:36:45.112051+0000","last_undegraded":"2023-10-09T11:36:45.112051+0000","last_fullsized":"2023-10-09T11:36:45.112051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:27.436296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.114960+0000","last_change":"2023-10-09T11:36:44.107700+0000","last_active":"2023-10-09T11:36:44.114960+0000","last_peered":"2023-10-09T11:36:44.114960+0000","last_clean":"2023-10-09T11:36:44.114960+0000","last_became_active":"2023-10-09T11:36:44.107428+0000","last_became_peered":"2023-10-09T11:36:44.107428+0000","last_unstale":"2023-10-09T11:36:44.114960+0000","last_undegraded":"2023-10-09T11:36:44.114960+0000","last_fullsized":"2023-10-09T11:36:44.114960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:38.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108365+0000","last_change":"2023-10-09T11:36:45.108365+0000","last_active":"2023-10-09T11:36:45.108365+0000","last_peered":"2023-10-09T11:36:45.108365+0000","last_clean":"2023-10-09T11:36:45.108365+0000","last_became_active":"2023-10-09T11:36:45.108050+0000","last_became_peered":"2023-10-09T11:36:45.108050+0000","last_unstale":"2023-10-09T11:36:45.108365+0000","last_undegraded":"2023-10-09T11:36:45.108365+0000","last_fullsized":"2023-10-09T11:36:45.108365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:55.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098150+0000","last_change":"2023-10-09T11:36:44.110429+0000","last_active":"2023-10-09T11:36:45.098150+0000","last_peered":"2023-10-09T11:36:45.098150+0000","last_clean":"2023-10-09T11:36:45.098150+0000","last_became_active":"2023-10-09T11:36:44.110148+0000","last_became_peered":"2023-10-09T11:36:44.110148+0000","last_unstale":"2023-10-09T11:36:45.098150+0000","last_undegraded":"2023-10-09T11:36:45.098150+0000","last_fullsized":"2023-10-09T11:36:45.098150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:25.678353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.109738+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:44.109738+0000","last_peered":"2023-10-09T11:36:44.109738+0000","last_clean":"2023-10-09T11:36:44.109738+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:44.109738+0000","last_undegraded":"2023-10-09T11:36:44.109738+0000","last_fullsized":"2023-10-09T11:36:44.109738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1196032,"data_stored":839820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68700000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":249292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.378},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.374}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.315},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.503}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39600000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.434}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":832897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.23300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.38}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.51200000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.376},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.32100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.51300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66000000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":250828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.443}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":249916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.307},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:49.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.389+0000 7fc901ddc700 1 Processor -- start 2023-10-09T11:36:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.389+0000 7fc901ddc700 1 -- start start 2023-10-09T11:36:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc901ddc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc901ddc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8fc0a90d0 0x7fc8fc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc901ddc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc06e7f0 con 0x7fc8fc06e380 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc901ddc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0ae680 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc901ddc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0aeee0 con 0x7fc8fc0a8d00 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc8faffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8fc0a90d0 0x7fc8fc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc8faffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8fc0a90d0 0x7fc8fc06de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51822/0 (socket says 172.21.15.26:51822) 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc8fbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc8fc06e380 0x7fc8fc0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55398/0 (socket says 172.21.15.26:55398) 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.390+0000 7fc8faffd700 1 -- 172.21.15.26:0/156551163 learned_addr learned my addr 172.21.15.26:0/156551163 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8fb7fe700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8faffd700 1 -- 172.21.15.26:0/156551163 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 msgr2=0x7fc8fc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8faffd700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8faffd700 1 -- 172.21.15.26:0/156551163 >> v1:172.21.15.26:6789/0 conn(0x7fc8fc06e380 legacy=0x7fc8fc0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8fa7fc700 1 -- 172.21.15.26:0/156551163 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038121016 0 0) 0x7fc8fc06e7f0 con 0x7fc8fc06e380 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8faffd700 1 -- 172.21.15.26:0/156551163 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc0cf490 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8faffd700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc06de40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009990 tx=0x7fc8f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ad4657a51572a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8fa7fc700 1 -- 172.21.15.26:0/156551163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0009e80 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8fa7fc700 1 -- 172.21.15.26:0/156551163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0005c10 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.391+0000 7fc8fa7fc700 1 -- 172.21.15.26:0/156551163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000b650 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 -- 172.21.15.26:0/156551163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc0a90d0 msgr2=0x7fc8fc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc06de40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009990 tx=0x7fc8f0009220 comp rx=0 tx=0).stop 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 -- 172.21.15.26:0/156551163 shutdown_connections 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 --2- 172.21.15.26:0/156551163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc06de40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 -- 172.21.15.26:0/156551163 >> 172.21.15.26:0/156551163 conn(0x7fc8fc06ce80 msgr2=0x7fc8fc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 -- 172.21.15.26:0/156551163 shutdown_connections 2023-10-09T11:36:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.392+0000 7fc901ddc700 1 -- 172.21.15.26:0/156551163 wait complete. 2023-10-09T11:36:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.393+0000 7fc901ddc700 1 Processor -- start 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.393+0000 7fc901ddc700 1 -- start start 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc09a290 con 0x7fc8fc06e380 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc09ae10 con 0x7fc8fc0a90d0 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc09a4e0 con 0x7fc8fc0a8d00 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51830/0 (socket says 172.21.15.26:51830) 2023-10-09T11:36:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 -- 172.21.15.26:0/864510231 learned_addr learned my addr 172.21.15.26:0/864510231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8faffd700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fbfff700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 -- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 msgr2=0x7fc8fc0c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 -- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8fc0a90d0 msgr2=0x7fc8fc0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc0c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 -- 172.21.15.26:0/864510231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009480 con 0x7fc8fc06e380 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8fb7fe700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00ecb0 tx=0x7fc8ec009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00c9d0 con 0x7fc8fc06e380 2023-10-09T11:36:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00cb30 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00ceb0 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.394+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc09a7c0 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.395+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc16aa60 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.395+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc16ac50 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.396+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8ec013680 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.396+0000 7fc8e37fe700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 0x7fc8e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.397+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8ec084c30 con 0x7fc8fc06e380 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.397+0000 7fc8faffd700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 0x7fc8e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.397+0000 7fc8faffd700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 0x7fc8e80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009260 tx=0x7fc8f0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.401+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8ec051e00 con 0x7fc8fc06e380 2023-10-09T11:36:49.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.588+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8fc09af50 con 0x7fc8e8066f30 2023-10-09T11:36:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.596+0000 7fc8e37fe700 1 -- 172.21.15.26:0/864510231 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288884 (secure 0 0 0) 0x7fc8f0000bc0 con 0x7fc8e8066f30 2023-10-09T11:36:49.601 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 msgr2=0x7fc8e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 0x7fc8e80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009260 tx=0x7fc8f0016000 comp rx=0 tx=0).stop 2023-10-09T11:36:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 msgr2=0x7fc8fc16a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00ecb0 tx=0x7fc8ec009120 comp rx=0 tx=0).stop 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 shutdown_connections 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8fc0a90d0 0x7fc8fc0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8fc06e380 0x7fc8fc16a520 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8e8066f30 0x7fc8e80693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 --2- 172.21.15.26:0/864510231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8fc0a8d00 0x7fc8fc0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.599+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 >> 172.21.15.26:0/864510231 conn(0x7fc8fc06ce80 msgr2=0x7fc8fc0b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.600+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 shutdown_connections 2023-10-09T11:36:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.600+0000 7fc901ddc700 1 -- 172.21.15.26:0/864510231 wait complete. 2023-10-09T11:36:49.606 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:36:49.613 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-09T11:36:49.124705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392276,"kb_used_data":5780,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582444,"statfs":{"total":773094113280,"available":770644422656,"internally_reserved":0,"allocated":5918720,"data_stored":3150340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001471"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.107010+0000","last_change":"2023-10-09T11:36:45.107010+0000","last_active":"2023-10-09T11:36:45.107010+0000","last_peered":"2023-10-09T11:36:45.107010+0000","last_clean":"2023-10-09T11:36:45.107010+0000","last_became_active":"2023-10-09T11:36:45.106756+0000","last_became_peered":"2023-10-09T11:36:45.106756+0000","last_unstale":"2023-10-09T11:36:45.107010+0000","last_undegraded":"2023-10-09T11:36:45.107010+0000","last_fullsized":"2023-10-09T11:36:45.107010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:57.336009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.107224+0000","last_change":"2023-10-09T11:36:45.107224+0000","last_active":"2023-10-09T11:36:45.107224+0000","last_peered":"2023-10-09T11:36:45.107224+0000","last_clean":"2023-10-09T11:36:45.107224+0000","last_became_active":"2023-10-09T11:36:45.106962+0000","last_became_peered":"2023-10-09T11:36:45.106962+0000","last_unstale":"2023-10-09T11:36:45.107224+0000","last_undegraded":"2023-10-09T11:36:45.107224+0000","last_fullsized":"2023-10-09T11:36:45.107224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:34.038576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114286+0000","last_change":"2023-10-09T11:36:45.114286+0000","last_active":"2023-10-09T11:36:45.114286+0000","last_peered":"2023-10-09T11:36:45.114286+0000","last_clean":"2023-10-09T11:36:45.114286+0000","last_became_active":"2023-10-09T11:36:45.113548+0000","last_became_peered":"2023-10-09T11:36:45.113548+0000","last_unstale":"2023-10-09T11:36:45.114286+0000","last_undegraded":"2023-10-09T11:36:45.114286+0000","last_fullsized":"2023-10-09T11:36:45.114286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:38.430520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110820+0000","last_change":"2023-10-09T11:36:45.108771+0000","last_active":"2023-10-09T11:36:45.110820+0000","last_peered":"2023-10-09T11:36:45.110820+0000","last_clean":"2023-10-09T11:36:45.110820+0000","last_became_active":"2023-10-09T11:36:45.108309+0000","last_became_peered":"2023-10-09T11:36:45.108309+0000","last_unstale":"2023-10-09T11:36:45.110820+0000","last_undegraded":"2023-10-09T11:36:45.110820+0000","last_fullsized":"2023-10-09T11:36:45.110820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.111683+0000","last_change":"2023-10-09T11:36:45.111683+0000","last_active":"2023-10-09T11:36:45.111683+0000","last_peered":"2023-10-09T11:36:45.111683+0000","last_clean":"2023-10-09T11:36:45.111683+0000","last_became_active":"2023-10-09T11:36:45.111380+0000","last_became_peered":"2023-10-09T11:36:45.111380+0000","last_unstale":"2023-10-09T11:36:45.111683+0000","last_undegraded":"2023-10-09T11:36:45.111683+0000","last_fullsized":"2023-10-09T11:36:45.111683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:49.540029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110679+0000","last_change":"2023-10-09T11:36:45.110679+0000","last_active":"2023-10-09T11:36:45.110679+0000","last_peered":"2023-10-09T11:36:45.110679+0000","last_clean":"2023-10-09T11:36:45.110679+0000","last_became_active":"2023-10-09T11:36:45.110410+0000","last_became_peered":"2023-10-09T11:36:45.110410+0000","last_unstale":"2023-10-09T11:36:45.110679+0000","last_undegraded":"2023-10-09T11:36:45.110679+0000","last_fullsized":"2023-10-09T11:36:45.110679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112274+0000","last_change":"2023-10-09T11:36:45.103980+0000","last_active":"2023-10-09T11:36:45.112274+0000","last_peered":"2023-10-09T11:36:45.112274+0000","last_clean":"2023-10-09T11:36:45.112274+0000","last_became_active":"2023-10-09T11:36:45.103785+0000","last_became_peered":"2023-10-09T11:36:45.103785+0000","last_unstale":"2023-10-09T11:36:45.112274+0000","last_undegraded":"2023-10-09T11:36:45.112274+0000","last_fullsized":"2023-10-09T11:36:45.112274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:29.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.103973+0000","last_change":"2023-10-09T11:36:45.103973+0000","last_active":"2023-10-09T11:36:45.103973+0000","last_peered":"2023-10-09T11:36:45.103973+0000","last_clean":"2023-10-09T11:36:45.103973+0000","last_became_active":"2023-10-09T11:36:45.103698+0000","last_became_peered":"2023-10-09T11:36:45.103698+0000","last_unstale":"2023-10-09T11:36:45.103973+0000","last_undegraded":"2023-10-09T11:36:45.103973+0000","last_fullsized":"2023-10-09T11:36:45.103973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:34.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117256+0000","last_change":"2023-10-09T11:36:45.106617+0000","last_active":"2023-10-09T11:36:45.117256+0000","last_peered":"2023-10-09T11:36:45.117256+0000","last_clean":"2023-10-09T11:36:45.117256+0000","last_became_active":"2023-10-09T11:36:45.106324+0000","last_became_peered":"2023-10-09T11:36:45.106324+0000","last_unstale":"2023-10-09T11:36:45.117256+0000","last_undegraded":"2023-10-09T11:36:45.117256+0000","last_fullsized":"2023-10-09T11:36:45.117256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:05.034806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.101109+0000","last_change":"2023-10-09T11:36:45.101109+0000","last_active":"2023-10-09T11:36:45.101109+0000","last_peered":"2023-10-09T11:36:45.101109+0000","last_clean":"2023-10-09T11:36:45.101109+0000","last_became_active":"2023-10-09T11:36:45.100797+0000","last_became_peered":"2023-10-09T11:36:45.100797+0000","last_unstale":"2023-10-09T11:36:45.101109+0000","last_undegraded":"2023-10-09T11:36:45.101109+0000","last_fullsized":"2023-10-09T11:36:45.101109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:57.624583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104585+0000","last_change":"2023-10-09T11:36:45.104585+0000","last_active":"2023-10-09T11:36:45.104585+0000","last_peered":"2023-10-09T11:36:45.104585+0000","last_clean":"2023-10-09T11:36:45.104585+0000","last_became_active":"2023-10-09T11:36:45.104321+0000","last_became_peered":"2023-10-09T11:36:45.104321+0000","last_unstale":"2023-10-09T11:36:45.104585+0000","last_undegraded":"2023-10-09T11:36:45.104585+0000","last_fullsized":"2023-10-09T11:36:45.104585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:38.448827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110794+0000","last_change":"2023-10-09T11:36:45.108005+0000","last_active":"2023-10-09T11:36:45.110794+0000","last_peered":"2023-10-09T11:36:45.110794+0000","last_clean":"2023-10-09T11:36:45.110794+0000","last_became_active":"2023-10-09T11:36:45.107702+0000","last_became_peered":"2023-10-09T11:36:45.107702+0000","last_unstale":"2023-10-09T11:36:45.110794+0000","last_undegraded":"2023-10-09T11:36:45.110794+0000","last_fullsized":"2023-10-09T11:36:45.110794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:39.134199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114881+0000","last_change":"2023-10-09T11:36:45.108930+0000","last_active":"2023-10-09T11:36:45.114881+0000","last_peered":"2023-10-09T11:36:45.114881+0000","last_clean":"2023-10-09T11:36:45.114881+0000","last_became_active":"2023-10-09T11:36:45.108672+0000","last_became_peered":"2023-10-09T11:36:45.108672+0000","last_unstale":"2023-10-09T11:36:45.114881+0000","last_undegraded":"2023-10-09T11:36:45.114881+0000","last_fullsized":"2023-10-09T11:36:45.114881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:48.941452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112157+0000","last_change":"2023-10-09T11:36:45.105466+0000","last_active":"2023-10-09T11:36:45.112157+0000","last_peered":"2023-10-09T11:36:45.112157+0000","last_clean":"2023-10-09T11:36:45.112157+0000","last_became_active":"2023-10-09T11:36:45.105247+0000","last_became_peered":"2023-10-09T11:36:45.105247+0000","last_unstale":"2023-10-09T11:36:45.112157+0000","last_undegraded":"2023-10-09T11:36:45.112157+0000","last_fullsized":"2023-10-09T11:36:45.112157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:38.448827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112295+0000","last_change":"2023-10-09T11:36:45.105425+0000","last_active":"2023-10-09T11:36:45.112295+0000","last_peered":"2023-10-09T11:36:45.112295+0000","last_clean":"2023-10-09T11:36:45.112295+0000","last_became_active":"2023-10-09T11:36:45.105121+0000","last_became_peered":"2023-10-09T11:36:45.105121+0000","last_unstale":"2023-10-09T11:36:45.112295+0000","last_undegraded":"2023-10-09T11:36:45.112295+0000","last_fullsized":"2023-10-09T11:36:45.112295+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:43.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113470+0000","last_change":"2023-10-09T11:36:45.113470+0000","last_active":"2023-10-09T11:36:45.113470+0000","last_peered":"2023-10-09T11:36:45.113470+0000","last_clean":"2023-10-09T11:36:45.113470+0000","last_became_active":"2023-10-09T11:36:45.113191+0000","last_became_peered":"2023-10-09T11:36:45.113191+0000","last_unstale":"2023-10-09T11:36:45.113470+0000","last_undegraded":"2023-10-09T11:36:45.113470+0000","last_fullsized":"2023-10-09T11:36:45.113470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:42.315639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113902+0000","last_change":"2023-10-09T11:36:45.113902+0000","last_active":"2023-10-09T11:36:45.113902+0000","last_peered":"2023-10-09T11:36:45.113902+0000","last_clean":"2023-10-09T11:36:45.113902+0000","last_became_active":"2023-10-09T11:36:45.113627+0000","last_became_peered":"2023-10-09T11:36:45.113627+0000","last_unstale":"2023-10-09T11:36:45.113902+0000","last_undegraded":"2023-10-09T11:36:45.113902+0000","last_fullsized":"2023-10-09T11:36:45.113902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:04.496644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115742+0000","last_change":"2023-10-09T11:36:45.115742+0000","last_active":"2023-10-09T11:36:45.115742+0000","last_peered":"2023-10-09T11:36:45.115742+0000","last_clean":"2023-10-09T11:36:45.115742+0000","last_became_active":"2023-10-09T11:36:45.115273+0000","last_became_peered":"2023-10-09T11:36:45.115273+0000","last_unstale":"2023-10-09T11:36:45.115742+0000","last_undegraded":"2023-10-09T11:36:45.115742+0000","last_fullsized":"2023-10-09T11:36:45.115742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.106505+0000","last_change":"2023-10-09T11:36:45.106505+0000","last_active":"2023-10-09T11:36:45.106505+0000","last_peered":"2023-10-09T11:36:45.106505+0000","last_clean":"2023-10-09T11:36:45.106505+0000","last_became_active":"2023-10-09T11:36:45.106230+0000","last_became_peered":"2023-10-09T11:36:45.106230+0000","last_unstale":"2023-10-09T11:36:45.106505+0000","last_undegraded":"2023-10-09T11:36:45.106505+0000","last_fullsized":"2023-10-09T11:36:45.106505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:26.419304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110918+0000","last_change":"2023-10-09T11:36:45.110918+0000","last_active":"2023-10-09T11:36:45.110918+0000","last_peered":"2023-10-09T11:36:45.110918+0000","last_clean":"2023-10-09T11:36:45.110918+0000","last_became_active":"2023-10-09T11:36:45.107736+0000","last_became_peered":"2023-10-09T11:36:45.107736+0000","last_unstale":"2023-10-09T11:36:45.110918+0000","last_undegraded":"2023-10-09T11:36:45.110918+0000","last_fullsized":"2023-10-09T11:36:45.110918+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:08.824410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113046+0000","last_change":"2023-10-09T11:36:45.113046+0000","last_active":"2023-10-09T11:36:45.113046+0000","last_peered":"2023-10-09T11:36:45.113046+0000","last_clean":"2023-10-09T11:36:45.113046+0000","last_became_active":"2023-10-09T11:36:45.112733+0000","last_became_peered":"2023-10-09T11:36:45.112733+0000","last_unstale":"2023-10-09T11:36:45.113046+0000","last_undegraded":"2023-10-09T11:36:45.113046+0000","last_fullsized":"2023-10-09T11:36:45.113046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:01.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114610+0000","last_change":"2023-10-09T11:36:45.114610+0000","last_active":"2023-10-09T11:36:45.114610+0000","last_peered":"2023-10-09T11:36:45.114610+0000","last_clean":"2023-10-09T11:36:45.114610+0000","last_became_active":"2023-10-09T11:36:45.114279+0000","last_became_peered":"2023-10-09T11:36:45.114279+0000","last_unstale":"2023-10-09T11:36:45.114610+0000","last_undegraded":"2023-10-09T11:36:45.114610+0000","last_fullsized":"2023-10-09T11:36:45.114610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:32.784744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113807+0000","last_change":"2023-10-09T11:36:45.113807+0000","last_active":"2023-10-09T11:36:45.113807+0000","last_peered":"2023-10-09T11:36:45.113807+0000","last_clean":"2023-10-09T11:36:45.113807+0000","last_became_active":"2023-10-09T11:36:45.113488+0000","last_became_peered":"2023-10-09T11:36:45.113488+0000","last_unstale":"2023-10-09T11:36:45.113807+0000","last_undegraded":"2023-10-09T11:36:45.113807+0000","last_fullsized":"2023-10-09T11:36:45.113807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:22.728198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114911+0000","last_change":"2023-10-09T11:36:45.108436+0000","last_active":"2023-10-09T11:36:45.114911+0000","last_peered":"2023-10-09T11:36:45.114911+0000","last_clean":"2023-10-09T11:36:45.114911+0000","last_became_active":"2023-10-09T11:36:45.108163+0000","last_became_peered":"2023-10-09T11:36:45.108163+0000","last_unstale":"2023-10-09T11:36:45.114911+0000","last_undegraded":"2023-10-09T11:36:45.114911+0000","last_fullsized":"2023-10-09T11:36:45.114911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:08.348754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112382+0000","last_change":"2023-10-09T11:36:45.112382+0000","last_active":"2023-10-09T11:36:45.112382+0000","last_peered":"2023-10-09T11:36:45.112382+0000","last_clean":"2023-10-09T11:36:45.112382+0000","last_became_active":"2023-10-09T11:36:45.112065+0000","last_became_peered":"2023-10-09T11:36:45.112065+0000","last_unstale":"2023-10-09T11:36:45.112382+0000","last_undegraded":"2023-10-09T11:36:45.112382+0000","last_fullsized":"2023-10-09T11:36:45.112382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:16.970278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110938+0000","last_change":"2023-10-09T11:36:45.107132+0000","last_active":"2023-10-09T11:36:45.110938+0000","last_peered":"2023-10-09T11:36:45.110938+0000","last_clean":"2023-10-09T11:36:45.110938+0000","last_became_active":"2023-10-09T11:36:45.106796+0000","last_became_peered":"2023-10-09T11:36:45.106796+0000","last_unstale":"2023-10-09T11:36:45.110938+0000","last_undegraded":"2023-10-09T11:36:45.110938+0000","last_fullsized":"2023-10-09T11:36:45.110938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:21.215319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113392+0000","last_change":"2023-10-09T11:36:45.113392+0000","last_active":"2023-10-09T11:36:45.113392+0000","last_peered":"2023-10-09T11:36:45.113392+0000","last_clean":"2023-10-09T11:36:45.113392+0000","last_became_active":"2023-10-09T11:36:45.112974+0000","last_became_peered":"2023-10-09T11:36:45.112974+0000","last_unstale":"2023-10-09T11:36:45.113392+0000","last_undegraded":"2023-10-09T11:36:45.113392+0000","last_fullsized":"2023-10-09T11:36:45.113392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112048+0000","last_change":"2023-10-09T11:36:45.112048+0000","last_active":"2023-10-09T11:36:45.112048+0000","last_peered":"2023-10-09T11:36:45.112048+0000","last_clean":"2023-10-09T11:36:45.112048+0000","last_became_active":"2023-10-09T11:36:45.111336+0000","last_became_peered":"2023-10-09T11:36:45.111336+0000","last_unstale":"2023-10-09T11:36:45.112048+0000","last_undegraded":"2023-10-09T11:36:45.112048+0000","last_fullsized":"2023-10-09T11:36:45.112048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:42.573203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104145+0000","last_change":"2023-10-09T11:36:45.104145+0000","last_active":"2023-10-09T11:36:45.104145+0000","last_peered":"2023-10-09T11:36:45.104145+0000","last_clean":"2023-10-09T11:36:45.104145+0000","last_became_active":"2023-10-09T11:36:45.103884+0000","last_became_peered":"2023-10-09T11:36:45.103884+0000","last_unstale":"2023-10-09T11:36:45.104145+0000","last_undegraded":"2023-10-09T11:36:45.104145+0000","last_fullsized":"2023-10-09T11:36:45.104145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:28.705398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113196+0000","last_change":"2023-10-09T11:36:45.113196+0000","last_active":"2023-10-09T11:36:45.113196+0000","last_peered":"2023-10-09T11:36:45.113196+0000","last_clean":"2023-10-09T11:36:45.113196+0000","last_became_active":"2023-10-09T11:36:45.112898+0000","last_became_peered":"2023-10-09T11:36:45.112898+0000","last_unstale":"2023-10-09T11:36:45.113196+0000","last_undegraded":"2023-10-09T11:36:45.113196+0000","last_fullsized":"2023-10-09T11:36:45.113196+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:30.168166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109819+0000","last_change":"2023-10-09T11:36:45.109819+0000","last_active":"2023-10-09T11:36:45.109819+0000","last_peered":"2023-10-09T11:36:45.109819+0000","last_clean":"2023-10-09T11:36:45.109819+0000","last_became_active":"2023-10-09T11:36:45.109616+0000","last_became_peered":"2023-10-09T11:36:45.109616+0000","last_unstale":"2023-10-09T11:36:45.109819+0000","last_undegraded":"2023-10-09T11:36:45.109819+0000","last_fullsized":"2023-10-09T11:36:45.109819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:19.957530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110975+0000","last_change":"2023-10-09T11:36:45.110975+0000","last_active":"2023-10-09T11:36:45.110975+0000","last_peered":"2023-10-09T11:36:45.110975+0000","last_clean":"2023-10-09T11:36:45.110975+0000","last_became_active":"2023-10-09T11:36:45.109739+0000","last_became_peered":"2023-10-09T11:36:45.109739+0000","last_unstale":"2023-10-09T11:36:45.110975+0000","last_undegraded":"2023-10-09T11:36:45.110975+0000","last_fullsized":"2023-10-09T11:36:45.110975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:18.533359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112563+0000","last_change":"2023-10-09T11:36:45.112563+0000","last_active":"2023-10-09T11:36:45.112563+0000","last_peered":"2023-10-09T11:36:45.112563+0000","last_clean":"2023-10-09T11:36:45.112563+0000","last_became_active":"2023-10-09T11:36:45.112298+0000","last_became_peered":"2023-10-09T11:36:45.112298+0000","last_unstale":"2023-10-09T11:36:45.112563+0000","last_undegraded":"2023-10-09T11:36:45.112563+0000","last_fullsized":"2023-10-09T11:36:45.112563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.152549+0000","last_change":"2023-10-09T11:36:44.110433+0000","last_active":"2023-10-09T11:36:45.152549+0000","last_peered":"2023-10-09T11:36:45.152549+0000","last_clean":"2023-10-09T11:36:45.152549+0000","last_became_active":"2023-10-09T11:36:44.110168+0000","last_became_peered":"2023-10-09T11:36:44.110168+0000","last_unstale":"2023-10-09T11:36:45.152549+0000","last_undegraded":"2023-10-09T11:36:45.152549+0000","last_fullsized":"2023-10-09T11:36:45.152549+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:29.824885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108504+0000","last_change":"2023-10-09T11:36:45.108504+0000","last_active":"2023-10-09T11:36:45.108504+0000","last_peered":"2023-10-09T11:36:45.108504+0000","last_clean":"2023-10-09T11:36:45.108504+0000","last_became_active":"2023-10-09T11:36:45.108241+0000","last_became_peered":"2023-10-09T11:36:45.108241+0000","last_unstale":"2023-10-09T11:36:45.108504+0000","last_undegraded":"2023-10-09T11:36:45.108504+0000","last_fullsized":"2023-10-09T11:36:45.108504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:39.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100220+0000","last_change":"2023-10-09T11:36:44.111365+0000","last_active":"2023-10-09T11:36:45.100220+0000","last_peered":"2023-10-09T11:36:45.100220+0000","last_clean":"2023-10-09T11:36:45.100220+0000","last_became_active":"2023-10-09T11:36:44.111042+0000","last_became_peered":"2023-10-09T11:36:44.111042+0000","last_unstale":"2023-10-09T11:36:45.100220+0000","last_undegraded":"2023-10-09T11:36:45.100220+0000","last_fullsized":"2023-10-09T11:36:45.100220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:05.576112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110502+0000","last_change":"2023-10-09T11:36:45.110502+0000","last_active":"2023-10-09T11:36:45.110502+0000","last_peered":"2023-10-09T11:36:45.110502+0000","last_clean":"2023-10-09T11:36:45.110502+0000","last_became_active":"2023-10-09T11:36:45.110202+0000","last_became_peered":"2023-10-09T11:36:45.110202+0000","last_unstale":"2023-10-09T11:36:45.110502+0000","last_undegraded":"2023-10-09T11:36:45.110502+0000","last_fullsized":"2023-10-09T11:36:45.110502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:41.607707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149565+0000","last_change":"2023-10-09T11:36:44.108034+0000","last_active":"2023-10-09T11:36:45.149565+0000","last_peered":"2023-10-09T11:36:45.149565+0000","last_clean":"2023-10-09T11:36:45.149565+0000","last_became_active":"2023-10-09T11:36:44.107790+0000","last_became_peered":"2023-10-09T11:36:44.107790+0000","last_unstale":"2023-10-09T11:36:45.149565+0000","last_undegraded":"2023-10-09T11:36:45.149565+0000","last_fullsized":"2023-10-09T11:36:45.149565+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:36.642362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108010+0000","last_change":"2023-10-09T11:36:45.108010+0000","last_active":"2023-10-09T11:36:45.108010+0000","last_peered":"2023-10-09T11:36:45.108010+0000","last_clean":"2023-10-09T11:36:45.108010+0000","last_became_active":"2023-10-09T11:36:45.107723+0000","last_became_peered":"2023-10-09T11:36:45.107723+0000","last_unstale":"2023-10-09T11:36:45.108010+0000","last_undegraded":"2023-10-09T11:36:45.108010+0000","last_fullsized":"2023-10-09T11:36:45.108010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:08.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149927+0000","last_change":"2023-10-09T11:36:44.111783+0000","last_active":"2023-10-09T11:36:45.149927+0000","last_peered":"2023-10-09T11:36:45.149927+0000","last_clean":"2023-10-09T11:36:45.149927+0000","last_became_active":"2023-10-09T11:36:44.111442+0000","last_became_peered":"2023-10-09T11:36:44.111442+0000","last_unstale":"2023-10-09T11:36:45.149927+0000","last_undegraded":"2023-10-09T11:36:45.149927+0000","last_fullsized":"2023-10-09T11:36:45.149927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.955585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.105400+0000","last_change":"2023-10-09T11:36:45.105400+0000","last_active":"2023-10-09T11:36:45.105400+0000","last_peered":"2023-10-09T11:36:45.105400+0000","last_clean":"2023-10-09T11:36:45.105400+0000","last_became_active":"2023-10-09T11:36:45.105099+0000","last_became_peered":"2023-10-09T11:36:45.105099+0000","last_unstale":"2023-10-09T11:36:45.105400+0000","last_undegraded":"2023-10-09T11:36:45.105400+0000","last_fullsized":"2023-10-09T11:36:45.105400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:54.400704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149041+0000","last_change":"2023-10-09T11:36:44.113320+0000","last_active":"2023-10-09T11:36:45.149041+0000","last_peered":"2023-10-09T11:36:45.149041+0000","last_clean":"2023-10-09T11:36:45.149041+0000","last_became_active":"2023-10-09T11:36:44.113033+0000","last_became_peered":"2023-10-09T11:36:44.113033+0000","last_unstale":"2023-10-09T11:36:45.149041+0000","last_undegraded":"2023-10-09T11:36:45.149041+0000","last_fullsized":"2023-10-09T11:36:45.149041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:53.281594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110937+0000","last_change":"2023-10-09T11:36:45.110937+0000","last_active":"2023-10-09T11:36:45.110937+0000","last_peered":"2023-10-09T11:36:45.110937+0000","last_clean":"2023-10-09T11:36:45.110937+0000","last_became_active":"2023-10-09T11:36:45.108358+0000","last_became_peered":"2023-10-09T11:36:45.108358+0000","last_unstale":"2023-10-09T11:36:45.110937+0000","last_undegraded":"2023-10-09T11:36:45.110937+0000","last_fullsized":"2023-10-09T11:36:45.110937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:39.736766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100853+0000","last_change":"2023-10-09T11:36:44.110722+0000","last_active":"2023-10-09T11:36:45.100853+0000","last_peered":"2023-10-09T11:36:45.100853+0000","last_clean":"2023-10-09T11:36:45.100853+0000","last_became_active":"2023-10-09T11:36:44.110454+0000","last_became_peered":"2023-10-09T11:36:44.110454+0000","last_unstale":"2023-10-09T11:36:45.100853+0000","last_undegraded":"2023-10-09T11:36:45.100853+0000","last_fullsized":"2023-10-09T11:36:45.100853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:35.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112533+0000","last_change":"2023-10-09T11:36:45.107864+0000","last_active":"2023-10-09T11:36:45.112533+0000","last_peered":"2023-10-09T11:36:45.112533+0000","last_clean":"2023-10-09T11:36:45.112533+0000","last_became_active":"2023-10-09T11:36:45.107566+0000","last_became_peered":"2023-10-09T11:36:45.107566+0000","last_unstale":"2023-10-09T11:36:45.112533+0000","last_undegraded":"2023-10-09T11:36:45.112533+0000","last_fullsized":"2023-10-09T11:36:45.112533+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:54.324605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102533+0000","last_change":"2023-10-09T11:36:44.114509+0000","last_active":"2023-10-09T11:36:45.102533+0000","last_peered":"2023-10-09T11:36:45.102533+0000","last_clean":"2023-10-09T11:36:45.102533+0000","last_became_active":"2023-10-09T11:36:44.114252+0000","last_became_peered":"2023-10-09T11:36:44.114252+0000","last_unstale":"2023-10-09T11:36:45.102533+0000","last_undegraded":"2023-10-09T11:36:45.102533+0000","last_fullsized":"2023-10-09T11:36:45.102533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:55.270267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112242+0000","last_change":"2023-10-09T11:36:45.112242+0000","last_active":"2023-10-09T11:36:45.112242+0000","last_peered":"2023-10-09T11:36:45.112242+0000","last_clean":"2023-10-09T11:36:45.112242+0000","last_became_active":"2023-10-09T11:36:45.110623+0000","last_became_peered":"2023-10-09T11:36:45.110623+0000","last_unstale":"2023-10-09T11:36:45.112242+0000","last_undegraded":"2023-10-09T11:36:45.112242+0000","last_fullsized":"2023-10-09T11:36:45.112242+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:47.847398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.097435+0000","last_change":"2023-10-09T11:36:44.116285+0000","last_active":"2023-10-09T11:36:45.097435+0000","last_peered":"2023-10-09T11:36:45.097435+0000","last_clean":"2023-10-09T11:36:45.097435+0000","last_became_active":"2023-10-09T11:36:44.115973+0000","last_became_peered":"2023-10-09T11:36:44.115973+0000","last_unstale":"2023-10-09T11:36:45.097435+0000","last_undegraded":"2023-10-09T11:36:45.097435+0000","last_fullsized":"2023-10-09T11:36:45.097435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:17.087435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117162+0000","last_change":"2023-10-09T11:36:45.106296+0000","last_active":"2023-10-09T11:36:45.117162+0000","last_peered":"2023-10-09T11:36:45.117162+0000","last_clean":"2023-10-09T11:36:45.117162+0000","last_became_active":"2023-10-09T11:36:45.105991+0000","last_became_peered":"2023-10-09T11:36:45.105991+0000","last_unstale":"2023-10-09T11:36:45.117162+0000","last_undegraded":"2023-10-09T11:36:45.117162+0000","last_fullsized":"2023-10-09T11:36:45.117162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:57.624583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.119898+0000","last_change":"2023-10-09T11:36:44.116701+0000","last_active":"2023-10-09T11:36:44.119898+0000","last_peered":"2023-10-09T11:36:44.119898+0000","last_clean":"2023-10-09T11:36:44.119898+0000","last_became_active":"2023-10-09T11:36:44.116436+0000","last_became_peered":"2023-10-09T11:36:44.116436+0000","last_unstale":"2023-10-09T11:36:44.119898+0000","last_undegraded":"2023-10-09T11:36:44.119898+0000","last_fullsized":"2023-10-09T11:36:44.119898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:28.156688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115449+0000","last_change":"2023-10-09T11:36:45.115449+0000","last_active":"2023-10-09T11:36:45.115449+0000","last_peered":"2023-10-09T11:36:45.115449+0000","last_clean":"2023-10-09T11:36:45.115449+0000","last_became_active":"2023-10-09T11:36:45.115157+0000","last_became_peered":"2023-10-09T11:36:45.115157+0000","last_unstale":"2023-10-09T11:36:45.115449+0000","last_undegraded":"2023-10-09T11:36:45.115449+0000","last_fullsized":"2023-10-09T11:36:45.115449+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:48.720175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.113065+0000","last_change":"2023-10-09T11:36:44.111473+0000","last_active":"2023-10-09T11:36:44.113065+0000","last_peered":"2023-10-09T11:36:44.113065+0000","last_clean":"2023-10-09T11:36:44.113065+0000","last_became_active":"2023-10-09T11:36:44.111192+0000","last_became_peered":"2023-10-09T11:36:44.111192+0000","last_unstale":"2023-10-09T11:36:44.113065+0000","last_undegraded":"2023-10-09T11:36:44.113065+0000","last_fullsized":"2023-10-09T11:36:44.113065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:41.311195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109851+0000","last_change":"2023-10-09T11:36:45.109851+0000","last_active":"2023-10-09T11:36:45.109851+0000","last_peered":"2023-10-09T11:36:45.109851+0000","last_clean":"2023-10-09T11:36:45.109851+0000","last_became_active":"2023-10-09T11:36:45.109594+0000","last_became_peered":"2023-10-09T11:36:45.109594+0000","last_unstale":"2023-10-09T11:36:45.109851+0000","last_undegraded":"2023-10-09T11:36:45.109851+0000","last_fullsized":"2023-10-09T11:36:45.109851+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:05.034806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149998+0000","last_change":"2023-10-09T11:36:44.114322+0000","last_active":"2023-10-09T11:36:45.149998+0000","last_peered":"2023-10-09T11:36:45.149998+0000","last_clean":"2023-10-09T11:36:45.149998+0000","last_became_active":"2023-10-09T11:36:44.113944+0000","last_became_peered":"2023-10-09T11:36:44.113944+0000","last_unstale":"2023-10-09T11:36:45.149998+0000","last_undegraded":"2023-10-09T11:36:45.149998+0000","last_fullsized":"2023-10-09T11:36:45.149998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114488+0000","last_change":"2023-10-09T11:36:45.114488+0000","last_active":"2023-10-09T11:36:45.114488+0000","last_peered":"2023-10-09T11:36:45.114488+0000","last_clean":"2023-10-09T11:36:45.114488+0000","last_became_active":"2023-10-09T11:36:45.113963+0000","last_became_peered":"2023-10-09T11:36:45.113963+0000","last_unstale":"2023-10-09T11:36:45.114488+0000","last_undegraded":"2023-10-09T11:36:45.114488+0000","last_fullsized":"2023-10-09T11:36:45.114488+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:42.359020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154155+0000","last_change":"2023-10-09T11:36:44.115296+0000","last_active":"2023-10-09T11:36:45.154155+0000","last_peered":"2023-10-09T11:36:45.154155+0000","last_clean":"2023-10-09T11:36:45.154155+0000","last_became_active":"2023-10-09T11:36:44.115015+0000","last_became_peered":"2023-10-09T11:36:44.115015+0000","last_unstale":"2023-10-09T11:36:45.154155+0000","last_undegraded":"2023-10-09T11:36:45.154155+0000","last_fullsized":"2023-10-09T11:36:45.154155+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:25.219051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115912+0000","last_change":"2023-10-09T11:36:45.110549+0000","last_active":"2023-10-09T11:36:45.115912+0000","last_peered":"2023-10-09T11:36:45.115912+0000","last_clean":"2023-10-09T11:36:45.115912+0000","last_became_active":"2023-10-09T11:36:45.110256+0000","last_became_peered":"2023-10-09T11:36:45.110256+0000","last_unstale":"2023-10-09T11:36:45.115912+0000","last_undegraded":"2023-10-09T11:36:45.115912+0000","last_fullsized":"2023-10-09T11:36:45.115912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.276625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.148221+0000","last_change":"2023-10-09T11:36:44.108435+0000","last_active":"2023-10-09T11:36:45.148221+0000","last_peered":"2023-10-09T11:36:45.148221+0000","last_clean":"2023-10-09T11:36:45.148221+0000","last_became_active":"2023-10-09T11:36:44.108159+0000","last_became_peered":"2023-10-09T11:36:44.108159+0000","last_unstale":"2023-10-09T11:36:45.148221+0000","last_undegraded":"2023-10-09T11:36:45.148221+0000","last_fullsized":"2023-10-09T11:36:45.148221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:17.528914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.113741+0000","last_change":"2023-10-09T11:36:45.113741+0000","last_active":"2023-10-09T11:36:45.113741+0000","last_peered":"2023-10-09T11:36:45.113741+0000","last_clean":"2023-10-09T11:36:45.113741+0000","last_became_active":"2023-10-09T11:36:45.113431+0000","last_became_peered":"2023-10-09T11:36:45.113431+0000","last_unstale":"2023-10-09T11:36:45.113741+0000","last_undegraded":"2023-10-09T11:36:45.113741+0000","last_fullsized":"2023-10-09T11:36:45.113741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:21.215319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098308+0000","last_change":"2023-10-09T11:36:44.114064+0000","last_active":"2023-10-09T11:36:45.098308+0000","last_peered":"2023-10-09T11:36:45.098308+0000","last_clean":"2023-10-09T11:36:45.098308+0000","last_became_active":"2023-10-09T11:36:44.113517+0000","last_became_peered":"2023-10-09T11:36:44.113517+0000","last_unstale":"2023-10-09T11:36:45.098308+0000","last_undegraded":"2023-10-09T11:36:45.098308+0000","last_fullsized":"2023-10-09T11:36:45.098308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:57.942487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117260+0000","last_change":"2023-10-09T11:36:45.108406+0000","last_active":"2023-10-09T11:36:45.117260+0000","last_peered":"2023-10-09T11:36:45.117260+0000","last_clean":"2023-10-09T11:36:45.117260+0000","last_became_active":"2023-10-09T11:36:45.108117+0000","last_became_peered":"2023-10-09T11:36:45.108117+0000","last_unstale":"2023-10-09T11:36:45.117260+0000","last_undegraded":"2023-10-09T11:36:45.117260+0000","last_fullsized":"2023-10-09T11:36:45.117260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:39.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102640+0000","last_change":"2023-10-09T11:36:44.111691+0000","last_active":"2023-10-09T11:36:45.102640+0000","last_peered":"2023-10-09T11:36:45.102640+0000","last_clean":"2023-10-09T11:36:45.102640+0000","last_became_active":"2023-10-09T11:36:44.111463+0000","last_became_peered":"2023-10-09T11:36:44.111463+0000","last_unstale":"2023-10-09T11:36:45.102640+0000","last_undegraded":"2023-10-09T11:36:45.102640+0000","last_fullsized":"2023-10-09T11:36:45.102640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:37.444382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115639+0000","last_change":"2023-10-09T11:36:45.115639+0000","last_active":"2023-10-09T11:36:45.115639+0000","last_peered":"2023-10-09T11:36:45.115639+0000","last_clean":"2023-10-09T11:36:45.115639+0000","last_became_active":"2023-10-09T11:36:45.115090+0000","last_became_peered":"2023-10-09T11:36:45.115090+0000","last_unstale":"2023-10-09T11:36:45.115639+0000","last_undegraded":"2023-10-09T11:36:45.115639+0000","last_fullsized":"2023-10-09T11:36:45.115639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:08.688589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154534+0000","last_change":"2023-10-09T11:36:44.116752+0000","last_active":"2023-10-09T11:36:45.154534+0000","last_peered":"2023-10-09T11:36:45.154534+0000","last_clean":"2023-10-09T11:36:45.154534+0000","last_became_active":"2023-10-09T11:36:44.116478+0000","last_became_peered":"2023-10-09T11:36:44.116478+0000","last_unstale":"2023-10-09T11:36:45.154534+0000","last_undegraded":"2023-10-09T11:36:45.154534+0000","last_fullsized":"2023-10-09T11:36:45.154534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.117942+0000","last_change":"2023-10-09T11:36:45.117942+0000","last_active":"2023-10-09T11:36:45.117942+0000","last_peered":"2023-10-09T11:36:45.117942+0000","last_clean":"2023-10-09T11:36:45.117942+0000","last_became_active":"2023-10-09T11:36:45.117607+0000","last_became_peered":"2023-10-09T11:36:45.117607+0000","last_unstale":"2023-10-09T11:36:45.117942+0000","last_undegraded":"2023-10-09T11:36:45.117942+0000","last_fullsized":"2023-10-09T11:36:45.117942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:02.251519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.100291+0000","last_change":"2023-10-09T11:36:44.111365+0000","last_active":"2023-10-09T11:36:45.100291+0000","last_peered":"2023-10-09T11:36:45.100291+0000","last_clean":"2023-10-09T11:36:45.100291+0000","last_became_active":"2023-10-09T11:36:44.111064+0000","last_became_peered":"2023-10-09T11:36:44.111064+0000","last_unstale":"2023-10-09T11:36:45.100291+0000","last_undegraded":"2023-10-09T11:36:45.100291+0000","last_fullsized":"2023-10-09T11:36:45.100291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.272180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115942+0000","last_change":"2023-10-09T11:36:45.111353+0000","last_active":"2023-10-09T11:36:45.115942+0000","last_peered":"2023-10-09T11:36:45.115942+0000","last_clean":"2023-10-09T11:36:45.115942+0000","last_became_active":"2023-10-09T11:36:45.111068+0000","last_became_peered":"2023-10-09T11:36:45.111068+0000","last_unstale":"2023-10-09T11:36:45.115942+0000","last_undegraded":"2023-10-09T11:36:45.115942+0000","last_fullsized":"2023-10-09T11:36:45.115942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:18.533359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149554+0000","last_change":"2023-10-09T11:36:44.114125+0000","last_active":"2023-10-09T11:36:45.149554+0000","last_peered":"2023-10-09T11:36:45.149554+0000","last_clean":"2023-10-09T11:36:45.149554+0000","last_became_active":"2023-10-09T11:36:44.111608+0000","last_became_peered":"2023-10-09T11:36:44.111608+0000","last_unstale":"2023-10-09T11:36:45.149554+0000","last_undegraded":"2023-10-09T11:36:45.149554+0000","last_fullsized":"2023-10-09T11:36:45.149554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:55.270267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112956+0000","last_change":"2023-10-09T11:36:45.112956+0000","last_active":"2023-10-09T11:36:45.112956+0000","last_peered":"2023-10-09T11:36:45.112956+0000","last_clean":"2023-10-09T11:36:45.112956+0000","last_became_active":"2023-10-09T11:36:45.112704+0000","last_became_peered":"2023-10-09T11:36:45.112704+0000","last_unstale":"2023-10-09T11:36:45.112956+0000","last_undegraded":"2023-10-09T11:36:45.112956+0000","last_fullsized":"2023-10-09T11:36:45.112956+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:44.593472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.154156+0000","last_change":"2023-10-09T11:36:44.114162+0000","last_active":"2023-10-09T11:36:45.154156+0000","last_peered":"2023-10-09T11:36:45.154156+0000","last_clean":"2023-10-09T11:36:45.154156+0000","last_became_active":"2023-10-09T11:36:44.113762+0000","last_became_peered":"2023-10-09T11:36:44.113762+0000","last_unstale":"2023-10-09T11:36:45.154156+0000","last_undegraded":"2023-10-09T11:36:45.154156+0000","last_fullsized":"2023-10-09T11:36:45.154156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:28.156688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.114494+0000","last_change":"2023-10-09T11:36:45.114494+0000","last_active":"2023-10-09T11:36:45.114494+0000","last_peered":"2023-10-09T11:36:45.114494+0000","last_clean":"2023-10-09T11:36:45.114494+0000","last_became_active":"2023-10-09T11:36:45.114282+0000","last_became_peered":"2023-10-09T11:36:45.114282+0000","last_unstale":"2023-10-09T11:36:45.114494+0000","last_undegraded":"2023-10-09T11:36:45.114494+0000","last_fullsized":"2023-10-09T11:36:45.114494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:09.473671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.115735+0000","last_change":"2023-10-09T11:36:44.114432+0000","last_active":"2023-10-09T11:36:44.115735+0000","last_peered":"2023-10-09T11:36:44.115735+0000","last_clean":"2023-10-09T11:36:44.115735+0000","last_became_active":"2023-10-09T11:36:44.114130+0000","last_became_peered":"2023-10-09T11:36:44.114130+0000","last_unstale":"2023-10-09T11:36:44.115735+0000","last_undegraded":"2023-10-09T11:36:44.115735+0000","last_fullsized":"2023-10-09T11:36:44.115735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:42.475105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.115892+0000","last_change":"2023-10-09T11:36:45.110417+0000","last_active":"2023-10-09T11:36:45.115892+0000","last_peered":"2023-10-09T11:36:45.115892+0000","last_clean":"2023-10-09T11:36:45.115892+0000","last_became_active":"2023-10-09T11:36:45.109954+0000","last_became_peered":"2023-10-09T11:36:45.109954+0000","last_unstale":"2023-10-09T11:36:45.115892+0000","last_undegraded":"2023-10-09T11:36:45.115892+0000","last_fullsized":"2023-10-09T11:36:45.115892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:42.315639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149600+0000","last_change":"2023-10-09T11:36:44.114202+0000","last_active":"2023-10-09T11:36:45.149600+0000","last_peered":"2023-10-09T11:36:45.149600+0000","last_clean":"2023-10-09T11:36:45.149600+0000","last_became_active":"2023-10-09T11:36:44.113975+0000","last_became_peered":"2023-10-09T11:36:44.113975+0000","last_unstale":"2023-10-09T11:36:45.149600+0000","last_undegraded":"2023-10-09T11:36:45.149600+0000","last_fullsized":"2023-10-09T11:36:45.149600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:57.481962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.116192+0000","last_change":"2023-10-09T11:36:45.116192+0000","last_active":"2023-10-09T11:36:45.116192+0000","last_peered":"2023-10-09T11:36:45.116192+0000","last_clean":"2023-10-09T11:36:45.116192+0000","last_became_active":"2023-10-09T11:36:45.115917+0000","last_became_peered":"2023-10-09T11:36:45.115917+0000","last_unstale":"2023-10-09T11:36:45.116192+0000","last_undegraded":"2023-10-09T11:36:45.116192+0000","last_fullsized":"2023-10-09T11:36:45.116192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.276625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.107781+0000","last_change":"2023-10-09T11:36:44.106196+0000","last_active":"2023-10-09T11:36:44.107781+0000","last_peered":"2023-10-09T11:36:44.107781+0000","last_clean":"2023-10-09T11:36:44.107781+0000","last_became_active":"2023-10-09T11:36:44.105936+0000","last_became_peered":"2023-10-09T11:36:44.105936+0000","last_unstale":"2023-10-09T11:36:44.107781+0000","last_undegraded":"2023-10-09T11:36:44.107781+0000","last_fullsized":"2023-10-09T11:36:44.107781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:53.281594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108713+0000","last_change":"2023-10-09T11:36:45.108713+0000","last_active":"2023-10-09T11:36:45.108713+0000","last_peered":"2023-10-09T11:36:45.108713+0000","last_clean":"2023-10-09T11:36:45.108713+0000","last_became_active":"2023-10-09T11:36:45.108456+0000","last_became_peered":"2023-10-09T11:36:45.108456+0000","last_unstale":"2023-10-09T11:36:45.108713+0000","last_undegraded":"2023-10-09T11:36:45.108713+0000","last_fullsized":"2023-10-09T11:36:45.108713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:39.134199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.102540+0000","last_change":"2023-10-09T11:36:44.112624+0000","last_active":"2023-10-09T11:36:45.102540+0000","last_peered":"2023-10-09T11:36:45.102540+0000","last_clean":"2023-10-09T11:36:45.102540+0000","last_became_active":"2023-10-09T11:36:44.112334+0000","last_became_peered":"2023-10-09T11:36:44.112334+0000","last_unstale":"2023-10-09T11:36:45.102540+0000","last_undegraded":"2023-10-09T11:36:45.102540+0000","last_fullsized":"2023-10-09T11:36:45.102540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:56.620138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112334+0000","last_change":"2023-10-09T11:36:45.109489+0000","last_active":"2023-10-09T11:36:45.112334+0000","last_peered":"2023-10-09T11:36:45.112334+0000","last_clean":"2023-10-09T11:36:45.112334+0000","last_became_active":"2023-10-09T11:36:45.109231+0000","last_became_peered":"2023-10-09T11:36:45.109231+0000","last_unstale":"2023-10-09T11:36:45.112334+0000","last_undegraded":"2023-10-09T11:36:45.112334+0000","last_fullsized":"2023-10-09T11:36:45.112334+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.149160+0000","last_change":"2023-10-09T11:36:44.113028+0000","last_active":"2023-10-09T11:36:45.149160+0000","last_peered":"2023-10-09T11:36:45.149160+0000","last_clean":"2023-10-09T11:36:45.149160+0000","last_became_active":"2023-10-09T11:36:44.112742+0000","last_became_peered":"2023-10-09T11:36:44.112742+0000","last_unstale":"2023-10-09T11:36:45.149160+0000","last_undegraded":"2023-10-09T11:36:45.149160+0000","last_fullsized":"2023-10-09T11:36:45.149160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:17.087435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110845+0000","last_change":"2023-10-09T11:36:45.108817+0000","last_active":"2023-10-09T11:36:45.110845+0000","last_peered":"2023-10-09T11:36:45.110845+0000","last_clean":"2023-10-09T11:36:45.110845+0000","last_became_active":"2023-10-09T11:36:45.107915+0000","last_became_peered":"2023-10-09T11:36:45.107915+0000","last_unstale":"2023-10-09T11:36:45.110845+0000","last_undegraded":"2023-10-09T11:36:45.110845+0000","last_fullsized":"2023-10-09T11:36:45.110845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:06.580556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.114287+0000","last_change":"2023-10-09T11:36:44.111428+0000","last_active":"2023-10-09T11:36:44.114287+0000","last_peered":"2023-10-09T11:36:44.114287+0000","last_clean":"2023-10-09T11:36:44.114287+0000","last_became_active":"2023-10-09T11:36:44.111049+0000","last_became_peered":"2023-10-09T11:36:44.111049+0000","last_unstale":"2023-10-09T11:36:44.114287+0000","last_undegraded":"2023-10-09T11:36:44.114287+0000","last_fullsized":"2023-10-09T11:36:44.114287+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:19.258414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.109834+0000","last_change":"2023-10-09T11:36:45.109834+0000","last_active":"2023-10-09T11:36:45.109834+0000","last_peered":"2023-10-09T11:36:45.109834+0000","last_clean":"2023-10-09T11:36:45.109834+0000","last_became_active":"2023-10-09T11:36:45.109573+0000","last_became_peered":"2023-10-09T11:36:45.109573+0000","last_unstale":"2023-10-09T11:36:45.109834+0000","last_undegraded":"2023-10-09T11:36:45.109834+0000","last_fullsized":"2023-10-09T11:36:45.109834+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:43.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098243+0000","last_change":"2023-10-09T11:36:44.113731+0000","last_active":"2023-10-09T11:36:45.098243+0000","last_peered":"2023-10-09T11:36:45.098243+0000","last_clean":"2023-10-09T11:36:45.098243+0000","last_became_active":"2023-10-09T11:36:44.113443+0000","last_became_peered":"2023-10-09T11:36:44.113443+0000","last_unstale":"2023-10-09T11:36:45.098243+0000","last_undegraded":"2023-10-09T11:36:45.098243+0000","last_fullsized":"2023-10-09T11:36:45.098243+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:46.237743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.104976+0000","last_change":"2023-10-09T11:36:45.104976+0000","last_active":"2023-10-09T11:36:45.104976+0000","last_peered":"2023-10-09T11:36:45.104976+0000","last_clean":"2023-10-09T11:36:45.104976+0000","last_became_active":"2023-10-09T11:36:45.104717+0000","last_became_peered":"2023-10-09T11:36:45.104717+0000","last_unstale":"2023-10-09T11:36:45.104976+0000","last_undegraded":"2023-10-09T11:36:45.104976+0000","last_fullsized":"2023-10-09T11:36:45.104976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:58.747794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.103252+0000","last_change":"2023-10-09T11:36:44.113419+0000","last_active":"2023-10-09T11:36:45.103252+0000","last_peered":"2023-10-09T11:36:45.103252+0000","last_clean":"2023-10-09T11:36:45.103252+0000","last_became_active":"2023-10-09T11:36:44.113140+0000","last_became_peered":"2023-10-09T11:36:44.113140+0000","last_unstale":"2023-10-09T11:36:45.103252+0000","last_undegraded":"2023-10-09T11:36:45.103252+0000","last_fullsized":"2023-10-09T11:36:45.103252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:35.170747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.110092+0000","last_change":"2023-10-09T11:36:45.110092+0000","last_active":"2023-10-09T11:36:45.110092+0000","last_peered":"2023-10-09T11:36:45.110092+0000","last_clean":"2023-10-09T11:36:45.110092+0000","last_became_active":"2023-10-09T11:36:45.109832+0000","last_became_peered":"2023-10-09T11:36:45.109832+0000","last_unstale":"2023-10-09T11:36:45.110092+0000","last_undegraded":"2023-10-09T11:36:45.110092+0000","last_fullsized":"2023-10-09T11:36:45.110092+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:42.212937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.110513+0000","last_change":"2023-10-09T11:36:44.108572+0000","last_active":"2023-10-09T11:36:44.110513+0000","last_peered":"2023-10-09T11:36:44.110513+0000","last_clean":"2023-10-09T11:36:44.110513+0000","last_became_active":"2023-10-09T11:36:44.108308+0000","last_became_peered":"2023-10-09T11:36:44.108308+0000","last_unstale":"2023-10-09T11:36:44.110513+0000","last_undegraded":"2023-10-09T11:36:44.110513+0000","last_fullsized":"2023-10-09T11:36:44.110513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:25.160531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112598+0000","last_change":"2023-10-09T11:36:45.112598+0000","last_active":"2023-10-09T11:36:45.112598+0000","last_peered":"2023-10-09T11:36:45.112598+0000","last_clean":"2023-10-09T11:36:45.112598+0000","last_became_active":"2023-10-09T11:36:45.112348+0000","last_became_peered":"2023-10-09T11:36:45.112348+0000","last_unstale":"2023-10-09T11:36:45.112598+0000","last_undegraded":"2023-10-09T11:36:45.112598+0000","last_fullsized":"2023-10-09T11:36:45.112598+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:58.486407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.097398+0000","last_change":"2023-10-09T11:36:44.114970+0000","last_active":"2023-10-09T11:36:45.097398+0000","last_peered":"2023-10-09T11:36:45.097398+0000","last_clean":"2023-10-09T11:36:45.097398+0000","last_became_active":"2023-10-09T11:36:44.114603+0000","last_became_peered":"2023-10-09T11:36:44.114603+0000","last_unstale":"2023-10-09T11:36:45.097398+0000","last_undegraded":"2023-10-09T11:36:45.097398+0000","last_fullsized":"2023-10-09T11:36:45.097398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:25.160531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.101322+0000","last_change":"2023-10-09T11:36:45.101322+0000","last_active":"2023-10-09T11:36:45.101322+0000","last_peered":"2023-10-09T11:36:45.101322+0000","last_clean":"2023-10-09T11:36:45.101322+0000","last_became_active":"2023-10-09T11:36:45.101040+0000","last_became_peered":"2023-10-09T11:36:45.101040+0000","last_unstale":"2023-10-09T11:36:45.101322+0000","last_undegraded":"2023-10-09T11:36:45.101322+0000","last_fullsized":"2023-10-09T11:36:45.101322+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:29.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.107766+0000","last_change":"2023-10-09T11:36:44.103454+0000","last_active":"2023-10-09T11:36:44.107766+0000","last_peered":"2023-10-09T11:36:44.107766+0000","last_clean":"2023-10-09T11:36:44.107766+0000","last_became_active":"2023-10-09T11:36:44.103107+0000","last_became_peered":"2023-10-09T11:36:44.103107+0000","last_unstale":"2023-10-09T11:36:44.107766+0000","last_undegraded":"2023-10-09T11:36:44.107766+0000","last_fullsized":"2023-10-09T11:36:44.107766+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:25.219051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.112051+0000","last_change":"2023-10-09T11:36:45.112051+0000","last_active":"2023-10-09T11:36:45.112051+0000","last_peered":"2023-10-09T11:36:45.112051+0000","last_clean":"2023-10-09T11:36:45.112051+0000","last_became_active":"2023-10-09T11:36:45.110593+0000","last_became_peered":"2023-10-09T11:36:45.110593+0000","last_unstale":"2023-10-09T11:36:45.112051+0000","last_undegraded":"2023-10-09T11:36:45.112051+0000","last_fullsized":"2023-10-09T11:36:45.112051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:27.436296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.114960+0000","last_change":"2023-10-09T11:36:44.107700+0000","last_active":"2023-10-09T11:36:44.114960+0000","last_peered":"2023-10-09T11:36:44.114960+0000","last_clean":"2023-10-09T11:36:44.114960+0000","last_became_active":"2023-10-09T11:36:44.107428+0000","last_became_peered":"2023-10-09T11:36:44.107428+0000","last_unstale":"2023-10-09T11:36:44.114960+0000","last_undegraded":"2023-10-09T11:36:44.114960+0000","last_fullsized":"2023-10-09T11:36:44.114960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:38.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.108365+0000","last_change":"2023-10-09T11:36:45.108365+0000","last_active":"2023-10-09T11:36:45.108365+0000","last_peered":"2023-10-09T11:36:45.108365+0000","last_clean":"2023-10-09T11:36:45.108365+0000","last_became_active":"2023-10-09T11:36:45.108050+0000","last_became_peered":"2023-10-09T11:36:45.108050+0000","last_unstale":"2023-10-09T11:36:45.108365+0000","last_undegraded":"2023-10-09T11:36:45.108365+0000","last_fullsized":"2023-10-09T11:36:45.108365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:44.083857+0000","last_clean_scrub_stamp":"2023-10-09T11:36:44.083857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:55.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T11:36:45.098150+0000","last_change":"2023-10-09T11:36:44.110429+0000","last_active":"2023-10-09T11:36:45.098150+0000","last_peered":"2023-10-09T11:36:45.098150+0000","last_clean":"2023-10-09T11:36:45.098150+0000","last_became_active":"2023-10-09T11:36:44.110148+0000","last_became_peered":"2023-10-09T11:36:44.110148+0000","last_unstale":"2023-10-09T11:36:45.098150+0000","last_undegraded":"2023-10-09T11:36:45.098150+0000","last_fullsized":"2023-10-09T11:36:45.098150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:43.079412+0000","last_clean_scrub_stamp":"2023-10-09T11:36:43.079412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:25.678353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T11:36:44.109738+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:36:44.109738+0000","last_peered":"2023-10-09T11:36:44.109738+0000","last_clean":"2023-10-09T11:36:44.109738+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:36:44.109738+0000","last_undegraded":"2023-10-09T11:36:44.109738+0000","last_fullsized":"2023-10-09T11:36:44.109738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298456,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073384,"statfs":{"total":96636764160,"available":96331145216,"internally_reserved":0,"allocated":1196032,"data_stored":839820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68700000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":249292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.378},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.374}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.315},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.503}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39600000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.434}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":832897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.23300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.38}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.51200000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.376},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.32100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":581632,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.51300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66000000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":250828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.443}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.495},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":249916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.307},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:36:49.620 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:36:49.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:36:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.778+0000 7f0614a98700 1 Processor -- start 2023-10-09T11:36:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.778+0000 7f0614a98700 1 -- start start 2023-10-09T11:36:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f0614a98700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0610159530 0x7f06100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f0614a98700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 0x7f06100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f0614a98700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100ccfd0 con 0x7f061006dc70 2023-10-09T11:36:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f0614a98700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100cf0e0 con 0x7f0610159530 2023-10-09T11:36:49.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f0614a98700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061015a3d0 con 0x7f061006e0e0 2023-10-09T11:36:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060e59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0610159530 0x7f06100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060ed9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 0x7f06100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060e59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0610159530 0x7f06100ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:55690/0 (socket says 172.21.15.26:55690) 2023-10-09T11:36:49.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060ed9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 0x7f06100cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:45346/0 (socket says 172.21.15.26:45346) 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060e59c700 1 -- 172.21.15.26:0/1365471737 learned_addr learned my addr 172.21.15.26:0/1365471737 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.779+0000 7f060dd9b700 1 --1- 172.21.15.26:0/1365471737 >> v1:172.21.15.67:6789/0 conn(0x7f061006dc70 0x7f0610159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53046/0 (socket says 172.21.15.26:53046) 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060e59c700 1 -- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 msgr2=0x7f06100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060e59c700 1 --2- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 0x7f06100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060e59c700 1 -- 172.21.15.26:0/1365471737 >> v1:172.21.15.67:6789/0 conn(0x7f061006dc70 legacy=0x7f0610159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060e59c700 1 -- 172.21.15.26:0/1365471737 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061015a6b0 con 0x7f0610159530 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060d59a700 1 -- 172.21.15.26:0/1365471737 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297028748 0 0) 0x7f06100ccfd0 con 0x7f061006dc70 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060e59c700 1 --2- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0610159530 0x7f06100ceba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06000099b0 tx=0x7f0600009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9bf7cb2ae2c7077 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060d59a700 1 -- 172.21.15.26:0/1365471737 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600009ea0 con 0x7f0610159530 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060d59a700 1 -- 172.21.15.26:0/1365471737 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000b860 con 0x7f0610159530 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.780+0000 7f060d59a700 1 -- 172.21.15.26:0/1365471737 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000bc00 con 0x7f0610159530 2023-10-09T11:36:49.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 -- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0610159530 msgr2=0x7f06100ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 --2- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0610159530 0x7f06100ceba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06000099b0 tx=0x7f0600009250 comp rx=0 tx=0).stop 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 -- 172.21.15.26:0/1365471737 shutdown_connections 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 --2- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f061006e0e0 0x7f06100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 --2- 172.21.15.26:0/1365471737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0610159530 0x7f06100ceba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 -- 172.21.15.26:0/1365471737 >> 172.21.15.26:0/1365471737 conn(0x7f06100703a0 msgr2=0x7f06100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 -- 172.21.15.26:0/1365471737 shutdown_connections 2023-10-09T11:36:49.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.781+0000 7f0614a98700 1 -- 172.21.15.26:0/1365471737 wait complete. 2023-10-09T11:36:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.782+0000 7f0614a98700 1 Processor -- start 2023-10-09T11:36:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.782+0000 7f0614a98700 1 -- start start 2023-10-09T11:36:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 0x7f06100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0610159530 0x7f0610147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610154c30 con 0x7f061006dc70 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c8340 con 0x7f061006e0e0 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c8620 con 0x7f0610159530 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54620/0 (socket says 172.21.15.26:54620) 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 -- 172.21.15.26:0/2160519010 learned_addr learned my addr 172.21.15.26:0/2160519010 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060dd9b700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 0x7f06100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060ed9d700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0610159530 0x7f0610147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 -- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0610159530 msgr2=0x7f0610147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0610159530 0x7f0610147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 -- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 msgr2=0x7f06100b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 0x7f06100b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 -- 172.21.15.26:0/2160519010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000094f0 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060dd9b700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 0x7f06100b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f060e59c700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0610089650 tx=0x7f0600017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000bbe0 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600011420 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06100c8900 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000117e0 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.783+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06100c8ec0 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.784+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061004c3c0 con 0x7f061006dc70 2023-10-09T11:36:49.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.785+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0600011c10 con 0x7f061006dc70 2023-10-09T11:36:49.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.785+0000 7f06067fc700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.785+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0600085e00 con 0x7f061006dc70 2023-10-09T11:36:49.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.786+0000 7f060dd9b700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.786+0000 7f060dd9b700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 0x7f05f00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f06100b29e0 tx=0x7f05f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:49.790+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0600053070 con 0x7f061006dc70 2023-10-09T11:36:50.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.063+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f061015a990 con 0x7f061006dc70 2023-10-09T11:36:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.066+0000 7f06067fc700 1 -- 172.21.15.26:0/2160519010 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0600056690 con 0x7f061006dc70 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 msgr2=0x7f05f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 0x7f05f00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f06100b29e0 tx=0x7f05f8009040 comp rx=0 tx=0).stop 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 msgr2=0x7f06100cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0610089650 tx=0x7f0600017000 comp rx=0 tx=0).stop 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 shutdown_connections 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0610159530 0x7f0610147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f061006dc70 0x7f06100cb700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 --2- 172.21.15.26:0/2160519010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061006e0e0 0x7f06100b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.068+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 >> 172.21.15.26:0/2160519010 conn(0x7f06100703a0 msgr2=0x7f0610155000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.069+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 shutdown_connections 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.069+0000 7f0614a98700 1 -- 172.21.15.26:0/2160519010 wait complete. 2023-10-09T11:36:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:36:50.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:50.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.201+0000 7f51e5e96700 1 Processor -- start 2023-10-09T11:36:50.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.201+0000 7f51e5e96700 1 -- start start 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5e96700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51e015de50 0x7f51e00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5e96700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e00cef40 0x7f51e015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5e96700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00cf3c0 con 0x7f51e0153c30 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5e96700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e015afd0 con 0x7f51e015de50 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5e96700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e015b2b0 con 0x7f51e00cef40 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51e015de50 0x7f51e00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51e015de50 0x7f51e00cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54626/0 (socket says 172.21.15.26:54626) 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 -- 172.21.15.26:0/683771635 learned_addr learned my addr 172.21.15.26:0/683771635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51e5695700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e00cef40 0x7f51e015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 -- 172.21.15.26:0/683771635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e00cef40 msgr2=0x7f51e015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e00cef40 0x7f51e015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 -- 172.21.15.26:0/683771635 >> v1:172.21.15.67:6789/0 conn(0x7f51e0153c30 legacy=0x7f51e015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.202+0000 7f51dffff700 1 -- 172.21.15.26:0/683771635 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e015b590 con 0x7f51e015de50 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51dffff700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00cea00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009f20 tx=0x7f51d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c89a1e68da41bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51df7fe700 1 -- 172.21.15.26:0/683771635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000e070 con 0x7f51e015de50 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51df7fe700 1 -- 172.21.15.26:0/683771635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000ba80 con 0x7f51e015de50 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51df7fe700 1 -- 172.21.15.26:0/683771635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00092e0 con 0x7f51e015de50 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 -- 172.21.15.26:0/683771635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 msgr2=0x7f51e00cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00cea00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009f20 tx=0x7f51d0009840 comp rx=0 tx=0).stop 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 -- 172.21.15.26:0/683771635 shutdown_connections 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e00cef40 0x7f51e015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 --2- 172.21.15.26:0/683771635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00cea00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 -- 172.21.15.26:0/683771635 >> 172.21.15.26:0/683771635 conn(0x7f51e00703a0 msgr2=0x7f51e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 -- 172.21.15.26:0/683771635 shutdown_connections 2023-10-09T11:36:50.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.203+0000 7f51e5e96700 1 -- 172.21.15.26:0/683771635 wait complete. 2023-10-09T11:36:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.204+0000 7f51e5e96700 1 Processor -- start 2023-10-09T11:36:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 -- start start 2023-10-09T11:36:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51e00cef40 0x7f51e0144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e0153c30 0x7f51e00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c75e0 con 0x7f51e015de50 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c8400 con 0x7f51e00cef40 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5e96700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c77f0 con 0x7f51e0153c30 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5695700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5695700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54632/0 (socket says 172.21.15.26:54632) 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e5695700 1 -- 172.21.15.26:0/2133579014 learned_addr learned my addr 172.21.15.26:0/2133579014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51dffff700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e0153c30 0x7f51e00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.205+0000 7f51e4e94700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51e00cef40 0x7f51e0144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 -- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e0153c30 msgr2=0x7f51e00b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e0153c30 0x7f51e00b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 -- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51e00cef40 msgr2=0x7f51e0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51e00cef40 0x7f51e0144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 -- 172.21.15.26:0/2133579014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0009ae0 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5695700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f51c800d860 tx=0x7f51c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c80125f0 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8012790 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e00c7ad0 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8012b50 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.206+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e00c8090 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.207+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e00d0170 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.208+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51c8013480 con 0x7f51e015de50 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.208+0000 7f51dcff9700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.208+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51c8084850 con 0x7f51e015de50 2023-10-09T11:36:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.208+0000 7f51e4e94700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.209+0000 7f51e4e94700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51d8003a80 tx=0x7f51d8007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.212+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51c8051ac0 con 0x7f51e015de50 2023-10-09T11:36:50.423 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-10-09T11:36:50.422+0000 7f011faa7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:50.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.449+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e00c8570 con 0x7f51e015de50 2023-10-09T11:36:50.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.450+0000 7f51dcff9700 1 -- 172.21.15.26:0/2133579014 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f51c80550e0 con 0x7f51e015de50 2023-10-09T11:36:50.451 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:50.451 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:50.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.451+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 msgr2=0x7f51c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.451+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51d8003a80 tx=0x7f51d8007ec0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.451+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 msgr2=0x7f51e00b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.451+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f51c800d860 tx=0x7f51c8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:50.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 shutdown_connections 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e015de50 0x7f51e00b0d50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51e00cef40 0x7f51e0144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 --2- 172.21.15.26:0/2133579014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51e0153c30 0x7f51e00b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 >> 172.21.15.26:0/2133579014 conn(0x7f51e00703a0 msgr2=0x7f51e0151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 shutdown_connections 2023-10-09T11:36:50.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.452+0000 7f51e5e96700 1 -- 172.21.15.26:0/2133579014 wait complete. 2023-10-09T11:36:50.455 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 30 2023-10-09T11:36:50.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:36:44.500145+0000', 'modified': '2023-10-09T11:36:48.146860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5391': {'gid': 5391, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/3587485118', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 3587485118}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3587485118}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:36:50.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:36:50.869 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:36:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.991+0000 7f60d0bcc700 1 Processor -- start 2023-10-09T11:36:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.991+0000 7f60d0bcc700 1 -- start start 2023-10-09T11:36:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.992+0000 7f60d0bcc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60cc0cb970 0x7f60cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.992+0000 7f60d0bcc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60cc15a400 0x7f60cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.992+0000 7f60d0bcc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc15ae40 con 0x7f60cc0cb5a0 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.992+0000 7f60d0bcc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0ce0f0 con 0x7f60cc0cb970 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.992+0000 7f60d0bcc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0d13f0 con 0x7f60cc15a400 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60cc0cb970 0x7f60cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60cc0cb970 0x7f60cc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54636/0 (socket says 172.21.15.26:54636) 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 -- 172.21.15.26:0/3921593974 learned_addr learned my addr 172.21.15.26:0/3921593974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60cad9d700 1 --2- 172.21.15.26:0/3921593974 >> v2:172.21.15.67:3300/0 conn(0x7f60cc15a400 0x7f60cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 -- 172.21.15.26:0/3921593974 >> v2:172.21.15.67:3300/0 conn(0x7f60cc15a400 msgr2=0x7f60cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/3921593974 >> v2:172.21.15.67:3300/0 conn(0x7f60cc15a400 0x7f60cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 -- 172.21.15.26:0/3921593974 >> v1:172.21.15.67:6789/0 conn(0x7f60cc0cb5a0 legacy=0x7f60cc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 -- 172.21.15.26:0/3921593974 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc15ab60 con 0x7f60cc0cb970 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/3921593974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc0cb970 0x7f60cc159ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0ccdf0 tx=0x7f60b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f381d78cd4d941ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c959a700 1 -- 172.21.15.26:0/3921593974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4009e70 con 0x7f60cc0cb970 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c959a700 1 -- 172.21.15.26:0/3921593974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b400b860 con 0x7f60cc0cb970 2023-10-09T11:36:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.993+0000 7f60c959a700 1 -- 172.21.15.26:0/3921593974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400bc00 con 0x7f60cc0cb970 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 -- 172.21.15.26:0/3921593974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc0cb970 msgr2=0x7f60cc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/3921593974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc0cb970 0x7f60cc159ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0ccdf0 tx=0x7f60b4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 -- 172.21.15.26:0/3921593974 shutdown_connections 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/3921593974 >> v2:172.21.15.67:3300/0 conn(0x7f60cc15a400 0x7f60cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/3921593974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc0cb970 0x7f60cc159ec0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 -- 172.21.15.26:0/3921593974 >> 172.21.15.26:0/3921593974 conn(0x7f60cc070e30 msgr2=0x7f60cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 -- 172.21.15.26:0/3921593974 shutdown_connections 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.994+0000 7f60d0bcc700 1 -- 172.21.15.26:0/3921593974 wait complete. 2023-10-09T11:36:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.995+0000 7f60d0bcc700 1 Processor -- start 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.995+0000 7f60d0bcc700 1 -- start start 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc0cb5a0 0x7f60cc151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 0x7f60cc0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b3ba0 con 0x7f60cc15a400 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0ca7e0 con 0x7f60cc0cb970 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60d0bcc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0ca500 con 0x7f60cc0cb5a0 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54650/0 (socket says 172.21.15.26:54650) 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 -- 172.21.15.26:0/2046838614 learned_addr learned my addr 172.21.15.26:0/2046838614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 0x7f60cc0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc0cb5a0 0x7f60cc151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 -- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc0cb5a0 msgr2=0x7f60cc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc0cb5a0 0x7f60cc151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 -- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 msgr2=0x7f60cc0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 0x7f60cc0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 -- 172.21.15.26:0/2046838614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40094f0 con 0x7f60cc15a400 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 0x7f60cc0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009df0 tx=0x7f60c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.996+0000 7f60c27fc700 1 -- 172.21.15.26:0/2046838614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400cb50 con 0x7f60cc15a400 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.997+0000 7f60c27fc700 1 -- 172.21.15.26:0/2046838614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c400f040 con 0x7f60cc15a400 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.997+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0b3550 con 0x7f60cc15a400 2023-10-09T11:36:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.997+0000 7f60c27fc700 1 -- 172.21.15.26:0/2046838614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4014480 con 0x7f60cc15a400 2023-10-09T11:36:51.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.997+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc151660 con 0x7f60cc15a400 2023-10-09T11:36:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.998+0000 7f60c27fc700 1 -- 172.21.15.26:0/2046838614 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60c4014830 con 0x7f60cc15a400 2023-10-09T11:36:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.998+0000 7f60c27fc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.998+0000 7f60c27fc700 1 -- 172.21.15.26:0/2046838614 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60c4084eb0 con 0x7f60cc15a400 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.999+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:50.999+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 0x7f60ac0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0037c0 tx=0x7f60bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.000+0000 7f60d9ec4b80 1 Processor -- start 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.000+0000 7f60d9ec4b80 1 -- start start 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc4fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc78a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dba6a70 con 0x55c90dc78f60 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dba4270 con 0x55c90dc99d00 2023-10-09T11:36:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90dba0060 con 0x55c90dc4fa50 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54652/0 (socket says 172.21.15.26:54652) 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60cad9d700 1 -- 172.21.15.26:0/3740664107 learned_addr learned my addr 172.21.15.26:0/3740664107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60ca59c700 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc4fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.001+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc78a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 -- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 msgr2=0x55c90dc4fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc4fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 -- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 msgr2=0x55c90dc78a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc78a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 -- 172.21.15.26:0/3740664107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90da3a270 con 0x55c90dc78f60 2023-10-09T11:36:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60cad9d700 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009d10 tx=0x7f60c4083330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47660021d58e7e04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60ab7fe700 1 -- 172.21.15.26:0/3740664107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c406c210 con 0x55c90dc78f60 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60ab7fe700 1 -- 172.21.15.26:0/3740664107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4059030 con 0x55c90dc78f60 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.002+0000 7f60ab7fe700 1 -- 172.21.15.26:0/3740664107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c405cd80 con 0x55c90dc78f60 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/3740664107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 msgr2=0x55c90dc4bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009d10 tx=0x7f60c4083330 comp rx=0 tx=0).stop 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/3740664107 shutdown_connections 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dc4bcf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc4fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/3740664107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc78a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/3740664107 >> 172.21.15.26:0/3740664107 conn(0x55c90dc51370 msgr2=0x55c90dc51740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/3740664107 shutdown_connections 2023-10-09T11:36:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/3740664107 wait complete. 2023-10-09T11:36:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 -- start start 2023-10-09T11:36:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.003+0000 7f60d9ec4b80 1 Processor -- start 2023-10-09T11:36:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc90ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc78f60 0x55c90dc8e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90db4b890 con 0x55c90dc99d00 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90db66ea0 con 0x55c90dc78f60 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90da22e30 con 0x55c90dc4fa50 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60d9ec4b80 10 client.0 _ll_register_callbacks cb 0x55c90dc13110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54662/0 (socket says 172.21.15.26:54662) 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60cad9d700 1 -- 172.21.15.26:0/2656604839 learned_addr learned my addr 172.21.15.26:0/2656604839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.004+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc90ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc78f60 0x55c90dc8e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 -- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 msgr2=0x55c90dc90ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc90ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 -- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc78f60 msgr2=0x55c90dc8e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc78f60 0x55c90dc8e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 -- 172.21.15.26:0/2656604839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc151660 con 0x55c90dc99d00 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c730 tx=0x7f60c406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164579947d4c7aec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4055de0 con 0x55c90dc99d00 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60c405cd80 con 0x55c90dc99d00 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c90dc44b70 con 0x55c90dc99d00 2023-10-09T11:36:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60c4083200 con 0x55c90dc99d00 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 10 client.5529 fetch_fsmap learned FSMap version 30 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55c90d9dcfe0 con 0x55c90dc99d00 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c90dc44b70 con 0x55c90dc99d00 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60c40552d0 con 0x55c90dc99d00 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 10 client.5529 fetch_fsmap finished waiting for FSMap version 30 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 10 client.5529 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 20 client.5529 populate_metadata read hostname 'smithi026' 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dca7660 0x55c90dc7c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 4 client.5529 mds_command: new command op to 5391 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.005+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 --> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c90dc21aa0 con 0x55c90dca7660 2023-10-09T11:36:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dca7660 0x55c90dc7c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dca7660 0x55c90dc7c7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b402bf7d70cb589d server_cookie=3ff14985745f55fa in_seq=0 out_seq=0 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60a8ff9700 10 client.5529 ms_handle_connect on v2:172.21.15.26:6833/3587485118 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60a8ff9700 1 -- 172.21.15.26:0/2656604839 <== mds.0 v2:172.21.15.26:6833/3587485118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c90dc21aa0 con 0x55c90dca7660 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60a8ff9700 10 client.5529 handle_command_reply: tid=0 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.006+0000 7f60d9ec4b80 1 client.5529 shutdown 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 msgr2=0x55c90dc4ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c730 tx=0x7f60c406b000 comp rx=0 tx=0).stop 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 shutdown_connections 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc99d00 0x55c90dc4ac20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dc90ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dca7660 0x55c90dc7c7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2656604839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc78f60 0x55c90dc8e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60a8ff9700 0 client.5529 ms_handle_reset on v2:172.21.15.26:6833/3587485118 2023-10-09T11:36:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 >> 172.21.15.26:0/2656604839 conn(0x55c90dc51370 msgr2=0x55c90dc502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 shutdown_connections 2023-10-09T11:36:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2656604839 wait complete. 2023-10-09T11:36:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.007+0000 7f60d9ec4b80 20 client.5529 trim_cache size 0 max 16384 2023-10-09T11:36:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.024+0000 7f60d9ec4b80 1 Processor -- start 2023-10-09T11:36:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.024+0000 7f60d9ec4b80 1 -- start start 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc4fa50 0x55c90dc8e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 0x55c90dca9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dc4f370 con 0x55c90dc78f60 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dc7f870 con 0x55c90dc4fa50 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90dc99900 con 0x55c90dc99d00 2023-10-09T11:36:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54664/0 (socket says 172.21.15.26:54664) 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 -- 172.21.15.26:0/2159983789 learned_addr learned my addr 172.21.15.26:0/2159983789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60ca59c700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc4fa50 0x55c90dc8e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 0x55c90dca9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 -- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 msgr2=0x55c90dca9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 0x55c90dca9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 -- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc4fa50 msgr2=0x55c90dc8e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc4fa50 0x55c90dc8e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 -- 172.21.15.26:0/2159983789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90db6e780 con 0x55c90dc78f60 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60cad9d700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 0x55c90dca9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006fd0 tx=0x7f60b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7143556c325b922 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60abfff700 1 -- 172.21.15.26:0/2159983789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4020040 con 0x55c90dc78f60 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60abfff700 1 -- 172.21.15.26:0/2159983789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4021040 con 0x55c90dc78f60 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.025+0000 7f60abfff700 1 -- 172.21.15.26:0/2159983789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4000cc0 con 0x55c90dc78f60 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2159983789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 msgr2=0x55c90dca8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006fd0 tx=0x7f60b4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2159983789 shutdown_connections 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc99d00 0x55c90dca9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc4fa50 0x55c90dc8e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/2159983789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dca8de0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2159983789 >> 172.21.15.26:0/2159983789 conn(0x55c90dc51370 msgr2=0x55c90dc51740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2159983789 shutdown_connections 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/2159983789 wait complete. 2023-10-09T11:36:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.026+0000 7f60d9ec4b80 1 -- start start 2023-10-09T11:36:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 Processor -- start 2023-10-09T11:36:51.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dca7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc7b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dcfc180 con 0x55c90dc78f60 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90dc99080 con 0x55c90dc99d00 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.027+0000 7f60d9ec4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90dc4ad00 con 0x55c90dc4fa50 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60d9ec4b80 10 client.0 _ll_register_callbacks cb 0x55c90dc13110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54674/0 (socket says 172.21.15.26:54674) 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 -- 172.21.15.26:0/1147092173 learned_addr learned my addr 172.21.15.26:0/1147092173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60ca59c700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dca7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60cad9d700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc7b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 -- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 msgr2=0x55c90dca7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dca7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 -- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 msgr2=0x55c90dc7b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc7b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 -- 172.21.15.26:0/1147092173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc15ab60 con 0x55c90dc78f60 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60cad9d700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc7b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60c9d9b700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f60b401b000 tx=0x7f60b401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d971669c624d2e45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4020040 con 0x55c90dc78f60 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60b4033020 con 0x55c90dc78f60 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60c4059030 con 0x55c90dc78f60 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60b401a630 con 0x55c90dc78f60 2023-10-09T11:36:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60d9ec4b80 10 client.5535 fetch_fsmap learned FSMap version 30 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.028+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55c90db55470 con 0x55c90dc78f60 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4059030 con 0x55c90dc78f60 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60b400b0e0 con 0x55c90dc78f60 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 10 client.5535 fetch_fsmap finished waiting for FSMap version 30 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 10 client.5535 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 20 client.5535 populate_metadata read hostname 'smithi026' 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dc7b8e0 0x55c90dc7e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 4 client.5535 mds_command: new command op to 5391 tid=0[{"prefix": "status"}] 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 --> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c90db42e00 con 0x55c90dc7b8e0 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60ca59c700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dc7b8e0 0x55c90dc7e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60ca59c700 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dc7b8e0 0x55c90dc7e7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99880778fd60aca server_cookie=63e9773d59a373 in_seq=0 out_seq=0 2023-10-09T11:36:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 10 client.5535 ms_handle_connect on v2:172.21.15.26:6833/3587485118 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 1 -- 172.21.15.26:0/1147092173 <== mds.0 v2:172.21.15.26:6833/3587485118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c90db42e00 con 0x55c90dc7b8e0 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 10 client.5535 handle_command_reply: tid=0 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 client.5535 shutdown 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 msgr2=0x55c90dcfb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f60b401b000 tx=0x7f60b401d070 comp rx=0 tx=0).stop 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 shutdown_connections 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:6833/3587485118,v1:172.21.15.26:6835/3587485118] conn(0x55c90dc7b8e0 0x55c90dc7e7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c90dc99d00 0x55c90dc7b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60a8ff9700 0 client.5535 ms_handle_reset on v2:172.21.15.26:6833/3587485118 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55c90dc4fa50 0x55c90dca7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 --2- 172.21.15.26:0/1147092173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c90dc78f60 0x55c90dcfb4a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.029+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 >> 172.21.15.26:0/1147092173 conn(0x55c90dc51370 msgr2=0x55c90dc4ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 shutdown_connections 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d9ec4b80 1 -- 172.21.15.26:0/1147092173 wait complete. 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d9ec4b80 20 client.5535 trim_cache size 0 max 16384 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5391, 2023-10-09T11:36:51.039 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.8895632579999999, 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 30, 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 51, 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 51, 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 10.988980358999999 2023-10-09T11:36:51.040 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 msgr2=0x7f60ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 0x7f60ac0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0037c0 tx=0x7f60bc009040 comp rx=0 tx=0).stop 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 msgr2=0x7f60cc0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009df0 tx=0x7f60c400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 shutdown_connections 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60cc15a400 0x7f60cc0b2480 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60ac066f30 0x7f60ac0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60cc0cb5a0 0x7f60cc151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 --2- 172.21.15.26:0/2046838614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60cc0cb970 0x7f60cc0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 >> 172.21.15.26:0/2046838614 conn(0x7f60cc070e30 msgr2=0x7f60cc0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 shutdown_connections 2023-10-09T11:36:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.030+0000 7f60d0bcc700 1 -- 172.21.15.26:0/2046838614 wait complete. 2023-10-09T11:36:51.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:51.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 Processor -- start 2023-10-09T11:36:51.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 -- start start 2023-10-09T11:36:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b00af5c0 0x7f15b00ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15b0156690 0x7f15b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00ca2b0 con 0x7f15b01562c0 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b00c96e0 con 0x7f15b0156690 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.162+0000 7f15b532b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b006b8d0 con 0x7f15b00af5c0 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15b0156690 0x7f15b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15b0156690 0x7f15b006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54686/0 (socket says 172.21.15.26:54686) 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 -- 172.21.15.26:0/400259979 learned_addr learned my addr 172.21.15.26:0/400259979 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15aeffd700 1 --1- 172.21.15.26:0/400259979 >> v1:172.21.15.26:6789/0 conn(0x7f15b01562c0 0x7f15b006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49582/0 (socket says 172.21.15.26:49582) 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15a67fc700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b00af5c0 0x7f15b00ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 -- 172.21.15.26:0/400259979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b00af5c0 msgr2=0x7f15b00ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b00af5c0 0x7f15b00ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 -- 172.21.15.26:0/400259979 >> v1:172.21.15.26:6789/0 conn(0x7f15b01562c0 legacy=0x7f15b006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 -- 172.21.15.26:0/400259979 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b006bb30 con 0x7f15b0156690 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15ae7fc700 1 -- 172.21.15.26:0/400259979 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060989737 0 0) 0x7f15b00ca2b0 con 0x7f15b01562c0 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15af7fe700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b0156690 0x7f15b006d7b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009f20 tx=0x7f15a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecc26815eb9d45d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15ae7fc700 1 -- 172.21.15.26:0/400259979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800e070 con 0x7f15b0156690 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15ae7fc700 1 -- 172.21.15.26:0/400259979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a800ba80 con 0x7f15b0156690 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.163+0000 7f15ae7fc700 1 -- 172.21.15.26:0/400259979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80092e0 con 0x7f15b0156690 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 -- 172.21.15.26:0/400259979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b0156690 msgr2=0x7f15b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b0156690 0x7f15b006d7b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009f20 tx=0x7f15a8009840 comp rx=0 tx=0).stop 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 -- 172.21.15.26:0/400259979 shutdown_connections 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b0156690 0x7f15b006d7b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 --2- 172.21.15.26:0/400259979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b00af5c0 0x7f15b00ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 -- 172.21.15.26:0/400259979 >> 172.21.15.26:0/400259979 conn(0x7f15b00675a0 msgr2=0x7f15b00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 -- 172.21.15.26:0/400259979 shutdown_connections 2023-10-09T11:36:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.164+0000 7f15b532b700 1 -- 172.21.15.26:0/400259979 wait complete. 2023-10-09T11:36:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.165+0000 7f15b532b700 1 Processor -- start 2023-10-09T11:36:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.165+0000 7f15b532b700 1 -- start start 2023-10-09T11:36:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b01562c0 0x7f15b0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b0156690 0x7f15b00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00b2580 con 0x7f15b00af5c0 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00b1bb0 con 0x7f15b01562c0 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15b532b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00b0fa0 con 0x7f15b0156690 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54690/0 (socket says 172.21.15.26:54690) 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 -- 172.21.15.26:0/1274798556 learned_addr learned my addr 172.21.15.26:0/1274798556 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15af7fe700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b0156690 0x7f15b00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15a67fc700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b01562c0 0x7f15b0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 -- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b0156690 msgr2=0x7f15b00b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b0156690 0x7f15b00b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 -- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b01562c0 msgr2=0x7f15b0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b01562c0 0x7f15b0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 -- 172.21.15.26:0/1274798556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009ae0 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15aeffd700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f15a00011e0 tx=0x7f15a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.166+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0005a70 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.167+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0005bd0 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.167+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00b1280 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.167+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00070d0 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.167+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b00b1840 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.168+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b004c3c0 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.168+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15a0007440 con 0x7f15b00af5c0 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.168+0000 7f15a77fe700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.168+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15a00839e0 con 0x7f15b00af5c0 2023-10-09T11:36:51.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.169+0000 7f15a67fc700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.169+0000 7f15a67fc700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 0x7f15900693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15b006d450 tx=0x7f1598008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.173+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15a0050c50 con 0x7f15b00af5c0 2023-10-09T11:36:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.412+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15b006be10 con 0x7f15b00af5c0 2023-10-09T11:36:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.413+0000 7f15a77fe700 1 -- 172.21.15.26:0/1274798556 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f15a0017070 con 0x7f15b00af5c0 2023-10-09T11:36:51.414 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:51.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 msgr2=0x7f15900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 0x7f15900693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15b006d450 tx=0x7f1598008040 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 msgr2=0x7f15b00b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f15a00011e0 tx=0x7f15a0007e10 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 shutdown_connections 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f15b0156690 0x7f15b00b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15b00af5c0 0x7f15b00b2040 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 --2- 172.21.15.26:0/1274798556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b01562c0 0x7f15b0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 >> 172.21.15.26:0/1274798556 conn(0x7f15b00675a0 msgr2=0x7f15b00c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 shutdown_connections 2023-10-09T11:36:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:51.415+0000 7f15b532b700 1 -- 172.21.15.26:0/1274798556 wait complete. 2023-10-09T11:36:51.428 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:51.429 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:51.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.430 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.447 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:51.448 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:36:51.448 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:36:51.448 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:51.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.448 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:51.509 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:36:51.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.510 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:51.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:36:51.568 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:36:51.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.669 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:36:51.684 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:36:51.684 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:36:51.684 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:51.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:36:51.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:51.750 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:51.805 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:51.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:51.806 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:51.861 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:36:51.861 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:51.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:51.942 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:51.942 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:51.960 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:51.961 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:51.982 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:36:51.983 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:36:51.985 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:51.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:51.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:52.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.211+0000 7f4ad9bd3700 1 Processor -- start 2023-10-09T11:36:52.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.211+0000 7f4ad9bd3700 1 -- start start 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad9bd3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 0x7f4ad4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad9bd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ad415a400 0x7f4ad4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad9bd3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad415ae40 con 0x7f4ad40cb5a0 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad9bd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40ce0f0 con 0x7f4ad415a400 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad9bd3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40cbde0 con 0x7f4ad40cb970 2023-10-09T11:36:52.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ad415a400 0x7f4ad4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ad415a400 0x7f4ad4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54692/0 (socket says 172.21.15.26:54692) 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.212+0000 7f4ad3fff700 1 -- 172.21.15.26:0/578134673 learned_addr learned my addr 172.21.15.26:0/578134673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad2ffd700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 0x7f4ad4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad3fff700 1 -- 172.21.15.26:0/578134673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 msgr2=0x7f4ad4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad3fff700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 0x7f4ad4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad3fff700 1 -- 172.21.15.26:0/578134673 >> v1:172.21.15.67:6789/0 conn(0x7f4ad40cb5a0 legacy=0x7f4ad40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad3fff700 1 -- 172.21.15.26:0/578134673 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad415ab60 con 0x7f4ad415a400 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad2ffd700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 0x7f4ad4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad3fff700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad415a400 0x7f4ad4156e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009f50 tx=0x7f4acc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde4fef2d2ab7f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad27fc700 1 -- 172.21.15.26:0/578134673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00e070 con 0x7f4ad415a400 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad27fc700 1 -- 172.21.15.26:0/578134673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc00ba30 con 0x7f4ad415a400 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.213+0000 7f4ad27fc700 1 -- 172.21.15.26:0/578134673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0092e0 con 0x7f4ad415a400 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/578134673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad415a400 msgr2=0x7f4ad4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad415a400 0x7f4ad4156e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009f50 tx=0x7f4acc009840 comp rx=0 tx=0).stop 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/578134673 shutdown_connections 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad415a400 0x7f4ad4156e90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/578134673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad40cb970 0x7f4ad4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/578134673 >> 172.21.15.26:0/578134673 conn(0x7f4ad4070e30 msgr2=0x7f4ad40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:52.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/578134673 shutdown_connections 2023-10-09T11:36:52.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.214+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/578134673 wait complete. 2023-10-09T11:36:52.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.215+0000 7f4ad9bd3700 1 Processor -- start 2023-10-09T11:36:52.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.215+0000 7f4ad9bd3700 1 -- start start 2023-10-09T11:36:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ad40cb5a0 0x7f4ad4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad415a400 0x7f4ad4155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad41520e0 con 0x7f4ad40cb970 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad416d1c0 con 0x7f4ad40cb5a0 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad416d460 con 0x7f4ad415a400 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54696/0 (socket says 172.21.15.26:54696) 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 -- 172.21.15.26:0/2332722510 learned_addr learned my addr 172.21.15.26:0/2332722510 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad37fe700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ad40cb5a0 0x7f4ad4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad3fff700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad415a400 0x7f4ad4155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 -- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad415a400 msgr2=0x7f4ad4155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad415a400 0x7f4ad4155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 -- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ad40cb5a0 msgr2=0x7f4ad4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ad40cb5a0 0x7f4ad4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 -- 172.21.15.26:0/2332722510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009ae0 con 0x7f4ad40cb970 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad2ffd700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c830 tx=0x7f4ac8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011600 con 0x7f4ad40cb970 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8011760 con 0x7f4ad40cb970 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.216+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad416d740 con 0x7f4ad40cb970 2023-10-09T11:36:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.217+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8011b20 con 0x7f4ad40cb970 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.217+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad416dd00 con 0x7f4ad40cb970 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.217+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad415c320 con 0x7f4ad40cb970 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.218+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ac8018360 con 0x7f4ad40cb970 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.218+0000 7f4abb7fe700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.218+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ac80844c0 con 0x7f4ad40cb970 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.218+0000 7f4ad37fe700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.219+0000 7f4ad37fe700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 0x7f4ac00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009af0 tx=0x7f4ac4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.223+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad415c320 con 0x7f4ad40cb970 2023-10-09T11:36:52.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.462+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ad415c320 con 0x7f4ad40cb970 2023-10-09T11:36:52.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.463+0000 7f4abb7fe700 1 -- 172.21.15.26:0/2332722510 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ad415c320 con 0x7f4ad40cb970 2023-10-09T11:36:52.464 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:52.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 msgr2=0x7f4ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 0x7f4ac00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009af0 tx=0x7f4ac4009060 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 msgr2=0x7f4ad41522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c830 tx=0x7f4ac8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 shutdown_connections 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ac0066f30 0x7f4ac00693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ad415a400 0x7f4ad4155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ad40cb5a0 0x7f4ad4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 --2- 172.21.15.26:0/2332722510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ad40cb970 0x7f4ad41522a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 >> 172.21.15.26:0/2332722510 conn(0x7f4ad4070e30 msgr2=0x7f4ad40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 shutdown_connections 2023-10-09T11:36:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:52.465+0000 7f4ad9bd3700 1 -- 172.21.15.26:0/2332722510 wait complete. 2023-10-09T11:36:52.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:52.479 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:52.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.480 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:36:52.498 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:52.499 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:36:52.501 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:36:52.502 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.503 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:52.503 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:36:52.503 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:36:52.503 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:52.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.503 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:52.568 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:36:52.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.570 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:36:52.629 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:36:52.629 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:52.629 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:36:52.629 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:36:52.629 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:52.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:36:52.630 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:36:52.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.739 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:36:52.755 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:36:52.755 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:36:52.755 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:52.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:52.756 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:36:52.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:52.822 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:52.877 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:52.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:52.878 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:52.933 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:36:52.933 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:52.933 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:53.014 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:53.015 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:53.033 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:53.033 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:53.033 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:53.033 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:53.034 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:53.034 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:53.034 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:53.034 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:36:53.055 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:53.056 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:53.056 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:53.056 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:36:53.056 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:36:53.056 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:36:53.057 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:53.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:53.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:53.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:36:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.249+0000 7f26e359e700 1 Processor -- start 2023-10-09T11:36:53.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.249+0000 7f26e359e700 1 -- start start 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26e415cb90 0x7f26e40c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415dc10 0x7f26e406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26e406cbe0 0x7f26e40c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40ccdf0 con 0x7f26e415cb90 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40c9b20 con 0x7f26e406cbe0 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e406d040 con 0x7f26e415dc10 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26e415cb90 0x7f26e40c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26e415cb90 0x7f26e40c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54712/0 (socket says 172.21.15.26:54712) 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 -- 172.21.15.26:0/936640773 learned_addr learned my addr 172.21.15.26:0/936640773 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:53.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e2d9d700 1 --2- 172.21.15.26:0/936640773 >> v2:172.21.15.67:3300/0 conn(0x7f26e406cbe0 0x7f26e40c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e1d9b700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415dc10 0x7f26e406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 -- 172.21.15.26:0/936640773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415dc10 msgr2=0x7f26e406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415dc10 0x7f26e406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 -- 172.21.15.26:0/936640773 >> v2:172.21.15.67:3300/0 conn(0x7f26e406cbe0 msgr2=0x7f26e40c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 --2- 172.21.15.26:0/936640773 >> v2:172.21.15.67:3300/0 conn(0x7f26e406cbe0 0x7f26e40c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.250+0000 7f26e259c700 1 -- 172.21.15.26:0/936640773 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40c2fa0 con 0x7f26e415cb90 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e259c700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e415cb90 0x7f26e40c7870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f26e406d760 tx=0x7f26d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b1b774ee47dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e159a700 1 -- 172.21.15.26:0/936640773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400b860 con 0x7f26e415cb90 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e159a700 1 -- 172.21.15.26:0/936640773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400b9c0 con 0x7f26e415cb90 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e159a700 1 -- 172.21.15.26:0/936640773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400bd60 con 0x7f26e415cb90 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 -- 172.21.15.26:0/936640773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e415cb90 msgr2=0x7f26e40c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e415cb90 0x7f26e40c7870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f26e406d760 tx=0x7f26d4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 -- 172.21.15.26:0/936640773 shutdown_connections 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 --2- 172.21.15.26:0/936640773 >> v2:172.21.15.67:3300/0 conn(0x7f26e406cbe0 0x7f26e40c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e415cb90 0x7f26e40c7870 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 --2- 172.21.15.26:0/936640773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415dc10 0x7f26e406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 -- 172.21.15.26:0/936640773 >> 172.21.15.26:0/936640773 conn(0x7f26e40cd230 msgr2=0x7f26e40cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 -- 172.21.15.26:0/936640773 shutdown_connections 2023-10-09T11:36:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.251+0000 7f26e359e700 1 -- 172.21.15.26:0/936640773 wait complete. 2023-10-09T11:36:53.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.252+0000 7f26e359e700 1 Processor -- start 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.252+0000 7f26e359e700 1 -- start start 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415cb90 0x7f26e40c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26e415dc10 0x7f26e4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e413d0f0 con 0x7f26e406cbe0 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e413d3c0 con 0x7f26e415dc10 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e413d6a0 con 0x7f26e415cb90 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54714/0 (socket says 172.21.15.26:54714) 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e259c700 1 -- 172.21.15.26:0/1186397401 learned_addr learned my addr 172.21.15.26:0/1186397401 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:53.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e1d9b700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415cb90 0x7f26e40c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.253+0000 7f26e2d9d700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26e415dc10 0x7f26e4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 -- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415cb90 msgr2=0x7f26e40c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415cb90 0x7f26e40c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 -- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26e415dc10 msgr2=0x7f26e4158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26e415dc10 0x7f26e4158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 -- 172.21.15.26:0/1186397401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40094f0 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e259c700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063720 tx=0x7f26d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4011dc0 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d4024440 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e413d980 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4024800 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.254+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e4169850 con 0x7f26e406cbe0 2023-10-09T11:36:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.255+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e404c3c0 con 0x7f26e406cbe0 2023-10-09T11:36:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.255+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26d401a420 con 0x7f26e406cbe0 2023-10-09T11:36:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.256+0000 7f26d27fc700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 0x7f26c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.256+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26d40863e0 con 0x7f26e406cbe0 2023-10-09T11:36:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.256+0000 7f26e1d9b700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 0x7f26c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.256+0000 7f26e1d9b700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 0x7f26c40693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c90e0 tx=0x7f26d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.260+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26d4053650 con 0x7f26e406cbe0 2023-10-09T11:36:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:53.499+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f26e40c2390 con 0x7f26e406cbe0 2023-10-09T11:36:54.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.165+0000 7f26d27fc700 1 -- 172.21.15.26:0/1186397401 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 136+0+0 (secure 0 0 0) 0x7f26d4056c70 con 0x7f26e406cbe0 2023-10-09T11:36:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 msgr2=0x7f26c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 0x7f26c40693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c90e0 tx=0x7f26d8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 msgr2=0x7f26e413cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063720 tx=0x7f26d4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 shutdown_connections 2023-10-09T11:36:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26e415dc10 0x7f26e4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26e406cbe0 0x7f26e413cbb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f26c4066f30 0x7f26c40693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 --2- 172.21.15.26:0/1186397401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26e415cb90 0x7f26e40c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 >> 172.21.15.26:0/1186397401 conn(0x7f26e40cd230 msgr2=0x7f26e40c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 shutdown_connections 2023-10-09T11:36:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.168+0000 7f26e359e700 1 -- 172.21.15.26:0/1186397401 wait complete. 2023-10-09T11:36:54.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:36:54.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.309+0000 7fdf90f24700 1 Processor -- start 2023-10-09T11:36:54.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.309+0000 7fdf90f24700 1 -- start start 2023-10-09T11:36:54.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf90f24700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdf8c153c30 0x7fdf8c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf90f24700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf8c0cf110 0x7fdf8c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf90f24700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c15afd0 con 0x7fdf8c15de50 2023-10-09T11:36:54.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf90f24700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c15b2b0 con 0x7fdf8c0cf110 2023-10-09T11:36:54.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf90f24700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c15b590 con 0x7fdf8c153c30 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf8c0cf110 0x7fdf8c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf8c15de50 0x7fdf8c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49594/0 (socket says 172.21.15.26:49594) 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8affd700 1 -- 172.21.15.26:0/2231790051 learned_addr learned my addr 172.21.15.26:0/2231790051 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/2231790051 >> v2:172.21.15.67:3300/0 conn(0x7fdf8c153c30 0x7fdf8c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2231790051 >> v2:172.21.15.67:3300/0 conn(0x7fdf8c153c30 msgr2=0x7fdf8c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8bfff700 1 --2- 172.21.15.26:0/2231790051 >> v2:172.21.15.67:3300/0 conn(0x7fdf8c153c30 0x7fdf8c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2231790051 >> v1:172.21.15.26:6789/0 conn(0x7fdf8c15de50 legacy=0x7fdf8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2231790051 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c15b870 con 0x7fdf8c0cf110 2023-10-09T11:36:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.310+0000 7fdf8a7fc700 1 -- 172.21.15.26:0/2231790051 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076094833 0 0) 0x7fdf8c15afd0 con 0x7fdf8c15de50 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf8bfff700 1 --2- 172.21.15.26:0/2231790051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0cf110 0x7fdf8c15c070 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c06ead0 tx=0x7fdf84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b3b9da5e1204c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf8a7fc700 1 -- 172.21.15.26:0/2231790051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400e070 con 0x7fdf8c0cf110 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf8a7fc700 1 -- 172.21.15.26:0/2231790051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400bc30 con 0x7fdf8c0cf110 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf8a7fc700 1 -- 172.21.15.26:0/2231790051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84012430 con 0x7fdf8c0cf110 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 -- 172.21.15.26:0/2231790051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0cf110 msgr2=0x7fdf8c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2231790051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0cf110 0x7fdf8c15c070 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c06ead0 tx=0x7fdf84009780 comp rx=0 tx=0).stop 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 -- 172.21.15.26:0/2231790051 shutdown_connections 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2231790051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0cf110 0x7fdf8c15c070 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2231790051 >> v2:172.21.15.67:3300/0 conn(0x7fdf8c153c30 0x7fdf8c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 -- 172.21.15.26:0/2231790051 >> 172.21.15.26:0/2231790051 conn(0x7fdf8c0703a0 msgr2=0x7fdf8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 -- 172.21.15.26:0/2231790051 shutdown_connections 2023-10-09T11:36:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.311+0000 7fdf90f24700 1 -- 172.21.15.26:0/2231790051 wait complete. 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 Processor -- start 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 -- start start 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf8c0cf110 0x7fdf8c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf8c153c30 0x7fdf8c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0c91e0 con 0x7fdf8c15de50 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c16ca10 con 0x7fdf8c153c30 2023-10-09T11:36:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf90f24700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c169980 con 0x7fdf8c0cf110 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.313+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54738/0 (socket says 172.21.15.26:54738) 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2198792850 learned_addr learned my addr 172.21.15.26:0/2198792850 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf8c0cf110 0x7fdf8c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8affd700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf8c153c30 0x7fdf8c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf8c0cf110 msgr2=0x7fdf8c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf8c0cf110 0x7fdf8c0cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf8c153c30 msgr2=0x7fdf8c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf8c153c30 0x7fdf8c0c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 -- 172.21.15.26:0/2198792850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009a20 con 0x7fdf8c15de50 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf8bfff700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84027470 con 0x7fdf8c15de50 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84027610 con 0x7fdf8c15de50 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c169c60 con 0x7fdf8c15de50 2023-10-09T11:36:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840279d0 con 0x7fdf8c15de50 2023-10-09T11:36:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.314+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c16a220 con 0x7fdf8c15de50 2023-10-09T11:36:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.315+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c15d8f0 con 0x7fdf8c15de50 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.316+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf84024070 con 0x7fdf8c15de50 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.316+0000 7fdf737fe700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.316+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf84086cf0 con 0x7fdf8c15de50 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.316+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.317+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 0x7fdf780693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006fd0 tx=0x7fdf7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.320+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf8408b070 con 0x7fdf8c15de50 2023-10-09T11:36:54.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.541+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf8c04c3c0 con 0x7fdf78066f30 2023-10-09T11:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.543+0000 7fdf737fe700 1 -- 172.21.15.26:0/2198792850 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdf8c04c3c0 con 0x7fdf78066f30 2023-10-09T11:36:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:36:54.544 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:54.544 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:36:54.544 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 msgr2=0x7fdf780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 0x7fdf780693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006fd0 tx=0x7fdf7c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 msgr2=0x7fdf8c0c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf84019000 comp rx=0 tx=0).stop 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 shutdown_connections 2023-10-09T11:36:54.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c15de50 0x7fdf8c0c75e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf78066f30 0x7fdf780693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf8c0cf110 0x7fdf8c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 --2- 172.21.15.26:0/2198792850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf8c153c30 0x7fdf8c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 >> 172.21.15.26:0/2198792850 conn(0x7fdf8c0703a0 msgr2=0x7fdf8c0c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 shutdown_connections 2023-10-09T11:36:54.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.544+0000 7fdf90f24700 1 -- 172.21.15.26:0/2198792850 wait complete. 2023-10-09T11:36:54.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:36:54.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.678+0000 7f2e54e9a700 1 Processor -- start 2023-10-09T11:36:54.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.678+0000 7f2e54e9a700 1 -- start start 2023-10-09T11:36:54.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.679+0000 7f2e54e9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e5006dc70 0x7f2e50159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.679+0000 7f2e54e9a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2e5006e0e0 0x7f2e500cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.679+0000 7f2e54e9a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500ccfd0 con 0x7f2e50159530 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.679+0000 7f2e54e9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5015a3d0 con 0x7f2e5006dc70 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.679+0000 7f2e54e9a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5015a6b0 con 0x7f2e5006e0e0 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e5006dc70 0x7f2e50159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e50159530 0x7f2e500ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49596/0 (socket says 172.21.15.26:49596) 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4e59c700 1 -- 172.21.15.26:0/3310466414 learned_addr learned my addr 172.21.15.26:0/3310466414 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/3310466414 >> v2:172.21.15.67:3300/0 conn(0x7f2e5006e0e0 msgr2=0x7f2e500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 --2- 172.21.15.26:0/3310466414 >> v2:172.21.15.67:3300/0 conn(0x7f2e5006e0e0 0x7f2e500cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/3310466414 >> v1:172.21.15.26:6789/0 conn(0x7f2e50159530 legacy=0x7f2e500ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/3310466414 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5015a990 con 0x7f2e5006dc70 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4d59a700 1 -- 172.21.15.26:0/3310466414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123732676 0 0) 0x7f2e500ccfd0 con 0x7f2e50159530 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4dd9b700 1 --2- 172.21.15.26:0/3310466414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006dc70 0x7f2e50159900 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e500cf2b0 tx=0x7f2e380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b4fa02b042906 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4d59a700 1 -- 172.21.15.26:0/3310466414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800b6b0 con 0x7f2e5006dc70 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4d59a700 1 -- 172.21.15.26:0/3310466414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3800b810 con 0x7f2e5006dc70 2023-10-09T11:36:54.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.680+0000 7f2e4d59a700 1 -- 172.21.15.26:0/3310466414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bbb0 con 0x7f2e5006dc70 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 -- 172.21.15.26:0/3310466414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006dc70 msgr2=0x7f2e50159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/3310466414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006dc70 0x7f2e50159900 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e500cf2b0 tx=0x7f2e380091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 -- 172.21.15.26:0/3310466414 shutdown_connections 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/3310466414 >> v2:172.21.15.67:3300/0 conn(0x7f2e5006e0e0 0x7f2e500cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/3310466414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006dc70 0x7f2e50159900 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 -- 172.21.15.26:0/3310466414 >> 172.21.15.26:0/3310466414 conn(0x7f2e500703a0 msgr2=0x7f2e500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 -- 172.21.15.26:0/3310466414 shutdown_connections 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.681+0000 7f2e54e9a700 1 -- 172.21.15.26:0/3310466414 wait complete. 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.682+0000 7f2e54e9a700 1 Processor -- start 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.682+0000 7f2e54e9a700 1 -- start start 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e5006dc70 0x7f2e5016d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e50159530 0x7f2e5014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5016e190 con 0x7f2e5006e0e0 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500b0c70 con 0x7f2e5006dc70 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500b56a0 con 0x7f2e50159530 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54760/0 (socket says 172.21.15.26:54760) 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/165504429 learned_addr learned my addr 172.21.15.26:0/165504429 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4e59c700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e5006dc70 0x7f2e5016d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4ed9d700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e50159530 0x7f2e5014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e50159530 msgr2=0x7f2e5014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e50159530 0x7f2e5014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e5006dc70 msgr2=0x7f2e5016d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e5006dc70 0x7f2e5016d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 -- 172.21.15.26:0/165504429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38009420 con 0x7f2e5006e0e0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e4dd9b700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2e50089650 tx=0x7f2e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bb90 con 0x7f2e5006e0e0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38011420 con 0x7f2e5006e0e0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380117a0 con 0x7f2e5006e0e0 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5014df30 con 0x7f2e5006e0e0 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.683+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5016d8f0 con 0x7f2e5006e0e0 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.684+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5004c3c0 con 0x7f2e5006e0e0 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.685+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e38011b50 con 0x7f2e5006e0e0 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.685+0000 7f2e467fc700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.685+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e38085f20 con 0x7f2e5006e0e0 2023-10-09T11:36:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.685+0000 7f2e4e59c700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.686+0000 7f2e4e59c700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 0x7f2e300693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007160 tx=0x7f2e48007f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.689+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e38053190 con 0x7f2e5006e0e0 2023-10-09T11:36:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.881+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2e5015ac70 con 0x7f2e5006e0e0 2023-10-09T11:36:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.881+0000 7f2e467fc700 1 -- 172.21.15.26:0/165504429 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e380567b0 con 0x7f2e5006e0e0 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 msgr2=0x7f2e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 0x7f2e300693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007160 tx=0x7f2e48007f50 comp rx=0 tx=0).stop 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 msgr2=0x7f2e500b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2e50089650 tx=0x7f2e38017000 comp rx=0 tx=0).stop 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 shutdown_connections 2023-10-09T11:36:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e50159530 0x7f2e5014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e5006dc70 0x7f2e5016d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 --2- 172.21.15.26:0/165504429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e5006e0e0 0x7f2e500b0730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.883+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 >> 172.21.15.26:0/165504429 conn(0x7f2e500703a0 msgr2=0x7f2e500d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.884+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 shutdown_connections 2023-10-09T11:36:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:54.884+0000 7f2e54e9a700 1 -- 172.21.15.26:0/165504429 wait complete. 2023-10-09T11:36:54.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000402568 2023-10-09T11:36:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 Processor -- start 2023-10-09T11:36:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 -- start start 2023-10-09T11:36:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c06dc70 0x7f3c4c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c4c06e0e0 0x7f3c4c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0ccfd0 con 0x7f3c4c159530 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c15a3d0 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.018+0000 7f3c526c8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15a6b0 con 0x7f3c4c06dc70 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c4c159530 0x7f3c4c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49610/0 (socket says 172.21.15.26:49610) 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c4c06e0e0 0x7f3c4c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4bfff700 1 -- 172.21.15.26:0/4207890176 learned_addr learned my addr 172.21.15.26:0/4207890176 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4b7fe700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c06dc70 0x7f3c4c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4affd700 1 -- 172.21.15.26:0/4207890176 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045624777 0 0) 0x7f3c4c0ccfd0 con 0x7f3c4c159530 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4affd700 1 -- 172.21.15.26:0/4207890176 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c34003570 con 0x7f3c4c159530 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 -- 172.21.15.26:0/4207890176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c06dc70 msgr2=0x7f3c4c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c06dc70 0x7f3c4c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 -- 172.21.15.26:0/4207890176 >> v1:172.21.15.26:6789/0 conn(0x7f3c4c159530 legacy=0x7f3c4c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 -- 172.21.15.26:0/4207890176 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c15a990 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c50c65700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0cb6f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009e60 tx=0x7f3c44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f6b5bd645250f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4affd700 1 -- 172.21.15.26:0/4207890176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400e070 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4affd700 1 -- 172.21.15.26:0/4207890176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400bab0 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.019+0000 7f3c4affd700 1 -- 172.21.15.26:0/4207890176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400be30 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 -- 172.21.15.26:0/4207890176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06e0e0 msgr2=0x7f3c4c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0cb6f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009e60 tx=0x7f3c44009780 comp rx=0 tx=0).stop 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 -- 172.21.15.26:0/4207890176 shutdown_connections 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0cb6f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 --2- 172.21.15.26:0/4207890176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c06dc70 0x7f3c4c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 -- 172.21.15.26:0/4207890176 >> 172.21.15.26:0/4207890176 conn(0x7f3c4c0703a0 msgr2=0x7f3c4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 -- 172.21.15.26:0/4207890176 shutdown_connections 2023-10-09T11:36:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.020+0000 7f3c526c8700 1 -- 172.21.15.26:0/4207890176 wait complete. 2023-10-09T11:36:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.021+0000 7f3c526c8700 1 Processor -- start 2023-10-09T11:36:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.021+0000 7f3c526c8700 1 -- start start 2023-10-09T11:36:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 0x7f3c4c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b5ee0 con 0x7f3c4c06dc70 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c146a30 con 0x7f3c4c06e0e0 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c526c8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c156f50 con 0x7f3c4c159530 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54766/0 (socket says 172.21.15.26:54766) 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 -- 172.21.15.26:0/1854814363 learned_addr learned my addr 172.21.15.26:0/1854814363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c50c65700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 0x7f3c4c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4b7fe700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 -- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 msgr2=0x7f3c4c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 0x7f3c4c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 -- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 msgr2=0x7f3c4c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 -- 172.21.15.26:0/1854814363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009a20 con 0x7f3c4c06dc70 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c50c65700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 0x7f3c4c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4b7fe700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.022+0000 7f3c4bfff700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0011e0 tx=0x7f3c3c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.023+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005b30 con 0x7f3c4c06dc70 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.023+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c005c90 con 0x7f3c4c06dc70 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.023+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0b5640 con 0x7f3c4c06dc70 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.023+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c007320 con 0x7f3c4c06dc70 2023-10-09T11:36:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.023+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0b5c00 con 0x7f3c4c06dc70 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.024+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c04c3c0 con 0x7f3c4c06dc70 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.024+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c3c007690 con 0x7f3c4c06dc70 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.024+0000 7f3c33fff700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 0x7f3c38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.025+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c3c0839e0 con 0x7f3c4c06dc70 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.025+0000 7f3c4b7fe700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 0x7f3c38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.025+0000 7f3c4b7fe700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 0x7f3c38069410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006f00 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.029+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c3c050c50 con 0x7f3c4c06dc70 2023-10-09T11:36:55.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:55.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.255+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000402568", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c4c0cc010 con 0x7f3c38066f60 2023-10-09T11:36:55.261 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:36:55.261+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:36:55.261 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:36:55.261+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:36:55.262 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:36:55.261+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:36:55.262 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:36:55.261+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:36:55.262 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:36:55.261+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:36:55.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.276+0000 7f3c33fff700 1 -- 172.21.15.26:0/1854814363 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3c4c0cc010 con 0x7f3c38066f60 2023-10-09T11:36:55.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 msgr2=0x7f3c38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 0x7f3c38069410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006f00 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2023-10-09T11:36:55.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 msgr2=0x7f3c4c169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0011e0 tx=0x7f3c3c007df0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 shutdown_connections 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c38066f60 0x7f3c38069410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c4c159530 0x7f3c4c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c4c06dc70 0x7f3c4c169f60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 --2- 172.21.15.26:0/1854814363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4c06e0e0 0x7f3c4c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 >> 172.21.15.26:0/1854814363 conn(0x7f3c4c0703a0 msgr2=0x7f3c4c0d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 shutdown_connections 2023-10-09T11:36:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.278+0000 7f3c526c8700 1 -- 172.21.15.26:0/1854814363 wait complete. 2023-10-09T11:36:55.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T11:36:55.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 Processor -- start 2023-10-09T11:36:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 -- start start 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 0x7f1c100c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c100b1150 0x7f1c100ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100adbc0 con 0x7f1c100c8bd0 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100c9d30 con 0x7f1c100b1150 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.411+0000 7f1c1542d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100acfb0 con 0x7f1c100c8800 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c100b1150 0x7f1c100ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c100b1150 0x7f1c100ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54770/0 (socket says 172.21.15.26:54770) 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 -- 172.21.15.26:0/408235723 learned_addr learned my addr 172.21.15.26:0/408235723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0effd700 1 --2- 172.21.15.26:0/408235723 >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 0x7f1c100c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 -- 172.21.15.26:0/408235723 >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 msgr2=0x7f1c100c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 --2- 172.21.15.26:0/408235723 >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 0x7f1c100c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 -- 172.21.15.26:0/408235723 >> v1:172.21.15.67:6789/0 conn(0x7f1c100c8bd0 legacy=0x7f1c100b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 -- 172.21.15.26:0/408235723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100ad290 con 0x7f1c100b1150 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0effd700 1 --2- 172.21.15.26:0/408235723 >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 0x7f1c100c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0f7fe700 1 --2- 172.21.15.26:0/408235723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100b1150 0x7f1c100ae050 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1c100694d0 tx=0x7f1c08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd5ce08e8473eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0dffb700 1 -- 172.21.15.26:0/408235723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800e070 con 0x7f1c100b1150 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0dffb700 1 -- 172.21.15.26:0/408235723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800ba10 con 0x7f1c100b1150 2023-10-09T11:36:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.412+0000 7f1c0dffb700 1 -- 172.21.15.26:0/408235723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080092e0 con 0x7f1c100b1150 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 -- 172.21.15.26:0/408235723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100b1150 msgr2=0x7f1c100ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 --2- 172.21.15.26:0/408235723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100b1150 0x7f1c100ae050 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1c100694d0 tx=0x7f1c08009840 comp rx=0 tx=0).stop 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 -- 172.21.15.26:0/408235723 shutdown_connections 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 --2- 172.21.15.26:0/408235723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100b1150 0x7f1c100ae050 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 --2- 172.21.15.26:0/408235723 >> v2:172.21.15.67:3300/0 conn(0x7f1c100c8800 0x7f1c100c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 -- 172.21.15.26:0/408235723 >> 172.21.15.26:0/408235723 conn(0x7f1c1006d170 msgr2=0x7f1c100cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 -- 172.21.15.26:0/408235723 shutdown_connections 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.413+0000 7f1c1542d700 1 -- 172.21.15.26:0/408235723 wait complete. 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.414+0000 7f1c1542d700 1 Processor -- start 2023-10-09T11:36:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.414+0000 7f1c1542d700 1 -- start start 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c100b1150 0x7f1c100c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c100c8bd0 0x7f1c10157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10158c50 con 0x7f1c100c8800 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10158040 con 0x7f1c100b1150 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c1542d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10158320 con 0x7f1c100c8bd0 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54784/0 (socket says 172.21.15.26:54784) 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 -- 172.21.15.26:0/3216343590 learned_addr learned my addr 172.21.15.26:0/3216343590 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0effd700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c100b1150 0x7f1c100c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0f7fe700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c100c8bd0 0x7f1c10157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 -- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c100c8bd0 msgr2=0x7f1c10157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c100c8bd0 0x7f1c10157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 -- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c100b1150 msgr2=0x7f1c100c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c100b1150 0x7f1c100c18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 -- 172.21.15.26:0/3216343590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009ae0 con 0x7f1c100c8800 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.415+0000 7f1c0e7fc700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c5d0 tx=0x7f1c04007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011590 con 0x7f1c100c8800 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04011710 con 0x7f1c100c8800 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c10158600 con 0x7f1c100c8800 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011ad0 con 0x7f1c100c8800 2023-10-09T11:36:55.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c10150300 con 0x7f1c100c8800 2023-10-09T11:36:55.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.416+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10158e00 con 0x7f1c100c8800 2023-10-09T11:36:55.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.417+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c0401c460 con 0x7f1c100c8800 2023-10-09T11:36:55.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.417+0000 7f1bf6ffd700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 0x7f1bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:55.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.417+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c04084330 con 0x7f1c100c8800 2023-10-09T11:36:55.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.418+0000 7f1c0effd700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 0x7f1bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:55.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.418+0000 7f1c0effd700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 0x7f1bfc0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006fd0 tx=0x7f1c00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:55.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.422+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c10158e00 con 0x7f1c100c8800 2023-10-09T11:36:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.643+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c1004c3c0 con 0x7f1bfc066f30 2023-10-09T11:36:55.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.647+0000 7f1bf6ffd700 1 -- 172.21.15.26:0/3216343590 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+528 (secure 0 0 0) 0x7f1c1004c3c0 con 0x7f1bfc066f30 2023-10-09T11:36:55.648 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:36:55.648 INFO:teuthology.orchestra.run.smithi026.stdout: "mon_addrs": [ 2023-10-09T11:36:55.648 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6789", 2023-10-09T11:36:55.649 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6789", 2023-10-09T11:36:55.649 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6790" 2023-10-09T11:36:55.649 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:36:55.649 INFO:teuthology.orchestra.run.smithi026.stdout: "pending_subvolume_deletions": 0, 2023-10-09T11:36:55.649 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": { 2023-10-09T11:36:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: "data": [ 2023-10-09T11:36:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365980352512, 2023-10-09T11:36:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_data", 2023-10-09T11:36:55.650 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 0 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": [ 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365980352512, 2023-10-09T11:36:55.651 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_metadata", 2023-10-09T11:36:55.652 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 65536 2023-10-09T11:36:55.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:36:55.652 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:36:55.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:36:55.652 INFO:teuthology.orchestra.run.smithi026.stdout: "used_size": 0 2023-10-09T11:36:55.653 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:36:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 msgr2=0x7f1bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 0x7f1bfc0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006fd0 tx=0x7f1c00008040 comp rx=0 tx=0).stop 2023-10-09T11:36:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 msgr2=0x7f1c101659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c5d0 tx=0x7f1c04007f60 comp rx=0 tx=0).stop 2023-10-09T11:36:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 shutdown_connections 2023-10-09T11:36:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bfc066f30 0x7f1bfc0693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c100c8bd0 0x7f1c10157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c100b1150 0x7f1c100c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 --2- 172.21.15.26:0/3216343590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c100c8800 0x7f1c101659b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.648+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 >> 172.21.15.26:0/3216343590 conn(0x7f1c1006d170 msgr2=0x7f1c100ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.649+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 shutdown_connections 2023-10-09T11:36:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:55.649+0000 7f1c1542d700 1 -- 172.21.15.26:0/3216343590 wait complete. 2023-10-09T11:36:55.662 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:36:55.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:55.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:55.752 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:36:55.752 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:36:55.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:55.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:55.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:36:55.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:55.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:36:55.813 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:36:55.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:55.813 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:55.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:36:55.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:55.856 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:36:55.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:56.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.032+0000 7fca8eaa8700 1 Processor -- start 2023-10-09T11:36:56.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.032+0000 7fca8eaa8700 1 -- start start 2023-10-09T11:36:56.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8eaa8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fca88159920 0x7fca880ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8eaa8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880acc00 con 0x7fca8815dfd0 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8eaa8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880abff0 con 0x7fca88159550 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8eaa8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880ac2d0 con 0x7fca88159920 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8d2a5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fca8815dfd0 0x7fca880aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49612/0 (socket says 172.21.15.26:49612) 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8d2a5700 1 -- 172.21.15.26:0/1281278873 learned_addr learned my addr 172.21.15.26:0/1281278873 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/1281278873 >> v2:172.21.15.67:3300/0 conn(0x7fca88159920 0x7fca880ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744147770 0 0) 0x7fca880acc00 con 0x7fca8815dfd0 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca70003570 con 0x7fca8815dfd0 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2963984040 0 0) 0x7fca70003570 con 0x7fca8815dfd0 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 >> v2:172.21.15.67:3300/0 conn(0x7fca88159920 msgr2=0x7fca880ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 --2- 172.21.15.26:0/1281278873 >> v2:172.21.15.67:3300/0 conn(0x7fca88159920 0x7fca880ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 >> v1:172.21.15.67:6789/0 conn(0x7fca88159550 legacy=0x7fca880ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880ac5b0 con 0x7fca8815dfd0 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.033+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fca7c001470 con 0x7fca8815dfd0 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 >> v1:172.21.15.26:6789/0 conn(0x7fca8815dfd0 legacy=0x7fca880aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca70003a60 0x7fca70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca70004810 0x7fca70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca880ac2d0 con 0x7fca700051c0 2023-10-09T11:36:56.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7000c0d0 con 0x7fca70003a60 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7000c290 con 0x7fca70004810 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8daa6700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca70003a60 0x7fca70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8d2a5700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca70004810 0x7fca70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 -- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca70004810 msgr2=0x7fca70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca70004810 0x7fca70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 -- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca70003a60 msgr2=0x7fca70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca70003a60 0x7fca70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 -- 172.21.15.26:0/1281278873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70003570 con 0x7fca700051c0 2023-10-09T11:36:56.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 -- 172.21.15.26:0/1281278873 reap_dead start 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca7000ba60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fca78009c00 tx=0x7fca780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182b9239486c0b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800e710 con 0x7fca700051c0 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800e890 con 0x7fca700051c0 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.034+0000 7fca8caa4700 1 -- 172.21.15.26:0/1281278873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800ec50 con 0x7fca700051c0 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 -- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 msgr2=0x7fca7000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca7000ba60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fca78009c00 tx=0x7fca780091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 -- 172.21.15.26:0/1281278873 shutdown_connections 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/1281278873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca7000ba60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 -- 172.21.15.26:0/1281278873 >> 172.21.15.26:0/1281278873 conn(0x7fca8806ce80 msgr2=0x7fca880ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 -- 172.21.15.26:0/1281278873 shutdown_connections 2023-10-09T11:36:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.035+0000 7fca8eaa8700 1 -- 172.21.15.26:0/1281278873 wait complete. 2023-10-09T11:36:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.036+0000 7fca8eaa8700 1 Processor -- start 2023-10-09T11:36:56.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.036+0000 7fca8eaa8700 1 -- start start 2023-10-09T11:36:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca880acf70 0x7fca880ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 0x7fca880b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca880ad920 con 0x7fca700051c0 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8816a760 con 0x7fca880b2710 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8eaa8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88149450 con 0x7fca880acf70 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54806/0 (socket says 172.21.15.26:54806) 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 -- 172.21.15.26:0/164023838 learned_addr learned my addr 172.21.15.26:0/164023838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8d2a5700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca880acf70 0x7fca880ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 0x7fca880b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 -- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca880acf70 msgr2=0x7fca880ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca880acf70 0x7fca880ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 -- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 msgr2=0x7fca880b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 0x7fca880b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 -- 172.21.15.26:0/164023838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88169b70 con 0x7fca700051c0 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8e2a7700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 0x7fca880b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.037+0000 7fca8daa6700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca8000ebf0 tx=0x7fca80001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.038+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000c8b0 con 0x7fca700051c0 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.038+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8000ca10 con 0x7fca700051c0 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.038+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca88169e30 con 0x7fca700051c0 2023-10-09T11:36:56.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.038+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000cdb0 con 0x7fca700051c0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.038+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8816a3f0 con 0x7fca700051c0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.039+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8804c3c0 con 0x7fca700051c0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.039+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca80015640 con 0x7fca700051c0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.039+0000 7fca85ffb700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 0x7fca740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.040+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca80084c60 con 0x7fca700051c0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.040+0000 7fca8d2a5700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 0x7fca740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.040+0000 7fca8d2a5700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 0x7fca740693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fca881540d0 tx=0x7fca7c001e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.044+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca80051ed0 con 0x7fca700051c0 2023-10-09T11:36:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.182+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fca800522a0 con 0x7fca700051c0 2023-10-09T11:36:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.283+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca8816aa40 con 0x7fca700051c0 2023-10-09T11:36:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.283+0000 7fca85ffb700 1 -- 172.21.15.26:0/164023838 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fca80055960 con 0x7fca700051c0 2023-10-09T11:36:56.285 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:56.285 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 msgr2=0x7fca740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 0x7fca740693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fca881540d0 tx=0x7fca7c001e50 comp rx=0 tx=0).stop 2023-10-09T11:36:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 msgr2=0x7fca88148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca8000ebf0 tx=0x7fca80001640 comp rx=0 tx=0).stop 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 shutdown_connections 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca880b2710 0x7fca880b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca700051c0 0x7fca88148f10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca74066f30 0x7fca740693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 --2- 172.21.15.26:0/164023838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca880acf70 0x7fca880ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 >> 172.21.15.26:0/164023838 conn(0x7fca8806ce80 msgr2=0x7fca880af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 shutdown_connections 2023-10-09T11:36:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.285+0000 7fca8eaa8700 1 -- 172.21.15.26:0/164023838 wait complete. 2023-10-09T11:36:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 31 2023-10-09T11:36:56.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.417+0000 7fe5f8abc700 1 Processor -- start 2023-10-09T11:36:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.417+0000 7fe5f8abc700 1 -- start start 2023-10-09T11:36:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f8abc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe5f40cf110 0x7fe5f4164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f8abc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f415afd0 con 0x7fe5f4153c30 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f8abc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f415b2b0 con 0x7fe5f415de50 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f8abc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f415b590 con 0x7fe5f40cf110 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49618/0 (socket says 172.21.15.26:49618) 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f37fe700 1 -- 172.21.15.26:0/2171445327 learned_addr learned my addr 172.21.15.26:0/2171445327 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/2171445327 >> v2:172.21.15.67:3300/0 conn(0x7fe5f40cf110 0x7fe5f4164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11193180 0 0) 0x7fe5f415afd0 con 0x7fe5f4153c30 2023-10-09T11:36:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.418+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc003570 con 0x7fe5f4153c30 2023-10-09T11:36:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362328784 0 0) 0x7fe5dc003570 con 0x7fe5f4153c30 2023-10-09T11:36:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 >> v2:172.21.15.67:3300/0 conn(0x7fe5f40cf110 msgr2=0x7fe5f4164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 --2- 172.21.15.26:0/2171445327 >> v2:172.21.15.67:3300/0 conn(0x7fe5f40cf110 0x7fe5f4164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 >> v1:172.21.15.67:6789/0 conn(0x7fe5f415de50 legacy=0x7fe5f40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f415b870 con 0x7fe5f4153c30 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fe5e4001470 con 0x7fe5f4153c30 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 >> v1:172.21.15.26:6789/0 conn(0x7fe5f4153c30 legacy=0x7fe5f415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc003a60 0x7fe5dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5dc004810 0x7fe5dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 0x7fe5dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f415b590 con 0x7fe5dc0051c0 2023-10-09T11:36:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc00c0d0 con 0x7fe5dc003a60 2023-10-09T11:36:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc00c290 con 0x7fe5dc004810 2023-10-09T11:36:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 0x7fe5dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f37fe700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc003a60 0x7fe5dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f2ffd700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5dc004810 0x7fe5dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 -- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5dc004810 msgr2=0x7fe5dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5dc004810 0x7fe5dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 -- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc003a60 msgr2=0x7fe5dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc003a60 0x7fe5dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 -- 172.21.15.26:0/2171445327 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc003570 con 0x7fe5dc0051c0 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 -- 172.21.15.26:0/2171445327 reap_dead start 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 0x7fe5dc00ba60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e210 tx=0x7fe5ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bd718851dc6147 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.419+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00eac0 con 0x7fe5dc0051c0 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00f040 con 0x7fe5dc0051c0 2023-10-09T11:36:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f27fc700 1 -- 172.21.15.26:0/2171445327 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00ee70 con 0x7fe5dc0051c0 2023-10-09T11:36:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 -- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 msgr2=0x7fe5dc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 0x7fe5dc00ba60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e210 tx=0x7fe5ec00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 -- 172.21.15.26:0/2171445327 shutdown_connections 2023-10-09T11:36:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/2171445327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0051c0 0x7fe5dc00ba60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 -- 172.21.15.26:0/2171445327 >> 172.21.15.26:0/2171445327 conn(0x7fe5f40703a0 msgr2=0x7fe5f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 -- 172.21.15.26:0/2171445327 shutdown_connections 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.420+0000 7fe5f8abc700 1 -- 172.21.15.26:0/2171445327 wait complete. 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.421+0000 7fe5f8abc700 1 Processor -- start 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.421+0000 7fe5f8abc700 1 -- start start 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc0051c0 0x7fe5f4147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5f40b15f0 0x7fe5f40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f4150880 con 0x7fe5f414fed0 2023-10-09T11:36:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40b1f80 con 0x7fe5dc0051c0 2023-10-09T11:36:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f8abc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40cc460 con 0x7fe5f40b15f0 2023-10-09T11:36:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54824/0 (socket says 172.21.15.26:54824) 2023-10-09T11:36:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 -- 172.21.15.26:0/817506366 learned_addr learned my addr 172.21.15.26:0/817506366 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f3fff700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5f40b15f0 0x7fe5f40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f37fe700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc0051c0 0x7fe5f4147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 -- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5f40b15f0 msgr2=0x7fe5f40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5f40b15f0 0x7fe5f40b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 -- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc0051c0 msgr2=0x7fe5f4147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.422+0000 7fe5f2ffd700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc0051c0 0x7fe5f4147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5f2ffd700 1 -- 172.21.15.26:0/817506366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40cc700 con 0x7fe5f414fed0 2023-10-09T11:36:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5f2ffd700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e580 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8002470 con 0x7fe5f414fed0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8010040 con 0x7fe5f414fed0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8002800 con 0x7fe5f414fed0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f40cc9e0 con 0x7fe5f414fed0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.423+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f40ccfa0 con 0x7fe5f414fed0 2023-10-09T11:36:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.424+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f404c3c0 con 0x7fe5f414fed0 2023-10-09T11:36:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.424+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe5e8002b70 con 0x7fe5f414fed0 2023-10-09T11:36:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.425+0000 7fe5db7fe700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 0x7fe5e0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.425+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5e8083b70 con 0x7fe5f414fed0 2023-10-09T11:36:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.425+0000 7fe5f37fe700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 0x7fe5e0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.425+0000 7fe5f37fe700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 0x7fe5e0069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40016e0 tx=0x7fe5f415e2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.429+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5e804d5a0 con 0x7fe5f414fed0 2023-10-09T11:36:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.620+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5f415bb50 con 0x7fe5f414fed0 2023-10-09T11:36:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.621+0000 7fe5db7fe700 1 -- 172.21.15.26:0/817506366 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe5e8019070 con 0x7fe5f414fed0 2023-10-09T11:36:56.623 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:56.623 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:46.093692+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 msgr2=0x7fe5e0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 0x7fe5e0069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40016e0 tx=0x7fe5f415e2d0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 msgr2=0x7fe5f4150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e580 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 shutdown_connections 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe5e0066fc0 0x7fe5e0069470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5f40b15f0 0x7fe5f40b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5dc0051c0 0x7fe5f4147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 --2- 172.21.15.26:0/817506366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5f414fed0 0x7fe5f4150340 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 >> 172.21.15.26:0/817506366 conn(0x7fe5f40703a0 msgr2=0x7fe5f4152490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 shutdown_connections 2023-10-09T11:36:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.623+0000 7fe5f8abc700 1 -- 172.21.15.26:0/817506366 wait complete. 2023-10-09T11:36:56.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:42.908862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:43.467721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:56.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.757+0000 7f9e5e1ca700 1 Processor -- start 2023-10-09T11:36:56.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.757+0000 7f9e5e1ca700 1 -- start start 2023-10-09T11:36:56.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e5e1ca700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e580cc320 0x7f9e5813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e5e1ca700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e5e1ca700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5806d7b0 con 0x7f9e58069a00 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e5e1ca700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5806a590 con 0x7f9e580cc320 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e5e1ca700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5806f7d0 con 0x7f9e580cc6f0 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e577fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e580cc320 0x7f9e5813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.758+0000 7f9e56ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e56ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:45558/0 (socket says 172.21.15.26:45558) 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e580cc320 0x7f9e5813c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:55884/0 (socket says 172.21.15.26:55884) 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e56ffd700 1 -- 172.21.15.26:0/1675327047 learned_addr learned my addr 172.21.15.26:0/1675327047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:56.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 -- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 msgr2=0x7f9e5813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 -- 172.21.15.26:0/1675327047 >> v1:172.21.15.67:6789/0 conn(0x7f9e58069a00 legacy=0x7f9e58069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e567fc700 1 -- 172.21.15.26:0/1675327047 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016208368 0 0) 0x7f9e5806d7b0 con 0x7f9e58069a00 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 -- 172.21.15.26:0/1675327047 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5806e330 con 0x7f9e580cc320 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e56ffd700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e577fe700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e5813c2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e480098e0 tx=0x7f9e480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78b8ade16691b58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e567fc700 1 -- 172.21.15.26:0/1675327047 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800b640 con 0x7f9e580cc320 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e567fc700 1 -- 172.21.15.26:0/1675327047 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4800b7a0 con 0x7f9e580cc320 2023-10-09T11:36:56.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.759+0000 7f9e567fc700 1 -- 172.21.15.26:0/1675327047 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800bb40 con 0x7f9e580cc320 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 msgr2=0x7f9e5813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e5813c2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e480098e0 tx=0x7f9e480091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/1675327047 shutdown_connections 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e5813c2a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/1675327047 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e5813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/1675327047 >> 172.21.15.26:0/1675327047 conn(0x7f9e58067f00 msgr2=0x7f9e58068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/1675327047 shutdown_connections 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.760+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/1675327047 wait complete. 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.761+0000 7f9e5e1ca700 1 Processor -- start 2023-10-09T11:36:56.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.761+0000 7f9e5e1ca700 1 -- start start 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e580c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e580c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580c9dc0 con 0x7f9e58069a00 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580c9520 con 0x7f9e580cc320 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e5e1ca700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580c9800 con 0x7f9e580cc6f0 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54826/0 (socket says 172.21.15.26:54826) 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 -- 172.21.15.26:0/3429223532 learned_addr learned my addr 172.21.15.26:0/3429223532 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e56ffd700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e580c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e57fff700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e580c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 -- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 msgr2=0x7f9e580c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e580c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 -- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 msgr2=0x7f9e580c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e580c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.762+0000 7f9e577fe700 1 -- 172.21.15.26:0/3429223532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0094f0 con 0x7f9e58069a00 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e577fe700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009f80 tx=0x7f9e48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800b910 con 0x7f9e58069a00 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4800ba70 con 0x7f9e58069a00 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e48009420 con 0x7f9e58069a00 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48024670 con 0x7f9e58069a00 2023-10-09T11:36:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.763+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e580ca560 con 0x7f9e58069a00 2023-10-09T11:36:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.764+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e58068a20 con 0x7f9e58069a00 2023-10-09T11:36:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.764+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9e48024aa0 con 0x7f9e58069a00 2023-10-09T11:36:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.765+0000 7f9e3f7fe700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 0x7f9e44069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.765+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e48085f70 con 0x7f9e58069a00 2023-10-09T11:36:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.765+0000 7f9e56ffd700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 0x7f9e44069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.765+0000 7f9e56ffd700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 0x7f9e44069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9e580b1f90 tx=0x7f9e4c009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.769+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e480b75a0 con 0x7f9e58069a00 2023-10-09T11:36:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.962+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e5804c3c0 con 0x7f9e58069a00 2023-10-09T11:36:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.963+0000 7f9e3f7fe700 1 -- 172.21.15.26:0/3429223532 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e480531f0 con 0x7f9e58069a00 2023-10-09T11:36:56.964 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 msgr2=0x7f9e44069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 0x7f9e44069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9e580b1f90 tx=0x7f9e4c009250 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 msgr2=0x7f9e581526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009f80 tx=0x7f9e48017000 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 shutdown_connections 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e44066fc0 0x7f9e44069470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e580cc6f0 0x7f9e580c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e58069a00 0x7f9e581526b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 --2- 172.21.15.26:0/3429223532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e580cc320 0x7f9e580c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 >> 172.21.15.26:0/3429223532 conn(0x7f9e58067f00 msgr2=0x7f9e5813c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 shutdown_connections 2023-10-09T11:36:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:56.965+0000 7f9e5e1ca700 1 -- 172.21.15.26:0/3429223532 wait complete. 2023-10-09T11:36:56.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:57.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.098+0000 7f82a47c2700 1 Processor -- start 2023-10-09T11:36:57.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.098+0000 7f82a47c2700 1 -- start start 2023-10-09T11:36:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.099+0000 7f82a47c2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f829c159530 0x7f829c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.099+0000 7f82a47c2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06dc70 0x7f829c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.099+0000 7f82a47c2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0ccfd0 con 0x7f829c06e0e0 2023-10-09T11:36:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.099+0000 7f82a47c2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0cf0e0 con 0x7f829c159530 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.099+0000 7f82a47c2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c15a3d0 con 0x7f829c06dc70 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f829c159530 0x7f829c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f829c159530 0x7f829c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54836/0 (socket says 172.21.15.26:54836) 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 -- 172.21.15.26:0/3697756935 learned_addr learned my addr 172.21.15.26:0/3697756935 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a1d5d700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06dc70 0x7f829c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 -- 172.21.15.26:0/3697756935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06dc70 msgr2=0x7f829c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06dc70 0x7f829c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 -- 172.21.15.26:0/3697756935 >> v1:172.21.15.67:6789/0 conn(0x7f829c06e0e0 legacy=0x7f829c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 -- 172.21.15.26:0/3697756935 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c15a6b0 con 0x7f829c159530 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a255e700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c159530 0x7f829c0ceba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f828c009f20 tx=0x7f828c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5feff6a9882ad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a155c700 1 -- 172.21.15.26:0/3697756935 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e070 con 0x7f829c159530 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a155c700 1 -- 172.21.15.26:0/3697756935 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00ba80 con 0x7f829c159530 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.100+0000 7f82a155c700 1 -- 172.21.15.26:0/3697756935 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0092e0 con 0x7f829c159530 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 -- 172.21.15.26:0/3697756935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c159530 msgr2=0x7f829c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c159530 0x7f829c0ceba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f828c009f20 tx=0x7f828c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 -- 172.21.15.26:0/3697756935 shutdown_connections 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c159530 0x7f829c0ceba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 --2- 172.21.15.26:0/3697756935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06dc70 0x7f829c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 -- 172.21.15.26:0/3697756935 >> 172.21.15.26:0/3697756935 conn(0x7f829c0703a0 msgr2=0x7f829c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 -- 172.21.15.26:0/3697756935 shutdown_connections 2023-10-09T11:36:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.101+0000 7f82a47c2700 1 -- 172.21.15.26:0/3697756935 wait complete. 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.102+0000 7f82a47c2700 1 Processor -- start 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.102+0000 7f82a47c2700 1 -- start start 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06e0e0 0x7f829c16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829c159530 0x7f829c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0d0670 con 0x7f829c06dc70 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0d1060 con 0x7f829c159530 2023-10-09T11:36:57.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0d0d80 con 0x7f829c06e0e0 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54840/0 (socket says 172.21.15.26:54840) 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 -- 172.21.15.26:0/530798366 learned_addr learned my addr 172.21.15.26:0/530798366 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 -- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06e0e0 msgr2=0x7f829c16a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06e0e0 0x7f829c16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 -- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829c159530 msgr2=0x7f829c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a2d5f700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829c159530 0x7f829c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829c159530 0x7f829c0d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 -- 172.21.15.26:0/530798366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009ae0 con 0x7f829c06dc70 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a255e700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f828c00b6c0 tx=0x7f828c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c008bb0 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c008d10 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0b3520 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c01c660 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.103+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0b3b70 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.104+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c04c3c0 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.105+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f828c003040 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.105+0000 7f829a7fc700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 0x7f8288069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.105+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f828c085dd0 con 0x7f829c06dc70 2023-10-09T11:36:57.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.105+0000 7f82a1d5d700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 0x7f8288069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.106+0000 7f82a1d5d700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 0x7f8288069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f829c15ee70 tx=0x7f8290008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.109+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f828c052f40 con 0x7f829c06dc70 2023-10-09T11:36:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.305+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f829c0b39c0 con 0x7f829c06dc70 2023-10-09T11:36:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.305+0000 7f829a7fc700 1 -- 172.21.15.26:0/530798366 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f828c056560 con 0x7f829c06dc70 2023-10-09T11:36:57.307 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 msgr2=0x7f8288069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 0x7f8288069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f829c15ee70 tx=0x7f8290008040 comp rx=0 tx=0).stop 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 msgr2=0x7f829c0cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f828c00b6c0 tx=0x7f828c018000 comp rx=0 tx=0).stop 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 shutdown_connections 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829c159530 0x7f829c0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c06dc70 0x7f829c0cf2b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8288066fc0 0x7f8288069470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 --2- 172.21.15.26:0/530798366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829c06e0e0 0x7f829c16a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 >> 172.21.15.26:0/530798366 conn(0x7f829c0703a0 msgr2=0x7f829c070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 shutdown_connections 2023-10-09T11:36:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.307+0000 7f82a47c2700 1 -- 172.21.15.26:0/530798366 wait complete. 2023-10-09T11:36:57.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:57.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.441+0000 7fe0a1d30700 1 Processor -- start 2023-10-09T11:36:57.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.441+0000 7fe0a1d30700 1 -- start start 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe0a1d30700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe09c1508b0 0x7fe09c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe0a1d30700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c0675a0 0x7fe09c0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe0a1d30700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0cddf0 con 0x7fe09c150c80 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe0a1d30700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b0360 con 0x7fe09c1508b0 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe0a1d30700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c067f20 con 0x7fe09c0675a0 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe09c1508b0 0x7fe09c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe09c1508b0 0x7fe09c0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54842/0 (socket says 172.21.15.26:54842) 2023-10-09T11:36:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4291687046 learned_addr learned my addr 172.21.15.26:0/4291687046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09bfff700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c0675a0 0x7fe09c0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4291687046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c0675a0 msgr2=0x7fe09c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c0675a0 0x7fe09c0679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4291687046 >> v1:172.21.15.67:6789/0 conn(0x7fe09c150c80 legacy=0x7fe09c1573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.442+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4291687046 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0cd550 con 0x7fe09c1508b0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe09b7fe700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c1508b0 0x7fe09c0ccec0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0099b0 tx=0x7fe08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400a2e8038be3949 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe09a7fc700 1 -- 172.21.15.26:0/4291687046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00b820 con 0x7fe09c1508b0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe09a7fc700 1 -- 172.21.15.26:0/4291687046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00b980 con 0x7fe09c1508b0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe09a7fc700 1 -- 172.21.15.26:0/4291687046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00bd20 con 0x7fe09c1508b0 2023-10-09T11:36:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4291687046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c1508b0 msgr2=0x7fe09c0ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c1508b0 0x7fe09c0ccec0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0099b0 tx=0x7fe08c009250 comp rx=0 tx=0).stop 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4291687046 shutdown_connections 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c0675a0 0x7fe09c0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4291687046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c1508b0 0x7fe09c0ccec0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4291687046 >> 172.21.15.26:0/4291687046 conn(0x7fe09c06d7b0 msgr2=0x7fe09c06dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4291687046 shutdown_connections 2023-10-09T11:36:57.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.443+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4291687046 wait complete. 2023-10-09T11:36:57.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 Processor -- start 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 -- start start 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c1508b0 0x7fe09c169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c150c80 0x7fe09c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0cc100 con 0x7fe09c0675a0 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0cb2c0 con 0x7fe09c150c80 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe0a1d30700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0cb7d0 con 0x7fe09c1508b0 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54856/0 (socket says 172.21.15.26:54856) 2023-10-09T11:36:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.445+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4050722008 learned_addr learned my addr 172.21.15.26:0/4050722008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09bfff700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c150c80 0x7fe09c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09affd700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c1508b0 0x7fe09c169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c1508b0 msgr2=0x7fe09c169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c1508b0 0x7fe09c169280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c150c80 msgr2=0x7fe09c158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c150c80 0x7fe09c158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 -- 172.21.15.26:0/4050722008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0094f0 con 0x7fe09c0675a0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe09b7fe700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009290 tx=0x7fe08c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011d70 con 0x7fe09c0675a0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c020070 con 0x7fe09c0675a0 2023-10-09T11:36:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0cbab0 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c01b6a0 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.446+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c1697c0 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.447+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c04c3c0 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.447+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe08c022030 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.448+0000 7fe0837fe700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 0x7fe088069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.448+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe08c086500 con 0x7fe09c0675a0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.448+0000 7fe09affd700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 0x7fe088069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.449+0000 7fe09affd700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 0x7fe088069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0c2420 tx=0x7fe090008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.453+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe08c053780 con 0x7fe09c0675a0 2023-10-09T11:36:57.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.644+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe09c04c3c0 con 0x7fe09c0675a0 2023-10-09T11:36:57.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.644+0000 7fe0837fe700 1 -- 172.21.15.26:0/4050722008 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe08c056da0 con 0x7fe09c0675a0 2023-10-09T11:36:57.646 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 msgr2=0x7fe088069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 0x7fe088069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0c2420 tx=0x7fe090008040 comp rx=0 tx=0).stop 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 msgr2=0x7fe09c166660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009290 tx=0x7fe08c016000 comp rx=0 tx=0).stop 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 shutdown_connections 2023-10-09T11:36:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c150c80 0x7fe09c158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe09c0675a0 0x7fe09c166660 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe088066fc0 0x7fe088069470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 --2- 172.21.15.26:0/4050722008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe09c1508b0 0x7fe09c169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 >> 172.21.15.26:0/4050722008 conn(0x7fe09c06d7b0 msgr2=0x7fe09c14ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 shutdown_connections 2023-10-09T11:36:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.646+0000 7fe0a1d30700 1 -- 172.21.15.26:0/4050722008 wait complete. 2023-10-09T11:36:57.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.778+0000 7f70e77e1700 1 Processor -- start 2023-10-09T11:36:57.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.778+0000 7f70e77e1700 1 -- start start 2023-10-09T11:36:57.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e77e1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e0159c20 0x7f70e00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e77e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 0x7f70e00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e77e1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00adb20 con 0x7f70e0159850 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e77e1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00ccdc0 con 0x7f70e0159c20 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e77e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b12f0 con 0x7f70e00b0e70 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e4d7c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e0159c20 0x7f70e00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e557d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f70e0159850 0x7f70e00adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53138/0 (socket says 172.21.15.26:53138) 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e557d700 1 -- 172.21.15.26:0/1524944199 learned_addr learned my addr 172.21.15.26:0/1524944199 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.779+0000 7f70e5d7e700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 0x7f70e00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e4d7c700 1 -- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 msgr2=0x7f70e00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e4d7c700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 0x7f70e00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e4d7c700 1 -- 172.21.15.26:0/1524944199 >> v1:172.21.15.67:6789/0 conn(0x7f70e0159850 legacy=0x7f70e00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70dffff700 1 -- 172.21.15.26:0/1524944199 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290732336 0 0) 0x7f70e00adb20 con 0x7f70e0159850 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e4d7c700 1 -- 172.21.15.26:0/1524944199 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00acf10 con 0x7f70e0159c20 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e5d7e700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 0x7f70e00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70e4d7c700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e00b0930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009910 tx=0x7f70d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd77536ad4419a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70dffff700 1 -- 172.21.15.26:0/1524944199 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d400b640 con 0x7f70e0159c20 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70dffff700 1 -- 172.21.15.26:0/1524944199 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d400b7a0 con 0x7f70e0159c20 2023-10-09T11:36:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.780+0000 7f70dffff700 1 -- 172.21.15.26:0/1524944199 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d400bb60 con 0x7f70e0159c20 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 -- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 msgr2=0x7f70e00b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e00b0930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009910 tx=0x7f70d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 -- 172.21.15.26:0/1524944199 shutdown_connections 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e00b0e70 0x7f70e00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 --2- 172.21.15.26:0/1524944199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e00b0930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 -- 172.21.15.26:0/1524944199 >> 172.21.15.26:0/1524944199 conn(0x7f70e006d170 msgr2=0x7f70e00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 -- 172.21.15.26:0/1524944199 shutdown_connections 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.781+0000 7f70e77e1700 1 -- 172.21.15.26:0/1524944199 wait complete. 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.782+0000 7f70e77e1700 1 Processor -- start 2023-10-09T11:36:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.782+0000 7f70e77e1700 1 -- start start 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e0159850 0x7f70e00aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e0140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00ab6b0 con 0x7f70e00b0e70 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00aaaa0 con 0x7f70e0159c20 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e77e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00aad80 con 0x7f70e0159850 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54858/0 (socket says 172.21.15.26:54858) 2023-10-09T11:36:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 -- 172.21.15.26:0/79060165 learned_addr learned my addr 172.21.15.26:0/79060165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e4d7c700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e0159850 0x7f70e00aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e5d7e700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e0140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 -- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e0159850 msgr2=0x7f70e00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e0159850 0x7f70e00aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 -- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 msgr2=0x7f70e0140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e0140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 -- 172.21.15.26:0/79060165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009a20 con 0x7f70e00b0e70 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e5d7e700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e0140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.783+0000 7f70e557d700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f70d000c7e0 tx=0x7f70d0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.784+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0005b30 con 0x7f70e00b0e70 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.784+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0005c90 con 0x7f70e00b0e70 2023-10-09T11:36:57.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.784+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d4009420 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.784+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0007300 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.784+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00ab340 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.785+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e004c3c0 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.785+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f70d001b400 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.785+0000 7f70dd7fa700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 0x7f70cc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.786+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70d0084060 con 0x7f70e00b0e70 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.786+0000 7f70e4d7c700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 0x7f70cc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.786+0000 7f70e4d7c700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 0x7f70cc069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009860 tx=0x7f70d4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:57.790+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70d0051360 con 0x7f70e00b0e70 2023-10-09T11:36:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.025+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e00ad1f0 con 0x7f70e00b0e70 2023-10-09T11:36:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.026+0000 7f70dd7fa700 1 -- 172.21.15.26:0/79060165 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f70d0054980 con 0x7f70e00b0e70 2023-10-09T11:36:58.030 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:58.031 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 msgr2=0x7f70cc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 0x7f70cc069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009860 tx=0x7f70d4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 msgr2=0x7f70e0168e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f70d000c7e0 tx=0x7f70d0007df0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 shutdown_connections 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e0159c20 0x7f70e0140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70e00b0e70 0x7f70e0168e60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f70cc066fc0 0x7f70cc069470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 --2- 172.21.15.26:0/79060165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70e0159850 0x7f70e00aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 >> 172.21.15.26:0/79060165 conn(0x7f70e006d170 msgr2=0x7f70e00afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 shutdown_connections 2023-10-09T11:36:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.028+0000 7f70e77e1700 1 -- 172.21.15.26:0/79060165 wait complete. 2023-10-09T11:36:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 31 2023-10-09T11:36:58.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.159+0000 7f62a8df4700 1 Processor -- start 2023-10-09T11:36:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.159+0000 7f62a8df4700 1 -- start start 2023-10-09T11:36:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a8df4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a40cb970 0x7f62a4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a8df4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a415ae40 con 0x7f62a40cb5a0 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a8df4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a415ab60 con 0x7f62a415a400 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a8df4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40ce0f0 con 0x7f62a40cb970 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f62a40cb5a0 0x7f62a40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49630/0 (socket says 172.21.15.26:49630) 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a259c700 1 -- 172.21.15.26:0/1212466076 learned_addr learned my addr 172.21.15.26:0/1212466076 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.160+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/1212466076 >> v2:172.21.15.67:3300/0 conn(0x7f62a40cb970 0x7f62a4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a159a700 1 -- 172.21.15.26:0/1212466076 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134187459 0 0) 0x7f62a415ae40 con 0x7f62a40cb5a0 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a159a700 1 -- 172.21.15.26:0/1212466076 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6290003570 con 0x7f62a40cb5a0 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a1d9b700 1 -- 172.21.15.26:0/1212466076 >> v1:172.21.15.67:6789/0 conn(0x7f62a415a400 legacy=0x7f62a4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a1d9b700 1 -- 172.21.15.26:0/1212466076 >> v1:172.21.15.26:6789/0 conn(0x7f62a40cb5a0 legacy=0x7f62a40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a1d9b700 1 -- 172.21.15.26:0/1212466076 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40ccf00 con 0x7f62a40cb970 2023-10-09T11:36:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/1212466076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4159ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f628c0098e0 tx=0x7f628c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7aff24121d6550b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a159a700 1 -- 172.21.15.26:0/1212466076 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00b640 con 0x7f62a40cb970 2023-10-09T11:36:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a159a700 1 -- 172.21.15.26:0/1212466076 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00b7a0 con 0x7f62a40cb970 2023-10-09T11:36:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.161+0000 7f62a159a700 1 -- 172.21.15.26:0/1212466076 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00bb40 con 0x7f62a40cb970 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 -- 172.21.15.26:0/1212466076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 msgr2=0x7f62a4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 --2- 172.21.15.26:0/1212466076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4159ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f628c0098e0 tx=0x7f628c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 -- 172.21.15.26:0/1212466076 shutdown_connections 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 --2- 172.21.15.26:0/1212466076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4159ec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 -- 172.21.15.26:0/1212466076 >> 172.21.15.26:0/1212466076 conn(0x7f62a4070e30 msgr2=0x7f62a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 -- 172.21.15.26:0/1212466076 shutdown_connections 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.162+0000 7f62a8df4700 1 -- 172.21.15.26:0/1212466076 wait complete. 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.163+0000 7f62a8df4700 1 Processor -- start 2023-10-09T11:36:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.163+0000 7f62a8df4700 1 -- start start 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62a415a400 0x7f62a41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415cc90 con 0x7f62a40cb5a0 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40b6450 con 0x7f62a40cb970 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40c9ff0 con 0x7f62a415a400 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54874/0 (socket says 172.21.15.26:54874) 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 -- 172.21.15.26:0/3591554331 learned_addr learned my addr 172.21.15.26:0/3591554331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a2d9d700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62a415a400 0x7f62a41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 -- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62a415a400 msgr2=0x7f62a41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62a415a400 0x7f62a41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 -- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 msgr2=0x7f62a4156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 -- 172.21.15.26:0/3591554331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c009420 con 0x7f62a40cb5a0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a259c700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c7c0 tx=0x7f629c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c005b30 con 0x7f62a40cb5a0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c005c90 con 0x7f62a40cb5a0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a40ca2d0 con 0x7f62a40cb5a0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.164+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c007340 con 0x7f62a40cb5a0 2023-10-09T11:36:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.165+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a41571a0 con 0x7f62a40cb5a0 2023-10-09T11:36:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.165+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a40895b0 con 0x7f62a40cb5a0 2023-10-09T11:36:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.166+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f629c01b400 con 0x7f62a40cb5a0 2023-10-09T11:36:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.166+0000 7f629a7fc700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 0x7f6284069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.166+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f629c084060 con 0x7f62a40cb5a0 2023-10-09T11:36:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.166+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 0x7f6284069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.167+0000 7f62a1d9b700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 0x7f6284069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f628c0093f0 tx=0x7f628c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.171+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f629c051360 con 0x7f62a40cb5a0 2023-10-09T11:36:58.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.368+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62a404c3c0 con 0x7f62a40cb5a0 2023-10-09T11:36:58.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.369+0000 7f629a7fc700 1 -- 172.21.15.26:0/3591554331 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f629c054980 con 0x7f62a40cb5a0 2023-10-09T11:36:58.370 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:58.371 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:46.093692+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 msgr2=0x7f6284069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 0x7f6284069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f628c0093f0 tx=0x7f628c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 msgr2=0x7f62a40b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c7c0 tx=0x7f629c007e00 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 shutdown_connections 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6284066fc0 0x7f6284069470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62a415a400 0x7f62a41530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a40cb5a0 0x7f62a40b5d90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 --2- 172.21.15.26:0/3591554331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40cb970 0x7f62a4156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 >> 172.21.15.26:0/3591554331 conn(0x7f62a4070e30 msgr2=0x7f62a40b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 shutdown_connections 2023-10-09T11:36:58.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.371+0000 7f62a8df4700 1 -- 172.21.15.26:0/3591554331 wait complete. 2023-10-09T11:36:58.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:36:58.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:58.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.502+0000 7fc5d0877700 1 Processor -- start 2023-10-09T11:36:58.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.502+0000 7fc5d0877700 1 -- start start 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.503+0000 7fc5d0877700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5cc0cb970 0x7fc5cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.503+0000 7fc5d0877700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc15a400 0x7fc5cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.503+0000 7fc5d0877700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc15ae40 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.503+0000 7fc5d0877700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0ce0f0 con 0x7fc5cc0cb970 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.503+0000 7fc5d0877700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0d13f0 con 0x7fc5cc15a400 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5cc0cb970 0x7fc5cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5cc0cb970 0x7fc5cc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54884/0 (socket says 172.21.15.26:54884) 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 -- 172.21.15.26:0/2816033405 learned_addr learned my addr 172.21.15.26:0/2816033405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5cad9d700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc15a400 0x7fc5cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 -- 172.21.15.26:0/2816033405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc15a400 msgr2=0x7fc5cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc15a400 0x7fc5cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 -- 172.21.15.26:0/2816033405 >> v1:172.21.15.67:6789/0 conn(0x7fc5cc0cb5a0 legacy=0x7fc5cc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 -- 172.21.15.26:0/2816033405 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc15ab60 con 0x7fc5cc0cb970 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c9d9b700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb970 0x7fc5cc159ec0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00099b0 tx=0x7fc5c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22f334a08e664f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c959a700 1 -- 172.21.15.26:0/2816033405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000b860 con 0x7fc5cc0cb970 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c959a700 1 -- 172.21.15.26:0/2816033405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000b9c0 con 0x7fc5cc0cb970 2023-10-09T11:36:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.504+0000 7fc5c959a700 1 -- 172.21.15.26:0/2816033405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000bd60 con 0x7fc5cc0cb970 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 -- 172.21.15.26:0/2816033405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb970 msgr2=0x7fc5cc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb970 0x7fc5cc159ec0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00099b0 tx=0x7fc5c0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 -- 172.21.15.26:0/2816033405 shutdown_connections 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc15a400 0x7fc5cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 --2- 172.21.15.26:0/2816033405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb970 0x7fc5cc159ec0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 -- 172.21.15.26:0/2816033405 >> 172.21.15.26:0/2816033405 conn(0x7fc5cc070e30 msgr2=0x7fc5cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 -- 172.21.15.26:0/2816033405 shutdown_connections 2023-10-09T11:36:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.505+0000 7fc5d0877700 1 -- 172.21.15.26:0/2816033405 wait complete. 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.506+0000 7fc5d0877700 1 Processor -- start 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.506+0000 7fc5d0877700 1 -- start start 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc0cb970 0x7fc5cc154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 0x7fc5cc16cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1556f0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc154860 con 0x7fc5cc15a400 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5d0877700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc154ae0 con 0x7fc5cc0cb970 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54900/0 (socket says 172.21.15.26:54900) 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 -- 172.21.15.26:0/1678891273 learned_addr learned my addr 172.21.15.26:0/1678891273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5c9d9b700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc0cb970 0x7fc5cc154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5cad9d700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 0x7fc5cc16cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 -- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc0cb970 msgr2=0x7fc5cc154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc0cb970 0x7fc5cc154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 -- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 msgr2=0x7fc5cc16cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 0x7fc5cc16cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 -- 172.21.15.26:0/1678891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00094f0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5cad9d700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 0x7fc5cc16cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.507+0000 7fc5ca59c700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c590 tx=0x7fc5bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011590 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0116f0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc154dc0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011ab0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc155380 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.508+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc1559d0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.509+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc5bc01b3b0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.509+0000 7fc5ba7fc700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 0x7fc5ac069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.509+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5bc083b00 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.509+0000 7fc5c9d9b700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 0x7fc5ac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.510+0000 7fc5c9d9b700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 0x7fc5ac069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00099b0 tx=0x7fc5c0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.514+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5bc050d80 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.750+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5cc04c3c0 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.750+0000 7fc5ba7fc700 1 -- 172.21.15.26:0/1678891273 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fc5bc017070 con 0x7fc5cc0cb5a0 2023-10-09T11:36:58.752 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:58.752 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 msgr2=0x7fc5ac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 0x7fc5ac069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00099b0 tx=0x7fc5c0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 msgr2=0x7fc5cc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c590 tx=0x7fc5bc00c950 comp rx=0 tx=0).stop 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 shutdown_connections 2023-10-09T11:36:58.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5cc15a400 0x7fc5cc16cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5cc0cb5a0 0x7fc5cc155b80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc5ac066fc0 0x7fc5ac069470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 --2- 172.21.15.26:0/1678891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5cc0cb970 0x7fc5cc154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 >> 172.21.15.26:0/1678891273 conn(0x7fc5cc070e30 msgr2=0x7fc5cc0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 shutdown_connections 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.752+0000 7fc5d0877700 1 -- 172.21.15.26:0/1678891273 wait complete. 2023-10-09T11:36:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 31 2023-10-09T11:36:58.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:58.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.883+0000 7f21c0cf9700 1 Processor -- start 2023-10-09T11:36:58.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.883+0000 7f21c0cf9700 1 -- start start 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21c0cf9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f21bc0b07d0 0x7f21bc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21c0cf9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f21bc0cf200 0x7f21bc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21c0cf9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc15a280 con 0x7f21bc0b0ba0 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21c0cf9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc06e180 con 0x7f21bc0cf200 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21c0cf9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0cd540 con 0x7f21bc0b07d0 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21b9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f21bc0cf200 0x7f21bc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21bad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f21bc0b0ba0 0x7f21bc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49632/0 (socket says 172.21.15.26:49632) 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21bad9d700 1 -- 172.21.15.26:0/1469228 learned_addr learned my addr 172.21.15.26:0/1469228 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.884+0000 7f21ba59c700 1 --2- 172.21.15.26:0/1469228 >> v2:172.21.15.67:3300/0 conn(0x7f21bc0b07d0 0x7f21bc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b9d9b700 1 -- 172.21.15.26:0/1469228 >> v2:172.21.15.67:3300/0 conn(0x7f21bc0b07d0 msgr2=0x7f21bc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b9d9b700 1 --2- 172.21.15.26:0/1469228 >> v2:172.21.15.67:3300/0 conn(0x7f21bc0b07d0 0x7f21bc0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b9d9b700 1 -- 172.21.15.26:0/1469228 >> v1:172.21.15.26:6789/0 conn(0x7f21bc0b0ba0 legacy=0x7f21bc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b9d9b700 1 -- 172.21.15.26:0/1469228 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc06d850 con 0x7f21bc0cf200 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b9d9b700 1 --2- 172.21.15.26:0/1469228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0cf200 0x7f21bc0cd000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f21bc064720 tx=0x7f21a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20c8481df6f9767 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b959a700 1 -- 172.21.15.26:0/1469228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400b690 con 0x7f21bc0cf200 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b959a700 1 -- 172.21.15.26:0/1469228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400b7f0 con 0x7f21bc0cf200 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21b959a700 1 -- 172.21.15.26:0/1469228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400bb90 con 0x7f21bc0cf200 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1469228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0cf200 msgr2=0x7f21bc0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.885+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1469228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0cf200 0x7f21bc0cd000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f21bc064720 tx=0x7f21a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1469228 shutdown_connections 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1469228 >> v2:172.21.15.67:3300/0 conn(0x7f21bc0b07d0 0x7f21bc0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1469228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0cf200 0x7f21bc0cd000 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1469228 >> 172.21.15.26:0/1469228 conn(0x7f21bc06ce80 msgr2=0x7f21bc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1469228 shutdown_connections 2023-10-09T11:36:58.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.886+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1469228 wait complete. 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 Processor -- start 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 -- start start 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21bc0b0ba0 0x7f21bc158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21bc0cf200 0x7f21bc098380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc09ac60 con 0x7f21bc0b07d0 2023-10-09T11:36:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc16e1e0 con 0x7f21bc0b0ba0 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.887+0000 7f21c0cf9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc09a5a0 con 0x7f21bc0cf200 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54916/0 (socket says 172.21.15.26:54916) 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 -- 172.21.15.26:0/1590668292 learned_addr learned my addr 172.21.15.26:0/1590668292 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21b9d9b700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21bc0b0ba0 0x7f21bc158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21bad9d700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21bc0cf200 0x7f21bc098380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 -- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21bc0cf200 msgr2=0x7f21bc098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21bc0cf200 0x7f21bc098380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 -- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21bc0b0ba0 msgr2=0x7f21bc158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21bc0b0ba0 0x7f21bc158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 -- 172.21.15.26:0/1590668292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009420 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21ba59c700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21b400ec80 tx=0x7f21b4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400c850 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400c9b0 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc09a880 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400cd30 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.888+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0b21d0 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.889+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc09aed0 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.890+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f21b4013680 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.890+0000 7f21b27fc700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 0x7f219c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.890+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21b4084ad0 con 0x7f21bc0b07d0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.890+0000 7f21b9d9b700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 0x7f219c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.891+0000 7f21b9d9b700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 0x7f219c069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21a40091e0 tx=0x7f21a4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:58.894+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b4051d50 con 0x7f21bc0b07d0 2023-10-09T11:36:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.128+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21bc04c3c0 con 0x7f21bc0b07d0 2023-10-09T11:36:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.129+0000 7f21b27fc700 1 -- 172.21.15.26:0/1590668292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f21b4021090 con 0x7f21bc0b07d0 2023-10-09T11:36:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:59.130 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:44.500145+0000","modified":"2023-10-09T11:36:48.146860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3587485118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3587485118},{"type":"v1","addr":"172.21.15.26:6835","nonce":3587485118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:36:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 msgr2=0x7f219c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 0x7f219c069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21a40091e0 tx=0x7f21a4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 msgr2=0x7f21bc0b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21b400ec80 tx=0x7f21b4009120 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 shutdown_connections 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f219c066fc0 0x7f219c069470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21bc0cf200 0x7f21bc098380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21bc0b07d0 0x7f21bc0b1c90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 --2- 172.21.15.26:0/1590668292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21bc0b0ba0 0x7f21bc158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 >> 172.21.15.26:0/1590668292 conn(0x7f21bc06ce80 msgr2=0x7f21bc151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 shutdown_connections 2023-10-09T11:36:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.131+0000 7f21c0cf9700 1 -- 172.21.15.26:0/1590668292 wait complete. 2023-10-09T11:36:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 31 2023-10-09T11:36:59.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.264+0000 7fa988bc9700 1 Processor -- start 2023-10-09T11:36:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.264+0000 7fa988bc9700 1 -- start start 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa988bc9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 0x7fa984159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa988bc9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa98415a400 0x7fa984156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa988bc9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98415ae40 con 0x7fa9840cb5a0 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa988bc9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840ce0f0 con 0x7fa98415a400 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa988bc9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840cbde0 con 0x7fa9840cb970 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa98259c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa9840cb5a0 0x7fa9840cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53166/0 (socket says 172.21.15.26:53166) 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa98259c700 1 -- 172.21.15.26:0/534138781 learned_addr learned my addr 172.21.15.26:0/534138781 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa981d9b700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 0x7fa984159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.265+0000 7fa982d9d700 1 --2- 172.21.15.26:0/534138781 >> v2:172.21.15.67:3300/0 conn(0x7fa98415a400 0x7fa984156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa98159a700 1 -- 172.21.15.26:0/534138781 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116338555 0 0) 0x7fa98415ae40 con 0x7fa9840cb5a0 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa98159a700 1 -- 172.21.15.26:0/534138781 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa970003570 con 0x7fa9840cb5a0 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa982d9d700 1 -- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 msgr2=0x7fa984159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa982d9d700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 0x7fa984159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa982d9d700 1 -- 172.21.15.26:0/534138781 >> v1:172.21.15.67:6789/0 conn(0x7fa9840cb5a0 legacy=0x7fa9840cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa982d9d700 1 -- 172.21.15.26:0/534138781 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98415ab60 con 0x7fa98415a400 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa981d9b700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 0x7fa984159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa982d9d700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa984156e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa974009910 tx=0x7fa9740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a04b9505036292 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa98159a700 1 -- 172.21.15.26:0/534138781 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974011630 con 0x7fa98415a400 2023-10-09T11:36:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa98159a700 1 -- 172.21.15.26:0/534138781 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974011790 con 0x7fa98415a400 2023-10-09T11:36:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.266+0000 7fa98159a700 1 -- 172.21.15.26:0/534138781 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974011b10 con 0x7fa98415a400 2023-10-09T11:36:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 -- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 msgr2=0x7fa984156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa984156e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa974009910 tx=0x7fa9740091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 -- 172.21.15.26:0/534138781 shutdown_connections 2023-10-09T11:36:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa984156e90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 --2- 172.21.15.26:0/534138781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb970 0x7fa984159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 -- 172.21.15.26:0/534138781 >> 172.21.15.26:0/534138781 conn(0x7fa984070e30 msgr2=0x7fa9840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 -- 172.21.15.26:0/534138781 shutdown_connections 2023-10-09T11:36:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.267+0000 7fa988bc9700 1 -- 172.21.15.26:0/534138781 wait complete. 2023-10-09T11:36:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.268+0000 7fa988bc9700 1 Processor -- start 2023-10-09T11:36:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.268+0000 7fa988bc9700 1 -- start start 2023-10-09T11:36:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 0x7fa984168c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa98415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840b5670 con 0x7fa9840cb970 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840b4a60 con 0x7fa98415a400 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa988bc9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840b4d40 con 0x7fa9840cb5a0 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54926/0 (socket says 172.21.15.26:54926) 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 -- 172.21.15.26:0/1914477614 learned_addr learned my addr 172.21.15.26:0/1914477614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa982d9d700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa98415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa98259c700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 0x7fa984168c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 -- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 msgr2=0x7fa984168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 0x7fa984168c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 -- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 msgr2=0x7fa98415b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa98415b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa981d9b700 1 -- 172.21.15.26:0/1914477614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009420 con 0x7fa9840cb970 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.269+0000 7fa98259c700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 0x7fa984168c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa981d9b700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00ec80 tx=0x7fa96c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00c9d0 con 0x7fa9840cb970 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c00cb30 con 0x7fa9840cb970 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00ced0 con 0x7fa9840cb970 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa974009420 con 0x7fa9840cb970 2023-10-09T11:36:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.270+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9840b5300 con 0x7fa9840cb970 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.271+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9840b57e0 con 0x7fa9840cb970 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.271+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa96c013680 con 0x7fa9840cb970 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.272+0000 7fa97a7fc700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 0x7fa964069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.272+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa96c084970 con 0x7fa9840cb970 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.272+0000 7fa98259c700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 0x7fa964069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.272+0000 7fa98259c700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 0x7fa964069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa97c005c50 tx=0x7fa97c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.276+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa96c051bf0 con 0x7fa9840cb970 2023-10-09T11:36:59.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.471+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa98404c3c0 con 0x7fa9840cb970 2023-10-09T11:36:59.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.472+0000 7fa97a7fc700 1 -- 172.21.15.26:0/1914477614 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa96c055210 con 0x7fa9840cb970 2023-10-09T11:36:59.474 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:36:59.474 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:36:46.093692+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:42.908862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:43.467721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 msgr2=0x7fa964069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 0x7fa964069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa97c005c50 tx=0x7fa97c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 msgr2=0x7fa98415b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00ec80 tx=0x7fa96c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 shutdown_connections 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a400 0x7fa98415b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa964066fc0 0x7fa964069470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9840cb5a0 0x7fa984168c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 --2- 172.21.15.26:0/1914477614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9840cb970 0x7fa98415b340 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 >> 172.21.15.26:0/1914477614 conn(0x7fa984070e30 msgr2=0x7fa9840b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 shutdown_connections 2023-10-09T11:36:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.474+0000 7fa988bc9700 1 -- 172.21.15.26:0/1914477614 wait complete. 2023-10-09T11:36:59.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:36:59.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.606+0000 7f33c0569700 1 Processor -- start 2023-10-09T11:36:59.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.606+0000 7f33c0569700 1 -- start start 2023-10-09T11:36:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33c0569700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b80cb5a0 0x7f33b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33c0569700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 0x7f33b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33c0569700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815ae40 con 0x7f33b80cd9e0 2023-10-09T11:36:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33c0569700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80d13f0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33c0569700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b815ab60 con 0x7f33b815a5d0 2023-10-09T11:36:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33be305700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b80cb5a0 0x7f33b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33be305700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b80cb5a0 0x7f33b80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54934/0 (socket says 172.21.15.26:54934) 2023-10-09T11:36:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33be305700 1 -- 172.21.15.26:0/2642431380 learned_addr learned my addr 172.21.15.26:0/2642431380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.607+0000 7f33beb06700 1 --2- 172.21.15.26:0/2642431380 >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 0x7f33b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33be305700 1 -- 172.21.15.26:0/2642431380 >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 msgr2=0x7f33b8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33be305700 1 --2- 172.21.15.26:0/2642431380 >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 0x7f33b8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33be305700 1 -- 172.21.15.26:0/2642431380 >> v1:172.21.15.67:6789/0 conn(0x7f33b80cd9e0 legacy=0x7f33b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33be305700 1 -- 172.21.15.26:0/2642431380 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80ccf00 con 0x7f33b80cb5a0 2023-10-09T11:36:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33beb06700 1 --2- 172.21.15.26:0/2642431380 >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 0x7f33b8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33be305700 1 --2- 172.21.15.26:0/2642431380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b80cb970 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f33b00099b0 tx=0x7f33b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3504c84f45e34f2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33bd303700 1 -- 172.21.15.26:0/2642431380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000b7e0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33bd303700 1 -- 172.21.15.26:0/2642431380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000b940 con 0x7f33b80cb5a0 2023-10-09T11:36:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33bd303700 1 -- 172.21.15.26:0/2642431380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000bce0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 -- 172.21.15.26:0/2642431380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 msgr2=0x7f33b80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 --2- 172.21.15.26:0/2642431380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b80cb970 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f33b00099b0 tx=0x7f33b0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:59.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 -- 172.21.15.26:0/2642431380 shutdown_connections 2023-10-09T11:36:59.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 --2- 172.21.15.26:0/2642431380 >> v2:172.21.15.67:3300/0 conn(0x7f33b815a5d0 0x7f33b8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 --2- 172.21.15.26:0/2642431380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b80cb970 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 -- 172.21.15.26:0/2642431380 >> 172.21.15.26:0/2642431380 conn(0x7f33b8070e30 msgr2=0x7f33b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.608+0000 7f33c0569700 1 -- 172.21.15.26:0/2642431380 shutdown_connections 2023-10-09T11:36:59.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.609+0000 7f33c0569700 1 -- 172.21.15.26:0/2642431380 wait complete. 2023-10-09T11:36:59.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 Processor -- start 2023-10-09T11:36:59.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 -- start start 2023-10-09T11:36:59.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 0x7f33b8159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33b815a5d0 0x7f33b8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8142000 con 0x7f33b80cb5a0 2023-10-09T11:36:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8159ca0 con 0x7f33b815a5d0 2023-10-09T11:36:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33c0569700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80b3a70 con 0x7f33b80cd9e0 2023-10-09T11:36:59.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33be305700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33be305700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54946/0 (socket says 172.21.15.26:54946) 2023-10-09T11:36:59.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.610+0000 7f33be305700 1 -- 172.21.15.26:0/3762296091 learned_addr learned my addr 172.21.15.26:0/3762296091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:36:59.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33beb06700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33b815a5d0 0x7f33b8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33bdb04700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 0x7f33b8159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 -- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 msgr2=0x7f33b8159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 0x7f33b8159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 -- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33b815a5d0 msgr2=0x7f33b8156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33b815a5d0 0x7f33b8156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 -- 172.21.15.26:0/3762296091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b00094f0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33bdb04700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 0x7f33b8159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33be305700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f33b00030c0 tx=0x7f33b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0026480 con 0x7f33b80cb5a0 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b001f070 con 0x7f33b80cb5a0 2023-10-09T11:36:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b80b3d50 con 0x7f33b80cb5a0 2023-10-09T11:36:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0026870 con 0x7f33b80cb5a0 2023-10-09T11:36:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.611+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b80b4310 con 0x7f33b80cb5a0 2023-10-09T11:36:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.612+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b804c3c0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.612+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f33b001a440 con 0x7f33b80cb5a0 2023-10-09T11:36:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.613+0000 7f33b67fc700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 0x7f33a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.613+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33b0021070 con 0x7f33b80cb5a0 2023-10-09T11:36:59.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.613+0000 7f33bdb04700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 0x7f33a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.614+0000 7f33bdb04700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 0x7f33a4069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007fd0 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.617+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33b0053910 con 0x7f33b80cb5a0 2023-10-09T11:36:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.856+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f33b80cd1e0 con 0x7f33b80cb5a0 2023-10-09T11:36:59.858 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:36:59.857+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:36:59.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.860+0000 7f33b67fc700 1 -- 172.21.15.26:0/3762296091 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f33b0056f30 con 0x7f33b80cb5a0 2023-10-09T11:36:59.863 INFO:tasks.ceph.mds.c.smithi026.stderr: -1764> 2023-10-09T11:36:50.422+0000 7f011faa7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 msgr2=0x7f33a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 0x7f33a4069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007fd0 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2023-10-09T11:36:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 msgr2=0x7f33b8141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f33b00030c0 tx=0x7f33b0016000 comp rx=0 tx=0).stop 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 shutdown_connections 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33b815a5d0 0x7f33b8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b80cb5a0 0x7f33b8141ac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f33a4066fc0 0x7f33a4069470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 --2- 172.21.15.26:0/3762296091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33b80cd9e0 0x7f33b8159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 >> 172.21.15.26:0/3762296091 conn(0x7f33b8070e30 msgr2=0x7f33b8155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 shutdown_connections 2023-10-09T11:36:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.863+0000 7f33c0569700 1 -- 172.21.15.26:0/3762296091 wait complete. 2023-10-09T11:36:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:36:59.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:36:59.885 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:36:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.997+0000 7f2a868af700 1 Processor -- start 2023-10-09T11:36:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.997+0000 7f2a868af700 1 -- start start 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a8015dfd0 0x7f2a800aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a80159920 0x7f2a800ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800acc00 con 0x7f2a8015dfd0 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800abff0 con 0x7f2a80159920 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a868af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ac2d0 con 0x7f2a80159550 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a8015dfd0 0x7f2a800aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a8015dfd0 0x7f2a800aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50432/0 (socket says 172.21.15.26:50432) 2023-10-09T11:37:00.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 -- 172.21.15.26:0/4180267904 learned_addr learned my addr 172.21.15.26:0/4180267904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a860ae700 1 --2- 172.21.15.26:0/4180267904 >> v2:172.21.15.67:3300/0 conn(0x7f2a80159920 0x7f2a800ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a858ad700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 -- 172.21.15.26:0/4180267904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 msgr2=0x7f2a800ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 -- 172.21.15.26:0/4180267904 >> v2:172.21.15.67:3300/0 conn(0x7f2a80159920 msgr2=0x7f2a800ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 --2- 172.21.15.26:0/4180267904 >> v2:172.21.15.67:3300/0 conn(0x7f2a80159920 0x7f2a800ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a850ac700 1 -- 172.21.15.26:0/4180267904 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800ac5b0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.998+0000 7f2a858ad700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a850ac700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800aedb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006c180 tx=0x7f2a74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4398038c545cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a848ab700 1 -- 172.21.15.26:0/4180267904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74009e70 con 0x7f2a8015dfd0 2023-10-09T11:37:00.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a848ab700 1 -- 172.21.15.26:0/4180267904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400b860 con 0x7f2a8015dfd0 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a848ab700 1 -- 172.21.15.26:0/4180267904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400bc00 con 0x7f2a8015dfd0 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 -- 172.21.15.26:0/4180267904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 msgr2=0x7f2a800aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800aedb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006c180 tx=0x7f2a74009250 comp rx=0 tx=0).stop 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 -- 172.21.15.26:0/4180267904 shutdown_connections 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 --2- 172.21.15.26:0/4180267904 >> v2:172.21.15.67:3300/0 conn(0x7f2a80159920 0x7f2a800ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 --2- 172.21.15.26:0/4180267904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800aedb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 -- 172.21.15.26:0/4180267904 >> 172.21.15.26:0/4180267904 conn(0x7f2a8006ce80 msgr2=0x7f2a800ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 -- 172.21.15.26:0/4180267904 shutdown_connections 2023-10-09T11:37:00.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:36:59.999+0000 7f2a868af700 1 -- 172.21.15.26:0/4180267904 wait complete. 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.000+0000 7f2a868af700 1 Processor -- start 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.000+0000 7f2a868af700 1 -- start start 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a80159920 0x7f2a800c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c84e0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c78d0 con 0x7f2a80159920 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a868af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c7bb0 con 0x7f2a80159550 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50438/0 (socket says 172.21.15.26:50438) 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 -- 172.21.15.26:0/326026007 learned_addr learned my addr 172.21.15.26:0/326026007 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 -- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 msgr2=0x7f2a800cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 -- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a80159920 msgr2=0x7f2a800c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.001+0000 7f2a860ae700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a80159920 0x7f2a800c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a860ae700 1 -- 172.21.15.26:0/326026007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a740094f0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a860ae700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800ea50 tx=0x7f2a780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800c920 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7800caa0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a800c7e90 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800ce60 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.002+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800cdc10 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.003+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8004c3c0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.003+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2a78013680 con 0x7f2a8015dfd0 2023-10-09T11:37:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.004+0000 7f2a7dffb700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.004+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2a78084990 con 0x7f2a8015dfd0 2023-10-09T11:37:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.004+0000 7f2a858ad700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.005+0000 7f2a858ad700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a700094d0 tx=0x7f2a700096b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.008+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a78051bc0 con 0x7f2a8015dfd0 2023-10-09T11:37:00.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.249+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a800c8620 con 0x7f2a8015dfd0 2023-10-09T11:37:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.861+0000 7f2a7dffb700 1 -- 172.21.15.26:0/326026007 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a800c8620 con 0x7f2a8015dfd0 2023-10-09T11:37:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 msgr2=0x7f2a6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a700094d0 tx=0x7f2a700096b0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 msgr2=0x7f2a800af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800ea50 tx=0x7f2a780091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 shutdown_connections 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a8015dfd0 0x7f2a800af350 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.864+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.865+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a80159550 0x7f2a800cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.865+0000 7f2a868af700 1 --2- 172.21.15.26:0/326026007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a80159920 0x7f2a800c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.865+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 >> 172.21.15.26:0/326026007 conn(0x7f2a8006ce80 msgr2=0x7f2a800b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.865+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 shutdown_connections 2023-10-09T11:37:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:00.865+0000 7f2a868af700 1 -- 172.21.15.26:0/326026007 wait complete. 2023-10-09T11:37:00.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:37:01.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.052+0000 7fc1ce41e700 1 Processor -- start 2023-10-09T11:37:01.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.052+0000 7fc1ce41e700 1 -- start start 2023-10-09T11:37:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1ce41e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1c8067e50 0x7fc1c815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1ce41e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc1c80c8c70 0x7fc1c80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1ce41e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c815d9f0 con 0x7fc1c8068220 2023-10-09T11:37:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1ce41e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c815d3c0 con 0x7fc1c8067e50 2023-10-09T11:37:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1ce41e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c815a8f0 con 0x7fc1c80c8c70 2023-10-09T11:37:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1c8067e50 0x7fc1c815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc1c8068220 0x7fc1c8159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46106/0 (socket says 172.21.15.26:46106) 2023-10-09T11:37:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1c8067e50 0x7fc1c815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50452/0 (socket says 172.21.15.26:50452) 2023-10-09T11:37:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c77fe700 1 -- 172.21.15.26:0/3656230347 learned_addr learned my addr 172.21.15.26:0/3656230347 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1cc9bb700 1 --2- 172.21.15.26:0/3656230347 >> v2:172.21.15.67:3300/0 conn(0x7fc1c80c8c70 0x7fc1c80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 -- 172.21.15.26:0/3656230347 >> v2:172.21.15.67:3300/0 conn(0x7fc1c80c8c70 msgr2=0x7fc1c80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 --2- 172.21.15.26:0/3656230347 >> v2:172.21.15.67:3300/0 conn(0x7fc1c80c8c70 0x7fc1c80c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 -- 172.21.15.26:0/3656230347 >> v1:172.21.15.26:6789/0 conn(0x7fc1c8068220 legacy=0x7fc1c8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 -- 172.21.15.26:0/3656230347 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c815abd0 con 0x7fc1c8067e50 2023-10-09T11:37:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c6ffd700 1 -- 172.21.15.26:0/3656230347 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185294663 0 0) 0x7fc1c815d9f0 con 0x7fc1c8068220 2023-10-09T11:37:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.053+0000 7fc1c7fff700 1 --2- 172.21.15.26:0/3656230347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c815de80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80c1da0 tx=0x7fc1bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be99402b843c728 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1c6ffd700 1 -- 172.21.15.26:0/3656230347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc011630 con 0x7fc1c8067e50 2023-10-09T11:37:01.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1c6ffd700 1 -- 172.21.15.26:0/3656230347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc011790 con 0x7fc1c8067e50 2023-10-09T11:37:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1c6ffd700 1 -- 172.21.15.26:0/3656230347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc011b30 con 0x7fc1c8067e50 2023-10-09T11:37:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 -- 172.21.15.26:0/3656230347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 msgr2=0x7fc1c815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/3656230347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c815de80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80c1da0 tx=0x7fc1bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 -- 172.21.15.26:0/3656230347 shutdown_connections 2023-10-09T11:37:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/3656230347 >> v2:172.21.15.67:3300/0 conn(0x7fc1c80c8c70 0x7fc1c80c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/3656230347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c815de80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 -- 172.21.15.26:0/3656230347 >> 172.21.15.26:0/3656230347 conn(0x7fc1c80ce4a0 msgr2=0x7fc1c80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 -- 172.21.15.26:0/3656230347 shutdown_connections 2023-10-09T11:37:01.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.054+0000 7fc1ce41e700 1 -- 172.21.15.26:0/3656230347 wait complete. 2023-10-09T11:37:01.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.055+0000 7fc1ce41e700 1 Processor -- start 2023-10-09T11:37:01.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.055+0000 7fc1ce41e700 1 -- start start 2023-10-09T11:37:01.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c8068220 0x7fc1c8155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 0x7fc1c80c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80c5b60 con 0x7fc1c8067e50 2023-10-09T11:37:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8156090 con 0x7fc1c80c8c70 2023-10-09T11:37:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1ce41e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80c5550 con 0x7fc1c8068220 2023-10-09T11:37:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50468/0 (socket says 172.21.15.26:50468) 2023-10-09T11:37:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1c7fff700 1 -- 172.21.15.26:0/2839442158 learned_addr learned my addr 172.21.15.26:0/2839442158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1c77fe700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c8068220 0x7fc1c8155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.056+0000 7fc1cc9bb700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 0x7fc1c80c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 -- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c8068220 msgr2=0x7fc1c8155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c8068220 0x7fc1c8155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 -- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 msgr2=0x7fc1c80c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 0x7fc1c80c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 -- 172.21.15.26:0/2839442158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009420 con 0x7fc1c8067e50 2023-10-09T11:37:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1cc9bb700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 0x7fc1c80c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1c7fff700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8067b90 tx=0x7fc1bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc011b10 con 0x7fc1c8067e50 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0253f0 con 0x7fc1c8067e50 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc025790 con 0x7fc1c8067e50 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c80c4e90 con 0x7fc1c8067e50 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.057+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c80c5170 con 0x7fc1c8067e50 2023-10-09T11:37:01.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.058+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c804c3c0 con 0x7fc1c8067e50 2023-10-09T11:37:01.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.058+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc1bc025b80 con 0x7fc1c8067e50 2023-10-09T11:37:01.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.059+0000 7fc1affff700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 0x7fc1b4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.059+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc1bc085e50 con 0x7fc1c8067e50 2023-10-09T11:37:01.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.059+0000 7fc1c77fe700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 0x7fc1b4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.059+0000 7fc1c77fe700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 0x7fc1b4069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1c815cab0 tx=0x7fc1b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.063+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1bc053080 con 0x7fc1c8067e50 2023-10-09T11:37:01.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:01.258+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1c815d680 con 0x7fc1c8067e50 2023-10-09T11:37:02.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.204+0000 7fc1affff700 1 -- 172.21.15.26:0/2839442158 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc1bc0150d0 con 0x7fc1c8067e50 2023-10-09T11:37:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.208+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 msgr2=0x7fc1b4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.208+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 0x7fc1b4069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1c815cab0 tx=0x7fc1b8009040 comp rx=0 tx=0).stop 2023-10-09T11:37:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.208+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 msgr2=0x7fc1c80c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.208+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8067b90 tx=0x7fc1bc017000 comp rx=0 tx=0).stop 2023-10-09T11:37:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 shutdown_connections 2023-10-09T11:37:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c80c8c70 0x7fc1c80c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1c8067e50 0x7fc1c80c84d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1b4066fc0 0x7fc1b4069470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 --2- 172.21.15.26:0/2839442158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1c8068220 0x7fc1c8155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 >> 172.21.15.26:0/2839442158 conn(0x7fc1c80ce4a0 msgr2=0x7fc1c8157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 shutdown_connections 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.209+0000 7fc1ce41e700 1 -- 172.21.15.26:0/2839442158 wait complete. 2023-10-09T11:37:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:37:02.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:37:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.353+0000 7f7bc7f22700 1 Processor -- start 2023-10-09T11:37:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.354+0000 7f7bc7f22700 1 -- start start 2023-10-09T11:37:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc7f22700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 0x7f7bc00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc7f22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bc006e700 0x7f7bc00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc7f22700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc006a550 con 0x7f7bc006e330 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc7f22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c75f0 con 0x7f7bc006e700 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc7f22700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c78d0 con 0x7f7bc0156fa0 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bc006e700 0x7f7bc00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc5cbe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7bc006e330 0x7f7bc00c6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46116/0 (socket says 172.21.15.26:46116) 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc5cbe700 1 -- 172.21.15.26:0/184689150 learned_addr learned my addr 172.21.15.26:0/184689150 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc54bd700 1 --2- 172.21.15.26:0/184689150 >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 0x7f7bc00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 -- 172.21.15.26:0/184689150 >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 msgr2=0x7f7bc00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 --2- 172.21.15.26:0/184689150 >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 0x7f7bc00cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 -- 172.21.15.26:0/184689150 >> v1:172.21.15.26:6789/0 conn(0x7f7bc006e330 legacy=0x7f7bc00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 -- 172.21.15.26:0/184689150 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00c7bb0 con 0x7f7bc006e700 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc4cbc700 1 -- 172.21.15.26:0/184689150 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507501143 0 0) 0x7f7bc006a550 con 0x7f7bc006e330 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc54bd700 1 --2- 172.21.15.26:0/184689150 >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 0x7f7bc00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc64bf700 1 --2- 172.21.15.26:0/184689150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc006e700 0x7f7bc00cb8b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006f880 tx=0x7f7bb800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf13b5365193bba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc4cbc700 1 -- 172.21.15.26:0/184689150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800db70 con 0x7f7bc006e700 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc4cbc700 1 -- 172.21.15.26:0/184689150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800dcd0 con 0x7f7bc006e700 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.355+0000 7f7bc4cbc700 1 -- 172.21.15.26:0/184689150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80196b0 con 0x7f7bc006e700 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 -- 172.21.15.26:0/184689150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc006e700 msgr2=0x7f7bc00cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/184689150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc006e700 0x7f7bc00cb8b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7bc006f880 tx=0x7f7bb800b430 comp rx=0 tx=0).stop 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 -- 172.21.15.26:0/184689150 shutdown_connections 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/184689150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc006e700 0x7f7bc00cb8b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/184689150 >> v2:172.21.15.67:3300/0 conn(0x7f7bc0156fa0 0x7f7bc00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 -- 172.21.15.26:0/184689150 >> 172.21.15.26:0/184689150 conn(0x7f7bc006d170 msgr2=0x7f7bc00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 -- 172.21.15.26:0/184689150 shutdown_connections 2023-10-09T11:37:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.356+0000 7f7bc7f22700 1 -- 172.21.15.26:0/184689150 wait complete. 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.357+0000 7f7bc7f22700 1 Processor -- start 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.357+0000 7f7bc7f22700 1 -- start start 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 0x7f7bc014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc006e700 0x7f7bc00c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc014b5c0 con 0x7f7bc0156fa0 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00af880 con 0x7f7bc006e330 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc7f22700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c6c20 con 0x7f7bc006e700 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50476/0 (socket says 172.21.15.26:50476) 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 -- 172.21.15.26:0/2438733122 learned_addr learned my addr 172.21.15.26:0/2438733122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc5cbe700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 0x7f7bc014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 -- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc006e700 msgr2=0x7f7bc00c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc006e700 0x7f7bc00c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 -- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 msgr2=0x7f7bc014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 0x7f7bc014b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 -- 172.21.15.26:0/2438733122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb800b6d0 con 0x7f7bc0156fa0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc5cbe700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 0x7f7bc014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.358+0000 7f7bc64bf700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b6a0 tx=0x7f7bb801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.359+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8019e20 con 0x7f7bc0156fa0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.359+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800de40 con 0x7f7bc0156fa0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.359+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8023400 con 0x7f7bc0156fa0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.359+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00af230 con 0x7f7bc0156fa0 2023-10-09T11:37:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.359+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc00c6860 con 0x7f7bc0156fa0 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.360+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00af090 con 0x7f7bc0156fa0 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.360+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7bb8023770 con 0x7f7bc0156fa0 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.360+0000 7f7bbdffb700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 0x7f7bac069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.361+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f7bb8014070 con 0x7f7bc0156fa0 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.361+0000 7f7bc5cbe700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 0x7f7bac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.361+0000 7f7bc5cbe700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 0x7f7bac069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0001560 tx=0x7f7bb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.365+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bc00af090 con 0x7f7bc0156fa0 2023-10-09T11:37:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:02.561+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7bc00af090 con 0x7f7bc0156fa0 2023-10-09T11:37:03.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.210+0000 7f7bbdffb700 1 -- 172.21.15.26:0/2438733122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7bc00af090 con 0x7f7bc0156fa0 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.213+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 msgr2=0x7f7bac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.213+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 0x7f7bac069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0001560 tx=0x7f7bb0009040 comp rx=0 tx=0).stop 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 msgr2=0x7f7bc00c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b6a0 tx=0x7f7bb801b000 comp rx=0 tx=0).stop 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 shutdown_connections 2023-10-09T11:37:03.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc0156fa0 0x7f7bc00c1070 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc006e330 0x7f7bc014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bac066fc0 0x7f7bac069470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 --2- 172.21.15.26:0/2438733122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc006e700 0x7f7bc00c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 >> 172.21.15.26:0/2438733122 conn(0x7f7bc006d170 msgr2=0x7f7bc00cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 shutdown_connections 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.214+0000 7f7bc7f22700 1 -- 172.21.15.26:0/2438733122 wait complete. 2023-10-09T11:37:03.216 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:37:03.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:37:03.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.353+0000 7f647aa60700 1 Processor -- start 2023-10-09T11:37:03.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.353+0000 7f647aa60700 1 -- start start 2023-10-09T11:37:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647aa60700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6474142fd0 0x7f64740c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647aa60700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64740c7dc0 0x7f647406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647aa60700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64740ca480 con 0x7f6474142c00 2023-10-09T11:37:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647aa60700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740c8220 con 0x7f6474142fd0 2023-10-09T11:37:03.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647aa60700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647415e240 con 0x7f64740c7dc0 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6474142fd0 0x7f64740c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6474142fd0 0x7f64740c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50490/0 (socket says 172.21.15.26:50490) 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 -- 172.21.15.26:0/3691618956 learned_addr learned my addr 172.21.15.26:0/3691618956 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647a25f700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64740c7dc0 0x7f647406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 -- 172.21.15.26:0/3691618956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64740c7dc0 msgr2=0x7f647406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64740c7dc0 0x7f647406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 -- 172.21.15.26:0/3691618956 >> v1:172.21.15.67:6789/0 conn(0x7f6474142c00 legacy=0x7f647406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.354+0000 7f647925d700 1 -- 172.21.15.26:0/3691618956 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647406b350 con 0x7f6474142fd0 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647925d700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142fd0 0x7f64740c7880 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f64680099b0 tx=0x7f6468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b7e83f370363e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f6478a5c700 1 -- 172.21.15.26:0/3691618956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800b820 con 0x7f6474142fd0 2023-10-09T11:37:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f6478a5c700 1 -- 172.21.15.26:0/3691618956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800b980 con 0x7f6474142fd0 2023-10-09T11:37:03.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f6478a5c700 1 -- 172.21.15.26:0/3691618956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800bd20 con 0x7f6474142fd0 2023-10-09T11:37:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 -- 172.21.15.26:0/3691618956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142fd0 msgr2=0x7f64740c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142fd0 0x7f64740c7880 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f64680099b0 tx=0x7f6468009250 comp rx=0 tx=0).stop 2023-10-09T11:37:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 -- 172.21.15.26:0/3691618956 shutdown_connections 2023-10-09T11:37:03.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64740c7dc0 0x7f647406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 --2- 172.21.15.26:0/3691618956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142fd0 0x7f64740c7880 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 -- 172.21.15.26:0/3691618956 >> 172.21.15.26:0/3691618956 conn(0x7f64740675a0 msgr2=0x7f64740679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 -- 172.21.15.26:0/3691618956 shutdown_connections 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.355+0000 7f647aa60700 1 -- 172.21.15.26:0/3691618956 wait complete. 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.356+0000 7f647aa60700 1 Processor -- start 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 -- start start 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740c7dc0 0x7f647415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6474142fd0 0x7f64740c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740c61b0 con 0x7f6474142c00 2023-10-09T11:37:03.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740c55a0 con 0x7f64740c7dc0 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647aa60700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64740c5880 con 0x7f6474142fd0 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647925d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647925d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50504/0 (socket says 172.21.15.26:50504) 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647925d700 1 -- 172.21.15.26:0/2868162754 learned_addr learned my addr 172.21.15.26:0/2868162754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f6479a5e700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740c7dc0 0x7f647415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.357+0000 7f647a25f700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6474142fd0 0x7f64740c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 -- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6474142fd0 msgr2=0x7f64740c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6474142fd0 0x7f64740c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 -- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740c7dc0 msgr2=0x7f647415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740c7dc0 0x7f647415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 -- 172.21.15.26:0/2868162754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680094f0 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647925d700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6468009290 tx=0x7f6468016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468011e40 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646801c480 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646801c820 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64740c5b60 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.358+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6474169870 con 0x7f6474142c00 2023-10-09T11:37:03.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.359+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647404c3c0 con 0x7f6474142c00 2023-10-09T11:37:03.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.360+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f646801cc50 con 0x7f6474142c00 2023-10-09T11:37:03.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.360+0000 7f6471ffb700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 0x7f6460069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.360+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6468086220 con 0x7f6474142c00 2023-10-09T11:37:03.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.360+0000 7f6479a5e700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 0x7f6460069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.361+0000 7f6479a5e700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 0x7f6460069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6464007fd0 tx=0x7f64640026a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.364+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64680537a0 con 0x7f6474142c00 2023-10-09T11:37:03.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.556+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f647415df60 con 0x7f6474142c00 2023-10-09T11:37:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.560+0000 7f6471ffb700 1 -- 172.21.15.26:0/2868162754 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6468056dc0 con 0x7f6474142c00 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 msgr2=0x7f6460069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 0x7f6460069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6464007fd0 tx=0x7f64640026a0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 msgr2=0x7f64741590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6468009290 tx=0x7f6468016000 comp rx=0 tx=0).stop 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 shutdown_connections 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6460066fc0 0x7f6460069470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6474142fd0 0x7f64740c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740c7dc0 0x7f647415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 --2- 172.21.15.26:0/2868162754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6474142c00 0x7f64741590f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 >> 172.21.15.26:0/2868162754 conn(0x7f64740675a0 msgr2=0x7f64740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:03.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 shutdown_connections 2023-10-09T11:37:03.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.562+0000 7f647aa60700 1 -- 172.21.15.26:0/2868162754 wait complete. 2023-10-09T11:37:03.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-09T11:37:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.693+0000 7fe65e46f700 1 Processor -- start 2023-10-09T11:37:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.693+0000 7fe65e46f700 1 -- start start 2023-10-09T11:37:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe65815de50 0x7fe6580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 0x7fe65806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65815afd0 con 0x7fe65815de50 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65815b2b0 con 0x7fe6580cef40 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65e46f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65815b590 con 0x7fe658153c30 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65cc6c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe65815de50 0x7fe6580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65cc6c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe65815de50 0x7fe6580cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50514/0 (socket says 172.21.15.26:50514) 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.694+0000 7fe65cc6c700 1 -- 172.21.15.26:0/686878197 learned_addr learned my addr 172.21.15.26:0/686878197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65d46d700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65dc6e700 1 --2- 172.21.15.26:0/686878197 >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 0x7fe65806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 -- 172.21.15.26:0/686878197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 msgr2=0x7fe65815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 -- 172.21.15.26:0/686878197 >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 msgr2=0x7fe65806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 --2- 172.21.15.26:0/686878197 >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 0x7fe65806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 -- 172.21.15.26:0/686878197 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65815b870 con 0x7fe65815de50 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65d46d700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65dc6e700 1 --2- 172.21.15.26:0/686878197 >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 0x7fe65806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65cc6c700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65815de50 0x7fe6580cea00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe658071370 tx=0x7fe64c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d2c8a9cba07b5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe657fff700 1 -- 172.21.15.26:0/686878197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00b860 con 0x7fe65815de50 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe657fff700 1 -- 172.21.15.26:0/686878197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00b9c0 con 0x7fe65815de50 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe657fff700 1 -- 172.21.15.26:0/686878197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00bd60 con 0x7fe65815de50 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65e46f700 1 -- 172.21.15.26:0/686878197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65815de50 msgr2=0x7fe6580cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.695+0000 7fe65e46f700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65815de50 0x7fe6580cea00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe658071370 tx=0x7fe64c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 -- 172.21.15.26:0/686878197 shutdown_connections 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 --2- 172.21.15.26:0/686878197 >> v2:172.21.15.67:3300/0 conn(0x7fe6580cef40 0x7fe65806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 --2- 172.21.15.26:0/686878197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65815de50 0x7fe6580cea00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 -- 172.21.15.26:0/686878197 >> 172.21.15.26:0/686878197 conn(0x7fe6580703a0 msgr2=0x7fe6580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 -- 172.21.15.26:0/686878197 shutdown_connections 2023-10-09T11:37:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.696+0000 7fe65e46f700 1 -- 172.21.15.26:0/686878197 wait complete. 2023-10-09T11:37:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.697+0000 7fe65e46f700 1 Processor -- start 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.697+0000 7fe65e46f700 1 -- start start 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 0x7fe6580cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658151d00 con 0x7fe658152190 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65816ad90 con 0x7fe6580cef40 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581510f0 con 0x7fe658153c30 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50518/0 (socket says 172.21.15.26:50518) 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 -- 172.21.15.26:0/1711276645 learned_addr learned my addr 172.21.15.26:0/1711276645 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65cc6c700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65d46d700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 0x7fe6580cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 -- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 msgr2=0x7fe65814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65814ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 -- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 msgr2=0x7fe6580cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 0x7fe6580cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 -- 172.21.15.26:0/1711276645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0094f0 con 0x7fe658152190 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65d46d700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 0x7fe6580cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65dc6e700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c880 tx=0x7fe650008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650011600 con 0x7fe658152190 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650011780 con 0x7fe658152190 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6581513d0 con 0x7fe658152190 2023-10-09T11:37:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650011b40 con 0x7fe658152190 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.698+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe658151990 con 0x7fe658152190 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.699+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe658151e70 con 0x7fe658152190 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.700+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe650018350 con 0x7fe658152190 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.700+0000 7fe6557fa700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 0x7fe644069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.700+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe6500842d0 con 0x7fe658152190 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.700+0000 7fe65d46d700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 0x7fe644069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.701+0000 7fe65d46d700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 0x7fe644069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe64800d4a0 tx=0x7fe6480075d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.704+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6500551d0 con 0x7fe658152190 2023-10-09T11:37:03.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:03.974+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7fe65804c3c0 con 0x7fe658152190 2023-10-09T11:37:04.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.209+0000 7fe6557fa700 1 -- 172.21.15.26:0/1711276645 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v119) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe650054d60 con 0x7fe658152190 2023-10-09T11:37:04.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.211+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 msgr2=0x7fe644069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.211+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 0x7fe644069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe64800d4a0 tx=0x7fe6480075d0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.211+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 msgr2=0x7fe6580c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.211+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c880 tx=0x7fe650008040 comp rx=0 tx=0).stop 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 shutdown_connections 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe658152190 0x7fe6580c8b60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6580cef40 0x7fe6580cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe644066fc0 0x7fe644069470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 --2- 172.21.15.26:0/1711276645 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe658153c30 0x7fe65814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 >> 172.21.15.26:0/1711276645 conn(0x7fe6580703a0 msgr2=0x7fe65815c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 shutdown_connections 2023-10-09T11:37:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.212+0000 7fe65e46f700 1 -- 172.21.15.26:0/1711276645 wait complete. 2023-10-09T11:37:04.225 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-09T11:37:04.226 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-09T11:37:04.226 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:37:04.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-09T11:37:04.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.346+0000 7ff5b7fd5700 1 Processor -- start 2023-10-09T11:37:04.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.346+0000 7ff5b7fd5700 1 -- start start 2023-10-09T11:37:04.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b7fd5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5b00cb970 0x7ff5b0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b7fd5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b7fd5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b015ae40 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b7fd5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00ce0f0 con 0x7ff5b00cb970 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b7fd5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00d13f0 con 0x7ff5b015a400 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5b00cb970 0x7ff5b0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b6572700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5b00cb970 0x7ff5b0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:41600/0 (socket says 172.21.15.26:41600) 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 -- 172.21.15.26:0/3781034002 learned_addr learned my addr 172.21.15.26:0/3781034002 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b6572700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57264/0 (socket says 172.21.15.26:57264) 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 -- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 msgr2=0x7ff5b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 -- 172.21.15.26:0/3781034002 >> v1:172.21.15.67:6789/0 conn(0x7ff5b00cb5a0 legacy=0x7ff5b00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b5570700 1 -- 172.21.15.26:0/3781034002 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b015ab60 con 0x7ff5b00cb970 2023-10-09T11:37:04.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.347+0000 7ff5b6572700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:04.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b5570700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b0159ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00099b0 tx=0x7ff5a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a534ba0bbc8a2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b4d6f700 1 -- 172.21.15.26:0/3781034002 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0009ea0 con 0x7ff5b00cb970 2023-10-09T11:37:04.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b4d6f700 1 -- 172.21.15.26:0/3781034002 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000b860 con 0x7ff5b00cb970 2023-10-09T11:37:04.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b4d6f700 1 -- 172.21.15.26:0/3781034002 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000bc00 con 0x7ff5b00cb970 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 msgr2=0x7ff5b0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b0159ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00099b0 tx=0x7ff5a0009250 comp rx=0 tx=0).stop 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/3781034002 shutdown_connections 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/3781034002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b0159ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.348+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/3781034002 >> 172.21.15.26:0/3781034002 conn(0x7ff5b0070e30 msgr2=0x7ff5b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:04.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.349+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/3781034002 shutdown_connections 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.349+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/3781034002 wait complete. 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 Processor -- start 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 -- start start 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b016a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b016a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b016b0f0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00ca620 con 0x7ff5b00cb970 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b7fd5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b016ab30 con 0x7ff5b015a400 2023-10-09T11:37:04.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.350+0000 7ff5b5d71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50520/0 (socket says 172.21.15.26:50520) 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 -- 172.21.15.26:0/2195477015 learned_addr learned my addr 172.21.15.26:0/2195477015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5570700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b016a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b6572700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b016a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 -- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 msgr2=0x7ff5b016a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b016a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 -- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 msgr2=0x7ff5b016a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b016a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 -- 172.21.15.26:0/2195477015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009a20 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5570700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b016a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b5d71700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c5c0 tx=0x7ff5ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac011590 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac011710 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac011ad0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00094f0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.351+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b016b730 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.352+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b004c3c0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.353+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff5ac01b3b0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.353+0000 7ff5a5ffb700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 0x7ff594069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.353+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff5ac0836c0 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.353+0000 7ff5b5570700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 0x7ff594069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.354+0000 7ff5b5570700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 0x7ff594069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00099b0 tx=0x7ff5a0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.357+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5ac050d00 con 0x7ff5b00cb5a0 2023-10-09T11:37:04.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:04.636+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7ff5b01540b0 con 0x7ff5b00cb5a0 2023-10-09T11:37:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.213+0000 7ff5a5ffb700 1 -- 172.21.15.26:0/2195477015 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v120) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff5ac017020 con 0x7ff5b00cb5a0 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 msgr2=0x7ff594069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 0x7ff594069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00099b0 tx=0x7ff5a0017000 comp rx=0 tx=0).stop 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 msgr2=0x7ff5b00ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c5c0 tx=0x7ff5ac00c8d0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 shutdown_connections 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff594066fc0 0x7ff594069470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5b015a400 0x7ff5b016a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b00cb5a0 0x7ff5b00ca0e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 --2- 172.21.15.26:0/2195477015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b00cb970 0x7ff5b016a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 >> 172.21.15.26:0/2195477015 conn(0x7ff5b0070e30 msgr2=0x7ff5b00b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 shutdown_connections 2023-10-09T11:37:05.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.216+0000 7ff5b7fd5700 1 -- 172.21.15.26:0/2195477015 wait complete. 2023-10-09T11:37:05.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:37:05.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.357+0000 7f88134f9700 1 Processor -- start 2023-10-09T11:37:05.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.357+0000 7f88134f9700 1 -- start start 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f88134f9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 0x7f880c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f88134f9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f880c0c8bd0 0x7f880c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f88134f9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c0adbc0 con 0x7f880c0b0f80 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f88134f9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0b13d0 con 0x7f880c0c8bd0 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f88134f9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0c9d30 con 0x7f880c0c8800 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f880c0c8bd0 0x7f880c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8811a96700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f880c0b0f80 0x7f880c0ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46122/0 (socket says 172.21.15.26:46122) 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f880c0c8bd0 0x7f880c0b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50530/0 (socket says 172.21.15.26:50530) 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8811a96700 1 -- 172.21.15.26:0/3894278549 learned_addr learned my addr 172.21.15.26:0/3894278549 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:05.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8811295700 1 --2- 172.21.15.26:0/3894278549 >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 0x7f880c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 -- 172.21.15.26:0/3894278549 >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 msgr2=0x7f880c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 --2- 172.21.15.26:0/3894278549 >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 0x7f880c0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 -- 172.21.15.26:0/3894278549 >> v1:172.21.15.26:6789/0 conn(0x7f880c0b0f80 legacy=0x7f880c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 -- 172.21.15.26:0/3894278549 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0acfb0 con 0x7f880c0c8bd0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8811295700 1 --2- 172.21.15.26:0/3894278549 >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 0x7f880c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f8810a94700 1 --2- 172.21.15.26:0/3894278549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8bd0 0x7f880c0b0a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f880c0694d0 tx=0x7f88000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9543ce8dd84ec3b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f880bfff700 1 -- 172.21.15.26:0/3894278549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000b6b0 con 0x7f880c0c8bd0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f880bfff700 1 -- 172.21.15.26:0/3894278549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000b810 con 0x7f880c0c8bd0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.358+0000 7f880bfff700 1 -- 172.21.15.26:0/3894278549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000bbb0 con 0x7f880c0c8bd0 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 -- 172.21.15.26:0/3894278549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8bd0 msgr2=0x7f880c0b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 --2- 172.21.15.26:0/3894278549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8bd0 0x7f880c0b0a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f880c0694d0 tx=0x7f88000091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 -- 172.21.15.26:0/3894278549 shutdown_connections 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 --2- 172.21.15.26:0/3894278549 >> v2:172.21.15.67:3300/0 conn(0x7f880c0c8800 0x7f880c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 --2- 172.21.15.26:0/3894278549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8bd0 0x7f880c0b0a40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 -- 172.21.15.26:0/3894278549 >> 172.21.15.26:0/3894278549 conn(0x7f880c06d170 msgr2=0x7f880c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 -- 172.21.15.26:0/3894278549 shutdown_connections 2023-10-09T11:37:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.359+0000 7f88134f9700 1 -- 172.21.15.26:0/3894278549 wait complete. 2023-10-09T11:37:05.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.360+0000 7f88134f9700 1 Processor -- start 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.360+0000 7f88134f9700 1 -- start start 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f880c0b0f80 0x7f880c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f880c0c8bd0 0x7f880c069da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0ab370 con 0x7f880c0c8800 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c16d2c0 con 0x7f880c0c8bd0 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f88134f9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c154630 con 0x7f880c0b0f80 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50540/0 (socket says 172.21.15.26:50540) 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 -- 172.21.15.26:0/1432559767 learned_addr learned my addr 172.21.15.26:0/1432559767 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8811295700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f880c0b0f80 0x7f880c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8811a96700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f880c0c8bd0 0x7f880c069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 -- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f880c0b0f80 msgr2=0x7f880c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f880c0b0f80 0x7f880c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 -- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f880c0c8bd0 msgr2=0x7f880c069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f880c0c8bd0 0x7f880c069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.361+0000 7f8810a94700 1 -- 172.21.15.26:0/1432559767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009420 con 0x7f880c0c8800 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f8810a94700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f880000b0e0 tx=0x7f8800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800011420 con 0x7f880c0c8800 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8800011580 con 0x7f880c0c8800 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c0aaad0 con 0x7f880c0c8800 2023-10-09T11:37:05.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800011920 con 0x7f880c0c8800 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.362+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c0ab090 con 0x7f880c0c8800 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.363+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c16d090 con 0x7f880c0c8800 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.363+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8800011d10 con 0x7f880c0c8800 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.363+0000 7f88097fa700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 0x7f87f8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.364+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8800085d30 con 0x7f880c0c8800 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.364+0000 7f8811295700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 0x7f87f8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.364+0000 7f8811295700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 0x7f87f8069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f880c0aa880 tx=0x7f87fc006f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.368+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f880c16d090 con 0x7f880c0c8800 2023-10-09T11:37:05.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.562+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f880c16d090 con 0x7f880c0c8800 2023-10-09T11:37:05.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.565+0000 7f88097fa700 1 -- 172.21.15.26:0/1432559767 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f88000150c0 con 0x7f880c0c8800 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 msgr2=0x7f87f8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 0x7f87f8069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f880c0aa880 tx=0x7f87fc006f90 comp rx=0 tx=0).stop 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 msgr2=0x7f880c145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f880000b0e0 tx=0x7f8800017000 comp rx=0 tx=0).stop 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 shutdown_connections 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f880c0c8bd0 0x7f880c069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f87f8066fc0 0x7f87f8069470 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f880c0b0f80 0x7f880c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 --2- 172.21.15.26:0/1432559767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f880c0c8800 0x7f880c145d90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 >> 172.21.15.26:0/1432559767 conn(0x7f880c06d170 msgr2=0x7f880c0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 shutdown_connections 2023-10-09T11:37:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.567+0000 7f88134f9700 1 -- 172.21.15.26:0/1432559767 wait complete. 2023-10-09T11:37:05.580 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:37:05.580 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:05.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:05.660 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:37:05.660 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:37:05.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.778+0000 7f4d78f55700 1 Processor -- start 2023-10-09T11:37:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.778+0000 7f4d78f55700 1 -- start start 2023-10-09T11:37:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d78f55700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 0x7f4d740cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d78f55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d7406e550 0x7f4d740af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d78f55700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d740aeee0 con 0x7f4d740a90d0 2023-10-09T11:37:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d78f55700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d740ae680 con 0x7f4d7406e550 2023-10-09T11:37:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d78f55700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740cf490 con 0x7f4d740a8d00 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d72d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d7406e550 0x7f4d740af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d71d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d740a90d0 0x7f4d7406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46132/0 (socket says 172.21.15.26:46132) 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.779+0000 7f4d71d9b700 1 -- 172.21.15.26:0/949503037 learned_addr learned my addr 172.21.15.26:0/949503037 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7259c700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 0x7f4d740cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d72d9d700 1 -- 172.21.15.26:0/949503037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 msgr2=0x7f4d740cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d72d9d700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 0x7f4d740cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d72d9d700 1 -- 172.21.15.26:0/949503037 >> v1:172.21.15.26:6789/0 conn(0x7f4d740a90d0 legacy=0x7f4d7406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7159a700 1 -- 172.21.15.26:0/949503037 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850094983 0 0) 0x7f4d740aeee0 con 0x7f4d740a90d0 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d72d9d700 1 -- 172.21.15.26:0/949503037 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740ce330 con 0x7f4d7406e550 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7259c700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 0x7f4d740cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d72d9d700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d740af370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009e60 tx=0x7f4d64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b5323b414f0fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7159a700 1 -- 172.21.15.26:0/949503037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400e070 con 0x7f4d7406e550 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7159a700 1 -- 172.21.15.26:0/949503037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400bc30 con 0x7f4d7406e550 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.780+0000 7f4d7159a700 1 -- 172.21.15.26:0/949503037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012430 con 0x7f4d7406e550 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 -- 172.21.15.26:0/949503037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 msgr2=0x7f4d740af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d740af370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009e60 tx=0x7f4d64009780 comp rx=0 tx=0).stop 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 -- 172.21.15.26:0/949503037 shutdown_connections 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d740af370 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 --2- 172.21.15.26:0/949503037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a8d00 0x7f4d740cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 -- 172.21.15.26:0/949503037 >> 172.21.15.26:0/949503037 conn(0x7f4d7406ce80 msgr2=0x7f4d740ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 -- 172.21.15.26:0/949503037 shutdown_connections 2023-10-09T11:37:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.781+0000 7f4d78f55700 1 -- 172.21.15.26:0/949503037 wait complete. 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 Processor -- start 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 -- start start 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d740a8d00 0x7f4d7409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a90d0 0x7f4d7409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7409b6d0 con 0x7f4d7406e550 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7409b9b0 con 0x7f4d740a8d00 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.782+0000 7f4d78f55700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7409bc90 con 0x7f4d740a90d0 2023-10-09T11:37:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50554/0 (socket says 172.21.15.26:50554) 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 -- 172.21.15.26:0/1329449255 learned_addr learned my addr 172.21.15.26:0/1329449255 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d72d9d700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a90d0 0x7f4d7409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d71d9b700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d740a8d00 0x7f4d7409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 -- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a90d0 msgr2=0x7f4d7409ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a90d0 0x7f4d7409ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 -- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d740a8d00 msgr2=0x7f4d7409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d740a8d00 0x7f4d7409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 -- 172.21.15.26:0/1329449255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009a20 con 0x7f4d7406e550 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d7259c700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c880 tx=0x7f4d6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c005a00 con 0x7f4d7406e550 2023-10-09T11:37:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c005b60 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7409bf70 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c011600 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.783+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7409b3c0 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.784+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74169d00 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.785+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4d6c0119f0 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.785+0000 7f4d6a7fc700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 0x7f4d54069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.785+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4d6c0841a0 con 0x7f4d7406e550 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.785+0000 7f4d71d9b700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 0x7f4d54069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.786+0000 7f4d71d9b700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 0x7f4d54069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c002800 tx=0x7f4d5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:05.789+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d6c051610 con 0x7f4d7406e550 2023-10-09T11:37:06.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.026+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d7404c3c0 con 0x7f4d7406e550 2023-10-09T11:37:06.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.027+0000 7f4d6a7fc700 1 -- 172.21.15.26:0/1329449255 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4d6c01ede0 con 0x7f4d7406e550 2023-10-09T11:37:06.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:06.028 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3403930069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3403930069},{"type":"v1","addr":"172.21.15.67:6836","nonce":3403930069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3063534297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3063534297},{"type":"v1","addr":"172.21.15.67:6837","nonce":3063534297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1660549779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1660549779},{"type":"v1","addr":"172.21.15.26:6834","nonce":1660549779}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3313769068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3313769068},{"type":"v1","addr":"172.21.15.26:6835","nonce":3313769068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2023-10-09T11:37:06.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 msgr2=0x7f4d54069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 0x7f4d54069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c002800 tx=0x7f4d5c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:06.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 msgr2=0x7f4d7415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c880 tx=0x7f4d6c008040 comp rx=0 tx=0).stop 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 shutdown_connections 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4d54066fc0 0x7f4d54069470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4d740a90d0 0x7f4d7409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d7406e550 0x7f4d7415c650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 --2- 172.21.15.26:0/1329449255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d740a8d00 0x7f4d7409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 >> 172.21.15.26:0/1329449255 conn(0x7f4d7406ce80 msgr2=0x7f4d74067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 shutdown_connections 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.029+0000 7f4d78f55700 1 -- 172.21.15.26:0/1329449255 wait complete. 2023-10-09T11:37:06.030 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 33 2023-10-09T11:37:06.041 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:37:06.041 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:37:06.042 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:37:06.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:06.042 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:37:06.042 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:37:06.042 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:37:06.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:06.043 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:37:06.043 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:37:06.043 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:37:06.043 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:06.043 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:37:06.043 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:37:06.043 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:37:06.043 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:06.051 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:37:06.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:37:06.052 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:37:06.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:37:06.054 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:37:06.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:37:06.055 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:37:06.055 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:37:06.094 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:37:06.094 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:06.094 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:37:06.095 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:06.097 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:37:06.097 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:06.098 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:37:06.098 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:06.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:37:06.169 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:37:06.169 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:37:06.182 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:37:06.182 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:37:06.183 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-10-09T11:37:06.182+0000 7f3c4f1c9700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T11:37:06.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.224+0000 7fcf63b9a700 1 Processor -- start 2023-10-09T11:37:06.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.224+0000 7fcf63b9a700 1 -- start start 2023-10-09T11:37:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.225+0000 7fcf63b9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.225+0000 7fcf63b9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf5c0c29b0 0x7fcf5c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf63b9a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0c3a30 con 0x7fcf5c070410 2023-10-09T11:37:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf63b9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c2e20 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf63b9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c3100 con 0x7fcf5c13fcc0 2023-10-09T11:37:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf5c0c29b0 0x7fcf5c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf62137700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcf5c070410 0x7fcf5c06c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:48658/0 (socket says 172.21.15.26:48658) 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf62137700 1 -- 172.21.15.26:0/3317096751 learned_addr learned my addr 172.21.15.26:0/3317096751 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61936700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 -- 172.21.15.26:0/3317096751 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 msgr2=0x7fcf5c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 --2- 172.21.15.26:0/3317096751 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 -- 172.21.15.26:0/3317096751 >> v1:172.21.15.67:6789/0 conn(0x7fcf5c070410 legacy=0x7fcf5c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 -- 172.21.15.26:0/3317096751 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0c33e0 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.226+0000 7fcf61135700 1 --2- 172.21.15.26:0/3317096751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c0c43a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0098e0 tx=0x7fcf4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b601ecd198d743b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.228+0000 7fcf60934700 1 -- 172.21.15.26:0/3317096751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00b640 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.228+0000 7fcf60934700 1 -- 172.21.15.26:0/3317096751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00b7a0 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.228+0000 7fcf60934700 1 -- 172.21.15.26:0/3317096751 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00bb40 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 -- 172.21.15.26:0/3317096751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 msgr2=0x7fcf5c0c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/3317096751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c0c43a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0098e0 tx=0x7fcf4c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 -- 172.21.15.26:0/3317096751 shutdown_connections 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/3317096751 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/3317096751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c0c43a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 -- 172.21.15.26:0/3317096751 >> 172.21.15.26:0/3317096751 conn(0x7fcf5c0ccb60 msgr2=0x7fcf5c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:06.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 -- 172.21.15.26:0/3317096751 shutdown_connections 2023-10-09T11:37:06.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.229+0000 7fcf63b9a700 1 -- 172.21.15.26:0/3317096751 wait complete. 2023-10-09T11:37:06.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.230+0000 7fcf63b9a700 1 Processor -- start 2023-10-09T11:37:06.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.230+0000 7fcf63b9a700 1 -- start start 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf5c070410 0x7fcf5c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cb700 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0caaf0 con 0x7fcf5c070410 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf63b9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cadd0 con 0x7fcf5c13fcc0 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf61135700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf61135700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50608/0 (socket says 172.21.15.26:50608) 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf61135700 1 -- 172.21.15.26:0/4203426681 learned_addr learned my addr 172.21.15.26:0/4203426681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf62137700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.231+0000 7fcf61936700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf5c070410 0x7fcf5c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 -- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 msgr2=0x7fcf5c132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c132800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 -- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf5c070410 msgr2=0x7fcf5c0cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf5c070410 0x7fcf5c0cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 -- 172.21.15.26:0/4203426681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009420 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf61135700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c069900 tx=0x7fcf4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01bc40 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0cb0b0 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c01bda0 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011670 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c135e80 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.233+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c06bfd0 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.234+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fcf4c011a20 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.234+0000 7fcf51ffb700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 0x7fcf40069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.234+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcf4c085910 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.234+0000 7fcf61936700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 0x7fcf40069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.235+0000 7fcf61936700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 0x7fcf40069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009d10 tx=0x7fcf580091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.239+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf4c052e90 con 0x7fcf5c0c29b0 2023-10-09T11:37:06.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:06.447+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcf5c04c3c0 con 0x7fcf5c0c29b0 2023-10-09T11:37:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.229+0000 7fcf51ffb700 1 -- 172.21.15.26:0/4203426681 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcf4c015080 con 0x7fcf5c0c29b0 2023-10-09T11:37:07.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 msgr2=0x7fcf40069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 0x7fcf40069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009d10 tx=0x7fcf580091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 msgr2=0x7fcf5c137c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c069900 tx=0x7fcf4c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 shutdown_connections 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcf40066fc0 0x7fcf40069470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf5c13fcc0 0x7fcf5c132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf5c070410 0x7fcf5c0cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 --2- 172.21.15.26:0/4203426681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf5c0c29b0 0x7fcf5c137c90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 >> 172.21.15.26:0/4203426681 conn(0x7fcf5c0ccb60 msgr2=0x7fcf5c06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 shutdown_connections 2023-10-09T11:37:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.232+0000 7fcf63b9a700 1 -- 172.21.15.26:0/4203426681 wait complete. 2023-10-09T11:37:07.234 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:37:07.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:37:07.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.366+0000 7f3e2a9db700 1 Processor -- start 2023-10-09T11:37:07.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.366+0000 7f3e2a9db700 1 -- start start 2023-10-09T11:37:07.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e2a9db700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e2a9db700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e2a9db700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240ce9d0 con 0x7f3e24159c80 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e2a9db700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240afc30 con 0x7f3e240af790 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e2a9db700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240aff10 con 0x7f3e241598b0 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e28f78700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.367+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57370/0 (socket says 172.21.15.26:57370) 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e28f78700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:41700/0 (socket says 172.21.15.26:41700) 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e237fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e24159c80 0x7f3e240cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:48674/0 (socket says 172.21.15.26:48674) 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 -- 172.21.15.26:0/3458282134 learned_addr learned my addr 172.21.15.26:0/3458282134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e22ffd700 1 -- 172.21.15.26:0/3458282134 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918451759 0 0) 0x7f3e240ce9d0 con 0x7f3e24159c80 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e22ffd700 1 -- 172.21.15.26:0/3458282134 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e10003570 con 0x7f3e24159c80 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 -- 172.21.15.26:0/3458282134 >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 msgr2=0x7f3e24163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 --2- 172.21.15.26:0/3458282134 >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 -- 172.21.15.26:0/3458282134 >> v1:172.21.15.67:6789/0 conn(0x7f3e24159c80 legacy=0x7f3e240cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 -- 172.21.15.26:0/3458282134 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240ce380 con 0x7f3e241598b0 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e28f78700 1 --2- 172.21.15.26:0/3458282134 >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e23fff700 1 --2- 172.21.15.26:0/3458282134 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0099b0 tx=0x7f3e0c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2fab7216849a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e22ffd700 1 -- 172.21.15.26:0/3458282134 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00b680 con 0x7f3e241598b0 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e22ffd700 1 -- 172.21.15.26:0/3458282134 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00b7e0 con 0x7f3e241598b0 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.368+0000 7f3e22ffd700 1 -- 172.21.15.26:0/3458282134 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00bb60 con 0x7f3e241598b0 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 -- 172.21.15.26:0/3458282134 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 msgr2=0x7f3e240af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/3458282134 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0099b0 tx=0x7f3e0c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 -- 172.21.15.26:0/3458282134 shutdown_connections 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/3458282134 >> v2:172.21.15.67:3300/0 conn(0x7f3e240af790 0x7f3e24163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/3458282134 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e241598b0 0x7f3e240af250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 -- 172.21.15.26:0/3458282134 >> 172.21.15.26:0/3458282134 conn(0x7f3e24070e30 msgr2=0x7f3e240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 -- 172.21.15.26:0/3458282134 shutdown_connections 2023-10-09T11:37:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.369+0000 7f3e2a9db700 1 -- 172.21.15.26:0/3458282134 wait complete. 2023-10-09T11:37:07.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.370+0000 7f3e2a9db700 1 Processor -- start 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.370+0000 7f3e2a9db700 1 -- start start 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e240af790 0x7f3e2415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e24159c80 0x7f3e24150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2415a460 con 0x7f3e241598b0 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241514d0 con 0x7f3e24159c80 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e2a9db700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c96d0 con 0x7f3e240af790 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50612/0 (socket says 172.21.15.26:50612) 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e237fe700 1 -- 172.21.15.26:0/1319221182 learned_addr learned my addr 172.21.15.26:0/1319221182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e28f78700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e24159c80 0x7f3e24150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.371+0000 7f3e23fff700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e240af790 0x7f3e2415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 -- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e240af790 msgr2=0x7f3e2415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e240af790 0x7f3e2415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 -- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e24159c80 msgr2=0x7f3e24150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e24159c80 0x7f3e24150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 -- 172.21.15.26:0/1319221182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c009a20 con 0x7f3e241598b0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e237fe700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c590 tx=0x7f3e14007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14005b40 con 0x7f3e241598b0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14005ca0 con 0x7f3e241598b0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c0094f0 con 0x7f3e241598b0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14007320 con 0x7f3e241598b0 2023-10-09T11:37:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.372+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240c9d10 con 0x7f3e241598b0 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.373+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2415a610 con 0x7f3e241598b0 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.373+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3e1401b3b0 con 0x7f3e241598b0 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.374+0000 7f3e1bfff700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 0x7f3e04069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.374+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e14083600 con 0x7f3e241598b0 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.374+0000 7f3e23fff700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 0x7f3e04069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.375+0000 7f3e23fff700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 0x7f3e04069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0099b0 tx=0x7f3e0c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.378+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e2415a610 con 0x7f3e241598b0 2023-10-09T11:37:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.648+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3e2415a210 con 0x7f3e241598b0 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.648+0000 7f3e1bfff700 1 -- 172.21.15.26:0/1319221182 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3e14050bd0 con 0x7f3e241598b0 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:37:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:37:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:37:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:37:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:37:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.661 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:37:07.662 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:37:07.664 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:07.665 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:37:07.666 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:37:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 msgr2=0x7f3e04069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 0x7f3e04069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0099b0 tx=0x7f3e0c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 msgr2=0x7f3e240b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c590 tx=0x7f3e14007dc0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 shutdown_connections 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e24159c80 0x7f3e24150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e04066fc0 0x7f3e04069470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e240af790 0x7f3e2415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 --2- 172.21.15.26:0/1319221182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e241598b0 0x7f3e240b5840 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.650+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 >> 172.21.15.26:0/1319221182 conn(0x7f3e24070e30 msgr2=0x7f3e240cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.651+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 shutdown_connections 2023-10-09T11:37:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.651+0000 7f3e2a9db700 1 -- 172.21.15.26:0/1319221182 wait complete. 2023-10-09T11:37:07.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.787+0000 7ffb94151700 1 Processor -- start 2023-10-09T11:37:07.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.788+0000 7ffb94151700 1 -- start start 2023-10-09T11:37:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.788+0000 7ffb94151700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb8c06dc70 0x7ffb8c164440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.788+0000 7ffb94151700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c06c7d0 con 0x7ffb8c143200 2023-10-09T11:37:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.788+0000 7ffb94151700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0c37a0 con 0x7ffb8c0c3250 2023-10-09T11:37:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.788+0000 7ffb94151700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c1171e0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb91eed700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffb8c143200 0x7ffb8c159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46156/0 (socket says 172.21.15.26:46156) 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb926ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb8c06dc70 0x7ffb8c164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb91eed700 1 -- 172.21.15.26:0/469694317 learned_addr learned my addr 172.21.15.26:0/469694317 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb926ee700 1 -- 172.21.15.26:0/469694317 >> v1:172.21.15.67:6789/0 conn(0x7ffb8c0c3250 legacy=0x7ffb8c15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb926ee700 1 -- 172.21.15.26:0/469694317 >> v1:172.21.15.26:6789/0 conn(0x7ffb8c143200 legacy=0x7ffb8c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb926ee700 1 -- 172.21.15.26:0/469694317 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0cc090 con 0x7ffb8c06dc70 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb926ee700 1 --2- 172.21.15.26:0/469694317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c164440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0098e0 tx=0x7ffb7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0b258c0d721e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb90eeb700 1 -- 172.21.15.26:0/469694317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c009e80 con 0x7ffb8c06dc70 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb90eeb700 1 -- 172.21.15.26:0/469694317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c00b860 con 0x7ffb8c06dc70 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.789+0000 7ffb90eeb700 1 -- 172.21.15.26:0/469694317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00bbe0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 -- 172.21.15.26:0/469694317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 msgr2=0x7ffb8c164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 --2- 172.21.15.26:0/469694317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c164440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0098e0 tx=0x7ffb7c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 -- 172.21.15.26:0/469694317 shutdown_connections 2023-10-09T11:37:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 --2- 172.21.15.26:0/469694317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c164440 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 -- 172.21.15.26:0/469694317 >> 172.21.15.26:0/469694317 conn(0x7ffb8c0ccb60 msgr2=0x7ffb8c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 -- 172.21.15.26:0/469694317 shutdown_connections 2023-10-09T11:37:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.790+0000 7ffb94151700 1 -- 172.21.15.26:0/469694317 wait complete. 2023-10-09T11:37:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.791+0000 7ffb94151700 1 Processor -- start 2023-10-09T11:37:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.791+0000 7ffb94151700 1 -- start start 2023-10-09T11:37:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb8c0c3250 0x7ffb8c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c143200 0x7ffb8c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c15e310 con 0x7ffb8c06dc70 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c15d480 con 0x7ffb8c143200 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c15d700 con 0x7ffb8c0c3250 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50638/0 (socket says 172.21.15.26:50638) 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 -- 172.21.15.26:0/4143597992 learned_addr learned my addr 172.21.15.26:0/4143597992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 -- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb8c0c3250 msgr2=0x7ffb8c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb8c0c3250 0x7ffb8c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb926ee700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c143200 0x7ffb8c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 -- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c143200 msgr2=0x7ffb8c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c143200 0x7ffb8c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 -- 172.21.15.26:0/4143597992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009420 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb91eed700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400cc70 tx=0x7ffb84001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400ce80 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8400ab70 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c15d9e0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.792+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840070f0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.793+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c15dfa0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.793+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c04c3c0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.794+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ffb84007520 con 0x7ffb8c06dc70 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.794+0000 7ffb89ffb700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 0x7ffb78069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.794+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffb84084650 con 0x7ffb8c06dc70 2023-10-09T11:37:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.794+0000 7ffb916ec700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 0x7ffb78069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.795+0000 7ffb916ec700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 0x7ffb78069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c16cf20 tx=0x7ffb80007b40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.798+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb84051ca0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.995+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb8c0cc370 con 0x7ffb8c06dc70 2023-10-09T11:37:07.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.995+0000 7ffb89ffb700 1 -- 172.21.15.26:0/4143597992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+12086 (secure 0 0 0) 0x7ffb840552c0 con 0x7ffb8c06dc70 2023-10-09T11:37:07.997 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:07.998 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":59,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:37:07.226866+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:07.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.997+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 msgr2=0x7ffb78069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.997+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 0x7ffb78069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c16cf20 tx=0x7ffb80007b40 comp rx=0 tx=0).stop 2023-10-09T11:37:07.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 msgr2=0x7ffb8c16da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400cc70 tx=0x7ffb84001a30 comp rx=0 tx=0).stop 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 shutdown_connections 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c143200 0x7ffb8c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8c06dc70 0x7ffb8c16da80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb78066fc0 0x7ffb78069470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 --2- 172.21.15.26:0/4143597992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb8c0c3250 0x7ffb8c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 >> 172.21.15.26:0/4143597992 conn(0x7ffb8c0ccb60 msgr2=0x7ffb8c13e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 shutdown_connections 2023-10-09T11:37:08.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:07.998+0000 7ffb94151700 1 -- 172.21.15.26:0/4143597992 wait complete. 2023-10-09T11:37:08.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:37:08.012 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:37:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.134+0000 7f6b89738700 1 Processor -- start 2023-10-09T11:37:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.134+0000 7f6b89738700 1 -- start start 2023-10-09T11:37:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b89738700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b840c8d90 0x7f6b8415b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b89738700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c9160 0x7f6b84157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b89738700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b840cc2e0 con 0x7f6b8406a3e0 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b89738700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840ce300 con 0x7f6b840c8d90 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b89738700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840cce60 con 0x7f6b840c9160 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b82ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b840c8d90 0x7f6b8415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b827fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b8406a3e0 0x7f6b84157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46162/0 (socket says 172.21.15.26:46162) 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.135+0000 7f6b827fc700 1 -- 172.21.15.26:0/769783788 learned_addr learned my addr 172.21.15.26:0/769783788 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b837fe700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c9160 0x7f6b84157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b82ffd700 1 -- 172.21.15.26:0/769783788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c9160 msgr2=0x7f6b84157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b82ffd700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c9160 0x7f6b84157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b82ffd700 1 -- 172.21.15.26:0/769783788 >> v1:172.21.15.26:6789/0 conn(0x7f6b8406a3e0 legacy=0x7f6b84157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b81ffb700 1 -- 172.21.15.26:0/769783788 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391932503 0 0) 0x7f6b840cc2e0 con 0x7f6b8406a3e0 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b82ffd700 1 -- 172.21.15.26:0/769783788 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840cc530 con 0x7f6b840c8d90 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b82ffd700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c8d90 0x7f6b8415b990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6b740098e0 tx=0x7f6b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c71002b0d4d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b81ffb700 1 -- 172.21.15.26:0/769783788 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74009e80 con 0x7f6b840c8d90 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b81ffb700 1 -- 172.21.15.26:0/769783788 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400b860 con 0x7f6b840c8d90 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.136+0000 7f6b81ffb700 1 -- 172.21.15.26:0/769783788 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400bbe0 con 0x7f6b840c8d90 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 -- 172.21.15.26:0/769783788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c8d90 msgr2=0x7f6b8415b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c8d90 0x7f6b8415b990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6b740098e0 tx=0x7f6b740091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 -- 172.21.15.26:0/769783788 shutdown_connections 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c9160 0x7f6b84157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 --2- 172.21.15.26:0/769783788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c8d90 0x7f6b8415b990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 -- 172.21.15.26:0/769783788 >> 172.21.15.26:0/769783788 conn(0x7f6b84067f00 msgr2=0x7f6b84068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 -- 172.21.15.26:0/769783788 shutdown_connections 2023-10-09T11:37:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.137+0000 7f6b89738700 1 -- 172.21.15.26:0/769783788 wait complete. 2023-10-09T11:37:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.138+0000 7f6b89738700 1 Processor -- start 2023-10-09T11:37:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.138+0000 7f6b89738700 1 -- start start 2023-10-09T11:37:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b8406a3e0 0x7f6b8415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 0x7f6b84158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84158a50 con 0x7f6b840c9160 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8406d8d0 con 0x7f6b8406a3e0 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b89738700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8406de90 con 0x7f6b840c8d90 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50668/0 (socket says 172.21.15.26:50668) 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 -- 172.21.15.26:0/3427813264 learned_addr learned my addr 172.21.15.26:0/3427813264 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b827fc700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 0x7f6b84158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b82ffd700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b8406a3e0 0x7f6b8415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 -- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 msgr2=0x7f6b84158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 0x7f6b84158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 -- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b8406a3e0 msgr2=0x7f6b8415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b8406a3e0 0x7f6b8415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 -- 172.21.15.26:0/3427813264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009420 con 0x7f6b840c9160 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b827fc700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 0x7f6b84158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b837fe700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007f50 tx=0x7f6b7c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00ecd0 con 0x7f6b840c9160 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.139+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00ee50 con 0x7f6b840c9160 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.140+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b84158c70 con 0x7f6b840c9160 2023-10-09T11:37:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.140+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c014670 con 0x7f6b840c9160 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.140+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8406db20 con 0x7f6b840c9160 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.141+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8404c3c0 con 0x7f6b840c9160 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.141+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6b7c0149e0 con 0x7f6b840c9160 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.141+0000 7f6b7affd700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 0x7f6b64069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.141+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b7c0848f0 con 0x7f6b840c9160 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.142+0000 7f6b82ffd700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 0x7f6b64069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.142+0000 7f6b82ffd700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 0x7f6b64069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b740091e0 tx=0x7f6b74017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.146+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b7c051ec0 con 0x7f6b840c9160 2023-10-09T11:37:08.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.338+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b8406dfd0 con 0x7f6b840c9160 2023-10-09T11:37:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.338+0000 7f6b7affd700 1 -- 172.21.15.26:0/3427813264 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b7c0554e0 con 0x7f6b840c9160 2023-10-09T11:37:08.339 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:37:08.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 msgr2=0x7f6b64069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 0x7f6b64069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b740091e0 tx=0x7f6b74017000 comp rx=0 tx=0).stop 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 msgr2=0x7f6b841520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007f50 tx=0x7f6b7c009860 comp rx=0 tx=0).stop 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 shutdown_connections 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b840c9160 0x7f6b841520f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b8406a3e0 0x7f6b8415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b64066fc0 0x7f6b64069470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 --2- 172.21.15.26:0/3427813264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b840c8d90 0x7f6b84158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 >> 172.21.15.26:0/3427813264 conn(0x7f6b84067f00 msgr2=0x7f6b840c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 shutdown_connections 2023-10-09T11:37:08.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.340+0000 7f6b89738700 1 -- 172.21.15.26:0/3427813264 wait complete. 2023-10-09T11:37:08.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:37:08.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.473+0000 7f9195e40700 1 Processor -- start 2023-10-09T11:37:08.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.473+0000 7f9195e40700 1 -- start start 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9190153c30 0x7f919015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 0x7f91900cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91900cef40 0x7f919006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919015afd0 con 0x7f91900cef40 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919015b2b0 con 0x7f919015de50 2023-10-09T11:37:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9195e40700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919015b590 con 0x7f9190153c30 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91900cef40 0x7f919006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91900cef40 0x7f919006d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50670/0 (socket says 172.21.15.26:50670) 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 -- 172.21.15.26:0/1531412503 learned_addr learned my addr 172.21.15.26:0/1531412503 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f9194e3e700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9190153c30 0x7f919015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f918ffff700 1 --2- 172.21.15.26:0/1531412503 >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 0x7f91900cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 -- 172.21.15.26:0/1531412503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9190153c30 msgr2=0x7f919015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9190153c30 0x7f919015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 -- 172.21.15.26:0/1531412503 >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 msgr2=0x7f91900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 --2- 172.21.15.26:0/1531412503 >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 0x7f91900cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f919563f700 1 -- 172.21.15.26:0/1531412503 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919015b870 con 0x7f91900cef40 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.474+0000 7f918ffff700 1 --2- 172.21.15.26:0/1531412503 >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 0x7f91900cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f919563f700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919006d790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f919006e800 tx=0x7f9178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751f8f1c015c727a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f918f7fe700 1 -- 172.21.15.26:0/1531412503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178009e70 con 0x7f91900cef40 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f918f7fe700 1 -- 172.21.15.26:0/1531412503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917800b860 con 0x7f91900cef40 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f918f7fe700 1 -- 172.21.15.26:0/1531412503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917800bc00 con 0x7f91900cef40 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 -- 172.21.15.26:0/1531412503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 msgr2=0x7f919006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919006d790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f919006e800 tx=0x7f9178009250 comp rx=0 tx=0).stop 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 -- 172.21.15.26:0/1531412503 shutdown_connections 2023-10-09T11:37:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919006d790 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 --2- 172.21.15.26:0/1531412503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9190153c30 0x7f919015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 --2- 172.21.15.26:0/1531412503 >> v2:172.21.15.67:3300/0 conn(0x7f919015de50 0x7f91900cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 -- 172.21.15.26:0/1531412503 >> 172.21.15.26:0/1531412503 conn(0x7f91900703a0 msgr2=0x7f91900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 -- 172.21.15.26:0/1531412503 shutdown_connections 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.475+0000 7f9195e40700 1 -- 172.21.15.26:0/1531412503 wait complete. 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.476+0000 7f9195e40700 1 Processor -- start 2023-10-09T11:37:08.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 -- start start 2023-10-09T11:37:08.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9190153c30 0x7f919014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f919015de50 0x7f919014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b0fb0 con 0x7f91900cef40 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b1290 con 0x7f9190153c30 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9195e40700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b1570 con 0x7f919015de50 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9194e3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9194e3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50686/0 (socket says 172.21.15.26:50686) 2023-10-09T11:37:08.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.477+0000 7f9194e3e700 1 -- 172.21.15.26:0/497371487 learned_addr learned my addr 172.21.15.26:0/497371487 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f918ffff700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9190153c30 0x7f919014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f919563f700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f919015de50 0x7f919014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 -- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f919015de50 msgr2=0x7f919014d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f919015de50 0x7f919014d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 -- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9190153c30 msgr2=0x7f919014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9190153c30 0x7f919014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 -- 172.21.15.26:0/497371487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780094f0 con 0x7f91900cef40 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9194e3e700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9188009ef0 tx=0x7f918800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800cb70 con 0x7f91900cef40 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800f040 con 0x7f91900cef40 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91900c7760 con 0x7f91900cef40 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188014480 con 0x7f91900cef40 2023-10-09T11:37:08.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.478+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900b0310 con 0x7f91900cef40 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.479+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900c7ad0 con 0x7f91900cef40 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.480+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f91880147f0 con 0x7f91900cef40 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.480+0000 7f918cff9700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 0x7f9170069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.480+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9188084f10 con 0x7f91900cef40 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.480+0000 7f918ffff700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 0x7f9170069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.481+0000 7f918ffff700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 0x7f9170069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9180006f00 tx=0x7f9180008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.484+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91880523d0 con 0x7f91900cef40 2023-10-09T11:37:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.681+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f919004c3c0 con 0x7f91900cef40 2023-10-09T11:37:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.682+0000 7f918cff9700 1 -- 172.21.15.26:0/497371487 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+65 (secure 0 0 0) 0x7f91880559f0 con 0x7f91900cef40 2023-10-09T11:37:08.682 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 msgr2=0x7f9170069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 0x7f9170069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9180006f00 tx=0x7f9180008040 comp rx=0 tx=0).stop 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 msgr2=0x7f919014dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9188009ef0 tx=0x7f918800b040 comp rx=0 tx=0).stop 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 shutdown_connections 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9170066fc0 0x7f9170069470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f919015de50 0x7f919014d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91900cef40 0x7f919014dc70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 --2- 172.21.15.26:0/497371487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9190153c30 0x7f919014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 >> 172.21.15.26:0/497371487 conn(0x7f91900703a0 msgr2=0x7f91900d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 shutdown_connections 2023-10-09T11:37:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.684+0000 7f9195e40700 1 -- 172.21.15.26:0/497371487 wait complete. 2023-10-09T11:37:08.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:37:08.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:37:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.819+0000 7f45134a0700 1 Processor -- start 2023-10-09T11:37:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.819+0000 7f45134a0700 1 -- start start 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f45134a0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f450c0cd330 0x7f450c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f45134a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c15d570 con 0x7f450c0cce90 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f45134a0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c15d850 con 0x7f450c159fb0 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f45134a0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c15e180 con 0x7f450c0cd330 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f4511c9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f450c0cce90 0x7f450c0cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46172/0 (socket says 172.21.15.26:46172) 2023-10-09T11:37:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.820+0000 7f4511c9d700 1 -- 172.21.15.26:0/1064548598 learned_addr learned my addr 172.21.15.26:0/1064548598 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 --2- 172.21.15.26:0/1064548598 >> v2:172.21.15.67:3300/0 conn(0x7f450c0cd330 0x7f450c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979990876 0 0) 0x7f450c15d570 con 0x7f450c0cce90 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f4003570 con 0x7f450c0cce90 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143294182 0 0) 0x7f44f4003570 con 0x7f450c0cce90 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 >> v2:172.21.15.67:3300/0 conn(0x7f450c0cd330 msgr2=0x7f450c0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 --2- 172.21.15.26:0/1064548598 >> v2:172.21.15.67:3300/0 conn(0x7f450c0cd330 0x7f450c0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 >> v1:172.21.15.67:6789/0 conn(0x7f450c159fb0 legacy=0x7f450c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c15db30 con 0x7f450c0cce90 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4500001470 con 0x7f450c0cce90 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 >> v1:172.21.15.26:6789/0 conn(0x7f450c0cce90 legacy=0x7f450c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4003a60 0x7f44f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44f4004810 0x7f44f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 0x7f44f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15e180 con 0x7f44f40051c0 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f400c0e0 con 0x7f44f4003a60 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f400c2a0 con 0x7f44f4004810 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 0x7f44f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f451249e700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4003a60 0x7f44f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4511c9d700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44f4004810 0x7f44f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 -- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44f4004810 msgr2=0x7f44f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44f4004810 0x7f44f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 -- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4003a60 msgr2=0x7f44f4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4003a60 0x7f44f4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.821+0000 7f4512c9f700 1 -- 172.21.15.26:0/1064548598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4003570 con 0x7f44f40051c0 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f4512c9f700 1 -- 172.21.15.26:0/1064548598 reap_dead start 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f4512c9f700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 0x7f44f400ba60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f450400e210 tx=0x7f450400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55625cb903e2d6a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400eac0 con 0x7f44f40051c0 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400f040 con 0x7f44f40051c0 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f451149c700 1 -- 172.21.15.26:0/1064548598 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400ee70 con 0x7f44f40051c0 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 -- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 msgr2=0x7f44f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 0x7f44f400ba60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f450400e210 tx=0x7f450400b040 comp rx=0 tx=0).stop 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 -- 172.21.15.26:0/1064548598 shutdown_connections 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 --2- 172.21.15.26:0/1064548598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44f40051c0 0x7f44f400ba60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 -- 172.21.15.26:0/1064548598 >> 172.21.15.26:0/1064548598 conn(0x7f450c0703a0 msgr2=0x7f450c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 -- 172.21.15.26:0/1064548598 shutdown_connections 2023-10-09T11:37:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.822+0000 7f45134a0700 1 -- 172.21.15.26:0/1064548598 wait complete. 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.823+0000 7f45134a0700 1 Processor -- start 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.823+0000 7f45134a0700 1 -- start start 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f40051c0 0x7f450c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f450c16d360 0x7f450c16d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c16e1f0 con 0x7f450c0c7600 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c16dd10 con 0x7f44f40051c0 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f45134a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0b0d60 con 0x7f450c16d360 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f4512c9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f4512c9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50698/0 (socket says 172.21.15.26:50698) 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f4512c9f700 1 -- 172.21.15.26:0/3352633687 learned_addr learned my addr 172.21.15.26:0/3352633687 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f451249e700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f40051c0 0x7f450c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.824+0000 7f4511c9d700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f450c16d360 0x7f450c16d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 -- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f450c16d360 msgr2=0x7f450c16d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f450c16d360 0x7f450c16d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 -- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f40051c0 msgr2=0x7f450c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f40051c0 0x7f450c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 -- 172.21.15.26:0/3352633687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0b1040 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f4512c9f700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f450c0caec0 tx=0x7f4504019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450401d660 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504022070 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c0b1320 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450401da30 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.825+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c0b18e0 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.826+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c0b1ad0 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.826+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4504003020 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.827+0000 7f450a7fc700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 0x7f44f8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.827+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4504024070 con 0x7f450c0c7600 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.827+0000 7f451249e700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 0x7f44f8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.828+0000 7f451249e700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 0x7f44f8069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44fc007e40 tx=0x7f44fc007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:08.831+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4504053690 con 0x7f450c0c7600 2023-10-09T11:37:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.027+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f450c04c3c0 con 0x7f450c0c7600 2023-10-09T11:37:09.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.239+0000 7f450a7fc700 1 -- 172.21.15.26:0/3352633687 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4504056cb0 con 0x7f450c0c7600 2023-10-09T11:37:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 msgr2=0x7f44f8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 0x7f44f8069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44fc007e40 tx=0x7f44fc007d30 comp rx=0 tx=0).stop 2023-10-09T11:37:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 msgr2=0x7f450c0c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f450c0caec0 tx=0x7f4504019000 comp rx=0 tx=0).stop 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 shutdown_connections 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f450c0c7600 0x7f450c0c7aa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.241+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f40051c0 0x7f450c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.242+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44f8066fc0 0x7f44f8069470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.242+0000 7f45134a0700 1 --2- 172.21.15.26:0/3352633687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f450c16d360 0x7f450c16d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.242+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 >> 172.21.15.26:0/3352633687 conn(0x7f450c0703a0 msgr2=0x7f450c158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.242+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 shutdown_connections 2023-10-09T11:37:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.242+0000 7f45134a0700 1 -- 172.21.15.26:0/3352633687 wait complete. 2023-10-09T11:37:09.244 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:37:09.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:37:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.383+0000 7feac172e700 1 Processor -- start 2023-10-09T11:37:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.383+0000 7feac172e700 1 -- start start 2023-10-09T11:37:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feac172e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feabc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feac172e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feabc06dc70 0x7feabc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feac172e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0ccfd0 con 0x7feabc06e0e0 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feac172e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0cf0e0 con 0x7feabc06dc70 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feac172e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc15a3d0 con 0x7feabc159530 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feabb7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feabc06e0e0 0x7feabc0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46176/0 (socket says 172.21.15.26:46176) 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feabb7fe700 1 -- 172.21.15.26:0/3331200482 learned_addr learned my addr 172.21.15.26:0/3331200482 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feaba7fc700 1 --2- 172.21.15.26:0/3331200482 >> v2:172.21.15.67:3300/0 conn(0x7feabc06dc70 0x7feabc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feabc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269994061 0 0) 0x7feabc0ccfd0 con 0x7feabc06e0e0 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa8003570 con 0x7feabc06e0e0 2023-10-09T11:37:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.384+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215123042 0 0) 0x7feaa8003570 con 0x7feabc06e0e0 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 msgr2=0x7feabc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feabc0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 >> v2:172.21.15.67:3300/0 conn(0x7feabc06dc70 msgr2=0x7feabc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 --2- 172.21.15.26:0/3331200482 >> v2:172.21.15.67:3300/0 conn(0x7feabc06dc70 0x7feabc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc15a6b0 con 0x7feabc06e0e0 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7feaac0017f0 con 0x7feabc06e0e0 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feaba7fc700 1 --2- 172.21.15.26:0/3331200482 >> v2:172.21.15.67:3300/0 conn(0x7feabc06dc70 0x7feabc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feabc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 >> v1:172.21.15.26:6789/0 conn(0x7feabc06e0e0 legacy=0x7feabc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa8003a60 0x7feaa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feaa8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa8004d50 0x7feaa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0cf0e0 con 0x7feaa8003a60 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc15a3d0 con 0x7feaa8004d50 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa800ba60 con 0x7feabc159530 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa8003a60 0x7feaa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feaba7fc700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feaa8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabb7fe700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa8004d50 0x7feaa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 -- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 msgr2=0x7feaa8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc159530 0x7feaa8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 -- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa8004d50 msgr2=0x7feaa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa8004d50 0x7feaa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 -- 172.21.15.26:0/3331200482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009420 con 0x7feaa8003a60 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feabaffd700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa8003a60 0x7feaa8003e70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feab4009df0 tx=0x7feab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cef2dfdc1c3778 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4009740 con 0x7feaa8003a60 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400e8c0 con 0x7feaa8003a60 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.385+0000 7feab9ffb700 1 -- 172.21.15.26:0/3331200482 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400ec80 con 0x7feaa8003a60 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 -- 172.21.15.26:0/3331200482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa8003a60 msgr2=0x7feaa8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 --2- 172.21.15.26:0/3331200482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa8003a60 0x7feaa8003e70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feab4009df0 tx=0x7feab40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feabb7fe700 1 -- 172.21.15.26:0/3331200482 reap_dead start 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 -- 172.21.15.26:0/3331200482 shutdown_connections 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 -- 172.21.15.26:0/3331200482 >> 172.21.15.26:0/3331200482 conn(0x7feabc0703a0 msgr2=0x7feabc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 -- 172.21.15.26:0/3331200482 shutdown_connections 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.386+0000 7feac172e700 1 -- 172.21.15.26:0/3331200482 wait complete. 2023-10-09T11:37:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.387+0000 7feac172e700 1 Processor -- start 2023-10-09T11:37:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.387+0000 7feac172e700 1 -- start start 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc14d3e0 0x7feabc0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c86f0 0x7feabc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0ca6b0 con 0x7feabc0c8280 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0b3e40 con 0x7feabc0c86f0 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feac172e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0b4680 con 0x7feabc14d3e0 2023-10-09T11:37:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feaba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feaba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50720/0 (socket says 172.21.15.26:50720) 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feaba7fc700 1 -- 172.21.15.26:0/496163260 learned_addr learned my addr 172.21.15.26:0/496163260 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feabaffd700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc14d3e0 0x7feabc0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.388+0000 7feabb7fe700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c86f0 0x7feabc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 -- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc14d3e0 msgr2=0x7feabc0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc14d3e0 0x7feabc0c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 -- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c86f0 msgr2=0x7feabc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c86f0 0x7feabc0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 -- 172.21.15.26:0/496163260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc14d7b0 con 0x7feabc0c8280 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feaba7fc700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feaa4011da0 tx=0x7feaa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4011ea0 con 0x7feabc0c8280 2023-10-09T11:37:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400fc20 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc0ca3d0 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4014440 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.389+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc0b4310 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.390+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc0b4810 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.390+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7feaa4014830 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.391+0000 7feab2ffd700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 0x7fea9c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.391+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5223+0+0 (secure 0 0 0) 0x7feaa4018030 con 0x7feabc0c8280 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.391+0000 7feabaffd700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 0x7fea9c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.391+0000 7feabaffd700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 0x7fea9c069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feab400f010 tx=0x7feab401a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.395+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaa40522c0 con 0x7feabc0c8280 2023-10-09T11:37:09.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:09.588+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feabc0b44d0 con 0x7feabc0c8280 2023-10-09T11:37:10.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.246+0000 7feab2ffd700 1 -- 172.21.15.26:0/496163260 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7feaa40220d0 con 0x7feabc0c8280 2023-10-09T11:37:10.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 msgr2=0x7fea9c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 0x7fea9c069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feab400f010 tx=0x7feab401a000 comp rx=0 tx=0).stop 2023-10-09T11:37:10.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 msgr2=0x7feabc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feaa4011da0 tx=0x7feaa40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 shutdown_connections 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c86f0 0x7feabc0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea9c066fc0 0x7fea9c069470 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feab400f010 tx=0x7feab401a000 comp rx=0 tx=0).stop 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc14d3e0 0x7feabc0c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 --2- 172.21.15.26:0/496163260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feabc0c8280 0x7feabc0d0270 secure :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feaa4011da0 tx=0x7feaa40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.253+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 >> 172.21.15.26:0/496163260 conn(0x7feabc0703a0 msgr2=0x7feabc15c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.254+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 shutdown_connections 2023-10-09T11:37:10.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.254+0000 7feac172e700 1 -- 172.21.15.26:0/496163260 wait complete. 2023-10-09T11:37:10.261 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:37:10.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:37:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.396+0000 7f529a586700 1 Processor -- start 2023-10-09T11:37:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.397+0000 7f529a586700 1 -- start start 2023-10-09T11:37:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.397+0000 7f529a586700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 0x7f529406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.397+0000 7f529a586700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940ca480 con 0x7f5294142c00 2023-10-09T11:37:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.397+0000 7f529a586700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529415e240 con 0x7f5294142fd0 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.397+0000 7f529a586700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529406b350 con 0x7f52940c7f90 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299584700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5294142c00 0x7f529406b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37404/0 (socket says 172.21.15.26:37404) 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299584700 1 -- 172.21.15.26:0/2027776909 learned_addr learned my addr 172.21.15.26:0/2027776909 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299d85700 1 --2- 172.21.15.26:0/2027776909 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 0x7f529406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043234584 0 0) 0x7f52940ca480 con 0x7f5294142c00 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f527c003570 con 0x7f5294142c00 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009620572 0 0) 0x7f529415e240 con 0x7f5294142fd0 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52940ca480 con 0x7f5294142fd0 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299d85700 1 -- 172.21.15.26:0/2027776909 >> v1:172.21.15.67:6789/0 conn(0x7f5294142fd0 legacy=0x7f52940c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299d85700 1 -- 172.21.15.26:0/2027776909 >> v1:172.21.15.26:6789/0 conn(0x7f5294142c00 legacy=0x7f529406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889778798 0 0) 0x7f527c003570 con 0x7f5294142c00 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299d85700 1 -- 172.21.15.26:0/2027776909 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529415df60 con 0x7f52940c7f90 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.398+0000 7f5299d85700 1 --2- 172.21.15.26:0/2027776909 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 0x7f529406c6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f528c009910 tx=0x7f528c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3c3396a3cef447 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840017f0 con 0x7f52940c7f90 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c011420 con 0x7f52940c7f90 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f5293fff700 1 -- 172.21.15.26:0/2027776909 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0117a0 con 0x7f52940c7f90 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 -- 172.21.15.26:0/2027776909 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 msgr2=0x7f529406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 --2- 172.21.15.26:0/2027776909 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 0x7f529406c6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f528c009910 tx=0x7f528c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 -- 172.21.15.26:0/2027776909 shutdown_connections 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 --2- 172.21.15.26:0/2027776909 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52940c7f90 0x7f529406c6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 -- 172.21.15.26:0/2027776909 >> 172.21.15.26:0/2027776909 conn(0x7f52940675a0 msgr2=0x7f52940679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 -- 172.21.15.26:0/2027776909 shutdown_connections 2023-10-09T11:37:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.399+0000 7f529a586700 1 -- 172.21.15.26:0/2027776909 wait complete. 2023-10-09T11:37:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.400+0000 7f529a586700 1 Processor -- start 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.400+0000 7f529a586700 1 -- start start 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 0x7f529415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 0x7f5294169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c5730 con 0x7f52940c7f90 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c62b0 con 0x7f5294142fd0 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f529a586700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c5980 con 0x7f5294142c00 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46940/0 (socket says 172.21.15.26:46940) 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 -- 172.21.15.26:0/4099521053 learned_addr learned my addr 172.21.15.26:0/4099521053 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299d85700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 0x7f5294169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5298d83700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 0x7f529415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 -- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 msgr2=0x7f529415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 0x7f529415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 -- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 msgr2=0x7f5294169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 0x7f5294169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.401+0000 7f5299584700 1 -- 172.21.15.26:0/4099521053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009420 con 0x7f52940c7f90 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f5298d83700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 0x7f529415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f5299d85700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 0x7f5294169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f5299584700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f528400cc70 tx=0x7f5284007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400ce80 con 0x7f52940c7f90 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940c5c60 con 0x7f52940c7f90 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284004dc0 con 0x7f52940c7f90 2023-10-09T11:37:10.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400abb0 con 0x7f52940c7f90 2023-10-09T11:37:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.402+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529415a4d0 con 0x7f52940c7f90 2023-10-09T11:37:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.403+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529404c3c0 con 0x7f52940c7f90 2023-10-09T11:37:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.403+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5284007150 con 0x7f52940c7f90 2023-10-09T11:37:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.404+0000 7f52917fa700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 0x7f5280069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.404+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f5284083e30 con 0x7f52940c7f90 2023-10-09T11:37:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.404+0000 7f5298d83700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 0x7f5280069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.405+0000 7f5298d83700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 0x7f5280069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f52941424c0 tx=0x7f5288009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.408+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5284051110 con 0x7f52940c7f90 2023-10-09T11:37:10.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:10.647+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f529406ad00 con 0x7f52940c7f90 2023-10-09T11:37:11.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.261+0000 7f52917fa700 1 -- 172.21.15.26:0/4099521053 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5284018020 con 0x7f52940c7f90 2023-10-09T11:37:11.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 msgr2=0x7f5280069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 0x7f5280069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f52941424c0 tx=0x7f5288009040 comp rx=0 tx=0).stop 2023-10-09T11:37:11.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 msgr2=0x7f5294140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f528400cc70 tx=0x7f5284007d20 comp rx=0 tx=0).stop 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 shutdown_connections 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5294142fd0 0x7f5294169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52940c7f90 0x7f5294140a00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5280066fc0 0x7f5280069470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 --2- 172.21.15.26:0/4099521053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5294142c00 0x7f529415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.265+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 >> 172.21.15.26:0/4099521053 conn(0x7f52940675a0 msgr2=0x7f52940c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.266+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 shutdown_connections 2023-10-09T11:37:11.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.266+0000 7f529a586700 1 -- 172.21.15.26:0/4099521053 wait complete. 2023-10-09T11:37:11.268 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T11:37:11.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.400+0000 7fea6a4ae700 1 Processor -- start 2023-10-09T11:37:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.401+0000 7fea6a4ae700 1 -- start start 2023-10-09T11:37:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.401+0000 7fea6a4ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea641579a0 0x7fea640aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.401+0000 7fea6a4ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640c3d00 con 0x7fea640c95c0 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea6a4ae700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640cd660 con 0x7fea640caa00 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea6a4ae700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea640c3110 con 0x7fea641579a0 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea69cad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea641579a0 0x7fea640aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea694ac700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fea640c95c0 0x7fea64157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37418/0 (socket says 172.21.15.26:37418) 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea694ac700 1 -- 172.21.15.26:0/1098595549 learned_addr learned my addr 172.21.15.26:0/1098595549 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea69cad700 1 -- 172.21.15.26:0/1098595549 >> v1:172.21.15.67:6789/0 conn(0x7fea640caa00 legacy=0x7fea640ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea69cad700 1 -- 172.21.15.26:0/1098595549 >> v1:172.21.15.26:6789/0 conn(0x7fea640c95c0 legacy=0x7fea64157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea69cad700 1 -- 172.21.15.26:0/1098595549 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea640c33d0 con 0x7fea641579a0 2023-10-09T11:37:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea63fff700 1 -- 172.21.15.26:0/1098595549 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915652536 0 0) 0x7fea640c3d00 con 0x7fea640c95c0 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea69cad700 1 --2- 172.21.15.26:0/1098595549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea641579a0 0x7fea640aaec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0098e0 tx=0x7fea5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d137705fdbaeb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea63fff700 1 -- 172.21.15.26:0/1098595549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c009e80 con 0x7fea641579a0 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea63fff700 1 -- 172.21.15.26:0/1098595549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c00b820 con 0x7fea641579a0 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.402+0000 7fea63fff700 1 -- 172.21.15.26:0/1098595549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00bba0 con 0x7fea641579a0 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 -- 172.21.15.26:0/1098595549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea641579a0 msgr2=0x7fea640aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/1098595549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea641579a0 0x7fea640aaec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0098e0 tx=0x7fea5c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 -- 172.21.15.26:0/1098595549 shutdown_connections 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/1098595549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea641579a0 0x7fea640aaec0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 -- 172.21.15.26:0/1098595549 >> 172.21.15.26:0/1098595549 conn(0x7fea64088000 msgr2=0x7fea640ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 -- 172.21.15.26:0/1098595549 shutdown_connections 2023-10-09T11:37:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.403+0000 7fea6a4ae700 1 -- 172.21.15.26:0/1098595549 wait complete. 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.404+0000 7fea6a4ae700 1 Processor -- start 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.404+0000 7fea6a4ae700 1 -- start start 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 0x7fea6414fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea6415cc60 0x7fea64150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415dc50 con 0x7fea640c95c0 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64150b60 con 0x7fea641579a0 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea6a4ae700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415d3b0 con 0x7fea6415cc60 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46958/0 (socket says 172.21.15.26:46958) 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 -- 172.21.15.26:0/3071104732 learned_addr learned my addr 172.21.15.26:0/3071104732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea68cab700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 0x7fea6414fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea69cad700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea6415cc60 0x7fea64150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 -- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea6415cc60 msgr2=0x7fea64150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea6415cc60 0x7fea64150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 -- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 msgr2=0x7fea6414fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.405+0000 7fea694ac700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 0x7fea6414fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea694ac700 1 -- 172.21.15.26:0/3071104732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009420 con 0x7fea640c95c0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea68cab700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 0x7fea6414fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea694ac700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c8e0 tx=0x7fea540016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400ce80 con 0x7fea640c95c0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54005d80 con 0x7fea640c95c0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6415d690 con 0x7fea640c95c0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400a820 con 0x7fea640c95c0 2023-10-09T11:37:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.406+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6415d0c0 con 0x7fea640c95c0 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.407+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea640c85d0 con 0x7fea640c95c0 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.407+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fea5400ac10 con 0x7fea640c95c0 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.408+0000 7fea617fa700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 0x7fea50069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.408+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea540843a0 con 0x7fea640c95c0 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.408+0000 7fea68cab700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 0x7fea50069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.408+0000 7fea68cab700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 0x7fea50069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea58007fd0 tx=0x7fea58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.412+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea540515a0 con 0x7fea640c95c0 2023-10-09T11:37:11.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.606+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea64150e40 con 0x7fea640c95c0 2023-10-09T11:37:11.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.607+0000 7fea617fa700 1 -- 172.21.15.26:0/3071104732 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fea54054bc0 con 0x7fea640c95c0 2023-10-09T11:37:11.608 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:11.608 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":62,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:37:10.648416+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 msgr2=0x7fea50069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 0x7fea50069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea58007fd0 tx=0x7fea58009040 comp rx=0 tx=0).stop 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 msgr2=0x7fea641560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c8e0 tx=0x7fea540016f0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 shutdown_connections 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea50066fc0 0x7fea50069470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea6415cc60 0x7fea64150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea640c95c0 0x7fea641560f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 --2- 172.21.15.26:0/3071104732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea641579a0 0x7fea6414fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 >> 172.21.15.26:0/3071104732 conn(0x7fea64088000 msgr2=0x7fea64152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 shutdown_connections 2023-10-09T11:37:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.609+0000 7fea6a4ae700 1 -- 172.21.15.26:0/3071104732 wait complete. 2023-10-09T11:37:11.622 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:11.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.740+0000 7fbaeee26700 1 Processor -- start 2023-10-09T11:37:11.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.740+0000 7fbaeee26700 1 -- start start 2023-10-09T11:37:11.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae80cb5a0 0x7fbae80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae80cd9e0 0x7fbae8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 0x7fbae815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae80d13f0 con 0x7fbae80cb5a0 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae815a940 con 0x7fbae80cde50 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaeee26700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae815ae40 con 0x7fbae80cd9e0 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaecbc2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae80cb5a0 0x7fbae80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaecbc2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae80cb5a0 0x7fbae80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46970/0 (socket says 172.21.15.26:46970) 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaecbc2700 1 -- 172.21.15.26:0/3883434737 learned_addr learned my addr 172.21.15.26:0/3883434737 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbae7fff700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae80cd9e0 0x7fbae8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.741+0000 7fbaed3c3700 1 --2- 172.21.15.26:0/3883434737 >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 0x7fbae815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 -- 172.21.15.26:0/3883434737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae80cd9e0 msgr2=0x7fbae8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae80cd9e0 0x7fbae8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 -- 172.21.15.26:0/3883434737 >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 msgr2=0x7fbae815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/3883434737 >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 0x7fbae815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 -- 172.21.15.26:0/3883434737 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae815ab60 con 0x7fbae80cb5a0 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaed3c3700 1 --2- 172.21.15.26:0/3883434737 >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 0x7fbae815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cb5a0 0x7fbae80cb970 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbae80cbeb0 tx=0x7fbad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a238b39be89220 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbae77fe700 1 -- 172.21.15.26:0/3883434737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8009ea0 con 0x7fbae80cb5a0 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbae77fe700 1 -- 172.21.15.26:0/3883434737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b820 con 0x7fbae80cb5a0 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbae77fe700 1 -- 172.21.15.26:0/3883434737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bbc0 con 0x7fbae80cb5a0 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 -- 172.21.15.26:0/3883434737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cb5a0 msgr2=0x7fbae80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cb5a0 0x7fbae80cb970 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbae80cbeb0 tx=0x7fbad8009250 comp rx=0 tx=0).stop 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 -- 172.21.15.26:0/3883434737 shutdown_connections 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 --2- 172.21.15.26:0/3883434737 >> v2:172.21.15.67:3300/0 conn(0x7fbae80cde50 0x7fbae815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cb5a0 0x7fbae80cb970 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 --2- 172.21.15.26:0/3883434737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae80cd9e0 0x7fbae8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.742+0000 7fbaeee26700 1 -- 172.21.15.26:0/3883434737 >> 172.21.15.26:0/3883434737 conn(0x7fbae8070e30 msgr2=0x7fbae80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.743+0000 7fbaeee26700 1 -- 172.21.15.26:0/3883434737 shutdown_connections 2023-10-09T11:37:11.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.743+0000 7fbaeee26700 1 -- 172.21.15.26:0/3883434737 wait complete. 2023-10-09T11:37:11.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.744+0000 7fbaeee26700 1 Processor -- start 2023-10-09T11:37:11.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.744+0000 7fbaeee26700 1 -- start start 2023-10-09T11:37:11.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.744+0000 7fbaeee26700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae80cb5a0 0x7fbae80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.744+0000 7fbaeee26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae815bf50 0x7fbae80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae815c7a0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae815cd60 con 0x7fbae80cb5a0 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80ca0e0 con 0x7fbae815bf50 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46976/0 (socket says 172.21.15.26:46976) 2023-10-09T11:37:11.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 -- 172.21.15.26:0/1659088483 learned_addr learned my addr 172.21.15.26:0/1659088483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaed3c3700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae815bf50 0x7fbae80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae80cb5a0 0x7fbae80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 -- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae815bf50 msgr2=0x7fbae80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae815bf50 0x7fbae80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 -- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae80cb5a0 msgr2=0x7fbae80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae80cb5a0 0x7fbae80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 -- 172.21.15.26:0/1659088483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80094f0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae7fff700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00ecb0 tx=0x7fbadc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00c970 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc00cad0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00ce90 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80ca340 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.745+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae815c9f0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.746+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae804c3c0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.747+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbadc013680 con 0x7fbae80cd9e0 2023-10-09T11:37:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.747+0000 7fbae4ff9700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 0x7fbad4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.747+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbadc084840 con 0x7fbae80cd9e0 2023-10-09T11:37:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.747+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 0x7fbad4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.748+0000 7fbaecbc2700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 0x7fbad4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbae80cbeb0 tx=0x7fbad8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.752+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbadc051ac0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.947+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbae815cea0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.948+0000 7fbae4ff9700 1 -- 172.21.15.26:0/1659088483 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fbadc0550e0 con 0x7fbae80cd9e0 2023-10-09T11:37:11.949 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:11.949 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":62,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:37:10.648416+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:11.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 msgr2=0x7fbad4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 0x7fbad4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbae80cbeb0 tx=0x7fbad8017000 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 msgr2=0x7fbae8145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00ecb0 tx=0x7fbadc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 shutdown_connections 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4066fc0 0x7fbad4069470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae815bf50 0x7fbae80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae80cb5a0 0x7fbae80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 --2- 172.21.15.26:0/1659088483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae80cd9e0 0x7fbae8145280 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.950+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 >> 172.21.15.26:0/1659088483 conn(0x7fbae8070e30 msgr2=0x7fbae80b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.951+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 shutdown_connections 2023-10-09T11:37:11.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:11.951+0000 7fbaeee26700 1 -- 172.21.15.26:0/1659088483 wait complete. 2023-10-09T11:37:11.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:37:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.085+0000 7fd51619e700 1 Processor -- start 2023-10-09T11:37:12.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.085+0000 7fd51619e700 1 -- start start 2023-10-09T11:37:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 0x7fd510153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd51015de50 0x7fd51015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5100cea00 0x7fd5100cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51015af60 con 0x7fd5100cea00 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51015b240 con 0x7fd51015de50 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51619e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51015b520 con 0x7fd510153a00 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51599d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5100cea00 0x7fd5100cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51599d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5100cea00 0x7fd5100cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46978/0 (socket says 172.21.15.26:46978) 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51599d700 1 -- 172.21.15.26:0/912896148 learned_addr learned my addr 172.21.15.26:0/912896148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51499b700 1 --2- 172.21.15.26:0/912896148 >> v2:172.21.15.67:3300/0 conn(0x7fd51015de50 0x7fd51015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.086+0000 7fd51519c700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 0x7fd510153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 -- 172.21.15.26:0/912896148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 msgr2=0x7fd510153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 0x7fd510153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 -- 172.21.15.26:0/912896148 >> v2:172.21.15.67:3300/0 conn(0x7fd51015de50 msgr2=0x7fd51015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 --2- 172.21.15.26:0/912896148 >> v2:172.21.15.67:3300/0 conn(0x7fd51015de50 0x7fd51015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 -- 172.21.15.26:0/912896148 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51015b800 con 0x7fd5100cea00 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51519c700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 0x7fd510153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51599d700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100cee40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd51006e800 tx=0x7fd508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df573d453395bc2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd50ffff700 1 -- 172.21.15.26:0/912896148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800b860 con 0x7fd5100cea00 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd50ffff700 1 -- 172.21.15.26:0/912896148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800b9c0 con 0x7fd5100cea00 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd50ffff700 1 -- 172.21.15.26:0/912896148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800bd60 con 0x7fd5100cea00 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 -- 172.21.15.26:0/912896148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 msgr2=0x7fd5100cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100cee40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd51006e800 tx=0x7fd508009250 comp rx=0 tx=0).stop 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 -- 172.21.15.26:0/912896148 shutdown_connections 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100cee40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 --2- 172.21.15.26:0/912896148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd510153a00 0x7fd510153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 --2- 172.21.15.26:0/912896148 >> v2:172.21.15.67:3300/0 conn(0x7fd51015de50 0x7fd51015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.087+0000 7fd51619e700 1 -- 172.21.15.26:0/912896148 >> 172.21.15.26:0/912896148 conn(0x7fd5100703a0 msgr2=0x7fd5100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.088+0000 7fd51619e700 1 -- 172.21.15.26:0/912896148 shutdown_connections 2023-10-09T11:37:12.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.088+0000 7fd51619e700 1 -- 172.21.15.26:0/912896148 wait complete. 2023-10-09T11:37:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.089+0000 7fd51619e700 1 Processor -- start 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.089+0000 7fd51619e700 1 -- start start 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 0x7fd5100cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 0x7fd5100cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100cc300 con 0x7fd5100cea00 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100cd140 con 0x7fd510153a00 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100cc530 con 0x7fd51015de50 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46982/0 (socket says 172.21.15.26:46982) 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 -- 172.21.15.26:0/1660710901 learned_addr learned my addr 172.21.15.26:0/1660710901 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51499b700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 0x7fd5100cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51599d700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 0x7fd5100cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 -- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 msgr2=0x7fd5100cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 0x7fd5100cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 -- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 msgr2=0x7fd5100cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 0x7fd5100cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 -- 172.21.15.26:0/1660710901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080094f0 con 0x7fd5100cea00 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51599d700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 0x7fd5100cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51499b700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 0x7fd5100cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51519c700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd50000a400 tx=0x7fd500007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000d650 con 0x7fd5100cea00 2023-10-09T11:37:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000d7b0 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100cc810 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000db50 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.090+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5100ccdd0 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.091+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5100cd420 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.092+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd500015440 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.092+0000 7fd50d7fa700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 0x7fd4fc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.092+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd500084e30 con 0x7fd5100cea00 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.092+0000 7fd51499b700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 0x7fd4fc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.093+0000 7fd51499b700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 0x7fd4fc069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5100cbc70 tx=0x7fd504008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.096+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd50004e5a0 con 0x7fd5100cea00 2023-10-09T11:37:12.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:12.336+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd51004c3c0 con 0x7fd5100cea00 2023-10-09T11:37:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.269+0000 7fd50d7fa700 1 -- 172.21.15.26:0/1660710901 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd500052160 con 0x7fd5100cea00 2023-10-09T11:37:13.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 msgr2=0x7fd4fc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 0x7fd4fc069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5100cbc70 tx=0x7fd504008040 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 msgr2=0x7fd5100c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd50000a400 tx=0x7fd500007910 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 shutdown_connections 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4fc066fc0 0x7fd4fc069470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd51015de50 0x7fd5100cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5100cea00 0x7fd5100c8040 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 --2- 172.21.15.26:0/1660710901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd510153a00 0x7fd5100cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 >> 172.21.15.26:0/1660710901 conn(0x7fd5100703a0 msgr2=0x7fd5100b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 shutdown_connections 2023-10-09T11:37:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.272+0000 7fd51619e700 1 -- 172.21.15.26:0/1660710901 wait complete. 2023-10-09T11:37:13.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:37:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 Processor -- start 2023-10-09T11:37:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 -- start start 2023-10-09T11:37:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd048159530 0x7fd0480ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd04806e0e0 0x7fd0480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480ccfd0 con 0x7fd04806dc70 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480cf0e0 con 0x7fd04806e0e0 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.412+0000 7fd04e880700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04815a3d0 con 0x7fd048159530 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd04806e0e0 0x7fd0480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd0477fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd04806dc70 0x7fd048159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37422/0 (socket says 172.21.15.26:37422) 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd0477fe700 1 -- 172.21.15.26:0/3565520036 learned_addr learned my addr 172.21.15.26:0/3565520036 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd047fff700 1 --2- 172.21.15.26:0/3565520036 >> v2:172.21.15.67:3300/0 conn(0x7fd048159530 0x7fd0480ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 -- 172.21.15.26:0/3565520036 >> v2:172.21.15.67:3300/0 conn(0x7fd048159530 msgr2=0x7fd0480ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 --2- 172.21.15.26:0/3565520036 >> v2:172.21.15.67:3300/0 conn(0x7fd048159530 0x7fd0480ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 -- 172.21.15.26:0/3565520036 >> v1:172.21.15.26:6789/0 conn(0x7fd04806dc70 legacy=0x7fd048159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd046ffd700 1 -- 172.21.15.26:0/3565520036 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132899378 0 0) 0x7fd0480ccfd0 con 0x7fd04806dc70 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 -- 172.21.15.26:0/3565520036 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04815a6b0 con 0x7fd04806e0e0 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd04ce1d700 1 --2- 172.21.15.26:0/3565520036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806e0e0 0x7fd0480cb6f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd04806d630 tx=0x7fd040009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16baca05a75fd0b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd046ffd700 1 -- 172.21.15.26:0/3565520036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04000e070 con 0x7fd04806e0e0 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd046ffd700 1 -- 172.21.15.26:0/3565520036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04000bc30 con 0x7fd04806e0e0 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.413+0000 7fd046ffd700 1 -- 172.21.15.26:0/3565520036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040012430 con 0x7fd04806e0e0 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 -- 172.21.15.26:0/3565520036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806e0e0 msgr2=0x7fd0480cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 --2- 172.21.15.26:0/3565520036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806e0e0 0x7fd0480cb6f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd04806d630 tx=0x7fd040009780 comp rx=0 tx=0).stop 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 -- 172.21.15.26:0/3565520036 shutdown_connections 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 --2- 172.21.15.26:0/3565520036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806e0e0 0x7fd0480cb6f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 --2- 172.21.15.26:0/3565520036 >> v2:172.21.15.67:3300/0 conn(0x7fd048159530 0x7fd0480ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 -- 172.21.15.26:0/3565520036 >> 172.21.15.26:0/3565520036 conn(0x7fd0480703a0 msgr2=0x7fd0480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 -- 172.21.15.26:0/3565520036 shutdown_connections 2023-10-09T11:37:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.414+0000 7fd04e880700 1 -- 172.21.15.26:0/3565520036 wait complete. 2023-10-09T11:37:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.415+0000 7fd04e880700 1 Processor -- start 2023-10-09T11:37:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.415+0000 7fd04e880700 1 -- start start 2023-10-09T11:37:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 0x7fd0480c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd048159530 0x7fd0480d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481548a0 con 0x7fd04806dc70 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd048155fc0 con 0x7fd04806e0e0 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04e880700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480c79e0 con 0x7fd048159530 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47004/0 (socket says 172.21.15.26:47004) 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 -- 172.21.15.26:0/3117982343 learned_addr learned my addr 172.21.15.26:0/3117982343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd04ce1d700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd048159530 0x7fd0480d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd0477fe700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 0x7fd0480c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 -- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd048159530 msgr2=0x7fd0480d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd048159530 0x7fd0480d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 -- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 msgr2=0x7fd0480c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 0x7fd0480c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd047fff700 1 -- 172.21.15.26:0/3117982343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009a20 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.416+0000 7fd0477fe700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 0x7fd0480c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd047fff700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd03800d860 tx=0x7fd038008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0380125f0 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038012750 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048156260 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038012b10 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.417+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd048156820 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.418+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0481569e0 con 0x7fd04806dc70 2023-10-09T11:37:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.418+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd03801e460 con 0x7fd04806dc70 2023-10-09T11:37:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.418+0000 7fd02ffff700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 0x7fd034069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.418+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd038084ac0 con 0x7fd04806dc70 2023-10-09T11:37:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.419+0000 7fd0477fe700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 0x7fd034069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.419+0000 7fd0477fe700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 0x7fd034069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0481588e0 tx=0x7fd03c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.423+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd038051d40 con 0x7fd04806dc70 2023-10-09T11:37:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:13.661+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd04804c3c0 con 0x7fd04806dc70 2023-10-09T11:37:14.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.270+0000 7fd02ffff700 1 -- 172.21.15.26:0/3117982343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd038055360 con 0x7fd04806dc70 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 msgr2=0x7fd034069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 0x7fd034069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0481588e0 tx=0x7fd03c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 msgr2=0x7fd048143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd03800d860 tx=0x7fd038008040 comp rx=0 tx=0).stop 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 shutdown_connections 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd034066fc0 0x7fd034069470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd048159530 0x7fd0480d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd04806dc70 0x7fd048143ce0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 --2- 172.21.15.26:0/3117982343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd04806e0e0 0x7fd0480c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 >> 172.21.15.26:0/3117982343 conn(0x7fd0480703a0 msgr2=0x7fd0480d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 shutdown_connections 2023-10-09T11:37:14.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.273+0000 7fd04e880700 1 -- 172.21.15.26:0/3117982343 wait complete. 2023-10-09T11:37:14.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:14.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.411+0000 7f68d3bf5700 1 Processor -- start 2023-10-09T11:37:14.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.411+0000 7f68d3bf5700 1 -- start start 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68cc0cb5a0 0x7f68cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f68cc0cd9e0 0x7f68cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc15a400 0x7f68cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0d13f0 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc15ae40 con 0x7f68cc0cd9e0 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d3bf5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15ab60 con 0x7f68cc15a400 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68cc0cb5a0 0x7f68cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68cc0cb5a0 0x7f68cc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47014/0 (socket says 172.21.15.26:47014) 2023-10-09T11:37:14.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 -- 172.21.15.26:0/1976922579 learned_addr learned my addr 172.21.15.26:0/1976922579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d2192700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc15a400 0x7f68cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1190700 1 --2- 172.21.15.26:0/1976922579 >> v2:172.21.15.67:3300/0 conn(0x7f68cc0cd9e0 0x7f68cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 -- 172.21.15.26:0/1976922579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc15a400 msgr2=0x7f68cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc15a400 0x7f68cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 -- 172.21.15.26:0/1976922579 >> v2:172.21.15.67:3300/0 conn(0x7f68cc0cd9e0 msgr2=0x7f68cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 --2- 172.21.15.26:0/1976922579 >> v2:172.21.15.67:3300/0 conn(0x7f68cc0cd9e0 0x7f68cc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.412+0000 7f68d1991700 1 -- 172.21.15.26:0/1976922579 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0ccf00 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d1991700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc0cb5a0 0x7f68cc0cb970 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f68c80099b0 tx=0x7f68c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d7f1c6df250b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d098f700 1 -- 172.21.15.26:0/1976922579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800b640 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d098f700 1 -- 172.21.15.26:0/1976922579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800b7a0 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d098f700 1 -- 172.21.15.26:0/1976922579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800bb40 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1976922579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc0cb5a0 msgr2=0x7f68cc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc0cb5a0 0x7f68cc0cb970 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f68c80099b0 tx=0x7f68c8009250 comp rx=0 tx=0).stop 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1976922579 shutdown_connections 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc15a400 0x7f68cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1976922579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc0cb5a0 0x7f68cc0cb970 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1976922579 >> v2:172.21.15.67:3300/0 conn(0x7f68cc0cd9e0 0x7f68cc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1976922579 >> 172.21.15.26:0/1976922579 conn(0x7f68cc070e30 msgr2=0x7f68cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1976922579 shutdown_connections 2023-10-09T11:37:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.413+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1976922579 wait complete. 2023-10-09T11:37:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.414+0000 7f68d3bf5700 1 Processor -- start 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.414+0000 7f68d3bf5700 1 -- start start 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc0cb5a0 0x7f68cc15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0cd9e0 0x7f68cc0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c8dc0 con 0x7f68cc15a400 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15e3c0 con 0x7f68cc0cd9e0 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d3bf5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c8ff0 con 0x7f68cc0cb5a0 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d2192700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d2192700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47026/0 (socket says 172.21.15.26:47026) 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d2192700 1 -- 172.21.15.26:0/1607864790 learned_addr learned my addr 172.21.15.26:0/1607864790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:14.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d1991700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc0cb5a0 0x7f68cc15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.415+0000 7f68d1190700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0cd9e0 0x7f68cc0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 -- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc0cb5a0 msgr2=0x7f68cc15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc0cb5a0 0x7f68cc15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 -- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0cd9e0 msgr2=0x7f68cc0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0cd9e0 0x7f68cc0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 -- 172.21.15.26:0/1607864790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c80094f0 con 0x7f68cc15a400 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d2192700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009df0 tx=0x7f68c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400caa0 con 0x7f68cc15a400 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c400f040 con 0x7f68cc15a400 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc16d160 con 0x7f68cc15a400 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400ce70 con 0x7f68cc15a400 2023-10-09T11:37:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.416+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc15bbb0 con 0x7f68cc15a400 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.417+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc04c3c0 con 0x7f68cc15a400 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.417+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f68c4014690 con 0x7f68cc15a400 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.418+0000 7f68c1ffb700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 0x7f68b0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.418+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68c4084e70 con 0x7f68cc15a400 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.418+0000 7f68d1991700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 0x7f68b0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.419+0000 7f68d1991700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 0x7f68b0069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68c80099b0 tx=0x7f68c8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.422+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68c4055a70 con 0x7f68cc15a400 2023-10-09T11:37:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.659+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc0cd210 con 0x7f68cc15a400 2023-10-09T11:37:14.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.659+0000 7f68c1ffb700 1 -- 172.21.15.26:0/1607864790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f68c4055600 con 0x7f68cc15a400 2023-10-09T11:37:14.660 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:14.660 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:37:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 msgr2=0x7f68b0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 0x7f68b0069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68c80099b0 tx=0x7f68c8017000 comp rx=0 tx=0).stop 2023-10-09T11:37:14.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 msgr2=0x7f68cc16cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009df0 tx=0x7f68c400b040 comp rx=0 tx=0).stop 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 shutdown_connections 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68cc15a400 0x7f68cc16cc20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f68b0066fc0 0x7f68b0069470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68cc0cb5a0 0x7f68cc15b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 --2- 172.21.15.26:0/1607864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0cd9e0 0x7f68cc0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 >> 172.21.15.26:0/1607864790 conn(0x7f68cc070e30 msgr2=0x7f68cc0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 shutdown_connections 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.661+0000 7f68d3bf5700 1 -- 172.21.15.26:0/1607864790 wait complete. 2023-10-09T11:37:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 39 2023-10-09T11:37:14.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.792+0000 7f0dcac72700 1 Processor -- start 2023-10-09T11:37:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 -- start start 2023-10-09T11:37:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0dc40cd9e0 0x7f0dc4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc415ae40 con 0x7f0dc40cde50 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40d13f0 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.793+0000 7f0dcac72700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc415ab60 con 0x7f0dc40cb5a0 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0dc40cd9e0 0x7f0dc4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc920f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0dc40cde50 0x7f0dc4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37428/0 (socket says 172.21.15.26:37428) 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc920f700 1 -- 172.21.15.26:0/3803030669 learned_addr learned my addr 172.21.15.26:0/3803030669 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc8a0e700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3803030669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 msgr2=0x7f0dc40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3803030669 >> v1:172.21.15.26:6789/0 conn(0x7f0dc40cde50 legacy=0x7f0dc4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc37fe700 1 -- 172.21.15.26:0/3803030669 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751007263 0 0) 0x7f0dc415ae40 con 0x7f0dc40cde50 2023-10-09T11:37:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3803030669 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40ccf00 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc8a0e700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc3fff700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc4159ec0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009e60 tx=0x7f0db4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7781c367f28276e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc37fe700 1 -- 172.21.15.26:0/3803030669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400e070 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc37fe700 1 -- 172.21.15.26:0/3803030669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400bc30 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.794+0000 7f0dc37fe700 1 -- 172.21.15.26:0/3803030669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4012430 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 -- 172.21.15.26:0/3803030669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 msgr2=0x7f0dc4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc4159ec0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009e60 tx=0x7f0db4009780 comp rx=0 tx=0).stop 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 -- 172.21.15.26:0/3803030669 shutdown_connections 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3803030669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc4159ec0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 -- 172.21.15.26:0/3803030669 >> 172.21.15.26:0/3803030669 conn(0x7f0dc4070e30 msgr2=0x7f0dc40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 -- 172.21.15.26:0/3803030669 shutdown_connections 2023-10-09T11:37:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.795+0000 7f0dcac72700 1 -- 172.21.15.26:0/3803030669 wait complete. 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.796+0000 7f0dcac72700 1 Processor -- start 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.796+0000 7f0dcac72700 1 -- start start 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc415dbb0 0x7f0dc41424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c8c20 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c8010 con 0x7f0dc415dbb0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dcac72700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40c82f0 con 0x7f0dc40cb5a0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47050/0 (socket says 172.21.15.26:47050) 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3030710487 learned_addr learned my addr 172.21.15.26:0/3030710487 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc920f700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc415dbb0 0x7f0dc41424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 msgr2=0x7f0dc40c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc415dbb0 msgr2=0x7f0dc41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc415dbb0 0x7f0dc41424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 -- 172.21.15.26:0/3030710487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4009a20 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.797+0000 7f0dc3fff700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406ea60 tx=0x7f0db4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4012e50 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db401d630 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc40c85d0 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db401d9f0 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40c7d00 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.798+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc404c3c0 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.799+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0db4024070 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.799+0000 7f0dc0ff9700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 0x7f0da4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.799+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0db4086c30 con 0x7f0dc40cd9e0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.799+0000 7f0dc8a0e700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 0x7f0da4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.800+0000 7f0dc8a0e700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 0x7f0da4069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dac007aa0 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:14.804+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db4053eb0 con 0x7f0dc40cd9e0 2023-10-09T11:37:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.001+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc40c8d60 con 0x7f0dc40cd9e0 2023-10-09T11:37:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.002+0000 7f0dc0ff9700 1 -- 172.21.15.26:0/3030710487 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f0db40574d0 con 0x7f0dc40cd9e0 2023-10-09T11:37:15.002 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:15.002 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":63,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:37:12.255113+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 msgr2=0x7f0da4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 0x7f0da4069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dac007aa0 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 msgr2=0x7f0dc40c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406ea60 tx=0x7f0db4019000 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 shutdown_connections 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dc415dbb0 0x7f0dc41424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0da4066fc0 0x7f0da4069470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dc40cb5a0 0x7f0dc40c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 --2- 172.21.15.26:0/3030710487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dc40cd9e0 0x7f0dc40c77c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 >> 172.21.15.26:0/3030710487 conn(0x7f0dc4070e30 msgr2=0x7f0dc40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 shutdown_connections 2023-10-09T11:37:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.004+0000 7f0dcac72700 1 -- 172.21.15.26:0/3030710487 wait complete. 2023-10-09T11:37:15.017 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:37:15.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.135+0000 7f9095515700 1 Processor -- start 2023-10-09T11:37:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.135+0000 7f9095515700 1 -- start start 2023-10-09T11:37:15.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f9095515700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 0x7f90900cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f9095515700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90900a90d0 0x7f909006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f9095515700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900aeee0 con 0x7f909006e380 2023-10-09T11:37:15.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f9095515700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909006e820 con 0x7f90900a90d0 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f9095515700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900ae680 con 0x7f90900a8d00 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f908e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90900a90d0 0x7f909006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f908e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90900a90d0 0x7f909006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47066/0 (socket says 172.21.15.26:47066) 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.136+0000 7f908e7fc700 1 -- 172.21.15.26:0/1292227936 learned_addr learned my addr 172.21.15.26:0/1292227936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908effd700 1 --2- 172.21.15.26:0/1292227936 >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 0x7f90900cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908e7fc700 1 -- 172.21.15.26:0/1292227936 >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 msgr2=0x7f90900cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1292227936 >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 0x7f90900cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908e7fc700 1 -- 172.21.15.26:0/1292227936 >> v1:172.21.15.67:6789/0 conn(0x7f909006e380 legacy=0x7f90900cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908e7fc700 1 -- 172.21.15.26:0/1292227936 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900cf490 con 0x7f90900a90d0 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908effd700 1 --2- 172.21.15.26:0/1292227936 >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 0x7f90900cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1292227936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90900a90d0 0x7f909006de40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9078009990 tx=0x7f9078009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9544f87174799f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908dffb700 1 -- 172.21.15.26:0/1292227936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078005c10 con 0x7f90900a90d0 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908dffb700 1 -- 172.21.15.26:0/1292227936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078005d70 con 0x7f90900a90d0 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.137+0000 7f908dffb700 1 -- 172.21.15.26:0/1292227936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800b840 con 0x7f90900a90d0 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 -- 172.21.15.26:0/1292227936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90900a90d0 msgr2=0x7f909006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 --2- 172.21.15.26:0/1292227936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90900a90d0 0x7f909006de40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9078009990 tx=0x7f9078009220 comp rx=0 tx=0).stop 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 -- 172.21.15.26:0/1292227936 shutdown_connections 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 --2- 172.21.15.26:0/1292227936 >> v2:172.21.15.67:3300/0 conn(0x7f90900a8d00 0x7f90900cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 --2- 172.21.15.26:0/1292227936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90900a90d0 0x7f909006de40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 -- 172.21.15.26:0/1292227936 >> 172.21.15.26:0/1292227936 conn(0x7f909006ce80 msgr2=0x7f90900ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 -- 172.21.15.26:0/1292227936 shutdown_connections 2023-10-09T11:37:15.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.138+0000 7f9095515700 1 -- 172.21.15.26:0/1292227936 wait complete. 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.139+0000 7f9095515700 1 Processor -- start 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.139+0000 7f9095515700 1 -- start start 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 0x7f909015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 0x7f909009a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909009c080 con 0x7f909006e380 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015ca80 con 0x7f90900a8d00 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909009aaa0 con 0x7f90900a90d0 2023-10-09T11:37:15.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47080/0 (socket says 172.21.15.26:47080) 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 -- 172.21.15.26:0/1382067497 learned_addr learned my addr 172.21.15.26:0/1382067497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 -- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 msgr2=0x7f909009a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 0x7f909015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908f7fe700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 0x7f909009a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 0x7f909009a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 -- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 msgr2=0x7f909015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 0x7f909015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 -- 172.21.15.26:0/1382067497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009480 con 0x7f909006e380 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 0x7f909015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908f7fe700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 0x7f909009a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:15.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f908effd700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f908000d220 tx=0x7f9080009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080015440 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000f040 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909009ad80 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800157d0 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.140+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909009b340 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.141+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909009b990 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.142+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9080015c00 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.142+0000 7f9086ffd700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 0x7f9070069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.143+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9080084b60 con 0x7f909006e380 2023-10-09T11:37:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.143+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 0x7f9070069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.143+0000 7f908e7fc700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 0x7f9070069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9078007fd0 tx=0x7f9078016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.147+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f908004e5a0 con 0x7f909006e380 2023-10-09T11:37:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.336+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f909004c3c0 con 0x7f9070066fc0 2023-10-09T11:37:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.346+0000 7f9086ffd700 1 -- 172.21.15.26:0/1382067497 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282589 (secure 0 0 0) 0x7f909004c3c0 con 0x7f9070066fc0 2023-10-09T11:37:15.350 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:15.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 msgr2=0x7f9070069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 0x7f9070069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9078007fd0 tx=0x7f9078016000 comp rx=0 tx=0).stop 2023-10-09T11:37:15.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 msgr2=0x7f909009bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f908000d220 tx=0x7f9080009ae0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 shutdown_connections 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9070066fc0 0x7f9070069470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90900a90d0 0x7f909009a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f909006e380 0x7f909009bb40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 --2- 172.21.15.26:0/1382067497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90900a8d00 0x7f909015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 >> 172.21.15.26:0/1382067497 conn(0x7f909006ce80 msgr2=0x7f90900b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 shutdown_connections 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.349+0000 7f9095515700 1 -- 172.21.15.26:0/1382067497 wait complete. 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:37:15.362 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-10-09T11:37:15.130597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397464,"kb_used_data":6872,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577256,"statfs":{"total":773094113280,"available":770639110144,"internally_reserved":0,"allocated":7036928,"data_stored":3642884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891435"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253674+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247636+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:00.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249305+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:21.436362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250690+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248396+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:20.555622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253497+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256418+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:32.650724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250169+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249016+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:58.939663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251724+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250621+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252317+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256870+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:33.420682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.258282+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254455+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252480+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250897+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250141+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247590+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.651563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252363+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.267368+0000","last_change":"2023-10-09T11:37:10.267368+0000","last_active":"2023-10-09T11:37:10.267368+0000","last_peered":"2023-10-09T11:37:10.267368+0000","last_clean":"2023-10-09T11:37:10.267368+0000","last_became_active":"2023-10-09T11:37:10.267112+0000","last_became_peered":"2023-10-09T11:37:10.267112+0000","last_unstale":"2023-10-09T11:37:10.267368+0000","last_undegraded":"2023-10-09T11:37:10.267368+0000","last_fullsized":"2023-10-09T11:37:10.267368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:29.602389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245503+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:28.609784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249320+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.309819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264621+0000","last_change":"2023-10-09T11:37:10.264621+0000","last_active":"2023-10-09T11:37:10.264621+0000","last_peered":"2023-10-09T11:37:10.264621+0000","last_clean":"2023-10-09T11:37:10.264621+0000","last_became_active":"2023-10-09T11:37:10.264308+0000","last_became_peered":"2023-10-09T11:37:10.264308+0000","last_unstale":"2023-10-09T11:37:10.264621+0000","last_undegraded":"2023-10-09T11:37:10.264621+0000","last_fullsized":"2023-10-09T11:37:10.264621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255990+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:41.956410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256443+0000","last_change":"2023-10-09T11:37:10.256443+0000","last_active":"2023-10-09T11:37:10.256443+0000","last_peered":"2023-10-09T11:37:10.256443+0000","last_clean":"2023-10-09T11:37:10.256443+0000","last_became_active":"2023-10-09T11:37:10.255918+0000","last_became_peered":"2023-10-09T11:37:10.255918+0000","last_unstale":"2023-10-09T11:37:10.256443+0000","last_undegraded":"2023-10-09T11:37:10.256443+0000","last_fullsized":"2023-10-09T11:37:10.256443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.993290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250516+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249432+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:32.411655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250854+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.258523+0000","last_change":"2023-10-09T11:37:10.258523+0000","last_active":"2023-10-09T11:37:10.258523+0000","last_peered":"2023-10-09T11:37:10.258523+0000","last_clean":"2023-10-09T11:37:10.258523+0000","last_became_active":"2023-10-09T11:37:10.258253+0000","last_became_peered":"2023-10-09T11:37:10.258253+0000","last_unstale":"2023-10-09T11:37:10.258523+0000","last_undegraded":"2023-10-09T11:37:10.258523+0000","last_fullsized":"2023-10-09T11:37:10.258523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:17.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247181+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:59.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244677+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:06.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253973+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264721+0000","last_change":"2023-10-09T11:37:10.264721+0000","last_active":"2023-10-09T11:37:10.264721+0000","last_peered":"2023-10-09T11:37:10.264721+0000","last_clean":"2023-10-09T11:37:10.264721+0000","last_became_active":"2023-10-09T11:37:10.264425+0000","last_became_peered":"2023-10-09T11:37:10.264425+0000","last_unstale":"2023-10-09T11:37:10.264721+0000","last_undegraded":"2023-10-09T11:37:10.264721+0000","last_fullsized":"2023-10-09T11:37:10.264721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253253+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259720+0000","last_change":"2023-10-09T11:37:10.259720+0000","last_active":"2023-10-09T11:37:10.259720+0000","last_peered":"2023-10-09T11:37:10.259720+0000","last_clean":"2023-10-09T11:37:10.259720+0000","last_became_active":"2023-10-09T11:37:10.259416+0000","last_became_peered":"2023-10-09T11:37:10.259416+0000","last_unstale":"2023-10-09T11:37:10.259720+0000","last_undegraded":"2023-10-09T11:37:10.259720+0000","last_fullsized":"2023-10-09T11:37:10.259720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:26.710877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248634+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:54.860317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249486+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:56.781268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247125+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:29.642536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254936+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:37.090746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.246862+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.882658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251273+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.260859+0000","last_change":"2023-10-09T11:37:10.260859+0000","last_active":"2023-10-09T11:37:10.260859+0000","last_peered":"2023-10-09T11:37:10.260859+0000","last_clean":"2023-10-09T11:37:10.260859+0000","last_became_active":"2023-10-09T11:37:10.260521+0000","last_became_peered":"2023-10-09T11:37:10.260521+0000","last_unstale":"2023-10-09T11:37:10.260859+0000","last_undegraded":"2023-10-09T11:37:10.260859+0000","last_fullsized":"2023-10-09T11:37:10.260859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:07.504912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253911+0000","last_change":"2023-10-09T11:37:10.253911+0000","last_active":"2023-10-09T11:37:10.253911+0000","last_peered":"2023-10-09T11:37:10.253911+0000","last_clean":"2023-10-09T11:37:10.253911+0000","last_became_active":"2023-10-09T11:37:10.253637+0000","last_became_peered":"2023-10-09T11:37:10.253637+0000","last_unstale":"2023-10-09T11:37:10.253911+0000","last_undegraded":"2023-10-09T11:37:10.253911+0000","last_fullsized":"2023-10-09T11:37:10.253911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.263400+0000","last_change":"2023-10-09T11:37:10.263400+0000","last_active":"2023-10-09T11:37:10.263400+0000","last_peered":"2023-10-09T11:37:10.263400+0000","last_clean":"2023-10-09T11:37:10.263400+0000","last_became_active":"2023-10-09T11:37:10.263092+0000","last_became_peered":"2023-10-09T11:37:10.263092+0000","last_unstale":"2023-10-09T11:37:10.263400+0000","last_undegraded":"2023-10-09T11:37:10.263400+0000","last_fullsized":"2023-10-09T11:37:10.263400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:28.300792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252391+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257739+0000","last_change":"2023-10-09T11:37:10.257739+0000","last_active":"2023-10-09T11:37:10.257739+0000","last_peered":"2023-10-09T11:37:10.257739+0000","last_clean":"2023-10-09T11:37:10.257739+0000","last_became_active":"2023-10-09T11:37:10.257447+0000","last_became_peered":"2023-10-09T11:37:10.257447+0000","last_unstale":"2023-10-09T11:37:10.257739+0000","last_undegraded":"2023-10-09T11:37:10.257739+0000","last_fullsized":"2023-10-09T11:37:10.257739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:33.970302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252751+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262395+0000","last_change":"2023-10-09T11:37:10.262395+0000","last_active":"2023-10-09T11:37:10.262395+0000","last_peered":"2023-10-09T11:37:10.262395+0000","last_clean":"2023-10-09T11:37:10.262395+0000","last_became_active":"2023-10-09T11:37:10.262108+0000","last_became_peered":"2023-10-09T11:37:10.262108+0000","last_unstale":"2023-10-09T11:37:10.262395+0000","last_undegraded":"2023-10-09T11:37:10.262395+0000","last_fullsized":"2023-10-09T11:37:10.262395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264262+0000","last_change":"2023-10-09T11:37:10.264262+0000","last_active":"2023-10-09T11:37:10.264262+0000","last_peered":"2023-10-09T11:37:10.264262+0000","last_clean":"2023-10-09T11:37:10.264262+0000","last_became_active":"2023-10-09T11:37:10.263996+0000","last_became_peered":"2023-10-09T11:37:10.263996+0000","last_unstale":"2023-10-09T11:37:10.264262+0000","last_undegraded":"2023-10-09T11:37:10.264262+0000","last_fullsized":"2023-10-09T11:37:10.264262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:13.533137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.266077+0000","last_change":"2023-10-09T11:37:10.266077+0000","last_active":"2023-10-09T11:37:10.266077+0000","last_peered":"2023-10-09T11:37:10.266077+0000","last_clean":"2023-10-09T11:37:10.266077+0000","last_became_active":"2023-10-09T11:37:10.265779+0000","last_became_peered":"2023-10-09T11:37:10.265779+0000","last_unstale":"2023-10-09T11:37:10.266077+0000","last_undegraded":"2023-10-09T11:37:10.266077+0000","last_fullsized":"2023-10-09T11:37:10.266077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:00.625064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253918+0000","last_change":"2023-10-09T11:37:10.253918+0000","last_active":"2023-10-09T11:37:10.253918+0000","last_peered":"2023-10-09T11:37:10.253918+0000","last_clean":"2023-10-09T11:37:10.253918+0000","last_became_active":"2023-10-09T11:37:10.253581+0000","last_became_peered":"2023-10-09T11:37:10.253581+0000","last_unstale":"2023-10-09T11:37:10.253918+0000","last_undegraded":"2023-10-09T11:37:10.253918+0000","last_fullsized":"2023-10-09T11:37:10.253918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:21.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257958+0000","last_change":"2023-10-09T11:37:10.257958+0000","last_active":"2023-10-09T11:37:10.257958+0000","last_peered":"2023-10-09T11:37:10.257958+0000","last_clean":"2023-10-09T11:37:10.257958+0000","last_became_active":"2023-10-09T11:37:10.257648+0000","last_became_peered":"2023-10-09T11:37:10.257648+0000","last_unstale":"2023-10-09T11:37:10.257958+0000","last_undegraded":"2023-10-09T11:37:10.257958+0000","last_fullsized":"2023-10-09T11:37:10.257958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245440+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:03.707975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.255048+0000","last_change":"2023-10-09T11:37:10.255048+0000","last_active":"2023-10-09T11:37:10.255048+0000","last_peered":"2023-10-09T11:37:10.255048+0000","last_clean":"2023-10-09T11:37:10.255048+0000","last_became_active":"2023-10-09T11:37:10.254710+0000","last_became_peered":"2023-10-09T11:37:10.254710+0000","last_unstale":"2023-10-09T11:37:10.255048+0000","last_undegraded":"2023-10-09T11:37:10.255048+0000","last_fullsized":"2023-10-09T11:37:10.255048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:07.358828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252959+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:11.101264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259893+0000","last_change":"2023-10-09T11:37:10.259893+0000","last_active":"2023-10-09T11:37:10.259893+0000","last_peered":"2023-10-09T11:37:10.259893+0000","last_clean":"2023-10-09T11:37:10.259893+0000","last_became_active":"2023-10-09T11:37:10.259638+0000","last_became_peered":"2023-10-09T11:37:10.259638+0000","last_unstale":"2023-10-09T11:37:10.259893+0000","last_undegraded":"2023-10-09T11:37:10.259893+0000","last_fullsized":"2023-10-09T11:37:10.259893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:19.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254430+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244611+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:54.881079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255554+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:59.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245446+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:07.308074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244688+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:04.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248903+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:10.748390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247000+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:59.184468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262319+0000","last_change":"2023-10-09T11:37:10.262319+0000","last_active":"2023-10-09T11:37:10.262319+0000","last_peered":"2023-10-09T11:37:10.262319+0000","last_clean":"2023-10-09T11:37:10.262319+0000","last_became_active":"2023-10-09T11:37:10.262032+0000","last_became_peered":"2023-10-09T11:37:10.262032+0000","last_unstale":"2023-10-09T11:37:10.262319+0000","last_undegraded":"2023-10-09T11:37:10.262319+0000","last_fullsized":"2023-10-09T11:37:10.262319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:20.427335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247423+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:05.891685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256612+0000","last_change":"2023-10-09T11:37:10.256612+0000","last_active":"2023-10-09T11:37:10.256612+0000","last_peered":"2023-10-09T11:37:10.256612+0000","last_clean":"2023-10-09T11:37:10.256612+0000","last_became_active":"2023-10-09T11:37:10.256341+0000","last_became_peered":"2023-10-09T11:37:10.256341+0000","last_unstale":"2023-10-09T11:37:10.256612+0000","last_undegraded":"2023-10-09T11:37:10.256612+0000","last_fullsized":"2023-10-09T11:37:10.256612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:52.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257014+0000","last_change":"2023-10-09T11:37:10.257014+0000","last_active":"2023-10-09T11:37:10.257014+0000","last_peered":"2023-10-09T11:37:10.257014+0000","last_clean":"2023-10-09T11:37:10.257014+0000","last_became_active":"2023-10-09T11:37:10.256748+0000","last_became_peered":"2023-10-09T11:37:10.256748+0000","last_unstale":"2023-10-09T11:37:10.257014+0000","last_undegraded":"2023-10-09T11:37:10.257014+0000","last_fullsized":"2023-10-09T11:37:10.257014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.897009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:37:09.251737+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:37:09.251737+0000","last_peered":"2023-10-09T11:37:09.251737+0000","last_clean":"2023-10-09T11:37:09.251737+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:37:09.251737+0000","last_undegraded":"2023-10-09T11:37:09.251737+0000","last_fullsized":"2023-10-09T11:37:09.251737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":901268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.748}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.495},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1318912,"data_stored":895005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.318}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.218},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":1.056,"15min":1.056},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.71399999999999997,"15min":0.74299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81499999999999995,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89800000000000002,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78100000000000003,"5min":1.234,"15min":1.234},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":1.282,"15min":1.282},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:37:15.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:15.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.521+0000 7f329d996700 1 Processor -- start 2023-10-09T11:37:15.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.522+0000 7f329d996700 1 -- start start 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.522+0000 7f329d996700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 0x7f32980b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.522+0000 7f329d996700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329815ad50 con 0x7f329815cf20 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.522+0000 7f329d996700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329815a140 con 0x7f32980b0710 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.522+0000 7f329d996700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329815a420 con 0x7f329815cb50 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f32967fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f329815cf20 0x7f32980b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37436/0 (socket says 172.21.15.26:37436) 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f32967fc700 1 -- 172.21.15.26:0/4208280882 learned_addr learned my addr 172.21.15.26:0/4208280882 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3296ffd700 1 --2- 172.21.15.26:0/4208280882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 0x7f32980b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212095649 0 0) 0x7f329815ad50 con 0x7f329815cf20 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3284003570 con 0x7f329815cf20 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691384983 0 0) 0x7f329815a140 con 0x7f32980b0710 2023-10-09T11:37:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f329815ad50 con 0x7f32980b0710 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3296ffd700 1 -- 172.21.15.26:0/4208280882 >> v1:172.21.15.67:6789/0 conn(0x7f32980b0710 legacy=0x7f32981536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3296ffd700 1 -- 172.21.15.26:0/4208280882 >> v1:172.21.15.26:6789/0 conn(0x7f329815cf20 legacy=0x7f32980b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3296ffd700 1 -- 172.21.15.26:0/4208280882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329815a700 con 0x7f329815cb50 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3296ffd700 1 --2- 172.21.15.26:0/4208280882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 0x7f32980b01d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3288009910 tx=0x7f32880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83da9b66fabbc5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288011630 con 0x7f329815cb50 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288011790 con 0x7f329815cb50 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.523+0000 7f3295ffb700 1 -- 172.21.15.26:0/4208280882 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288011b30 con 0x7f329815cb50 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 -- 172.21.15.26:0/4208280882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 msgr2=0x7f32980b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 --2- 172.21.15.26:0/4208280882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 0x7f32980b01d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3288009910 tx=0x7f32880091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 -- 172.21.15.26:0/4208280882 shutdown_connections 2023-10-09T11:37:15.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 --2- 172.21.15.26:0/4208280882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f329815cb50 0x7f32980b01d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 -- 172.21.15.26:0/4208280882 >> 172.21.15.26:0/4208280882 conn(0x7f32980cded0 msgr2=0x7f329806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 -- 172.21.15.26:0/4208280882 shutdown_connections 2023-10-09T11:37:15.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.524+0000 7f329d996700 1 -- 172.21.15.26:0/4208280882 wait complete. 2023-10-09T11:37:15.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.525+0000 7f329d996700 1 Processor -- start 2023-10-09T11:37:15.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.525+0000 7f329d996700 1 -- start start 2023-10-09T11:37:15.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32980b0710 0x7f32980cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 0x7f3298142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980aef40 con 0x7f329815cb50 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980ae330 con 0x7f329815cf20 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f329d996700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980ae610 con 0x7f32980b0710 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47084/0 (socket says 172.21.15.26:47084) 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 -- 172.21.15.26:0/3047601560 learned_addr learned my addr 172.21.15.26:0/3047601560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f3296ffd700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32980b0710 0x7f32980cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32977fe700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 0x7f3298142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 -- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32980b0710 msgr2=0x7f32980cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32980b0710 0x7f32980cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 -- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 msgr2=0x7f3298142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 0x7f3298142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32967fc700 1 -- 172.21.15.26:0/3047601560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009420 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.526+0000 7f32977fe700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 0x7f3298142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f32967fc700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f328000c790 tx=0x7f3280007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280005b30 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280005c90 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32980ae8f0 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800072e0 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.527+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32980ccb50 con 0x7f329815cb50 2023-10-09T11:37:15.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.528+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329804c3c0 con 0x7f329815cb50 2023-10-09T11:37:15.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.528+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3280007690 con 0x7f329815cb50 2023-10-09T11:37:15.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.529+0000 7f328effd700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 0x7f3278069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.529+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32800839e0 con 0x7f329815cb50 2023-10-09T11:37:15.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.529+0000 7f3296ffd700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 0x7f3278069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.529+0000 7f3296ffd700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 0x7f3278069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3288009860 tx=0x7f3288017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.533+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3280050d10 con 0x7f329815cb50 2023-10-09T11:37:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.719+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32980af080 con 0x7f3278066fc0 2023-10-09T11:37:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.728+0000 7f328effd700 1 -- 172.21.15.26:0/3047601560 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282589 (secure 0 0 0) 0x7f32980af080 con 0x7f3278066fc0 2023-10-09T11:37:15.731 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:15.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 msgr2=0x7f3278069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 0x7f3278069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3288009860 tx=0x7f3288017000 comp rx=0 tx=0).stop 2023-10-09T11:37:15.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 msgr2=0x7f32980ad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f328000c790 tx=0x7f3280007e40 comp rx=0 tx=0).stop 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 shutdown_connections 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f329815cf20 0x7f3298142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3278066fc0 0x7f3278069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32980b0710 0x7f32980cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 --2- 172.21.15.26:0/3047601560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f329815cb50 0x7f32980ad520 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 >> 172.21.15.26:0/3047601560 conn(0x7f32980cded0 msgr2=0x7f3298159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 shutdown_connections 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.731+0000 7f329d996700 1 -- 172.21.15.26:0/3047601560 wait complete. 2023-10-09T11:37:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:37:15.743 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-10-09T11:37:15.130597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397464,"kb_used_data":6872,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577256,"statfs":{"total":773094113280,"available":770639110144,"internally_reserved":0,"allocated":7036928,"data_stored":3642884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891435"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253674+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247636+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:00.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249305+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:21.436362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250690+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248396+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:20.555622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253497+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256418+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:32.650724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250169+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249016+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:58.939663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251724+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250621+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252317+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256870+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:33.420682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.258282+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254455+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252480+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250897+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250141+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247590+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.651563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252363+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.267368+0000","last_change":"2023-10-09T11:37:10.267368+0000","last_active":"2023-10-09T11:37:10.267368+0000","last_peered":"2023-10-09T11:37:10.267368+0000","last_clean":"2023-10-09T11:37:10.267368+0000","last_became_active":"2023-10-09T11:37:10.267112+0000","last_became_peered":"2023-10-09T11:37:10.267112+0000","last_unstale":"2023-10-09T11:37:10.267368+0000","last_undegraded":"2023-10-09T11:37:10.267368+0000","last_fullsized":"2023-10-09T11:37:10.267368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:29.602389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245503+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:28.609784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249320+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.309819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264621+0000","last_change":"2023-10-09T11:37:10.264621+0000","last_active":"2023-10-09T11:37:10.264621+0000","last_peered":"2023-10-09T11:37:10.264621+0000","last_clean":"2023-10-09T11:37:10.264621+0000","last_became_active":"2023-10-09T11:37:10.264308+0000","last_became_peered":"2023-10-09T11:37:10.264308+0000","last_unstale":"2023-10-09T11:37:10.264621+0000","last_undegraded":"2023-10-09T11:37:10.264621+0000","last_fullsized":"2023-10-09T11:37:10.264621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255990+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:41.956410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256443+0000","last_change":"2023-10-09T11:37:10.256443+0000","last_active":"2023-10-09T11:37:10.256443+0000","last_peered":"2023-10-09T11:37:10.256443+0000","last_clean":"2023-10-09T11:37:10.256443+0000","last_became_active":"2023-10-09T11:37:10.255918+0000","last_became_peered":"2023-10-09T11:37:10.255918+0000","last_unstale":"2023-10-09T11:37:10.256443+0000","last_undegraded":"2023-10-09T11:37:10.256443+0000","last_fullsized":"2023-10-09T11:37:10.256443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.993290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250516+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249432+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:32.411655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250854+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.258523+0000","last_change":"2023-10-09T11:37:10.258523+0000","last_active":"2023-10-09T11:37:10.258523+0000","last_peered":"2023-10-09T11:37:10.258523+0000","last_clean":"2023-10-09T11:37:10.258523+0000","last_became_active":"2023-10-09T11:37:10.258253+0000","last_became_peered":"2023-10-09T11:37:10.258253+0000","last_unstale":"2023-10-09T11:37:10.258523+0000","last_undegraded":"2023-10-09T11:37:10.258523+0000","last_fullsized":"2023-10-09T11:37:10.258523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:17.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247181+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:59.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244677+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:06.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253973+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264721+0000","last_change":"2023-10-09T11:37:10.264721+0000","last_active":"2023-10-09T11:37:10.264721+0000","last_peered":"2023-10-09T11:37:10.264721+0000","last_clean":"2023-10-09T11:37:10.264721+0000","last_became_active":"2023-10-09T11:37:10.264425+0000","last_became_peered":"2023-10-09T11:37:10.264425+0000","last_unstale":"2023-10-09T11:37:10.264721+0000","last_undegraded":"2023-10-09T11:37:10.264721+0000","last_fullsized":"2023-10-09T11:37:10.264721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253253+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259720+0000","last_change":"2023-10-09T11:37:10.259720+0000","last_active":"2023-10-09T11:37:10.259720+0000","last_peered":"2023-10-09T11:37:10.259720+0000","last_clean":"2023-10-09T11:37:10.259720+0000","last_became_active":"2023-10-09T11:37:10.259416+0000","last_became_peered":"2023-10-09T11:37:10.259416+0000","last_unstale":"2023-10-09T11:37:10.259720+0000","last_undegraded":"2023-10-09T11:37:10.259720+0000","last_fullsized":"2023-10-09T11:37:10.259720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:26.710877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248634+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:54.860317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249486+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:56.781268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247125+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:29.642536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254936+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:37.090746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.246862+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.882658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251273+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.260859+0000","last_change":"2023-10-09T11:37:10.260859+0000","last_active":"2023-10-09T11:37:10.260859+0000","last_peered":"2023-10-09T11:37:10.260859+0000","last_clean":"2023-10-09T11:37:10.260859+0000","last_became_active":"2023-10-09T11:37:10.260521+0000","last_became_peered":"2023-10-09T11:37:10.260521+0000","last_unstale":"2023-10-09T11:37:10.260859+0000","last_undegraded":"2023-10-09T11:37:10.260859+0000","last_fullsized":"2023-10-09T11:37:10.260859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:07.504912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253911+0000","last_change":"2023-10-09T11:37:10.253911+0000","last_active":"2023-10-09T11:37:10.253911+0000","last_peered":"2023-10-09T11:37:10.253911+0000","last_clean":"2023-10-09T11:37:10.253911+0000","last_became_active":"2023-10-09T11:37:10.253637+0000","last_became_peered":"2023-10-09T11:37:10.253637+0000","last_unstale":"2023-10-09T11:37:10.253911+0000","last_undegraded":"2023-10-09T11:37:10.253911+0000","last_fullsized":"2023-10-09T11:37:10.253911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.263400+0000","last_change":"2023-10-09T11:37:10.263400+0000","last_active":"2023-10-09T11:37:10.263400+0000","last_peered":"2023-10-09T11:37:10.263400+0000","last_clean":"2023-10-09T11:37:10.263400+0000","last_became_active":"2023-10-09T11:37:10.263092+0000","last_became_peered":"2023-10-09T11:37:10.263092+0000","last_unstale":"2023-10-09T11:37:10.263400+0000","last_undegraded":"2023-10-09T11:37:10.263400+0000","last_fullsized":"2023-10-09T11:37:10.263400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:28.300792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252391+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257739+0000","last_change":"2023-10-09T11:37:10.257739+0000","last_active":"2023-10-09T11:37:10.257739+0000","last_peered":"2023-10-09T11:37:10.257739+0000","last_clean":"2023-10-09T11:37:10.257739+0000","last_became_active":"2023-10-09T11:37:10.257447+0000","last_became_peered":"2023-10-09T11:37:10.257447+0000","last_unstale":"2023-10-09T11:37:10.257739+0000","last_undegraded":"2023-10-09T11:37:10.257739+0000","last_fullsized":"2023-10-09T11:37:10.257739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:33.970302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252751+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262395+0000","last_change":"2023-10-09T11:37:10.262395+0000","last_active":"2023-10-09T11:37:10.262395+0000","last_peered":"2023-10-09T11:37:10.262395+0000","last_clean":"2023-10-09T11:37:10.262395+0000","last_became_active":"2023-10-09T11:37:10.262108+0000","last_became_peered":"2023-10-09T11:37:10.262108+0000","last_unstale":"2023-10-09T11:37:10.262395+0000","last_undegraded":"2023-10-09T11:37:10.262395+0000","last_fullsized":"2023-10-09T11:37:10.262395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264262+0000","last_change":"2023-10-09T11:37:10.264262+0000","last_active":"2023-10-09T11:37:10.264262+0000","last_peered":"2023-10-09T11:37:10.264262+0000","last_clean":"2023-10-09T11:37:10.264262+0000","last_became_active":"2023-10-09T11:37:10.263996+0000","last_became_peered":"2023-10-09T11:37:10.263996+0000","last_unstale":"2023-10-09T11:37:10.264262+0000","last_undegraded":"2023-10-09T11:37:10.264262+0000","last_fullsized":"2023-10-09T11:37:10.264262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:13.533137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.266077+0000","last_change":"2023-10-09T11:37:10.266077+0000","last_active":"2023-10-09T11:37:10.266077+0000","last_peered":"2023-10-09T11:37:10.266077+0000","last_clean":"2023-10-09T11:37:10.266077+0000","last_became_active":"2023-10-09T11:37:10.265779+0000","last_became_peered":"2023-10-09T11:37:10.265779+0000","last_unstale":"2023-10-09T11:37:10.266077+0000","last_undegraded":"2023-10-09T11:37:10.266077+0000","last_fullsized":"2023-10-09T11:37:10.266077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:00.625064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253918+0000","last_change":"2023-10-09T11:37:10.253918+0000","last_active":"2023-10-09T11:37:10.253918+0000","last_peered":"2023-10-09T11:37:10.253918+0000","last_clean":"2023-10-09T11:37:10.253918+0000","last_became_active":"2023-10-09T11:37:10.253581+0000","last_became_peered":"2023-10-09T11:37:10.253581+0000","last_unstale":"2023-10-09T11:37:10.253918+0000","last_undegraded":"2023-10-09T11:37:10.253918+0000","last_fullsized":"2023-10-09T11:37:10.253918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:21.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257958+0000","last_change":"2023-10-09T11:37:10.257958+0000","last_active":"2023-10-09T11:37:10.257958+0000","last_peered":"2023-10-09T11:37:10.257958+0000","last_clean":"2023-10-09T11:37:10.257958+0000","last_became_active":"2023-10-09T11:37:10.257648+0000","last_became_peered":"2023-10-09T11:37:10.257648+0000","last_unstale":"2023-10-09T11:37:10.257958+0000","last_undegraded":"2023-10-09T11:37:10.257958+0000","last_fullsized":"2023-10-09T11:37:10.257958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245440+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:03.707975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.255048+0000","last_change":"2023-10-09T11:37:10.255048+0000","last_active":"2023-10-09T11:37:10.255048+0000","last_peered":"2023-10-09T11:37:10.255048+0000","last_clean":"2023-10-09T11:37:10.255048+0000","last_became_active":"2023-10-09T11:37:10.254710+0000","last_became_peered":"2023-10-09T11:37:10.254710+0000","last_unstale":"2023-10-09T11:37:10.255048+0000","last_undegraded":"2023-10-09T11:37:10.255048+0000","last_fullsized":"2023-10-09T11:37:10.255048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:07.358828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252959+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:11.101264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259893+0000","last_change":"2023-10-09T11:37:10.259893+0000","last_active":"2023-10-09T11:37:10.259893+0000","last_peered":"2023-10-09T11:37:10.259893+0000","last_clean":"2023-10-09T11:37:10.259893+0000","last_became_active":"2023-10-09T11:37:10.259638+0000","last_became_peered":"2023-10-09T11:37:10.259638+0000","last_unstale":"2023-10-09T11:37:10.259893+0000","last_undegraded":"2023-10-09T11:37:10.259893+0000","last_fullsized":"2023-10-09T11:37:10.259893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:19.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254430+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244611+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:54.881079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255554+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:59.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245446+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:07.308074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244688+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:04.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248903+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:10.748390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247000+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:59.184468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262319+0000","last_change":"2023-10-09T11:37:10.262319+0000","last_active":"2023-10-09T11:37:10.262319+0000","last_peered":"2023-10-09T11:37:10.262319+0000","last_clean":"2023-10-09T11:37:10.262319+0000","last_became_active":"2023-10-09T11:37:10.262032+0000","last_became_peered":"2023-10-09T11:37:10.262032+0000","last_unstale":"2023-10-09T11:37:10.262319+0000","last_undegraded":"2023-10-09T11:37:10.262319+0000","last_fullsized":"2023-10-09T11:37:10.262319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:20.427335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247423+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:05.891685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256612+0000","last_change":"2023-10-09T11:37:10.256612+0000","last_active":"2023-10-09T11:37:10.256612+0000","last_peered":"2023-10-09T11:37:10.256612+0000","last_clean":"2023-10-09T11:37:10.256612+0000","last_became_active":"2023-10-09T11:37:10.256341+0000","last_became_peered":"2023-10-09T11:37:10.256341+0000","last_unstale":"2023-10-09T11:37:10.256612+0000","last_undegraded":"2023-10-09T11:37:10.256612+0000","last_fullsized":"2023-10-09T11:37:10.256612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:52.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257014+0000","last_change":"2023-10-09T11:37:10.257014+0000","last_active":"2023-10-09T11:37:10.257014+0000","last_peered":"2023-10-09T11:37:10.257014+0000","last_clean":"2023-10-09T11:37:10.257014+0000","last_became_active":"2023-10-09T11:37:10.256748+0000","last_became_peered":"2023-10-09T11:37:10.256748+0000","last_unstale":"2023-10-09T11:37:10.257014+0000","last_undegraded":"2023-10-09T11:37:10.257014+0000","last_fullsized":"2023-10-09T11:37:10.257014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.897009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:37:09.251737+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:37:09.251737+0000","last_peered":"2023-10-09T11:37:09.251737+0000","last_clean":"2023-10-09T11:37:09.251737+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:37:09.251737+0000","last_undegraded":"2023-10-09T11:37:09.251737+0000","last_fullsized":"2023-10-09T11:37:09.251737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":901268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.748}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.495},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1318912,"data_stored":895005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.318}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.218},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":1.056,"15min":1.056},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.71399999999999997,"15min":0.74299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81499999999999995,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89800000000000002,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78100000000000003,"5min":1.234,"15min":1.234},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":1.282,"15min":1.282},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:37:15.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:15.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.902+0000 7fe1593c7700 1 Processor -- start 2023-10-09T11:37:15.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.902+0000 7fe1593c7700 1 -- start start 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1593c7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540cb5a0 0x7fe1540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1593c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1540cd9e0 0x7fe154159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1593c7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15415ae40 con 0x7fe1540cde50 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1593c7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540d13f0 con 0x7fe1540cd9e0 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1593c7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15415ab60 con 0x7fe1540cb5a0 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1540cd9e0 0x7fe154159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1540cd9e0 0x7fe154159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47094/0 (socket says 172.21.15.26:47094) 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 -- 172.21.15.26:0/3443923749 learned_addr learned my addr 172.21.15.26:0/3443923749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe152ffd700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540cb5a0 0x7fe1540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 -- 172.21.15.26:0/3443923749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540cb5a0 msgr2=0x7fe1540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540cb5a0 0x7fe1540cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 -- 172.21.15.26:0/3443923749 >> v1:172.21.15.67:6789/0 conn(0x7fe1540cde50 legacy=0x7fe154156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 -- 172.21.15.26:0/3443923749 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540ccf00 con 0x7fe1540cd9e0 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.903+0000 7fe1527fc700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe154159ec0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41fe212e1eadf0a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe151ffb700 1 -- 172.21.15.26:0/3443923749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00b860 con 0x7fe1540cd9e0 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe151ffb700 1 -- 172.21.15.26:0/3443923749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00b9c0 con 0x7fe1540cd9e0 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe151ffb700 1 -- 172.21.15.26:0/3443923749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00bd60 con 0x7fe1540cd9e0 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 -- 172.21.15.26:0/3443923749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 msgr2=0x7fe154159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe154159ec0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:15.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 -- 172.21.15.26:0/3443923749 shutdown_connections 2023-10-09T11:37:15.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540cb5a0 0x7fe1540cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 --2- 172.21.15.26:0/3443923749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe154159ec0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 -- 172.21.15.26:0/3443923749 >> 172.21.15.26:0/3443923749 conn(0x7fe154070e30 msgr2=0x7fe1540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 -- 172.21.15.26:0/3443923749 shutdown_connections 2023-10-09T11:37:15.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.904+0000 7fe1593c7700 1 -- 172.21.15.26:0/3443923749 wait complete. 2023-10-09T11:37:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.905+0000 7fe1593c7700 1 Processor -- start 2023-10-09T11:37:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 -- start start 2023-10-09T11:37:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1540cb5a0 0x7fe15415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540c8160 0x7fe1540b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540b5970 con 0x7fe1540cd9e0 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15416b2f0 con 0x7fe1540cb5a0 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1593c7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15416b5d0 con 0x7fe1540c8160 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47108/0 (socket says 172.21.15.26:47108) 2023-10-09T11:37:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1527fc700 1 -- 172.21.15.26:0/1383391593 learned_addr learned my addr 172.21.15.26:0/1383391593 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe152ffd700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1540cb5a0 0x7fe15415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.906+0000 7fe1537fe700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540c8160 0x7fe1540b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 -- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540c8160 msgr2=0x7fe1540b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540c8160 0x7fe1540b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 -- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1540cb5a0 msgr2=0x7fe15415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1540cb5a0 0x7fe15415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 -- 172.21.15.26:0/1383391593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094f0 con 0x7fe1540cd9e0 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1527fc700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe15406ea60 tx=0x7fe13c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011e40 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c024440 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c024800 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15416b8b0 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.907+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15416be70 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.908+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15416c090 con 0x7fe1540cd9e0 2023-10-09T11:37:15.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.908+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe13c01a420 con 0x7fe1540cd9e0 2023-10-09T11:37:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.909+0000 7fe14affd700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 0x7fe134069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.909+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe13c086330 con 0x7fe1540cd9e0 2023-10-09T11:37:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.909+0000 7fe152ffd700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 0x7fe134069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.910+0000 7fe152ffd700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 0x7fe134069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe144006fd0 tx=0x7fe144008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:15.913+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe13c0535b0 con 0x7fe1540cd9e0 2023-10-09T11:37:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.102+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe15404c3c0 con 0x7fe134066fc0 2023-10-09T11:37:16.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.110+0000 7fe14affd700 1 -- 172.21.15.26:0/1383391593 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282589 (secure 0 0 0) 0x7fe15404c3c0 con 0x7fe134066fc0 2023-10-09T11:37:16.114 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 msgr2=0x7fe134069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 0x7fe134069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe144006fd0 tx=0x7fe144008040 comp rx=0 tx=0).stop 2023-10-09T11:37:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 msgr2=0x7fe15415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe15406ea60 tx=0x7fe13c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 shutdown_connections 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe134066fc0 0x7fe134069470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1540c8160 0x7fe1540b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1540cb5a0 0x7fe15415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 --2- 172.21.15.26:0/1383391593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1540cd9e0 0x7fe15415a220 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 >> 172.21.15.26:0/1383391593 conn(0x7fe154070e30 msgr2=0x7fe1540d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 shutdown_connections 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.114+0000 7fe1593c7700 1 -- 172.21.15.26:0/1383391593 wait complete. 2023-10-09T11:37:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:37:16.126 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-10-09T11:37:15.130597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397464,"kb_used_data":6872,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577256,"statfs":{"total":773094113280,"available":770639110144,"internally_reserved":0,"allocated":7036928,"data_stored":3642884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891435"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253674+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247636+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:00.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249305+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:21.436362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250690+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248396+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:20.555622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253497+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256418+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:32.650724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250169+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249016+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:58.939663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251724+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250621+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252317+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256870+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:33.420682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.258282+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254455+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252480+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250897+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250141+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247590+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.651563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252363+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.267368+0000","last_change":"2023-10-09T11:37:10.267368+0000","last_active":"2023-10-09T11:37:10.267368+0000","last_peered":"2023-10-09T11:37:10.267368+0000","last_clean":"2023-10-09T11:37:10.267368+0000","last_became_active":"2023-10-09T11:37:10.267112+0000","last_became_peered":"2023-10-09T11:37:10.267112+0000","last_unstale":"2023-10-09T11:37:10.267368+0000","last_undegraded":"2023-10-09T11:37:10.267368+0000","last_fullsized":"2023-10-09T11:37:10.267368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:29.602389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245503+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:28.609784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249320+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.309819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264621+0000","last_change":"2023-10-09T11:37:10.264621+0000","last_active":"2023-10-09T11:37:10.264621+0000","last_peered":"2023-10-09T11:37:10.264621+0000","last_clean":"2023-10-09T11:37:10.264621+0000","last_became_active":"2023-10-09T11:37:10.264308+0000","last_became_peered":"2023-10-09T11:37:10.264308+0000","last_unstale":"2023-10-09T11:37:10.264621+0000","last_undegraded":"2023-10-09T11:37:10.264621+0000","last_fullsized":"2023-10-09T11:37:10.264621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255990+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:41.956410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256443+0000","last_change":"2023-10-09T11:37:10.256443+0000","last_active":"2023-10-09T11:37:10.256443+0000","last_peered":"2023-10-09T11:37:10.256443+0000","last_clean":"2023-10-09T11:37:10.256443+0000","last_became_active":"2023-10-09T11:37:10.255918+0000","last_became_peered":"2023-10-09T11:37:10.255918+0000","last_unstale":"2023-10-09T11:37:10.256443+0000","last_undegraded":"2023-10-09T11:37:10.256443+0000","last_fullsized":"2023-10-09T11:37:10.256443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.993290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250516+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249432+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:32.411655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250854+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.258523+0000","last_change":"2023-10-09T11:37:10.258523+0000","last_active":"2023-10-09T11:37:10.258523+0000","last_peered":"2023-10-09T11:37:10.258523+0000","last_clean":"2023-10-09T11:37:10.258523+0000","last_became_active":"2023-10-09T11:37:10.258253+0000","last_became_peered":"2023-10-09T11:37:10.258253+0000","last_unstale":"2023-10-09T11:37:10.258523+0000","last_undegraded":"2023-10-09T11:37:10.258523+0000","last_fullsized":"2023-10-09T11:37:10.258523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:17.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247181+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:59.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244677+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:06.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253973+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264721+0000","last_change":"2023-10-09T11:37:10.264721+0000","last_active":"2023-10-09T11:37:10.264721+0000","last_peered":"2023-10-09T11:37:10.264721+0000","last_clean":"2023-10-09T11:37:10.264721+0000","last_became_active":"2023-10-09T11:37:10.264425+0000","last_became_peered":"2023-10-09T11:37:10.264425+0000","last_unstale":"2023-10-09T11:37:10.264721+0000","last_undegraded":"2023-10-09T11:37:10.264721+0000","last_fullsized":"2023-10-09T11:37:10.264721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253253+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259720+0000","last_change":"2023-10-09T11:37:10.259720+0000","last_active":"2023-10-09T11:37:10.259720+0000","last_peered":"2023-10-09T11:37:10.259720+0000","last_clean":"2023-10-09T11:37:10.259720+0000","last_became_active":"2023-10-09T11:37:10.259416+0000","last_became_peered":"2023-10-09T11:37:10.259416+0000","last_unstale":"2023-10-09T11:37:10.259720+0000","last_undegraded":"2023-10-09T11:37:10.259720+0000","last_fullsized":"2023-10-09T11:37:10.259720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:26.710877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248634+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:54.860317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249486+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:56.781268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247125+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:29.642536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254936+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:37.090746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.246862+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.882658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251273+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.260859+0000","last_change":"2023-10-09T11:37:10.260859+0000","last_active":"2023-10-09T11:37:10.260859+0000","last_peered":"2023-10-09T11:37:10.260859+0000","last_clean":"2023-10-09T11:37:10.260859+0000","last_became_active":"2023-10-09T11:37:10.260521+0000","last_became_peered":"2023-10-09T11:37:10.260521+0000","last_unstale":"2023-10-09T11:37:10.260859+0000","last_undegraded":"2023-10-09T11:37:10.260859+0000","last_fullsized":"2023-10-09T11:37:10.260859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:07.504912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253911+0000","last_change":"2023-10-09T11:37:10.253911+0000","last_active":"2023-10-09T11:37:10.253911+0000","last_peered":"2023-10-09T11:37:10.253911+0000","last_clean":"2023-10-09T11:37:10.253911+0000","last_became_active":"2023-10-09T11:37:10.253637+0000","last_became_peered":"2023-10-09T11:37:10.253637+0000","last_unstale":"2023-10-09T11:37:10.253911+0000","last_undegraded":"2023-10-09T11:37:10.253911+0000","last_fullsized":"2023-10-09T11:37:10.253911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.263400+0000","last_change":"2023-10-09T11:37:10.263400+0000","last_active":"2023-10-09T11:37:10.263400+0000","last_peered":"2023-10-09T11:37:10.263400+0000","last_clean":"2023-10-09T11:37:10.263400+0000","last_became_active":"2023-10-09T11:37:10.263092+0000","last_became_peered":"2023-10-09T11:37:10.263092+0000","last_unstale":"2023-10-09T11:37:10.263400+0000","last_undegraded":"2023-10-09T11:37:10.263400+0000","last_fullsized":"2023-10-09T11:37:10.263400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:28.300792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252391+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257739+0000","last_change":"2023-10-09T11:37:10.257739+0000","last_active":"2023-10-09T11:37:10.257739+0000","last_peered":"2023-10-09T11:37:10.257739+0000","last_clean":"2023-10-09T11:37:10.257739+0000","last_became_active":"2023-10-09T11:37:10.257447+0000","last_became_peered":"2023-10-09T11:37:10.257447+0000","last_unstale":"2023-10-09T11:37:10.257739+0000","last_undegraded":"2023-10-09T11:37:10.257739+0000","last_fullsized":"2023-10-09T11:37:10.257739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:33.970302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252751+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262395+0000","last_change":"2023-10-09T11:37:10.262395+0000","last_active":"2023-10-09T11:37:10.262395+0000","last_peered":"2023-10-09T11:37:10.262395+0000","last_clean":"2023-10-09T11:37:10.262395+0000","last_became_active":"2023-10-09T11:37:10.262108+0000","last_became_peered":"2023-10-09T11:37:10.262108+0000","last_unstale":"2023-10-09T11:37:10.262395+0000","last_undegraded":"2023-10-09T11:37:10.262395+0000","last_fullsized":"2023-10-09T11:37:10.262395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264262+0000","last_change":"2023-10-09T11:37:10.264262+0000","last_active":"2023-10-09T11:37:10.264262+0000","last_peered":"2023-10-09T11:37:10.264262+0000","last_clean":"2023-10-09T11:37:10.264262+0000","last_became_active":"2023-10-09T11:37:10.263996+0000","last_became_peered":"2023-10-09T11:37:10.263996+0000","last_unstale":"2023-10-09T11:37:10.264262+0000","last_undegraded":"2023-10-09T11:37:10.264262+0000","last_fullsized":"2023-10-09T11:37:10.264262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:13.533137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.266077+0000","last_change":"2023-10-09T11:37:10.266077+0000","last_active":"2023-10-09T11:37:10.266077+0000","last_peered":"2023-10-09T11:37:10.266077+0000","last_clean":"2023-10-09T11:37:10.266077+0000","last_became_active":"2023-10-09T11:37:10.265779+0000","last_became_peered":"2023-10-09T11:37:10.265779+0000","last_unstale":"2023-10-09T11:37:10.266077+0000","last_undegraded":"2023-10-09T11:37:10.266077+0000","last_fullsized":"2023-10-09T11:37:10.266077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:00.625064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253918+0000","last_change":"2023-10-09T11:37:10.253918+0000","last_active":"2023-10-09T11:37:10.253918+0000","last_peered":"2023-10-09T11:37:10.253918+0000","last_clean":"2023-10-09T11:37:10.253918+0000","last_became_active":"2023-10-09T11:37:10.253581+0000","last_became_peered":"2023-10-09T11:37:10.253581+0000","last_unstale":"2023-10-09T11:37:10.253918+0000","last_undegraded":"2023-10-09T11:37:10.253918+0000","last_fullsized":"2023-10-09T11:37:10.253918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:21.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257958+0000","last_change":"2023-10-09T11:37:10.257958+0000","last_active":"2023-10-09T11:37:10.257958+0000","last_peered":"2023-10-09T11:37:10.257958+0000","last_clean":"2023-10-09T11:37:10.257958+0000","last_became_active":"2023-10-09T11:37:10.257648+0000","last_became_peered":"2023-10-09T11:37:10.257648+0000","last_unstale":"2023-10-09T11:37:10.257958+0000","last_undegraded":"2023-10-09T11:37:10.257958+0000","last_fullsized":"2023-10-09T11:37:10.257958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245440+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:03.707975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.255048+0000","last_change":"2023-10-09T11:37:10.255048+0000","last_active":"2023-10-09T11:37:10.255048+0000","last_peered":"2023-10-09T11:37:10.255048+0000","last_clean":"2023-10-09T11:37:10.255048+0000","last_became_active":"2023-10-09T11:37:10.254710+0000","last_became_peered":"2023-10-09T11:37:10.254710+0000","last_unstale":"2023-10-09T11:37:10.255048+0000","last_undegraded":"2023-10-09T11:37:10.255048+0000","last_fullsized":"2023-10-09T11:37:10.255048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:07.358828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252959+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:11.101264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259893+0000","last_change":"2023-10-09T11:37:10.259893+0000","last_active":"2023-10-09T11:37:10.259893+0000","last_peered":"2023-10-09T11:37:10.259893+0000","last_clean":"2023-10-09T11:37:10.259893+0000","last_became_active":"2023-10-09T11:37:10.259638+0000","last_became_peered":"2023-10-09T11:37:10.259638+0000","last_unstale":"2023-10-09T11:37:10.259893+0000","last_undegraded":"2023-10-09T11:37:10.259893+0000","last_fullsized":"2023-10-09T11:37:10.259893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:19.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254430+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244611+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:54.881079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255554+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:59.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245446+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:07.308074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244688+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:04.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248903+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:10.748390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247000+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:59.184468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262319+0000","last_change":"2023-10-09T11:37:10.262319+0000","last_active":"2023-10-09T11:37:10.262319+0000","last_peered":"2023-10-09T11:37:10.262319+0000","last_clean":"2023-10-09T11:37:10.262319+0000","last_became_active":"2023-10-09T11:37:10.262032+0000","last_became_peered":"2023-10-09T11:37:10.262032+0000","last_unstale":"2023-10-09T11:37:10.262319+0000","last_undegraded":"2023-10-09T11:37:10.262319+0000","last_fullsized":"2023-10-09T11:37:10.262319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:20.427335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247423+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:05.891685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256612+0000","last_change":"2023-10-09T11:37:10.256612+0000","last_active":"2023-10-09T11:37:10.256612+0000","last_peered":"2023-10-09T11:37:10.256612+0000","last_clean":"2023-10-09T11:37:10.256612+0000","last_became_active":"2023-10-09T11:37:10.256341+0000","last_became_peered":"2023-10-09T11:37:10.256341+0000","last_unstale":"2023-10-09T11:37:10.256612+0000","last_undegraded":"2023-10-09T11:37:10.256612+0000","last_fullsized":"2023-10-09T11:37:10.256612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:52.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257014+0000","last_change":"2023-10-09T11:37:10.257014+0000","last_active":"2023-10-09T11:37:10.257014+0000","last_peered":"2023-10-09T11:37:10.257014+0000","last_clean":"2023-10-09T11:37:10.257014+0000","last_became_active":"2023-10-09T11:37:10.256748+0000","last_became_peered":"2023-10-09T11:37:10.256748+0000","last_unstale":"2023-10-09T11:37:10.257014+0000","last_undegraded":"2023-10-09T11:37:10.257014+0000","last_fullsized":"2023-10-09T11:37:10.257014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.897009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:37:09.251737+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:37:09.251737+0000","last_peered":"2023-10-09T11:37:09.251737+0000","last_clean":"2023-10-09T11:37:09.251737+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:37:09.251737+0000","last_undegraded":"2023-10-09T11:37:09.251737+0000","last_fullsized":"2023-10-09T11:37:09.251737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":901268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.748}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.495},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1318912,"data_stored":895005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.318}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.218},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":1.056,"15min":1.056},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.71399999999999997,"15min":0.74299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81499999999999995,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89800000000000002,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78100000000000003,"5min":1.234,"15min":1.234},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":1.282,"15min":1.282},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:37:16.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-09T11:37:16.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.253674+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.247636+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:58:00.707900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-09T11:37:16.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.249305+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:06:21.436362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-09T11:37:16.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250690+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.248396+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:13:20.555622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-09T11:37:16.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.253497+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.256418+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:56:32.650724+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-09T11:37:16.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-09T11:37:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250169+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-09T11:37:16.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.249016+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:47:58.939663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.251724+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-09T11:37:16.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250621+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252317+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.256870+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:55:33.420682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.258282+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.254455+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252480+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-09T11:37:16.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-09T11:37:16.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250897+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-09T11:37:16.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250141+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.247590+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:37:30.651563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252363+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-09T11:37:16.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.245503+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:51:28.609784+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.249320+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:16:29.309819+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.255990+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:38:41.956410+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-09T11:37:16.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250516+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-09T11:37:16.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.249432+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:55:32.411655+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:37:16.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-09T11:37:16.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.250854+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.247181+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:57:59.698873+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.244677+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:47:06.753598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.253973+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.253253+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.248634+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:52:54.860317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.249486+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:45:56.781268+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-09T11:37:16.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.247125+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:37:29.642536+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:37:16.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-09T11:37:16.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.254936+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:49:37.090746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-09T11:37:16.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.246862+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:24:04.882658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.251273+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-09T11:37:16.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252391+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252751+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-09T11:37:16.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-09T11:37:16.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.245440+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:06:03.707975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-09T11:37:16.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.252959+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:35:11.101264+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.254430+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.244611+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:06:54.881079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.255554+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:14:59.947129+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:37:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.245446+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:08:07.308074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.244688+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:53:04.901983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.248903+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:46:10.748390+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:09.229748+0000', 'last_change': '2023-10-09T11:37:09.247000+0000', 'last_active': '2023-10-09T11:37:09.229748+0000', 'last_peered': '2023-10-09T11:37:09.229748+0000', 'last_clean': '2023-10-09T11:37:09.229748+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:09.229748+0000', 'last_undegraded': '2023-10-09T11:37:09.229748+0000', 'last_fullsized': '2023-10-09T11:37:09.229748+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:09.229748+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:12:59.184468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:37:16.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-09T11:37:16.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-09T11:37:16.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.247423+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:24:05.891685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:37:16.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-09T11:37:16.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:37:10.238776+0000', 'last_change': '2023-10-09T11:37:10.238776+0000', 'last_active': '2023-10-09T11:37:10.238776+0000', 'last_peered': '2023-10-09T11:37:10.238776+0000', 'last_clean': '2023-10-09T11:37:10.238776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:37:10.238776+0000', 'last_undegraded': '2023-10-09T11:37:10.238776+0000', 'last_fullsized': '2023-10-09T11:37:10.238776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'last_clean_scrub_stamp': '2023-10-09T11:37:10.238776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:37:16.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:37:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.284+0000 7ff0989b5700 1 Processor -- start 2023-10-09T11:37:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.284+0000 7ff0989b5700 1 -- start start 2023-10-09T11:37:16.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.285+0000 7ff0989b5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff0940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.285+0000 7ff0989b5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09415ae40 con 0x7ff0940cd9e0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.285+0000 7ff0989b5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09415ab60 con 0x7ff0940cde50 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.285+0000 7ff0989b5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940d13f0 con 0x7ff0940cb5a0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.285+0000 7ff091d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0940cd9e0 0x7ff094159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37444/0 (socket says 172.21.15.26:37444) 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff091d9b700 1 -- 172.21.15.26:0/1529441354 learned_addr learned my addr 172.21.15.26:0/1529441354 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09259c700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff0940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621948096 0 0) 0x7ff09415ae40 con 0x7ff0940cd9e0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff080003570 con 0x7ff0940cd9e0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667070355 0 0) 0x7ff080003570 con 0x7ff0940cd9e0 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 msgr2=0x7ff0940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff0940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 >> v1:172.21.15.67:6789/0 conn(0x7ff0940cde50 legacy=0x7ff094156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940ccf00 con 0x7ff0940cd9e0 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ff07c001470 con 0x7ff0940cd9e0 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 >> v1:172.21.15.26:6789/0 conn(0x7ff0940cd9e0 legacy=0x7ff094159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080003a90 0x7ff080003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff080004d50 0x7ff0800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08000bb10 con 0x7ff080004d50 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08000bc50 con 0x7ff080003a90 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08000be10 con 0x7ff0940cb5a0 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff092d9d700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff080004d50 0x7ff0800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff091d9b700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.286+0000 7ff09259c700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080003a90 0x7ff080003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 -- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 msgr2=0x7ff080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0940cb5a0 0x7ff080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 -- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080003a90 msgr2=0x7ff080003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080003a90 0x7ff080003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 -- 172.21.15.26:0/1529441354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080003570 con 0x7ff080004d50 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff080004d50 0x7ff0800051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff0840020a0 tx=0x7ff0840016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc949ec2d037201e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840019e0 con 0x7ff080004d50 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400c8b0 con 0x7ff080004d50 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff09159a700 1 -- 172.21.15.26:0/1529441354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400cc50 con 0x7ff080004d50 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff0989b5700 1 -- 172.21.15.26:0/1529441354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff080004d50 msgr2=0x7ff0800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff0989b5700 1 --2- 172.21.15.26:0/1529441354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff080004d50 0x7ff0800051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff0840020a0 tx=0x7ff0840016d0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff092d9d700 1 -- 172.21.15.26:0/1529441354 reap_dead start 2023-10-09T11:37:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.287+0000 7ff0989b5700 1 -- 172.21.15.26:0/1529441354 shutdown_connections 2023-10-09T11:37:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.288+0000 7ff0989b5700 1 -- 172.21.15.26:0/1529441354 >> 172.21.15.26:0/1529441354 conn(0x7ff094070e30 msgr2=0x7ff0940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.288+0000 7ff0989b5700 1 -- 172.21.15.26:0/1529441354 shutdown_connections 2023-10-09T11:37:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.288+0000 7ff0989b5700 1 -- 172.21.15.26:0/1529441354 wait complete. 2023-10-09T11:37:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 Processor -- start 2023-10-09T11:37:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 -- start start 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080004d50 0x7ff09416a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff094156220 0x7ff0940cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940cf790 con 0x7ff0940cf2f0 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09416a660 con 0x7ff080004d50 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.289+0000 7ff0989b5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940c7b80 con 0x7ff094156220 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47124/0 (socket says 172.21.15.26:47124) 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 -- 172.21.15.26:0/3770808048 learned_addr learned my addr 172.21.15.26:0/3770808048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff09259c700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080004d50 0x7ff09416a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff091d9b700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff094156220 0x7ff0940cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 -- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff094156220 msgr2=0x7ff0940cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff094156220 0x7ff0940cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 -- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080004d50 msgr2=0x7ff09416a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080004d50 0x7ff09416a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 -- 172.21.15.26:0/3770808048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940c7e60 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff092d9d700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff084012000 tx=0x7ff084016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840019e0 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084022070 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0940c8140 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084012ce0 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.290+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0940c8700 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.291+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0940c8920 con 0x7ff0940cf2f0 2023-10-09T11:37:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.292+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff08401e430 con 0x7ff0940cf2f0 2023-10-09T11:37:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.292+0000 7ff08a7fc700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 0x7ff074069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.292+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff084086090 con 0x7ff0940cf2f0 2023-10-09T11:37:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.292+0000 7ff09259c700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 0x7ff074069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.293+0000 7ff09259c700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 0x7ff074069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff08c006f00 tx=0x7ff08c0091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.296+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0840533d0 con 0x7ff0940cf2f0 2023-10-09T11:37:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.566+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff09404c3c0 con 0x7ff0940cf2f0 2023-10-09T11:37:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.566+0000 7ff08a7fc700 1 -- 172.21.15.26:0/3770808048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1531 (secure 0 0 0) 0x7ff08402c080 con 0x7ff0940cf2f0 2023-10-09T11:37:16.567 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:16.567 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":137,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":48},{"state_name":"unknown","count":28},{"state_name":"active+clean","count":21}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2455003136,"bytes_avail":770639110144,"bytes_total":773094113280,"unknown_pgs_ratio":0.28865978121757507,"inactive_pgs_ratio":0.49484536051750183},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":5742}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T11:36:27.119445+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 msgr2=0x7ff074069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 0x7ff074069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff08c006f00 tx=0x7ff08c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 msgr2=0x7ff094159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff084012000 tx=0x7ff084016000 comp rx=0 tx=0).stop 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 shutdown_connections 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0940cf2f0 0x7ff094159360 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff080004d50 0x7ff09416a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff074066fc0 0x7ff074069470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 --2- 172.21.15.26:0/3770808048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff094156220 0x7ff0940cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 >> 172.21.15.26:0/3770808048 conn(0x7ff094070e30 msgr2=0x7ff0940b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 shutdown_connections 2023-10-09T11:37:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.568+0000 7ff0989b5700 1 -- 172.21.15.26:0/3770808048 wait complete. 2023-10-09T11:37:16.571 INFO:tasks.ceph.mds.d.smithi067.stderr:2023-10-09T11:37:16.570+0000 7efcb37b7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:37:16.581 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:37:16.581 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.700+0000 7fc9b8a5a700 1 Processor -- start 2023-10-09T11:37:16.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.700+0000 7fc9b8a5a700 1 -- start start 2023-10-09T11:37:16.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b8a5a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b8a5a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9b415dfd0 0x7fc9b40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b8a5a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b40acc00 con 0x7fc9b4159920 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b8a5a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b40abff0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b8a5a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40ac2d0 con 0x7fc9b4159550 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b259c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9b415dfd0 0x7fc9b40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b2d9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b359e700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc9b4159920 0x7fc9b40ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:59428/0 (socket says 172.21.15.26:59428) 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b2d9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:43306/0 (socket says 172.21.15.26:43306) 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b259c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9b415dfd0 0x7fc9b40aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:45856/0 (socket says 172.21.15.26:45856) 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.701+0000 7fc9b2d9d700 1 -- 172.21.15.26:0/1755099613 learned_addr learned my addr 172.21.15.26:0/1755099613 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b1d9b700 1 -- 172.21.15.26:0/1755099613 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575182751 0 0) 0x7fc9b40acc00 con 0x7fc9b4159920 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b1d9b700 1 -- 172.21.15.26:0/1755099613 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a0003570 con 0x7fc9b4159920 2023-10-09T11:37:16.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b259c700 1 -- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 msgr2=0x7fc9b40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b259c700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b259c700 1 -- 172.21.15.26:0/1755099613 >> v1:172.21.15.67:6789/0 conn(0x7fc9b4159920 legacy=0x7fc9b40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b259c700 1 -- 172.21.15.26:0/1755099613 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40ac5b0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b2d9d700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b259c700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40aedb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0098e0 tx=0x7fc99c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea291f50baed0118 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b1d9b700 1 -- 172.21.15.26:0/1755099613 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c011630 con 0x7fc9b415dfd0 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b1d9b700 1 -- 172.21.15.26:0/1755099613 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c011790 con 0x7fc9b415dfd0 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.702+0000 7fc9b1d9b700 1 -- 172.21.15.26:0/1755099613 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c011b30 con 0x7fc9b415dfd0 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b415dfd0 msgr2=0x7fc9b40aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40aedb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0098e0 tx=0x7fc99c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/1755099613 shutdown_connections 2023-10-09T11:37:16.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/1755099613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40aedb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/1755099613 >> 172.21.15.26:0/1755099613 conn(0x7fc9b406ce80 msgr2=0x7fc9b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/1755099613 shutdown_connections 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.703+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/1755099613 wait complete. 2023-10-09T11:37:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.704+0000 7fc9b8a5a700 1 Processor -- start 2023-10-09T11:37:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.704+0000 7fc9b8a5a700 1 -- start start 2023-10-09T11:37:16.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b4148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b4159920 0x7fc9b4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40cdd20 con 0x7fc9b415dfd0 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4155f20 con 0x7fc9b4159920 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b8a5a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40cd6d0 con 0x7fc9b4159550 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47136/0 (socket says 172.21.15.26:47136) 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 -- 172.21.15.26:0/2263517524 learned_addr learned my addr 172.21.15.26:0/2263517524 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b2d9d700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b4148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b259c700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b4159920 0x7fc9b4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 -- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 msgr2=0x7fc9b4148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b4148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 -- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b4159920 msgr2=0x7fc9b4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b4159920 0x7fc9b4156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 -- 172.21.15.26:0/2263517524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009ae0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.705+0000 7fc9b359e700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c7c0 tx=0x7fc9ac007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.706+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac005b40 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.706+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac005ca0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.706+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c009420 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.706+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0072e0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.706+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b41494b0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.707+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b406d250 con 0x7fc9b415dfd0 2023-10-09T11:37:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.707+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc9ac012400 con 0x7fc9b415dfd0 2023-10-09T11:37:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.707+0000 7fc9aaffd700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 0x7fc994069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.708+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9ac083a20 con 0x7fc9b415dfd0 2023-10-09T11:37:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.708+0000 7fc9b2d9d700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 0x7fc994069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.708+0000 7fc9b2d9d700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 0x7fc994069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40c9f90 tx=0x7fc9a400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.712+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9ac04b5a0 con 0x7fc9b415dfd0 2023-10-09T11:37:16.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.898+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9b40cd550 con 0x7fc994066fc0 2023-10-09T11:37:16.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.907+0000 7fc9aaffd700 1 -- 172.21.15.26:0/2263517524 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282589 (secure 0 0 0) 0x7fc9a400f040 con 0x7fc994066fc0 2023-10-09T11:37:16.911 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:16.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 msgr2=0x7fc994069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 0x7fc994069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40c9f90 tx=0x7fc9a400b040 comp rx=0 tx=0).stop 2023-10-09T11:37:16.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 msgr2=0x7fc9b40ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c7c0 tx=0x7fc9ac007d90 comp rx=0 tx=0).stop 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 shutdown_connections 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9b415dfd0 0x7fc9b40ce1b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc994066fc0 0x7fc994069470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9b4159550 0x7fc9b4148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 --2- 172.21.15.26:0/2263517524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9b4159920 0x7fc9b4156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 >> 172.21.15.26:0/2263517524 conn(0x7fc9b406ce80 msgr2=0x7fc9b40aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 shutdown_connections 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:16.910+0000 7fc9b8a5a700 1 -- 172.21.15.26:0/2263517524 wait complete. 2023-10-09T11:37:16.914 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:37:16.923 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-10-09T11:37:15.130597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397464,"kb_used_data":6872,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577256,"statfs":{"total":773094113280,"available":770639110144,"internally_reserved":0,"allocated":7036928,"data_stored":3642884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891435"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253674+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247636+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:00.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249305+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:21.436362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250690+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248396+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:20.555622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253497+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256418+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:32.650724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250169+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249016+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:58.939663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251724+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250621+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252317+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.256870+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:33.420682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.258282+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254455+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252480+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250897+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250141+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247590+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.651563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252363+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.267368+0000","last_change":"2023-10-09T11:37:10.267368+0000","last_active":"2023-10-09T11:37:10.267368+0000","last_peered":"2023-10-09T11:37:10.267368+0000","last_clean":"2023-10-09T11:37:10.267368+0000","last_became_active":"2023-10-09T11:37:10.267112+0000","last_became_peered":"2023-10-09T11:37:10.267112+0000","last_unstale":"2023-10-09T11:37:10.267368+0000","last_undegraded":"2023-10-09T11:37:10.267368+0000","last_fullsized":"2023-10-09T11:37:10.267368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:29.602389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245503+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:28.609784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.249320+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.309819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264621+0000","last_change":"2023-10-09T11:37:10.264621+0000","last_active":"2023-10-09T11:37:10.264621+0000","last_peered":"2023-10-09T11:37:10.264621+0000","last_clean":"2023-10-09T11:37:10.264621+0000","last_became_active":"2023-10-09T11:37:10.264308+0000","last_became_peered":"2023-10-09T11:37:10.264308+0000","last_unstale":"2023-10-09T11:37:10.264621+0000","last_undegraded":"2023-10-09T11:37:10.264621+0000","last_fullsized":"2023-10-09T11:37:10.264621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255990+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:41.956410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256443+0000","last_change":"2023-10-09T11:37:10.256443+0000","last_active":"2023-10-09T11:37:10.256443+0000","last_peered":"2023-10-09T11:37:10.256443+0000","last_clean":"2023-10-09T11:37:10.256443+0000","last_became_active":"2023-10-09T11:37:10.255918+0000","last_became_peered":"2023-10-09T11:37:10.255918+0000","last_unstale":"2023-10-09T11:37:10.256443+0000","last_undegraded":"2023-10-09T11:37:10.256443+0000","last_fullsized":"2023-10-09T11:37:10.256443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.993290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250516+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:28.718795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249432+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:32.411655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.250854+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.258523+0000","last_change":"2023-10-09T11:37:10.258523+0000","last_active":"2023-10-09T11:37:10.258523+0000","last_peered":"2023-10-09T11:37:10.258523+0000","last_clean":"2023-10-09T11:37:10.258523+0000","last_became_active":"2023-10-09T11:37:10.258253+0000","last_became_peered":"2023-10-09T11:37:10.258253+0000","last_unstale":"2023-10-09T11:37:10.258523+0000","last_undegraded":"2023-10-09T11:37:10.258523+0000","last_fullsized":"2023-10-09T11:37:10.258523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:17.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247181+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:59.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244677+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:06.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253973+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264721+0000","last_change":"2023-10-09T11:37:10.264721+0000","last_active":"2023-10-09T11:37:10.264721+0000","last_peered":"2023-10-09T11:37:10.264721+0000","last_clean":"2023-10-09T11:37:10.264721+0000","last_became_active":"2023-10-09T11:37:10.264425+0000","last_became_peered":"2023-10-09T11:37:10.264425+0000","last_unstale":"2023-10-09T11:37:10.264721+0000","last_undegraded":"2023-10-09T11:37:10.264721+0000","last_fullsized":"2023-10-09T11:37:10.264721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.253253+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259720+0000","last_change":"2023-10-09T11:37:10.259720+0000","last_active":"2023-10-09T11:37:10.259720+0000","last_peered":"2023-10-09T11:37:10.259720+0000","last_clean":"2023-10-09T11:37:10.259720+0000","last_became_active":"2023-10-09T11:37:10.259416+0000","last_became_peered":"2023-10-09T11:37:10.259416+0000","last_unstale":"2023-10-09T11:37:10.259720+0000","last_undegraded":"2023-10-09T11:37:10.259720+0000","last_fullsized":"2023-10-09T11:37:10.259720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:26.710877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248634+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:54.860317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.249486+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:56.781268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247125+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:29.642536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254936+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:37.090746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.246862+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.882658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.251273+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.260859+0000","last_change":"2023-10-09T11:37:10.260859+0000","last_active":"2023-10-09T11:37:10.260859+0000","last_peered":"2023-10-09T11:37:10.260859+0000","last_clean":"2023-10-09T11:37:10.260859+0000","last_became_active":"2023-10-09T11:37:10.260521+0000","last_became_peered":"2023-10-09T11:37:10.260521+0000","last_unstale":"2023-10-09T11:37:10.260859+0000","last_undegraded":"2023-10-09T11:37:10.260859+0000","last_fullsized":"2023-10-09T11:37:10.260859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:07.504912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253911+0000","last_change":"2023-10-09T11:37:10.253911+0000","last_active":"2023-10-09T11:37:10.253911+0000","last_peered":"2023-10-09T11:37:10.253911+0000","last_clean":"2023-10-09T11:37:10.253911+0000","last_became_active":"2023-10-09T11:37:10.253637+0000","last_became_peered":"2023-10-09T11:37:10.253637+0000","last_unstale":"2023-10-09T11:37:10.253911+0000","last_undegraded":"2023-10-09T11:37:10.253911+0000","last_fullsized":"2023-10-09T11:37:10.253911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.263400+0000","last_change":"2023-10-09T11:37:10.263400+0000","last_active":"2023-10-09T11:37:10.263400+0000","last_peered":"2023-10-09T11:37:10.263400+0000","last_clean":"2023-10-09T11:37:10.263400+0000","last_became_active":"2023-10-09T11:37:10.263092+0000","last_became_peered":"2023-10-09T11:37:10.263092+0000","last_unstale":"2023-10-09T11:37:10.263400+0000","last_undegraded":"2023-10-09T11:37:10.263400+0000","last_fullsized":"2023-10-09T11:37:10.263400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:28.300792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252391+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257739+0000","last_change":"2023-10-09T11:37:10.257739+0000","last_active":"2023-10-09T11:37:10.257739+0000","last_peered":"2023-10-09T11:37:10.257739+0000","last_clean":"2023-10-09T11:37:10.257739+0000","last_became_active":"2023-10-09T11:37:10.257447+0000","last_became_peered":"2023-10-09T11:37:10.257447+0000","last_unstale":"2023-10-09T11:37:10.257739+0000","last_undegraded":"2023-10-09T11:37:10.257739+0000","last_fullsized":"2023-10-09T11:37:10.257739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:33.970302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252751+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262395+0000","last_change":"2023-10-09T11:37:10.262395+0000","last_active":"2023-10-09T11:37:10.262395+0000","last_peered":"2023-10-09T11:37:10.262395+0000","last_clean":"2023-10-09T11:37:10.262395+0000","last_became_active":"2023-10-09T11:37:10.262108+0000","last_became_peered":"2023-10-09T11:37:10.262108+0000","last_unstale":"2023-10-09T11:37:10.262395+0000","last_undegraded":"2023-10-09T11:37:10.262395+0000","last_fullsized":"2023-10-09T11:37:10.262395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.264262+0000","last_change":"2023-10-09T11:37:10.264262+0000","last_active":"2023-10-09T11:37:10.264262+0000","last_peered":"2023-10-09T11:37:10.264262+0000","last_clean":"2023-10-09T11:37:10.264262+0000","last_became_active":"2023-10-09T11:37:10.263996+0000","last_became_peered":"2023-10-09T11:37:10.263996+0000","last_unstale":"2023-10-09T11:37:10.264262+0000","last_undegraded":"2023-10-09T11:37:10.264262+0000","last_fullsized":"2023-10-09T11:37:10.264262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:13.533137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.266077+0000","last_change":"2023-10-09T11:37:10.266077+0000","last_active":"2023-10-09T11:37:10.266077+0000","last_peered":"2023-10-09T11:37:10.266077+0000","last_clean":"2023-10-09T11:37:10.266077+0000","last_became_active":"2023-10-09T11:37:10.265779+0000","last_became_peered":"2023-10-09T11:37:10.265779+0000","last_unstale":"2023-10-09T11:37:10.266077+0000","last_undegraded":"2023-10-09T11:37:10.266077+0000","last_fullsized":"2023-10-09T11:37:10.266077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:00.625064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.253918+0000","last_change":"2023-10-09T11:37:10.253918+0000","last_active":"2023-10-09T11:37:10.253918+0000","last_peered":"2023-10-09T11:37:10.253918+0000","last_clean":"2023-10-09T11:37:10.253918+0000","last_became_active":"2023-10-09T11:37:10.253581+0000","last_became_peered":"2023-10-09T11:37:10.253581+0000","last_unstale":"2023-10-09T11:37:10.253918+0000","last_undegraded":"2023-10-09T11:37:10.253918+0000","last_fullsized":"2023-10-09T11:37:10.253918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:21.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257958+0000","last_change":"2023-10-09T11:37:10.257958+0000","last_active":"2023-10-09T11:37:10.257958+0000","last_peered":"2023-10-09T11:37:10.257958+0000","last_clean":"2023-10-09T11:37:10.257958+0000","last_became_active":"2023-10-09T11:37:10.257648+0000","last_became_peered":"2023-10-09T11:37:10.257648+0000","last_unstale":"2023-10-09T11:37:10.257958+0000","last_undegraded":"2023-10-09T11:37:10.257958+0000","last_fullsized":"2023-10-09T11:37:10.257958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245440+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:03.707975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.255048+0000","last_change":"2023-10-09T11:37:10.255048+0000","last_active":"2023-10-09T11:37:10.255048+0000","last_peered":"2023-10-09T11:37:10.255048+0000","last_clean":"2023-10-09T11:37:10.255048+0000","last_became_active":"2023-10-09T11:37:10.254710+0000","last_became_peered":"2023-10-09T11:37:10.254710+0000","last_unstale":"2023-10-09T11:37:10.255048+0000","last_undegraded":"2023-10-09T11:37:10.255048+0000","last_fullsized":"2023-10-09T11:37:10.255048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:07.358828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.252959+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:11.101264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.259893+0000","last_change":"2023-10-09T11:37:10.259893+0000","last_active":"2023-10-09T11:37:10.259893+0000","last_peered":"2023-10-09T11:37:10.259893+0000","last_clean":"2023-10-09T11:37:10.259893+0000","last_became_active":"2023-10-09T11:37:10.259638+0000","last_became_peered":"2023-10-09T11:37:10.259638+0000","last_unstale":"2023-10-09T11:37:10.259893+0000","last_undegraded":"2023-10-09T11:37:10.259893+0000","last_fullsized":"2023-10-09T11:37:10.259893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:19.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.254430+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244611+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:54.881079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.255554+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:59.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.245446+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:07.308074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.244688+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:04.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.248903+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:10.748390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:09.229748+0000","last_change":"2023-10-09T11:37:09.247000+0000","last_active":"2023-10-09T11:37:09.229748+0000","last_peered":"2023-10-09T11:37:09.229748+0000","last_clean":"2023-10-09T11:37:09.229748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:09.229748+0000","last_undegraded":"2023-10-09T11:37:09.229748+0000","last_fullsized":"2023-10-09T11:37:09.229748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:59.184468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.262319+0000","last_change":"2023-10-09T11:37:10.262319+0000","last_active":"2023-10-09T11:37:10.262319+0000","last_peered":"2023-10-09T11:37:10.262319+0000","last_clean":"2023-10-09T11:37:10.262319+0000","last_became_active":"2023-10-09T11:37:10.262032+0000","last_became_peered":"2023-10-09T11:37:10.262032+0000","last_unstale":"2023-10-09T11:37:10.262319+0000","last_undegraded":"2023-10-09T11:37:10.262319+0000","last_fullsized":"2023-10-09T11:37:10.262319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:20.427335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.247423+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:05.891685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.256612+0000","last_change":"2023-10-09T11:37:10.256612+0000","last_active":"2023-10-09T11:37:10.256612+0000","last_peered":"2023-10-09T11:37:10.256612+0000","last_clean":"2023-10-09T11:37:10.256612+0000","last_became_active":"2023-10-09T11:37:10.256341+0000","last_became_peered":"2023-10-09T11:37:10.256341+0000","last_unstale":"2023-10-09T11:37:10.256612+0000","last_undegraded":"2023-10-09T11:37:10.256612+0000","last_fullsized":"2023-10-09T11:37:10.256612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:52.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:37:10.238776+0000","last_change":"2023-10-09T11:37:10.238776+0000","last_active":"2023-10-09T11:37:10.238776+0000","last_peered":"2023-10-09T11:37:10.238776+0000","last_clean":"2023-10-09T11:37:10.238776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:37:10.238776+0000","last_undegraded":"2023-10-09T11:37:10.238776+0000","last_fullsized":"2023-10-09T11:37:10.238776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:37:10.257014+0000","last_change":"2023-10-09T11:37:10.257014+0000","last_active":"2023-10-09T11:37:10.257014+0000","last_peered":"2023-10-09T11:37:10.257014+0000","last_clean":"2023-10-09T11:37:10.257014+0000","last_became_active":"2023-10-09T11:37:10.256748+0000","last_became_peered":"2023-10-09T11:37:10.256748+0000","last_unstale":"2023-10-09T11:37:10.257014+0000","last_undegraded":"2023-10-09T11:37:10.257014+0000","last_fullsized":"2023-10-09T11:37:10.257014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.897009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:37:09.251737+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:37:09.251737+0000","last_peered":"2023-10-09T11:37:09.251737+0000","last_clean":"2023-10-09T11:37:09.251737+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:37:09.251737+0000","last_undegraded":"2023-10-09T11:37:09.251737+0000","last_fullsized":"2023-10-09T11:37:09.251737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":901268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9450000000000003,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":8.8940000000000001,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.748}]},{"osd":3,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.495},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1318912,"data_stored":895005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.8180000000000001,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.318}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.218},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302092,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069748,"statfs":{"total":96636764160,"available":96327421952,"internally_reserved":0,"allocated":724992,"data_stored":304637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:36:13 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":1.056,"15min":1.056},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.71399999999999997,"15min":0.74299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81499999999999995,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89800000000000002,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78100000000000003,"5min":1.234,"15min":1.234},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":1.282,"15min":1.282},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":310900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:37:19.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:20.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.062+0000 7fb86bf1a700 1 Processor -- start 2023-10-09T11:37:20.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.062+0000 7fb86bf1a700 1 -- start start 2023-10-09T11:37:20.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb86bf1a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 0x7fb8640adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb86bf1a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640adb20 con 0x7fb864159c20 2023-10-09T11:37:20.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb86bf1a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640acf10 con 0x7fb8640b1040 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb86bf1a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640ccdc0 con 0x7fb864159850 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb8694b5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb864159c20 0x7fb8640b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46246/0 (socket says 172.21.15.26:46246) 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.063+0000 7fb8694b5700 1 -- 172.21.15.26:0/126745104 learned_addr learned my addr 172.21.15.26:0/126745104 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb869cb6700 1 --2- 172.21.15.26:0/126745104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 0x7fb8640adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11221789 0 0) 0x7fb8640adb20 con 0x7fb864159c20 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850003570 con 0x7fb864159c20 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041775864 0 0) 0x7fb8640acf10 con 0x7fb8640b1040 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8640adb20 con 0x7fb8640b1040 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb869cb6700 1 -- 172.21.15.26:0/126745104 >> v1:172.21.15.67:6789/0 conn(0x7fb8640b1040 legacy=0x7fb8640c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb869cb6700 1 -- 172.21.15.26:0/126745104 >> v1:172.21.15.26:6789/0 conn(0x7fb864159c20 legacy=0x7fb8640b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088212546 0 0) 0x7fb850003570 con 0x7fb864159c20 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb869cb6700 1 -- 172.21.15.26:0/126745104 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640ad1f0 con 0x7fb864159850 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb869cb6700 1 --2- 172.21.15.26:0/126745104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 0x7fb8640adfb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb860009910 tx=0x7fb8600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e063b77ae3ba7136 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854001470 con 0x7fb864159850 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.064+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860011420 con 0x7fb864159850 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb868cb4700 1 -- 172.21.15.26:0/126745104 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600117a0 con 0x7fb864159850 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 -- 172.21.15.26:0/126745104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 msgr2=0x7fb8640adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/126745104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 0x7fb8640adfb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb860009910 tx=0x7fb8600091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 -- 172.21.15.26:0/126745104 shutdown_connections 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/126745104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159850 0x7fb8640adfb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 -- 172.21.15.26:0/126745104 >> 172.21.15.26:0/126745104 conn(0x7fb86406d170 msgr2=0x7fb8640cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 -- 172.21.15.26:0/126745104 shutdown_connections 2023-10-09T11:37:20.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.065+0000 7fb86bf1a700 1 -- 172.21.15.26:0/126745104 wait complete. 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.066+0000 7fb86bf1a700 1 Processor -- start 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.066+0000 7fb86bf1a700 1 -- start start 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 0x7fb8640c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 0x7fb864154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c8580 con 0x7fb864159850 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864154f30 con 0x7fb8640b1040 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86bf1a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864155210 con 0x7fb864159c20 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32852/0 (socket says 172.21.15.26:32852) 2023-10-09T11:37:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 -- 172.21.15.26:0/738981544 learned_addr learned my addr 172.21.15.26:0/738981544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb869cb6700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 0x7fb8640c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86a4b7700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 0x7fb864154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 -- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 msgr2=0x7fb864154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 0x7fb864154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 -- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 msgr2=0x7fb8640c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 0x7fb8640c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb8694b5700 1 -- 172.21.15.26:0/738981544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860009420 con 0x7fb864159850 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb86a4b7700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 0x7fb864154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.067+0000 7fb869cb6700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 0x7fb8640c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb8694b5700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7e0 tx=0x7fb854001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854007360 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8540074e0 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854004830 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8641554f0 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.068+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb864167b20 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.069+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864167da0 con 0x7fb864159850 2023-10-09T11:37:20.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.069+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb854004ba0 con 0x7fb864159850 2023-10-09T11:37:20.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.070+0000 7fb859ffb700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 0x7fb848069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.070+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8540838c0 con 0x7fb864159850 2023-10-09T11:37:20.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.070+0000 7fb869cb6700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 0x7fb848069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.071+0000 7fb869cb6700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 0x7fb848069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb860009860 tx=0x7fb860016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.074+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb864167da0 con 0x7fb864159850 2023-10-09T11:37:20.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.262+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb864167da0 con 0x7fb848066fc0 2023-10-09T11:37:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.272+0000 7fb859ffb700 1 -- 172.21.15.26:0/738981544 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289182 (secure 0 0 0) 0x7fb864167da0 con 0x7fb848066fc0 2023-10-09T11:37:20.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 msgr2=0x7fb848069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 0x7fb848069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb860009860 tx=0x7fb860016000 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 msgr2=0x7fb8640c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7e0 tx=0x7fb854001a30 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 shutdown_connections 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb848066fc0 0x7fb848069470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb864159c20 0x7fb864154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8640b1040 0x7fb8640c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 --2- 172.21.15.26:0/738981544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb864159850 0x7fb8640c1ab0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 >> 172.21.15.26:0/738981544 conn(0x7fb86406d170 msgr2=0x7fb8640638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 shutdown_connections 2023-10-09T11:37:20.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.275+0000 7fb86bf1a700 1 -- 172.21.15.26:0/738981544 wait complete. 2023-10-09T11:37:20.279 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:37:20.288 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-10-09T11:37:19.131627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397768,"kb_used_data":7176,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752576952,"statfs":{"total":773094113280,"available":770638798848,"internally_reserved":0,"allocated":7348224,"data_stored":3776956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002012"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.272946+0000","last_change":"2023-10-09T11:37:11.261731+0000","last_active":"2023-10-09T11:37:11.272946+0000","last_peered":"2023-10-09T11:37:11.272946+0000","last_clean":"2023-10-09T11:37:11.272946+0000","last_became_active":"2023-10-09T11:37:11.261089+0000","last_became_peered":"2023-10-09T11:37:11.261089+0000","last_unstale":"2023-10-09T11:37:11.272946+0000","last_undegraded":"2023-10-09T11:37:11.272946+0000","last_fullsized":"2023-10-09T11:37:11.272946+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:05.342142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274123+0000","last_change":"2023-10-09T11:37:11.264933+0000","last_active":"2023-10-09T11:37:11.274123+0000","last_peered":"2023-10-09T11:37:11.274123+0000","last_clean":"2023-10-09T11:37:11.274123+0000","last_became_active":"2023-10-09T11:37:11.264687+0000","last_became_peered":"2023-10-09T11:37:11.264687+0000","last_unstale":"2023-10-09T11:37:11.274123+0000","last_undegraded":"2023-10-09T11:37:11.274123+0000","last_fullsized":"2023-10-09T11:37:11.274123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.261175+0000","last_change":"2023-10-09T11:37:11.256495+0000","last_active":"2023-10-09T11:37:11.261175+0000","last_peered":"2023-10-09T11:37:11.261175+0000","last_clean":"2023-10-09T11:37:11.261175+0000","last_became_active":"2023-10-09T11:37:11.256239+0000","last_became_peered":"2023-10-09T11:37:11.256239+0000","last_unstale":"2023-10-09T11:37:11.261175+0000","last_undegraded":"2023-10-09T11:37:11.261175+0000","last_fullsized":"2023-10-09T11:37:11.261175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:39.543367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266883+0000","last_change":"2023-10-09T11:37:11.264975+0000","last_active":"2023-10-09T11:37:11.266883+0000","last_peered":"2023-10-09T11:37:11.266883+0000","last_clean":"2023-10-09T11:37:11.266883+0000","last_became_active":"2023-10-09T11:37:11.264716+0000","last_became_peered":"2023-10-09T11:37:11.264716+0000","last_unstale":"2023-10-09T11:37:11.266883+0000","last_undegraded":"2023-10-09T11:37:11.266883+0000","last_fullsized":"2023-10-09T11:37:11.266883+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:26.484762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.262637+0000","last_change":"2023-10-09T11:37:11.261510+0000","last_active":"2023-10-09T11:37:11.262637+0000","last_peered":"2023-10-09T11:37:11.262637+0000","last_clean":"2023-10-09T11:37:11.262637+0000","last_became_active":"2023-10-09T11:37:11.261191+0000","last_became_peered":"2023-10-09T11:37:11.261191+0000","last_unstale":"2023-10-09T11:37:11.262637+0000","last_undegraded":"2023-10-09T11:37:11.262637+0000","last_fullsized":"2023-10-09T11:37:11.262637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:21.906036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274290+0000","last_change":"2023-10-09T11:37:11.265453+0000","last_active":"2023-10-09T11:37:11.274290+0000","last_peered":"2023-10-09T11:37:11.274290+0000","last_clean":"2023-10-09T11:37:11.274290+0000","last_became_active":"2023-10-09T11:37:11.265203+0000","last_became_peered":"2023-10-09T11:37:11.265203+0000","last_unstale":"2023-10-09T11:37:11.274290+0000","last_undegraded":"2023-10-09T11:37:11.274290+0000","last_fullsized":"2023-10-09T11:37:11.274290+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:05.798733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.264883+0000","last_change":"2023-10-09T11:37:11.257911+0000","last_active":"2023-10-09T11:37:11.264883+0000","last_peered":"2023-10-09T11:37:11.264883+0000","last_clean":"2023-10-09T11:37:11.264883+0000","last_became_active":"2023-10-09T11:37:11.257620+0000","last_became_peered":"2023-10-09T11:37:11.257620+0000","last_unstale":"2023-10-09T11:37:11.264883+0000","last_undegraded":"2023-10-09T11:37:11.264883+0000","last_fullsized":"2023-10-09T11:37:11.264883+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:30.611416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.273998+0000","last_change":"2023-10-09T11:37:11.262350+0000","last_active":"2023-10-09T11:37:11.273998+0000","last_peered":"2023-10-09T11:37:11.273998+0000","last_clean":"2023-10-09T11:37:11.273998+0000","last_became_active":"2023-10-09T11:37:11.261067+0000","last_became_peered":"2023-10-09T11:37:11.261067+0000","last_unstale":"2023-10-09T11:37:11.273998+0000","last_undegraded":"2023-10-09T11:37:11.273998+0000","last_fullsized":"2023-10-09T11:37:11.273998+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:04.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260678+0000","last_change":"2023-10-09T11:37:11.257714+0000","last_active":"2023-10-09T11:37:11.260678+0000","last_peered":"2023-10-09T11:37:11.260678+0000","last_clean":"2023-10-09T11:37:11.260678+0000","last_became_active":"2023-10-09T11:37:11.257173+0000","last_became_peered":"2023-10-09T11:37:11.257173+0000","last_unstale":"2023-10-09T11:37:11.260678+0000","last_undegraded":"2023-10-09T11:37:11.260678+0000","last_fullsized":"2023-10-09T11:37:11.260678+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:18.126165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.275040+0000","last_change":"2023-10-09T11:37:11.264156+0000","last_active":"2023-10-09T11:37:11.275040+0000","last_peered":"2023-10-09T11:37:11.275040+0000","last_clean":"2023-10-09T11:37:11.275040+0000","last_became_active":"2023-10-09T11:37:11.263847+0000","last_became_peered":"2023-10-09T11:37:11.263847+0000","last_unstale":"2023-10-09T11:37:11.275040+0000","last_undegraded":"2023-10-09T11:37:11.275040+0000","last_fullsized":"2023-10-09T11:37:11.275040+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:57.330723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.273004+0000","last_change":"2023-10-09T11:37:11.262322+0000","last_active":"2023-10-09T11:37:11.273004+0000","last_peered":"2023-10-09T11:37:11.273004+0000","last_clean":"2023-10-09T11:37:11.273004+0000","last_became_active":"2023-10-09T11:37:11.261704+0000","last_became_peered":"2023-10-09T11:37:11.261704+0000","last_unstale":"2023-10-09T11:37:11.273004+0000","last_undegraded":"2023-10-09T11:37:11.273004+0000","last_fullsized":"2023-10-09T11:37:11.273004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:12.136541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.259998+0000","last_change":"2023-10-09T11:37:11.257044+0000","last_active":"2023-10-09T11:37:11.259998+0000","last_peered":"2023-10-09T11:37:11.259998+0000","last_clean":"2023-10-09T11:37:11.259998+0000","last_became_active":"2023-10-09T11:37:11.256770+0000","last_became_peered":"2023-10-09T11:37:11.256770+0000","last_unstale":"2023-10-09T11:37:11.259998+0000","last_undegraded":"2023-10-09T11:37:11.259998+0000","last_fullsized":"2023-10-09T11:37:11.259998+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260976+0000","last_change":"2023-10-09T11:37:11.256334+0000","last_active":"2023-10-09T11:37:11.260976+0000","last_peered":"2023-10-09T11:37:11.260976+0000","last_clean":"2023-10-09T11:37:11.260976+0000","last_became_active":"2023-10-09T11:37:11.256077+0000","last_became_peered":"2023-10-09T11:37:11.256077+0000","last_unstale":"2023-10-09T11:37:11.260976+0000","last_undegraded":"2023-10-09T11:37:11.260976+0000","last_fullsized":"2023-10-09T11:37:11.260976+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:51.588811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266917+0000","last_change":"2023-10-09T11:37:11.265794+0000","last_active":"2023-10-09T11:37:11.266917+0000","last_peered":"2023-10-09T11:37:11.266917+0000","last_clean":"2023-10-09T11:37:11.266917+0000","last_became_active":"2023-10-09T11:37:11.265503+0000","last_became_peered":"2023-10-09T11:37:11.265503+0000","last_unstale":"2023-10-09T11:37:11.266917+0000","last_undegraded":"2023-10-09T11:37:11.266917+0000","last_fullsized":"2023-10-09T11:37:11.266917+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:22.084874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.261148+0000","last_change":"2023-10-09T11:37:11.257871+0000","last_active":"2023-10-09T11:37:11.261148+0000","last_peered":"2023-10-09T11:37:11.261148+0000","last_clean":"2023-10-09T11:37:11.261148+0000","last_became_active":"2023-10-09T11:37:11.257616+0000","last_became_peered":"2023-10-09T11:37:11.257616+0000","last_unstale":"2023-10-09T11:37:11.261148+0000","last_undegraded":"2023-10-09T11:37:11.261148+0000","last_fullsized":"2023-10-09T11:37:11.261148+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:26.264325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.277498+0000","last_change":"2023-10-09T11:37:11.275368+0000","last_active":"2023-10-09T11:37:11.277498+0000","last_peered":"2023-10-09T11:37:11.277498+0000","last_clean":"2023-10-09T11:37:11.277498+0000","last_became_active":"2023-10-09T11:37:11.275110+0000","last_became_peered":"2023-10-09T11:37:11.275110+0000","last_unstale":"2023-10-09T11:37:11.277498+0000","last_undegraded":"2023-10-09T11:37:11.277498+0000","last_fullsized":"2023-10-09T11:37:11.277498+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:04.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260700+0000","last_change":"2023-10-09T11:37:11.257871+0000","last_active":"2023-10-09T11:37:11.260700+0000","last_peered":"2023-10-09T11:37:11.260700+0000","last_clean":"2023-10-09T11:37:11.260700+0000","last_became_active":"2023-10-09T11:37:11.257464+0000","last_became_peered":"2023-10-09T11:37:11.257464+0000","last_unstale":"2023-10-09T11:37:11.260700+0000","last_undegraded":"2023-10-09T11:37:11.260700+0000","last_fullsized":"2023-10-09T11:37:11.260700+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:08.513939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266873+0000","last_change":"2023-10-09T11:37:11.263736+0000","last_active":"2023-10-09T11:37:11.266873+0000","last_peered":"2023-10-09T11:37:11.266873+0000","last_clean":"2023-10-09T11:37:11.266873+0000","last_became_active":"2023-10-09T11:37:11.263471+0000","last_became_peered":"2023-10-09T11:37:11.263471+0000","last_unstale":"2023-10-09T11:37:11.266873+0000","last_undegraded":"2023-10-09T11:37:11.266873+0000","last_fullsized":"2023-10-09T11:37:11.266873+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274184+0000","last_change":"2023-10-09T11:37:11.262551+0000","last_active":"2023-10-09T11:37:11.274184+0000","last_peered":"2023-10-09T11:37:11.274184+0000","last_clean":"2023-10-09T11:37:11.274184+0000","last_became_active":"2023-10-09T11:37:11.260767+0000","last_became_peered":"2023-10-09T11:37:11.260767+0000","last_unstale":"2023-10-09T11:37:11.274184+0000","last_undegraded":"2023-10-09T11:37:11.274184+0000","last_fullsized":"2023-10-09T11:37:11.274184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:08.317101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.262610+0000","last_change":"2023-10-09T11:37:11.258536+0000","last_active":"2023-10-09T11:37:11.262610+0000","last_peered":"2023-10-09T11:37:11.262610+0000","last_clean":"2023-10-09T11:37:11.262610+0000","last_became_active":"2023-10-09T11:37:11.258293+0000","last_became_peered":"2023-10-09T11:37:11.258293+0000","last_unstale":"2023-10-09T11:37:11.262610+0000","last_undegraded":"2023-10-09T11:37:11.262610+0000","last_fullsized":"2023-10-09T11:37:11.262610+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:01.634092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274927+0000","last_change":"2023-10-09T11:37:11.263369+0000","last_active":"2023-10-09T11:37:11.274927+0000","last_peered":"2023-10-09T11:37:11.274927+0000","last_clean":"2023-10-09T11:37:11.274927+0000","last_became_active":"2023-10-09T11:37:11.261630+0000","last_became_peered":"2023-10-09T11:37:11.261630+0000","last_unstale":"2023-10-09T11:37:11.274927+0000","last_undegraded":"2023-10-09T11:37:11.274927+0000","last_fullsized":"2023-10-09T11:37:11.274927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:15.703120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274983+0000","last_change":"2023-10-09T11:37:11.263808+0000","last_active":"2023-10-09T11:37:11.274983+0000","last_peered":"2023-10-09T11:37:11.274983+0000","last_clean":"2023-10-09T11:37:11.274983+0000","last_became_active":"2023-10-09T11:37:11.261484+0000","last_became_peered":"2023-10-09T11:37:11.261484+0000","last_unstale":"2023-10-09T11:37:11.274983+0000","last_undegraded":"2023-10-09T11:37:11.274983+0000","last_fullsized":"2023-10-09T11:37:11.274983+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:13.978284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.273040+0000","last_change":"2023-10-09T11:37:11.264731+0000","last_active":"2023-10-09T11:37:11.273040+0000","last_peered":"2023-10-09T11:37:11.273040+0000","last_clean":"2023-10-09T11:37:11.273040+0000","last_became_active":"2023-10-09T11:37:11.264461+0000","last_became_peered":"2023-10-09T11:37:11.264461+0000","last_unstale":"2023-10-09T11:37:11.273040+0000","last_undegraded":"2023-10-09T11:37:11.273040+0000","last_fullsized":"2023-10-09T11:37:11.273040+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:47.744994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266045+0000","last_change":"2023-10-09T11:37:11.258426+0000","last_active":"2023-10-09T11:37:11.266045+0000","last_peered":"2023-10-09T11:37:11.266045+0000","last_clean":"2023-10-09T11:37:11.266045+0000","last_became_active":"2023-10-09T11:37:11.257673+0000","last_became_peered":"2023-10-09T11:37:11.257673+0000","last_unstale":"2023-10-09T11:37:11.266045+0000","last_undegraded":"2023-10-09T11:37:11.266045+0000","last_fullsized":"2023-10-09T11:37:11.266045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:33.926030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.275412+0000","last_change":"2023-10-09T11:37:11.268270+0000","last_active":"2023-10-09T11:37:11.275412+0000","last_peered":"2023-10-09T11:37:11.275412+0000","last_clean":"2023-10-09T11:37:11.275412+0000","last_became_active":"2023-10-09T11:37:11.267999+0000","last_became_peered":"2023-10-09T11:37:11.267999+0000","last_unstale":"2023-10-09T11:37:11.275412+0000","last_undegraded":"2023-10-09T11:37:11.275412+0000","last_fullsized":"2023-10-09T11:37:11.275412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:32.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.263518+0000","last_change":"2023-10-09T11:37:11.257099+0000","last_active":"2023-10-09T11:37:11.263518+0000","last_peered":"2023-10-09T11:37:11.263518+0000","last_clean":"2023-10-09T11:37:11.263518+0000","last_became_active":"2023-10-09T11:37:11.256807+0000","last_became_peered":"2023-10-09T11:37:11.256807+0000","last_unstale":"2023-10-09T11:37:11.263518+0000","last_undegraded":"2023-10-09T11:37:11.263518+0000","last_fullsized":"2023-10-09T11:37:11.263518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:56.254564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267519+0000","last_change":"2023-10-09T11:37:11.264653+0000","last_active":"2023-10-09T11:37:11.267519+0000","last_peered":"2023-10-09T11:37:11.267519+0000","last_clean":"2023-10-09T11:37:11.267519+0000","last_became_active":"2023-10-09T11:37:11.264125+0000","last_became_peered":"2023-10-09T11:37:11.264125+0000","last_unstale":"2023-10-09T11:37:11.267519+0000","last_undegraded":"2023-10-09T11:37:11.267519+0000","last_fullsized":"2023-10-09T11:37:11.267519+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:59.433844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.272816+0000","last_change":"2023-10-09T11:37:11.261871+0000","last_active":"2023-10-09T11:37:11.272816+0000","last_peered":"2023-10-09T11:37:11.272816+0000","last_clean":"2023-10-09T11:37:11.272816+0000","last_became_active":"2023-10-09T11:37:11.261572+0000","last_became_peered":"2023-10-09T11:37:11.261572+0000","last_unstale":"2023-10-09T11:37:11.272816+0000","last_undegraded":"2023-10-09T11:37:11.272816+0000","last_fullsized":"2023-10-09T11:37:11.272816+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:41:47.587905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267879+0000","last_change":"2023-10-09T11:37:11.266629+0000","last_active":"2023-10-09T11:37:11.267879+0000","last_peered":"2023-10-09T11:37:11.267879+0000","last_clean":"2023-10-09T11:37:11.267879+0000","last_became_active":"2023-10-09T11:37:11.265490+0000","last_became_peered":"2023-10-09T11:37:11.265490+0000","last_unstale":"2023-10-09T11:37:11.267879+0000","last_undegraded":"2023-10-09T11:37:11.267879+0000","last_fullsized":"2023-10-09T11:37:11.267879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:12.413294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.264511+0000","last_change":"2023-10-09T11:37:11.256100+0000","last_active":"2023-10-09T11:37:11.264511+0000","last_peered":"2023-10-09T11:37:11.264511+0000","last_clean":"2023-10-09T11:37:11.264511+0000","last_became_active":"2023-10-09T11:37:11.255557+0000","last_became_peered":"2023-10-09T11:37:11.255557+0000","last_unstale":"2023-10-09T11:37:11.264511+0000","last_undegraded":"2023-10-09T11:37:11.264511+0000","last_fullsized":"2023-10-09T11:37:11.264511+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:35.841797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.262856+0000","last_change":"2023-10-09T11:37:11.255800+0000","last_active":"2023-10-09T11:37:11.262856+0000","last_peered":"2023-10-09T11:37:11.262856+0000","last_clean":"2023-10-09T11:37:11.262856+0000","last_became_active":"2023-10-09T11:37:11.255505+0000","last_became_peered":"2023-10-09T11:37:11.255505+0000","last_unstale":"2023-10-09T11:37:11.262856+0000","last_undegraded":"2023-10-09T11:37:11.262856+0000","last_fullsized":"2023-10-09T11:37:11.262856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:40.876106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274031+0000","last_change":"2023-10-09T11:37:11.262380+0000","last_active":"2023-10-09T11:37:11.274031+0000","last_peered":"2023-10-09T11:37:11.274031+0000","last_clean":"2023-10-09T11:37:11.274031+0000","last_became_active":"2023-10-09T11:37:11.262062+0000","last_became_peered":"2023-10-09T11:37:11.262062+0000","last_unstale":"2023-10-09T11:37:11.274031+0000","last_undegraded":"2023-10-09T11:37:11.274031+0000","last_fullsized":"2023-10-09T11:37:11.274031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:42.930214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.265925+0000","last_change":"2023-10-09T11:37:11.258536+0000","last_active":"2023-10-09T11:37:11.265925+0000","last_peered":"2023-10-09T11:37:11.265925+0000","last_clean":"2023-10-09T11:37:11.265925+0000","last_became_active":"2023-10-09T11:37:11.258203+0000","last_became_peered":"2023-10-09T11:37:11.258203+0000","last_unstale":"2023-10-09T11:37:11.265925+0000","last_undegraded":"2023-10-09T11:37:11.265925+0000","last_fullsized":"2023-10-09T11:37:11.265925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:52.268521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274997+0000","last_change":"2023-10-09T11:37:10.267368+0000","last_active":"2023-10-09T11:37:11.274997+0000","last_peered":"2023-10-09T11:37:11.274997+0000","last_clean":"2023-10-09T11:37:11.274997+0000","last_became_active":"2023-10-09T11:37:10.267112+0000","last_became_peered":"2023-10-09T11:37:10.267112+0000","last_unstale":"2023-10-09T11:37:11.274997+0000","last_undegraded":"2023-10-09T11:37:11.274997+0000","last_fullsized":"2023-10-09T11:37:11.274997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:29.602389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.258790+0000","last_change":"2023-10-09T11:37:11.255112+0000","last_active":"2023-10-09T11:37:11.258790+0000","last_peered":"2023-10-09T11:37:11.258790+0000","last_clean":"2023-10-09T11:37:11.258790+0000","last_became_active":"2023-10-09T11:37:11.254849+0000","last_became_peered":"2023-10-09T11:37:11.254849+0000","last_unstale":"2023-10-09T11:37:11.258790+0000","last_undegraded":"2023-10-09T11:37:11.258790+0000","last_fullsized":"2023-10-09T11:37:11.258790+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:04.585439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267232+0000","last_change":"2023-10-09T11:37:10.262043+0000","last_active":"2023-10-09T11:37:11.267232+0000","last_peered":"2023-10-09T11:37:11.267232+0000","last_clean":"2023-10-09T11:37:11.267232+0000","last_became_active":"2023-10-09T11:37:10.261762+0000","last_became_peered":"2023-10-09T11:37:10.261762+0000","last_unstale":"2023-10-09T11:37:11.267232+0000","last_undegraded":"2023-10-09T11:37:11.267232+0000","last_fullsized":"2023-10-09T11:37:11.267232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:25.475735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.272722+0000","last_change":"2023-10-09T11:37:11.260471+0000","last_active":"2023-10-09T11:37:11.272722+0000","last_peered":"2023-10-09T11:37:11.272722+0000","last_clean":"2023-10-09T11:37:11.272722+0000","last_became_active":"2023-10-09T11:37:11.260158+0000","last_became_peered":"2023-10-09T11:37:11.260158+0000","last_unstale":"2023-10-09T11:37:11.272722+0000","last_undegraded":"2023-10-09T11:37:11.272722+0000","last_fullsized":"2023-10-09T11:37:11.272722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:30.106796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276765+0000","last_change":"2023-10-09T11:37:10.264621+0000","last_active":"2023-10-09T11:37:11.276765+0000","last_peered":"2023-10-09T11:37:11.276765+0000","last_clean":"2023-10-09T11:37:11.276765+0000","last_became_active":"2023-10-09T11:37:10.264308+0000","last_became_peered":"2023-10-09T11:37:10.264308+0000","last_unstale":"2023-10-09T11:37:11.276765+0000","last_undegraded":"2023-10-09T11:37:11.276765+0000","last_fullsized":"2023-10-09T11:37:11.276765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.272894+0000","last_change":"2023-10-09T11:37:11.262485+0000","last_active":"2023-10-09T11:37:11.272894+0000","last_peered":"2023-10-09T11:37:11.272894+0000","last_clean":"2023-10-09T11:37:11.272894+0000","last_became_active":"2023-10-09T11:37:11.262005+0000","last_became_peered":"2023-10-09T11:37:11.262005+0000","last_unstale":"2023-10-09T11:37:11.272894+0000","last_undegraded":"2023-10-09T11:37:11.272894+0000","last_fullsized":"2023-10-09T11:37:11.272894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:58.337645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276401+0000","last_change":"2023-10-09T11:37:10.256443+0000","last_active":"2023-10-09T11:37:11.276401+0000","last_peered":"2023-10-09T11:37:11.276401+0000","last_clean":"2023-10-09T11:37:11.276401+0000","last_became_active":"2023-10-09T11:37:10.255918+0000","last_became_peered":"2023-10-09T11:37:10.255918+0000","last_unstale":"2023-10-09T11:37:11.276401+0000","last_undegraded":"2023-10-09T11:37:11.276401+0000","last_fullsized":"2023-10-09T11:37:11.276401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.993290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.264555+0000","last_change":"2023-10-09T11:37:11.257073+0000","last_active":"2023-10-09T11:37:11.264555+0000","last_peered":"2023-10-09T11:37:11.264555+0000","last_clean":"2023-10-09T11:37:11.264555+0000","last_became_active":"2023-10-09T11:37:11.256738+0000","last_became_peered":"2023-10-09T11:37:11.256738+0000","last_unstale":"2023-10-09T11:37:11.264555+0000","last_undegraded":"2023-10-09T11:37:11.264555+0000","last_fullsized":"2023-10-09T11:37:11.264555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:01.634092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.275859+0000","last_change":"2023-10-09T11:37:10.263288+0000","last_active":"2023-10-09T11:37:11.275859+0000","last_peered":"2023-10-09T11:37:11.275859+0000","last_clean":"2023-10-09T11:37:11.275859+0000","last_became_active":"2023-10-09T11:37:10.262993+0000","last_became_peered":"2023-10-09T11:37:10.262993+0000","last_unstale":"2023-10-09T11:37:11.275859+0000","last_undegraded":"2023-10-09T11:37:11.275859+0000","last_fullsized":"2023-10-09T11:37:11.275859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:04.333115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.275575+0000","last_change":"2023-10-09T11:37:11.269275+0000","last_active":"2023-10-09T11:37:11.275575+0000","last_peered":"2023-10-09T11:37:11.275575+0000","last_clean":"2023-10-09T11:37:11.275575+0000","last_became_active":"2023-10-09T11:37:11.268962+0000","last_became_peered":"2023-10-09T11:37:11.268962+0000","last_unstale":"2023-10-09T11:37:11.275575+0000","last_undegraded":"2023-10-09T11:37:11.275575+0000","last_fullsized":"2023-10-09T11:37:11.275575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:20.831426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276207+0000","last_change":"2023-10-09T11:37:10.258523+0000","last_active":"2023-10-09T11:37:11.276207+0000","last_peered":"2023-10-09T11:37:11.276207+0000","last_clean":"2023-10-09T11:37:11.276207+0000","last_became_active":"2023-10-09T11:37:10.258253+0000","last_became_peered":"2023-10-09T11:37:10.258253+0000","last_unstale":"2023-10-09T11:37:11.276207+0000","last_undegraded":"2023-10-09T11:37:11.276207+0000","last_fullsized":"2023-10-09T11:37:11.276207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:17.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266481+0000","last_change":"2023-10-09T11:37:11.264925+0000","last_active":"2023-10-09T11:37:11.266481+0000","last_peered":"2023-10-09T11:37:11.266481+0000","last_clean":"2023-10-09T11:37:11.266481+0000","last_became_active":"2023-10-09T11:37:11.264663+0000","last_became_peered":"2023-10-09T11:37:11.264663+0000","last_unstale":"2023-10-09T11:37:11.266481+0000","last_undegraded":"2023-10-09T11:37:11.266481+0000","last_fullsized":"2023-10-09T11:37:11.266481+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:53.591215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.251419+0000","last_change":"2023-10-09T11:37:10.259992+0000","last_active":"2023-10-09T11:37:11.251419+0000","last_peered":"2023-10-09T11:37:11.251419+0000","last_clean":"2023-10-09T11:37:11.251419+0000","last_became_active":"2023-10-09T11:37:10.259726+0000","last_became_peered":"2023-10-09T11:37:10.259726+0000","last_unstale":"2023-10-09T11:37:11.251419+0000","last_undegraded":"2023-10-09T11:37:11.251419+0000","last_fullsized":"2023-10-09T11:37:11.251419+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:53.851290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.262700+0000","last_change":"2023-10-09T11:37:11.260203+0000","last_active":"2023-10-09T11:37:11.262700+0000","last_peered":"2023-10-09T11:37:11.262700+0000","last_clean":"2023-10-09T11:37:11.262700+0000","last_became_active":"2023-10-09T11:37:11.259938+0000","last_became_peered":"2023-10-09T11:37:11.259938+0000","last_unstale":"2023-10-09T11:37:11.262700+0000","last_undegraded":"2023-10-09T11:37:11.262700+0000","last_fullsized":"2023-10-09T11:37:11.262700+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:35.841797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.250246+0000","last_change":"2023-10-09T11:37:10.256945+0000","last_active":"2023-10-09T11:37:11.250246+0000","last_peered":"2023-10-09T11:37:11.250246+0000","last_clean":"2023-10-09T11:37:11.250246+0000","last_became_active":"2023-10-09T11:37:10.256672+0000","last_became_peered":"2023-10-09T11:37:10.256672+0000","last_unstale":"2023-10-09T11:37:11.250246+0000","last_undegraded":"2023-10-09T11:37:11.250246+0000","last_fullsized":"2023-10-09T11:37:11.250246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:33.438522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.264915+0000","last_change":"2023-10-09T11:37:11.258314+0000","last_active":"2023-10-09T11:37:11.264915+0000","last_peered":"2023-10-09T11:37:11.264915+0000","last_clean":"2023-10-09T11:37:11.264915+0000","last_became_active":"2023-10-09T11:37:11.258066+0000","last_became_peered":"2023-10-09T11:37:11.258066+0000","last_unstale":"2023-10-09T11:37:11.264915+0000","last_undegraded":"2023-10-09T11:37:11.264915+0000","last_fullsized":"2023-10-09T11:37:11.264915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:30.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260253+0000","last_change":"2023-10-09T11:37:10.264721+0000","last_active":"2023-10-09T11:37:11.260253+0000","last_peered":"2023-10-09T11:37:11.260253+0000","last_clean":"2023-10-09T11:37:11.260253+0000","last_became_active":"2023-10-09T11:37:10.264425+0000","last_became_peered":"2023-10-09T11:37:10.264425+0000","last_unstale":"2023-10-09T11:37:11.260253+0000","last_undegraded":"2023-10-09T11:37:11.260253+0000","last_fullsized":"2023-10-09T11:37:11.260253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267730+0000","last_change":"2023-10-09T11:37:11.258836+0000","last_active":"2023-10-09T11:37:11.267730+0000","last_peered":"2023-10-09T11:37:11.267730+0000","last_clean":"2023-10-09T11:37:11.267730+0000","last_became_active":"2023-10-09T11:37:11.257898+0000","last_became_peered":"2023-10-09T11:37:11.257898+0000","last_unstale":"2023-10-09T11:37:11.267730+0000","last_undegraded":"2023-10-09T11:37:11.267730+0000","last_fullsized":"2023-10-09T11:37:11.267730+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:24.722178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.256601+0000","last_change":"2023-10-09T11:37:10.259720+0000","last_active":"2023-10-09T11:37:11.256601+0000","last_peered":"2023-10-09T11:37:11.256601+0000","last_clean":"2023-10-09T11:37:11.256601+0000","last_became_active":"2023-10-09T11:37:10.259416+0000","last_became_peered":"2023-10-09T11:37:10.259416+0000","last_unstale":"2023-10-09T11:37:11.256601+0000","last_undegraded":"2023-10-09T11:37:11.256601+0000","last_fullsized":"2023-10-09T11:37:11.256601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:26.710877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274334+0000","last_change":"2023-10-09T11:37:11.266289+0000","last_active":"2023-10-09T11:37:11.274334+0000","last_peered":"2023-10-09T11:37:11.274334+0000","last_clean":"2023-10-09T11:37:11.274334+0000","last_became_active":"2023-10-09T11:37:11.266010+0000","last_became_peered":"2023-10-09T11:37:11.266010+0000","last_unstale":"2023-10-09T11:37:11.274334+0000","last_undegraded":"2023-10-09T11:37:11.274334+0000","last_fullsized":"2023-10-09T11:37:11.274334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:29.618811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.273750+0000","last_change":"2023-10-09T11:37:10.262110+0000","last_active":"2023-10-09T11:37:11.273750+0000","last_peered":"2023-10-09T11:37:11.273750+0000","last_clean":"2023-10-09T11:37:11.273750+0000","last_became_active":"2023-10-09T11:37:10.261557+0000","last_became_peered":"2023-10-09T11:37:10.261557+0000","last_unstale":"2023-10-09T11:37:11.273750+0000","last_undegraded":"2023-10-09T11:37:11.273750+0000","last_fullsized":"2023-10-09T11:37:11.273750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:30.489980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260779+0000","last_change":"2023-10-09T11:37:11.259101+0000","last_active":"2023-10-09T11:37:11.260779+0000","last_peered":"2023-10-09T11:37:11.260779+0000","last_clean":"2023-10-09T11:37:11.260779+0000","last_became_active":"2023-10-09T11:37:11.258832+0000","last_became_peered":"2023-10-09T11:37:11.258832+0000","last_unstale":"2023-10-09T11:37:11.260779+0000","last_undegraded":"2023-10-09T11:37:11.260779+0000","last_fullsized":"2023-10-09T11:37:11.260779+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:27.719904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'6","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.277726+0000","last_change":"2023-10-09T11:37:10.258223+0000","last_active":"2023-10-09T11:37:11.277726+0000","last_peered":"2023-10-09T11:37:11.277726+0000","last_clean":"2023-10-09T11:37:11.277726+0000","last_became_active":"2023-10-09T11:37:10.257714+0000","last_became_peered":"2023-10-09T11:37:10.257714+0000","last_unstale":"2023-10-09T11:37:11.277726+0000","last_undegraded":"2023-10-09T11:37:11.277726+0000","last_fullsized":"2023-10-09T11:37:11.277726+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:19.546595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266931+0000","last_change":"2023-10-09T11:37:11.260338+0000","last_active":"2023-10-09T11:37:11.266931+0000","last_peered":"2023-10-09T11:37:11.266931+0000","last_clean":"2023-10-09T11:37:11.266931+0000","last_became_active":"2023-10-09T11:37:11.259831+0000","last_became_peered":"2023-10-09T11:37:11.259831+0000","last_unstale":"2023-10-09T11:37:11.266931+0000","last_undegraded":"2023-10-09T11:37:11.266931+0000","last_fullsized":"2023-10-09T11:37:11.266931+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:26:31.499007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276522+0000","last_change":"2023-10-09T11:37:10.262718+0000","last_active":"2023-10-09T11:37:11.276522+0000","last_peered":"2023-10-09T11:37:11.276522+0000","last_clean":"2023-10-09T11:37:11.276522+0000","last_became_active":"2023-10-09T11:37:10.262439+0000","last_became_peered":"2023-10-09T11:37:10.262439+0000","last_unstale":"2023-10-09T11:37:11.276522+0000","last_undegraded":"2023-10-09T11:37:11.276522+0000","last_fullsized":"2023-10-09T11:37:11.276522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.739363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.270220+0000","last_change":"2023-10-09T11:37:11.263078+0000","last_active":"2023-10-09T11:37:11.270220+0000","last_peered":"2023-10-09T11:37:11.270220+0000","last_clean":"2023-10-09T11:37:11.270220+0000","last_became_active":"2023-10-09T11:37:11.262767+0000","last_became_peered":"2023-10-09T11:37:11.262767+0000","last_unstale":"2023-10-09T11:37:11.270220+0000","last_undegraded":"2023-10-09T11:37:11.270220+0000","last_fullsized":"2023-10-09T11:37:11.270220+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:36.581152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.255972+0000","last_change":"2023-10-09T11:37:10.260859+0000","last_active":"2023-10-09T11:37:11.255972+0000","last_peered":"2023-10-09T11:37:11.255972+0000","last_clean":"2023-10-09T11:37:11.255972+0000","last_became_active":"2023-10-09T11:37:10.260521+0000","last_became_peered":"2023-10-09T11:37:10.260521+0000","last_unstale":"2023-10-09T11:37:11.255972+0000","last_undegraded":"2023-10-09T11:37:11.255972+0000","last_fullsized":"2023-10-09T11:37:11.255972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:07.504912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260589+0000","last_change":"2023-10-09T11:37:11.254662+0000","last_active":"2023-10-09T11:37:11.260589+0000","last_peered":"2023-10-09T11:37:11.260589+0000","last_clean":"2023-10-09T11:37:11.260589+0000","last_became_active":"2023-10-09T11:37:11.254401+0000","last_became_peered":"2023-10-09T11:37:11.254401+0000","last_unstale":"2023-10-09T11:37:11.260589+0000","last_undegraded":"2023-10-09T11:37:11.260589+0000","last_fullsized":"2023-10-09T11:37:11.260589+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.247662+0000","last_change":"2023-10-09T11:37:10.253911+0000","last_active":"2023-10-09T11:37:11.247662+0000","last_peered":"2023-10-09T11:37:11.247662+0000","last_clean":"2023-10-09T11:37:11.247662+0000","last_became_active":"2023-10-09T11:37:10.253637+0000","last_became_peered":"2023-10-09T11:37:10.253637+0000","last_unstale":"2023-10-09T11:37:11.247662+0000","last_undegraded":"2023-10-09T11:37:11.247662+0000","last_fullsized":"2023-10-09T11:37:11.247662+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.259559+0000","last_change":"2023-10-09T11:37:11.255202+0000","last_active":"2023-10-09T11:37:11.259559+0000","last_peered":"2023-10-09T11:37:11.259559+0000","last_clean":"2023-10-09T11:37:11.259559+0000","last_became_active":"2023-10-09T11:37:11.254915+0000","last_became_peered":"2023-10-09T11:37:11.254915+0000","last_unstale":"2023-10-09T11:37:11.259559+0000","last_undegraded":"2023-10-09T11:37:11.259559+0000","last_fullsized":"2023-10-09T11:37:11.259559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:28.406437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"62'8","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.277464+0000","last_change":"2023-10-09T11:37:10.263400+0000","last_active":"2023-10-09T11:37:11.277464+0000","last_peered":"2023-10-09T11:37:11.277464+0000","last_clean":"2023-10-09T11:37:11.277464+0000","last_became_active":"2023-10-09T11:37:10.263092+0000","last_became_peered":"2023-10-09T11:37:10.263092+0000","last_unstale":"2023-10-09T11:37:11.277464+0000","last_undegraded":"2023-10-09T11:37:11.277464+0000","last_fullsized":"2023-10-09T11:37:11.277464+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:28.300792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.275006+0000","last_change":"2023-10-09T11:37:11.264144+0000","last_active":"2023-10-09T11:37:11.275006+0000","last_peered":"2023-10-09T11:37:11.275006+0000","last_clean":"2023-10-09T11:37:11.275006+0000","last_became_active":"2023-10-09T11:37:11.263784+0000","last_became_peered":"2023-10-09T11:37:11.263784+0000","last_unstale":"2023-10-09T11:37:11.275006+0000","last_undegraded":"2023-10-09T11:37:11.275006+0000","last_fullsized":"2023-10-09T11:37:11.275006+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:49:59.434024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276915+0000","last_change":"2023-10-09T11:37:10.257739+0000","last_active":"2023-10-09T11:37:11.276915+0000","last_peered":"2023-10-09T11:37:11.276915+0000","last_clean":"2023-10-09T11:37:11.276915+0000","last_became_active":"2023-10-09T11:37:10.257447+0000","last_became_peered":"2023-10-09T11:37:10.257447+0000","last_unstale":"2023-10-09T11:37:11.276915+0000","last_undegraded":"2023-10-09T11:37:11.276915+0000","last_fullsized":"2023-10-09T11:37:11.276915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:33.970302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267751+0000","last_change":"2023-10-09T11:37:11.259344+0000","last_active":"2023-10-09T11:37:11.267751+0000","last_peered":"2023-10-09T11:37:11.267751+0000","last_clean":"2023-10-09T11:37:11.267751+0000","last_became_active":"2023-10-09T11:37:11.258292+0000","last_became_peered":"2023-10-09T11:37:11.258292+0000","last_unstale":"2023-10-09T11:37:11.267751+0000","last_undegraded":"2023-10-09T11:37:11.267751+0000","last_fullsized":"2023-10-09T11:37:11.267751+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:57.790295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276654+0000","last_change":"2023-10-09T11:37:10.262395+0000","last_active":"2023-10-09T11:37:11.276654+0000","last_peered":"2023-10-09T11:37:11.276654+0000","last_clean":"2023-10-09T11:37:11.276654+0000","last_became_active":"2023-10-09T11:37:10.262108+0000","last_became_peered":"2023-10-09T11:37:10.262108+0000","last_unstale":"2023-10-09T11:37:11.276654+0000","last_undegraded":"2023-10-09T11:37:11.276654+0000","last_fullsized":"2023-10-09T11:37:11.276654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260015+0000","last_change":"2023-10-09T11:37:11.257379+0000","last_active":"2023-10-09T11:37:11.260015+0000","last_peered":"2023-10-09T11:37:11.260015+0000","last_clean":"2023-10-09T11:37:11.260015+0000","last_became_active":"2023-10-09T11:37:11.257110+0000","last_became_peered":"2023-10-09T11:37:11.257110+0000","last_unstale":"2023-10-09T11:37:11.260015+0000","last_undegraded":"2023-10-09T11:37:11.260015+0000","last_fullsized":"2023-10-09T11:37:11.260015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:04.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276667+0000","last_change":"2023-10-09T11:37:10.264262+0000","last_active":"2023-10-09T11:37:11.276667+0000","last_peered":"2023-10-09T11:37:11.276667+0000","last_clean":"2023-10-09T11:37:11.276667+0000","last_became_active":"2023-10-09T11:37:10.263996+0000","last_became_peered":"2023-10-09T11:37:10.263996+0000","last_unstale":"2023-10-09T11:37:11.276667+0000","last_undegraded":"2023-10-09T11:37:11.276667+0000","last_fullsized":"2023-10-09T11:37:11.276667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:13.533137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266967+0000","last_change":"2023-10-09T11:37:11.266082+0000","last_active":"2023-10-09T11:37:11.266967+0000","last_peered":"2023-10-09T11:37:11.266967+0000","last_clean":"2023-10-09T11:37:11.266967+0000","last_became_active":"2023-10-09T11:37:11.265833+0000","last_became_peered":"2023-10-09T11:37:11.265833+0000","last_unstale":"2023-10-09T11:37:11.266967+0000","last_undegraded":"2023-10-09T11:37:11.266967+0000","last_fullsized":"2023-10-09T11:37:11.266967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:14.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.248882+0000","last_change":"2023-10-09T11:37:10.266077+0000","last_active":"2023-10-09T11:37:11.248882+0000","last_peered":"2023-10-09T11:37:11.248882+0000","last_clean":"2023-10-09T11:37:11.248882+0000","last_became_active":"2023-10-09T11:37:10.265779+0000","last_became_peered":"2023-10-09T11:37:10.265779+0000","last_unstale":"2023-10-09T11:37:11.248882+0000","last_undegraded":"2023-10-09T11:37:11.248882+0000","last_fullsized":"2023-10-09T11:37:11.248882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:00.625064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.261231+0000","last_change":"2023-10-09T11:37:11.259639+0000","last_active":"2023-10-09T11:37:11.261231+0000","last_peered":"2023-10-09T11:37:11.261231+0000","last_clean":"2023-10-09T11:37:11.261231+0000","last_became_active":"2023-10-09T11:37:11.259289+0000","last_became_peered":"2023-10-09T11:37:11.259289+0000","last_unstale":"2023-10-09T11:37:11.261231+0000","last_undegraded":"2023-10-09T11:37:11.261231+0000","last_fullsized":"2023-10-09T11:37:11.261231+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:16.817644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.255888+0000","last_change":"2023-10-09T11:37:10.253918+0000","last_active":"2023-10-09T11:37:11.255888+0000","last_peered":"2023-10-09T11:37:11.255888+0000","last_clean":"2023-10-09T11:37:11.255888+0000","last_became_active":"2023-10-09T11:37:10.253581+0000","last_became_peered":"2023-10-09T11:37:10.253581+0000","last_unstale":"2023-10-09T11:37:11.255888+0000","last_undegraded":"2023-10-09T11:37:11.255888+0000","last_fullsized":"2023-10-09T11:37:11.255888+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:21.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.265578+0000","last_change":"2023-10-09T11:37:11.264099+0000","last_active":"2023-10-09T11:37:11.265578+0000","last_peered":"2023-10-09T11:37:11.265578+0000","last_clean":"2023-10-09T11:37:11.265578+0000","last_became_active":"2023-10-09T11:37:11.263822+0000","last_became_peered":"2023-10-09T11:37:11.263822+0000","last_unstale":"2023-10-09T11:37:11.265578+0000","last_undegraded":"2023-10-09T11:37:11.265578+0000","last_fullsized":"2023-10-09T11:37:11.265578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:38.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.247796+0000","last_change":"2023-10-09T11:37:10.257958+0000","last_active":"2023-10-09T11:37:11.247796+0000","last_peered":"2023-10-09T11:37:11.247796+0000","last_clean":"2023-10-09T11:37:11.247796+0000","last_became_active":"2023-10-09T11:37:10.257648+0000","last_became_peered":"2023-10-09T11:37:10.257648+0000","last_unstale":"2023-10-09T11:37:11.247796+0000","last_undegraded":"2023-10-09T11:37:11.247796+0000","last_fullsized":"2023-10-09T11:37:11.247796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.267543+0000","last_change":"2023-10-09T11:37:11.264640+0000","last_active":"2023-10-09T11:37:11.267543+0000","last_peered":"2023-10-09T11:37:11.267543+0000","last_clean":"2023-10-09T11:37:11.267543+0000","last_became_active":"2023-10-09T11:37:11.264360+0000","last_became_peered":"2023-10-09T11:37:11.264360+0000","last_unstale":"2023-10-09T11:37:11.267543+0000","last_undegraded":"2023-10-09T11:37:11.267543+0000","last_fullsized":"2023-10-09T11:37:11.267543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:39.061224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.248946+0000","last_change":"2023-10-09T11:37:10.262122+0000","last_active":"2023-10-09T11:37:11.248946+0000","last_peered":"2023-10-09T11:37:11.248946+0000","last_clean":"2023-10-09T11:37:11.248946+0000","last_became_active":"2023-10-09T11:37:10.261804+0000","last_became_peered":"2023-10-09T11:37:10.261804+0000","last_unstale":"2023-10-09T11:37:11.248946+0000","last_undegraded":"2023-10-09T11:37:11.248946+0000","last_fullsized":"2023-10-09T11:37:11.248946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:29.097769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.260844+0000","last_change":"2023-10-09T11:37:11.257905+0000","last_active":"2023-10-09T11:37:11.260844+0000","last_peered":"2023-10-09T11:37:11.260844+0000","last_clean":"2023-10-09T11:37:11.260844+0000","last_became_active":"2023-10-09T11:37:11.257665+0000","last_became_peered":"2023-10-09T11:37:11.257665+0000","last_unstale":"2023-10-09T11:37:11.260844+0000","last_undegraded":"2023-10-09T11:37:11.260844+0000","last_fullsized":"2023-10-09T11:37:11.260844+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:30.611416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276854+0000","last_change":"2023-10-09T11:37:10.255048+0000","last_active":"2023-10-09T11:37:11.276854+0000","last_peered":"2023-10-09T11:37:11.276854+0000","last_clean":"2023-10-09T11:37:11.276854+0000","last_became_active":"2023-10-09T11:37:10.254710+0000","last_became_peered":"2023-10-09T11:37:10.254710+0000","last_unstale":"2023-10-09T11:37:11.276854+0000","last_undegraded":"2023-10-09T11:37:11.276854+0000","last_fullsized":"2023-10-09T11:37:11.276854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:07.358828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.264835+0000","last_change":"2023-10-09T11:37:11.259883+0000","last_active":"2023-10-09T11:37:11.264835+0000","last_peered":"2023-10-09T11:37:11.264835+0000","last_clean":"2023-10-09T11:37:11.264835+0000","last_became_active":"2023-10-09T11:37:11.259625+0000","last_became_peered":"2023-10-09T11:37:11.259625+0000","last_unstale":"2023-10-09T11:37:11.264835+0000","last_undegraded":"2023-10-09T11:37:11.264835+0000","last_fullsized":"2023-10-09T11:37:11.264835+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:42.057936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.248193+0000","last_change":"2023-10-09T11:37:10.259893+0000","last_active":"2023-10-09T11:37:11.248193+0000","last_peered":"2023-10-09T11:37:11.248193+0000","last_clean":"2023-10-09T11:37:11.248193+0000","last_became_active":"2023-10-09T11:37:10.259638+0000","last_became_peered":"2023-10-09T11:37:10.259638+0000","last_unstale":"2023-10-09T11:37:11.248193+0000","last_undegraded":"2023-10-09T11:37:11.248193+0000","last_fullsized":"2023-10-09T11:37:11.248193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:19.822399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.266088+0000","last_change":"2023-10-09T11:37:11.258251+0000","last_active":"2023-10-09T11:37:11.266088+0000","last_peered":"2023-10-09T11:37:11.266088+0000","last_clean":"2023-10-09T11:37:11.266088+0000","last_became_active":"2023-10-09T11:37:11.257947+0000","last_became_peered":"2023-10-09T11:37:11.257947+0000","last_unstale":"2023-10-09T11:37:11.266088+0000","last_undegraded":"2023-10-09T11:37:11.266088+0000","last_fullsized":"2023-10-09T11:37:11.266088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:49.485671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.251191+0000","last_change":"2023-10-09T11:37:10.257584+0000","last_active":"2023-10-09T11:37:11.251191+0000","last_peered":"2023-10-09T11:37:11.251191+0000","last_clean":"2023-10-09T11:37:11.251191+0000","last_became_active":"2023-10-09T11:37:10.257058+0000","last_became_peered":"2023-10-09T11:37:10.257058+0000","last_unstale":"2023-10-09T11:37:11.251191+0000","last_undegraded":"2023-10-09T11:37:11.251191+0000","last_fullsized":"2023-10-09T11:37:11.251191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:23.893686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.273092+0000","last_change":"2023-10-09T11:37:11.265410+0000","last_active":"2023-10-09T11:37:11.273092+0000","last_peered":"2023-10-09T11:37:11.273092+0000","last_clean":"2023-10-09T11:37:11.273092+0000","last_became_active":"2023-10-09T11:37:11.265083+0000","last_became_peered":"2023-10-09T11:37:11.265083+0000","last_unstale":"2023-10-09T11:37:11.273092+0000","last_undegraded":"2023-10-09T11:37:11.273092+0000","last_fullsized":"2023-10-09T11:37:11.273092+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:30.186522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.249012+0000","last_change":"2023-10-09T11:37:10.262645+0000","last_active":"2023-10-09T11:37:11.249012+0000","last_peered":"2023-10-09T11:37:11.249012+0000","last_clean":"2023-10-09T11:37:11.249012+0000","last_became_active":"2023-10-09T11:37:10.262398+0000","last_became_peered":"2023-10-09T11:37:10.262398+0000","last_unstale":"2023-10-09T11:37:11.249012+0000","last_undegraded":"2023-10-09T11:37:11.249012+0000","last_fullsized":"2023-10-09T11:37:11.249012+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:14.694093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.261362+0000","last_change":"2023-10-09T11:37:11.256774+0000","last_active":"2023-10-09T11:37:11.261362+0000","last_peered":"2023-10-09T11:37:11.261362+0000","last_clean":"2023-10-09T11:37:11.261362+0000","last_became_active":"2023-10-09T11:37:11.256458+0000","last_became_peered":"2023-10-09T11:37:11.256458+0000","last_unstale":"2023-10-09T11:37:11.261362+0000","last_undegraded":"2023-10-09T11:37:11.261362+0000","last_fullsized":"2023-10-09T11:37:11.261362+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:05.289118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.250425+0000","last_change":"2023-10-09T11:37:10.258496+0000","last_active":"2023-10-09T11:37:11.250425+0000","last_peered":"2023-10-09T11:37:11.250425+0000","last_clean":"2023-10-09T11:37:11.250425+0000","last_became_active":"2023-10-09T11:37:10.257474+0000","last_became_peered":"2023-10-09T11:37:10.257474+0000","last_unstale":"2023-10-09T11:37:11.250425+0000","last_undegraded":"2023-10-09T11:37:11.250425+0000","last_fullsized":"2023-10-09T11:37:11.250425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:09.744154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.274105+0000","last_change":"2023-10-09T11:37:11.263329+0000","last_active":"2023-10-09T11:37:11.274105+0000","last_peered":"2023-10-09T11:37:11.274105+0000","last_clean":"2023-10-09T11:37:11.274105+0000","last_became_active":"2023-10-09T11:37:11.263065+0000","last_became_peered":"2023-10-09T11:37:11.263065+0000","last_unstale":"2023-10-09T11:37:11.274105+0000","last_undegraded":"2023-10-09T11:37:11.274105+0000","last_fullsized":"2023-10-09T11:37:11.274105+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:26.072680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.248604+0000","last_change":"2023-10-09T11:37:10.260064+0000","last_active":"2023-10-09T11:37:11.248604+0000","last_peered":"2023-10-09T11:37:11.248604+0000","last_clean":"2023-10-09T11:37:11.248604+0000","last_became_active":"2023-10-09T11:37:10.259749+0000","last_became_peered":"2023-10-09T11:37:10.259749+0000","last_unstale":"2023-10-09T11:37:11.248604+0000","last_undegraded":"2023-10-09T11:37:11.248604+0000","last_fullsized":"2023-10-09T11:37:11.248604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:57.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.259497+0000","last_change":"2023-10-09T11:37:11.255925+0000","last_active":"2023-10-09T11:37:11.259497+0000","last_peered":"2023-10-09T11:37:11.259497+0000","last_clean":"2023-10-09T11:37:11.259497+0000","last_became_active":"2023-10-09T11:37:11.255640+0000","last_became_peered":"2023-10-09T11:37:11.255640+0000","last_unstale":"2023-10-09T11:37:11.259497+0000","last_undegraded":"2023-10-09T11:37:11.259497+0000","last_fullsized":"2023-10-09T11:37:11.259497+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:05.798733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.259665+0000","last_change":"2023-10-09T11:37:10.262319+0000","last_active":"2023-10-09T11:37:11.259665+0000","last_peered":"2023-10-09T11:37:11.259665+0000","last_clean":"2023-10-09T11:37:11.259665+0000","last_became_active":"2023-10-09T11:37:10.262032+0000","last_became_peered":"2023-10-09T11:37:10.262032+0000","last_unstale":"2023-10-09T11:37:11.259665+0000","last_undegraded":"2023-10-09T11:37:11.259665+0000","last_fullsized":"2023-10-09T11:37:11.259665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:20.427335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.271812+0000","last_change":"2023-10-09T11:37:11.260869+0000","last_active":"2023-10-09T11:37:11.271812+0000","last_peered":"2023-10-09T11:37:11.271812+0000","last_clean":"2023-10-09T11:37:11.271812+0000","last_became_active":"2023-10-09T11:37:11.260552+0000","last_became_peered":"2023-10-09T11:37:11.260552+0000","last_unstale":"2023-10-09T11:37:11.271812+0000","last_undegraded":"2023-10-09T11:37:11.271812+0000","last_fullsized":"2023-10-09T11:37:11.271812+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:43.712349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.255399+0000","last_change":"2023-10-09T11:37:10.256612+0000","last_active":"2023-10-09T11:37:11.255399+0000","last_peered":"2023-10-09T11:37:11.255399+0000","last_clean":"2023-10-09T11:37:11.255399+0000","last_became_active":"2023-10-09T11:37:10.256341+0000","last_became_peered":"2023-10-09T11:37:10.256341+0000","last_unstale":"2023-10-09T11:37:11.255399+0000","last_undegraded":"2023-10-09T11:37:11.255399+0000","last_fullsized":"2023-10-09T11:37:11.255399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:52.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.263471+0000","last_change":"2023-10-09T11:37:11.261984+0000","last_active":"2023-10-09T11:37:11.263471+0000","last_peered":"2023-10-09T11:37:11.263471+0000","last_clean":"2023-10-09T11:37:11.263471+0000","last_became_active":"2023-10-09T11:37:11.261717+0000","last_became_peered":"2023-10-09T11:37:11.261717+0000","last_unstale":"2023-10-09T11:37:11.263471+0000","last_undegraded":"2023-10-09T11:37:11.263471+0000","last_fullsized":"2023-10-09T11:37:11.263471+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:10.238776+0000","last_clean_scrub_stamp":"2023-10-09T11:37:10.238776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:21.017957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.276359+0000","last_change":"2023-10-09T11:37:10.257014+0000","last_active":"2023-10-09T11:37:11.276359+0000","last_peered":"2023-10-09T11:37:11.276359+0000","last_clean":"2023-10-09T11:37:11.276359+0000","last_became_active":"2023-10-09T11:37:10.256748+0000","last_became_peered":"2023-10-09T11:37:10.256748+0000","last_unstale":"2023-10-09T11:37:11.276359+0000","last_undegraded":"2023-10-09T11:37:11.276359+0000","last_fullsized":"2023-10-09T11:37:11.276359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:09.229748+0000","last_clean_scrub_stamp":"2023-10-09T11:37:09.229748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.897009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:37:11.248901+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:37:11.248901+0000","last_peered":"2023-10-09T11:37:11.248901+0000","last_clean":"2023-10-09T11:37:11.248901+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:37:11.248901+0000","last_undegraded":"2023-10-09T11:37:11.248901+0000","last_fullsized":"2023-10-09T11:37:11.248901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298620,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073220,"statfs":{"total":96636764160,"available":96330977280,"internally_reserved":0,"allocated":1363968,"data_stored":914907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.71899999999999997,"15min":0.751},"min":{"1min":0.378,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.753,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.76700000000000002,"15min":0.80100000000000005},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82199999999999995,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89400000000000002,"5min":1.256,"15min":1.256},"last":0.77300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.92500000000000004,"15min":0.98399999999999999},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.996,"15min":1.054},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91700000000000004,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.68200000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80400000000000005,"5min":1.3,"15min":1.3},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.163,"15min":1.163},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83299999999999996,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82999999999999996,"5min":1.369,"15min":1.369},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":0.999,"15min":0.999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.81200000000000006,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.66700000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298040,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073800,"statfs":{"total":96636764160,"available":96331571200,"internally_reserved":0,"allocated":770048,"data_stored":324043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.435,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83899999999999997,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.443},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91100000000000003,"5min":1.153,"15min":1.153},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77600000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.311,"15min":0.311},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.622}]},{"osd":2,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96099999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46800000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":0.874,"15min":0.874},"last":0.63900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302148,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069692,"statfs":{"total":96636764160,"available":96327364608,"internally_reserved":0,"allocated":782336,"data_stored":326075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.0330000000000004,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.06,"5min":11.06,"15min":11.06},"last":0.24399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.318}]},{"osd":3,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":11.087,"5min":11.087,"15min":11.087},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.307}]},{"osd":4,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":10.939,"5min":10.939,"15min":10.939},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.9370000000000003,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.41699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":10.975,"5min":10.975,"15min":10.975},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1355776,"data_stored":914319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.57799999999999996,"15min":0.61799999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52600000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.218},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.60699999999999998,"15min":0.64400000000000002},"min":{"1min":0.30299999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.61399999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.90400000000000003,"15min":0.98999999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.49399999999999999,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.96099999999999997,"15min":1.0600000000000001},"min":{"1min":0.23300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.58799999999999997,"5min":12.589,"15min":12.589},"last":0.311}]},{"osd":3,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64800000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.47899999999999998,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57599999999999996,"5min":1.502,"15min":1.502},"last":0.29899999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":1.446,"15min":1.446},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.278,"15min":1.278},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.69999999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83899999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.76400000000000001,"5min":1.415,"15min":1.415},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.76700000000000002,"5min":1.639,"15min":1.639},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.443}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":325487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38,"15min":0.38},"min":{"1min":0.248,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.25,"5min":0.246,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.313}]},{"osd":3,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.434,"15min":0.432},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.41499999999999998,"15min":0.42099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51900000000000002,"5min":0.623,"15min":0.623},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.754}]},{"osd":6,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.50800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":770048,"data_stored":324063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45900000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.309}]},{"osd":1,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55400000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.85399999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86699999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.622},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84999999999999998,"5min":0.876,"15min":0.876},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.68799999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298036,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073804,"statfs":{"total":96636764160,"available":96331575296,"internally_reserved":0,"allocated":765952,"data_stored":324021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":1.056,"15min":1.056},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.71399999999999997,"15min":0.74299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81499999999999995,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.442},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89800000000000002,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78100000000000003,"5min":1.234,"15min":1.234},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":1.282,"15min":1.282},"last":0.625}]},{"osd":7,"last update":"Mon Oct 9 11:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.67300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298036,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073804,"statfs":{"total":96636764160,"available":96331575296,"internally_reserved":0,"allocated":765952,"data_stored":324041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.438},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.5},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.625}]},{"osd":3,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:37:20.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:37:20.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:37:20.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.454+0000 7f904b1a9700 1 Processor -- start 2023-10-09T11:37:20.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.454+0000 7f904b1a9700 1 -- start start 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f904b1a9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 0x7f90440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f904b1a9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f904406dc70 0x7f9044159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f904b1a9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440ccfd0 con 0x7f904406e0e0 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f904b1a9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440cf0e0 con 0x7f904406dc70 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f904b1a9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904415a3d0 con 0x7f9044159530 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f904406dc70 0x7f9044159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f904406dc70 0x7f9044159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32864/0 (socket says 172.21.15.26:32864) 2023-10-09T11:37:20.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 -- 172.21.15.26:0/1808724235 learned_addr learned my addr 172.21.15.26:0/1808724235 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9048f45700 1 --2- 172.21.15.26:0/1808724235 >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 0x7f90440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 -- 172.21.15.26:0/1808724235 >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 msgr2=0x7f90440ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 --2- 172.21.15.26:0/1808724235 >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 0x7f90440ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 -- 172.21.15.26:0/1808724235 >> v1:172.21.15.67:6789/0 conn(0x7f904406e0e0 legacy=0x7f90440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 -- 172.21.15.26:0/1808724235 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904415a6b0 con 0x7f904406dc70 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9048f45700 1 --2- 172.21.15.26:0/1808724235 >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 0x7f90440ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f9043fff700 1 --2- 172.21.15.26:0/1808724235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904406dc70 0x7f9044159900 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f904406d630 tx=0x7f9034009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78045d78ed42fcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f90437fe700 1 -- 172.21.15.26:0/1808724235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400b860 con 0x7f904406dc70 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f90437fe700 1 -- 172.21.15.26:0/1808724235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400b9c0 con 0x7f904406dc70 2023-10-09T11:37:20.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.455+0000 7f90437fe700 1 -- 172.21.15.26:0/1808724235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400bd60 con 0x7f904406dc70 2023-10-09T11:37:20.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 -- 172.21.15.26:0/1808724235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904406dc70 msgr2=0x7f9044159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1808724235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904406dc70 0x7f9044159900 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f904406d630 tx=0x7f9034009250 comp rx=0 tx=0).stop 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 -- 172.21.15.26:0/1808724235 shutdown_connections 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1808724235 >> v2:172.21.15.67:3300/0 conn(0x7f9044159530 0x7f90440ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1808724235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904406dc70 0x7f9044159900 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 -- 172.21.15.26:0/1808724235 >> 172.21.15.26:0/1808724235 conn(0x7f90440703a0 msgr2=0x7f90440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 -- 172.21.15.26:0/1808724235 shutdown_connections 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.456+0000 7f904b1a9700 1 -- 172.21.15.26:0/1808724235 wait complete. 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.457+0000 7f904b1a9700 1 Processor -- start 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.457+0000 7f904b1a9700 1 -- start start 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f904406dc70 0x7f904415e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f904406e0e0 0x7f90440b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440b3d20 con 0x7f9044159530 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440b1450 con 0x7f904406dc70 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f904b1a9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904416d6d0 con 0x7f904406e0e0 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f9049746700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f9049746700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32880/0 (socket says 172.21.15.26:32880) 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f9048f45700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f904406dc70 0x7f904415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f9049746700 1 -- 172.21.15.26:0/1751290236 learned_addr learned my addr 172.21.15.26:0/1751290236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.458+0000 7f9043fff700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f904406e0e0 0x7f90440b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 -- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f904406e0e0 msgr2=0x7f90440b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f904406e0e0 0x7f90440b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 -- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f904406dc70 msgr2=0x7f904415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f904406dc70 0x7f904415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 -- 172.21.15.26:0/1751290236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340094f0 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9049746700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c8e0 tx=0x7f903c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c012630 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c012790 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904416d9b0 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c012b50 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.459+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904416df70 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.460+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9044088410 con 0x7f9044159530 2023-10-09T11:37:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.460+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f903c01a3a0 con 0x7f9044159530 2023-10-09T11:37:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.461+0000 7f9040ff9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 0x7f9024069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.461+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f903c0846c0 con 0x7f9044159530 2023-10-09T11:37:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.461+0000 7f9048f45700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 0x7f9024069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.461+0000 7f9048f45700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 0x7f9024069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f902c006f00 tx=0x7f902c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.465+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f903c0553d0 con 0x7f9044159530 2023-10-09T11:37:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.734+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f904404c3c0 con 0x7f9044159530 2023-10-09T11:37:20.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.737+0000 7f9040ff9700 1 -- 172.21.15.26:0/1751290236 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f903c054f60 con 0x7f9044159530 2023-10-09T11:37:20.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 msgr2=0x7f9024069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 0x7f9024069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f902c006f00 tx=0x7f902c008040 comp rx=0 tx=0).stop 2023-10-09T11:37:20.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 msgr2=0x7f904414df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c8e0 tx=0x7f903c001710 comp rx=0 tx=0).stop 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 shutdown_connections 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9044159530 0x7f904414df20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f904406dc70 0x7f904415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9024066fc0 0x7f9024069470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 --2- 172.21.15.26:0/1751290236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f904406e0e0 0x7f90440b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 >> 172.21.15.26:0/1751290236 conn(0x7f90440703a0 msgr2=0x7f904415bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 shutdown_connections 2023-10-09T11:37:20.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.740+0000 7f904b1a9700 1 -- 172.21.15.26:0/1751290236 wait complete. 2023-10-09T11:37:20.742 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:37:20.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.871+0000 7ff1798a2700 1 Processor -- start 2023-10-09T11:37:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.871+0000 7ff1798a2700 1 -- start start 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1798a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1741594d0 0x7ff1740cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1798a2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17415e010 con 0x7ff1740cb1a0 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1798a2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17415d420 con 0x7ff1741598a0 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1798a2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17415d6e0 con 0x7ff1741594d0 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff172ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1741594d0 0x7ff1740cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1727fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff1740cb1a0 0x7ff1740ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46248/0 (socket says 172.21.15.26:46248) 2023-10-09T11:37:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff1727fc700 1 -- 172.21.15.26:0/1461313388 learned_addr learned my addr 172.21.15.26:0/1461313388 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff172ffd700 1 -- 172.21.15.26:0/1461313388 >> v1:172.21.15.67:6789/0 conn(0x7ff1741598a0 legacy=0x7ff174159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff172ffd700 1 -- 172.21.15.26:0/1461313388 >> v1:172.21.15.26:6789/0 conn(0x7ff1740cb1a0 legacy=0x7ff1740ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff172ffd700 1 -- 172.21.15.26:0/1461313388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17415d9c0 con 0x7ff1741594d0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.872+0000 7ff171ffb700 1 -- 172.21.15.26:0/1461313388 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452211025 0 0) 0x7ff17415e010 con 0x7ff1740cb1a0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff172ffd700 1 --2- 172.21.15.26:0/1461313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1741594d0 0x7ff1740cea70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098e0 tx=0x7ff16c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac7840eb655b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff171ffb700 1 -- 172.21.15.26:0/1461313388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c009e80 con 0x7ff1741594d0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff171ffb700 1 -- 172.21.15.26:0/1461313388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00b820 con 0x7ff1741594d0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff171ffb700 1 -- 172.21.15.26:0/1461313388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00bba0 con 0x7ff1741594d0 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 -- 172.21.15.26:0/1461313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1741594d0 msgr2=0x7ff1740cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1461313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1741594d0 0x7ff1740cea70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098e0 tx=0x7ff16c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 -- 172.21.15.26:0/1461313388 shutdown_connections 2023-10-09T11:37:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1461313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1741594d0 0x7ff1740cea70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 -- 172.21.15.26:0/1461313388 >> 172.21.15.26:0/1461313388 conn(0x7ff1740703a0 msgr2=0x7ff174070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 -- 172.21.15.26:0/1461313388 shutdown_connections 2023-10-09T11:37:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.873+0000 7ff1798a2700 1 -- 172.21.15.26:0/1461313388 wait complete. 2023-10-09T11:37:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 Processor -- start 2023-10-09T11:37:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 -- start start 2023-10-09T11:37:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1741594d0 0x7ff1740c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1741598a0 0x7ff1740c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740b1c50 con 0x7ff1740cb1a0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740b1040 con 0x7ff1741594d0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff1798a2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740b1320 con 0x7ff1741598a0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.875+0000 7ff172ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 -- 172.21.15.26:0/1314367977 learned_addr learned my addr 172.21.15.26:0/1314367977 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff1727fc700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1741594d0 0x7ff1740c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff1737fe700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1741598a0 0x7ff1740c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 -- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1741598a0 msgr2=0x7ff1740c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1741598a0 0x7ff1740c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 -- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1741594d0 msgr2=0x7ff1740c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1741594d0 0x7ff1740c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 -- 172.21.15.26:0/1314367977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009420 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff172ffd700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0030c0 tx=0x7ff16c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00ba10 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c020070 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1740b1600 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c01b6a0 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.876+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740c7d50 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.877+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1740b1f30 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.878+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff16c022030 con 0x7ff1740cb1a0 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.878+0000 7ff16affd700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 0x7ff154069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.878+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff16c086630 con 0x7ff1740cb1a0 2023-10-09T11:37:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.878+0000 7ff1727fc700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 0x7ff154069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.879+0000 7ff1727fc700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 0x7ff154069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff174158d70 tx=0x7ff15c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:20.882+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff16c0538b0 con 0x7ff1740cb1a0 2023-10-09T11:37:21.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.116+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1740b1f30 con 0x7ff1740cb1a0 2023-10-09T11:37:21.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.117+0000 7ff16affd700 1 -- 172.21.15.26:0/1314367977 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ff16c056ed0 con 0x7ff1740cb1a0 2023-10-09T11:37:21.118 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:37:21.118 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 msgr2=0x7ff154069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 0x7ff154069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff174158d70 tx=0x7ff15c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 msgr2=0x7ff1740b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0030c0 tx=0x7ff16c016000 comp rx=0 tx=0).stop 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 shutdown_connections 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff154066fc0 0x7ff154069470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff1741598a0 0x7ff1740c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1740cb1a0 0x7ff1740b20e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 --2- 172.21.15.26:0/1314367977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1741594d0 0x7ff1740c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 >> 172.21.15.26:0/1314367977 conn(0x7ff1740703a0 msgr2=0x7ff174149c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 shutdown_connections 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.119+0000 7ff1798a2700 1 -- 172.21.15.26:0/1314367977 wait complete. 2023-10-09T11:37:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 39 2023-10-09T11:37:21.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:37:10.648720+0000', 'modified': '2023-10-09T11:37:14.268575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5742}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5742': {'gid': 5742, 'name': 'd', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6836/4209550485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 4209550485}, {'type': 'v1', 'addr': '172.21.15.67:6836', 'nonce': 4209550485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:37:21.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:37:21.534 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:37:21.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.657+0000 7f24652a0700 1 Processor -- start 2023-10-09T11:37:21.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f24652a0700 1 -- start start 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f24652a0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24600cb5a0 0x7f24600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f24652a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246015ae40 con 0x7f24600cd9e0 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f24652a0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246015ab60 con 0x7f246015a5d0 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f24652a0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24600d13f0 con 0x7f24600cb5a0 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.658+0000 7f245e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f24600cd9e0 0x7f2460159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46254/0 (socket says 172.21.15.26:46254) 2023-10-09T11:37:21.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245e7fc700 1 -- 172.21.15.26:0/1850469912 learned_addr learned my addr 172.21.15.26:0/1850469912 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245effd700 1 --2- 172.21.15.26:0/1850469912 >> v2:172.21.15.67:3300/0 conn(0x7f24600cb5a0 0x7f24600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016759875 0 0) 0x7f246015ae40 con 0x7f24600cd9e0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2448003570 con 0x7f24600cd9e0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962905807 0 0) 0x7f246015ab60 con 0x7f246015a5d0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f246015ae40 con 0x7f246015a5d0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1397773088 0 0) 0x7f2448003570 con 0x7f24600cd9e0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 >> v2:172.21.15.67:3300/0 conn(0x7f24600cb5a0 msgr2=0x7f24600cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 --2- 172.21.15.26:0/1850469912 >> v2:172.21.15.67:3300/0 conn(0x7f24600cb5a0 0x7f24600cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 >> v1:172.21.15.67:6789/0 conn(0x7f246015a5d0 legacy=0x7f2460156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600ccf00 con 0x7f24600cd9e0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f2454001470 con 0x7f24600cd9e0 2023-10-09T11:37:21.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 >> v1:172.21.15.26:6789/0 conn(0x7f24600cd9e0 legacy=0x7f2460159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2448003bf0 0x7f2448003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2448004810 0x7f2448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f244800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244800c080 con 0x7f24480051c0 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244800c1f0 con 0x7f2448004810 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244800c3b0 con 0x7f2448003bf0 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f244800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245e7fc700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2448004810 0x7f2448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.659+0000 7f245effd700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2448003bf0 0x7f2448003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 -- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2448003bf0 msgr2=0x7f2448003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2448003bf0 0x7f2448003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 -- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2448004810 msgr2=0x7f2448004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2448004810 0x7f2448004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 -- 172.21.15.26:0/1850469912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448003570 con 0x7f24480051c0 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 -- 172.21.15.26:0/1850469912 reap_dead start 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f244800ba60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2458002120 tx=0x7f24580017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150075134e0b2955 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458001ab0 con 0x7f24480051c0 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245800c980 con 0x7f24480051c0 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f245dffb700 1 -- 172.21.15.26:0/1850469912 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800cd00 con 0x7f24480051c0 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 -- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 msgr2=0x7f244800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f244800ba60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2458002120 tx=0x7f24580017a0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 -- 172.21.15.26:0/1850469912 shutdown_connections 2023-10-09T11:37:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 --2- 172.21.15.26:0/1850469912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f244800ba60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 -- 172.21.15.26:0/1850469912 >> 172.21.15.26:0/1850469912 conn(0x7f2460070e30 msgr2=0x7f24600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.660+0000 7f24652a0700 1 -- 172.21.15.26:0/1850469912 shutdown_connections 2023-10-09T11:37:21.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.661+0000 7f24652a0700 1 -- 172.21.15.26:0/1850469912 wait complete. 2023-10-09T11:37:21.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.662+0000 7f24652a0700 1 Processor -- start 2023-10-09T11:37:21.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.662+0000 7f24652a0700 1 -- start start 2023-10-09T11:37:21.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.662+0000 7f24652a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f246016d900 0x7f24600b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24600b47c0 0x7f2460155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600b4c40 con 0x7f24480051c0 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600b4e60 con 0x7f24600b47c0 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246016a220 con 0x7f246016d900 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32900/0 (socket says 172.21.15.26:32900) 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 -- 172.21.15.26:0/1674473599 learned_addr learned my addr 172.21.15.26:0/1674473599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 -- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f246016d900 msgr2=0x7f24600b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f246016d900 0x7f24600b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 -- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24600b47c0 msgr2=0x7f2460155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24600b47c0 0x7f2460155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 -- 172.21.15.26:0/1674473599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24601698f0 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f245effd700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2450011b10 tx=0x7f24500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f2446ffd700 1 -- 172.21.15.26:0/1674473599 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000f990 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f2446ffd700 1 -- 172.21.15.26:0/1674473599 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245000faf0 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f2446ffd700 1 -- 172.21.15.26:0/1674473599 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000fe70 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2460169bd0 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.663+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24601695f0 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.665+0000 7f2446ffd700 1 -- 172.21.15.26:0/1674473599 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2450014650 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.665+0000 7f2446ffd700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 0x7f244c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.665+0000 7f2446ffd700 1 -- 172.21.15.26:0/1674473599 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2450018030 con 0x7f24480051c0 2023-10-09T11:37:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.665+0000 7f245e7fc700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 0x7f244c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.666+0000 7f245e7fc700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 0x7f244c069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2454001660 tx=0x7f2454001df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.667+0000 7f246e598b80 1 Processor -- start 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.667+0000 7f246e598b80 1 -- start start 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e792e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7bba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e6e9a70 con 0x56369e7bbf60 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e6e7270 con 0x56369e792a50 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56369e6e3060 con 0x56369e7dcd00 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32902/0 (socket says 172.21.15.26:32902) 2023-10-09T11:37:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 -- 172.21.15.26:0/4150515963 learned_addr learned my addr 172.21.15.26:0/4150515963 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 -- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 msgr2=0x56369e7bba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245e7fc700 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245effd700 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e792e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7bba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 -- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 msgr2=0x56369e792e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e792e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 -- 172.21.15.26:0/4150515963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56369e57d270 con 0x56369e7bbf60 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f245f7fe700 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2458001820 tx=0x7f2458016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1fb925faeabb08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.668+0000 7f243ffff700 1 -- 172.21.15.26:0/4150515963 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458006ba0 con 0x56369e7bbf60 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f243ffff700 1 -- 172.21.15.26:0/4150515963 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458006d00 con 0x56369e7bbf60 2023-10-09T11:37:21.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f243ffff700 1 -- 172.21.15.26:0/4150515963 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800cd40 con 0x56369e7bbf60 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 -- 172.21.15.26:0/4150515963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 msgr2=0x56369e78ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2458001820 tx=0x7f2458016000 comp rx=0 tx=0).stop 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 -- 172.21.15.26:0/4150515963 shutdown_connections 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e78ecf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e792e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 --2- 172.21.15.26:0/4150515963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7bba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 -- 172.21.15.26:0/4150515963 >> 172.21.15.26:0/4150515963 conn(0x56369e794370 msgr2=0x56369e794740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 -- 172.21.15.26:0/4150515963 shutdown_connections 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.669+0000 7f246e598b80 1 -- 172.21.15.26:0/4150515963 wait complete. 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.670+0000 7f246e598b80 1 -- start start 2023-10-09T11:37:21.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.670+0000 7f246e598b80 1 Processor -- start 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7dc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e68e890 con 0x56369e7bbf60 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e6a9ea0 con 0x56369e792a50 2023-10-09T11:37:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56369e565e30 con 0x56369e7dcd00 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f246e598b80 10 client.0 _ll_register_callbacks cb 0x56369e756110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32914/0 (socket says 172.21.15.26:32914) 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 -- 172.21.15.26:0/877372603 learned_addr learned my addr 172.21.15.26:0/877372603 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 -- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 msgr2=0x56369e7c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 -- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 msgr2=0x56369e7dc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245effd700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7dc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7dc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 -- 172.21.15.26:0/877372603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2448003570 con 0x56369e7bbf60 2023-10-09T11:37:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f245e7fc700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2460156280 tx=0x7f2454014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a86606b4e2ff2f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.671+0000 7f243d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454013c40 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f245401b040 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56369e787b70 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f245402b3b0 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 10 client.5901 fetch_fsmap learned FSMap version 39 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56369e51ffe0 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56369e787b70 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f245402b510 con 0x56369e7bbf60 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 10 client.5901 fetch_fsmap finished waiting for FSMap version 39 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 10 client.5901 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:37:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 20 client.5901 populate_metadata read hostname 'smithi026' 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e7d4760 0x56369e7ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 4 client.5901 mds_command: new command op to 5742 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 --> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56369e764aa0 con 0x56369e7d4760 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.672+0000 7f245effd700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e7d4760 0x56369e7ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.673+0000 7f243d7fa700 10 client.5901 ms_handle_connect on v2:172.21.15.67:6834/4209550485 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.673+0000 7f245effd700 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e7d4760 0x56369e7ec430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b40e84b57d5908 server_cookie=4b04a79a911dd5b5 in_seq=0 out_seq=0 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.673+0000 7f243d7fa700 1 -- 172.21.15.26:0/877372603 <== mds.0 v2:172.21.15.67:6834/4209550485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56369e764aa0 con 0x56369e7d4760 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.673+0000 7f243d7fa700 10 client.5901 handle_command_reply: tid=0 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.673+0000 7f246e598b80 1 client.5901 shutdown 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 msgr2=0x56369e7d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2460156280 tx=0x7f2454014000 comp rx=0 tx=0).stop 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 shutdown_connections 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e7d4760 0x56369e7ec430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e7c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f243d7fa700 0 client.5901 ms_handle_reset on v2:172.21.15.67:6834/4209550485 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7dc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 --2- 172.21.15.26:0/877372603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7bbf60 0x56369e7d15e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 >> 172.21.15.26:0/877372603 conn(0x56369e794370 msgr2=0x56369e7d8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 shutdown_connections 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 1 -- 172.21.15.26:0/877372603 wait complete. 2023-10-09T11:37:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.674+0000 7f246e598b80 20 client.5901 trim_cache size 0 max 16384 2023-10-09T11:37:21.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 Processor -- start 2023-10-09T11:37:21.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 -- start start 2023-10-09T11:37:21.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 0x56369e7e8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.691+0000 7f246e598b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e790b10 con 0x56369e7dcd00 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e791cd0 con 0x56369e792a50 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56369e7bba90 con 0x56369e7bbf60 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32926/0 (socket says 172.21.15.26:32926) 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 -- 172.21.15.26:0/1281797277 learned_addr learned my addr 172.21.15.26:0/1281797277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245e7fc700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 0x56369e7e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245effd700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 -- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 msgr2=0x56369e7e8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 0x56369e7e8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 -- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 msgr2=0x56369e7d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 -- 172.21.15.26:0/1281797277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56369e790d40 con 0x56369e7dcd00 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245e7fc700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 0x56369e7e8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245effd700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f245f7fe700 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f245800c6a0 tx=0x7f245801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd302e5257a57131 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f2444ff9700 1 -- 172.21.15.26:0/1281797277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800c6d0 con 0x56369e7dcd00 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f2444ff9700 1 -- 172.21.15.26:0/1281797277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458007e90 con 0x56369e7dcd00 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.692+0000 7f2444ff9700 1 -- 172.21.15.26:0/1281797277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800caf0 con 0x56369e7dcd00 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- 172.21.15.26:0/1281797277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 msgr2=0x56369e78ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f245800c6a0 tx=0x7f245801f000 comp rx=0 tx=0).stop 2023-10-09T11:37:21.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- 172.21.15.26:0/1281797277 shutdown_connections 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e7dcd00 0x56369e78ddf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e792a50 0x56369e7d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 --2- 172.21.15.26:0/1281797277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7bbf60 0x56369e7e8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- 172.21.15.26:0/1281797277 >> 172.21.15.26:0/1281797277 conn(0x56369e794370 msgr2=0x56369e78b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- 172.21.15.26:0/1281797277 shutdown_connections 2023-10-09T11:37:21.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- 172.21.15.26:0/1281797277 wait complete. 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.693+0000 7f246e598b80 1 -- start start 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 Processor -- start 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 0x56369e7e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e840410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e83f950 con 0x56369e792a50 2023-10-09T11:37:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56369e83fe80 con 0x56369e7bbf60 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.694+0000 7f246e598b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56369e7dbd20 con 0x56369e7dcd00 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f246e598b80 10 client.0 _ll_register_callbacks cb 0x56369e756110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32942/0 (socket says 172.21.15.26:32942) 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 -- 172.21.15.26:0/353567527 learned_addr learned my addr 172.21.15.26:0/353567527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245e7fc700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 0x56369e7e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245f7fe700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e840410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 -- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 msgr2=0x56369e840410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e840410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 -- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 msgr2=0x56369e7e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 0x56369e7e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 -- 172.21.15.26:0/353567527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56369e57d270 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245e7fc700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 0x56369e7e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f245effd700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f245000f520 tx=0x7f245006a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f50890144b01a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f243d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450055f00 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f245006c1c0 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2458006d00 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2450056370 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f246e598b80 10 client.5907 fetch_fsmap learned FSMap version 39 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56369e6b1780 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.695+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458006d00 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f24500553f0 con 0x56369e792a50 2023-10-09T11:37:21.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 10 client.5907 fetch_fsmap finished waiting for FSMap version 39 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 10 client.5907 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 20 client.5907 populate_metadata read hostname 'smithi026' 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e841030 0x56369e84a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 4 client.5907 mds_command: new command op to 5742 tid=0[{"prefix": "status"}] 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 --> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56369e685e00 con 0x56369e841030 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f245e7fc700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e841030 0x56369e84a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f243d7fa700 10 client.5907 ms_handle_connect on v2:172.21.15.67:6834/4209550485 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f245e7fc700 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e841030 0x56369e84a510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aebb17423f1af82 server_cookie=b11ddd4dfae3a56a in_seq=0 out_seq=0 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f243d7fa700 1 -- 172.21.15.26:0/353567527 <== mds.0 v2:172.21.15.67:6834/4209550485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56369e685e00 con 0x56369e841030 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f243d7fa700 10 client.5907 handle_command_reply: tid=0 2023-10-09T11:37:21.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.696+0000 7f246e598b80 1 client.5907 shutdown 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 msgr2=0x56369e7e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f245000f520 tx=0x7f245006a040 comp rx=0 tx=0).stop 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 shutdown_connections 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:6834/4209550485,v1:172.21.15.67:6836/4209550485] conn(0x56369e841030 0x56369e84a510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56369e7dcd00 0x56369e840410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56369e792a50 0x56369e7e71c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f243d7fa700 0 client.5907 ms_handle_reset on v2:172.21.15.67:6834/4209550485 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 --2- 172.21.15.26:0/353567527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56369e7bbf60 0x56369e7e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 >> 172.21.15.26:0/353567527 conn(0x56369e794370 msgr2=0x56369e78ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 shutdown_connections 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 1 -- 172.21.15.26:0/353567527 wait complete. 2023-10-09T11:37:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f246e598b80 20 client.5907 trim_cache size 0 max 16384 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5742, 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.441027241, 2023-10-09T11:37:21.705 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 39, 2023-10-09T11:37:21.706 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 63, 2023-10-09T11:37:21.706 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 63, 2023-10-09T11:37:21.706 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 15.512794338000001 2023-10-09T11:37:21.706 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 msgr2=0x7f244c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 0x7f244c069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2454001660 tx=0x7f2454001df0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 msgr2=0x7f246016d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2450011b10 tx=0x7f24500091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 shutdown_connections 2023-10-09T11:37:21.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24600b47c0 0x7f2460155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24480051c0 0x7f246016d3c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f244c066fc0 0x7f244c069470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 --2- 172.21.15.26:0/1674473599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f246016d900 0x7f24600b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 >> 172.21.15.26:0/1674473599 conn(0x7f2460070e30 msgr2=0x7f24600b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 shutdown_connections 2023-10-09T11:37:21.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.697+0000 7f24652a0700 1 -- 172.21.15.26:0/1674473599 wait complete. 2023-10-09T11:37:21.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.829+0000 7f99efe95700 1 Processor -- start 2023-10-09T11:37:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.829+0000 7f99efe95700 1 -- start start 2023-10-09T11:37:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99efe95700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99efe95700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 0x7f99e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99efe95700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e815ae40 con 0x7f99e80cd9e0 2023-10-09T11:37:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99efe95700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80d13f0 con 0x7f99e80cde50 2023-10-09T11:37:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99efe95700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e815ab60 con 0x7f99e80cb5a0 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.830+0000 7f99ee432700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 0x7f99e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ee432700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 0x7f99e8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:44204/0 (socket says 172.21.15.26:44204) 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ee432700 1 -- 172.21.15.26:0/593166173 learned_addr learned my addr 172.21.15.26:0/593166173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ed430700 1 --1- 172.21.15.26:0/593166173 >> v1:172.21.15.67:6789/0 conn(0x7f99e80cd9e0 0x7f99e8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:53376/0 (socket says 172.21.15.26:53376) 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 -- 172.21.15.26:0/593166173 >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 msgr2=0x7f99e8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 --2- 172.21.15.26:0/593166173 >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 0x7f99e8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 -- 172.21.15.26:0/593166173 >> v1:172.21.15.67:6789/0 conn(0x7f99e80cd9e0 legacy=0x7f99e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 -- 172.21.15.26:0/593166173 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80ccf00 con 0x7f99e80cb5a0 2023-10-09T11:37:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99edc31700 1 --2- 172.21.15.26:0/593166173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e80cb970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99e00098e0 tx=0x7f99e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc520ef50d7cb8c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ecc2f700 1 -- 172.21.15.26:0/593166173 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000b640 con 0x7f99e80cb5a0 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ecc2f700 1 -- 172.21.15.26:0/593166173 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000b7a0 con 0x7f99e80cb5a0 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.831+0000 7f99ecc2f700 1 -- 172.21.15.26:0/593166173 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000bb40 con 0x7f99e80cb5a0 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 -- 172.21.15.26:0/593166173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 msgr2=0x7f99e80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 --2- 172.21.15.26:0/593166173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e80cb970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99e00098e0 tx=0x7f99e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 -- 172.21.15.26:0/593166173 shutdown_connections 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 --2- 172.21.15.26:0/593166173 >> v2:172.21.15.67:3300/0 conn(0x7f99e80cde50 0x7f99e8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 --2- 172.21.15.26:0/593166173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e80cb970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 -- 172.21.15.26:0/593166173 >> 172.21.15.26:0/593166173 conn(0x7f99e8070e30 msgr2=0x7f99e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 -- 172.21.15.26:0/593166173 shutdown_connections 2023-10-09T11:37:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.832+0000 7f99efe95700 1 -- 172.21.15.26:0/593166173 wait complete. 2023-10-09T11:37:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.833+0000 7f99efe95700 1 Processor -- start 2023-10-09T11:37:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.833+0000 7f99efe95700 1 -- start start 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e8169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e80c94e0 0x7f99e80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e816a2e0 con 0x7f99e80cd9e0 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e816d740 con 0x7f99e80c94e0 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99efe95700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e816da20 con 0x7f99e80cb5a0 2023-10-09T11:37:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32944/0 (socket says 172.21.15.26:32944) 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 -- 172.21.15.26:0/1840001615 learned_addr learned my addr 172.21.15.26:0/1840001615 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99edc31700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e8169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ee432700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e80c94e0 0x7f99e80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 -- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 msgr2=0x7f99e8169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e8169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 -- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e80c94e0 msgr2=0x7f99e80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e80c94e0 0x7f99e80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 -- 172.21.15.26:0/1840001615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009420 con 0x7f99e80cd9e0 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.834+0000 7f99ed430700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c7c0 tx=0x7f99dc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.835+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc005a70 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.835+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc005bf0 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.835+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e816dd00 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.835+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0070f0 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.835+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e81566a0 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.836+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e80c7580 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.836+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f99dc007460 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.836+0000 7f99e5ffb700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 0x7f99d4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.837+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99dc083fb0 con 0x7f99e80cd9e0 2023-10-09T11:37:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.837+0000 7f99edc31700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 0x7f99d4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.837+0000 7f99edc31700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 0x7f99d4069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99e00093f0 tx=0x7f99e0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:21.841+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99dc0512b0 con 0x7f99e80cd9e0 2023-10-09T11:37:22.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.081+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99e804c3c0 con 0x7f99e80cd9e0 2023-10-09T11:37:22.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.082+0000 7f99e5ffb700 1 -- 172.21.15.26:0/1840001615 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99dc0548d0 con 0x7f99e80cd9e0 2023-10-09T11:37:22.082 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 msgr2=0x7f99d4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 0x7f99d4069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99e00093f0 tx=0x7f99e0017000 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 msgr2=0x7f99e8156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c7c0 tx=0x7f99dc007f70 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 shutdown_connections 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e80c94e0 0x7f99e80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d4066fc0 0x7f99d4069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99e80cb5a0 0x7f99e8169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 --2- 172.21.15.26:0/1840001615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e80cd9e0 0x7f99e8156160 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 >> 172.21.15.26:0/1840001615 conn(0x7f99e8070e30 msgr2=0x7f99e80b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 shutdown_connections 2023-10-09T11:37:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.084+0000 7f99efe95700 1 -- 172.21.15.26:0/1840001615 wait complete. 2023-10-09T11:37:22.096 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:22.096 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:22.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:22.097 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:22.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.097 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:37:22.112 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:22.112 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:37:22.113 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:22.114 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:37:22.115 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:22.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.116 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:22.176 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:37:22.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.178 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:37:22.235 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:37:22.235 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:22.235 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:37:22.235 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:37:22.235 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:22.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:37:22.236 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:37:22.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.338 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:37:22.353 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:37:22.353 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:37:22.353 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:22.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:37:22.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:22.418 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:22.473 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:22.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:22.473 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:22.527 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:37:22.528 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:22.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:22.609 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:22.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:22.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:37:22.652 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:37:22.652 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:37:22.653 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:22.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:22.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:22.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:22.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.878+0000 7fd025703700 1 Processor -- start 2023-10-09T11:37:22.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.878+0000 7fd025703700 1 -- start start 2023-10-09T11:37:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd025703700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd0200cb1a0 0x7fd020164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd025703700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02015e010 con 0x7fd0200cf180 2023-10-09T11:37:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd025703700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02015d420 con 0x7fd0201594d0 2023-10-09T11:37:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd025703700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02015d6e0 con 0x7fd0200cb1a0 2023-10-09T11:37:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd01e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd0200cf180 0x7fd0200ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46256/0 (socket says 172.21.15.26:46256) 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd01e7fc700 1 -- 172.21.15.26:0/1441081114 learned_addr learned my addr 172.21.15.26:0/1441081114 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd01f7fe700 1 --2- 172.21.15.26:0/1441081114 >> v2:172.21.15.67:3300/0 conn(0x7fd0200cb1a0 0x7fd020164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.879+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476321880 0 0) 0x7fd02015e010 con 0x7fd0200cf180 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd00c003570 con 0x7fd0200cf180 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064045935 0 0) 0x7fd02015d420 con 0x7fd0201594d0 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd02015e010 con 0x7fd0201594d0 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268069160 0 0) 0x7fd00c003570 con 0x7fd0200cf180 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01f7fe700 1 -- 172.21.15.26:0/1441081114 >> v1:172.21.15.67:6789/0 conn(0x7fd0201594d0 legacy=0x7fd0200cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01f7fe700 1 -- 172.21.15.26:0/1441081114 >> v1:172.21.15.26:6789/0 conn(0x7fd0200cf180 legacy=0x7fd0200ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01f7fe700 1 -- 172.21.15.26:0/1441081114 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02015d9c0 con 0x7fd0200cb1a0 2023-10-09T11:37:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01f7fe700 1 --2- 172.21.15.26:0/1441081114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020164640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd0180098e0 tx=0x7fd0180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc71c2874fb77a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008001470 con 0x7fd0200cb1a0 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018011420 con 0x7fd0200cb1a0 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.880+0000 7fd01dffb700 1 -- 172.21.15.26:0/1441081114 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0180117c0 con 0x7fd0200cb1a0 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 -- 172.21.15.26:0/1441081114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 msgr2=0x7fd020164640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 --2- 172.21.15.26:0/1441081114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020164640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd0180098e0 tx=0x7fd0180091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 -- 172.21.15.26:0/1441081114 shutdown_connections 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 --2- 172.21.15.26:0/1441081114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020164640 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 -- 172.21.15.26:0/1441081114 >> 172.21.15.26:0/1441081114 conn(0x7fd0200703a0 msgr2=0x7fd020070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 -- 172.21.15.26:0/1441081114 shutdown_connections 2023-10-09T11:37:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.881+0000 7fd025703700 1 -- 172.21.15.26:0/1441081114 wait complete. 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.882+0000 7fd025703700 1 Processor -- start 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.882+0000 7fd025703700 1 -- start start 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 0x7fd0200c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020159d40 con 0x7fd0201594d0 2023-10-09T11:37:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c9b30 con 0x7fd0200cb1a0 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd025703700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c9e10 con 0x7fd0200cf180 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32954/0 (socket says 172.21.15.26:32954) 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 -- 172.21.15.26:0/2290628925 learned_addr learned my addr 172.21.15.26:0/2290628925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01effd700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01e7fc700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 0x7fd0200c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 -- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 msgr2=0x7fd0200c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 0x7fd0200c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 -- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 msgr2=0x7fd020149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 -- 172.21.15.26:0/2290628925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018009420 con 0x7fd0201594d0 2023-10-09T11:37:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01e7fc700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 0x7fd0200c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.883+0000 7fd01f7fe700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0180093f0 tx=0x7fd018016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.884+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01801cd50 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.884+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01801a450 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.884+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0200ca0f0 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.884+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01801a810 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.884+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd020149c70 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.885+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02004c3c0 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.885+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd01801ab80 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.885+0000 7fd016ffd700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 0x7fd000069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.886+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0180860b0 con 0x7fd0201594d0 2023-10-09T11:37:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.886+0000 7fd01effd700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 0x7fd000069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.886+0000 7fd01effd700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 0x7fd000069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd0100040a0 tx=0x7fd010002690 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:22.890+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd018053330 con 0x7fd0201594d0 2023-10-09T11:37:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.133+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd02015dca0 con 0x7fd0201594d0 2023-10-09T11:37:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.133+0000 7fd016ffd700 1 -- 172.21.15.26:0/2290628925 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd018056950 con 0x7fd0201594d0 2023-10-09T11:37:23.134 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 msgr2=0x7fd000069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 0x7fd000069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd0100040a0 tx=0x7fd010002690 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 msgr2=0x7fd0200c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0180093f0 tx=0x7fd018016000 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 shutdown_connections 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0201594d0 0x7fd0200c9490 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0200cb1a0 0x7fd020149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd000066fc0 0x7fd000069470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 --2- 172.21.15.26:0/2290628925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0200cf180 0x7fd0200c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 >> 172.21.15.26:0/2290628925 conn(0x7fd0200703a0 msgr2=0x7fd0200c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:23.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 shutdown_connections 2023-10-09T11:37:23.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.135+0000 7fd025703700 1 -- 172.21.15.26:0/2290628925 wait complete. 2023-10-09T11:37:23.147 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:23.147 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:23.148 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:23.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.148 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:37:23.167 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:23.168 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.169 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:37:23.170 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:23.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.171 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:23.236 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:37:23.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.238 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:23.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.297 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:37:23.298 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:37:23.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:37:23.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:37:23.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:37:23.298 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:37:23.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.404 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:37:23.419 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:37:23.419 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:37:23.420 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:23.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:37:23.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:23.485 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:23.541 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:23.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:23.541 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:23.595 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:37:23.595 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:23.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:23.677 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:23.677 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:23.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:37:23.720 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:23.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:23.720 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:23.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:37:23.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.913+0000 7f64fff22700 1 Processor -- start 2023-10-09T11:37:23.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.913+0000 7f64fff22700 1 -- start start 2023-10-09T11:37:23.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fff22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64f8159530 0x7f64f80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fff22700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 0x7f64f80cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fff22700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80cc090 con 0x7f64f806dcf0 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fff22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80ccfd0 con 0x7f64f8159530 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fff22700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815a410 con 0x7f64f80cb6f0 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64f8159530 0x7f64f80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f64f8159530 0x7f64f80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32960/0 (socket says 172.21.15.26:32960) 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 -- 172.21.15.26:0/69382335 learned_addr learned my addr 172.21.15.26:0/69382335 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fe4bf700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 0x7f64f80cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 -- 172.21.15.26:0/69382335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 msgr2=0x7f64f80cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 0x7f64f80cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 -- 172.21.15.26:0/69382335 >> v1:172.21.15.67:6789/0 conn(0x7f64f806dcf0 legacy=0x7f64f8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 -- 172.21.15.26:0/69382335 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f815a6f0 con 0x7f64f8159530 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fe4bf700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 0x7f64f80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.914+0000 7f64fdcbe700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f80ceba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009f20 tx=0x7f64e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2eb046dfb70ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fccbc700 1 -- 172.21.15.26:0/69382335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800e070 con 0x7f64f8159530 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fccbc700 1 -- 172.21.15.26:0/69382335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800ba80 con 0x7f64f8159530 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fccbc700 1 -- 172.21.15.26:0/69382335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e80092e0 con 0x7f64f8159530 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 -- 172.21.15.26:0/69382335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 msgr2=0x7f64f80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f80ceba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009f20 tx=0x7f64e8009840 comp rx=0 tx=0).stop 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 -- 172.21.15.26:0/69382335 shutdown_connections 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f80cb6f0 0x7f64f80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 --2- 172.21.15.26:0/69382335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f80ceba0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 -- 172.21.15.26:0/69382335 >> 172.21.15.26:0/69382335 conn(0x7f64f80703a0 msgr2=0x7f64f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 -- 172.21.15.26:0/69382335 shutdown_connections 2023-10-09T11:37:23.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.915+0000 7f64fff22700 1 -- 172.21.15.26:0/69382335 wait complete. 2023-10-09T11:37:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.916+0000 7f64fff22700 1 Processor -- start 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.916+0000 7f64fff22700 1 -- start start 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f806dcf0 0x7f64f816a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64f80cb6f0 0x7f64f816d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f816de70 con 0x7f64f8159530 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80b3480 con 0x7f64f80cb6f0 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fff22700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f816a090 con 0x7f64f806dcf0 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32970/0 (socket says 172.21.15.26:32970) 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 -- 172.21.15.26:0/3896162666 learned_addr learned my addr 172.21.15.26:0/3896162666 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fd4bd700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64f80cb6f0 0x7f64f816d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fdcbe700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f806dcf0 0x7f64f816a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 -- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f806dcf0 msgr2=0x7f64f816a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f806dcf0 0x7f64f816a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 -- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64f80cb6f0 msgr2=0x7f64f816d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64f80cb6f0 0x7f64f816d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.917+0000 7f64fe4bf700 1 -- 172.21.15.26:0/3896162666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8009ae0 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64fe4bf700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f64f000e8a0 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0013410 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0013570 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f8147690 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00138f0 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.918+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f80b39b0 con 0x7f64f8159530 2023-10-09T11:37:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.919+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f804c3c0 con 0x7f64f8159530 2023-10-09T11:37:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.919+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f64f0013ca0 con 0x7f64f8159530 2023-10-09T11:37:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.920+0000 7f64f5ffb700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 0x7f64e40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.920+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64f0084290 con 0x7f64f8159530 2023-10-09T11:37:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.920+0000 7f64fdcbe700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 0x7f64e40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.920+0000 7f64fdcbe700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 0x7f64e40694a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009880 tx=0x7f64e8018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:23.924+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64f0054e90 con 0x7f64f8159530 2023-10-09T11:37:24.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:24.167+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f64f816a1d0 con 0x7f64f8159530 2023-10-09T11:37:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.150+0000 7f64f5ffb700 1 -- 172.21.15.26:0/3896162666 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 136+0+0 (secure 0 0 0) 0x7f64f0054a20 con 0x7f64f8159530 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 msgr2=0x7f64e40694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 0x7f64e40694a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009880 tx=0x7f64e8018000 comp rx=0 tx=0).stop 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 msgr2=0x7f64f8147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f64f000e8a0 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 shutdown_connections 2023-10-09T11:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64f8159530 0x7f64f8147150 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64e4066ff0 0x7f64e40694a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64f806dcf0 0x7f64f816a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 --2- 172.21.15.26:0/3896162666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64f80cb6f0 0x7f64f816d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.152+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 >> 172.21.15.26:0/3896162666 conn(0x7f64f80703a0 msgr2=0x7f64f80ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.153+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 shutdown_connections 2023-10-09T11:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.153+0000 7f64fff22700 1 -- 172.21.15.26:0/3896162666 wait complete. 2023-10-09T11:37:25.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:37:25.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:25.213 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.296+0000 7f9f1b525700 1 Processor -- start 2023-10-09T11:37:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.296+0000 7f9f1b525700 1 -- start start 2023-10-09T11:37:25.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1b525700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 0x7f9f140cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1b525700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 0x7f9f1415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1b525700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140cf3c0 con 0x7f9f14153c30 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1b525700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1415afd0 con 0x7f9f1415de50 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1b525700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1415b2b0 con 0x7f9f140cef40 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1a523700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9f14153c30 0x7f9f1415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46260/0 (socket says 172.21.15.26:46260) 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1a523700 1 -- 172.21.15.26:0/2410730911 learned_addr learned my addr 172.21.15.26:0/2410730911 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f19d22700 1 --2- 172.21.15.26:0/2410730911 >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 0x7f9f140cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1ad24700 1 --2- 172.21.15.26:0/2410730911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 0x7f9f1415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f19521700 1 -- 172.21.15.26:0/2410730911 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547316399 0 0) 0x7f9f140cf3c0 con 0x7f9f14153c30 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f19521700 1 -- 172.21.15.26:0/2410730911 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f00003570 con 0x7f9f14153c30 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1ad24700 1 -- 172.21.15.26:0/2410730911 >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 msgr2=0x7f9f140cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1ad24700 1 --2- 172.21.15.26:0/2410730911 >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 0x7f9f140cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1ad24700 1 -- 172.21.15.26:0/2410730911 >> v1:172.21.15.26:6789/0 conn(0x7f9f14153c30 legacy=0x7f9f1415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f1ad24700 1 -- 172.21.15.26:0/2410730911 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1415b590 con 0x7f9f140cef40 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.297+0000 7f9f19d22700 1 --2- 172.21.15.26:0/2410730911 >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 0x7f9f140cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1ad24700 1 --2- 172.21.15.26:0/2410730911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 0x7f9f1415c070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009e60 tx=0x7f9f0c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992e282665e5b74c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f19521700 1 -- 172.21.15.26:0/2410730911 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00e070 con 0x7f9f140cef40 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f19521700 1 -- 172.21.15.26:0/2410730911 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c00bab0 con 0x7f9f140cef40 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f19521700 1 -- 172.21.15.26:0/2410730911 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00be70 con 0x7f9f140cef40 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 -- 172.21.15.26:0/2410730911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 msgr2=0x7f9f1415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 --2- 172.21.15.26:0/2410730911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 0x7f9f1415c070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009e60 tx=0x7f9f0c009780 comp rx=0 tx=0).stop 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 -- 172.21.15.26:0/2410730911 shutdown_connections 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 --2- 172.21.15.26:0/2410730911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f140cef40 0x7f9f1415c070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 --2- 172.21.15.26:0/2410730911 >> v2:172.21.15.67:3300/0 conn(0x7f9f1415de50 0x7f9f140cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 -- 172.21.15.26:0/2410730911 >> 172.21.15.26:0/2410730911 conn(0x7f9f140703a0 msgr2=0x7f9f140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 -- 172.21.15.26:0/2410730911 shutdown_connections 2023-10-09T11:37:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.298+0000 7f9f1b525700 1 -- 172.21.15.26:0/2410730911 wait complete. 2023-10-09T11:37:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.299+0000 7f9f1b525700 1 Processor -- start 2023-10-09T11:37:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.299+0000 7f9f1b525700 1 -- start start 2023-10-09T11:37:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f14153c30 0x7f9f140c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f1415de50 0x7f9f140c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cc4e0 con 0x7f9f140cef40 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cb910 con 0x7f9f1415de50 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1b525700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cbbb0 con 0x7f9f14153c30 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1a523700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1a523700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32986/0 (socket says 172.21.15.26:32986) 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1a523700 1 -- 172.21.15.26:0/377157734 learned_addr learned my addr 172.21.15.26:0/377157734 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f19d22700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f14153c30 0x7f9f140c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.300+0000 7f9f1ad24700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f1415de50 0x7f9f140c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 -- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f14153c30 msgr2=0x7f9f140c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f14153c30 0x7f9f140c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 -- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f1415de50 msgr2=0x7f9f140c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f1415de50 0x7f9f140c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 -- 172.21.15.26:0/377157734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04009420 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1a523700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c7c0 tx=0x7f9f10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10005b30 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10005c90 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c009a20 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10007320 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.301+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f140cc170 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.302+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1404c3c0 con 0x7f9f140cef40 2023-10-09T11:37:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.302+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9f1001b400 con 0x7f9f140cef40 2023-10-09T11:37:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.303+0000 7f9f0a7fc700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 0x7f9ef8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.303+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f10084050 con 0x7f9f140cef40 2023-10-09T11:37:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.303+0000 7f9f19d22700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 0x7f9ef8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.303+0000 7f9f19d22700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 0x7f9ef8069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f040093f0 tx=0x7f9f04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.307+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f10051350 con 0x7f9f140cef40 2023-10-09T11:37:25.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.530+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f140cc620 con 0x7f9ef8066fc0 2023-10-09T11:37:25.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.532+0000 7f9f0a7fc700 1 -- 172.21.15.26:0/377157734 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9f04011a20 con 0x7f9ef8066fc0 2023-10-09T11:37:25.532 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:37:25.532 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:37:25.532 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:37:25.532 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:37:25.533 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:37:25.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 msgr2=0x7f9ef8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 0x7f9ef8069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f040093f0 tx=0x7f9f04008040 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 msgr2=0x7f9f14141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c7c0 tx=0x7f9f10007e00 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 shutdown_connections 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f1415de50 0x7f9f140c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f140cef40 0x7f9f14141db0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ef8066fc0 0x7f9ef8069470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 --2- 172.21.15.26:0/377157734 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f14153c30 0x7f9f140c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 >> 172.21.15.26:0/377157734 conn(0x7f9f140703a0 msgr2=0x7f9f1415bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 shutdown_connections 2023-10-09T11:37:25.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.534+0000 7f9f1b525700 1 -- 172.21.15.26:0/377157734 wait complete. 2023-10-09T11:37:25.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:37:25.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.708+0000 7f8b7edac700 1 Processor -- start 2023-10-09T11:37:25.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 -- start start 2023-10-09T11:37:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b78159860 0x7f8b780ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b780cbd90 0x7f8b780cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780cf510 con 0x7f8b780cbd90 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780cc210 con 0x7f8b78159860 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.709+0000 7f8b7edac700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780cd960 con 0x7f8b780ccfa0 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b780cbd90 0x7f8b780cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b780cbd90 0x7f8b780cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32992/0 (socket says 172.21.15.26:32992) 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 -- 172.21.15.26:0/3762172646 learned_addr learned my addr 172.21.15.26:0/3762172646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b7cb48700 1 --2- 172.21.15.26:0/3762172646 >> v2:172.21.15.67:3300/0 conn(0x7f8b78159860 0x7f8b780ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b7d349700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 -- 172.21.15.26:0/3762172646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 msgr2=0x7f8b780cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 -- 172.21.15.26:0/3762172646 >> v2:172.21.15.67:3300/0 conn(0x7f8b78159860 msgr2=0x7f8b780ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 --2- 172.21.15.26:0/3762172646 >> v2:172.21.15.67:3300/0 conn(0x7f8b78159860 0x7f8b780ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 -- 172.21.15.26:0/3762172646 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780ce900 con 0x7f8b780cbd90 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b77fff700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b780cf9a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8b78088e40 tx=0x7f8b6c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930034ce19170fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b777fe700 1 -- 172.21.15.26:0/3762172646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c005c10 con 0x7f8b780cbd90 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b777fe700 1 -- 172.21.15.26:0/3762172646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c005d70 con 0x7f8b780cbd90 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.710+0000 7f8b777fe700 1 -- 172.21.15.26:0/3762172646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00b880 con 0x7f8b780cbd90 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 -- 172.21.15.26:0/3762172646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 msgr2=0x7f8b780cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b780cf9a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8b78088e40 tx=0x7f8b6c009220 comp rx=0 tx=0).stop 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 -- 172.21.15.26:0/3762172646 shutdown_connections 2023-10-09T11:37:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 --2- 172.21.15.26:0/3762172646 >> v2:172.21.15.67:3300/0 conn(0x7f8b78159860 0x7f8b780ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 --2- 172.21.15.26:0/3762172646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b780cf9a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 -- 172.21.15.26:0/3762172646 >> 172.21.15.26:0/3762172646 conn(0x7f8b780999b0 msgr2=0x7f8b78070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 -- 172.21.15.26:0/3762172646 shutdown_connections 2023-10-09T11:37:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.711+0000 7f8b7edac700 1 -- 172.21.15.26:0/3762172646 wait complete. 2023-10-09T11:37:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.712+0000 7f8b7edac700 1 Processor -- start 2023-10-09T11:37:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.712+0000 7f8b7edac700 1 -- start start 2023-10-09T11:37:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b78159860 0x7f8b780b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78157e20 con 0x7f8b780cbd90 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78158320 con 0x7f8b78159860 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7edac700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780c9060 con 0x7f8b780ccfa0 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32996/0 (socket says 172.21.15.26:32996) 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 -- 172.21.15.26:0/2720661684 learned_addr learned my addr 172.21.15.26:0/2720661684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7d349700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b78159860 0x7f8b780b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b77fff700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 -- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 msgr2=0x7f8b780b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 -- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b78159860 msgr2=0x7f8b780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b78159860 0x7f8b780b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.713+0000 7f8b7cb48700 1 -- 172.21.15.26:0/2720661684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009480 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b7cb48700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d890 tx=0x7f8b68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68018070 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68005a00 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b780c8770 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68005dc0 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.714+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b780c8d70 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.715+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b780ca7f0 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.715+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8b68012800 con 0x7f8b780cbd90 2023-10-09T11:37:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.715+0000 7f8b74ff9700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 0x7f8b64069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.715+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b68084550 con 0x7f8b780cbd90 2023-10-09T11:37:25.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.716+0000 7f8b77fff700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 0x7f8b64069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.716+0000 7f8b77fff700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 0x7f8b64069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b780c6d10 tx=0x7f8b6c016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.720+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b68055260 con 0x7f8b780cbd90 2023-10-09T11:37:25.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.913+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8b7804c3c0 con 0x7f8b780cbd90 2023-10-09T11:37:25.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.914+0000 7f8b74ff9700 1 -- 172.21.15.26:0/2720661684 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b68054df0 con 0x7f8b780cbd90 2023-10-09T11:37:25.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 msgr2=0x7f8b64069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 0x7f8b64069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b780c6d10 tx=0x7f8b6c016000 comp rx=0 tx=0).stop 2023-10-09T11:37:25.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 msgr2=0x7f8b781578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d890 tx=0x7f8b68008040 comp rx=0 tx=0).stop 2023-10-09T11:37:25.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 shutdown_connections 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b78159860 0x7f8b780b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b780cbd90 0x7f8b781578e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8b64066fc0 0x7f8b64069470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 --2- 172.21.15.26:0/2720661684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8b780ccfa0 0x7f8b780b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 >> 172.21.15.26:0/2720661684 conn(0x7f8b780999b0 msgr2=0x7f8b78158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 shutdown_connections 2023-10-09T11:37:25.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:25.916+0000 7f8b7edac700 1 -- 172.21.15.26:0/2720661684 wait complete. 2023-10-09T11:37:25.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000261528 --mode=777 2023-10-09T11:37:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.050+0000 7f42e2550700 1 Processor -- start 2023-10-09T11:37:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 -- start start 2023-10-09T11:37:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 0x7f42dc0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42dc0cfd10 0x7f42dc0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0cf340 con 0x7f42dc0cfd10 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0ce730 con 0x7f42dc1595e0 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e2550700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0cea10 con 0x7f42dc0ce270 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e0aed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42dc0cfd10 0x7f42dc0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.051+0000 7f42e0aed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42dc0cfd10 0x7f42dc0ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33012/0 (socket says 172.21.15.26:33012) 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 -- 172.21.15.26:0/1699027538 learned_addr learned my addr 172.21.15.26:0/1699027538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42dbfff700 1 --2- 172.21.15.26:0/1699027538 >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 0x7f42dc0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42db7fe700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 -- 172.21.15.26:0/1699027538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 msgr2=0x7f42dc0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 -- 172.21.15.26:0/1699027538 >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 msgr2=0x7f42dc0cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 --2- 172.21.15.26:0/1699027538 >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 0x7f42dc0cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 -- 172.21.15.26:0/1699027538 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0cecf0 con 0x7f42dc0cfd10 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42dbfff700 1 --2- 172.21.15.26:0/1699027538 >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 0x7f42dc0cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42e0aed700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0ad780 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f42dc06c480 tx=0x7f42d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcafbe04790d1021 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42daffd700 1 -- 172.21.15.26:0/1699027538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400e070 con 0x7f42dc0cfd10 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42daffd700 1 -- 172.21.15.26:0/1699027538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d400ba50 con 0x7f42dc0cfd10 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.052+0000 7f42daffd700 1 -- 172.21.15.26:0/1699027538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40092e0 con 0x7f42dc0cfd10 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 -- 172.21.15.26:0/1699027538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc0cfd10 msgr2=0x7f42dc0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0ad780 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f42dc06c480 tx=0x7f42d4009840 comp rx=0 tx=0).stop 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 -- 172.21.15.26:0/1699027538 shutdown_connections 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 --2- 172.21.15.26:0/1699027538 >> v2:172.21.15.67:3300/0 conn(0x7f42dc1595e0 0x7f42dc0cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0ad780 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 --2- 172.21.15.26:0/1699027538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 -- 172.21.15.26:0/1699027538 >> 172.21.15.26:0/1699027538 conn(0x7f42dc0999c0 msgr2=0x7f42dc070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 -- 172.21.15.26:0/1699027538 shutdown_connections 2023-10-09T11:37:26.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.053+0000 7f42e2550700 1 -- 172.21.15.26:0/1699027538 wait complete. 2023-10-09T11:37:26.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.054+0000 7f42e2550700 1 Processor -- start 2023-10-09T11:37:26.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.054+0000 7f42e2550700 1 -- start start 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0c4c80 con 0x7f42dc1595e0 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0b5760 con 0x7f42dc0cfd10 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e2550700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0b5a40 con 0x7f42dc0ce270 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33024/0 (socket says 172.21.15.26:33024) 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 -- 172.21.15.26:0/4250915549 learned_addr learned my addr 172.21.15.26:0/4250915549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42dbfff700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42db7fe700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 -- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 msgr2=0x7f42dc0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 -- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc0cfd10 msgr2=0x7f42dc0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 -- 172.21.15.26:0/4250915549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4009ae0 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42e0aed700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42dc071290 tx=0x7f42d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.055+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40032f0 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.056+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4008e80 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.056+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4026690 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.056+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc0b5d20 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.056+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc0b53c0 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.056+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc04c3c0 con 0x7f42dc1595e0 2023-10-09T11:37:26.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.057+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f42d4003040 con 0x7f42dc1595e0 2023-10-09T11:37:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.057+0000 7f42d3fff700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 0x7f42bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.057+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42d40862c0 con 0x7f42dc1595e0 2023-10-09T11:37:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.058+0000 7f42dbfff700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 0x7f42bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.058+0000 7f42dbfff700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 0x7f42bc069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42c4006fd0 tx=0x7f42c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.062+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42d40533e0 con 0x7f42dc1595e0 2023-10-09T11:37:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.287+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000261528", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f42dc0cefd0 con 0x7f42bc066fc0 2023-10-09T11:37:26.290 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.289+0000 7f48c13c6700 -1 client.5275 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-09T11:36:55.271014+0000 mtime=2023-10-09T11:36:55.271014+0000 ctime=2023-10-09T11:36:55.277171+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000402568"] has_dir_layout 0x562f39640000) 2023-10-09T11:37:26.294 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.294+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:37:26.295 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.294+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:37:26.295 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.294+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:37:26.295 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.294+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:37:26.295 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:37:26.294+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:37:26.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.327+0000 7f42d3fff700 1 -- 172.21.15.26:0/4250915549 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f42dc0cefd0 con 0x7f42bc066fc0 2023-10-09T11:37:26.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 msgr2=0x7f42bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 0x7f42bc069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42c4006fd0 tx=0x7f42c4008040 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 msgr2=0x7f42dc16cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42dc071290 tx=0x7f42d4018000 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 shutdown_connections 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42dc1595e0 0x7f42dc16cae0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42bc066fc0 0x7f42bc069470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42dc0ce270 0x7f42dc0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 --2- 172.21.15.26:0/4250915549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc0cfd10 0x7f42dc0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 >> 172.21.15.26:0/4250915549 conn(0x7f42dc0999c0 msgr2=0x7f42dc0cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 shutdown_connections 2023-10-09T11:37:26.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.329+0000 7f42e2550700 1 -- 172.21.15.26:0/4250915549 wait complete. 2023-10-09T11:37:26.342 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000261528 2023-10-09T11:37:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 Processor -- start 2023-10-09T11:37:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 -- start start 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4b8159530 0x7fd4b80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806dc70 0x7fd4b8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 0x7fd4b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80ccfd0 con 0x7fd4b8159530 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80cf0e0 con 0x7fd4b806e0e0 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.464+0000 7fd4bda20700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815a3d0 con 0x7fd4b806dc70 2023-10-09T11:37:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4b8159530 0x7fd4b80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4b8159530 0x7fd4b80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33028/0 (socket says 172.21.15.26:33028) 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/680966945 learned_addr learned my addr 172.21.15.26:0/680966945 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b67fc700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806dc70 0x7fd4b8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b77fe700 1 --2- 172.21.15.26:0/680966945 >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 0x7fd4b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/680966945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806dc70 msgr2=0x7fd4b8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806dc70 0x7fd4b8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/680966945 >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 msgr2=0x7fd4b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/680966945 >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 0x7fd4b80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/680966945 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b815a6b0 con 0x7fd4b8159530 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b77fe700 1 --2- 172.21.15.26:0/680966945 >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 0x7fd4b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b8159530 0x7fd4b80ceba0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8089880 tx=0x7fd4a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c117b67af3452eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b5ffb700 1 -- 172.21.15.26:0/680966945 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800b860 con 0x7fd4b8159530 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b5ffb700 1 -- 172.21.15.26:0/680966945 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a800b9c0 con 0x7fd4b8159530 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.465+0000 7fd4b5ffb700 1 -- 172.21.15.26:0/680966945 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800bd60 con 0x7fd4b8159530 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 -- 172.21.15.26:0/680966945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b8159530 msgr2=0x7fd4b80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b8159530 0x7fd4b80ceba0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8089880 tx=0x7fd4a8009250 comp rx=0 tx=0).stop 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 -- 172.21.15.26:0/680966945 shutdown_connections 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 --2- 172.21.15.26:0/680966945 >> v2:172.21.15.67:3300/0 conn(0x7fd4b806e0e0 0x7fd4b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b8159530 0x7fd4b80ceba0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 --2- 172.21.15.26:0/680966945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806dc70 0x7fd4b8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 -- 172.21.15.26:0/680966945 >> 172.21.15.26:0/680966945 conn(0x7fd4b80703a0 msgr2=0x7fd4b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 -- 172.21.15.26:0/680966945 shutdown_connections 2023-10-09T11:37:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.466+0000 7fd4bda20700 1 -- 172.21.15.26:0/680966945 wait complete. 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.467+0000 7fd4bda20700 1 Processor -- start 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.467+0000 7fd4bda20700 1 -- start start 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806e0e0 0x7fd4b80b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b8159530 0x7fd4b80b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80b35b0 con 0x7fd4b806dc70 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81521a0 con 0x7fd4b8159530 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4bda20700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80c98b0 con 0x7fd4b806e0e0 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33038/0 (socket says 172.21.15.26:33038) 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/2272087699 learned_addr learned my addr 172.21.15.26:0/2272087699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806e0e0 msgr2=0x7fd4b80b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806e0e0 0x7fd4b80b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b8159530 msgr2=0x7fd4b80b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b8159530 0x7fd4b80b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 -- 172.21.15.26:0/2272087699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80094f0 con 0x7fd4b806dc70 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.468+0000 7fd4b6ffd700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8006fd0 tx=0x7fd4a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.469+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8024440 con 0x7fd4b806dc70 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.469+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a80245a0 con 0x7fd4b806dc70 2023-10-09T11:37:26.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.469+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b80c9b90 con 0x7fd4b806dc70 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.469+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8024960 con 0x7fd4b806dc70 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.469+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b80ca150 con 0x7fd4b806dc70 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.470+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b804c3c0 con 0x7fd4b806dc70 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.470+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd4a801a420 con 0x7fd4b806dc70 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.470+0000 7fd49effd700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 0x7fd4a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.470+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4a8086310 con 0x7fd4b806dc70 2023-10-09T11:37:26.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.471+0000 7fd4b67fc700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 0x7fd4a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.471+0000 7fd4b67fc700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 0x7fd4a4069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80ce460 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.475+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4a8053590 con 0x7fd4b806dc70 2023-10-09T11:37:26.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.702+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000261528", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4b80b36f0 con 0x7fd4a4066fc0 2023-10-09T11:37:26.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.709+0000 7fd49effd700 1 -- 172.21.15.26:0/2272087699 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fd4ac007e10 con 0x7fd4a4066fc0 2023-10-09T11:37:26.710 INFO:teuthology.orchestra.run.smithi026.stdout:/volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 msgr2=0x7fd4a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 0x7fd4a4069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80ce460 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 msgr2=0x7fd4b8151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8006fd0 tx=0x7fd4a8017000 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 shutdown_connections 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b8159530 0x7fd4b80b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b806dc70 0x7fd4b8151c60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4a4066fc0 0x7fd4a4069470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 --2- 172.21.15.26:0/2272087699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4b806e0e0 0x7fd4b80b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 >> 172.21.15.26:0/2272087699 conn(0x7fd4b80703a0 msgr2=0x7fd4b80cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 shutdown_connections 2023-10-09T11:37:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:37:26.711+0000 7fd4bda20700 1 -- 172.21.15.26:0/2272087699 wait complete. 2023-10-09T11:37:26.724 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000261528 with 3000 files each 0.1MB size under directory volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746 2023-10-09T11:37:26.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.725 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.724e-05 s, 0.0 kB/s 2023-10-09T11:37:26.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.749 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5337e-05 s, 0.0 kB/s 2023-10-09T11:37:26.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.806 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:26.862 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:26.862 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:26.862 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-09T11:37:26.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.863 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:26.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:26.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:26.918 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0849e-05 s, 0.0 kB/s 2023-10-09T11:37:26.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:26.974 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:26.974 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:26.975 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0068e-05 s, 0.0 kB/s 2023-10-09T11:37:26.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:26.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.032 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6343e-05 s, 0.0 kB/s 2023-10-09T11:37:27.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.033 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6656e-05 s, 0.0 kB/s 2023-10-09T11:37:27.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.089 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.144 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.144 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.144 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2058e-05 s, 0.0 kB/s 2023-10-09T11:37:27.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.145 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.201 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7532e-05 s, 0.0 kB/s 2023-10-09T11:37:27.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.201 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.256 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0677e-05 s, 0.0 kB/s 2023-10-09T11:37:27.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.256 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.312 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.313 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.754e-05 s, 0.0 kB/s 2023-10-09T11:37:27.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.313 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1168e-05 s, 0.0 kB/s 2023-10-09T11:37:27.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.369 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.426 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.426 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.426 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103739 s, 0.0 kB/s 2023-10-09T11:37:27.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.427 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8532e-05 s, 0.0 kB/s 2023-10-09T11:37:27.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.483 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8628e-05 s, 0.0 kB/s 2023-10-09T11:37:27.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.540 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2577e-05 s, 0.0 kB/s 2023-10-09T11:37:27.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.596 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1401e-05 s, 0.0 kB/s 2023-10-09T11:37:27.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.652 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-09T11:37:27.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.708 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7429e-05 s, 0.0 kB/s 2023-10-09T11:37:27.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.765 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1227e-05 s, 0.0 kB/s 2023-10-09T11:37:27.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.820 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.876 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1045e-05 s, 0.0 kB/s 2023-10-09T11:37:27.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.876 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0012e-05 s, 0.0 kB/s 2023-10-09T11:37:27.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.933 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5828e-05 s, 0.0 kB/s 2023-10-09T11:37:27.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:27.988 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.044 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2607e-05 s, 0.0 kB/s 2023-10-09T11:37:28.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.045 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6928e-05 s, 0.0 kB/s 2023-10-09T11:37:28.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0383e-05 s, 0.0 kB/s 2023-10-09T11:37:28.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.157 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.214 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3492e-05 s, 0.0 kB/s 2023-10-09T11:37:28.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.214 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4601e-05 s, 0.0 kB/s 2023-10-09T11:37:28.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.270 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.326 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.327 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.839e-05 s, 0.0 kB/s 2023-10-09T11:37:28.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.327 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1898e-05 s, 0.0 kB/s 2023-10-09T11:37:28.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2796e-05 s, 0.0 kB/s 2023-10-09T11:37:28.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.441 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.496 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2015e-05 s, 0.0 kB/s 2023-10-09T11:37:28.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.497 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.552 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1779e-05 s, 0.0 kB/s 2023-10-09T11:37:28.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.553 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9712e-05 s, 0.0 kB/s 2023-10-09T11:37:28.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.609 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2603e-05 s, 0.0 kB/s 2023-10-09T11:37:28.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.664 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-09T11:37:28.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.720 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.776 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100389 s, 0.0 kB/s 2023-10-09T11:37:28.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.777 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8859e-05 s, 0.0 kB/s 2023-10-09T11:37:28.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.833 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3998e-05 s, 0.0 kB/s 2023-10-09T11:37:28.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.888 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:28.944 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:28.944 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:28.944 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3818e-05 s, 0.0 kB/s 2023-10-09T11:37:28.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:28.944 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.000 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3401e-05 s, 0.0 kB/s 2023-10-09T11:37:29.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.000 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.056 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6349e-05 s, 0.0 kB/s 2023-10-09T11:37:29.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.056 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4827e-05 s, 0.0 kB/s 2023-10-09T11:37:29.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.113 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7267e-05 s, 0.0 kB/s 2023-10-09T11:37:29.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.169 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6792e-05 s, 0.0 kB/s 2023-10-09T11:37:29.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.228 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.284 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4295e-05 s, 0.0 kB/s 2023-10-09T11:37:29.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.285 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.341 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.341 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.341 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2405e-05 s, 0.0 kB/s 2023-10-09T11:37:29.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.342 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.398 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0522e-05 s, 0.0 kB/s 2023-10-09T11:37:29.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.399 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3751e-05 s, 0.0 kB/s 2023-10-09T11:37:29.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.456 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0739e-05 s, 0.0 kB/s 2023-10-09T11:37:29.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.512 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.569 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4292e-05 s, 0.0 kB/s 2023-10-09T11:37:29.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.626 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6459e-05 s, 0.0 kB/s 2023-10-09T11:37:29.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.626 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.7164e-05 s, 0.0 kB/s 2023-10-09T11:37:29.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.683 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1525e-05 s, 0.0 kB/s 2023-10-09T11:37:29.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5492e-05 s, 0.0 kB/s 2023-10-09T11:37:29.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.854 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3924e-05 s, 0.0 kB/s 2023-10-09T11:37:29.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.911 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.684e-05 s, 0.0 kB/s 2023-10-09T11:37:29.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.911 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:29.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:29.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:29.967 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1686e-05 s, 0.0 kB/s 2023-10-09T11:37:29.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:29.968 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2743e-05 s, 0.0 kB/s 2023-10-09T11:37:30.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000116102 s, 0.0 kB/s 2023-10-09T11:37:30.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.137 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.175e-05 s, 0.0 kB/s 2023-10-09T11:37:30.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.137 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6325e-05 s, 0.0 kB/s 2023-10-09T11:37:30.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.195 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3834e-05 s, 0.0 kB/s 2023-10-09T11:37:30.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.252 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.307 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7892e-05 s, 0.0 kB/s 2023-10-09T11:37:30.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.308 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6635e-05 s, 0.0 kB/s 2023-10-09T11:37:30.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.365 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.275e-05 s, 0.0 kB/s 2023-10-09T11:37:30.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6079e-05 s, 0.0 kB/s 2023-10-09T11:37:30.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5201e-05 s, 0.0 kB/s 2023-10-09T11:37:30.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.537 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.592 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1292e-05 s, 0.0 kB/s 2023-10-09T11:37:30.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.593 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6311e-05 s, 0.0 kB/s 2023-10-09T11:37:30.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.649 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6959e-05 s, 0.0 kB/s 2023-10-09T11:37:30.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.705 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.761 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.761 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.761 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1895e-05 s, 0.0 kB/s 2023-10-09T11:37:30.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.762 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6745e-05 s, 0.0 kB/s 2023-10-09T11:37:30.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.818 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-09T11:37:30.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.875 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6649e-05 s, 0.0 kB/s 2023-10-09T11:37:30.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.932 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7936e-05 s, 0.0 kB/s 2023-10-09T11:37:30.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.989 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.044 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4933e-05 s, 0.0 kB/s 2023-10-09T11:37:31.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.045 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4892e-05 s, 0.0 kB/s 2023-10-09T11:37:31.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7959e-05 s, 0.0 kB/s 2023-10-09T11:37:31.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.158 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101919 s, 0.0 kB/s 2023-10-09T11:37:31.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.215 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000119525 s, 0.0 kB/s 2023-10-09T11:37:31.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.272 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.328 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6695e-05 s, 0.0 kB/s 2023-10-09T11:37:31.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9823e-05 s, 0.0 kB/s 2023-10-09T11:37:31.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.441 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3183e-05 s, 0.0 kB/s 2023-10-09T11:37:31.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.441 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2126e-05 s, 0.0 kB/s 2023-10-09T11:37:31.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-09T11:37:31.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.554 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.366e-05 s, 0.0 kB/s 2023-10-09T11:37:31.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.611 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.666 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4238e-05 s, 0.0 kB/s 2023-10-09T11:37:31.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.666 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.722 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4251e-05 s, 0.0 kB/s 2023-10-09T11:37:31.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.722 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.778 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0106e-05 s, 0.0 kB/s 2023-10-09T11:37:31.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.834 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2291e-05 s, 0.0 kB/s 2023-10-09T11:37:31.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.834 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.890 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9869e-05 s, 0.0 kB/s 2023-10-09T11:37:31.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.890 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1804e-05 s, 0.0 kB/s 2023-10-09T11:37:31.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:31.946 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4085e-05 s, 0.0 kB/s 2023-10-09T11:37:32.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.003 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.058 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4751e-05 s, 0.0 kB/s 2023-10-09T11:37:32.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.059 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4038e-05 s, 0.0 kB/s 2023-10-09T11:37:32.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4008e-05 s, 0.0 kB/s 2023-10-09T11:37:32.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.171 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.226 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1523e-05 s, 0.0 kB/s 2023-10-09T11:37:32.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4722e-05 s, 0.0 kB/s 2023-10-09T11:37:32.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.283 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7049e-05 s, 0.0 kB/s 2023-10-09T11:37:32.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.338 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.62e-05 s, 0.0 kB/s 2023-10-09T11:37:32.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.450 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.450 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.450 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9579e-05 s, 0.0 kB/s 2023-10-09T11:37:32.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.450 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3156e-05 s, 0.0 kB/s 2023-10-09T11:37:32.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.507 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6316e-05 s, 0.0 kB/s 2023-10-09T11:37:32.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.562 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0617e-05 s, 0.0 kB/s 2023-10-09T11:37:32.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.618 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.674 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3048e-05 s, 0.0 kB/s 2023-10-09T11:37:32.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.675 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.730 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2905e-05 s, 0.0 kB/s 2023-10-09T11:37:32.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.731 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.786 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3936e-05 s, 0.0 kB/s 2023-10-09T11:37:32.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.786 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-09T11:37:32.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.842 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.898 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3682e-05 s, 0.0 kB/s 2023-10-09T11:37:32.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:32.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:32.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:32.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3626e-05 s, 0.0 kB/s 2023-10-09T11:37:32.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.955 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2317e-05 s, 0.0 kB/s 2023-10-09T11:37:33.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5001e-05 s, 0.0 kB/s 2023-10-09T11:37:33.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.067 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.122 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3018e-05 s, 0.0 kB/s 2023-10-09T11:37:33.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.123 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3166e-05 s, 0.0 kB/s 2023-10-09T11:37:33.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.179 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1322e-05 s, 0.0 kB/s 2023-10-09T11:37:33.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.235 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3355e-05 s, 0.0 kB/s 2023-10-09T11:37:33.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.290 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2553e-05 s, 0.0 kB/s 2023-10-09T11:37:33.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.347 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0615e-05 s, 0.0 kB/s 2023-10-09T11:37:33.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.404 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2192e-05 s, 0.0 kB/s 2023-10-09T11:37:33.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.517 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.9898e-05 s, 0.0 kB/s 2023-10-09T11:37:33.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.573 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4772e-05 s, 0.0 kB/s 2023-10-09T11:37:33.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.574 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4903e-05 s, 0.0 kB/s 2023-10-09T11:37:33.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.629 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5989e-05 s, 0.0 kB/s 2023-10-09T11:37:33.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.685 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4043e-05 s, 0.0 kB/s 2023-10-09T11:37:33.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.742 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0195e-05 s, 0.0 kB/s 2023-10-09T11:37:33.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T11:37:33.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.953 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:33.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6276e-05 s, 0.0 kB/s 2023-10-09T11:37:33.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:33.970 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.026 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.4094e-05 s, 0.0 kB/s 2023-10-09T11:37:34.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.027 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9709e-05 s, 0.0 kB/s 2023-10-09T11:37:34.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.084 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1694e-05 s, 0.0 kB/s 2023-10-09T11:37:34.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.139 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.196 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.251 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.251 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.251 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.8056e-05 s, 0.0 kB/s 2023-10-09T11:37:34.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.252 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.307 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.307 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.307 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7475e-05 s, 0.0 kB/s 2023-10-09T11:37:34.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.308 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6685e-05 s, 0.0 kB/s 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.364 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2022e-05 s, 0.0 kB/s 2023-10-09T11:37:34.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.420 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3229e-05 s, 0.0 kB/s 2023-10-09T11:37:34.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.532 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3202e-05 s, 0.0 kB/s 2023-10-09T11:37:34.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4479e-05 s, 0.0 kB/s 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7909e-05 s, 0.0 kB/s 2023-10-09T11:37:34.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.645 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2929e-05 s, 0.0 kB/s 2023-10-09T11:37:34.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5927e-05 s, 0.0 kB/s 2023-10-09T11:37:34.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.756 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5809e-05 s, 0.0 kB/s 2023-10-09T11:37:34.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.813 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3979e-05 s, 0.0 kB/s 2023-10-09T11:37:34.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.868 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2022e-05 s, 0.0 kB/s 2023-10-09T11:37:34.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.924 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:34.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:34.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:34.979 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3958e-05 s, 0.0 kB/s 2023-10-09T11:37:34.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:34.980 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.036 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.036 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.036 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000131759 s, 0.0 kB/s 2023-10-09T11:37:35.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.037 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5129e-05 s, 0.0 kB/s 2023-10-09T11:37:35.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.092 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1052e-05 s, 0.0 kB/s 2023-10-09T11:37:35.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.148 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.029e-05 s, 0.0 kB/s 2023-10-09T11:37:35.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.205 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.260 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5999e-05 s, 0.0 kB/s 2023-10-09T11:37:35.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.261 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.318 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6183e-05 s, 0.0 kB/s 2023-10-09T11:37:35.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.318 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4336e-05 s, 0.0 kB/s 2023-10-09T11:37:35.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.374 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.430 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1896e-05 s, 0.0 kB/s 2023-10-09T11:37:35.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.431 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4683e-05 s, 0.0 kB/s 2023-10-09T11:37:35.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4194e-05 s, 0.0 kB/s 2023-10-09T11:37:35.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.543 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1299e-05 s, 0.0 kB/s 2023-10-09T11:37:35.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.599 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4571e-05 s, 0.0 kB/s 2023-10-09T11:37:35.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.711 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6502e-05 s, 0.0 kB/s 2023-10-09T11:37:35.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.767 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2874e-05 s, 0.0 kB/s 2023-10-09T11:37:35.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.768 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9156e-05 s, 0.0 kB/s 2023-10-09T11:37:35.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.824 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.879 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100051 s, 0.0 kB/s 2023-10-09T11:37:35.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.880 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3982e-05 s, 0.0 kB/s 2023-10-09T11:37:35.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:35.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:35.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:35.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3126e-05 s, 0.0 kB/s 2023-10-09T11:37:35.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:35.993 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.048 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2055e-05 s, 0.0 kB/s 2023-10-09T11:37:36.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.049 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-09T11:37:36.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.105 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4603e-05 s, 0.0 kB/s 2023-10-09T11:37:36.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.160 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3302e-05 s, 0.0 kB/s 2023-10-09T11:37:36.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.218 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7926e-05 s, 0.0 kB/s 2023-10-09T11:37:36.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.274 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7055e-05 s, 0.0 kB/s 2023-10-09T11:37:36.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.330 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1953e-05 s, 0.0 kB/s 2023-10-09T11:37:36.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.386 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1584e-05 s, 0.0 kB/s 2023-10-09T11:37:36.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.02e-05 s, 0.0 kB/s 2023-10-09T11:37:36.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1624e-05 s, 0.0 kB/s 2023-10-09T11:37:36.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.554 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.610 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2514e-05 s, 0.0 kB/s 2023-10-09T11:37:36.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.610 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.665 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.665 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.665 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9124e-05 s, 0.0 kB/s 2023-10-09T11:37:36.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.666 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2124e-05 s, 0.0 kB/s 2023-10-09T11:37:36.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.722 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.779 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4466e-05 s, 0.0 kB/s 2023-10-09T11:37:36.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.779 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2542e-05 s, 0.0 kB/s 2023-10-09T11:37:36.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.835 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6195e-05 s, 0.0 kB/s 2023-10-09T11:37:36.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.891 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4482e-05 s, 0.0 kB/s 2023-10-09T11:37:36.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:36.948 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.003 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.003 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.004 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3376e-05 s, 0.0 kB/s 2023-10-09T11:37:37.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.004 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8082e-05 s, 0.0 kB/s 2023-10-09T11:37:37.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.060 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.116 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1929e-05 s, 0.0 kB/s 2023-10-09T11:37:37.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.116 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.172 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-09T11:37:37.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.173 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.228 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.228 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.229 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4135e-05 s, 0.0 kB/s 2023-10-09T11:37:37.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.229 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.284 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.284 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.284 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6606e-05 s, 0.0 kB/s 2023-10-09T11:37:37.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.285 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.340 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0744e-05 s, 0.0 kB/s 2023-10-09T11:37:37.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.340 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.397 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9928e-05 s, 0.0 kB/s 2023-10-09T11:37:37.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.397 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.045e-05 s, 0.0 kB/s 2023-10-09T11:37:37.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.454 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3782e-05 s, 0.0 kB/s 2023-10-09T11:37:37.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1559e-05 s, 0.0 kB/s 2023-10-09T11:37:37.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.622 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1987e-05 s, 0.0 kB/s 2023-10-09T11:37:37.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.623 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9185e-05 s, 0.0 kB/s 2023-10-09T11:37:37.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.678 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6142e-05 s, 0.0 kB/s 2023-10-09T11:37:37.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.735 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4966e-05 s, 0.0 kB/s 2023-10-09T11:37:37.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.791 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2479e-05 s, 0.0 kB/s 2023-10-09T11:37:37.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.848 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8525e-05 s, 0.0 kB/s 2023-10-09T11:37:37.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.903 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0505e-05 s, 0.0 kB/s 2023-10-09T11:37:37.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:37.959 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3449e-05 s, 0.0 kB/s 2023-10-09T11:37:38.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.016 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4627e-05 s, 0.0 kB/s 2023-10-09T11:37:38.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.072 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0246e-05 s, 0.0 kB/s 2023-10-09T11:37:38.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.128 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0973e-05 s, 0.0 kB/s 2023-10-09T11:37:38.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3955e-05 s, 0.0 kB/s 2023-10-09T11:37:38.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.240 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3917e-05 s, 0.0 kB/s 2023-10-09T11:37:38.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.296 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.265e-05 s, 0.0 kB/s 2023-10-09T11:37:38.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.409 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.409 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2655e-05 s, 0.0 kB/s 2023-10-09T11:37:38.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.409 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.464 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.465 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.465 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0933e-05 s, 0.0 kB/s 2023-10-09T11:37:38.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.465 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.521 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.521 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.521 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1779e-05 s, 0.0 kB/s 2023-10-09T11:37:38.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.522 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.577 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.577 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.577 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4049e-05 s, 0.0 kB/s 2023-10-09T11:37:38.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.578 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.452e-05 s, 0.0 kB/s 2023-10-09T11:37:38.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.634 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9523e-05 s, 0.0 kB/s 2023-10-09T11:37:38.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.689 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2222e-05 s, 0.0 kB/s 2023-10-09T11:37:38.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.746 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1989e-05 s, 0.0 kB/s 2023-10-09T11:37:38.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.802 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2604e-05 s, 0.0 kB/s 2023-10-09T11:37:38.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.913 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.913 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.913 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5008e-05 s, 0.0 kB/s 2023-10-09T11:37:38.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.913 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:38.969 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7905e-05 s, 0.0 kB/s 2023-10-09T11:37:38.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:38.970 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.025 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.025 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.026 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4236e-05 s, 0.0 kB/s 2023-10-09T11:37:39.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.026 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0137e-05 s, 0.0 kB/s 2023-10-09T11:37:39.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.137 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6409e-05 s, 0.0 kB/s 2023-10-09T11:37:39.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.138 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5281e-05 s, 0.0 kB/s 2023-10-09T11:37:39.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.195 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.250 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0852e-05 s, 0.0 kB/s 2023-10-09T11:37:39.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.251 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6032e-05 s, 0.0 kB/s 2023-10-09T11:37:39.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3589e-05 s, 0.0 kB/s 2023-10-09T11:37:39.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.420 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1593e-05 s, 0.0 kB/s 2023-10-09T11:37:39.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.420 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106909 s, 0.0 kB/s 2023-10-09T11:37:39.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.342e-05 s, 0.0 kB/s 2023-10-09T11:37:39.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.587 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6839e-05 s, 0.0 kB/s 2023-10-09T11:37:39.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2762e-05 s, 0.0 kB/s 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.646 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.702 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7412e-05 s, 0.0 kB/s 2023-10-09T11:37:39.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.702 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1323e-05 s, 0.0 kB/s 2023-10-09T11:37:39.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.759 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3844e-05 s, 0.0 kB/s 2023-10-09T11:37:39.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6939e-05 s, 0.0 kB/s 2023-10-09T11:37:39.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.872 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.927 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1775e-05 s, 0.0 kB/s 2023-10-09T11:37:39.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.928 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9597e-05 s, 0.0 kB/s 2023-10-09T11:37:39.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.039 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.039 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.039 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0479e-05 s, 0.0 kB/s 2023-10-09T11:37:40.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.040 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.095 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0479e-05 s, 0.0 kB/s 2023-10-09T11:37:40.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.096 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.152 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4036e-05 s, 0.0 kB/s 2023-10-09T11:37:40.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.208 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2748e-05 s, 0.0 kB/s 2023-10-09T11:37:40.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.209 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2569e-05 s, 0.0 kB/s 2023-10-09T11:37:40.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.265 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1159e-05 s, 0.0 kB/s 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.322 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4779e-05 s, 0.0 kB/s 2023-10-09T11:37:40.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.379 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.686e-05 s, 0.0 kB/s 2023-10-09T11:37:40.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.437 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.493 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.493 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.493 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7982e-05 s, 0.0 kB/s 2023-10-09T11:37:40.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.494 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5415e-05 s, 0.0 kB/s 2023-10-09T11:37:40.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.551 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5915e-05 s, 0.0 kB/s 2023-10-09T11:37:40.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.608 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2373e-05 s, 0.0 kB/s 2023-10-09T11:37:40.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.665 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1971e-05 s, 0.0 kB/s 2023-10-09T11:37:40.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.722 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1744e-05 s, 0.0 kB/s 2023-10-09T11:37:40.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.3666e-05 s, 0.0 kB/s 2023-10-09T11:37:40.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.834 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-09T11:37:40.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.890 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:40.946 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1505e-05 s, 0.0 kB/s 2023-10-09T11:37:40.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.946 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.003 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4176e-05 s, 0.0 kB/s 2023-10-09T11:37:41.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.003 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.059 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7869e-05 s, 0.0 kB/s 2023-10-09T11:37:41.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.059 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8816e-05 s, 0.0 kB/s 2023-10-09T11:37:41.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.115 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1107e-05 s, 0.0 kB/s 2023-10-09T11:37:41.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.171 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8453e-05 s, 0.0 kB/s 2023-10-09T11:37:41.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.283 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-09T11:37:41.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.284 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.339 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3392e-05 s, 0.0 kB/s 2023-10-09T11:37:41.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.340 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4215e-05 s, 0.0 kB/s 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.396 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1432e-05 s, 0.0 kB/s 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.454 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1812e-05 s, 0.0 kB/s 2023-10-09T11:37:41.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.510 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2699e-05 s, 0.0 kB/s 2023-10-09T11:37:41.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.622 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8208e-05 s, 0.0 kB/s 2023-10-09T11:37:41.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.623 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3527e-05 s, 0.0 kB/s 2023-10-09T11:37:41.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.680 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.736 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1432e-05 s, 0.0 kB/s 2023-10-09T11:37:41.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.736 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.793 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.793 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.793 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7866e-05 s, 0.0 kB/s 2023-10-09T11:37:41.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.793 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8232e-05 s, 0.0 kB/s 2023-10-09T11:37:41.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.905 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.905 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.905 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2513e-05 s, 0.0 kB/s 2023-10-09T11:37:41.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.906 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:41.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:41.961 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:41.961 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2595e-05 s, 0.0 kB/s 2023-10-09T11:37:41.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:41.962 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.018 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.019 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-09T11:37:42.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.019 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0022e-05 s, 0.0 kB/s 2023-10-09T11:37:42.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.076 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4639e-05 s, 0.0 kB/s 2023-10-09T11:37:42.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.133 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3482e-05 s, 0.0 kB/s 2023-10-09T11:37:42.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.188 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3664e-05 s, 0.0 kB/s 2023-10-09T11:37:42.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.245 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4588e-05 s, 0.0 kB/s 2023-10-09T11:37:42.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-09T11:37:42.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.357 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7046e-05 s, 0.0 kB/s 2023-10-09T11:37:42.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.414 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.472 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2457e-05 s, 0.0 kB/s 2023-10-09T11:37:42.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.472 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1102e-05 s, 0.0 kB/s 2023-10-09T11:37:42.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4168e-05 s, 0.0 kB/s 2023-10-09T11:37:42.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.585 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4434e-05 s, 0.0 kB/s 2023-10-09T11:37:42.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.642 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4626e-05 s, 0.0 kB/s 2023-10-09T11:37:42.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.754 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2546e-05 s, 0.0 kB/s 2023-10-09T11:37:42.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.755 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.812 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7815e-05 s, 0.0 kB/s 2023-10-09T11:37:42.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.812 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3783e-05 s, 0.0 kB/s 2023-10-09T11:37:42.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.869 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.924 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-09T11:37:42.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.925 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:42.980 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:42.980 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:42.980 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5963e-05 s, 0.0 kB/s 2023-10-09T11:37:42.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:42.981 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.038 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4793e-05 s, 0.0 kB/s 2023-10-09T11:37:43.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.038 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.095 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6655e-05 s, 0.0 kB/s 2023-10-09T11:37:43.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.096 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4137e-05 s, 0.0 kB/s 2023-10-09T11:37:43.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.208 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0138e-05 s, 0.0 kB/s 2023-10-09T11:37:43.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.209 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9692e-05 s, 0.0 kB/s 2023-10-09T11:37:43.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.267 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.323 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.323 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6293e-05 s, 0.0 kB/s 2023-10-09T11:37:43.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.323 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5386e-05 s, 0.0 kB/s 2023-10-09T11:37:43.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.380 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.435 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.435 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.435 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.4061e-05 s, 0.0 kB/s 2023-10-09T11:37:43.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.436 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-09T11:37:43.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.492 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.549 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.549 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.549 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-09T11:37:43.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.549 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2601e-05 s, 0.0 kB/s 2023-10-09T11:37:43.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.604 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1948e-05 s, 0.0 kB/s 2023-10-09T11:37:43.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.661 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8492e-05 s, 0.0 kB/s 2023-10-09T11:37:43.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.717 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8032e-05 s, 0.0 kB/s 2023-10-09T11:37:43.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.774 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.362e-05 s, 0.0 kB/s 2023-10-09T11:37:43.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.830 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7692e-05 s, 0.0 kB/s 2023-10-09T11:37:43.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.886 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.27e-05 s, 0.0 kB/s 2023-10-09T11:37:43.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.942 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2473e-05 s, 0.0 kB/s 2023-10-09T11:37:43.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:43.998 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.053 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.053 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.053 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6491e-05 s, 0.0 kB/s 2023-10-09T11:37:44.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.054 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.110 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8075e-05 s, 0.0 kB/s 2023-10-09T11:37:44.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.111 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0799e-05 s, 0.0 kB/s 2023-10-09T11:37:44.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.168 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7962e-05 s, 0.0 kB/s 2023-10-09T11:37:44.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.225 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.189e-05 s, 0.0 kB/s 2023-10-09T11:37:44.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.282 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.337 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.338 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8369e-05 s, 0.0 kB/s 2023-10-09T11:37:44.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.338 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5916e-05 s, 0.0 kB/s 2023-10-09T11:37:44.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.461e-05 s, 0.0 kB/s 2023-10-09T11:37:44.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.452 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3349e-05 s, 0.0 kB/s 2023-10-09T11:37:44.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.509 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-09T11:37:44.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.565 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2829e-05 s, 0.0 kB/s 2023-10-09T11:37:44.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.622 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.677 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4599e-05 s, 0.0 kB/s 2023-10-09T11:37:44.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.678 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3519e-05 s, 0.0 kB/s 2023-10-09T11:37:44.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.734 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.791 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2141e-05 s, 0.0 kB/s 2023-10-09T11:37:44.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.791 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.846 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.846 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.846 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8123e-05 s, 0.0 kB/s 2023-10-09T11:37:44.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.847 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.596e-05 s, 0.0 kB/s 2023-10-09T11:37:44.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.904 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:44.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:44.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:44.959 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6963e-05 s, 0.0 kB/s 2023-10-09T11:37:44.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:44.960 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.016 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2776e-05 s, 0.0 kB/s 2023-10-09T11:37:45.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.016 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3887e-05 s, 0.0 kB/s 2023-10-09T11:37:45.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.072 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-09T11:37:45.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.129 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2472e-05 s, 0.0 kB/s 2023-10-09T11:37:45.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.186 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3175e-05 s, 0.0 kB/s 2023-10-09T11:37:45.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.242 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-09T11:37:45.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.299 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.354 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2429e-05 s, 0.0 kB/s 2023-10-09T11:37:45.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.355 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.410 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.410 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.410 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3777e-05 s, 0.0 kB/s 2023-10-09T11:37:45.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.411 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.466 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.466 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.467 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4592e-05 s, 0.0 kB/s 2023-10-09T11:37:45.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.467 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.946e-05 s, 0.0 kB/s 2023-10-09T11:37:45.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.523 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.578 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2704e-05 s, 0.0 kB/s 2023-10-09T11:37:45.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.579 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.396e-05 s, 0.0 kB/s 2023-10-09T11:37:45.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.635 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2878e-05 s, 0.0 kB/s 2023-10-09T11:37:45.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.691 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.746 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.746 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.747 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3964e-05 s, 0.0 kB/s 2023-10-09T11:37:45.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.747 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9812e-05 s, 0.0 kB/s 2023-10-09T11:37:45.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.803 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4787e-05 s, 0.0 kB/s 2023-10-09T11:37:45.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.860 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0162e-05 s, 0.0 kB/s 2023-10-09T11:37:45.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.916 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:45.973 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3634e-05 s, 0.0 kB/s 2023-10-09T11:37:45.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:45.974 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1079e-05 s, 0.0 kB/s 2023-10-09T11:37:46.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.029 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.085 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2922e-05 s, 0.0 kB/s 2023-10-09T11:37:46.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.086 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.141 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.374e-05 s, 0.0 kB/s 2023-10-09T11:37:46.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.142 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.198 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.198 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.198 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2981e-05 s, 0.0 kB/s 2023-10-09T11:37:46.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.199 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.254 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.254 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2272e-05 s, 0.0 kB/s 2023-10-09T11:37:46.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.255 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9162e-05 s, 0.0 kB/s 2023-10-09T11:37:46.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.312 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4758e-05 s, 0.0 kB/s 2023-10-09T11:37:46.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1876e-05 s, 0.0 kB/s 2023-10-09T11:37:46.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.424 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-09T11:37:46.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.536 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1935e-05 s, 0.0 kB/s 2023-10-09T11:37:46.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.537 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.592 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3712e-05 s, 0.0 kB/s 2023-10-09T11:37:46.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.593 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.650 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.650 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.650 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5012e-05 s, 0.0 kB/s 2023-10-09T11:37:46.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.650 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.706 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.706 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.707 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5376e-05 s, 0.0 kB/s 2023-10-09T11:37:46.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.707 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.762 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.762 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.762 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4086e-05 s, 0.0 kB/s 2023-10-09T11:37:46.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.763 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4735e-05 s, 0.0 kB/s 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.822 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0889e-05 s, 0.0 kB/s 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.877 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0309e-05 s, 0.0 kB/s 2023-10-09T11:37:46.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.935 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:46.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:46.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4799e-05 s, 0.0 kB/s 2023-10-09T11:37:46.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:46.992 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.049 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5107e-05 s, 0.0 kB/s 2023-10-09T11:37:47.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.050 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000105725 s, 0.0 kB/s 2023-10-09T11:37:47.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.107 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8002e-05 s, 0.0 kB/s 2023-10-09T11:37:47.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.164 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-09T11:37:47.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.222 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7572e-05 s, 0.0 kB/s 2023-10-09T11:37:47.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.280 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.336 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7022e-05 s, 0.0 kB/s 2023-10-09T11:37:47.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.337 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2702e-05 s, 0.0 kB/s 2023-10-09T11:37:47.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.451 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1879e-05 s, 0.0 kB/s 2023-10-09T11:37:47.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.452 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4487e-05 s, 0.0 kB/s 2023-10-09T11:37:47.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.509 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.567 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.567 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0479e-05 s, 0.0 kB/s 2023-10-09T11:37:47.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.623 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2513e-05 s, 0.0 kB/s 2023-10-09T11:37:47.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.624 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2669e-05 s, 0.0 kB/s 2023-10-09T11:37:47.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.680 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.737 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4771e-05 s, 0.0 kB/s 2023-10-09T11:37:47.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.738 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.794 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.794 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.794 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1435e-05 s, 0.0 kB/s 2023-10-09T11:37:47.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.795 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2482e-05 s, 0.0 kB/s 2023-10-09T11:37:47.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.851 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4956e-05 s, 0.0 kB/s 2023-10-09T11:37:47.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.908 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2402e-05 s, 0.0 kB/s 2023-10-09T11:37:47.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:47.965 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3492e-05 s, 0.0 kB/s 2023-10-09T11:37:48.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.021 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6542e-05 s, 0.0 kB/s 2023-10-09T11:37:48.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.077 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.134 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-09T11:37:48.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0119e-05 s, 0.0 kB/s 2023-10-09T11:37:48.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.190 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1899e-05 s, 0.0 kB/s 2023-10-09T11:37:48.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.247 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3502e-05 s, 0.0 kB/s 2023-10-09T11:37:48.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.303 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.359 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5265e-05 s, 0.0 kB/s 2023-10-09T11:37:48.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.360 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.415 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.416 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.416 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6152e-05 s, 0.0 kB/s 2023-10-09T11:37:48.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.417 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-09T11:37:48.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.529 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-09T11:37:48.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.8829e-05 s, 0.0 kB/s 2023-10-09T11:37:48.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.586 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2148e-05 s, 0.0 kB/s 2023-10-09T11:37:48.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.698 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.639e-05 s, 0.0 kB/s 2023-10-09T11:37:48.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2297e-05 s, 0.0 kB/s 2023-10-09T11:37:48.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.755 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2961e-05 s, 0.0 kB/s 2023-10-09T11:37:48.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.811 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6553e-05 s, 0.0 kB/s 2023-10-09T11:37:48.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.867 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.922 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.922 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1712e-05 s, 0.0 kB/s 2023-10-09T11:37:48.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.923 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4589e-05 s, 0.0 kB/s 2023-10-09T11:37:48.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:48.980 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.038 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2404e-05 s, 0.0 kB/s 2023-10-09T11:37:49.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.038 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.092 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.093 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1216e-05 s, 0.0 kB/s 2023-10-09T11:37:49.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.093 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.149 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4877e-05 s, 0.0 kB/s 2023-10-09T11:37:49.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.150 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.205 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7639e-05 s, 0.0 kB/s 2023-10-09T11:37:49.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.206 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7339e-05 s, 0.0 kB/s 2023-10-09T11:37:49.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.263 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4565e-05 s, 0.0 kB/s 2023-10-09T11:37:49.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.319 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.374 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.374 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.374 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-09T11:37:49.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.374 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6096e-05 s, 0.0 kB/s 2023-10-09T11:37:49.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5439e-05 s, 0.0 kB/s 2023-10-09T11:37:49.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.544 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.544 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1029e-05 s, 0.0 kB/s 2023-10-09T11:37:49.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.544 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1925e-05 s, 0.0 kB/s 2023-10-09T11:37:49.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.601 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.356e-05 s, 0.0 kB/s 2023-10-09T11:37:49.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.658 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-09T11:37:49.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4914e-05 s, 0.0 kB/s 2023-10-09T11:37:49.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7219e-05 s, 0.0 kB/s 2023-10-09T11:37:49.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.825 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.881 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3769e-05 s, 0.0 kB/s 2023-10-09T11:37:49.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.937 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2452e-05 s, 0.0 kB/s 2023-10-09T11:37:49.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.938 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:49.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:49.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:49.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1582e-05 s, 0.0 kB/s 2023-10-09T11:37:49.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:49.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-09T11:37:50.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.050 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7945e-05 s, 0.0 kB/s 2023-10-09T11:37:50.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.107 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0889e-05 s, 0.0 kB/s 2023-10-09T11:37:50.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.165 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.221 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.221 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2778e-05 s, 0.0 kB/s 2023-10-09T11:37:50.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.221 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.277 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4169e-05 s, 0.0 kB/s 2023-10-09T11:37:50.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.278 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.334 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000112875 s, 0.0 kB/s 2023-10-09T11:37:50.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.334 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2679e-05 s, 0.0 kB/s 2023-10-09T11:37:50.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.390 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.445 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.446 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4489e-05 s, 0.0 kB/s 2023-10-09T11:37:50.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.446 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2139e-05 s, 0.0 kB/s 2023-10-09T11:37:50.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.503 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.068e-05 s, 0.0 kB/s 2023-10-09T11:37:50.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.558 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7629e-05 s, 0.0 kB/s 2023-10-09T11:37:50.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.615 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9742e-05 s, 0.0 kB/s 2023-10-09T11:37:50.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.672 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1706e-05 s, 0.0 kB/s 2023-10-09T11:37:50.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.784 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6026e-05 s, 0.0 kB/s 2023-10-09T11:37:50.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.784 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.839 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-09T11:37:50.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.839 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.898 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7916e-05 s, 0.0 kB/s 2023-10-09T11:37:50.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2492e-05 s, 0.0 kB/s 2023-10-09T11:37:50.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:50.955 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0905e-05 s, 0.0 kB/s 2023-10-09T11:37:51.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0911e-05 s, 0.0 kB/s 2023-10-09T11:37:51.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.067 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.122 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.8903e-05 s, 0.0 kB/s 2023-10-09T11:37:51.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.122 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.178 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4681e-05 s, 0.0 kB/s 2023-10-09T11:37:51.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.178 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7199e-05 s, 0.0 kB/s 2023-10-09T11:37:51.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.235 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7985e-05 s, 0.0 kB/s 2023-10-09T11:37:51.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.292 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.44e-05 s, 0.0 kB/s 2023-10-09T11:37:51.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.404 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8325e-05 s, 0.0 kB/s 2023-10-09T11:37:51.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.405 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.460 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4563e-05 s, 0.0 kB/s 2023-10-09T11:37:51.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7336e-05 s, 0.0 kB/s 2023-10-09T11:37:51.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-09T11:37:51.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.574 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4206e-05 s, 0.0 kB/s 2023-10-09T11:37:51.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1203e-05 s, 0.0 kB/s 2023-10-09T11:37:51.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1074e-05 s, 0.0 kB/s 2023-10-09T11:37:51.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.743 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.799 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0755e-05 s, 0.0 kB/s 2023-10-09T11:37:51.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.800 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.856 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.4114e-05 s, 0.0 kB/s 2023-10-09T11:37:51.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.857 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8886e-05 s, 0.0 kB/s 2023-10-09T11:37:51.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.912 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:51.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:51.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:51.968 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0207e-05 s, 0.0 kB/s 2023-10-09T11:37:51.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:51.968 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3923e-05 s, 0.0 kB/s 2023-10-09T11:37:52.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4175e-05 s, 0.0 kB/s 2023-10-09T11:37:52.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.7484e-05 s, 0.0 kB/s 2023-10-09T11:37:52.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3515e-05 s, 0.0 kB/s 2023-10-09T11:37:52.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.192 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5295e-05 s, 0.0 kB/s 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.249 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1299e-05 s, 0.0 kB/s 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8958e-05 s, 0.0 kB/s 2023-10-09T11:37:52.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.361 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.417 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-09T11:37:52.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.417 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.473 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4482e-05 s, 0.0 kB/s 2023-10-09T11:37:52.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7692e-05 s, 0.0 kB/s 2023-10-09T11:37:52.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0862e-05 s, 0.0 kB/s 2023-10-09T11:37:52.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3052e-05 s, 0.0 kB/s 2023-10-09T11:37:52.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.644 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9697e-05 s, 0.0 kB/s 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6699e-05 s, 0.0 kB/s 2023-10-09T11:37:52.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.757 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4188e-05 s, 0.0 kB/s 2023-10-09T11:37:52.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.813 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1607e-05 s, 0.0 kB/s 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.869 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.461e-05 s, 0.0 kB/s 2023-10-09T11:37:52.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.925 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:52.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:52.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:52.981 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2787e-05 s, 0.0 kB/s 2023-10-09T11:37:52.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:52.981 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2121e-05 s, 0.0 kB/s 2023-10-09T11:37:53.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.037 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.093 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0199e-05 s, 0.0 kB/s 2023-10-09T11:37:53.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.093 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.149 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.113e-05 s, 0.0 kB/s 2023-10-09T11:37:53.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.150 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1917e-05 s, 0.0 kB/s 2023-10-09T11:37:53.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.206 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.261 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.261 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.261 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-09T11:37:53.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.262 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2232e-05 s, 0.0 kB/s 2023-10-09T11:37:53.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.318 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2142e-05 s, 0.0 kB/s 2023-10-09T11:37:53.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100345 s, 0.0 kB/s 2023-10-09T11:37:53.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.485 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-09T11:37:53.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.486 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0729e-05 s, 0.0 kB/s 2023-10-09T11:37:53.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.542 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3448e-05 s, 0.0 kB/s 2023-10-09T11:37:53.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7588e-05 s, 0.0 kB/s 2023-10-09T11:37:53.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3515e-05 s, 0.0 kB/s 2023-10-09T11:37:53.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.711 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-09T11:37:53.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.768 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5435e-05 s, 0.0 kB/s 2023-10-09T11:37:53.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.824 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2286e-05 s, 0.0 kB/s 2023-10-09T11:37:53.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2159e-05 s, 0.0 kB/s 2023-10-09T11:37:53.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:53.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:53.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:53.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6672e-05 s, 0.0 kB/s 2023-10-09T11:37:53.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.993 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3891e-05 s, 0.0 kB/s 2023-10-09T11:37:54.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.050 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.104 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.104 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.105 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2803e-05 s, 0.0 kB/s 2023-10-09T11:37:54.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.105 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.161 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-09T11:37:54.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.161 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.218 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3733e-05 s, 0.0 kB/s 2023-10-09T11:37:54.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4548e-05 s, 0.0 kB/s 2023-10-09T11:37:54.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.275 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5626e-05 s, 0.0 kB/s 2023-10-09T11:37:54.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.330 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.386 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.386 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.386 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2713e-05 s, 0.0 kB/s 2023-10-09T11:37:54.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.387 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-09T11:37:54.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3294e-05 s, 0.0 kB/s 2023-10-09T11:37:54.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0953e-05 s, 0.0 kB/s 2023-10-09T11:37:54.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.555 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.611 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2032e-05 s, 0.0 kB/s 2023-10-09T11:37:54.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.612 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.668 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.687e-05 s, 0.0 kB/s 2023-10-09T11:37:54.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.668 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.722 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3289e-05 s, 0.0 kB/s 2023-10-09T11:37:54.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.723 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-09T11:37:54.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.780 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6425e-05 s, 0.0 kB/s 2023-10-09T11:37:54.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.836 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4063e-05 s, 0.0 kB/s 2023-10-09T11:37:54.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.893 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:54.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0763e-05 s, 0.0 kB/s 2023-10-09T11:37:54.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:54.949 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4355e-05 s, 0.0 kB/s 2023-10-09T11:37:55.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.005 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9942e-05 s, 0.0 kB/s 2023-10-09T11:37:55.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.062 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.117 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.117 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4419e-05 s, 0.0 kB/s 2023-10-09T11:37:55.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.118 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1157e-05 s, 0.0 kB/s 2023-10-09T11:37:55.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3406e-05 s, 0.0 kB/s 2023-10-09T11:37:55.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.231 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4354e-05 s, 0.0 kB/s 2023-10-09T11:37:55.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.288 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:55.330 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4551e-05 s, 0.0 kB/s 2023-10-09T11:37:55.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.344 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2787e-05 s, 0.0 kB/s 2023-10-09T11:37:55.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.401 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.456 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101428 s, 0.0 kB/s 2023-10-09T11:37:55.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2641e-05 s, 0.0 kB/s 2023-10-09T11:37:55.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.513 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.568 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2426e-05 s, 0.0 kB/s 2023-10-09T11:37:55.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0475e-05 s, 0.0 kB/s 2023-10-09T11:37:55.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2212e-05 s, 0.0 kB/s 2023-10-09T11:37:55.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.682 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.738 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.739 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5225e-05 s, 0.0 kB/s 2023-10-09T11:37:55.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.739 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-09T11:37:55.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.796 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.851 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000108322 s, 0.0 kB/s 2023-10-09T11:37:55.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.852 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.908 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.205e-05 s, 0.0 kB/s 2023-10-09T11:37:55.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.909 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:55.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:55.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:55.964 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0927e-05 s, 0.0 kB/s 2023-10-09T11:37:55.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:55.965 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.020 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2011e-05 s, 0.0 kB/s 2023-10-09T11:37:56.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.021 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7426e-05 s, 0.0 kB/s 2023-10-09T11:37:56.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.078 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1846e-05 s, 0.0 kB/s 2023-10-09T11:37:56.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.134 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.189 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5905e-05 s, 0.0 kB/s 2023-10-09T11:37:56.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.190 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.246 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3352e-05 s, 0.0 kB/s 2023-10-09T11:37:56.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.246 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.303 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3928e-05 s, 0.0 kB/s 2023-10-09T11:37:56.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.303 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2569e-05 s, 0.0 kB/s 2023-10-09T11:37:56.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.359 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.7219e-05 s, 0.0 kB/s 2023-10-09T11:37:56.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.415 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.214e-05 s, 0.0 kB/s 2023-10-09T11:37:56.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.473 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2535e-05 s, 0.0 kB/s 2023-10-09T11:37:56.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.529 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-09T11:37:56.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.586 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.643 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0298e-05 s, 0.0 kB/s 2023-10-09T11:37:56.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9545e-05 s, 0.0 kB/s 2023-10-09T11:37:56.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.754 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.755 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2296e-05 s, 0.0 kB/s 2023-10-09T11:37:56.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.755 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.098e-05 s, 0.0 kB/s 2023-10-09T11:37:56.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.870 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2252e-05 s, 0.0 kB/s 2023-10-09T11:37:56.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2321e-05 s, 0.0 kB/s 2023-10-09T11:37:56.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.926 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.8511e-05 s, 0.0 kB/s 2023-10-09T11:37:56.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:56.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3748e-05 s, 0.0 kB/s 2023-10-09T11:37:57.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.039 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-09T11:37:57.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.096 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3609e-05 s, 0.0 kB/s 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3772e-05 s, 0.0 kB/s 2023-10-09T11:37:57.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.208 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.263 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.261e-05 s, 0.0 kB/s 2023-10-09T11:37:57.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.264 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7269e-05 s, 0.0 kB/s 2023-10-09T11:37:57.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.321 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5149e-05 s, 0.0 kB/s 2023-10-09T11:37:57.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.378 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2136e-05 s, 0.0 kB/s 2023-10-09T11:37:57.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.434 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5355e-05 s, 0.0 kB/s 2023-10-09T11:37:57.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.490 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3661e-05 s, 0.0 kB/s 2023-10-09T11:37:57.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.546 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5582e-05 s, 0.0 kB/s 2023-10-09T11:37:57.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0219e-05 s, 0.0 kB/s 2023-10-09T11:37:57.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5254e-05 s, 0.0 kB/s 2023-10-09T11:37:57.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.715 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4366e-05 s, 0.0 kB/s 2023-10-09T11:37:57.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.771 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9066e-05 s, 0.0 kB/s 2023-10-09T11:37:57.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.828 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.8094e-05 s, 0.0 kB/s 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.884 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-09T11:37:57.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0788e-05 s, 0.0 kB/s 2023-10-09T11:37:57.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:57.996 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6942e-05 s, 0.0 kB/s 2023-10-09T11:37:58.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.053 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-09T11:37:58.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.109 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9845e-05 s, 0.0 kB/s 2023-10-09T11:37:58.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.165 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7555e-05 s, 0.0 kB/s 2023-10-09T11:37:58.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.221 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.276 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.277 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4631e-05 s, 0.0 kB/s 2023-10-09T11:37:58.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.277 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2283e-05 s, 0.0 kB/s 2023-10-09T11:37:58.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.334 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.389 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.390 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0804e-05 s, 0.0 kB/s 2023-10-09T11:37:58.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.390 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106916 s, 0.0 kB/s 2023-10-09T11:37:58.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.447 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.504 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.8198e-05 s, 0.0 kB/s 2023-10-09T11:37:58.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.504 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3439e-05 s, 0.0 kB/s 2023-10-09T11:37:58.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.561 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1607e-05 s, 0.0 kB/s 2023-10-09T11:37:58.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.673 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3881e-05 s, 0.0 kB/s 2023-10-09T11:37:58.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.730 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5618e-05 s, 0.0 kB/s 2023-10-09T11:37:58.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.731 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.787 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1319e-05 s, 0.0 kB/s 2023-10-09T11:37:58.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.788 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.844 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-09T11:37:58.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.844 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.900 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-09T11:37:58.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:58.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:58.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:58.956 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.134e-05 s, 0.0 kB/s 2023-10-09T11:37:58.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:58.957 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.011 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3626e-05 s, 0.0 kB/s 2023-10-09T11:37:59.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.012 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.068 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6269e-05 s, 0.0 kB/s 2023-10-09T11:37:59.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.125 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5626e-05 s, 0.0 kB/s 2023-10-09T11:37:59.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8246e-05 s, 0.0 kB/s 2023-10-09T11:37:59.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-09T11:37:59.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.238 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T11:37:59.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.295 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8973e-05 s, 0.0 kB/s 2023-10-09T11:37:59.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.407 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1537e-05 s, 0.0 kB/s 2023-10-09T11:37:59.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.408 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.506 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.506 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4009e-05 s, 0.0 kB/s 2023-10-09T11:37:59.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.507 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7979e-05 s, 0.0 kB/s 2023-10-09T11:37:59.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.525 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4004e-05 s, 0.0 kB/s 2023-10-09T11:37:59.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.583 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1282e-05 s, 0.0 kB/s 2023-10-09T11:37:59.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.641 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.697 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8125e-05 s, 0.0 kB/s 2023-10-09T11:37:59.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.698 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.755 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0364e-05 s, 0.0 kB/s 2023-10-09T11:37:59.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.756 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2638e-05 s, 0.0 kB/s 2023-10-09T11:37:59.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.812 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.867 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8475e-05 s, 0.0 kB/s 2023-10-09T11:37:59.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.867 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.924 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1582e-05 s, 0.0 kB/s 2023-10-09T11:37:59.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.924 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:59.978 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:37:59.978 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:37:59.978 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5636e-05 s, 0.0 kB/s 2023-10-09T11:37:59.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:59.979 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.035 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.035 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.035 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2075e-05 s, 0.0 kB/s 2023-10-09T11:38:00.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.035 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.091 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.091 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0909e-05 s, 0.0 kB/s 2023-10-09T11:38:00.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.092 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.148 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4503e-05 s, 0.0 kB/s 2023-10-09T11:38:00.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.148 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.801e-05 s, 0.0 kB/s 2023-10-09T11:38:00.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.205 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.260 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2812e-05 s, 0.0 kB/s 2023-10-09T11:38:00.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.260 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-09T11:38:00.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.316 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7398e-05 s, 0.0 kB/s 2023-10-09T11:38:00.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.428 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0795e-05 s, 0.0 kB/s 2023-10-09T11:38:00.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.428 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9979e-05 s, 0.0 kB/s 2023-10-09T11:38:00.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.540 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1402e-05 s, 0.0 kB/s 2023-10-09T11:38:00.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.541 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.596 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.596 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.596 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1802e-05 s, 0.0 kB/s 2023-10-09T11:38:00.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.596 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3153e-05 s, 0.0 kB/s 2023-10-09T11:38:00.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.653 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1069e-05 s, 0.0 kB/s 2023-10-09T11:38:00.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.708 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102033 s, 0.0 kB/s 2023-10-09T11:38:00.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.764 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.819 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3573e-05 s, 0.0 kB/s 2023-10-09T11:38:00.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.819 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1747e-05 s, 0.0 kB/s 2023-10-09T11:38:00.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.875 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.932 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7849e-05 s, 0.0 kB/s 2023-10-09T11:38:00.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.932 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:00.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:00.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:00.988 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3712e-05 s, 0.0 kB/s 2023-10-09T11:38:00.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:00.988 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.044 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5566e-05 s, 0.0 kB/s 2023-10-09T11:38:01.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.045 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3014e-05 s, 0.0 kB/s 2023-10-09T11:38:01.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4082e-05 s, 0.0 kB/s 2023-10-09T11:38:01.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.157 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6019e-05 s, 0.0 kB/s 2023-10-09T11:38:01.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.213 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1762e-05 s, 0.0 kB/s 2023-10-09T11:38:01.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.269 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4833e-05 s, 0.0 kB/s 2023-10-09T11:38:01.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.325 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.380 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.380 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.381 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-09T11:38:01.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.381 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.436 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.436 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.436 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0859e-05 s, 0.0 kB/s 2023-10-09T11:38:01.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.437 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2092e-05 s, 0.0 kB/s 2023-10-09T11:38:01.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.493 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.549 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.549 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.549 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-09T11:38:01.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.549 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.605 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1012e-05 s, 0.0 kB/s 2023-10-09T11:38:01.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.605 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.661 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.661 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.661 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6932e-05 s, 0.0 kB/s 2023-10-09T11:38:01.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.661 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.717 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.717 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.717 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1047e-05 s, 0.0 kB/s 2023-10-09T11:38:01.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.718 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.773 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.774 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1568e-05 s, 0.0 kB/s 2023-10-09T11:38:01.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.774 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6902e-05 s, 0.0 kB/s 2023-10-09T11:38:01.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.831 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.148e-05 s, 0.0 kB/s 2023-10-09T11:38:01.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.887 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.942 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3659e-05 s, 0.0 kB/s 2023-10-09T11:38:01.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.943 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:01.999 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:01.999 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:01.999 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3395e-05 s, 0.0 kB/s 2023-10-09T11:38:01.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:01.999 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3777e-05 s, 0.0 kB/s 2023-10-09T11:38:02.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.056 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.52e-05 s, 0.0 kB/s 2023-10-09T11:38:02.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.111 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4274e-05 s, 0.0 kB/s 2023-10-09T11:38:02.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.167 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8605e-05 s, 0.0 kB/s 2023-10-09T11:38:02.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.224 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5103e-05 s, 0.0 kB/s 2023-10-09T11:38:02.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.280 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.8149e-05 s, 0.0 kB/s 2023-10-09T11:38:02.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.336 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.392 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4024e-05 s, 0.0 kB/s 2023-10-09T11:38:02.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.392 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.377e-05 s, 0.0 kB/s 2023-10-09T11:38:02.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.449 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.504 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104957 s, 0.0 kB/s 2023-10-09T11:38:02.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.505 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1375e-05 s, 0.0 kB/s 2023-10-09T11:38:02.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.561 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.617 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4198e-05 s, 0.0 kB/s 2023-10-09T11:38:02.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.618 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7595e-05 s, 0.0 kB/s 2023-10-09T11:38:02.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0142e-05 s, 0.0 kB/s 2023-10-09T11:38:02.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.731 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.787 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2966e-05 s, 0.0 kB/s 2023-10-09T11:38:02.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.787 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1904e-05 s, 0.0 kB/s 2023-10-09T11:38:02.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.843 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-09T11:38:02.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.899 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:02.955 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6385e-05 s, 0.0 kB/s 2023-10-09T11:38:02.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:02.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.011 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0302e-05 s, 0.0 kB/s 2023-10-09T11:38:03.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.011 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.067 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3381e-05 s, 0.0 kB/s 2023-10-09T11:38:03.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.067 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.123 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5122e-05 s, 0.0 kB/s 2023-10-09T11:38:03.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.124 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9879e-05 s, 0.0 kB/s 2023-10-09T11:38:03.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3067e-05 s, 0.0 kB/s 2023-10-09T11:38:03.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.292 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.292 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.292 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7978e-05 s, 0.0 kB/s 2023-10-09T11:38:03.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.293 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.348 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.348 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.348 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1743e-05 s, 0.0 kB/s 2023-10-09T11:38:03.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.349 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.404 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-09T11:38:03.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.405 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8306e-05 s, 0.0 kB/s 2023-10-09T11:38:03.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.517 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3197e-05 s, 0.0 kB/s 2023-10-09T11:38:03.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.517 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.573 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7452e-05 s, 0.0 kB/s 2023-10-09T11:38:03.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.574 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.0207e-05 s, 0.0 kB/s 2023-10-09T11:38:03.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.630 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4668e-05 s, 0.0 kB/s 2023-10-09T11:38:03.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.686 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2262e-05 s, 0.0 kB/s 2023-10-09T11:38:03.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.742 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4541e-05 s, 0.0 kB/s 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.799 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3952e-05 s, 0.0 kB/s 2023-10-09T11:38:03.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.910 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2635e-05 s, 0.0 kB/s 2023-10-09T11:38:03.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.910 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:03.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:03.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:03.966 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4394e-05 s, 0.0 kB/s 2023-10-09T11:38:03.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:03.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5353e-05 s, 0.0 kB/s 2023-10-09T11:38:04.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.078 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6209e-05 s, 0.0 kB/s 2023-10-09T11:38:04.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.079 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4017e-05 s, 0.0 kB/s 2023-10-09T11:38:04.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.591e-05 s, 0.0 kB/s 2023-10-09T11:38:04.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2482e-05 s, 0.0 kB/s 2023-10-09T11:38:04.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1579e-05 s, 0.0 kB/s 2023-10-09T11:38:04.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.306 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5192e-05 s, 0.0 kB/s 2023-10-09T11:38:04.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.363 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3052e-05 s, 0.0 kB/s 2023-10-09T11:38:04.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.420 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1828e-05 s, 0.0 kB/s 2023-10-09T11:38:04.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.532 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7789e-05 s, 0.0 kB/s 2023-10-09T11:38:04.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3396e-05 s, 0.0 kB/s 2023-10-09T11:38:04.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.594 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-09T11:38:04.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1889e-05 s, 0.0 kB/s 2023-10-09T11:38:04.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0933e-05 s, 0.0 kB/s 2023-10-09T11:38:04.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.779 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2338e-05 s, 0.0 kB/s 2023-10-09T11:38:04.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.841 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2281e-05 s, 0.0 kB/s 2023-10-09T11:38:04.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4018e-05 s, 0.0 kB/s 2023-10-09T11:38:04.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:04.962 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3707e-05 s, 0.0 kB/s 2023-10-09T11:38:05.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1421e-05 s, 0.0 kB/s 2023-10-09T11:38:05.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2704e-05 s, 0.0 kB/s 2023-10-09T11:38:05.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.140 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.196 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.196 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7909e-05 s, 0.0 kB/s 2023-10-09T11:38:05.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.256 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9885e-05 s, 0.0 kB/s 2023-10-09T11:38:05.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.256 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.314 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0762e-05 s, 0.0 kB/s 2023-10-09T11:38:05.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.314 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9962e-05 s, 0.0 kB/s 2023-10-09T11:38:05.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.372 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.429 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0974e-05 s, 0.0 kB/s 2023-10-09T11:38:05.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.236e-05 s, 0.0 kB/s 2023-10-09T11:38:05.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.486 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.019e-05 s, 0.0 kB/s 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.543 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.600 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2822e-05 s, 0.0 kB/s 2023-10-09T11:38:05.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.600 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.656 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.656 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-09T11:38:05.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5047e-05 s, 0.0 kB/s 2023-10-09T11:38:05.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.770 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1749e-05 s, 0.0 kB/s 2023-10-09T11:38:05.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.771 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.829 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2845e-05 s, 0.0 kB/s 2023-10-09T11:38:05.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.830 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.9603e-05 s, 0.0 kB/s 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.887 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3461e-05 s, 0.0 kB/s 2023-10-09T11:38:05.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:05.944 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:05.999 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.000 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3593e-05 s, 0.0 kB/s 2023-10-09T11:38:06.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.000 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9782e-05 s, 0.0 kB/s 2023-10-09T11:38:06.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.058 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.114 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4915e-05 s, 0.0 kB/s 2023-10-09T11:38:06.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1596e-05 s, 0.0 kB/s 2023-10-09T11:38:06.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.170 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.229 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.230 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5809e-05 s, 0.0 kB/s 2023-10-09T11:38:06.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.230 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5396e-05 s, 0.0 kB/s 2023-10-09T11:38:06.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.288 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.345 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.345 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104916 s, 0.0 kB/s 2023-10-09T11:38:06.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.345 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.401 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6766e-05 s, 0.0 kB/s 2023-10-09T11:38:06.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.402 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.457 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.457 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.457 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-09T11:38:06.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.513 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2299e-05 s, 0.0 kB/s 2023-10-09T11:38:06.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.514 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.569 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.5004e-05 s, 0.0 kB/s 2023-10-09T11:38:06.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.570 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.625 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2533e-05 s, 0.0 kB/s 2023-10-09T11:38:06.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.626 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.681 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.681 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.681 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-09T11:38:06.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.682 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2772e-05 s, 0.0 kB/s 2023-10-09T11:38:06.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.738 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5669e-05 s, 0.0 kB/s 2023-10-09T11:38:06.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.794 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101344 s, 0.0 kB/s 2023-10-09T11:38:06.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.851 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.907 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.908 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4199e-05 s, 0.0 kB/s 2023-10-09T11:38:06.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.908 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:06.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:06.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:06.965 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-09T11:38:06.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:06.965 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.020 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4204e-05 s, 0.0 kB/s 2023-10-09T11:38:07.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.021 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4767e-05 s, 0.0 kB/s 2023-10-09T11:38:07.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.077 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4197e-05 s, 0.0 kB/s 2023-10-09T11:38:07.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.138 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4751e-05 s, 0.0 kB/s 2023-10-09T11:38:07.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.196 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.254 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.254 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.254 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1195e-05 s, 0.0 kB/s 2023-10-09T11:38:07.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.255 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.311 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4726e-05 s, 0.0 kB/s 2023-10-09T11:38:07.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.311 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1739e-05 s, 0.0 kB/s 2023-10-09T11:38:07.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8026e-05 s, 0.0 kB/s 2023-10-09T11:38:07.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.574e-05 s, 0.0 kB/s 2023-10-09T11:38:07.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.479 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-09T11:38:07.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.590 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2414e-05 s, 0.0 kB/s 2023-10-09T11:38:07.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.590 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6904e-05 s, 0.0 kB/s 2023-10-09T11:38:07.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.647 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1824e-05 s, 0.0 kB/s 2023-10-09T11:38:07.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.161e-05 s, 0.0 kB/s 2023-10-09T11:38:07.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.759 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1098e-05 s, 0.0 kB/s 2023-10-09T11:38:07.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2547e-05 s, 0.0 kB/s 2023-10-09T11:38:07.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.872 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T11:38:07.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.929 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3307e-05 s, 0.0 kB/s 2023-10-09T11:38:07.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:07.984 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.040 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2505e-05 s, 0.0 kB/s 2023-10-09T11:38:08.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.040 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.096 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.096 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1961e-05 s, 0.0 kB/s 2023-10-09T11:38:08.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.096 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.152 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.152 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.152 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.392e-05 s, 0.0 kB/s 2023-10-09T11:38:08.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.153 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1797e-05 s, 0.0 kB/s 2023-10-09T11:38:08.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.208 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3359e-05 s, 0.0 kB/s 2023-10-09T11:38:08.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.265 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-09T11:38:08.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.320 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.376 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0817e-05 s, 0.0 kB/s 2023-10-09T11:38:08.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.376 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.432 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.432 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.432 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0939e-05 s, 0.0 kB/s 2023-10-09T11:38:08.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.432 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3526e-05 s, 0.0 kB/s 2023-10-09T11:38:08.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.488 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.544 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.544 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.544 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.00010899 s, 0.0 kB/s 2023-10-09T11:38:08.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.545 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.600 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.600 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.600 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6512e-05 s, 0.0 kB/s 2023-10-09T11:38:08.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.601 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.656 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.656 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.656 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0927e-05 s, 0.0 kB/s 2023-10-09T11:38:08.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.657 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-09T11:38:08.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.714 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1781e-05 s, 0.0 kB/s 2023-10-09T11:38:08.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2625e-05 s, 0.0 kB/s 2023-10-09T11:38:08.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.826 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-09T11:38:08.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.938 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3195e-05 s, 0.0 kB/s 2023-10-09T11:38:08.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.938 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7034e-05 s, 0.0 kB/s 2023-10-09T11:38:08.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:08.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6198e-05 s, 0.0 kB/s 2023-10-09T11:38:09.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.049 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3434e-05 s, 0.0 kB/s 2023-10-09T11:38:09.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.106 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1871e-05 s, 0.0 kB/s 2023-10-09T11:38:09.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.161 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2719e-05 s, 0.0 kB/s 2023-10-09T11:38:09.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.218 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2895e-05 s, 0.0 kB/s 2023-10-09T11:38:09.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.274 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.329 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4519e-05 s, 0.0 kB/s 2023-10-09T11:38:09.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.330 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2411e-05 s, 0.0 kB/s 2023-10-09T11:38:09.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.386 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4872e-05 s, 0.0 kB/s 2023-10-09T11:38:09.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.498 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6812e-05 s, 0.0 kB/s 2023-10-09T11:38:09.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.499 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.555 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4505e-05 s, 0.0 kB/s 2023-10-09T11:38:09.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.555 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.611 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2915e-05 s, 0.0 kB/s 2023-10-09T11:38:09.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.612 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.668 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1552e-05 s, 0.0 kB/s 2023-10-09T11:38:09.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.668 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.724 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.724 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2902e-05 s, 0.0 kB/s 2023-10-09T11:38:09.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.725 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.782 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-09T11:38:09.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.838 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T11:38:09.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.838 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.894 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.894 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6499e-05 s, 0.0 kB/s 2023-10-09T11:38:09.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.894 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-09T11:38:09.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:09.951 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3501e-05 s, 0.0 kB/s 2023-10-09T11:38:10.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3679e-05 s, 0.0 kB/s 2023-10-09T11:38:10.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.064 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.119 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.119 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6358e-05 s, 0.0 kB/s 2023-10-09T11:38:10.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.120 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-09T11:38:10.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9205e-05 s, 0.0 kB/s 2023-10-09T11:38:10.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.233 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.289 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.289 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.289 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4936e-05 s, 0.0 kB/s 2023-10-09T11:38:10.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.290 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.345 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.345 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.345 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1979e-05 s, 0.0 kB/s 2023-10-09T11:38:10.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.346 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1272e-05 s, 0.0 kB/s 2023-10-09T11:38:10.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.401 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0857e-05 s, 0.0 kB/s 2023-10-09T11:38:10.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-09T11:38:10.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.513 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.570 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8019e-05 s, 0.0 kB/s 2023-10-09T11:38:10.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.570 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8989e-05 s, 0.0 kB/s 2023-10-09T11:38:10.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.627 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3963e-05 s, 0.0 kB/s 2023-10-09T11:38:10.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.684 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6719e-05 s, 0.0 kB/s 2023-10-09T11:38:10.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.742 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2589e-05 s, 0.0 kB/s 2023-10-09T11:38:10.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4129e-05 s, 0.0 kB/s 2023-10-09T11:38:10.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-09T11:38:10.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.909 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:10.965 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:10.965 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:10.966 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3362e-05 s, 0.0 kB/s 2023-10-09T11:38:10.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:10.966 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.021 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1732e-05 s, 0.0 kB/s 2023-10-09T11:38:11.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.022 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1462e-05 s, 0.0 kB/s 2023-10-09T11:38:11.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.078 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.133 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5462e-05 s, 0.0 kB/s 2023-10-09T11:38:11.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.134 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.7363e-05 s, 0.0 kB/s 2023-10-09T11:38:11.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.190 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3523e-05 s, 0.0 kB/s 2023-10-09T11:38:11.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.247 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4708e-05 s, 0.0 kB/s 2023-10-09T11:38:11.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.303 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.358 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3965e-05 s, 0.0 kB/s 2023-10-09T11:38:11.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.359 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6329e-05 s, 0.0 kB/s 2023-10-09T11:38:11.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.415 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.471 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5173e-05 s, 0.0 kB/s 2023-10-09T11:38:11.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.472 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4118e-05 s, 0.0 kB/s 2023-10-09T11:38:11.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.527 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1898e-05 s, 0.0 kB/s 2023-10-09T11:38:11.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.584 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.639 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.639 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.639 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5222e-05 s, 0.0 kB/s 2023-10-09T11:38:11.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.640 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.694 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.695 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T11:38:11.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.696 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6526e-05 s, 0.0 kB/s 2023-10-09T11:38:11.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.752 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5325e-05 s, 0.0 kB/s 2023-10-09T11:38:11.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.808 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1977e-05 s, 0.0 kB/s 2023-10-09T11:38:11.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.865 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.920 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.920 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.920 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4329e-05 s, 0.0 kB/s 2023-10-09T11:38:11.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.921 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2957e-05 s, 0.0 kB/s 2023-10-09T11:38:11.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:11.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2428e-05 s, 0.0 kB/s 2023-10-09T11:38:12.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.034 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.090 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7173e-05 s, 0.0 kB/s 2023-10-09T11:38:12.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.090 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3058e-05 s, 0.0 kB/s 2023-10-09T11:38:12.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.146 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5895e-05 s, 0.0 kB/s 2023-10-09T11:38:12.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.203 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.259 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5768e-05 s, 0.0 kB/s 2023-10-09T11:38:12.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.259 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.315 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9759e-05 s, 0.0 kB/s 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.316 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6696e-05 s, 0.0 kB/s 2023-10-09T11:38:12.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.430 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7332e-05 s, 0.0 kB/s 2023-10-09T11:38:12.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0656e-05 s, 0.0 kB/s 2023-10-09T11:38:12.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4683e-05 s, 0.0 kB/s 2023-10-09T11:38:12.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.544 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.599 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-09T11:38:12.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.600 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3447e-05 s, 0.0 kB/s 2023-10-09T11:38:12.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7335e-05 s, 0.0 kB/s 2023-10-09T11:38:12.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3349e-05 s, 0.0 kB/s 2023-10-09T11:38:12.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.826 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102906 s, 0.0 kB/s 2023-10-09T11:38:12.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.826 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2006e-05 s, 0.0 kB/s 2023-10-09T11:38:12.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.883 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.938 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100182 s, 0.0 kB/s 2023-10-09T11:38:12.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.939 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:12.996 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:12.996 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:12.996 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-09T11:38:12.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:12.997 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.396e-05 s, 0.0 kB/s 2023-10-09T11:38:13.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.052 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.108 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9189e-05 s, 0.0 kB/s 2023-10-09T11:38:13.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.109 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4628e-05 s, 0.0 kB/s 2023-10-09T11:38:13.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.164 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.220 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1236e-05 s, 0.0 kB/s 2023-10-09T11:38:13.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.221 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.278 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6343e-05 s, 0.0 kB/s 2023-10-09T11:38:13.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.278 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.334 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1368e-05 s, 0.0 kB/s 2023-10-09T11:38:13.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.335 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4707e-05 s, 0.0 kB/s 2023-10-09T11:38:13.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.392 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1979e-05 s, 0.0 kB/s 2023-10-09T11:38:13.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.448 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.504 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2736e-05 s, 0.0 kB/s 2023-10-09T11:38:13.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.504 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.560 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.438e-05 s, 0.0 kB/s 2023-10-09T11:38:13.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.561 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4621e-05 s, 0.0 kB/s 2023-10-09T11:38:13.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.616 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.672 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8488e-05 s, 0.0 kB/s 2023-10-09T11:38:13.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.672 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6169e-05 s, 0.0 kB/s 2023-10-09T11:38:13.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.729 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-09T11:38:13.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.785 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0636e-05 s, 0.0 kB/s 2023-10-09T11:38:13.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.842 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.898 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4655e-05 s, 0.0 kB/s 2023-10-09T11:38:13.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:13.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:13.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:13.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4155e-05 s, 0.0 kB/s 2023-10-09T11:38:13.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:13.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6376e-05 s, 0.0 kB/s 2023-10-09T11:38:14.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.012 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9369e-05 s, 0.0 kB/s 2023-10-09T11:38:14.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5198e-05 s, 0.0 kB/s 2023-10-09T11:38:14.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.124 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2143e-05 s, 0.0 kB/s 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.180 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.235 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.235 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.235 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8006e-05 s, 0.0 kB/s 2023-10-09T11:38:14.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.235 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.484e-05 s, 0.0 kB/s 2023-10-09T11:38:14.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.292 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4388e-05 s, 0.0 kB/s 2023-10-09T11:38:14.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.402 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.403 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.361e-05 s, 0.0 kB/s 2023-10-09T11:38:14.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.403 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.459 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6549e-05 s, 0.0 kB/s 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.460 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6412e-05 s, 0.0 kB/s 2023-10-09T11:38:14.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.516 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.572 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.572 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.572 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3801e-05 s, 0.0 kB/s 2023-10-09T11:38:14.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.573 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.629 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2697e-05 s, 0.0 kB/s 2023-10-09T11:38:14.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.629 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.684 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5769e-05 s, 0.0 kB/s 2023-10-09T11:38:14.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.685 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-09T11:38:14.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.741 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.426e-05 s, 0.0 kB/s 2023-10-09T11:38:14.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.854 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2622e-05 s, 0.0 kB/s 2023-10-09T11:38:14.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.855 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3664e-05 s, 0.0 kB/s 2023-10-09T11:38:14.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.911 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7286e-05 s, 0.0 kB/s 2023-10-09T11:38:14.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:14.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2092e-05 s, 0.0 kB/s 2023-10-09T11:38:15.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.079 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8801e-05 s, 0.0 kB/s 2023-10-09T11:38:15.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7282e-05 s, 0.0 kB/s 2023-10-09T11:38:15.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.191 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.191 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4423e-05 s, 0.0 kB/s 2023-10-09T11:38:15.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2528e-05 s, 0.0 kB/s 2023-10-09T11:38:15.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1739e-05 s, 0.0 kB/s 2023-10-09T11:38:15.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.306 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3448e-05 s, 0.0 kB/s 2023-10-09T11:38:15.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3461e-05 s, 0.0 kB/s 2023-10-09T11:38:15.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3351e-05 s, 0.0 kB/s 2023-10-09T11:38:15.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.475 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.530 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0702e-05 s, 0.0 kB/s 2023-10-09T11:38:15.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.531 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-09T11:38:15.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.642 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0772e-05 s, 0.0 kB/s 2023-10-09T11:38:15.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.700 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.700 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0842e-05 s, 0.0 kB/s 2023-10-09T11:38:15.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.701 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.757 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4823e-05 s, 0.0 kB/s 2023-10-09T11:38:15.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.757 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.814 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4111e-05 s, 0.0 kB/s 2023-10-09T11:38:15.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6136e-05 s, 0.0 kB/s 2023-10-09T11:38:15.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.927 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4126e-05 s, 0.0 kB/s 2023-10-09T11:38:15.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.928 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:15.984 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7535e-05 s, 0.0 kB/s 2023-10-09T11:38:15.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:15.984 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.041 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1104e-05 s, 0.0 kB/s 2023-10-09T11:38:16.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.9594e-05 s, 0.0 kB/s 2023-10-09T11:38:16.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.100 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.156 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7152e-05 s, 0.0 kB/s 2023-10-09T11:38:16.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.156 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4383e-05 s, 0.0 kB/s 2023-10-09T11:38:16.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.214 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1689e-05 s, 0.0 kB/s 2023-10-09T11:38:16.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8399e-05 s, 0.0 kB/s 2023-10-09T11:38:16.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2066e-05 s, 0.0 kB/s 2023-10-09T11:38:16.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4768e-05 s, 0.0 kB/s 2023-10-09T11:38:16.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.499 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.499 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6152e-05 s, 0.0 kB/s 2023-10-09T11:38:16.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.500 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.556 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.556 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.556 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9386e-05 s, 0.0 kB/s 2023-10-09T11:38:16.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.557 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.613 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.614 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.614 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5036e-05 s, 0.0 kB/s 2023-10-09T11:38:16.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.615 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.670 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2834e-05 s, 0.0 kB/s 2023-10-09T11:38:16.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.671 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.727 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1555e-05 s, 0.0 kB/s 2023-10-09T11:38:16.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.784 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5863e-05 s, 0.0 kB/s 2023-10-09T11:38:16.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.785 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2506e-05 s, 0.0 kB/s 2023-10-09T11:38:16.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.841 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.896 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.896 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.896 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8877e-05 s, 0.0 kB/s 2023-10-09T11:38:16.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.897 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6809e-05 s, 0.0 kB/s 2023-10-09T11:38:16.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:16.953 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3601e-05 s, 0.0 kB/s 2023-10-09T11:38:17.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3076e-05 s, 0.0 kB/s 2023-10-09T11:38:17.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.065 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4874e-05 s, 0.0 kB/s 2023-10-09T11:38:17.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.121 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.176 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5969e-05 s, 0.0 kB/s 2023-10-09T11:38:17.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.176 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.232 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6986e-05 s, 0.0 kB/s 2023-10-09T11:38:17.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.232 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3063e-05 s, 0.0 kB/s 2023-10-09T11:38:17.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.289 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3752e-05 s, 0.0 kB/s 2023-10-09T11:38:17.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.344 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.400 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4564e-05 s, 0.0 kB/s 2023-10-09T11:38:17.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.400 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.456 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6842e-05 s, 0.0 kB/s 2023-10-09T11:38:17.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.513 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2656e-05 s, 0.0 kB/s 2023-10-09T11:38:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.514 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.570 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2652e-05 s, 0.0 kB/s 2023-10-09T11:38:17.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.571 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.626 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-09T11:38:17.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.627 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.683 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7021e-05 s, 0.0 kB/s 2023-10-09T11:38:17.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.683 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-09T11:38:17.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6045e-05 s, 0.0 kB/s 2023-10-09T11:38:17.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.854 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6419e-05 s, 0.0 kB/s 2023-10-09T11:38:17.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.2936e-05 s, 0.0 kB/s 2023-10-09T11:38:17.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.911 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1154e-05 s, 0.0 kB/s 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:17.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4134e-05 s, 0.0 kB/s 2023-10-09T11:38:18.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1518e-05 s, 0.0 kB/s 2023-10-09T11:38:18.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.079 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.136 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2224e-05 s, 0.0 kB/s 2023-10-09T11:38:18.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6682e-05 s, 0.0 kB/s 2023-10-09T11:38:18.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3266e-05 s, 0.0 kB/s 2023-10-09T11:38:18.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7419e-05 s, 0.0 kB/s 2023-10-09T11:38:18.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4482e-05 s, 0.0 kB/s 2023-10-09T11:38:18.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1535e-05 s, 0.0 kB/s 2023-10-09T11:38:18.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4836e-05 s, 0.0 kB/s 2023-10-09T11:38:18.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7425e-05 s, 0.0 kB/s 2023-10-09T11:38:18.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3188e-05 s, 0.0 kB/s 2023-10-09T11:38:18.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-09T11:38:18.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.645 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.701 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1362e-05 s, 0.0 kB/s 2023-10-09T11:38:18.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.702 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2485e-05 s, 0.0 kB/s 2023-10-09T11:38:18.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.759 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.816 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2248e-05 s, 0.0 kB/s 2023-10-09T11:38:18.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.873 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2066e-05 s, 0.0 kB/s 2023-10-09T11:38:18.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.873 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.246e-05 s, 0.0 kB/s 2023-10-09T11:38:18.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.930 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:18.986 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0961e-05 s, 0.0 kB/s 2023-10-09T11:38:18.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:18.986 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7742e-05 s, 0.0 kB/s 2023-10-09T11:38:19.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.043 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1691e-05 s, 0.0 kB/s 2023-10-09T11:38:19.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1383e-05 s, 0.0 kB/s 2023-10-09T11:38:19.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.157 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5286e-05 s, 0.0 kB/s 2023-10-09T11:38:19.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.214 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.33e-05 s, 0.0 kB/s 2023-10-09T11:38:19.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.293e-05 s, 0.0 kB/s 2023-10-09T11:38:19.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3008e-05 s, 0.0 kB/s 2023-10-09T11:38:19.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.439 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2729e-05 s, 0.0 kB/s 2023-10-09T11:38:19.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.439 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0158e-05 s, 0.0 kB/s 2023-10-09T11:38:19.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.496 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.551 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.28e-05 s, 0.0 kB/s 2023-10-09T11:38:19.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8025e-05 s, 0.0 kB/s 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.607 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0977e-05 s, 0.0 kB/s 2023-10-09T11:38:19.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.663 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.719 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-09T11:38:19.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.719 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.775 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2982e-05 s, 0.0 kB/s 2023-10-09T11:38:19.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8561e-05 s, 0.0 kB/s 2023-10-09T11:38:19.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.832 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.888 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3821e-05 s, 0.0 kB/s 2023-10-09T11:38:19.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.889 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3862e-05 s, 0.0 kB/s 2023-10-09T11:38:19.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:19.945 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.001 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2822e-05 s, 0.0 kB/s 2023-10-09T11:38:20.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.001 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0432e-05 s, 0.0 kB/s 2023-10-09T11:38:20.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.057 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.113 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2137e-05 s, 0.0 kB/s 2023-10-09T11:38:20.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3114e-05 s, 0.0 kB/s 2023-10-09T11:38:20.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.170 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-09T11:38:20.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.283 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5334e-05 s, 0.0 kB/s 2023-10-09T11:38:20.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.284 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8239e-05 s, 0.0 kB/s 2023-10-09T11:38:20.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.340 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.396 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9399e-05 s, 0.0 kB/s 2023-10-09T11:38:20.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.397 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.452 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.452 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2755e-05 s, 0.0 kB/s 2023-10-09T11:38:20.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.453 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1118e-05 s, 0.0 kB/s 2023-10-09T11:38:20.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.509 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2171e-05 s, 0.0 kB/s 2023-10-09T11:38:20.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.565 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5983e-05 s, 0.0 kB/s 2023-10-09T11:38:20.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.621 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6395e-05 s, 0.0 kB/s 2023-10-09T11:38:20.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.678 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4016e-05 s, 0.0 kB/s 2023-10-09T11:38:20.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.733 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.789 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.789 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.789 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8176e-05 s, 0.0 kB/s 2023-10-09T11:38:20.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.790 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.845 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.845 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.845 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3707e-05 s, 0.0 kB/s 2023-10-09T11:38:20.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.845 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.901 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3877e-05 s, 0.0 kB/s 2023-10-09T11:38:20.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.011e-05 s, 0.0 kB/s 2023-10-09T11:38:20.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:20.958 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.013 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.013 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.013 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2257e-05 s, 0.0 kB/s 2023-10-09T11:38:21.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.859e-05 s, 0.0 kB/s 2023-10-09T11:38:21.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.070 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0166e-05 s, 0.0 kB/s 2023-10-09T11:38:21.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.126 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7825e-05 s, 0.0 kB/s 2023-10-09T11:38:21.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.182 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.238 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.238 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.238 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5097e-05 s, 0.0 kB/s 2023-10-09T11:38:21.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.238 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6056e-05 s, 0.0 kB/s 2023-10-09T11:38:21.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.295 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-09T11:38:21.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.350 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2581e-05 s, 0.0 kB/s 2023-10-09T11:38:21.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.406 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4214e-05 s, 0.0 kB/s 2023-10-09T11:38:21.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.463 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1898e-05 s, 0.0 kB/s 2023-10-09T11:38:21.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4011e-05 s, 0.0 kB/s 2023-10-09T11:38:21.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.575 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4396e-05 s, 0.0 kB/s 2023-10-09T11:38:21.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5152e-05 s, 0.0 kB/s 2023-10-09T11:38:21.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.687 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.744 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.6947e-05 s, 0.0 kB/s 2023-10-09T11:38:21.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.744 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.799 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.799 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.799 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3746e-05 s, 0.0 kB/s 2023-10-09T11:38:21.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.800 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0422e-05 s, 0.0 kB/s 2023-10-09T11:38:21.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.855 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4601e-05 s, 0.0 kB/s 2023-10-09T11:38:21.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.911 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1796e-05 s, 0.0 kB/s 2023-10-09T11:38:21.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:21.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1222e-05 s, 0.0 kB/s 2023-10-09T11:38:22.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1536e-05 s, 0.0 kB/s 2023-10-09T11:38:22.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.137 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.138 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.138 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2765e-05 s, 0.0 kB/s 2023-10-09T11:38:22.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.138 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4088e-05 s, 0.0 kB/s 2023-10-09T11:38:22.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.194 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4685e-05 s, 0.0 kB/s 2023-10-09T11:38:22.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2916e-05 s, 0.0 kB/s 2023-10-09T11:38:22.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3892e-05 s, 0.0 kB/s 2023-10-09T11:38:22.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.364 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.420 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6086e-05 s, 0.0 kB/s 2023-10-09T11:38:22.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.421 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.477 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1462e-05 s, 0.0 kB/s 2023-10-09T11:38:22.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2396e-05 s, 0.0 kB/s 2023-10-09T11:38:22.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5089e-05 s, 0.0 kB/s 2023-10-09T11:38:22.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.591 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2962e-05 s, 0.0 kB/s 2023-10-09T11:38:22.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.648 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-09T11:38:22.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.704 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1064e-05 s, 0.0 kB/s 2023-10-09T11:38:22.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.761 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6996e-05 s, 0.0 kB/s 2023-10-09T11:38:22.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.817 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.872 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9662e-05 s, 0.0 kB/s 2023-10-09T11:38:22.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.873 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103608 s, 0.0 kB/s 2023-10-09T11:38:22.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.929 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3282e-05 s, 0.0 kB/s 2023-10-09T11:38:22.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:22.985 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.041 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2086e-05 s, 0.0 kB/s 2023-10-09T11:38:23.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7159e-05 s, 0.0 kB/s 2023-10-09T11:38:23.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.098 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.154 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7232e-05 s, 0.0 kB/s 2023-10-09T11:38:23.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.155 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.211 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4074e-05 s, 0.0 kB/s 2023-10-09T11:38:23.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.212 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3335e-05 s, 0.0 kB/s 2023-10-09T11:38:23.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.269 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.324 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3718e-05 s, 0.0 kB/s 2023-10-09T11:38:23.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.325 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.380 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.380 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.380 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1972e-05 s, 0.0 kB/s 2023-10-09T11:38:23.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.381 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2086e-05 s, 0.0 kB/s 2023-10-09T11:38:23.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.438 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.494 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1692e-05 s, 0.0 kB/s 2023-10-09T11:38:23.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.495 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.551 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0685e-05 s, 0.0 kB/s 2023-10-09T11:38:23.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2871e-05 s, 0.0 kB/s 2023-10-09T11:38:23.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.608 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5116e-05 s, 0.0 kB/s 2023-10-09T11:38:23.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.665 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8733e-05 s, 0.0 kB/s 2023-10-09T11:38:23.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.721 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0915e-05 s, 0.0 kB/s 2023-10-09T11:38:23.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.777 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.833 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2474e-05 s, 0.0 kB/s 2023-10-09T11:38:23.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.834 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1699e-05 s, 0.0 kB/s 2023-10-09T11:38:23.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.890 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9069e-05 s, 0.0 kB/s 2023-10-09T11:38:23.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:23.946 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.001 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2182e-05 s, 0.0 kB/s 2023-10-09T11:38:24.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.002 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.398e-05 s, 0.0 kB/s 2023-10-09T11:38:24.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.058 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2193e-05 s, 0.0 kB/s 2023-10-09T11:38:24.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1836e-05 s, 0.0 kB/s 2023-10-09T11:38:24.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.171 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4104e-05 s, 0.0 kB/s 2023-10-09T11:38:24.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.228 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5493e-05 s, 0.0 kB/s 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.284 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106172 s, 0.0 kB/s 2023-10-09T11:38:24.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.341 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0136e-05 s, 0.0 kB/s 2023-10-09T11:38:24.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.398 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6533e-05 s, 0.0 kB/s 2023-10-09T11:38:24.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.455 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7508e-05 s, 0.0 kB/s 2023-10-09T11:38:24.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.567 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3249e-05 s, 0.0 kB/s 2023-10-09T11:38:24.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.622 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8969e-05 s, 0.0 kB/s 2023-10-09T11:38:24.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.623 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9496e-05 s, 0.0 kB/s 2023-10-09T11:38:24.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.679 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.735 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9226e-05 s, 0.0 kB/s 2023-10-09T11:38:24.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.736 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2587e-05 s, 0.0 kB/s 2023-10-09T11:38:24.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.793 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4712e-05 s, 0.0 kB/s 2023-10-09T11:38:24.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.849 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7135e-05 s, 0.0 kB/s 2023-10-09T11:38:24.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.906 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9458e-05 s, 0.0 kB/s 2023-10-09T11:38:24.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:24.963 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1334e-05 s, 0.0 kB/s 2023-10-09T11:38:25.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.019 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3013e-05 s, 0.0 kB/s 2023-10-09T11:38:25.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.076 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0813e-05 s, 0.0 kB/s 2023-10-09T11:38:25.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.132 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4279e-05 s, 0.0 kB/s 2023-10-09T11:38:25.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.189 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.244 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4595e-05 s, 0.0 kB/s 2023-10-09T11:38:25.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.245 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3816e-05 s, 0.0 kB/s 2023-10-09T11:38:25.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.357 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.358 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.358 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7953e-05 s, 0.0 kB/s 2023-10-09T11:38:25.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.358 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2746e-05 s, 0.0 kB/s 2023-10-09T11:38:25.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.415 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.423 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:25.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:25.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5682e-05 s, 0.0 kB/s 2023-10-09T11:38:25.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.552 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T11:38:25.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.7439e-05 s, 0.0 kB/s 2023-10-09T11:38:25.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.609 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2262e-05 s, 0.0 kB/s 2023-10-09T11:38:25.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.664 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2252e-05 s, 0.0 kB/s 2023-10-09T11:38:25.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.721 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.777 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5889e-05 s, 0.0 kB/s 2023-10-09T11:38:25.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.833 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2864e-05 s, 0.0 kB/s 2023-10-09T11:38:25.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.833 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.889 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.889 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8109e-05 s, 0.0 kB/s 2023-10-09T11:38:25.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.890 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2484e-05 s, 0.0 kB/s 2023-10-09T11:38:25.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:25.946 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.001 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-09T11:38:26.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.002 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.255e-05 s, 0.0 kB/s 2023-10-09T11:38:26.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.058 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.113 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2144e-05 s, 0.0 kB/s 2023-10-09T11:38:26.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102443 s, 0.0 kB/s 2023-10-09T11:38:26.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.170 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T11:38:26.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4179e-05 s, 0.0 kB/s 2023-10-09T11:38:26.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.284 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5832e-05 s, 0.0 kB/s 2023-10-09T11:38:26.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.341 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.398 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0005e-05 s, 0.0 kB/s 2023-10-09T11:38:26.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.398 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5047e-05 s, 0.0 kB/s 2023-10-09T11:38:26.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.454 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7379e-05 s, 0.0 kB/s 2023-10-09T11:38:26.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.567 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.568 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7017e-05 s, 0.0 kB/s 2023-10-09T11:38:26.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.568 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5175e-05 s, 0.0 kB/s 2023-10-09T11:38:26.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9666e-05 s, 0.0 kB/s 2023-10-09T11:38:26.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.680 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9089e-05 s, 0.0 kB/s 2023-10-09T11:38:26.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.737 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8732e-05 s, 0.0 kB/s 2023-10-09T11:38:26.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.793 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.848 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-09T11:38:26.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.848 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.548e-05 s, 0.0 kB/s 2023-10-09T11:38:26.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.905 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:26.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:26.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:26.960 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2873e-05 s, 0.0 kB/s 2023-10-09T11:38:26.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:26.960 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6149e-05 s, 0.0 kB/s 2023-10-09T11:38:27.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.017 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.072 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.072 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1448e-05 s, 0.0 kB/s 2023-10-09T11:38:27.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.073 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.128 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.129 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3302e-05 s, 0.0 kB/s 2023-10-09T11:38:27.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.129 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6042e-05 s, 0.0 kB/s 2023-10-09T11:38:27.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.186 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.456e-05 s, 0.0 kB/s 2023-10-09T11:38:27.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.242 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.297 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.297 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.297 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3055e-05 s, 0.0 kB/s 2023-10-09T11:38:27.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.298 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.352 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.353 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.353 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5029e-05 s, 0.0 kB/s 2023-10-09T11:38:27.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.353 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.409 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.409 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6192e-05 s, 0.0 kB/s 2023-10-09T11:38:27.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.410 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0004e-05 s, 0.0 kB/s 2023-10-09T11:38:27.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.466 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.522 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5279e-05 s, 0.0 kB/s 2023-10-09T11:38:27.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.522 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-09T11:38:27.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.578 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4023e-05 s, 0.0 kB/s 2023-10-09T11:38:27.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.635 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2558e-05 s, 0.0 kB/s 2023-10-09T11:38:27.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.692 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.749 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7536e-05 s, 0.0 kB/s 2023-10-09T11:38:27.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.749 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.803 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7313e-05 s, 0.0 kB/s 2023-10-09T11:38:27.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.804 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.860 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2093e-05 s, 0.0 kB/s 2023-10-09T11:38:27.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.861 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.917 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7865e-05 s, 0.0 kB/s 2023-10-09T11:38:27.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.918 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4616e-05 s, 0.0 kB/s 2023-10-09T11:38:27.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:27.974 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.029 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4666e-05 s, 0.0 kB/s 2023-10-09T11:38:28.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.029 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8058e-05 s, 0.0 kB/s 2023-10-09T11:38:28.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.086 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.141 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3636e-05 s, 0.0 kB/s 2023-10-09T11:38:28.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.141 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.197 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2472e-05 s, 0.0 kB/s 2023-10-09T11:38:28.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.845e-05 s, 0.0 kB/s 2023-10-09T11:38:28.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.254 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.310 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3474e-05 s, 0.0 kB/s 2023-10-09T11:38:28.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.311 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3217e-05 s, 0.0 kB/s 2023-10-09T11:38:28.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8919e-05 s, 0.0 kB/s 2023-10-09T11:38:28.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4182e-05 s, 0.0 kB/s 2023-10-09T11:38:28.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.479 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2462e-05 s, 0.0 kB/s 2023-10-09T11:38:28.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-09T11:38:28.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.591 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.646 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4032e-05 s, 0.0 kB/s 2023-10-09T11:38:28.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.647 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.702 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3222e-05 s, 0.0 kB/s 2023-10-09T11:38:28.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4542e-05 s, 0.0 kB/s 2023-10-09T11:38:28.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.774 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4026e-05 s, 0.0 kB/s 2023-10-09T11:38:28.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.831 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.886 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3011e-05 s, 0.0 kB/s 2023-10-09T11:38:28.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.887 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.942 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3355e-05 s, 0.0 kB/s 2023-10-09T11:38:28.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.943 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1487e-05 s, 0.0 kB/s 2023-10-09T11:38:28.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:28.999 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.054 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-09T11:38:29.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.055 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5701e-05 s, 0.0 kB/s 2023-10-09T11:38:29.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.111 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.166 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.166 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.166 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4035e-05 s, 0.0 kB/s 2023-10-09T11:38:29.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.166 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6639e-05 s, 0.0 kB/s 2023-10-09T11:38:29.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.223 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.280 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5029e-05 s, 0.0 kB/s 2023-10-09T11:38:29.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4186e-05 s, 0.0 kB/s 2023-10-09T11:38:29.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.336 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.392 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.392 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-09T11:38:29.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.392 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5394e-05 s, 0.0 kB/s 2023-10-09T11:38:29.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.448 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4929e-05 s, 0.0 kB/s 2023-10-09T11:38:29.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.505 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.560 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7908e-05 s, 0.0 kB/s 2023-10-09T11:38:29.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.560 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1742e-05 s, 0.0 kB/s 2023-10-09T11:38:29.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.672 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3752e-05 s, 0.0 kB/s 2023-10-09T11:38:29.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.673 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7129e-05 s, 0.0 kB/s 2023-10-09T11:38:29.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.729 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2819e-05 s, 0.0 kB/s 2023-10-09T11:38:29.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.785 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6012e-05 s, 0.0 kB/s 2023-10-09T11:38:29.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.841 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.896 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.896 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.896 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4071e-05 s, 0.0 kB/s 2023-10-09T11:38:29.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.896 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6232e-05 s, 0.0 kB/s 2023-10-09T11:38:29.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:29.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5515e-05 s, 0.0 kB/s 2023-10-09T11:38:30.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.009 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.5462e-05 s, 0.0 kB/s 2023-10-09T11:38:30.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.066 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.121 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.121 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.121 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8906e-05 s, 0.0 kB/s 2023-10-09T11:38:30.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.122 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-09T11:38:30.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.178 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2304e-05 s, 0.0 kB/s 2023-10-09T11:38:30.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.234 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.332e-05 s, 0.0 kB/s 2023-10-09T11:38:30.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.292 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.42e-05 s, 0.0 kB/s 2023-10-09T11:38:30.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.429 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1734e-05 s, 0.0 kB/s 2023-10-09T11:38:30.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.429 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.459 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3539e-05 s, 0.0 kB/s 2023-10-09T11:38:30.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.460 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.515 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3132e-05 s, 0.0 kB/s 2023-10-09T11:38:30.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.515 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2452e-05 s, 0.0 kB/s 2023-10-09T11:38:30.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.572 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1593e-05 s, 0.0 kB/s 2023-10-09T11:38:30.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.628 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.684 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4037e-05 s, 0.0 kB/s 2023-10-09T11:38:30.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.685 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9469e-05 s, 0.0 kB/s 2023-10-09T11:38:30.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7552e-05 s, 0.0 kB/s 2023-10-09T11:38:30.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.796 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.707e-05 s, 0.0 kB/s 2023-10-09T11:38:30.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.852 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8108e-05 s, 0.0 kB/s 2023-10-09T11:38:30.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.909 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:30.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:30.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:30.964 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.266e-05 s, 0.0 kB/s 2023-10-09T11:38:30.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:30.964 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-09T11:38:31.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.020 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3985e-05 s, 0.0 kB/s 2023-10-09T11:38:31.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.077 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000108949 s, 0.0 kB/s 2023-10-09T11:38:31.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.133 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2539e-05 s, 0.0 kB/s 2023-10-09T11:38:31.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.191 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0055e-05 s, 0.0 kB/s 2023-10-09T11:38:31.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.248 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9071e-05 s, 0.0 kB/s 2023-10-09T11:38:31.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.306 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1458e-05 s, 0.0 kB/s 2023-10-09T11:38:31.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.363 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5469e-05 s, 0.0 kB/s 2023-10-09T11:38:31.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.418 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.475 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5261e-05 s, 0.0 kB/s 2023-10-09T11:38:31.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.475 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9402e-05 s, 0.0 kB/s 2023-10-09T11:38:31.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2439e-05 s, 0.0 kB/s 2023-10-09T11:38:31.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-09T11:38:31.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1635e-05 s, 0.0 kB/s 2023-10-09T11:38:31.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.755 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.0817e-05 s, 0.0 kB/s 2023-10-09T11:38:31.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.755 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.811 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.345e-05 s, 0.0 kB/s 2023-10-09T11:38:31.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.811 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2202e-05 s, 0.0 kB/s 2023-10-09T11:38:31.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.867 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9545e-05 s, 0.0 kB/s 2023-10-09T11:38:31.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.923 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6702e-05 s, 0.0 kB/s 2023-10-09T11:38:31.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:31.980 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.036 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.036 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.036 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4591e-05 s, 0.0 kB/s 2023-10-09T11:38:32.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.037 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.091 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9182e-05 s, 0.0 kB/s 2023-10-09T11:38:32.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.092 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.148 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3943e-05 s, 0.0 kB/s 2023-10-09T11:38:32.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.149 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.204 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1559e-05 s, 0.0 kB/s 2023-10-09T11:38:32.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.204 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.260 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1032e-05 s, 0.0 kB/s 2023-10-09T11:38:32.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.261 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2842e-05 s, 0.0 kB/s 2023-10-09T11:38:32.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.318 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.375 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3197e-05 s, 0.0 kB/s 2023-10-09T11:38:32.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.375 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.431 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.432 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.432 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.104e-05 s, 0.0 kB/s 2023-10-09T11:38:32.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.432 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.488 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4536e-05 s, 0.0 kB/s 2023-10-09T11:38:32.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.489 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1711e-05 s, 0.0 kB/s 2023-10-09T11:38:32.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.546 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.602 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.9155e-05 s, 0.0 kB/s 2023-10-09T11:38:32.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6369e-05 s, 0.0 kB/s 2023-10-09T11:38:32.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6019e-05 s, 0.0 kB/s 2023-10-09T11:38:32.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.715 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4847e-05 s, 0.0 kB/s 2023-10-09T11:38:32.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.772 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.828 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8559e-05 s, 0.0 kB/s 2023-10-09T11:38:32.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.829 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.885 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4256e-05 s, 0.0 kB/s 2023-10-09T11:38:32.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.886 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1849e-05 s, 0.0 kB/s 2023-10-09T11:38:32.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.942 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4125e-05 s, 0.0 kB/s 2023-10-09T11:38:32.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:32.998 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.055 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.055 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2266e-05 s, 0.0 kB/s 2023-10-09T11:38:33.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.055 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4926e-05 s, 0.0 kB/s 2023-10-09T11:38:33.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.112 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1174e-05 s, 0.0 kB/s 2023-10-09T11:38:33.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.169 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.0611e-05 s, 0.0 kB/s 2023-10-09T11:38:33.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.225 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4953e-05 s, 0.0 kB/s 2023-10-09T11:38:33.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.282 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0252e-05 s, 0.0 kB/s 2023-10-09T11:38:33.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.339 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8399e-05 s, 0.0 kB/s 2023-10-09T11:38:33.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.396 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1159e-05 s, 0.0 kB/s 2023-10-09T11:38:33.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.452 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.508 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.508 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3455e-05 s, 0.0 kB/s 2023-10-09T11:38:33.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.508 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6732e-05 s, 0.0 kB/s 2023-10-09T11:38:33.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.565 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.621 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5928e-05 s, 0.0 kB/s 2023-10-09T11:38:33.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.621 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.677 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.677 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1426e-05 s, 0.0 kB/s 2023-10-09T11:38:33.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.677 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.734 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2677e-05 s, 0.0 kB/s 2023-10-09T11:38:33.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.734 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3978e-05 s, 0.0 kB/s 2023-10-09T11:38:33.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.791 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5403e-05 s, 0.0 kB/s 2023-10-09T11:38:33.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.847 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7826e-05 s, 0.0 kB/s 2023-10-09T11:38:33.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.932 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7619e-05 s, 0.0 kB/s 2023-10-09T11:38:33.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:33.949 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4094e-05 s, 0.0 kB/s 2023-10-09T11:38:34.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.006 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.062 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.062 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1625e-05 s, 0.0 kB/s 2023-10-09T11:38:34.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.062 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6946e-05 s, 0.0 kB/s 2023-10-09T11:38:34.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.118 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2906e-05 s, 0.0 kB/s 2023-10-09T11:38:34.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.176 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.231 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.231 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.231 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2502e-05 s, 0.0 kB/s 2023-10-09T11:38:34.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.232 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4528e-05 s, 0.0 kB/s 2023-10-09T11:38:34.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.288 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4249e-05 s, 0.0 kB/s 2023-10-09T11:38:34.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.344 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4959e-05 s, 0.0 kB/s 2023-10-09T11:38:34.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.400 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.456 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8002e-05 s, 0.0 kB/s 2023-10-09T11:38:34.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.512 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3785e-05 s, 0.0 kB/s 2023-10-09T11:38:34.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.513 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.568 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1692e-05 s, 0.0 kB/s 2023-10-09T11:38:34.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.625 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0459e-05 s, 0.0 kB/s 2023-10-09T11:38:34.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7646e-05 s, 0.0 kB/s 2023-10-09T11:38:34.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.682 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.738 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.738 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.738 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.025e-05 s, 0.0 kB/s 2023-10-09T11:38:34.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.738 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.794 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.794 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.794 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-09T11:38:34.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.795 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6619e-05 s, 0.0 kB/s 2023-10-09T11:38:34.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.906 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.907 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000105225 s, 0.0 kB/s 2023-10-09T11:38:34.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.907 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:34.963 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:34.963 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:34.964 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2307e-05 s, 0.0 kB/s 2023-10-09T11:38:34.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:34.964 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-09T11:38:35.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.020 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2297e-05 s, 0.0 kB/s 2023-10-09T11:38:35.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.076 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.7103e-05 s, 0.0 kB/s 2023-10-09T11:38:35.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.131 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1358e-05 s, 0.0 kB/s 2023-10-09T11:38:35.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.188 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1871e-05 s, 0.0 kB/s 2023-10-09T11:38:35.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.249 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5692e-05 s, 0.0 kB/s 2023-10-09T11:38:35.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2586e-05 s, 0.0 kB/s 2023-10-09T11:38:35.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.499e-05 s, 0.0 kB/s 2023-10-09T11:38:35.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100576 s, 0.0 kB/s 2023-10-09T11:38:35.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.475 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7919e-05 s, 0.0 kB/s 2023-10-09T11:38:35.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.531 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.3277e-05 s, 0.0 kB/s 2023-10-09T11:38:35.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.591 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6802e-05 s, 0.0 kB/s 2023-10-09T11:38:35.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.650 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.709 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2453e-05 s, 0.0 kB/s 2023-10-09T11:38:35.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.710 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.766 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4192e-05 s, 0.0 kB/s 2023-10-09T11:38:35.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.767 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.822 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8117e-05 s, 0.0 kB/s 2023-10-09T11:38:35.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.877 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.877 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0235e-05 s, 0.0 kB/s 2023-10-09T11:38:35.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.879 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9223e-05 s, 0.0 kB/s 2023-10-09T11:38:35.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7053e-05 s, 0.0 kB/s 2023-10-09T11:38:35.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:35.992 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.047 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.047 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.047 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2622e-05 s, 0.0 kB/s 2023-10-09T11:38:36.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.048 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1703e-05 s, 0.0 kB/s 2023-10-09T11:38:36.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.103 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4025e-05 s, 0.0 kB/s 2023-10-09T11:38:36.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.160 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6748e-05 s, 0.0 kB/s 2023-10-09T11:38:36.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.216 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1149e-05 s, 0.0 kB/s 2023-10-09T11:38:36.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.273 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2305e-05 s, 0.0 kB/s 2023-10-09T11:38:36.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6615e-05 s, 0.0 kB/s 2023-10-09T11:38:36.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.441 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0887e-05 s, 0.0 kB/s 2023-10-09T11:38:36.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2597e-05 s, 0.0 kB/s 2023-10-09T11:38:36.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4337e-05 s, 0.0 kB/s 2023-10-09T11:38:36.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.554 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.610 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3702e-05 s, 0.0 kB/s 2023-10-09T11:38:36.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.610 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4105e-05 s, 0.0 kB/s 2023-10-09T11:38:36.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.666 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-09T11:38:36.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.723 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.778 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.276e-05 s, 0.0 kB/s 2023-10-09T11:38:36.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1865e-05 s, 0.0 kB/s 2023-10-09T11:38:36.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.835 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8706e-05 s, 0.0 kB/s 2023-10-09T11:38:36.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.891 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3747e-05 s, 0.0 kB/s 2023-10-09T11:38:36.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:36.947 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.003 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.003 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.003 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.7525e-05 s, 0.0 kB/s 2023-10-09T11:38:37.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.004 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7232e-05 s, 0.0 kB/s 2023-10-09T11:38:37.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.059 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.115 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-09T11:38:37.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.115 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.171 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-09T11:38:37.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.171 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.227 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.227 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2714e-05 s, 0.0 kB/s 2023-10-09T11:38:37.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.285 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.285 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.285 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000121308 s, 0.0 kB/s 2023-10-09T11:38:37.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.286 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.341 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.342 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.342 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2782e-05 s, 0.0 kB/s 2023-10-09T11:38:37.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.342 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2248e-05 s, 0.0 kB/s 2023-10-09T11:38:37.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.399 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5039e-05 s, 0.0 kB/s 2023-10-09T11:38:37.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.455 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.511 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5112e-05 s, 0.0 kB/s 2023-10-09T11:38:37.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.512 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4342e-05 s, 0.0 kB/s 2023-10-09T11:38:37.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.568 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.623 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-09T11:38:37.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.624 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2149e-05 s, 0.0 kB/s 2023-10-09T11:38:37.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.679 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7182e-05 s, 0.0 kB/s 2023-10-09T11:38:37.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.735 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3186e-05 s, 0.0 kB/s 2023-10-09T11:38:37.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.792 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7338e-05 s, 0.0 kB/s 2023-10-09T11:38:37.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.847 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1965e-05 s, 0.0 kB/s 2023-10-09T11:38:37.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.904 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1609e-05 s, 0.0 kB/s 2023-10-09T11:38:37.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:37.959 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7256e-05 s, 0.0 kB/s 2023-10-09T11:38:38.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.016 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4552e-05 s, 0.0 kB/s 2023-10-09T11:38:38.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.072 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.128 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2042e-05 s, 0.0 kB/s 2023-10-09T11:38:38.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.128 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.184 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1936e-05 s, 0.0 kB/s 2023-10-09T11:38:38.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9469e-05 s, 0.0 kB/s 2023-10-09T11:38:38.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.240 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4875e-05 s, 0.0 kB/s 2023-10-09T11:38:38.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.298 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5059e-05 s, 0.0 kB/s 2023-10-09T11:38:38.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.355 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.411 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.411 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.412 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.2868e-05 s, 0.0 kB/s 2023-10-09T11:38:38.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.412 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.467 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.335e-05 s, 0.0 kB/s 2023-10-09T11:38:38.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.468 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.524 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4161e-05 s, 0.0 kB/s 2023-10-09T11:38:38.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.524 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.581 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.581 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.581 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3729e-05 s, 0.0 kB/s 2023-10-09T11:38:38.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.581 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.3339e-05 s, 0.0 kB/s 2023-10-09T11:38:38.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.638 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3027e-05 s, 0.0 kB/s 2023-10-09T11:38:38.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.694 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.750 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.750 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.750 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0419e-05 s, 0.0 kB/s 2023-10-09T11:38:38.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.750 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1848e-05 s, 0.0 kB/s 2023-10-09T11:38:38.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.807 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1657e-05 s, 0.0 kB/s 2023-10-09T11:38:38.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.864 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.920 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.921 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0596e-05 s, 0.0 kB/s 2023-10-09T11:38:38.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.921 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103921 s, 0.0 kB/s 2023-10-09T11:38:38.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:38.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1395e-05 s, 0.0 kB/s 2023-10-09T11:38:39.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.062 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-09T11:38:39.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.079 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.134 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.134 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.134 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-09T11:38:39.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.191 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.191 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3357e-05 s, 0.0 kB/s 2023-10-09T11:38:39.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.191 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.247 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.247 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.247 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3985e-05 s, 0.0 kB/s 2023-10-09T11:38:39.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.248 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3625e-05 s, 0.0 kB/s 2023-10-09T11:38:39.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7739e-05 s, 0.0 kB/s 2023-10-09T11:38:39.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.419 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-09T11:38:39.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.0057e-05 s, 0.0 kB/s 2023-10-09T11:38:39.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2609e-05 s, 0.0 kB/s 2023-10-09T11:38:39.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.587 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.587 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.587 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4605e-05 s, 0.0 kB/s 2023-10-09T11:38:39.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.588 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9822e-05 s, 0.0 kB/s 2023-10-09T11:38:39.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.644 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2032e-05 s, 0.0 kB/s 2023-10-09T11:38:39.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1283e-05 s, 0.0 kB/s 2023-10-09T11:38:39.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.756 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.812 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3099e-05 s, 0.0 kB/s 2023-10-09T11:38:39.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.813 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.868 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.868 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4414e-05 s, 0.0 kB/s 2023-10-09T11:38:39.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.869 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.924 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2797e-05 s, 0.0 kB/s 2023-10-09T11:38:39.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.925 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6332e-05 s, 0.0 kB/s 2023-10-09T11:38:39.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:39.981 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.037 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5991e-05 s, 0.0 kB/s 2023-10-09T11:38:40.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.038 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2272e-05 s, 0.0 kB/s 2023-10-09T11:38:40.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.094 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2721e-05 s, 0.0 kB/s 2023-10-09T11:38:40.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.150 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.205 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8808e-05 s, 0.0 kB/s 2023-10-09T11:38:40.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.206 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4751e-05 s, 0.0 kB/s 2023-10-09T11:38:40.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.262 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4419e-05 s, 0.0 kB/s 2023-10-09T11:38:40.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.318 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4052e-05 s, 0.0 kB/s 2023-10-09T11:38:40.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3484e-05 s, 0.0 kB/s 2023-10-09T11:38:40.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.431 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5127e-05 s, 0.0 kB/s 2023-10-09T11:38:40.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4321e-05 s, 0.0 kB/s 2023-10-09T11:38:40.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.542 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-09T11:38:40.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5672e-05 s, 0.0 kB/s 2023-10-09T11:38:40.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4269e-05 s, 0.0 kB/s 2023-10-09T11:38:40.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100216 s, 0.0 kB/s 2023-10-09T11:38:40.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.836 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2953e-05 s, 0.0 kB/s 2023-10-09T11:38:40.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.837 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0939e-05 s, 0.0 kB/s 2023-10-09T11:38:40.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.894 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:40.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:40.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:40.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0409e-05 s, 0.0 kB/s 2023-10-09T11:38:40.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:40.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-09T11:38:41.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3908e-05 s, 0.0 kB/s 2023-10-09T11:38:41.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.126 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.127 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3951e-05 s, 0.0 kB/s 2023-10-09T11:38:41.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.127 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.561e-05 s, 0.0 kB/s 2023-10-09T11:38:41.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.186 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3916e-05 s, 0.0 kB/s 2023-10-09T11:38:41.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.246 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.421e-05 s, 0.0 kB/s 2023-10-09T11:38:41.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.306 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6595e-05 s, 0.0 kB/s 2023-10-09T11:38:41.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2675e-05 s, 0.0 kB/s 2023-10-09T11:38:41.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.532e-05 s, 0.0 kB/s 2023-10-09T11:38:41.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9079e-05 s, 0.0 kB/s 2023-10-09T11:38:41.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2083e-05 s, 0.0 kB/s 2023-10-09T11:38:41.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.645 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8439e-05 s, 0.0 kB/s 2023-10-09T11:38:41.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.646 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1691e-05 s, 0.0 kB/s 2023-10-09T11:38:41.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.760 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4142e-05 s, 0.0 kB/s 2023-10-09T11:38:41.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6895e-05 s, 0.0 kB/s 2023-10-09T11:38:41.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.818 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.873 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7175e-05 s, 0.0 kB/s 2023-10-09T11:38:41.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.874 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0418e-05 s, 0.0 kB/s 2023-10-09T11:38:41.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.930 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:41.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4038e-05 s, 0.0 kB/s 2023-10-09T11:38:41.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:41.986 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7418e-05 s, 0.0 kB/s 2023-10-09T11:38:42.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.099 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1532e-05 s, 0.0 kB/s 2023-10-09T11:38:42.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.099 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.155 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2528e-05 s, 0.0 kB/s 2023-10-09T11:38:42.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.155 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.0372e-05 s, 0.0 kB/s 2023-10-09T11:38:42.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.211 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3781e-05 s, 0.0 kB/s 2023-10-09T11:38:42.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.268 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.325 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8703e-05 s, 0.0 kB/s 2023-10-09T11:38:42.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.325 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4031e-05 s, 0.0 kB/s 2023-10-09T11:38:42.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.381 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.437 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.438 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.438 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3452e-05 s, 0.0 kB/s 2023-10-09T11:38:42.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.438 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.494 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.494 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.494 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5239e-05 s, 0.0 kB/s 2023-10-09T11:38:42.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.495 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6476e-05 s, 0.0 kB/s 2023-10-09T11:38:42.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2025e-05 s, 0.0 kB/s 2023-10-09T11:38:42.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.609 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7179e-05 s, 0.0 kB/s 2023-10-09T11:38:42.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.664 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-09T11:38:42.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.720 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3142e-05 s, 0.0 kB/s 2023-10-09T11:38:42.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.776 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.832 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-09T11:38:42.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.832 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3207e-05 s, 0.0 kB/s 2023-10-09T11:38:42.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.888 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4339e-05 s, 0.0 kB/s 2023-10-09T11:38:42.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:42.945 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.001 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.296e-05 s, 0.0 kB/s 2023-10-09T11:38:43.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.002 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6195e-05 s, 0.0 kB/s 2023-10-09T11:38:43.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.057 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.113 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.113 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4338e-05 s, 0.0 kB/s 2023-10-09T11:38:43.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4329e-05 s, 0.0 kB/s 2023-10-09T11:38:43.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.169 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8179e-05 s, 0.0 kB/s 2023-10-09T11:38:43.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.226 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.281 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.444e-05 s, 0.0 kB/s 2023-10-09T11:38:43.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.282 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.326e-05 s, 0.0 kB/s 2023-10-09T11:38:43.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.339 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.396 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.7357e-05 s, 0.0 kB/s 2023-10-09T11:38:43.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.396 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.453 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-09T11:38:43.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.454 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3175e-05 s, 0.0 kB/s 2023-10-09T11:38:43.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.512 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.568 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0809e-05 s, 0.0 kB/s 2023-10-09T11:38:43.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.625 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4437e-05 s, 0.0 kB/s 2023-10-09T11:38:43.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.626 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1338e-05 s, 0.0 kB/s 2023-10-09T11:38:43.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.682 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.738 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.739 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1555e-05 s, 0.0 kB/s 2023-10-09T11:38:43.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.739 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-09T11:38:43.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.796 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8309e-05 s, 0.0 kB/s 2023-10-09T11:38:43.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.853 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.910 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1894e-05 s, 0.0 kB/s 2023-10-09T11:38:43.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.910 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:43.966 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5989e-05 s, 0.0 kB/s 2023-10-09T11:38:43.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:43.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.141e-05 s, 0.0 kB/s 2023-10-09T11:38:44.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-09T11:38:44.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8358e-05 s, 0.0 kB/s 2023-10-09T11:38:44.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.137 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4405e-05 s, 0.0 kB/s 2023-10-09T11:38:44.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.249 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-09T11:38:44.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4693e-05 s, 0.0 kB/s 2023-10-09T11:38:44.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.306 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2628e-05 s, 0.0 kB/s 2023-10-09T11:38:44.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.363 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2475e-05 s, 0.0 kB/s 2023-10-09T11:38:44.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5449e-05 s, 0.0 kB/s 2023-10-09T11:38:44.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.476 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3646e-05 s, 0.0 kB/s 2023-10-09T11:38:44.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.534 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.589 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4155e-05 s, 0.0 kB/s 2023-10-09T11:38:44.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.590 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.309e-05 s, 0.0 kB/s 2023-10-09T11:38:44.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.646 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7299e-05 s, 0.0 kB/s 2023-10-09T11:38:44.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2342e-05 s, 0.0 kB/s 2023-10-09T11:38:44.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1229e-05 s, 0.0 kB/s 2023-10-09T11:38:44.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.817 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.873 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5995e-05 s, 0.0 kB/s 2023-10-09T11:38:44.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.874 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.930 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1491e-05 s, 0.0 kB/s 2023-10-09T11:38:44.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.930 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4039e-05 s, 0.0 kB/s 2023-10-09T11:38:44.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:44.987 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6556e-05 s, 0.0 kB/s 2023-10-09T11:38:45.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.044 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2223e-05 s, 0.0 kB/s 2023-10-09T11:38:45.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.102 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4862e-05 s, 0.0 kB/s 2023-10-09T11:38:45.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.213 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.214 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0673e-05 s, 0.0 kB/s 2023-10-09T11:38:45.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.214 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5849e-05 s, 0.0 kB/s 2023-10-09T11:38:45.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.328 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.328 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1699e-05 s, 0.0 kB/s 2023-10-09T11:38:45.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-09T11:38:45.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.441 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2329e-05 s, 0.0 kB/s 2023-10-09T11:38:45.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.441 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.497 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.498 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0822e-05 s, 0.0 kB/s 2023-10-09T11:38:45.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.555 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.399e-05 s, 0.0 kB/s 2023-10-09T11:38:45.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.556 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.610 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.611 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8703e-05 s, 0.0 kB/s 2023-10-09T11:38:45.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.612 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.668 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7915e-05 s, 0.0 kB/s 2023-10-09T11:38:45.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.669 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.725 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.725 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.725 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4621e-05 s, 0.0 kB/s 2023-10-09T11:38:45.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.726 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4573e-05 s, 0.0 kB/s 2023-10-09T11:38:45.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.837 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101729 s, 0.0 kB/s 2023-10-09T11:38:45.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.838 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.895 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.895 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1353e-05 s, 0.0 kB/s 2023-10-09T11:38:45.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.895 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5435e-05 s, 0.0 kB/s 2023-10-09T11:38:45.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:45.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.008 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2734e-05 s, 0.0 kB/s 2023-10-09T11:38:46.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.064 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4183e-05 s, 0.0 kB/s 2023-10-09T11:38:46.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.064 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8813e-05 s, 0.0 kB/s 2023-10-09T11:38:46.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.121 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.177 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.177 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.177 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9782e-05 s, 0.0 kB/s 2023-10-09T11:38:46.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.234 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4457e-05 s, 0.0 kB/s 2023-10-09T11:38:46.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.234 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2999e-05 s, 0.0 kB/s 2023-10-09T11:38:46.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.291 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.346 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2009e-05 s, 0.0 kB/s 2023-10-09T11:38:46.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.346 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2467e-05 s, 0.0 kB/s 2023-10-09T11:38:46.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.402 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-09T11:38:46.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.458 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109755 s, 0.0 kB/s 2023-10-09T11:38:46.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.515 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2265e-05 s, 0.0 kB/s 2023-10-09T11:38:46.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.572 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.628 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4965e-05 s, 0.0 kB/s 2023-10-09T11:38:46.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.629 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5709e-05 s, 0.0 kB/s 2023-10-09T11:38:46.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.685 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2561e-05 s, 0.0 kB/s 2023-10-09T11:38:46.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.742 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8662e-05 s, 0.0 kB/s 2023-10-09T11:38:46.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2487e-05 s, 0.0 kB/s 2023-10-09T11:38:46.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.855 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.911 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.911 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2089e-05 s, 0.0 kB/s 2023-10-09T11:38:46.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.912 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7679e-05 s, 0.0 kB/s 2023-10-09T11:38:46.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:46.969 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.026 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5689e-05 s, 0.0 kB/s 2023-10-09T11:38:47.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.026 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.082 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.082 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.082 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6995e-05 s, 0.0 kB/s 2023-10-09T11:38:47.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.083 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2079e-05 s, 0.0 kB/s 2023-10-09T11:38:47.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.140 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.197 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.265e-05 s, 0.0 kB/s 2023-10-09T11:38:47.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.253 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0147e-05 s, 0.0 kB/s 2023-10-09T11:38:47.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.254 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.310 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4832e-05 s, 0.0 kB/s 2023-10-09T11:38:47.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.311 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.81e-05 s, 0.0 kB/s 2023-10-09T11:38:47.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1131e-05 s, 0.0 kB/s 2023-10-09T11:38:47.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1991e-05 s, 0.0 kB/s 2023-10-09T11:38:47.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0979e-05 s, 0.0 kB/s 2023-10-09T11:38:47.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.592 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2253e-05 s, 0.0 kB/s 2023-10-09T11:38:47.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.593 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.648 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.648 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.648 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9349e-05 s, 0.0 kB/s 2023-10-09T11:38:47.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.649 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.704 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7235e-05 s, 0.0 kB/s 2023-10-09T11:38:47.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.705 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0592e-05 s, 0.0 kB/s 2023-10-09T11:38:47.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.762 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2944e-05 s, 0.0 kB/s 2023-10-09T11:38:47.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.819 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.876 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5757e-05 s, 0.0 kB/s 2023-10-09T11:38:47.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.876 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6311e-05 s, 0.0 kB/s 2023-10-09T11:38:47.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.933 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:47.989 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2533e-05 s, 0.0 kB/s 2023-10-09T11:38:47.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:47.990 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6875e-05 s, 0.0 kB/s 2023-10-09T11:38:48.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.046 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.102 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.103 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.103 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2793e-05 s, 0.0 kB/s 2023-10-09T11:38:48.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.103 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.159 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-09T11:38:48.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.160 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.216 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.217 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.217 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4389e-05 s, 0.0 kB/s 2023-10-09T11:38:48.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.217 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.274 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3051e-05 s, 0.0 kB/s 2023-10-09T11:38:48.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.274 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.331 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-09T11:38:48.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.332 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1579e-05 s, 0.0 kB/s 2023-10-09T11:38:48.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.388 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.444 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.444 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.445 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4019e-05 s, 0.0 kB/s 2023-10-09T11:38:48.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.445 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1594e-05 s, 0.0 kB/s 2023-10-09T11:38:48.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.502 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0346e-05 s, 0.0 kB/s 2023-10-09T11:38:48.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.559 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.617 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2509e-05 s, 0.0 kB/s 2023-10-09T11:38:48.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1499e-05 s, 0.0 kB/s 2023-10-09T11:38:48.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.731 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.731 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.9321e-05 s, 0.0 kB/s 2023-10-09T11:38:48.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.731 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-09T11:38:48.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.788 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.844 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.844 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.844 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103132 s, 0.0 kB/s 2023-10-09T11:38:48.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.845 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000113518 s, 0.0 kB/s 2023-10-09T11:38:48.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:48.957 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:48.958 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:48.958 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6553e-05 s, 0.0 kB/s 2023-10-09T11:38:48.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:48.958 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.015 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.816e-05 s, 0.0 kB/s 2023-10-09T11:38:49.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.015 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.071 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3195e-05 s, 0.0 kB/s 2023-10-09T11:38:49.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.072 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.127 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.0282e-05 s, 0.0 kB/s 2023-10-09T11:38:49.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.128 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.317e-05 s, 0.0 kB/s 2023-10-09T11:38:49.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.240 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.240 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.241 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8026e-05 s, 0.0 kB/s 2023-10-09T11:38:49.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.241 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.297 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.298 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4103e-05 s, 0.0 kB/s 2023-10-09T11:38:49.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.298 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.355 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6064e-05 s, 0.0 kB/s 2023-10-09T11:38:49.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.355 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.238e-05 s, 0.0 kB/s 2023-10-09T11:38:49.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.411 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.468 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4679e-05 s, 0.0 kB/s 2023-10-09T11:38:49.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.468 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.525 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2697e-05 s, 0.0 kB/s 2023-10-09T11:38:49.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.525 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.581 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.582 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.582 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1547e-05 s, 0.0 kB/s 2023-10-09T11:38:49.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.582 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1814e-05 s, 0.0 kB/s 2023-10-09T11:38:49.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.640 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.695 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.696 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6782e-05 s, 0.0 kB/s 2023-10-09T11:38:49.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.696 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7676e-05 s, 0.0 kB/s 2023-10-09T11:38:49.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.754 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4311e-05 s, 0.0 kB/s 2023-10-09T11:38:49.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.811 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.867 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-09T11:38:49.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.867 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4366e-05 s, 0.0 kB/s 2023-10-09T11:38:49.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.924 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:49.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:49.979 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:49.980 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-09T11:38:49.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:49.980 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.037 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.299e-05 s, 0.0 kB/s 2023-10-09T11:38:50.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.037 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.094 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4231e-05 s, 0.0 kB/s 2023-10-09T11:38:50.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.095 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2072e-05 s, 0.0 kB/s 2023-10-09T11:38:50.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T11:38:50.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.209 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000110922 s, 0.0 kB/s 2023-10-09T11:38:50.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.266 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.322 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.332e-05 s, 0.0 kB/s 2023-10-09T11:38:50.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.322 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2559e-05 s, 0.0 kB/s 2023-10-09T11:38:50.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.379 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.435 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104718 s, 0.0 kB/s 2023-10-09T11:38:50.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.435 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.491 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.492 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2407e-05 s, 0.0 kB/s 2023-10-09T11:38:50.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.492 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.548 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2493e-05 s, 0.0 kB/s 2023-10-09T11:38:50.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.549 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.121e-05 s, 0.0 kB/s 2023-10-09T11:38:50.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.605 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3377e-05 s, 0.0 kB/s 2023-10-09T11:38:50.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.662 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9795e-05 s, 0.0 kB/s 2023-10-09T11:38:50.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.718 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.4352e-05 s, 0.0 kB/s 2023-10-09T11:38:50.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.841 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4696e-05 s, 0.0 kB/s 2023-10-09T11:38:50.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.857 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4358e-05 s, 0.0 kB/s 2023-10-09T11:38:50.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.913 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1855e-05 s, 0.0 kB/s 2023-10-09T11:38:50.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:50.969 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1475e-05 s, 0.0 kB/s 2023-10-09T11:38:51.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.025 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.080 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6809e-05 s, 0.0 kB/s 2023-10-09T11:38:51.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3433e-05 s, 0.0 kB/s 2023-10-09T11:38:51.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.137 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8764e-05 s, 0.0 kB/s 2023-10-09T11:38:51.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.250 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4085e-05 s, 0.0 kB/s 2023-10-09T11:38:51.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7762e-05 s, 0.0 kB/s 2023-10-09T11:38:51.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.607e-05 s, 0.0 kB/s 2023-10-09T11:38:51.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.364 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-09T11:38:51.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.421 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5999e-05 s, 0.0 kB/s 2023-10-09T11:38:51.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4905e-05 s, 0.0 kB/s 2023-10-09T11:38:51.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4513e-05 s, 0.0 kB/s 2023-10-09T11:38:51.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.592 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.147e-05 s, 0.0 kB/s 2023-10-09T11:38:51.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.648 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.704 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.704 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.704 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4636e-05 s, 0.0 kB/s 2023-10-09T11:38:51.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.705 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.760 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.760 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.760 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3927e-05 s, 0.0 kB/s 2023-10-09T11:38:51.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.761 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.817 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.817 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1806e-05 s, 0.0 kB/s 2023-10-09T11:38:51.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.817 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.874 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4299e-05 s, 0.0 kB/s 2023-10-09T11:38:51.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.874 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3215e-05 s, 0.0 kB/s 2023-10-09T11:38:51.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.931 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4098e-05 s, 0.0 kB/s 2023-10-09T11:38:51.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:51.988 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1551e-05 s, 0.0 kB/s 2023-10-09T11:38:52.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.045 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3867e-05 s, 0.0 kB/s 2023-10-09T11:38:52.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.158 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.158 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.158 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2239e-05 s, 0.0 kB/s 2023-10-09T11:38:52.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.158 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-09T11:38:52.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.215 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8351e-05 s, 0.0 kB/s 2023-10-09T11:38:52.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.272 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3655e-05 s, 0.0 kB/s 2023-10-09T11:38:52.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.329 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.385 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3145e-05 s, 0.0 kB/s 2023-10-09T11:38:52.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7303e-05 s, 0.0 kB/s 2023-10-09T11:38:52.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.498 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.279e-05 s, 0.0 kB/s 2023-10-09T11:38:52.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.499 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4601e-05 s, 0.0 kB/s 2023-10-09T11:38:52.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.556 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1756e-05 s, 0.0 kB/s 2023-10-09T11:38:52.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.613 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1245e-05 s, 0.0 kB/s 2023-10-09T11:38:52.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.670 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7642e-05 s, 0.0 kB/s 2023-10-09T11:38:52.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5306e-05 s, 0.0 kB/s 2023-10-09T11:38:52.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.784 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.842 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.171e-05 s, 0.0 kB/s 2023-10-09T11:38:52.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.842 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.899 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4616e-05 s, 0.0 kB/s 2023-10-09T11:38:52.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.899 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:52.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:52.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:52.956 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4033e-05 s, 0.0 kB/s 2023-10-09T11:38:52.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:52.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7322e-05 s, 0.0 kB/s 2023-10-09T11:38:53.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.068 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3807e-05 s, 0.0 kB/s 2023-10-09T11:38:53.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8989e-05 s, 0.0 kB/s 2023-10-09T11:38:53.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.182 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-09T11:38:53.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.182 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1939e-05 s, 0.0 kB/s 2023-10-09T11:38:53.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.238 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.295 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1215e-05 s, 0.0 kB/s 2023-10-09T11:38:53.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.295 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.352 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.344e-05 s, 0.0 kB/s 2023-10-09T11:38:53.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102224 s, 0.0 kB/s 2023-10-09T11:38:53.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.409 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-09T11:38:53.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.465 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7945e-05 s, 0.0 kB/s 2023-10-09T11:38:53.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.521 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6476e-05 s, 0.0 kB/s 2023-10-09T11:38:53.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.577 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0941e-05 s, 0.0 kB/s 2023-10-09T11:38:53.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.633 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0342e-05 s, 0.0 kB/s 2023-10-09T11:38:53.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.690 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6348e-05 s, 0.0 kB/s 2023-10-09T11:38:53.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.748 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.803 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4302e-05 s, 0.0 kB/s 2023-10-09T11:38:53.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.804 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.862 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.862 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1243e-05 s, 0.0 kB/s 2023-10-09T11:38:53.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.862 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.919 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0614e-05 s, 0.0 kB/s 2023-10-09T11:38:53.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:53.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:53.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:53.975 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6558e-05 s, 0.0 kB/s 2023-10-09T11:38:53.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:53.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1696e-05 s, 0.0 kB/s 2023-10-09T11:38:54.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.032 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3023e-05 s, 0.0 kB/s 2023-10-09T11:38:54.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.089 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2344e-05 s, 0.0 kB/s 2023-10-09T11:38:54.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.146 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.5419e-05 s, 0.0 kB/s 2023-10-09T11:38:54.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.202 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-09T11:38:54.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.258 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2776e-05 s, 0.0 kB/s 2023-10-09T11:38:54.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.315 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.371 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5233e-05 s, 0.0 kB/s 2023-10-09T11:38:54.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.371 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2599e-05 s, 0.0 kB/s 2023-10-09T11:38:54.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.427 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.483 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3302e-05 s, 0.0 kB/s 2023-10-09T11:38:54.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.483 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2054e-05 s, 0.0 kB/s 2023-10-09T11:38:54.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.540 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2891e-05 s, 0.0 kB/s 2023-10-09T11:38:54.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.596 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.652 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000120232 s, 0.0 kB/s 2023-10-09T11:38:54.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.652 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.707 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4253e-05 s, 0.0 kB/s 2023-10-09T11:38:54.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.707 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.763 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.763 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.764 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3708e-05 s, 0.0 kB/s 2023-10-09T11:38:54.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.764 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.820 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.356e-05 s, 0.0 kB/s 2023-10-09T11:38:54.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.821 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4179e-05 s, 0.0 kB/s 2023-10-09T11:38:54.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.877 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1279e-05 s, 0.0 kB/s 2023-10-09T11:38:54.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.933 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:54.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:54.988 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:54.988 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3689e-05 s, 0.0 kB/s 2023-10-09T11:38:54.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:54.989 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2669e-05 s, 0.0 kB/s 2023-10-09T11:38:55.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.044 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.100 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.100 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1959e-05 s, 0.0 kB/s 2023-10-09T11:38:55.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.157 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6932e-05 s, 0.0 kB/s 2023-10-09T11:38:55.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.158 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.226e-05 s, 0.0 kB/s 2023-10-09T11:38:55.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.215 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1547e-05 s, 0.0 kB/s 2023-10-09T11:38:55.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5017e-05 s, 0.0 kB/s 2023-10-09T11:38:55.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.466e-05 s, 0.0 kB/s 2023-10-09T11:38:55.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2509e-05 s, 0.0 kB/s 2023-10-09T11:38:55.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.440 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3302e-05 s, 0.0 kB/s 2023-10-09T11:38:55.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.496 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-09T11:38:55.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.610 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.610 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3596e-05 s, 0.0 kB/s 2023-10-09T11:38:55.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.610 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.668 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4707e-05 s, 0.0 kB/s 2023-10-09T11:38:55.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.668 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2554e-05 s, 0.0 kB/s 2023-10-09T11:38:55.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.724 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3612e-05 s, 0.0 kB/s 2023-10-09T11:38:55.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.780 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8465e-05 s, 0.0 kB/s 2023-10-09T11:38:55.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.837 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6679e-05 s, 0.0 kB/s 2023-10-09T11:38:55.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:55.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:55.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:55.953 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103932 s, 0.0 kB/s 2023-10-09T11:38:55.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:55.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.009 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2295e-05 s, 0.0 kB/s 2023-10-09T11:38:56.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.066 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2005e-05 s, 0.0 kB/s 2023-10-09T11:38:56.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.067 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4191e-05 s, 0.0 kB/s 2023-10-09T11:38:56.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.123 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.503e-05 s, 0.0 kB/s 2023-10-09T11:38:56.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3242e-05 s, 0.0 kB/s 2023-10-09T11:38:56.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.238 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4421e-05 s, 0.0 kB/s 2023-10-09T11:38:56.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.295 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.352 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3763e-05 s, 0.0 kB/s 2023-10-09T11:38:56.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4793e-05 s, 0.0 kB/s 2023-10-09T11:38:56.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.409 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2699e-05 s, 0.0 kB/s 2023-10-09T11:38:56.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.465 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-09T11:38:56.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.523 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.579 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.579 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.579 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1775e-05 s, 0.0 kB/s 2023-10-09T11:38:56.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.579 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.636 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.637 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.637 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2854e-05 s, 0.0 kB/s 2023-10-09T11:38:56.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.638 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4339e-05 s, 0.0 kB/s 2023-10-09T11:38:56.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.694 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.8155e-05 s, 0.0 kB/s 2023-10-09T11:38:56.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.752 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.809 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.809 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.809 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7452e-05 s, 0.0 kB/s 2023-10-09T11:38:56.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.809 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.867 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5139e-05 s, 0.0 kB/s 2023-10-09T11:38:56.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.867 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.925 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.925 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.926 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5119e-05 s, 0.0 kB/s 2023-10-09T11:38:56.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.926 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:56.982 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.001e-05 s, 0.0 kB/s 2023-10-09T11:38:56.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:56.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3032e-05 s, 0.0 kB/s 2023-10-09T11:38:57.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.039 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.095 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4575e-05 s, 0.0 kB/s 2023-10-09T11:38:57.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.096 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.151 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5384e-05 s, 0.0 kB/s 2023-10-09T11:38:57.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9446e-05 s, 0.0 kB/s 2023-10-09T11:38:57.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.208 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3165e-05 s, 0.0 kB/s 2023-10-09T11:38:57.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.264 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5366e-05 s, 0.0 kB/s 2023-10-09T11:38:57.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.321 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.378 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3946e-05 s, 0.0 kB/s 2023-10-09T11:38:57.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.378 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.433 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.7676e-05 s, 0.0 kB/s 2023-10-09T11:38:57.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.434 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3378e-05 s, 0.0 kB/s 2023-10-09T11:38:57.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.490 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5688e-05 s, 0.0 kB/s 2023-10-09T11:38:57.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.546 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7105e-05 s, 0.0 kB/s 2023-10-09T11:38:57.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.659 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3919e-05 s, 0.0 kB/s 2023-10-09T11:38:57.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000139675 s, 0.0 kB/s 2023-10-09T11:38:57.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3071e-05 s, 0.0 kB/s 2023-10-09T11:38:57.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.773 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1595e-05 s, 0.0 kB/s 2023-10-09T11:38:57.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.829 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.885 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7537e-05 s, 0.0 kB/s 2023-10-09T11:38:57.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.886 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.942 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-09T11:38:57.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.942 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3016e-05 s, 0.0 kB/s 2023-10-09T11:38:57.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:57.999 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2183e-05 s, 0.0 kB/s 2023-10-09T11:38:58.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.055 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3545e-05 s, 0.0 kB/s 2023-10-09T11:38:58.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.111 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-09T11:38:58.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.168 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5031e-05 s, 0.0 kB/s 2023-10-09T11:38:58.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.224 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.280 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5015e-05 s, 0.0 kB/s 2023-10-09T11:38:58.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4992e-05 s, 0.0 kB/s 2023-10-09T11:38:58.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.339 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5138e-05 s, 0.0 kB/s 2023-10-09T11:38:58.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.397 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103469 s, 0.0 kB/s 2023-10-09T11:38:58.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.455 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5334e-05 s, 0.0 kB/s 2023-10-09T11:38:58.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.513 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.569 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0376e-05 s, 0.0 kB/s 2023-10-09T11:38:58.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.570 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.627 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.627 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.628 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5527e-05 s, 0.0 kB/s 2023-10-09T11:38:58.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.628 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4654e-05 s, 0.0 kB/s 2023-10-09T11:38:58.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.686 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6353e-05 s, 0.0 kB/s 2023-10-09T11:38:58.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.743 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.327e-05 s, 0.0 kB/s 2023-10-09T11:38:58.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.858 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.858 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.859 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6141e-05 s, 0.0 kB/s 2023-10-09T11:38:58.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.860 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7957e-05 s, 0.0 kB/s 2023-10-09T11:38:58.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.918 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:58.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:58.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:58.977 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5395e-05 s, 0.0 kB/s 2023-10-09T11:38:58.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:58.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4811e-05 s, 0.0 kB/s 2023-10-09T11:38:59.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.036 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5912e-05 s, 0.0 kB/s 2023-10-09T11:38:59.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.093 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.150 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.150 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.151 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4674e-05 s, 0.0 kB/s 2023-10-09T11:38:59.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.151 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6036e-05 s, 0.0 kB/s 2023-10-09T11:38:59.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.208 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6618e-05 s, 0.0 kB/s 2023-10-09T11:38:59.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.266 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.323 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.324 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7809e-05 s, 0.0 kB/s 2023-10-09T11:38:59.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.324 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0616e-05 s, 0.0 kB/s 2023-10-09T11:38:59.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.382 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.439 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.838e-05 s, 0.0 kB/s 2023-10-09T11:38:59.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.440 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.496 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000111635 s, 0.0 kB/s 2023-10-09T11:38:59.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.497 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.396e-05 s, 0.0 kB/s 2023-10-09T11:38:59.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.554 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.1031e-05 s, 0.0 kB/s 2023-10-09T11:38:59.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.611 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.668 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.579e-05 s, 0.0 kB/s 2023-10-09T11:38:59.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.668 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.544e-05 s, 0.0 kB/s 2023-10-09T11:38:59.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.725 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7205e-05 s, 0.0 kB/s 2023-10-09T11:38:59.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.783 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.839 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7322e-05 s, 0.0 kB/s 2023-10-09T11:38:59.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.840 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.897 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1911e-05 s, 0.0 kB/s 2023-10-09T11:38:59.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.897 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:38:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:38:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:38:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000124582 s, 0.0 kB/s 2023-10-09T11:38:59.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:38:59.955 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4719e-05 s, 0.0 kB/s 2023-10-09T11:39:00.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.012 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7222e-05 s, 0.0 kB/s 2023-10-09T11:39:00.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.070 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.126 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.126 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.126 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106516 s, 0.0 kB/s 2023-10-09T11:39:00.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.127 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.573e-05 s, 0.0 kB/s 2023-10-09T11:39:00.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5127e-05 s, 0.0 kB/s 2023-10-09T11:39:00.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.242 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7072e-05 s, 0.0 kB/s 2023-10-09T11:39:00.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.300 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.357 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.357 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.358 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7035e-05 s, 0.0 kB/s 2023-10-09T11:39:00.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.358 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.415 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.415 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.415 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9412e-05 s, 0.0 kB/s 2023-10-09T11:39:00.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.416 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.605e-05 s, 0.0 kB/s 2023-10-09T11:39:00.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.531 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.531 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3362e-05 s, 0.0 kB/s 2023-10-09T11:39:00.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.532 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.589 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4832e-05 s, 0.0 kB/s 2023-10-09T11:39:00.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.590 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9802e-05 s, 0.0 kB/s 2023-10-09T11:39:00.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.648 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.827e-05 s, 0.0 kB/s 2023-10-09T11:39:00.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.707 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.7208e-05 s, 0.0 kB/s 2023-10-09T11:39:00.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.766 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.824 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0682e-05 s, 0.0 kB/s 2023-10-09T11:39:00.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.824 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5453e-05 s, 0.0 kB/s 2023-10-09T11:39:00.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.882 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.940 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0139e-05 s, 0.0 kB/s 2023-10-09T11:39:00.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:00.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:00.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:00.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:00.998 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4605e-05 s, 0.0 kB/s 2023-10-09T11:39:00.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.001 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5479e-05 s, 0.0 kB/s 2023-10-09T11:39:01.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.057 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0878e-05 s, 0.0 kB/s 2023-10-09T11:39:01.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.115 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5819e-05 s, 0.0 kB/s 2023-10-09T11:39:01.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.173 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.229 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.229 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.230 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.0312e-05 s, 0.0 kB/s 2023-10-09T11:39:01.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.230 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.286 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.286 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.286 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2439e-05 s, 0.0 kB/s 2023-10-09T11:39:01.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.287 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.344 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6456e-05 s, 0.0 kB/s 2023-10-09T11:39:01.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.345 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.400 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2072e-05 s, 0.0 kB/s 2023-10-09T11:39:01.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.479 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4002e-05 s, 0.0 kB/s 2023-10-09T11:39:01.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4699e-05 s, 0.0 kB/s 2023-10-09T11:39:01.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.538 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4972e-05 s, 0.0 kB/s 2023-10-09T11:39:01.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.594 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.651 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5942e-05 s, 0.0 kB/s 2023-10-09T11:39:01.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.651 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.708 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5546e-05 s, 0.0 kB/s 2023-10-09T11:39:01.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.708 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.765 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3885e-05 s, 0.0 kB/s 2023-10-09T11:39:01.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.765 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6638e-05 s, 0.0 kB/s 2023-10-09T11:39:01.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4406e-05 s, 0.0 kB/s 2023-10-09T11:39:01.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.879 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9666e-05 s, 0.0 kB/s 2023-10-09T11:39:01.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:01.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:01.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:01.994 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4333e-05 s, 0.0 kB/s 2023-10-09T11:39:01.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:01.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4303e-05 s, 0.0 kB/s 2023-10-09T11:39:02.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.052 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6385e-05 s, 0.0 kB/s 2023-10-09T11:39:02.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.109 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9991e-05 s, 0.0 kB/s 2023-10-09T11:39:02.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.166 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.543e-05 s, 0.0 kB/s 2023-10-09T11:39:02.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.224 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101285 s, 0.0 kB/s 2023-10-09T11:39:02.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.280 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.337 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4035e-05 s, 0.0 kB/s 2023-10-09T11:39:02.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.338 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4656e-05 s, 0.0 kB/s 2023-10-09T11:39:02.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2819e-05 s, 0.0 kB/s 2023-10-09T11:39:02.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.452 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2272e-05 s, 0.0 kB/s 2023-10-09T11:39:02.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.509 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.513e-05 s, 0.0 kB/s 2023-10-09T11:39:02.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.566 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.623 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5892e-05 s, 0.0 kB/s 2023-10-09T11:39:02.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.623 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.680 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.344e-05 s, 0.0 kB/s 2023-10-09T11:39:02.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.680 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1531e-05 s, 0.0 kB/s 2023-10-09T11:39:02.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.736 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4863e-05 s, 0.0 kB/s 2023-10-09T11:39:02.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.793 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1841e-05 s, 0.0 kB/s 2023-10-09T11:39:02.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.849 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3348e-05 s, 0.0 kB/s 2023-10-09T11:39:02.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.905 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:02.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:02.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:02.960 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102946 s, 0.0 kB/s 2023-10-09T11:39:02.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:02.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7736e-05 s, 0.0 kB/s 2023-10-09T11:39:03.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.019 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9832e-05 s, 0.0 kB/s 2023-10-09T11:39:03.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.075 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.130 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.130 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.130 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7455e-05 s, 0.0 kB/s 2023-10-09T11:39:03.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.131 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8184e-05 s, 0.0 kB/s 2023-10-09T11:39:03.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.187 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1639e-05 s, 0.0 kB/s 2023-10-09T11:39:03.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.298 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3237e-05 s, 0.0 kB/s 2023-10-09T11:39:03.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.299 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.354 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1232e-05 s, 0.0 kB/s 2023-10-09T11:39:03.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.355 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.411 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.412 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.412 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2876e-05 s, 0.0 kB/s 2023-10-09T11:39:03.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.412 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3084e-05 s, 0.0 kB/s 2023-10-09T11:39:03.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.469 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1921e-05 s, 0.0 kB/s 2023-10-09T11:39:03.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.525 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.580 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.580 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.580 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6277e-05 s, 0.0 kB/s 2023-10-09T11:39:03.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.581 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.479e-05 s, 0.0 kB/s 2023-10-09T11:39:03.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.637 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3722e-05 s, 0.0 kB/s 2023-10-09T11:39:03.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.693 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2587e-05 s, 0.0 kB/s 2023-10-09T11:39:03.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.749 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1801e-05 s, 0.0 kB/s 2023-10-09T11:39:03.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.805 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.860 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7342e-05 s, 0.0 kB/s 2023-10-09T11:39:03.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.860 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5172e-05 s, 0.0 kB/s 2023-10-09T11:39:03.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.916 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:03.972 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:03.972 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:03.973 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9629e-05 s, 0.0 kB/s 2023-10-09T11:39:03.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:03.973 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.030 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3369e-05 s, 0.0 kB/s 2023-10-09T11:39:04.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.031 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.086 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4279e-05 s, 0.0 kB/s 2023-10-09T11:39:04.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.087 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.141 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.141 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1861e-05 s, 0.0 kB/s 2023-10-09T11:39:04.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.143 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.198 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.199 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.199 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3032e-05 s, 0.0 kB/s 2023-10-09T11:39:04.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.199 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2889e-05 s, 0.0 kB/s 2023-10-09T11:39:04.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.256 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4977e-05 s, 0.0 kB/s 2023-10-09T11:39:04.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.313 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3252e-05 s, 0.0 kB/s 2023-10-09T11:39:04.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.369 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1226e-05 s, 0.0 kB/s 2023-10-09T11:39:04.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.426 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2052e-05 s, 0.0 kB/s 2023-10-09T11:39:04.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.483 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.539 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7473e-05 s, 0.0 kB/s 2023-10-09T11:39:04.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.539 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.595 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.596 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2293e-05 s, 0.0 kB/s 2023-10-09T11:39:04.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.596 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2182e-05 s, 0.0 kB/s 2023-10-09T11:39:04.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.653 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3927e-05 s, 0.0 kB/s 2023-10-09T11:39:04.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.710 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1711e-05 s, 0.0 kB/s 2023-10-09T11:39:04.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.767 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-09T11:39:04.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0632e-05 s, 0.0 kB/s 2023-10-09T11:39:04.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.880 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-09T11:39:04.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2644e-05 s, 0.0 kB/s 2023-10-09T11:39:04.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:04.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5653e-05 s, 0.0 kB/s 2023-10-09T11:39:05.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2189e-05 s, 0.0 kB/s 2023-10-09T11:39:05.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.108 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3083e-05 s, 0.0 kB/s 2023-10-09T11:39:05.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.165 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4476e-05 s, 0.0 kB/s 2023-10-09T11:39:05.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.222 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2172e-05 s, 0.0 kB/s 2023-10-09T11:39:05.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.279 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.336 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9346e-05 s, 0.0 kB/s 2023-10-09T11:39:05.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.337 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.393 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4846e-05 s, 0.0 kB/s 2023-10-09T11:39:05.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.393 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3979e-05 s, 0.0 kB/s 2023-10-09T11:39:05.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.449 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.505 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-09T11:39:05.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.505 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3941e-05 s, 0.0 kB/s 2023-10-09T11:39:05.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.561 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2582e-05 s, 0.0 kB/s 2023-10-09T11:39:05.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7627e-05 s, 0.0 kB/s 2023-10-09T11:39:05.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.673 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3074e-05 s, 0.0 kB/s 2023-10-09T11:39:05.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.729 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.785 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1853e-05 s, 0.0 kB/s 2023-10-09T11:39:05.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.785 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.842 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2158e-05 s, 0.0 kB/s 2023-10-09T11:39:05.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.842 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5706e-05 s, 0.0 kB/s 2023-10-09T11:39:05.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2835e-05 s, 0.0 kB/s 2023-10-09T11:39:05.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:05.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3949e-05 s, 0.0 kB/s 2023-10-09T11:39:06.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.011 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1174e-05 s, 0.0 kB/s 2023-10-09T11:39:06.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4432e-05 s, 0.0 kB/s 2023-10-09T11:39:06.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.124 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.179 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4182e-05 s, 0.0 kB/s 2023-10-09T11:39:06.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.180 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.236 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000110112 s, 0.0 kB/s 2023-10-09T11:39:06.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3861e-05 s, 0.0 kB/s 2023-10-09T11:39:06.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.293 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5269e-05 s, 0.0 kB/s 2023-10-09T11:39:06.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.350 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.405 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6533e-05 s, 0.0 kB/s 2023-10-09T11:39:06.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.406 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1079e-05 s, 0.0 kB/s 2023-10-09T11:39:06.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.462 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3021e-05 s, 0.0 kB/s 2023-10-09T11:39:06.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.574 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2169e-05 s, 0.0 kB/s 2023-10-09T11:39:06.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.574 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3887e-05 s, 0.0 kB/s 2023-10-09T11:39:06.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1372e-05 s, 0.0 kB/s 2023-10-09T11:39:06.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.696 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0313e-05 s, 0.0 kB/s 2023-10-09T11:39:06.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.753 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.239e-05 s, 0.0 kB/s 2023-10-09T11:39:06.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.809 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.864 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.865 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.865 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0203e-05 s, 0.0 kB/s 2023-10-09T11:39:06.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.865 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.255e-05 s, 0.0 kB/s 2023-10-09T11:39:06.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.921 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:06.976 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:06.976 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:06.976 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7475e-05 s, 0.0 kB/s 2023-10-09T11:39:06.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:06.977 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.845e-05 s, 0.0 kB/s 2023-10-09T11:39:07.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.034 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.090 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.090 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2957e-05 s, 0.0 kB/s 2023-10-09T11:39:07.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.090 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9289e-05 s, 0.0 kB/s 2023-10-09T11:39:07.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.147 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.203 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.204 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1067e-05 s, 0.0 kB/s 2023-10-09T11:39:07.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.204 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2238e-05 s, 0.0 kB/s 2023-10-09T11:39:07.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.261 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4379e-05 s, 0.0 kB/s 2023-10-09T11:39:07.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.317 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5073e-05 s, 0.0 kB/s 2023-10-09T11:39:07.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.429 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4239e-05 s, 0.0 kB/s 2023-10-09T11:39:07.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.429 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1909e-05 s, 0.0 kB/s 2023-10-09T11:39:07.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.485 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.541 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2474e-05 s, 0.0 kB/s 2023-10-09T11:39:07.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.541 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4965e-05 s, 0.0 kB/s 2023-10-09T11:39:07.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3305e-05 s, 0.0 kB/s 2023-10-09T11:39:07.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.710 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.710 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.710 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2781e-05 s, 0.0 kB/s 2023-10-09T11:39:07.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.711 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-09T11:39:07.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.768 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4865e-05 s, 0.0 kB/s 2023-10-09T11:39:07.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.824 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2593e-05 s, 0.0 kB/s 2023-10-09T11:39:07.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.880 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7865e-05 s, 0.0 kB/s 2023-10-09T11:39:07.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:07.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:07.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:07.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5289e-05 s, 0.0 kB/s 2023-10-09T11:39:07.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:07.993 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3675e-05 s, 0.0 kB/s 2023-10-09T11:39:08.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.049 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8487e-05 s, 0.0 kB/s 2023-10-09T11:39:08.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.106 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.162 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1699e-05 s, 0.0 kB/s 2023-10-09T11:39:08.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.163 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1268e-05 s, 0.0 kB/s 2023-10-09T11:39:08.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.274 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.278e-05 s, 0.0 kB/s 2023-10-09T11:39:08.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.274 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4626e-05 s, 0.0 kB/s 2023-10-09T11:39:08.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.331 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.386 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.387 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.387 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5359e-05 s, 0.0 kB/s 2023-10-09T11:39:08.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.387 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9459e-05 s, 0.0 kB/s 2023-10-09T11:39:08.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.444 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.499 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.499 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.499 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3142e-05 s, 0.0 kB/s 2023-10-09T11:39:08.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.500 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.555 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4211e-05 s, 0.0 kB/s 2023-10-09T11:39:08.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.556 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.611 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.611 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7669e-05 s, 0.0 kB/s 2023-10-09T11:39:08.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.612 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.667 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-09T11:39:08.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.668 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.723 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6285e-05 s, 0.0 kB/s 2023-10-09T11:39:08.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.724 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5546e-05 s, 0.0 kB/s 2023-10-09T11:39:08.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.780 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.835 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5949e-05 s, 0.0 kB/s 2023-10-09T11:39:08.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.836 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.892 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3763e-05 s, 0.0 kB/s 2023-10-09T11:39:08.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.893 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:08.947 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:08.948 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:08.948 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5833e-05 s, 0.0 kB/s 2023-10-09T11:39:08.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:08.949 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.005 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.006 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.4111e-05 s, 0.0 kB/s 2023-10-09T11:39:09.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.006 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.061 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.061 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8302e-05 s, 0.0 kB/s 2023-10-09T11:39:09.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.062 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6539e-05 s, 0.0 kB/s 2023-10-09T11:39:09.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.119 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3999e-05 s, 0.0 kB/s 2023-10-09T11:39:09.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.175 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.231 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.232 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6102e-05 s, 0.0 kB/s 2023-10-09T11:39:09.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.232 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.288 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2525e-05 s, 0.0 kB/s 2023-10-09T11:39:09.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.289 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.345 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.345 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.345 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2925e-05 s, 0.0 kB/s 2023-10-09T11:39:09.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.345 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.402 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3668e-05 s, 0.0 kB/s 2023-10-09T11:39:09.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.402 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9837e-05 s, 0.0 kB/s 2023-10-09T11:39:09.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.460 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.516 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.516 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.516 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3933e-05 s, 0.0 kB/s 2023-10-09T11:39:09.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.517 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1044e-05 s, 0.0 kB/s 2023-10-09T11:39:09.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.574 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9847e-05 s, 0.0 kB/s 2023-10-09T11:39:09.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.630 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.686 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2492e-05 s, 0.0 kB/s 2023-10-09T11:39:09.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.686 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.742 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.743 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8732e-05 s, 0.0 kB/s 2023-10-09T11:39:09.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.743 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3356e-05 s, 0.0 kB/s 2023-10-09T11:39:09.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.857 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3167e-05 s, 0.0 kB/s 2023-10-09T11:39:09.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.915 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.403e-05 s, 0.0 kB/s 2023-10-09T11:39:09.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.916 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:09.971 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:09.972 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:09.972 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3504e-05 s, 0.0 kB/s 2023-10-09T11:39:09.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:09.972 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.029 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0405e-05 s, 0.0 kB/s 2023-10-09T11:39:10.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.029 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.086 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1524e-05 s, 0.0 kB/s 2023-10-09T11:39:10.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.086 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.143 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5925e-05 s, 0.0 kB/s 2023-10-09T11:39:10.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.144 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.201 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5285e-05 s, 0.0 kB/s 2023-10-09T11:39:10.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.202 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.258 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4643e-05 s, 0.0 kB/s 2023-10-09T11:39:10.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.258 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.315 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3226e-05 s, 0.0 kB/s 2023-10-09T11:39:10.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.315 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2142e-05 s, 0.0 kB/s 2023-10-09T11:39:10.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.371 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.428 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5315e-05 s, 0.0 kB/s 2023-10-09T11:39:10.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.428 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2815e-05 s, 0.0 kB/s 2023-10-09T11:39:10.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.485 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.541 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.5818e-05 s, 0.0 kB/s 2023-10-09T11:39:10.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.541 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9648e-05 s, 0.0 kB/s 2023-10-09T11:39:10.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104555 s, 0.0 kB/s 2023-10-09T11:39:10.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109509 s, 0.0 kB/s 2023-10-09T11:39:10.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.767 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.767 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4577e-05 s, 0.0 kB/s 2023-10-09T11:39:10.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.768 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2738e-05 s, 0.0 kB/s 2023-10-09T11:39:10.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.824 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.881 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6315e-05 s, 0.0 kB/s 2023-10-09T11:39:10.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2956e-05 s, 0.0 kB/s 2023-10-09T11:39:10.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1624e-05 s, 0.0 kB/s 2023-10-09T11:39:10.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:10.993 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.047 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2576e-05 s, 0.0 kB/s 2023-10-09T11:39:11.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.049 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.105 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6532e-05 s, 0.0 kB/s 2023-10-09T11:39:11.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.106 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2632e-05 s, 0.0 kB/s 2023-10-09T11:39:11.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.162 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9846e-05 s, 0.0 kB/s 2023-10-09T11:39:11.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.275 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.275 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.276 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-09T11:39:11.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.276 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7139e-05 s, 0.0 kB/s 2023-10-09T11:39:11.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.332 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.388 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.388 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.388 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.309e-05 s, 0.0 kB/s 2023-10-09T11:39:11.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.389 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.444 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.444 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.445 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4047e-05 s, 0.0 kB/s 2023-10-09T11:39:11.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.445 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-09T11:39:11.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.501 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.556 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.556 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.556 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1089e-05 s, 0.0 kB/s 2023-10-09T11:39:11.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.557 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.612 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.612 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.613 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.6418e-05 s, 0.0 kB/s 2023-10-09T11:39:11.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.613 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.668 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.669 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.669 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9281e-05 s, 0.0 kB/s 2023-10-09T11:39:11.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.669 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.724 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.724 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4819e-05 s, 0.0 kB/s 2023-10-09T11:39:11.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.725 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9198e-05 s, 0.0 kB/s 2023-10-09T11:39:11.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.807 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.864 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-09T11:39:11.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.864 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.919 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.919 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.920 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2352e-05 s, 0.0 kB/s 2023-10-09T11:39:11.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.920 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3435e-05 s, 0.0 kB/s 2023-10-09T11:39:11.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:11.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1077e-05 s, 0.0 kB/s 2023-10-09T11:39:12.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.032 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2441e-05 s, 0.0 kB/s 2023-10-09T11:39:12.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.088 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.143 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.189e-05 s, 0.0 kB/s 2023-10-09T11:39:12.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.143 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2477e-05 s, 0.0 kB/s 2023-10-09T11:39:12.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.200 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.257 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0419e-05 s, 0.0 kB/s 2023-10-09T11:39:12.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.257 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.314 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9819e-05 s, 0.0 kB/s 2023-10-09T11:39:12.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.314 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3516e-05 s, 0.0 kB/s 2023-10-09T11:39:12.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.371 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3522e-05 s, 0.0 kB/s 2023-10-09T11:39:12.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.428 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3085e-05 s, 0.0 kB/s 2023-10-09T11:39:12.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.540 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8959e-05 s, 0.0 kB/s 2023-10-09T11:39:12.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.541 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.596 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.596 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.596 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9465e-05 s, 0.0 kB/s 2023-10-09T11:39:12.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.597 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.654 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1196e-05 s, 0.0 kB/s 2023-10-09T11:39:12.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.654 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.710 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3486e-05 s, 0.0 kB/s 2023-10-09T11:39:12.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.710 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.117e-05 s, 0.0 kB/s 2023-10-09T11:39:12.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.766 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.821 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.821 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.821 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6089e-05 s, 0.0 kB/s 2023-10-09T11:39:12.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.822 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.879 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.879 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5144e-05 s, 0.0 kB/s 2023-10-09T11:39:12.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.879 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.935 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4123e-05 s, 0.0 kB/s 2023-10-09T11:39:12.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.935 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:12.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:12.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:12.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4819e-05 s, 0.0 kB/s 2023-10-09T11:39:12.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:12.992 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7812e-05 s, 0.0 kB/s 2023-10-09T11:39:13.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.048 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.103 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.103 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.104 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1758e-05 s, 0.0 kB/s 2023-10-09T11:39:13.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.104 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1638e-05 s, 0.0 kB/s 2023-10-09T11:39:13.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.160 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.215 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.216 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.216 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-09T11:39:13.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.216 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.272 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.273 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8896e-05 s, 0.0 kB/s 2023-10-09T11:39:13.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.273 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.330 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3111e-05 s, 0.0 kB/s 2023-10-09T11:39:13.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.330 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8263e-05 s, 0.0 kB/s 2023-10-09T11:39:13.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.386 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2654e-05 s, 0.0 kB/s 2023-10-09T11:39:13.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.442 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.499 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.499 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-09T11:39:13.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.499 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.555 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.556 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.556 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4556e-05 s, 0.0 kB/s 2023-10-09T11:39:13.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.556 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.612 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.613 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.613 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1341e-05 s, 0.0 kB/s 2023-10-09T11:39:13.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.613 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.669 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.669 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.669 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4503e-05 s, 0.0 kB/s 2023-10-09T11:39:13.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.670 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.0611e-05 s, 0.0 kB/s 2023-10-09T11:39:13.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.727 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0099e-05 s, 0.0 kB/s 2023-10-09T11:39:13.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.783 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.838 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.838 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.839 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.3404e-05 s, 0.0 kB/s 2023-10-09T11:39:13.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.839 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.895 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.895 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2477e-05 s, 0.0 kB/s 2023-10-09T11:39:13.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.896 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101849 s, 0.0 kB/s 2023-10-09T11:39:13.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:13.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0902e-05 s, 0.0 kB/s 2023-10-09T11:39:14.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8996e-05 s, 0.0 kB/s 2023-10-09T11:39:14.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.064 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2103e-05 s, 0.0 kB/s 2023-10-09T11:39:14.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.120 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.177 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.177 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8052e-05 s, 0.0 kB/s 2023-10-09T11:39:14.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.235 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1347e-05 s, 0.0 kB/s 2023-10-09T11:39:14.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.235 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.366e-05 s, 0.0 kB/s 2023-10-09T11:39:14.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.291 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3196e-05 s, 0.0 kB/s 2023-10-09T11:39:14.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.405 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3684e-05 s, 0.0 kB/s 2023-10-09T11:39:14.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.405 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7379e-05 s, 0.0 kB/s 2023-10-09T11:39:14.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.462 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.518 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4785e-05 s, 0.0 kB/s 2023-10-09T11:39:14.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.574 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.575 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5888e-05 s, 0.0 kB/s 2023-10-09T11:39:14.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.575 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9957e-05 s, 0.0 kB/s 2023-10-09T11:39:14.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000125666 s, 0.0 kB/s 2023-10-09T11:39:14.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.745 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4569e-05 s, 0.0 kB/s 2023-10-09T11:39:14.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.745 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000108826 s, 0.0 kB/s 2023-10-09T11:39:14.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.858 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101962 s, 0.0 kB/s 2023-10-09T11:39:14.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-09T11:39:14.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.915 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.5411e-05 s, 0.0 kB/s 2023-10-09T11:39:14.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:14.971 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1623e-05 s, 0.0 kB/s 2023-10-09T11:39:15.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.028 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.083 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5009e-05 s, 0.0 kB/s 2023-10-09T11:39:15.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.084 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.139 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4984e-05 s, 0.0 kB/s 2023-10-09T11:39:15.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.140 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1682e-05 s, 0.0 kB/s 2023-10-09T11:39:15.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.196 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-09T11:39:15.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.253 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.309 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6472e-05 s, 0.0 kB/s 2023-10-09T11:39:15.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.309 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4836e-05 s, 0.0 kB/s 2023-10-09T11:39:15.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.366 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.421 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.476e-05 s, 0.0 kB/s 2023-10-09T11:39:15.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-09T11:39:15.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.477 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.533 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5144e-05 s, 0.0 kB/s 2023-10-09T11:39:15.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.533 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.588 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.589 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.589 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2049e-05 s, 0.0 kB/s 2023-10-09T11:39:15.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.589 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.644 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1725e-05 s, 0.0 kB/s 2023-10-09T11:39:15.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.645 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.701 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-09T11:39:15.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.701 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.757 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.758 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.758 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-09T11:39:15.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.758 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.814 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3229e-05 s, 0.0 kB/s 2023-10-09T11:39:15.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.314e-05 s, 0.0 kB/s 2023-10-09T11:39:15.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.926 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1328e-05 s, 0.0 kB/s 2023-10-09T11:39:15.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.927 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6322e-05 s, 0.0 kB/s 2023-10-09T11:39:15.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:15.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.038 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.038 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.038 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T11:39:16.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.038 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.094 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.094 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.094 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0529e-05 s, 0.0 kB/s 2023-10-09T11:39:16.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.094 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.150 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.150 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.150 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6834e-05 s, 0.0 kB/s 2023-10-09T11:39:16.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.151 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4759e-05 s, 0.0 kB/s 2023-10-09T11:39:16.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.208 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3218e-05 s, 0.0 kB/s 2023-10-09T11:39:16.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.265 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1809e-05 s, 0.0 kB/s 2023-10-09T11:39:16.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.321 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0569e-05 s, 0.0 kB/s 2023-10-09T11:39:16.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.377 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1125e-05 s, 0.0 kB/s 2023-10-09T11:39:16.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.433 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8566e-05 s, 0.0 kB/s 2023-10-09T11:39:16.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.490 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-09T11:39:16.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.546 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000111925 s, 0.0 kB/s 2023-10-09T11:39:16.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.659 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.508e-05 s, 0.0 kB/s 2023-10-09T11:39:16.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8693e-05 s, 0.0 kB/s 2023-10-09T11:39:16.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.715 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.775 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.0527e-05 s, 0.0 kB/s 2023-10-09T11:39:16.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3744e-05 s, 0.0 kB/s 2023-10-09T11:39:16.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4849e-05 s, 0.0 kB/s 2023-10-09T11:39:16.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:16.959 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:16.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:16.960 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2222e-05 s, 0.0 kB/s 2023-10-09T11:39:16.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:16.960 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3167e-05 s, 0.0 kB/s 2023-10-09T11:39:17.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.084 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.084 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.085 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1911e-05 s, 0.0 kB/s 2023-10-09T11:39:17.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.085 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1496e-05 s, 0.0 kB/s 2023-10-09T11:39:17.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.145 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2989e-05 s, 0.0 kB/s 2023-10-09T11:39:17.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.206 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.271 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-09T11:39:17.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5317e-05 s, 0.0 kB/s 2023-10-09T11:39:17.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.330 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1569e-05 s, 0.0 kB/s 2023-10-09T11:39:17.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.388 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.447 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2324e-05 s, 0.0 kB/s 2023-10-09T11:39:17.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.447 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.505 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.505 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.404e-05 s, 0.0 kB/s 2023-10-09T11:39:17.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.506 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.563 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.563 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.564 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2354e-05 s, 0.0 kB/s 2023-10-09T11:39:17.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.564 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9672e-05 s, 0.0 kB/s 2023-10-09T11:39:17.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.619 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.675 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.675 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4548e-05 s, 0.0 kB/s 2023-10-09T11:39:17.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.675 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.731 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.731 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.731 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0862e-05 s, 0.0 kB/s 2023-10-09T11:39:17.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.732 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6429e-05 s, 0.0 kB/s 2023-10-09T11:39:17.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.788 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2621e-05 s, 0.0 kB/s 2023-10-09T11:39:17.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.843 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.899 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-09T11:39:17.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.900 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:17.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:17.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:17.956 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2231e-05 s, 0.0 kB/s 2023-10-09T11:39:17.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:17.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3104e-05 s, 0.0 kB/s 2023-10-09T11:39:18.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.068 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1938e-05 s, 0.0 kB/s 2023-10-09T11:39:18.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1658e-05 s, 0.0 kB/s 2023-10-09T11:39:18.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.3682e-05 s, 0.0 kB/s 2023-10-09T11:39:18.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.182 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4912e-05 s, 0.0 kB/s 2023-10-09T11:39:18.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-09T11:39:18.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.294 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1833e-05 s, 0.0 kB/s 2023-10-09T11:39:18.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.352 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2419e-05 s, 0.0 kB/s 2023-10-09T11:39:18.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.408 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.463 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.463 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.463 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0386e-05 s, 0.0 kB/s 2023-10-09T11:39:18.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.464 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.520 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4292e-05 s, 0.0 kB/s 2023-10-09T11:39:18.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.520 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.578 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.363e-05 s, 0.0 kB/s 2023-10-09T11:39:18.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.578 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1296e-05 s, 0.0 kB/s 2023-10-09T11:39:18.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.634 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7432e-05 s, 0.0 kB/s 2023-10-09T11:39:18.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.691 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3622e-05 s, 0.0 kB/s 2023-10-09T11:39:18.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.748 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.803 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5051e-05 s, 0.0 kB/s 2023-10-09T11:39:18.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.803 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3539e-05 s, 0.0 kB/s 2023-10-09T11:39:18.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.861 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.918 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-09T11:39:18.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2246e-05 s, 0.0 kB/s 2023-10-09T11:39:18.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:18.975 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.031 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.884e-05 s, 0.0 kB/s 2023-10-09T11:39:19.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.031 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-09T11:39:19.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.087 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000117838 s, 0.0 kB/s 2023-10-09T11:39:19.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.143 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.199 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.200 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1915e-05 s, 0.0 kB/s 2023-10-09T11:39:19.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.200 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4735e-05 s, 0.0 kB/s 2023-10-09T11:39:19.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.256 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.313 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.313 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6755e-05 s, 0.0 kB/s 2023-10-09T11:39:19.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.313 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000115058 s, 0.0 kB/s 2023-10-09T11:39:19.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.371 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.426 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2999e-05 s, 0.0 kB/s 2023-10-09T11:39:19.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.427 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2375e-05 s, 0.0 kB/s 2023-10-09T11:39:19.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2662e-05 s, 0.0 kB/s 2023-10-09T11:39:19.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.540 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.599 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4513e-05 s, 0.0 kB/s 2023-10-09T11:39:19.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.599 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3951e-05 s, 0.0 kB/s 2023-10-09T11:39:19.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4786e-05 s, 0.0 kB/s 2023-10-09T11:39:19.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8029e-05 s, 0.0 kB/s 2023-10-09T11:39:19.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.769 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2437e-05 s, 0.0 kB/s 2023-10-09T11:39:19.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.826 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.881 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2667e-05 s, 0.0 kB/s 2023-10-09T11:39:19.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.882 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.937 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4563e-05 s, 0.0 kB/s 2023-10-09T11:39:19.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.938 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:19.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1152e-05 s, 0.0 kB/s 2023-10-09T11:39:19.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:19.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3559e-05 s, 0.0 kB/s 2023-10-09T11:39:20.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.106 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.106 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3183e-05 s, 0.0 kB/s 2023-10-09T11:39:20.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.107 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.162 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.404e-05 s, 0.0 kB/s 2023-10-09T11:39:20.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.163 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.218 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.156e-05 s, 0.0 kB/s 2023-10-09T11:39:20.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.274 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3168e-05 s, 0.0 kB/s 2023-10-09T11:39:20.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.275 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.333 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.592e-05 s, 0.0 kB/s 2023-10-09T11:39:20.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.334 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.390 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.284e-05 s, 0.0 kB/s 2023-10-09T11:39:20.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.391 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4199e-05 s, 0.0 kB/s 2023-10-09T11:39:20.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.448 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-09T11:39:20.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.504 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.559 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104852 s, 0.0 kB/s 2023-10-09T11:39:20.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.560 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9495e-05 s, 0.0 kB/s 2023-10-09T11:39:20.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.673 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2702e-05 s, 0.0 kB/s 2023-10-09T11:39:20.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6479e-05 s, 0.0 kB/s 2023-10-09T11:39:20.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.730 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.786 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2557e-05 s, 0.0 kB/s 2023-10-09T11:39:20.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.787 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.842 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6369e-05 s, 0.0 kB/s 2023-10-09T11:39:20.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.843 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.900 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4407e-05 s, 0.0 kB/s 2023-10-09T11:39:20.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.900 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:20.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:20.956 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9698e-05 s, 0.0 kB/s 2023-10-09T11:39:20.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:20.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-09T11:39:21.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000115956 s, 0.0 kB/s 2023-10-09T11:39:21.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0538e-05 s, 0.0 kB/s 2023-10-09T11:39:21.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 2.9179e-05 s, 0.0 kB/s 2023-10-09T11:39:21.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.182 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0259e-05 s, 0.0 kB/s 2023-10-09T11:39:21.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.238 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.417e-05 s, 0.0 kB/s 2023-10-09T11:39:21.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.293 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.284e-05 s, 0.0 kB/s 2023-10-09T11:39:21.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.350 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7115e-05 s, 0.0 kB/s 2023-10-09T11:39:21.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.407 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000110491 s, 0.0 kB/s 2023-10-09T11:39:21.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.463 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101289 s, 0.0 kB/s 2023-10-09T11:39:21.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.520 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2904e-05 s, 0.0 kB/s 2023-10-09T11:39:21.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.577 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2898e-05 s, 0.0 kB/s 2023-10-09T11:39:21.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.633 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3244e-05 s, 0.0 kB/s 2023-10-09T11:39:21.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.745 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3916e-05 s, 0.0 kB/s 2023-10-09T11:39:21.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.745 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7673e-05 s, 0.0 kB/s 2023-10-09T11:39:21.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.800 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.945e-05 s, 0.0 kB/s 2023-10-09T11:39:21.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.856 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6242e-05 s, 0.0 kB/s 2023-10-09T11:39:21.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.913 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.347e-05 s, 0.0 kB/s 2023-10-09T11:39:21.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:21.969 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7835e-05 s, 0.0 kB/s 2023-10-09T11:39:22.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.107 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2516e-05 s, 0.0 kB/s 2023-10-09T11:39:22.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.108 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5988e-05 s, 0.0 kB/s 2023-10-09T11:39:22.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.164 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2811e-05 s, 0.0 kB/s 2023-10-09T11:39:22.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.221 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.473e-05 s, 0.0 kB/s 2023-10-09T11:39:22.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.277 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.334 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.334 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.334 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3979e-05 s, 0.0 kB/s 2023-10-09T11:39:22.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.335 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.391 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.391 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1472e-05 s, 0.0 kB/s 2023-10-09T11:39:22.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.392 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.447 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1522e-05 s, 0.0 kB/s 2023-10-09T11:39:22.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.448 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2533e-05 s, 0.0 kB/s 2023-10-09T11:39:22.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.505 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.560 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.00011613 s, 0.0 kB/s 2023-10-09T11:39:22.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.561 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.616 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4091e-05 s, 0.0 kB/s 2023-10-09T11:39:22.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.616 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.672 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.672 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3816e-05 s, 0.0 kB/s 2023-10-09T11:39:22.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.673 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7499e-05 s, 0.0 kB/s 2023-10-09T11:39:22.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.729 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.785 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106948 s, 0.0 kB/s 2023-10-09T11:39:22.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.786 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.842 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1382e-05 s, 0.0 kB/s 2023-10-09T11:39:22.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.843 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2447e-05 s, 0.0 kB/s 2023-10-09T11:39:22.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.899 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2028e-05 s, 0.0 kB/s 2023-10-09T11:39:22.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:22.955 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.011 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1845e-05 s, 0.0 kB/s 2023-10-09T11:39:23.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.011 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4103e-05 s, 0.0 kB/s 2023-10-09T11:39:23.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4866e-05 s, 0.0 kB/s 2023-10-09T11:39:23.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4817e-05 s, 0.0 kB/s 2023-10-09T11:39:23.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-09T11:39:23.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000118279 s, 0.0 kB/s 2023-10-09T11:39:23.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.294 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6031e-05 s, 0.0 kB/s 2023-10-09T11:39:23.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.351 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.407 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7281e-05 s, 0.0 kB/s 2023-10-09T11:39:23.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.407 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.463 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.463 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.463 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5283e-05 s, 0.0 kB/s 2023-10-09T11:39:23.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.464 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3112e-05 s, 0.0 kB/s 2023-10-09T11:39:23.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.520 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-09T11:39:23.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.577 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.632 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.138e-05 s, 0.0 kB/s 2023-10-09T11:39:23.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.633 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3889e-05 s, 0.0 kB/s 2023-10-09T11:39:23.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.690 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.745 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.745 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.745 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2438e-05 s, 0.0 kB/s 2023-10-09T11:39:23.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.745 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8265e-05 s, 0.0 kB/s 2023-10-09T11:39:23.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.802 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.857 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1449e-05 s, 0.0 kB/s 2023-10-09T11:39:23.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.913 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.914 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1739e-05 s, 0.0 kB/s 2023-10-09T11:39:23.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.914 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:23.970 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:23.970 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4089e-05 s, 0.0 kB/s 2023-10-09T11:39:23.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:23.971 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2039e-05 s, 0.0 kB/s 2023-10-09T11:39:24.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.028 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4356e-05 s, 0.0 kB/s 2023-10-09T11:39:24.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.085 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.140 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.140 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.140 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-09T11:39:24.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.140 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9456e-05 s, 0.0 kB/s 2023-10-09T11:39:24.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.253 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1659e-05 s, 0.0 kB/s 2023-10-09T11:39:24.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.254 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.310 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7409e-05 s, 0.0 kB/s 2023-10-09T11:39:24.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.310 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.367 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2867e-05 s, 0.0 kB/s 2023-10-09T11:39:24.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.423 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-09T11:39:24.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2294e-05 s, 0.0 kB/s 2023-10-09T11:39:24.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.481 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.535 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.535 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.535 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-09T11:39:24.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4335e-05 s, 0.0 kB/s 2023-10-09T11:39:24.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.592 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7852e-05 s, 0.0 kB/s 2023-10-09T11:39:24.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.648 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1256e-05 s, 0.0 kB/s 2023-10-09T11:39:24.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.704 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2993e-05 s, 0.0 kB/s 2023-10-09T11:39:24.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7822e-05 s, 0.0 kB/s 2023-10-09T11:39:24.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2896e-05 s, 0.0 kB/s 2023-10-09T11:39:24.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.872 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.928 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-09T11:39:24.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.929 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7496e-05 s, 0.0 kB/s 2023-10-09T11:39:24.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:24.985 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2039e-05 s, 0.0 kB/s 2023-10-09T11:39:25.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2159e-05 s, 0.0 kB/s 2023-10-09T11:39:25.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.098 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106626 s, 0.0 kB/s 2023-10-09T11:39:25.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.154 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2989e-05 s, 0.0 kB/s 2023-10-09T11:39:25.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.211 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1814e-05 s, 0.0 kB/s 2023-10-09T11:39:25.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.266 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.322 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.322 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8239e-05 s, 0.0 kB/s 2023-10-09T11:39:25.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.323 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2206e-05 s, 0.0 kB/s 2023-10-09T11:39:25.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.380 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.436 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3501e-05 s, 0.0 kB/s 2023-10-09T11:39:25.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.436 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.492 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.492 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8831e-05 s, 0.0 kB/s 2023-10-09T11:39:25.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.493 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.547 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.548 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.548 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4649e-05 s, 0.0 kB/s 2023-10-09T11:39:25.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.548 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.604 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.604 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.604 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4029e-05 s, 0.0 kB/s 2023-10-09T11:39:25.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.605 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:25.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:25.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.660 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.660 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7528e-05 s, 0.0 kB/s 2023-10-09T11:39:25.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.661 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.718 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3014e-05 s, 0.0 kB/s 2023-10-09T11:39:25.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.719 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.396e-05 s, 0.0 kB/s 2023-10-09T11:39:25.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.830 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.830 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.831 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6321e-05 s, 0.0 kB/s 2023-10-09T11:39:25.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.831 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.144e-05 s, 0.0 kB/s 2023-10-09T11:39:25.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.887 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.942 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-09T11:39:25.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.942 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:25.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:25.999 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:25.999 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6399e-05 s, 0.0 kB/s 2023-10-09T11:39:25.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:25.999 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.056 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1884e-05 s, 0.0 kB/s 2023-10-09T11:39:26.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.056 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3545e-05 s, 0.0 kB/s 2023-10-09T11:39:26.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.113 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.168 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8202e-05 s, 0.0 kB/s 2023-10-09T11:39:26.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.169 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.224 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4033e-05 s, 0.0 kB/s 2023-10-09T11:39:26.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.225 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109604 s, 0.0 kB/s 2023-10-09T11:39:26.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.282 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.176e-05 s, 0.0 kB/s 2023-10-09T11:39:26.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.339 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3149e-05 s, 0.0 kB/s 2023-10-09T11:39:26.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.396 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.452 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.452 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7515e-05 s, 0.0 kB/s 2023-10-09T11:39:26.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.453 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4629e-05 s, 0.0 kB/s 2023-10-09T11:39:26.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.510 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.565 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.565 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3787e-05 s, 0.0 kB/s 2023-10-09T11:39:26.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.566 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1313e-05 s, 0.0 kB/s 2023-10-09T11:39:26.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.621 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1971e-05 s, 0.0 kB/s 2023-10-09T11:39:26.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.679 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9905e-05 s, 0.0 kB/s 2023-10-09T11:39:26.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.846 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.864 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.865 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.865 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5856e-05 s, 0.0 kB/s 2023-10-09T11:39:26.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.866 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6555e-05 s, 0.0 kB/s 2023-10-09T11:39:26.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.931 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:26.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:26.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-09T11:39:26.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:26.992 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.050 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5071e-05 s, 0.0 kB/s 2023-10-09T11:39:27.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.109 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.109 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.109 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8776e-05 s, 0.0 kB/s 2023-10-09T11:39:27.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.109 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7672e-05 s, 0.0 kB/s 2023-10-09T11:39:27.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.166 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.221 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.222 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2212e-05 s, 0.0 kB/s 2023-10-09T11:39:27.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.222 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.277 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.448e-05 s, 0.0 kB/s 2023-10-09T11:39:27.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.278 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.334 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9182e-05 s, 0.0 kB/s 2023-10-09T11:39:27.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.334 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.758e-05 s, 0.0 kB/s 2023-10-09T11:39:27.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.390 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6402e-05 s, 0.0 kB/s 2023-10-09T11:39:27.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.447 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.503 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.503 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4409e-05 s, 0.0 kB/s 2023-10-09T11:39:27.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.503 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2885e-05 s, 0.0 kB/s 2023-10-09T11:39:27.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.560 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.616 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.617 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7852e-05 s, 0.0 kB/s 2023-10-09T11:39:27.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.617 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2152e-05 s, 0.0 kB/s 2023-10-09T11:39:27.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.728 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.728 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5665e-05 s, 0.0 kB/s 2023-10-09T11:39:27.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.730 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3766e-05 s, 0.0 kB/s 2023-10-09T11:39:27.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.786 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4166e-05 s, 0.0 kB/s 2023-10-09T11:39:27.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.842 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-09T11:39:27.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:27.953 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3293e-05 s, 0.0 kB/s 2023-10-09T11:39:27.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:27.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.174e-05 s, 0.0 kB/s 2023-10-09T11:39:28.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.009 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109296 s, 0.0 kB/s 2023-10-09T11:39:28.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.066 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2195e-05 s, 0.0 kB/s 2023-10-09T11:39:28.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.121 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.204 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.204 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3544e-05 s, 0.0 kB/s 2023-10-09T11:39:28.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.205 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2845e-05 s, 0.0 kB/s 2023-10-09T11:39:28.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.260 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8319e-05 s, 0.0 kB/s 2023-10-09T11:39:28.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.317 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3049e-05 s, 0.0 kB/s 2023-10-09T11:39:28.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.428 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9722e-05 s, 0.0 kB/s 2023-10-09T11:39:28.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.429 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6935e-05 s, 0.0 kB/s 2023-10-09T11:39:28.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4221e-05 s, 0.0 kB/s 2023-10-09T11:39:28.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.542 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1894e-05 s, 0.0 kB/s 2023-10-09T11:39:28.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3705e-05 s, 0.0 kB/s 2023-10-09T11:39:28.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.654 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.709 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3783e-05 s, 0.0 kB/s 2023-10-09T11:39:28.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.710 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.766 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.469e-05 s, 0.0 kB/s 2023-10-09T11:39:28.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.769 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.822 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3167e-05 s, 0.0 kB/s 2023-10-09T11:39:28.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7675e-05 s, 0.0 kB/s 2023-10-09T11:39:28.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.879 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3515e-05 s, 0.0 kB/s 2023-10-09T11:39:28.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:28.991 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5558e-05 s, 0.0 kB/s 2023-10-09T11:39:28.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:28.992 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.048 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.048 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9851e-05 s, 0.0 kB/s 2023-10-09T11:39:29.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.049 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.105 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.105 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5847e-05 s, 0.0 kB/s 2023-10-09T11:39:29.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.106 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1629e-05 s, 0.0 kB/s 2023-10-09T11:39:29.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.162 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.218 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.219 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1769e-05 s, 0.0 kB/s 2023-10-09T11:39:29.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.274 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.275 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.3799e-05 s, 0.0 kB/s 2023-10-09T11:39:29.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.275 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6989e-05 s, 0.0 kB/s 2023-10-09T11:39:29.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.332 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.257e-05 s, 0.0 kB/s 2023-10-09T11:39:29.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.389 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0987e-05 s, 0.0 kB/s 2023-10-09T11:39:29.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.445 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4259e-05 s, 0.0 kB/s 2023-10-09T11:39:29.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.501 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.557 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.558 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.558 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4727e-05 s, 0.0 kB/s 2023-10-09T11:39:29.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.558 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2537e-05 s, 0.0 kB/s 2023-10-09T11:39:29.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.614 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.670 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.670 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.670 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4591e-05 s, 0.0 kB/s 2023-10-09T11:39:29.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.671 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.727 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2966e-05 s, 0.0 kB/s 2023-10-09T11:39:29.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2346e-05 s, 0.0 kB/s 2023-10-09T11:39:29.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.784 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.839 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.0715e-05 s, 0.0 kB/s 2023-10-09T11:39:29.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.840 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.895 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.895 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.895 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4742e-05 s, 0.0 kB/s 2023-10-09T11:39:29.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.896 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.394e-05 s, 0.0 kB/s 2023-10-09T11:39:29.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:29.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.199e-05 s, 0.0 kB/s 2023-10-09T11:39:30.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.007 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.063 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.064 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1725e-05 s, 0.0 kB/s 2023-10-09T11:39:30.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.064 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.123 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0972e-05 s, 0.0 kB/s 2023-10-09T11:39:30.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.124 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.3716e-05 s, 0.0 kB/s 2023-10-09T11:39:30.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.186 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2163e-05 s, 0.0 kB/s 2023-10-09T11:39:30.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.249 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4037e-05 s, 0.0 kB/s 2023-10-09T11:39:30.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.368 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.368 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4254e-05 s, 0.0 kB/s 2023-10-09T11:39:30.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.369 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.426 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.426 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1879e-05 s, 0.0 kB/s 2023-10-09T11:39:30.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.427 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3148e-05 s, 0.0 kB/s 2023-10-09T11:39:30.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.501 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.567 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4638e-05 s, 0.0 kB/s 2023-10-09T11:39:30.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5296e-05 s, 0.0 kB/s 2023-10-09T11:39:30.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.688 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8973e-05 s, 0.0 kB/s 2023-10-09T11:39:30.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.689 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4077e-05 s, 0.0 kB/s 2023-10-09T11:39:30.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.750 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3172e-05 s, 0.0 kB/s 2023-10-09T11:39:30.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7545e-05 s, 0.0 kB/s 2023-10-09T11:39:30.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.876 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4268e-05 s, 0.0 kB/s 2023-10-09T11:39:30.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:30.942 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.000 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9723e-05 s, 0.0 kB/s 2023-10-09T11:39:31.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.001 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.058 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.058 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4015e-05 s, 0.0 kB/s 2023-10-09T11:39:31.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.059 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5246e-05 s, 0.0 kB/s 2023-10-09T11:39:31.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.117 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6851e-05 s, 0.0 kB/s 2023-10-09T11:39:31.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.185 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.243 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7305e-05 s, 0.0 kB/s 2023-10-09T11:39:31.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.244 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.301 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.302 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5339e-05 s, 0.0 kB/s 2023-10-09T11:39:31.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.303 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5825e-05 s, 0.0 kB/s 2023-10-09T11:39:31.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.361 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4033e-05 s, 0.0 kB/s 2023-10-09T11:39:31.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2038e-05 s, 0.0 kB/s 2023-10-09T11:39:31.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.536 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.484e-05 s, 0.0 kB/s 2023-10-09T11:39:31.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.537 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-09T11:39:31.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.659 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2591e-05 s, 0.0 kB/s 2023-10-09T11:39:31.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.716 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.716 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0245e-05 s, 0.0 kB/s 2023-10-09T11:39:31.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.777 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2964e-05 s, 0.0 kB/s 2023-10-09T11:39:31.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.777 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.834 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.834 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1585e-05 s, 0.0 kB/s 2023-10-09T11:39:31.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.834 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.891 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.891 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.891 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2618e-05 s, 0.0 kB/s 2023-10-09T11:39:31.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.892 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:31.949 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-09T11:39:31.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:31.950 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8299e-05 s, 0.0 kB/s 2023-10-09T11:39:32.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.007 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4532e-05 s, 0.0 kB/s 2023-10-09T11:39:32.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.071 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.128 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.128 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1534e-05 s, 0.0 kB/s 2023-10-09T11:39:32.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.128 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.184 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.185 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101046 s, 0.0 kB/s 2023-10-09T11:39:32.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.185 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6781e-05 s, 0.0 kB/s 2023-10-09T11:39:32.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.244 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.301 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7342e-05 s, 0.0 kB/s 2023-10-09T11:39:32.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3226e-05 s, 0.0 kB/s 2023-10-09T11:39:32.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.359 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7795e-05 s, 0.0 kB/s 2023-10-09T11:39:32.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7226e-05 s, 0.0 kB/s 2023-10-09T11:39:32.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.477 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8612e-05 s, 0.0 kB/s 2023-10-09T11:39:32.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.592 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.592 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8995e-05 s, 0.0 kB/s 2023-10-09T11:39:32.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.593 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.651 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.651 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3016e-05 s, 0.0 kB/s 2023-10-09T11:39:32.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.652 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3884e-05 s, 0.0 kB/s 2023-10-09T11:39:32.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.710 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4471e-05 s, 0.0 kB/s 2023-10-09T11:39:32.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.769 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.826 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0846e-05 s, 0.0 kB/s 2023-10-09T11:39:32.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.827 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.884 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7995e-05 s, 0.0 kB/s 2023-10-09T11:39:32.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.885 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:32.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:32.943 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4045e-05 s, 0.0 kB/s 2023-10-09T11:39:32.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:32.944 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8572e-05 s, 0.0 kB/s 2023-10-09T11:39:33.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.005 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8265e-05 s, 0.0 kB/s 2023-10-09T11:39:33.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.065 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9152e-05 s, 0.0 kB/s 2023-10-09T11:39:33.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5239e-05 s, 0.0 kB/s 2023-10-09T11:39:33.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000111112 s, 0.0 kB/s 2023-10-09T11:39:33.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000108651 s, 0.0 kB/s 2023-10-09T11:39:33.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.302 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.5992e-05 s, 0.0 kB/s 2023-10-09T11:39:33.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6092e-05 s, 0.0 kB/s 2023-10-09T11:39:33.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6687e-05 s, 0.0 kB/s 2023-10-09T11:39:33.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.538 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6394e-05 s, 0.0 kB/s 2023-10-09T11:39:33.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.539 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9708e-05 s, 0.0 kB/s 2023-10-09T11:39:33.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.598 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5247e-05 s, 0.0 kB/s 2023-10-09T11:39:33.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.657 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7996e-05 s, 0.0 kB/s 2023-10-09T11:39:33.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3445e-05 s, 0.0 kB/s 2023-10-09T11:39:33.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3465e-05 s, 0.0 kB/s 2023-10-09T11:39:33.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.836 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.893 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3204e-05 s, 0.0 kB/s 2023-10-09T11:39:33.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.893 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4266e-05 s, 0.0 kB/s 2023-10-09T11:39:33.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:33.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8832e-05 s, 0.0 kB/s 2023-10-09T11:39:34.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.011 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109275 s, 0.0 kB/s 2023-10-09T11:39:34.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.069 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7614e-05 s, 0.0 kB/s 2023-10-09T11:39:34.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.128 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1812e-05 s, 0.0 kB/s 2023-10-09T11:39:34.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.187 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.245 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.245 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.245 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000124765 s, 0.0 kB/s 2023-10-09T11:39:34.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.246 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.302 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1398e-05 s, 0.0 kB/s 2023-10-09T11:39:34.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.304 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4092e-05 s, 0.0 kB/s 2023-10-09T11:39:34.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.360 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3696e-05 s, 0.0 kB/s 2023-10-09T11:39:34.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.417 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.116e-05 s, 0.0 kB/s 2023-10-09T11:39:34.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.475 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.530 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.406e-05 s, 0.0 kB/s 2023-10-09T11:39:34.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.531 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2536e-05 s, 0.0 kB/s 2023-10-09T11:39:34.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.643 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4844e-05 s, 0.0 kB/s 2023-10-09T11:39:34.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0559e-05 s, 0.0 kB/s 2023-10-09T11:39:34.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8695e-05 s, 0.0 kB/s 2023-10-09T11:39:34.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.757 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2544e-05 s, 0.0 kB/s 2023-10-09T11:39:34.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4468e-05 s, 0.0 kB/s 2023-10-09T11:39:34.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2824e-05 s, 0.0 kB/s 2023-10-09T11:39:34.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.928 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:34.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:34.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:34.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2088e-05 s, 0.0 kB/s 2023-10-09T11:39:34.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:34.985 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.502e-05 s, 0.0 kB/s 2023-10-09T11:39:35.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.041 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.198e-05 s, 0.0 kB/s 2023-10-09T11:39:35.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.098 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.152 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.153 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.153 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3189e-05 s, 0.0 kB/s 2023-10-09T11:39:35.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.154 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4586e-05 s, 0.0 kB/s 2023-10-09T11:39:35.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.211 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3459e-05 s, 0.0 kB/s 2023-10-09T11:39:35.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.269 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.325 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.325 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2165e-05 s, 0.0 kB/s 2023-10-09T11:39:35.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.326 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7642e-05 s, 0.0 kB/s 2023-10-09T11:39:35.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.383 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.438 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.439 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5457e-05 s, 0.0 kB/s 2023-10-09T11:39:35.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.439 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.495 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0902e-05 s, 0.0 kB/s 2023-10-09T11:39:35.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.496 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.6582e-05 s, 0.0 kB/s 2023-10-09T11:39:35.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.553 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4616e-05 s, 0.0 kB/s 2023-10-09T11:39:35.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.610 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2619e-05 s, 0.0 kB/s 2023-10-09T11:39:35.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.667 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.724 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.724 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.724 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.1027e-05 s, 0.0 kB/s 2023-10-09T11:39:35.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.724 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-09T11:39:35.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.837 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3672e-05 s, 0.0 kB/s 2023-10-09T11:39:35.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.838 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6129e-05 s, 0.0 kB/s 2023-10-09T11:39:35.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.895 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:35.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:35.951 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:35.951 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4428e-05 s, 0.0 kB/s 2023-10-09T11:39:35.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:35.952 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.006 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2403e-05 s, 0.0 kB/s 2023-10-09T11:39:36.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6712e-05 s, 0.0 kB/s 2023-10-09T11:39:36.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.065 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0315e-05 s, 0.0 kB/s 2023-10-09T11:39:36.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.121 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9872e-05 s, 0.0 kB/s 2023-10-09T11:39:36.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.233 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1196e-05 s, 0.0 kB/s 2023-10-09T11:39:36.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.233 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6255e-05 s, 0.0 kB/s 2023-10-09T11:39:36.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.290 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9759e-05 s, 0.0 kB/s 2023-10-09T11:39:36.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.347 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.402 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.402 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.402 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5679e-05 s, 0.0 kB/s 2023-10-09T11:39:36.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.403 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.459 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.459 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3891e-05 s, 0.0 kB/s 2023-10-09T11:39:36.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.460 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.515 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.516 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0462e-05 s, 0.0 kB/s 2023-10-09T11:39:36.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.516 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2523e-05 s, 0.0 kB/s 2023-10-09T11:39:36.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.571 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.627 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.627 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.0211e-05 s, 0.0 kB/s 2023-10-09T11:39:36.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.628 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2419e-05 s, 0.0 kB/s 2023-10-09T11:39:36.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.685 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4249e-05 s, 0.0 kB/s 2023-10-09T11:39:36.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.741 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2194e-05 s, 0.0 kB/s 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2991e-05 s, 0.0 kB/s 2023-10-09T11:39:36.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.853 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.908 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.909 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2429e-05 s, 0.0 kB/s 2023-10-09T11:39:36.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.910 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4365e-05 s, 0.0 kB/s 2023-10-09T11:39:36.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:36.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.023 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.5505e-05 s, 0.0 kB/s 2023-10-09T11:39:37.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.024 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.079 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2215e-05 s, 0.0 kB/s 2023-10-09T11:39:37.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.135 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.063e-05 s, 0.0 kB/s 2023-10-09T11:39:37.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.191 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.191 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.191 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9622e-05 s, 0.0 kB/s 2023-10-09T11:39:37.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.192 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1511e-05 s, 0.0 kB/s 2023-10-09T11:39:37.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.248 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.303 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.303 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.303 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8899e-05 s, 0.0 kB/s 2023-10-09T11:39:37.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.304 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.8058e-05 s, 0.0 kB/s 2023-10-09T11:39:37.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.361 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.417 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-09T11:39:37.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.418 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.473 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2046e-05 s, 0.0 kB/s 2023-10-09T11:39:37.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1316e-05 s, 0.0 kB/s 2023-10-09T11:39:37.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0975e-05 s, 0.0 kB/s 2023-10-09T11:39:37.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.643 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.644 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.644 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.55e-05 s, 0.0 kB/s 2023-10-09T11:39:37.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.644 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2302e-05 s, 0.0 kB/s 2023-10-09T11:39:37.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4566e-05 s, 0.0 kB/s 2023-10-09T11:39:37.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.757 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.812 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.813 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3532e-05 s, 0.0 kB/s 2023-10-09T11:39:37.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2888e-05 s, 0.0 kB/s 2023-10-09T11:39:37.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-09T11:39:37.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.929 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1974e-05 s, 0.0 kB/s 2023-10-09T11:39:37.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:37.986 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.041 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.041 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5939e-05 s, 0.0 kB/s 2023-10-09T11:39:38.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1502e-05 s, 0.0 kB/s 2023-10-09T11:39:38.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.098 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2062e-05 s, 0.0 kB/s 2023-10-09T11:39:38.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.154 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2478e-05 s, 0.0 kB/s 2023-10-09T11:39:38.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.209 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2724e-05 s, 0.0 kB/s 2023-10-09T11:39:38.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.266 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1193e-05 s, 0.0 kB/s 2023-10-09T11:39:38.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.322 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.378 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.2306e-05 s, 0.0 kB/s 2023-10-09T11:39:38.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.379 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.434 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4177e-05 s, 0.0 kB/s 2023-10-09T11:39:38.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.435 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.491 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2959e-05 s, 0.0 kB/s 2023-10-09T11:39:38.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.491 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.546 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1828e-05 s, 0.0 kB/s 2023-10-09T11:39:38.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.548 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.7167e-05 s, 0.0 kB/s 2023-10-09T11:39:38.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.603 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.660 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2368e-05 s, 0.0 kB/s 2023-10-09T11:39:38.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.660 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8496e-05 s, 0.0 kB/s 2023-10-09T11:39:38.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.771 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.772 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3457e-05 s, 0.0 kB/s 2023-10-09T11:39:38.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.772 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3325e-05 s, 0.0 kB/s 2023-10-09T11:39:38.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.829 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.885 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3113e-05 s, 0.0 kB/s 2023-10-09T11:39:38.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.886 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:38.949 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-09T11:39:38.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:38.949 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.005 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1982e-05 s, 0.0 kB/s 2023-10-09T11:39:39.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.005 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000107232 s, 0.0 kB/s 2023-10-09T11:39:39.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.061 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.116 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.116 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-09T11:39:39.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.117 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.172 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.172 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3764e-05 s, 0.0 kB/s 2023-10-09T11:39:39.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.173 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.229 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.229 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9019e-05 s, 0.0 kB/s 2023-10-09T11:39:39.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.229 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.171e-05 s, 0.0 kB/s 2023-10-09T11:39:39.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.286 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3307e-05 s, 0.0 kB/s 2023-10-09T11:39:39.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.343 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6741e-05 s, 0.0 kB/s 2023-10-09T11:39:39.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.399 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1336e-05 s, 0.0 kB/s 2023-10-09T11:39:39.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.455 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.412e-05 s, 0.0 kB/s 2023-10-09T11:39:39.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8342e-05 s, 0.0 kB/s 2023-10-09T11:39:39.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2775e-05 s, 0.0 kB/s 2023-10-09T11:39:39.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.623 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2575e-05 s, 0.0 kB/s 2023-10-09T11:39:39.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.679 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.734 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.735 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.3035e-05 s, 0.0 kB/s 2023-10-09T11:39:39.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.735 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3988e-05 s, 0.0 kB/s 2023-10-09T11:39:39.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.791 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.848 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5624e-05 s, 0.0 kB/s 2023-10-09T11:39:39.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.848 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7335e-05 s, 0.0 kB/s 2023-10-09T11:39:39.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.905 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102564 s, 0.0 kB/s 2023-10-09T11:39:39.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2078e-05 s, 0.0 kB/s 2023-10-09T11:39:40.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.017 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.073 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.073 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.073 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5228e-05 s, 0.0 kB/s 2023-10-09T11:39:40.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.073 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.129 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.129 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.129 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5751e-05 s, 0.0 kB/s 2023-10-09T11:39:40.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.130 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.184 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.185 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.185 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5054e-05 s, 0.0 kB/s 2023-10-09T11:39:40.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.186 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.238e-05 s, 0.0 kB/s 2023-10-09T11:39:40.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.299 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.299 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.299 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3762e-05 s, 0.0 kB/s 2023-10-09T11:39:40.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.300 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6839e-05 s, 0.0 kB/s 2023-10-09T11:39:40.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.355 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3679e-05 s, 0.0 kB/s 2023-10-09T11:39:40.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.411 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.467 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2331e-05 s, 0.0 kB/s 2023-10-09T11:39:40.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.467 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.522 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.522 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0839e-05 s, 0.0 kB/s 2023-10-09T11:39:40.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.523 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.578 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1954e-05 s, 0.0 kB/s 2023-10-09T11:39:40.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.580 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1535e-05 s, 0.0 kB/s 2023-10-09T11:39:40.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.636 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5539e-05 s, 0.0 kB/s 2023-10-09T11:39:40.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.692 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.747 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.747 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7636e-05 s, 0.0 kB/s 2023-10-09T11:39:40.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.748 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.804 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.804 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.804 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3984e-05 s, 0.0 kB/s 2023-10-09T11:39:40.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.805 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8566e-05 s, 0.0 kB/s 2023-10-09T11:39:40.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.862 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2549e-05 s, 0.0 kB/s 2023-10-09T11:39:40.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.918 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:40.973 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:40.974 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4023e-05 s, 0.0 kB/s 2023-10-09T11:39:40.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.974 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4581e-05 s, 0.0 kB/s 2023-10-09T11:39:41.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.031 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2281e-05 s, 0.0 kB/s 2023-10-09T11:39:41.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.087 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4613e-05 s, 0.0 kB/s 2023-10-09T11:39:41.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.144 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.201 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8985e-05 s, 0.0 kB/s 2023-10-09T11:39:41.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.203 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8865e-05 s, 0.0 kB/s 2023-10-09T11:39:41.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.259 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.315 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2626e-05 s, 0.0 kB/s 2023-10-09T11:39:41.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.316 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.373 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9598e-05 s, 0.0 kB/s 2023-10-09T11:39:41.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.373 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.430 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-09T11:39:41.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2465e-05 s, 0.0 kB/s 2023-10-09T11:39:41.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.543 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8322e-05 s, 0.0 kB/s 2023-10-09T11:39:41.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.543 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.600 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.600 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0379e-05 s, 0.0 kB/s 2023-10-09T11:39:41.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.600 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3577e-05 s, 0.0 kB/s 2023-10-09T11:39:41.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.657 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3209e-05 s, 0.0 kB/s 2023-10-09T11:39:41.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.714 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.770 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1491e-05 s, 0.0 kB/s 2023-10-09T11:39:41.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.827 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.827 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.827 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4444e-05 s, 0.0 kB/s 2023-10-09T11:39:41.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.827 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2964e-05 s, 0.0 kB/s 2023-10-09T11:39:41.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.885 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.941 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.941 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0938e-05 s, 0.0 kB/s 2023-10-09T11:39:41.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:41.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.4763e-05 s, 0.0 kB/s 2023-10-09T11:39:41.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:41.998 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3721e-05 s, 0.0 kB/s 2023-10-09T11:39:42.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.055 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.111 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4891e-05 s, 0.0 kB/s 2023-10-09T11:39:42.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.111 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.168 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.168 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2789e-05 s, 0.0 kB/s 2023-10-09T11:39:42.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.168 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3203e-05 s, 0.0 kB/s 2023-10-09T11:39:42.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.226 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3201e-05 s, 0.0 kB/s 2023-10-09T11:39:42.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.283 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.340 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5546e-05 s, 0.0 kB/s 2023-10-09T11:39:42.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.341 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4995e-05 s, 0.0 kB/s 2023-10-09T11:39:42.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.397 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.454 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.454 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3984e-05 s, 0.0 kB/s 2023-10-09T11:39:42.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.454 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4561e-05 s, 0.0 kB/s 2023-10-09T11:39:42.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.568 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-09T11:39:42.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.625 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.9489e-05 s, 0.0 kB/s 2023-10-09T11:39:42.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.681 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.682 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.465e-05 s, 0.0 kB/s 2023-10-09T11:39:42.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.682 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3513e-05 s, 0.0 kB/s 2023-10-09T11:39:42.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-09T11:39:42.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.853 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.854 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4522e-05 s, 0.0 kB/s 2023-10-09T11:39:42.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3792e-05 s, 0.0 kB/s 2023-10-09T11:39:42.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.911 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:42.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:42.967 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-09T11:39:42.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:42.967 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6286e-05 s, 0.0 kB/s 2023-10-09T11:39:43.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.025 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.080 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5586e-05 s, 0.0 kB/s 2023-10-09T11:39:43.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2091e-05 s, 0.0 kB/s 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.138 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3844e-05 s, 0.0 kB/s 2023-10-09T11:39:43.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.196 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.414e-05 s, 0.0 kB/s 2023-10-09T11:39:43.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.253 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2408e-05 s, 0.0 kB/s 2023-10-09T11:39:43.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.309 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2274e-05 s, 0.0 kB/s 2023-10-09T11:39:43.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.366 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-09T11:39:43.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2699e-05 s, 0.0 kB/s 2023-10-09T11:39:43.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.480 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.537 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.537 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.537 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2332e-05 s, 0.0 kB/s 2023-10-09T11:39:43.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.537 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-09T11:39:43.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.594 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1925e-05 s, 0.0 kB/s 2023-10-09T11:39:43.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.650 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.708 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2479e-05 s, 0.0 kB/s 2023-10-09T11:39:43.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.709 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1383e-05 s, 0.0 kB/s 2023-10-09T11:39:43.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.767 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.3239e-05 s, 0.0 kB/s 2023-10-09T11:39:43.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.880 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.880 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.085e-05 s, 0.0 kB/s 2023-10-09T11:39:43.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1811e-05 s, 0.0 kB/s 2023-10-09T11:39:43.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.937 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101659 s, 0.0 kB/s 2023-10-09T11:39:43.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:43.994 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.050 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.155e-05 s, 0.0 kB/s 2023-10-09T11:39:44.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3696e-05 s, 0.0 kB/s 2023-10-09T11:39:44.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.108 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1791e-05 s, 0.0 kB/s 2023-10-09T11:39:44.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.166 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3233e-05 s, 0.0 kB/s 2023-10-09T11:39:44.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.223 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.279 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2831e-05 s, 0.0 kB/s 2023-10-09T11:39:44.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.279 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.336 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3539e-05 s, 0.0 kB/s 2023-10-09T11:39:44.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.337 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.392 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.392 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.393 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.152e-05 s, 0.0 kB/s 2023-10-09T11:39:44.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.393 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4495e-05 s, 0.0 kB/s 2023-10-09T11:39:44.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.449 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104999 s, 0.0 kB/s 2023-10-09T11:39:44.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.505 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104466 s, 0.0 kB/s 2023-10-09T11:39:44.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.562 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7482e-05 s, 0.0 kB/s 2023-10-09T11:39:44.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.619 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3803e-05 s, 0.0 kB/s 2023-10-09T11:39:44.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.674 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.730 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4219e-05 s, 0.0 kB/s 2023-10-09T11:39:44.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.730 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.787 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-09T11:39:44.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.787 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.843 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1786e-05 s, 0.0 kB/s 2023-10-09T11:39:44.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.844 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.900 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-09T11:39:44.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:44.957 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:44.957 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2821e-05 s, 0.0 kB/s 2023-10-09T11:39:44.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:44.958 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.013 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.013 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.014 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5365e-05 s, 0.0 kB/s 2023-10-09T11:39:45.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.015 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.8794e-05 s, 0.0 kB/s 2023-10-09T11:39:45.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.103 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.119 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7379e-05 s, 0.0 kB/s 2023-10-09T11:39:45.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.120 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2085e-05 s, 0.0 kB/s 2023-10-09T11:39:45.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.232 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.232 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3398e-05 s, 0.0 kB/s 2023-10-09T11:39:45.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.233 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.8103e-05 s, 0.0 kB/s 2023-10-09T11:39:45.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.288 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.344 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.345 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.408e-05 s, 0.0 kB/s 2023-10-09T11:39:45.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.345 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-09T11:39:45.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.402 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3428e-05 s, 0.0 kB/s 2023-10-09T11:39:45.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.458 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.513 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.513 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1909e-05 s, 0.0 kB/s 2023-10-09T11:39:45.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.513 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.569 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.569 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-09T11:39:45.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.569 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.625 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.626 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.626 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2739e-05 s, 0.0 kB/s 2023-10-09T11:39:45.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.626 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.682 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.683 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.683 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4535e-05 s, 0.0 kB/s 2023-10-09T11:39:45.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.683 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.739 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.740 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2618e-05 s, 0.0 kB/s 2023-10-09T11:39:45.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2134e-05 s, 0.0 kB/s 2023-10-09T11:39:45.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.797 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.851 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.852 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.852 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2089e-05 s, 0.0 kB/s 2023-10-09T11:39:45.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.853 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.909 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.909 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.910 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2544e-05 s, 0.0 kB/s 2023-10-09T11:39:45.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.910 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3711e-05 s, 0.0 kB/s 2023-10-09T11:39:45.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:45.966 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.022 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.023 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4985e-05 s, 0.0 kB/s 2023-10-09T11:39:46.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.23e-05 s, 0.0 kB/s 2023-10-09T11:39:46.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.078 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2409e-05 s, 0.0 kB/s 2023-10-09T11:39:46.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.191 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5592e-05 s, 0.0 kB/s 2023-10-09T11:39:46.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.191 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1614e-05 s, 0.0 kB/s 2023-10-09T11:39:46.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.248 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7714e-05 s, 0.0 kB/s 2023-10-09T11:39:46.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0069e-05 s, 0.0 kB/s 2023-10-09T11:39:46.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.361 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2688e-05 s, 0.0 kB/s 2023-10-09T11:39:46.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.418 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1468e-05 s, 0.0 kB/s 2023-10-09T11:39:46.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.529 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.529 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8376e-05 s, 0.0 kB/s 2023-10-09T11:39:46.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.585 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.219e-05 s, 0.0 kB/s 2023-10-09T11:39:46.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.586 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.641 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3019e-05 s, 0.0 kB/s 2023-10-09T11:39:46.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.698 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5299e-05 s, 0.0 kB/s 2023-10-09T11:39:46.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.700 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2729e-05 s, 0.0 kB/s 2023-10-09T11:39:46.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.757 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.813 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5319e-05 s, 0.0 kB/s 2023-10-09T11:39:46.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.870 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.870 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1273e-05 s, 0.0 kB/s 2023-10-09T11:39:46.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.871 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4602e-05 s, 0.0 kB/s 2023-10-09T11:39:46.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.927 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:46.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:46.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:46.981 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4949e-05 s, 0.0 kB/s 2023-10-09T11:39:46.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:46.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.039 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.040 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.040 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-09T11:39:47.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.040 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.257e-05 s, 0.0 kB/s 2023-10-09T11:39:47.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.095 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.151 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2318e-05 s, 0.0 kB/s 2023-10-09T11:39:47.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.152 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.208 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2517e-05 s, 0.0 kB/s 2023-10-09T11:39:47.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.209 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.264 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100799 s, 0.0 kB/s 2023-10-09T11:39:47.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.265 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.321 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.321 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.321 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4015e-05 s, 0.0 kB/s 2023-10-09T11:39:47.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.321 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6989e-05 s, 0.0 kB/s 2023-10-09T11:39:47.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.378 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8706e-05 s, 0.0 kB/s 2023-10-09T11:39:47.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.435 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3656e-05 s, 0.0 kB/s 2023-10-09T11:39:47.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.491 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.547 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5016e-05 s, 0.0 kB/s 2023-10-09T11:39:47.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.547 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.603 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.603 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.603 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3082e-05 s, 0.0 kB/s 2023-10-09T11:39:47.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.604 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.659 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.660 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-09T11:39:47.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.660 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3449e-05 s, 0.0 kB/s 2023-10-09T11:39:47.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.716 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.772 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.772 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1623e-05 s, 0.0 kB/s 2023-10-09T11:39:47.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.773 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.829 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.830 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4342e-05 s, 0.0 kB/s 2023-10-09T11:39:47.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.830 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6683e-05 s, 0.0 kB/s 2023-10-09T11:39:47.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.886 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:47.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:47.943 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9128e-05 s, 0.0 kB/s 2023-10-09T11:39:47.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:47.944 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.001 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.001 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102419 s, 0.0 kB/s 2023-10-09T11:39:48.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.001 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4457e-05 s, 0.0 kB/s 2023-10-09T11:39:48.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.057 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.112 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.112 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4192e-05 s, 0.0 kB/s 2023-10-09T11:39:48.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.113 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.169 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1632e-05 s, 0.0 kB/s 2023-10-09T11:39:48.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.170 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3442e-05 s, 0.0 kB/s 2023-10-09T11:39:48.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.227 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1906e-05 s, 0.0 kB/s 2023-10-09T11:39:48.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.283 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3226e-05 s, 0.0 kB/s 2023-10-09T11:39:48.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.339 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.394 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.395 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2976e-05 s, 0.0 kB/s 2023-10-09T11:39:48.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.395 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.450 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.450 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.450 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.272e-05 s, 0.0 kB/s 2023-10-09T11:39:48.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.451 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.8169e-05 s, 0.0 kB/s 2023-10-09T11:39:48.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.507 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.562 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.562 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.563 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0029e-05 s, 0.0 kB/s 2023-10-09T11:39:48.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.563 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.618 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.618 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.00013464 s, 0.0 kB/s 2023-10-09T11:39:48.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.619 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.839e-05 s, 0.0 kB/s 2023-10-09T11:39:48.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.675 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4541e-05 s, 0.0 kB/s 2023-10-09T11:39:48.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.730 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.786 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-09T11:39:48.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.787 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.842 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.843 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.843 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1866e-05 s, 0.0 kB/s 2023-10-09T11:39:48.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.843 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102558 s, 0.0 kB/s 2023-10-09T11:39:48.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.900 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:48.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:48.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:48.955 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2671e-05 s, 0.0 kB/s 2023-10-09T11:39:48.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:48.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7954e-05 s, 0.0 kB/s 2023-10-09T11:39:49.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.068 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1871e-05 s, 0.0 kB/s 2023-10-09T11:39:49.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0805e-05 s, 0.0 kB/s 2023-10-09T11:39:49.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.124 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2333e-05 s, 0.0 kB/s 2023-10-09T11:39:49.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5913e-05 s, 0.0 kB/s 2023-10-09T11:39:49.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.294 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2399e-05 s, 0.0 kB/s 2023-10-09T11:39:49.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.294 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7389e-05 s, 0.0 kB/s 2023-10-09T11:39:49.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.351 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.407 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5269e-05 s, 0.0 kB/s 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.408 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.464 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.464 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.464 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4597e-05 s, 0.0 kB/s 2023-10-09T11:39:49.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.465 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4199e-05 s, 0.0 kB/s 2023-10-09T11:39:49.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.521 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.577 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9678e-05 s, 0.0 kB/s 2023-10-09T11:39:49.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.577 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.632 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.632 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.632 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5209e-05 s, 0.0 kB/s 2023-10-09T11:39:49.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.633 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2727e-05 s, 0.0 kB/s 2023-10-09T11:39:49.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.689 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.744 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2649e-05 s, 0.0 kB/s 2023-10-09T11:39:49.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.745 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.800 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0185e-05 s, 0.0 kB/s 2023-10-09T11:39:49.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.9859e-05 s, 0.0 kB/s 2023-10-09T11:39:49.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.856 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-09T11:39:49.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.912 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8269e-05 s, 0.0 kB/s 2023-10-09T11:39:49.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:49.969 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1605e-05 s, 0.0 kB/s 2023-10-09T11:39:50.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.025 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4552e-05 s, 0.0 kB/s 2023-10-09T11:39:50.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.080 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9312e-05 s, 0.0 kB/s 2023-10-09T11:39:50.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.136 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.2474e-05 s, 0.0 kB/s 2023-10-09T11:39:50.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.193 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.249 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.250 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3457e-05 s, 0.0 kB/s 2023-10-09T11:39:50.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.250 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.306 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.307 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.307 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7699e-05 s, 0.0 kB/s 2023-10-09T11:39:50.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.307 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.363 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.364 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.364 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7146e-05 s, 0.0 kB/s 2023-10-09T11:39:50.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.364 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3228e-05 s, 0.0 kB/s 2023-10-09T11:39:50.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.421 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4972e-05 s, 0.0 kB/s 2023-10-09T11:39:50.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4126e-05 s, 0.0 kB/s 2023-10-09T11:39:50.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1914e-05 s, 0.0 kB/s 2023-10-09T11:39:50.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.591 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000105103 s, 0.0 kB/s 2023-10-09T11:39:50.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.647 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3461e-05 s, 0.0 kB/s 2023-10-09T11:39:50.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.734 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.750 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.750 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3232e-05 s, 0.0 kB/s 2023-10-09T11:39:50.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.750 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.806 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-09T11:39:50.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.807 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5994e-05 s, 0.0 kB/s 2023-10-09T11:39:50.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.863 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T11:39:50.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4081e-05 s, 0.0 kB/s 2023-10-09T11:39:50.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:50.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4726e-05 s, 0.0 kB/s 2023-10-09T11:39:51.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.033 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.089 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.00010893 s, 0.0 kB/s 2023-10-09T11:39:51.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.090 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.145 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.145 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4498e-05 s, 0.0 kB/s 2023-10-09T11:39:51.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.146 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.202 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2729e-05 s, 0.0 kB/s 2023-10-09T11:39:51.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.203 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.259 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9518e-05 s, 0.0 kB/s 2023-10-09T11:39:51.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.260 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4907e-05 s, 0.0 kB/s 2023-10-09T11:39:51.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.317 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4321e-05 s, 0.0 kB/s 2023-10-09T11:39:51.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.374 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.430 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.2954e-05 s, 0.0 kB/s 2023-10-09T11:39:51.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.431 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2455e-05 s, 0.0 kB/s 2023-10-09T11:39:51.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5469e-05 s, 0.0 kB/s 2023-10-09T11:39:51.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.543 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.599 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9248e-05 s, 0.0 kB/s 2023-10-09T11:39:51.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.600 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.656 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5395e-05 s, 0.0 kB/s 2023-10-09T11:39:51.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.657 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.712 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000106345 s, 0.0 kB/s 2023-10-09T11:39:51.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3665e-05 s, 0.0 kB/s 2023-10-09T11:39:51.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.825 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5081e-05 s, 0.0 kB/s 2023-10-09T11:39:51.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.826 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.882 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.882 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.6757e-05 s, 0.0 kB/s 2023-10-09T11:39:51.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.882 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.938 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4029e-05 s, 0.0 kB/s 2023-10-09T11:39:51.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.938 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4582e-05 s, 0.0 kB/s 2023-10-09T11:39:51.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:51.995 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000101829 s, 0.0 kB/s 2023-10-09T11:39:52.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.051 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4032e-05 s, 0.0 kB/s 2023-10-09T11:39:52.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.108 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9178e-05 s, 0.0 kB/s 2023-10-09T11:39:52.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.165 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.220 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.221 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3022e-05 s, 0.0 kB/s 2023-10-09T11:39:52.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.221 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2405e-05 s, 0.0 kB/s 2023-10-09T11:39:52.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.278 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.395e-05 s, 0.0 kB/s 2023-10-09T11:39:52.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.334 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.390 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.390 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.390 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2391e-05 s, 0.0 kB/s 2023-10-09T11:39:52.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.390 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2715e-05 s, 0.0 kB/s 2023-10-09T11:39:52.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.447 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.502 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.502 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4105e-05 s, 0.0 kB/s 2023-10-09T11:39:52.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.502 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.557 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.558 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.558 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2956e-05 s, 0.0 kB/s 2023-10-09T11:39:52.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.559 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6266e-05 s, 0.0 kB/s 2023-10-09T11:39:52.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.616 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.671 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.671 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.7962e-05 s, 0.0 kB/s 2023-10-09T11:39:52.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.671 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-09T11:39:52.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-09T11:39:52.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.783 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6279e-05 s, 0.0 kB/s 2023-10-09T11:39:52.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.840 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.896 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.897 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6769e-05 s, 0.0 kB/s 2023-10-09T11:39:52.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.897 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:52.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:52.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:52.953 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2943e-05 s, 0.0 kB/s 2023-10-09T11:39:52.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:52.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1205e-05 s, 0.0 kB/s 2023-10-09T11:39:53.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.066 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.067 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2694e-05 s, 0.0 kB/s 2023-10-09T11:39:53.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.067 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4927e-05 s, 0.0 kB/s 2023-10-09T11:39:53.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.123 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1566e-05 s, 0.0 kB/s 2023-10-09T11:39:53.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.180 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.237 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-09T11:39:53.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.237 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4312e-05 s, 0.0 kB/s 2023-10-09T11:39:53.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.294 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.349 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.8496e-05 s, 0.0 kB/s 2023-10-09T11:39:53.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.350 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.405 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5412e-05 s, 0.0 kB/s 2023-10-09T11:39:53.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.406 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.462 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1608e-05 s, 0.0 kB/s 2023-10-09T11:39:53.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.463 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3131e-05 s, 0.0 kB/s 2023-10-09T11:39:53.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.519 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.575 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4058e-05 s, 0.0 kB/s 2023-10-09T11:39:53.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.575 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5719e-05 s, 0.0 kB/s 2023-10-09T11:39:53.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.632 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104823 s, 0.0 kB/s 2023-10-09T11:39:53.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2522e-05 s, 0.0 kB/s 2023-10-09T11:39:53.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.744 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.799 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.799 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.799 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3743e-05 s, 0.0 kB/s 2023-10-09T11:39:53.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.799 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0355e-05 s, 0.0 kB/s 2023-10-09T11:39:53.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.856 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.914 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6483e-05 s, 0.0 kB/s 2023-10-09T11:39:53.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.915 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:53.970 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:53.970 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:53.970 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3525e-05 s, 0.0 kB/s 2023-10-09T11:39:53.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:53.971 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.026 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.026 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.026 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1925e-05 s, 0.0 kB/s 2023-10-09T11:39:54.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.027 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6095e-05 s, 0.0 kB/s 2023-10-09T11:39:54.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.084 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1267e-05 s, 0.0 kB/s 2023-10-09T11:39:54.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.140 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2626e-05 s, 0.0 kB/s 2023-10-09T11:39:54.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.196 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.252 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.252 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4902e-05 s, 0.0 kB/s 2023-10-09T11:39:54.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.253 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.310 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.310 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1379e-05 s, 0.0 kB/s 2023-10-09T11:39:54.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.310 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7242e-05 s, 0.0 kB/s 2023-10-09T11:39:54.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-09T11:39:54.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2347e-05 s, 0.0 kB/s 2023-10-09T11:39:54.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.479 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9797e-05 s, 0.0 kB/s 2023-10-09T11:39:54.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1384e-05 s, 0.0 kB/s 2023-10-09T11:39:54.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.590 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6672e-05 s, 0.0 kB/s 2023-10-09T11:39:54.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.647 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3145e-05 s, 0.0 kB/s 2023-10-09T11:39:54.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0778e-05 s, 0.0 kB/s 2023-10-09T11:39:54.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6756e-05 s, 0.0 kB/s 2023-10-09T11:39:54.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2541e-05 s, 0.0 kB/s 2023-10-09T11:39:54.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.873 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3394e-05 s, 0.0 kB/s 2023-10-09T11:39:54.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.929 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:54.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:54.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:54.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1435e-05 s, 0.0 kB/s 2023-10-09T11:39:54.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:54.986 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.042 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2861e-05 s, 0.0 kB/s 2023-10-09T11:39:55.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.043 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.098 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.098 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.725e-05 s, 0.0 kB/s 2023-10-09T11:39:55.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.099 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.154 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000102998 s, 0.0 kB/s 2023-10-09T11:39:55.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.155 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3512e-05 s, 0.0 kB/s 2023-10-09T11:39:55.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.213 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2369e-05 s, 0.0 kB/s 2023-10-09T11:39:55.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.270 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1476e-05 s, 0.0 kB/s 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.327 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.383 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0086e-05 s, 0.0 kB/s 2023-10-09T11:39:55.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-09T11:39:55.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.441 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5104e-05 s, 0.0 kB/s 2023-10-09T11:39:55.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.497 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.552 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2947e-05 s, 0.0 kB/s 2023-10-09T11:39:55.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.553 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.4078e-05 s, 0.0 kB/s 2023-10-09T11:39:55.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.609 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7615e-05 s, 0.0 kB/s 2023-10-09T11:39:55.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.665 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1468e-05 s, 0.0 kB/s 2023-10-09T11:39:55.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.721 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2236e-05 s, 0.0 kB/s 2023-10-09T11:39:55.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.777 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:55.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.847 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.848 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.7567e-05 s, 0.0 kB/s 2023-10-09T11:39:55.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.848 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.918 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6802e-05 s, 0.0 kB/s 2023-10-09T11:39:55.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2719e-05 s, 0.0 kB/s 2023-10-09T11:39:55.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:55.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.031 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.031 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2229e-05 s, 0.0 kB/s 2023-10-09T11:39:56.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.031 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.087 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.088 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7899e-05 s, 0.0 kB/s 2023-10-09T11:39:56.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.088 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4482e-05 s, 0.0 kB/s 2023-10-09T11:39:56.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.145 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.201 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.202 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4185e-05 s, 0.0 kB/s 2023-10-09T11:39:56.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.202 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.258 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.258 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2965e-05 s, 0.0 kB/s 2023-10-09T11:39:56.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.258 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.314 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3202e-05 s, 0.0 kB/s 2023-10-09T11:39:56.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.315 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.371 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.371 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3436e-05 s, 0.0 kB/s 2023-10-09T11:39:56.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.371 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1899e-05 s, 0.0 kB/s 2023-10-09T11:39:56.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.429 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2289e-05 s, 0.0 kB/s 2023-10-09T11:39:56.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.485 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.541 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.541 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2122e-05 s, 0.0 kB/s 2023-10-09T11:39:56.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.542 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1518e-05 s, 0.0 kB/s 2023-10-09T11:39:56.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.599 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.655 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3291e-05 s, 0.0 kB/s 2023-10-09T11:39:56.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.655 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5072e-05 s, 0.0 kB/s 2023-10-09T11:39:56.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-09T11:39:56.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.769 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.825 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-09T11:39:56.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.826 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.881 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.881 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-09T11:39:56.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.882 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3254e-05 s, 0.0 kB/s 2023-10-09T11:39:56.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.939 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:56.995 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:56.995 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:56.995 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-09T11:39:56.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:56.996 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2244e-05 s, 0.0 kB/s 2023-10-09T11:39:57.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.052 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2269e-05 s, 0.0 kB/s 2023-10-09T11:39:57.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.109 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1512e-05 s, 0.0 kB/s 2023-10-09T11:39:57.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.167 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.224 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.224 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4264e-05 s, 0.0 kB/s 2023-10-09T11:39:57.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.224 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.281 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1619e-05 s, 0.0 kB/s 2023-10-09T11:39:57.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.409 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6316e-05 s, 0.0 kB/s 2023-10-09T11:39:57.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.409 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.426 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.427 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.427 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1618e-05 s, 0.0 kB/s 2023-10-09T11:39:57.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.427 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3467e-05 s, 0.0 kB/s 2023-10-09T11:39:57.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.486 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3164e-05 s, 0.0 kB/s 2023-10-09T11:39:57.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.546 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.606 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1932e-05 s, 0.0 kB/s 2023-10-09T11:39:57.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.606 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.195e-05 s, 0.0 kB/s 2023-10-09T11:39:57.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.665 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.723 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.723 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7165e-05 s, 0.0 kB/s 2023-10-09T11:39:57.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.723 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2662e-05 s, 0.0 kB/s 2023-10-09T11:39:57.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5179e-05 s, 0.0 kB/s 2023-10-09T11:39:57.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.840 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5109e-05 s, 0.0 kB/s 2023-10-09T11:39:57.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.897 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:57.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:57.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:57.953 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3004e-05 s, 0.0 kB/s 2023-10-09T11:39:57.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:57.954 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7494e-05 s, 0.0 kB/s 2023-10-09T11:39:58.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.010 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8664e-05 s, 0.0 kB/s 2023-10-09T11:39:58.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.066 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6035e-05 s, 0.0 kB/s 2023-10-09T11:39:58.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.122 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.179 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1376e-05 s, 0.0 kB/s 2023-10-09T11:39:58.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.179 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.235 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3182e-05 s, 0.0 kB/s 2023-10-09T11:39:58.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.236 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.292 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.292 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5203e-05 s, 0.0 kB/s 2023-10-09T11:39:58.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.293 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.349 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.349 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4567e-05 s, 0.0 kB/s 2023-10-09T11:39:58.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.350 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1949e-05 s, 0.0 kB/s 2023-10-09T11:39:58.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.406 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.460 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1697e-05 s, 0.0 kB/s 2023-10-09T11:39:58.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.516 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.516 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.516 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-09T11:39:58.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.517 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4762e-05 s, 0.0 kB/s 2023-10-09T11:39:58.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.573 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-09T11:39:58.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.630 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.685 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9488e-05 s, 0.0 kB/s 2023-10-09T11:39:58.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.686 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1668e-05 s, 0.0 kB/s 2023-10-09T11:39:58.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.742 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.797 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.798 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.798 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3029e-05 s, 0.0 kB/s 2023-10-09T11:39:58.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.799 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.854 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.855 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.855 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2625e-05 s, 0.0 kB/s 2023-10-09T11:39:58.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.856 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.912 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.912 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5258e-05 s, 0.0 kB/s 2023-10-09T11:39:58.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.913 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:58.968 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2502e-05 s, 0.0 kB/s 2023-10-09T11:39:58.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:58.969 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.179e-05 s, 0.0 kB/s 2023-10-09T11:39:59.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.025 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4191e-05 s, 0.0 kB/s 2023-10-09T11:39:59.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.082 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4455e-05 s, 0.0 kB/s 2023-10-09T11:39:59.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.139 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.194 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.195 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.195 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4513e-05 s, 0.0 kB/s 2023-10-09T11:39:59.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.195 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.0685e-05 s, 0.0 kB/s 2023-10-09T11:39:59.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.252 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2516e-05 s, 0.0 kB/s 2023-10-09T11:39:59.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.309 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4275e-05 s, 0.0 kB/s 2023-10-09T11:39:59.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.366 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0547e-05 s, 0.0 kB/s 2023-10-09T11:39:59.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.423 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.276e-05 s, 0.0 kB/s 2023-10-09T11:39:59.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.534 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0831e-05 s, 0.0 kB/s 2023-10-09T11:39:59.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4387e-05 s, 0.0 kB/s 2023-10-09T11:39:59.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.592 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.1719e-05 s, 0.0 kB/s 2023-10-09T11:39:59.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.648 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6299e-05 s, 0.0 kB/s 2023-10-09T11:39:59.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.704 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.759 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.759 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0797e-05 s, 0.0 kB/s 2023-10-09T11:39:59.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.815 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.815 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4905e-05 s, 0.0 kB/s 2023-10-09T11:39:59.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.816 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.871 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3211e-05 s, 0.0 kB/s 2023-10-09T11:39:59.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.873 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.929 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.929 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7467e-05 s, 0.0 kB/s 2023-10-09T11:39:59.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.930 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:39:59.984 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:39:59.985 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:39:59.985 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2936e-05 s, 0.0 kB/s 2023-10-09T11:39:59.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:59.986 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4548e-05 s, 0.0 kB/s 2023-10-09T11:40:00.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.042 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.097 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.098 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3063e-05 s, 0.0 kB/s 2023-10-09T11:40:00.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.099 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3383e-05 s, 0.0 kB/s 2023-10-09T11:40:00.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.156 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3136e-05 s, 0.0 kB/s 2023-10-09T11:40:00.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.213 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.268 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.268 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2376e-05 s, 0.0 kB/s 2023-10-09T11:40:00.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.271 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.327 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.327 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6913e-05 s, 0.0 kB/s 2023-10-09T11:40:00.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.328 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2204e-05 s, 0.0 kB/s 2023-10-09T11:40:00.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.440 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.440 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0152e-05 s, 0.0 kB/s 2023-10-09T11:40:00.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.440 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.496 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2747e-05 s, 0.0 kB/s 2023-10-09T11:40:00.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.497 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.551 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.551 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3244e-05 s, 0.0 kB/s 2023-10-09T11:40:00.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.552 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.608 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.608 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2604e-05 s, 0.0 kB/s 2023-10-09T11:40:00.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.608 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4336e-05 s, 0.0 kB/s 2023-10-09T11:40:00.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.664 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.28e-05 s, 0.0 kB/s 2023-10-09T11:40:00.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.720 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2622e-05 s, 0.0 kB/s 2023-10-09T11:40:00.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.776 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.832 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.832 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.5661e-05 s, 0.0 kB/s 2023-10-09T11:40:00.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.832 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6549e-05 s, 0.0 kB/s 2023-10-09T11:40:00.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.889 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4505e-05 s, 0.0 kB/s 2023-10-09T11:40:00.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:00.965 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.020 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.021 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0718e-05 s, 0.0 kB/s 2023-10-09T11:40:01.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.021 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-09T11:40:01.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.078 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.132 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.133 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7079e-05 s, 0.0 kB/s 2023-10-09T11:40:01.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.134 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.190 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.190 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3196e-05 s, 0.0 kB/s 2023-10-09T11:40:01.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.191 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.249 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.303 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7306e-05 s, 0.0 kB/s 2023-10-09T11:40:01.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.361 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.361 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3782e-05 s, 0.0 kB/s 2023-10-09T11:40:01.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.362 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0355e-05 s, 0.0 kB/s 2023-10-09T11:40:01.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.473 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100316 s, 0.0 kB/s 2023-10-09T11:40:01.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.474 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4009e-05 s, 0.0 kB/s 2023-10-09T11:40:01.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.530 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.586 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.025e-05 s, 0.0 kB/s 2023-10-09T11:40:01.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.587 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.642 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.643 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109881 s, 0.0 kB/s 2023-10-09T11:40:01.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.643 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.701 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.701 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3584e-05 s, 0.0 kB/s 2023-10-09T11:40:01.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.701 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.757 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1459e-05 s, 0.0 kB/s 2023-10-09T11:40:01.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.758 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.707e-05 s, 0.0 kB/s 2023-10-09T11:40:01.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.814 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1546e-05 s, 0.0 kB/s 2023-10-09T11:40:01.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.876 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:01.939 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:01.939 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:01.939 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3912e-05 s, 0.0 kB/s 2023-10-09T11:40:01.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:01.940 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.004 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.004 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2356e-05 s, 0.0 kB/s 2023-10-09T11:40:02.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.005 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1854e-05 s, 0.0 kB/s 2023-10-09T11:40:02.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.073 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.251e-05 s, 0.0 kB/s 2023-10-09T11:40:02.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.133 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8276e-05 s, 0.0 kB/s 2023-10-09T11:40:02.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.198 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1769e-05 s, 0.0 kB/s 2023-10-09T11:40:02.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.259 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.323 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.324 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.324 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7983e-05 s, 0.0 kB/s 2023-10-09T11:40:02.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.324 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.386 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.386 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.386 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.758e-05 s, 0.0 kB/s 2023-10-09T11:40:02.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.387 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1712e-05 s, 0.0 kB/s 2023-10-09T11:40:02.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.449 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2231e-05 s, 0.0 kB/s 2023-10-09T11:40:02.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0784e-05 s, 0.0 kB/s 2023-10-09T11:40:02.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.577 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.636 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.636 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.636 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6655e-05 s, 0.0 kB/s 2023-10-09T11:40:02.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.637 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104609 s, 0.0 kB/s 2023-10-09T11:40:02.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.703 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.770 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.373e-05 s, 0.0 kB/s 2023-10-09T11:40:02.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.771 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.849 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.463e-05 s, 0.0 kB/s 2023-10-09T11:40:02.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.849 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4357e-05 s, 0.0 kB/s 2023-10-09T11:40:02.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.916 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:02.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:02.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:02.977 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7662e-05 s, 0.0 kB/s 2023-10-09T11:40:02.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:02.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-09T11:40:03.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.053 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.118 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100709 s, 0.0 kB/s 2023-10-09T11:40:03.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.119 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3027e-05 s, 0.0 kB/s 2023-10-09T11:40:03.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.179 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7455e-05 s, 0.0 kB/s 2023-10-09T11:40:03.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.244 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.304 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.305 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2731e-05 s, 0.0 kB/s 2023-10-09T11:40:03.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.305 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.367 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2784e-05 s, 0.0 kB/s 2023-10-09T11:40:03.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.367 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.425 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.425 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.425 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4191e-05 s, 0.0 kB/s 2023-10-09T11:40:03.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.425 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.486 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.486 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1876e-05 s, 0.0 kB/s 2023-10-09T11:40:03.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.7247e-05 s, 0.0 kB/s 2023-10-09T11:40:03.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.549 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1799e-05 s, 0.0 kB/s 2023-10-09T11:40:03.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.606 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5853e-05 s, 0.0 kB/s 2023-10-09T11:40:03.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.663 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3351e-05 s, 0.0 kB/s 2023-10-09T11:40:03.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.720 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7003e-05 s, 0.0 kB/s 2023-10-09T11:40:03.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.836 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2839e-05 s, 0.0 kB/s 2023-10-09T11:40:03.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.837 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.894 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.894 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.895 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3241e-05 s, 0.0 kB/s 2023-10-09T11:40:03.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.895 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:03.952 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.8791e-05 s, 0.0 kB/s 2023-10-09T11:40:03.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:03.953 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5157e-05 s, 0.0 kB/s 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.011 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.067 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.067 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6971e-05 s, 0.0 kB/s 2023-10-09T11:40:04.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.124 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.124 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.8513e-05 s, 0.0 kB/s 2023-10-09T11:40:04.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3129e-05 s, 0.0 kB/s 2023-10-09T11:40:04.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.183 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6441e-05 s, 0.0 kB/s 2023-10-09T11:40:04.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.241 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6581e-05 s, 0.0 kB/s 2023-10-09T11:40:04.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.359 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.9089e-05 s, 0.0 kB/s 2023-10-09T11:40:04.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.360 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3899e-05 s, 0.0 kB/s 2023-10-09T11:40:04.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.419 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2494e-05 s, 0.0 kB/s 2023-10-09T11:40:04.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.475 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.533 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.533 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-09T11:40:04.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.534 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5388e-05 s, 0.0 kB/s 2023-10-09T11:40:04.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.595 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2812e-05 s, 0.0 kB/s 2023-10-09T11:40:04.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.654 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-09T11:40:04.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.4923e-05 s, 0.0 kB/s 2023-10-09T11:40:04.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.771 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.7824e-05 s, 0.0 kB/s 2023-10-09T11:40:04.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.829 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3848e-05 s, 0.0 kB/s 2023-10-09T11:40:04.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.887 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9743e-05 s, 0.0 kB/s 2023-10-09T11:40:04.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:04.944 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2202e-05 s, 0.0 kB/s 2023-10-09T11:40:05.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.002 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5621e-05 s, 0.0 kB/s 2023-10-09T11:40:05.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.060 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6067e-05 s, 0.0 kB/s 2023-10-09T11:40:05.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.119 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8079e-05 s, 0.0 kB/s 2023-10-09T11:40:05.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.181 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.8742e-05 s, 0.0 kB/s 2023-10-09T11:40:05.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.241 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.303 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.707e-05 s, 0.0 kB/s 2023-10-09T11:40:05.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.303 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.362 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000107802 s, 0.0 kB/s 2023-10-09T11:40:05.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.363 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6543e-05 s, 0.0 kB/s 2023-10-09T11:40:05.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.483 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.483 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3235e-05 s, 0.0 kB/s 2023-10-09T11:40:05.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.484 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.543 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5563e-05 s, 0.0 kB/s 2023-10-09T11:40:05.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.543 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.602 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.602 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.602 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109645 s, 0.0 kB/s 2023-10-09T11:40:05.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.603 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.644e-05 s, 0.0 kB/s 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.663 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4966e-05 s, 0.0 kB/s 2023-10-09T11:40:05.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.722 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3555e-05 s, 0.0 kB/s 2023-10-09T11:40:05.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5124e-05 s, 0.0 kB/s 2023-10-09T11:40:05.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.840 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4991e-05 s, 0.0 kB/s 2023-10-09T11:40:05.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.898 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0204e-05 s, 0.0 kB/s 2023-10-09T11:40:05.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:05.956 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.012 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.012 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.648e-05 s, 0.0 kB/s 2023-10-09T11:40:06.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.013 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2995e-05 s, 0.0 kB/s 2023-10-09T11:40:06.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.070 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.126 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.126 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.126 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6461e-05 s, 0.0 kB/s 2023-10-09T11:40:06.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.127 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1322e-05 s, 0.0 kB/s 2023-10-09T11:40:06.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.184 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8862e-05 s, 0.0 kB/s 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8419e-05 s, 0.0 kB/s 2023-10-09T11:40:06.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2649e-05 s, 0.0 kB/s 2023-10-09T11:40:06.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.357 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.414 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.414 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5305e-05 s, 0.0 kB/s 2023-10-09T11:40:06.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.415 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.471 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.471 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6896e-05 s, 0.0 kB/s 2023-10-09T11:40:06.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.472 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4845e-05 s, 0.0 kB/s 2023-10-09T11:40:06.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.528 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.585 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3626e-05 s, 0.0 kB/s 2023-10-09T11:40:06.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.586 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9351e-05 s, 0.0 kB/s 2023-10-09T11:40:06.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.642 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5759e-05 s, 0.0 kB/s 2023-10-09T11:40:06.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.699 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.755 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.756 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4765e-05 s, 0.0 kB/s 2023-10-09T11:40:06.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.756 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2152e-05 s, 0.0 kB/s 2023-10-09T11:40:06.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.812 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.867 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.868 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9139e-05 s, 0.0 kB/s 2023-10-09T11:40:06.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.868 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.924 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.925 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1686e-05 s, 0.0 kB/s 2023-10-09T11:40:06.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.925 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:06.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:06.981 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:06.981 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1738e-05 s, 0.0 kB/s 2023-10-09T11:40:06.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:06.981 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.038 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0255e-05 s, 0.0 kB/s 2023-10-09T11:40:07.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.038 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5936e-05 s, 0.0 kB/s 2023-10-09T11:40:07.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.120 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.174 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.174 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.175 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2256e-05 s, 0.0 kB/s 2023-10-09T11:40:07.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.176 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9735e-05 s, 0.0 kB/s 2023-10-09T11:40:07.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.234 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3155e-05 s, 0.0 kB/s 2023-10-09T11:40:07.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.291 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6682e-05 s, 0.0 kB/s 2023-10-09T11:40:07.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.406 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.406 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6542e-05 s, 0.0 kB/s 2023-10-09T11:40:07.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.406 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.462 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.463 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000124313 s, 0.0 kB/s 2023-10-09T11:40:07.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.463 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104077 s, 0.0 kB/s 2023-10-09T11:40:07.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.519 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.9777e-05 s, 0.0 kB/s 2023-10-09T11:40:07.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.576 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1775e-05 s, 0.0 kB/s 2023-10-09T11:40:07.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.632 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1697e-05 s, 0.0 kB/s 2023-10-09T11:40:07.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4746e-05 s, 0.0 kB/s 2023-10-09T11:40:07.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.744 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.799 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.800 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.800 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6487e-05 s, 0.0 kB/s 2023-10-09T11:40:07.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-09T11:40:07.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0422e-05 s, 0.0 kB/s 2023-10-09T11:40:07.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.915 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:07.970 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T11:40:07.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:07.971 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3721e-05 s, 0.0 kB/s 2023-10-09T11:40:08.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.028 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6922e-05 s, 0.0 kB/s 2023-10-09T11:40:08.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.084 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.140 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2157e-05 s, 0.0 kB/s 2023-10-09T11:40:08.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.141 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.196 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.197 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.197 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1435e-05 s, 0.0 kB/s 2023-10-09T11:40:08.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1811e-05 s, 0.0 kB/s 2023-10-09T11:40:08.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.254 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.309 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.309 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4502e-05 s, 0.0 kB/s 2023-10-09T11:40:08.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.310 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.365 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.365 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2422e-05 s, 0.0 kB/s 2023-10-09T11:40:08.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.366 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3097e-05 s, 0.0 kB/s 2023-10-09T11:40:08.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.422 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4516e-05 s, 0.0 kB/s 2023-10-09T11:40:08.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.478 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-09T11:40:08.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.535 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.591 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5512e-05 s, 0.0 kB/s 2023-10-09T11:40:08.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.592 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.647 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.647 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2352e-05 s, 0.0 kB/s 2023-10-09T11:40:08.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.649 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.6682e-05 s, 0.0 kB/s 2023-10-09T11:40:08.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.706 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.760 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.761 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.761 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1528e-05 s, 0.0 kB/s 2023-10-09T11:40:08.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.762 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.817 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.818 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.818 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1901e-05 s, 0.0 kB/s 2023-10-09T11:40:08.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.818 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.874 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.874 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2056e-05 s, 0.0 kB/s 2023-10-09T11:40:08.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.875 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.930 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.930 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.930 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4404e-05 s, 0.0 kB/s 2023-10-09T11:40:08.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.930 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.3726e-05 s, 0.0 kB/s 2023-10-09T11:40:08.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:08.987 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.043 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.043 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.043 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9362e-05 s, 0.0 kB/s 2023-10-09T11:40:09.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.044 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.099 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3137e-05 s, 0.0 kB/s 2023-10-09T11:40:09.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.099 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6492e-05 s, 0.0 kB/s 2023-10-09T11:40:09.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.156 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9519e-05 s, 0.0 kB/s 2023-10-09T11:40:09.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.213 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.269 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.9796e-05 s, 0.0 kB/s 2023-10-09T11:40:09.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.270 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4742e-05 s, 0.0 kB/s 2023-10-09T11:40:09.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.327 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2902e-05 s, 0.0 kB/s 2023-10-09T11:40:09.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.383 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4105e-05 s, 0.0 kB/s 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.439 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.494 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.495 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.495 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2794e-05 s, 0.0 kB/s 2023-10-09T11:40:09.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.496 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.552 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.552 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7716e-05 s, 0.0 kB/s 2023-10-09T11:40:09.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.553 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.609 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.609 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0584e-05 s, 0.0 kB/s 2023-10-09T11:40:09.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.610 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.665 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.713e-05 s, 0.0 kB/s 2023-10-09T11:40:09.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.666 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.721 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.722 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.722 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4135e-05 s, 0.0 kB/s 2023-10-09T11:40:09.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.722 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9195e-05 s, 0.0 kB/s 2023-10-09T11:40:09.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.779 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.836 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1147e-05 s, 0.0 kB/s 2023-10-09T11:40:09.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.836 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.893 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9792e-05 s, 0.0 kB/s 2023-10-09T11:40:09.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.893 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3286e-05 s, 0.0 kB/s 2023-10-09T11:40:09.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:09.950 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.006 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.007 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104786 s, 0.0 kB/s 2023-10-09T11:40:10.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.007 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0766e-05 s, 0.0 kB/s 2023-10-09T11:40:10.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.066 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.119 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8366e-05 s, 0.0 kB/s 2023-10-09T11:40:10.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.120 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4915e-05 s, 0.0 kB/s 2023-10-09T11:40:10.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.177 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.583e-05 s, 0.0 kB/s 2023-10-09T11:40:10.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.234 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.290 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.290 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.1805e-05 s, 0.0 kB/s 2023-10-09T11:40:10.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.291 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.346 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5225e-05 s, 0.0 kB/s 2023-10-09T11:40:10.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.347 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4533e-05 s, 0.0 kB/s 2023-10-09T11:40:10.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.404 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1026e-05 s, 0.0 kB/s 2023-10-09T11:40:10.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.462 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.519 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.519 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0662e-05 s, 0.0 kB/s 2023-10-09T11:40:10.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.519 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-09T11:40:10.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.576 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2383e-05 s, 0.0 kB/s 2023-10-09T11:40:10.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.634 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.689 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.690 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.690 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6029e-05 s, 0.0 kB/s 2023-10-09T11:40:10.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.690 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.0932e-05 s, 0.0 kB/s 2023-10-09T11:40:10.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.747 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9626e-05 s, 0.0 kB/s 2023-10-09T11:40:10.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.804 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4163e-05 s, 0.0 kB/s 2023-10-09T11:40:10.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.861 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2342e-05 s, 0.0 kB/s 2023-10-09T11:40:10.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.919 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:10.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:10.975 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:10.976 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4326e-05 s, 0.0 kB/s 2023-10-09T11:40:10.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:10.976 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7012e-05 s, 0.0 kB/s 2023-10-09T11:40:11.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.033 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3847e-05 s, 0.0 kB/s 2023-10-09T11:40:11.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.089 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.146 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.146 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.146 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3074e-05 s, 0.0 kB/s 2023-10-09T11:40:11.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.146 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.203 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.203 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.203 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0389e-05 s, 0.0 kB/s 2023-10-09T11:40:11.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.203 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1859e-05 s, 0.0 kB/s 2023-10-09T11:40:11.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.260 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.316 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000104852 s, 0.0 kB/s 2023-10-09T11:40:11.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.317 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2706e-05 s, 0.0 kB/s 2023-10-09T11:40:11.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.374 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100532 s, 0.0 kB/s 2023-10-09T11:40:11.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.430 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4395e-05 s, 0.0 kB/s 2023-10-09T11:40:11.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.487 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.544 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3519e-05 s, 0.0 kB/s 2023-10-09T11:40:11.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.544 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1391e-05 s, 0.0 kB/s 2023-10-09T11:40:11.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.600 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.654 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.655 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-09T11:40:11.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.656 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.713 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.713 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7219e-05 s, 0.0 kB/s 2023-10-09T11:40:11.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.713 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.769 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.769 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4269e-05 s, 0.0 kB/s 2023-10-09T11:40:11.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.770 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.825 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.826 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7859e-05 s, 0.0 kB/s 2023-10-09T11:40:11.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.827 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5032e-05 s, 0.0 kB/s 2023-10-09T11:40:11.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.884 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-09T11:40:11.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:11.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:11.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:11.997 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3068e-05 s, 0.0 kB/s 2023-10-09T11:40:11.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:11.998 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-09T11:40:12.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.054 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.109 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4385e-05 s, 0.0 kB/s 2023-10-09T11:40:12.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.110 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.192e-05 s, 0.0 kB/s 2023-10-09T11:40:12.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.167 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4872e-05 s, 0.0 kB/s 2023-10-09T11:40:12.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.224 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6483e-05 s, 0.0 kB/s 2023-10-09T11:40:12.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.337 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.337 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.337 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.55e-05 s, 0.0 kB/s 2023-10-09T11:40:12.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.338 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.393e-05 s, 0.0 kB/s 2023-10-09T11:40:12.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.394 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.449 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.449 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.449 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3133e-05 s, 0.0 kB/s 2023-10-09T11:40:12.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.450 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4216e-05 s, 0.0 kB/s 2023-10-09T11:40:12.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.506 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.561 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.561 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0916e-05 s, 0.0 kB/s 2023-10-09T11:40:12.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.562 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6583e-05 s, 0.0 kB/s 2023-10-09T11:40:12.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.618 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.674 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.675 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8788e-05 s, 0.0 kB/s 2023-10-09T11:40:12.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.675 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2485e-05 s, 0.0 kB/s 2023-10-09T11:40:12.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.754 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4662e-05 s, 0.0 kB/s 2023-10-09T11:40:12.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.809 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.865 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.865 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.865 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3771e-05 s, 0.0 kB/s 2023-10-09T11:40:12.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.866 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.921 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.921 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.8669e-05 s, 0.0 kB/s 2023-10-09T11:40:12.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.922 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7142e-05 s, 0.0 kB/s 2023-10-09T11:40:12.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:12.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.034 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.034 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.035 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0594e-05 s, 0.0 kB/s 2023-10-09T11:40:13.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.035 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.091 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.395e-05 s, 0.0 kB/s 2023-10-09T11:40:13.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.091 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.147 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.148 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.148 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3539e-05 s, 0.0 kB/s 2023-10-09T11:40:13.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.148 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2095e-05 s, 0.0 kB/s 2023-10-09T11:40:13.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.206 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4152e-05 s, 0.0 kB/s 2023-10-09T11:40:13.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.264 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4916e-05 s, 0.0 kB/s 2023-10-09T11:40:13.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.321 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6423e-05 s, 0.0 kB/s 2023-10-09T11:40:13.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.377 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000112583 s, 0.0 kB/s 2023-10-09T11:40:13.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.435 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6506e-05 s, 0.0 kB/s 2023-10-09T11:40:13.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.492 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7605e-05 s, 0.0 kB/s 2023-10-09T11:40:13.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.551 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.606 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.607 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.607 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4104e-05 s, 0.0 kB/s 2023-10-09T11:40:13.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.607 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.663 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.664 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.664 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.2028e-05 s, 0.0 kB/s 2023-10-09T11:40:13.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.664 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.720 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.720 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5249e-05 s, 0.0 kB/s 2023-10-09T11:40:13.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.721 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1402e-05 s, 0.0 kB/s 2023-10-09T11:40:13.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.778 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.835 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.835 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 7.2025e-05 s, 0.0 kB/s 2023-10-09T11:40:13.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.835 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.892 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.892 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2852e-05 s, 0.0 kB/s 2023-10-09T11:40:13.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.893 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.7165e-05 s, 0.0 kB/s 2023-10-09T11:40:13.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:13.951 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.007 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.008 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.6545e-05 s, 0.0 kB/s 2023-10-09T11:40:14.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.008 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2615e-05 s, 0.0 kB/s 2023-10-09T11:40:14.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.065 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2707e-05 s, 0.0 kB/s 2023-10-09T11:40:14.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.121 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.177 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.178 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.178 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4752e-05 s, 0.0 kB/s 2023-10-09T11:40:14.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.178 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.234 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.304e-05 s, 0.0 kB/s 2023-10-09T11:40:14.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.234 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.291 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2885e-05 s, 0.0 kB/s 2023-10-09T11:40:14.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.292 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.347 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2478e-05 s, 0.0 kB/s 2023-10-09T11:40:14.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.348 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.403 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.404 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.307e-05 s, 0.0 kB/s 2023-10-09T11:40:14.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.404 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.460 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 6.6568e-05 s, 0.0 kB/s 2023-10-09T11:40:14.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.517 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.518 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.518 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5928e-05 s, 0.0 kB/s 2023-10-09T11:40:14.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.518 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.575 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.575 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3128e-05 s, 0.0 kB/s 2023-10-09T11:40:14.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.576 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.631 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3553e-05 s, 0.0 kB/s 2023-10-09T11:40:14.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.632 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3704e-05 s, 0.0 kB/s 2023-10-09T11:40:14.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.744 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.744 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5368e-05 s, 0.0 kB/s 2023-10-09T11:40:14.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.744 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.3906e-05 s, 0.0 kB/s 2023-10-09T11:40:14.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.801 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.858 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.858 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.858 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3951e-05 s, 0.0 kB/s 2023-10-09T11:40:14.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.858 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4317e-05 s, 0.0 kB/s 2023-10-09T11:40:14.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.915 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-09T11:40:14.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:14.972 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6731e-05 s, 0.0 kB/s 2023-10-09T11:40:15.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.029 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.086 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.086 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4116e-05 s, 0.0 kB/s 2023-10-09T11:40:15.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.086 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.142 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9038e-05 s, 0.0 kB/s 2023-10-09T11:40:15.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.143 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.734e-05 s, 0.0 kB/s 2023-10-09T11:40:15.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.201 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.258 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.3757e-05 s, 0.0 kB/s 2023-10-09T11:40:15.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.258 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.314 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.314 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.6791e-05 s, 0.0 kB/s 2023-10-09T11:40:15.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.315 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.375 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4349e-05 s, 0.0 kB/s 2023-10-09T11:40:15.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.376 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.431 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.431 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.431 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.9105e-05 s, 0.0 kB/s 2023-10-09T11:40:15.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.432 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.487 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.488 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 5.994e-05 s, 0.0 kB/s 2023-10-09T11:40:15.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.488 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.544 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.544 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.544 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109229 s, 0.0 kB/s 2023-10-09T11:40:15.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.545 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.601 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.602 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.6832e-05 s, 0.0 kB/s 2023-10-09T11:40:15.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.658 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.5189e-05 s, 0.0 kB/s 2023-10-09T11:40:15.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.659 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.714 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.714 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-09T11:40:15.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.715 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2234e-05 s, 0.0 kB/s 2023-10-09T11:40:15.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.771 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.826 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.2212e-05 s, 0.0 kB/s 2023-10-09T11:40:15.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.827 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000109385 s, 0.0 kB/s 2023-10-09T11:40:15.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.884 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.940 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.940 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.5055e-05 s, 0.0 kB/s 2023-10-09T11:40:15.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:15.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:15.997 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:15.997 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.0618e-05 s, 0.0 kB/s 2023-10-09T11:40:15.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:15.998 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.053 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.054 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.054 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1683e-05 s, 0.0 kB/s 2023-10-09T11:40:16.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.055 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.111 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.111 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2108e-05 s, 0.0 kB/s 2023-10-09T11:40:16.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.112 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3558e-05 s, 0.0 kB/s 2023-10-09T11:40:16.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.168 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.225 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.225 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3769e-05 s, 0.0 kB/s 2023-10-09T11:40:16.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.225 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.283 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9412e-05 s, 0.0 kB/s 2023-10-09T11:40:16.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.284 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.4772e-05 s, 0.0 kB/s 2023-10-09T11:40:16.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.340 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 8.9298e-05 s, 0.0 kB/s 2023-10-09T11:40:16.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.397 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4002e-05 s, 0.0 kB/s 2023-10-09T11:40:16.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.453 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 4.1673e-05 s, 0.0 kB/s 2023-10-09T11:40:16.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.510 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000103236 s, 0.0 kB/s 2023-10-09T11:40:16.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.567 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.364e-05 s, 0.0 kB/s 2023-10-09T11:40:16.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.624 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.680 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.681 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.4959e-05 s, 0.0 kB/s 2023-10-09T11:40:16.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.681 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.737 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.737 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-09T11:40:16.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.737 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 0.000100369 s, 0.0 kB/s 2023-10-09T11:40:16.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.794 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.848 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.849 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2517e-05 s, 0.0 kB/s 2023-10-09T11:40:16.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.906 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.906 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.906 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.2941e-05 s, 0.0 kB/s 2023-10-09T11:40:16.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.907 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:16.962 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:16.962 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:16.962 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-09T11:40:16.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:16.962 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-09T11:40:17.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.018 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0069e-05 s, 0.0 kB/s 2023-10-09T11:40:17.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.075 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.129 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.129 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.129 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3488e-05 s, 0.0 kB/s 2023-10-09T11:40:17.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.130 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.0573e-05 s, 0.0 kB/s 2023-10-09T11:40:17.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.187 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.242 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.242 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3034e-05 s, 0.0 kB/s 2023-10-09T11:40:17.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.298 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.299 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 3.3511e-05 s, 0.0 kB/s 2023-10-09T11:40:17.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:17.299 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000261528/4bdcb833-560b-4008-8e62-8607c48d7746/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:40:17.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records in 2023-10-09T11:40:17.354 INFO:teuthology.orchestra.run.smithi026.stderr:0+0 records out 2023-10-09T11:40:17.354 INFO:teuthology.orchestra.run.smithi026.stderr:0 bytes copied, 9.1629e-05 s, 0.0 kB/s 2023-10-09T11:40:17.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000261528 2023-10-09T11:40:17.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.516+0000 7f7dda812700 1 Processor -- start 2023-10-09T11:40:17.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.516+0000 7f7dda812700 1 -- start start 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.517+0000 7f7dda812700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.517+0000 7f7dda812700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 0x7f7dd40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.517+0000 7f7dda812700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40cc060 con 0x7f7dd40b1a10 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.517+0000 7f7dda812700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40b1e90 con 0x7f7dd40aead0 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.517+0000 7f7dda812700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40cb450 con 0x7f7dd41576d0 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 0x7f7dd40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:59778/0 (socket says 172.21.15.26:59778) 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 -- 172.21.15.26:0/2843385431 learned_addr learned my addr 172.21.15.26:0/2843385431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd8daf700 1 --1- 172.21.15.26:0/2843385431 >> v1:172.21.15.67:6789/0 conn(0x7f7dd40b1a10 0x7f7dd40abdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:49748/0 (socket says 172.21.15.26:49748) 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 -- 172.21.15.26:0/2843385431 >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 msgr2=0x7f7dd40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 --2- 172.21.15.26:0/2843385431 >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 0x7f7dd40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 -- 172.21.15.26:0/2843385431 >> v1:172.21.15.67:6789/0 conn(0x7f7dd40b1a10 legacy=0x7f7dd40abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 -- 172.21.15.26:0/2843385431 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40cb730 con 0x7f7dd41576d0 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd37fe700 1 --2- 172.21.15.26:0/2843385431 >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 0x7f7dd40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.518+0000 7f7dd3fff700 1 --2- 172.21.15.26:0/2843385431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80099b0 tx=0x7f7dc8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dffdc3519a66efc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dd2ffd700 1 -- 172.21.15.26:0/2843385431 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8009ea0 con 0x7f7dd41576d0 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dd2ffd700 1 -- 172.21.15.26:0/2843385431 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc800b860 con 0x7f7dd41576d0 2023-10-09T11:40:17.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dd2ffd700 1 -- 172.21.15.26:0/2843385431 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800bc00 con 0x7f7dd41576d0 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 -- 172.21.15.26:0/2843385431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 msgr2=0x7f7dd40ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 --2- 172.21.15.26:0/2843385431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80099b0 tx=0x7f7dc8009250 comp rx=0 tx=0).stop 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 -- 172.21.15.26:0/2843385431 shutdown_connections 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 --2- 172.21.15.26:0/2843385431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd40ae590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 --2- 172.21.15.26:0/2843385431 >> v2:172.21.15.67:3300/0 conn(0x7f7dd40aead0 0x7f7dd40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 -- 172.21.15.26:0/2843385431 >> 172.21.15.26:0/2843385431 conn(0x7f7dd406d170 msgr2=0x7f7dd40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 -- 172.21.15.26:0/2843385431 shutdown_connections 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.519+0000 7f7dda812700 1 -- 172.21.15.26:0/2843385431 wait complete. 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.520+0000 7f7dda812700 1 Processor -- start 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.520+0000 7f7dda812700 1 -- start start 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd40b1a10 0x7f7dd414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414de30 con 0x7f7dd40aead0 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414e110 con 0x7f7dd40b1a10 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dda812700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414e3f0 con 0x7f7dd41576d0 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dd3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dd3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51300/0 (socket says 172.21.15.26:51300) 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dd3fff700 1 -- 172.21.15.26:0/867067739 learned_addr learned my addr 172.21.15.26:0/867067739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dd37fe700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd40b1a10 0x7f7dd414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.521+0000 7f7dd8daf700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 -- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 msgr2=0x7f7dd4155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd4155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 -- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd40b1a10 msgr2=0x7f7dd414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd40b1a10 0x7f7dd414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 -- 172.21.15.26:0/867067739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009420 con 0x7f7dd40aead0 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd8daf700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dd3fff700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cb590 tx=0x7f7dc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800bbe0 con 0x7f7dd40aead0 2023-10-09T11:40:17.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc801a430 con 0x7f7dd40aead0 2023-10-09T11:40:17.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80094f0 con 0x7f7dd40aead0 2023-10-09T11:40:17.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc801a7d0 con 0x7f7dd40aead0 2023-10-09T11:40:17.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.522+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd414ea40 con 0x7f7dd40aead0 2023-10-09T11:40:17.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.523+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd404c3c0 con 0x7f7dd40aead0 2023-10-09T11:40:17.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.523+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7dc801abc0 con 0x7f7dd40aead0 2023-10-09T11:40:17.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.524+0000 7f7dbbfff700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 0x7f7dc0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.524+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7dc8086220 con 0x7f7dd40aead0 2023-10-09T11:40:17.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.524+0000 7f7dd37fe700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 0x7f7dc0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.525+0000 7f7dd37fe700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 0x7f7dc0069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ace10 tx=0x7f7dc40091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.529+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc8053460 con 0x7f7dd40aead0 2023-10-09T11:40:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.755+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000261528", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dd40cba10 con 0x7f7dc0066fc0 2023-10-09T11:40:17.761 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.760+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.761 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.760+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.761 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.760+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.762 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.760+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.762 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.760+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.794+0000 7f7dbbfff700 1 -- 172.21.15.26:0/867067739 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7dd40cba10 con 0x7f7dc0066fc0 2023-10-09T11:40:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 msgr2=0x7f7dc0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 0x7f7dc0069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ace10 tx=0x7f7dc40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 msgr2=0x7f7dd414bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cb590 tx=0x7f7dc8017000 comp rx=0 tx=0).stop 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 shutdown_connections 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7dc0066fc0 0x7f7dc0069470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dd41576d0 0x7f7dd4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd40aead0 0x7f7dd414bfa0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 --2- 172.21.15.26:0/867067739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd40b1a10 0x7f7dd414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 >> 172.21.15.26:0/867067739 conn(0x7f7dd406d170 msgr2=0x7f7dd41566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 shutdown_connections 2023-10-09T11:40:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.796+0000 7f7dda812700 1 -- 172.21.15.26:0/867067739 wait complete. 2023-10-09T11:40:17.799 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.798+0000 7f48c43cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.799 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.798+0000 7f48c43cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.799 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.798+0000 7f48c43cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.799 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.798+0000 7f48c43cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.800 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.798+0000 7f48c43cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T11:40:17.814 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.813+0000 7f48c2bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.814 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.813+0000 7f48c2bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.814 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.813+0000 7f48c2bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.814 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.813+0000 7f48c2bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.814 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:17.813+0000 7f48c2bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.928+0000 7f9a94282700 1 Processor -- start 2023-10-09T11:40:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.928+0000 7f9a94282700 1 -- start start 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a94282700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a94282700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c0ccfd0 con 0x7f9a8c159530 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a94282700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c15a3d0 con 0x7f9a8c06dc70 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a94282700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c15a6b0 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a9201e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a8c159530 0x7f9a8c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40702/0 (socket says 172.21.15.26:40702) 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.929+0000 7f9a9201e700 1 -- 172.21.15.26:0/1444722959 learned_addr learned my addr 172.21.15.26:0/1444722959 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9281f700 1 --2- 172.21.15.26:0/1444722959 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397698070 0 0) 0x7f9a8c0ccfd0 con 0x7f9a8c159530 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a78003570 con 0x7f9a8c159530 2023-10-09T11:40:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431139194 0 0) 0x7f9a8c15a3d0 con 0x7f9a8c06dc70 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a8c0ccfd0 con 0x7f9a8c06dc70 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9281f700 1 -- 172.21.15.26:0/1444722959 >> v1:172.21.15.67:6789/0 conn(0x7f9a8c06dc70 legacy=0x7f9a8c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 332729841 0 0) 0x7f9a78003570 con 0x7f9a8c159530 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9281f700 1 -- 172.21.15.26:0/1444722959 >> v1:172.21.15.26:6789/0 conn(0x7f9a8c159530 legacy=0x7f9a8c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9281f700 1 -- 172.21.15.26:0/1444722959 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c15a990 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9281f700 1 --2- 172.21.15.26:0/1444722959 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0cb6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009e90 tx=0x7f9a84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16cbcb275fde48f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400e070 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400b870 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.930+0000 7f9a9101c700 1 -- 172.21.15.26:0/1444722959 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88001470 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 -- 172.21.15.26:0/1444722959 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 msgr2=0x7f9a8c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 --2- 172.21.15.26:0/1444722959 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0cb6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009e90 tx=0x7f9a84009780 comp rx=0 tx=0).stop 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 -- 172.21.15.26:0/1444722959 shutdown_connections 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 --2- 172.21.15.26:0/1444722959 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0cb6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 -- 172.21.15.26:0/1444722959 >> 172.21.15.26:0/1444722959 conn(0x7f9a8c0703a0 msgr2=0x7f9a8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 -- 172.21.15.26:0/1444722959 shutdown_connections 2023-10-09T11:40:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.931+0000 7f9a94282700 1 -- 172.21.15.26:0/1444722959 wait complete. 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.932+0000 7f9a94282700 1 Processor -- start 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.932+0000 7f9a94282700 1 -- start start 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0b4440 con 0x7f9a8c159530 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c9260 con 0x7f9a8c06dc70 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a94282700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0b38c0 con 0x7f9a8c06e0e0 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9201e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51302/0 (socket says 172.21.15.26:51302) 2023-10-09T11:40:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9201e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:57758/0 (socket says 172.21.15.26:57758) 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 -- 172.21.15.26:0/2649185856 learned_addr learned my addr 172.21.15.26:0/2649185856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9181d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 -- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 msgr2=0x7f9a8c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 -- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 msgr2=0x7f9a8c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 -- 172.21.15.26:0/2649185856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84009a20 con 0x7f9a8c159530 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9201e700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.933+0000 7f9a9281f700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9a84003000 tx=0x7f9a84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a84012bb0 con 0x7f9a8c159530 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a84012d30 con 0x7f9a8c159530 2023-10-09T11:40:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a84012ea0 con 0x7f9a8c159530 2023-10-09T11:40:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c0b3ba0 con 0x7f9a8c159530 2023-10-09T11:40:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c0b4160 con 0x7f9a8c159530 2023-10-09T11:40:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.934+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c04c3c0 con 0x7f9a8c159530 2023-10-09T11:40:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.935+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9a8401e8b0 con 0x7f9a8c159530 2023-10-09T11:40:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.935+0000 7f9a827fc700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 0x7f9a70069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.935+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9a84086530 con 0x7f9a8c159530 2023-10-09T11:40:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.936+0000 7f9a9201e700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 0x7f9a70069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.936+0000 7f9a9201e700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 0x7f9a70069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a880011e0 tx=0x7f9a88000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:17.940+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a84053660 con 0x7f9a8c159530 2023-10-09T11:40:18.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.163+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8c15ac70 con 0x7f9a70066fc0 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.171+0000 7f9a827fc700 1 -- 172.21.15.26:0/2649185856 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+536 (secure 0 0 0) 0x7f9a8c15ac70 con 0x7f9a70066fc0 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mon_addrs": [ 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6789", 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6789", 2023-10-09T11:40:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6790" 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "pending_subvolume_deletions": 1, 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": { 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "data": [ 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365958365184, 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_data", 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 8192 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:18.174 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": [ 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365958365184, 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_metadata", 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 20672512 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout: "used_size": 145 2023-10-09T11:40:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:40:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.173+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 msgr2=0x7f9a70069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.173+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 0x7f9a70069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a880011e0 tx=0x7f9a88000bc0 comp rx=0 tx=0).stop 2023-10-09T11:40:18.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.173+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 msgr2=0x7f9a8c0b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.173+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9a84003000 tx=0x7f9a84017000 comp rx=0 tx=0).stop 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 shutdown_connections 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c159530 0x7f9a8c0b15c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a8c06dc70 0x7f9a8c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a70066fc0 0x7f9a70069470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 --2- 172.21.15.26:0/2649185856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a8c06e0e0 0x7f9a8c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 >> 172.21.15.26:0/2649185856 conn(0x7f9a8c0703a0 msgr2=0x7f9a8c15c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 shutdown_connections 2023-10-09T11:40:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:18.174+0000 7f9a94282700 1 -- 172.21.15.26:0/2649185856 wait complete. 2023-10-09T11:40:18.187 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:18.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:18.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:18.270 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:18.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:40:18.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:18.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:18.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:40:18.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:18.820 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:40:18.836 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:40:18.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:18.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:19.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:40:19.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:19.366 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:40:19.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:19.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.509+0000 7f628bfa1700 1 Processor -- start 2023-10-09T11:40:19.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 -- start start 2023-10-09T11:40:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62840cb970 0x7f6284159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f628415a400 0x7f6284156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628415ae40 con 0x7f62840cb5a0 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840ce0f0 con 0x7f62840cb970 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.510+0000 7f628bfa1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840d13f0 con 0x7f628415a400 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6289d3d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f62840cb5a0 0x7f62840cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40712/0 (socket says 172.21.15.26:40712) 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62840cb970 0x7f6284159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6289d3d700 1 -- 172.21.15.26:0/1486327507 learned_addr learned my addr 172.21.15.26:0/1486327507 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628a53e700 1 --2- 172.21.15.26:0/1486327507 >> v2:172.21.15.67:3300/0 conn(0x7f628415a400 0x7f6284156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 -- 172.21.15.26:0/1486327507 >> v2:172.21.15.67:3300/0 conn(0x7f628415a400 msgr2=0x7f6284156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 --2- 172.21.15.26:0/1486327507 >> v2:172.21.15.67:3300/0 conn(0x7f628415a400 0x7f6284156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 -- 172.21.15.26:0/1486327507 >> v1:172.21.15.26:6789/0 conn(0x7f62840cb5a0 legacy=0x7f62840cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 -- 172.21.15.26:0/1486327507 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628415ab60 con 0x7f62840cb970 2023-10-09T11:40:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6288d3b700 1 -- 172.21.15.26:0/1486327507 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468662223 0 0) 0x7f628415ae40 con 0x7f62840cb5a0 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f628953c700 1 --2- 172.21.15.26:0/1486327507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb970 0x7f6284159ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f62840ccdf0 tx=0x7f62780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2971d5e3bb5bec12 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6288d3b700 1 -- 172.21.15.26:0/1486327507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011630 con 0x7f62840cb970 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6288d3b700 1 -- 172.21.15.26:0/1486327507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278011790 con 0x7f62840cb970 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.511+0000 7f6288d3b700 1 -- 172.21.15.26:0/1486327507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011b30 con 0x7f62840cb970 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 -- 172.21.15.26:0/1486327507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb970 msgr2=0x7f6284159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1486327507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb970 0x7f6284159ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f62840ccdf0 tx=0x7f62780091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 -- 172.21.15.26:0/1486327507 shutdown_connections 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1486327507 >> v2:172.21.15.67:3300/0 conn(0x7f628415a400 0x7f6284156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1486327507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb970 0x7f6284159ec0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 -- 172.21.15.26:0/1486327507 >> 172.21.15.26:0/1486327507 conn(0x7f6284070e30 msgr2=0x7f62840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 -- 172.21.15.26:0/1486327507 shutdown_connections 2023-10-09T11:40:19.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.512+0000 7f628bfa1700 1 -- 172.21.15.26:0/1486327507 wait complete. 2023-10-09T11:40:19.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.513+0000 7f628bfa1700 1 Processor -- start 2023-10-09T11:40:19.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.513+0000 7f628bfa1700 1 -- start start 2023-10-09T11:40:19.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62840cb970 0x7f628415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f628415a400 0x7f62841513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628415c440 con 0x7f62840cb5a0 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628415b5b0 con 0x7f628415a400 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628bfa1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628415b830 con 0x7f62840cb970 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51324/0 (socket says 172.21.15.26:51324) 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 -- 172.21.15.26:0/1127081570 learned_addr learned my addr 172.21.15.26:0/1127081570 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628953c700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62840cb970 0x7f628415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f628a53e700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f628415a400 0x7f62841513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 -- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62840cb970 msgr2=0x7f628415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62840cb970 0x7f628415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 -- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f628415a400 msgr2=0x7f62841513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f628415a400 0x7f62841513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 -- 172.21.15.26:0/1127081570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009420 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.514+0000 7f6289d3d700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f627400c7e0 tx=0x7f6274007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.515+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274005b30 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.515+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6274005c90 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.515+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628415bb10 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.515+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274007300 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.515+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628415c0d0 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.516+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628415c720 con 0x7f62840cb5a0 2023-10-09T11:40:19.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.516+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f627401b3b0 con 0x7f62840cb5a0 2023-10-09T11:40:19.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.516+0000 7f6281ffb700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 0x7f6270069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.516+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6274083e60 con 0x7f62840cb5a0 2023-10-09T11:40:19.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.517+0000 7f628953c700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 0x7f6270069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.517+0000 7f628953c700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 0x7f6270069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62780093f0 tx=0x7f6278017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.521+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6274050d30 con 0x7f62840cb5a0 2023-10-09T11:40:19.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.755+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f628404c3c0 con 0x7f62840cb5a0 2023-10-09T11:40:19.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.756+0000 7f6281ffb700 1 -- 172.21.15.26:0/1127081570 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6274017090 con 0x7f62840cb5a0 2023-10-09T11:40:19.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:19.758 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 msgr2=0x7f6270069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 0x7f6270069620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62780093f0 tx=0x7f6278017000 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 msgr2=0x7f62840ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f627400c7e0 tx=0x7f6274007df0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 shutdown_connections 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f628415a400 0x7f62841513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62840cb5a0 0x7f62840ca150 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6270067170 0x7f6270069620 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 --2- 172.21.15.26:0/1127081570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62840cb970 0x7f628415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 >> 172.21.15.26:0/1127081570 conn(0x7f6284070e30 msgr2=0x7f62840b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:19.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 shutdown_connections 2023-10-09T11:40:19.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.758+0000 7f628bfa1700 1 -- 172.21.15.26:0/1127081570 wait complete. 2023-10-09T11:40:19.761 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 40 2023-10-09T11:40:19.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.889+0000 7f042afb6700 1 Processor -- start 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.889+0000 7f042afb6700 1 -- start start 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f042afb6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f04240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f042afb6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042415ae40 con 0x7f04240cd9e0 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f042afb6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042415ab60 con 0x7f04240cde50 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f042afb6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240d13f0 con 0x7f04240cb5a0 2023-10-09T11:40:19.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f0423fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f04240cd9e0 0x7f0424159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41292/0 (socket says 172.21.15.26:41292) 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f0423fff700 1 -- 172.21.15.26:0/1493049386 learned_addr learned my addr 172.21.15.26:0/1493049386 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f0428d52700 1 --2- 172.21.15.26:0/1493049386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f04240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.890+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711548653 0 0) 0x7f042415ae40 con 0x7f04240cd9e0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f040c003570 con 0x7f04240cd9e0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292796500 0 0) 0x7f042415ab60 con 0x7f04240cde50 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f042415ae40 con 0x7f04240cde50 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f0428d52700 1 -- 172.21.15.26:0/1493049386 >> v1:172.21.15.67:6789/0 conn(0x7f04240cde50 legacy=0x7f0424156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f0428d52700 1 -- 172.21.15.26:0/1493049386 >> v1:172.21.15.26:6789/0 conn(0x7f04240cd9e0 legacy=0x7f0424159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f0428d52700 1 -- 172.21.15.26:0/1493049386 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240ccf00 con 0x7f04240cb5a0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f0428d52700 1 --2- 172.21.15.26:0/1493049386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f04240cb970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e90 tx=0x7f041c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec5c5b95959d7cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00e070 con 0x7f04240cb5a0 2023-10-09T11:40:19.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00bb80 con 0x7f04240cb5a0 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.891+0000 7f04237fe700 1 -- 172.21.15.26:0/1493049386 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c012430 con 0x7f04240cb5a0 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 -- 172.21.15.26:0/1493049386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 msgr2=0x7f04240cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 --2- 172.21.15.26:0/1493049386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f04240cb970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e90 tx=0x7f041c009780 comp rx=0 tx=0).stop 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 -- 172.21.15.26:0/1493049386 shutdown_connections 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 --2- 172.21.15.26:0/1493049386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f04240cb970 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 -- 172.21.15.26:0/1493049386 >> 172.21.15.26:0/1493049386 conn(0x7f0424070e30 msgr2=0x7f04240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 -- 172.21.15.26:0/1493049386 shutdown_connections 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.892+0000 7f042afb6700 1 -- 172.21.15.26:0/1493049386 wait complete. 2023-10-09T11:40:19.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.893+0000 7f042afb6700 1 Processor -- start 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.893+0000 7f042afb6700 1 -- start start 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f042415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042415a6f0 0x7f0424155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424169d30 con 0x7f04240cd9e0 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042415c520 con 0x7f042415a6f0 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042415c800 con 0x7f04240cb5a0 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55366/0 (socket says 172.21.15.26:55366) 2023-10-09T11:40:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 -- 172.21.15.26:0/3877439161 learned_addr learned my addr 172.21.15.26:0/3877439161 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0428d52700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f042415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0429553700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042415a6f0 0x7f0424155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 -- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 msgr2=0x7f042415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f042415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 -- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042415a6f0 msgr2=0x7f0424155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042415a6f0 0x7f0424155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 -- 172.21.15.26:0/3877439161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009a20 con 0x7f04240cd9e0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0423fff700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f041800c790 tx=0x7f0418007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418005b30 con 0x7f04240cd9e0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418005c90 con 0x7f04240cd9e0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042415cae0 con 0x7f04240cd9e0 2023-10-09T11:40:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418007300 con 0x7f04240cd9e0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.894+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240c92e0 con 0x7f04240cd9e0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.895+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0424169ee0 con 0x7f04240cd9e0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.896+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f041801b3b0 con 0x7f04240cd9e0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.896+0000 7f0420ff9700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 0x7f0410069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.896+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0418083dc0 con 0x7f04240cd9e0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.896+0000 7f0428d52700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 0x7f0410069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:19.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.897+0000 7f0428d52700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 0x7f0410069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097c0 tx=0x7f041c019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:19.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:19.900+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0424169ee0 con 0x7f04240cd9e0 2023-10-09T11:40:20.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.095+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f042404c3c0 con 0x7f04240cd9e0 2023-10-09T11:40:20.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.095+0000 7f0420ff9700 1 -- 172.21.15.26:0/3877439161 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15402 (secure 0 0 0) 0x7f0418017020 con 0x7f04240cd9e0 2023-10-09T11:40:20.097 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:20.097 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":65,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:38:06.217788+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 msgr2=0x7f0410069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 0x7f0410069620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097c0 tx=0x7f041c019000 comp rx=0 tx=0).stop 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 msgr2=0x7f042415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f041800c790 tx=0x7f0418007ea0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 shutdown_connections 2023-10-09T11:40:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042415a6f0 0x7f0424155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0410067170 0x7f0410069620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04240cb5a0 0x7f042415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 --2- 172.21.15.26:0/3877439161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04240cd9e0 0x7f042415ba50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.097+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 >> 172.21.15.26:0/3877439161 conn(0x7f0424070e30 msgr2=0x7f04240b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.098+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 shutdown_connections 2023-10-09T11:40:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.098+0000 7f042afb6700 1 -- 172.21.15.26:0/3877439161 wait complete. 2023-10-09T11:40:20.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:37:09.056959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:37:09.617851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:40:20.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:20.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.233+0000 7f7bce34c700 1 Processor -- start 2023-10-09T11:40:20.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.233+0000 7f7bce34c700 1 -- start start 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bce34c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 0x7f7bc80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bce34c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc80ccfd0 con 0x7f7bc8159530 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bce34c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc815a3d0 con 0x7f7bc806dc70 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bce34c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc815a6b0 con 0x7f7bc806e0e0 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7bc8159530 0x7f7bc80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41296/0 (socket says 172.21.15.26:41296) 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc7fff700 1 -- 172.21.15.26:0/1996111851 learned_addr learned my addr 172.21.15.26:0/1996111851 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bcc8e9700 1 --2- 172.21.15.26:0/1996111851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 0x7f7bc80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275101194 0 0) 0x7f7bc80ccfd0 con 0x7f7bc8159530 2023-10-09T11:40:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb4003570 con 0x7f7bc8159530 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209194322 0 0) 0x7f7bc815a3d0 con 0x7f7bc806dc70 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc80ccfd0 con 0x7f7bc806dc70 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bcc8e9700 1 -- 172.21.15.26:0/1996111851 >> v1:172.21.15.67:6789/0 conn(0x7f7bc806dc70 legacy=0x7f7bc8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bcc8e9700 1 -- 172.21.15.26:0/1996111851 >> v1:172.21.15.26:6789/0 conn(0x7f7bc8159530 legacy=0x7f7bc80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bcc8e9700 1 -- 172.21.15.26:0/1996111851 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc815a990 con 0x7f7bc806e0e0 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.234+0000 7f7bcc8e9700 1 --2- 172.21.15.26:0/1996111851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 0x7f7bc80cb6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e90 tx=0x7f7bc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214853c4a1c669bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000e070 con 0x7f7bc806e0e0 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000bb80 con 0x7f7bc806e0e0 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bc6ffd700 1 -- 172.21.15.26:0/1996111851 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0012430 con 0x7f7bc806e0e0 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 -- 172.21.15.26:0/1996111851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 msgr2=0x7f7bc80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1996111851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 0x7f7bc80cb6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e90 tx=0x7f7bc0009780 comp rx=0 tx=0).stop 2023-10-09T11:40:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 -- 172.21.15.26:0/1996111851 shutdown_connections 2023-10-09T11:40:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1996111851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806e0e0 0x7f7bc80cb6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 -- 172.21.15.26:0/1996111851 >> 172.21.15.26:0/1996111851 conn(0x7f7bc80703a0 msgr2=0x7f7bc80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 -- 172.21.15.26:0/1996111851 shutdown_connections 2023-10-09T11:40:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.235+0000 7f7bce34c700 1 -- 172.21.15.26:0/1996111851 wait complete. 2023-10-09T11:40:20.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.236+0000 7f7bce34c700 1 Processor -- start 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.236+0000 7f7bce34c700 1 -- start start 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806dc70 0x7f7bc816d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc8159530 0x7f7bc80d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81466a0 con 0x7f7bc806e0e0 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc816dbc0 con 0x7f7bc8159530 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bce34c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc816dea0 con 0x7f7bc806dc70 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bc7fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806dc70 0x7f7bc816d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55370/0 (socket says 172.21.15.26:55370) 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bc77fe700 1 -- 172.21.15.26:0/1118019 learned_addr learned my addr 172.21.15.26:0/1118019 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.237+0000 7f7bcc8e9700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc8159530 0x7f7bc80d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 -- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806dc70 msgr2=0x7f7bc816d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806dc70 0x7f7bc816d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 -- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc8159530 msgr2=0x7f7bc80d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc8159530 0x7f7bc80d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 -- 172.21.15.26:0/1118019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0009a20 con 0x7f7bc806e0e0 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bc77fe700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c580 tx=0x7f7bb8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8010510 con 0x7f7bc806e0e0 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb8010670 con 0x7f7bc806e0e0 2023-10-09T11:40:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc816e180 con 0x7f7bc806e0e0 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8010a30 con 0x7f7bc806e0e0 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.238+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc80b3720 con 0x7f7bc806e0e0 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.239+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc80b3d10 con 0x7f7bc806e0e0 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.239+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7bb801b400 con 0x7f7bc806e0e0 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.240+0000 7f7bbffff700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 0x7f7ba8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.240+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7bb80843c0 con 0x7f7bc806e0e0 2023-10-09T11:40:20.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.240+0000 7f7bc7fff700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 0x7f7ba8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.240+0000 7f7bc7fff700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 0x7f7ba8069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0007fd0 tx=0x7f7bb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.244+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bc80b3d10 con 0x7f7bc806e0e0 2023-10-09T11:40:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.437+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bc80b3d10 con 0x7f7bc806e0e0 2023-10-09T11:40:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.437+0000 7f7bbffff700 1 -- 172.21.15.26:0/1118019 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bc80b3d10 con 0x7f7bc806e0e0 2023-10-09T11:40:20.439 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:40:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 msgr2=0x7f7ba8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 0x7f7ba8069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0007fd0 tx=0x7f7bb0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 msgr2=0x7f7bc8146160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c580 tx=0x7f7bb8007e10 comp rx=0 tx=0).stop 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 shutdown_connections 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bc8159530 0x7f7bc80d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ba8067170 0x7f7ba8069620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bc806dc70 0x7f7bc816d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.439+0000 7f7bce34c700 1 --2- 172.21.15.26:0/1118019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc806e0e0 0x7f7bc8146160 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.440+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 >> 172.21.15.26:0/1118019 conn(0x7f7bc80703a0 msgr2=0x7f7bc8153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.440+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 shutdown_connections 2023-10-09T11:40:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.440+0000 7f7bce34c700 1 -- 172.21.15.26:0/1118019 wait complete. 2023-10-09T11:40:20.453 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:40:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.572+0000 7ffb8d113700 1 Processor -- start 2023-10-09T11:40:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.573+0000 7ffb8d113700 1 -- start start 2023-10-09T11:40:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.573+0000 7ffb8d113700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb880cc320 0x7ffb8813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.573+0000 7ffb8d113700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8806d7b0 con 0x7ffb8806a110 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.573+0000 7ffb8d113700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8806e330 con 0x7ffb880cc6f0 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.573+0000 7ffb8d113700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8806a570 con 0x7ffb880cc320 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb8759e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffb8806a110 0x7ffb8806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41312/0 (socket says 172.21.15.26:41312) 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb8759e700 1 -- 172.21.15.26:0/3472094676 learned_addr learned my addr 172.21.15.26:0/3472094676 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb86d9d700 1 --2- 172.21.15.26:0/3472094676 >> v2:172.21.15.67:3300/0 conn(0x7ffb880cc320 0x7ffb8813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723251321 0 0) 0x7ffb8806d7b0 con 0x7ffb8806a110 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb74003570 con 0x7ffb8806a110 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb86d9d700 1 -- 172.21.15.26:0/3472094676 >> v1:172.21.15.67:6789/0 conn(0x7ffb880cc6f0 legacy=0x7ffb88069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250691656 0 0) 0x7ffb8806e330 con 0x7ffb880cc6f0 2023-10-09T11:40:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb86d9d700 1 -- 172.21.15.26:0/3472094676 >> v1:172.21.15.26:6789/0 conn(0x7ffb8806a110 legacy=0x7ffb8806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb86d9d700 1 -- 172.21.15.26:0/3472094676 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8806da00 con 0x7ffb880cc320 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb86d9d700 1 --2- 172.21.15.26:0/3472094676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb880cc320 0x7ffb8813c2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb780098e0 tx=0x7ffb780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e310f8af522d2aa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800b640 con 0x7ffb880cc320 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800b7a0 con 0x7ffb880cc320 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.574+0000 7ffb85d9b700 1 -- 172.21.15.26:0/3472094676 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800bb40 con 0x7ffb880cc320 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 -- 172.21.15.26:0/3472094676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb880cc320 msgr2=0x7ffb8813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 --2- 172.21.15.26:0/3472094676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb880cc320 0x7ffb8813c2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb780098e0 tx=0x7ffb780091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 -- 172.21.15.26:0/3472094676 shutdown_connections 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 --2- 172.21.15.26:0/3472094676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb880cc320 0x7ffb8813c2a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 -- 172.21.15.26:0/3472094676 >> 172.21.15.26:0/3472094676 conn(0x7ffb88067f00 msgr2=0x7ffb88068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 -- 172.21.15.26:0/3472094676 shutdown_connections 2023-10-09T11:40:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.575+0000 7ffb8d113700 1 -- 172.21.15.26:0/3472094676 wait complete. 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.576+0000 7ffb8d113700 1 Processor -- start 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.576+0000 7ffb8d113700 1 -- start start 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 0x7ffb880c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb880cc320 0x7ffb88135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88135fc0 con 0x7ffb880cc6f0 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880c9dc0 con 0x7ffb8806a110 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8d113700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880c91b0 con 0x7ffb880cc320 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb86d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 0x7ffb880c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55384/0 (socket says 172.21.15.26:55384) 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 -- 172.21.15.26:0/4140874947 learned_addr learned my addr 172.21.15.26:0/4140874947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8659c700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb880cc320 0x7ffb88135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 -- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb880cc320 msgr2=0x7ffb88135a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb880cc320 0x7ffb88135a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 -- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 msgr2=0x7ffb880c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 0x7ffb880c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb8759e700 1 -- 172.21.15.26:0/4140874947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78009420 con 0x7ffb880cc6f0 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.577+0000 7ffb86d9d700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 0x7ffb880c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb8759e700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffb80001460 tx=0x7ffb80001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000a890 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8000a9f0 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000ad70 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb880c9490 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.578+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb880c9a50 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.579+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb880c9f70 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.579+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ffb80007300 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.579+0000 7ffb7effd700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 0x7ffb68069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.579+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ffb80084bb0 con 0x7ffb880cc6f0 2023-10-09T11:40:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.579+0000 7ffb86d9d700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 0x7ffb68069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.580+0000 7ffb86d9d700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 0x7ffb68069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffb780093f0 tx=0x7ffb78017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.584+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb880c9f70 con 0x7ffb880cc6f0 2023-10-09T11:40:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.777+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb880c9f30 con 0x7ffb880cc6f0 2023-10-09T11:40:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.778+0000 7ffb7effd700 1 -- 172.21.15.26:0/4140874947 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb80051bd0 con 0x7ffb880cc6f0 2023-10-09T11:40:20.779 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:40:20.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 msgr2=0x7ffb68069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 0x7ffb68069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffb780093f0 tx=0x7ffb78017000 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 msgr2=0x7ffb88153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffb80001460 tx=0x7ffb80001ae0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 shutdown_connections 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880cc6f0 0x7ffb88153bc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8806a110 0x7ffb880c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffb68067170 0x7ffb68069620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 --2- 172.21.15.26:0/4140874947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb880cc320 0x7ffb88135a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 >> 172.21.15.26:0/4140874947 conn(0x7ffb88067f00 msgr2=0x7ffb880b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 shutdown_connections 2023-10-09T11:40:20.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.780+0000 7ffb8d113700 1 -- 172.21.15.26:0/4140874947 wait complete. 2023-10-09T11:40:20.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:40:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.913+0000 7fcc35027700 1 Processor -- start 2023-10-09T11:40:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.913+0000 7fcc35027700 1 -- start start 2023-10-09T11:40:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc35027700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc30153dd0 0x7fcc3015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc35027700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc300ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc35027700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3015ac50 con 0x7fcc30153a00 2023-10-09T11:40:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc35027700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3015d010 con 0x7fcc30153dd0 2023-10-09T11:40:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc35027700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300cf3e0 con 0x7fcc300cea00 2023-10-09T11:40:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc2f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc30153dd0 0x7fcc3015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc2f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc30153dd0 0x7fcc3015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55396/0 (socket says 172.21.15.26:55396) 2023-10-09T11:40:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2586942294 learned_addr learned my addr 172.21.15.26:0/2586942294 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc34826700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc300ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2586942294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 msgr2=0x7fcc300ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.914+0000 7fcc2f7fe700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc300ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2586942294 >> v1:172.21.15.67:6789/0 conn(0x7fcc30153a00 legacy=0x7fcc3015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2586942294 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3015af60 con 0x7fcc30153dd0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2f7fe700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153dd0 0x7fcc3015de50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcc200099b0 tx=0x7fcc20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc69e1c2a53ae7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2effd700 1 -- 172.21.15.26:0/2586942294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000b860 con 0x7fcc30153dd0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2effd700 1 -- 172.21.15.26:0/2586942294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000b9c0 con 0x7fcc30153dd0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc2effd700 1 -- 172.21.15.26:0/2586942294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000bd60 con 0x7fcc30153dd0 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 -- 172.21.15.26:0/2586942294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153dd0 msgr2=0x7fcc3015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153dd0 0x7fcc3015de50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcc200099b0 tx=0x7fcc20009250 comp rx=0 tx=0).stop 2023-10-09T11:40:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 -- 172.21.15.26:0/2586942294 shutdown_connections 2023-10-09T11:40:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc300ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 --2- 172.21.15.26:0/2586942294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153dd0 0x7fcc3015de50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 -- 172.21.15.26:0/2586942294 >> 172.21.15.26:0/2586942294 conn(0x7fcc300703a0 msgr2=0x7fcc300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 -- 172.21.15.26:0/2586942294 shutdown_connections 2023-10-09T11:40:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.915+0000 7fcc35027700 1 -- 172.21.15.26:0/2586942294 wait complete. 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 Processor -- start 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 -- start start 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc30158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc30153dd0 0x7fcc30142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3016d440 con 0x7fcc30153a00 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3016d690 con 0x7fcc30153dd0 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.917+0000 7fcc35027700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3016d970 con 0x7fcc300cea00 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55404/0 (socket says 172.21.15.26:55404) 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2151295755 learned_addr learned my addr 172.21.15.26:0/2151295755 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2ffff700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc30158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc34826700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc30153dd0 0x7fcc30142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 msgr2=0x7fcc30158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc30158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc30153dd0 msgr2=0x7fcc30142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc30153dd0 0x7fcc30142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 -- 172.21.15.26:0/2151295755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200094f0 con 0x7fcc30153a00 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc2f7fe700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009290 tx=0x7fcc20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20011e40 con 0x7fcc30153a00 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc20024440 con 0x7fcc30153a00 2023-10-09T11:40:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3016dc50 con 0x7fcc30153a00 2023-10-09T11:40:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200247e0 con 0x7fcc30153a00 2023-10-09T11:40:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.918+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3016e210 con 0x7fcc30153a00 2023-10-09T11:40:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.919+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3004c3c0 con 0x7fcc30153a00 2023-10-09T11:40:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.920+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcc2001a420 con 0x7fcc30153a00 2023-10-09T11:40:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.920+0000 7fcc27fff700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 0x7fcc10069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:20.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.920+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcc20086660 con 0x7fcc30153a00 2023-10-09T11:40:20.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.920+0000 7fcc2ffff700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 0x7fcc10069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:20.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.921+0000 7fcc2ffff700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 0x7fcc10069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc18003a80 tx=0x7fcc18007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:20.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:20.924+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc20053680 con 0x7fcc30153a00 2023-10-09T11:40:21.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.114+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc3015b240 con 0x7fcc30153a00 2023-10-09T11:40:21.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.115+0000 7fcc27fff700 1 -- 172.21.15.26:0/2151295755 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc20056ca0 con 0x7fcc30153a00 2023-10-09T11:40:21.116 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:40:21.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.116+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 msgr2=0x7fcc10069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.116+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 0x7fcc10069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc18003a80 tx=0x7fcc18007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.116+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 msgr2=0x7fcc3006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009290 tx=0x7fcc20017000 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 shutdown_connections 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc30153dd0 0x7fcc30142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc10067170 0x7fcc10069620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc300cea00 0x7fcc30158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 --2- 172.21.15.26:0/2151295755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc30153a00 0x7fcc3006d9e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 >> 172.21.15.26:0/2151295755 conn(0x7fcc300703a0 msgr2=0x7fcc30152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 shutdown_connections 2023-10-09T11:40:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.117+0000 7fcc35027700 1 -- 172.21.15.26:0/2151295755 wait complete. 2023-10-09T11:40:21.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.249+0000 7f2856a3a700 1 Processor -- start 2023-10-09T11:40:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.249+0000 7f2856a3a700 1 -- start start 2023-10-09T11:40:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856a3a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28500cec90 0x7f28500cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856a3a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28500b0970 0x7f28500c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856a3a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285006e560 con 0x7f28500b05a0 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856a3a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285006e260 con 0x7f28500b0970 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856a3a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500c3240 con 0x7f28500cec90 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856239700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28500b0970 0x7f28500c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2855237700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28500cec90 0x7f28500cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856239700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28500b0970 0x7f28500c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55408/0 (socket says 172.21.15.26:55408) 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.250+0000 7f2856239700 1 -- 172.21.15.26:0/1676164898 learned_addr learned my addr 172.21.15.26:0/1676164898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2856239700 1 -- 172.21.15.26:0/1676164898 >> v2:172.21.15.67:3300/0 conn(0x7f28500cec90 msgr2=0x7f28500cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2856239700 1 --2- 172.21.15.26:0/1676164898 >> v2:172.21.15.67:3300/0 conn(0x7f28500cec90 0x7f28500cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2856239700 1 -- 172.21.15.26:0/1676164898 >> v1:172.21.15.67:6789/0 conn(0x7f28500b05a0 legacy=0x7f28500c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2856239700 1 -- 172.21.15.26:0/1676164898 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500c3520 con 0x7f28500b0970 2023-10-09T11:40:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2856239700 1 --2- 172.21.15.26:0/1676164898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c3ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f285006e170 tx=0x7f2848009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab24be734616a2fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2854a36700 1 -- 172.21.15.26:0/1676164898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800e070 con 0x7f28500b0970 2023-10-09T11:40:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2854a36700 1 -- 172.21.15.26:0/1676164898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800ba20 con 0x7f28500b0970 2023-10-09T11:40:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.251+0000 7f2854a36700 1 -- 172.21.15.26:0/1676164898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480092e0 con 0x7f28500b0970 2023-10-09T11:40:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 -- 172.21.15.26:0/1676164898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 msgr2=0x7f28500c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 --2- 172.21.15.26:0/1676164898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c3ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f285006e170 tx=0x7f2848009840 comp rx=0 tx=0).stop 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 -- 172.21.15.26:0/1676164898 shutdown_connections 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 --2- 172.21.15.26:0/1676164898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c3ad0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 --2- 172.21.15.26:0/1676164898 >> v2:172.21.15.67:3300/0 conn(0x7f28500cec90 0x7f28500cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 -- 172.21.15.26:0/1676164898 >> 172.21.15.26:0/1676164898 conn(0x7f2850088000 msgr2=0x7f28500ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 -- 172.21.15.26:0/1676164898 shutdown_connections 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.252+0000 7f2856a3a700 1 -- 172.21.15.26:0/1676164898 wait complete. 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.253+0000 7f2856a3a700 1 Processor -- start 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.253+0000 7f2856a3a700 1 -- start start 2023-10-09T11:40:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28500b05a0 0x7f28501520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28500cec90 0x7f285016cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500c68a0 con 0x7f28500b0970 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500c6410 con 0x7f28500b05a0 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856a3a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28500c5800 con 0x7f28500cec90 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55416/0 (socket says 172.21.15.26:55416) 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 -- 172.21.15.26:0/2206042081 learned_addr learned my addr 172.21.15.26:0/2206042081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2856239700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28500cec90 0x7f285016cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855a38700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28500b05a0 0x7f28501520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 -- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28500cec90 msgr2=0x7f285016cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28500cec90 0x7f285016cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 -- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28500b05a0 msgr2=0x7f28501520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28500b05a0 0x7f28501520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 -- 172.21.15.26:0/2206042081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009ae0 con 0x7f28500b0970 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2855237700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f284000ec50 tx=0x7f28400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000c850 con 0x7f28500b0970 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.254+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000c9b0 con 0x7f28500b0970 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.255+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28500c5ae0 con 0x7f28500b0970 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.255+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000cd70 con 0x7f28500b0970 2023-10-09T11:40:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.255+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28500c60a0 con 0x7f28500b0970 2023-10-09T11:40:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.256+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285004c3c0 con 0x7f28500b0970 2023-10-09T11:40:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.256+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2840013680 con 0x7f28500b0970 2023-10-09T11:40:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.256+0000 7f2845ffb700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 0x7f2834069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.256+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2840084ad0 con 0x7f28500b0970 2023-10-09T11:40:21.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.256+0000 7f2855a38700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 0x7f2834069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.257+0000 7f2855a38700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 0x7f2834069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f284c003a20 tx=0x7f284c007f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.261+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2840051a70 con 0x7f28500b0970 2023-10-09T11:40:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.497+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28500c6550 con 0x7f28500b0970 2023-10-09T11:40:21.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.497+0000 7f2845ffb700 1 -- 172.21.15.26:0/2206042081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2840055090 con 0x7f28500b0970 2023-10-09T11:40:21.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:21.499 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.499+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 msgr2=0x7f2834069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.499+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 0x7f2834069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f284c003a20 tx=0x7f284c007f10 comp rx=0 tx=0).stop 2023-10-09T11:40:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.499+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 msgr2=0x7f28500c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.499+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f284000ec50 tx=0x7f28400091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 shutdown_connections 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2834067170 0x7f2834069620 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28500cec90 0x7f285016cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28500b05a0 0x7f28501520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 --2- 172.21.15.26:0/2206042081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28500b0970 0x7f28500c7820 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 >> 172.21.15.26:0/2206042081 conn(0x7f2850088000 msgr2=0x7f285006e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 shutdown_connections 2023-10-09T11:40:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.500+0000 7f2856a3a700 1 -- 172.21.15.26:0/2206042081 wait complete. 2023-10-09T11:40:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 40 2023-10-09T11:40:21.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:21.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.631+0000 7f075cb46700 1 Processor -- start 2023-10-09T11:40:21.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.631+0000 7f075cb46700 1 -- start start 2023-10-09T11:40:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580cb5a0 0x7f07580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07580cd9e0 0x7f0758159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07580cde50 0x7f075815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580d13f0 con 0x7f07580cde50 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075815a940 con 0x7f07580cd9e0 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.632+0000 7f075cb46700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075815ae40 con 0x7f07580cb5a0 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07580cde50 0x7f075815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07580cde50 0x7f075815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55418/0 (socket says 172.21.15.26:55418) 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 -- 172.21.15.26:0/2111717723 learned_addr learned my addr 172.21.15.26:0/2111717723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0755d9b700 1 --2- 172.21.15.26:0/2111717723 >> v2:172.21.15.67:3300/0 conn(0x7f07580cd9e0 0x7f0758159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f075659c700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580cb5a0 0x7f07580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 -- 172.21.15.26:0/2111717723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580cb5a0 msgr2=0x7f07580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580cb5a0 0x7f07580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 -- 172.21.15.26:0/2111717723 >> v2:172.21.15.67:3300/0 conn(0x7f07580cd9e0 msgr2=0x7f0758159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 --2- 172.21.15.26:0/2111717723 >> v2:172.21.15.67:3300/0 conn(0x7f07580cd9e0 0x7f0758159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 -- 172.21.15.26:0/2111717723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075815ab60 con 0x7f07580cde50 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f0756d9d700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cde50 0x7f075815a400 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f075806ea90 tx=0x7f0748009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0e3fc21cbf5321 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f075559a700 1 -- 172.21.15.26:0/2111717723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800e070 con 0x7f07580cde50 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f075559a700 1 -- 172.21.15.26:0/2111717723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800b930 con 0x7f07580cde50 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.633+0000 7f075559a700 1 -- 172.21.15.26:0/2111717723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480092e0 con 0x7f07580cde50 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 -- 172.21.15.26:0/2111717723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cde50 msgr2=0x7f075815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cde50 0x7f075815a400 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f075806ea90 tx=0x7f0748009840 comp rx=0 tx=0).stop 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 -- 172.21.15.26:0/2111717723 shutdown_connections 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cde50 0x7f075815a400 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 --2- 172.21.15.26:0/2111717723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580cb5a0 0x7f07580cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 --2- 172.21.15.26:0/2111717723 >> v2:172.21.15.67:3300/0 conn(0x7f07580cd9e0 0x7f0758159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 -- 172.21.15.26:0/2111717723 >> 172.21.15.26:0/2111717723 conn(0x7f0758070e30 msgr2=0x7f07580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 -- 172.21.15.26:0/2111717723 shutdown_connections 2023-10-09T11:40:21.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.634+0000 7f075cb46700 1 -- 172.21.15.26:0/2111717723 wait complete. 2023-10-09T11:40:21.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.635+0000 7f075cb46700 1 Processor -- start 2023-10-09T11:40:21.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.635+0000 7f075cb46700 1 -- start start 2023-10-09T11:40:21.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07580cd9e0 0x7f075814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580ca0a0 0x7f07580b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075816a150 con 0x7f07580cb5a0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758169760 con 0x7f07580cd9e0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0758169a40 con 0x7f07580ca0a0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55434/0 (socket says 172.21.15.26:55434) 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 -- 172.21.15.26:0/296990756 learned_addr learned my addr 172.21.15.26:0/296990756 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f0756d9d700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580ca0a0 0x7f07580b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f0755d9b700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07580cd9e0 0x7f075814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 -- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580ca0a0 msgr2=0x7f07580b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580ca0a0 0x7f07580b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 -- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07580cd9e0 msgr2=0x7f075814a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07580cd9e0 0x7f075814a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 -- 172.21.15.26:0/296990756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009ae0 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075659c700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f075000ec80 tx=0x7f07500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000c850 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000c9b0 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0758169d20 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0758169470 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.636+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000cd50 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.637+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758157150 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.638+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0750013680 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.638+0000 7f074e7fc700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 0x7f0738069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.638+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0750084e20 con 0x7f07580cb5a0 2023-10-09T11:40:21.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.638+0000 7f0755d9b700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 0x7f0738069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.639+0000 7f0755d9b700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 0x7f0738069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f075815e550 tx=0x7f07400091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.642+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0750051dc0 con 0x7f07580cb5a0 2023-10-09T11:40:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.836+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0758156c40 con 0x7f07580cb5a0 2023-10-09T11:40:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.837+0000 7f074e7fc700 1 -- 172.21.15.26:0/296990756 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15402 (secure 0 0 0) 0x7f0758156c40 con 0x7f07580cb5a0 2023-10-09T11:40:21.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:21.838 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":65,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:38:06.217788+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 msgr2=0x7f0738069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 0x7f0738069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f075815e550 tx=0x7f07400091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 msgr2=0x7f0758168f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f075000ec80 tx=0x7f07500091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 shutdown_connections 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0738067170 0x7f0738069620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07580ca0a0 0x7f07580b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07580cb5a0 0x7f0758168f30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 --2- 172.21.15.26:0/296990756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07580cd9e0 0x7f075814a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 >> 172.21.15.26:0/296990756 conn(0x7f0758070e30 msgr2=0x7f07580d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 shutdown_connections 2023-10-09T11:40:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.839+0000 7f075cb46700 1 -- 172.21.15.26:0/296990756 wait complete. 2023-10-09T11:40:21.853 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:40:21.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.969+0000 7f0227ae0700 1 Processor -- start 2023-10-09T11:40:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 -- start start 2023-10-09T11:40:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02200cb970 0x7f0220159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f022015a400 0x7f0220156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022015ae40 con 0x7f02200cb5a0 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200ce0f0 con 0x7f02200cb970 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.970+0000 7f0227ae0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200d13f0 con 0x7f022015a400 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02200cb970 0x7f0220159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02200cb970 0x7f0220159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55450/0 (socket says 172.21.15.26:55450) 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 -- 172.21.15.26:0/1849853325 learned_addr learned my addr 172.21.15.26:0/1849853325 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022607d700 1 --2- 172.21.15.26:0/1849853325 >> v2:172.21.15.67:3300/0 conn(0x7f022015a400 0x7f0220156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 -- 172.21.15.26:0/1849853325 >> v2:172.21.15.67:3300/0 conn(0x7f022015a400 msgr2=0x7f0220156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 --2- 172.21.15.26:0/1849853325 >> v2:172.21.15.67:3300/0 conn(0x7f022015a400 0x7f0220156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 -- 172.21.15.26:0/1849853325 >> v1:172.21.15.67:6789/0 conn(0x7f02200cb5a0 legacy=0x7f02200cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 -- 172.21.15.26:0/1849853325 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022015ab60 con 0x7f02200cb970 2023-10-09T11:40:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022507b700 1 --2- 172.21.15.26:0/1849853325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f0220159ec0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f02200ccdf0 tx=0x7f0214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a633dd2095284491 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022487a700 1 -- 172.21.15.26:0/1849853325 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214009e70 con 0x7f02200cb970 2023-10-09T11:40:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022487a700 1 -- 172.21.15.26:0/1849853325 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400b860 con 0x7f02200cb970 2023-10-09T11:40:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.971+0000 7f022487a700 1 -- 172.21.15.26:0/1849853325 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400bc00 con 0x7f02200cb970 2023-10-09T11:40:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 -- 172.21.15.26:0/1849853325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 msgr2=0x7f0220159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 --2- 172.21.15.26:0/1849853325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f0220159ec0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f02200ccdf0 tx=0x7f0214009250 comp rx=0 tx=0).stop 2023-10-09T11:40:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 -- 172.21.15.26:0/1849853325 shutdown_connections 2023-10-09T11:40:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 --2- 172.21.15.26:0/1849853325 >> v2:172.21.15.67:3300/0 conn(0x7f022015a400 0x7f0220156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 --2- 172.21.15.26:0/1849853325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f0220159ec0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 -- 172.21.15.26:0/1849853325 >> 172.21.15.26:0/1849853325 conn(0x7f0220070e30 msgr2=0x7f02200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 -- 172.21.15.26:0/1849853325 shutdown_connections 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.972+0000 7f0227ae0700 1 -- 172.21.15.26:0/1849853325 wait complete. 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.973+0000 7f0227ae0700 1 Processor -- start 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.973+0000 7f0227ae0700 1 -- start start 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02200cb5a0 0x7f022016a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 0x7f02200b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c9790 con 0x7f02200cb970 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200afd30 con 0x7f022015a400 2023-10-09T11:40:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220169b60 con 0x7f02200cb5a0 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55454/0 (socket says 172.21.15.26:55454) 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 -- 172.21.15.26:0/2826300402 learned_addr learned my addr 172.21.15.26:0/2826300402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022587c700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02200cb5a0 0x7f022016a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022607d700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 0x7f02200b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 -- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02200cb5a0 msgr2=0x7f022016a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02200cb5a0 0x7f022016a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 -- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 msgr2=0x7f02200b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 0x7f02200b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 -- 172.21.15.26:0/2826300402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02140094f0 con 0x7f02200cb970 2023-10-09T11:40:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022607d700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 0x7f02200b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f022507b700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f022006ea60 tx=0x7f0214017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400b9d0 con 0x7f02200cb970 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400bb30 con 0x7f02200cb970 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022016aae0 con 0x7f02200cb970 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.974+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214025670 con 0x7f02200cb970 2023-10-09T11:40:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.975+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200c94b0 con 0x7f02200cb970 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.975+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022004c3c0 con 0x7f02200cb970 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.976+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0214023070 con 0x7f02200cb970 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.976+0000 7f021dffb700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 0x7f020c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.976+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0214085e90 con 0x7f02200cb970 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.976+0000 7f022587c700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 0x7f020c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.977+0000 7f022587c700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 0x7f020c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0218003a80 tx=0x7f0218007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:21.981+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0214052d90 con 0x7f02200cb970 2023-10-09T11:40:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.217+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02200ccf00 con 0x7f02200cb970 2023-10-09T11:40:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.217+0000 7f021dffb700 1 -- 172.21.15.26:0/2826300402 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f02140563b0 con 0x7f02200cb970 2023-10-09T11:40:22.219 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:22.219 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 msgr2=0x7f020c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 0x7f020c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0218003a80 tx=0x7f0218007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 msgr2=0x7f022015ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f022006ea60 tx=0x7f0214017000 comp rx=0 tx=0).stop 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 shutdown_connections 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f022015a400 0x7f02200b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f020c067170 0x7f020c069620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02200cb5a0 0x7f022016a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 --2- 172.21.15.26:0/2826300402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02200cb970 0x7f022015ddf0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.219+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 >> 172.21.15.26:0/2826300402 conn(0x7f0220070e30 msgr2=0x7f02200ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.220+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 shutdown_connections 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.220+0000 7f0227ae0700 1 -- 172.21.15.26:0/2826300402 wait complete. 2023-10-09T11:40:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 40 2023-10-09T11:40:22.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.351+0000 7fb422317700 1 Processor -- start 2023-10-09T11:40:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.351+0000 7fb422317700 1 -- start start 2023-10-09T11:40:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb422317700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb41c153c30 0x7fb41c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb422317700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c15afd0 con 0x7fb41c15de50 2023-10-09T11:40:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb422317700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c15b2b0 con 0x7fb41c0cf110 2023-10-09T11:40:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb422317700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c15b590 con 0x7fb41c153c30 2023-10-09T11:40:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb41c153c30 0x7fb41c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb41c153c30 0x7fb41c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55470/0 (socket says 172.21.15.26:55470) 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 -- 172.21.15.26:0/2389583714 learned_addr learned my addr 172.21.15.26:0/2389583714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb420b14700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb41c15de50 0x7fb41c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41316/0 (socket says 172.21.15.26:41316) 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 -- 172.21.15.26:0/2389583714 >> v1:172.21.15.67:6789/0 conn(0x7fb41c0cf110 legacy=0x7fb41c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 -- 172.21.15.26:0/2389583714 >> v1:172.21.15.26:6789/0 conn(0x7fb41c15de50 legacy=0x7fb41c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb421315700 1 -- 172.21.15.26:0/2389583714 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c15b870 con 0x7fb41c153c30 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.352+0000 7fb41bfff700 1 -- 172.21.15.26:0/2389583714 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221090977 0 0) 0x7fb41c15afd0 con 0x7fb41c15de50 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb421315700 1 --2- 172.21.15.26:0/2389583714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c15a5e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb4140099b0 tx=0x7fb414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664a2a72852a8dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb41bfff700 1 -- 172.21.15.26:0/2389583714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400b860 con 0x7fb41c153c30 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb41bfff700 1 -- 172.21.15.26:0/2389583714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41400b9c0 con 0x7fb41c153c30 2023-10-09T11:40:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb41bfff700 1 -- 172.21.15.26:0/2389583714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400bd60 con 0x7fb41c153c30 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 -- 172.21.15.26:0/2389583714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 msgr2=0x7fb41c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 --2- 172.21.15.26:0/2389583714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c15a5e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb4140099b0 tx=0x7fb414009250 comp rx=0 tx=0).stop 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 -- 172.21.15.26:0/2389583714 shutdown_connections 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 --2- 172.21.15.26:0/2389583714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c15a5e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 -- 172.21.15.26:0/2389583714 >> 172.21.15.26:0/2389583714 conn(0x7fb41c0703a0 msgr2=0x7fb41c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 -- 172.21.15.26:0/2389583714 shutdown_connections 2023-10-09T11:40:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.353+0000 7fb422317700 1 -- 172.21.15.26:0/2389583714 wait complete. 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.354+0000 7fb422317700 1 Processor -- start 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 -- start start 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb41c0cf110 0x7fb41c146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb41c15de50 0x7fb41c0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b32d0 con 0x7fb41c153c30 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b3b70 con 0x7fb41c15de50 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb422317700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0c99a0 con 0x7fb41c0cf110 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb420b14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb420b14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55472/0 (socket says 172.21.15.26:55472) 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.355+0000 7fb420b14700 1 -- 172.21.15.26:0/3425971288 learned_addr learned my addr 172.21.15.26:0/3425971288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb421b16700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb41c15de50 0x7fb41c0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb421315700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb41c0cf110 0x7fb41c146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 -- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb41c0cf110 msgr2=0x7fb41c146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb41c0cf110 0x7fb41c146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 -- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb41c15de50 msgr2=0x7fb41c0d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb41c15de50 0x7fb41c0d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 -- 172.21.15.26:0/3425971288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140094f0 con 0x7fb41c153c30 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb420b14700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c560 tx=0x7fb410007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410005a70 con 0x7fb41c153c30 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410005bd0 con 0x7fb41c153c30 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c0b3520 con 0x7fb41c153c30 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100070d0 con 0x7fb41c153c30 2023-10-09T11:40:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.356+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c147400 con 0x7fb41c153c30 2023-10-09T11:40:22.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.357+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c0b3ce0 con 0x7fb41c153c30 2023-10-09T11:40:22.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.357+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb4100074c0 con 0x7fb41c153c30 2023-10-09T11:40:22.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.358+0000 7fb4197fa700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 0x7fb408069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.358+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb410083c90 con 0x7fb41c153c30 2023-10-09T11:40:22.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.358+0000 7fb421315700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 0x7fb408069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.358+0000 7fb421315700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 0x7fb408069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4140099b0 tx=0x7fb414017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.362+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb410050c30 con 0x7fb41c153c30 2023-10-09T11:40:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.600+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb41c04c3c0 con 0x7fb41c153c30 2023-10-09T11:40:22.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.600+0000 7fb4197fa700 1 -- 172.21.15.26:0/3425971288 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb410017070 con 0x7fb41c153c30 2023-10-09T11:40:22.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:22.602 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:10.648720+0000","modified":"2023-10-09T11:37:14.268575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/4209550485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4209550485},{"type":"v1","addr":"172.21.15.67:6836","nonce":4209550485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.602+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 msgr2=0x7fb408069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.602+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 0x7fb408069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4140099b0 tx=0x7fb414017000 comp rx=0 tx=0).stop 2023-10-09T11:40:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.602+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 msgr2=0x7fb41c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.602+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c560 tx=0x7fb410007f60 comp rx=0 tx=0).stop 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 shutdown_connections 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb41c15de50 0x7fb41c0d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb408067170 0x7fb408069620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb41c0cf110 0x7fb41c146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 --2- 172.21.15.26:0/3425971288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb41c153c30 0x7fb41c0c8fc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 >> 172.21.15.26:0/3425971288 conn(0x7fb41c0703a0 msgr2=0x7fb41c0cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 shutdown_connections 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.603+0000 7fb422317700 1 -- 172.21.15.26:0/3425971288 wait complete. 2023-10-09T11:40:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 40 2023-10-09T11:40:22.616 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.733+0000 7f470d666700 1 Processor -- start 2023-10-09T11:40:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.733+0000 7f470d666700 1 -- start start 2023-10-09T11:40:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470d666700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470d666700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470d666700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47080cf3c0 con 0x7f4708153c30 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470d666700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470815afd0 con 0x7f470815de50 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470d666700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470815b2b0 con 0x7f47080cef40 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f47077fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57334/0 (socket says 172.21.15.26:57334) 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 -- 172.21.15.26:0/923042200 learned_addr learned my addr 172.21.15.26:0/923042200 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f47077fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:51430/0 (socket says 172.21.15.26:51430) 2023-10-09T11:40:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f4707fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4708153c30 0x7f470815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:41782/0 (socket says 172.21.15.26:41782) 2023-10-09T11:40:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 -- 172.21.15.26:0/923042200 >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 msgr2=0x7f47080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 --2- 172.21.15.26:0/923042200 >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 -- 172.21.15.26:0/923042200 >> v1:172.21.15.67:6789/0 conn(0x7f4708153c30 legacy=0x7f470815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f470ce65700 1 -- 172.21.15.26:0/923042200 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470815b590 con 0x7f47080cef40 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.734+0000 7f47077fe700 1 --2- 172.21.15.26:0/923042200 >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470ce65700 1 --2- 172.21.15.26:0/923042200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4700009f20 tx=0x7f4700009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43133e6f3c84247c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f4706ffd700 1 -- 172.21.15.26:0/923042200 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000e070 con 0x7f47080cef40 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f4706ffd700 1 -- 172.21.15.26:0/923042200 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470000b9d0 con 0x7f47080cef40 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f4706ffd700 1 -- 172.21.15.26:0/923042200 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000092e0 con 0x7f47080cef40 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 -- 172.21.15.26:0/923042200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 msgr2=0x7f470815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 --2- 172.21.15.26:0/923042200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4700009f20 tx=0x7f4700009840 comp rx=0 tx=0).stop 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 -- 172.21.15.26:0/923042200 shutdown_connections 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 --2- 172.21.15.26:0/923042200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47080cef40 0x7f470815c070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 --2- 172.21.15.26:0/923042200 >> v2:172.21.15.67:3300/0 conn(0x7f470815de50 0x7f47080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 -- 172.21.15.26:0/923042200 >> 172.21.15.26:0/923042200 conn(0x7f47080703a0 msgr2=0x7f47080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 -- 172.21.15.26:0/923042200 shutdown_connections 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.735+0000 7f470d666700 1 -- 172.21.15.26:0/923042200 wait complete. 2023-10-09T11:40:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.736+0000 7f470d666700 1 Processor -- start 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 -- start start 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 0x7f47080c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 0x7f470816ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c9660 con 0x7f470815de50 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470814fcb0 con 0x7f47080cef40 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.737+0000 7f470d666700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080ca410 con 0x7f4708153c30 2023-10-09T11:40:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f47077fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 0x7f47080c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f470ce65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 0x7f470816ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:51440/0 (socket says 172.21.15.26:51440) 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f47077fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 0x7f47080c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57348/0 (socket says 172.21.15.26:57348) 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 -- 172.21.15.26:0/1425491778 learned_addr learned my addr 172.21.15.26:0/1425491778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 -- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 msgr2=0x7f47080c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 0x7f47080c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 -- 172.21.15.26:0/1425491778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 msgr2=0x7f470816ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 0x7f470816ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 -- 172.21.15.26:0/1425491778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009420 con 0x7f47080cef40 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f470ce65700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 0x7f470816ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f4707fff700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7c0 tx=0x7f46fc007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc005a70 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc005bd0 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4700009ae0 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0070d0 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.738+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708151df0 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.739+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708152830 con 0x7f47080cef40 2023-10-09T11:40:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.740+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f46fc007480 con 0x7f47080cef40 2023-10-09T11:40:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.740+0000 7f46effff700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 0x7f46f4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.740+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f46fc083e10 con 0x7f47080cef40 2023-10-09T11:40:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.740+0000 7f47077fe700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 0x7f46f4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.741+0000 7f47077fe700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 0x7f46f4069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4708166fc0 tx=0x7f46f80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.745+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46fc087030 con 0x7f47080cef40 2023-10-09T11:40:22.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.938+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f470804c3c0 con 0x7f47080cef40 2023-10-09T11:40:22.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.939+0000 7f46effff700 1 -- 172.21.15.26:0/1425491778 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15402 (secure 0 0 0) 0x7f46fc017020 con 0x7f47080cef40 2023-10-09T11:40:22.940 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:22.940 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":65,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:38:06.217788+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:09.056959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:09.617851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 msgr2=0x7f46f4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 0x7f46f4069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4708166fc0 tx=0x7f46f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 msgr2=0x7f470814f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7c0 tx=0x7f46fc007f70 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 shutdown_connections 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f470815de50 0x7f470816ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47080cef40 0x7f470814f770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46f4067170 0x7f46f4069620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 --2- 172.21.15.26:0/1425491778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4708153c30 0x7f47080c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 >> 172.21.15.26:0/1425491778 conn(0x7f47080703a0 msgr2=0x7f47080c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 shutdown_connections 2023-10-09T11:40:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:22.941+0000 7f470d666700 1 -- 172.21.15.26:0/1425491778 wait complete. 2023-10-09T11:40:22.954 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:40:23.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.072+0000 7fd4ef221700 1 Processor -- start 2023-10-09T11:40:23.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.072+0000 7fd4ef221700 1 -- start start 2023-10-09T11:40:23.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.073+0000 7fd4ef221700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4e815de50 0x7fd4e80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.073+0000 7fd4ef221700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.073+0000 7fd4ef221700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80cf3c0 con 0x7fd4e8153c30 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.073+0000 7fd4ef221700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e815afd0 con 0x7fd4e815de50 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.073+0000 7fd4ef221700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e815b2b0 con 0x7fd4e80cef40 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4e815de50 0x7fd4e80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4e815de50 0x7fd4e80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55492/0 (socket says 172.21.15.26:55492) 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 -- 172.21.15.26:0/2386357877 learned_addr learned my addr 172.21.15.26:0/2386357877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eea20700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 -- 172.21.15.26:0/2386357877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 msgr2=0x7fd4e815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 -- 172.21.15.26:0/2386357877 >> v1:172.21.15.67:6789/0 conn(0x7fd4e8153c30 legacy=0x7fd4e815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 -- 172.21.15.26:0/2386357877 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e815b590 con 0x7fd4e815de50 2023-10-09T11:40:23.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4eda1e700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80cea00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0099b0 tx=0x7fd4dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7631c069a3a9e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4ed21d700 1 -- 172.21.15.26:0/2386357877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc009ea0 con 0x7fd4e815de50 2023-10-09T11:40:23.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4ed21d700 1 -- 172.21.15.26:0/2386357877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc00b860 con 0x7fd4e815de50 2023-10-09T11:40:23.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.074+0000 7fd4ed21d700 1 -- 172.21.15.26:0/2386357877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00bc00 con 0x7fd4e815de50 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 -- 172.21.15.26:0/2386357877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 msgr2=0x7fd4e80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80cea00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0099b0 tx=0x7fd4dc009250 comp rx=0 tx=0).stop 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 -- 172.21.15.26:0/2386357877 shutdown_connections 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2386357877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80cea00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 -- 172.21.15.26:0/2386357877 >> 172.21.15.26:0/2386357877 conn(0x7fd4e80703a0 msgr2=0x7fd4e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 -- 172.21.15.26:0/2386357877 shutdown_connections 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.075+0000 7fd4ef221700 1 -- 172.21.15.26:0/2386357877 wait complete. 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.076+0000 7fd4ef221700 1 Processor -- start 2023-10-09T11:40:23.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.076+0000 7fd4ef221700 1 -- start start 2023-10-09T11:40:23.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4e8153c30 0x7fd4e8140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b6100 con 0x7fd4e815de50 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b5730 con 0x7fd4e8153c30 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ef221700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b4b20 con 0x7fd4e80cef40 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eda1e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4e8153c30 0x7fd4e8140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55500/0 (socket says 172.21.15.26:55500) 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 -- 172.21.15.26:0/2173317511 learned_addr learned my addr 172.21.15.26:0/2173317511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4ee21f700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 -- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 msgr2=0x7fd4e80b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e80b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 -- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4e8153c30 msgr2=0x7fd4e8140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4e8153c30 0x7fd4e8140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 -- 172.21.15.26:0/2173317511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0094f0 con 0x7fd4e815de50 2023-10-09T11:40:23.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.077+0000 7fd4eea20700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009df0 tx=0x7fd4d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.078+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800caa0 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.078+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800f040 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.078+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80b4e00 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.078+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800ce70 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.078+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80b53c0 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.079+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e80b58a0 con 0x7fd4e815de50 2023-10-09T11:40:23.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.079+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd4d8014690 con 0x7fd4e815de50 2023-10-09T11:40:23.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.080+0000 7fd4e67fc700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 0x7fd4d4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.080+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd4d80854b0 con 0x7fd4e815de50 2023-10-09T11:40:23.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.080+0000 7fd4ee21f700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 0x7fd4d4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.080+0000 7fd4ee21f700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 0x7fd4d4069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00039f0 tx=0x7fd4e0007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.084+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4d8055dd0 con 0x7fd4e815de50 2023-10-09T11:40:23.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.325+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd4e804c3c0 con 0x7fd4e815de50 2023-10-09T11:40:23.327 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:40:23.326+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:40:23.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.329+0000 7fd4e67fc700 1 -- 172.21.15.26:0/2173317511 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd4d8055960 con 0x7fd4e815de50 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.331+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 msgr2=0x7fd4d4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.331+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 0x7fd4d4069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00039f0 tx=0x7fd4e0007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.331+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 msgr2=0x7fd4e80b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.331+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009df0 tx=0x7fd4d800b040 comp rx=0 tx=0).stop 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 shutdown_connections 2023-10-09T11:40:23.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4e815de50 0x7fd4e80b4190 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4d4067170 0x7fd4d4069620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4e80cef40 0x7fd4e80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 --2- 172.21.15.26:0/2173317511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4e8153c30 0x7fd4e8140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 >> 172.21.15.26:0/2173317511 conn(0x7fd4e80703a0 msgr2=0x7fd4e80b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 shutdown_connections 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.332+0000 7fd4ef221700 1 -- 172.21.15.26:0/2173317511 wait complete. 2023-10-09T11:40:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:40:23.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:40:23.366 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:40:23.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 Processor -- start 2023-10-09T11:40:23.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 -- start start 2023-10-09T11:40:23.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcb74159530 0x7fcb740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740ccfd0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740cf0e0 con 0x7fcb74159530 2023-10-09T11:40:23.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.465+0000 7fcb79990700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7415a3d0 con 0x7fcb7406dc70 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb727fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcb74159530 0x7fcb740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb727fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57364/0 (socket says 172.21.15.26:57364) 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb727fc700 1 -- 172.21.15.26:0/3496419031 learned_addr learned my addr 172.21.15.26:0/3496419031 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 -- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 msgr2=0x7fcb74159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 -- 172.21.15.26:0/3496419031 >> v1:172.21.15.67:6789/0 conn(0x7fcb7406e0e0 legacy=0x7fcb740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 -- 172.21.15.26:0/3496419031 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7415a6b0 con 0x7fcb74159530 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb727fc700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb71ffb700 1 -- 172.21.15.26:0/3496419031 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978428881 0 0) 0x7fcb740ccfd0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.466+0000 7fcb72ffd700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb74159530 0x7fcb740ceba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb640098e0 tx=0x7fcb640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81505abdffabc51c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb71ffb700 1 -- 172.21.15.26:0/3496419031 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400b640 con 0x7fcb74159530 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb71ffb700 1 -- 172.21.15.26:0/3496419031 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400b7a0 con 0x7fcb74159530 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb71ffb700 1 -- 172.21.15.26:0/3496419031 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400bb40 con 0x7fcb74159530 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 -- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb74159530 msgr2=0x7fcb740ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb74159530 0x7fcb740ceba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb640098e0 tx=0x7fcb640091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 -- 172.21.15.26:0/3496419031 shutdown_connections 2023-10-09T11:40:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb74159530 0x7fcb740ceba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 --2- 172.21.15.26:0/3496419031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 -- 172.21.15.26:0/3496419031 >> 172.21.15.26:0/3496419031 conn(0x7fcb740703a0 msgr2=0x7fcb740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:23.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 -- 172.21.15.26:0/3496419031 shutdown_connections 2023-10-09T11:40:23.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.467+0000 7fcb79990700 1 -- 172.21.15.26:0/3496419031 wait complete. 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.468+0000 7fcb79990700 1 Processor -- start 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.468+0000 7fcb79990700 1 -- start start 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb7406dc70 0x7fcb7414e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb74159530 0x7fcb740cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7414e950 con 0x7fcb7406e0e0 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7416de10 con 0x7fcb7406dc70 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb79990700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740b35b0 con 0x7fcb74159530 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb727fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb727fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55510/0 (socket says 172.21.15.26:55510) 2023-10-09T11:40:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb727fc700 1 -- 172.21.15.26:0/2010882710 learned_addr learned my addr 172.21.15.26:0/2010882710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb737fe700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb74159530 0x7fcb740cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.469+0000 7fcb72ffd700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb7406dc70 0x7fcb7414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 -- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb74159530 msgr2=0x7fcb740cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb74159530 0x7fcb740cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 -- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb7406dc70 msgr2=0x7fcb7414e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb7406dc70 0x7fcb7414e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 -- 172.21.15.26:0/2010882710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680094f0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb727fc700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800ec50 tx=0x7fcb68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680097d0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800c850 con 0x7fcb7406e0e0 2023-10-09T11:40:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64009420 con 0x7fcb7406e0e0 2023-10-09T11:40:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800cbf0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.470+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7416db30 con 0x7fcb7406e0e0 2023-10-09T11:40:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.471+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7404c3c0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.472+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcb68013470 con 0x7fcb7406e0e0 2023-10-09T11:40:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.472+0000 7fcb5affd700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 0x7fcb60069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.472+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fcb68084ea0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.472+0000 7fcb72ffd700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 0x7fcb60069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.472+0000 7fcb72ffd700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 0x7fcb60069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcb640093f0 tx=0x7fcb64017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.476+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb68051df0 con 0x7fcb7406e0e0 2023-10-09T11:40:23.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:23.715+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb7415a990 con 0x7fcb7406e0e0 2023-10-09T11:40:24.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.329+0000 7fcb5affd700 1 -- 172.21.15.26:0/2010882710 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb68055410 con 0x7fcb7406e0e0 2023-10-09T11:40:24.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 msgr2=0x7fcb60069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 0x7fcb60069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcb640093f0 tx=0x7fcb64017000 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 msgr2=0x7fcb7416cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800ec50 tx=0x7fcb68009250 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 shutdown_connections 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb60067170 0x7fcb60069620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb74159530 0x7fcb740cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb7406dc70 0x7fcb7414e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 --2- 172.21.15.26:0/2010882710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7406e0e0 0x7fcb7416cee0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 >> 172.21.15.26:0/2010882710 conn(0x7fcb740703a0 msgr2=0x7fcb740cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:24.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 shutdown_connections 2023-10-09T11:40:24.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.332+0000 7fcb79990700 1 -- 172.21.15.26:0/2010882710 wait complete. 2023-10-09T11:40:24.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:40:24.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.473+0000 7f5acd783700 1 Processor -- start 2023-10-09T11:40:24.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.473+0000 7f5acd783700 1 -- start start 2023-10-09T11:40:24.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5acd783700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac8157430 0x7f5ac80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5acd783700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 0x7f5ac80ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5acd783700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac80cc8b0 con 0x7f5ac8157800 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5acd783700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac80cefc0 con 0x7f5ac8157430 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5acd783700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80cbfc0 con 0x7f5ac815bdd0 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac8157430 0x7f5ac80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac8157430 0x7f5ac80ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55516/0 (socket says 172.21.15.26:55516) 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 -- 172.21.15.26:0/4267476865 learned_addr learned my addr 172.21.15.26:0/4267476865 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac67fc700 1 --1- 172.21.15.26:0/4267476865 >> v1:172.21.15.26:6789/0 conn(0x7f5ac8157800 0x7f5ac80b1730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41322/0 (socket says 172.21.15.26:41322) 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac77fe700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 0x7f5ac80ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 -- 172.21.15.26:0/4267476865 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 msgr2=0x7f5ac80ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:24.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 0x7f5ac80ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 -- 172.21.15.26:0/4267476865 >> v1:172.21.15.26:6789/0 conn(0x7f5ac8157800 legacy=0x7f5ac80b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 -- 172.21.15.26:0/4267476865 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80cece0 con 0x7f5ac8157430 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac5ffb700 1 -- 172.21.15.26:0/4267476865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559153408 0 0) 0x7f5ac80cc8b0 con 0x7f5ac8157800 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac77fe700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 0x7f5ac80ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157430 0x7f5ac80ce300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009990 tx=0x7f5ab8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163e9d56f89d589e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.474+0000 7f5ac5ffb700 1 -- 172.21.15.26:0/4267476865 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8005c10 con 0x7f5ac8157430 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5ac5ffb700 1 -- 172.21.15.26:0/4267476865 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8005d70 con 0x7f5ac8157430 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5ac5ffb700 1 -- 172.21.15.26:0/4267476865 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800b880 con 0x7f5ac8157430 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 -- 172.21.15.26:0/4267476865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157430 msgr2=0x7f5ac80ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157430 0x7f5ac80ce300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009990 tx=0x7f5ab8009220 comp rx=0 tx=0).stop 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 -- 172.21.15.26:0/4267476865 shutdown_connections 2023-10-09T11:40:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac815bdd0 0x7f5ac80ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 --2- 172.21.15.26:0/4267476865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157430 0x7f5ac80ce300 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 -- 172.21.15.26:0/4267476865 >> 172.21.15.26:0/4267476865 conn(0x7f5ac8067d40 msgr2=0x7f5ac8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 -- 172.21.15.26:0/4267476865 shutdown_connections 2023-10-09T11:40:24.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.475+0000 7f5acd783700 1 -- 172.21.15.26:0/4267476865 wait complete. 2023-10-09T11:40:24.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.476+0000 7f5acd783700 1 Processor -- start 2023-10-09T11:40:24.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 -- start start 2023-10-09T11:40:24.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 0x7f5ac8169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 0x7f5ac816d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8159e10 con 0x7f5ac8157800 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8157e90 con 0x7f5ac815a770 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5acd783700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac816e410 con 0x7f5ac8157430 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5ac67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5ac67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55528/0 (socket says 172.21.15.26:55528) 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.477+0000 7f5ac67fc700 1 -- 172.21.15.26:0/3917561488 learned_addr learned my addr 172.21.15.26:0/3917561488 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 0x7f5ac8169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac77fe700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 0x7f5ac816d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 -- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 msgr2=0x7f5ac8169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 0x7f5ac8169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 -- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 msgr2=0x7f5ac816d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:24.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 0x7f5ac816d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 -- 172.21.15.26:0/3917561488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009480 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac77fe700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 0x7f5ac816d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 0x7f5ac8169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5ac67fc700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c810 tx=0x7f5ab0007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0005b40 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0005cc0 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac816e6f0 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0007320 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.478+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac816a010 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.479+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac8159f50 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.480+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5ab001b3b0 con 0x7f5ac8157800 2023-10-09T11:40:24.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.480+0000 7f5abeffd700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 0x7f5aa8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:24.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.480+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f5ab0083eb0 con 0x7f5ac8157800 2023-10-09T11:40:24.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.480+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 0x7f5aa8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:24.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.481+0000 7f5ac6ffd700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 0x7f5aa8069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009260 tx=0x7f5ab8016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:24.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.484+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac8159f50 con 0x7f5ac8157800 2023-10-09T11:40:24.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:24.677+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ac8159f50 con 0x7f5ac8157800 2023-10-09T11:40:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.334+0000 7f5abeffd700 1 -- 172.21.15.26:0/3917561488 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5ac8159f50 con 0x7f5ac8157800 2023-10-09T11:40:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 msgr2=0x7f5aa8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 0x7f5aa8069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009260 tx=0x7f5ab8016000 comp rx=0 tx=0).stop 2023-10-09T11:40:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 msgr2=0x7f5ac815a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c810 tx=0x7f5ab0007de0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 shutdown_connections 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815a770 0x7f5ac816d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5aa8067170 0x7f5aa8069620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac8157430 0x7f5ac8169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 --2- 172.21.15.26:0/3917561488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac8157800 0x7f5ac815a230 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 >> 172.21.15.26:0/3917561488 conn(0x7f5ac8067d40 msgr2=0x7f5ac80ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 shutdown_connections 2023-10-09T11:40:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.337+0000 7f5acd783700 1 -- 172.21.15.26:0/3917561488 wait complete. 2023-10-09T11:40:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:40:25.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:40:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 Processor -- start 2023-10-09T11:40:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 -- start start 2023-10-09T11:40:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f560c06dcf0 0x7f560c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0ccfd0 con 0x7f560c159e40 2023-10-09T11:40:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c15a410 con 0x7f560c06dcf0 2023-10-09T11:40:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.477+0000 7f5612bc8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c15a6f0 con 0x7f560c159530 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f560c06dcf0 0x7f560c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f5610964700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f5611165700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f560c159e40 0x7f560c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:41808/0 (socket says 172.21.15.26:41808) 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f5611165700 1 -- 172.21.15.26:0/3916717137 learned_addr learned my addr 172.21.15.26:0/3916717137 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f560c06dcf0 0x7f560c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:51492/0 (socket says 172.21.15.26:51492) 2023-10-09T11:40:25.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f5610964700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:57390/0 (socket says 172.21.15.26:57390) 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 -- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 msgr2=0x7f560c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 -- 172.21.15.26:0/3916717137 >> v1:172.21.15.67:6789/0 conn(0x7f560c159e40 legacy=0x7f560c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560bfff700 1 -- 172.21.15.26:0/3916717137 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c15a9d0 con 0x7f560c06dcf0 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f5610964700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.478+0000 7f560b7fe700 1 -- 172.21.15.26:0/3916717137 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872763353 0 0) 0x7f560c0ccfd0 con 0x7f560c159e40 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f560bfff700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c159900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098e0 tx=0x7f55f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b006ee016dce52af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f560b7fe700 1 -- 172.21.15.26:0/3916717137 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800b640 con 0x7f560c06dcf0 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f560b7fe700 1 -- 172.21.15.26:0/3916717137 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800b7a0 con 0x7f560c06dcf0 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f560b7fe700 1 -- 172.21.15.26:0/3916717137 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800bb40 con 0x7f560c06dcf0 2023-10-09T11:40:25.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 -- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 msgr2=0x7f560c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c159900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098e0 tx=0x7f55f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 -- 172.21.15.26:0/3916717137 shutdown_connections 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 --2- 172.21.15.26:0/3916717137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c159900 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 -- 172.21.15.26:0/3916717137 >> 172.21.15.26:0/3916717137 conn(0x7f560c0703a0 msgr2=0x7f560c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 -- 172.21.15.26:0/3916717137 shutdown_connections 2023-10-09T11:40:25.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.479+0000 7f5612bc8700 1 -- 172.21.15.26:0/3916717137 wait complete. 2023-10-09T11:40:25.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.480+0000 7f5612bc8700 1 Processor -- start 2023-10-09T11:40:25.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 -- start start 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c15b9e0 con 0x7f560c159e40 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c95e0 con 0x7f560c06dcf0 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5612bc8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c98c0 con 0x7f560c159530 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5611165700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5611165700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55534/0 (socket says 172.21.15.26:55534) 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.481+0000 7f5611165700 1 -- 172.21.15.26:0/2062563216 learned_addr learned my addr 172.21.15.26:0/2062563216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5610964700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f560bfff700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 -- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 msgr2=0x7f560c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 -- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 msgr2=0x7f560c13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 -- 172.21.15.26:0/2062563216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009420 con 0x7f560c159e40 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5611165700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f560400cbf0 tx=0x7f56040019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400a910 con 0x7f560c159e40 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400aa70 con 0x7f560c159e40 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f8009420 con 0x7f560c159e40 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400ae30 con 0x7f560c159e40 2023-10-09T11:40:25.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.482+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c0c9e80 con 0x7f560c159e40 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.483+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c04c3c0 con 0x7f560c159e40 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.483+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5604007300 con 0x7f560c159e40 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.484+0000 7f5608ff9700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 0x7f55f0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.484+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f5604084aa0 con 0x7f560c159e40 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.484+0000 7f5610964700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 0x7f55f0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:25.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.485+0000 7f5610964700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 0x7f55f0069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5600009f40 tx=0x7f56000091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:25.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.488+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5604051c20 con 0x7f560c159e40 2023-10-09T11:40:25.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:25.679+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f560c15acb0 con 0x7f560c159e40 2023-10-09T11:40:25.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:25.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:26.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.340+0000 7f5608ff9700 1 -- 172.21.15.26:0/2062563216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5604055240 con 0x7f560c159e40 2023-10-09T11:40:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 msgr2=0x7f55f0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 0x7f55f0069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5600009f40 tx=0x7f56000091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 msgr2=0x7f560c15b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f560400cbf0 tx=0x7f56040019b0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 shutdown_connections 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560c159e40 0x7f560c15b4a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f560c06dcf0 0x7f560c13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067170 0x7f55f0069620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 --2- 172.21.15.26:0/2062563216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560c159530 0x7f560c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 >> 172.21.15.26:0/2062563216 conn(0x7f560c0703a0 msgr2=0x7f560c158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 shutdown_connections 2023-10-09T11:40:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.345+0000 7f5612bc8700 1 -- 172.21.15.26:0/2062563216 wait complete. 2023-10-09T11:40:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:40:26.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:40:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.492+0000 7fbb7036e700 1 Processor -- start 2023-10-09T11:40:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.492+0000 7fbb7036e700 1 -- start start 2023-10-09T11:40:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.493+0000 7fbb7036e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbb68159530 0x7fbb680ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.493+0000 7fbb7036e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680ccfd0 con 0x7fbb6806e0e0 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.493+0000 7fbb7036e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680cf0e0 con 0x7fbb6806dc70 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.493+0000 7fbb7036e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6815a3d0 con 0x7fbb68159530 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6e90b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb6806e0e0 0x7fbb680cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41332/0 (socket says 172.21.15.26:41332) 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6e90b700 1 -- 172.21.15.26:0/142450308 learned_addr learned my addr 172.21.15.26:0/142450308 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/142450308 >> v2:172.21.15.67:3300/0 conn(0x7fbb68159530 0x7fbb680ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787148520 0 0) 0x7fbb680ccfd0 con 0x7fbb6806e0e0 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb50003570 con 0x7fbb6806e0e0 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589233045 0 0) 0x7fbb50003570 con 0x7fbb6806e0e0 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 >> v2:172.21.15.67:3300/0 conn(0x7fbb68159530 msgr2=0x7fbb680ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 --2- 172.21.15.26:0/142450308 >> v2:172.21.15.67:3300/0 conn(0x7fbb68159530 0x7fbb680ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 >> v1:172.21.15.67:6789/0 conn(0x7fbb6806dc70 legacy=0x7fbb68159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6815a6b0 con 0x7fbb6806e0e0 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fbb60001470 con 0x7fbb6806e0e0 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 >> v1:172.21.15.26:6789/0 conn(0x7fbb6806e0e0 legacy=0x7fbb680cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb50004810 0x7fbb50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb500051c0 0x7fbb5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815a3d0 con 0x7fbb50003a60 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5000c0d0 con 0x7fbb500051c0 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5000c290 con 0x7fbb50004810 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.494+0000 7fbb6d909700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb50004810 0x7fbb50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e90b700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb500051c0 0x7fbb5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 -- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb50004810 msgr2=0x7fbb50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb50004810 0x7fbb50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 -- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb500051c0 msgr2=0x7fbb5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb500051c0 0x7fbb5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 -- 172.21.15.26:0/142450308 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50003570 con 0x7fbb50003a60 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e90b700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb500051c0 0x7fbb5000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e90b700 1 -- 172.21.15.26:0/142450308 reap_dead start 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6d909700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb50004810 0x7fbb50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb50003e70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e210 tx=0x7fbb5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7387ff7f7d0fd81b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800eac0 con 0x7fbb50003a60 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800f040 con 0x7fbb50003a60 2023-10-09T11:40:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb6d108700 1 -- 172.21.15.26:0/142450308 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800ee70 con 0x7fbb50003a60 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb7036e700 1 -- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 msgr2=0x7fbb50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.495+0000 7fbb7036e700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb50003e70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e210 tx=0x7fbb5800b040 comp rx=0 tx=0).stop 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.496+0000 7fbb7036e700 1 -- 172.21.15.26:0/142450308 shutdown_connections 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.496+0000 7fbb7036e700 1 --2- 172.21.15.26:0/142450308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb50003e70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.496+0000 7fbb7036e700 1 -- 172.21.15.26:0/142450308 >> 172.21.15.26:0/142450308 conn(0x7fbb680703a0 msgr2=0x7fbb680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.496+0000 7fbb7036e700 1 -- 172.21.15.26:0/142450308 shutdown_connections 2023-10-09T11:40:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.496+0000 7fbb7036e700 1 -- 172.21.15.26:0/142450308 wait complete. 2023-10-09T11:40:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.497+0000 7fbb7036e700 1 Processor -- start 2023-10-09T11:40:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.497+0000 7fbb7036e700 1 -- start start 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.497+0000 7fbb7036e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.497+0000 7fbb7036e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb680ca2b0 0x7fbb680ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 0x7fbb680c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6816d580 con 0x7fbb50003a60 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6816d860 con 0x7fbb680c8130 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6816db40 con 0x7fbb680ca2b0 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55562/0 (socket says 172.21.15.26:55562) 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 -- 172.21.15.26:0/632750067 learned_addr learned my addr 172.21.15.26:0/632750067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6d909700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb680ca2b0 0x7fbb680ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e90b700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 0x7fbb680c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 -- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb680ca2b0 msgr2=0x7fbb680ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb680ca2b0 0x7fbb680ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 -- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 msgr2=0x7fbb680c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 0x7fbb680c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 -- 172.21.15.26:0/632750067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6816de20 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e90b700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 0x7fbb680c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb6e10a700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800afd0 tx=0x7fbb5801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58029450 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb580295d0 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb680c8ae0 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58029990 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.498+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6814dfa0 con 0x7fbb50003a60 2023-10-09T11:40:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.499+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6804c3c0 con 0x7fbb50003a60 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.500+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fbb58003040 con 0x7fbb50003a60 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.500+0000 7fbb667fc700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 0x7fbb54069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.500+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbb58086990 con 0x7fbb50003a60 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.500+0000 7fbb6d909700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 0x7fbb54069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.501+0000 7fbb6d909700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 0x7fbb54069620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007bc0 tx=0x7fbb5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.505+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb58053b60 con 0x7fbb50003a60 2023-10-09T11:40:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.697+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbb6815a990 con 0x7fbb50003a60 2023-10-09T11:40:26.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.700+0000 7fbb667fc700 1 -- 172.21.15.26:0/632750067 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb580180a0 con 0x7fbb50003a60 2023-10-09T11:40:26.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 msgr2=0x7fbb54069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 0x7fbb54069620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007bc0 tx=0x7fbb5c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:26.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 msgr2=0x7fbb6814da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800afd0 tx=0x7fbb5801a000 comp rx=0 tx=0).stop 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 shutdown_connections 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb680c8130 0x7fbb680c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb50003a60 0x7fbb6814da60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbb54067170 0x7fbb54069620 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 --2- 172.21.15.26:0/632750067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb680ca2b0 0x7fbb680ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 >> 172.21.15.26:0/632750067 conn(0x7fbb680703a0 msgr2=0x7fbb68154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 shutdown_connections 2023-10-09T11:40:26.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.703+0000 7fbb7036e700 1 -- 172.21.15.26:0/632750067 wait complete. 2023-10-09T11:40:26.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-09T11:40:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.833+0000 7f0751b51700 1 Processor -- start 2023-10-09T11:40:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.833+0000 7f0751b51700 1 -- start start 2023-10-09T11:40:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f0751b51700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f074c153c30 0x7f074c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f0751b51700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f074c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f0751b51700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c15afd0 con 0x7f074c15de50 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f0751b51700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c15b2b0 con 0x7f074c153c30 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f0751b51700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c15b590 con 0x7f074c0cf110 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f074bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f074c15de50 0x7f074c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41344/0 (socket says 172.21.15.26:41344) 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.834+0000 7f074bfff700 1 -- 172.21.15.26:0/283674001 learned_addr learned my addr 172.21.15.26:0/283674001 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f0750b4f700 1 --2- 172.21.15.26:0/283674001 >> v2:172.21.15.67:3300/0 conn(0x7f074c153c30 0x7f074c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f0751350700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f074c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894256863 0 0) 0x7f074c15afd0 con 0x7f074c15de50 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0734003570 con 0x7f074c15de50 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1926741098 0 0) 0x7f0734003570 con 0x7f074c15de50 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 msgr2=0x7f074c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f074c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 >> v2:172.21.15.67:3300/0 conn(0x7f074c153c30 msgr2=0x7f074c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 --2- 172.21.15.26:0/283674001 >> v2:172.21.15.67:3300/0 conn(0x7f074c153c30 0x7f074c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c15b870 con 0x7f074c15de50 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f0740001470 con 0x7f074c15de50 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 >> v1:172.21.15.26:6789/0 conn(0x7f074c15de50 legacy=0x7f074c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f0734003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0734003fe0 0x7f0734004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0734004d50 0x7f07340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c15b2b0 con 0x7f0734003fe0 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c15b590 con 0x7f0734004d50 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073400ba90 con 0x7f074c0cf110 2023-10-09T11:40:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f074bfff700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0734003fe0 0x7f0734004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f0750b4f700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f0734003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.835+0000 7f0751350700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0734004d50 0x7f07340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 -- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 msgr2=0x7f0734003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f074c0cf110 0x7f0734003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 -- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0734004d50 msgr2=0x7f07340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0734004d50 0x7f07340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 -- 172.21.15.26:0/283674001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734003570 con 0x7f0734003fe0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751350700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0734004d50 0x7f07340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074bfff700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0734003fe0 0x7f0734004810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f074000c3c0 tx=0x7f074c15a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96e52f0ee590e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000cc30 con 0x7f0734003fe0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074000cd90 con 0x7f0734003fe0 2023-10-09T11:40:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f074b7fe700 1 -- 172.21.15.26:0/283674001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740005b70 con 0x7f0734003fe0 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 -- 172.21.15.26:0/283674001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0734003fe0 msgr2=0x7f0734004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 --2- 172.21.15.26:0/283674001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0734003fe0 0x7f0734004810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f074000c3c0 tx=0x7f074c15a170 comp rx=0 tx=0).stop 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751350700 1 -- 172.21.15.26:0/283674001 reap_dead start 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 -- 172.21.15.26:0/283674001 shutdown_connections 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 -- 172.21.15.26:0/283674001 >> 172.21.15.26:0/283674001 conn(0x7f074c0703a0 msgr2=0x7f074c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 -- 172.21.15.26:0/283674001 shutdown_connections 2023-10-09T11:40:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.836+0000 7f0751b51700 1 -- 172.21.15.26:0/283674001 wait complete. 2023-10-09T11:40:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.837+0000 7f0751b51700 1 Processor -- start 2023-10-09T11:40:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 -- start start 2023-10-09T11:40:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0734003fe0 0x7f074c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f074c151cb0 0x7f074c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c152690 con 0x7f074c0b2c40 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c88d0 con 0x7f074c151cb0 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f0751b51700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c8bb0 con 0x7f0734003fe0 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f074bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f074bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55592/0 (socket says 172.21.15.26:55592) 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.838+0000 7f074bfff700 1 -- 172.21.15.26:0/3033854389 learned_addr learned my addr 172.21.15.26:0/3033854389 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0751350700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f074c151cb0 0x7f074c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0750b4f700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0734003fe0 0x7f074c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 -- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0734003fe0 msgr2=0x7f074c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0734003fe0 0x7f074c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 -- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f074c151cb0 msgr2=0x7f074c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f074c151cb0 0x7f074c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 -- 172.21.15.26:0/3033854389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0c8e90 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f074bfff700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f074000c9b0 tx=0x7f0740015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000cc30 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400072e0 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0b3370 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400076a0 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.839+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c0c84c0 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.840+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c0b3890 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.840+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0740019030 con 0x7f074c0b2c40 2023-10-09T11:40:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.841+0000 7f0748ff9700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 0x7f0738069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.841+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0740085800 con 0x7f074c0b2c40 2023-10-09T11:40:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.841+0000 7f0750b4f700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 0x7f0738069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.842+0000 7f0750b4f700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 0x7f0738069650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f073c006f00 tx=0x7f073c0091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:26.845+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f074c0b3890 con 0x7f074c0b2c40 2023-10-09T11:40:27.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.119+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f074c0b3890 con 0x7f074c0b2c40 2023-10-09T11:40:27.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.341+0000 7f0748ff9700 1 -- 172.21.15.26:0/3033854389 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v238) v1 ==== 158+0+0 (secure 0 0 0) 0x7f074c0b3890 con 0x7f074c0b2c40 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 msgr2=0x7f0738069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 0x7f0738069650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f073c006f00 tx=0x7f073c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 msgr2=0x7f074c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f074000c9b0 tx=0x7f0740015000 comp rx=0 tx=0).stop 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 shutdown_connections 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f074c151cb0 0x7f074c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f07380671a0 0x7f0738069650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0734003fe0 0x7f074c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 --2- 172.21.15.26:0/3033854389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f074c0b2c40 0x7f074c0c7f80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 >> 172.21.15.26:0/3033854389 conn(0x7f074c0703a0 msgr2=0x7f074c0ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 shutdown_connections 2023-10-09T11:40:27.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.343+0000 7f0751b51700 1 -- 172.21.15.26:0/3033854389 wait complete. 2023-10-09T11:40:27.357 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-09T11:40:27.357 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-09T11:40:27.358 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:40:27.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-09T11:40:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.476+0000 7f2eda67b700 1 Processor -- start 2023-10-09T11:40:27.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.476+0000 7f2eda67b700 1 -- start start 2023-10-09T11:40:27.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2eda67b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40cb970 0x7f2ed4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2eda67b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2eda67b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed415ae40 con 0x7f2ed40cb5a0 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2eda67b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed40ce0f0 con 0x7f2ed40cb970 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2eda67b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40d13f0 con 0x7f2ed415a400 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2ed37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40cb970 0x7f2ed4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2ed8c18700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2ed3fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2ed40cb5a0 0x7f2ed40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:41816/0 (socket says 172.21.15.26:41816) 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2ed37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40cb970 0x7f2ed4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:51556/0 (socket says 172.21.15.26:51556) 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.477+0000 7f2ed3fff700 1 -- 172.21.15.26:0/292807176 learned_addr learned my addr 172.21.15.26:0/292807176 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed2ffd700 1 -- 172.21.15.26:0/292807176 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592206565 0 0) 0x7f2ed415ae40 con 0x7f2ed40cb5a0 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed2ffd700 1 -- 172.21.15.26:0/292807176 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec0003570 con 0x7f2ed40cb5a0 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed37fe700 1 -- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 msgr2=0x7f2ed4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed37fe700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed37fe700 1 -- 172.21.15.26:0/292807176 >> v1:172.21.15.67:6789/0 conn(0x7f2ed40cb5a0 legacy=0x7f2ed40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed37fe700 1 -- 172.21.15.26:0/292807176 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed415ab60 con 0x7f2ed40cb970 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed8c18700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed37fe700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb970 0x7f2ed4159ec0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098e0 tx=0x7f2ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b83903646fa687 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed2ffd700 1 -- 172.21.15.26:0/292807176 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc011630 con 0x7f2ed40cb970 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed2ffd700 1 -- 172.21.15.26:0/292807176 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc011790 con 0x7f2ed40cb970 2023-10-09T11:40:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.478+0000 7f2ed2ffd700 1 -- 172.21.15.26:0/292807176 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc011b30 con 0x7f2ed40cb970 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 -- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb970 msgr2=0x7f2ed4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb970 0x7f2ed4159ec0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098e0 tx=0x7f2ebc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 -- 172.21.15.26:0/292807176 shutdown_connections 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 --2- 172.21.15.26:0/292807176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb970 0x7f2ed4159ec0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 -- 172.21.15.26:0/292807176 >> 172.21.15.26:0/292807176 conn(0x7f2ed4070e30 msgr2=0x7f2ed40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 -- 172.21.15.26:0/292807176 shutdown_connections 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.479+0000 7f2eda67b700 1 -- 172.21.15.26:0/292807176 wait complete. 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.480+0000 7f2eda67b700 1 Processor -- start 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.480+0000 7f2eda67b700 1 -- start start 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb5a0 0x7f2ed41501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed40c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed416dfc0 con 0x7f2ed40cb970 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed416d3b0 con 0x7f2ed40cb5a0 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2eda67b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed416d690 con 0x7f2ed415a400 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55598/0 (socket says 172.21.15.26:55598) 2023-10-09T11:40:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 -- 172.21.15.26:0/2113173937 learned_addr learned my addr 172.21.15.26:0/2113173937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed8c18700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed40c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed3fff700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb5a0 0x7f2ed41501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 -- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 msgr2=0x7f2ed40c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed40c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 -- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb5a0 msgr2=0x7f2ed41501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb5a0 0x7f2ed41501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 -- 172.21.15.26:0/2113173937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc009a20 con 0x7f2ed40cb970 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ed37fe700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2ed406ea60 tx=0x7f2ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.481+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc011b10 con 0x7f2ed40cb970 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.482+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0253f0 con 0x7f2ed40cb970 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.482+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc009420 con 0x7f2ed40cb970 2023-10-09T11:40:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.482+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc025790 con 0x7f2ed40cb970 2023-10-09T11:40:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.482+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed416dc50 con 0x7f2ed40cb970 2023-10-09T11:40:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.482+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed416e130 con 0x7f2ed40cb970 2023-10-09T11:40:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.483+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2ebc025b80 con 0x7f2ed40cb970 2023-10-09T11:40:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.483+0000 7f2ecbfff700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 0x7f2eb4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.483+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2ebc085e10 con 0x7f2ed40cb970 2023-10-09T11:40:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.483+0000 7f2ed3fff700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 0x7f2eb4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.484+0000 7f2ed3fff700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 0x7f2eb4069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40058d0 tx=0x7f2ec4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.487+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ebc0530f0 con 0x7f2ed40cb970 2023-10-09T11:40:27.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:27.761+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f2ed404c3c0 con 0x7f2ed40cb970 2023-10-09T11:40:28.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.342+0000 7f2ecbfff700 1 -- 172.21.15.26:0/2113173937 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v239) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ebc0150e0 con 0x7f2ed40cb970 2023-10-09T11:40:28.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 msgr2=0x7f2eb4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 0x7f2eb4069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40058d0 tx=0x7f2ec4009040 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 msgr2=0x7f2ed4153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2ed406ea60 tx=0x7f2ebc017000 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 shutdown_connections 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb4067170 0x7f2eb4069620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed415a400 0x7f2ed40c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cb5a0 0x7f2ed41501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 --2- 172.21.15.26:0/2113173937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed40cb970 0x7f2ed4153840 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 >> 172.21.15.26:0/2113173937 conn(0x7f2ed4070e30 msgr2=0x7f2ed4155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 shutdown_connections 2023-10-09T11:40:28.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.345+0000 7f2eda67b700 1 -- 172.21.15.26:0/2113173937 wait complete. 2023-10-09T11:40:28.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:40:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.483+0000 7f61133d4700 1 Processor -- start 2023-10-09T11:40:28.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.483+0000 7f61133d4700 1 -- start start 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f61133d4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c159530 0x7f610c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f61133d4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f610c06e0e0 0x7f610c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f61133d4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0ccfd0 con 0x7f610c06dc70 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f61133d4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0cf0e0 con 0x7f610c06e0e0 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f61133d4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15a3d0 con 0x7f610c159530 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f610c06e0e0 0x7f610c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f610c06e0e0 0x7f610c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55614/0 (socket says 172.21.15.26:55614) 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f611096f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f610c06dc70 0x7f610c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41350/0 (socket says 172.21.15.26:41350) 2023-10-09T11:40:28.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 -- 172.21.15.26:0/4293098731 learned_addr learned my addr 172.21.15.26:0/4293098731 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111170700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c159530 0x7f610c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 -- 172.21.15.26:0/4293098731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c159530 msgr2=0x7f610c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c159530 0x7f610c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 -- 172.21.15.26:0/4293098731 >> v1:172.21.15.26:6789/0 conn(0x7f610c06dc70 legacy=0x7f610c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.484+0000 7f6111971700 1 -- 172.21.15.26:0/4293098731 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c15a6b0 con 0x7f610c06e0e0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f6111971700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c06e0e0 0x7f610c0cb6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0099b0 tx=0x7f60fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4d686880d11925 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f610bfff700 1 -- 172.21.15.26:0/4293098731 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00b860 con 0x7f610c06e0e0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f610bfff700 1 -- 172.21.15.26:0/4293098731 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00b9c0 con 0x7f610c06e0e0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f610bfff700 1 -- 172.21.15.26:0/4293098731 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00bd60 con 0x7f610c06e0e0 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 -- 172.21.15.26:0/4293098731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c06e0e0 msgr2=0x7f610c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c06e0e0 0x7f610c0cb6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0099b0 tx=0x7f60fc009250 comp rx=0 tx=0).stop 2023-10-09T11:40:28.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 -- 172.21.15.26:0/4293098731 shutdown_connections 2023-10-09T11:40:28.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c06e0e0 0x7f610c0cb6f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 --2- 172.21.15.26:0/4293098731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c159530 0x7f610c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 -- 172.21.15.26:0/4293098731 >> 172.21.15.26:0/4293098731 conn(0x7f610c0703a0 msgr2=0x7f610c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:28.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 -- 172.21.15.26:0/4293098731 shutdown_connections 2023-10-09T11:40:28.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.485+0000 7f61133d4700 1 -- 172.21.15.26:0/4293098731 wait complete. 2023-10-09T11:40:28.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.486+0000 7f61133d4700 1 Processor -- start 2023-10-09T11:40:28.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 -- start start 2023-10-09T11:40:28.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 0x7f610c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c06e0e0 0x7f610c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c155890 con 0x7f610c159530 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0c8bd0 con 0x7f610c06dc70 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f61133d4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0c8e90 con 0x7f610c06e0e0 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.487+0000 7f6111971700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55618/0 (socket says 172.21.15.26:55618) 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 -- 172.21.15.26:0/1685945208 learned_addr learned my addr 172.21.15.26:0/1685945208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f611096f700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c06e0e0 0x7f610c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111170700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 0x7f610c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 -- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c06e0e0 msgr2=0x7f610c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c06e0e0 0x7f610c0c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 -- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 msgr2=0x7f610c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 0x7f610c0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 -- 172.21.15.26:0/1685945208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0094f0 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111170700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 0x7f610c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f6111971700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f610c089650 tx=0x7f60fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc01a630 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc01a7b0 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c0c9170 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc01ab70 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.488+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c155520 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.489+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c04c3c0 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.490+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f60fc02d440 con 0x7f610c159530 2023-10-09T11:40:28.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.490+0000 7f61097fa700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 0x7f60f8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.490+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f60fc086120 con 0x7f610c159530 2023-10-09T11:40:28.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.490+0000 7f6111170700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 0x7f60f8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.491+0000 7f6111170700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 0x7f60f8069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6104009fd0 tx=0x7f6104009740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.494+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60fc053400 con 0x7f610c159530 2023-10-09T11:40:28.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.685+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f610c1559d0 con 0x7f610c159530 2023-10-09T11:40:28.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.688+0000 7f61097fa700 1 -- 172.21.15.26:0/1685945208 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60fc056a20 con 0x7f610c159530 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 msgr2=0x7f60f8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 0x7f60f8069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6104009fd0 tx=0x7f6104009740 comp rx=0 tx=0).stop 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 msgr2=0x7f610c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f610c089650 tx=0x7f60fc017000 comp rx=0 tx=0).stop 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 shutdown_connections 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c159530 0x7f610c0c9620 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610c06dc70 0x7f610c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f60f8067170 0x7f60f8069620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 --2- 172.21.15.26:0/1685945208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f610c06e0e0 0x7f610c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 >> 172.21.15.26:0/1685945208 conn(0x7f610c0703a0 msgr2=0x7f610c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:28.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 shutdown_connections 2023-10-09T11:40:28.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.690+0000 7f61133d4700 1 -- 172.21.15.26:0/1685945208 wait complete. 2023-10-09T11:40:28.703 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:28.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:28.740 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:28.790 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:28.790 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:40:28.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:28.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.907+0000 7feb9f4db700 1 Processor -- start 2023-10-09T11:40:28.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.907+0000 7feb9f4db700 1 -- start start 2023-10-09T11:40:28.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9f4db700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb980cb5a0 0x7feb980cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9f4db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb980cd9e0 0x7feb98159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9f4db700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9815ae40 con 0x7feb980cde50 2023-10-09T11:40:28.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9f4db700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980d13f0 con 0x7feb980cd9e0 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9f4db700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9815ab60 con 0x7feb980cb5a0 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9ca76700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb980cd9e0 0x7feb98159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9da78700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feb980cde50 0x7feb98156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41358/0 (socket says 172.21.15.26:41358) 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9da78700 1 -- 172.21.15.26:0/253320856 learned_addr learned my addr 172.21.15.26:0/253320856 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9d277700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb980cb5a0 0x7feb980cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9ca76700 1 -- 172.21.15.26:0/253320856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb980cb5a0 msgr2=0x7feb980cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.908+0000 7feb9ca76700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb980cb5a0 0x7feb980cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9ca76700 1 -- 172.21.15.26:0/253320856 >> v1:172.21.15.26:6789/0 conn(0x7feb980cde50 legacy=0x7feb98156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb97fff700 1 -- 172.21.15.26:0/253320856 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885919957 0 0) 0x7feb9815ae40 con 0x7feb980cde50 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9ca76700 1 -- 172.21.15.26:0/253320856 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980ccf00 con 0x7feb980cd9e0 2023-10-09T11:40:28.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9ca76700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cd9e0 0x7feb98159ec0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7861c363534028fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb97fff700 1 -- 172.21.15.26:0/253320856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c009e80 con 0x7feb980cd9e0 2023-10-09T11:40:28.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb97fff700 1 -- 172.21.15.26:0/253320856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00b860 con 0x7feb980cd9e0 2023-10-09T11:40:28.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb97fff700 1 -- 172.21.15.26:0/253320856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00bbe0 con 0x7feb980cd9e0 2023-10-09T11:40:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 -- 172.21.15.26:0/253320856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cd9e0 msgr2=0x7feb98159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cd9e0 0x7feb98159ec0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 -- 172.21.15.26:0/253320856 shutdown_connections 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb980cb5a0 0x7feb980cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 --2- 172.21.15.26:0/253320856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cd9e0 0x7feb98159ec0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.909+0000 7feb9f4db700 1 -- 172.21.15.26:0/253320856 >> 172.21.15.26:0/253320856 conn(0x7feb98070e30 msgr2=0x7feb980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.910+0000 7feb9f4db700 1 -- 172.21.15.26:0/253320856 shutdown_connections 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.910+0000 7feb9f4db700 1 -- 172.21.15.26:0/253320856 wait complete. 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.911+0000 7feb9f4db700 1 Processor -- start 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.911+0000 7feb9f4db700 1 -- start start 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 0x7feb98155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb9815c470 0x7feb9815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9815ce00 con 0x7feb980cb5a0 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981560c0 con 0x7feb980cd9e0 2023-10-09T11:40:28.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9815c950 con 0x7feb9815c470 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55630/0 (socket says 172.21.15.26:55630) 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 -- 172.21.15.26:0/3613188030 learned_addr learned my addr 172.21.15.26:0/3613188030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9da78700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb9815c470 0x7feb9815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9ca76700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 0x7feb98155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 -- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb9815c470 msgr2=0x7feb9815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb9815c470 0x7feb9815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 -- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 msgr2=0x7feb98155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 0x7feb98155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 -- 172.21.15.26:0/3613188030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009420 con 0x7feb980cb5a0 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9ca76700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 0x7feb98155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:28.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9d277700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7feb8800e190 tx=0x7feb88009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800ee30 con 0x7feb980cb5a0 2023-10-09T11:40:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88014420 con 0x7feb980cb5a0 2023-10-09T11:40:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880147e0 con 0x7feb980cb5a0 2023-10-09T11:40:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9815d050 con 0x7feb980cb5a0 2023-10-09T11:40:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.912+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9815d610 con 0x7feb980cb5a0 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.913+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9815d980 con 0x7feb980cb5a0 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.914+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7feb88014b90 con 0x7feb980cb5a0 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.914+0000 7feb957fa700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 0x7feb84069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.914+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7feb88084e30 con 0x7feb980cb5a0 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.914+0000 7feb9ca76700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 0x7feb84069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.915+0000 7feb9ca76700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 0x7feb84069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb981568d0 tx=0x7feb8c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:28.918+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb88052070 con 0x7feb980cb5a0 2023-10-09T11:40:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.156+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb9804c3c0 con 0x7feb980cb5a0 2023-10-09T11:40:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.157+0000 7feb957fa700 1 -- 172.21.15.26:0/3613188030 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3529 (secure 0 0 0) 0x7feb88009a60 con 0x7feb980cb5a0 2023-10-09T11:40:29.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:29.159 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1540019170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1540019170},{"type":"v1","addr":"172.21.15.67:6837","nonce":1540019170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3481430693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3481430693},{"type":"v1","addr":"172.21.15.67:6836","nonce":3481430693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2541851610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2541851610},{"type":"v1","addr":"172.21.15.26:6834","nonce":2541851610}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2801806841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2801806841},{"type":"v1","addr":"172.21.15.26:6835","nonce":2801806841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 msgr2=0x7feb84069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 0x7feb84069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb981568d0 tx=0x7feb8c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 msgr2=0x7feb9815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7feb8800e190 tx=0x7feb88009920 comp rx=0 tx=0).stop 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 shutdown_connections 2023-10-09T11:40:29.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb84067170 0x7feb84069620 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb9815c470 0x7feb9815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb980cb5a0 0x7feb9815db30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 --2- 172.21.15.26:0/3613188030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb980cd9e0 0x7feb98155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 >> 172.21.15.26:0/3613188030 conn(0x7feb98070e30 msgr2=0x7feb980b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 shutdown_connections 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.159+0000 7feb9f4db700 1 -- 172.21.15.26:0/3613188030 wait complete. 2023-10-09T11:40:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 42 2023-10-09T11:40:29.173 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:40:29.173 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:40:29.173 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:40:29.173 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:29.173 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:40:29.173 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:40:29.174 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:40:29.174 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:29.174 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:40:29.174 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:40:29.174 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:40:29.174 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:29.174 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:40:29.175 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:40:29.175 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:40:29.175 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:29.182 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:40:29.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:40:29.183 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:40:29.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:40:29.186 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:40:29.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:40:29.187 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:40:29.187 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:40:29.224 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:40:29.225 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:29.225 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:40:29.225 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:29.229 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:40:29.229 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:29.230 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:40:29.230 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:29.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:40:29.301 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:40:29.301 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:40:29.312 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:40:29.312 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:40:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.354+0000 7fb7558c0700 1 Processor -- start 2023-10-09T11:40:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.354+0000 7fb7558c0700 1 -- start start 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7558c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb75013fb20 0x7fb75015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7558c0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb75006aaa0 0x7fb7500c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7558c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75015ae70 con 0x7fb75013fef0 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7558c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75006af60 con 0x7fb75013fb20 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7558c0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75006b240 con 0x7fb75006aaa0 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb75013fb20 0x7fb75015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb75013fb20 0x7fb75015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55664/0 (socket says 172.21.15.26:55664) 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb74ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb75013fef0 0x7fb7500c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41384/0 (socket says 172.21.15.26:41384) 2023-10-09T11:40:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 -- 172.21.15.26:0/1247572257 learned_addr learned my addr 172.21.15.26:0/1247572257 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7550bf700 1 --2- 172.21.15.26:0/1247572257 >> v2:172.21.15.67:3300/0 conn(0x7fb75006aaa0 0x7fb7500c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 -- 172.21.15.26:0/1247572257 >> v2:172.21.15.67:3300/0 conn(0x7fb75006aaa0 msgr2=0x7fb7500c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 --2- 172.21.15.26:0/1247572257 >> v2:172.21.15.67:3300/0 conn(0x7fb75006aaa0 0x7fb7500c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 -- 172.21.15.26:0/1247572257 >> v1:172.21.15.26:6789/0 conn(0x7fb75013fef0 legacy=0x7fb7500c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 -- 172.21.15.26:0/1247572257 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75006b520 con 0x7fb75013fb20 2023-10-09T11:40:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.355+0000 7fb7548be700 1 --2- 172.21.15.26:0/1247572257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb75015a930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb750069d40 tx=0x7fb74400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222f6746238d5299 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:29.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.356+0000 7fb74f7fe700 1 -- 172.21.15.26:0/1247572257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74400dba0 con 0x7fb75013fb20 2023-10-09T11:40:29.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.356+0000 7fb74f7fe700 1 -- 172.21.15.26:0/1247572257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74400dd00 con 0x7fb75013fb20 2023-10-09T11:40:29.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.356+0000 7fb74f7fe700 1 -- 172.21.15.26:0/1247572257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440196d0 con 0x7fb75013fb20 2023-10-09T11:40:29.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 -- 172.21.15.26:0/1247572257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 msgr2=0x7fb75015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1247572257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb75015a930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb750069d40 tx=0x7fb74400b4f0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 -- 172.21.15.26:0/1247572257 shutdown_connections 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1247572257 >> v2:172.21.15.67:3300/0 conn(0x7fb75006aaa0 0x7fb7500c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1247572257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb75015a930 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 -- 172.21.15.26:0/1247572257 >> 172.21.15.26:0/1247572257 conn(0x7fb75006d170 msgr2=0x7fb7500cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 -- 172.21.15.26:0/1247572257 shutdown_connections 2023-10-09T11:40:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.357+0000 7fb7558c0700 1 -- 172.21.15.26:0/1247572257 wait complete. 2023-10-09T11:40:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.358+0000 7fb7558c0700 1 Processor -- start 2023-10-09T11:40:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 -- start start 2023-10-09T11:40:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb75006aaa0 0x7fb7500ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75013fef0 0x7fb750155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500ac0b0 con 0x7fb75013fb20 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500ac390 con 0x7fb75013fef0 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7558c0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500ac670 con 0x7fb75006aaa0 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb74ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb74ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55676/0 (socket says 172.21.15.26:55676) 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb74ffff700 1 -- 172.21.15.26:0/1408784869 learned_addr learned my addr 172.21.15.26:0/1408784869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.359+0000 7fb7548be700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb75006aaa0 0x7fb7500ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb7550bf700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75013fef0 0x7fb750155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 -- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb75006aaa0 msgr2=0x7fb7500ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb75006aaa0 0x7fb7500ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 -- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75013fef0 msgr2=0x7fb750155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75013fef0 0x7fb750155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 -- 172.21.15.26:0/1408784869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74400b790 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74ffff700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c590 tx=0x7fb73c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c001ea0 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0072e0 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7500ac950 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c007680 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.360+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7500acf20 con 0x7fb75013fb20 2023-10-09T11:40:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.361+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7500ad0b0 con 0x7fb75013fb20 2023-10-09T11:40:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.361+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb73c005a00 con 0x7fb75013fb20 2023-10-09T11:40:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.362+0000 7fb74cff9700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 0x7fb734069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.362+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb73c0835a0 con 0x7fb75013fb20 2023-10-09T11:40:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.362+0000 7fb7548be700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 0x7fb734069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.362+0000 7fb7548be700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 0x7fb734069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb750069d40 tx=0x7fb74401b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.366+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb73c04b5a0 con 0x7fb75013fb20 2023-10-09T11:40:29.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:29.578+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb75015ae70 con 0x7fb75013fb20 2023-10-09T11:40:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.356+0000 7fb74cff9700 1 -- 172.21.15.26:0/1408784869 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb75015ae70 con 0x7fb75013fb20 2023-10-09T11:40:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 msgr2=0x7fb734069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 0x7fb734069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb750069d40 tx=0x7fb74401b000 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 msgr2=0x7fb7500c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c590 tx=0x7fb73c007ea0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 shutdown_connections 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75013fef0 0x7fb750155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb734067170 0x7fb734069620 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb75006aaa0 0x7fb7500ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 --2- 172.21.15.26:0/1408784869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75013fb20 0x7fb7500c7870 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 >> 172.21.15.26:0/1408784869 conn(0x7fb75006d170 msgr2=0x7fb75006ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 shutdown_connections 2023-10-09T11:40:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.359+0000 7fb7558c0700 1 -- 172.21.15.26:0/1408784869 wait complete. 2023-10-09T11:40:30.362 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:40:30.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:40:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 Processor -- start 2023-10-09T11:40:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 -- start start 2023-10-09T11:40:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d58159c80 0x7f9d580cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580ce9d0 con 0x7f9d580cfe70 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580af960 con 0x7f9d581598b0 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5f8fd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580afc30 con 0x7f9d58159c80 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5ce98700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d58159c80 0x7f9d580cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5de9a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d580cfe70 0x7f9d58163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40520/0 (socket says 172.21.15.26:40520) 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.493+0000 7f9d5de9a700 1 -- 172.21.15.26:0/2908039420 learned_addr learned my addr 172.21.15.26:0/2908039420 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d5ce98700 1 -- 172.21.15.26:0/2908039420 >> v1:172.21.15.67:6789/0 conn(0x7f9d581598b0 legacy=0x7f9d580af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d5ce98700 1 -- 172.21.15.26:0/2908039420 >> v1:172.21.15.26:6789/0 conn(0x7f9d580cfe70 legacy=0x7f9d58163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d57fff700 1 -- 172.21.15.26:0/2908039420 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847588304 0 0) 0x7f9d580ce9d0 con 0x7f9d580cfe70 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d5ce98700 1 -- 172.21.15.26:0/2908039420 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580aff10 con 0x7f9d58159c80 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d5ce98700 1 --2- 172.21.15.26:0/2908039420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d58159c80 0x7f9d580cb6f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0098e0 tx=0x7f9d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a9a5fce6fe424f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d57fff700 1 -- 172.21.15.26:0/2908039420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c009e80 con 0x7f9d58159c80 2023-10-09T11:40:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d57fff700 1 -- 172.21.15.26:0/2908039420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00b860 con 0x7f9d58159c80 2023-10-09T11:40:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.494+0000 7f9d57fff700 1 -- 172.21.15.26:0/2908039420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00bbe0 con 0x7f9d58159c80 2023-10-09T11:40:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/2908039420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d58159c80 msgr2=0x7f9d580cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/2908039420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d58159c80 0x7f9d580cb6f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0098e0 tx=0x7f9d4c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/2908039420 shutdown_connections 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/2908039420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d58159c80 0x7f9d580cb6f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/2908039420 >> 172.21.15.26:0/2908039420 conn(0x7f9d58070e30 msgr2=0x7f9d580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/2908039420 shutdown_connections 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.495+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/2908039420 wait complete. 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.496+0000 7f9d5f8fd700 1 Processor -- start 2023-10-09T11:40:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.496+0000 7f9d5f8fd700 1 -- start start 2023-10-09T11:40:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d580cfe70 0x7f9d580c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d58159c80 0x7f9d5815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5815cf40 con 0x7f9d581598b0 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58169990 con 0x7f9d580cfe70 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58169f10 con 0x7f9d58159c80 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44944/0 (socket says 172.21.15.26:44944) 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 -- 172.21.15.26:0/3421583573 learned_addr learned my addr 172.21.15.26:0/3421583573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5de9a700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d58159c80 0x7f9d5815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5d699700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d580cfe70 0x7f9d580c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 -- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d58159c80 msgr2=0x7f9d5815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d58159c80 0x7f9d5815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 -- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d580cfe70 msgr2=0x7f9d580c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d580cfe70 0x7f9d580c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 -- 172.21.15.26:0/3421583573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c009420 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5ce98700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806cd60 tx=0x7f9d4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c01f070 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c011420 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.497+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5815c9c0 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.498+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00bbe0 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.498+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d58169ba0 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.498+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5816a0c0 con 0x7f9d581598b0 2023-10-09T11:40:30.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.499+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9d4c011a50 con 0x7f9d581598b0 2023-10-09T11:40:30.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.499+0000 7f9d557fa700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 0x7f9d44069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.499+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d4c085a40 con 0x7f9d581598b0 2023-10-09T11:40:30.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.500+0000 7f9d5d699700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 0x7f9d44069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.500+0000 7f9d5d699700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 0x7f9d44069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d48007fd0 tx=0x7f9d48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.504+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d5816a0c0 con 0x7f9d581598b0 2023-10-09T11:40:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.774+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d5816a080 con 0x7f9d581598b0 2023-10-09T11:40:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.775+0000 7f9d557fa700 1 -- 172.21.15.26:0/3421583573 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9d4c015090 con 0x7f9d581598b0 2023-10-09T11:40:30.776 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.777 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.778 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:40:30.779 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.780 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.781 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:40:30.782 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.783 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.784 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:40:30.785 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:40:30.786 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.787 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:40:30.788 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:30.789 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.790 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:40:30.791 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 msgr2=0x7f9d44069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 0x7f9d44069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d48007fd0 tx=0x7f9d48009040 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 msgr2=0x7f9d5816a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9d5806cd60 tx=0x7f9d4c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 shutdown_connections 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9d44067170 0x7f9d44069620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d58159c80 0x7f9d5815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d580cfe70 0x7f9d580c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 --2- 172.21.15.26:0/3421583573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d581598b0 0x7f9d5816a3a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 >> 172.21.15.26:0/3421583573 conn(0x7f9d58070e30 msgr2=0x7f9d580b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:30.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 shutdown_connections 2023-10-09T11:40:30.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.777+0000 7f9d5f8fd700 1 -- 172.21.15.26:0/3421583573 wait complete. 2023-10-09T11:40:30.794 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.913+0000 7fced8e1c700 1 Processor -- start 2023-10-09T11:40:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.913+0000 7fced8e1c700 1 -- start start 2023-10-09T11:40:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced8e1c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fced4153c30 0x7fced415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced8e1c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fced40cf110 0x7fced415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced8e1c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced415afd0 con 0x7fced415de50 2023-10-09T11:40:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced8e1c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced415b2b0 con 0x7fced40cf110 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced8e1c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced415b590 con 0x7fced4153c30 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fced40cf110 0x7fced415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fced40cf110 0x7fced415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44946/0 (socket says 172.21.15.26:44946) 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced3fff700 1 -- 172.21.15.26:0/3385182509 learned_addr learned my addr 172.21.15.26:0/3385182509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.914+0000 7fced37fe700 1 --2- 172.21.15.26:0/3385182509 >> v2:172.21.15.67:3300/0 conn(0x7fced4153c30 0x7fced415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced3fff700 1 -- 172.21.15.26:0/3385182509 >> v2:172.21.15.67:3300/0 conn(0x7fced4153c30 msgr2=0x7fced415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced3fff700 1 --2- 172.21.15.26:0/3385182509 >> v2:172.21.15.67:3300/0 conn(0x7fced4153c30 0x7fced415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced3fff700 1 -- 172.21.15.26:0/3385182509 >> v1:172.21.15.67:6789/0 conn(0x7fced415de50 legacy=0x7fced40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced3fff700 1 -- 172.21.15.26:0/3385182509 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced415b870 con 0x7fced40cf110 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced3fff700 1 --2- 172.21.15.26:0/3385182509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced40cf110 0x7fced415c070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fced406ead0 tx=0x7fcecc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a12b2399acfdf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced27fc700 1 -- 172.21.15.26:0/3385182509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00e070 con 0x7fced40cf110 2023-10-09T11:40:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced27fc700 1 -- 172.21.15.26:0/3385182509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00ba10 con 0x7fced40cf110 2023-10-09T11:40:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced27fc700 1 -- 172.21.15.26:0/3385182509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0092e0 con 0x7fced40cf110 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 -- 172.21.15.26:0/3385182509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced40cf110 msgr2=0x7fced415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 --2- 172.21.15.26:0/3385182509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced40cf110 0x7fced415c070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fced406ead0 tx=0x7fcecc009840 comp rx=0 tx=0).stop 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 -- 172.21.15.26:0/3385182509 shutdown_connections 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 --2- 172.21.15.26:0/3385182509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced40cf110 0x7fced415c070 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 --2- 172.21.15.26:0/3385182509 >> v2:172.21.15.67:3300/0 conn(0x7fced4153c30 0x7fced415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.915+0000 7fced8e1c700 1 -- 172.21.15.26:0/3385182509 >> 172.21.15.26:0/3385182509 conn(0x7fced40703a0 msgr2=0x7fced40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.916+0000 7fced8e1c700 1 -- 172.21.15.26:0/3385182509 shutdown_connections 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.916+0000 7fced8e1c700 1 -- 172.21.15.26:0/3385182509 wait complete. 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 Processor -- start 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 -- start start 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fced40cf110 0x7fced4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415de50 0x7fced40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced416dc40 con 0x7fced4153c30 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4152200 con 0x7fced415de50 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.917+0000 7fced8e1c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced416d030 con 0x7fced40cf110 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44950/0 (socket says 172.21.15.26:44950) 2023-10-09T11:40:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 -- 172.21.15.26:0/1841733430 learned_addr learned my addr 172.21.15.26:0/1841733430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced3fff700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415de50 0x7fced40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced37fe700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fced40cf110 0x7fced4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 -- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fced40cf110 msgr2=0x7fced4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fced40cf110 0x7fced4151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 -- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415de50 msgr2=0x7fced40c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415de50 0x7fced40c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 -- 172.21.15.26:0/1841733430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009ae0 con 0x7fced4153c30 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced2ffd700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcec800b5e0 tx=0x7fcec8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800f510 con 0x7fced4153c30 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec800f670 con 0x7fced4153c30 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced416d310 con 0x7fced4153c30 2023-10-09T11:40:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800fa30 con 0x7fced4153c30 2023-10-09T11:40:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.918+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced416d8d0 con 0x7fced4153c30 2023-10-09T11:40:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.919+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced404c3c0 con 0x7fced4153c30 2023-10-09T11:40:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.920+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcec801a400 con 0x7fced4153c30 2023-10-09T11:40:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.920+0000 7fcebb7fe700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 0x7fcec0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.920+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcec8084030 con 0x7fced4153c30 2023-10-09T11:40:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.920+0000 7fced37fe700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 0x7fcec0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.921+0000 7fced37fe700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 0x7fcec0069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcec4006fd0 tx=0x7fcec4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:30.924+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcec80513e0 con 0x7fced4153c30 2023-10-09T11:40:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.119+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced415bb50 con 0x7fced4153c30 2023-10-09T11:40:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.119+0000 7fcebb7fe700 1 -- 172.21.15.26:0/1841733430 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+12087 (secure 0 0 0) 0x7fcec8054a00 con 0x7fced4153c30 2023-10-09T11:40:31.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:31.120 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":73,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:30.355566+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 msgr2=0x7fcec0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 0x7fcec0069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcec4006fd0 tx=0x7fcec4008040 comp rx=0 tx=0).stop 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 msgr2=0x7fced40c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcec800b5e0 tx=0x7fcec8009120 comp rx=0 tx=0).stop 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 shutdown_connections 2023-10-09T11:40:31.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415de50 0x7fced40c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcec0067170 0x7fcec0069620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fced40cf110 0x7fced4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 --2- 172.21.15.26:0/1841733430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4153c30 0x7fced40c9630 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 >> 172.21.15.26:0/1841733430 conn(0x7fced40703a0 msgr2=0x7fced40c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 shutdown_connections 2023-10-09T11:40:31.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.121+0000 7fced8e1c700 1 -- 172.21.15.26:0/1841733430 wait complete. 2023-10-09T11:40:31.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:40:31.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:31.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.256+0000 7f9ee8a37700 1 Processor -- start 2023-10-09T11:40:31.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.256+0000 7f9ee8a37700 1 -- start start 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee8a37700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9ee4155b60 0x7f9ee40b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee8a37700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee41575a0 con 0x7f9ee415a0e0 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee8a37700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee4156990 con 0x7f9ee4155f30 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee8a37700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4156c70 con 0x7f9ee4155b60 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee2d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9ee415a0e0 0x7f9ee4157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40536/0 (socket says 172.21.15.26:40536) 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee2d9d700 1 -- 172.21.15.26:0/4095595254 learned_addr learned my addr 172.21.15.26:0/4095595254 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee259c700 1 --2- 172.21.15.26:0/4095595254 >> v2:172.21.15.67:3300/0 conn(0x7f9ee4155b60 0x7f9ee40b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635900599 0 0) 0x7f9ee41575a0 con 0x7f9ee415a0e0 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc003570 con 0x7f9ee415a0e0 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200087329 0 0) 0x7f9ee4156990 con 0x7f9ee4155f30 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee41575a0 con 0x7f9ee4155f30 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164236930 0 0) 0x7f9ecc003570 con 0x7f9ee415a0e0 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 >> v2:172.21.15.67:3300/0 conn(0x7f9ee4155b60 msgr2=0x7f9ee40b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 --2- 172.21.15.26:0/4095595254 >> v2:172.21.15.67:3300/0 conn(0x7f9ee4155b60 0x7f9ee40b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 >> v1:172.21.15.67:6789/0 conn(0x7f9ee4155f30 legacy=0x7f9ee41599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4156f50 con 0x7f9ee415a0e0 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f9edc0017f0 con 0x7f9ee415a0e0 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 >> v1:172.21.15.26:6789/0 conn(0x7f9ee415a0e0 legacy=0x7f9ee4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc003bf0 0x7f9ecc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ecc004810 0x7f9ecc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 0x7f9ecc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.257+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4156c70 con 0x7f9ecc0051c0 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c0b0 con 0x7f9ecc003bf0 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c270 con 0x7f9ecc004810 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 0x7f9ecc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee259c700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc003bf0 0x7f9ecc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee1d9b700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ecc004810 0x7f9ecc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 -- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ecc004810 msgr2=0x7f9ecc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ecc004810 0x7f9ecc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 -- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc003bf0 msgr2=0x7f9ecc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc003bf0 0x7f9ecc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 -- 172.21.15.26:0/4095595254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc003570 con 0x7f9ecc0051c0 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee1d9b700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ecc004810 0x7f9ecc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 -- 172.21.15.26:0/4095595254 reap_dead start 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee2d9d700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 0x7f9ecc00ba60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00a8c0 tx=0x7f9ee40c8d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3975503723f654c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0070d0 con 0x7f9ecc0051c0 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc007250 con 0x7f9ecc0051c0 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.258+0000 7f9ee159a700 1 -- 172.21.15.26:0/4095595254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc007610 con 0x7f9ecc0051c0 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 -- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 msgr2=0x7f9ecc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 0x7f9ecc00ba60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00a8c0 tx=0x7f9ee40c8d10 comp rx=0 tx=0).stop 2023-10-09T11:40:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 -- 172.21.15.26:0/4095595254 shutdown_connections 2023-10-09T11:40:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/4095595254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ecc0051c0 0x7f9ecc00ba60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 -- 172.21.15.26:0/4095595254 >> 172.21.15.26:0/4095595254 conn(0x7f9ee406d170 msgr2=0x7f9ee40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 -- 172.21.15.26:0/4095595254 shutdown_connections 2023-10-09T11:40:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.259+0000 7f9ee8a37700 1 -- 172.21.15.26:0/4095595254 wait complete. 2023-10-09T11:40:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.260+0000 7f9ee8a37700 1 Processor -- start 2023-10-09T11:40:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.260+0000 7f9ee8a37700 1 -- start start 2023-10-09T11:40:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc0051c0 0x7f9ee4150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ee40c6e60 0x7f9ee40c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c7ee0 con 0x7f9ee40adb60 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41507d0 con 0x7f9ecc0051c0 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee8a37700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40ae510 con 0x7f9ee40c6e60 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44968/0 (socket says 172.21.15.26:44968) 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 -- 172.21.15.26:0/455917190 learned_addr learned my addr 172.21.15.26:0/455917190 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee259c700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc0051c0 0x7f9ee4150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee2d9d700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ee40c6e60 0x7f9ee40c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 -- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ee40c6e60 msgr2=0x7f9ee40c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ee40c6e60 0x7f9ee40c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 -- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc0051c0 msgr2=0x7f9ee4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc0051c0 0x7f9ee4150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 -- 172.21.15.26:0/455917190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40c1990 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.261+0000 7f9ee1d9b700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e7e0 tx=0x7f9ed8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.262+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80026a0 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.262+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8010040 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.262+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40c7c00 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.262+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8002a50 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.262+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40c1620 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.263+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee40c11a0 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.263+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9ed80143f0 con 0x7f9ee40adb60 2023-10-09T11:40:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.263+0000 7f9ed27fc700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 0x7f9ec4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.263+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9ed8083ea0 con 0x7f9ee40adb60 2023-10-09T11:40:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.264+0000 7f9ee259c700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 0x7f9ec4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.264+0000 7f9ee259c700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 0x7f9ec4069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006ed0 tx=0x7f9ed400a330 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.268+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ed804d5a0 con 0x7f9ee40adb60 2023-10-09T11:40:31.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.459+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ee40c1b20 con 0x7f9ee40adb60 2023-10-09T11:40:31.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.459+0000 7f9ed27fc700 1 -- 172.21.15.26:0/455917190 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ee40c11a0 con 0x7f9ee40adb60 2023-10-09T11:40:31.460 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 msgr2=0x7f9ec4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 0x7f9ec4069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006ed0 tx=0x7f9ed400a330 comp rx=0 tx=0).stop 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 msgr2=0x7f9ee40adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e7e0 tx=0x7f9ed8009040 comp rx=0 tx=0).stop 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 shutdown_connections 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9ec4067170 0x7f9ec4069620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ee40c6e60 0x7f9ee40c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ecc0051c0 0x7f9ee4150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 --2- 172.21.15.26:0/455917190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee40adb60 0x7f9ee40adfd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 >> 172.21.15.26:0/455917190 conn(0x7f9ee406d170 msgr2=0x7f9ee4158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 shutdown_connections 2023-10-09T11:40:31.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.461+0000 7f9ee8a37700 1 -- 172.21.15.26:0/455917190 wait complete. 2023-10-09T11:40:31.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:40:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.592+0000 7f056c930700 1 Processor -- start 2023-10-09T11:40:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.592+0000 7f056c930700 1 -- start start 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f056c930700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f056815de50 0x7f05680cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f056c930700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05680cf3c0 con 0x7f0568153c30 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f056c930700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056815afd0 con 0x7f05680cef40 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f056c930700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056815b2b0 con 0x7f056815de50 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0566d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0568153c30 0x7f056815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40550/0 (socket says 172.21.15.26:40550) 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0566d9d700 1 -- 172.21.15.26:0/2530378265 learned_addr learned my addr 172.21.15.26:0/2530378265 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590279316 0 0) 0x7f05680cf3c0 con 0x7f0568153c30 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f056659c700 1 --2- 172.21.15.26:0/2530378265 >> v2:172.21.15.67:3300/0 conn(0x7f056815de50 0x7f05680cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0554003570 con 0x7f0568153c30 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909328072 0 0) 0x7f0554003570 con 0x7f0568153c30 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 >> v2:172.21.15.67:3300/0 conn(0x7f056815de50 msgr2=0x7f05680cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 --2- 172.21.15.26:0/2530378265 >> v2:172.21.15.67:3300/0 conn(0x7f056815de50 0x7f05680cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 >> v1:172.21.15.67:6789/0 conn(0x7f05680cef40 legacy=0x7f056815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056815b590 con 0x7f0568153c30 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.593+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f05580017f0 con 0x7f0568153c30 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 >> v1:172.21.15.26:6789/0 conn(0x7f0568153c30 legacy=0x7f056815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554003a60 0x7f0554003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 0x7f0554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05540051c0 0x7f055400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056815b2b0 con 0x7f0554004810 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055400c0d0 con 0x7f0554003a60 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055400c290 con 0x7f05540051c0 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0566d9d700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554003a60 0x7f0554003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 0x7f0554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056759e700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05540051c0 0x7f055400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 -- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05540051c0 msgr2=0x7f055400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05540051c0 0x7f055400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 -- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554003a60 msgr2=0x7f0554003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554003a60 0x7f0554003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 -- 172.21.15.26:0/2530378265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554003570 con 0x7f0554004810 2023-10-09T11:40:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056759e700 1 -- 172.21.15.26:0/2530378265 reap_dead start 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f056659c700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 0x7f0554004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0550009c00 tx=0x7f05500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9290f9d60dc31bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000e710 con 0x7f0554004810 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000e870 con 0x7f0554004810 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.594+0000 7f0565d9b700 1 -- 172.21.15.26:0/2530378265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000ec30 con 0x7f0554004810 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 -- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 msgr2=0x7f0554004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 0x7f0554004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0550009c00 tx=0x7f05500091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 -- 172.21.15.26:0/2530378265 shutdown_connections 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 --2- 172.21.15.26:0/2530378265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0554004810 0x7f0554004c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 -- 172.21.15.26:0/2530378265 >> 172.21.15.26:0/2530378265 conn(0x7f05680703a0 msgr2=0x7f05680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 -- 172.21.15.26:0/2530378265 shutdown_connections 2023-10-09T11:40:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.595+0000 7f056c930700 1 -- 172.21.15.26:0/2530378265 wait complete. 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.596+0000 7f056c930700 1 Processor -- start 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.596+0000 7f056c930700 1 -- start start 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554004810 0x7f05680b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05680c9e70 0x7f056815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05680c75e0 con 0x7f056814f6f0 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05681500b0 con 0x7f0554004810 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056c930700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05680b5bf0 con 0x7f05680c9e70 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44984/0 (socket says 172.21.15.26:44984) 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f0566d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554004810 0x7f05680b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 -- 172.21.15.26:0/4008394924 learned_addr learned my addr 172.21.15.26:0/4008394924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056659c700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05680c9e70 0x7f056815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 -- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05680c9e70 msgr2=0x7f056815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05680c9e70 0x7f056815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 -- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554004810 msgr2=0x7f05680b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554004810 0x7f05680b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.597+0000 7f056759e700 1 -- 172.21.15.26:0/4008394924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680b5ed0 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f056759e700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0568071370 tx=0x7f0560009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000ee40 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560013420 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05680b61b0 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600137e0 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.598+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05680ca2e0 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.599+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05680c7a70 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.599+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0560013b90 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.599+0000 7f055effd700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 0x7f0548069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.600+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0560084070 con 0x7f056814f6f0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.600+0000 7f0566d9d700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 0x7f0548069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.600+0000 7f0566d9d700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 0x7f0548069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05680c9e10 tx=0x7f0558006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.604+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05680c7a70 con 0x7f056814f6f0 2023-10-09T11:40:31.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.799+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f05680c7a70 con 0x7f056814f6f0 2023-10-09T11:40:31.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.799+0000 7f055effd700 1 -- 172.21.15.26:0/4008394924 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+65 (secure 0 0 0) 0x7f05680c7a70 con 0x7f056814f6f0 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:31.800 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 msgr2=0x7f0548069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 0x7f0548069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05680c9e10 tx=0x7f0558006040 comp rx=0 tx=0).stop 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 msgr2=0x7f056814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0568071370 tx=0x7f0560009040 comp rx=0 tx=0).stop 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 shutdown_connections 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056814f6f0 0x7f056814fb70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0554004810 0x7f05680b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0548067170 0x7f0548069620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 --2- 172.21.15.26:0/4008394924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f05680c9e70 0x7f056815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 >> 172.21.15.26:0/4008394924 conn(0x7f05680703a0 msgr2=0x7f05680c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 shutdown_connections 2023-10-09T11:40:31.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.801+0000 7f056c930700 1 -- 172.21.15.26:0/4008394924 wait complete. 2023-10-09T11:40:31.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:40:31.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:40:31.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.936+0000 7f7981d9e700 1 Processor -- start 2023-10-09T11:40:31.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.936+0000 7f7981d9e700 1 -- start start 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7981d9e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7981d9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0c2200 con 0x7f797c153660 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7981d9e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0c15f0 con 0x7f797c0c9090 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7981d9e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c18d0 con 0x7f797c153a30 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7980d9c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f797c153660 0x7f797c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40564/0 (socket says 172.21.15.26:40564) 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.937+0000 7f7980d9c700 1 -- 172.21.15.26:0/1501426365 learned_addr learned my addr 172.21.15.26:0/1501426365 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797bfff700 1 --2- 172.21.15.26:0/1501426365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354094538 0 0) 0x7f797c0c2200 con 0x7f797c153660 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7964003570 con 0x7f797c153660 2023-10-09T11:40:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897372565 0 0) 0x7f797c0c15f0 con 0x7f797c0c9090 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c0c2200 con 0x7f797c0c9090 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797bfff700 1 -- 172.21.15.26:0/1501426365 >> v1:172.21.15.67:6789/0 conn(0x7f797c0c9090 legacy=0x7f797c06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797bfff700 1 -- 172.21.15.26:0/1501426365 >> v1:172.21.15.26:6789/0 conn(0x7f797c153660 legacy=0x7f797c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797bfff700 1 -- 172.21.15.26:0/1501426365 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0c1bb0 con 0x7f797c153a30 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797bfff700 1 --2- 172.21.15.26:0/1501426365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c0c0ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f797000aac0 tx=0x7f797000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe9535e971e3258 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000c970 con 0x7f797c153a30 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000cad0 con 0x7f797c153a30 2023-10-09T11:40:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.938+0000 7f797b7fe700 1 -- 172.21.15.26:0/1501426365 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000ce50 con 0x7f797c153a30 2023-10-09T11:40:31.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 -- 172.21.15.26:0/1501426365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 msgr2=0x7f797c0c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1501426365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c0c0ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f797000aac0 tx=0x7f797000a330 comp rx=0 tx=0).stop 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 -- 172.21.15.26:0/1501426365 shutdown_connections 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1501426365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c0c0ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 -- 172.21.15.26:0/1501426365 >> 172.21.15.26:0/1501426365 conn(0x7f797c06c6a0 msgr2=0x7f797c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 -- 172.21.15.26:0/1501426365 shutdown_connections 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.939+0000 7f7981d9e700 1 -- 172.21.15.26:0/1501426365 wait complete. 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.940+0000 7f7981d9e700 1 Processor -- start 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.940+0000 7f7981d9e700 1 -- start start 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f797c0c9090 0x7f797c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c13bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c158360 con 0x7f797c153660 2023-10-09T11:40:31.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c157750 con 0x7f797c0c9090 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f7981d9e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c157a30 con 0x7f797c153a30 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44994/0 (socket says 172.21.15.26:44994) 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 -- 172.21.15.26:0/1646544251 learned_addr learned my addr 172.21.15.26:0/1646544251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 -- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 msgr2=0x7f797c13bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c13bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 -- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f797c0c9090 msgr2=0x7f797c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f797c0c9090 0x7f797c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 -- 172.21.15.26:0/1646544251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797000a5d0 con 0x7f797c153660 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.941+0000 7f797bfff700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f797000a370 tx=0x7f797001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.942+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797001c050 con 0x7f797c153660 2023-10-09T11:40:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.942+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797001d040 con 0x7f797c153660 2023-10-09T11:40:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.942+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c157d10 con 0x7f797c153660 2023-10-09T11:40:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.942+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970010870 con 0x7f797c153660 2023-10-09T11:40:31.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.942+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c13c040 con 0x7f797c153660 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.943+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c1581b0 con 0x7f797c153660 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.943+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7970010be0 con 0x7f797c153660 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.943+0000 7f7978ff9700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 0x7f7968069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.943+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7970085810 con 0x7f797c153660 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.943+0000 7f7980d9c700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 0x7f7968069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:31.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.944+0000 7f7980d9c700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 0x7f7968069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f796c0058d0 tx=0x7f796c0079f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:31.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:31.948+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7970052a30 con 0x7f797c153660 2023-10-09T11:40:32.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.140+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f797c04c3c0 con 0x7f797c153660 2023-10-09T11:40:32.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.367+0000 7f7978ff9700 1 -- 172.21.15.26:0/1646544251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) v1 ==== 138+0+0 (secure 0 0 0) 0x7f79700260b0 con 0x7f797c153660 2023-10-09T11:40:32.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 msgr2=0x7f7968069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 0x7f7968069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f796c0058d0 tx=0x7f796c0079f0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 msgr2=0x7f797c14ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f797000a370 tx=0x7f797001a000 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 shutdown_connections 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7968067170 0x7f7968069620 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f796c0058d0 tx=0x7f796c0079f0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f797c153a30 0x7f797c13bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f797c0c9090 0x7f797c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 --2- 172.21.15.26:0/1646544251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f797c153660 0x7f797c14ee50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.370+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 >> 172.21.15.26:0/1646544251 conn(0x7f797c06c6a0 msgr2=0x7f797c0c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.371+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 shutdown_connections 2023-10-09T11:40:32.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.371+0000 7f7981d9e700 1 -- 172.21.15.26:0/1646544251 wait complete. 2023-10-09T11:40:32.373 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:40:32.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:40:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.511+0000 7fd59894f700 1 Processor -- start 2023-10-09T11:40:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.511+0000 7fd59894f700 1 -- start start 2023-10-09T11:40:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd59894f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 0x7fd5940ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd59894f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd59406dc70 0x7fd594159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd59894f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940ccfd0 con 0x7fd59406e0e0 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd59894f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5940cf0e0 con 0x7fd59406dc70 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd59894f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415a3d0 con 0x7fd594159530 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd591d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd59406dc70 0x7fd594159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd592d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd59406e0e0 0x7fd5940cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40576/0 (socket says 172.21.15.26:40576) 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.512+0000 7fd592d9d700 1 -- 172.21.15.26:0/2229103390 learned_addr learned my addr 172.21.15.26:0/2229103390 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59259c700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 0x7fd5940ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd591d9b700 1 -- 172.21.15.26:0/2229103390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 msgr2=0x7fd5940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd591d9b700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 0x7fd5940ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd591d9b700 1 -- 172.21.15.26:0/2229103390 >> v1:172.21.15.26:6789/0 conn(0x7fd59406e0e0 legacy=0x7fd5940cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd591d9b700 1 -- 172.21.15.26:0/2229103390 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59415a6b0 con 0x7fd59406dc70 2023-10-09T11:40:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59159a700 1 -- 172.21.15.26:0/2229103390 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607242372 0 0) 0x7fd5940ccfd0 con 0x7fd59406e0e0 2023-10-09T11:40:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59259c700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 0x7fd5940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd591d9b700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd594159900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac2a419163d3b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59159a700 1 -- 172.21.15.26:0/2229103390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c009e80 con 0x7fd59406dc70 2023-10-09T11:40:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59159a700 1 -- 172.21.15.26:0/2229103390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00b860 con 0x7fd59406dc70 2023-10-09T11:40:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59159a700 1 -- 172.21.15.26:0/2229103390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00bbe0 con 0x7fd59406dc70 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59894f700 1 -- 172.21.15.26:0/2229103390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 msgr2=0x7fd594159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.513+0000 7fd59894f700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd594159900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 -- 172.21.15.26:0/2229103390 shutdown_connections 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd594159530 0x7fd5940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 --2- 172.21.15.26:0/2229103390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd594159900 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 -- 172.21.15.26:0/2229103390 >> 172.21.15.26:0/2229103390 conn(0x7fd5940703a0 msgr2=0x7fd5940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 -- 172.21.15.26:0/2229103390 shutdown_connections 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.514+0000 7fd59894f700 1 -- 172.21.15.26:0/2229103390 wait complete. 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 Processor -- start 2023-10-09T11:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 -- start start 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59406e0e0 0x7fd5940c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 0x7fd5940b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b64f0 con 0x7fd59406dc70 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b5fa0 con 0x7fd594159530 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.515+0000 7fd59894f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b6210 con 0x7fd59406e0e0 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45020/0 (socket says 172.21.15.26:45020) 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 -- 172.21.15.26:0/573443798 learned_addr learned my addr 172.21.15.26:0/573443798 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd592d9d700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 0x7fd5940b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd591d9b700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59406e0e0 0x7fd5940c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 -- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59406e0e0 msgr2=0x7fd5940c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59406e0e0 0x7fd5940c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 -- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 msgr2=0x7fd5940b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 0x7fd5940b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 -- 172.21.15.26:0/573443798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd592d9d700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 0x7fd5940b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59259c700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c850 tx=0x7fd58c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c011600 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c011760 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5940b3fc0 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c011b00 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.516+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940ca020 con 0x7fd59406dc70 2023-10-09T11:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.517+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59404c3c0 con 0x7fd59406dc70 2023-10-09T11:40:32.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.518+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd58c0073b0 con 0x7fd59406dc70 2023-10-09T11:40:32.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.518+0000 7fd58a7fc700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 0x7fd574069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:32.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.518+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd58c0847e0 con 0x7fd59406dc70 2023-10-09T11:40:32.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.518+0000 7fd591d9b700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 0x7fd574069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:32.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.519+0000 7fd591d9b700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 0x7fd574069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd5940b66c0 tx=0x7fd57c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:32.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.523+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd58c055280 con 0x7fd59406dc70 2023-10-09T11:40:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:32.714+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd59415a990 con 0x7fd59406dc70 2023-10-09T11:40:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.373+0000 7fd58a7fc700 1 -- 172.21.15.26:0/573443798 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd58c054e10 con 0x7fd59406dc70 2023-10-09T11:40:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 msgr2=0x7fd574069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 0x7fd574069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd5940b66c0 tx=0x7fd57c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 msgr2=0x7fd59414cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c850 tx=0x7fd58c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 shutdown_connections 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd594159530 0x7fd5940b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd59406dc70 0x7fd59414cf70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd574067170 0x7fd574069620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 --2- 172.21.15.26:0/573443798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd59406e0e0 0x7fd5940c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.378+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 >> 172.21.15.26:0/573443798 conn(0x7fd5940703a0 msgr2=0x7fd5940c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.379+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 shutdown_connections 2023-10-09T11:40:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.379+0000 7fd59894f700 1 -- 172.21.15.26:0/573443798 wait complete. 2023-10-09T11:40:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:40:33.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:40:33.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.524+0000 7f0bba9ab700 1 Processor -- start 2023-10-09T11:40:33.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.524+0000 7f0bba9ab700 1 -- start start 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 0x7f0bb4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40ccfd0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40cf0e0 con 0x7f0bb406dc70 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bba9ab700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb415a3d0 con 0x7f0bb4159530 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45028/0 (socket says 172.21.15.26:45028) 2023-10-09T11:40:33.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 -- 172.21.15.26:0/1738442691 learned_addr learned my addr 172.21.15.26:0/1738442691 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb37fe700 1 --2- 172.21.15.26:0/1738442691 >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 0x7f0bb4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 -- 172.21.15.26:0/1738442691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 msgr2=0x7f0bb40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb3fff700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 -- 172.21.15.26:0/1738442691 >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 msgr2=0x7f0bb4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 --2- 172.21.15.26:0/1738442691 >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 0x7f0bb4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 -- 172.21.15.26:0/1738442691 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb415a6b0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb37fe700 1 --2- 172.21.15.26:0/1738442691 >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 0x7f0bb4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb3fff700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.525+0000 7f0bb8f48700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40713a0 tx=0x7f0bac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b795bdf0b49878 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bb2ffd700 1 -- 172.21.15.26:0/1738442691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00e070 con 0x7f0bb406e0e0 2023-10-09T11:40:33.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bb2ffd700 1 -- 172.21.15.26:0/1738442691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac00ba50 con 0x7f0bb406e0e0 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bb2ffd700 1 -- 172.21.15.26:0/1738442691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0092e0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1738442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 msgr2=0x7f0bb40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40713a0 tx=0x7f0bac009840 comp rx=0 tx=0).stop 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1738442691 shutdown_connections 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40cb6f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1738442691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1738442691 >> v2:172.21.15.67:3300/0 conn(0x7f0bb406dc70 0x7f0bb4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1738442691 >> 172.21.15.26:0/1738442691 conn(0x7f0bb40703a0 msgr2=0x7f0bb40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1738442691 shutdown_connections 2023-10-09T11:40:33.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.526+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1738442691 wait complete. 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.527+0000 7f0bba9ab700 1 Processor -- start 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 -- start start 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb406dc70 0x7f0bb41506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b51f0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4150c10 con 0x7f0bb406dc70 2023-10-09T11:40:33.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bba9ab700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40c7cd0 con 0x7f0bb4159530 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bb37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bb37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45044/0 (socket says 172.21.15.26:45044) 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.528+0000 7f0bb37fe700 1 -- 172.21.15.26:0/1922105829 learned_addr learned my addr 172.21.15.26:0/1922105829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb3fff700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb406dc70 0x7f0bb41506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb8f48700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 -- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 msgr2=0x7f0bb415e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb415e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 -- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb406dc70 msgr2=0x7f0bb41506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb406dc70 0x7f0bb41506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 -- 172.21.15.26:0/1922105829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac009ae0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bb37fe700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c8b0 tx=0x7f0ba8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011660 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80117c0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb40b45e0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011b40 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.529+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb40b4ba0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.530+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb404c3c0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.531+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0ba8010350 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.531+0000 7f0b9bfff700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 0x7f0ba0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.531+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0ba80848c0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.531+0000 7f0bb3fff700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 0x7f0ba0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:33.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.532+0000 7f0bb3fff700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 0x7f0ba0069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4006fd0 tx=0x7f0ba4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.536+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ba80517f0 con 0x7f0bb406e0e0 2023-10-09T11:40:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:33.773+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0bb415a990 con 0x7f0bb406e0e0 2023-10-09T11:40:34.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.374+0000 7f0b9bfff700 1 -- 172.21.15.26:0/1922105829 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0ba801e0c0 con 0x7f0bb406e0e0 2023-10-09T11:40:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 msgr2=0x7f0ba0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 0x7f0ba0069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4006fd0 tx=0x7f0ba4008040 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 msgr2=0x7f0bb40c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c8b0 tx=0x7f0ba8008040 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 shutdown_connections 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ba0067170 0x7f0ba0069620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0bb4159530 0x7f0bb415e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb406dc70 0x7f0bb41506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 --2- 172.21.15.26:0/1922105829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb406e0e0 0x7f0bb40c7790 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.377+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 >> 172.21.15.26:0/1922105829 conn(0x7f0bb40703a0 msgr2=0x7f0bb40cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:34.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.378+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 shutdown_connections 2023-10-09T11:40:34.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.379+0000 7f0bba9ab700 1 -- 172.21.15.26:0/1922105829 wait complete. 2023-10-09T11:40:34.384 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T11:40:34.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.516+0000 7f7ea16ca700 1 Processor -- start 2023-10-09T11:40:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.516+0000 7f7ea16ca700 1 -- start start 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7ea16ca700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e9c0cb5a0 0x7f7e9c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7ea16ca700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c15ae40 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7ea16ca700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c15ab60 con 0x7f7e9c15a5d0 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7ea16ca700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d13f0 con 0x7f7e9c0cb5a0 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7e9a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7e9c0cd9e0 0x7f7e9c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40578/0 (socket says 172.21.15.26:40578) 2023-10-09T11:40:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7e9a7fc700 1 -- 172.21.15.26:0/547564573 learned_addr learned my addr 172.21.15.26:0/547564573 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.517+0000 7f7e9affd700 1 --2- 172.21.15.26:0/547564573 >> v2:172.21.15.67:3300/0 conn(0x7f7e9c0cb5a0 0x7f7e9c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744410125 0 0) 0x7f7e9c15ae40 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e88003570 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180826965 0 0) 0x7f7e88003570 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 >> v2:172.21.15.67:3300/0 conn(0x7f7e9c0cb5a0 msgr2=0x7f7e9c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 --2- 172.21.15.26:0/547564573 >> v2:172.21.15.67:3300/0 conn(0x7f7e9c0cb5a0 0x7f7e9c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 >> v1:172.21.15.67:6789/0 conn(0x7f7e9c15a5d0 legacy=0x7f7e9c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0ccf00 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f7e84001470 con 0x7f7e9c0cd9e0 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 >> v1:172.21.15.26:6789/0 conn(0x7f7e9c0cd9e0 legacy=0x7f7e9c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e88003a60 0x7f7e88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 0x7f7e88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e880051c0 0x7f7e8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c0a0 con 0x7f7e88004810 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c210 con 0x7f7e88003a60 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c3d0 con 0x7f7e880051c0 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 0x7f7e88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9affd700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e88003a60 0x7f7e88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9b7fe700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e880051c0 0x7f7e8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 -- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e880051c0 msgr2=0x7f7e8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e880051c0 0x7f7e8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 -- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e88003a60 msgr2=0x7f7e88003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e88003a60 0x7f7e88003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9a7fc700 1 -- 172.21.15.26:0/547564573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88003570 con 0x7f7e88004810 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.518+0000 7f7e9b7fe700 1 -- 172.21.15.26:0/547564573 reap_dead start 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7e9a7fc700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 0x7f7e88004c80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c3c0 tx=0x7f7e84001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66562ea22ec8120b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400cc90 con 0x7f7e88004810 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400cdf0 con 0x7f7e88004810 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7e99ffb700 1 -- 172.21.15.26:0/547564573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84005b70 con 0x7f7e88004810 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 -- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 msgr2=0x7f7e88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 0x7f7e88004c80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c3c0 tx=0x7f7e84001e50 comp rx=0 tx=0).stop 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 -- 172.21.15.26:0/547564573 shutdown_connections 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/547564573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e88004810 0x7f7e88004c80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 -- 172.21.15.26:0/547564573 >> 172.21.15.26:0/547564573 conn(0x7f7e9c070e30 msgr2=0x7f7e9c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:34.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 -- 172.21.15.26:0/547564573 shutdown_connections 2023-10-09T11:40:34.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.519+0000 7f7ea16ca700 1 -- 172.21.15.26:0/547564573 wait complete. 2023-10-09T11:40:34.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 Processor -- start 2023-10-09T11:40:34.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 -- start start 2023-10-09T11:40:34.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e88004810 0x7f7e9c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9c0c8c20 0x7f7e9c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c15c980 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c15f560 con 0x7f7e9c0c8c20 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7ea16ca700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c9fd0 con 0x7f7e88004810 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7e9b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7e9b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45054/0 (socket says 172.21.15.26:45054) 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7e9b7fe700 1 -- 172.21.15.26:0/103503502 learned_addr learned my addr 172.21.15.26:0/103503502 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7e9affd700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e88004810 0x7f7e9c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.521+0000 7f7e9a7fc700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9c0c8c20 0x7f7e9c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 -- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e88004810 msgr2=0x7f7e9c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e88004810 0x7f7e9c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 -- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9c0c8c20 msgr2=0x7f7e9c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9c0c8c20 0x7f7e9c156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 -- 172.21.15.26:0/103503502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0c96a0 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e9b7fe700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c064ad0 tx=0x7f7e8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0032e0 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c003440 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0c9980 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0017d0 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.522+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0c9090 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.523+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c04c3c0 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.523+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7e8c001c00 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.524+0000 7f7e92ffd700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 0x7f7e7c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.524+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e8c084230 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.524+0000 7f7e9affd700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 0x7f7e7c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.525+0000 7f7e9affd700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 0x7f7e7c069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0897e0 tx=0x7f7e940091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.528+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e8c051210 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.725+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9c0ca110 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.726+0000 7f7e92ffd700 1 -- 172.21.15.26:0/103503502 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f7e8c058e60 con 0x7f7e9c15ebb0 2023-10-09T11:40:34.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:34.726 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:33.774637+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 msgr2=0x7f7e7c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 0x7f7e7c069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0897e0 tx=0x7f7e940091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 msgr2=0x7f7e9c15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c064ad0 tx=0x7f7e8c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 shutdown_connections 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e9c15ebb0 0x7f7e9c15f020 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7e7c067170 0x7f7e7c069620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e88004810 0x7f7e9c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 --2- 172.21.15.26:0/103503502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9c0c8c20 0x7f7e9c156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 >> 172.21.15.26:0/103503502 conn(0x7f7e9c070e30 msgr2=0x7f7e9c0c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 shutdown_connections 2023-10-09T11:40:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.728+0000 7f7ea16ca700 1 -- 172.21.15.26:0/103503502 wait complete. 2023-10-09T11:40:34.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:34.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.859+0000 7fae4623c700 1 Processor -- start 2023-10-09T11:40:34.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.859+0000 7fae4623c700 1 -- start start 2023-10-09T11:40:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae4623c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae400cb970 0x7fae40159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae4623c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae4015a400 0x7fae40156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae4623c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4015ae40 con 0x7fae400cb5a0 2023-10-09T11:40:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae4623c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae400ce0f0 con 0x7fae4015a400 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae4623c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400cbde0 con 0x7fae400cb970 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae400cb5a0 0x7fae400cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40594/0 (socket says 172.21.15.26:40594) 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3f7fe700 1 -- 172.21.15.26:0/735617920 learned_addr learned my addr 172.21.15.26:0/735617920 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3ffff700 1 --2- 172.21.15.26:0/735617920 >> v2:172.21.15.26:3300/0 conn(0x7fae4015a400 0x7fae40156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3effd700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae400cb970 0x7fae40159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3e7fc700 1 -- 172.21.15.26:0/735617920 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402273549 0 0) 0x7fae4015ae40 con 0x7fae400cb5a0 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3ffff700 1 -- 172.21.15.26:0/735617920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae400cb970 msgr2=0x7fae40159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3ffff700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae400cb970 0x7fae40159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3ffff700 1 -- 172.21.15.26:0/735617920 >> v1:172.21.15.26:6789/0 conn(0x7fae400cb5a0 legacy=0x7fae400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.860+0000 7fae3ffff700 1 -- 172.21.15.26:0/735617920 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4015ab60 con 0x7fae4015a400 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae3ffff700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae4015a400 0x7fae40156e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fae38009e90 tx=0x7fae38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f3f3cd0e5d392 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae3e7fc700 1 -- 172.21.15.26:0/735617920 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800e070 con 0x7fae4015a400 2023-10-09T11:40:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae3e7fc700 1 -- 172.21.15.26:0/735617920 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800bbf0 con 0x7fae4015a400 2023-10-09T11:40:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae3e7fc700 1 -- 172.21.15.26:0/735617920 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38012430 con 0x7fae4015a400 2023-10-09T11:40:34.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 -- 172.21.15.26:0/735617920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae4015a400 msgr2=0x7fae40156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae4015a400 0x7fae40156e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fae38009e90 tx=0x7fae38009780 comp rx=0 tx=0).stop 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 -- 172.21.15.26:0/735617920 shutdown_connections 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae4015a400 0x7fae40156e90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 --2- 172.21.15.26:0/735617920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae400cb970 0x7fae40159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 -- 172.21.15.26:0/735617920 >> 172.21.15.26:0/735617920 conn(0x7fae40070e30 msgr2=0x7fae400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 -- 172.21.15.26:0/735617920 shutdown_connections 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.861+0000 7fae4623c700 1 -- 172.21.15.26:0/735617920 wait complete. 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.863+0000 7fae4623c700 1 Processor -- start 2023-10-09T11:40:34.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.863+0000 7fae4623c700 1 -- start start 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae400cb5a0 0x7fae40153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae4015a400 0x7fae4015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400c8ce0 con 0x7fae400cb970 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4016a260 con 0x7fae400cb5a0 2023-10-09T11:40:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400c8f30 con 0x7fae4015a400 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45064/0 (socket says 172.21.15.26:45064) 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 -- 172.21.15.26:0/1976561662 learned_addr learned my addr 172.21.15.26:0/1976561662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3f7fe700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae400cb5a0 0x7fae40153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3ffff700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae4015a400 0x7fae4015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 -- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae4015a400 msgr2=0x7fae4015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae4015a400 0x7fae4015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 -- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae400cb5a0 msgr2=0x7fae40153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae400cb5a0 0x7fae40153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 -- 172.21.15.26:0/1976561662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009a20 con 0x7fae400cb970 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae3effd700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fae3400ec80 tx=0x7fae340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400c9d0 con 0x7fae400cb970 2023-10-09T11:40:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400cb30 con 0x7fae400cb970 2023-10-09T11:40:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.864+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae400c9210 con 0x7fae400cb970 2023-10-09T11:40:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.865+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34013470 con 0x7fae400cb970 2023-10-09T11:40:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.865+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae400c97d0 con 0x7fae400cb970 2023-10-09T11:40:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.866+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4004c3c0 con 0x7fae400cb970 2023-10-09T11:40:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.866+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fae34013820 con 0x7fae400cb970 2023-10-09T11:40:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.867+0000 7fae277fe700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 0x7fae2c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.867+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae34084c10 con 0x7fae400cb970 2023-10-09T11:40:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.867+0000 7fae3f7fe700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 0x7fae2c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.867+0000 7fae3f7fe700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 0x7fae2c069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c8f0 tx=0x7fae30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:34.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:34.871+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae34051bf0 con 0x7fae400cb970 2023-10-09T11:40:35.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.063+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae400d0fe0 con 0x7fae400cb970 2023-10-09T11:40:35.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.064+0000 7fae277fe700 1 -- 172.21.15.26:0/1976561662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fae34055210 con 0x7fae400cb970 2023-10-09T11:40:35.064 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:35.064 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:33.774637+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 msgr2=0x7fae2c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 0x7fae2c069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c8f0 tx=0x7fae30009040 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 msgr2=0x7fae40169d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fae3400ec80 tx=0x7fae340091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 shutdown_connections 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fae2c067170 0x7fae2c069620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae4015a400 0x7fae4015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae400cb5a0 0x7fae40153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 --2- 172.21.15.26:0/1976561662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae400cb970 0x7fae40169d20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 >> 172.21.15.26:0/1976561662 conn(0x7fae40070e30 msgr2=0x7fae400b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 shutdown_connections 2023-10-09T11:40:35.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.066+0000 7fae4623c700 1 -- 172.21.15.26:0/1976561662 wait complete. 2023-10-09T11:40:35.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:40:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.200+0000 7f01fbccf700 1 Processor -- start 2023-10-09T11:40:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 -- start start 2023-10-09T11:40:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01f4159530 0x7f01f40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f406e0e0 0x7f01f40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40ccfd0 con 0x7f01f406dc70 2023-10-09T11:40:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40cf0e0 con 0x7f01f4159530 2023-10-09T11:40:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.201+0000 7f01fbccf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f415a3d0 con 0x7f01f406e0e0 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01f4159530 0x7f01f40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f926a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f01f406dc70 0x7f01f4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40602/0 (socket says 172.21.15.26:40602) 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01f4159530 0x7f01f40ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45066/0 (socket says 172.21.15.26:45066) 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f926a700 1 -- 172.21.15.26:0/3778582658 learned_addr learned my addr 172.21.15.26:0/3778582658 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01fa26c700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f406e0e0 0x7f01f40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3778582658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f406e0e0 msgr2=0x7f01f40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f406e0e0 0x7f01f40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3778582658 >> v1:172.21.15.26:6789/0 conn(0x7f01f406dc70 legacy=0x7f01f4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f8a69700 1 -- 172.21.15.26:0/3778582658 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54671652 0 0) 0x7f01f40ccfd0 con 0x7f01f406dc70 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3778582658 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f415a6b0 con 0x7f01f4159530 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f9a6b700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f4159530 0x7f01f40ceba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e60 tx=0x7f01e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fbe71f0e17fee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f8a69700 1 -- 172.21.15.26:0/3778582658 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e070 con 0x7f01f4159530 2023-10-09T11:40:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f8a69700 1 -- 172.21.15.26:0/3778582658 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400bb60 con 0x7f01f4159530 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.202+0000 7f01f8a69700 1 -- 172.21.15.26:0/3778582658 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4012430 con 0x7f01f4159530 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 -- 172.21.15.26:0/3778582658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f4159530 msgr2=0x7f01f40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f4159530 0x7f01f40ceba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e60 tx=0x7f01e4009780 comp rx=0 tx=0).stop 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 -- 172.21.15.26:0/3778582658 shutdown_connections 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f406e0e0 0x7f01f40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3778582658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f4159530 0x7f01f40ceba0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 -- 172.21.15.26:0/3778582658 >> 172.21.15.26:0/3778582658 conn(0x7f01f40703a0 msgr2=0x7f01f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 -- 172.21.15.26:0/3778582658 shutdown_connections 2023-10-09T11:40:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.203+0000 7f01fbccf700 1 -- 172.21.15.26:0/3778582658 wait complete. 2023-10-09T11:40:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.204+0000 7f01fbccf700 1 Processor -- start 2023-10-09T11:40:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.204+0000 7f01fbccf700 1 -- start start 2023-10-09T11:40:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f406e0e0 0x7f01f40cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 0x7f01f40cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b5980 con 0x7f01f406dc70 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b4db0 con 0x7f01f406e0e0 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b5050 con 0x7f01f4159530 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45074/0 (socket says 172.21.15.26:45074) 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3246814065 learned_addr learned my addr 172.21.15.26:0/3246814065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f926a700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f406e0e0 0x7f01f40cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fa26c700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 0x7f01f40cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 msgr2=0x7f01f40cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 0x7f01f40cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f406e0e0 msgr2=0x7f01f40cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f406e0e0 0x7f01f40cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 -- 172.21.15.26:0/3246814065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009a20 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fa26c700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 0x7f01f40cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f9a6b700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f01f4089650 tx=0x7f01e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4012d30 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4027470 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40b5330 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.205+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4027830 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.206+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f41485b0 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.207+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f404c3c0 con 0x7f01f406dc70 2023-10-09T11:40:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.207+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f01e4024070 con 0x7f01f406dc70 2023-10-09T11:40:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.207+0000 7f01f1ffb700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 0x7f01e0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.208+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01e4086da0 con 0x7f01f406dc70 2023-10-09T11:40:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.208+0000 7f01f926a700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 0x7f01e0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.208+0000 7f01f926a700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 0x7f01e0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01f40b65f0 tx=0x7f01e8007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.214+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01e4053d80 con 0x7f01f406dc70 2023-10-09T11:40:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:35.453+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f01f415a990 con 0x7f01f406dc70 2023-10-09T11:40:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.388+0000 7f01f1ffb700 1 -- 172.21.15.26:0/3246814065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01e40573a0 con 0x7f01f406dc70 2023-10-09T11:40:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.391+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 msgr2=0x7f01e0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.391+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 0x7f01e0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01f40b65f0 tx=0x7f01e8007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.391+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 msgr2=0x7f01f4148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.391+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f01f4089650 tx=0x7f01e4019000 comp rx=0 tx=0).stop 2023-10-09T11:40:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 shutdown_connections 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01e0067170 0x7f01e0069620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01f4159530 0x7f01f40cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f406dc70 0x7f01f4148070 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 --2- 172.21.15.26:0/3246814065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f406e0e0 0x7f01f40cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 >> 172.21.15.26:0/3246814065 conn(0x7f01f40703a0 msgr2=0x7f01f40d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 shutdown_connections 2023-10-09T11:40:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.392+0000 7f01fbccf700 1 -- 172.21.15.26:0/3246814065 wait complete. 2023-10-09T11:40:36.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:40:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.535+0000 7fd043530700 1 Processor -- start 2023-10-09T11:40:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 -- start start 2023-10-09T11:40:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03c159530 0x7fd03c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 0x7fd03c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0ccfd0 con 0x7fd03c159530 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0cf0e0 con 0x7fd03c06dc70 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.536+0000 7fd043530700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c15a3d0 con 0x7fd03c06e0e0 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03c159530 0x7fd03c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03c159530 0x7fd03c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45090/0 (socket says 172.21.15.26:45090) 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 -- 172.21.15.26:0/985092860 learned_addr learned my addr 172.21.15.26:0/985092860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd040acb700 1 --2- 172.21.15.26:0/985092860 >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 0x7fd03c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd041acd700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 -- 172.21.15.26:0/985092860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 msgr2=0x7fd03c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 -- 172.21.15.26:0/985092860 >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 msgr2=0x7fd03c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 --2- 172.21.15.26:0/985092860 >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 0x7fd03c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 -- 172.21.15.26:0/985092860 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c15a6b0 con 0x7fd03c159530 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd040acb700 1 --2- 172.21.15.26:0/985092860 >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 0x7fd03c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd041acd700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd0412cc700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0ceba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0b66e0 tx=0x7fd02c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693028cc0cf49c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd03bfff700 1 -- 172.21.15.26:0/985092860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00e070 con 0x7fd03c159530 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd03bfff700 1 -- 172.21.15.26:0/985092860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c00ba50 con 0x7fd03c159530 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.537+0000 7fd03bfff700 1 -- 172.21.15.26:0/985092860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c0092e0 con 0x7fd03c159530 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 -- 172.21.15.26:0/985092860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 msgr2=0x7fd03c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0ceba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0b66e0 tx=0x7fd02c009840 comp rx=0 tx=0).stop 2023-10-09T11:40:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 -- 172.21.15.26:0/985092860 shutdown_connections 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 --2- 172.21.15.26:0/985092860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0ceba0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 --2- 172.21.15.26:0/985092860 >> v2:172.21.15.67:3300/0 conn(0x7fd03c06dc70 0x7fd03c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 -- 172.21.15.26:0/985092860 >> 172.21.15.26:0/985092860 conn(0x7fd03c0703a0 msgr2=0x7fd03c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 -- 172.21.15.26:0/985092860 shutdown_connections 2023-10-09T11:40:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.538+0000 7fd043530700 1 -- 172.21.15.26:0/985092860 wait complete. 2023-10-09T11:40:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.539+0000 7fd043530700 1 Processor -- start 2023-10-09T11:40:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.539+0000 7fd043530700 1 -- start start 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd03c06dc70 0x7fd03c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b5800 con 0x7fd03c159530 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b4bf0 con 0x7fd03c06dc70 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd043530700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b4ed0 con 0x7fd03c06e0e0 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45096/0 (socket says 172.21.15.26:45096) 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 -- 172.21.15.26:0/2768064341 learned_addr learned my addr 172.21.15.26:0/2768064341 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd040acb700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd0412cc700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd03c06dc70 0x7fd03c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 -- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 msgr2=0x7fd03c0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 -- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd03c06dc70 msgr2=0x7fd03c152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd03c06dc70 0x7fd03c152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.540+0000 7fd041acd700 1 -- 172.21.15.26:0/2768064341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c009ae0 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd041acd700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c880 tx=0x7fd034008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011600 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034011780 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c0b51b0 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011b40 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.541+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c152fd0 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.542+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c0b59b0 con 0x7fd03c159530 2023-10-09T11:40:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.542+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd034018350 con 0x7fd03c159530 2023-10-09T11:40:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.542+0000 7fd0397fa700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 0x7fd028069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.543+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd034084940 con 0x7fd03c159530 2023-10-09T11:40:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.543+0000 7fd0412cc700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 0x7fd028069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.543+0000 7fd0412cc700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 0x7fd028069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009880 tx=0x7fd02c018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.547+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd03c0b59b0 con 0x7fd03c159530 2023-10-09T11:40:36.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:36.785+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd03c0b5b90 con 0x7fd03c159530 2023-10-09T11:40:37.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.397+0000 7fd0397fa700 1 -- 172.21.15.26:0/2768064341 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd03c0b5b90 con 0x7fd03c159530 2023-10-09T11:40:37.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 msgr2=0x7fd028069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 0x7fd028069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009880 tx=0x7fd02c018000 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 msgr2=0x7fd03c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c880 tx=0x7fd034008040 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 shutdown_connections 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c159530 0x7fd03c0b1af0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd03c06dc70 0x7fd03c152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd028067170 0x7fd028069620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 --2- 172.21.15.26:0/2768064341 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd03c06e0e0 0x7fd03c0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 >> 172.21.15.26:0/2768064341 conn(0x7fd03c0703a0 msgr2=0x7fd03c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 shutdown_connections 2023-10-09T11:40:37.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.400+0000 7fd043530700 1 -- 172.21.15.26:0/2768064341 wait complete. 2023-10-09T11:40:37.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:37.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.540+0000 7fc57bce8700 1 Processor -- start 2023-10-09T11:40:37.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.540+0000 7fc57bce8700 1 -- start start 2023-10-09T11:40:37.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57bce8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 0x7fc5740c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57bce8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5740b0ba0 0x7fc57406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57bce8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57415a280 con 0x7fc5740b07d0 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57bce8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57406e180 con 0x7fc5740b0ba0 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57bce8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57406d850 con 0x7fc5740cf200 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5740b0ba0 0x7fc57406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc579a84700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc5740b07d0 0x7fc5740ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40614/0 (socket says 172.21.15.26:40614) 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc579a84700 1 -- 172.21.15.26:0/442211990 learned_addr learned my addr 172.21.15.26:0/442211990 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc579283700 1 --2- 172.21.15.26:0/442211990 >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 0x7fc5740c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 -- 172.21.15.26:0/442211990 >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 msgr2=0x7fc5740c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 --2- 172.21.15.26:0/442211990 >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 0x7fc5740c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 -- 172.21.15.26:0/442211990 >> v1:172.21.15.26:6789/0 conn(0x7fc5740b07d0 legacy=0x7fc5740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 -- 172.21.15.26:0/442211990 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57406db30 con 0x7fc5740b0ba0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc578a82700 1 -- 172.21.15.26:0/442211990 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857898484 0 0) 0x7fc57415a280 con 0x7fc5740b07d0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc579283700 1 --2- 172.21.15.26:0/442211990 >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 0x7fc5740c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.541+0000 7fc57a285700 1 --2- 172.21.15.26:0/442211990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740b0ba0 0x7fc57406e610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc5740cab40 tx=0x7fc564009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8911b43a2e5a1ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc578a82700 1 -- 172.21.15.26:0/442211990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400e070 con 0x7fc5740b0ba0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc578a82700 1 -- 172.21.15.26:0/442211990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400bc30 con 0x7fc5740b0ba0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc578a82700 1 -- 172.21.15.26:0/442211990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564012430 con 0x7fc5740b0ba0 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 -- 172.21.15.26:0/442211990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740b0ba0 msgr2=0x7fc57406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 --2- 172.21.15.26:0/442211990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740b0ba0 0x7fc57406e610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc5740cab40 tx=0x7fc564009780 comp rx=0 tx=0).stop 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 -- 172.21.15.26:0/442211990 shutdown_connections 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 --2- 172.21.15.26:0/442211990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740b0ba0 0x7fc57406e610 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 --2- 172.21.15.26:0/442211990 >> v2:172.21.15.67:3300/0 conn(0x7fc5740cf200 0x7fc5740c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 -- 172.21.15.26:0/442211990 >> 172.21.15.26:0/442211990 conn(0x7fc57406ce80 msgr2=0x7fc5740ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 -- 172.21.15.26:0/442211990 shutdown_connections 2023-10-09T11:40:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.542+0000 7fc57bce8700 1 -- 172.21.15.26:0/442211990 wait complete. 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.543+0000 7fc57bce8700 1 Processor -- start 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.543+0000 7fc57bce8700 1 -- start start 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5740b07d0 0x7fc574140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 0x7fc574142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574154410 con 0x7fc5740cf200 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574153e50 con 0x7fc5740b0ba0 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57bce8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574154130 con 0x7fc5740b07d0 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57a285700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57a285700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45120/0 (socket says 172.21.15.26:45120) 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc57a285700 1 -- 172.21.15.26:0/2967841542 learned_addr learned my addr 172.21.15.26:0/2967841542 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc579283700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 0x7fc574142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.544+0000 7fc579a84700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5740b07d0 0x7fc574140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 -- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5740b07d0 msgr2=0x7fc574140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5740b07d0 0x7fc574140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 -- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 msgr2=0x7fc574142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 0x7fc574142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 -- 172.21.15.26:0/2967841542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564009a20 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc579283700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 0x7fc574142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57a285700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc57406af10 tx=0x7fc564019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564012e60 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56401d630 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5741577e0 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56401d9f0 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.545+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc574153a20 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.546+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc574157640 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.547+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc564024070 con 0x7fc5740cf200 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.547+0000 7fc571ffb700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 0x7fc560069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.547+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5640870e0 con 0x7fc5740cf200 2023-10-09T11:40:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.547+0000 7fc579a84700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 0x7fc560069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.548+0000 7fc579a84700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 0x7fc560069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc56c002800 tx=0x7fc56c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.551+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc574157640 con 0x7fc5740cf200 2023-10-09T11:40:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.786+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc574157d00 con 0x7fc5740cf200 2023-10-09T11:40:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.787+0000 7fc571ffb700 1 -- 172.21.15.26:0/2967841542 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fc574157d00 con 0x7fc5740cf200 2023-10-09T11:40:37.787 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:37.788 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 msgr2=0x7fc560069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 0x7fc560069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc56c002800 tx=0x7fc56c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 msgr2=0x7fc574157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc57406af10 tx=0x7fc564019000 comp rx=0 tx=0).stop 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 shutdown_connections 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5740cf200 0x7fc574157fe0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc560067170 0x7fc560069620 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5740b07d0 0x7fc574140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 --2- 172.21.15.26:0/2967841542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5740b0ba0 0x7fc574142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 >> 172.21.15.26:0/2967841542 conn(0x7fc57406ce80 msgr2=0x7fc574067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 shutdown_connections 2023-10-09T11:40:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.789+0000 7fc57bce8700 1 -- 172.21.15.26:0/2967841542 wait complete. 2023-10-09T11:40:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 48 2023-10-09T11:40:37.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 Processor -- start 2023-10-09T11:40:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 -- start start 2023-10-09T11:40:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a40a8be0 0x7f20a40a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 0x7f20a40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20a40ae780 0x7f20a40aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40af140 con 0x7f20a40ae780 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40ce1a0 con 0x7f20a406d280 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.920+0000 7f20aa7df700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40cd5d0 con 0x7f20a40a8be0 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20a40ae780 0x7f20a40aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20a40ae780 0x7f20a40aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45126/0 (socket says 172.21.15.26:45126) 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 -- 172.21.15.26:0/1507687448 learned_addr learned my addr 172.21.15.26:0/1507687448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a3fff700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a40a8be0 0x7f20a40a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a37fe700 1 --2- 172.21.15.26:0/1507687448 >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 0x7f20a40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 -- 172.21.15.26:0/1507687448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a40a8be0 msgr2=0x7f20a40a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a40a8be0 0x7f20a40a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 -- 172.21.15.26:0/1507687448 >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 msgr2=0x7f20a40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 --2- 172.21.15.26:0/1507687448 >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 0x7f20a40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 -- 172.21.15.26:0/1507687448 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40cd870 con 0x7f20a40ae780 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a37fe700 1 --2- 172.21.15.26:0/1507687448 >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 0x7f20a40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a8d7c700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40ae780 0x7f20a40aec00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f20a40ce480 tx=0x7f209c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd67007fb512ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a2ffd700 1 -- 172.21.15.26:0/1507687448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c00e070 con 0x7f20a40ae780 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a2ffd700 1 -- 172.21.15.26:0/1507687448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c00bae0 con 0x7f20a40ae780 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.921+0000 7f20a2ffd700 1 -- 172.21.15.26:0/1507687448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c0092e0 con 0x7f20a40ae780 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 -- 172.21.15.26:0/1507687448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40ae780 msgr2=0x7f20a40aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40ae780 0x7f20a40aec00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f20a40ce480 tx=0x7f209c009840 comp rx=0 tx=0).stop 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 -- 172.21.15.26:0/1507687448 shutdown_connections 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40ae780 0x7f20a40aec00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 --2- 172.21.15.26:0/1507687448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a40a8be0 0x7f20a40a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 --2- 172.21.15.26:0/1507687448 >> v2:172.21.15.67:3300/0 conn(0x7f20a406d280 0x7f20a40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 -- 172.21.15.26:0/1507687448 >> 172.21.15.26:0/1507687448 conn(0x7f20a406ce80 msgr2=0x7f20a40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 -- 172.21.15.26:0/1507687448 shutdown_connections 2023-10-09T11:40:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.922+0000 7f20aa7df700 1 -- 172.21.15.26:0/1507687448 wait complete. 2023-10-09T11:40:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.923+0000 7f20aa7df700 1 Processor -- start 2023-10-09T11:40:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.923+0000 7f20aa7df700 1 -- start start 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a406d280 0x7f20a4156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a40ae780 0x7f20a40ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a41570e0 con 0x7f20a40a8be0 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40a9ff0 con 0x7f20a40ae780 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20aa7df700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40aa2d0 con 0x7f20a406d280 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45130/0 (socket says 172.21.15.26:45130) 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 -- 172.21.15.26:0/2629145258 learned_addr learned my addr 172.21.15.26:0/2629145258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a8d7c700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a40ae780 0x7f20a40ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a3fff700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a406d280 0x7f20a4156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 -- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a406d280 msgr2=0x7f20a4156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a406d280 0x7f20a4156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 -- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a40ae780 msgr2=0x7f20a40ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a40ae780 0x7f20a40ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 -- 172.21.15.26:0/2629145258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009ae0 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.924+0000 7f20a37fe700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f209800c880 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.925+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098005a00 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.925+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098005b60 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.925+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40aa5b0 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.925+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011600 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.925+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a4156540 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.926+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40990c0 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.926+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f20980119f0 con 0x7f20a40a8be0 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.927+0000 7f208bfff700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 0x7f2090069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.927+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20980847d0 con 0x7f20a40a8be0 2023-10-09T11:40:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.927+0000 7f20a3fff700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 0x7f2090069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.927+0000 7f20a3fff700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 0x7f2090069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:37.931+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a40990c0 con 0x7f20a40a8be0 2023-10-09T11:40:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.127+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a40990c0 con 0x7f20a40a8be0 2023-10-09T11:40:38.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.128+0000 7f208bfff700 1 -- 172.21.15.26:0/2629145258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f20a40990c0 con 0x7f20a40a8be0 2023-10-09T11:40:38.128 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:38.128 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:35.178315+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:38.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 msgr2=0x7f2090069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 0x7f2090069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 msgr2=0x7f20a40ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f209800c880 tx=0x7f2098008040 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 shutdown_connections 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a40ae780 0x7f20a40ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2090067170 0x7f2090069620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20a406d280 0x7f20a4156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 --2- 172.21.15.26:0/2629145258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20a40a8be0 0x7f20a40ab3f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 >> 172.21.15.26:0/2629145258 conn(0x7f20a406ce80 msgr2=0x7f20a40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 shutdown_connections 2023-10-09T11:40:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.130+0000 7f20aa7df700 1 -- 172.21.15.26:0/2629145258 wait complete. 2023-10-09T11:40:38.142 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:40:38.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.261+0000 7f99f759e700 1 Processor -- start 2023-10-09T11:40:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.261+0000 7f99f759e700 1 -- start start 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99f8164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f759e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f815afd0 con 0x7f99f8153c30 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f759e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f815b2b0 con 0x7f99f815de50 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f815b590 con 0x7f99f80cf110 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f99f8153c30 0x7f99f815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40620/0 (socket says 172.21.15.26:40620) 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f659c700 1 -- 172.21.15.26:0/4180802302 learned_addr learned my addr 172.21.15.26:0/4180802302 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f6d9d700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99f8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691035121 0 0) 0x7f99f815afd0 con 0x7f99f8153c30 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.262+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4003570 con 0x7f99f8153c30 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828881485 0 0) 0x7f99e4003570 con 0x7f99f8153c30 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 msgr2=0x7f99f8164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99f8164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 >> v1:172.21.15.67:6789/0 conn(0x7f99f815de50 legacy=0x7f99f80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f815b870 con 0x7f99f8153c30 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f99f0001470 con 0x7f99f8153c30 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 >> v1:172.21.15.26:6789/0 conn(0x7f99f8153c30 legacy=0x7f99f815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99e4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e4003fd0 0x7f99e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4004d50 0x7f99e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f815b590 con 0x7f99e4003fd0 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400bb40 con 0x7f99e4004d50 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400bd00 con 0x7f99f80cf110 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e4003fd0 0x7f99e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f659c700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99e4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f6d9d700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4004d50 0x7f99e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 -- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 msgr2=0x7f99e4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80cf110 0x7f99e4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 -- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4004d50 msgr2=0x7f99e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4004d50 0x7f99e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 -- 172.21.15.26:0/4180802302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4003570 con 0x7f99e4003fd0 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e4003fd0 0x7f99e4004810 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f99e00019a0 tx=0x7f99e0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429d901262462621 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000c5d0 con 0x7f99e4003fd0 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000c750 con 0x7f99e4003fd0 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.263+0000 7f99f559a700 1 -- 172.21.15.26:0/4180802302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000cb10 con 0x7f99e4003fd0 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 -- 172.21.15.26:0/4180802302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e4003fd0 msgr2=0x7f99e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 --2- 172.21.15.26:0/4180802302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e4003fd0 0x7f99e4004810 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f99e00019a0 tx=0x7f99e0007d10 comp rx=0 tx=0).stop 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f6d9d700 1 -- 172.21.15.26:0/4180802302 reap_dead start 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 -- 172.21.15.26:0/4180802302 shutdown_connections 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 -- 172.21.15.26:0/4180802302 >> 172.21.15.26:0/4180802302 conn(0x7f99f80703a0 msgr2=0x7f99f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 -- 172.21.15.26:0/4180802302 shutdown_connections 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.264+0000 7f99f759e700 1 -- 172.21.15.26:0/4180802302 wait complete. 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.265+0000 7f99f759e700 1 Processor -- start 2023-10-09T11:40:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.265+0000 7f99f759e700 1 -- start start 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4003fd0 0x7f99f80b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 0x7f99f81531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8153720 con 0x7f99f80b1460 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c79a0 con 0x7f99e4003fd0 2023-10-09T11:40:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c7c80 con 0x7f99f80b18d0 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45138/0 (socket says 172.21.15.26:45138) 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 -- 172.21.15.26:0/1594588190 learned_addr learned my addr 172.21.15.26:0/1594588190 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f6d9d700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 0x7f99f81531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f659c700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4003fd0 0x7f99f80b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 -- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 msgr2=0x7f99f81531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 0x7f99f81531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 -- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4003fd0 msgr2=0x7f99f80b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4003fd0 0x7f99f80b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f5d9b700 1 -- 172.21.15.26:0/1594588190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80c7f60 con 0x7f99f80b1460 2023-10-09T11:40:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.266+0000 7f99f6d9d700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 0x7f99f81531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99f5d9b700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c3c0 tx=0x7f99e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0007af0 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000c5d0 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80c8240 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000cec0 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.267+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f80ca190 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.268+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f80c86e0 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.268+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f99e0019030 con 0x7f99f80b1460 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.268+0000 7f99ee7fc700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 0x7f99d8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.269+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99e0085fd0 con 0x7f99f80b1460 2023-10-09T11:40:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.269+0000 7f99f659c700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 0x7f99d8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.269+0000 7f99f659c700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 0x7f99d8069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f99f00015a0 tx=0x7f99f8159c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.273+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99e0053070 con 0x7f99f80b1460 2023-10-09T11:40:38.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.462+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99f8153720 con 0x7f99d8067170 2023-10-09T11:40:38.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.471+0000 7f99ee7fc700 1 -- 172.21.15.26:0/1594588190 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289066 (secure 0 0 0) 0x7f99f8153720 con 0x7f99d8067170 2023-10-09T11:40:38.476 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:38.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 msgr2=0x7f99d8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 0x7f99d8069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f99f00015a0 tx=0x7f99f8159c60 comp rx=0 tx=0).stop 2023-10-09T11:40:38.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 msgr2=0x7f99f8152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c3c0 tx=0x7f99e0015000 comp rx=0 tx=0).stop 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 shutdown_connections 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99d8067170 0x7f99d8069620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99f80b18d0 0x7f99f81531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99e4003fd0 0x7f99f80b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 --2- 172.21.15.26:0/1594588190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99f80b1460 0x7f99f8152ca0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 >> 172.21.15.26:0/1594588190 conn(0x7f99f80703a0 msgr2=0x7f99f815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 shutdown_connections 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.475+0000 7f99f759e700 1 -- 172.21.15.26:0/1594588190 wait complete. 2023-10-09T11:40:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:40:38.487 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-10-09T11:40:37.182484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403224,"kb_used_data":8536,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571496,"statfs":{"total":773094113280,"available":770633211904,"internally_reserved":0,"allocated":8740864,"data_stored":4395844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.814893"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203508+0000","last_change":"2023-10-09T11:40:34.197305+0000","last_active":"2023-10-09T11:40:34.203508+0000","last_peered":"2023-10-09T11:40:34.203508+0000","last_clean":"2023-10-09T11:40:34.203508+0000","last_became_active":"2023-10-09T11:40:34.196502+0000","last_became_peered":"2023-10-09T11:40:34.196502+0000","last_unstale":"2023-10-09T11:40:34.203508+0000","last_undegraded":"2023-10-09T11:40:34.203508+0000","last_fullsized":"2023-10-09T11:40:34.203508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196805+0000","last_change":"2023-10-09T11:40:34.196805+0000","last_active":"2023-10-09T11:40:34.196805+0000","last_peered":"2023-10-09T11:40:34.196805+0000","last_clean":"2023-10-09T11:40:34.196805+0000","last_became_active":"2023-10-09T11:40:34.196184+0000","last_became_peered":"2023-10-09T11:40:34.196184+0000","last_unstale":"2023-10-09T11:40:34.196805+0000","last_undegraded":"2023-10-09T11:40:34.196805+0000","last_fullsized":"2023-10-09T11:40:34.196805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:13.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204253+0000","last_change":"2023-10-09T11:40:34.199185+0000","last_active":"2023-10-09T11:40:34.204253+0000","last_peered":"2023-10-09T11:40:34.204253+0000","last_clean":"2023-10-09T11:40:34.204253+0000","last_became_active":"2023-10-09T11:40:34.198886+0000","last_became_peered":"2023-10-09T11:40:34.198886+0000","last_unstale":"2023-10-09T11:40:34.204253+0000","last_undegraded":"2023-10-09T11:40:34.204253+0000","last_fullsized":"2023-10-09T11:40:34.204253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:27.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192521+0000","last_change":"2023-10-09T11:40:34.192521+0000","last_active":"2023-10-09T11:40:34.192521+0000","last_peered":"2023-10-09T11:40:34.192521+0000","last_clean":"2023-10-09T11:40:34.192521+0000","last_became_active":"2023-10-09T11:40:34.192070+0000","last_became_peered":"2023-10-09T11:40:34.192070+0000","last_unstale":"2023-10-09T11:40:34.192521+0000","last_undegraded":"2023-10-09T11:40:34.192521+0000","last_fullsized":"2023-10-09T11:40:34.192521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:39.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200836+0000","last_change":"2023-10-09T11:40:34.194675+0000","last_active":"2023-10-09T11:40:34.200836+0000","last_peered":"2023-10-09T11:40:34.200836+0000","last_clean":"2023-10-09T11:40:34.200836+0000","last_became_active":"2023-10-09T11:40:34.194385+0000","last_became_peered":"2023-10-09T11:40:34.194385+0000","last_unstale":"2023-10-09T11:40:34.200836+0000","last_undegraded":"2023-10-09T11:40:34.200836+0000","last_fullsized":"2023-10-09T11:40:34.200836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204008+0000","last_change":"2023-10-09T11:40:34.199871+0000","last_active":"2023-10-09T11:40:34.204008+0000","last_peered":"2023-10-09T11:40:34.204008+0000","last_clean":"2023-10-09T11:40:34.204008+0000","last_became_active":"2023-10-09T11:40:34.199370+0000","last_became_peered":"2023-10-09T11:40:34.199370+0000","last_unstale":"2023-10-09T11:40:34.204008+0000","last_undegraded":"2023-10-09T11:40:34.204008+0000","last_fullsized":"2023-10-09T11:40:34.204008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:12.793028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193543+0000","last_change":"2023-10-09T11:40:34.193543+0000","last_active":"2023-10-09T11:40:34.193543+0000","last_peered":"2023-10-09T11:40:34.193543+0000","last_clean":"2023-10-09T11:40:34.193543+0000","last_became_active":"2023-10-09T11:40:34.193285+0000","last_became_peered":"2023-10-09T11:40:34.193285+0000","last_unstale":"2023-10-09T11:40:34.193543+0000","last_undegraded":"2023-10-09T11:40:34.193543+0000","last_fullsized":"2023-10-09T11:40:34.193543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:47.016441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204040+0000","last_change":"2023-10-09T11:40:34.201630+0000","last_active":"2023-10-09T11:40:34.204040+0000","last_peered":"2023-10-09T11:40:34.204040+0000","last_clean":"2023-10-09T11:40:34.204040+0000","last_became_active":"2023-10-09T11:40:34.199112+0000","last_became_peered":"2023-10-09T11:40:34.199112+0000","last_unstale":"2023-10-09T11:40:34.204040+0000","last_undegraded":"2023-10-09T11:40:34.204040+0000","last_fullsized":"2023-10-09T11:40:34.204040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204043+0000","last_change":"2023-10-09T11:40:34.201921+0000","last_active":"2023-10-09T11:40:34.204043+0000","last_peered":"2023-10-09T11:40:34.204043+0000","last_clean":"2023-10-09T11:40:34.204043+0000","last_became_active":"2023-10-09T11:40:34.199839+0000","last_became_peered":"2023-10-09T11:40:34.199839+0000","last_unstale":"2023-10-09T11:40:34.204043+0000","last_undegraded":"2023-10-09T11:40:34.204043+0000","last_fullsized":"2023-10-09T11:40:34.204043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:07.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196726+0000","last_change":"2023-10-09T11:40:34.190704+0000","last_active":"2023-10-09T11:40:34.196726+0000","last_peered":"2023-10-09T11:40:34.196726+0000","last_clean":"2023-10-09T11:40:34.196726+0000","last_became_active":"2023-10-09T11:40:34.190381+0000","last_became_peered":"2023-10-09T11:40:34.190381+0000","last_unstale":"2023-10-09T11:40:34.196726+0000","last_undegraded":"2023-10-09T11:40:34.196726+0000","last_fullsized":"2023-10-09T11:40:34.196726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:53.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192839+0000","last_change":"2023-10-09T11:40:34.192839+0000","last_active":"2023-10-09T11:40:34.192839+0000","last_peered":"2023-10-09T11:40:34.192839+0000","last_clean":"2023-10-09T11:40:34.192839+0000","last_became_active":"2023-10-09T11:40:34.192586+0000","last_became_peered":"2023-10-09T11:40:34.192586+0000","last_unstale":"2023-10-09T11:40:34.192839+0000","last_undegraded":"2023-10-09T11:40:34.192839+0000","last_fullsized":"2023-10-09T11:40:34.192839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:05.991854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196384+0000","last_change":"2023-10-09T11:40:34.190532+0000","last_active":"2023-10-09T11:40:34.196384+0000","last_peered":"2023-10-09T11:40:34.196384+0000","last_clean":"2023-10-09T11:40:34.196384+0000","last_became_active":"2023-10-09T11:40:34.190260+0000","last_became_peered":"2023-10-09T11:40:34.190260+0000","last_unstale":"2023-10-09T11:40:34.196384+0000","last_undegraded":"2023-10-09T11:40:34.196384+0000","last_fullsized":"2023-10-09T11:40:34.196384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:25.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204313+0000","last_change":"2023-10-09T11:40:34.200916+0000","last_active":"2023-10-09T11:40:34.204313+0000","last_peered":"2023-10-09T11:40:34.204313+0000","last_clean":"2023-10-09T11:40:34.204313+0000","last_became_active":"2023-10-09T11:40:34.200637+0000","last_became_peered":"2023-10-09T11:40:34.200637+0000","last_unstale":"2023-10-09T11:40:34.204313+0000","last_undegraded":"2023-10-09T11:40:34.204313+0000","last_fullsized":"2023-10-09T11:40:34.204313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:25.495566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193952+0000","last_change":"2023-10-09T11:40:34.193952+0000","last_active":"2023-10-09T11:40:34.193952+0000","last_peered":"2023-10-09T11:40:34.193952+0000","last_clean":"2023-10-09T11:40:34.193952+0000","last_became_active":"2023-10-09T11:40:34.193662+0000","last_became_peered":"2023-10-09T11:40:34.193662+0000","last_unstale":"2023-10-09T11:40:34.193952+0000","last_undegraded":"2023-10-09T11:40:34.193952+0000","last_fullsized":"2023-10-09T11:40:34.193952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:25.030871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195438+0000","last_change":"2023-10-09T11:40:34.195438+0000","last_active":"2023-10-09T11:40:34.195438+0000","last_peered":"2023-10-09T11:40:34.195438+0000","last_clean":"2023-10-09T11:40:34.195438+0000","last_became_active":"2023-10-09T11:40:34.194999+0000","last_became_peered":"2023-10-09T11:40:34.194999+0000","last_unstale":"2023-10-09T11:40:34.195438+0000","last_undegraded":"2023-10-09T11:40:34.195438+0000","last_fullsized":"2023-10-09T11:40:34.195438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:01.699417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200947+0000","last_change":"2023-10-09T11:40:34.197469+0000","last_active":"2023-10-09T11:40:34.200947+0000","last_peered":"2023-10-09T11:40:34.200947+0000","last_clean":"2023-10-09T11:40:34.200947+0000","last_became_active":"2023-10-09T11:40:34.197202+0000","last_became_peered":"2023-10-09T11:40:34.197202+0000","last_unstale":"2023-10-09T11:40:34.200947+0000","last_undegraded":"2023-10-09T11:40:34.200947+0000","last_fullsized":"2023-10-09T11:40:34.200947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:36.091734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200283+0000","last_change":"2023-10-09T11:40:34.188507+0000","last_active":"2023-10-09T11:40:34.200283+0000","last_peered":"2023-10-09T11:40:34.200283+0000","last_clean":"2023-10-09T11:40:34.200283+0000","last_became_active":"2023-10-09T11:40:34.188142+0000","last_became_peered":"2023-10-09T11:40:34.188142+0000","last_unstale":"2023-10-09T11:40:34.200283+0000","last_undegraded":"2023-10-09T11:40:34.200283+0000","last_fullsized":"2023-10-09T11:40:34.200283+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:13.566866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195517+0000","last_change":"2023-10-09T11:40:34.195517+0000","last_active":"2023-10-09T11:40:34.195517+0000","last_peered":"2023-10-09T11:40:34.195517+0000","last_clean":"2023-10-09T11:40:34.195517+0000","last_became_active":"2023-10-09T11:40:34.195118+0000","last_became_peered":"2023-10-09T11:40:34.195118+0000","last_unstale":"2023-10-09T11:40:34.195517+0000","last_undegraded":"2023-10-09T11:40:34.195517+0000","last_fullsized":"2023-10-09T11:40:34.195517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:42.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190351+0000","last_change":"2023-10-09T11:40:34.190351+0000","last_active":"2023-10-09T11:40:34.190351+0000","last_peered":"2023-10-09T11:40:34.190351+0000","last_clean":"2023-10-09T11:40:34.190351+0000","last_became_active":"2023-10-09T11:40:34.190083+0000","last_became_peered":"2023-10-09T11:40:34.190083+0000","last_unstale":"2023-10-09T11:40:34.190351+0000","last_undegraded":"2023-10-09T11:40:34.190351+0000","last_fullsized":"2023-10-09T11:40:34.190351+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:45.295387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192357+0000","last_change":"2023-10-09T11:40:34.192357+0000","last_active":"2023-10-09T11:40:34.192357+0000","last_peered":"2023-10-09T11:40:34.192357+0000","last_clean":"2023-10-09T11:40:34.192357+0000","last_became_active":"2023-10-09T11:40:34.191472+0000","last_became_peered":"2023-10-09T11:40:34.191472+0000","last_unstale":"2023-10-09T11:40:34.192357+0000","last_undegraded":"2023-10-09T11:40:34.192357+0000","last_fullsized":"2023-10-09T11:40:34.192357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:04.161227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193018+0000","last_change":"2023-10-09T11:40:34.193018+0000","last_active":"2023-10-09T11:40:34.193018+0000","last_peered":"2023-10-09T11:40:34.193018+0000","last_clean":"2023-10-09T11:40:34.193018+0000","last_became_active":"2023-10-09T11:40:34.192744+0000","last_became_peered":"2023-10-09T11:40:34.192744+0000","last_unstale":"2023-10-09T11:40:34.193018+0000","last_undegraded":"2023-10-09T11:40:34.193018+0000","last_fullsized":"2023-10-09T11:40:34.193018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:08.037738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.191097+0000","last_change":"2023-10-09T11:40:34.191097+0000","last_active":"2023-10-09T11:40:34.191097+0000","last_peered":"2023-10-09T11:40:34.191097+0000","last_clean":"2023-10-09T11:40:34.191097+0000","last_became_active":"2023-10-09T11:40:34.190852+0000","last_became_peered":"2023-10-09T11:40:34.190852+0000","last_unstale":"2023-10-09T11:40:34.191097+0000","last_undegraded":"2023-10-09T11:40:34.191097+0000","last_fullsized":"2023-10-09T11:40:34.191097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:13.566866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197388+0000","last_change":"2023-10-09T11:40:34.191033+0000","last_active":"2023-10-09T11:40:34.197388+0000","last_peered":"2023-10-09T11:40:34.197388+0000","last_clean":"2023-10-09T11:40:34.197388+0000","last_became_active":"2023-10-09T11:40:34.190695+0000","last_became_peered":"2023-10-09T11:40:34.190695+0000","last_unstale":"2023-10-09T11:40:34.197388+0000","last_undegraded":"2023-10-09T11:40:34.197388+0000","last_fullsized":"2023-10-09T11:40:34.197388+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:06.854823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.189271+0000","last_change":"2023-10-09T11:40:34.189271+0000","last_active":"2023-10-09T11:40:34.189271+0000","last_peered":"2023-10-09T11:40:34.189271+0000","last_clean":"2023-10-09T11:40:34.189271+0000","last_became_active":"2023-10-09T11:40:34.188992+0000","last_became_peered":"2023-10-09T11:40:34.188992+0000","last_unstale":"2023-10-09T11:40:34.189271+0000","last_undegraded":"2023-10-09T11:40:34.189271+0000","last_fullsized":"2023-10-09T11:40:34.189271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:19:58.921622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.198941+0000","last_change":"2023-10-09T11:40:34.198941+0000","last_active":"2023-10-09T11:40:34.198941+0000","last_peered":"2023-10-09T11:40:34.198941+0000","last_clean":"2023-10-09T11:40:34.198941+0000","last_became_active":"2023-10-09T11:40:34.198658+0000","last_became_peered":"2023-10-09T11:40:34.198658+0000","last_unstale":"2023-10-09T11:40:34.198941+0000","last_undegraded":"2023-10-09T11:40:34.198941+0000","last_fullsized":"2023-10-09T11:40:34.198941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:50.701025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203495+0000","last_change":"2023-10-09T11:40:34.197247+0000","last_active":"2023-10-09T11:40:34.203495+0000","last_peered":"2023-10-09T11:40:34.203495+0000","last_clean":"2023-10-09T11:40:34.203495+0000","last_became_active":"2023-10-09T11:40:34.196933+0000","last_became_peered":"2023-10-09T11:40:34.196933+0000","last_unstale":"2023-10-09T11:40:34.203495+0000","last_undegraded":"2023-10-09T11:40:34.203495+0000","last_fullsized":"2023-10-09T11:40:34.203495+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:48.315919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199781+0000","last_change":"2023-10-09T11:40:34.192158+0000","last_active":"2023-10-09T11:40:34.199781+0000","last_peered":"2023-10-09T11:40:34.199781+0000","last_clean":"2023-10-09T11:40:34.199781+0000","last_became_active":"2023-10-09T11:40:34.191829+0000","last_became_peered":"2023-10-09T11:40:34.191829+0000","last_unstale":"2023-10-09T11:40:34.199781+0000","last_undegraded":"2023-10-09T11:40:34.199781+0000","last_fullsized":"2023-10-09T11:40:34.199781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:28.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197445+0000","last_change":"2023-10-09T11:40:34.194509+0000","last_active":"2023-10-09T11:40:34.197445+0000","last_peered":"2023-10-09T11:40:34.197445+0000","last_clean":"2023-10-09T11:40:34.197445+0000","last_became_active":"2023-10-09T11:40:34.194181+0000","last_became_peered":"2023-10-09T11:40:34.194181+0000","last_unstale":"2023-10-09T11:40:34.197445+0000","last_undegraded":"2023-10-09T11:40:34.197445+0000","last_fullsized":"2023-10-09T11:40:34.197445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190088+0000","last_change":"2023-10-09T11:40:34.190088+0000","last_active":"2023-10-09T11:40:34.190088+0000","last_peered":"2023-10-09T11:40:34.190088+0000","last_clean":"2023-10-09T11:40:34.190088+0000","last_became_active":"2023-10-09T11:40:34.189748+0000","last_became_peered":"2023-10-09T11:40:34.189748+0000","last_unstale":"2023-10-09T11:40:34.190088+0000","last_undegraded":"2023-10-09T11:40:34.190088+0000","last_fullsized":"2023-10-09T11:40:34.190088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:00.129725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190272+0000","last_change":"2023-10-09T11:40:34.190272+0000","last_active":"2023-10-09T11:40:34.190272+0000","last_peered":"2023-10-09T11:40:34.190272+0000","last_clean":"2023-10-09T11:40:34.190272+0000","last_became_active":"2023-10-09T11:40:34.189780+0000","last_became_peered":"2023-10-09T11:40:34.189780+0000","last_unstale":"2023-10-09T11:40:34.190272+0000","last_undegraded":"2023-10-09T11:40:34.190272+0000","last_fullsized":"2023-10-09T11:40:34.190272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:30.346116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199570+0000","last_change":"2023-10-09T11:40:34.190715+0000","last_active":"2023-10-09T11:40:34.199570+0000","last_peered":"2023-10-09T11:40:34.199570+0000","last_clean":"2023-10-09T11:40:34.199570+0000","last_became_active":"2023-10-09T11:40:34.190454+0000","last_became_peered":"2023-10-09T11:40:34.190454+0000","last_unstale":"2023-10-09T11:40:34.199570+0000","last_undegraded":"2023-10-09T11:40:34.199570+0000","last_fullsized":"2023-10-09T11:40:34.199570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:53.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196811+0000","last_change":"2023-10-09T11:40:34.194255+0000","last_active":"2023-10-09T11:40:34.196811+0000","last_peered":"2023-10-09T11:40:34.196811+0000","last_clean":"2023-10-09T11:40:34.196811+0000","last_became_active":"2023-10-09T11:40:34.193960+0000","last_became_peered":"2023-10-09T11:40:34.193960+0000","last_unstale":"2023-10-09T11:40:34.196811+0000","last_undegraded":"2023-10-09T11:40:34.196811+0000","last_fullsized":"2023-10-09T11:40:34.196811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:36.091734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.201361+0000","last_change":"2023-10-09T11:40:34.198434+0000","last_active":"2023-10-09T11:40:34.201361+0000","last_peered":"2023-10-09T11:40:34.201361+0000","last_clean":"2023-10-09T11:40:34.201361+0000","last_became_active":"2023-10-09T11:40:34.197524+0000","last_became_peered":"2023-10-09T11:40:34.197524+0000","last_unstale":"2023-10-09T11:40:34.201361+0000","last_undegraded":"2023-10-09T11:40:34.201361+0000","last_fullsized":"2023-10-09T11:40:34.201361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:19.800373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.386146+0000","last_change":"2023-10-09T11:40:33.390205+0000","last_active":"2023-10-09T11:40:34.386146+0000","last_peered":"2023-10-09T11:40:34.386146+0000","last_clean":"2023-10-09T11:40:34.386146+0000","last_became_active":"2023-10-09T11:40:33.389848+0000","last_became_peered":"2023-10-09T11:40:33.389848+0000","last_unstale":"2023-10-09T11:40:34.386146+0000","last_undegraded":"2023-10-09T11:40:34.386146+0000","last_fullsized":"2023-10-09T11:40:34.386146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:06.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203487+0000","last_change":"2023-10-09T11:40:34.197111+0000","last_active":"2023-10-09T11:40:34.203487+0000","last_peered":"2023-10-09T11:40:34.203487+0000","last_clean":"2023-10-09T11:40:34.203487+0000","last_became_active":"2023-10-09T11:40:34.195643+0000","last_became_peered":"2023-10-09T11:40:34.195643+0000","last_unstale":"2023-10-09T11:40:34.203487+0000","last_undegraded":"2023-10-09T11:40:34.203487+0000","last_fullsized":"2023-10-09T11:40:34.203487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:28.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381472+0000","last_change":"2023-10-09T11:40:33.392564+0000","last_active":"2023-10-09T11:40:34.381472+0000","last_peered":"2023-10-09T11:40:34.381472+0000","last_clean":"2023-10-09T11:40:34.381472+0000","last_became_active":"2023-10-09T11:40:33.392249+0000","last_became_peered":"2023-10-09T11:40:33.392249+0000","last_unstale":"2023-10-09T11:40:34.381472+0000","last_undegraded":"2023-10-09T11:40:34.381472+0000","last_fullsized":"2023-10-09T11:40:34.381472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:04.922660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203727+0000","last_change":"2023-10-09T11:40:34.198615+0000","last_active":"2023-10-09T11:40:34.203727+0000","last_peered":"2023-10-09T11:40:34.203727+0000","last_clean":"2023-10-09T11:40:34.203727+0000","last_became_active":"2023-10-09T11:40:34.198331+0000","last_became_peered":"2023-10-09T11:40:34.198331+0000","last_unstale":"2023-10-09T11:40:34.203727+0000","last_undegraded":"2023-10-09T11:40:34.203727+0000","last_fullsized":"2023-10-09T11:40:34.203727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:07.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.384075+0000","last_change":"2023-10-09T11:40:33.386078+0000","last_active":"2023-10-09T11:40:34.384075+0000","last_peered":"2023-10-09T11:40:34.384075+0000","last_clean":"2023-10-09T11:40:34.384075+0000","last_became_active":"2023-10-09T11:40:33.385578+0000","last_became_peered":"2023-10-09T11:40:33.385578+0000","last_unstale":"2023-10-09T11:40:34.384075+0000","last_undegraded":"2023-10-09T11:40:34.384075+0000","last_fullsized":"2023-10-09T11:40:34.384075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:06.464070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203725+0000","last_change":"2023-10-09T11:40:34.198214+0000","last_active":"2023-10-09T11:40:34.203725+0000","last_peered":"2023-10-09T11:40:34.203725+0000","last_clean":"2023-10-09T11:40:34.203725+0000","last_became_active":"2023-10-09T11:40:34.196775+0000","last_became_peered":"2023-10-09T11:40:34.196775+0000","last_unstale":"2023-10-09T11:40:34.203725+0000","last_undegraded":"2023-10-09T11:40:34.203725+0000","last_fullsized":"2023-10-09T11:40:34.203725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:55.122157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.384064+0000","last_change":"2023-10-09T11:40:33.391846+0000","last_active":"2023-10-09T11:40:34.384064+0000","last_peered":"2023-10-09T11:40:34.384064+0000","last_clean":"2023-10-09T11:40:34.384064+0000","last_became_active":"2023-10-09T11:40:33.391325+0000","last_became_peered":"2023-10-09T11:40:33.391325+0000","last_unstale":"2023-10-09T11:40:34.384064+0000","last_undegraded":"2023-10-09T11:40:34.384064+0000","last_fullsized":"2023-10-09T11:40:34.384064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:51.789471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190078+0000","last_change":"2023-10-09T11:40:34.190078+0000","last_active":"2023-10-09T11:40:34.190078+0000","last_peered":"2023-10-09T11:40:34.190078+0000","last_clean":"2023-10-09T11:40:34.190078+0000","last_became_active":"2023-10-09T11:40:34.189761+0000","last_became_peered":"2023-10-09T11:40:34.189761+0000","last_unstale":"2023-10-09T11:40:34.190078+0000","last_undegraded":"2023-10-09T11:40:34.190078+0000","last_fullsized":"2023-10-09T11:40:34.190078+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:42.759214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381391+0000","last_change":"2023-10-09T11:40:33.392523+0000","last_active":"2023-10-09T11:40:34.381391+0000","last_peered":"2023-10-09T11:40:34.381391+0000","last_clean":"2023-10-09T11:40:34.381391+0000","last_became_active":"2023-10-09T11:40:33.392198+0000","last_became_peered":"2023-10-09T11:40:33.392198+0000","last_unstale":"2023-10-09T11:40:34.381391+0000","last_undegraded":"2023-10-09T11:40:34.381391+0000","last_fullsized":"2023-10-09T11:40:34.381391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:06.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193289+0000","last_change":"2023-10-09T11:40:34.187573+0000","last_active":"2023-10-09T11:40:34.193289+0000","last_peered":"2023-10-09T11:40:34.193289+0000","last_clean":"2023-10-09T11:40:34.193289+0000","last_became_active":"2023-10-09T11:40:34.187234+0000","last_became_peered":"2023-10-09T11:40:34.187234+0000","last_unstale":"2023-10-09T11:40:34.193289+0000","last_undegraded":"2023-10-09T11:40:34.193289+0000","last_fullsized":"2023-10-09T11:40:34.193289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:47.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381317+0000","last_change":"2023-10-09T11:40:33.392596+0000","last_active":"2023-10-09T11:40:34.381317+0000","last_peered":"2023-10-09T11:40:34.381317+0000","last_clean":"2023-10-09T11:40:34.381317+0000","last_became_active":"2023-10-09T11:40:33.392301+0000","last_became_peered":"2023-10-09T11:40:33.392301+0000","last_unstale":"2023-10-09T11:40:34.381317+0000","last_undegraded":"2023-10-09T11:40:34.381317+0000","last_fullsized":"2023-10-09T11:40:34.381317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:21.508695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203594+0000","last_change":"2023-10-09T11:40:34.197541+0000","last_active":"2023-10-09T11:40:34.203594+0000","last_peered":"2023-10-09T11:40:34.203594+0000","last_clean":"2023-10-09T11:40:34.203594+0000","last_became_active":"2023-10-09T11:40:34.197265+0000","last_became_peered":"2023-10-09T11:40:34.197265+0000","last_unstale":"2023-10-09T11:40:34.203594+0000","last_undegraded":"2023-10-09T11:40:34.203594+0000","last_fullsized":"2023-10-09T11:40:34.203594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:07.898484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391380+0000","last_change":"2023-10-09T11:40:33.385116+0000","last_active":"2023-10-09T11:40:33.391380+0000","last_peered":"2023-10-09T11:40:33.391380+0000","last_clean":"2023-10-09T11:40:33.391380+0000","last_became_active":"2023-10-09T11:40:33.384836+0000","last_became_peered":"2023-10-09T11:40:33.384836+0000","last_unstale":"2023-10-09T11:40:33.391380+0000","last_undegraded":"2023-10-09T11:40:33.391380+0000","last_fullsized":"2023-10-09T11:40:33.391380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:32.552658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195259+0000","last_change":"2023-10-09T11:40:34.195259+0000","last_active":"2023-10-09T11:40:34.195259+0000","last_peered":"2023-10-09T11:40:34.195259+0000","last_clean":"2023-10-09T11:40:34.195259+0000","last_became_active":"2023-10-09T11:40:34.194643+0000","last_became_peered":"2023-10-09T11:40:34.194643+0000","last_unstale":"2023-10-09T11:40:34.195259+0000","last_undegraded":"2023-10-09T11:40:34.195259+0000","last_fullsized":"2023-10-09T11:40:34.195259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:42.198572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.395558+0000","last_change":"2023-10-09T11:40:33.395256+0000","last_active":"2023-10-09T11:40:33.395558+0000","last_peered":"2023-10-09T11:40:33.395558+0000","last_clean":"2023-10-09T11:40:33.395558+0000","last_became_active":"2023-10-09T11:40:33.394965+0000","last_became_peered":"2023-10-09T11:40:33.394965+0000","last_unstale":"2023-10-09T11:40:33.395558+0000","last_undegraded":"2023-10-09T11:40:33.395558+0000","last_fullsized":"2023-10-09T11:40:33.395558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196992+0000","last_change":"2023-10-09T11:40:34.196992+0000","last_active":"2023-10-09T11:40:34.196992+0000","last_peered":"2023-10-09T11:40:34.196992+0000","last_clean":"2023-10-09T11:40:34.196992+0000","last_became_active":"2023-10-09T11:40:34.196736+0000","last_became_peered":"2023-10-09T11:40:34.196736+0000","last_unstale":"2023-10-09T11:40:34.196992+0000","last_undegraded":"2023-10-09T11:40:34.196992+0000","last_fullsized":"2023-10-09T11:40:34.196992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:17.891769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.184775+0000","last_change":"2023-10-09T11:40:33.382907+0000","last_active":"2023-10-09T11:40:34.184775+0000","last_peered":"2023-10-09T11:40:34.184775+0000","last_clean":"2023-10-09T11:40:34.184775+0000","last_became_active":"2023-10-09T11:40:33.382601+0000","last_became_peered":"2023-10-09T11:40:33.382601+0000","last_unstale":"2023-10-09T11:40:34.184775+0000","last_undegraded":"2023-10-09T11:40:34.184775+0000","last_fullsized":"2023-10-09T11:40:34.184775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:13.124900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203291+0000","last_change":"2023-10-09T11:40:34.199356+0000","last_active":"2023-10-09T11:40:34.203291+0000","last_peered":"2023-10-09T11:40:34.203291+0000","last_clean":"2023-10-09T11:40:34.203291+0000","last_became_active":"2023-10-09T11:40:34.199001+0000","last_became_peered":"2023-10-09T11:40:34.199001+0000","last_unstale":"2023-10-09T11:40:34.203291+0000","last_undegraded":"2023-10-09T11:40:34.203291+0000","last_fullsized":"2023-10-09T11:40:34.203291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:56.429306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.183931+0000","last_change":"2023-10-09T11:40:33.392498+0000","last_active":"2023-10-09T11:40:34.183931+0000","last_peered":"2023-10-09T11:40:34.183931+0000","last_clean":"2023-10-09T11:40:34.183931+0000","last_became_active":"2023-10-09T11:40:33.392215+0000","last_became_peered":"2023-10-09T11:40:33.392215+0000","last_unstale":"2023-10-09T11:40:34.183931+0000","last_undegraded":"2023-10-09T11:40:34.183931+0000","last_fullsized":"2023-10-09T11:40:34.183931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.880652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194610+0000","last_change":"2023-10-09T11:40:34.194610+0000","last_active":"2023-10-09T11:40:34.194610+0000","last_peered":"2023-10-09T11:40:34.194610+0000","last_clean":"2023-10-09T11:40:34.194610+0000","last_became_active":"2023-10-09T11:40:34.194339+0000","last_became_peered":"2023-10-09T11:40:34.194339+0000","last_unstale":"2023-10-09T11:40:34.194610+0000","last_undegraded":"2023-10-09T11:40:34.194610+0000","last_fullsized":"2023-10-09T11:40:34.194610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:48.315919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385348+0000","last_change":"2023-10-09T11:40:33.389212+0000","last_active":"2023-10-09T11:40:34.385348+0000","last_peered":"2023-10-09T11:40:34.385348+0000","last_clean":"2023-10-09T11:40:34.385348+0000","last_became_active":"2023-10-09T11:40:33.388944+0000","last_became_peered":"2023-10-09T11:40:33.388944+0000","last_unstale":"2023-10-09T11:40:34.385348+0000","last_undegraded":"2023-10-09T11:40:34.385348+0000","last_fullsized":"2023-10-09T11:40:34.385348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:36.591920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199762+0000","last_change":"2023-10-09T11:40:34.191424+0000","last_active":"2023-10-09T11:40:34.199762+0000","last_peered":"2023-10-09T11:40:34.199762+0000","last_clean":"2023-10-09T11:40:34.199762+0000","last_became_active":"2023-10-09T11:40:34.191121+0000","last_became_peered":"2023-10-09T11:40:34.191121+0000","last_unstale":"2023-10-09T11:40:34.199762+0000","last_undegraded":"2023-10-09T11:40:34.199762+0000","last_fullsized":"2023-10-09T11:40:34.199762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:06.854823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.387588+0000","last_change":"2023-10-09T11:40:33.385174+0000","last_active":"2023-10-09T11:40:34.387588+0000","last_peered":"2023-10-09T11:40:34.387588+0000","last_clean":"2023-10-09T11:40:34.387588+0000","last_became_active":"2023-10-09T11:40:33.384549+0000","last_became_peered":"2023-10-09T11:40:33.384549+0000","last_unstale":"2023-10-09T11:40:34.387588+0000","last_undegraded":"2023-10-09T11:40:34.387588+0000","last_fullsized":"2023-10-09T11:40:34.387588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:26.162626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194503+0000","last_change":"2023-10-09T11:40:34.194503+0000","last_active":"2023-10-09T11:40:34.194503+0000","last_peered":"2023-10-09T11:40:34.194503+0000","last_clean":"2023-10-09T11:40:34.194503+0000","last_became_active":"2023-10-09T11:40:34.194221+0000","last_became_peered":"2023-10-09T11:40:34.194221+0000","last_unstale":"2023-10-09T11:40:34.194503+0000","last_undegraded":"2023-10-09T11:40:34.194503+0000","last_fullsized":"2023-10-09T11:40:34.194503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:01.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.382329+0000","last_change":"2023-10-09T11:40:33.392561+0000","last_active":"2023-10-09T11:40:34.382329+0000","last_peered":"2023-10-09T11:40:34.382329+0000","last_clean":"2023-10-09T11:40:34.382329+0000","last_became_active":"2023-10-09T11:40:33.392203+0000","last_became_peered":"2023-10-09T11:40:33.392203+0000","last_unstale":"2023-10-09T11:40:34.382329+0000","last_undegraded":"2023-10-09T11:40:34.382329+0000","last_fullsized":"2023-10-09T11:40:34.382329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:07.032783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203714+0000","last_change":"2023-10-09T11:40:34.197999+0000","last_active":"2023-10-09T11:40:34.203714+0000","last_peered":"2023-10-09T11:40:34.203714+0000","last_clean":"2023-10-09T11:40:34.203714+0000","last_became_active":"2023-10-09T11:40:34.196887+0000","last_became_peered":"2023-10-09T11:40:34.196887+0000","last_unstale":"2023-10-09T11:40:34.203714+0000","last_undegraded":"2023-10-09T11:40:34.203714+0000","last_fullsized":"2023-10-09T11:40:34.203714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:27.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391629+0000","last_change":"2023-10-09T11:40:33.389394+0000","last_active":"2023-10-09T11:40:33.391629+0000","last_peered":"2023-10-09T11:40:33.391629+0000","last_clean":"2023-10-09T11:40:33.391629+0000","last_became_active":"2023-10-09T11:40:33.389096+0000","last_became_peered":"2023-10-09T11:40:33.389096+0000","last_unstale":"2023-10-09T11:40:33.391629+0000","last_undegraded":"2023-10-09T11:40:33.391629+0000","last_fullsized":"2023-10-09T11:40:33.391629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:00.122341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.188827+0000","last_change":"2023-10-09T11:40:34.188827+0000","last_active":"2023-10-09T11:40:34.188827+0000","last_peered":"2023-10-09T11:40:34.188827+0000","last_clean":"2023-10-09T11:40:34.188827+0000","last_became_active":"2023-10-09T11:40:34.188573+0000","last_became_peered":"2023-10-09T11:40:34.188573+0000","last_unstale":"2023-10-09T11:40:34.188827+0000","last_undegraded":"2023-10-09T11:40:34.188827+0000","last_fullsized":"2023-10-09T11:40:34.188827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:28.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193129+0000","last_change":"2023-10-09T11:40:33.387430+0000","last_active":"2023-10-09T11:40:34.193129+0000","last_peered":"2023-10-09T11:40:34.193129+0000","last_clean":"2023-10-09T11:40:34.193129+0000","last_became_active":"2023-10-09T11:40:33.387101+0000","last_became_peered":"2023-10-09T11:40:33.387101+0000","last_unstale":"2023-10-09T11:40:34.193129+0000","last_undegraded":"2023-10-09T11:40:34.193129+0000","last_fullsized":"2023-10-09T11:40:34.193129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:46.669932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197683+0000","last_change":"2023-10-09T11:40:34.197683+0000","last_active":"2023-10-09T11:40:34.197683+0000","last_peered":"2023-10-09T11:40:34.197683+0000","last_clean":"2023-10-09T11:40:34.197683+0000","last_became_active":"2023-10-09T11:40:34.197381+0000","last_became_peered":"2023-10-09T11:40:34.197381+0000","last_unstale":"2023-10-09T11:40:34.197683+0000","last_undegraded":"2023-10-09T11:40:34.197683+0000","last_fullsized":"2023-10-09T11:40:34.197683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:37.036391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"76'8","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.386560+0000","last_change":"2023-10-09T11:40:33.386662+0000","last_active":"2023-10-09T11:40:34.386560+0000","last_peered":"2023-10-09T11:40:34.386560+0000","last_clean":"2023-10-09T11:40:34.386560+0000","last_became_active":"2023-10-09T11:40:33.386367+0000","last_became_peered":"2023-10-09T11:40:33.386367+0000","last_unstale":"2023-10-09T11:40:34.386560+0000","last_undegraded":"2023-10-09T11:40:34.386560+0000","last_fullsized":"2023-10-09T11:40:34.386560+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:55.424352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204293+0000","last_change":"2023-10-09T11:40:34.200895+0000","last_active":"2023-10-09T11:40:34.204293+0000","last_peered":"2023-10-09T11:40:34.204293+0000","last_clean":"2023-10-09T11:40:34.204293+0000","last_became_active":"2023-10-09T11:40:34.200588+0000","last_became_peered":"2023-10-09T11:40:34.200588+0000","last_unstale":"2023-10-09T11:40:34.204293+0000","last_undegraded":"2023-10-09T11:40:34.204293+0000","last_fullsized":"2023-10-09T11:40:34.204293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:57.457592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385993+0000","last_change":"2023-10-09T11:40:33.386094+0000","last_active":"2023-10-09T11:40:34.385993+0000","last_peered":"2023-10-09T11:40:34.385993+0000","last_clean":"2023-10-09T11:40:34.385993+0000","last_became_active":"2023-10-09T11:40:33.385791+0000","last_became_peered":"2023-10-09T11:40:33.385791+0000","last_unstale":"2023-10-09T11:40:34.385993+0000","last_undegraded":"2023-10-09T11:40:34.385993+0000","last_fullsized":"2023-10-09T11:40:34.385993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:21.508695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203528+0000","last_change":"2023-10-09T11:40:34.197478+0000","last_active":"2023-10-09T11:40:34.203528+0000","last_peered":"2023-10-09T11:40:34.203528+0000","last_clean":"2023-10-09T11:40:34.203528+0000","last_became_active":"2023-10-09T11:40:34.196852+0000","last_became_peered":"2023-10-09T11:40:34.196852+0000","last_unstale":"2023-10-09T11:40:34.203528+0000","last_undegraded":"2023-10-09T11:40:34.203528+0000","last_fullsized":"2023-10-09T11:40:34.203528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.060244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385901+0000","last_change":"2023-10-09T11:40:33.388989+0000","last_active":"2023-10-09T11:40:34.385901+0000","last_peered":"2023-10-09T11:40:34.385901+0000","last_clean":"2023-10-09T11:40:34.385901+0000","last_became_active":"2023-10-09T11:40:33.388706+0000","last_became_peered":"2023-10-09T11:40:33.388706+0000","last_unstale":"2023-10-09T11:40:34.385901+0000","last_undegraded":"2023-10-09T11:40:34.385901+0000","last_fullsized":"2023-10-09T11:40:34.385901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:39.227147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.201056+0000","last_change":"2023-10-09T11:40:34.195110+0000","last_active":"2023-10-09T11:40:34.201056+0000","last_peered":"2023-10-09T11:40:34.201056+0000","last_clean":"2023-10-09T11:40:34.201056+0000","last_became_active":"2023-10-09T11:40:34.194799+0000","last_became_peered":"2023-10-09T11:40:34.194799+0000","last_unstale":"2023-10-09T11:40:34.201056+0000","last_undegraded":"2023-10-09T11:40:34.201056+0000","last_fullsized":"2023-10-09T11:40:34.201056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391961+0000","last_change":"2023-10-09T11:40:33.386587+0000","last_active":"2023-10-09T11:40:33.391961+0000","last_peered":"2023-10-09T11:40:33.391961+0000","last_clean":"2023-10-09T11:40:33.391961+0000","last_became_active":"2023-10-09T11:40:33.386275+0000","last_became_peered":"2023-10-09T11:40:33.386275+0000","last_unstale":"2023-10-09T11:40:33.391961+0000","last_undegraded":"2023-10-09T11:40:33.391961+0000","last_fullsized":"2023-10-09T11:40:33.391961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:29.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193242+0000","last_change":"2023-10-09T11:40:34.193242+0000","last_active":"2023-10-09T11:40:34.193242+0000","last_peered":"2023-10-09T11:40:34.193242+0000","last_clean":"2023-10-09T11:40:34.193242+0000","last_became_active":"2023-10-09T11:40:34.192499+0000","last_became_peered":"2023-10-09T11:40:34.192499+0000","last_unstale":"2023-10-09T11:40:34.193242+0000","last_undegraded":"2023-10-09T11:40:34.193242+0000","last_fullsized":"2023-10-09T11:40:34.193242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:18.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383499+0000","last_change":"2023-10-09T11:40:33.378383+0000","last_active":"2023-10-09T11:40:34.383499+0000","last_peered":"2023-10-09T11:40:34.383499+0000","last_clean":"2023-10-09T11:40:34.383499+0000","last_became_active":"2023-10-09T11:40:33.377854+0000","last_became_peered":"2023-10-09T11:40:33.377854+0000","last_unstale":"2023-10-09T11:40:34.383499+0000","last_undegraded":"2023-10-09T11:40:34.383499+0000","last_fullsized":"2023-10-09T11:40:34.383499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:47.310964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203460+0000","last_change":"2023-10-09T11:40:34.199992+0000","last_active":"2023-10-09T11:40:34.203460+0000","last_peered":"2023-10-09T11:40:34.203460+0000","last_clean":"2023-10-09T11:40:34.203460+0000","last_became_active":"2023-10-09T11:40:34.199674+0000","last_became_peered":"2023-10-09T11:40:34.199674+0000","last_unstale":"2023-10-09T11:40:34.203460+0000","last_undegraded":"2023-10-09T11:40:34.203460+0000","last_fullsized":"2023-10-09T11:40:34.203460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.794426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.393375+0000","last_change":"2023-10-09T11:40:33.391319+0000","last_active":"2023-10-09T11:40:33.393375+0000","last_peered":"2023-10-09T11:40:33.393375+0000","last_clean":"2023-10-09T11:40:33.393375+0000","last_became_active":"2023-10-09T11:40:33.391057+0000","last_became_peered":"2023-10-09T11:40:33.391057+0000","last_unstale":"2023-10-09T11:40:33.393375+0000","last_undegraded":"2023-10-09T11:40:33.393375+0000","last_fullsized":"2023-10-09T11:40:33.393375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:55.828733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200649+0000","last_change":"2023-10-09T11:40:34.200649+0000","last_active":"2023-10-09T11:40:34.200649+0000","last_peered":"2023-10-09T11:40:34.200649+0000","last_clean":"2023-10-09T11:40:34.200649+0000","last_became_active":"2023-10-09T11:40:34.200384+0000","last_became_peered":"2023-10-09T11:40:34.200384+0000","last_unstale":"2023-10-09T11:40:34.200649+0000","last_undegraded":"2023-10-09T11:40:34.200649+0000","last_fullsized":"2023-10-09T11:40:34.200649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:45.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.390148+0000","last_change":"2023-10-09T11:40:33.385243+0000","last_active":"2023-10-09T11:40:33.390148+0000","last_peered":"2023-10-09T11:40:33.390148+0000","last_clean":"2023-10-09T11:40:33.390148+0000","last_became_active":"2023-10-09T11:40:33.384932+0000","last_became_peered":"2023-10-09T11:40:33.384932+0000","last_unstale":"2023-10-09T11:40:33.390148+0000","last_undegraded":"2023-10-09T11:40:33.390148+0000","last_fullsized":"2023-10-09T11:40:33.390148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:06.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204094+0000","last_change":"2023-10-09T11:40:34.202084+0000","last_active":"2023-10-09T11:40:34.204094+0000","last_peered":"2023-10-09T11:40:34.204094+0000","last_clean":"2023-10-09T11:40:34.204094+0000","last_became_active":"2023-10-09T11:40:34.199529+0000","last_became_peered":"2023-10-09T11:40:34.199529+0000","last_unstale":"2023-10-09T11:40:34.204094+0000","last_undegraded":"2023-10-09T11:40:34.204094+0000","last_fullsized":"2023-10-09T11:40:34.204094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.380862+0000","last_change":"2023-10-09T11:40:33.380116+0000","last_active":"2023-10-09T11:40:33.380862+0000","last_peered":"2023-10-09T11:40:33.380862+0000","last_clean":"2023-10-09T11:40:33.380862+0000","last_became_active":"2023-10-09T11:40:33.379746+0000","last_became_peered":"2023-10-09T11:40:33.379746+0000","last_unstale":"2023-10-09T11:40:33.380862+0000","last_undegraded":"2023-10-09T11:40:33.380862+0000","last_fullsized":"2023-10-09T11:40:33.380862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:26.742390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203940+0000","last_change":"2023-10-09T11:40:34.202255+0000","last_active":"2023-10-09T11:40:34.203940+0000","last_peered":"2023-10-09T11:40:34.203940+0000","last_clean":"2023-10-09T11:40:34.203940+0000","last_became_active":"2023-10-09T11:40:34.201974+0000","last_became_peered":"2023-10-09T11:40:34.201974+0000","last_unstale":"2023-10-09T11:40:34.203940+0000","last_undegraded":"2023-10-09T11:40:34.203940+0000","last_fullsized":"2023-10-09T11:40:34.203940+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:51.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383503+0000","last_change":"2023-10-09T11:40:33.389065+0000","last_active":"2023-10-09T11:40:34.383503+0000","last_peered":"2023-10-09T11:40:34.383503+0000","last_clean":"2023-10-09T11:40:34.383503+0000","last_became_active":"2023-10-09T11:40:33.387917+0000","last_became_peered":"2023-10-09T11:40:33.387917+0000","last_unstale":"2023-10-09T11:40:34.383503+0000","last_undegraded":"2023-10-09T11:40:34.383503+0000","last_fullsized":"2023-10-09T11:40:34.383503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:03.156273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204639+0000","last_change":"2023-10-09T11:40:34.204115+0000","last_active":"2023-10-09T11:40:34.204639+0000","last_peered":"2023-10-09T11:40:34.204639+0000","last_clean":"2023-10-09T11:40:34.204639+0000","last_became_active":"2023-10-09T11:40:34.203861+0000","last_became_peered":"2023-10-09T11:40:34.203861+0000","last_unstale":"2023-10-09T11:40:34.204639+0000","last_undegraded":"2023-10-09T11:40:34.204639+0000","last_fullsized":"2023-10-09T11:40:34.204639+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:45.295387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.393239+0000","last_change":"2023-10-09T11:40:33.392696+0000","last_active":"2023-10-09T11:40:33.393239+0000","last_peered":"2023-10-09T11:40:33.393239+0000","last_clean":"2023-10-09T11:40:33.393239+0000","last_became_active":"2023-10-09T11:40:33.392449+0000","last_became_peered":"2023-10-09T11:40:33.392449+0000","last_unstale":"2023-10-09T11:40:33.393239+0000","last_undegraded":"2023-10-09T11:40:33.393239+0000","last_fullsized":"2023-10-09T11:40:33.393239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:17.135642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196304+0000","last_change":"2023-10-09T11:40:34.189813+0000","last_active":"2023-10-09T11:40:34.196304+0000","last_peered":"2023-10-09T11:40:34.196304+0000","last_clean":"2023-10-09T11:40:34.196304+0000","last_became_active":"2023-10-09T11:40:34.189516+0000","last_became_peered":"2023-10-09T11:40:34.189516+0000","last_unstale":"2023-10-09T11:40:34.196304+0000","last_undegraded":"2023-10-09T11:40:34.196304+0000","last_fullsized":"2023-10-09T11:40:34.196304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:19.800373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.182557+0000","last_change":"2023-10-09T11:40:33.383135+0000","last_active":"2023-10-09T11:40:34.182557+0000","last_peered":"2023-10-09T11:40:34.182557+0000","last_clean":"2023-10-09T11:40:34.182557+0000","last_became_active":"2023-10-09T11:40:33.382306+0000","last_became_peered":"2023-10-09T11:40:33.382306+0000","last_unstale":"2023-10-09T11:40:34.182557+0000","last_undegraded":"2023-10-09T11:40:34.182557+0000","last_fullsized":"2023-10-09T11:40:34.182557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:32.424849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199740+0000","last_change":"2023-10-09T11:40:34.189167+0000","last_active":"2023-10-09T11:40:34.199740+0000","last_peered":"2023-10-09T11:40:34.199740+0000","last_clean":"2023-10-09T11:40:34.199740+0000","last_became_active":"2023-10-09T11:40:34.188576+0000","last_became_peered":"2023-10-09T11:40:34.188576+0000","last_unstale":"2023-10-09T11:40:34.199740+0000","last_undegraded":"2023-10-09T11:40:34.199740+0000","last_fullsized":"2023-10-09T11:40:34.199740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.060244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.185473+0000","last_change":"2023-10-09T11:40:33.381484+0000","last_active":"2023-10-09T11:40:34.185473+0000","last_peered":"2023-10-09T11:40:34.185473+0000","last_clean":"2023-10-09T11:40:34.185473+0000","last_became_active":"2023-10-09T11:40:33.381199+0000","last_became_peered":"2023-10-09T11:40:33.381199+0000","last_unstale":"2023-10-09T11:40:34.185473+0000","last_undegraded":"2023-10-09T11:40:34.185473+0000","last_fullsized":"2023-10-09T11:40:34.185473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:04.922660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203312+0000","last_change":"2023-10-09T11:40:34.199515+0000","last_active":"2023-10-09T11:40:34.203312+0000","last_peered":"2023-10-09T11:40:34.203312+0000","last_clean":"2023-10-09T11:40:34.203312+0000","last_became_active":"2023-10-09T11:40:34.198914+0000","last_became_peered":"2023-10-09T11:40:34.198914+0000","last_unstale":"2023-10-09T11:40:34.203312+0000","last_undegraded":"2023-10-09T11:40:34.203312+0000","last_fullsized":"2023-10-09T11:40:34.203312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:40.232101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.392882+0000","last_change":"2023-10-09T11:40:33.387115+0000","last_active":"2023-10-09T11:40:33.392882+0000","last_peered":"2023-10-09T11:40:33.392882+0000","last_clean":"2023-10-09T11:40:33.392882+0000","last_became_active":"2023-10-09T11:40:33.386854+0000","last_became_peered":"2023-10-09T11:40:33.386854+0000","last_unstale":"2023-10-09T11:40:33.392882+0000","last_undegraded":"2023-10-09T11:40:33.392882+0000","last_fullsized":"2023-10-09T11:40:33.392882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:11.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194694+0000","last_change":"2023-10-09T11:40:34.194694+0000","last_active":"2023-10-09T11:40:34.194694+0000","last_peered":"2023-10-09T11:40:34.194694+0000","last_clean":"2023-10-09T11:40:34.194694+0000","last_became_active":"2023-10-09T11:40:34.194421+0000","last_became_peered":"2023-10-09T11:40:34.194421+0000","last_unstale":"2023-10-09T11:40:34.194694+0000","last_undegraded":"2023-10-09T11:40:34.194694+0000","last_fullsized":"2023-10-09T11:40:34.194694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:27.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.182908+0000","last_change":"2023-10-09T11:40:33.392502+0000","last_active":"2023-10-09T11:40:34.182908+0000","last_peered":"2023-10-09T11:40:34.182908+0000","last_clean":"2023-10-09T11:40:34.182908+0000","last_became_active":"2023-10-09T11:40:33.392217+0000","last_became_peered":"2023-10-09T11:40:33.392217+0000","last_unstale":"2023-10-09T11:40:34.182908+0000","last_undegraded":"2023-10-09T11:40:34.182908+0000","last_fullsized":"2023-10-09T11:40:34.182908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:13.124900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203614+0000","last_change":"2023-10-09T11:40:34.197640+0000","last_active":"2023-10-09T11:40:34.203614+0000","last_peered":"2023-10-09T11:40:34.203614+0000","last_clean":"2023-10-09T11:40:34.203614+0000","last_became_active":"2023-10-09T11:40:34.196931+0000","last_became_peered":"2023-10-09T11:40:34.196931+0000","last_unstale":"2023-10-09T11:40:34.203614+0000","last_undegraded":"2023-10-09T11:40:34.203614+0000","last_fullsized":"2023-10-09T11:40:34.203614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:01.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.185530+0000","last_change":"2023-10-09T11:40:33.382752+0000","last_active":"2023-10-09T11:40:34.185530+0000","last_peered":"2023-10-09T11:40:34.185530+0000","last_clean":"2023-10-09T11:40:34.185530+0000","last_became_active":"2023-10-09T11:40:33.382272+0000","last_became_peered":"2023-10-09T11:40:33.382272+0000","last_unstale":"2023-10-09T11:40:34.185530+0000","last_undegraded":"2023-10-09T11:40:34.185530+0000","last_fullsized":"2023-10-09T11:40:34.185530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:21.321975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196271+0000","last_change":"2023-10-09T11:40:34.189625+0000","last_active":"2023-10-09T11:40:34.196271+0000","last_peered":"2023-10-09T11:40:34.196271+0000","last_clean":"2023-10-09T11:40:34.196271+0000","last_became_active":"2023-10-09T11:40:34.189340+0000","last_became_peered":"2023-10-09T11:40:34.189340+0000","last_unstale":"2023-10-09T11:40:34.196271+0000","last_undegraded":"2023-10-09T11:40:34.196271+0000","last_fullsized":"2023-10-09T11:40:34.196271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:51.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.184555+0000","last_change":"2023-10-09T11:40:33.390817+0000","last_active":"2023-10-09T11:40:34.184555+0000","last_peered":"2023-10-09T11:40:34.184555+0000","last_clean":"2023-10-09T11:40:34.184555+0000","last_became_active":"2023-10-09T11:40:33.390533+0000","last_became_peered":"2023-10-09T11:40:33.390533+0000","last_unstale":"2023-10-09T11:40:34.184555+0000","last_undegraded":"2023-10-09T11:40:34.184555+0000","last_fullsized":"2023-10-09T11:40:34.184555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:21.321975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200456+0000","last_change":"2023-10-09T11:40:34.200456+0000","last_active":"2023-10-09T11:40:34.200456+0000","last_peered":"2023-10-09T11:40:34.200456+0000","last_clean":"2023-10-09T11:40:34.200456+0000","last_became_active":"2023-10-09T11:40:34.199791+0000","last_became_peered":"2023-10-09T11:40:34.199791+0000","last_unstale":"2023-10-09T11:40:34.200456+0000","last_undegraded":"2023-10-09T11:40:34.200456+0000","last_fullsized":"2023-10-09T11:40:34.200456+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:22.513649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383345+0000","last_change":"2023-10-09T11:40:33.384956+0000","last_active":"2023-10-09T11:40:34.383345+0000","last_peered":"2023-10-09T11:40:34.383345+0000","last_clean":"2023-10-09T11:40:34.383345+0000","last_became_active":"2023-10-09T11:40:33.384623+0000","last_became_peered":"2023-10-09T11:40:33.384623+0000","last_unstale":"2023-10-09T11:40:34.383345+0000","last_undegraded":"2023-10-09T11:40:34.383345+0000","last_fullsized":"2023-10-09T11:40:34.383345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:57.708188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.191653+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:34.191653+0000","last_peered":"2023-10-09T11:40:34.191653+0000","last_clean":"2023-10-09T11:40:34.191653+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:34.191653+0000","last_undegraded":"2023-10-09T11:40:34.191653+0000","last_fullsized":"2023-10-09T11:40:34.191653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073048,"statfs":{"total":96636764160,"available":96330801152,"internally_reserved":0,"allocated":1540096,"data_stored":994894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.747},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.59099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":405122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.436},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.496}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":398362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.314}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.38}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.42799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":988570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.38900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.59399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":933888,"data_stored":398722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.436},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.496}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":399704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.52000000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542215,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":404456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.89200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542215,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:40:38.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.648+0000 7f0902e73700 1 Processor -- start 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.648+0000 7f0902e73700 1 -- start start 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0902e73700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0cb5a0 0x7f08fc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0902e73700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc0cd9e0 0x7f08fc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0902e73700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc15ae40 con 0x7f08fc0cde50 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0902e73700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0d13f0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0902e73700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15ab60 con 0x7f08fc0cb5a0 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc0cd9e0 0x7f08fc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0901410700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f08fc0cde50 0x7f08fc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40632/0 (socket says 172.21.15.26:40632) 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc0cd9e0 0x7f08fc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45144/0 (socket says 172.21.15.26:45144) 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0901410700 1 -- 172.21.15.26:0/3434491347 learned_addr learned my addr 172.21.15.26:0/3434491347 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f0900c0f700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0cb5a0 0x7f08fc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 -- 172.21.15.26:0/3434491347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0cb5a0 msgr2=0x7f08fc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0cb5a0 0x7f08fc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 -- 172.21.15.26:0/3434491347 >> v1:172.21.15.26:6789/0 conn(0x7f08fc0cde50 legacy=0x7f08fc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 -- 172.21.15.26:0/3434491347 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0ccf00 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fb7fe700 1 -- 172.21.15.26:0/3434491347 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163606830 0 0) 0x7f08fc15ae40 con 0x7f08fc0cde50 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fbfff700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc159ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098e0 tx=0x7f08e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b348e61920d41351 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fb7fe700 1 -- 172.21.15.26:0/3434491347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4009e80 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fb7fe700 1 -- 172.21.15.26:0/3434491347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400b860 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.649+0000 7f08fb7fe700 1 -- 172.21.15.26:0/3434491347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bbe0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 -- 172.21.15.26:0/3434491347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 msgr2=0x7f08fc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc159ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098e0 tx=0x7f08e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 -- 172.21.15.26:0/3434491347 shutdown_connections 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0cb5a0 0x7f08fc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 --2- 172.21.15.26:0/3434491347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc159ec0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 -- 172.21.15.26:0/3434491347 >> 172.21.15.26:0/3434491347 conn(0x7f08fc070e30 msgr2=0x7f08fc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 -- 172.21.15.26:0/3434491347 shutdown_connections 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.650+0000 7f0902e73700 1 -- 172.21.15.26:0/3434491347 wait complete. 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.651+0000 7f0902e73700 1 Processor -- start 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.651+0000 7f0902e73700 1 -- start start 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 0x7f08fc156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0ca000 0x7f08fc0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0b5320 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0b4710 con 0x7f08fc0cb5a0 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0902e73700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0b49f0 con 0x7f08fc0ca000 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45146/0 (socket says 172.21.15.26:45146) 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 -- 172.21.15.26:0/3728683406 learned_addr learned my addr 172.21.15.26:0/3728683406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0901410700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0ca000 0x7f08fc0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0900c0f700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 0x7f08fc156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 -- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0ca000 msgr2=0x7f08fc0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0ca000 0x7f08fc0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 -- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 msgr2=0x7f08fc156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 0x7f08fc156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f08fbfff700 1 -- 172.21.15.26:0/3728683406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009420 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.652+0000 7f0900c0f700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 0x7f08fc156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f08fbfff700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f08fc06ea60 tx=0x7f08e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bbe0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4011420 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40117e0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc0b4cd0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.653+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc156740 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.654+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc04c3c0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.654+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f08e4011bd0 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.655+0000 7f08f8ff9700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 0x7f08dc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.655+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08e4086170 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.655+0000 7f0900c0f700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 0x7f08dc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.655+0000 7f0900c0f700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 0x7f08dc069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08f40075e0 tx=0x7f08f40097e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.659+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e4053150 con 0x7f08fc0cd9e0 2023-10-09T11:40:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.851+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08fc0cd1e0 con 0x7f08dc067170 2023-10-09T11:40:38.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.860+0000 7f08f8ff9700 1 -- 172.21.15.26:0/3728683406 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289066 (secure 0 0 0) 0x7f08fc0cd1e0 con 0x7f08dc067170 2023-10-09T11:40:38.861 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 msgr2=0x7f08dc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 0x7f08dc069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08f40075e0 tx=0x7f08f40097e0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 msgr2=0x7f08fc0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f08fc06ea60 tx=0x7f08e4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 shutdown_connections 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08dc067170 0x7f08dc069620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08fc0ca000 0x7f08fc0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc0cb5a0 0x7f08fc156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 --2- 172.21.15.26:0/3728683406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc0cd9e0 0x7f08fc0c9ac0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 >> 172.21.15.26:0/3728683406 conn(0x7f08fc070e30 msgr2=0x7f08fc0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 shutdown_connections 2023-10-09T11:40:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:38.863+0000 7f0902e73700 1 -- 172.21.15.26:0/3728683406 wait complete. 2023-10-09T11:40:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:40:38.876 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-10-09T11:40:37.182484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403224,"kb_used_data":8536,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571496,"statfs":{"total":773094113280,"available":770633211904,"internally_reserved":0,"allocated":8740864,"data_stored":4395844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.814893"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203508+0000","last_change":"2023-10-09T11:40:34.197305+0000","last_active":"2023-10-09T11:40:34.203508+0000","last_peered":"2023-10-09T11:40:34.203508+0000","last_clean":"2023-10-09T11:40:34.203508+0000","last_became_active":"2023-10-09T11:40:34.196502+0000","last_became_peered":"2023-10-09T11:40:34.196502+0000","last_unstale":"2023-10-09T11:40:34.203508+0000","last_undegraded":"2023-10-09T11:40:34.203508+0000","last_fullsized":"2023-10-09T11:40:34.203508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196805+0000","last_change":"2023-10-09T11:40:34.196805+0000","last_active":"2023-10-09T11:40:34.196805+0000","last_peered":"2023-10-09T11:40:34.196805+0000","last_clean":"2023-10-09T11:40:34.196805+0000","last_became_active":"2023-10-09T11:40:34.196184+0000","last_became_peered":"2023-10-09T11:40:34.196184+0000","last_unstale":"2023-10-09T11:40:34.196805+0000","last_undegraded":"2023-10-09T11:40:34.196805+0000","last_fullsized":"2023-10-09T11:40:34.196805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:13.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204253+0000","last_change":"2023-10-09T11:40:34.199185+0000","last_active":"2023-10-09T11:40:34.204253+0000","last_peered":"2023-10-09T11:40:34.204253+0000","last_clean":"2023-10-09T11:40:34.204253+0000","last_became_active":"2023-10-09T11:40:34.198886+0000","last_became_peered":"2023-10-09T11:40:34.198886+0000","last_unstale":"2023-10-09T11:40:34.204253+0000","last_undegraded":"2023-10-09T11:40:34.204253+0000","last_fullsized":"2023-10-09T11:40:34.204253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:27.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192521+0000","last_change":"2023-10-09T11:40:34.192521+0000","last_active":"2023-10-09T11:40:34.192521+0000","last_peered":"2023-10-09T11:40:34.192521+0000","last_clean":"2023-10-09T11:40:34.192521+0000","last_became_active":"2023-10-09T11:40:34.192070+0000","last_became_peered":"2023-10-09T11:40:34.192070+0000","last_unstale":"2023-10-09T11:40:34.192521+0000","last_undegraded":"2023-10-09T11:40:34.192521+0000","last_fullsized":"2023-10-09T11:40:34.192521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:39.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200836+0000","last_change":"2023-10-09T11:40:34.194675+0000","last_active":"2023-10-09T11:40:34.200836+0000","last_peered":"2023-10-09T11:40:34.200836+0000","last_clean":"2023-10-09T11:40:34.200836+0000","last_became_active":"2023-10-09T11:40:34.194385+0000","last_became_peered":"2023-10-09T11:40:34.194385+0000","last_unstale":"2023-10-09T11:40:34.200836+0000","last_undegraded":"2023-10-09T11:40:34.200836+0000","last_fullsized":"2023-10-09T11:40:34.200836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204008+0000","last_change":"2023-10-09T11:40:34.199871+0000","last_active":"2023-10-09T11:40:34.204008+0000","last_peered":"2023-10-09T11:40:34.204008+0000","last_clean":"2023-10-09T11:40:34.204008+0000","last_became_active":"2023-10-09T11:40:34.199370+0000","last_became_peered":"2023-10-09T11:40:34.199370+0000","last_unstale":"2023-10-09T11:40:34.204008+0000","last_undegraded":"2023-10-09T11:40:34.204008+0000","last_fullsized":"2023-10-09T11:40:34.204008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:12.793028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193543+0000","last_change":"2023-10-09T11:40:34.193543+0000","last_active":"2023-10-09T11:40:34.193543+0000","last_peered":"2023-10-09T11:40:34.193543+0000","last_clean":"2023-10-09T11:40:34.193543+0000","last_became_active":"2023-10-09T11:40:34.193285+0000","last_became_peered":"2023-10-09T11:40:34.193285+0000","last_unstale":"2023-10-09T11:40:34.193543+0000","last_undegraded":"2023-10-09T11:40:34.193543+0000","last_fullsized":"2023-10-09T11:40:34.193543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:47.016441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204040+0000","last_change":"2023-10-09T11:40:34.201630+0000","last_active":"2023-10-09T11:40:34.204040+0000","last_peered":"2023-10-09T11:40:34.204040+0000","last_clean":"2023-10-09T11:40:34.204040+0000","last_became_active":"2023-10-09T11:40:34.199112+0000","last_became_peered":"2023-10-09T11:40:34.199112+0000","last_unstale":"2023-10-09T11:40:34.204040+0000","last_undegraded":"2023-10-09T11:40:34.204040+0000","last_fullsized":"2023-10-09T11:40:34.204040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204043+0000","last_change":"2023-10-09T11:40:34.201921+0000","last_active":"2023-10-09T11:40:34.204043+0000","last_peered":"2023-10-09T11:40:34.204043+0000","last_clean":"2023-10-09T11:40:34.204043+0000","last_became_active":"2023-10-09T11:40:34.199839+0000","last_became_peered":"2023-10-09T11:40:34.199839+0000","last_unstale":"2023-10-09T11:40:34.204043+0000","last_undegraded":"2023-10-09T11:40:34.204043+0000","last_fullsized":"2023-10-09T11:40:34.204043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:07.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196726+0000","last_change":"2023-10-09T11:40:34.190704+0000","last_active":"2023-10-09T11:40:34.196726+0000","last_peered":"2023-10-09T11:40:34.196726+0000","last_clean":"2023-10-09T11:40:34.196726+0000","last_became_active":"2023-10-09T11:40:34.190381+0000","last_became_peered":"2023-10-09T11:40:34.190381+0000","last_unstale":"2023-10-09T11:40:34.196726+0000","last_undegraded":"2023-10-09T11:40:34.196726+0000","last_fullsized":"2023-10-09T11:40:34.196726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:53.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192839+0000","last_change":"2023-10-09T11:40:34.192839+0000","last_active":"2023-10-09T11:40:34.192839+0000","last_peered":"2023-10-09T11:40:34.192839+0000","last_clean":"2023-10-09T11:40:34.192839+0000","last_became_active":"2023-10-09T11:40:34.192586+0000","last_became_peered":"2023-10-09T11:40:34.192586+0000","last_unstale":"2023-10-09T11:40:34.192839+0000","last_undegraded":"2023-10-09T11:40:34.192839+0000","last_fullsized":"2023-10-09T11:40:34.192839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:05.991854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196384+0000","last_change":"2023-10-09T11:40:34.190532+0000","last_active":"2023-10-09T11:40:34.196384+0000","last_peered":"2023-10-09T11:40:34.196384+0000","last_clean":"2023-10-09T11:40:34.196384+0000","last_became_active":"2023-10-09T11:40:34.190260+0000","last_became_peered":"2023-10-09T11:40:34.190260+0000","last_unstale":"2023-10-09T11:40:34.196384+0000","last_undegraded":"2023-10-09T11:40:34.196384+0000","last_fullsized":"2023-10-09T11:40:34.196384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:25.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204313+0000","last_change":"2023-10-09T11:40:34.200916+0000","last_active":"2023-10-09T11:40:34.204313+0000","last_peered":"2023-10-09T11:40:34.204313+0000","last_clean":"2023-10-09T11:40:34.204313+0000","last_became_active":"2023-10-09T11:40:34.200637+0000","last_became_peered":"2023-10-09T11:40:34.200637+0000","last_unstale":"2023-10-09T11:40:34.204313+0000","last_undegraded":"2023-10-09T11:40:34.204313+0000","last_fullsized":"2023-10-09T11:40:34.204313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:25.495566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193952+0000","last_change":"2023-10-09T11:40:34.193952+0000","last_active":"2023-10-09T11:40:34.193952+0000","last_peered":"2023-10-09T11:40:34.193952+0000","last_clean":"2023-10-09T11:40:34.193952+0000","last_became_active":"2023-10-09T11:40:34.193662+0000","last_became_peered":"2023-10-09T11:40:34.193662+0000","last_unstale":"2023-10-09T11:40:34.193952+0000","last_undegraded":"2023-10-09T11:40:34.193952+0000","last_fullsized":"2023-10-09T11:40:34.193952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:25.030871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195438+0000","last_change":"2023-10-09T11:40:34.195438+0000","last_active":"2023-10-09T11:40:34.195438+0000","last_peered":"2023-10-09T11:40:34.195438+0000","last_clean":"2023-10-09T11:40:34.195438+0000","last_became_active":"2023-10-09T11:40:34.194999+0000","last_became_peered":"2023-10-09T11:40:34.194999+0000","last_unstale":"2023-10-09T11:40:34.195438+0000","last_undegraded":"2023-10-09T11:40:34.195438+0000","last_fullsized":"2023-10-09T11:40:34.195438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:01.699417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200947+0000","last_change":"2023-10-09T11:40:34.197469+0000","last_active":"2023-10-09T11:40:34.200947+0000","last_peered":"2023-10-09T11:40:34.200947+0000","last_clean":"2023-10-09T11:40:34.200947+0000","last_became_active":"2023-10-09T11:40:34.197202+0000","last_became_peered":"2023-10-09T11:40:34.197202+0000","last_unstale":"2023-10-09T11:40:34.200947+0000","last_undegraded":"2023-10-09T11:40:34.200947+0000","last_fullsized":"2023-10-09T11:40:34.200947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:36.091734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200283+0000","last_change":"2023-10-09T11:40:34.188507+0000","last_active":"2023-10-09T11:40:34.200283+0000","last_peered":"2023-10-09T11:40:34.200283+0000","last_clean":"2023-10-09T11:40:34.200283+0000","last_became_active":"2023-10-09T11:40:34.188142+0000","last_became_peered":"2023-10-09T11:40:34.188142+0000","last_unstale":"2023-10-09T11:40:34.200283+0000","last_undegraded":"2023-10-09T11:40:34.200283+0000","last_fullsized":"2023-10-09T11:40:34.200283+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:13.566866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195517+0000","last_change":"2023-10-09T11:40:34.195517+0000","last_active":"2023-10-09T11:40:34.195517+0000","last_peered":"2023-10-09T11:40:34.195517+0000","last_clean":"2023-10-09T11:40:34.195517+0000","last_became_active":"2023-10-09T11:40:34.195118+0000","last_became_peered":"2023-10-09T11:40:34.195118+0000","last_unstale":"2023-10-09T11:40:34.195517+0000","last_undegraded":"2023-10-09T11:40:34.195517+0000","last_fullsized":"2023-10-09T11:40:34.195517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:42.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190351+0000","last_change":"2023-10-09T11:40:34.190351+0000","last_active":"2023-10-09T11:40:34.190351+0000","last_peered":"2023-10-09T11:40:34.190351+0000","last_clean":"2023-10-09T11:40:34.190351+0000","last_became_active":"2023-10-09T11:40:34.190083+0000","last_became_peered":"2023-10-09T11:40:34.190083+0000","last_unstale":"2023-10-09T11:40:34.190351+0000","last_undegraded":"2023-10-09T11:40:34.190351+0000","last_fullsized":"2023-10-09T11:40:34.190351+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:45.295387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.192357+0000","last_change":"2023-10-09T11:40:34.192357+0000","last_active":"2023-10-09T11:40:34.192357+0000","last_peered":"2023-10-09T11:40:34.192357+0000","last_clean":"2023-10-09T11:40:34.192357+0000","last_became_active":"2023-10-09T11:40:34.191472+0000","last_became_peered":"2023-10-09T11:40:34.191472+0000","last_unstale":"2023-10-09T11:40:34.192357+0000","last_undegraded":"2023-10-09T11:40:34.192357+0000","last_fullsized":"2023-10-09T11:40:34.192357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:04.161227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193018+0000","last_change":"2023-10-09T11:40:34.193018+0000","last_active":"2023-10-09T11:40:34.193018+0000","last_peered":"2023-10-09T11:40:34.193018+0000","last_clean":"2023-10-09T11:40:34.193018+0000","last_became_active":"2023-10-09T11:40:34.192744+0000","last_became_peered":"2023-10-09T11:40:34.192744+0000","last_unstale":"2023-10-09T11:40:34.193018+0000","last_undegraded":"2023-10-09T11:40:34.193018+0000","last_fullsized":"2023-10-09T11:40:34.193018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:08.037738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.191097+0000","last_change":"2023-10-09T11:40:34.191097+0000","last_active":"2023-10-09T11:40:34.191097+0000","last_peered":"2023-10-09T11:40:34.191097+0000","last_clean":"2023-10-09T11:40:34.191097+0000","last_became_active":"2023-10-09T11:40:34.190852+0000","last_became_peered":"2023-10-09T11:40:34.190852+0000","last_unstale":"2023-10-09T11:40:34.191097+0000","last_undegraded":"2023-10-09T11:40:34.191097+0000","last_fullsized":"2023-10-09T11:40:34.191097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:13.566866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197388+0000","last_change":"2023-10-09T11:40:34.191033+0000","last_active":"2023-10-09T11:40:34.197388+0000","last_peered":"2023-10-09T11:40:34.197388+0000","last_clean":"2023-10-09T11:40:34.197388+0000","last_became_active":"2023-10-09T11:40:34.190695+0000","last_became_peered":"2023-10-09T11:40:34.190695+0000","last_unstale":"2023-10-09T11:40:34.197388+0000","last_undegraded":"2023-10-09T11:40:34.197388+0000","last_fullsized":"2023-10-09T11:40:34.197388+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:06.854823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.189271+0000","last_change":"2023-10-09T11:40:34.189271+0000","last_active":"2023-10-09T11:40:34.189271+0000","last_peered":"2023-10-09T11:40:34.189271+0000","last_clean":"2023-10-09T11:40:34.189271+0000","last_became_active":"2023-10-09T11:40:34.188992+0000","last_became_peered":"2023-10-09T11:40:34.188992+0000","last_unstale":"2023-10-09T11:40:34.189271+0000","last_undegraded":"2023-10-09T11:40:34.189271+0000","last_fullsized":"2023-10-09T11:40:34.189271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:19:58.921622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.198941+0000","last_change":"2023-10-09T11:40:34.198941+0000","last_active":"2023-10-09T11:40:34.198941+0000","last_peered":"2023-10-09T11:40:34.198941+0000","last_clean":"2023-10-09T11:40:34.198941+0000","last_became_active":"2023-10-09T11:40:34.198658+0000","last_became_peered":"2023-10-09T11:40:34.198658+0000","last_unstale":"2023-10-09T11:40:34.198941+0000","last_undegraded":"2023-10-09T11:40:34.198941+0000","last_fullsized":"2023-10-09T11:40:34.198941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:50.701025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203495+0000","last_change":"2023-10-09T11:40:34.197247+0000","last_active":"2023-10-09T11:40:34.203495+0000","last_peered":"2023-10-09T11:40:34.203495+0000","last_clean":"2023-10-09T11:40:34.203495+0000","last_became_active":"2023-10-09T11:40:34.196933+0000","last_became_peered":"2023-10-09T11:40:34.196933+0000","last_unstale":"2023-10-09T11:40:34.203495+0000","last_undegraded":"2023-10-09T11:40:34.203495+0000","last_fullsized":"2023-10-09T11:40:34.203495+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:48.315919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199781+0000","last_change":"2023-10-09T11:40:34.192158+0000","last_active":"2023-10-09T11:40:34.199781+0000","last_peered":"2023-10-09T11:40:34.199781+0000","last_clean":"2023-10-09T11:40:34.199781+0000","last_became_active":"2023-10-09T11:40:34.191829+0000","last_became_peered":"2023-10-09T11:40:34.191829+0000","last_unstale":"2023-10-09T11:40:34.199781+0000","last_undegraded":"2023-10-09T11:40:34.199781+0000","last_fullsized":"2023-10-09T11:40:34.199781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:28.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197445+0000","last_change":"2023-10-09T11:40:34.194509+0000","last_active":"2023-10-09T11:40:34.197445+0000","last_peered":"2023-10-09T11:40:34.197445+0000","last_clean":"2023-10-09T11:40:34.197445+0000","last_became_active":"2023-10-09T11:40:34.194181+0000","last_became_peered":"2023-10-09T11:40:34.194181+0000","last_unstale":"2023-10-09T11:40:34.197445+0000","last_undegraded":"2023-10-09T11:40:34.197445+0000","last_fullsized":"2023-10-09T11:40:34.197445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:58.713142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190088+0000","last_change":"2023-10-09T11:40:34.190088+0000","last_active":"2023-10-09T11:40:34.190088+0000","last_peered":"2023-10-09T11:40:34.190088+0000","last_clean":"2023-10-09T11:40:34.190088+0000","last_became_active":"2023-10-09T11:40:34.189748+0000","last_became_peered":"2023-10-09T11:40:34.189748+0000","last_unstale":"2023-10-09T11:40:34.190088+0000","last_undegraded":"2023-10-09T11:40:34.190088+0000","last_fullsized":"2023-10-09T11:40:34.190088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:00.129725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190272+0000","last_change":"2023-10-09T11:40:34.190272+0000","last_active":"2023-10-09T11:40:34.190272+0000","last_peered":"2023-10-09T11:40:34.190272+0000","last_clean":"2023-10-09T11:40:34.190272+0000","last_became_active":"2023-10-09T11:40:34.189780+0000","last_became_peered":"2023-10-09T11:40:34.189780+0000","last_unstale":"2023-10-09T11:40:34.190272+0000","last_undegraded":"2023-10-09T11:40:34.190272+0000","last_fullsized":"2023-10-09T11:40:34.190272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:30.346116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199570+0000","last_change":"2023-10-09T11:40:34.190715+0000","last_active":"2023-10-09T11:40:34.199570+0000","last_peered":"2023-10-09T11:40:34.199570+0000","last_clean":"2023-10-09T11:40:34.199570+0000","last_became_active":"2023-10-09T11:40:34.190454+0000","last_became_peered":"2023-10-09T11:40:34.190454+0000","last_unstale":"2023-10-09T11:40:34.199570+0000","last_undegraded":"2023-10-09T11:40:34.199570+0000","last_fullsized":"2023-10-09T11:40:34.199570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:53.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196811+0000","last_change":"2023-10-09T11:40:34.194255+0000","last_active":"2023-10-09T11:40:34.196811+0000","last_peered":"2023-10-09T11:40:34.196811+0000","last_clean":"2023-10-09T11:40:34.196811+0000","last_became_active":"2023-10-09T11:40:34.193960+0000","last_became_peered":"2023-10-09T11:40:34.193960+0000","last_unstale":"2023-10-09T11:40:34.196811+0000","last_undegraded":"2023-10-09T11:40:34.196811+0000","last_fullsized":"2023-10-09T11:40:34.196811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:36.091734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.201361+0000","last_change":"2023-10-09T11:40:34.198434+0000","last_active":"2023-10-09T11:40:34.201361+0000","last_peered":"2023-10-09T11:40:34.201361+0000","last_clean":"2023-10-09T11:40:34.201361+0000","last_became_active":"2023-10-09T11:40:34.197524+0000","last_became_peered":"2023-10-09T11:40:34.197524+0000","last_unstale":"2023-10-09T11:40:34.201361+0000","last_undegraded":"2023-10-09T11:40:34.201361+0000","last_fullsized":"2023-10-09T11:40:34.201361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:19.800373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.386146+0000","last_change":"2023-10-09T11:40:33.390205+0000","last_active":"2023-10-09T11:40:34.386146+0000","last_peered":"2023-10-09T11:40:34.386146+0000","last_clean":"2023-10-09T11:40:34.386146+0000","last_became_active":"2023-10-09T11:40:33.389848+0000","last_became_peered":"2023-10-09T11:40:33.389848+0000","last_unstale":"2023-10-09T11:40:34.386146+0000","last_undegraded":"2023-10-09T11:40:34.386146+0000","last_fullsized":"2023-10-09T11:40:34.386146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:06.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203487+0000","last_change":"2023-10-09T11:40:34.197111+0000","last_active":"2023-10-09T11:40:34.203487+0000","last_peered":"2023-10-09T11:40:34.203487+0000","last_clean":"2023-10-09T11:40:34.203487+0000","last_became_active":"2023-10-09T11:40:34.195643+0000","last_became_peered":"2023-10-09T11:40:34.195643+0000","last_unstale":"2023-10-09T11:40:34.203487+0000","last_undegraded":"2023-10-09T11:40:34.203487+0000","last_fullsized":"2023-10-09T11:40:34.203487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:28.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381472+0000","last_change":"2023-10-09T11:40:33.392564+0000","last_active":"2023-10-09T11:40:34.381472+0000","last_peered":"2023-10-09T11:40:34.381472+0000","last_clean":"2023-10-09T11:40:34.381472+0000","last_became_active":"2023-10-09T11:40:33.392249+0000","last_became_peered":"2023-10-09T11:40:33.392249+0000","last_unstale":"2023-10-09T11:40:34.381472+0000","last_undegraded":"2023-10-09T11:40:34.381472+0000","last_fullsized":"2023-10-09T11:40:34.381472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:04.922660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203727+0000","last_change":"2023-10-09T11:40:34.198615+0000","last_active":"2023-10-09T11:40:34.203727+0000","last_peered":"2023-10-09T11:40:34.203727+0000","last_clean":"2023-10-09T11:40:34.203727+0000","last_became_active":"2023-10-09T11:40:34.198331+0000","last_became_peered":"2023-10-09T11:40:34.198331+0000","last_unstale":"2023-10-09T11:40:34.203727+0000","last_undegraded":"2023-10-09T11:40:34.203727+0000","last_fullsized":"2023-10-09T11:40:34.203727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:07.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.384075+0000","last_change":"2023-10-09T11:40:33.386078+0000","last_active":"2023-10-09T11:40:34.384075+0000","last_peered":"2023-10-09T11:40:34.384075+0000","last_clean":"2023-10-09T11:40:34.384075+0000","last_became_active":"2023-10-09T11:40:33.385578+0000","last_became_peered":"2023-10-09T11:40:33.385578+0000","last_unstale":"2023-10-09T11:40:34.384075+0000","last_undegraded":"2023-10-09T11:40:34.384075+0000","last_fullsized":"2023-10-09T11:40:34.384075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:06.464070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203725+0000","last_change":"2023-10-09T11:40:34.198214+0000","last_active":"2023-10-09T11:40:34.203725+0000","last_peered":"2023-10-09T11:40:34.203725+0000","last_clean":"2023-10-09T11:40:34.203725+0000","last_became_active":"2023-10-09T11:40:34.196775+0000","last_became_peered":"2023-10-09T11:40:34.196775+0000","last_unstale":"2023-10-09T11:40:34.203725+0000","last_undegraded":"2023-10-09T11:40:34.203725+0000","last_fullsized":"2023-10-09T11:40:34.203725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:55.122157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.384064+0000","last_change":"2023-10-09T11:40:33.391846+0000","last_active":"2023-10-09T11:40:34.384064+0000","last_peered":"2023-10-09T11:40:34.384064+0000","last_clean":"2023-10-09T11:40:34.384064+0000","last_became_active":"2023-10-09T11:40:33.391325+0000","last_became_peered":"2023-10-09T11:40:33.391325+0000","last_unstale":"2023-10-09T11:40:34.384064+0000","last_undegraded":"2023-10-09T11:40:34.384064+0000","last_fullsized":"2023-10-09T11:40:34.384064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:51.789471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.190078+0000","last_change":"2023-10-09T11:40:34.190078+0000","last_active":"2023-10-09T11:40:34.190078+0000","last_peered":"2023-10-09T11:40:34.190078+0000","last_clean":"2023-10-09T11:40:34.190078+0000","last_became_active":"2023-10-09T11:40:34.189761+0000","last_became_peered":"2023-10-09T11:40:34.189761+0000","last_unstale":"2023-10-09T11:40:34.190078+0000","last_undegraded":"2023-10-09T11:40:34.190078+0000","last_fullsized":"2023-10-09T11:40:34.190078+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:42.759214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381391+0000","last_change":"2023-10-09T11:40:33.392523+0000","last_active":"2023-10-09T11:40:34.381391+0000","last_peered":"2023-10-09T11:40:34.381391+0000","last_clean":"2023-10-09T11:40:34.381391+0000","last_became_active":"2023-10-09T11:40:33.392198+0000","last_became_peered":"2023-10-09T11:40:33.392198+0000","last_unstale":"2023-10-09T11:40:34.381391+0000","last_undegraded":"2023-10-09T11:40:34.381391+0000","last_fullsized":"2023-10-09T11:40:34.381391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:06.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193289+0000","last_change":"2023-10-09T11:40:34.187573+0000","last_active":"2023-10-09T11:40:34.193289+0000","last_peered":"2023-10-09T11:40:34.193289+0000","last_clean":"2023-10-09T11:40:34.193289+0000","last_became_active":"2023-10-09T11:40:34.187234+0000","last_became_peered":"2023-10-09T11:40:34.187234+0000","last_unstale":"2023-10-09T11:40:34.193289+0000","last_undegraded":"2023-10-09T11:40:34.193289+0000","last_fullsized":"2023-10-09T11:40:34.193289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:47.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.381317+0000","last_change":"2023-10-09T11:40:33.392596+0000","last_active":"2023-10-09T11:40:34.381317+0000","last_peered":"2023-10-09T11:40:34.381317+0000","last_clean":"2023-10-09T11:40:34.381317+0000","last_became_active":"2023-10-09T11:40:33.392301+0000","last_became_peered":"2023-10-09T11:40:33.392301+0000","last_unstale":"2023-10-09T11:40:34.381317+0000","last_undegraded":"2023-10-09T11:40:34.381317+0000","last_fullsized":"2023-10-09T11:40:34.381317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:21.508695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203594+0000","last_change":"2023-10-09T11:40:34.197541+0000","last_active":"2023-10-09T11:40:34.203594+0000","last_peered":"2023-10-09T11:40:34.203594+0000","last_clean":"2023-10-09T11:40:34.203594+0000","last_became_active":"2023-10-09T11:40:34.197265+0000","last_became_peered":"2023-10-09T11:40:34.197265+0000","last_unstale":"2023-10-09T11:40:34.203594+0000","last_undegraded":"2023-10-09T11:40:34.203594+0000","last_fullsized":"2023-10-09T11:40:34.203594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:07.898484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391380+0000","last_change":"2023-10-09T11:40:33.385116+0000","last_active":"2023-10-09T11:40:33.391380+0000","last_peered":"2023-10-09T11:40:33.391380+0000","last_clean":"2023-10-09T11:40:33.391380+0000","last_became_active":"2023-10-09T11:40:33.384836+0000","last_became_peered":"2023-10-09T11:40:33.384836+0000","last_unstale":"2023-10-09T11:40:33.391380+0000","last_undegraded":"2023-10-09T11:40:33.391380+0000","last_fullsized":"2023-10-09T11:40:33.391380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:32.552658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.195259+0000","last_change":"2023-10-09T11:40:34.195259+0000","last_active":"2023-10-09T11:40:34.195259+0000","last_peered":"2023-10-09T11:40:34.195259+0000","last_clean":"2023-10-09T11:40:34.195259+0000","last_became_active":"2023-10-09T11:40:34.194643+0000","last_became_peered":"2023-10-09T11:40:34.194643+0000","last_unstale":"2023-10-09T11:40:34.195259+0000","last_undegraded":"2023-10-09T11:40:34.195259+0000","last_fullsized":"2023-10-09T11:40:34.195259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:42.198572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.395558+0000","last_change":"2023-10-09T11:40:33.395256+0000","last_active":"2023-10-09T11:40:33.395558+0000","last_peered":"2023-10-09T11:40:33.395558+0000","last_clean":"2023-10-09T11:40:33.395558+0000","last_became_active":"2023-10-09T11:40:33.394965+0000","last_became_peered":"2023-10-09T11:40:33.394965+0000","last_unstale":"2023-10-09T11:40:33.395558+0000","last_undegraded":"2023-10-09T11:40:33.395558+0000","last_fullsized":"2023-10-09T11:40:33.395558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.025916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196992+0000","last_change":"2023-10-09T11:40:34.196992+0000","last_active":"2023-10-09T11:40:34.196992+0000","last_peered":"2023-10-09T11:40:34.196992+0000","last_clean":"2023-10-09T11:40:34.196992+0000","last_became_active":"2023-10-09T11:40:34.196736+0000","last_became_peered":"2023-10-09T11:40:34.196736+0000","last_unstale":"2023-10-09T11:40:34.196992+0000","last_undegraded":"2023-10-09T11:40:34.196992+0000","last_fullsized":"2023-10-09T11:40:34.196992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:17.891769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.184775+0000","last_change":"2023-10-09T11:40:33.382907+0000","last_active":"2023-10-09T11:40:34.184775+0000","last_peered":"2023-10-09T11:40:34.184775+0000","last_clean":"2023-10-09T11:40:34.184775+0000","last_became_active":"2023-10-09T11:40:33.382601+0000","last_became_peered":"2023-10-09T11:40:33.382601+0000","last_unstale":"2023-10-09T11:40:34.184775+0000","last_undegraded":"2023-10-09T11:40:34.184775+0000","last_fullsized":"2023-10-09T11:40:34.184775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:13.124900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203291+0000","last_change":"2023-10-09T11:40:34.199356+0000","last_active":"2023-10-09T11:40:34.203291+0000","last_peered":"2023-10-09T11:40:34.203291+0000","last_clean":"2023-10-09T11:40:34.203291+0000","last_became_active":"2023-10-09T11:40:34.199001+0000","last_became_peered":"2023-10-09T11:40:34.199001+0000","last_unstale":"2023-10-09T11:40:34.203291+0000","last_undegraded":"2023-10-09T11:40:34.203291+0000","last_fullsized":"2023-10-09T11:40:34.203291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:56.429306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.183931+0000","last_change":"2023-10-09T11:40:33.392498+0000","last_active":"2023-10-09T11:40:34.183931+0000","last_peered":"2023-10-09T11:40:34.183931+0000","last_clean":"2023-10-09T11:40:34.183931+0000","last_became_active":"2023-10-09T11:40:33.392215+0000","last_became_peered":"2023-10-09T11:40:33.392215+0000","last_unstale":"2023-10-09T11:40:34.183931+0000","last_undegraded":"2023-10-09T11:40:34.183931+0000","last_fullsized":"2023-10-09T11:40:34.183931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.880652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194610+0000","last_change":"2023-10-09T11:40:34.194610+0000","last_active":"2023-10-09T11:40:34.194610+0000","last_peered":"2023-10-09T11:40:34.194610+0000","last_clean":"2023-10-09T11:40:34.194610+0000","last_became_active":"2023-10-09T11:40:34.194339+0000","last_became_peered":"2023-10-09T11:40:34.194339+0000","last_unstale":"2023-10-09T11:40:34.194610+0000","last_undegraded":"2023-10-09T11:40:34.194610+0000","last_fullsized":"2023-10-09T11:40:34.194610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:48.315919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385348+0000","last_change":"2023-10-09T11:40:33.389212+0000","last_active":"2023-10-09T11:40:34.385348+0000","last_peered":"2023-10-09T11:40:34.385348+0000","last_clean":"2023-10-09T11:40:34.385348+0000","last_became_active":"2023-10-09T11:40:33.388944+0000","last_became_peered":"2023-10-09T11:40:33.388944+0000","last_unstale":"2023-10-09T11:40:34.385348+0000","last_undegraded":"2023-10-09T11:40:34.385348+0000","last_fullsized":"2023-10-09T11:40:34.385348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:36.591920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199762+0000","last_change":"2023-10-09T11:40:34.191424+0000","last_active":"2023-10-09T11:40:34.199762+0000","last_peered":"2023-10-09T11:40:34.199762+0000","last_clean":"2023-10-09T11:40:34.199762+0000","last_became_active":"2023-10-09T11:40:34.191121+0000","last_became_peered":"2023-10-09T11:40:34.191121+0000","last_unstale":"2023-10-09T11:40:34.199762+0000","last_undegraded":"2023-10-09T11:40:34.199762+0000","last_fullsized":"2023-10-09T11:40:34.199762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:06.854823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.387588+0000","last_change":"2023-10-09T11:40:33.385174+0000","last_active":"2023-10-09T11:40:34.387588+0000","last_peered":"2023-10-09T11:40:34.387588+0000","last_clean":"2023-10-09T11:40:34.387588+0000","last_became_active":"2023-10-09T11:40:33.384549+0000","last_became_peered":"2023-10-09T11:40:33.384549+0000","last_unstale":"2023-10-09T11:40:34.387588+0000","last_undegraded":"2023-10-09T11:40:34.387588+0000","last_fullsized":"2023-10-09T11:40:34.387588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:26.162626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194503+0000","last_change":"2023-10-09T11:40:34.194503+0000","last_active":"2023-10-09T11:40:34.194503+0000","last_peered":"2023-10-09T11:40:34.194503+0000","last_clean":"2023-10-09T11:40:34.194503+0000","last_became_active":"2023-10-09T11:40:34.194221+0000","last_became_peered":"2023-10-09T11:40:34.194221+0000","last_unstale":"2023-10-09T11:40:34.194503+0000","last_undegraded":"2023-10-09T11:40:34.194503+0000","last_fullsized":"2023-10-09T11:40:34.194503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:01.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.382329+0000","last_change":"2023-10-09T11:40:33.392561+0000","last_active":"2023-10-09T11:40:34.382329+0000","last_peered":"2023-10-09T11:40:34.382329+0000","last_clean":"2023-10-09T11:40:34.382329+0000","last_became_active":"2023-10-09T11:40:33.392203+0000","last_became_peered":"2023-10-09T11:40:33.392203+0000","last_unstale":"2023-10-09T11:40:34.382329+0000","last_undegraded":"2023-10-09T11:40:34.382329+0000","last_fullsized":"2023-10-09T11:40:34.382329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:07.032783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203714+0000","last_change":"2023-10-09T11:40:34.197999+0000","last_active":"2023-10-09T11:40:34.203714+0000","last_peered":"2023-10-09T11:40:34.203714+0000","last_clean":"2023-10-09T11:40:34.203714+0000","last_became_active":"2023-10-09T11:40:34.196887+0000","last_became_peered":"2023-10-09T11:40:34.196887+0000","last_unstale":"2023-10-09T11:40:34.203714+0000","last_undegraded":"2023-10-09T11:40:34.203714+0000","last_fullsized":"2023-10-09T11:40:34.203714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:27.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391629+0000","last_change":"2023-10-09T11:40:33.389394+0000","last_active":"2023-10-09T11:40:33.391629+0000","last_peered":"2023-10-09T11:40:33.391629+0000","last_clean":"2023-10-09T11:40:33.391629+0000","last_became_active":"2023-10-09T11:40:33.389096+0000","last_became_peered":"2023-10-09T11:40:33.389096+0000","last_unstale":"2023-10-09T11:40:33.391629+0000","last_undegraded":"2023-10-09T11:40:33.391629+0000","last_fullsized":"2023-10-09T11:40:33.391629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:00.122341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.188827+0000","last_change":"2023-10-09T11:40:34.188827+0000","last_active":"2023-10-09T11:40:34.188827+0000","last_peered":"2023-10-09T11:40:34.188827+0000","last_clean":"2023-10-09T11:40:34.188827+0000","last_became_active":"2023-10-09T11:40:34.188573+0000","last_became_peered":"2023-10-09T11:40:34.188573+0000","last_unstale":"2023-10-09T11:40:34.188827+0000","last_undegraded":"2023-10-09T11:40:34.188827+0000","last_fullsized":"2023-10-09T11:40:34.188827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:28.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193129+0000","last_change":"2023-10-09T11:40:33.387430+0000","last_active":"2023-10-09T11:40:34.193129+0000","last_peered":"2023-10-09T11:40:34.193129+0000","last_clean":"2023-10-09T11:40:34.193129+0000","last_became_active":"2023-10-09T11:40:33.387101+0000","last_became_peered":"2023-10-09T11:40:33.387101+0000","last_unstale":"2023-10-09T11:40:34.193129+0000","last_undegraded":"2023-10-09T11:40:34.193129+0000","last_fullsized":"2023-10-09T11:40:34.193129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:46.669932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.197683+0000","last_change":"2023-10-09T11:40:34.197683+0000","last_active":"2023-10-09T11:40:34.197683+0000","last_peered":"2023-10-09T11:40:34.197683+0000","last_clean":"2023-10-09T11:40:34.197683+0000","last_became_active":"2023-10-09T11:40:34.197381+0000","last_became_peered":"2023-10-09T11:40:34.197381+0000","last_unstale":"2023-10-09T11:40:34.197683+0000","last_undegraded":"2023-10-09T11:40:34.197683+0000","last_fullsized":"2023-10-09T11:40:34.197683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:37.036391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"76'8","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.386560+0000","last_change":"2023-10-09T11:40:33.386662+0000","last_active":"2023-10-09T11:40:34.386560+0000","last_peered":"2023-10-09T11:40:34.386560+0000","last_clean":"2023-10-09T11:40:34.386560+0000","last_became_active":"2023-10-09T11:40:33.386367+0000","last_became_peered":"2023-10-09T11:40:33.386367+0000","last_unstale":"2023-10-09T11:40:34.386560+0000","last_undegraded":"2023-10-09T11:40:34.386560+0000","last_fullsized":"2023-10-09T11:40:34.386560+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:55.424352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204293+0000","last_change":"2023-10-09T11:40:34.200895+0000","last_active":"2023-10-09T11:40:34.204293+0000","last_peered":"2023-10-09T11:40:34.204293+0000","last_clean":"2023-10-09T11:40:34.204293+0000","last_became_active":"2023-10-09T11:40:34.200588+0000","last_became_peered":"2023-10-09T11:40:34.200588+0000","last_unstale":"2023-10-09T11:40:34.204293+0000","last_undegraded":"2023-10-09T11:40:34.204293+0000","last_fullsized":"2023-10-09T11:40:34.204293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:57.457592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385993+0000","last_change":"2023-10-09T11:40:33.386094+0000","last_active":"2023-10-09T11:40:34.385993+0000","last_peered":"2023-10-09T11:40:34.385993+0000","last_clean":"2023-10-09T11:40:34.385993+0000","last_became_active":"2023-10-09T11:40:33.385791+0000","last_became_peered":"2023-10-09T11:40:33.385791+0000","last_unstale":"2023-10-09T11:40:34.385993+0000","last_undegraded":"2023-10-09T11:40:34.385993+0000","last_fullsized":"2023-10-09T11:40:34.385993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:21.508695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203528+0000","last_change":"2023-10-09T11:40:34.197478+0000","last_active":"2023-10-09T11:40:34.203528+0000","last_peered":"2023-10-09T11:40:34.203528+0000","last_clean":"2023-10-09T11:40:34.203528+0000","last_became_active":"2023-10-09T11:40:34.196852+0000","last_became_peered":"2023-10-09T11:40:34.196852+0000","last_unstale":"2023-10-09T11:40:34.203528+0000","last_undegraded":"2023-10-09T11:40:34.203528+0000","last_fullsized":"2023-10-09T11:40:34.203528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.060244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.385901+0000","last_change":"2023-10-09T11:40:33.388989+0000","last_active":"2023-10-09T11:40:34.385901+0000","last_peered":"2023-10-09T11:40:34.385901+0000","last_clean":"2023-10-09T11:40:34.385901+0000","last_became_active":"2023-10-09T11:40:33.388706+0000","last_became_peered":"2023-10-09T11:40:33.388706+0000","last_unstale":"2023-10-09T11:40:34.385901+0000","last_undegraded":"2023-10-09T11:40:34.385901+0000","last_fullsized":"2023-10-09T11:40:34.385901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:39.227147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.201056+0000","last_change":"2023-10-09T11:40:34.195110+0000","last_active":"2023-10-09T11:40:34.201056+0000","last_peered":"2023-10-09T11:40:34.201056+0000","last_clean":"2023-10-09T11:40:34.201056+0000","last_became_active":"2023-10-09T11:40:34.194799+0000","last_became_peered":"2023-10-09T11:40:34.194799+0000","last_unstale":"2023-10-09T11:40:34.201056+0000","last_undegraded":"2023-10-09T11:40:34.201056+0000","last_fullsized":"2023-10-09T11:40:34.201056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.391961+0000","last_change":"2023-10-09T11:40:33.386587+0000","last_active":"2023-10-09T11:40:33.391961+0000","last_peered":"2023-10-09T11:40:33.391961+0000","last_clean":"2023-10-09T11:40:33.391961+0000","last_became_active":"2023-10-09T11:40:33.386275+0000","last_became_peered":"2023-10-09T11:40:33.386275+0000","last_unstale":"2023-10-09T11:40:33.391961+0000","last_undegraded":"2023-10-09T11:40:33.391961+0000","last_fullsized":"2023-10-09T11:40:33.391961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:29.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.193242+0000","last_change":"2023-10-09T11:40:34.193242+0000","last_active":"2023-10-09T11:40:34.193242+0000","last_peered":"2023-10-09T11:40:34.193242+0000","last_clean":"2023-10-09T11:40:34.193242+0000","last_became_active":"2023-10-09T11:40:34.192499+0000","last_became_peered":"2023-10-09T11:40:34.192499+0000","last_unstale":"2023-10-09T11:40:34.193242+0000","last_undegraded":"2023-10-09T11:40:34.193242+0000","last_fullsized":"2023-10-09T11:40:34.193242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:18.140596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383499+0000","last_change":"2023-10-09T11:40:33.378383+0000","last_active":"2023-10-09T11:40:34.383499+0000","last_peered":"2023-10-09T11:40:34.383499+0000","last_clean":"2023-10-09T11:40:34.383499+0000","last_became_active":"2023-10-09T11:40:33.377854+0000","last_became_peered":"2023-10-09T11:40:33.377854+0000","last_unstale":"2023-10-09T11:40:34.383499+0000","last_undegraded":"2023-10-09T11:40:34.383499+0000","last_fullsized":"2023-10-09T11:40:34.383499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:47.310964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203460+0000","last_change":"2023-10-09T11:40:34.199992+0000","last_active":"2023-10-09T11:40:34.203460+0000","last_peered":"2023-10-09T11:40:34.203460+0000","last_clean":"2023-10-09T11:40:34.203460+0000","last_became_active":"2023-10-09T11:40:34.199674+0000","last_became_peered":"2023-10-09T11:40:34.199674+0000","last_unstale":"2023-10-09T11:40:34.203460+0000","last_undegraded":"2023-10-09T11:40:34.203460+0000","last_fullsized":"2023-10-09T11:40:34.203460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.794426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.393375+0000","last_change":"2023-10-09T11:40:33.391319+0000","last_active":"2023-10-09T11:40:33.393375+0000","last_peered":"2023-10-09T11:40:33.393375+0000","last_clean":"2023-10-09T11:40:33.393375+0000","last_became_active":"2023-10-09T11:40:33.391057+0000","last_became_peered":"2023-10-09T11:40:33.391057+0000","last_unstale":"2023-10-09T11:40:33.393375+0000","last_undegraded":"2023-10-09T11:40:33.393375+0000","last_fullsized":"2023-10-09T11:40:33.393375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:55.828733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200649+0000","last_change":"2023-10-09T11:40:34.200649+0000","last_active":"2023-10-09T11:40:34.200649+0000","last_peered":"2023-10-09T11:40:34.200649+0000","last_clean":"2023-10-09T11:40:34.200649+0000","last_became_active":"2023-10-09T11:40:34.200384+0000","last_became_peered":"2023-10-09T11:40:34.200384+0000","last_unstale":"2023-10-09T11:40:34.200649+0000","last_undegraded":"2023-10-09T11:40:34.200649+0000","last_fullsized":"2023-10-09T11:40:34.200649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:45.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.390148+0000","last_change":"2023-10-09T11:40:33.385243+0000","last_active":"2023-10-09T11:40:33.390148+0000","last_peered":"2023-10-09T11:40:33.390148+0000","last_clean":"2023-10-09T11:40:33.390148+0000","last_became_active":"2023-10-09T11:40:33.384932+0000","last_became_peered":"2023-10-09T11:40:33.384932+0000","last_unstale":"2023-10-09T11:40:33.390148+0000","last_undegraded":"2023-10-09T11:40:33.390148+0000","last_fullsized":"2023-10-09T11:40:33.390148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:06.810900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204094+0000","last_change":"2023-10-09T11:40:34.202084+0000","last_active":"2023-10-09T11:40:34.204094+0000","last_peered":"2023-10-09T11:40:34.204094+0000","last_clean":"2023-10-09T11:40:34.204094+0000","last_became_active":"2023-10-09T11:40:34.199529+0000","last_became_peered":"2023-10-09T11:40:34.199529+0000","last_unstale":"2023-10-09T11:40:34.204094+0000","last_undegraded":"2023-10-09T11:40:34.204094+0000","last_fullsized":"2023-10-09T11:40:34.204094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.731309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.380862+0000","last_change":"2023-10-09T11:40:33.380116+0000","last_active":"2023-10-09T11:40:33.380862+0000","last_peered":"2023-10-09T11:40:33.380862+0000","last_clean":"2023-10-09T11:40:33.380862+0000","last_became_active":"2023-10-09T11:40:33.379746+0000","last_became_peered":"2023-10-09T11:40:33.379746+0000","last_unstale":"2023-10-09T11:40:33.380862+0000","last_undegraded":"2023-10-09T11:40:33.380862+0000","last_fullsized":"2023-10-09T11:40:33.380862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:26.742390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203940+0000","last_change":"2023-10-09T11:40:34.202255+0000","last_active":"2023-10-09T11:40:34.203940+0000","last_peered":"2023-10-09T11:40:34.203940+0000","last_clean":"2023-10-09T11:40:34.203940+0000","last_became_active":"2023-10-09T11:40:34.201974+0000","last_became_peered":"2023-10-09T11:40:34.201974+0000","last_unstale":"2023-10-09T11:40:34.203940+0000","last_undegraded":"2023-10-09T11:40:34.203940+0000","last_fullsized":"2023-10-09T11:40:34.203940+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:51.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"76'2","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383503+0000","last_change":"2023-10-09T11:40:33.389065+0000","last_active":"2023-10-09T11:40:34.383503+0000","last_peered":"2023-10-09T11:40:34.383503+0000","last_clean":"2023-10-09T11:40:34.383503+0000","last_became_active":"2023-10-09T11:40:33.387917+0000","last_became_peered":"2023-10-09T11:40:33.387917+0000","last_unstale":"2023-10-09T11:40:34.383503+0000","last_undegraded":"2023-10-09T11:40:34.383503+0000","last_fullsized":"2023-10-09T11:40:34.383503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:03.156273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.204639+0000","last_change":"2023-10-09T11:40:34.204115+0000","last_active":"2023-10-09T11:40:34.204639+0000","last_peered":"2023-10-09T11:40:34.204639+0000","last_clean":"2023-10-09T11:40:34.204639+0000","last_became_active":"2023-10-09T11:40:34.203861+0000","last_became_peered":"2023-10-09T11:40:34.203861+0000","last_unstale":"2023-10-09T11:40:34.204639+0000","last_undegraded":"2023-10-09T11:40:34.204639+0000","last_fullsized":"2023-10-09T11:40:34.204639+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:45.295387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.393239+0000","last_change":"2023-10-09T11:40:33.392696+0000","last_active":"2023-10-09T11:40:33.393239+0000","last_peered":"2023-10-09T11:40:33.393239+0000","last_clean":"2023-10-09T11:40:33.393239+0000","last_became_active":"2023-10-09T11:40:33.392449+0000","last_became_peered":"2023-10-09T11:40:33.392449+0000","last_unstale":"2023-10-09T11:40:33.393239+0000","last_undegraded":"2023-10-09T11:40:33.393239+0000","last_fullsized":"2023-10-09T11:40:33.393239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:17.135642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196304+0000","last_change":"2023-10-09T11:40:34.189813+0000","last_active":"2023-10-09T11:40:34.196304+0000","last_peered":"2023-10-09T11:40:34.196304+0000","last_clean":"2023-10-09T11:40:34.196304+0000","last_became_active":"2023-10-09T11:40:34.189516+0000","last_became_peered":"2023-10-09T11:40:34.189516+0000","last_unstale":"2023-10-09T11:40:34.196304+0000","last_undegraded":"2023-10-09T11:40:34.196304+0000","last_fullsized":"2023-10-09T11:40:34.196304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:19.800373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.182557+0000","last_change":"2023-10-09T11:40:33.383135+0000","last_active":"2023-10-09T11:40:34.182557+0000","last_peered":"2023-10-09T11:40:34.182557+0000","last_clean":"2023-10-09T11:40:34.182557+0000","last_became_active":"2023-10-09T11:40:33.382306+0000","last_became_peered":"2023-10-09T11:40:33.382306+0000","last_unstale":"2023-10-09T11:40:34.182557+0000","last_undegraded":"2023-10-09T11:40:34.182557+0000","last_fullsized":"2023-10-09T11:40:34.182557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:32.424849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.199740+0000","last_change":"2023-10-09T11:40:34.189167+0000","last_active":"2023-10-09T11:40:34.199740+0000","last_peered":"2023-10-09T11:40:34.199740+0000","last_clean":"2023-10-09T11:40:34.199740+0000","last_became_active":"2023-10-09T11:40:34.188576+0000","last_became_peered":"2023-10-09T11:40:34.188576+0000","last_unstale":"2023-10-09T11:40:34.199740+0000","last_undegraded":"2023-10-09T11:40:34.199740+0000","last_fullsized":"2023-10-09T11:40:34.199740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.060244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.185473+0000","last_change":"2023-10-09T11:40:33.381484+0000","last_active":"2023-10-09T11:40:34.185473+0000","last_peered":"2023-10-09T11:40:34.185473+0000","last_clean":"2023-10-09T11:40:34.185473+0000","last_became_active":"2023-10-09T11:40:33.381199+0000","last_became_peered":"2023-10-09T11:40:33.381199+0000","last_unstale":"2023-10-09T11:40:34.185473+0000","last_undegraded":"2023-10-09T11:40:34.185473+0000","last_fullsized":"2023-10-09T11:40:34.185473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:04.922660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203312+0000","last_change":"2023-10-09T11:40:34.199515+0000","last_active":"2023-10-09T11:40:34.203312+0000","last_peered":"2023-10-09T11:40:34.203312+0000","last_clean":"2023-10-09T11:40:34.203312+0000","last_became_active":"2023-10-09T11:40:34.198914+0000","last_became_peered":"2023-10-09T11:40:34.198914+0000","last_unstale":"2023-10-09T11:40:34.203312+0000","last_undegraded":"2023-10-09T11:40:34.203312+0000","last_fullsized":"2023-10-09T11:40:34.203312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:40.232101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-09T11:40:33.392882+0000","last_change":"2023-10-09T11:40:33.387115+0000","last_active":"2023-10-09T11:40:33.392882+0000","last_peered":"2023-10-09T11:40:33.392882+0000","last_clean":"2023-10-09T11:40:33.392882+0000","last_became_active":"2023-10-09T11:40:33.386854+0000","last_became_peered":"2023-10-09T11:40:33.386854+0000","last_unstale":"2023-10-09T11:40:33.392882+0000","last_undegraded":"2023-10-09T11:40:33.392882+0000","last_fullsized":"2023-10-09T11:40:33.392882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:11.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.194694+0000","last_change":"2023-10-09T11:40:34.194694+0000","last_active":"2023-10-09T11:40:34.194694+0000","last_peered":"2023-10-09T11:40:34.194694+0000","last_clean":"2023-10-09T11:40:34.194694+0000","last_became_active":"2023-10-09T11:40:34.194421+0000","last_became_peered":"2023-10-09T11:40:34.194421+0000","last_unstale":"2023-10-09T11:40:34.194694+0000","last_undegraded":"2023-10-09T11:40:34.194694+0000","last_fullsized":"2023-10-09T11:40:34.194694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:27.747344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.182908+0000","last_change":"2023-10-09T11:40:33.392502+0000","last_active":"2023-10-09T11:40:34.182908+0000","last_peered":"2023-10-09T11:40:34.182908+0000","last_clean":"2023-10-09T11:40:34.182908+0000","last_became_active":"2023-10-09T11:40:33.392217+0000","last_became_peered":"2023-10-09T11:40:33.392217+0000","last_unstale":"2023-10-09T11:40:34.182908+0000","last_undegraded":"2023-10-09T11:40:34.182908+0000","last_fullsized":"2023-10-09T11:40:34.182908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:13.124900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.203614+0000","last_change":"2023-10-09T11:40:34.197640+0000","last_active":"2023-10-09T11:40:34.203614+0000","last_peered":"2023-10-09T11:40:34.203614+0000","last_clean":"2023-10-09T11:40:34.203614+0000","last_became_active":"2023-10-09T11:40:34.196931+0000","last_became_peered":"2023-10-09T11:40:34.196931+0000","last_unstale":"2023-10-09T11:40:34.203614+0000","last_undegraded":"2023-10-09T11:40:34.203614+0000","last_fullsized":"2023-10-09T11:40:34.203614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:01.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.185530+0000","last_change":"2023-10-09T11:40:33.382752+0000","last_active":"2023-10-09T11:40:34.185530+0000","last_peered":"2023-10-09T11:40:34.185530+0000","last_clean":"2023-10-09T11:40:34.185530+0000","last_became_active":"2023-10-09T11:40:33.382272+0000","last_became_peered":"2023-10-09T11:40:33.382272+0000","last_unstale":"2023-10-09T11:40:34.185530+0000","last_undegraded":"2023-10-09T11:40:34.185530+0000","last_fullsized":"2023-10-09T11:40:34.185530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:21.321975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.196271+0000","last_change":"2023-10-09T11:40:34.189625+0000","last_active":"2023-10-09T11:40:34.196271+0000","last_peered":"2023-10-09T11:40:34.196271+0000","last_clean":"2023-10-09T11:40:34.196271+0000","last_became_active":"2023-10-09T11:40:34.189340+0000","last_became_peered":"2023-10-09T11:40:34.189340+0000","last_unstale":"2023-10-09T11:40:34.196271+0000","last_undegraded":"2023-10-09T11:40:34.196271+0000","last_fullsized":"2023-10-09T11:40:34.196271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:51.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.184555+0000","last_change":"2023-10-09T11:40:33.390817+0000","last_active":"2023-10-09T11:40:34.184555+0000","last_peered":"2023-10-09T11:40:34.184555+0000","last_clean":"2023-10-09T11:40:34.184555+0000","last_became_active":"2023-10-09T11:40:33.390533+0000","last_became_peered":"2023-10-09T11:40:33.390533+0000","last_unstale":"2023-10-09T11:40:34.184555+0000","last_undegraded":"2023-10-09T11:40:34.184555+0000","last_fullsized":"2023-10-09T11:40:34.184555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:21.321975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.200456+0000","last_change":"2023-10-09T11:40:34.200456+0000","last_active":"2023-10-09T11:40:34.200456+0000","last_peered":"2023-10-09T11:40:34.200456+0000","last_clean":"2023-10-09T11:40:34.200456+0000","last_became_active":"2023-10-09T11:40:34.199791+0000","last_became_peered":"2023-10-09T11:40:34.199791+0000","last_unstale":"2023-10-09T11:40:34.200456+0000","last_undegraded":"2023-10-09T11:40:34.200456+0000","last_fullsized":"2023-10-09T11:40:34.200456+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:33.366667+0000","last_clean_scrub_stamp":"2023-10-09T11:40:33.366667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:22.513649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.383345+0000","last_change":"2023-10-09T11:40:33.384956+0000","last_active":"2023-10-09T11:40:34.383345+0000","last_peered":"2023-10-09T11:40:34.383345+0000","last_clean":"2023-10-09T11:40:34.383345+0000","last_became_active":"2023-10-09T11:40:33.384623+0000","last_became_peered":"2023-10-09T11:40:33.384623+0000","last_unstale":"2023-10-09T11:40:34.383345+0000","last_undegraded":"2023-10-09T11:40:34.383345+0000","last_fullsized":"2023-10-09T11:40:34.383345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:32.361713+0000","last_clean_scrub_stamp":"2023-10-09T11:40:32.361713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:57.708188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:40:34.191653+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:34.191653+0000","last_peered":"2023-10-09T11:40:34.191653+0000","last_clean":"2023-10-09T11:40:34.191653+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:34.191653+0000","last_undegraded":"2023-10-09T11:40:34.191653+0000","last_fullsized":"2023-10-09T11:40:34.191653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073048,"statfs":{"total":96636764160,"available":96330801152,"internally_reserved":0,"allocated":1540096,"data_stored":994894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.747},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.59099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":405122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.436},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.496}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":398362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.314}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.38}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.42799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":988570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.38900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.59399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":933888,"data_stored":398722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.436},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.496}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":399704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.52000000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542215,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":404456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.89200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542215,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:40:38.882 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:40:38.882 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:40:39.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.045+0000 7fc168317700 1 Processor -- start 2023-10-09T11:40:39.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.045+0000 7fc168317700 1 -- start start 2023-10-09T11:40:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc168317700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc160159530 0x7fc1600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc168317700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 0x7fc160159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc168317700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1600ccfd0 con 0x7fc16006e0e0 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc168317700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1600cf0e0 con 0x7fc160159530 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc168317700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015a3d0 con 0x7fc16006dc70 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1668b4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc16006e0e0 0x7fc1600cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40646/0 (socket says 172.21.15.26:40646) 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1668b4700 1 -- 172.21.15.26:0/3886615384 learned_addr learned my addr 172.21.15.26:0/3886615384 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 --2- 172.21.15.26:0/3886615384 >> v2:172.21.15.67:3300/0 conn(0x7fc160159530 0x7fc1600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1658b2700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 0x7fc160159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1650b1700 1 -- 172.21.15.26:0/3886615384 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222900926 0 0) 0x7fc1600ccfd0 con 0x7fc16006e0e0 2023-10-09T11:40:39.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1650b1700 1 -- 172.21.15.26:0/3886615384 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc148003570 con 0x7fc16006e0e0 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 -- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 msgr2=0x7fc160159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 0x7fc160159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 -- 172.21.15.26:0/3886615384 >> v1:172.21.15.26:6789/0 conn(0x7fc16006e0e0 legacy=0x7fc1600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 -- 172.21.15.26:0/3886615384 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16015a6b0 con 0x7fc160159530 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1658b2700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 0x7fc160159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.046+0000 7fc1660b3700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc160159530 0x7fc1600ceba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc150009e60 tx=0x7fc150009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295f5c7a41e3d700 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc1650b1700 1 -- 172.21.15.26:0/3886615384 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000e070 con 0x7fc160159530 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc1650b1700 1 -- 172.21.15.26:0/3886615384 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000bab0 con 0x7fc160159530 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc1650b1700 1 -- 172.21.15.26:0/3886615384 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000be70 con 0x7fc160159530 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 -- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc160159530 msgr2=0x7fc1600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc160159530 0x7fc1600ceba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc150009e60 tx=0x7fc150009780 comp rx=0 tx=0).stop 2023-10-09T11:40:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 -- 172.21.15.26:0/3886615384 shutdown_connections 2023-10-09T11:40:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc160159530 0x7fc1600ceba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 --2- 172.21.15.26:0/3886615384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006dc70 0x7fc160159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 -- 172.21.15.26:0/3886615384 >> 172.21.15.26:0/3886615384 conn(0x7fc1600703a0 msgr2=0x7fc1600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 -- 172.21.15.26:0/3886615384 shutdown_connections 2023-10-09T11:40:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.047+0000 7fc168317700 1 -- 172.21.15.26:0/3886615384 wait complete. 2023-10-09T11:40:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.048+0000 7fc168317700 1 Processor -- start 2023-10-09T11:40:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.048+0000 7fc168317700 1 -- start start 2023-10-09T11:40:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc16006dc70 0x7fc1600b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006e0e0 0x7fc160153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600b57b0 con 0x7fc160159530 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600b5d00 con 0x7fc16006dc70 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc168317700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600b5fe0 con 0x7fc16006e0e0 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc1668b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc1668b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45160/0 (socket says 172.21.15.26:45160) 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc1668b4700 1 -- 172.21.15.26:0/303682024 learned_addr learned my addr 172.21.15.26:0/303682024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc1660b3700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc16006dc70 0x7fc1600b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.049+0000 7fc1658b2700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006e0e0 0x7fc160153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 -- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006e0e0 msgr2=0x7fc160153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006e0e0 0x7fc160153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 -- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc16006dc70 msgr2=0x7fc1600b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc16006dc70 0x7fc1600b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 -- 172.21.15.26:0/303682024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009420 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc1668b4700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc15800c790 tx=0x7fc158007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158005c00 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158005d60 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc150009a20 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580072e0 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.050+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1600c7b10 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.051+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16004c3c0 con 0x7fc160159530 2023-10-09T11:40:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.051+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc15801b3b0 con 0x7fc160159530 2023-10-09T11:40:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.052+0000 7fc15e7fc700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 0x7fc14c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.052+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc158083bb0 con 0x7fc160159530 2023-10-09T11:40:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.052+0000 7fc1660b3700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 0x7fc14c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.053+0000 7fc1660b3700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 0x7fc14c069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc1500097c0 tx=0x7fc150019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.056+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc15804b5a0 con 0x7fc160159530 2023-10-09T11:40:39.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.332+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc16015a990 con 0x7fc160159530 2023-10-09T11:40:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.335+0000 7fc15e7fc700 1 -- 172.21.15.26:0/303682024 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc158017020 con 0x7fc160159530 2023-10-09T11:40:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 msgr2=0x7fc14c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 0x7fc14c069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc1500097c0 tx=0x7fc150019000 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 msgr2=0x7fc1600b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc15800c790 tx=0x7fc158007d90 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 shutdown_connections 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc160159530 0x7fc1600b1a60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc16006dc70 0x7fc1600b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc14c067170 0x7fc14c069620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 --2- 172.21.15.26:0/303682024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc16006e0e0 0x7fc160153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 >> 172.21.15.26:0/303682024 conn(0x7fc1600703a0 msgr2=0x7fc16015ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 shutdown_connections 2023-10-09T11:40:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.338+0000 7fc168317700 1 -- 172.21.15.26:0/303682024 wait complete. 2023-10-09T11:40:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:40:39.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.469+0000 7f00b553d700 1 Processor -- start 2023-10-09T11:40:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.469+0000 7f00b553d700 1 -- start start 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00b553d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00b553d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b015e010 con 0x7f00b00cb1a0 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00b553d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b015d420 con 0x7f00b01598a0 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00b553d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b015d6e0 con 0x7f00b01594d0 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00ae7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f00b00cb1a0 0x7f00b00ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40648/0 (socket says 172.21.15.26:40648) 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00ae7fc700 1 -- 172.21.15.26:0/658443539 learned_addr learned my addr 172.21.15.26:0/658443539 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00aeffd700 1 --2- 172.21.15.26:0/658443539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141544169 0 0) 0x7f00b015e010 con 0x7f00b00cb1a0 2023-10-09T11:40:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f009c003570 con 0x7f00b00cb1a0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906604094 0 0) 0x7f00b015d420 con 0x7f00b01598a0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b015e010 con 0x7f00b01598a0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00aeffd700 1 -- 172.21.15.26:0/658443539 >> v1:172.21.15.67:6789/0 conn(0x7f00b01598a0 legacy=0x7f00b0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00aeffd700 1 -- 172.21.15.26:0/658443539 >> v1:172.21.15.26:6789/0 conn(0x7f00b00cb1a0 legacy=0x7f00b00ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.470+0000 7f00aeffd700 1 -- 172.21.15.26:0/658443539 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b015d9c0 con 0x7f00b01594d0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00aeffd700 1 --2- 172.21.15.26:0/658443539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b00cea70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009910 tx=0x7f00a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2066225b211b23d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8011630 con 0x7f00b01594d0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8011790 con 0x7f00b01594d0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00adffb700 1 -- 172.21.15.26:0/658443539 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8011b30 con 0x7f00b01594d0 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 -- 172.21.15.26:0/658443539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 msgr2=0x7f00b00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 --2- 172.21.15.26:0/658443539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b00cea70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009910 tx=0x7f00a80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 -- 172.21.15.26:0/658443539 shutdown_connections 2023-10-09T11:40:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 --2- 172.21.15.26:0/658443539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b00cea70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 -- 172.21.15.26:0/658443539 >> 172.21.15.26:0/658443539 conn(0x7f00b00703a0 msgr2=0x7f00b0070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.471+0000 7f00b553d700 1 -- 172.21.15.26:0/658443539 shutdown_connections 2023-10-09T11:40:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.472+0000 7f00b553d700 1 -- 172.21.15.26:0/658443539 wait complete. 2023-10-09T11:40:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.473+0000 7f00b553d700 1 Processor -- start 2023-10-09T11:40:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.473+0000 7f00b553d700 1 -- start start 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.473+0000 7f00b553d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b00cb1a0 0x7f00b0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b0148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0151ea0 con 0x7f00b01598a0 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0152180 con 0x7f00b00cb1a0 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0152460 con 0x7f00b01594d0 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45168/0 (socket says 172.21.15.26:45168) 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 -- 172.21.15.26:0/3458444544 learned_addr learned my addr 172.21.15.26:0/3458444544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00aeffd700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b00cb1a0 0x7f00b0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00ae7fc700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b0148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 -- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 msgr2=0x7f00b0148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b0148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 -- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b00cb1a0 msgr2=0x7f00b0151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b00cb1a0 0x7f00b0151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 -- 172.21.15.26:0/3458444544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009420 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00af7fe700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c860 tx=0x7f00a0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0002030 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00021b0 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b0152740 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0012630 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.474+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01494b0 con 0x7f00b01598a0 2023-10-09T11:40:39.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.475+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00c7840 con 0x7f00b01598a0 2023-10-09T11:40:39.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.476+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f00a0012a20 con 0x7f00b01598a0 2023-10-09T11:40:39.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.476+0000 7f00a6ffd700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 0x7f0090069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.476+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00a00848a0 con 0x7f00b01598a0 2023-10-09T11:40:39.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.476+0000 7f00aeffd700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 0x7f0090069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.477+0000 7f00aeffd700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 0x7f0090069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00b00ce520 tx=0x7f00a8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.480+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00a00517b0 con 0x7f00b01598a0 2023-10-09T11:40:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.717+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00b004c3c0 con 0x7f00b01598a0 2023-10-09T11:40:39.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.718+0000 7f00a6ffd700 1 -- 172.21.15.26:0/3458444544 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f00a0054dd0 con 0x7f00b01598a0 2023-10-09T11:40:39.718 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:39.718 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 msgr2=0x7f0090069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 0x7f0090069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00b00ce520 tx=0x7f00a8017000 comp rx=0 tx=0).stop 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 msgr2=0x7f00b016cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c860 tx=0x7f00a0002700 comp rx=0 tx=0).stop 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 shutdown_connections 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b01598a0 0x7f00b016cf70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b00cb1a0 0x7f00b0151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0090067170 0x7f0090069620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 --2- 172.21.15.26:0/3458444544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00b01594d0 0x7f00b0148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 >> 172.21.15.26:0/3458444544 conn(0x7f00b00703a0 msgr2=0x7f00b0149960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 shutdown_connections 2023-10-09T11:40:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:39.720+0000 7f00b553d700 1 -- 172.21.15.26:0/3458444544 wait complete. 2023-10-09T11:40:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 48 2023-10-09T11:40:40.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:40:33.774944+0000', 'modified': '2023-10-09T11:40:37.391327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6117': {'gid': 6117, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/2829870297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 2829870297}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 2829870297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:40:40.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:40:40.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:40:40.185 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-10-09T11:40:40.185+0000 7ff3289d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:40:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.260+0000 7f879f512700 1 Processor -- start 2023-10-09T11:40:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.260+0000 7f879f512700 1 -- start start 2023-10-09T11:40:40.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87980cb5a0 0x7f87980cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f87980cde50 0x7f879815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980d13f0 con 0x7f87980cb5a0 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879815a940 con 0x7f87980cde50 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879f512700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879815ae40 con 0x7f87980cd9e0 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.261+0000 7f879d2ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87980cb5a0 0x7f87980cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87980cb5a0 0x7f87980cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48592/0 (socket says 172.21.15.26:48592) 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 -- 172.21.15.26:0/2740013030 learned_addr learned my addr 172.21.15.26:0/2740013030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879caad700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879daaf700 1 --2- 172.21.15.26:0/2740013030 >> v2:172.21.15.67:3300/0 conn(0x7f87980cde50 0x7f879815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 -- 172.21.15.26:0/2740013030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 msgr2=0x7f8798159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 -- 172.21.15.26:0/2740013030 >> v2:172.21.15.67:3300/0 conn(0x7f87980cde50 msgr2=0x7f879815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2740013030 >> v2:172.21.15.67:3300/0 conn(0x7f87980cde50 0x7f879815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 -- 172.21.15.26:0/2740013030 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879815ab60 con 0x7f87980cb5a0 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87980cb5a0 0x7f87980cb970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87980cbeb0 tx=0x7f8790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563c8f846af3a8db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f8797fff700 1 -- 172.21.15.26:0/2740013030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000b820 con 0x7f87980cb5a0 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f8797fff700 1 -- 172.21.15.26:0/2740013030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879000b980 con 0x7f87980cb5a0 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.262+0000 7f8797fff700 1 -- 172.21.15.26:0/2740013030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000bd20 con 0x7f87980cb5a0 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 -- 172.21.15.26:0/2740013030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87980cb5a0 msgr2=0x7f87980cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87980cb5a0 0x7f87980cb970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87980cbeb0 tx=0x7f8790009250 comp rx=0 tx=0).stop 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 -- 172.21.15.26:0/2740013030 shutdown_connections 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 --2- 172.21.15.26:0/2740013030 >> v2:172.21.15.67:3300/0 conn(0x7f87980cde50 0x7f879815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87980cb5a0 0x7f87980cb970 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 --2- 172.21.15.26:0/2740013030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 -- 172.21.15.26:0/2740013030 >> 172.21.15.26:0/2740013030 conn(0x7f8798070e30 msgr2=0x7f87980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 -- 172.21.15.26:0/2740013030 shutdown_connections 2023-10-09T11:40:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.263+0000 7f879f512700 1 -- 172.21.15.26:0/2740013030 wait complete. 2023-10-09T11:40:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.264+0000 7f879f512700 1 Processor -- start 2023-10-09T11:40:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.264+0000 7f879f512700 1 -- start start 2023-10-09T11:40:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87980cb5a0 0x7f8798141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879815a0b0 con 0x7f8798157330 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798159010 con 0x7f87980cb5a0 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879f512700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87981592f0 con 0x7f87980cd9e0 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48594/0 (socket says 172.21.15.26:48594) 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 -- 172.21.15.26:0/2185406958 learned_addr learned my addr 172.21.15.26:0/2185406958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879caad700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 -- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 msgr2=0x7f8798156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87980cb5a0 0x7f8798141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 -- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87980cb5a0 msgr2=0x7f8798141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87980cb5a0 0x7f8798141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 -- 172.21.15.26:0/2185406958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900094f0 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879caad700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f879daaf700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8788007f20 tx=0x7f8788009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.265+0000 7f87957fa700 1 -- 172.21.15.26:0/2185406958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800eca0 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.266+0000 7f87957fa700 1 -- 172.21.15.26:0/2185406958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800ee20 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.266+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87981595d0 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.266+0000 7f87957fa700 1 -- 172.21.15.26:0/2185406958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788014670 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.266+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798159b90 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.267+0000 7f87957fa700 1 -- 172.21.15.26:0/2185406958 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f87880149e0 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.267+0000 7f87957fa700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 0x7f8784069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.267+0000 7f87957fa700 1 -- 172.21.15.26:0/2185406958 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8788084f10 con 0x7f8798157330 2023-10-09T11:40:40.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.267+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 0x7f8784069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.268+0000 7f879d2ae700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 0x7f8784069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f87980cbeb0 tx=0x7f8790017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.269+0000 7f87a880ab80 1 Processor -- start 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.269+0000 7f87a880ab80 1 -- start start 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f5093e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f4feaa70 con 0x5638f50bcf60 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f4fe8270 con 0x5638f50ddd00 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638f4fe4060 con 0x5638f5093a50 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48596/0 (socket says 172.21.15.26:48596) 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 -- 172.21.15.26:0/4227373173 learned_addr learned my addr 172.21.15.26:0/4227373173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879d2ae700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f5093e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879caad700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 -- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 msgr2=0x5638f5093e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f5093e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 -- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 msgr2=0x5638f50bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879daaf700 1 -- 172.21.15.26:0/4227373173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638f4e7e270 con 0x5638f50bcf60 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.270+0000 7f879caad700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f879daaf700 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8788083130 tx=0x7f8788055980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25249288f38f2000 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f877e7fc700 1 -- 172.21.15.26:0/4227373173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788058e00 con 0x5638f50bcf60 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f877e7fc700 1 -- 172.21.15.26:0/4227373173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878805cb50 con 0x5638f50bcf60 2023-10-09T11:40:40.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f877e7fc700 1 -- 172.21.15.26:0/4227373173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788055e10 con 0x5638f50bcf60 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 -- 172.21.15.26:0/4227373173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 msgr2=0x5638f508fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8788083130 tx=0x7f8788055980 comp rx=0 tx=0).stop 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 -- 172.21.15.26:0/4227373173 shutdown_connections 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f508fcf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f5093e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4227373173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 -- 172.21.15.26:0/4227373173 >> 172.21.15.26:0/4227373173 conn(0x5638f5095370 msgr2=0x5638f5095740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 -- 172.21.15.26:0/4227373173 shutdown_connections 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.271+0000 7f87a880ab80 1 -- 172.21.15.26:0/4227373173 wait complete. 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.272+0000 7f87a880ab80 1 -- start start 2023-10-09T11:40:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.272+0000 7f87a880ab80 1 Processor -- start 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f5093a50 0x5638f50d4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50bcf60 0x5638f50be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f4f8f890 con 0x5638f50ddd00 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f4faaea0 con 0x5638f5093a50 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638f4e66e30 con 0x5638f50bcf60 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f87a880ab80 10 client.0 _ll_register_callbacks cb 0x5638f5057110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48600/0 (socket says 172.21.15.26:48600) 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 -- 172.21.15.26:0/239758816 learned_addr learned my addr 172.21.15.26:0/239758816 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879d2ae700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f5093a50 0x5638f50d4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879caad700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50bcf60 0x5638f50be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 -- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50bcf60 msgr2=0x5638f50be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50bcf60 0x5638f50be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 -- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f5093a50 msgr2=0x5638f50d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f5093a50 0x5638f50d4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.273+0000 7f879daaf700 1 -- 172.21.15.26:0/239758816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798159b90 con 0x5638f50ddd00 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f879daaf700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f878800c040 tx=0x7f8788069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b9fd101243141c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788082070 con 0x5638f50ddd00 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638f5088b70 con 0x5638f50ddd00 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87880552f0 con 0x5638f50ddd00 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87880099c0 con 0x5638f50ddd00 2023-10-09T11:40:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 10 client.6267 fetch_fsmap learned FSMap version 48 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x5638f4e20fe0 con 0x5638f50ddd00 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5638f5088b70 con 0x5638f50ddd00 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8788056bc0 con 0x5638f50ddd00 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 10 client.6267 fetch_fsmap finished waiting for FSMap version 48 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 10 client.6267 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 20 client.6267 populate_metadata read hostname 'smithi026' 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f508ec20 0x5638f508eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 4 client.6267 mds_command: new command op to 6117 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 --> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638f5065aa0 con 0x5638f508ec20 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.274+0000 7f879d2ae700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f508ec20 0x5638f508eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87777fe700 10 client.6267 ms_handle_connect on v2:172.21.15.26:6833/2829870297 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f879d2ae700 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f508ec20 0x5638f508eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfda17234f00c14 server_cookie=56eb514f0aa24d97 in_seq=0 out_seq=0 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87777fe700 1 -- 172.21.15.26:0/239758816 <== mds.0 v2:172.21.15.26:6833/2829870297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5638f5065aa0 con 0x5638f508ec20 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87777fe700 10 client.6267 handle_command_reply: tid=0 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 client.6267 shutdown 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 msgr2=0x5638f50d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f878800c040 tx=0x7f8788069000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 shutdown_connections 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f508ec20 0x5638f508eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50ddd00 0x5638f50d25c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f5093a50 0x5638f50d4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 --2- 172.21.15.26:0/239758816 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50bcf60 0x5638f50be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87777fe700 0 client.6267 ms_handle_reset on v2:172.21.15.26:6833/2829870297 2023-10-09T11:40:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.275+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 >> 172.21.15.26:0/239758816 conn(0x5638f5095370 msgr2=0x5638f508fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.276+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 shutdown_connections 2023-10-09T11:40:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.276+0000 7f87a880ab80 1 -- 172.21.15.26:0/239758816 wait complete. 2023-10-09T11:40:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.276+0000 7f87a880ab80 20 client.6267 trim_cache size 0 max 16384 2023-10-09T11:40:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.292+0000 7f87a880ab80 1 Processor -- start 2023-10-09T11:40:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 -- start start 2023-10-09T11:40:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f50c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f50c37c0 con 0x5638f50bcf60 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f50d2640 con 0x5638f50ddd00 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638f5093370 con 0x5638f5093a50 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f879caad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f879caad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48608/0 (socket says 172.21.15.26:48608) 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f879caad700 1 -- 172.21.15.26:0/3689076746 learned_addr learned my addr 172.21.15.26:0/3689076746 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f879d2ae700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f50c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.293+0000 7f879daaf700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 -- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 msgr2=0x5638f50c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f50c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 -- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 msgr2=0x5638f50bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 -- 172.21.15.26:0/3689076746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638f4fb2780 con 0x5638f50bcf60 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879d2ae700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f50c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f879caad700 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f878c009da0 tx=0x7f878c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20092be3f45b0f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f877effd700 1 -- 172.21.15.26:0/3689076746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c009970 con 0x5638f50bcf60 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f877effd700 1 -- 172.21.15.26:0/3689076746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c00c070 con 0x5638f50bcf60 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f877effd700 1 -- 172.21.15.26:0/3689076746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c013d10 con 0x5638f50bcf60 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 -- 172.21.15.26:0/3689076746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 msgr2=0x5638f50bf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f878c009da0 tx=0x7f878c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 -- 172.21.15.26:0/3689076746 shutdown_connections 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50ddd00 0x5638f50bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f5093a50 0x5638f50c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 --2- 172.21.15.26:0/3689076746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f50bcf60 0x5638f50bf2d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 -- 172.21.15.26:0/3689076746 >> 172.21.15.26:0/3689076746 conn(0x5638f5095370 msgr2=0x5638f508c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 -- 172.21.15.26:0/3689076746 shutdown_connections 2023-10-09T11:40:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.294+0000 7f87a880ab80 1 -- 172.21.15.26:0/3689076746 wait complete. 2023-10-09T11:40:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.295+0000 7f87a880ab80 1 -- start start 2023-10-09T11:40:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.295+0000 7f87a880ab80 1 Processor -- start 2023-10-09T11:40:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50bcf60 0x5638f50beff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50ddd00 0x5638f50bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f513fd10 con 0x5638f5093a50 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638f50f9e20 con 0x5638f50bcf60 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638f5094cc0 con 0x5638f50ddd00 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87a880ab80 10 client.0 _ll_register_callbacks cb 0x5638f5057110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48624/0 (socket says 172.21.15.26:48624) 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 -- 172.21.15.26:0/4191622251 learned_addr learned my addr 172.21.15.26:0/4191622251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 -- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50ddd00 msgr2=0x5638f50bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50ddd00 0x5638f50bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 -- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50bcf60 msgr2=0x5638f50beff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50bcf60 0x5638f50beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 -- 172.21.15.26:0/4191622251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c009b00 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f879d2ae700 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f879806ea60 tx=0x7f8790014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f7fff569aaf9c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.296+0000 7f87777fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879002f040 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87900356a0 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f878805cb50 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8790035a90 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 10 client.6273 fetch_fsmap learned FSMap version 48 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x5638f4f99470 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878805cb50 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8790035bf0 con 0x5638f5093a50 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 10 client.6273 fetch_fsmap finished waiting for FSMap version 48 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 10 client.6273 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:40:40.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 20 client.6273 populate_metadata read hostname 'smithi026' 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f5143870 0x5638f5143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 4 client.6273 mds_command: new command op to 6117 tid=0[{"prefix": "status"}] 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 --> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5638f4f86e00 con 0x5638f5143870 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f879caad700 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f5143870 0x5638f5143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f87777fe700 10 client.6273 ms_handle_connect on v2:172.21.15.26:6833/2829870297 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.297+0000 7f879caad700 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f5143870 0x5638f5143c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260fc9d414d87d9f server_cookie=1d6ff8064e49653a in_seq=0 out_seq=0 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87777fe700 1 -- 172.21.15.26:0/4191622251 <== mds.0 v2:172.21.15.26:6833/2829870297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5638f4f86e00 con 0x5638f5143870 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87777fe700 10 client.6273 handle_command_reply: tid=0 2023-10-09T11:40:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 client.6273 shutdown 2023-10-09T11:40:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 msgr2=0x5638f513f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f879806ea60 tx=0x7f8790014000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 shutdown_connections 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5638f50ddd00 0x5638f50bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:6833/2829870297,v1:172.21.15.26:6835/2829870297] conn(0x5638f5143870 0x5638f5143c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5638f5093a50 0x5638f513f7d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 --2- 172.21.15.26:0/4191622251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5638f50bcf60 0x5638f50beff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87777fe700 0 client.6273 ms_handle_reset on v2:172.21.15.26:6833/2829870297 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 >> 172.21.15.26:0/4191622251 conn(0x5638f5095370 msgr2=0x5638f50f3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 shutdown_connections 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 1 -- 172.21.15.26:0/4191622251 wait complete. 2023-10-09T11:40:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f87a880ab80 20 client.6273 trim_cache size 0 max 16384 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6117, 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9258719270000002, 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 48, 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 77, 2023-10-09T11:40:40.307 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 77, 2023-10-09T11:40:40.308 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 10.995470879000001 2023-10-09T11:40:40.308 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 msgr2=0x7f8784069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 0x7f8784069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f87980cbeb0 tx=0x7f8790017000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 msgr2=0x7f87980c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.298+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8788007f20 tx=0x7f8788009860 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 shutdown_connections 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8798157330 0x7f87980c6760 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87980cb5a0 0x7f8798141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8784067170 0x7f8784069620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 --2- 172.21.15.26:0/2185406958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87980cd9e0 0x7f8798156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 >> 172.21.15.26:0/2185406958 conn(0x7f8798070e30 msgr2=0x7f87980d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 shutdown_connections 2023-10-09T11:40:40.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.299+0000 7f879f512700 1 -- 172.21.15.26:0/2185406958 wait complete. 2023-10-09T11:40:40.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.429+0000 7f7dcd5fd700 1 Processor -- start 2023-10-09T11:40:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.429+0000 7f7dcd5fd700 1 -- start start 2023-10-09T11:40:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dcd5fd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7dc80ce8c0 0x7f7dc8164610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dcd5fd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80b1c00 con 0x7f7dc80cdd10 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dcd5fd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80b12d0 con 0x7f7dc81594a0 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dcd5fd700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80cede0 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dc67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7dc80cdd10 0x7f7dc80ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56224/0 (socket says 172.21.15.26:56224) 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dc67fc700 1 -- 172.21.15.26:0/2565077747 learned_addr learned my addr 172.21.15.26:0/2565077747 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dc77fe700 1 --2- 172.21.15.26:0/2565077747 >> v2:172.21.15.67:3300/0 conn(0x7f7dc80ce8c0 0x7f7dc8164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421894879 0 0) 0x7f7dc80b1c00 con 0x7f7dc80cdd10 2023-10-09T11:40:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.430+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db4003570 con 0x7f7dc80cdd10 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc77fe700 1 -- 172.21.15.26:0/2565077747 >> v1:172.21.15.67:6789/0 conn(0x7f7dc81594a0 legacy=0x7f7dc80cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461069255 0 0) 0x7f7db4003570 con 0x7f7dc80cdd10 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc77fe700 1 -- 172.21.15.26:0/2565077747 >> v1:172.21.15.26:6789/0 conn(0x7f7dc80cdd10 legacy=0x7f7dc80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc77fe700 1 -- 172.21.15.26:0/2565077747 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80b15b0 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc77fe700 1 --2- 172.21.15.26:0/2565077747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc8164610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009e60 tx=0x7f7dc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9729721fe763c3d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000e070 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000b850 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.431+0000 7f7dc5ffb700 1 -- 172.21.15.26:0/2565077747 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0001470 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2565077747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 msgr2=0x7f7dc8164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2565077747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc8164610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009e60 tx=0x7f7dc0009780 comp rx=0 tx=0).stop 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2565077747 shutdown_connections 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2565077747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc8164610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2565077747 >> 172.21.15.26:0/2565077747 conn(0x7f7dc8067da0 msgr2=0x7f7dc80681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2565077747 shutdown_connections 2023-10-09T11:40:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.432+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2565077747 wait complete. 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.433+0000 7f7dcd5fd700 1 Processor -- start 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.433+0000 7f7dcd5fd700 1 -- start start 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dc81594a0 0x7f7dc815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815f180 con 0x7f7dc80cdd10 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815f460 con 0x7f7dc80ce8c0 2023-10-09T11:40:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815f740 con 0x7f7dc81594a0 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48626/0 (socket says 172.21.15.26:48626) 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 -- 172.21.15.26:0/2201412490 learned_addr learned my addr 172.21.15.26:0/2201412490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc67fc700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 -- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dc81594a0 msgr2=0x7f7dc815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dc81594a0 0x7f7dc815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 -- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 msgr2=0x7f7dc815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 -- 172.21.15.26:0/2201412490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0009a20 con 0x7f7dc80cdd10 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dc6ffd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7db800c5c0 tx=0x7f7db800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8012630 con 0x7f7dc80cdd10 2023-10-09T11:40:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db80127b0 con 0x7f7dc80cdd10 2023-10-09T11:40:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc815fa20 con 0x7f7dc80cdd10 2023-10-09T11:40:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8012b70 con 0x7f7dc80cdd10 2023-10-09T11:40:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.434+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc8159db0 con 0x7f7dc80cdd10 2023-10-09T11:40:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.435+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80ae250 con 0x7f7dc80cdd10 2023-10-09T11:40:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.436+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7db801b400 con 0x7f7dc80cdd10 2023-10-09T11:40:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.436+0000 7f7dbeffd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 0x7f7da8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.436+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7db8084430 con 0x7f7dc80cdd10 2023-10-09T11:40:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.436+0000 7f7dc67fc700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 0x7f7da8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.437+0000 7f7dc67fc700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 0x7f7da8069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7db00015a0 tx=0x7f7db0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.440+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7db8051410 con 0x7f7dc80cdd10 2023-10-09T11:40:40.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.679+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7dc804c3c0 con 0x7f7dc80cdd10 2023-10-09T11:40:40.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.679+0000 7f7dbeffd700 1 -- 172.21.15.26:0/2201412490 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7db8054a30 con 0x7f7dc80cdd10 2023-10-09T11:40:40.680 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 msgr2=0x7f7da8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 0x7f7da8069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7db00015a0 tx=0x7f7db0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 msgr2=0x7f7dc8159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7db800c5c0 tx=0x7f7db800c980 comp rx=0 tx=0).stop 2023-10-09T11:40:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 shutdown_connections 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7da8067170 0x7f7da8069620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7dc81594a0 0x7f7dc815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc80cdd10 0x7f7dc8159870 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.681+0000 7f7dcd5fd700 1 --2- 172.21.15.26:0/2201412490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dc80ce8c0 0x7f7dc815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.682+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 >> 172.21.15.26:0/2201412490 conn(0x7f7dc8067da0 msgr2=0x7f7dc806e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.682+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 shutdown_connections 2023-10-09T11:40:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:40.682+0000 7f7dcd5fd700 1 -- 172.21.15.26:0/2201412490 wait complete. 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:40.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:40.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.695 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.710 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42152sec preferred_lft 42152sec 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.711 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:40:40.712 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.713 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:40.713 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:40:40.713 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:40:40.713 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:40.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.713 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:40.774 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:40:40.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.776 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:40:40.832 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:40:40.833 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:40.833 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:40:40.833 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:40:40.833 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:40.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.833 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:40:40.833 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:40:40.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:40:40.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:40:40.834 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:40:40.834 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:40:40.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.935 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:40:40.950 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:40:40.950 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:40:40.950 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:40.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:40.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:40:41.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:41.015 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:41.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:41.071 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:41.124 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:40:41.124 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:41.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:41.205 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:41.205 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:40:41.247 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:41.248 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:41.248 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:41.248 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:40:41.248 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:40:41.248 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:40:41.250 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:40:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:41.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:41.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.477+0000 7f56bee4e700 1 Processor -- start 2023-10-09T11:40:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.477+0000 7f56bee4e700 1 -- start start 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.477+0000 7f56bee4e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f56b80cb5a0 0x7f56b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.477+0000 7f56bee4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56b815a5d0 0x7f56b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bee4e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b815ae40 con 0x7f56b80cd9e0 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bee4e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80d13f0 con 0x7f56b815a5d0 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bee4e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b815ab60 con 0x7f56b80cb5a0 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56b815a5d0 0x7f56b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56b815a5d0 0x7f56b8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48640/0 (socket says 172.21.15.26:48640) 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 -- 172.21.15.26:0/396893795 learned_addr learned my addr 172.21.15.26:0/396893795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bcbea700 1 --2- 172.21.15.26:0/396893795 >> v2:172.21.15.67:3300/0 conn(0x7f56b80cb5a0 0x7f56b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 -- 172.21.15.26:0/396893795 >> v2:172.21.15.67:3300/0 conn(0x7f56b80cb5a0 msgr2=0x7f56b80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 --2- 172.21.15.26:0/396893795 >> v2:172.21.15.67:3300/0 conn(0x7f56b80cb5a0 0x7f56b80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 -- 172.21.15.26:0/396893795 >> v1:172.21.15.67:6789/0 conn(0x7f56b80cd9e0 legacy=0x7f56b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 -- 172.21.15.26:0/396893795 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80ccf00 con 0x7f56b815a5d0 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56bd3eb700 1 --2- 172.21.15.26:0/396893795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b815a5d0 0x7f56b8156e90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56b00099b0 tx=0x7f56b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b473396f1fb52d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56b77fe700 1 -- 172.21.15.26:0/396893795 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0009ea0 con 0x7f56b815a5d0 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56b77fe700 1 -- 172.21.15.26:0/396893795 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000b820 con 0x7f56b815a5d0 2023-10-09T11:40:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.478+0000 7f56b77fe700 1 -- 172.21.15.26:0/396893795 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000bbc0 con 0x7f56b815a5d0 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 -- 172.21.15.26:0/396893795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b815a5d0 msgr2=0x7f56b8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 --2- 172.21.15.26:0/396893795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b815a5d0 0x7f56b8156e90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56b00099b0 tx=0x7f56b0009250 comp rx=0 tx=0).stop 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 -- 172.21.15.26:0/396893795 shutdown_connections 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 --2- 172.21.15.26:0/396893795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b815a5d0 0x7f56b8156e90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 --2- 172.21.15.26:0/396893795 >> v2:172.21.15.67:3300/0 conn(0x7f56b80cb5a0 0x7f56b80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 -- 172.21.15.26:0/396893795 >> 172.21.15.26:0/396893795 conn(0x7f56b8070e30 msgr2=0x7f56b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 -- 172.21.15.26:0/396893795 shutdown_connections 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.479+0000 7f56bee4e700 1 -- 172.21.15.26:0/396893795 wait complete. 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.480+0000 7f56bee4e700 1 Processor -- start 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.480+0000 7f56bee4e700 1 -- start start 2023-10-09T11:40:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 0x7f56b8152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 0x7f56b815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b815da30 con 0x7f56b80cb5a0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8152bc0 con 0x7f56b815a5d0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bee4e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b815e380 con 0x7f56b80cd9e0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48646/0 (socket says 172.21.15.26:48646) 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 -- 172.21.15.26:0/2726681379 learned_addr learned my addr 172.21.15.26:0/2726681379 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56b7fff700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 0x7f56b8152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bd3eb700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 0x7f56b815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 -- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 msgr2=0x7f56b8152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 0x7f56b8152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 -- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 msgr2=0x7f56b815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 0x7f56b815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bcbea700 1 -- 172.21.15.26:0/2726681379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00094f0 con 0x7f56b80cb5a0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56b7fff700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 0x7f56b8152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.481+0000 7f56bd3eb700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 0x7f56b815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56bcbea700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56a000ecb0 tx=0x7f56a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000c9d0 con 0x7f56b80cb5a0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000cb30 con 0x7f56b80cb5a0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b815b410 con 0x7f56b80cb5a0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000ced0 con 0x7f56b80cb5a0 2023-10-09T11:40:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.482+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b80b4b10 con 0x7f56b80cb5a0 2023-10-09T11:40:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.483+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b804c3c0 con 0x7f56b80cb5a0 2023-10-09T11:40:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.483+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f56a0013680 con 0x7f56b80cb5a0 2023-10-09T11:40:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.484+0000 7f56b4ff9700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 0x7f5698069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.484+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56a0084c20 con 0x7f56b80cb5a0 2023-10-09T11:40:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.484+0000 7f56b7fff700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 0x7f5698069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.484+0000 7f56b7fff700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 0x7f5698069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f56b815b9d0 tx=0x7f56a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.488+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56a0051c00 con 0x7f56b80cb5a0 2023-10-09T11:40:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.726+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56b80cd1e0 con 0x7f56b80cb5a0 2023-10-09T11:40:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.727+0000 7f56b4ff9700 1 -- 172.21.15.26:0/2726681379 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56a0055220 con 0x7f56b80cb5a0 2023-10-09T11:40:41.728 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 msgr2=0x7f5698069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 0x7f5698069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f56b815b9d0 tx=0x7f56a8009040 comp rx=0 tx=0).stop 2023-10-09T11:40:41.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 msgr2=0x7f56b8152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56a000ecb0 tx=0x7f56a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 shutdown_connections 2023-10-09T11:40:41.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.728+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56b815a5d0 0x7f56b815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56b80cb5a0 0x7f56b8152d50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5698067170 0x7f5698069620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 --2- 172.21.15.26:0/2726681379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56b80cd9e0 0x7f56b8152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 >> 172.21.15.26:0/2726681379 conn(0x7f56b8070e30 msgr2=0x7f56b80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 shutdown_connections 2023-10-09T11:40:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:41.729+0000 7f56bee4e700 1 -- 172.21.15.26:0/2726681379 wait complete. 2023-10-09T11:40:41.741 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:41.742 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:41.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:40:41.742 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:40:41.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:41.743 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:41.743 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:41.743 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:41.743 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:41.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:41.744 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:40:41.764 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:41.764 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:41.764 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:41.764 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.765 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:41.765 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.765 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:41.765 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:41.765 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:40:41.766 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:41.766 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:41.766 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:40:41.766 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:41.766 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:41.767 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:41.767 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:41.767 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:40:41.767 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42165sec preferred_lft 42165sec 2023-10-09T11:40:41.767 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.768 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:40:41.769 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.769 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:41.769 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:40:41.769 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:40:41.770 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.770 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:41.770 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:40:41.770 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:40:41.771 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:41.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:41.772 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:41.832 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:40:41.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:41.834 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:40:41.894 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:40:41.894 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:41.894 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:40:41.894 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:40:41.895 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:41.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:41.896 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:40:41.896 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:40:41.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:40:41.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:40:41.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:40:41.897 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:40:42.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:42.003 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:40:42.019 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:40:42.019 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:40:42.020 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:42.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:42.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:40:42.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:42.086 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:42.143 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:42.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:42.144 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:42.199 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:40:42.199 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:42.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:42.280 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:42.280 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:42.299 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:42.299 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:42.300 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:40:42.300 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:40:42.300 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:40:42.300 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:42.301 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:42.301 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:42.321 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:42.322 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:42.322 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:40:42.322 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:40:42.322 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:40:42.322 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:42.323 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:42.323 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:42.323 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:40:42.323 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:40:42.325 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:40:42.326 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:40:42.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:42.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:42.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:40:42.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.527+0000 7f7ac4113700 1 Processor -- start 2023-10-09T11:40:42.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.527+0000 7f7ac4113700 1 -- start start 2023-10-09T11:40:42.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac4113700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac4113700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0cf330 con 0x7f7abc0cb880 2023-10-09T11:40:42.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac4113700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0cddd0 con 0x7f7abc0b04f0 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac4113700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0cead0 con 0x7f7abc0cd770 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac1eaf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7abc0cb880 0x7f7abc0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56226/0 (socket says 172.21.15.26:56226) 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac1eaf700 1 -- 172.21.15.26:0/3383432459 learned_addr learned my addr 172.21.15.26:0/3383432459 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac16ae700 1 --2- 172.21.15.26:0/3383432459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596288853 0 0) 0x7f7abc0cf330 con 0x7f7abc0cb880 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa8003570 con 0x7f7abc0cb880 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525534392 0 0) 0x7f7abc0cddd0 con 0x7f7abc0b04f0 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7abc0cf330 con 0x7f7abc0b04f0 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac16ae700 1 -- 172.21.15.26:0/3383432459 >> v1:172.21.15.67:6789/0 conn(0x7f7abc0b04f0 legacy=0x7f7abc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.528+0000 7f7ac16ae700 1 -- 172.21.15.26:0/3383432459 >> v1:172.21.15.26:6789/0 conn(0x7f7abc0cb880 legacy=0x7f7abc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac16ae700 1 -- 172.21.15.26:0/3383432459 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0cece0 con 0x7f7abc0cd770 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac16ae700 1 --2- 172.21.15.26:0/3383432459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0cbc50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009910 tx=0x7f7aac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1237462f8d16292 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac011630 con 0x7f7abc0cd770 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac011790 con 0x7f7abc0cd770 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac0ead700 1 -- 172.21.15.26:0/3383432459 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac011b10 con 0x7f7abc0cd770 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac4113700 1 -- 172.21.15.26:0/3383432459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 msgr2=0x7f7abc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac4113700 1 --2- 172.21.15.26:0/3383432459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0cbc50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009910 tx=0x7f7aac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac4113700 1 -- 172.21.15.26:0/3383432459 shutdown_connections 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac4113700 1 --2- 172.21.15.26:0/3383432459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0cbc50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.529+0000 7f7ac4113700 1 -- 172.21.15.26:0/3383432459 >> 172.21.15.26:0/3383432459 conn(0x7f7abc0703a0 msgr2=0x7f7abc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.530+0000 7f7ac4113700 1 -- 172.21.15.26:0/3383432459 shutdown_connections 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.530+0000 7f7ac4113700 1 -- 172.21.15.26:0/3383432459 wait complete. 2023-10-09T11:40:42.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 Processor -- start 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 -- start start 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7abc0cb880 0x7f7abc148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15a360 con 0x7f7abc0b04f0 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b2960 con 0x7f7abc0cb880 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac4113700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b2c40 con 0x7f7abc0cd770 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac1eaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac1eaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48656/0 (socket says 172.21.15.26:48656) 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.531+0000 7f7ac1eaf700 1 -- 172.21.15.26:0/1566275878 learned_addr learned my addr 172.21.15.26:0/1566275878 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:42.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac16ae700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7abc0cb880 0x7f7abc148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac26b0700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 -- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 msgr2=0x7f7abc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 -- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7abc0cb880 msgr2=0x7f7abc148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7abc0cb880 0x7f7abc148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 -- 172.21.15.26:0/1566275878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009420 con 0x7f7abc0b04f0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac1eaf700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c790 tx=0x7f7ab8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8005b30 con 0x7f7abc0b04f0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8005c90 con 0x7f7abc0b04f0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0b24a0 con 0x7f7abc0b04f0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8007300 con 0x7f7abc0b04f0 2023-10-09T11:40:42.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.532+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0b5800 con 0x7f7abc0b04f0 2023-10-09T11:40:42.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.533+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0af480 con 0x7f7abc0b04f0 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.534+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7ab801b3b0 con 0x7f7abc0b04f0 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.534+0000 7f7ab1ffb700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 0x7f7aa0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.534+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ab8083da0 con 0x7f7abc0b04f0 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.534+0000 7f7ac16ae700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 0x7f7aa0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.535+0000 7f7ac16ae700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 0x7f7aa0069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009860 tx=0x7f7aac017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.538+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab8050d80 con 0x7f7abc0b04f0 2023-10-09T11:40:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:42.778+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7abc15a110 con 0x7f7abc0b04f0 2023-10-09T11:40:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.242+0000 7f7ab1ffb700 1 -- 172.21.15.26:0/1566275878 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7ab80170c0 con 0x7f7abc0b04f0 2023-10-09T11:40:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 msgr2=0x7f7aa0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 0x7f7aa0069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009860 tx=0x7f7aac017000 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 msgr2=0x7f7abc16d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c790 tx=0x7f7ab8007ea0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 shutdown_connections 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7aa0067170 0x7f7aa0069620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7abc0cd770 0x7f7abc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7abc0b04f0 0x7f7abc16d9a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 --2- 172.21.15.26:0/1566275878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7abc0cb880 0x7f7abc148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 >> 172.21.15.26:0/1566275878 conn(0x7f7abc0703a0 msgr2=0x7f7abc158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 shutdown_connections 2023-10-09T11:40:43.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.245+0000 7f7ac4113700 1 -- 172.21.15.26:0/1566275878 wait complete. 2023-10-09T11:40:43.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:40:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.382+0000 7f98ae852700 1 Processor -- start 2023-10-09T11:40:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.382+0000 7f98ae852700 1 -- start start 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98ae852700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 0x7f98a8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98ae852700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98a815a400 0x7f98a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98ae852700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a815ae40 con 0x7f98a80cb5a0 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98ae852700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a80ce0f0 con 0x7f98a815a400 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98ae852700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80cbde0 con 0x7f98a80cb970 2023-10-09T11:40:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98a815a400 0x7f98a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f98a80cb5a0 0x7f98a80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56236/0 (socket says 172.21.15.26:56236) 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a7fff700 1 -- 172.21.15.26:0/3066833948 learned_addr learned my addr 172.21.15.26:0/3066833948 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 -- 172.21.15.26:0/3066833948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 msgr2=0x7f98a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a77fe700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 0x7f98a8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 0x7f98a8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 -- 172.21.15.26:0/3066833948 >> v1:172.21.15.26:6789/0 conn(0x7f98a80cb5a0 legacy=0x7f98a80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a6ffd700 1 -- 172.21.15.26:0/3066833948 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765484158 0 0) 0x7f98a815ae40 con 0x7f98a80cb5a0 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 -- 172.21.15.26:0/3066833948 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a815ab60 con 0x7f98a815a400 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a77fe700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 0x7f98a8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98acdef700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a815a400 0x7f98a8156e90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009e90 tx=0x7f98a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfbefb26c7f6652 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a6ffd700 1 -- 172.21.15.26:0/3066833948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a000e070 con 0x7f98a815a400 2023-10-09T11:40:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a6ffd700 1 -- 172.21.15.26:0/3066833948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a000bbf0 con 0x7f98a815a400 2023-10-09T11:40:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.383+0000 7f98a6ffd700 1 -- 172.21.15.26:0/3066833948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0012430 con 0x7f98a815a400 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 -- 172.21.15.26:0/3066833948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a815a400 msgr2=0x7f98a8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a815a400 0x7f98a8156e90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009e90 tx=0x7f98a0009780 comp rx=0 tx=0).stop 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 -- 172.21.15.26:0/3066833948 shutdown_connections 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a815a400 0x7f98a8156e90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 --2- 172.21.15.26:0/3066833948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a80cb970 0x7f98a8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 -- 172.21.15.26:0/3066833948 >> 172.21.15.26:0/3066833948 conn(0x7f98a8070e30 msgr2=0x7f98a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 -- 172.21.15.26:0/3066833948 shutdown_connections 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.384+0000 7f98ae852700 1 -- 172.21.15.26:0/3066833948 wait complete. 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.385+0000 7f98ae852700 1 Processor -- start 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.385+0000 7f98ae852700 1 -- start start 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a80cb5a0 0x7f98a8148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a815a400 0x7f98a80c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80b4f70 con 0x7f98a80cb970 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80b4360 con 0x7f98a80cb5a0 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98ae852700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80b4640 con 0x7f98a815a400 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48676/0 (socket says 172.21.15.26:48676) 2023-10-09T11:40:43.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 -- 172.21.15.26:0/3177233247 learned_addr learned my addr 172.21.15.26:0/3177233247 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98acdef700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a815a400 0x7f98a80c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a7fff700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a80cb5a0 0x7f98a8148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 -- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a815a400 msgr2=0x7f98a80c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a815a400 0x7f98a80c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 -- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a80cb5a0 msgr2=0x7f98a8148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a80cb5a0 0x7f98a8148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.386+0000 7f98a77fe700 1 -- 172.21.15.26:0/3177233247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0009a20 con 0x7f98a80cb970 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f98a77fe700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c830 tx=0x7f989c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011600 con 0x7f98a80cb970 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c011760 con 0x7f98a80cb970 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a80b4920 con 0x7f98a80cb970 2023-10-09T11:40:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011b20 con 0x7f98a80cb970 2023-10-09T11:40:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.387+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a80b3ff0 con 0x7f98a80cb970 2023-10-09T11:40:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.388+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a80b5120 con 0x7f98a80cb970 2023-10-09T11:40:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.388+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f989c00a3e0 con 0x7f98a80cb970 2023-10-09T11:40:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.389+0000 7f988ffff700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 0x7f9894069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.389+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f989c084de0 con 0x7f98a80cb970 2023-10-09T11:40:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.389+0000 7f98a7fff700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 0x7f9894069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.389+0000 7f98a7fff700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 0x7f9894069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f989800c8f0 tx=0x7f9898009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.393+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98a80b5120 con 0x7f98a80cb970 2023-10-09T11:40:43.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.618+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a804c3c0 con 0x7f9894067170 2023-10-09T11:40:43.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.620+0000 7f988ffff700 1 -- 172.21.15.26:0/3177233247 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f98a804c3c0 con 0x7f9894067170 2023-10-09T11:40:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:40:43.621 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:43.621 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:40:43.621 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:40:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 msgr2=0x7f9894069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 0x7f9894069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f989800c8f0 tx=0x7f9898009040 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 msgr2=0x7f98a80b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c830 tx=0x7f989c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 shutdown_connections 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9894067170 0x7f9894069620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98a815a400 0x7f98a80c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a80cb5a0 0x7f98a8148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 --2- 172.21.15.26:0/3177233247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80cb970 0x7f98a80b5400 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 >> 172.21.15.26:0/3177233247 conn(0x7f98a8070e30 msgr2=0x7f98a80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 shutdown_connections 2023-10-09T11:40:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.622+0000 7f98ae852700 1 -- 172.21.15.26:0/3177233247 wait complete. 2023-10-09T11:40:43.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:40:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.762+0000 7f40da071700 1 Processor -- start 2023-10-09T11:40:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.762+0000 7f40da071700 1 -- start start 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40da071700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40d40b1150 0x7f40d40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40da071700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d40adbc0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40da071700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d40c9d30 con 0x7f40d40c8800 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40da071700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d40acfb0 con 0x7f40d40b1150 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40d2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f40d40c8bd0 0x7f40d40b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56242/0 (socket says 172.21.15.26:56242) 2023-10-09T11:40:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40d2ffd700 1 -- 172.21.15.26:0/601088834 learned_addr learned my addr 172.21.15.26:0/601088834 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40d3fff700 1 --2- 172.21.15.26:0/601088834 >> v2:172.21.15.67:3300/0 conn(0x7f40d40b1150 0x7f40d40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833498599 0 0) 0x7f40d40adbc0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.763+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc003570 con 0x7f40d40c8bd0 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345145862 0 0) 0x7f40d40c9d30 con 0x7f40d40c8800 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d40adbc0 con 0x7f40d40c8800 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d3fff700 1 -- 172.21.15.26:0/601088834 >> v1:172.21.15.67:6789/0 conn(0x7f40d40c8800 legacy=0x7f40d40c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d3fff700 1 -- 172.21.15.26:0/601088834 >> v1:172.21.15.26:6789/0 conn(0x7f40d40c8bd0 legacy=0x7f40d40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346279751 0 0) 0x7f40bc003570 con 0x7f40d40c8bd0 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d3fff700 1 -- 172.21.15.26:0/601088834 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40ad290 con 0x7f40d40b1150 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d3fff700 1 --2- 172.21.15.26:0/601088834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40b1150 0x7f40d40ae050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009e60 tx=0x7f40cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47985045a34871d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00e070 con 0x7f40d40b1150 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc00b7a0 con 0x7f40d40b1150 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.764+0000 7f40d27fc700 1 -- 172.21.15.26:0/601088834 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8001470 con 0x7f40d40b1150 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 -- 172.21.15.26:0/601088834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40b1150 msgr2=0x7f40d40ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 --2- 172.21.15.26:0/601088834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40b1150 0x7f40d40ae050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009e60 tx=0x7f40cc009780 comp rx=0 tx=0).stop 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 -- 172.21.15.26:0/601088834 shutdown_connections 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 --2- 172.21.15.26:0/601088834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40b1150 0x7f40d40ae050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 -- 172.21.15.26:0/601088834 >> 172.21.15.26:0/601088834 conn(0x7f40d406d170 msgr2=0x7f40d40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 -- 172.21.15.26:0/601088834 shutdown_connections 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.765+0000 7f40da071700 1 -- 172.21.15.26:0/601088834 wait complete. 2023-10-09T11:40:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.766+0000 7f40da071700 1 Processor -- start 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.766+0000 7f40da071700 1 -- start start 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d40b1150 0x7f40d4167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40c8800 0x7f40d4168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41695d0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41689c0 con 0x7f40d40c8800 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d4168ca0 con 0x7f40d40b1150 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48682/0 (socket says 172.21.15.26:48682) 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 -- 172.21.15.26:0/653651580 learned_addr learned my addr 172.21.15.26:0/653651580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d2ffd700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40c8800 0x7f40d4168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d37fe700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d40b1150 0x7f40d4167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 -- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d40b1150 msgr2=0x7f40d4167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d40b1150 0x7f40d4167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 -- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40c8800 msgr2=0x7f40d4168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40c8800 0x7f40d4168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 -- 172.21.15.26:0/653651580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009a20 con 0x7f40d40c8bd0 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40d3fff700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f40d406e1f0 tx=0x7f40cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc012cd0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc012e30 con 0x7f40d40c8bd0 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d4168f80 con 0x7f40d40c8bd0 2023-10-09T11:40:43.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc01d6c0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.767+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d41686d0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.768+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d404c3c0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.769+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f40cc01da70 con 0x7f40d40c8bd0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.769+0000 7f40bb7fe700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 0x7f40c0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.769+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40cc086810 con 0x7f40d40c8bd0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.769+0000 7f40d37fe700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 0x7f40c0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.770+0000 7f40d37fe700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 0x7f40c0069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40d40a6f60 tx=0x7f40c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.774+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40cc053610 con 0x7f40d40c8bd0 2023-10-09T11:40:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.967+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f40d406d6b0 con 0x7f40d40c8bd0 2023-10-09T11:40:43.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.967+0000 7f40bb7fe700 1 -- 172.21.15.26:0/653651580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40cc056c30 con 0x7f40d40c8bd0 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 msgr2=0x7f40c0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 0x7f40c0069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40d40a6f60 tx=0x7f40c4009040 comp rx=0 tx=0).stop 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 msgr2=0x7f40d413e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f40d406e1f0 tx=0x7f40cc017000 comp rx=0 tx=0).stop 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 shutdown_connections 2023-10-09T11:40:43.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40d40c8bd0 0x7f40d413e9f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f40c0067170 0x7f40c0069620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d40b1150 0x7f40d4167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 --2- 172.21.15.26:0/653651580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d40c8800 0x7f40d4168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 >> 172.21.15.26:0/653651580 conn(0x7f40d406d170 msgr2=0x7f40d40cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 shutdown_connections 2023-10-09T11:40:43.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:43.969+0000 7f40da071700 1 -- 172.21.15.26:0/653651580 wait complete. 2023-10-09T11:40:43.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000381635 2023-10-09T11:40:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.105+0000 7f0c91397700 1 Processor -- start 2023-10-09T11:40:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.105+0000 7f0c91397700 1 -- start start 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c91397700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c8c159550 0x7f0c8c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c91397700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0acc00 con 0x7f0c8c15dfd0 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c91397700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0abff0 con 0x7f0c8c159920 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c91397700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0ac2d0 con 0x7f0c8c159550 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c8c159550 0x7f0c8c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c8c15dfd0 0x7f0c8c0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56248/0 (socket says 172.21.15.26:56248) 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/3313366814 learned_addr learned my addr 172.21.15.26:0/3313366814 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8bfff700 1 -- 172.21.15.26:0/3313366814 >> v1:172.21.15.67:6789/0 conn(0x7f0c8c159920 legacy=0x7f0c8c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8bfff700 1 -- 172.21.15.26:0/3313366814 >> v1:172.21.15.26:6789/0 conn(0x7f0c8c15dfd0 legacy=0x7f0c8c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8affd700 1 -- 172.21.15.26:0/3313366814 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682299572 0 0) 0x7f0c8c0acc00 con 0x7f0c8c15dfd0 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.106+0000 7f0c8bfff700 1 -- 172.21.15.26:0/3313366814 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0ac5b0 con 0x7f0c8c159550 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/3313366814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c0ceac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098e0 tx=0x7f0c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acbe4b134f75d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c8affd700 1 -- 172.21.15.26:0/3313366814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80009e80 con 0x7f0c8c159550 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c8affd700 1 -- 172.21.15.26:0/3313366814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8000b820 con 0x7f0c8c159550 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c8affd700 1 -- 172.21.15.26:0/3313366814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000bba0 con 0x7f0c8c159550 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 -- 172.21.15.26:0/3313366814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 msgr2=0x7f0c8c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 --2- 172.21.15.26:0/3313366814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c0ceac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098e0 tx=0x7f0c800091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 -- 172.21.15.26:0/3313366814 shutdown_connections 2023-10-09T11:40:44.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 --2- 172.21.15.26:0/3313366814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c0ceac0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 -- 172.21.15.26:0/3313366814 >> 172.21.15.26:0/3313366814 conn(0x7f0c8c06ce80 msgr2=0x7f0c8c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 -- 172.21.15.26:0/3313366814 shutdown_connections 2023-10-09T11:40:44.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.107+0000 7f0c91397700 1 -- 172.21.15.26:0/3313366814 wait complete. 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.108+0000 7f0c91397700 1 Processor -- start 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 -- start start 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0c8c159920 0x7f0c8c16d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 0x7f0c8c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c16d620 con 0x7f0c8c159550 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0c8250 con 0x7f0c8c15dfd0 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c91397700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0c8530 con 0x7f0c8c159920 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c8bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c8bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48696/0 (socket says 172.21.15.26:48696) 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.109+0000 7f0c8bfff700 1 -- 172.21.15.26:0/1363080642 learned_addr learned my addr 172.21.15.26:0/1363080642 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0c8c159920 0x7f0c8c16d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c90b96700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 0x7f0c8c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 -- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0c8c159920 msgr2=0x7f0c8c16d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0c8c159920 0x7f0c8c16d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 -- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 msgr2=0x7f0c8c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 0x7f0c8c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 -- 172.21.15.26:0/1363080642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009420 con 0x7f0c8c159550 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c90b96700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 0x7f0c8c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0c800030c0 tx=0x7f0c80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000ba10 con 0x7f0c8c159550 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80020070 con 0x7f0c8c159550 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c0c8a70 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8001b6a0 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.110+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c0c9030 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.111+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c158de0 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.111+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0c80022030 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.112+0000 7f0c73fff700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 0x7f0c78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.112+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c80086940 con 0x7f0c8c159550 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.112+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 0x7f0c78069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.113+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 0x7f0c78069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b41d0 tx=0x7f0c7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.116+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c80053880 con 0x7f0c8c159550 2023-10-09T11:40:44.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.338+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000381635", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c8c04c3c0 con 0x7f0c78067170 2023-10-09T11:40:44.345 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:44.344+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:44.345 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:44.344+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:44.345 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:44.344+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:44.345 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:44.344+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:44.345 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:40:44.344+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:40:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.361+0000 7f0c73fff700 1 -- 172.21.15.26:0/1363080642 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c8c04c3c0 con 0x7f0c78067170 2023-10-09T11:40:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 msgr2=0x7f0c78069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 0x7f0c78069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0b41d0 tx=0x7f0c7c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 msgr2=0x7f0c8c16b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0c800030c0 tx=0x7f0c80016000 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 shutdown_connections 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c8c15dfd0 0x7f0c8c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c159550 0x7f0c8c16b490 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0c78067170 0x7f0c78069620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 --2- 172.21.15.26:0/1363080642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0c8c159920 0x7f0c8c16d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 >> 172.21.15.26:0/1363080642 conn(0x7f0c8c06ce80 msgr2=0x7f0c8c15f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 shutdown_connections 2023-10-09T11:40:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.363+0000 7f0c91397700 1 -- 172.21.15.26:0/1363080642 wait complete. 2023-10-09T11:40:44.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-09T11:40:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.497+0000 7f63c086a700 1 Processor -- start 2023-10-09T11:40:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.497+0000 7f63c086a700 1 -- start start 2023-10-09T11:40:44.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63c086a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63bc06e0e0 0x7f63bc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63c086a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc0ccfd0 con 0x7f63bc06dc70 2023-10-09T11:40:44.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63c086a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc15a3d0 con 0x7f63bc159530 2023-10-09T11:40:44.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63c086a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63bc15a6b0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63bad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63bc06e0e0 0x7f63bc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63b9d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f63bc06dc70 0x7f63bc159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56262/0 (socket says 172.21.15.26:56262) 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.498+0000 7f63b9d9b700 1 -- 172.21.15.26:0/1710045125 learned_addr learned my addr 172.21.15.26:0/1710045125 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63b959a700 1 -- 172.21.15.26:0/1710045125 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460230888 0 0) 0x7f63bc0ccfd0 con 0x7f63bc06dc70 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63b959a700 1 -- 172.21.15.26:0/1710045125 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003570 con 0x7f63bc06dc70 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63bad9d700 1 -- 172.21.15.26:0/1710045125 >> v1:172.21.15.67:6789/0 conn(0x7f63bc159530 legacy=0x7f63bc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63bad9d700 1 -- 172.21.15.26:0/1710045125 >> v1:172.21.15.26:6789/0 conn(0x7f63bc06dc70 legacy=0x7f63bc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63bad9d700 1 -- 172.21.15.26:0/1710045125 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc15a990 con 0x7f63bc06e0e0 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63bad9d700 1 --2- 172.21.15.26:0/1710045125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cb6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009e60 tx=0x7f63b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f2dcdf873e09a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63b959a700 1 -- 172.21.15.26:0/1710045125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b400e070 con 0x7f63bc06e0e0 2023-10-09T11:40:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63b959a700 1 -- 172.21.15.26:0/1710045125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b400bb60 con 0x7f63bc06e0e0 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63b959a700 1 -- 172.21.15.26:0/1710045125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4012430 con 0x7f63bc06e0e0 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63c086a700 1 -- 172.21.15.26:0/1710045125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 msgr2=0x7f63bc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.499+0000 7f63c086a700 1 --2- 172.21.15.26:0/1710045125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cb6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009e60 tx=0x7f63b4009780 comp rx=0 tx=0).stop 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.500+0000 7f63c086a700 1 -- 172.21.15.26:0/1710045125 shutdown_connections 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.500+0000 7f63c086a700 1 --2- 172.21.15.26:0/1710045125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cb6f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.500+0000 7f63c086a700 1 -- 172.21.15.26:0/1710045125 >> 172.21.15.26:0/1710045125 conn(0x7f63bc0703a0 msgr2=0x7f63bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.500+0000 7f63c086a700 1 -- 172.21.15.26:0/1710045125 shutdown_connections 2023-10-09T11:40:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.500+0000 7f63c086a700 1 -- 172.21.15.26:0/1710045125 wait complete. 2023-10-09T11:40:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.501+0000 7f63c086a700 1 Processor -- start 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.501+0000 7f63c086a700 1 -- start start 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.501+0000 7f63c086a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63bc06dc70 0x7f63bc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.501+0000 7f63c086a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.501+0000 7f63c086a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63bc159530 0x7f63bc147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63c086a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b4130 con 0x7f63bc06e0e0 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63c086a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b3520 con 0x7f63bc159530 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63c086a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b3800 con 0x7f63bc06dc70 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48710/0 (socket says 172.21.15.26:48710) 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 -- 172.21.15.26:0/809289742 learned_addr learned my addr 172.21.15.26:0/809289742 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63ba59c700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63bc06dc70 0x7f63bc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63bad9d700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63bc159530 0x7f63bc147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 -- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63bc06dc70 msgr2=0x7f63bc0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63bc06dc70 0x7f63bc0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 -- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63bc159530 msgr2=0x7f63bc147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63bc159530 0x7f63bc147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 -- 172.21.15.26:0/809289742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4009a20 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b9d9b700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c590 tx=0x7f63a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4005b30 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4005cb0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc0b3ae0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4007320 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.502+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63bc144ba0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.503+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63bc0b42a0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.504+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f63a401b3b0 con 0x7f63bc06e0e0 2023-10-09T11:40:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.504+0000 7f63b27fc700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 0x7f639c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.504+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63a4083d60 con 0x7f63bc06e0e0 2023-10-09T11:40:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.504+0000 7f63ba59c700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 0x7f639c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.505+0000 7f63ba59c700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 0x7f639c069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0d1050 tx=0x7f63ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.508+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63a4050c70 con 0x7f63bc06e0e0 2023-10-09T11:40:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.733+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f63bc04c3c0 con 0x7f639c067170 2023-10-09T11:40:44.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.736+0000 7f63b27fc700 1 -- 172.21.15.26:0/809289742 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f63bc04c3c0 con 0x7f639c067170 2023-10-09T11:40:44.736 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:40:44.736 INFO:teuthology.orchestra.run.smithi026.stdout: "mon_addrs": [ 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6789", 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6789", 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6790" 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "pending_subvolume_deletions": 0, 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": { 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "data": [ 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": " 340G", 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_data", 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: "used": " 0 " 2023-10-09T11:40:44.737 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": [ 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": " 340G", 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_metadata", 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: "used": "64.0k" 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout: "used_size": " 0 " 2023-10-09T11:40:44.738 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:40:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 msgr2=0x7f639c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 0x7f639c069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0d1050 tx=0x7f63ac009040 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 msgr2=0x7f63bc0cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c590 tx=0x7f63a4007e00 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 shutdown_connections 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63bc159530 0x7f63bc147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f639c067170 0x7f639c069620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63bc06dc70 0x7f63bc0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 --2- 172.21.15.26:0/809289742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63bc06e0e0 0x7f63bc0cffd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 >> 172.21.15.26:0/809289742 conn(0x7f63bc0703a0 msgr2=0x7f63bc0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 shutdown_connections 2023-10-09T11:40:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:44.738+0000 7f63c086a700 1 -- 172.21.15.26:0/809289742 wait complete. 2023-10-09T11:40:44.750 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:44.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:44.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:44.829 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:44.829 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:40:44.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:44.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:44.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:40:44.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:44.869 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:40:44.924 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:40:44.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:44.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:44.964 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:40:44.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:44.965 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:40:45.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:45.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 Processor -- start 2023-10-09T11:40:45.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 -- start start 2023-10-09T11:40:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f945c157600 0x7f945c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 0x7f945c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c158210 con 0x7f945c1579d0 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0cb850 con 0x7f945c157600 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.142+0000 7f9462412700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0cb290 con 0x7f945c0ccba0 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f945c157600 0x7f945c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f945c1579d0 0x7f945c1586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56278/0 (socket says 172.21.15.26:56278) 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945b7fe700 1 -- 172.21.15.26:0/1004486073 learned_addr learned my addr 172.21.15.26:0/1004486073 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f94609af700 1 --2- 172.21.15.26:0/1004486073 >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 0x7f945c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 -- 172.21.15.26:0/1004486073 >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 msgr2=0x7f945c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 --2- 172.21.15.26:0/1004486073 >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 0x7f945c0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 -- 172.21.15.26:0/1004486073 >> v1:172.21.15.26:6789/0 conn(0x7f945c1579d0 legacy=0x7f945c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 -- 172.21.15.26:0/1004486073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0cb570 con 0x7f945c157600 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945affd700 1 -- 172.21.15.26:0/1004486073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722566120 0 0) 0x7f945c158210 con 0x7f945c1579d0 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f94609af700 1 --2- 172.21.15.26:0/1004486073 >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 0x7f945c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945bfff700 1 --2- 172.21.15.26:0/1004486073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c0b1410 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f945c0af1b0 tx=0x7f944c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b4396e537ce1e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945affd700 1 -- 172.21.15.26:0/1004486073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00b6b0 con 0x7f945c157600 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945affd700 1 -- 172.21.15.26:0/1004486073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c00b810 con 0x7f945c157600 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.143+0000 7f945affd700 1 -- 172.21.15.26:0/1004486073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00bbb0 con 0x7f945c157600 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 -- 172.21.15.26:0/1004486073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 msgr2=0x7f945c0b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 --2- 172.21.15.26:0/1004486073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c0b1410 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f945c0af1b0 tx=0x7f944c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 -- 172.21.15.26:0/1004486073 shutdown_connections 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 --2- 172.21.15.26:0/1004486073 >> v2:172.21.15.67:3300/0 conn(0x7f945c0ccba0 0x7f945c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 --2- 172.21.15.26:0/1004486073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c0b1410 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 -- 172.21.15.26:0/1004486073 >> 172.21.15.26:0/1004486073 conn(0x7f945c06d170 msgr2=0x7f945c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 -- 172.21.15.26:0/1004486073 shutdown_connections 2023-10-09T11:40:45.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.144+0000 7f9462412700 1 -- 172.21.15.26:0/1004486073 wait complete. 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.145+0000 7f9462412700 1 Processor -- start 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.145+0000 7f9462412700 1 -- start start 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 0x7f945c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f945c1579d0 0x7f945c0a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c7230 con 0x7f945c157600 2023-10-09T11:40:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c8030 con 0x7f945c0ccba0 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9462412700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c7420 con 0x7f945c1579d0 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48734/0 (socket says 172.21.15.26:48734) 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 -- 172.21.15.26:0/1064097132 learned_addr learned my addr 172.21.15.26:0/1064097132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945bfff700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 0x7f945c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 -- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f945c1579d0 msgr2=0x7f945c0a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f945c1579d0 0x7f945c0a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 -- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 msgr2=0x7f945c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 0x7f945c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 -- 172.21.15.26:0/1064097132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c009420 con 0x7f945c157600 2023-10-09T11:40:45.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945bfff700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 0x7f945c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f945b7fe700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f945000c7e0 tx=0x7f9450007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.146+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450005b30 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.147+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450005c90 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.147+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c0c7700 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.147+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450007300 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.147+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0c7cc0 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.147+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0c81c0 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.148+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f945001b400 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.148+0000 7f9443fff700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 0x7f9448069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.148+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9450084470 con 0x7f945c157600 2023-10-09T11:40:45.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.149+0000 7f945bfff700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 0x7f9448069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.149+0000 7f945bfff700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 0x7f9448069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f944c003080 tx=0x7f944c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.153+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9450051400 con 0x7f945c157600 2023-10-09T11:40:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.251+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f94500517d0 con 0x7f945c157600 2023-10-09T11:40:45.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.391+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f945c155910 con 0x7f945c157600 2023-10-09T11:40:45.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.392+0000 7f9443fff700 1 -- 172.21.15.26:0/1064097132 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f9450054e90 con 0x7f945c157600 2023-10-09T11:40:45.392 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:45.393 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 msgr2=0x7f9448069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 0x7f9448069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f944c003080 tx=0x7f944c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 msgr2=0x7f945c149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f945000c7e0 tx=0x7f9450007df0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 shutdown_connections 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9448067170 0x7f9448069620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f945c1579d0 0x7f945c0a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f945c0ccba0 0x7f945c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 --2- 172.21.15.26:0/1064097132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f945c157600 0x7f945c149e70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 >> 172.21.15.26:0/1064097132 conn(0x7f945c06d170 msgr2=0x7f945c159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 shutdown_connections 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.394+0000 7f9462412700 1 -- 172.21.15.26:0/1064097132 wait complete. 2023-10-09T11:40:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 49 2023-10-09T11:40:45.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.525+0000 7f28f5473700 1 Processor -- start 2023-10-09T11:40:45.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.525+0000 7f28f5473700 1 -- start start 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28f5473700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f00cb5a0 0x7f28f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28f5473700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28f00cde50 0x7f28f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28f5473700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f015ae40 con 0x7f28f00cd9e0 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28f5473700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00d13f0 con 0x7f28f00cde50 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28f5473700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f015ab60 con 0x7f28f00cb5a0 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ef7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28f00cde50 0x7f28f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ee7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28f00cd9e0 0x7f28f0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56290/0 (socket says 172.21.15.26:56290) 2023-10-09T11:40:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ee7fc700 1 -- 172.21.15.26:0/1322987553 learned_addr learned my addr 172.21.15.26:0/1322987553 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28eeffd700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f00cb5a0 0x7f28f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ef7fe700 1 -- 172.21.15.26:0/1322987553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f00cb5a0 msgr2=0x7f28f00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ef7fe700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f00cb5a0 0x7f28f00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ef7fe700 1 -- 172.21.15.26:0/1322987553 >> v1:172.21.15.26:6789/0 conn(0x7f28f00cd9e0 legacy=0x7f28f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28ef7fe700 1 -- 172.21.15.26:0/1322987553 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00ccf00 con 0x7f28f00cde50 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.526+0000 7f28edffb700 1 -- 172.21.15.26:0/1322987553 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194187455 0 0) 0x7f28f015ae40 con 0x7f28f00cd9e0 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28ef7fe700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cde50 0x7f28f0156e90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098e0 tx=0x7f28e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1af0cccd02a123e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28edffb700 1 -- 172.21.15.26:0/1322987553 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8009e80 con 0x7f28f00cde50 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28edffb700 1 -- 172.21.15.26:0/1322987553 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800b860 con 0x7f28f00cde50 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28edffb700 1 -- 172.21.15.26:0/1322987553 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800bbe0 con 0x7f28f00cde50 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 -- 172.21.15.26:0/1322987553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cde50 msgr2=0x7f28f0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cde50 0x7f28f0156e90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098e0 tx=0x7f28e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 -- 172.21.15.26:0/1322987553 shutdown_connections 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cde50 0x7f28f0156e90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 --2- 172.21.15.26:0/1322987553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f00cb5a0 0x7f28f00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 -- 172.21.15.26:0/1322987553 >> 172.21.15.26:0/1322987553 conn(0x7f28f0070e30 msgr2=0x7f28f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 -- 172.21.15.26:0/1322987553 shutdown_connections 2023-10-09T11:40:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.527+0000 7f28f5473700 1 -- 172.21.15.26:0/1322987553 wait complete. 2023-10-09T11:40:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.528+0000 7f28f5473700 1 Processor -- start 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 -- start start 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00cd9e0 0x7f28f0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f01571a0 0x7f28f01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f015a3d0 con 0x7f28f00cb5a0 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0157640 con 0x7f28f00cd9e0 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28f5473700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0159e10 con 0x7f28f01571a0 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48748/0 (socket says 172.21.15.26:48748) 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.529+0000 7f28eeffd700 1 -- 172.21.15.26:0/4150924947 learned_addr learned my addr 172.21.15.26:0/4150924947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:45.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28ee7fc700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00cd9e0 0x7f28f0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28ef7fe700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f01571a0 0x7f28f01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 -- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f01571a0 msgr2=0x7f28f01590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f01571a0 0x7f28f01590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 -- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00cd9e0 msgr2=0x7f28f0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00cd9e0 0x7f28f0156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 -- 172.21.15.26:0/4150924947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8009420 con 0x7f28f00cb5a0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28eeffd700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e1c0 tx=0x7f28e0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000ee60 con 0x7f28f00cb5a0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e0014420 con 0x7f28f00cb5a0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f015a0f0 con 0x7f28f00cb5a0 2023-10-09T11:40:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00147e0 con 0x7f28f00cb5a0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.530+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f015c4c0 con 0x7f28f00cb5a0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.531+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f015c040 con 0x7f28f00cb5a0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.531+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f28e0014b90 con 0x7f28f00cb5a0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.532+0000 7f28e6ffd700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 0x7f28d00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.532+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28e00851a0 con 0x7f28f00cb5a0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.532+0000 7f28ee7fc700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 0x7f28d00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.533+0000 7f28ee7fc700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 0x7f28d00696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f28d8007fd0 tx=0x7f28d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.536+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f015c040 con 0x7f28f00cb5a0 2023-10-09T11:40:45.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.729+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f015c040 con 0x7f28f00cb5a0 2023-10-09T11:40:45.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.729+0000 7f28e6ffd700 1 -- 172.21.15.26:0/4150924947 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f28f015c040 con 0x7f28f00cb5a0 2023-10-09T11:40:45.730 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:45.730 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:35.178315+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 msgr2=0x7f28d00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 0x7f28d00696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f28d8007fd0 tx=0x7f28d8009040 comp rx=0 tx=0).stop 2023-10-09T11:40:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 msgr2=0x7f28f0144100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e1c0 tx=0x7f28e0009920 comp rx=0 tx=0).stop 2023-10-09T11:40:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 shutdown_connections 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28d0067200 0x7f28d00696b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28f01571a0 0x7f28f01590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28f00cb5a0 0x7f28f0144100 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 --2- 172.21.15.26:0/4150924947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00cd9e0 0x7f28f0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.731+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 >> 172.21.15.26:0/4150924947 conn(0x7f28f0070e30 msgr2=0x7f28f00c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.732+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 shutdown_connections 2023-10-09T11:40:45.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.732+0000 7f28f5473700 1 -- 172.21.15.26:0/4150924947 wait complete. 2023-10-09T11:40:45.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:40:32.170908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:40:32.744674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:40:45.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 Processor -- start 2023-10-09T11:40:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 -- start start 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 0x7f1c780ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7806dc70 0x7f1c78159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c7806e0e0 0x7f1c780cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780ccfd0 con 0x7f1c7806e0e0 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780cf0e0 con 0x7f1c78159530 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.866+0000 7f1c7d072700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815a3d0 con 0x7f1c7806dc70 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c7806e0e0 0x7f1c780cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c7806e0e0 0x7f1c780cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48760/0 (socket says 172.21.15.26:48760) 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 -- 172.21.15.26:0/642044700 learned_addr learned my addr 172.21.15.26:0/642044700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7659c700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7806dc70 0x7f1c78159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c76d9d700 1 --2- 172.21.15.26:0/642044700 >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 0x7f1c780ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 -- 172.21.15.26:0/642044700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7806dc70 msgr2=0x7f1c78159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7806dc70 0x7f1c78159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 -- 172.21.15.26:0/642044700 >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 msgr2=0x7f1c780ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 --2- 172.21.15.26:0/642044700 >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 0x7f1c780ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 -- 172.21.15.26:0/642044700 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7815a6b0 con 0x7f1c7806e0e0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c76d9d700 1 --2- 172.21.15.26:0/642044700 >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 0x7f1c780ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c7759e700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806e0e0 0x7f1c780cb6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1c7806d630 tx=0x7f1c70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e631b02c7787709f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c75d9b700 1 -- 172.21.15.26:0/642044700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000b860 con 0x7f1c7806e0e0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c75d9b700 1 -- 172.21.15.26:0/642044700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7000b9c0 con 0x7f1c7806e0e0 2023-10-09T11:40:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.867+0000 7f1c75d9b700 1 -- 172.21.15.26:0/642044700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000bd60 con 0x7f1c7806e0e0 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 -- 172.21.15.26:0/642044700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806e0e0 msgr2=0x7f1c780cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806e0e0 0x7f1c780cb6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1c7806d630 tx=0x7f1c70009250 comp rx=0 tx=0).stop 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 -- 172.21.15.26:0/642044700 shutdown_connections 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 --2- 172.21.15.26:0/642044700 >> v2:172.21.15.67:3300/0 conn(0x7f1c78159530 0x7f1c780ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806e0e0 0x7f1c780cb6f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 --2- 172.21.15.26:0/642044700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7806dc70 0x7f1c78159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 -- 172.21.15.26:0/642044700 >> 172.21.15.26:0/642044700 conn(0x7f1c780703a0 msgr2=0x7f1c780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 -- 172.21.15.26:0/642044700 shutdown_connections 2023-10-09T11:40:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.868+0000 7f1c7d072700 1 -- 172.21.15.26:0/642044700 wait complete. 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.869+0000 7f1c7d072700 1 Processor -- start 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.869+0000 7f1c7d072700 1 -- start start 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 0x7f1c780b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 0x7f1c780c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780b2000 con 0x7f1c7806dc70 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780b1d20 con 0x7f1c7806e0e0 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7d072700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780b3a60 con 0x7f1c78159530 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48776/0 (socket says 172.21.15.26:48776) 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 -- 172.21.15.26:0/3975121576 learned_addr learned my addr 172.21.15.26:0/3975121576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7659c700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 0x7f1c780b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7759e700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 0x7f1c780c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 -- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 msgr2=0x7f1c780c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 0x7f1c780c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 -- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 msgr2=0x7f1c780b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 0x7f1c780b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c76d9d700 1 -- 172.21.15.26:0/3975121576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700094f0 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7759e700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 0x7f1c780c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.870+0000 7f1c7659c700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 0x7f1c780b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c76d9d700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800cfb0 tx=0x7f1c68007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68016420 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68016580 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780b3d40 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68016940 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.871+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780b6390 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.872+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c780b41e0 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.872+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f1c68016d30 con 0x7f1c7806dc70 2023-10-09T11:40:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.873+0000 7f1c6effd700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 0x7f1c580696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.873+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c68012070 con 0x7f1c7806dc70 2023-10-09T11:40:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.873+0000 7f1c7659c700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 0x7f1c580696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.874+0000 7f1c7659c700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 0x7f1c580696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1c7815d360 tx=0x7f1c60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:45.877+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c6804e5a0 con 0x7f1c7806dc70 2023-10-09T11:40:46.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.068+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c780b4390 con 0x7f1c7806dc70 2023-10-09T11:40:46.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.068+0000 7f1c6effd700 1 -- 172.21.15.26:0/3975121576 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c68059e60 con 0x7f1c7806dc70 2023-10-09T11:40:46.069 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:40:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 msgr2=0x7f1c580696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 0x7f1c580696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1c7815d360 tx=0x7f1c60008040 comp rx=0 tx=0).stop 2023-10-09T11:40:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 msgr2=0x7f1c780ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800cfb0 tx=0x7f1c68007870 comp rx=0 tx=0).stop 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 shutdown_connections 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1c58067200 0x7f1c580696b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c78159530 0x7f1c780c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7806dc70 0x7f1c780ca2b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 --2- 172.21.15.26:0/3975121576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7806e0e0 0x7f1c780b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.070+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 >> 172.21.15.26:0/3975121576 conn(0x7f1c780703a0 msgr2=0x7f1c7815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.071+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 shutdown_connections 2023-10-09T11:40:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.071+0000 7f1c7d072700 1 -- 172.21.15.26:0/3975121576 wait complete. 2023-10-09T11:40:46.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:40:46.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.206+0000 7fbbcdd57700 1 Processor -- start 2023-10-09T11:40:46.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.206+0000 7fbbcdd57700 1 -- start start 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbcdd57700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbbc8159530 0x7fbbc80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbcdd57700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbcdd57700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80ccfd0 con 0x7fbbc806dc70 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbcdd57700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80cf0e0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbcdd57700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc815a3d0 con 0x7fbbc8159530 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc6ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbbc806dc70 0x7fbbc8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56294/0 (socket says 172.21.15.26:56294) 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48782/0 (socket says 172.21.15.26:48782) 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc6ffd700 1 -- 172.21.15.26:0/2794967147 learned_addr learned my addr 172.21.15.26:0/2794967147 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc77fe700 1 --2- 172.21.15.26:0/2794967147 >> v2:172.21.15.67:3300/0 conn(0x7fbbc8159530 0x7fbbc80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 -- 172.21.15.26:0/2794967147 >> v2:172.21.15.67:3300/0 conn(0x7fbbc8159530 msgr2=0x7fbbc80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 --2- 172.21.15.26:0/2794967147 >> v2:172.21.15.67:3300/0 conn(0x7fbbc8159530 0x7fbbc80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 -- 172.21.15.26:0/2794967147 >> v1:172.21.15.26:6789/0 conn(0x7fbbc806dc70 legacy=0x7fbbc8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc67fc700 1 -- 172.21.15.26:0/2794967147 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987661445 0 0) 0x7fbbc80ccfd0 con 0x7fbbc806dc70 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 -- 172.21.15.26:0/2794967147 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc815a6b0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc7fff700 1 --2- 172.21.15.26:0/2794967147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbbc806d630 tx=0x7fbbc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7687fb4c58e88b71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.207+0000 7fbbc67fc700 1 -- 172.21.15.26:0/2794967147 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000e070 con 0x7fbbc806e0e0 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbc67fc700 1 -- 172.21.15.26:0/2794967147 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000bc30 con 0x7fbbc806e0e0 2023-10-09T11:40:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbc67fc700 1 -- 172.21.15.26:0/2794967147 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0012430 con 0x7fbbc806e0e0 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 -- 172.21.15.26:0/2794967147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 msgr2=0x7fbbc80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/2794967147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbbc806d630 tx=0x7fbbc0009780 comp rx=0 tx=0).stop 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 -- 172.21.15.26:0/2794967147 shutdown_connections 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/2794967147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/2794967147 >> v2:172.21.15.67:3300/0 conn(0x7fbbc8159530 0x7fbbc80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 -- 172.21.15.26:0/2794967147 >> 172.21.15.26:0/2794967147 conn(0x7fbbc80703a0 msgr2=0x7fbbc80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 -- 172.21.15.26:0/2794967147 shutdown_connections 2023-10-09T11:40:46.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.208+0000 7fbbcdd57700 1 -- 172.21.15.26:0/2794967147 wait complete. 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.209+0000 7fbbcdd57700 1 Processor -- start 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.209+0000 7fbbcdd57700 1 -- start start 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 0x7fbbc8143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 0x7fbbc80d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81548a0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8155fc0 con 0x7fbbc8159530 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbcdd57700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80c79e0 con 0x7fbbc806dc70 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbc6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbc6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48798/0 (socket says 172.21.15.26:48798) 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbc6ffd700 1 -- 172.21.15.26:0/739229472 learned_addr learned my addr 172.21.15.26:0/739229472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.210+0000 7fbbc7fff700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 0x7fbbc80d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 -- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 msgr2=0x7fbbc8143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc77fe700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 0x7fbbc8143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 0x7fbbc8143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 -- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 msgr2=0x7fbbc80d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 0x7fbbc80d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 -- 172.21.15.26:0/739229472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009a20 con 0x7fbbc806e0e0 2023-10-09T11:40:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc7fff700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 0x7fbbc80d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc77fe700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 0x7fbbc8143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbc6ffd700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c7e0 tx=0x7fbbb8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8005b30 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8005c90 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8156260 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8007300 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.211+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8156820 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.212+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8156a40 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.212+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fbbb801b400 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.213+0000 7fbbaf7fe700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 0x7fbbb40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.213+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbb8084430 con 0x7fbbc806e0e0 2023-10-09T11:40:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.213+0000 7fbbc77fe700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 0x7fbbb40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.214+0000 7fbbc77fe700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 0x7fbbb40696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009990 tx=0x7fbbbc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.217+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbb80513d0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.408+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbc804c3c0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.409+0000 7fbbaf7fe700 1 -- 172.21.15.26:0/739229472 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbb80549f0 con 0x7fbbc806e0e0 2023-10-09T11:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:40:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.410+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 msgr2=0x7fbbb40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.410+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 0x7fbbb40696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009990 tx=0x7fbbbc008040 comp rx=0 tx=0).stop 2023-10-09T11:40:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.410+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 msgr2=0x7fbbc80c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.410+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c7e0 tx=0x7fbbb8007df0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 shutdown_connections 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbc8159530 0x7fbbc80d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbb4067200 0x7fbbb40696b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbc806dc70 0x7fbbc8143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 --2- 172.21.15.26:0/739229472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbc806e0e0 0x7fbbc80c9e50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 >> 172.21.15.26:0/739229472 conn(0x7fbbc80703a0 msgr2=0x7fbbc80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 shutdown_connections 2023-10-09T11:40:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.411+0000 7fbbcdd57700 1 -- 172.21.15.26:0/739229472 wait complete. 2023-10-09T11:40:46.423 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.545+0000 7ff834694700 1 Processor -- start 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.545+0000 7ff834694700 1 -- start start 2023-10-09T11:40:46.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff834694700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff82c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff834694700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff82c06e0e0 0x7ff82c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff834694700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0ccfd0 con 0x7ff82c06dc70 2023-10-09T11:40:46.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff834694700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0cf0e0 con 0x7ff82c06e0e0 2023-10-09T11:40:46.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff834694700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c15a3d0 con 0x7ff82c159530 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff831c2f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff82c06dc70 0x7ff82c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56302/0 (socket says 172.21.15.26:56302) 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.546+0000 7ff831c2f700 1 -- 172.21.15.26:0/1315693854 learned_addr learned my addr 172.21.15.26:0/1315693854 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff832c31700 1 --2- 172.21.15.26:0/1315693854 >> v2:172.21.15.67:3300/0 conn(0x7ff82c06e0e0 0x7ff82c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff832430700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff82c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370696421 0 0) 0x7ff82c0ccfd0 con 0x7ff82c06dc70 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff814003570 con 0x7ff82c06dc70 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 44532308 0 0) 0x7ff814003570 con 0x7ff82c06dc70 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 msgr2=0x7ff82c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff82c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 >> v2:172.21.15.67:3300/0 conn(0x7ff82c06e0e0 msgr2=0x7ff82c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 --2- 172.21.15.26:0/1315693854 >> v2:172.21.15.67:3300/0 conn(0x7ff82c06e0e0 0x7ff82c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c15a6b0 con 0x7ff82c06dc70 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ff820001470 con 0x7ff82c06dc70 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 >> v1:172.21.15.26:6789/0 conn(0x7ff82c06dc70 legacy=0x7ff82c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814003ae0 0x7ff814003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff814004810 0x7ff814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff8140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0cf0e0 con 0x7ff814004810 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c15a3d0 con 0x7ff814003ae0 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81400bb10 con 0x7ff82c159530 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff831c2f700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff814004810 0x7ff814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff832430700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814003ae0 0x7ff814003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff832c31700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff8140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.547+0000 7ff831c2f700 1 -- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 msgr2=0x7ff8140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff831c2f700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c159530 0x7ff8140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff831c2f700 1 -- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814003ae0 msgr2=0x7ff814003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff831c2f700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814003ae0 0x7ff814003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff831c2f700 1 -- 172.21.15.26:0/1315693854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814003570 con 0x7ff814004810 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff832430700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814003ae0 0x7ff814003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff831c2f700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff814004810 0x7ff814004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c2d0 tx=0x7ff820001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf6ad54da046f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000cba0 con 0x7ff814004810 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000cd20 con 0x7ff814004810 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff83142e700 1 -- 172.21.15.26:0/1315693854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820005b70 con 0x7ff814004810 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 -- 172.21.15.26:0/1315693854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff814004810 msgr2=0x7ff814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 --2- 172.21.15.26:0/1315693854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff814004810 0x7ff814004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c2d0 tx=0x7ff820001dc0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff832c31700 1 -- 172.21.15.26:0/1315693854 reap_dead start 2023-10-09T11:40:46.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 -- 172.21.15.26:0/1315693854 shutdown_connections 2023-10-09T11:40:46.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 -- 172.21.15.26:0/1315693854 >> 172.21.15.26:0/1315693854 conn(0x7ff82c0703a0 msgr2=0x7ff82c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 -- 172.21.15.26:0/1315693854 shutdown_connections 2023-10-09T11:40:46.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.548+0000 7ff834694700 1 -- 172.21.15.26:0/1315693854 wait complete. 2023-10-09T11:40:46.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 Processor -- start 2023-10-09T11:40:46.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 -- start start 2023-10-09T11:40:46.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 0x7ff82c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c0c8e40 0x7ff82c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c14d8b0 con 0x7ff82c0ca460 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c93c0 con 0x7ff814004810 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff834694700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c96a0 con 0x7ff82c0c8e40 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff831c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff832430700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 0x7ff82c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff831c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48806/0 (socket says 172.21.15.26:48806) 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff831c2f700 1 -- 172.21.15.26:0/4188633274 learned_addr learned my addr 172.21.15.26:0/4188633274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.550+0000 7ff832c31700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c0c8e40 0x7ff82c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 -- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c0c8e40 msgr2=0x7ff82c0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c0c8e40 0x7ff82c0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 -- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 msgr2=0x7ff82c14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 0x7ff82c14d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 -- 172.21.15.26:0/4188633274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0c9980 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff832430700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 0x7ff82c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff831c2f700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff81400ba60 tx=0x7ff820012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000ce90 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8200070d0 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8200074b0 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0c9c60 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.551+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0ca8d0 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.552+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c04c3c0 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.552+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff820019030 con 0x7ff82c0ca460 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.553+0000 7ff82a7fc700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 0x7ff8180696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.553+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8200859a0 con 0x7ff82c0ca460 2023-10-09T11:40:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.553+0000 7ff832430700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 0x7ff8180696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.554+0000 7ff832430700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 0x7ff8180696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0094d0 tx=0x7ff81c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.557+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff820052980 con 0x7ff82c0ca460 2023-10-09T11:40:46.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.748+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff82c15a990 con 0x7ff82c0ca460 2023-10-09T11:40:46.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.749+0000 7ff82a7fc700 1 -- 172.21.15.26:0/4188633274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff820017020 con 0x7ff82c0ca460 2023-10-09T11:40:46.749 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:40:46.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 msgr2=0x7ff8180696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 0x7ff8180696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0094d0 tx=0x7ff81c00b040 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 msgr2=0x7ff82c0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff81400ba60 tx=0x7ff820012000 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 shutdown_connections 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff818067200 0x7ff8180696b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c0c8e40 0x7ff82c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814004810 0x7ff82c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 --2- 172.21.15.26:0/4188633274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff82c0ca460 0x7ff82c0c8900 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 >> 172.21.15.26:0/4188633274 conn(0x7ff82c0703a0 msgr2=0x7ff82c15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 shutdown_connections 2023-10-09T11:40:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.751+0000 7ff834694700 1 -- 172.21.15.26:0/4188633274 wait complete. 2023-10-09T11:40:46.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:46.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.882+0000 7fa0098d4700 1 Processor -- start 2023-10-09T11:40:46.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.882+0000 7fa0098d4700 1 -- start start 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa0040703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa00406ade0 0x7fa0040c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0040c7570 0x7fa00406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00406c740 con 0x7fa00406ade0 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00406c9b0 con 0x7fa0040c7570 2023-10-09T11:40:46.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0098d4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00406cc90 con 0x7fa004159790 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0027fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa00406ade0 0x7fa0040c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0027fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa00406ade0 0x7fa0040c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48808/0 (socket says 172.21.15.26:48808) 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0027fc700 1 -- 172.21.15.26:0/2873668554 learned_addr learned my addr 172.21.15.26:0/2873668554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa0037fe700 1 --2- 172.21.15.26:0/2873668554 >> v2:172.21.15.67:3300/0 conn(0x7fa0040c7570 0x7fa00406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.883+0000 7fa002ffd700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa0040703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 -- 172.21.15.26:0/2873668554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 msgr2=0x7fa0040703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa0040703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 -- 172.21.15.26:0/2873668554 >> v2:172.21.15.67:3300/0 conn(0x7fa0040c7570 msgr2=0x7fa00406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 --2- 172.21.15.26:0/2873668554 >> v2:172.21.15.67:3300/0 conn(0x7fa0040c7570 0x7fa00406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 -- 172.21.15.26:0/2873668554 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00406cf70 con 0x7fa00406ade0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0027fc700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00406ade0 0x7fa0040c7030 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa00406a2f0 tx=0x7f9fec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d104a5014bcaddd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa001ffb700 1 -- 172.21.15.26:0/2873668554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00b860 con 0x7fa00406ade0 2023-10-09T11:40:46.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa001ffb700 1 -- 172.21.15.26:0/2873668554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec00b9c0 con 0x7fa00406ade0 2023-10-09T11:40:46.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa001ffb700 1 -- 172.21.15.26:0/2873668554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00bd60 con 0x7fa00406ade0 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 -- 172.21.15.26:0/2873668554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00406ade0 msgr2=0x7fa0040c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00406ade0 0x7fa0040c7030 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa00406a2f0 tx=0x7f9fec009250 comp rx=0 tx=0).stop 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 -- 172.21.15.26:0/2873668554 shutdown_connections 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 --2- 172.21.15.26:0/2873668554 >> v2:172.21.15.67:3300/0 conn(0x7fa0040c7570 0x7fa00406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa0040703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 --2- 172.21.15.26:0/2873668554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00406ade0 0x7fa0040c7030 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 -- 172.21.15.26:0/2873668554 >> 172.21.15.26:0/2873668554 conn(0x7fa00406ecd0 msgr2=0x7fa00406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 -- 172.21.15.26:0/2873668554 shutdown_connections 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.884+0000 7fa0098d4700 1 -- 172.21.15.26:0/2873668554 wait complete. 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 Processor -- start 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 -- start start 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa00406ade0 0x7fa004151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa00414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b2270 con 0x7fa0040c7570 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b1660 con 0x7fa00406ade0 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.886+0000 7fa0098d4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b1940 con 0x7fa004159790 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48824/0 (socket says 172.21.15.26:48824) 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 -- 172.21.15.26:0/1475897990 learned_addr learned my addr 172.21.15.26:0/1475897990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:46.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa002ffd700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa00406ade0 0x7fa004151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0037fe700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa00414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 -- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 msgr2=0x7fa00414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa00414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 -- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa00406ade0 msgr2=0x7fa004151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa00406ade0 0x7fa004151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 -- 172.21.15.26:0/1475897990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0094f0 con 0x7fa0040c7570 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0027fc700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa004069c00 tx=0x7f9fec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec011dc0 con 0x7fa0040c7570 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec024440 con 0x7fa0040c7570 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040b1c20 con 0x7fa0040c7570 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec024800 con 0x7fa0040c7570 2023-10-09T11:40:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.887+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00414fba0 con 0x7fa0040c7570 2023-10-09T11:40:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.888+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00404c3c0 con 0x7fa0040c7570 2023-10-09T11:40:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.889+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9fec01a420 con 0x7fa0040c7570 2023-10-09T11:40:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.889+0000 7f9ffaffd700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 0x7f9fe40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.889+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fec0867f0 con 0x7fa0040c7570 2023-10-09T11:40:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.889+0000 7fa002ffd700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 0x7f9fe40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.890+0000 7fa002ffd700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 0x7f9fe40696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006fd0 tx=0x7f9ff4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:46.893+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fec053710 con 0x7fa0040c7570 2023-10-09T11:40:47.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.132+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0040b23b0 con 0x7fa0040c7570 2023-10-09T11:40:47.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.133+0000 7f9ffaffd700 1 -- 172.21.15.26:0/1475897990 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f9fec056d30 con 0x7fa0040c7570 2023-10-09T11:40:47.133 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:47.133 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 msgr2=0x7f9fe40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 0x7f9fe40696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006fd0 tx=0x7f9ff4008040 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 msgr2=0x7fa0040b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa004069c00 tx=0x7f9fec017000 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 shutdown_connections 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9fe4067200 0x7f9fe40696b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004159790 0x7fa00414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa00406ade0 0x7fa004151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 --2- 172.21.15.26:0/1475897990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0040c7570 0x7fa0040b0b80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 >> 172.21.15.26:0/1475897990 conn(0x7fa00406ecd0 msgr2=0x7fa0040cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 shutdown_connections 2023-10-09T11:40:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.135+0000 7fa0098d4700 1 -- 172.21.15.26:0/1475897990 wait complete. 2023-10-09T11:40:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 49 2023-10-09T11:40:47.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.267+0000 7fd56edf0700 1 Processor -- start 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.267+0000 7fd56edf0700 1 -- start start 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56edf0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd568153c30 0x7fd56815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56edf0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56815afd0 con 0x7fd56815de50 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56edf0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56815b2b0 con 0x7fd5680cf110 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56edf0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56815b590 con 0x7fd568153c30 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56ddee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd568153c30 0x7fd56815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56d5ed700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd56815de50 0x7fd5680cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56308/0 (socket says 172.21.15.26:56308) 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56d5ed700 1 -- 172.21.15.26:0/565862088 learned_addr learned my addr 172.21.15.26:0/565862088 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56ddee700 1 -- 172.21.15.26:0/565862088 >> v1:172.21.15.67:6789/0 conn(0x7fd5680cf110 legacy=0x7fd56815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56ddee700 1 -- 172.21.15.26:0/565862088 >> v1:172.21.15.26:6789/0 conn(0x7fd56815de50 legacy=0x7fd5680cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.268+0000 7fd56ddee700 1 -- 172.21.15.26:0/565862088 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56815b870 con 0x7fd568153c30 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56ddee700 1 --2- 172.21.15.26:0/565862088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd568153c30 0x7fd56815a5e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd558009e60 tx=0x7fd558009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235ab0b720a56176 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56cdec700 1 -- 172.21.15.26:0/565862088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800e070 con 0x7fd568153c30 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56cdec700 1 -- 172.21.15.26:0/565862088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800bc30 con 0x7fd568153c30 2023-10-09T11:40:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56cdec700 1 -- 172.21.15.26:0/565862088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558012430 con 0x7fd568153c30 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 -- 172.21.15.26:0/565862088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd568153c30 msgr2=0x7fd56815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 --2- 172.21.15.26:0/565862088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd568153c30 0x7fd56815a5e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd558009e60 tx=0x7fd558009780 comp rx=0 tx=0).stop 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 -- 172.21.15.26:0/565862088 shutdown_connections 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 --2- 172.21.15.26:0/565862088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd568153c30 0x7fd56815a5e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 -- 172.21.15.26:0/565862088 >> 172.21.15.26:0/565862088 conn(0x7fd5680703a0 msgr2=0x7fd5680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 -- 172.21.15.26:0/565862088 shutdown_connections 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.269+0000 7fd56edf0700 1 -- 172.21.15.26:0/565862088 wait complete. 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.270+0000 7fd56edf0700 1 Processor -- start 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 -- start start 2023-10-09T11:40:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5680cf110 0x7fd5680c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd568153c30 0x7fd5680cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56813eae0 con 0x7fd56815de50 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680cc450 con 0x7fd5680cf110 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56edf0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680ca400 con 0x7fd568153c30 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56e5ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56e5ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48842/0 (socket says 172.21.15.26:48842) 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56ddee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5680cf110 0x7fd5680c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56e5ef700 1 -- 172.21.15.26:0/2264260113 learned_addr learned my addr 172.21.15.26:0/2264260113 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.271+0000 7fd56d5ed700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd568153c30 0x7fd5680cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 -- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd568153c30 msgr2=0x7fd5680cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd568153c30 0x7fd5680cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 -- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5680cf110 msgr2=0x7fd5680c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5680cf110 0x7fd5680c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 -- 172.21.15.26:0/2264260113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558009a20 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56e5ef700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c590 tx=0x7fd560007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011590 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5600116f0 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680cce20 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011ab0 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.272+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680cbe00 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.273+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56804c3c0 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.273+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd56001b3b0 con 0x7fd56815de50 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.274+0000 7fd565ffb700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 0x7fd5540696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.274+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd560083cf0 con 0x7fd56815de50 2023-10-09T11:40:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.274+0000 7fd56ddee700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 0x7fd5540696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.275+0000 7fd56ddee700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 0x7fd5540696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd558009e60 tx=0x7fd558019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.278+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd560050c10 con 0x7fd56815de50 2023-10-09T11:40:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.472+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5680caef0 con 0x7fd56815de50 2023-10-09T11:40:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.473+0000 7fd565ffb700 1 -- 172.21.15.26:0/2264260113 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fd560017070 con 0x7fd56815de50 2023-10-09T11:40:47.473 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:47.473 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:35.178315+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:47.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 msgr2=0x7fd5540696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 0x7fd5540696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd558009e60 tx=0x7fd558019000 comp rx=0 tx=0).stop 2023-10-09T11:40:47.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 msgr2=0x7fd5680c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c590 tx=0x7fd560007ef0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 shutdown_connections 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd56815de50 0x7fd5680c75e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5680cf110 0x7fd5680c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd554067200 0x7fd5540696b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 --2- 172.21.15.26:0/2264260113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd568153c30 0x7fd5680cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 >> 172.21.15.26:0/2264260113 conn(0x7fd5680703a0 msgr2=0x7fd56815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 shutdown_connections 2023-10-09T11:40:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.475+0000 7fd56edf0700 1 -- 172.21.15.26:0/2264260113 wait complete. 2023-10-09T11:40:47.487 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:40:47.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:47.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.605+0000 7f7287f9e700 1 Processor -- start 2023-10-09T11:40:47.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 -- start start 2023-10-09T11:40:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72800cb5a0 0x7f72800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72800cd9e0 0x7f7280159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800d13f0 con 0x7f72800cb5a0 2023-10-09T11:40:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728015ae40 con 0x7f72800cd9e0 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7287f9e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728015ab60 con 0x7f728015a400 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.606+0000 7f7285d3a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72800cb5a0 0x7f72800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72800cb5a0 0x7f72800cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48850/0 (socket says 172.21.15.26:48850) 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 -- 172.21.15.26:0/4065931447 learned_addr learned my addr 172.21.15.26:0/4065931447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f728653b700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285539700 1 --2- 172.21.15.26:0/4065931447 >> v2:172.21.15.67:3300/0 conn(0x7f72800cd9e0 0x7f7280159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 -- 172.21.15.26:0/4065931447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 msgr2=0x7f7280156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 -- 172.21.15.26:0/4065931447 >> v2:172.21.15.67:3300/0 conn(0x7f72800cd9e0 msgr2=0x7f7280159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 --2- 172.21.15.26:0/4065931447 >> v2:172.21.15.67:3300/0 conn(0x7f72800cd9e0 0x7f7280159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 -- 172.21.15.26:0/4065931447 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800ccf00 con 0x7f72800cb5a0 2023-10-09T11:40:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f728653b700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7285d3a700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f72800cb970 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7278009f20 tx=0x7f7278009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c316f8b525eeefc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7284d38700 1 -- 172.21.15.26:0/4065931447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800e070 con 0x7f72800cb5a0 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7284d38700 1 -- 172.21.15.26:0/4065931447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800ba40 con 0x7f72800cb5a0 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.607+0000 7f7284d38700 1 -- 172.21.15.26:0/4065931447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780092e0 con 0x7f72800cb5a0 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 -- 172.21.15.26:0/4065931447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 msgr2=0x7f72800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f72800cb970 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7278009f20 tx=0x7f7278009840 comp rx=0 tx=0).stop 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 -- 172.21.15.26:0/4065931447 shutdown_connections 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 --2- 172.21.15.26:0/4065931447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f72800cb970 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 --2- 172.21.15.26:0/4065931447 >> v2:172.21.15.67:3300/0 conn(0x7f72800cd9e0 0x7f7280159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 -- 172.21.15.26:0/4065931447 >> 172.21.15.26:0/4065931447 conn(0x7f7280070e30 msgr2=0x7f72800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 -- 172.21.15.26:0/4065931447 shutdown_connections 2023-10-09T11:40:47.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.608+0000 7f7287f9e700 1 -- 172.21.15.26:0/4065931447 wait complete. 2023-10-09T11:40:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.609+0000 7f7287f9e700 1 Processor -- start 2023-10-09T11:40:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.609+0000 7f7287f9e700 1 -- start start 2023-10-09T11:40:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 0x7f72800c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280154030 con 0x7f72800cb5a0 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800c7af0 con 0x7f72800cd9e0 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7280157ab0 con 0x7f728015a400 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48864/0 (socket says 172.21.15.26:48864) 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 -- 172.21.15.26:0/2712950101 learned_addr learned my addr 172.21.15.26:0/2712950101 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285539700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 0x7f72800c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f728653b700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 -- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 msgr2=0x7f7280156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 -- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 msgr2=0x7f72800c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 0x7f72800c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 -- 172.21.15.26:0/2712950101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278009ae0 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285539700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 0x7f72800c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7285d3a700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f728006ea60 tx=0x7f7278018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278008930 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278008a90 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.610+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72800b4170 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.611+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278008e30 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.611+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7280158e60 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.612+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728004c3c0 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.612+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7278003040 con 0x7f72800cb5a0 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.613+0000 7f727dffb700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 0x7f726c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.613+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7278086830 con 0x7f72800cb5a0 2023-10-09T11:40:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.613+0000 7f7285539700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 0x7f726c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.613+0000 7f7285539700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 0x7f726c0696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.617+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72780536f0 con 0x7f72800cb5a0 2023-10-09T11:40:47.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.853+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72800cd1e0 con 0x7f72800cb5a0 2023-10-09T11:40:47.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.854+0000 7f727dffb700 1 -- 172.21.15.26:0/2712950101 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f7278021090 con 0x7f72800cb5a0 2023-10-09T11:40:47.854 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:47.854 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 msgr2=0x7f726c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 0x7f726c0696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274008040 comp rx=0 tx=0).stop 2023-10-09T11:40:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 msgr2=0x7f7280153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f728006ea60 tx=0x7f7278018000 comp rx=0 tx=0).stop 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 shutdown_connections 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f726c067200 0x7f726c0696b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f728015a400 0x7f7280156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72800cb5a0 0x7f7280153af0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 --2- 172.21.15.26:0/2712950101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800cd9e0 0x7f72800c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 >> 172.21.15.26:0/2712950101 conn(0x7f7280070e30 msgr2=0x7f72800b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 shutdown_connections 2023-10-09T11:40:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.856+0000 7f7287f9e700 1 -- 172.21.15.26:0/2712950101 wait complete. 2023-10-09T11:40:47.858 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 49 2023-10-09T11:40:47.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.987+0000 7f8140aa5700 1 Processor -- start 2023-10-09T11:40:47.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.987+0000 7f8140aa5700 1 -- start start 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f8140aa5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f813c153c30 0x7f813c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f8140aa5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c15afd0 con 0x7f813c0cf110 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f8140aa5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c15b2b0 con 0x7f813c15de50 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f8140aa5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c15b590 con 0x7f813c153c30 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f813bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f813c0cf110 0x7f813c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56316/0 (socket says 172.21.15.26:56316) 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f813bfff700 1 -- 172.21.15.26:0/2736598464 learned_addr learned my addr 172.21.15.26:0/2736598464 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f813b7fe700 1 --2- 172.21.15.26:0/2736598464 >> v2:172.21.15.67:3300/0 conn(0x7f813c153c30 0x7f813c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.988+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285668582 0 0) 0x7f813c15afd0 con 0x7f813c0cf110 2023-10-09T11:40:47.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8124003570 con 0x7f813c0cf110 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463892033 0 0) 0x7f8124003570 con 0x7f813c0cf110 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 >> v2:172.21.15.67:3300/0 conn(0x7f813c153c30 msgr2=0x7f813c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 --2- 172.21.15.26:0/2736598464 >> v2:172.21.15.67:3300/0 conn(0x7f813c153c30 0x7f813c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 >> v1:172.21.15.67:6789/0 conn(0x7f813c15de50 legacy=0x7f813c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c15b870 con 0x7f813c0cf110 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f81340017f0 con 0x7f813c0cf110 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 >> v1:172.21.15.26:6789/0 conn(0x7f813c0cf110 legacy=0x7f813c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 0x7f8124003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8124004810 0x7f8124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81240051c0 0x7f812400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c15b590 con 0x7f8124003a60 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812400c0d0 con 0x7f8124004810 2023-10-09T11:40:47.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812400c290 con 0x7f81240051c0 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 0x7f8124003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813affd700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8124004810 0x7f8124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813bfff700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81240051c0 0x7f812400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 -- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81240051c0 msgr2=0x7f812400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81240051c0 0x7f812400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 -- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8124004810 msgr2=0x7f8124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8124004810 0x7f8124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 -- 172.21.15.26:0/2736598464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124003570 con 0x7f8124003a60 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813affd700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8124004810 0x7f8124004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813bfff700 1 -- 172.21.15.26:0/2736598464 reap_dead start 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.989+0000 7f813b7fe700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 0x7f8124003e70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f812c009c00 tx=0x7f812c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bca869b0b6d8e25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00e710 con 0x7f8124003a60 2023-10-09T11:40:47.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00e870 con 0x7f8124003a60 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f813a7fc700 1 -- 172.21.15.26:0/2736598464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00ec30 con 0x7f8124003a60 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 -- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 msgr2=0x7f8124003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 0x7f8124003e70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f812c009c00 tx=0x7f812c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 -- 172.21.15.26:0/2736598464 shutdown_connections 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 --2- 172.21.15.26:0/2736598464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8124003a60 0x7f8124003e70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 -- 172.21.15.26:0/2736598464 >> 172.21.15.26:0/2736598464 conn(0x7f813c0703a0 msgr2=0x7f813c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 -- 172.21.15.26:0/2736598464 shutdown_connections 2023-10-09T11:40:47.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.990+0000 7f8140aa5700 1 -- 172.21.15.26:0/2736598464 wait complete. 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.991+0000 7f8140aa5700 1 Processor -- start 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.991+0000 7f8140aa5700 1 -- start start 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8124003a60 0x7f813c14dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f813c0cc3a0 0x7f813c0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0b32d0 con 0x7f813c0b1300 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0ccd50 con 0x7f813c0cc3a0 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f8140aa5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0c75e0 con 0x7f8124003a60 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f813bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f813bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48872/0 (socket says 172.21.15.26:48872) 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f813bfff700 1 -- 172.21.15.26:0/1808905096 learned_addr learned my addr 172.21.15.26:0/1808905096 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f813affd700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f813c0cc3a0 0x7f813c0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.992+0000 7f813b7fe700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8124003a60 0x7f813c14dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 -- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8124003a60 msgr2=0x7f813c14dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8124003a60 0x7f813c14dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 -- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f813c0cc3a0 msgr2=0x7f813c0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f813c0cc3a0 0x7f813c0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 -- 172.21.15.26:0/1808905096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c14e110 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f813bfff700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8134000f80 tx=0x7f813c15e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813400eab0 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813400ec10 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0b1fc0 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134013420 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.993+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0b2580 con 0x7f813c0b1300 2023-10-09T11:40:47.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.994+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c0c7790 con 0x7f813c0b1300 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.995+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8134013850 con 0x7f813c0b1300 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.995+0000 7f81237fe700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 0x7f81280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.995+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8134084d30 con 0x7f813c0b1300 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.995+0000 7f813b7fe700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 0x7f81280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.996+0000 7f813b7fe700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 0x7f81280696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f812c0091e0 tx=0x7f812c01a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:47.999+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f813c0c7790 con 0x7f813c0b1300 2023-10-09T11:40:48.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.236+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f813c0c7750 con 0x7f813c0b1300 2023-10-09T11:40:48.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.236+0000 7f81237fe700 1 -- 172.21.15.26:0/1808905096 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f8134089070 con 0x7f813c0b1300 2023-10-09T11:40:48.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:48.237 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:33.774944+0000","modified":"2023-10-09T11:40:37.391327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2829870297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2829870297},{"type":"v1","addr":"172.21.15.26:6835","nonce":2829870297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 msgr2=0x7f81280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 0x7f81280696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f812c0091e0 tx=0x7f812c01a000 comp rx=0 tx=0).stop 2023-10-09T11:40:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 msgr2=0x7f813c0b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8134000f80 tx=0x7f813c15e2d0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 shutdown_connections 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f813c0b1300 0x7f813c0b17a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8128067200 0x7f81280696b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8124003a60 0x7f813c14dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 --2- 172.21.15.26:0/1808905096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f813c0cc3a0 0x7f813c0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.238+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 >> 172.21.15.26:0/1808905096 conn(0x7f813c0703a0 msgr2=0x7f813c0c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.239+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 shutdown_connections 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.239+0000 7f8140aa5700 1 -- 172.21.15.26:0/1808905096 wait complete. 2023-10-09T11:40:48.240 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 49 2023-10-09T11:40:48.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:48.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.369+0000 7f9a1d7c1700 1 Processor -- start 2023-10-09T11:40:48.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.369+0000 7f9a1d7c1700 1 -- start start 2023-10-09T11:40:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a1d7c1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a180cb970 0x7f9a18159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a1d7c1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a1815a400 0x7f9a18156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a1d7c1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1815ae40 con 0x7f9a180cb5a0 2023-10-09T11:40:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a1d7c1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180ce0f0 con 0x7f9a1815a400 2023-10-09T11:40:48.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a1d7c1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180cbde0 con 0x7f9a180cb970 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a1815a400 0x7f9a18156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a16ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a180cb5a0 0x7f9a180cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56324/0 (socket says 172.21.15.26:56324) 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.370+0000 7f9a16ffd700 1 -- 172.21.15.26:0/1780726999 learned_addr learned my addr 172.21.15.26:0/1780726999 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a167fc700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a180cb970 0x7f9a18159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a177fe700 1 -- 172.21.15.26:0/1780726999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a180cb970 msgr2=0x7f9a18159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a177fe700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a180cb970 0x7f9a18159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a177fe700 1 -- 172.21.15.26:0/1780726999 >> v1:172.21.15.26:6789/0 conn(0x7f9a180cb5a0 legacy=0x7f9a180cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a177fe700 1 -- 172.21.15.26:0/1780726999 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1815ab60 con 0x7f9a1815a400 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a15ffb700 1 -- 172.21.15.26:0/1780726999 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467206889 0 0) 0x7f9a1815ae40 con 0x7f9a180cb5a0 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a177fe700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1815a400 0x7f9a18156e90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009910 tx=0x7f9a100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d480c6c552f3f00e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a15ffb700 1 -- 172.21.15.26:0/1780726999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000b820 con 0x7f9a1815a400 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a15ffb700 1 -- 172.21.15.26:0/1780726999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000b980 con 0x7f9a1815a400 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.371+0000 7f9a15ffb700 1 -- 172.21.15.26:0/1780726999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000bd20 con 0x7f9a1815a400 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/1780726999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1815a400 msgr2=0x7f9a18156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1815a400 0x7f9a18156e90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009910 tx=0x7f9a100091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/1780726999 shutdown_connections 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1815a400 0x7f9a18156e90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/1780726999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a180cb970 0x7f9a18159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/1780726999 >> 172.21.15.26:0/1780726999 conn(0x7f9a18070e30 msgr2=0x7f9a180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/1780726999 shutdown_connections 2023-10-09T11:40:48.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.372+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/1780726999 wait complete. 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.373+0000 7f9a1d7c1700 1 Processor -- start 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.373+0000 7f9a1d7c1700 1 -- start start 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a180cb970 0x7f9a180b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1815a400 0x7f9a18153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180c7860 con 0x7f9a180cb5a0 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180b5dd0 con 0x7f9a180cb970 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180b60b0 con 0x7f9a1815a400 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48884/0 (socket says 172.21.15.26:48884) 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 -- 172.21.15.26:0/3240834291 learned_addr learned my addr 172.21.15.26:0/3240834291 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a177fe700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1815a400 0x7f9a18153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 -- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1815a400 msgr2=0x7f9a18153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1815a400 0x7f9a18153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a167fc700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a180cb970 0x7f9a180b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 -- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a180cb970 msgr2=0x7f9a180b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a180cb970 0x7f9a180b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 -- 172.21.15.26:0/3240834291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009420 con 0x7f9a180cb5a0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a16ffd700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800cc70 tx=0x7f9a08001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800ce80 con 0x7f9a180cb5a0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800ab70 con 0x7f9a180cb5a0 2023-10-09T11:40:48.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a180c7b00 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080070f0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.374+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a181571a0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.375+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1815a800 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.376+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9a080074e0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.376+0000 7f9a0effd700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 0x7f99f80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.376+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a08084e20 con 0x7f9a180cb5a0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.377+0000 7f9a167fc700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 0x7f99f80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.377+0000 7f9a167fc700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 0x7f99f80696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a180ca7c0 tx=0x7f9a00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.381+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a08051dc0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.574+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a1804c3c0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.575+0000 7f9a0effd700 1 -- 172.21.15.26:0/3240834291 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f9a080553e0 con 0x7f9a180cb5a0 2023-10-09T11:40:48.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:48.575 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:35.178315+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:32.170908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:32.744674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 msgr2=0x7f99f80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 0x7f99f80696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a180ca7c0 tx=0x7f9a00008040 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 msgr2=0x7f9a18156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800cc70 tx=0x7f9a08001a30 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 shutdown_connections 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f99f8067200 0x7f99f80696b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1815a400 0x7f9a18153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a180cb5a0 0x7f9a18156c60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 --2- 172.21.15.26:0/3240834291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a180cb970 0x7f9a180b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 >> 172.21.15.26:0/3240834291 conn(0x7f9a18070e30 msgr2=0x7f9a18154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 shutdown_connections 2023-10-09T11:40:48.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.577+0000 7f9a1d7c1700 1 -- 172.21.15.26:0/3240834291 wait complete. 2023-10-09T11:40:48.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:40:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.708+0000 7f0d0b6d2700 1 Processor -- start 2023-10-09T11:40:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.708+0000 7f0d0b6d2700 1 -- start start 2023-10-09T11:40:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.709+0000 7f0d0b6d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.709+0000 7f0d0b6d2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d0415a400 0x7f0d04156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.709+0000 7f0d0b6d2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0415ae40 con 0x7f0d040cb5a0 2023-10-09T11:40:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.709+0000 7f0d0b6d2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d040ce0f0 con 0x7f0d0415a400 2023-10-09T11:40:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.709+0000 7f0d0b6d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040cbde0 con 0x7f0d040cb970 2023-10-09T11:40:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d08c6d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d0415a400 0x7f0d04156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d08c6d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:34774/0 (socket says 172.21.15.26:34774) 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d08c6d700 1 -- 172.21.15.26:0/2996249558 learned_addr learned my addr 172.21.15.26:0/2996249558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d0946e700 1 --1- 172.21.15.26:0/2996249558 >> v1:172.21.15.67:6789/0 conn(0x7f0d040cb5a0 0x7f0d040cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:57964/0 (socket says 172.21.15.26:57964) 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 -- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 msgr2=0x7f0d04159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 -- 172.21.15.26:0/2996249558 >> v1:172.21.15.67:6789/0 conn(0x7f0d040cb5a0 legacy=0x7f0d040cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d03fff700 1 -- 172.21.15.26:0/2996249558 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933916245 0 0) 0x7f0d0415ae40 con 0x7f0d040cb5a0 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 -- 172.21.15.26:0/2996249558 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0415ab60 con 0x7f0d0415a400 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d08c6d700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d09c6f700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d0415a400 0x7f0d04156e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009e90 tx=0x7f0cfc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f954cf427896c29c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d03fff700 1 -- 172.21.15.26:0/2996249558 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00e070 con 0x7f0d0415a400 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.710+0000 7f0d03fff700 1 -- 172.21.15.26:0/2996249558 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00bbf0 con 0x7f0d0415a400 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d03fff700 1 -- 172.21.15.26:0/2996249558 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc012430 con 0x7f0d0415a400 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d0415a400 msgr2=0x7f0d04156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d0415a400 0x7f0d04156e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009e90 tx=0x7f0cfc009780 comp rx=0 tx=0).stop 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/2996249558 shutdown_connections 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d0415a400 0x7f0d04156e90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/2996249558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d040cb970 0x7f0d04159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/2996249558 >> 172.21.15.26:0/2996249558 conn(0x7f0d04070e30 msgr2=0x7f0d040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/2996249558 shutdown_connections 2023-10-09T11:40:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.711+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/2996249558 wait complete. 2023-10-09T11:40:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.712+0000 7f0d0b6d2700 1 Processor -- start 2023-10-09T11:40:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.712+0000 7f0d0b6d2700 1 -- start start 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d040cb970 0x7f0d04154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d0415a400 0x7f0d04154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c7e10 con 0x7f0d040cb5a0 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04169060 con 0x7f0d040cb970 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0b6d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04155670 con 0x7f0d0415a400 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0946e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0946e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48892/0 (socket says 172.21.15.26:48892) 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d0946e700 1 -- 172.21.15.26:0/248429422 learned_addr learned my addr 172.21.15.26:0/248429422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d09c6f700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d0415a400 0x7f0d04154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.713+0000 7f0d08c6d700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d040cb970 0x7f0d04154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 -- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d0415a400 msgr2=0x7f0d04154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d0415a400 0x7f0d04154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 -- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d040cb970 msgr2=0x7f0d04154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d040cb970 0x7f0d04154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 -- 172.21.15.26:0/248429422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80094f0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0946e700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c5e0 tx=0x7f0cf4001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4005a70 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4005bd0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc009a20 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40070d0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.714+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040c77c0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.715+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0404c3c0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.715+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0cf4007480 con 0x7f0d040cb5a0 2023-10-09T11:40:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.716+0000 7f0d017fa700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 0x7f0cf00696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.716+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0cf4083dd0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.716+0000 7f0d08c6d700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 0x7f0cf00696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.716+0000 7f0d08c6d700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 0x7f0cf00696e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d040af6c0 tx=0x7f0cf8009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.720+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cf4050cf0 con 0x7f0d040cb5a0 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.959+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d040c7b60 con 0x7f0d040cb5a0 2023-10-09T11:40:48.960 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:40:48.959+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.963+0000 7f0d017fa700 1 -- 172.21.15.26:0/248429422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cf4017070 con 0x7f0d040cb5a0 2023-10-09T11:40:48.964 INFO:tasks.ceph.mds.c.smithi026.stderr: -1765> 2023-10-09T11:40:40.185+0000 7ff3289d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 msgr2=0x7f0cf00696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 0x7f0cf00696e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d040af6c0 tx=0x7f0cf8009250 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 msgr2=0x7f0d04168b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c5e0 tx=0x7f0cf4001040 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 shutdown_connections 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0cf0067230 0x7f0cf00696e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d0415a400 0x7f0d04154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d040cb5a0 0x7f0d04168b20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 --2- 172.21.15.26:0/248429422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d040cb970 0x7f0d04154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 >> 172.21.15.26:0/248429422 conn(0x7f0d04070e30 msgr2=0x7f0d040b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 shutdown_connections 2023-10-09T11:40:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:48.965+0000 7f0d0b6d2700 1 -- 172.21.15.26:0/248429422 wait complete. 2023-10-09T11:40:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:40:48.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:40:48.988 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:40:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.100+0000 7f285df60700 1 Processor -- start 2023-10-09T11:40:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.100+0000 7f285df60700 1 -- start start 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285df60700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2858153dd0 0x7f285815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285df60700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815ac50 con 0x7f2858153a00 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285df60700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815d010 con 0x7f28580cea00 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285df60700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285815af60 con 0x7f2858153dd0 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f2857fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2858153dd0 0x7f285815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285cf5e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2858153a00 0x7f285815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56352/0 (socket says 172.21.15.26:56352) 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f285cf5e700 1 -- 172.21.15.26:0/433182080 learned_addr learned my addr 172.21.15.26:0/433182080 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f2857fff700 1 -- 172.21.15.26:0/433182080 >> v1:172.21.15.67:6789/0 conn(0x7f28580cea00 legacy=0x7f28580ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f2857fff700 1 -- 172.21.15.26:0/433182080 >> v1:172.21.15.26:6789/0 conn(0x7f2858153a00 legacy=0x7f285815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f28577fe700 1 -- 172.21.15.26:0/433182080 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075169624 0 0) 0x7f285815ac50 con 0x7f2858153a00 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.101+0000 7f2857fff700 1 -- 172.21.15.26:0/433182080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285815b240 con 0x7f2858153dd0 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f2857fff700 1 --2- 172.21.15.26:0/433182080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f285815de50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2848009e60 tx=0x7f2848009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8ebca735cfc315 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f28577fe700 1 -- 172.21.15.26:0/433182080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800e070 con 0x7f2858153dd0 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f28577fe700 1 -- 172.21.15.26:0/433182080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800bc30 con 0x7f2858153dd0 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f28577fe700 1 -- 172.21.15.26:0/433182080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848012430 con 0x7f2858153dd0 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 -- 172.21.15.26:0/433182080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 msgr2=0x7f285815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 --2- 172.21.15.26:0/433182080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f285815de50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2848009e60 tx=0x7f2848009780 comp rx=0 tx=0).stop 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 -- 172.21.15.26:0/433182080 shutdown_connections 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 --2- 172.21.15.26:0/433182080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f285815de50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 -- 172.21.15.26:0/433182080 >> 172.21.15.26:0/433182080 conn(0x7f28580703a0 msgr2=0x7f28580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 -- 172.21.15.26:0/433182080 shutdown_connections 2023-10-09T11:40:49.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.102+0000 7f285df60700 1 -- 172.21.15.26:0/433182080 wait complete. 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.103+0000 7f285df60700 1 Processor -- start 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 -- start start 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28580cea00 0x7f28580c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2858153a00 0x7f28580ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580ccfe0 con 0x7f2858153dd0 2023-10-09T11:40:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858140fb0 con 0x7f28580cea00 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285df60700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580cd1d0 con 0x7f2858153a00 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285d75f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285d75f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48942/0 (socket says 172.21.15.26:48942) 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285d75f700 1 -- 172.21.15.26:0/3470986447 learned_addr learned my addr 172.21.15.26:0/3470986447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f285cf5e700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28580cea00 0x7f28580c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.104+0000 7f2857fff700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2858153a00 0x7f28580ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 -- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2858153a00 msgr2=0x7f28580ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2858153a00 0x7f28580ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 -- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28580cea00 msgr2=0x7f28580c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28580cea00 0x7f28580c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 -- 172.21.15.26:0/3470986447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009a20 con 0x7f2858153dd0 2023-10-09T11:40:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285d75f700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f284000c560 tx=0x7f2840007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011590 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28400116f0 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011ab0 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858155e50 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.105+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858156410 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.106+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285804c3c0 con 0x7f2858153dd0 2023-10-09T11:40:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.107+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f284001b3b0 con 0x7f2858153dd0 2023-10-09T11:40:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.107+0000 7f2854ff9700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 0x7f28380696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.107+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2840083d90 con 0x7f2858153dd0 2023-10-09T11:40:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.107+0000 7f285cf5e700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 0x7f28380696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.108+0000 7f285cf5e700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 0x7f28380696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2850007fd0 tx=0x7f2850007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.111+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2840087030 con 0x7f2858153dd0 2023-10-09T11:40:49.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.351+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f285815b520 con 0x7f2858153dd0 2023-10-09T11:40:49.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.964+0000 7f2854ff9700 1 -- 172.21.15.26:0/3470986447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2840017020 con 0x7f2858153dd0 2023-10-09T11:40:49.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 msgr2=0x7f28380696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 0x7f28380696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2850007fd0 tx=0x7f2850007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 msgr2=0x7f2858140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f284000c560 tx=0x7f2840007ef0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 shutdown_connections 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2858153dd0 0x7f2858140a70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28580cea00 0x7f28580c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2838067200 0x7f28380696b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 --2- 172.21.15.26:0/3470986447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2858153a00 0x7f28580ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 >> 172.21.15.26:0/3470986447 conn(0x7f28580703a0 msgr2=0x7f28580b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 shutdown_connections 2023-10-09T11:40:49.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:49.967+0000 7f285df60700 1 -- 172.21.15.26:0/3470986447 wait complete. 2023-10-09T11:40:49.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:40:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.154+0000 7f870afc6700 1 Processor -- start 2023-10-09T11:40:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.154+0000 7f870afc6700 1 -- start start 2023-10-09T11:40:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f870afc6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8704159fb0 0x7f870415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f870afc6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870415d570 con 0x7f870415a8c0 2023-10-09T11:40:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f870afc6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870415d850 con 0x7f87040cd5a0 2023-10-09T11:40:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f870afc6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870415e180 con 0x7f8704159fb0 2023-10-09T11:40:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f8709fc4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8704159fb0 0x7f870415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f87097c3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f870415a8c0 0x7f87040cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34032/0 (socket says 172.21.15.26:34032) 2023-10-09T11:40:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f87097c3700 1 -- 172.21.15.26:0/3343747695 learned_addr learned my addr 172.21.15.26:0/3343747695 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f8709fc4700 1 -- 172.21.15.26:0/3343747695 >> v1:172.21.15.67:6789/0 conn(0x7f87040cd5a0 legacy=0x7f87040cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f8709fc4700 1 -- 172.21.15.26:0/3343747695 >> v1:172.21.15.26:6789/0 conn(0x7f870415a8c0 legacy=0x7f87040cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f8709fc4700 1 -- 172.21.15.26:0/3343747695 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870415db30 con 0x7f8704159fb0 2023-10-09T11:40:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.155+0000 7f8708fc2700 1 -- 172.21.15.26:0/3343747695 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796665594 0 0) 0x7f870415d570 con 0x7f870415a8c0 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f8709fc4700 1 --2- 172.21.15.26:0/3343747695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704159fb0 0x7f870415a380 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098e0 tx=0x7f86fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e96348ed476408 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f8708fc2700 1 -- 172.21.15.26:0/3343747695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc009e80 con 0x7f8704159fb0 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f8708fc2700 1 -- 172.21.15.26:0/3343747695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00b820 con 0x7f8704159fb0 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f8708fc2700 1 -- 172.21.15.26:0/3343747695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00bba0 con 0x7f8704159fb0 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 -- 172.21.15.26:0/3343747695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704159fb0 msgr2=0x7f870415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 --2- 172.21.15.26:0/3343747695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704159fb0 0x7f870415a380 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098e0 tx=0x7f86fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 -- 172.21.15.26:0/3343747695 shutdown_connections 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 --2- 172.21.15.26:0/3343747695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704159fb0 0x7f870415a380 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 -- 172.21.15.26:0/3343747695 >> 172.21.15.26:0/3343747695 conn(0x7f87040703a0 msgr2=0x7f87040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.156+0000 7f870afc6700 1 -- 172.21.15.26:0/3343747695 shutdown_connections 2023-10-09T11:40:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.157+0000 7f870afc6700 1 -- 172.21.15.26:0/3343747695 wait complete. 2023-10-09T11:40:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 Processor -- start 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 -- start start 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 0x7f8704147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 0x7f87040c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b2140 con 0x7f870415a8c0 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040c7f50 con 0x7f8704159fb0 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870afc6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b18a0 con 0x7f87040cd5a0 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870a7c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870a7c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50782/0 (socket says 172.21.15.26:50782) 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.158+0000 7f870a7c5700 1 -- 172.21.15.26:0/3953303042 learned_addr learned my addr 172.21.15.26:0/3953303042 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f87097c3700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 0x7f87040c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f8709fc4700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 0x7f8704147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 -- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 msgr2=0x7f8704147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 0x7f8704147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 -- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 msgr2=0x7f87040c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 0x7f87040c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 -- 172.21.15.26:0/3953303042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc009420 con 0x7f870415a8c0 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f87097c3700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 0x7f87040c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f8709fc4700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 0x7f8704147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870a7c5700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f86f400bc30 tx=0x7f86f4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400c9b0 con 0x7f870415a8c0 2023-10-09T11:40:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400cb50 con 0x7f870415a8c0 2023-10-09T11:40:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87040b1b80 con 0x7f870415a8c0 2023-10-09T11:40:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4014410 con 0x7f870415a8c0 2023-10-09T11:40:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.159+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87040c81f0 con 0x7f870415a8c0 2023-10-09T11:40:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.160+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87040c8410 con 0x7f870415a8c0 2023-10-09T11:40:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.161+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f86f4014800 con 0x7f870415a8c0 2023-10-09T11:40:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.161+0000 7f8701ffb700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 0x7f86f00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.161+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f86f4084a80 con 0x7f870415a8c0 2023-10-09T11:40:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.161+0000 7f8709fc4700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 0x7f86f00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.162+0000 7f8709fc4700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 0x7f86f00696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0030c0 tx=0x7f86fc016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.166+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86f404c5a0 con 0x7f870415a8c0 2023-10-09T11:40:50.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:50.362+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f870404c3c0 con 0x7f870415a8c0 2023-10-09T11:40:51.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.263+0000 7f8701ffb700 1 -- 172.21.15.26:0/3953303042 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f86f4086e60 con 0x7f870415a8c0 2023-10-09T11:40:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.267+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 msgr2=0x7f86f00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.267+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 0x7f86f00696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0030c0 tx=0x7f86fc016000 comp rx=0 tx=0).stop 2023-10-09T11:40:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 msgr2=0x7f87040c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f86f400bc30 tx=0x7f86f4009820 comp rx=0 tx=0).stop 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 shutdown_connections 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870415a8c0 0x7f87040c69b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f0067200 0x7f86f00696b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87040cd5a0 0x7f8704147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 --2- 172.21.15.26:0/3953303042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704159fb0 0x7f87040c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 >> 172.21.15.26:0/3953303042 conn(0x7f87040703a0 msgr2=0x7f870414dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 shutdown_connections 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.268+0000 7f870afc6700 1 -- 172.21.15.26:0/3953303042 wait complete. 2023-10-09T11:40:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:40:51.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:40:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.419+0000 7f2f8f1a2700 1 Processor -- start 2023-10-09T11:40:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.419+0000 7f2f8f1a2700 1 -- start start 2023-10-09T11:40:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8f1a2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 0x7f2f880b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8f1a2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880b0c80 con 0x7f2f88159800 2023-10-09T11:40:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8f1a2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880b0f60 con 0x7f2f880b1d40 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8f1a2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880d10d0 con 0x7f2f880b24f0 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8e9a1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2f88159800 0x7f2f880b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34046/0 (socket says 172.21.15.26:34046) 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8e9a1700 1 -- 172.21.15.26:0/327067738 learned_addr learned my addr 172.21.15.26:0/327067738 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8e1a0700 1 --2- 172.21.15.26:0/327067738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 0x7f2f880b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035551645 0 0) 0x7f2f880b0c80 con 0x7f2f88159800 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.420+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f70003570 con 0x7f2f88159800 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244484093 0 0) 0x7f2f880b0f60 con 0x7f2f880b1d40 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f880b0c80 con 0x7f2f880b1d40 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76197145 0 0) 0x7f2f70003570 con 0x7f2f88159800 2023-10-09T11:40:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8e1a0700 1 -- 172.21.15.26:0/327067738 >> v1:172.21.15.67:6789/0 conn(0x7f2f880b1d40 legacy=0x7f2f881590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8e1a0700 1 -- 172.21.15.26:0/327067738 >> v1:172.21.15.26:6789/0 conn(0x7f2f88159800 legacy=0x7f2f880b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8e1a0700 1 -- 172.21.15.26:0/327067738 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880b1240 con 0x7f2f880b24f0 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8e1a0700 1 --2- 172.21.15.26:0/327067738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 0x7f2f880b0580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009910 tx=0x7f2f780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8cd7971908cfa0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800017f0 con 0x7f2f880b24f0 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78011420 con 0x7f2f880b24f0 2023-10-09T11:40:51.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.421+0000 7f2f8d19e700 1 -- 172.21.15.26:0/327067738 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780117c0 con 0x7f2f880b24f0 2023-10-09T11:40:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/327067738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 msgr2=0x7f2f880b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/327067738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 0x7f2f880b0580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009910 tx=0x7f2f780091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/327067738 shutdown_connections 2023-10-09T11:40:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/327067738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b24f0 0x7f2f880b0580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/327067738 >> 172.21.15.26:0/327067738 conn(0x7f2f880703a0 msgr2=0x7f2f880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/327067738 shutdown_connections 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.422+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/327067738 wait complete. 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 Processor -- start 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 -- start start 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b1d40 0x7f2f8815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f880b24f0 0x7f2f880a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a7370 con 0x7f2f88159800 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a75f0 con 0x7f2f880b24f0 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.423+0000 7f2f8f1a2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a78d0 con 0x7f2f880b1d40 2023-10-09T11:40:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50798/0 (socket says 172.21.15.26:50798) 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 -- 172.21.15.26:0/1611993180 learned_addr learned my addr 172.21.15.26:0/1611993180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e1a0700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b1d40 0x7f2f8815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8d99f700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f880b24f0 0x7f2f880a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 -- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b1d40 msgr2=0x7f2f8815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b1d40 0x7f2f8815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 -- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f880b24f0 msgr2=0x7f2f880a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f880b24f0 0x7f2f880a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 -- 172.21.15.26:0/1611993180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78009420 con 0x7f2f88159800 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8e9a1700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000cc80 tx=0x7f2f80007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80004dc0 con 0x7f2f88159800 2023-10-09T11:40:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880a7bb0 con 0x7f2f88159800 2023-10-09T11:40:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000a660 con 0x7f2f88159800 2023-10-09T11:40:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000aa20 con 0x7f2f88159800 2023-10-09T11:40:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.424+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880a8170 con 0x7f2f88159800 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.425+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f880a8390 con 0x7f2f88159800 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.426+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2f80007150 con 0x7f2f88159800 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.426+0000 7f2f867fc700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 0x7f2f740696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.426+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2f80083ed0 con 0x7f2f88159800 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.426+0000 7f2f8e1a0700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 0x7f2f740696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.427+0000 7f2f8e1a0700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 0x7f2f740696e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f780030c0 tx=0x7f2f78016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.431+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f80050f50 con 0x7f2f88159800 2023-10-09T11:40:51.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:51.623+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f8804c3c0 con 0x7f2f88159800 2023-10-09T11:40:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.264+0000 7f2f867fc700 1 -- 172.21.15.26:0/1611993180 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2f80018020 con 0x7f2f88159800 2023-10-09T11:40:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 msgr2=0x7f2f740696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 0x7f2f740696e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f780030c0 tx=0x7f2f78016000 comp rx=0 tx=0).stop 2023-10-09T11:40:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 msgr2=0x7f2f881531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000cc80 tx=0x7f2f80007d20 comp rx=0 tx=0).stop 2023-10-09T11:40:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 shutdown_connections 2023-10-09T11:40:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f88159800 0x7f2f881531b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2f74067230 0x7f2f740696e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f880b1d40 0x7f2f8815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 --2- 172.21.15.26:0/1611993180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f880b24f0 0x7f2f880a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 >> 172.21.15.26:0/1611993180 conn(0x7f2f880703a0 msgr2=0x7f2f88155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 shutdown_connections 2023-10-09T11:40:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.268+0000 7f2f8f1a2700 1 -- 172.21.15.26:0/1611993180 wait complete. 2023-10-09T11:40:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:40:52.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:40:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.411+0000 7f746b59e700 1 Processor -- start 2023-10-09T11:40:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.411+0000 7f746b59e700 1 -- start start 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.411+0000 7f746b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.411+0000 7f746b59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746b59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c15af60 con 0x7f746c0cea00 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746b59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c15d010 con 0x7f746c15de50 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c15b240 con 0x7f746c153a00 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f7469d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:59268/0 (socket says 172.21.15.26:59268) 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 -- 172.21.15.26:0/1570688957 learned_addr learned my addr 172.21.15.26:0/1570688957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f7469d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:34002/0 (socket says 172.21.15.26:34002) 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746ad9d700 1 --1- 172.21.15.26:0/1570688957 >> v1:172.21.15.67:6789/0 conn(0x7f746c0cea00 0x7f746c0cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51218/0 (socket says 172.21.15.26:51218) 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 -- 172.21.15.26:0/1570688957 >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 msgr2=0x7f746c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 --2- 172.21.15.26:0/1570688957 >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 -- 172.21.15.26:0/1570688957 >> v1:172.21.15.67:6789/0 conn(0x7f746c0cea00 legacy=0x7f746c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f746a59c700 1 -- 172.21.15.26:0/1570688957 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c15b520 con 0x7f746c153a00 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.412+0000 7f7469d9b700 1 --2- 172.21.15.26:0/1570688957 >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746a59c700 1 --2- 172.21.15.26:0/1570688957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f745c009f20 tx=0x7f745c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf58216c08975264 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746959a700 1 -- 172.21.15.26:0/1570688957 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00e070 con 0x7f746c153a00 2023-10-09T11:40:52.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746959a700 1 -- 172.21.15.26:0/1570688957 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00b9d0 con 0x7f746c153a00 2023-10-09T11:40:52.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746959a700 1 -- 172.21.15.26:0/1570688957 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0092e0 con 0x7f746c153a00 2023-10-09T11:40:52.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 -- 172.21.15.26:0/1570688957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 msgr2=0x7f746c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 --2- 172.21.15.26:0/1570688957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f745c009f20 tx=0x7f745c009840 comp rx=0 tx=0).stop 2023-10-09T11:40:52.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 -- 172.21.15.26:0/1570688957 shutdown_connections 2023-10-09T11:40:52.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 --2- 172.21.15.26:0/1570688957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c153a00 0x7f746c153dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 --2- 172.21.15.26:0/1570688957 >> v2:172.21.15.67:3300/0 conn(0x7f746c15de50 0x7f746c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 -- 172.21.15.26:0/1570688957 >> 172.21.15.26:0/1570688957 conn(0x7f746c0703a0 msgr2=0x7f746c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 -- 172.21.15.26:0/1570688957 shutdown_connections 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.413+0000 7f746b59e700 1 -- 172.21.15.26:0/1570688957 wait complete. 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.414+0000 7f746b59e700 1 Processor -- start 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 -- start start 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c15de50 0x7f746c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c16a6b0 con 0x7f746c153a00 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c1568a0 con 0x7f746c0cea00 2023-10-09T11:40:52.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c16a060 con 0x7f746c15de50 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f7469d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f7469d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50802/0 (socket says 172.21.15.26:50802) 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f7469d9b700 1 -- 172.21.15.26:0/1859962376 learned_addr learned my addr 172.21.15.26:0/1859962376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:34008/0 (socket says 172.21.15.26:34008) 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.415+0000 7f746ad9d700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c15de50 0x7f746c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 -- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c15de50 msgr2=0x7f746c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c15de50 0x7f746c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 -- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 msgr2=0x7f746c0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 -- 172.21.15.26:0/1859962376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454009420 con 0x7f746c153a00 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f746a59c700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f7469d9b700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f745400ec80 tx=0x7f74540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400c850 con 0x7f746c153a00 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400c9b0 con 0x7f746c153a00 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c009ae0 con 0x7f746c153a00 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400cd30 con 0x7f746c153a00 2023-10-09T11:40:52.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.416+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c156500 con 0x7f746c153a00 2023-10-09T11:40:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.417+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c16a820 con 0x7f746c153a00 2023-10-09T11:40:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.418+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7454013680 con 0x7f746c153a00 2023-10-09T11:40:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.418+0000 7f74627fc700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 0x7f744c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.418+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f74540848c0 con 0x7f746c153a00 2023-10-09T11:40:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.418+0000 7f746a59c700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 0x7f744c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.419+0000 7f746a59c700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 0x7f744c0696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f746c0cdb30 tx=0x7f745c018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.423+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7454051ae0 con 0x7f746c153a00 2023-10-09T11:40:52.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.616+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f746c04c3c0 con 0x7f746c153a00 2023-10-09T11:40:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.620+0000 7f74627fc700 1 -- 172.21.15.26:0/1859962376 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7454055100 con 0x7f746c153a00 2023-10-09T11:40:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 msgr2=0x7f744c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 0x7f744c0696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f746c0cdb30 tx=0x7f745c018000 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 msgr2=0x7f746c0b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f745400ec80 tx=0x7f74540091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 shutdown_connections 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f744c067200 0x7f744c0696b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f746c15de50 0x7f746c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f746c0cea00 0x7f746c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 --2- 172.21.15.26:0/1859962376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c153a00 0x7f746c0b1820 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 >> 172.21.15.26:0/1859962376 conn(0x7f746c0703a0 msgr2=0x7f746c158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 shutdown_connections 2023-10-09T11:40:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.622+0000 7f746b59e700 1 -- 172.21.15.26:0/1859962376 wait complete. 2023-10-09T11:40:52.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-09T11:40:52.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.752+0000 7f9142072700 1 Processor -- start 2023-10-09T11:40:52.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.752+0000 7f9142072700 1 -- start start 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f9142072700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 0x7f913c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f9142072700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c0cd9e0 0x7f913c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f9142072700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c15ae40 con 0x7f913c15a400 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f9142072700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0d13f0 con 0x7f913c0cd9e0 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f9142072700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c15ab60 con 0x7f913c0cb5a0 2023-10-09T11:40:52.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f913affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c0cd9e0 0x7f913c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f913affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c0cd9e0 0x7f913c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50812/0 (socket says 172.21.15.26:50812) 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f913affd700 1 -- 172.21.15.26:0/198246954 learned_addr learned my addr 172.21.15.26:0/198246954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.753+0000 7f913b7fe700 1 --2- 172.21.15.26:0/198246954 >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 0x7f913c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913affd700 1 -- 172.21.15.26:0/198246954 >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 msgr2=0x7f913c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913affd700 1 --2- 172.21.15.26:0/198246954 >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 0x7f913c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913affd700 1 -- 172.21.15.26:0/198246954 >> v1:172.21.15.67:6789/0 conn(0x7f913c15a400 legacy=0x7f913c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913affd700 1 -- 172.21.15.26:0/198246954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0ccf00 con 0x7f913c0cd9e0 2023-10-09T11:40:52.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913b7fe700 1 --2- 172.21.15.26:0/198246954 >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 0x7f913c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913affd700 1 --2- 172.21.15.26:0/198246954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cd9e0 0x7f913c159ec0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f91300099b0 tx=0x7f9130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b639755019fb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913a7fc700 1 -- 172.21.15.26:0/198246954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000b820 con 0x7f913c0cd9e0 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913a7fc700 1 -- 172.21.15.26:0/198246954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000b980 con 0x7f913c0cd9e0 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f913a7fc700 1 -- 172.21.15.26:0/198246954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000bd20 con 0x7f913c0cd9e0 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 -- 172.21.15.26:0/198246954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cd9e0 msgr2=0x7f913c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 --2- 172.21.15.26:0/198246954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cd9e0 0x7f913c159ec0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f91300099b0 tx=0x7f9130009250 comp rx=0 tx=0).stop 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 -- 172.21.15.26:0/198246954 shutdown_connections 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 --2- 172.21.15.26:0/198246954 >> v2:172.21.15.67:3300/0 conn(0x7f913c0cb5a0 0x7f913c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 --2- 172.21.15.26:0/198246954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cd9e0 0x7f913c159ec0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 -- 172.21.15.26:0/198246954 >> 172.21.15.26:0/198246954 conn(0x7f913c070e30 msgr2=0x7f913c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 -- 172.21.15.26:0/198246954 shutdown_connections 2023-10-09T11:40:52.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.754+0000 7f9142072700 1 -- 172.21.15.26:0/198246954 wait complete. 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.756+0000 7f9142072700 1 Processor -- start 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.756+0000 7f9142072700 1 -- start start 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.756+0000 7f9142072700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.756+0000 7f9142072700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 0x7f913c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 0x7f913c0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c151710 con 0x7f913c0cb5a0 2023-10-09T11:40:52.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0b3d00 con 0x7f913c15a400 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0b3fe0 con 0x7f913c0cd9e0 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50824/0 (socket says 172.21.15.26:50824) 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 -- 172.21.15.26:0/86207062 learned_addr learned my addr 172.21.15.26:0/86207062 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913bfff700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 0x7f913c0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913affd700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 0x7f913c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 -- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 msgr2=0x7f913c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 0x7f913c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 -- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 msgr2=0x7f913c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 0x7f913c0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 -- 172.21.15.26:0/86207062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300094f0 con 0x7f913c0cb5a0 2023-10-09T11:40:52.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913affd700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 0x7f913c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913bfff700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 0x7f913c0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f913b7fe700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e8d0 tx=0x7f912c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ee70 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c00c5e0 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c0b42c0 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00c980 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.757+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0b4880 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.758+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c04c3c0 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.759+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f912c013410 con 0x7f913c0cb5a0 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.759+0000 7f91237fe700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 0x7f91280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.759+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f912c084660 con 0x7f913c0cb5a0 2023-10-09T11:40:52.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.760+0000 7f913affd700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 0x7f91280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.760+0000 7f913affd700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 0x7f91280696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91300099b0 tx=0x7f9130017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:52.764+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f912c055120 con 0x7f913c0cb5a0 2023-10-09T11:40:53.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.038+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f913c0b4bf0 con 0x7f913c0cb5a0 2023-10-09T11:40:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.274+0000 7f91237fe700 1 -- 172.21.15.26:0/86207062 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v263) v1 ==== 158+0+0 (secure 0 0 0) 0x7f912c054cb0 con 0x7f913c0cb5a0 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 msgr2=0x7f91280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 0x7f91280696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91300099b0 tx=0x7f9130017000 comp rx=0 tx=0).stop 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 msgr2=0x7f913c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e8d0 tx=0x7f912c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 shutdown_connections 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f913c15a400 0x7f913c0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0cb5a0 0x7f913c0b34b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9128067200 0x7f91280696b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 --2- 172.21.15.26:0/86207062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f913c0cd9e0 0x7f913c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 >> 172.21.15.26:0/86207062 conn(0x7f913c070e30 msgr2=0x7f913c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:53.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 shutdown_connections 2023-10-09T11:40:53.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.276+0000 7f9142072700 1 -- 172.21.15.26:0/86207062 wait complete. 2023-10-09T11:40:53.290 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-09T11:40:53.290 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-09T11:40:53.290 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:40:53.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-09T11:40:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.408+0000 7f8abf902700 1 Processor -- start 2023-10-09T11:40:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.408+0000 7f8abf902700 1 -- start start 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abf902700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8ab80cb970 0x7f8ab8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abf902700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ab815a400 0x7f8ab8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abf902700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab815ae40 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abf902700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80ce0f0 con 0x7f8ab815a400 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abf902700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80d13f0 con 0x7f8ab80cb970 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ab815a400 0x7f8ab8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ab815a400 0x7f8ab8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50828/0 (socket says 172.21.15.26:50828) 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abd69e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8ab80cb5a0 0x7f8ab80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34050/0 (socket says 172.21.15.26:34050) 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 -- 172.21.15.26:0/1277762504 learned_addr learned my addr 172.21.15.26:0/1277762504 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abce9d700 1 --2- 172.21.15.26:0/1277762504 >> v2:172.21.15.67:3300/0 conn(0x7f8ab80cb970 0x7f8ab8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 -- 172.21.15.26:0/1277762504 >> v2:172.21.15.67:3300/0 conn(0x7f8ab80cb970 msgr2=0x7f8ab8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 --2- 172.21.15.26:0/1277762504 >> v2:172.21.15.67:3300/0 conn(0x7f8ab80cb970 0x7f8ab8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 -- 172.21.15.26:0/1277762504 >> v1:172.21.15.26:6789/0 conn(0x7f8ab80cb5a0 legacy=0x7f8ab80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 -- 172.21.15.26:0/1277762504 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab815ab60 con 0x7f8ab815a400 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8aaffff700 1 -- 172.21.15.26:0/1277762504 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013298434 0 0) 0x7f8ab815ae40 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.409+0000 7f8abde9f700 1 --2- 172.21.15.26:0/1277762504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab815a400 0x7f8ab8156e90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80d1780 tx=0x7f8ab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e57b5e2a78ca19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8aaffff700 1 -- 172.21.15.26:0/1277762504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000e070 con 0x7f8ab815a400 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8aaffff700 1 -- 172.21.15.26:0/1277762504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab000ba50 con 0x7f8ab815a400 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8aaffff700 1 -- 172.21.15.26:0/1277762504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00092e0 con 0x7f8ab815a400 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 -- 172.21.15.26:0/1277762504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab815a400 msgr2=0x7f8ab8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 --2- 172.21.15.26:0/1277762504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab815a400 0x7f8ab8156e90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80d1780 tx=0x7f8ab0009840 comp rx=0 tx=0).stop 2023-10-09T11:40:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 -- 172.21.15.26:0/1277762504 shutdown_connections 2023-10-09T11:40:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 --2- 172.21.15.26:0/1277762504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab815a400 0x7f8ab8156e90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 --2- 172.21.15.26:0/1277762504 >> v2:172.21.15.67:3300/0 conn(0x7f8ab80cb970 0x7f8ab8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 -- 172.21.15.26:0/1277762504 >> 172.21.15.26:0/1277762504 conn(0x7f8ab8070e30 msgr2=0x7f8ab80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 -- 172.21.15.26:0/1277762504 shutdown_connections 2023-10-09T11:40:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.410+0000 7f8abf902700 1 -- 172.21.15.26:0/1277762504 wait complete. 2023-10-09T11:40:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.411+0000 7f8abf902700 1 Processor -- start 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.411+0000 7f8abf902700 1 -- start start 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab80cb970 0x7f8ab815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ab815a400 0x7f8ab8169250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c9d60 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c8a90 con 0x7f8ab80cb970 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abf902700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c98d0 con 0x7f8ab815a400 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abd69e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abd69e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50842/0 (socket says 172.21.15.26:50842) 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abd69e700 1 -- 172.21.15.26:0/4273536484 learned_addr learned my addr 172.21.15.26:0/4273536484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abce9d700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab80cb970 0x7f8ab815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.412+0000 7f8abde9f700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ab815a400 0x7f8ab8169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 -- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ab815a400 msgr2=0x7f8ab8169250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ab815a400 0x7f8ab8169250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 -- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab80cb970 msgr2=0x7f8ab815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab80cb970 0x7f8ab815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 -- 172.21.15.26:0/4273536484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009ae0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abd69e700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40011e0 tx=0x7f8ab4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4005a70 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4005bd0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab80c8cc0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40070d0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.413+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80c9300 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.414+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab804c3c0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.414+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8ab4007440 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.415+0000 7f8aad7fa700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 0x7f8a9c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.415+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8ab4083ba0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.415+0000 7f8abce9d700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 0x7f8a9c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.415+0000 7f8abce9d700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 0x7f8a9c0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c6f90 tx=0x7f8aa8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.419+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ab4050dc0 con 0x7f8ab80cb5a0 2023-10-09T11:40:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:53.690+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f8ab80c9bb0 con 0x7f8ab80cb5a0 2023-10-09T11:40:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.275+0000 7f8aad7fa700 1 -- 172.21.15.26:0/4273536484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v264) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8ab4017020 con 0x7f8ab80cb5a0 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 msgr2=0x7f8a9c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 0x7f8a9c0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c6f90 tx=0x7f8aa8008040 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 msgr2=0x7f8ab80c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40011e0 tx=0x7f8ab4007e10 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 shutdown_connections 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a9c067200 0x7f8a9c0696b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ab815a400 0x7f8ab8169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ab80cb5a0 0x7f8ab80c8550 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 --2- 172.21.15.26:0/4273536484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab80cb970 0x7f8ab815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 >> 172.21.15.26:0/4273536484 conn(0x7f8ab8070e30 msgr2=0x7f8ab81547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 shutdown_connections 2023-10-09T11:40:54.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.277+0000 7f8abf902700 1 -- 172.21.15.26:0/4273536484 wait complete. 2023-10-09T11:40:54.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:40:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.422+0000 7fdf9d582700 1 Processor -- start 2023-10-09T11:40:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 -- start start 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf98159530 0x7fdf980ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf9806dc70 0x7fdf98159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980ccfd0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980cf0e0 con 0x7fdf9806dc70 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf9d582700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9815a3d0 con 0x7fdf98159530 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.423+0000 7fdf967fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf9806dc70 0x7fdf98159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf977fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf9806e0e0 0x7fdf980cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34054/0 (socket says 172.21.15.26:34054) 2023-10-09T11:40:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf977fe700 1 -- 172.21.15.26:0/1374190828 learned_addr learned my addr 172.21.15.26:0/1374190828 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf96ffd700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf98159530 0x7fdf980ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf967fc700 1 -- 172.21.15.26:0/1374190828 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf98159530 msgr2=0x7fdf980ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf967fc700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf98159530 0x7fdf980ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf967fc700 1 -- 172.21.15.26:0/1374190828 >> v1:172.21.15.26:6789/0 conn(0x7fdf9806e0e0 legacy=0x7fdf980cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf95ffb700 1 -- 172.21.15.26:0/1374190828 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206069113 0 0) 0x7fdf980ccfd0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf967fc700 1 -- 172.21.15.26:0/1374190828 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9815a6b0 con 0x7fdf9806dc70 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf967fc700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806dc70 0x7fdf98159900 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0098e0 tx=0x7fdf8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349436358a95c532 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf95ffb700 1 -- 172.21.15.26:0/1374190828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00b640 con 0x7fdf9806dc70 2023-10-09T11:40:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf95ffb700 1 -- 172.21.15.26:0/1374190828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00b7a0 con 0x7fdf9806dc70 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.424+0000 7fdf95ffb700 1 -- 172.21.15.26:0/1374190828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00bb40 con 0x7fdf9806dc70 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 -- 172.21.15.26:0/1374190828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806dc70 msgr2=0x7fdf98159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806dc70 0x7fdf98159900 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0098e0 tx=0x7fdf8c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 -- 172.21.15.26:0/1374190828 shutdown_connections 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf98159530 0x7fdf980ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1374190828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806dc70 0x7fdf98159900 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 -- 172.21.15.26:0/1374190828 >> 172.21.15.26:0/1374190828 conn(0x7fdf980703a0 msgr2=0x7fdf980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 -- 172.21.15.26:0/1374190828 shutdown_connections 2023-10-09T11:40:54.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.425+0000 7fdf9d582700 1 -- 172.21.15.26:0/1374190828 wait complete. 2023-10-09T11:40:54.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.426+0000 7fdf9d582700 1 Processor -- start 2023-10-09T11:40:54.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.426+0000 7fdf9d582700 1 -- start start 2023-10-09T11:40:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf9806dc70 0x7fdf980c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf98159530 0x7fdf981436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156a60 con 0x7fdf9806e0e0 2023-10-09T11:40:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156c40 con 0x7fdf98159530 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf9d582700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156f20 con 0x7fdf9806dc70 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50854/0 (socket says 172.21.15.26:50854) 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 -- 172.21.15.26:0/1701550663 learned_addr learned my addr 172.21.15.26:0/1701550663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf96ffd700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf9806dc70 0x7fdf980c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf977fe700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf98159530 0x7fdf981436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 -- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf9806dc70 msgr2=0x7fdf980c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf9806dc70 0x7fdf980c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 -- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf98159530 msgr2=0x7fdf981436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf98159530 0x7fdf981436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 -- 172.21.15.26:0/1701550663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c009420 con 0x7fdf9806e0e0 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.427+0000 7fdf967fc700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdf98089650 tx=0x7fdf8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.428+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00bb20 con 0x7fdf9806e0e0 2023-10-09T11:40:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.428+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c011420 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.428+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf98157200 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.428+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0117c0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.428+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980c8090 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.429+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98157410 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.429+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fdf8c011b70 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.429+0000 7fdf7effd700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 0x7fdf840696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.430+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdf8c085da0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.430+0000 7fdf96ffd700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 0x7fdf840696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.430+0000 7fdf96ffd700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 0x7fdf840696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdf88006f00 tx=0x7fdf88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.434+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf8c052f80 con 0x7fdf9806e0e0 2023-10-09T11:40:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.625+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdf981575f0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.629+0000 7fdf7effd700 1 -- 172.21.15.26:0/1701550663 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf8c0565a0 con 0x7fdf9806e0e0 2023-10-09T11:40:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 msgr2=0x7fdf840696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 0x7fdf840696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdf88006f00 tx=0x7fdf88008040 comp rx=0 tx=0).stop 2023-10-09T11:40:54.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 msgr2=0x7fdf980cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdf98089650 tx=0x7fdf8c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 shutdown_connections 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf98159530 0x7fdf981436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf84067200 0x7fdf840696b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf9806dc70 0x7fdf980c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 --2- 172.21.15.26:0/1701550663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf9806e0e0 0x7fdf980cb700 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 >> 172.21.15.26:0/1701550663 conn(0x7fdf980703a0 msgr2=0x7fdf980c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 shutdown_connections 2023-10-09T11:40:54.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.631+0000 7fdf9d582700 1 -- 172.21.15.26:0/1701550663 wait complete. 2023-10-09T11:40:54.646 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:54.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:54.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:54.751 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:54.751 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:40:54.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 Processor -- start 2023-10-09T11:40:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 -- start start 2023-10-09T11:40:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe02c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c15a280 con 0x7fe02c0cf200 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c06e180 con 0x7fe02c0b0ba0 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.870+0000 7fe03209c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c06d850 con 0x7fe02c0b07d0 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe02c0cf200 0x7fe02c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34068/0 (socket says 172.21.15.26:34068) 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02affd700 1 -- 172.21.15.26:0/594712136 learned_addr learned my addr 172.21.15.26:0/594712136 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02b7fe700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe02c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280285441 0 0) 0x7fe02c15a280 con 0x7fe02c0cf200 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe014003570 con 0x7fe02c0cf200 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002169629 0 0) 0x7fe02c06e180 con 0x7fe02c0b0ba0 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c15a280 con 0x7fe02c0b0ba0 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1594370304 0 0) 0x7fe014003570 con 0x7fe02c0cf200 2023-10-09T11:40:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 msgr2=0x7fe02c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe02c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 >> v1:172.21.15.67:6789/0 conn(0x7fe02c0b0ba0 legacy=0x7fe02c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c06db30 con 0x7fe02c0cf200 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fe020001470 con 0x7fe02c0cf200 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 >> v1:172.21.15.26:6789/0 conn(0x7fe02c0cf200 legacy=0x7fe02c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe014003c20 0x7fe014004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe0140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c06d850 con 0x7fe014004810 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01400bb40 con 0x7fe014003c20 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01400bd00 con 0x7fe02c0b07d0 2023-10-09T11:40:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02affd700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.871+0000 7fe02b7fe700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe014003c20 0x7fe014004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02bfff700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe0140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 -- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 msgr2=0x7fe0140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe0140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 -- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe014003c20 msgr2=0x7fe014004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe014003c20 0x7fe014004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 -- 172.21.15.26:0/594712136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014003570 con 0x7fe014004810 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02bfff700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c0b07d0 0x7fe0140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02affd700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe014004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c2d0 tx=0x7fe020001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a546054a9dd494 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000cba0 con 0x7fe014004810 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000cd00 con 0x7fe014004810 2023-10-09T11:40:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02a7fc700 1 -- 172.21.15.26:0/594712136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020005b70 con 0x7fe014004810 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe03209c700 1 -- 172.21.15.26:0/594712136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 msgr2=0x7fe014004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe03209c700 1 --2- 172.21.15.26:0/594712136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe014004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c2d0 tx=0x7fe020001e10 comp rx=0 tx=0).stop 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.872+0000 7fe02bfff700 1 -- 172.21.15.26:0/594712136 reap_dead start 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.873+0000 7fe03209c700 1 -- 172.21.15.26:0/594712136 shutdown_connections 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.873+0000 7fe03209c700 1 -- 172.21.15.26:0/594712136 >> 172.21.15.26:0/594712136 conn(0x7fe02c06ce80 msgr2=0x7fe02c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.873+0000 7fe03209c700 1 -- 172.21.15.26:0/594712136 shutdown_connections 2023-10-09T11:40:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.873+0000 7fe03209c700 1 -- 172.21.15.26:0/594712136 wait complete. 2023-10-09T11:40:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.874+0000 7fe03209c700 1 Processor -- start 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.874+0000 7fe03209c700 1 -- start start 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.874+0000 7fe03209c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe02c0b37a0 0x7fe02c169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c16a430 0x7fe02c16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c098500 con 0x7fe014004810 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c16ade0 con 0x7fe02c0b37a0 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0b41e0 con 0x7fe02c16a430 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50876/0 (socket says 172.21.15.26:50876) 2023-10-09T11:40:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 -- 172.21.15.26:0/3488298945 learned_addr learned my addr 172.21.15.26:0/3488298945 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02bfff700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c16a430 0x7fe02c16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02affd700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe02c0b37a0 0x7fe02c169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 -- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c16a430 msgr2=0x7fe02c16a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c16a430 0x7fe02c16a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 -- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe02c0b37a0 msgr2=0x7fe02c169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe02c0b37a0 0x7fe02c169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 -- 172.21.15.26:0/3488298945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c09a7c0 con 0x7fe014004810 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe02b7fe700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009fd0 tx=0x7fe01c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00e040 con 0x7fe014004810 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c00f040 con 0x7fe014004810 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c151a90 con 0x7fe014004810 2023-10-09T11:40:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c015430 con 0x7fe014004810 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.875+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c09a170 con 0x7fe014004810 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.876+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c06f4c0 con 0x7fe014004810 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.877+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe01c0157e0 con 0x7fe014004810 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.877+0000 7fe0137fe700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 0x7fe0180696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.877+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe01c085590 con 0x7fe014004810 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.877+0000 7fe02affd700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 0x7fe0180696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.878+0000 7fe02affd700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 0x7fe0180696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0ccf40 tx=0x7fe020015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:54.881+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe01c0525c0 con 0x7fe014004810 2023-10-09T11:40:55.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.116+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02c04c3c0 con 0x7fe014004810 2023-10-09T11:40:55.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.116+0000 7fe0137fe700 1 -- 172.21.15.26:0/3488298945 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fe01c022090 con 0x7fe014004810 2023-10-09T11:40:55.119 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:55.119 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/356299143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":356299143},{"type":"v1","addr":"172.21.15.67:6837","nonce":356299143}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/574540072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":574540072},{"type":"v1","addr":"172.21.15.67:6836","nonce":574540072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3712347228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3712347228},{"type":"v1","addr":"172.21.15.26:6834","nonce":3712347228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6414,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1042368300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1042368300},{"type":"v1","addr":"172.21.15.26:6835","nonce":1042368300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-09T11:40:55.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 msgr2=0x7fe0180696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 0x7fe0180696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0ccf40 tx=0x7fe020015000 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 msgr2=0x7fe02c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009fd0 tx=0x7fe01c00b040 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 shutdown_connections 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe018067200 0x7fe0180696b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe02c16a430 0x7fe02c16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014004810 0x7fe02c0b3260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 --2- 172.21.15.26:0/3488298945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe02c0b37a0 0x7fe02c169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 >> 172.21.15.26:0/3488298945 conn(0x7fe02c06ce80 msgr2=0x7fe02c0cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 shutdown_connections 2023-10-09T11:40:55.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.119+0000 7fe03209c700 1 -- 172.21.15.26:0/3488298945 wait complete. 2023-10-09T11:40:55.122 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 51 2023-10-09T11:40:55.132 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:40:55.132 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:40:55.133 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:55.133 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:40:55.133 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:40:55.133 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:55.134 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:40:55.134 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:40:55.134 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:55.134 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:40:55.134 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:40:55.134 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:55.142 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:40:55.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:40:55.142 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:40:55.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:40:55.145 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:40:55.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:40:55.146 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:40:55.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:40:55.186 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:40:55.186 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:55.190 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:40:55.191 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:55.192 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:40:55.195 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:40:55.195 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:55.195 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:55.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:40:55.262 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:40:55.263 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:40:55.275 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:40:55.276 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:40:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.320+0000 7fd69cd3e700 1 Processor -- start 2023-10-09T11:40:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.320+0000 7fd69cd3e700 1 -- start start 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.321+0000 7fd69cd3e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd6980cb5a0 0x7fd6980cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.321+0000 7fd69cd3e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd69815a5d0 0x7fd698156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.321+0000 7fd69cd3e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69815ae40 con 0x7fd6980cd9e0 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.321+0000 7fd69cd3e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980d13f0 con 0x7fd6980cb5a0 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.321+0000 7fd69cd3e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69815ab60 con 0x7fd69815a5d0 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd6980cb5a0 0x7fd6980cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd695d9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd6980cd9e0 0x7fd698159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51246/0 (socket says 172.21.15.26:51246) 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd6980cb5a0 0x7fd6980cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:34106/0 (socket says 172.21.15.26:34106) 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd695d9b700 1 -- 172.21.15.26:0/78091650 learned_addr learned my addr 172.21.15.26:0/78091650 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd696d9d700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd69815a5d0 0x7fd698156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 -- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd69815a5d0 msgr2=0x7fd698156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd69815a5d0 0x7fd698156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 -- 172.21.15.26:0/78091650 >> v1:172.21.15.67:6789/0 conn(0x7fd6980cd9e0 legacy=0x7fd698159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 -- 172.21.15.26:0/78091650 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980ccf00 con 0x7fd6980cb5a0 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69659c700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cb5a0 0x7fd6980cb970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd680009910 tx=0x7fd6800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bca2191f79ccef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69559a700 1 -- 172.21.15.26:0/78091650 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000b640 con 0x7fd6980cb5a0 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69559a700 1 -- 172.21.15.26:0/78091650 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000b7a0 con 0x7fd6980cb5a0 2023-10-09T11:40:55.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.322+0000 7fd69559a700 1 -- 172.21.15.26:0/78091650 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000bb60 con 0x7fd6980cb5a0 2023-10-09T11:40:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 -- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cb5a0 msgr2=0x7fd6980cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cb5a0 0x7fd6980cb970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd680009910 tx=0x7fd6800091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 -- 172.21.15.26:0/78091650 shutdown_connections 2023-10-09T11:40:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd69815a5d0 0x7fd698156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/78091650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cb5a0 0x7fd6980cb970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 -- 172.21.15.26:0/78091650 >> 172.21.15.26:0/78091650 conn(0x7fd698070e30 msgr2=0x7fd6980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 -- 172.21.15.26:0/78091650 shutdown_connections 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.323+0000 7fd69cd3e700 1 -- 172.21.15.26:0/78091650 wait complete. 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.324+0000 7fd69cd3e700 1 Processor -- start 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.324+0000 7fd69cd3e700 1 -- start start 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 0x7fd698153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cd9e0 0x7fd6980b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b59b0 con 0x7fd69815a5d0 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b5110 con 0x7fd6980cd9e0 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69cd3e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b53f0 con 0x7fd6980cb5a0 2023-10-09T11:40:55.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69659c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 0x7fd698153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd695d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cd9e0 0x7fd6980b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50920/0 (socket says 172.21.15.26:50920) 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 -- 172.21.15.26:0/2808448305 learned_addr learned my addr 172.21.15.26:0/2808448305 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 -- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 msgr2=0x7fd698153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 0x7fd698153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 -- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cd9e0 msgr2=0x7fd6980b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cd9e0 0x7fd6980b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 -- 172.21.15.26:0/2808448305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680009420 con 0x7fd69815a5d0 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd69659c700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 0x7fd698153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:55.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.325+0000 7fd696d9d700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd690009df0 tx=0x7fd69000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.326+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000caa0 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.326+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000f040 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.326+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6980b56d0 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.326+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000ce70 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.326+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69815de20 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.327+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69815b070 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.327+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd690014690 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.328+0000 7fd68e7fc700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 0x7fd67c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.328+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd690085300 con 0x7fd69815a5d0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.328+0000 7fd69659c700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 0x7fd67c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.328+0000 7fd69659c700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 0x7fd67c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd6800091e0 tx=0x7fd680017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.332+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd69815b070 con 0x7fd69815a5d0 2023-10-09T11:40:55.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.543+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd69815b450 con 0x7fd69815a5d0 2023-10-09T11:40:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.636+0000 7fd68e7fc700 1 -- 172.21.15.26:0/2808448305 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd69815b450 con 0x7fd69815a5d0 2023-10-09T11:40:55.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 msgr2=0x7fd67c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 0x7fd67c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd6800091e0 tx=0x7fd680017000 comp rx=0 tx=0).stop 2023-10-09T11:40:55.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 msgr2=0x7fd698158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd690009df0 tx=0x7fd69000b040 comp rx=0 tx=0).stop 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 shutdown_connections 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69815a5d0 0x7fd698158db0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd67c067200 0x7fd67c0696b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6980cb5a0 0x7fd698153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 --2- 172.21.15.26:0/2808448305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6980cd9e0 0x7fd6980b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 >> 172.21.15.26:0/2808448305 conn(0x7fd698070e30 msgr2=0x7fd6980b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 shutdown_connections 2023-10-09T11:40:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.638+0000 7fd69cd3e700 1 -- 172.21.15.26:0/2808448305 wait complete. 2023-10-09T11:40:55.642 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:40:55.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:40:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.770+0000 7fd85ad90700 1 Processor -- start 2023-10-09T11:40:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.770+0000 7fd85ad90700 1 -- start start 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85ad90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8540cb5a0 0x7fd8540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85ad90700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 0x7fd854159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85ad90700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85415ae40 con 0x7fd85415a400 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85ad90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540d13f0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85ad90700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85415ab60 con 0x7fd8540cd9e0 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8540cb5a0 0x7fd8540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8540cb5a0 0x7fd8540cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50934/0 (socket says 172.21.15.26:50934) 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd85932d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd85415a400 0x7fd854156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34092/0 (socket says 172.21.15.26:34092) 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 -- 172.21.15.26:0/1636469666 learned_addr learned my addr 172.21.15.26:0/1636469666 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd853fff700 1 --2- 172.21.15.26:0/1636469666 >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 0x7fd854159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 -- 172.21.15.26:0/1636469666 >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 msgr2=0x7fd854159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 --2- 172.21.15.26:0/1636469666 >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 0x7fd854159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 -- 172.21.15.26:0/1636469666 >> v1:172.21.15.26:6789/0 conn(0x7fd85415a400 legacy=0x7fd854156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd8537fe700 1 -- 172.21.15.26:0/1636469666 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975687764 0 0) 0x7fd85415ae40 con 0x7fd85415a400 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 -- 172.21.15.26:0/1636469666 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540ccf00 con 0x7fd8540cb5a0 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd853fff700 1 --2- 172.21.15.26:0/1636469666 >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 0x7fd854159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.771+0000 7fd858b2c700 1 --2- 172.21.15.26:0/1636469666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd8540cb970 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd8480099b0 tx=0x7fd848009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f741f64aba1d6271 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd8537fe700 1 -- 172.21.15.26:0/1636469666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800b820 con 0x7fd8540cb5a0 2023-10-09T11:40:55.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd8537fe700 1 -- 172.21.15.26:0/1636469666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84800b980 con 0x7fd8540cb5a0 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd8537fe700 1 -- 172.21.15.26:0/1636469666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800bd20 con 0x7fd8540cb5a0 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 -- 172.21.15.26:0/1636469666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 msgr2=0x7fd8540cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 --2- 172.21.15.26:0/1636469666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd8540cb970 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd8480099b0 tx=0x7fd848009250 comp rx=0 tx=0).stop 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 -- 172.21.15.26:0/1636469666 shutdown_connections 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 --2- 172.21.15.26:0/1636469666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd8540cb970 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 --2- 172.21.15.26:0/1636469666 >> v2:172.21.15.67:3300/0 conn(0x7fd8540cd9e0 0x7fd854159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 -- 172.21.15.26:0/1636469666 >> 172.21.15.26:0/1636469666 conn(0x7fd854070e30 msgr2=0x7fd8540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 -- 172.21.15.26:0/1636469666 shutdown_connections 2023-10-09T11:40:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.772+0000 7fd85ad90700 1 -- 172.21.15.26:0/1636469666 wait complete. 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.773+0000 7fd85ad90700 1 Processor -- start 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.773+0000 7fd85ad90700 1 -- start start 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8540cd9e0 0x7fd8541597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd85415a400 0x7fd8540c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854157630 con 0x7fd8540cb5a0 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540c9910 con 0x7fd85415a400 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd85ad90700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd854156d00 con 0x7fd8540cd9e0 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50944/0 (socket says 172.21.15.26:50944) 2023-10-09T11:40:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 -- 172.21.15.26:0/4189936364 learned_addr learned my addr 172.21.15.26:0/4189936364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 -- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8540cd9e0 msgr2=0x7fd8541597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8540cd9e0 0x7fd8541597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 -- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd85415a400 msgr2=0x7fd8540c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd85415a400 0x7fd8540c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.774+0000 7fd858b2c700 1 -- 172.21.15.26:0/4189936364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480094f0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd858b2c700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd8480090b0 tx=0x7fd848017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848026480 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84801f070 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848026830 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854156fe0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.775+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8540c95d0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.776+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85404c3c0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.776+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd848026ba0 con 0x7fd8540cb5a0 2023-10-09T11:40:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.776+0000 7fd850ff9700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 0x7fd8380696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.777+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd848021070 con 0x7fd8540cb5a0 2023-10-09T11:40:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.777+0000 7fd853fff700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 0x7fd8380696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.777+0000 7fd853fff700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 0x7fd8380696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd840008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:55.781+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd848053760 con 0x7fd8540cb5a0 2023-10-09T11:40:55.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:55.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.052+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd8540cd1e0 con 0x7fd8540cb5a0 2023-10-09T11:40:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.053+0000 7fd850ff9700 1 -- 172.21.15.26:0/4189936364 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd84802b020 con 0x7fd8540cb5a0 2023-10-09T11:40:56.054 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:56.055 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.056 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.057 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.059 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:40:56.060 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.061 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.062 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.063 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.064 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:40:56.065 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:40:56.067 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:56.068 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:40:56.069 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:40:56.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 msgr2=0x7fd8380696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 0x7fd8380696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd840008040 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 msgr2=0x7fd85416a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd8480090b0 tx=0x7fd848017000 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 shutdown_connections 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd85415a400 0x7fd8540c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8540cb5a0 0x7fd85416a690 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd838067200 0x7fd8380696b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 --2- 172.21.15.26:0/4189936364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8540cd9e0 0x7fd8541597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 >> 172.21.15.26:0/4189936364 conn(0x7fd854070e30 msgr2=0x7fd8540b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 shutdown_connections 2023-10-09T11:40:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.055+0000 7fd85ad90700 1 -- 172.21.15.26:0/4189936364 wait complete. 2023-10-09T11:40:56.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:56.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.189+0000 7f556f2ff700 1 Processor -- start 2023-10-09T11:40:56.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.189+0000 7f556f2ff700 1 -- start start 2023-10-09T11:40:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556f2ff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5568153c30 0x7f556815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556f2ff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556815de50 0x7f55680cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556f2ff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556815afd0 con 0x7f55680cef40 2023-10-09T11:40:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556f2ff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556815b2b0 con 0x7f5568153c30 2023-10-09T11:40:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556f2ff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556815b590 con 0x7f556815de50 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5568153c30 0x7f556815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5568153c30 0x7f556815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50956/0 (socket says 172.21.15.26:50956) 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 -- 172.21.15.26:0/728613867 learned_addr learned my addr 172.21.15.26:0/728613867 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 -- 172.21.15.26:0/728613867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556815de50 msgr2=0x7f55680cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556dafc700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556815de50 0x7f55680cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556815de50 0x7f55680cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 -- 172.21.15.26:0/728613867 >> v1:172.21.15.67:6789/0 conn(0x7f55680cef40 legacy=0x7f556806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.190+0000 7f556e2fd700 1 -- 172.21.15.26:0/728613867 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556815b870 con 0x7f5568153c30 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556e2fd700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5568153c30 0x7f556815a5e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5558009f20 tx=0x7f5558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf86ef41698430e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556d2fb700 1 -- 172.21.15.26:0/728613867 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800e070 con 0x7f5568153c30 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556d2fb700 1 -- 172.21.15.26:0/728613867 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800ba40 con 0x7f5568153c30 2023-10-09T11:40:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556d2fb700 1 -- 172.21.15.26:0/728613867 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55580092e0 con 0x7f5568153c30 2023-10-09T11:40:56.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 -- 172.21.15.26:0/728613867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5568153c30 msgr2=0x7f556815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5568153c30 0x7f556815a5e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5558009f20 tx=0x7f5558009840 comp rx=0 tx=0).stop 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 -- 172.21.15.26:0/728613867 shutdown_connections 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5568153c30 0x7f556815a5e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 --2- 172.21.15.26:0/728613867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556815de50 0x7f55680cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 -- 172.21.15.26:0/728613867 >> 172.21.15.26:0/728613867 conn(0x7f55680703a0 msgr2=0x7f55680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 -- 172.21.15.26:0/728613867 shutdown_connections 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.191+0000 7f556f2ff700 1 -- 172.21.15.26:0/728613867 wait complete. 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.192+0000 7f556f2ff700 1 Processor -- start 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.192+0000 7f556f2ff700 1 -- start start 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5568153c30 0x7f556814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f556815de50 0x7f55680c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55680b2410 con 0x7f55680cef40 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556814fbc0 con 0x7f556815de50 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556f2ff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55680b1800 con 0x7f5568153c30 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556e2fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556e2fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50970/0 (socket says 172.21.15.26:50970) 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556e2fd700 1 -- 172.21.15.26:0/374200891 learned_addr learned my addr 172.21.15.26:0/374200891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556dafc700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5568153c30 0x7f556814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.193+0000 7f556eafe700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f556815de50 0x7f55680c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 -- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5568153c30 msgr2=0x7f556814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5568153c30 0x7f556814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 -- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f556815de50 msgr2=0x7f55680c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f556815de50 0x7f55680c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 -- 172.21.15.26:0/374200891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009ae0 con 0x7f55680cef40 2023-10-09T11:40:56.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556e2fd700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f556806eb00 tx=0x7f5558017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55580129a0 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558012b00 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55680b1ae0 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555801d420 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.194+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55680b20a0 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.195+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556804c3c0 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.195+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f555801d850 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.196+0000 7f55667fc700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 0x7f55540696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.196+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5558085d60 con 0x7f55680cef40 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.196+0000 7f556dafc700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 0x7f55540696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.196+0000 7f556dafc700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 0x7f55540696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55680c9020 tx=0x7f555c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.200+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5558052e80 con 0x7f55680cef40 2023-10-09T11:40:56.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.396+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5568064f70 con 0x7f55680cef40 2023-10-09T11:40:56.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.397+0000 7f55667fc700 1 -- 172.21.15.26:0/374200891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f55580564a0 con 0x7f55680cef40 2023-10-09T11:40:56.398 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:56.398 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":84,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:55.637611+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 msgr2=0x7f55540696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 0x7f55540696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55680c9020 tx=0x7f555c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 msgr2=0x7f55680b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f556806eb00 tx=0x7f5558017000 comp rx=0 tx=0).stop 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 shutdown_connections 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f556815de50 0x7f55680c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55680cef40 0x7f55680b2600 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5554067200 0x7f55540696b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 --2- 172.21.15.26:0/374200891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5568153c30 0x7f556814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 >> 172.21.15.26:0/374200891 conn(0x7f55680703a0 msgr2=0x7f55680c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 shutdown_connections 2023-10-09T11:40:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.399+0000 7f556f2ff700 1 -- 172.21.15.26:0/374200891 wait complete. 2023-10-09T11:40:56.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:40:56.413 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:56.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.534+0000 7fd3b5204700 1 Processor -- start 2023-10-09T11:40:56.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.534+0000 7fd3b5204700 1 -- start start 2023-10-09T11:40:56.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3b5204700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3b00cf110 0x7fd3b015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3b5204700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b015ac50 con 0x7fd3b0153dd0 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3b5204700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b015d010 con 0x7fd3b0153a00 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3b5204700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b015af60 con 0x7fd3b00cf110 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3af7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3b0153dd0 0x7fd3b00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34098/0 (socket says 172.21.15.26:34098) 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3af7fe700 1 -- 172.21.15.26:0/2675248609 learned_addr learned my addr 172.21.15.26:0/2675248609 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3b4a03700 1 --2- 172.21.15.26:0/2675248609 >> v2:172.21.15.26:3300/0 conn(0x7fd3b00cf110 0x7fd3b015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.535+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502806314 0 0) 0x7fd3b015ac50 con 0x7fd3b0153dd0 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c003570 con 0x7fd3b0153dd0 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3b4a03700 1 -- 172.21.15.26:0/2675248609 >> v1:172.21.15.67:6789/0 conn(0x7fd3b0153a00 legacy=0x7fd3b015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525311973 0 0) 0x7fd3b015d010 con 0x7fd3b0153a00 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3b4a03700 1 -- 172.21.15.26:0/2675248609 >> v1:172.21.15.26:6789/0 conn(0x7fd3b0153dd0 legacy=0x7fd3b00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3b4a03700 1 -- 172.21.15.26:0/2675248609 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b015b240 con 0x7fd3b00cf110 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3b4a03700 1 --2- 172.21.15.26:0/2675248609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b00cf110 0x7fd3b015de50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009e60 tx=0x7fd3a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73980b7037d22f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800e070 con 0x7fd3b00cf110 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800bb60 con 0x7fd3b00cf110 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.536+0000 7fd3aeffd700 1 -- 172.21.15.26:0/2675248609 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8012430 con 0x7fd3b00cf110 2023-10-09T11:40:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 -- 172.21.15.26:0/2675248609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b00cf110 msgr2=0x7fd3b015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 --2- 172.21.15.26:0/2675248609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b00cf110 0x7fd3b015de50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009e60 tx=0x7fd3a8009780 comp rx=0 tx=0).stop 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 -- 172.21.15.26:0/2675248609 shutdown_connections 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 --2- 172.21.15.26:0/2675248609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b00cf110 0x7fd3b015de50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 -- 172.21.15.26:0/2675248609 >> 172.21.15.26:0/2675248609 conn(0x7fd3b00703a0 msgr2=0x7fd3b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 -- 172.21.15.26:0/2675248609 shutdown_connections 2023-10-09T11:40:56.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.537+0000 7fd3b5204700 1 -- 172.21.15.26:0/2675248609 wait complete. 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.538+0000 7fd3b5204700 1 Processor -- start 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.538+0000 7fd3b5204700 1 -- start start 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 0x7fd3b00cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b0153a00 0x7fd3b00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00b6130 con 0x7fd3b0153dd0 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00c9610 con 0x7fd3b00cf110 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b5204700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00cb780 con 0x7fd3b0153a00 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50988/0 (socket says 172.21.15.26:50988) 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 -- 172.21.15.26:0/1859768545 learned_addr learned my addr 172.21.15.26:0/1859768545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3affff700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 0x7fd3b00cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3af7fe700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b0153a00 0x7fd3b00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 -- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b0153a00 msgr2=0x7fd3b00b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b0153a00 0x7fd3b00b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 -- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 msgr2=0x7fd3b00cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 0x7fd3b00cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 -- 172.21.15.26:0/1859768545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8009a20 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3affff700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 0x7fd3b00cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3b4a03700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8013000 tx=0x7fd3a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.539+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8012e00 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.540+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a801c610 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.540+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00cba60 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.540+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a801c9d0 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.540+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b00cc020 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.541+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b004c3c0 con 0x7fd3b0153dd0 2023-10-09T11:40:56.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.541+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd3a801cd40 con 0x7fd3b0153dd0 2023-10-09T11:40:56.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.541+0000 7fd3a7fff700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 0x7fd3900696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.541+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd3a8086720 con 0x7fd3b0153dd0 2023-10-09T11:40:56.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.542+0000 7fd3affff700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 0x7fd3900696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.542+0000 7fd3affff700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 0x7fd3900696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3980011e0 tx=0x7fd398009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.546+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3a8053880 con 0x7fd3b0153dd0 2023-10-09T11:40:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.738+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3b015b520 con 0x7fd3b0153dd0 2023-10-09T11:40:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.739+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1859768545 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3a8056ea0 con 0x7fd3b0153dd0 2023-10-09T11:40:56.740 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 msgr2=0x7fd3900696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 0x7fd3900696b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3980011e0 tx=0x7fd398009040 comp rx=0 tx=0).stop 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 msgr2=0x7fd3b00c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8013000 tx=0x7fd3a8019000 comp rx=0 tx=0).stop 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 shutdown_connections 2023-10-09T11:40:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b0153dd0 0x7fd3b00c90d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b00cf110 0x7fd3b00cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd390067200 0x7fd3900696b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 --2- 172.21.15.26:0/1859768545 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b0153a00 0x7fd3b00b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 >> 172.21.15.26:0/1859768545 conn(0x7fd3b00703a0 msgr2=0x7fd3b00b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 shutdown_connections 2023-10-09T11:40:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.741+0000 7fd3b5204700 1 -- 172.21.15.26:0/1859768545 wait complete. 2023-10-09T11:40:56.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:40:56.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.872+0000 7f8bcec75700 1 Processor -- start 2023-10-09T11:40:56.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.872+0000 7f8bcec75700 1 -- start start 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcec75700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bc80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcec75700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bc815cf20 0x7f8bc80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcec75700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc815ad50 con 0x7f8bc80b0710 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcec75700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc815a140 con 0x7f8bc815cf20 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcec75700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815a420 con 0x7f8bc815cb50 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcd212700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8bc80b0710 0x7f8bc81536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34114/0 (socket says 172.21.15.26:34114) 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcd212700 1 -- 172.21.15.26:0/2391614464 learned_addr learned my addr 172.21.15.26:0/2391614464 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:56.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bcca11700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bc80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bc7fff700 1 --2- 172.21.15.26:0/2391614464 >> v2:172.21.15.67:3300/0 conn(0x7f8bc815cf20 0x7f8bc80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058174336 0 0) 0x7f8bc815ad50 con 0x7f8bc80b0710 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.873+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb4003570 con 0x7f8bc80b0710 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212997387 0 0) 0x7f8bb4003570 con 0x7f8bc80b0710 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 msgr2=0x7f8bc80b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bc80b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 >> v2:172.21.15.67:3300/0 conn(0x7f8bc815cf20 msgr2=0x7f8bc80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 --2- 172.21.15.26:0/2391614464 >> v2:172.21.15.67:3300/0 conn(0x7f8bc815cf20 0x7f8bc80b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc815a700 con 0x7f8bc80b0710 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f8bb8001470 con 0x7f8bc80b0710 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 >> v1:172.21.15.26:6789/0 conn(0x7f8bc80b0710 legacy=0x7f8bc81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bb4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bb4003fe0 0x7f8bb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bb4004d50 0x7f8bb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815a140 con 0x7f8bb4004d50 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815a420 con 0x7f8bb4003fe0 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb400ba90 con 0x7f8bc815cb50 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bb4004d50 0x7f8bb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc7fff700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bb4003fe0 0x7f8bb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcca11700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bb4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 -- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 msgr2=0x7f8bb4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc815cb50 0x7f8bb4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 -- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bb4003fe0 msgr2=0x7f8bb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bb4003fe0 0x7f8bb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 -- 172.21.15.26:0/2391614464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb4003570 con 0x7f8bb4004d50 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bb4004d50 0x7f8bb40051c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c390 tx=0x7f8bb8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ed1d3a20807124 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800cc00 con 0x7f8bb4004d50 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800cda0 con 0x7f8bb4004d50 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.874+0000 7f8bc77fe700 1 -- 172.21.15.26:0/2391614464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8005b70 con 0x7f8bb4004d50 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 -- 172.21.15.26:0/2391614464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bb4004d50 msgr2=0x7f8bb40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2391614464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bb4004d50 0x7f8bb40051c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c390 tx=0x7f8bb8001e90 comp rx=0 tx=0).stop 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcd212700 1 -- 172.21.15.26:0/2391614464 reap_dead start 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 -- 172.21.15.26:0/2391614464 shutdown_connections 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 -- 172.21.15.26:0/2391614464 >> 172.21.15.26:0/2391614464 conn(0x7f8bc80cded0 msgr2=0x7f8bc806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 -- 172.21.15.26:0/2391614464 shutdown_connections 2023-10-09T11:40:56.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.875+0000 7f8bcec75700 1 -- 172.21.15.26:0/2391614464 wait complete. 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.876+0000 7f8bcec75700 1 Processor -- start 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.876+0000 7f8bcec75700 1 -- start start 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc8166870 0x7f8bc80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc8166c40 0x7f8bc80c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815e4c0 con 0x7f8bc815d790 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815e7a0 con 0x7f8bc8166c40 2023-10-09T11:40:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcec75700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc815ea80 con 0x7f8bc8166870 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51006/0 (socket says 172.21.15.26:51006) 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 -- 172.21.15.26:0/2942494405 learned_addr learned my addr 172.21.15.26:0/2942494405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bc7fff700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc8166c40 0x7f8bc80c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcca11700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc8166870 0x7f8bc80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 -- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc8166870 msgr2=0x7f8bc80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc8166870 0x7f8bc80c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 -- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc8166c40 msgr2=0x7f8bc80c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.877+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc8166c40 0x7f8bc80c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bcd212700 1 -- 172.21.15.26:0/2942494405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc815ed60 con 0x7f8bc815d790 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bcd212700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8011000 tx=0x7f8bb8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800cc00 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8001430 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc815f040 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007530 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.878+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc816ca30 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.879+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc8063230 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.879+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8bb8027460 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.880+0000 7f8bc4ff9700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 0x7f8ba80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.880+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8bb80858b0 con 0x7f8bc815d790 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.880+0000 7f8bcca11700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 0x7f8ba80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.880+0000 7f8bcca11700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 0x7f8ba80696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009fd0 tx=0x7f8bc000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:56.884+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bc8063230 con 0x7f8bc815d790 2023-10-09T11:40:57.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.078+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8bc8063230 con 0x7f8bc815d790 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.078+0000 7f8bc4ff9700 1 -- 172.21.15.26:0/2942494405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8bb8017060 con 0x7f8bc815d790 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:40:57.080 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 msgr2=0x7f8ba80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 0x7f8ba80696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009fd0 tx=0x7f8bc000b040 comp rx=0 tx=0).stop 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 msgr2=0x7f8bc815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8011000 tx=0x7f8bb8015000 comp rx=0 tx=0).stop 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 shutdown_connections 2023-10-09T11:40:57.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bc815d790 0x7f8bc815dc30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ba8067200 0x7f8ba80696b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bc8166870 0x7f8bc80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 --2- 172.21.15.26:0/2942494405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc8166c40 0x7f8bc80c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 >> 172.21.15.26:0/2942494405 conn(0x7f8bc80cded0 msgr2=0x7f8bc80a9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 shutdown_connections 2023-10-09T11:40:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.080+0000 7f8bcec75700 1 -- 172.21.15.26:0/2942494405 wait complete. 2023-10-09T11:40:57.094 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:40:57.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:40:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.215+0000 7f2e2e649700 1 Processor -- start 2023-10-09T11:40:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.215+0000 7f2e2e649700 1 -- start start 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e2e649700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e28159530 0x7f2e280ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e2e649700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e280ccfd0 con 0x7f2e2806dcf0 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e2e649700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2815a410 con 0x7f2e280cb6f0 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e2e649700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2815a6f0 con 0x7f2e28159530 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e27fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e28159530 0x7f2e280ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e277fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e2806dcf0 0x7f2e28159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34116/0 (socket says 172.21.15.26:34116) 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e27fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e28159530 0x7f2e280ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51022/0 (socket says 172.21.15.26:51022) 2023-10-09T11:40:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.216+0000 7f2e277fe700 1 -- 172.21.15.26:0/859587805 learned_addr learned my addr 172.21.15.26:0/859587805 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e27fff700 1 -- 172.21.15.26:0/859587805 >> v1:172.21.15.67:6789/0 conn(0x7f2e280cb6f0 legacy=0x7f2e280cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e27fff700 1 -- 172.21.15.26:0/859587805 >> v1:172.21.15.26:6789/0 conn(0x7f2e2806dcf0 legacy=0x7f2e28159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e27fff700 1 -- 172.21.15.26:0/859587805 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2815a9d0 con 0x7f2e28159530 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e27fff700 1 --2- 172.21.15.26:0/859587805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280ceba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e100098e0 tx=0x7f2e100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e2c958629786a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e26ffd700 1 -- 172.21.15.26:0/859587805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10009e80 con 0x7f2e28159530 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e26ffd700 1 -- 172.21.15.26:0/859587805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000b860 con 0x7f2e28159530 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e26ffd700 1 -- 172.21.15.26:0/859587805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000bbe0 con 0x7f2e28159530 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 -- 172.21.15.26:0/859587805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 msgr2=0x7f2e280ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 --2- 172.21.15.26:0/859587805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280ceba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e100098e0 tx=0x7f2e100091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 -- 172.21.15.26:0/859587805 shutdown_connections 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 --2- 172.21.15.26:0/859587805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280ceba0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 -- 172.21.15.26:0/859587805 >> 172.21.15.26:0/859587805 conn(0x7f2e280703a0 msgr2=0x7f2e280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.217+0000 7f2e2e649700 1 -- 172.21.15.26:0/859587805 shutdown_connections 2023-10-09T11:40:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.218+0000 7f2e2e649700 1 -- 172.21.15.26:0/859587805 wait complete. 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 Processor -- start 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 -- start start 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e2806dcf0 0x7f2e280c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e280cb6f0 0x7f2e2816a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2816adc0 con 0x7f2e28159530 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2816d1e0 con 0x7f2e280cb6f0 2023-10-09T11:40:57.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.219+0000 7f2e2e649700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280c9c50 con 0x7f2e2806dcf0 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51024/0 (socket says 172.21.15.26:51024) 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 -- 172.21.15.26:0/3808501879 learned_addr learned my addr 172.21.15.26:0/3808501879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e277fe700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e280cb6f0 0x7f2e2816a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e27fff700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e2806dcf0 0x7f2e280c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 -- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e2806dcf0 msgr2=0x7f2e280c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e2806dcf0 0x7f2e280c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 -- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e280cb6f0 msgr2=0x7f2e2816a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e280cb6f0 0x7f2e2816a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 -- 172.21.15.26:0/3808501879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10009420 con 0x7f2e28159530 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2cbe6700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c930 tx=0x7f2e20001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20012630 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e200127d0 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e280c9f30 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20012b90 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.220+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e280ca4f0 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.221+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2816afd0 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.222+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2e20011380 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.222+0000 7f2e1ffff700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 0x7f2e080696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.222+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2e200848a0 con 0x7f2e28159530 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.222+0000 7f2e27fff700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 0x7f2e080696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.223+0000 7f2e27fff700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 0x7f2e080696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2e100093f0 tx=0x7f2e10017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.226+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e20051b10 con 0x7f2e28159530 2023-10-09T11:40:57.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:57.420+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2e2804c3c0 con 0x7f2e28159530 2023-10-09T11:40:58.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.283+0000 7f2e1ffff700 1 -- 172.21.15.26:0/3808501879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2e20055130 con 0x7f2e28159530 2023-10-09T11:40:58.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.287+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 msgr2=0x7f2e080696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.287+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 0x7f2e080696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2e100093f0 tx=0x7f2e10017000 comp rx=0 tx=0).stop 2023-10-09T11:40:58.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.287+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 msgr2=0x7f2e280c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.287+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c930 tx=0x7f2e20001750 comp rx=0 tx=0).stop 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 shutdown_connections 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e28159530 0x7f2e280c6620 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2e08067200 0x7f2e080696b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e2806dcf0 0x7f2e280c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 --2- 172.21.15.26:0/3808501879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e280cb6f0 0x7f2e2816a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.288+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 >> 172.21.15.26:0/3808501879 conn(0x7f2e280703a0 msgr2=0x7f2e28155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.289+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 shutdown_connections 2023-10-09T11:40:58.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.289+0000 7f2e2e649700 1 -- 172.21.15.26:0/3808501879 wait complete. 2023-10-09T11:40:58.294 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:40:58.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.437+0000 7fa76062e700 1 Processor -- start 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.437+0000 7fa76062e700 1 -- start start 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa76062e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75806dc70 0x7fa758159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa76062e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa75806e0e0 0x7fa7580cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa76062e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7580ccfd0 con 0x7fa758159530 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa76062e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75815a3d0 con 0x7fa75806e0e0 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa76062e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815a6b0 con 0x7fa75806dc70 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa75806e0e0 0x7fa7580cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa75806e0e0 0x7fa7580cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51032/0 (socket says 172.21.15.26:51032) 2023-10-09T11:40:58.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 -- 172.21.15.26:0/1274773738 learned_addr learned my addr 172.21.15.26:0/1274773738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75dbc9700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75806dc70 0x7fa758159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 -- 172.21.15.26:0/1274773738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75806dc70 msgr2=0x7fa758159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75806dc70 0x7fa758159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 -- 172.21.15.26:0/1274773738 >> v1:172.21.15.67:6789/0 conn(0x7fa758159530 legacy=0x7fa7580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 -- 172.21.15.26:0/1274773738 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75815a990 con 0x7fa75806e0e0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75ebcb700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa7580cb6f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa7500099b0 tx=0x7fa750009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0944da4eeb7d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75d3c8700 1 -- 172.21.15.26:0/1274773738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75000b860 con 0x7fa75806e0e0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.438+0000 7fa75d3c8700 1 -- 172.21.15.26:0/1274773738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75000b9c0 con 0x7fa75806e0e0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa75d3c8700 1 -- 172.21.15.26:0/1274773738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75000bd60 con 0x7fa75806e0e0 2023-10-09T11:40:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 -- 172.21.15.26:0/1274773738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 msgr2=0x7fa7580cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa7580cb6f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa7500099b0 tx=0x7fa750009250 comp rx=0 tx=0).stop 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 -- 172.21.15.26:0/1274773738 shutdown_connections 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa7580cb6f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 --2- 172.21.15.26:0/1274773738 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75806dc70 0x7fa758159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 -- 172.21.15.26:0/1274773738 >> 172.21.15.26:0/1274773738 conn(0x7fa7580703a0 msgr2=0x7fa7580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 -- 172.21.15.26:0/1274773738 shutdown_connections 2023-10-09T11:40:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.439+0000 7fa76062e700 1 -- 172.21.15.26:0/1274773738 wait complete. 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.440+0000 7fa76062e700 1 Processor -- start 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.440+0000 7fa76062e700 1 -- start start 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75806dc70 0x7fa7580c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa758159530 0x7fa7580b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758154d90 con 0x7fa75806e0e0 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580c84b0 con 0x7fa75806dc70 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa76062e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580c8940 con 0x7fa758159530 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51046/0 (socket says 172.21.15.26:51046) 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 -- 172.21.15.26:0/4274509819 learned_addr learned my addr 172.21.15.26:0/4274509819 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75e3ca700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75806dc70 0x7fa7580c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75ebcb700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa758159530 0x7fa7580b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 -- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa758159530 msgr2=0x7fa7580b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa758159530 0x7fa7580b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 -- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75806dc70 msgr2=0x7fa7580c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75806dc70 0x7fa7580c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 -- 172.21.15.26:0/4274509819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500094f0 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.441+0000 7fa75dbc9700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00d890 tx=0x7fa74c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.442+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0125f0 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.442+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c012750 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.442+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7580c7900 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.442+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c012af0 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.442+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7580c8140 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.443+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7580c8620 con 0x7fa75806e0e0 2023-10-09T11:40:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.443+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa74c01e460 con 0x7fa75806e0e0 2023-10-09T11:40:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.443+0000 7fa7567fc700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 0x7fa7440696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.444+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa74c084ca0 con 0x7fa75806e0e0 2023-10-09T11:40:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.444+0000 7fa75e3ca700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 0x7fa7440696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.444+0000 7fa75e3ca700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 0x7fa7440696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa748007fd0 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.448+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa74c051da0 con 0x7fa75806e0e0 2023-10-09T11:40:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:58.640+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa75804c3c0 con 0x7fa75806e0e0 2023-10-09T11:40:59.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.289+0000 7fa7567fc700 1 -- 172.21.15.26:0/4274509819 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa74c0553c0 con 0x7fa75806e0e0 2023-10-09T11:40:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 msgr2=0x7fa7440696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 0x7fa7440696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa748007fd0 tx=0x7fa748009040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 msgr2=0x7fa758153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00d890 tx=0x7fa74c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 shutdown_connections 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa744067200 0x7fa7440696b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa758159530 0x7fa7580b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75806dc70 0x7fa7580c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 --2- 172.21.15.26:0/4274509819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa75806e0e0 0x7fa758153bc0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.297+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 >> 172.21.15.26:0/4274509819 conn(0x7fa7580703a0 msgr2=0x7fa7580cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.299+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 shutdown_connections 2023-10-09T11:40:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.300+0000 7fa76062e700 1 -- 172.21.15.26:0/4274509819 wait complete. 2023-10-09T11:40:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:40:59.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:40:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.448+0000 7f0d30355700 1 Processor -- start 2023-10-09T11:40:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.448+0000 7f0d30355700 1 -- start start 2023-10-09T11:40:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d30355700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 0x7f0d280ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d30355700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d2806e0e0 0x7f0d280cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d30355700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d280ccfd0 con 0x7f0d2806dc70 2023-10-09T11:40:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d30355700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280cf0e0 con 0x7f0d2806e0e0 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d30355700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2815a3d0 con 0x7f0d28159530 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d2e0f1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 0x7f0d280ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d2e8f2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d2806e0e0 0x7f0d280cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d2e0f1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 0x7f0d280ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:59496/0 (socket says 172.21.15.26:59496) 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d2e0f1700 1 -- 172.21.15.26:0/2181392389 learned_addr learned my addr 172.21.15.26:0/2181392389 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.449+0000 7f0d2d8f0700 1 --1- 172.21.15.26:0/2181392389 >> v1:172.21.15.67:6789/0 conn(0x7f0d2806dc70 0x7f0d28159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51298/0 (socket says 172.21.15.26:51298) 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 msgr2=0x7f0d280ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2e8f2700 1 --2- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 0x7f0d280ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/2181392389 >> v1:172.21.15.67:6789/0 conn(0x7f0d2806dc70 legacy=0x7f0d28159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/2181392389 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2815a6b0 con 0x7f0d2806e0e0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2d0ef700 1 -- 172.21.15.26:0/2181392389 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561848271 0 0) 0x7f0d280ccfd0 con 0x7f0d2806dc70 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2e8f2700 1 --2- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d280cb6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098e0 tx=0x7f0d200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65abffaa678d95ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2d0ef700 1 -- 172.21.15.26:0/2181392389 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000b640 con 0x7f0d2806e0e0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2d0ef700 1 -- 172.21.15.26:0/2181392389 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000b7a0 con 0x7f0d2806e0e0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d2d0ef700 1 -- 172.21.15.26:0/2181392389 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000bb40 con 0x7f0d2806e0e0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.450+0000 7f0d30355700 1 -- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 msgr2=0x7f0d280cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 --2- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d280cb6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098e0 tx=0x7f0d200091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 -- 172.21.15.26:0/2181392389 shutdown_connections 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 --2- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d280cb6f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 --2- 172.21.15.26:0/2181392389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d28159530 0x7f0d280ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 -- 172.21.15.26:0/2181392389 >> 172.21.15.26:0/2181392389 conn(0x7f0d280703a0 msgr2=0x7f0d280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 -- 172.21.15.26:0/2181392389 shutdown_connections 2023-10-09T11:40:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.451+0000 7f0d30355700 1 -- 172.21.15.26:0/2181392389 wait complete. 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 Processor -- start 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 -- start start 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d2806dc70 0x7f0d280c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d2815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d281565d0 con 0x7f0d28159530 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280ca6c0 con 0x7f0d2806e0e0 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.452+0000 7f0d30355700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280ca9a0 con 0x7f0d2806dc70 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51050/0 (socket says 172.21.15.26:51050) 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/3559072529 learned_addr learned my addr 172.21.15.26:0/3559072529 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e0f1700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d2806dc70 0x7f0d280c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2d8f0700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d2815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d2806dc70 msgr2=0x7f0d280c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d2806dc70 0x7f0d280c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 msgr2=0x7f0d2815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d2815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 -- 172.21.15.26:0/3559072529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009420 con 0x7f0d28159530 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d2e8f2700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0d20013000 tx=0x7f0d20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000b910 con 0x7f0d28159530 2023-10-09T11:40:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2815cb30 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000ba90 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20025670 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.453+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2815d0f0 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.454+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2815d2e0 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.455+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0d20023070 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.455+0000 7f0d267fc700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 0x7f0d140696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.455+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0d20086050 con 0x7f0d28159530 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.455+0000 7f0d2e0f1700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 0x7f0d140696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.456+0000 7f0d2e0f1700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 0x7f0d140696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009fd0 tx=0x7f0d1800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.460+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d20053050 con 0x7f0d28159530 2023-10-09T11:40:59.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:40:59.695+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0d2804c3c0 con 0x7f0d28159530 2023-10-09T11:41:00.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.291+0000 7f0d267fc700 1 -- 172.21.15.26:0/3559072529 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0d20056670 con 0x7f0d28159530 2023-10-09T11:41:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.294+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 msgr2=0x7f0d140696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.294+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 0x7f0d140696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009fd0 tx=0x7f0d1800b040 comp rx=0 tx=0).stop 2023-10-09T11:41:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.294+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 msgr2=0x7f0d2815b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.294+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0d20013000 tx=0x7f0d20017000 comp rx=0 tx=0).stop 2023-10-09T11:41:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 shutdown_connections 2023-10-09T11:41:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d28159530 0x7f0d2815b110 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0d14067200 0x7f0d140696b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d2806dc70 0x7f0d280c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 --2- 172.21.15.26:0/3559072529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d2806e0e0 0x7f0d2815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.297+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 >> 172.21.15.26:0/3559072529 conn(0x7f0d280703a0 msgr2=0x7f0d280d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.298+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 shutdown_connections 2023-10-09T11:41:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.298+0000 7f0d30355700 1 -- 172.21.15.26:0/3559072529 wait complete. 2023-10-09T11:41:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T11:41:00.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.433+0000 7f89905b2700 1 Processor -- start 2023-10-09T11:41:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.433+0000 7f89905b2700 1 -- start start 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f89905b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 0x7f89880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f89905b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89880cd9e0 0x7f8988159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f89905b2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898815ae40 con 0x7f89880cde50 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f89905b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880d13f0 con 0x7f89880cd9e0 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f89905b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898815ab60 con 0x7f89880cb5a0 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89880cd9e0 0x7f8988159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898eb4f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f89880cde50 0x7f8988156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52460/0 (socket says 172.21.15.26:52460) 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898eb4f700 1 -- 172.21.15.26:0/4183648902 learned_addr learned my addr 172.21.15.26:0/4183648902 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898e34e700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 0x7f89880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 -- 172.21.15.26:0/4183648902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 msgr2=0x7f89880cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 0x7f89880cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 -- 172.21.15.26:0/4183648902 >> v1:172.21.15.26:6789/0 conn(0x7f89880cde50 legacy=0x7f8988156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 -- 172.21.15.26:0/4183648902 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880ccf00 con 0x7f89880cd9e0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898d34c700 1 -- 172.21.15.26:0/4183648902 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072677450 0 0) 0x7f898815ae40 con 0x7f89880cde50 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898e34e700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 0x7f89880cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898db4d700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988159ec0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f89780098e0 tx=0x7f89780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5804cc3be5e824e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.434+0000 7f898d34c700 1 -- 172.21.15.26:0/4183648902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978009e80 con 0x7f89880cd9e0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f898d34c700 1 -- 172.21.15.26:0/4183648902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b860 con 0x7f89880cd9e0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f898d34c700 1 -- 172.21.15.26:0/4183648902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bbe0 con 0x7f89880cd9e0 2023-10-09T11:41:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 -- 172.21.15.26:0/4183648902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 msgr2=0x7f8988159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988159ec0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f89780098e0 tx=0x7f89780091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 -- 172.21.15.26:0/4183648902 shutdown_connections 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89880cb5a0 0x7f89880cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 --2- 172.21.15.26:0/4183648902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988159ec0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 -- 172.21.15.26:0/4183648902 >> 172.21.15.26:0/4183648902 conn(0x7f8988070e30 msgr2=0x7f89880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 -- 172.21.15.26:0/4183648902 shutdown_connections 2023-10-09T11:41:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.435+0000 7f89905b2700 1 -- 172.21.15.26:0/4183648902 wait complete. 2023-10-09T11:41:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.436+0000 7f89905b2700 1 Processor -- start 2023-10-09T11:41:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.436+0000 7f89905b2700 1 -- start start 2023-10-09T11:41:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880cb5a0 0x7f89880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8988151eb0 0x7f89880c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898815c810 con 0x7f89880cd9e0 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988152310 con 0x7f89880cb5a0 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f89905b2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898815bc20 con 0x7f8988151eb0 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48164/0 (socket says 172.21.15.26:48164) 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 -- 172.21.15.26:0/2603882258 learned_addr learned my addr 172.21.15.26:0/2603882258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898e34e700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880cb5a0 0x7f89880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 -- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8988151eb0 msgr2=0x7f89880c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898eb4f700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8988151eb0 0x7f89880c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8988151eb0 0x7f89880c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 -- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880cb5a0 msgr2=0x7f89880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880cb5a0 0x7f89880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.437+0000 7f898db4d700 1 -- 172.21.15.26:0/2603882258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009420 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f898db4d700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f898806ea60 tx=0x7f8978017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800b9d0 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800bb50 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978025670 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898815bee0 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.438+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898815c4a0 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.439+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898815c980 con 0x7f89880cd9e0 2023-10-09T11:41:00.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.439+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8978023070 con 0x7f89880cd9e0 2023-10-09T11:41:00.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.440+0000 7f897e7fc700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.440+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8978086170 con 0x7f89880cd9e0 2023-10-09T11:41:00.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.440+0000 7f898e34e700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.440+0000 7f898e34e700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 0x7f896c0696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8984006fd0 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.444+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8978053050 con 0x7f89880cd9e0 2023-10-09T11:41:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.637+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f898804c3c0 con 0x7f89880cd9e0 2023-10-09T11:41:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.638+0000 7f897e7fc700 1 -- 172.21.15.26:0/2603882258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f8978056670 con 0x7f89880cd9e0 2023-10-09T11:41:00.640 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:00.640 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":87,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:59.697353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 msgr2=0x7f896c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 0x7f896c0696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8984006fd0 tx=0x7f8984008040 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 msgr2=0x7f8988151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f898806ea60 tx=0x7f8978017000 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 shutdown_connections 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8988151eb0 0x7f89880c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880cb5a0 0x7f89880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 --2- 172.21.15.26:0/2603882258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89880cd9e0 0x7f8988151970 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.640+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 >> 172.21.15.26:0/2603882258 conn(0x7f8988070e30 msgr2=0x7f89880b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.641+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 shutdown_connections 2023-10-09T11:41:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.641+0000 7f89905b2700 1 -- 172.21.15.26:0/2603882258 wait complete. 2023-10-09T11:41:00.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.772+0000 7f5d19fc0700 1 Processor -- start 2023-10-09T11:41:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.772+0000 7f5d19fc0700 1 -- start start 2023-10-09T11:41:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d19fc0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d1415de50 0x7f5d140cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d19fc0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 0x7f5d1415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d19fc0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d140cf3c0 con 0x7f5d14153c30 2023-10-09T11:41:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d19fc0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1415afd0 con 0x7f5d1415de50 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d19fc0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1415b2b0 con 0x7f5d140cef40 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d1415de50 0x7f5d140cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d1415de50 0x7f5d140cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48172/0 (socket says 172.21.15.26:48172) 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 -- 172.21.15.26:0/2155771183 learned_addr learned my addr 172.21.15.26:0/2155771183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d197bf700 1 --2- 172.21.15.26:0/2155771183 >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 0x7f5d1415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 -- 172.21.15.26:0/2155771183 >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 msgr2=0x7f5d1415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 --2- 172.21.15.26:0/2155771183 >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 0x7f5d1415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 -- 172.21.15.26:0/2155771183 >> v1:172.21.15.67:6789/0 conn(0x7f5d14153c30 legacy=0x7f5d1415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d13fff700 1 -- 172.21.15.26:0/2155771183 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1415b590 con 0x7f5d1415de50 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.773+0000 7f5d197bf700 1 --2- 172.21.15.26:0/2155771183 >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 0x7f5d1415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d13fff700 1 --2- 172.21.15.26:0/2155771183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d1415de50 0x7f5d140cea00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5d140cdab0 tx=0x7f5d04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a92f3c405256e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d137fe700 1 -- 172.21.15.26:0/2155771183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400e070 con 0x7f5d1415de50 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d137fe700 1 -- 172.21.15.26:0/2155771183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400ba50 con 0x7f5d1415de50 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d137fe700 1 -- 172.21.15.26:0/2155771183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d040092e0 con 0x7f5d1415de50 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2155771183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d1415de50 msgr2=0x7f5d140cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2155771183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d1415de50 0x7f5d140cea00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5d140cdab0 tx=0x7f5d04009840 comp rx=0 tx=0).stop 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2155771183 shutdown_connections 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2155771183 >> v2:172.21.15.67:3300/0 conn(0x7f5d140cef40 0x7f5d1415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2155771183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d1415de50 0x7f5d140cea00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2155771183 >> 172.21.15.26:0/2155771183 conn(0x7f5d140703a0 msgr2=0x7f5d140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2155771183 shutdown_connections 2023-10-09T11:41:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.774+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2155771183 wait complete. 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.775+0000 7f5d19fc0700 1 Processor -- start 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 -- start start 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d140cef40 0x7f5d14152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d1415de50 0x7f5d140d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140c84d0 con 0x7f5d14153c30 2023-10-09T11:41:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14152540 con 0x7f5d1415de50 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d19fc0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1416b150 con 0x7f5d140cef40 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48176/0 (socket says 172.21.15.26:48176) 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d13fff700 1 -- 172.21.15.26:0/2239110279 learned_addr learned my addr 172.21.15.26:0/2239110279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d18fbe700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d140cef40 0x7f5d14152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.776+0000 7f5d197bf700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d1415de50 0x7f5d140d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 -- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d140cef40 msgr2=0x7f5d14152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d140cef40 0x7f5d14152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 -- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d1415de50 msgr2=0x7f5d140d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d1415de50 0x7f5d140d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 -- 172.21.15.26:0/2239110279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009ae0 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d13fff700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5d1406eb00 tx=0x7f5d04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04007970 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d04007af0 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d140c75e0 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0401e430 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.777+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d140c7ba0 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.778+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1404c3c0 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.779+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5d04003040 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.779+0000 7f5d10ff9700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 0x7f5cf40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.779+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d04086970 con 0x7f5d14153c30 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.779+0000 7f5d18fbe700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 0x7f5cf40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.780+0000 7f5d18fbe700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 0x7f5cf40696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d14153720 tx=0x7f5cfc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.783+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d04053780 con 0x7f5d14153c30 2023-10-09T11:41:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.978+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d140c8610 con 0x7f5d14153c30 2023-10-09T11:41:00.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.978+0000 7f5d10ff9700 1 -- 172.21.15.26:0/2239110279 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f5d04056da0 con 0x7f5d14153c30 2023-10-09T11:41:00.980 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:00.980 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":87,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:40:59.697353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 msgr2=0x7f5cf40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 0x7f5cf40696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d14153720 tx=0x7f5cfc009040 comp rx=0 tx=0).stop 2023-10-09T11:41:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 msgr2=0x7f5d1416ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5d1406eb00 tx=0x7f5d04018000 comp rx=0 tx=0).stop 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 shutdown_connections 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d1415de50 0x7f5d140d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cf4067200 0x7f5cf40696b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d140cef40 0x7f5d14152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 --2- 172.21.15.26:0/2239110279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d14153c30 0x7f5d1416ac10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 >> 172.21.15.26:0/2239110279 conn(0x7f5d140703a0 msgr2=0x7f5d1415eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 shutdown_connections 2023-10-09T11:41:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:00.981+0000 7f5d19fc0700 1 -- 172.21.15.26:0/2239110279 wait complete. 2023-10-09T11:41:00.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:41:01.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.115+0000 7f4a4a750700 1 Processor -- start 2023-10-09T11:41:01.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 -- start start 2023-10-09T11:41:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a441508b0 0x7f4a440ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a44150c80 0x7f4a441573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440cddf0 con 0x7f4a440675a0 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440b0360 con 0x7f4a441508b0 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a4a750700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440cd550 con 0x7f4a44150c80 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.116+0000 7f4a43fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a441508b0 0x7f4a440ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a48ced700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a440675a0 0x7f4a440679a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52464/0 (socket says 172.21.15.26:52464) 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a48ced700 1 -- 172.21.15.26:0/1265606081 learned_addr learned my addr 172.21.15.26:0/1265606081 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a437fe700 1 --2- 172.21.15.26:0/1265606081 >> v2:172.21.15.67:3300/0 conn(0x7f4a44150c80 0x7f4a441573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a43fff700 1 -- 172.21.15.26:0/1265606081 >> v2:172.21.15.67:3300/0 conn(0x7f4a44150c80 msgr2=0x7f4a441573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a43fff700 1 --2- 172.21.15.26:0/1265606081 >> v2:172.21.15.67:3300/0 conn(0x7f4a44150c80 0x7f4a441573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a43fff700 1 -- 172.21.15.26:0/1265606081 >> v1:172.21.15.26:6789/0 conn(0x7f4a440675a0 legacy=0x7f4a440679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a43fff700 1 -- 172.21.15.26:0/1265606081 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440cd830 con 0x7f4a441508b0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a42ffd700 1 -- 172.21.15.26:0/1265606081 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933692107 0 0) 0x7f4a440cddf0 con 0x7f4a440675a0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a43fff700 1 --2- 172.21.15.26:0/1265606081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a441508b0 0x7f4a440ccec0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406a1f0 tx=0x7f4a340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9aec5777bb81ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a42ffd700 1 -- 172.21.15.26:0/1265606081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400b6b0 con 0x7f4a441508b0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a42ffd700 1 -- 172.21.15.26:0/1265606081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400b810 con 0x7f4a441508b0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.117+0000 7f4a42ffd700 1 -- 172.21.15.26:0/1265606081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400bbb0 con 0x7f4a441508b0 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 -- 172.21.15.26:0/1265606081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a441508b0 msgr2=0x7f4a440ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 --2- 172.21.15.26:0/1265606081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a441508b0 0x7f4a440ccec0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406a1f0 tx=0x7f4a340091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 -- 172.21.15.26:0/1265606081 shutdown_connections 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 --2- 172.21.15.26:0/1265606081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a441508b0 0x7f4a440ccec0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 --2- 172.21.15.26:0/1265606081 >> v2:172.21.15.67:3300/0 conn(0x7f4a44150c80 0x7f4a441573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 -- 172.21.15.26:0/1265606081 >> 172.21.15.26:0/1265606081 conn(0x7f4a4406d7b0 msgr2=0x7f4a4406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 -- 172.21.15.26:0/1265606081 shutdown_connections 2023-10-09T11:41:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.118+0000 7f4a4a750700 1 -- 172.21.15.26:0/1265606081 wait complete. 2023-10-09T11:41:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.119+0000 7f4a4a750700 1 Processor -- start 2023-10-09T11:41:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.119+0000 7f4a4a750700 1 -- start start 2023-10-09T11:41:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a441508b0 0x7f4a44151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a44150c80 0x7f4a4406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c9c50 con 0x7f4a440675a0 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c9040 con 0x7f4a44150c80 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a4a750700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c9320 con 0x7f4a441508b0 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48192/0 (socket says 172.21.15.26:48192) 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 -- 172.21.15.26:0/107256288 learned_addr learned my addr 172.21.15.26:0/107256288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a437fe700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a441508b0 0x7f4a44151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a48ced700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a44150c80 0x7f4a4406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 -- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a441508b0 msgr2=0x7f4a44151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a441508b0 0x7f4a44151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 -- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a44150c80 msgr2=0x7f4a4406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a44150c80 0x7f4a4406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 -- 172.21.15.26:0/107256288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009420 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.120+0000 7f4a43fff700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406e4a0 tx=0x7f4a34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.121+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011420 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.121+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34011580 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.121+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a440c9600 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.121+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011940 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.121+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44145350 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.122+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4404c3c0 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.122+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4a34011d30 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.122+0000 7f4a2bfff700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 0x7f4a300696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.123+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a34085ec0 con 0x7f4a440675a0 2023-10-09T11:41:01.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.123+0000 7f4a437fe700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 0x7f4a300696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:01.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.123+0000 7f4a437fe700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 0x7f4a300696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4a44153540 tx=0x7f4a38008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:01.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.127+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a34052de0 con 0x7f4a440675a0 2023-10-09T11:41:01.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:01.369+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4a440cdb10 con 0x7f4a440675a0 2023-10-09T11:41:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.302+0000 7f4a2bfff700 1 -- 172.21.15.26:0/107256288 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4a340150b0 con 0x7f4a440675a0 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 msgr2=0x7f4a300696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 0x7f4a300696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4a44153540 tx=0x7f4a38008040 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 msgr2=0x7f4a44144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406e4a0 tx=0x7f4a34017000 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 shutdown_connections 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a44150c80 0x7f4a4406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a440675a0 0x7f4a44144e10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a30067200 0x7f4a300696b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 --2- 172.21.15.26:0/107256288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a441508b0 0x7f4a44151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 >> 172.21.15.26:0/107256288 conn(0x7f4a4406d7b0 msgr2=0x7f4a4414fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 shutdown_connections 2023-10-09T11:41:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.305+0000 7f4a4a750700 1 -- 172.21.15.26:0/107256288 wait complete. 2023-10-09T11:41:02.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:41:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.449+0000 7fea5cf72700 1 Processor -- start 2023-10-09T11:41:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.449+0000 7fea5cf72700 1 -- start start 2023-10-09T11:41:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.450+0000 7fea5cf72700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea58159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.450+0000 7fea5cf72700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580ccfd0 con 0x7fea58159530 2023-10-09T11:41:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.450+0000 7fea5cf72700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5815a3d0 con 0x7fea5806e0e0 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.450+0000 7fea5cf72700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5815a6b0 con 0x7fea5806dc70 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.450+0000 7fea5659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fea58159530 0x7fea580ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52476/0 (socket says 172.21.15.26:52476) 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5659c700 1 -- 172.21.15.26:0/843174748 learned_addr learned my addr 172.21.15.26:0/843174748 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257037014 0 0) 0x7fea580ccfd0 con 0x7fea58159530 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea40003570 con 0x7fea58159530 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea55d9b700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea58159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210958776 0 0) 0x7fea40003570 con 0x7fea58159530 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 msgr2=0x7fea58159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:02.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea58159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 >> v1:172.21.15.67:6789/0 conn(0x7fea5806e0e0 legacy=0x7fea580cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5815a990 con 0x7fea58159530 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fea48001470 con 0x7fea58159530 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 >> v1:172.21.15.26:6789/0 conn(0x7fea58159530 legacy=0x7fea580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea40003a90 0x7fea40003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea40004810 0x7fea40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5815a6b0 con 0x7fea40004810 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4000bb60 con 0x7fea40003a90 2023-10-09T11:41:02.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4000bd20 con 0x7fea5806dc70 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea55d9b700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea40004810 0x7fea40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea5659c700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea40003a90 0x7fea40003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.451+0000 7fea56d9d700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 -- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 msgr2=0x7fea400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea5806dc70 0x7fea400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 -- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea40003a90 msgr2=0x7fea40003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea40003a90 0x7fea40003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 -- 172.21.15.26:0/843174748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40003570 con 0x7fea40004810 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5659c700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea40003a90 0x7fea40003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:02.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea55d9b700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea40004810 0x7fea40004c80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009c00 tx=0x7fea4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85582576a6d2da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00e710 con 0x7fea40004810 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00e870 con 0x7fea40004810 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5559a700 1 -- 172.21.15.26:0/843174748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00ec30 con 0x7fea40004810 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 -- 172.21.15.26:0/843174748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea40004810 msgr2=0x7fea40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 --2- 172.21.15.26:0/843174748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea40004810 0x7fea40004c80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009c00 tx=0x7fea4c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea56d9d700 1 -- 172.21.15.26:0/843174748 reap_dead start 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 -- 172.21.15.26:0/843174748 shutdown_connections 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 -- 172.21.15.26:0/843174748 >> 172.21.15.26:0/843174748 conn(0x7fea580703a0 msgr2=0x7fea580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 -- 172.21.15.26:0/843174748 shutdown_connections 2023-10-09T11:41:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.452+0000 7fea5cf72700 1 -- 172.21.15.26:0/843174748 wait complete. 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 Processor -- start 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 -- start start 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 0x7fea5814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea580ca240 0x7fea580b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5814e2c0 con 0x7fea5814e460 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580b1080 con 0x7fea580ca240 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea5cf72700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580b0a70 con 0x7fea40004810 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48204/0 (socket says 172.21.15.26:48204) 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea55d9b700 1 -- 172.21.15.26:0/3378427143 learned_addr learned my addr 172.21.15.26:0/3378427143 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.454+0000 7fea56d9d700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea580ca240 0x7fea580b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea5659c700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 0x7fea5814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 -- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 msgr2=0x7fea5814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 0x7fea5814dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 -- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea580ca240 msgr2=0x7fea580b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea580ca240 0x7fea580b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 -- 172.21.15.26:0/3378427143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580b4060 con 0x7fea5814e460 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea5659c700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 0x7fea5814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:02.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea55d9b700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fea4000bb30 tx=0x7fea4c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c022070 con 0x7fea5814e460 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00ebf0 con 0x7fea5814e460 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea580b4340 con 0x7fea5814e460 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c01c6a0 con 0x7fea5814e460 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.455+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea580c8440 con 0x7fea5814e460 2023-10-09T11:41:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.456+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5804c3c0 con 0x7fea5814e460 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.456+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fea4c01ca50 con 0x7fea5814e460 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.457+0000 7fea467fc700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 0x7fea380696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.457+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea4c086190 con 0x7fea5814e460 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.457+0000 7fea5659c700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 0x7fea380696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.458+0000 7fea5659c700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 0x7fea380696e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea48001ed0 tx=0x7fea48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:02.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.461+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea4c0531b0 con 0x7fea5814e460 2023-10-09T11:41:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:02.698+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fea580b11c0 con 0x7fea5814e460 2023-10-09T11:41:03.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.307+0000 7fea467fc700 1 -- 172.21.15.26:0/3378427143 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea4c056790 con 0x7fea5814e460 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 msgr2=0x7fea380696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 0x7fea380696e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea48001ed0 tx=0x7fea48009040 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 msgr2=0x7fea580b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fea4000bb30 tx=0x7fea4c01a000 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 shutdown_connections 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea580ca240 0x7fea580b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea38067230 0x7fea380696e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea40004810 0x7fea5814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 --2- 172.21.15.26:0/3378427143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5814e460 0x7fea580b3480 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 >> 172.21.15.26:0/3378427143 conn(0x7fea580703a0 msgr2=0x7fea580ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 shutdown_connections 2023-10-09T11:41:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.309+0000 7fea5cf72700 1 -- 172.21.15.26:0/3378427143 wait complete. 2023-10-09T11:41:03.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:03.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.446+0000 7f150b419700 1 Processor -- start 2023-10-09T11:41:03.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.446+0000 7f150b419700 1 -- start start 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f150b419700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15041595d0 0x7f15041599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f150b419700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f15040c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f150b419700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15040c7f50 con 0x7f15040675a0 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f150b419700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150406bd00 con 0x7f15041595d0 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f150b419700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150406b740 con 0x7f1504067a40 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15041595d0 0x7f15041599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15041595d0 0x7f15041599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48214/0 (socket says 172.21.15.26:48214) 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 -- 172.21.15.26:0/30211255 learned_addr learned my addr 172.21.15.26:0/30211255 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:03.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15099b6700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f15040c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 -- 172.21.15.26:0/30211255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 msgr2=0x7f15040c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f15040c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 -- 172.21.15.26:0/30211255 >> v1:172.21.15.67:6789/0 conn(0x7f15040675a0 legacy=0x7f150406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 -- 172.21.15.26:0/30211255 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150406ba20 con 0x7f15041595d0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15099b6700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f15040c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f15091b5700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15041595d0 0x7f15041599a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009f20 tx=0x7f14f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c97f72b07929f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f1503fff700 1 -- 172.21.15.26:0/30211255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400e070 con 0x7f15041595d0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f1503fff700 1 -- 172.21.15.26:0/30211255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f400ba80 con 0x7f15041595d0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.447+0000 7f1503fff700 1 -- 172.21.15.26:0/30211255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40092e0 con 0x7f15041595d0 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 -- 172.21.15.26:0/30211255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15041595d0 msgr2=0x7f15041599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15041595d0 0x7f15041599a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009f20 tx=0x7f14f4009840 comp rx=0 tx=0).stop 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 -- 172.21.15.26:0/30211255 shutdown_connections 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f15040c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 --2- 172.21.15.26:0/30211255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15041595d0 0x7f15041599a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 -- 172.21.15.26:0/30211255 >> 172.21.15.26:0/30211255 conn(0x7f15040cd400 msgr2=0x7f15040cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 -- 172.21.15.26:0/30211255 shutdown_connections 2023-10-09T11:41:03.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.448+0000 7f150b419700 1 -- 172.21.15.26:0/30211255 wait complete. 2023-10-09T11:41:03.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.449+0000 7f150b419700 1 Processor -- start 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.449+0000 7f150b419700 1 -- start start 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f150406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15041595d0 0x7f150406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150416d300 con 0x7f15040675a0 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150416d5b0 con 0x7f15041595d0 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f150b419700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150416d890 con 0x7f1504067a40 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48220/0 (socket says 172.21.15.26:48220) 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 -- 172.21.15.26:0/3199142476 learned_addr learned my addr 172.21.15.26:0/3199142476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15099b6700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15041595d0 0x7f150406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15089b4700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f150406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 -- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 msgr2=0x7f150406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f150406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 -- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15041595d0 msgr2=0x7f150406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.450+0000 7f15091b5700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15041595d0 0x7f150406cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f15091b5700 1 -- 172.21.15.26:0/3199142476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f4009ae0 con 0x7f15040675a0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f15091b5700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b6c0 tx=0x7f14f4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4008980 con 0x7f15040675a0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f4008ae0 con 0x7f15040675a0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150416db70 con 0x7f15040675a0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4008ea0 con 0x7f15040675a0 2023-10-09T11:41:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.451+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15040a9b80 con 0x7f15040675a0 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.452+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150404c3c0 con 0x7f15040675a0 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.452+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f14f4003040 con 0x7f15040675a0 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.453+0000 7f15017fa700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 0x7f14f00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.453+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14f40860b0 con 0x7f15040675a0 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.453+0000 7f15089b4700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 0x7f14f00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.453+0000 7f15089b4700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 0x7f14f00696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15040af6f0 tx=0x7f14f8007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.457+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14f4052ec0 con 0x7f15040675a0 2023-10-09T11:41:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.693+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15040c7be0 con 0x7f15040675a0 2023-10-09T11:41:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.694+0000 7f15017fa700 1 -- 172.21.15.26:0/3199142476 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f14f40564e0 con 0x7f15040675a0 2023-10-09T11:41:03.695 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:03.696 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 msgr2=0x7f14f00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 0x7f14f00696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15040af6f0 tx=0x7f14f8007ec0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 msgr2=0x7f150416cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b6c0 tx=0x7f14f4018000 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 shutdown_connections 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15041595d0 0x7f150406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15040675a0 0x7f150416cdc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f14f0067200 0x7f14f00696b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 --2- 172.21.15.26:0/3199142476 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1504067a40 0x7f150406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 >> 172.21.15.26:0/3199142476 conn(0x7f15040cd400 msgr2=0x7f1504158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 shutdown_connections 2023-10-09T11:41:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.696+0000 7f150b419700 1 -- 172.21.15.26:0/3199142476 wait complete. 2023-10-09T11:41:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 58 2023-10-09T11:41:03.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:03.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.827+0000 7f6cfa1d0700 1 Processor -- start 2023-10-09T11:41:03.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.827+0000 7f6cfa1d0700 1 -- start start 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cfa1d0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cf415de50 0x7f6cf40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cfa1d0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40cf3c0 con 0x7f6cf40cef40 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cfa1d0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf415afd0 con 0x7f6cf4153c30 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cfa1d0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf415b2b0 con 0x7f6cf415de50 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cf99cf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6cf40cef40 0x7f6cf415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52490/0 (socket says 172.21.15.26:52490) 2023-10-09T11:41:03.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cf99cf700 1 -- 172.21.15.26:0/1651266462 learned_addr learned my addr 172.21.15.26:0/1651266462 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cf89cd700 1 --2- 172.21.15.26:0/1651266462 >> v2:172.21.15.67:3300/0 conn(0x7f6cf415de50 0x7f6cf40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488426937 0 0) 0x7f6cf40cf3c0 con 0x7f6cf40cef40 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.828+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc003570 con 0x7f6cf40cef40 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486497471 0 0) 0x7f6cdc003570 con 0x7f6cf40cef40 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 >> v2:172.21.15.67:3300/0 conn(0x7f6cf415de50 msgr2=0x7f6cf40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 --2- 172.21.15.26:0/1651266462 >> v2:172.21.15.67:3300/0 conn(0x7f6cf415de50 0x7f6cf40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 >> v1:172.21.15.67:6789/0 conn(0x7f6cf4153c30 legacy=0x7f6cf415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf415b590 con 0x7f6cf40cef40 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f6ce40017f0 con 0x7f6cf40cef40 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 >> v1:172.21.15.26:6789/0 conn(0x7f6cf40cef40 legacy=0x7f6cf415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc003a60 0x7f6cdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cdc004810 0x7f6cdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 0x7f6cdc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf415b2b0 con 0x7f6cdc0051c0 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc00c0d0 con 0x7f6cdc004810 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc00c290 con 0x7f6cdc003a60 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 0x7f6cdc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf89cd700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cdc004810 0x7f6cdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf91ce700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc003a60 0x7f6cdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 -- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc003a60 msgr2=0x7f6cdc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc003a60 0x7f6cdc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 -- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cdc004810 msgr2=0x7f6cdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cdc004810 0x7f6cdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 -- 172.21.15.26:0/1651266462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc003570 con 0x7f6cdc0051c0 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 -- 172.21.15.26:0/1651266462 reap_dead start 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.829+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 0x7f6cdc00ba60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400a930 tx=0x7f6ce40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac38d386dcadf7df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40070d0 con 0x7f6cdc0051c0 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4007230 con 0x7f6cdc0051c0 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cf3fff700 1 -- 172.21.15.26:0/1651266462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40075d0 con 0x7f6cdc0051c0 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 msgr2=0x7f6cdc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 0x7f6cdc00ba60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400a930 tx=0x7f6ce40021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/1651266462 shutdown_connections 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/1651266462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cdc0051c0 0x7f6cdc00ba60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/1651266462 >> 172.21.15.26:0/1651266462 conn(0x7f6cf40703a0 msgr2=0x7f6cf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/1651266462 shutdown_connections 2023-10-09T11:41:03.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.830+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/1651266462 wait complete. 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.831+0000 7f6cfa1d0700 1 Processor -- start 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.831+0000 7f6cfa1d0700 1 -- start start 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 0x7f6cf40b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cf40c9eb0 0x7f6cf40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40b1e20 con 0x7f6cf414aa20 2023-10-09T11:41:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40b1210 con 0x7f6cf40c9eb0 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cfa1d0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40b14f0 con 0x7f6cdc0051c0 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cf99cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cf99cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48236/0 (socket says 172.21.15.26:48236) 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cf99cf700 1 -- 172.21.15.26:0/4034162086 learned_addr learned my addr 172.21.15.26:0/4034162086 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cf91ce700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 0x7f6cf40b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.832+0000 7f6cf89cd700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cf40c9eb0 0x7f6cf40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 -- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 msgr2=0x7f6cf40b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 0x7f6cf40b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 -- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cf40c9eb0 msgr2=0x7f6cf40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cf40c9eb0 0x7f6cf40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 -- 172.21.15.26:0/4034162086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40b17d0 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf91ce700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 0x7f6cf40b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf99cf700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4071370 tx=0x7f6ce4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4007b50 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce40073a0 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf40b1ab0 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce401d420 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.833+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf40b0e00 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.834+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf40b1fd0 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.834+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6ce401d7d0 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.835+0000 7f6cf17fa700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 0x7f6ce00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.835+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ce4086970 con 0x7f6cf414aa20 2023-10-09T11:41:03.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.835+0000 7f6cf91ce700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 0x7f6ce00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.836+0000 7f6cf91ce700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 0x7f6ce00696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40ca5e0 tx=0x7f6cec007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:03.839+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cf40b1fd0 con 0x7f6cf414aa20 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.035+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf404c3c0 con 0x7f6cf414aa20 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.036+0000 7f6cf17fa700 1 -- 172.21.15.26:0/4034162086 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f6ce4053850 con 0x7f6cf414aa20 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":88,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:01.185353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 msgr2=0x7f6ce00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 0x7f6ce00696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40ca5e0 tx=0x7f6cec007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 msgr2=0x7f6cf41590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4071370 tx=0x7f6ce4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 shutdown_connections 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf414aa20 0x7f6cf41590f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ce0067200 0x7f6ce00696b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cdc0051c0 0x7f6cf40b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 --2- 172.21.15.26:0/4034162086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cf40c9eb0 0x7f6cf40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 >> 172.21.15.26:0/4034162086 conn(0x7f6cf40703a0 msgr2=0x7f6cf415d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 shutdown_connections 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.038+0000 7f6cfa1d0700 1 -- 172.21.15.26:0/4034162086 wait complete. 2023-10-09T11:41:04.052 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:41:04.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.170+0000 7fa3859d2700 1 Processor -- start 2023-10-09T11:41:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.170+0000 7fa3859d2700 1 -- start start 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa3859d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa380156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa3859d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38015ae40 con 0x7fa3800cb970 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa3859d2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38015ab60 con 0x7fa3800cb5a0 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa3859d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800ce0f0 con 0x7fa38015a5d0 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa3800cb970 0x7fa380159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52502/0 (socket says 172.21.15.26:52502) 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37e7fc700 1 -- 172.21.15.26:0/55690444 learned_addr learned my addr 172.21.15.26:0/55690444 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37f7fe700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa380156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152261484 0 0) 0x7fa38015ae40 con 0x7fa3800cb970 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa36c003570 con 0x7fa3800cb970 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343220237 0 0) 0x7fa36c003570 con 0x7fa3800cb970 2023-10-09T11:41:04.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 msgr2=0x7fa380156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa380156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 >> v1:172.21.15.67:6789/0 conn(0x7fa3800cb5a0 legacy=0x7fa3800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800ccf00 con 0x7fa3800cb970 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fa368001470 con 0x7fa3800cb970 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 >> v1:172.21.15.26:6789/0 conn(0x7fa3800cb970 legacy=0x7fa380159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa36c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa36c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa36c004d50 0x7fa36c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800ce0f0 con 0x7fa36c003fd0 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c00bb40 con 0x7fa36c004d50 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.171+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c00bd00 con 0x7fa38015a5d0 2023-10-09T11:41:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa36c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37effd700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa36c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37f7fe700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa36c004d50 0x7fa36c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 -- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 msgr2=0x7fa36c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa38015a5d0 0x7fa36c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 -- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa36c004d50 msgr2=0x7fa36c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa36c004d50 0x7fa36c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 -- 172.21.15.26:0/55690444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c003570 con 0x7fa36c003fd0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa36c004810 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c3c0 tx=0x7fa368001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af03ad6778ced721 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800cc90 con 0x7fa36c003fd0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800cdf0 con 0x7fa36c003fd0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.172+0000 7fa37dffb700 1 -- 172.21.15.26:0/55690444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368005b70 con 0x7fa36c003fd0 2023-10-09T11:41:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 -- 172.21.15.26:0/55690444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 msgr2=0x7fa36c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 --2- 172.21.15.26:0/55690444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa36c004810 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c3c0 tx=0x7fa368001e70 comp rx=0 tx=0).stop 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa37f7fe700 1 -- 172.21.15.26:0/55690444 reap_dead start 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 -- 172.21.15.26:0/55690444 shutdown_connections 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 -- 172.21.15.26:0/55690444 >> 172.21.15.26:0/55690444 conn(0x7fa380070e30 msgr2=0x7fa3800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 -- 172.21.15.26:0/55690444 shutdown_connections 2023-10-09T11:41:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.173+0000 7fa3859d2700 1 -- 172.21.15.26:0/55690444 wait complete. 2023-10-09T11:41:04.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.174+0000 7fa3859d2700 1 Processor -- start 2023-10-09T11:41:04.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.174+0000 7fa3859d2700 1 -- start start 2023-10-09T11:41:04.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3800c9ff0 0x7fa380151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 0x7fa3800c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800ca440 con 0x7fa36c003fd0 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c7140 con 0x7fa3800c9ff0 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa3859d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801528e0 con 0x7fa3800c6790 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48256/0 (socket says 172.21.15.26:48256) 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 -- 172.21.15.26:0/699545448 learned_addr learned my addr 172.21.15.26:0/699545448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3800c9ff0 0x7fa380151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37f7fe700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 0x7fa3800c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 -- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 msgr2=0x7fa3800c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 0x7fa3800c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 -- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3800c9ff0 msgr2=0x7fa380151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3800c9ff0 0x7fa380151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 -- 172.21.15.26:0/699545448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380159a80 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37f7fe700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 0x7fa3800c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.175+0000 7fa37effd700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ec40 tx=0x7fa3700016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.176+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370001ce0 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.176+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370001e40 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.176+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3800ca620 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.176+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c8b0 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.176+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa380159190 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.177+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38004c3c0 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.177+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa37000cc60 con 0x7fa36c003fd0 2023-10-09T11:41:04.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.177+0000 7fa376ffd700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 0x7fa3600696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.177+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa370084b30 con 0x7fa36c003fd0 2023-10-09T11:41:04.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.178+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 0x7fa3600696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.178+0000 7fa37e7fc700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 0x7fa3600696e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa368001ed0 tx=0x7fa368015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.182+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa370051a50 con 0x7fa36c003fd0 2023-10-09T11:41:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.371+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3800c57c0 con 0x7fa360067230 2023-10-09T11:41:04.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.380+0000 7fa376ffd700 1 -- 172.21.15.26:0/699545448 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287989 (secure 0 0 0) 0x7fa3800c57c0 con 0x7fa360067230 2023-10-09T11:41:04.385 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 msgr2=0x7fa3600696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 0x7fa3600696e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa368001ed0 tx=0x7fa368015000 comp rx=0 tx=0).stop 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 msgr2=0x7fa380156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ec40 tx=0x7fa3700016d0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 shutdown_connections 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa360067230 0x7fa3600696e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3800c6790 0x7fa3800c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c003fd0 0x7fa380156c60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 --2- 172.21.15.26:0/699545448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3800c9ff0 0x7fa380151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 >> 172.21.15.26:0/699545448 conn(0x7fa380070e30 msgr2=0x7fa3800b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 shutdown_connections 2023-10-09T11:41:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.383+0000 7fa3859d2700 1 -- 172.21.15.26:0/699545448 wait complete. 2023-10-09T11:41:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:04.396 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2023-10-09T11:41:03.188258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408320,"kb_used_data":9536,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566400,"statfs":{"total":773094113280,"available":770627993600,"internally_reserved":0,"allocated":9764864,"data_stored":4846726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904471"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192056+0000","last_change":"2023-10-09T11:41:00.192174+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192056+0000","last_undegraded":"2023-10-09T11:41:00.192056+0000","last_fullsized":"2023-10-09T11:41:00.192056+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196279+0000","last_change":"2023-10-09T11:41:00.196435+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196279+0000","last_undegraded":"2023-10-09T11:41:00.196279+0000","last_fullsized":"2023-10-09T11:41:00.196279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191209+0000","last_change":"2023-10-09T11:41:00.191346+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191209+0000","last_undegraded":"2023-10-09T11:41:00.191209+0000","last_fullsized":"2023-10-09T11:41:00.191209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187559+0000","last_change":"2023-10-09T11:41:00.187689+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187559+0000","last_undegraded":"2023-10-09T11:41:00.187559+0000","last_fullsized":"2023-10-09T11:41:00.187559+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200751+0000","last_change":"2023-10-09T11:41:00.195607+0000","last_active":"2023-10-09T11:41:00.200751+0000","last_peered":"2023-10-09T11:41:00.200751+0000","last_clean":"2023-10-09T11:41:00.200751+0000","last_became_active":"2023-10-09T11:41:00.195342+0000","last_became_peered":"2023-10-09T11:41:00.195342+0000","last_unstale":"2023-10-09T11:41:00.200751+0000","last_undegraded":"2023-10-09T11:41:00.200751+0000","last_fullsized":"2023-10-09T11:41:00.200751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199290+0000","last_change":"2023-10-09T11:41:00.199290+0000","last_active":"2023-10-09T11:41:00.199290+0000","last_peered":"2023-10-09T11:41:00.199290+0000","last_clean":"2023-10-09T11:41:00.199290+0000","last_became_active":"2023-10-09T11:41:00.199006+0000","last_became_peered":"2023-10-09T11:41:00.199006+0000","last_unstale":"2023-10-09T11:41:00.199290+0000","last_undegraded":"2023-10-09T11:41:00.199290+0000","last_fullsized":"2023-10-09T11:41:00.199290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:37.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.197074+0000","last_change":"2023-10-09T11:41:00.197074+0000","last_active":"2023-10-09T11:41:00.197074+0000","last_peered":"2023-10-09T11:41:00.197074+0000","last_clean":"2023-10-09T11:41:00.197074+0000","last_became_active":"2023-10-09T11:41:00.196781+0000","last_became_peered":"2023-10-09T11:41:00.196781+0000","last_unstale":"2023-10-09T11:41:00.197074+0000","last_undegraded":"2023-10-09T11:41:00.197074+0000","last_fullsized":"2023-10-09T11:41:00.197074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:05.170649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199097+0000","last_change":"2023-10-09T11:41:00.199173+0000","last_active":"2023-10-09T11:41:00.199097+0000","last_peered":"2023-10-09T11:41:00.199097+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.196113+0000","last_became_peered":"2023-10-09T11:41:00.196113+0000","last_unstale":"2023-10-09T11:41:00.199097+0000","last_undegraded":"2023-10-09T11:41:00.199097+0000","last_fullsized":"2023-10-09T11:41:00.199097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211312+0000","last_change":"2023-10-09T11:41:00.204730+0000","last_active":"2023-10-09T11:41:00.211312+0000","last_peered":"2023-10-09T11:41:00.211312+0000","last_clean":"2023-10-09T11:41:00.211312+0000","last_became_active":"2023-10-09T11:41:00.204428+0000","last_became_peered":"2023-10-09T11:41:00.204428+0000","last_unstale":"2023-10-09T11:41:00.211312+0000","last_undegraded":"2023-10-09T11:41:00.211312+0000","last_fullsized":"2023-10-09T11:41:00.211312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203902+0000","last_change":"2023-10-09T11:41:00.198185+0000","last_active":"2023-10-09T11:41:00.203902+0000","last_peered":"2023-10-09T11:41:00.203902+0000","last_clean":"2023-10-09T11:41:00.203902+0000","last_became_active":"2023-10-09T11:41:00.197877+0000","last_became_peered":"2023-10-09T11:41:00.197877+0000","last_unstale":"2023-10-09T11:41:00.203902+0000","last_undegraded":"2023-10-09T11:41:00.203902+0000","last_fullsized":"2023-10-09T11:41:00.203902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:20.433153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205889+0000","last_change":"2023-10-09T11:41:00.205889+0000","last_active":"2023-10-09T11:41:00.205889+0000","last_peered":"2023-10-09T11:41:00.205889+0000","last_clean":"2023-10-09T11:41:00.205889+0000","last_became_active":"2023-10-09T11:41:00.205596+0000","last_became_peered":"2023-10-09T11:41:00.205596+0000","last_unstale":"2023-10-09T11:41:00.205889+0000","last_undegraded":"2023-10-09T11:41:00.205889+0000","last_fullsized":"2023-10-09T11:41:00.205889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203639+0000","last_change":"2023-10-09T11:41:00.202214+0000","last_active":"2023-10-09T11:41:00.203639+0000","last_peered":"2023-10-09T11:41:00.203639+0000","last_clean":"2023-10-09T11:41:00.203639+0000","last_became_active":"2023-10-09T11:41:00.201923+0000","last_became_peered":"2023-10-09T11:41:00.201923+0000","last_unstale":"2023-10-09T11:41:00.203639+0000","last_undegraded":"2023-10-09T11:41:00.203639+0000","last_fullsized":"2023-10-09T11:41:00.203639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187145+0000","last_change":"2023-10-09T11:41:00.187599+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187145+0000","last_undegraded":"2023-10-09T11:41:00.187145+0000","last_fullsized":"2023-10-09T11:41:00.187145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190990+0000","last_change":"2023-10-09T11:41:00.191111+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190990+0000","last_undegraded":"2023-10-09T11:41:00.190990+0000","last_fullsized":"2023-10-09T11:41:00.190990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187222+0000","last_change":"2023-10-09T11:41:00.187373+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187222+0000","last_undegraded":"2023-10-09T11:41:00.187222+0000","last_fullsized":"2023-10-09T11:41:00.187222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204159+0000","last_change":"2023-10-09T11:41:00.204159+0000","last_active":"2023-10-09T11:41:00.204159+0000","last_peered":"2023-10-09T11:41:00.204159+0000","last_clean":"2023-10-09T11:41:00.204159+0000","last_became_active":"2023-10-09T11:41:00.203128+0000","last_became_peered":"2023-10-09T11:41:00.203128+0000","last_unstale":"2023-10-09T11:41:00.204159+0000","last_undegraded":"2023-10-09T11:41:00.204159+0000","last_fullsized":"2023-10-09T11:41:00.204159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:13.177318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190268+0000","last_change":"2023-10-09T11:41:00.190411+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190268+0000","last_undegraded":"2023-10-09T11:41:00.190268+0000","last_fullsized":"2023-10-09T11:41:00.190268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187098+0000","last_change":"2023-10-09T11:41:00.187265+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187098+0000","last_undegraded":"2023-10-09T11:41:00.187098+0000","last_fullsized":"2023-10-09T11:41:00.187098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191321+0000","last_change":"2023-10-09T11:41:00.192903+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191321+0000","last_undegraded":"2023-10-09T11:41:00.191321+0000","last_fullsized":"2023-10-09T11:41:00.191321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211342+0000","last_change":"2023-10-09T11:41:00.205012+0000","last_active":"2023-10-09T11:41:00.211342+0000","last_peered":"2023-10-09T11:41:00.211342+0000","last_clean":"2023-10-09T11:41:00.211342+0000","last_became_active":"2023-10-09T11:41:00.204745+0000","last_became_peered":"2023-10-09T11:41:00.204745+0000","last_unstale":"2023-10-09T11:41:00.211342+0000","last_undegraded":"2023-10-09T11:41:00.211342+0000","last_fullsized":"2023-10-09T11:41:00.211342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190948+0000","last_change":"2023-10-09T11:41:00.191089+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190948+0000","last_undegraded":"2023-10-09T11:41:00.190948+0000","last_fullsized":"2023-10-09T11:41:00.190948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199788+0000","last_change":"2023-10-09T11:41:00.199862+0000","last_active":"2023-10-09T11:41:00.199788+0000","last_peered":"2023-10-09T11:41:00.199788+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199592+0000","last_became_peered":"2023-10-09T11:41:00.199592+0000","last_unstale":"2023-10-09T11:41:00.199788+0000","last_undegraded":"2023-10-09T11:41:00.199788+0000","last_fullsized":"2023-10-09T11:41:00.199788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198789+0000","last_change":"2023-10-09T11:41:00.198858+0000","last_active":"2023-10-09T11:41:00.198789+0000","last_peered":"2023-10-09T11:41:00.198789+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.198619+0000","last_became_peered":"2023-10-09T11:41:00.198619+0000","last_unstale":"2023-10-09T11:41:00.198789+0000","last_undegraded":"2023-10-09T11:41:00.198789+0000","last_fullsized":"2023-10-09T11:41:00.198789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200562+0000","last_change":"2023-10-09T11:41:00.200562+0000","last_active":"2023-10-09T11:41:00.200562+0000","last_peered":"2023-10-09T11:41:00.200562+0000","last_clean":"2023-10-09T11:41:00.200562+0000","last_became_active":"2023-10-09T11:41:00.199082+0000","last_became_peered":"2023-10-09T11:41:00.199082+0000","last_unstale":"2023-10-09T11:41:00.200562+0000","last_undegraded":"2023-10-09T11:41:00.200562+0000","last_fullsized":"2023-10-09T11:41:00.200562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203884+0000","last_change":"2023-10-09T11:41:00.197274+0000","last_active":"2023-10-09T11:41:00.203884+0000","last_peered":"2023-10-09T11:41:00.203884+0000","last_clean":"2023-10-09T11:41:00.203884+0000","last_became_active":"2023-10-09T11:41:00.197002+0000","last_became_peered":"2023-10-09T11:41:00.197002+0000","last_unstale":"2023-10-09T11:41:00.203884+0000","last_undegraded":"2023-10-09T11:41:00.203884+0000","last_fullsized":"2023-10-09T11:41:00.203884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191520+0000","last_change":"2023-10-09T11:41:00.191644+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191520+0000","last_undegraded":"2023-10-09T11:41:00.191520+0000","last_fullsized":"2023-10-09T11:41:00.191520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198845+0000","last_change":"2023-10-09T11:41:00.198845+0000","last_active":"2023-10-09T11:41:00.198845+0000","last_peered":"2023-10-09T11:41:00.198845+0000","last_clean":"2023-10-09T11:41:00.198845+0000","last_became_active":"2023-10-09T11:41:00.198566+0000","last_became_peered":"2023-10-09T11:41:00.198566+0000","last_unstale":"2023-10-09T11:41:00.198845+0000","last_undegraded":"2023-10-09T11:41:00.198845+0000","last_fullsized":"2023-10-09T11:41:00.198845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205095+0000","last_change":"2023-10-09T11:41:00.200060+0000","last_active":"2023-10-09T11:41:00.205095+0000","last_peered":"2023-10-09T11:41:00.205095+0000","last_clean":"2023-10-09T11:41:00.205095+0000","last_became_active":"2023-10-09T11:41:00.199755+0000","last_became_peered":"2023-10-09T11:41:00.199755+0000","last_unstale":"2023-10-09T11:41:00.205095+0000","last_undegraded":"2023-10-09T11:41:00.205095+0000","last_fullsized":"2023-10-09T11:41:00.205095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:12.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":5,"reported_epoch":87,"state":"active","last_fresh":"2023-10-09T11:41:00.199898+0000","last_change":"2023-10-09T11:41:00.199898+0000","last_active":"2023-10-09T11:41:00.199898+0000","last_peered":"2023-10-09T11:41:00.199898+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199898+0000","last_became_peered":"2023-10-09T11:41:00.199898+0000","last_unstale":"2023-10-09T11:41:00.199898+0000","last_undegraded":"2023-10-09T11:41:00.199898+0000","last_fullsized":"2023-10-09T11:41:00.199898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191317+0000","last_change":"2023-10-09T11:41:00.191451+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191317+0000","last_undegraded":"2023-10-09T11:41:00.191317+0000","last_fullsized":"2023-10-09T11:41:00.191317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187036+0000","last_change":"2023-10-09T11:41:00.187136+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187036+0000","last_undegraded":"2023-10-09T11:41:00.187036+0000","last_fullsized":"2023-10-09T11:41:00.187036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193811+0000","last_change":"2023-10-09T11:41:00.193927+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193811+0000","last_undegraded":"2023-10-09T11:41:00.193811+0000","last_fullsized":"2023-10-09T11:41:00.193811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192212+0000","last_change":"2023-10-09T11:41:00.192335+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192212+0000","last_undegraded":"2023-10-09T11:41:00.192212+0000","last_fullsized":"2023-10-09T11:41:00.192212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309601+0000","last_change":"2023-10-09T11:40:59.308487+0000","last_active":"2023-10-09T11:40:59.309601+0000","last_peered":"2023-10-09T11:40:59.309601+0000","last_clean":"2023-10-09T11:40:59.309601+0000","last_became_active":"2023-10-09T11:40:59.308214+0000","last_became_peered":"2023-10-09T11:40:59.308214+0000","last_unstale":"2023-10-09T11:40:59.309601+0000","last_undegraded":"2023-10-09T11:40:59.309601+0000","last_fullsized":"2023-10-09T11:40:59.309601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:40.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187352+0000","last_change":"2023-10-09T11:41:00.187486+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187352+0000","last_undegraded":"2023-10-09T11:41:00.187352+0000","last_fullsized":"2023-10-09T11:41:00.187352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192344+0000","last_change":"2023-10-09T11:40:59.305539+0000","last_active":"2023-10-09T11:41:00.192344+0000","last_peered":"2023-10-09T11:41:00.192344+0000","last_clean":"2023-10-09T11:41:00.192344+0000","last_became_active":"2023-10-09T11:40:59.305219+0000","last_became_peered":"2023-10-09T11:40:59.305219+0000","last_unstale":"2023-10-09T11:41:00.192344+0000","last_undegraded":"2023-10-09T11:41:00.192344+0000","last_fullsized":"2023-10-09T11:41:00.192344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:14.227138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192577+0000","last_change":"2023-10-09T11:41:00.192711+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192577+0000","last_undegraded":"2023-10-09T11:41:00.192577+0000","last_fullsized":"2023-10-09T11:41:00.192577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312474+0000","last_change":"2023-10-09T11:40:59.311238+0000","last_active":"2023-10-09T11:40:59.312474+0000","last_peered":"2023-10-09T11:40:59.312474+0000","last_clean":"2023-10-09T11:40:59.312474+0000","last_became_active":"2023-10-09T11:40:59.310971+0000","last_became_peered":"2023-10-09T11:40:59.310971+0000","last_unstale":"2023-10-09T11:40:59.312474+0000","last_undegraded":"2023-10-09T11:40:59.312474+0000","last_fullsized":"2023-10-09T11:40:59.312474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211291+0000","last_change":"2023-10-09T11:41:00.203295+0000","last_active":"2023-10-09T11:41:00.211291+0000","last_peered":"2023-10-09T11:41:00.211291+0000","last_clean":"2023-10-09T11:41:00.211291+0000","last_became_active":"2023-10-09T11:41:00.202916+0000","last_became_peered":"2023-10-09T11:41:00.202916+0000","last_unstale":"2023-10-09T11:41:00.211291+0000","last_undegraded":"2023-10-09T11:41:00.211291+0000","last_fullsized":"2023-10-09T11:41:00.211291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309259+0000","last_change":"2023-10-09T11:40:59.304921+0000","last_active":"2023-10-09T11:40:59.309259+0000","last_peered":"2023-10-09T11:40:59.309259+0000","last_clean":"2023-10-09T11:40:59.309259+0000","last_became_active":"2023-10-09T11:40:59.304647+0000","last_became_peered":"2023-10-09T11:40:59.304647+0000","last_unstale":"2023-10-09T11:40:59.309259+0000","last_undegraded":"2023-10-09T11:40:59.309259+0000","last_fullsized":"2023-10-09T11:40:59.309259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:32.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204348+0000","last_change":"2023-10-09T11:41:00.204348+0000","last_active":"2023-10-09T11:41:00.204348+0000","last_peered":"2023-10-09T11:41:00.204348+0000","last_clean":"2023-10-09T11:41:00.204348+0000","last_became_active":"2023-10-09T11:41:00.204062+0000","last_became_peered":"2023-10-09T11:41:00.204062+0000","last_unstale":"2023-10-09T11:41:00.204348+0000","last_undegraded":"2023-10-09T11:41:00.204348+0000","last_fullsized":"2023-10-09T11:41:00.204348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:38.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310869+0000","last_change":"2023-10-09T11:40:59.309418+0000","last_active":"2023-10-09T11:40:59.310869+0000","last_peered":"2023-10-09T11:40:59.310869+0000","last_clean":"2023-10-09T11:40:59.310869+0000","last_became_active":"2023-10-09T11:40:59.309124+0000","last_became_peered":"2023-10-09T11:40:59.309124+0000","last_unstale":"2023-10-09T11:40:59.310869+0000","last_undegraded":"2023-10-09T11:40:59.310869+0000","last_fullsized":"2023-10-09T11:40:59.310869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:02.793137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201293+0000","last_change":"2023-10-09T11:41:00.201293+0000","last_active":"2023-10-09T11:41:00.201293+0000","last_peered":"2023-10-09T11:41:00.201293+0000","last_clean":"2023-10-09T11:41:00.201293+0000","last_became_active":"2023-10-09T11:41:00.201006+0000","last_became_peered":"2023-10-09T11:41:00.201006+0000","last_unstale":"2023-10-09T11:41:00.201293+0000","last_undegraded":"2023-10-09T11:41:00.201293+0000","last_fullsized":"2023-10-09T11:41:00.201293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:01.783061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309879+0000","last_change":"2023-10-09T11:40:59.309157+0000","last_active":"2023-10-09T11:40:59.309879+0000","last_peered":"2023-10-09T11:40:59.309879+0000","last_clean":"2023-10-09T11:40:59.309879+0000","last_became_active":"2023-10-09T11:40:59.308897+0000","last_became_peered":"2023-10-09T11:40:59.308897+0000","last_unstale":"2023-10-09T11:40:59.309879+0000","last_undegraded":"2023-10-09T11:40:59.309879+0000","last_fullsized":"2023-10-09T11:40:59.309879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.172569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.186949+0000","last_change":"2023-10-09T11:41:00.187132+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.186949+0000","last_undegraded":"2023-10-09T11:41:00.186949+0000","last_fullsized":"2023-10-09T11:41:00.186949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190616+0000","last_change":"2023-10-09T11:40:59.306629+0000","last_active":"2023-10-09T11:41:00.190616+0000","last_peered":"2023-10-09T11:41:00.190616+0000","last_clean":"2023-10-09T11:41:00.190616+0000","last_became_active":"2023-10-09T11:40:59.306323+0000","last_became_peered":"2023-10-09T11:40:59.306323+0000","last_unstale":"2023-10-09T11:41:00.190616+0000","last_undegraded":"2023-10-09T11:41:00.190616+0000","last_fullsized":"2023-10-09T11:41:00.190616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203696+0000","last_change":"2023-10-09T11:41:00.201888+0000","last_active":"2023-10-09T11:41:00.203696+0000","last_peered":"2023-10-09T11:41:00.203696+0000","last_clean":"2023-10-09T11:41:00.203696+0000","last_became_active":"2023-10-09T11:41:00.201618+0000","last_became_peered":"2023-10-09T11:41:00.201618+0000","last_unstale":"2023-10-09T11:41:00.203696+0000","last_undegraded":"2023-10-09T11:41:00.203696+0000","last_fullsized":"2023-10-09T11:41:00.203696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:39.216602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310944+0000","last_change":"2023-10-09T11:40:59.307929+0000","last_active":"2023-10-09T11:40:59.310944+0000","last_peered":"2023-10-09T11:40:59.310944+0000","last_clean":"2023-10-09T11:40:59.310944+0000","last_became_active":"2023-10-09T11:40:59.307659+0000","last_became_peered":"2023-10-09T11:40:59.307659+0000","last_unstale":"2023-10-09T11:40:59.310944+0000","last_undegraded":"2023-10-09T11:40:59.310944+0000","last_fullsized":"2023-10-09T11:40:59.310944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:03.479960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191856+0000","last_change":"2023-10-09T11:41:00.191985+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191856+0000","last_undegraded":"2023-10-09T11:41:00.191856+0000","last_fullsized":"2023-10-09T11:41:00.191856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310815+0000","last_change":"2023-10-09T11:40:59.304810+0000","last_active":"2023-10-09T11:40:59.310815+0000","last_peered":"2023-10-09T11:40:59.310815+0000","last_clean":"2023-10-09T11:40:59.310815+0000","last_became_active":"2023-10-09T11:40:59.304549+0000","last_became_peered":"2023-10-09T11:40:59.304549+0000","last_unstale":"2023-10-09T11:40:59.310815+0000","last_undegraded":"2023-10-09T11:40:59.310815+0000","last_fullsized":"2023-10-09T11:40:59.310815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:08.412199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211386+0000","last_change":"2023-10-09T11:41:00.205378+0000","last_active":"2023-10-09T11:41:00.211386+0000","last_peered":"2023-10-09T11:41:00.211386+0000","last_clean":"2023-10-09T11:41:00.211386+0000","last_became_active":"2023-10-09T11:41:00.205077+0000","last_became_peered":"2023-10-09T11:41:00.205077+0000","last_unstale":"2023-10-09T11:41:00.211386+0000","last_undegraded":"2023-10-09T11:41:00.211386+0000","last_fullsized":"2023-10-09T11:41:00.211386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.308122+0000","last_change":"2023-10-09T11:40:59.305950+0000","last_active":"2023-10-09T11:40:59.308122+0000","last_peered":"2023-10-09T11:40:59.308122+0000","last_clean":"2023-10-09T11:40:59.308122+0000","last_became_active":"2023-10-09T11:40:59.305644+0000","last_became_peered":"2023-10-09T11:40:59.305644+0000","last_unstale":"2023-10-09T11:40:59.308122+0000","last_undegraded":"2023-10-09T11:40:59.308122+0000","last_fullsized":"2023-10-09T11:40:59.308122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211202+0000","last_change":"2023-10-09T11:41:00.208244+0000","last_active":"2023-10-09T11:41:00.211202+0000","last_peered":"2023-10-09T11:41:00.211202+0000","last_clean":"2023-10-09T11:41:00.211202+0000","last_became_active":"2023-10-09T11:41:00.207912+0000","last_became_peered":"2023-10-09T11:41:00.207912+0000","last_unstale":"2023-10-09T11:41:00.211202+0000","last_undegraded":"2023-10-09T11:41:00.211202+0000","last_fullsized":"2023-10-09T11:41:00.211202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"87'3","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304694+0000","last_change":"2023-10-09T11:40:59.303316+0000","last_active":"2023-10-09T11:41:00.304694+0000","last_peered":"2023-10-09T11:41:00.304694+0000","last_clean":"2023-10-09T11:41:00.304694+0000","last_became_active":"2023-10-09T11:40:59.302954+0000","last_became_peered":"2023-10-09T11:40:59.302954+0000","last_unstale":"2023-10-09T11:41:00.304694+0000","last_undegraded":"2023-10-09T11:41:00.304694+0000","last_fullsized":"2023-10-09T11:41:00.304694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:07.142190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208470+0000","last_change":"2023-10-09T11:41:00.208470+0000","last_active":"2023-10-09T11:41:00.208470+0000","last_peered":"2023-10-09T11:41:00.208470+0000","last_clean":"2023-10-09T11:41:00.208470+0000","last_became_active":"2023-10-09T11:41:00.208213+0000","last_became_peered":"2023-10-09T11:41:00.208213+0000","last_unstale":"2023-10-09T11:41:00.208470+0000","last_undegraded":"2023-10-09T11:41:00.208470+0000","last_fullsized":"2023-10-09T11:41:00.208470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"87'6","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.307024+0000","last_change":"2023-10-09T11:40:59.307720+0000","last_active":"2023-10-09T11:41:00.307024+0000","last_peered":"2023-10-09T11:41:00.307024+0000","last_clean":"2023-10-09T11:41:00.307024+0000","last_became_active":"2023-10-09T11:40:59.307437+0000","last_became_peered":"2023-10-09T11:40:59.307437+0000","last_unstale":"2023-10-09T11:41:00.307024+0000","last_undegraded":"2023-10-09T11:41:00.307024+0000","last_fullsized":"2023-10-09T11:41:00.307024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:02.662263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187212+0000","last_change":"2023-10-09T11:41:00.187377+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187212+0000","last_undegraded":"2023-10-09T11:41:00.187212+0000","last_fullsized":"2023-10-09T11:41:00.187212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311366+0000","last_change":"2023-10-09T11:40:59.306793+0000","last_active":"2023-10-09T11:40:59.311366+0000","last_peered":"2023-10-09T11:40:59.311366+0000","last_clean":"2023-10-09T11:40:59.311366+0000","last_became_active":"2023-10-09T11:40:59.306510+0000","last_became_peered":"2023-10-09T11:40:59.306510+0000","last_unstale":"2023-10-09T11:40:59.311366+0000","last_undegraded":"2023-10-09T11:40:59.311366+0000","last_fullsized":"2023-10-09T11:40:59.311366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:37.705035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192936+0000","last_change":"2023-10-09T11:41:00.193063+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192936+0000","last_undegraded":"2023-10-09T11:41:00.192936+0000","last_fullsized":"2023-10-09T11:41:00.192936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312451+0000","last_change":"2023-10-09T11:40:59.309374+0000","last_active":"2023-10-09T11:40:59.312451+0000","last_peered":"2023-10-09T11:40:59.312451+0000","last_clean":"2023-10-09T11:40:59.312451+0000","last_became_active":"2023-10-09T11:40:59.309083+0000","last_became_peered":"2023-10-09T11:40:59.309083+0000","last_unstale":"2023-10-09T11:40:59.312451+0000","last_undegraded":"2023-10-09T11:40:59.312451+0000","last_fullsized":"2023-10-09T11:40:59.312451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:58.469619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204138+0000","last_change":"2023-10-09T11:41:00.201482+0000","last_active":"2023-10-09T11:41:00.204138+0000","last_peered":"2023-10-09T11:41:00.204138+0000","last_clean":"2023-10-09T11:41:00.204138+0000","last_became_active":"2023-10-09T11:41:00.201208+0000","last_became_peered":"2023-10-09T11:41:00.201208+0000","last_unstale":"2023-10-09T11:41:00.204138+0000","last_undegraded":"2023-10-09T11:41:00.204138+0000","last_fullsized":"2023-10-09T11:41:00.204138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200308+0000","last_change":"2023-10-09T11:40:59.307781+0000","last_active":"2023-10-09T11:41:00.200308+0000","last_peered":"2023-10-09T11:41:00.200308+0000","last_clean":"2023-10-09T11:41:00.200308+0000","last_became_active":"2023-10-09T11:40:59.307502+0000","last_became_peered":"2023-10-09T11:40:59.307502+0000","last_unstale":"2023-10-09T11:41:00.200308+0000","last_undegraded":"2023-10-09T11:41:00.200308+0000","last_fullsized":"2023-10-09T11:41:00.200308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191151+0000","last_change":"2023-10-09T11:41:00.191281+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191151+0000","last_undegraded":"2023-10-09T11:41:00.191151+0000","last_fullsized":"2023-10-09T11:41:00.191151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312668+0000","last_change":"2023-10-09T11:40:59.311585+0000","last_active":"2023-10-09T11:40:59.312668+0000","last_peered":"2023-10-09T11:40:59.312668+0000","last_clean":"2023-10-09T11:40:59.312668+0000","last_became_active":"2023-10-09T11:40:59.310224+0000","last_became_peered":"2023-10-09T11:40:59.310224+0000","last_unstale":"2023-10-09T11:40:59.312668+0000","last_undegraded":"2023-10-09T11:40:59.312668+0000","last_fullsized":"2023-10-09T11:40:59.312668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:28.139612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206440+0000","last_change":"2023-10-09T11:41:00.205217+0000","last_active":"2023-10-09T11:41:00.206440+0000","last_peered":"2023-10-09T11:41:00.206440+0000","last_clean":"2023-10-09T11:41:00.206440+0000","last_became_active":"2023-10-09T11:41:00.204945+0000","last_became_peered":"2023-10-09T11:41:00.204945+0000","last_unstale":"2023-10-09T11:41:00.206440+0000","last_undegraded":"2023-10-09T11:41:00.206440+0000","last_fullsized":"2023-10-09T11:41:00.206440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304354+0000","last_change":"2023-10-09T11:40:59.311483+0000","last_active":"2023-10-09T11:41:00.304354+0000","last_peered":"2023-10-09T11:41:00.304354+0000","last_clean":"2023-10-09T11:41:00.304354+0000","last_became_active":"2023-10-09T11:40:59.311249+0000","last_became_peered":"2023-10-09T11:40:59.311249+0000","last_unstale":"2023-10-09T11:41:00.304354+0000","last_undegraded":"2023-10-09T11:41:00.304354+0000","last_fullsized":"2023-10-09T11:41:00.304354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202133+0000","last_change":"2023-10-09T11:41:00.202133+0000","last_active":"2023-10-09T11:41:00.202133+0000","last_peered":"2023-10-09T11:41:00.202133+0000","last_clean":"2023-10-09T11:41:00.202133+0000","last_became_active":"2023-10-09T11:41:00.201841+0000","last_became_peered":"2023-10-09T11:41:00.201841+0000","last_unstale":"2023-10-09T11:41:00.202133+0000","last_undegraded":"2023-10-09T11:41:00.202133+0000","last_fullsized":"2023-10-09T11:41:00.202133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:28.230567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305220+0000","last_change":"2023-10-09T11:40:59.307530+0000","last_active":"2023-10-09T11:41:00.305220+0000","last_peered":"2023-10-09T11:41:00.305220+0000","last_clean":"2023-10-09T11:41:00.305220+0000","last_became_active":"2023-10-09T11:40:59.307240+0000","last_became_peered":"2023-10-09T11:40:59.307240+0000","last_unstale":"2023-10-09T11:41:00.305220+0000","last_undegraded":"2023-10-09T11:41:00.305220+0000","last_fullsized":"2023-10-09T11:41:00.305220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205520+0000","last_change":"2023-10-09T11:41:00.205520+0000","last_active":"2023-10-09T11:41:00.205520+0000","last_peered":"2023-10-09T11:41:00.205520+0000","last_clean":"2023-10-09T11:41:00.205520+0000","last_became_active":"2023-10-09T11:41:00.205256+0000","last_became_peered":"2023-10-09T11:41:00.205256+0000","last_unstale":"2023-10-09T11:41:00.205520+0000","last_undegraded":"2023-10-09T11:41:00.205520+0000","last_fullsized":"2023-10-09T11:41:00.205520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:47.838489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.305008+0000","last_change":"2023-10-09T11:40:59.303336+0000","last_active":"2023-10-09T11:40:59.305008+0000","last_peered":"2023-10-09T11:40:59.305008+0000","last_clean":"2023-10-09T11:40:59.305008+0000","last_became_active":"2023-10-09T11:40:59.303065+0000","last_became_peered":"2023-10-09T11:40:59.303065+0000","last_unstale":"2023-10-09T11:40:59.305008+0000","last_undegraded":"2023-10-09T11:40:59.305008+0000","last_fullsized":"2023-10-09T11:40:59.305008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:25.211376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190504+0000","last_change":"2023-10-09T11:41:00.190798+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190504+0000","last_undegraded":"2023-10-09T11:41:00.190504+0000","last_fullsized":"2023-10-09T11:41:00.190504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.303449+0000","last_change":"2023-10-09T11:40:59.300828+0000","last_active":"2023-10-09T11:40:59.303449+0000","last_peered":"2023-10-09T11:40:59.303449+0000","last_clean":"2023-10-09T11:40:59.303449+0000","last_became_active":"2023-10-09T11:40:59.300609+0000","last_became_peered":"2023-10-09T11:40:59.300609+0000","last_unstale":"2023-10-09T11:40:59.303449+0000","last_undegraded":"2023-10-09T11:40:59.303449+0000","last_fullsized":"2023-10-09T11:40:59.303449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:36.893466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191323+0000","last_change":"2023-10-09T11:41:00.191446+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191323+0000","last_undegraded":"2023-10-09T11:41:00.191323+0000","last_fullsized":"2023-10-09T11:41:00.191323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307163+0000","last_change":"2023-10-09T11:40:59.305991+0000","last_active":"2023-10-09T11:40:59.307163+0000","last_peered":"2023-10-09T11:40:59.307163+0000","last_clean":"2023-10-09T11:40:59.307163+0000","last_became_active":"2023-10-09T11:40:59.305696+0000","last_became_peered":"2023-10-09T11:40:59.305696+0000","last_unstale":"2023-10-09T11:40:59.307163+0000","last_undegraded":"2023-10-09T11:40:59.307163+0000","last_fullsized":"2023-10-09T11:40:59.307163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:08.639887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190449+0000","last_change":"2023-10-09T11:41:00.190596+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190449+0000","last_undegraded":"2023-10-09T11:41:00.190449+0000","last_fullsized":"2023-10-09T11:41:00.190449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.306840+0000","last_change":"2023-10-09T11:40:59.304467+0000","last_active":"2023-10-09T11:40:59.306840+0000","last_peered":"2023-10-09T11:40:59.306840+0000","last_clean":"2023-10-09T11:40:59.306840+0000","last_became_active":"2023-10-09T11:40:59.304147+0000","last_became_peered":"2023-10-09T11:40:59.304147+0000","last_unstale":"2023-10-09T11:40:59.306840+0000","last_undegraded":"2023-10-09T11:40:59.306840+0000","last_fullsized":"2023-10-09T11:40:59.306840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:23.168219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203833+0000","last_change":"2023-10-09T11:41:00.198067+0000","last_active":"2023-10-09T11:41:00.203833+0000","last_peered":"2023-10-09T11:41:00.203833+0000","last_clean":"2023-10-09T11:41:00.203833+0000","last_became_active":"2023-10-09T11:41:00.197769+0000","last_became_peered":"2023-10-09T11:41:00.197769+0000","last_unstale":"2023-10-09T11:41:00.203833+0000","last_undegraded":"2023-10-09T11:41:00.203833+0000","last_fullsized":"2023-10-09T11:41:00.203833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:42.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309472+0000","last_change":"2023-10-09T11:40:59.305531+0000","last_active":"2023-10-09T11:40:59.309472+0000","last_peered":"2023-10-09T11:40:59.309472+0000","last_clean":"2023-10-09T11:40:59.309472+0000","last_became_active":"2023-10-09T11:40:59.305268+0000","last_became_peered":"2023-10-09T11:40:59.305268+0000","last_unstale":"2023-10-09T11:40:59.309472+0000","last_undegraded":"2023-10-09T11:40:59.309472+0000","last_fullsized":"2023-10-09T11:40:59.309472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.165900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196125+0000","last_change":"2023-10-09T11:41:00.196506+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196125+0000","last_undegraded":"2023-10-09T11:41:00.196125+0000","last_fullsized":"2023-10-09T11:41:00.196125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"87'2","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298838+0000","last_change":"2023-10-09T11:40:59.304065+0000","last_active":"2023-10-09T11:41:00.298838+0000","last_peered":"2023-10-09T11:41:00.298838+0000","last_clean":"2023-10-09T11:41:00.298838+0000","last_became_active":"2023-10-09T11:40:59.303714+0000","last_became_peered":"2023-10-09T11:40:59.303714+0000","last_unstale":"2023-10-09T11:41:00.298838+0000","last_undegraded":"2023-10-09T11:41:00.298838+0000","last_fullsized":"2023-10-09T11:41:00.298838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191742+0000","last_change":"2023-10-09T11:41:00.191851+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191742+0000","last_undegraded":"2023-10-09T11:41:00.191742+0000","last_fullsized":"2023-10-09T11:41:00.191742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312534+0000","last_change":"2023-10-09T11:40:59.311346+0000","last_active":"2023-10-09T11:40:59.312534+0000","last_peered":"2023-10-09T11:40:59.312534+0000","last_clean":"2023-10-09T11:40:59.312534+0000","last_became_active":"2023-10-09T11:40:59.311075+0000","last_became_peered":"2023-10-09T11:40:59.311075+0000","last_unstale":"2023-10-09T11:40:59.312534+0000","last_undegraded":"2023-10-09T11:40:59.312534+0000","last_fullsized":"2023-10-09T11:40:59.312534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193641+0000","last_change":"2023-10-09T11:41:00.193782+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193641+0000","last_undegraded":"2023-10-09T11:41:00.193641+0000","last_fullsized":"2023-10-09T11:41:00.193641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.304229+0000","last_change":"2023-10-09T11:40:59.303219+0000","last_active":"2023-10-09T11:40:59.304229+0000","last_peered":"2023-10-09T11:40:59.304229+0000","last_clean":"2023-10-09T11:40:59.304229+0000","last_became_active":"2023-10-09T11:40:59.302933+0000","last_became_peered":"2023-10-09T11:40:59.302933+0000","last_unstale":"2023-10-09T11:40:59.304229+0000","last_undegraded":"2023-10-09T11:40:59.304229+0000","last_fullsized":"2023-10-09T11:40:59.304229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:27.987978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205722+0000","last_change":"2023-10-09T11:41:00.200343+0000","last_active":"2023-10-09T11:41:00.205722+0000","last_peered":"2023-10-09T11:41:00.205722+0000","last_clean":"2023-10-09T11:41:00.205722+0000","last_became_active":"2023-10-09T11:41:00.200104+0000","last_became_peered":"2023-10-09T11:41:00.200104+0000","last_unstale":"2023-10-09T11:41:00.205722+0000","last_undegraded":"2023-10-09T11:41:00.205722+0000","last_fullsized":"2023-10-09T11:41:00.205722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:41.980263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190960+0000","last_change":"2023-10-09T11:40:59.307643+0000","last_active":"2023-10-09T11:41:00.190960+0000","last_peered":"2023-10-09T11:41:00.190960+0000","last_clean":"2023-10-09T11:41:00.190960+0000","last_became_active":"2023-10-09T11:40:59.307289+0000","last_became_peered":"2023-10-09T11:40:59.307289+0000","last_unstale":"2023-10-09T11:41:00.190960+0000","last_undegraded":"2023-10-09T11:41:00.190960+0000","last_fullsized":"2023-10-09T11:41:00.190960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:08.218968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190155+0000","last_change":"2023-10-09T11:41:00.190283+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190155+0000","last_undegraded":"2023-10-09T11:41:00.190155+0000","last_fullsized":"2023-10-09T11:41:00.190155+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307364+0000","last_change":"2023-10-09T11:40:59.304273+0000","last_active":"2023-10-09T11:40:59.307364+0000","last_peered":"2023-10-09T11:40:59.307364+0000","last_clean":"2023-10-09T11:40:59.307364+0000","last_became_active":"2023-10-09T11:40:59.303919+0000","last_became_peered":"2023-10-09T11:40:59.303919+0000","last_unstale":"2023-10-09T11:40:59.307364+0000","last_undegraded":"2023-10-09T11:40:59.307364+0000","last_fullsized":"2023-10-09T11:40:59.307364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:48.013168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211595+0000","last_change":"2023-10-09T11:41:00.207662+0000","last_active":"2023-10-09T11:41:00.211595+0000","last_peered":"2023-10-09T11:41:00.211595+0000","last_clean":"2023-10-09T11:41:00.211595+0000","last_became_active":"2023-10-09T11:41:00.207086+0000","last_became_peered":"2023-10-09T11:41:00.207086+0000","last_unstale":"2023-10-09T11:41:00.211595+0000","last_undegraded":"2023-10-09T11:41:00.211595+0000","last_fullsized":"2023-10-09T11:41:00.211595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:06.889859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191114+0000","last_change":"2023-10-09T11:40:59.306512+0000","last_active":"2023-10-09T11:41:00.191114+0000","last_peered":"2023-10-09T11:41:00.191114+0000","last_clean":"2023-10-09T11:41:00.191114+0000","last_became_active":"2023-10-09T11:40:59.306149+0000","last_became_peered":"2023-10-09T11:40:59.306149+0000","last_unstale":"2023-10-09T11:41:00.191114+0000","last_undegraded":"2023-10-09T11:41:00.191114+0000","last_fullsized":"2023-10-09T11:41:00.191114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190529+0000","last_change":"2023-10-09T11:41:00.190657+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190529+0000","last_undegraded":"2023-10-09T11:41:00.190529+0000","last_fullsized":"2023-10-09T11:41:00.190529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311913+0000","last_change":"2023-10-09T11:40:59.308119+0000","last_active":"2023-10-09T11:40:59.311913+0000","last_peered":"2023-10-09T11:40:59.311913+0000","last_clean":"2023-10-09T11:40:59.311913+0000","last_became_active":"2023-10-09T11:40:59.307789+0000","last_became_peered":"2023-10-09T11:40:59.307789+0000","last_unstale":"2023-10-09T11:40:59.311913+0000","last_undegraded":"2023-10-09T11:40:59.311913+0000","last_fullsized":"2023-10-09T11:40:59.311913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200239+0000","last_change":"2023-10-09T11:41:00.191564+0000","last_active":"2023-10-09T11:41:00.200239+0000","last_peered":"2023-10-09T11:41:00.200239+0000","last_clean":"2023-10-09T11:41:00.200239+0000","last_became_active":"2023-10-09T11:41:00.191263+0000","last_became_peered":"2023-10-09T11:41:00.191263+0000","last_unstale":"2023-10-09T11:41:00.200239+0000","last_undegraded":"2023-10-09T11:41:00.200239+0000","last_fullsized":"2023-10-09T11:41:00.200239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310874+0000","last_change":"2023-10-09T11:40:59.307057+0000","last_active":"2023-10-09T11:40:59.310874+0000","last_peered":"2023-10-09T11:40:59.310874+0000","last_clean":"2023-10-09T11:40:59.310874+0000","last_became_active":"2023-10-09T11:40:59.306788+0000","last_became_peered":"2023-10-09T11:40:59.306788+0000","last_unstale":"2023-10-09T11:40:59.310874+0000","last_undegraded":"2023-10-09T11:40:59.310874+0000","last_fullsized":"2023-10-09T11:40:59.310874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:55.363742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191889+0000","last_change":"2023-10-09T11:41:00.192023+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191889+0000","last_undegraded":"2023-10-09T11:41:00.191889+0000","last_fullsized":"2023-10-09T11:41:00.191889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192437+0000","last_change":"2023-10-09T11:40:59.305040+0000","last_active":"2023-10-09T11:41:00.192437+0000","last_peered":"2023-10-09T11:41:00.192437+0000","last_clean":"2023-10-09T11:41:00.192437+0000","last_became_active":"2023-10-09T11:40:59.304676+0000","last_became_peered":"2023-10-09T11:40:59.304676+0000","last_unstale":"2023-10-09T11:41:00.192437+0000","last_undegraded":"2023-10-09T11:41:00.192437+0000","last_fullsized":"2023-10-09T11:41:00.192437+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:36.911436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.293513+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:59.293513+0000","last_peered":"2023-10-09T11:40:59.293513+0000","last_clean":"2023-10-09T11:40:59.293513+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:59.293513+0000","last_undegraded":"2023-10-09T11:40:59.293513+0000","last_fullsized":"2023-10-09T11:40:59.293513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":1675264,"data_stored":1051802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":461946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.33800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.35399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.219}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.248},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1654784,"data_stored":1044927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.377},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.75}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.95199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.57799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":462982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.378},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.432}]}]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:04.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.555+0000 7f3638bc9700 1 Processor -- start 2023-10-09T11:41:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.555+0000 7f3638bc9700 1 -- start start 2023-10-09T11:41:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3638bc9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36340a90d0 0x7f363406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3638bc9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3638bc9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340aeee0 con 0x7f36340a8d00 2023-10-09T11:41:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3638bc9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363406e820 con 0x7f36340a90d0 2023-10-09T11:41:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3638bc9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340ae680 con 0x7f363406e380 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3631d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36340a90d0 0x7f363406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f363259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f36340a8d00 0x7f36340cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52514/0 (socket says 172.21.15.26:52514) 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f363259c700 1 -- 172.21.15.26:0/3478153721 learned_addr learned my addr 172.21.15.26:0/3478153721 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.556+0000 7f3632d9d700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3631d9b700 1 -- 172.21.15.26:0/3478153721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 msgr2=0x7f36340af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3631d9b700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3631d9b700 1 -- 172.21.15.26:0/3478153721 >> v1:172.21.15.26:6789/0 conn(0x7f36340a8d00 legacy=0x7f36340cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3631d9b700 1 -- 172.21.15.26:0/3478153721 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340cf490 con 0x7f36340a90d0 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f363159a700 1 -- 172.21.15.26:0/3478153721 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948216015 0 0) 0x7f36340aeee0 con 0x7f36340a8d00 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3631d9b700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f363406de40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f361c0098d0 tx=0x7f361c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ebd8ec882f051b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f363159a700 1 -- 172.21.15.26:0/3478153721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c005c10 con 0x7f36340a90d0 2023-10-09T11:41:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f363159a700 1 -- 172.21.15.26:0/3478153721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c005d70 con 0x7f36340a90d0 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f363159a700 1 -- 172.21.15.26:0/3478153721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c006280 con 0x7f36340a90d0 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3638bc9700 1 -- 172.21.15.26:0/3478153721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 msgr2=0x7f363406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.557+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f363406de40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f361c0098d0 tx=0x7f361c009120 comp rx=0 tx=0).stop 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 -- 172.21.15.26:0/3478153721 shutdown_connections 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3478153721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f363406de40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 -- 172.21.15.26:0/3478153721 >> 172.21.15.26:0/3478153721 conn(0x7f363406ce80 msgr2=0x7f36340ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 -- 172.21.15.26:0/3478153721 shutdown_connections 2023-10-09T11:41:04.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.558+0000 7f3638bc9700 1 -- 172.21.15.26:0/3478153721 wait complete. 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.559+0000 7f3638bc9700 1 Processor -- start 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.559+0000 7f3638bc9700 1 -- start start 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.559+0000 7f3638bc9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36340a8d00 0x7f363415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363415b670 con 0x7f36340a90d0 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363415a790 con 0x7f36340a8d00 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363415aa60 con 0x7f363406e380 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48280/0 (socket says 172.21.15.26:48280) 2023-10-09T11:41:04.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 -- 172.21.15.26:0/3577662391 learned_addr learned my addr 172.21.15.26:0/3577662391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f363259c700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3631d9b700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36340a8d00 0x7f363415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 -- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 msgr2=0x7f36340b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 -- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36340a8d00 msgr2=0x7f363415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36340a8d00 0x7f363415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 -- 172.21.15.26:0/3577662391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0093c0 con 0x7f36340a90d0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3632d9d700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f362c00e8d0 tx=0x7f362c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00ee70 con 0x7f36340a90d0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00c850 con 0x7f36340a90d0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363415ad40 con 0x7f36340a90d0 2023-10-09T11:41:04.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00cc50 con 0x7f36340a90d0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.560+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363415b300 con 0x7f36340a90d0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.561+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363404c3c0 con 0x7f36340a90d0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.562+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f362c013680 con 0x7f36340a90d0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.562+0000 7f362a7fc700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 0x7f36140696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.562+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f362c084b70 con 0x7f36340a90d0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.562+0000 7f363259c700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 0x7f36140696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.563+0000 7f363259c700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 0x7f36140696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.566+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f362c051a90 con 0x7f36340a90d0 2023-10-09T11:41:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.755+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f363415b7b0 con 0x7f3614067200 2023-10-09T11:41:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.764+0000 7f362a7fc700 1 -- 172.21.15.26:0/3577662391 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287989 (secure 0 0 0) 0x7f363415b7b0 con 0x7f3614067200 2023-10-09T11:41:04.768 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 msgr2=0x7f36140696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 0x7f36140696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624009040 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 msgr2=0x7f3634144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f362c00e8d0 tx=0x7f362c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 shutdown_connections 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36340a90d0 0x7f3634144a40 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3614067200 0x7f36140696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f363406e380 0x7f36340b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 --2- 172.21.15.26:0/3577662391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36340a8d00 0x7f363415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 >> 172.21.15.26:0/3577662391 conn(0x7f363406ce80 msgr2=0x7f36340b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 shutdown_connections 2023-10-09T11:41:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.767+0000 7f3638bc9700 1 -- 172.21.15.26:0/3577662391 wait complete. 2023-10-09T11:41:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:04.780 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2023-10-09T11:41:03.188258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408320,"kb_used_data":9536,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566400,"statfs":{"total":773094113280,"available":770627993600,"internally_reserved":0,"allocated":9764864,"data_stored":4846726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904471"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192056+0000","last_change":"2023-10-09T11:41:00.192174+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192056+0000","last_undegraded":"2023-10-09T11:41:00.192056+0000","last_fullsized":"2023-10-09T11:41:00.192056+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196279+0000","last_change":"2023-10-09T11:41:00.196435+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196279+0000","last_undegraded":"2023-10-09T11:41:00.196279+0000","last_fullsized":"2023-10-09T11:41:00.196279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191209+0000","last_change":"2023-10-09T11:41:00.191346+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191209+0000","last_undegraded":"2023-10-09T11:41:00.191209+0000","last_fullsized":"2023-10-09T11:41:00.191209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187559+0000","last_change":"2023-10-09T11:41:00.187689+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187559+0000","last_undegraded":"2023-10-09T11:41:00.187559+0000","last_fullsized":"2023-10-09T11:41:00.187559+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200751+0000","last_change":"2023-10-09T11:41:00.195607+0000","last_active":"2023-10-09T11:41:00.200751+0000","last_peered":"2023-10-09T11:41:00.200751+0000","last_clean":"2023-10-09T11:41:00.200751+0000","last_became_active":"2023-10-09T11:41:00.195342+0000","last_became_peered":"2023-10-09T11:41:00.195342+0000","last_unstale":"2023-10-09T11:41:00.200751+0000","last_undegraded":"2023-10-09T11:41:00.200751+0000","last_fullsized":"2023-10-09T11:41:00.200751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199290+0000","last_change":"2023-10-09T11:41:00.199290+0000","last_active":"2023-10-09T11:41:00.199290+0000","last_peered":"2023-10-09T11:41:00.199290+0000","last_clean":"2023-10-09T11:41:00.199290+0000","last_became_active":"2023-10-09T11:41:00.199006+0000","last_became_peered":"2023-10-09T11:41:00.199006+0000","last_unstale":"2023-10-09T11:41:00.199290+0000","last_undegraded":"2023-10-09T11:41:00.199290+0000","last_fullsized":"2023-10-09T11:41:00.199290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:37.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.197074+0000","last_change":"2023-10-09T11:41:00.197074+0000","last_active":"2023-10-09T11:41:00.197074+0000","last_peered":"2023-10-09T11:41:00.197074+0000","last_clean":"2023-10-09T11:41:00.197074+0000","last_became_active":"2023-10-09T11:41:00.196781+0000","last_became_peered":"2023-10-09T11:41:00.196781+0000","last_unstale":"2023-10-09T11:41:00.197074+0000","last_undegraded":"2023-10-09T11:41:00.197074+0000","last_fullsized":"2023-10-09T11:41:00.197074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:05.170649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199097+0000","last_change":"2023-10-09T11:41:00.199173+0000","last_active":"2023-10-09T11:41:00.199097+0000","last_peered":"2023-10-09T11:41:00.199097+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.196113+0000","last_became_peered":"2023-10-09T11:41:00.196113+0000","last_unstale":"2023-10-09T11:41:00.199097+0000","last_undegraded":"2023-10-09T11:41:00.199097+0000","last_fullsized":"2023-10-09T11:41:00.199097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211312+0000","last_change":"2023-10-09T11:41:00.204730+0000","last_active":"2023-10-09T11:41:00.211312+0000","last_peered":"2023-10-09T11:41:00.211312+0000","last_clean":"2023-10-09T11:41:00.211312+0000","last_became_active":"2023-10-09T11:41:00.204428+0000","last_became_peered":"2023-10-09T11:41:00.204428+0000","last_unstale":"2023-10-09T11:41:00.211312+0000","last_undegraded":"2023-10-09T11:41:00.211312+0000","last_fullsized":"2023-10-09T11:41:00.211312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203902+0000","last_change":"2023-10-09T11:41:00.198185+0000","last_active":"2023-10-09T11:41:00.203902+0000","last_peered":"2023-10-09T11:41:00.203902+0000","last_clean":"2023-10-09T11:41:00.203902+0000","last_became_active":"2023-10-09T11:41:00.197877+0000","last_became_peered":"2023-10-09T11:41:00.197877+0000","last_unstale":"2023-10-09T11:41:00.203902+0000","last_undegraded":"2023-10-09T11:41:00.203902+0000","last_fullsized":"2023-10-09T11:41:00.203902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:20.433153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205889+0000","last_change":"2023-10-09T11:41:00.205889+0000","last_active":"2023-10-09T11:41:00.205889+0000","last_peered":"2023-10-09T11:41:00.205889+0000","last_clean":"2023-10-09T11:41:00.205889+0000","last_became_active":"2023-10-09T11:41:00.205596+0000","last_became_peered":"2023-10-09T11:41:00.205596+0000","last_unstale":"2023-10-09T11:41:00.205889+0000","last_undegraded":"2023-10-09T11:41:00.205889+0000","last_fullsized":"2023-10-09T11:41:00.205889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203639+0000","last_change":"2023-10-09T11:41:00.202214+0000","last_active":"2023-10-09T11:41:00.203639+0000","last_peered":"2023-10-09T11:41:00.203639+0000","last_clean":"2023-10-09T11:41:00.203639+0000","last_became_active":"2023-10-09T11:41:00.201923+0000","last_became_peered":"2023-10-09T11:41:00.201923+0000","last_unstale":"2023-10-09T11:41:00.203639+0000","last_undegraded":"2023-10-09T11:41:00.203639+0000","last_fullsized":"2023-10-09T11:41:00.203639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187145+0000","last_change":"2023-10-09T11:41:00.187599+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187145+0000","last_undegraded":"2023-10-09T11:41:00.187145+0000","last_fullsized":"2023-10-09T11:41:00.187145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190990+0000","last_change":"2023-10-09T11:41:00.191111+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190990+0000","last_undegraded":"2023-10-09T11:41:00.190990+0000","last_fullsized":"2023-10-09T11:41:00.190990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187222+0000","last_change":"2023-10-09T11:41:00.187373+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187222+0000","last_undegraded":"2023-10-09T11:41:00.187222+0000","last_fullsized":"2023-10-09T11:41:00.187222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204159+0000","last_change":"2023-10-09T11:41:00.204159+0000","last_active":"2023-10-09T11:41:00.204159+0000","last_peered":"2023-10-09T11:41:00.204159+0000","last_clean":"2023-10-09T11:41:00.204159+0000","last_became_active":"2023-10-09T11:41:00.203128+0000","last_became_peered":"2023-10-09T11:41:00.203128+0000","last_unstale":"2023-10-09T11:41:00.204159+0000","last_undegraded":"2023-10-09T11:41:00.204159+0000","last_fullsized":"2023-10-09T11:41:00.204159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:13.177318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190268+0000","last_change":"2023-10-09T11:41:00.190411+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190268+0000","last_undegraded":"2023-10-09T11:41:00.190268+0000","last_fullsized":"2023-10-09T11:41:00.190268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187098+0000","last_change":"2023-10-09T11:41:00.187265+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187098+0000","last_undegraded":"2023-10-09T11:41:00.187098+0000","last_fullsized":"2023-10-09T11:41:00.187098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191321+0000","last_change":"2023-10-09T11:41:00.192903+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191321+0000","last_undegraded":"2023-10-09T11:41:00.191321+0000","last_fullsized":"2023-10-09T11:41:00.191321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211342+0000","last_change":"2023-10-09T11:41:00.205012+0000","last_active":"2023-10-09T11:41:00.211342+0000","last_peered":"2023-10-09T11:41:00.211342+0000","last_clean":"2023-10-09T11:41:00.211342+0000","last_became_active":"2023-10-09T11:41:00.204745+0000","last_became_peered":"2023-10-09T11:41:00.204745+0000","last_unstale":"2023-10-09T11:41:00.211342+0000","last_undegraded":"2023-10-09T11:41:00.211342+0000","last_fullsized":"2023-10-09T11:41:00.211342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190948+0000","last_change":"2023-10-09T11:41:00.191089+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190948+0000","last_undegraded":"2023-10-09T11:41:00.190948+0000","last_fullsized":"2023-10-09T11:41:00.190948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199788+0000","last_change":"2023-10-09T11:41:00.199862+0000","last_active":"2023-10-09T11:41:00.199788+0000","last_peered":"2023-10-09T11:41:00.199788+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199592+0000","last_became_peered":"2023-10-09T11:41:00.199592+0000","last_unstale":"2023-10-09T11:41:00.199788+0000","last_undegraded":"2023-10-09T11:41:00.199788+0000","last_fullsized":"2023-10-09T11:41:00.199788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198789+0000","last_change":"2023-10-09T11:41:00.198858+0000","last_active":"2023-10-09T11:41:00.198789+0000","last_peered":"2023-10-09T11:41:00.198789+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.198619+0000","last_became_peered":"2023-10-09T11:41:00.198619+0000","last_unstale":"2023-10-09T11:41:00.198789+0000","last_undegraded":"2023-10-09T11:41:00.198789+0000","last_fullsized":"2023-10-09T11:41:00.198789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200562+0000","last_change":"2023-10-09T11:41:00.200562+0000","last_active":"2023-10-09T11:41:00.200562+0000","last_peered":"2023-10-09T11:41:00.200562+0000","last_clean":"2023-10-09T11:41:00.200562+0000","last_became_active":"2023-10-09T11:41:00.199082+0000","last_became_peered":"2023-10-09T11:41:00.199082+0000","last_unstale":"2023-10-09T11:41:00.200562+0000","last_undegraded":"2023-10-09T11:41:00.200562+0000","last_fullsized":"2023-10-09T11:41:00.200562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203884+0000","last_change":"2023-10-09T11:41:00.197274+0000","last_active":"2023-10-09T11:41:00.203884+0000","last_peered":"2023-10-09T11:41:00.203884+0000","last_clean":"2023-10-09T11:41:00.203884+0000","last_became_active":"2023-10-09T11:41:00.197002+0000","last_became_peered":"2023-10-09T11:41:00.197002+0000","last_unstale":"2023-10-09T11:41:00.203884+0000","last_undegraded":"2023-10-09T11:41:00.203884+0000","last_fullsized":"2023-10-09T11:41:00.203884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191520+0000","last_change":"2023-10-09T11:41:00.191644+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191520+0000","last_undegraded":"2023-10-09T11:41:00.191520+0000","last_fullsized":"2023-10-09T11:41:00.191520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198845+0000","last_change":"2023-10-09T11:41:00.198845+0000","last_active":"2023-10-09T11:41:00.198845+0000","last_peered":"2023-10-09T11:41:00.198845+0000","last_clean":"2023-10-09T11:41:00.198845+0000","last_became_active":"2023-10-09T11:41:00.198566+0000","last_became_peered":"2023-10-09T11:41:00.198566+0000","last_unstale":"2023-10-09T11:41:00.198845+0000","last_undegraded":"2023-10-09T11:41:00.198845+0000","last_fullsized":"2023-10-09T11:41:00.198845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205095+0000","last_change":"2023-10-09T11:41:00.200060+0000","last_active":"2023-10-09T11:41:00.205095+0000","last_peered":"2023-10-09T11:41:00.205095+0000","last_clean":"2023-10-09T11:41:00.205095+0000","last_became_active":"2023-10-09T11:41:00.199755+0000","last_became_peered":"2023-10-09T11:41:00.199755+0000","last_unstale":"2023-10-09T11:41:00.205095+0000","last_undegraded":"2023-10-09T11:41:00.205095+0000","last_fullsized":"2023-10-09T11:41:00.205095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:12.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":5,"reported_epoch":87,"state":"active","last_fresh":"2023-10-09T11:41:00.199898+0000","last_change":"2023-10-09T11:41:00.199898+0000","last_active":"2023-10-09T11:41:00.199898+0000","last_peered":"2023-10-09T11:41:00.199898+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199898+0000","last_became_peered":"2023-10-09T11:41:00.199898+0000","last_unstale":"2023-10-09T11:41:00.199898+0000","last_undegraded":"2023-10-09T11:41:00.199898+0000","last_fullsized":"2023-10-09T11:41:00.199898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191317+0000","last_change":"2023-10-09T11:41:00.191451+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191317+0000","last_undegraded":"2023-10-09T11:41:00.191317+0000","last_fullsized":"2023-10-09T11:41:00.191317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187036+0000","last_change":"2023-10-09T11:41:00.187136+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187036+0000","last_undegraded":"2023-10-09T11:41:00.187036+0000","last_fullsized":"2023-10-09T11:41:00.187036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193811+0000","last_change":"2023-10-09T11:41:00.193927+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193811+0000","last_undegraded":"2023-10-09T11:41:00.193811+0000","last_fullsized":"2023-10-09T11:41:00.193811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192212+0000","last_change":"2023-10-09T11:41:00.192335+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192212+0000","last_undegraded":"2023-10-09T11:41:00.192212+0000","last_fullsized":"2023-10-09T11:41:00.192212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309601+0000","last_change":"2023-10-09T11:40:59.308487+0000","last_active":"2023-10-09T11:40:59.309601+0000","last_peered":"2023-10-09T11:40:59.309601+0000","last_clean":"2023-10-09T11:40:59.309601+0000","last_became_active":"2023-10-09T11:40:59.308214+0000","last_became_peered":"2023-10-09T11:40:59.308214+0000","last_unstale":"2023-10-09T11:40:59.309601+0000","last_undegraded":"2023-10-09T11:40:59.309601+0000","last_fullsized":"2023-10-09T11:40:59.309601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:40.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187352+0000","last_change":"2023-10-09T11:41:00.187486+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187352+0000","last_undegraded":"2023-10-09T11:41:00.187352+0000","last_fullsized":"2023-10-09T11:41:00.187352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192344+0000","last_change":"2023-10-09T11:40:59.305539+0000","last_active":"2023-10-09T11:41:00.192344+0000","last_peered":"2023-10-09T11:41:00.192344+0000","last_clean":"2023-10-09T11:41:00.192344+0000","last_became_active":"2023-10-09T11:40:59.305219+0000","last_became_peered":"2023-10-09T11:40:59.305219+0000","last_unstale":"2023-10-09T11:41:00.192344+0000","last_undegraded":"2023-10-09T11:41:00.192344+0000","last_fullsized":"2023-10-09T11:41:00.192344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:14.227138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192577+0000","last_change":"2023-10-09T11:41:00.192711+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192577+0000","last_undegraded":"2023-10-09T11:41:00.192577+0000","last_fullsized":"2023-10-09T11:41:00.192577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312474+0000","last_change":"2023-10-09T11:40:59.311238+0000","last_active":"2023-10-09T11:40:59.312474+0000","last_peered":"2023-10-09T11:40:59.312474+0000","last_clean":"2023-10-09T11:40:59.312474+0000","last_became_active":"2023-10-09T11:40:59.310971+0000","last_became_peered":"2023-10-09T11:40:59.310971+0000","last_unstale":"2023-10-09T11:40:59.312474+0000","last_undegraded":"2023-10-09T11:40:59.312474+0000","last_fullsized":"2023-10-09T11:40:59.312474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211291+0000","last_change":"2023-10-09T11:41:00.203295+0000","last_active":"2023-10-09T11:41:00.211291+0000","last_peered":"2023-10-09T11:41:00.211291+0000","last_clean":"2023-10-09T11:41:00.211291+0000","last_became_active":"2023-10-09T11:41:00.202916+0000","last_became_peered":"2023-10-09T11:41:00.202916+0000","last_unstale":"2023-10-09T11:41:00.211291+0000","last_undegraded":"2023-10-09T11:41:00.211291+0000","last_fullsized":"2023-10-09T11:41:00.211291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309259+0000","last_change":"2023-10-09T11:40:59.304921+0000","last_active":"2023-10-09T11:40:59.309259+0000","last_peered":"2023-10-09T11:40:59.309259+0000","last_clean":"2023-10-09T11:40:59.309259+0000","last_became_active":"2023-10-09T11:40:59.304647+0000","last_became_peered":"2023-10-09T11:40:59.304647+0000","last_unstale":"2023-10-09T11:40:59.309259+0000","last_undegraded":"2023-10-09T11:40:59.309259+0000","last_fullsized":"2023-10-09T11:40:59.309259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:32.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204348+0000","last_change":"2023-10-09T11:41:00.204348+0000","last_active":"2023-10-09T11:41:00.204348+0000","last_peered":"2023-10-09T11:41:00.204348+0000","last_clean":"2023-10-09T11:41:00.204348+0000","last_became_active":"2023-10-09T11:41:00.204062+0000","last_became_peered":"2023-10-09T11:41:00.204062+0000","last_unstale":"2023-10-09T11:41:00.204348+0000","last_undegraded":"2023-10-09T11:41:00.204348+0000","last_fullsized":"2023-10-09T11:41:00.204348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:38.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310869+0000","last_change":"2023-10-09T11:40:59.309418+0000","last_active":"2023-10-09T11:40:59.310869+0000","last_peered":"2023-10-09T11:40:59.310869+0000","last_clean":"2023-10-09T11:40:59.310869+0000","last_became_active":"2023-10-09T11:40:59.309124+0000","last_became_peered":"2023-10-09T11:40:59.309124+0000","last_unstale":"2023-10-09T11:40:59.310869+0000","last_undegraded":"2023-10-09T11:40:59.310869+0000","last_fullsized":"2023-10-09T11:40:59.310869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:02.793137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201293+0000","last_change":"2023-10-09T11:41:00.201293+0000","last_active":"2023-10-09T11:41:00.201293+0000","last_peered":"2023-10-09T11:41:00.201293+0000","last_clean":"2023-10-09T11:41:00.201293+0000","last_became_active":"2023-10-09T11:41:00.201006+0000","last_became_peered":"2023-10-09T11:41:00.201006+0000","last_unstale":"2023-10-09T11:41:00.201293+0000","last_undegraded":"2023-10-09T11:41:00.201293+0000","last_fullsized":"2023-10-09T11:41:00.201293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:01.783061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309879+0000","last_change":"2023-10-09T11:40:59.309157+0000","last_active":"2023-10-09T11:40:59.309879+0000","last_peered":"2023-10-09T11:40:59.309879+0000","last_clean":"2023-10-09T11:40:59.309879+0000","last_became_active":"2023-10-09T11:40:59.308897+0000","last_became_peered":"2023-10-09T11:40:59.308897+0000","last_unstale":"2023-10-09T11:40:59.309879+0000","last_undegraded":"2023-10-09T11:40:59.309879+0000","last_fullsized":"2023-10-09T11:40:59.309879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.172569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.186949+0000","last_change":"2023-10-09T11:41:00.187132+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.186949+0000","last_undegraded":"2023-10-09T11:41:00.186949+0000","last_fullsized":"2023-10-09T11:41:00.186949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190616+0000","last_change":"2023-10-09T11:40:59.306629+0000","last_active":"2023-10-09T11:41:00.190616+0000","last_peered":"2023-10-09T11:41:00.190616+0000","last_clean":"2023-10-09T11:41:00.190616+0000","last_became_active":"2023-10-09T11:40:59.306323+0000","last_became_peered":"2023-10-09T11:40:59.306323+0000","last_unstale":"2023-10-09T11:41:00.190616+0000","last_undegraded":"2023-10-09T11:41:00.190616+0000","last_fullsized":"2023-10-09T11:41:00.190616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203696+0000","last_change":"2023-10-09T11:41:00.201888+0000","last_active":"2023-10-09T11:41:00.203696+0000","last_peered":"2023-10-09T11:41:00.203696+0000","last_clean":"2023-10-09T11:41:00.203696+0000","last_became_active":"2023-10-09T11:41:00.201618+0000","last_became_peered":"2023-10-09T11:41:00.201618+0000","last_unstale":"2023-10-09T11:41:00.203696+0000","last_undegraded":"2023-10-09T11:41:00.203696+0000","last_fullsized":"2023-10-09T11:41:00.203696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:39.216602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310944+0000","last_change":"2023-10-09T11:40:59.307929+0000","last_active":"2023-10-09T11:40:59.310944+0000","last_peered":"2023-10-09T11:40:59.310944+0000","last_clean":"2023-10-09T11:40:59.310944+0000","last_became_active":"2023-10-09T11:40:59.307659+0000","last_became_peered":"2023-10-09T11:40:59.307659+0000","last_unstale":"2023-10-09T11:40:59.310944+0000","last_undegraded":"2023-10-09T11:40:59.310944+0000","last_fullsized":"2023-10-09T11:40:59.310944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:03.479960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191856+0000","last_change":"2023-10-09T11:41:00.191985+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191856+0000","last_undegraded":"2023-10-09T11:41:00.191856+0000","last_fullsized":"2023-10-09T11:41:00.191856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310815+0000","last_change":"2023-10-09T11:40:59.304810+0000","last_active":"2023-10-09T11:40:59.310815+0000","last_peered":"2023-10-09T11:40:59.310815+0000","last_clean":"2023-10-09T11:40:59.310815+0000","last_became_active":"2023-10-09T11:40:59.304549+0000","last_became_peered":"2023-10-09T11:40:59.304549+0000","last_unstale":"2023-10-09T11:40:59.310815+0000","last_undegraded":"2023-10-09T11:40:59.310815+0000","last_fullsized":"2023-10-09T11:40:59.310815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:08.412199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211386+0000","last_change":"2023-10-09T11:41:00.205378+0000","last_active":"2023-10-09T11:41:00.211386+0000","last_peered":"2023-10-09T11:41:00.211386+0000","last_clean":"2023-10-09T11:41:00.211386+0000","last_became_active":"2023-10-09T11:41:00.205077+0000","last_became_peered":"2023-10-09T11:41:00.205077+0000","last_unstale":"2023-10-09T11:41:00.211386+0000","last_undegraded":"2023-10-09T11:41:00.211386+0000","last_fullsized":"2023-10-09T11:41:00.211386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.308122+0000","last_change":"2023-10-09T11:40:59.305950+0000","last_active":"2023-10-09T11:40:59.308122+0000","last_peered":"2023-10-09T11:40:59.308122+0000","last_clean":"2023-10-09T11:40:59.308122+0000","last_became_active":"2023-10-09T11:40:59.305644+0000","last_became_peered":"2023-10-09T11:40:59.305644+0000","last_unstale":"2023-10-09T11:40:59.308122+0000","last_undegraded":"2023-10-09T11:40:59.308122+0000","last_fullsized":"2023-10-09T11:40:59.308122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211202+0000","last_change":"2023-10-09T11:41:00.208244+0000","last_active":"2023-10-09T11:41:00.211202+0000","last_peered":"2023-10-09T11:41:00.211202+0000","last_clean":"2023-10-09T11:41:00.211202+0000","last_became_active":"2023-10-09T11:41:00.207912+0000","last_became_peered":"2023-10-09T11:41:00.207912+0000","last_unstale":"2023-10-09T11:41:00.211202+0000","last_undegraded":"2023-10-09T11:41:00.211202+0000","last_fullsized":"2023-10-09T11:41:00.211202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"87'3","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304694+0000","last_change":"2023-10-09T11:40:59.303316+0000","last_active":"2023-10-09T11:41:00.304694+0000","last_peered":"2023-10-09T11:41:00.304694+0000","last_clean":"2023-10-09T11:41:00.304694+0000","last_became_active":"2023-10-09T11:40:59.302954+0000","last_became_peered":"2023-10-09T11:40:59.302954+0000","last_unstale":"2023-10-09T11:41:00.304694+0000","last_undegraded":"2023-10-09T11:41:00.304694+0000","last_fullsized":"2023-10-09T11:41:00.304694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:07.142190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208470+0000","last_change":"2023-10-09T11:41:00.208470+0000","last_active":"2023-10-09T11:41:00.208470+0000","last_peered":"2023-10-09T11:41:00.208470+0000","last_clean":"2023-10-09T11:41:00.208470+0000","last_became_active":"2023-10-09T11:41:00.208213+0000","last_became_peered":"2023-10-09T11:41:00.208213+0000","last_unstale":"2023-10-09T11:41:00.208470+0000","last_undegraded":"2023-10-09T11:41:00.208470+0000","last_fullsized":"2023-10-09T11:41:00.208470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"87'6","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.307024+0000","last_change":"2023-10-09T11:40:59.307720+0000","last_active":"2023-10-09T11:41:00.307024+0000","last_peered":"2023-10-09T11:41:00.307024+0000","last_clean":"2023-10-09T11:41:00.307024+0000","last_became_active":"2023-10-09T11:40:59.307437+0000","last_became_peered":"2023-10-09T11:40:59.307437+0000","last_unstale":"2023-10-09T11:41:00.307024+0000","last_undegraded":"2023-10-09T11:41:00.307024+0000","last_fullsized":"2023-10-09T11:41:00.307024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:02.662263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187212+0000","last_change":"2023-10-09T11:41:00.187377+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187212+0000","last_undegraded":"2023-10-09T11:41:00.187212+0000","last_fullsized":"2023-10-09T11:41:00.187212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311366+0000","last_change":"2023-10-09T11:40:59.306793+0000","last_active":"2023-10-09T11:40:59.311366+0000","last_peered":"2023-10-09T11:40:59.311366+0000","last_clean":"2023-10-09T11:40:59.311366+0000","last_became_active":"2023-10-09T11:40:59.306510+0000","last_became_peered":"2023-10-09T11:40:59.306510+0000","last_unstale":"2023-10-09T11:40:59.311366+0000","last_undegraded":"2023-10-09T11:40:59.311366+0000","last_fullsized":"2023-10-09T11:40:59.311366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:37.705035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192936+0000","last_change":"2023-10-09T11:41:00.193063+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192936+0000","last_undegraded":"2023-10-09T11:41:00.192936+0000","last_fullsized":"2023-10-09T11:41:00.192936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312451+0000","last_change":"2023-10-09T11:40:59.309374+0000","last_active":"2023-10-09T11:40:59.312451+0000","last_peered":"2023-10-09T11:40:59.312451+0000","last_clean":"2023-10-09T11:40:59.312451+0000","last_became_active":"2023-10-09T11:40:59.309083+0000","last_became_peered":"2023-10-09T11:40:59.309083+0000","last_unstale":"2023-10-09T11:40:59.312451+0000","last_undegraded":"2023-10-09T11:40:59.312451+0000","last_fullsized":"2023-10-09T11:40:59.312451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:58.469619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204138+0000","last_change":"2023-10-09T11:41:00.201482+0000","last_active":"2023-10-09T11:41:00.204138+0000","last_peered":"2023-10-09T11:41:00.204138+0000","last_clean":"2023-10-09T11:41:00.204138+0000","last_became_active":"2023-10-09T11:41:00.201208+0000","last_became_peered":"2023-10-09T11:41:00.201208+0000","last_unstale":"2023-10-09T11:41:00.204138+0000","last_undegraded":"2023-10-09T11:41:00.204138+0000","last_fullsized":"2023-10-09T11:41:00.204138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200308+0000","last_change":"2023-10-09T11:40:59.307781+0000","last_active":"2023-10-09T11:41:00.200308+0000","last_peered":"2023-10-09T11:41:00.200308+0000","last_clean":"2023-10-09T11:41:00.200308+0000","last_became_active":"2023-10-09T11:40:59.307502+0000","last_became_peered":"2023-10-09T11:40:59.307502+0000","last_unstale":"2023-10-09T11:41:00.200308+0000","last_undegraded":"2023-10-09T11:41:00.200308+0000","last_fullsized":"2023-10-09T11:41:00.200308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191151+0000","last_change":"2023-10-09T11:41:00.191281+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191151+0000","last_undegraded":"2023-10-09T11:41:00.191151+0000","last_fullsized":"2023-10-09T11:41:00.191151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312668+0000","last_change":"2023-10-09T11:40:59.311585+0000","last_active":"2023-10-09T11:40:59.312668+0000","last_peered":"2023-10-09T11:40:59.312668+0000","last_clean":"2023-10-09T11:40:59.312668+0000","last_became_active":"2023-10-09T11:40:59.310224+0000","last_became_peered":"2023-10-09T11:40:59.310224+0000","last_unstale":"2023-10-09T11:40:59.312668+0000","last_undegraded":"2023-10-09T11:40:59.312668+0000","last_fullsized":"2023-10-09T11:40:59.312668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:28.139612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206440+0000","last_change":"2023-10-09T11:41:00.205217+0000","last_active":"2023-10-09T11:41:00.206440+0000","last_peered":"2023-10-09T11:41:00.206440+0000","last_clean":"2023-10-09T11:41:00.206440+0000","last_became_active":"2023-10-09T11:41:00.204945+0000","last_became_peered":"2023-10-09T11:41:00.204945+0000","last_unstale":"2023-10-09T11:41:00.206440+0000","last_undegraded":"2023-10-09T11:41:00.206440+0000","last_fullsized":"2023-10-09T11:41:00.206440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304354+0000","last_change":"2023-10-09T11:40:59.311483+0000","last_active":"2023-10-09T11:41:00.304354+0000","last_peered":"2023-10-09T11:41:00.304354+0000","last_clean":"2023-10-09T11:41:00.304354+0000","last_became_active":"2023-10-09T11:40:59.311249+0000","last_became_peered":"2023-10-09T11:40:59.311249+0000","last_unstale":"2023-10-09T11:41:00.304354+0000","last_undegraded":"2023-10-09T11:41:00.304354+0000","last_fullsized":"2023-10-09T11:41:00.304354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202133+0000","last_change":"2023-10-09T11:41:00.202133+0000","last_active":"2023-10-09T11:41:00.202133+0000","last_peered":"2023-10-09T11:41:00.202133+0000","last_clean":"2023-10-09T11:41:00.202133+0000","last_became_active":"2023-10-09T11:41:00.201841+0000","last_became_peered":"2023-10-09T11:41:00.201841+0000","last_unstale":"2023-10-09T11:41:00.202133+0000","last_undegraded":"2023-10-09T11:41:00.202133+0000","last_fullsized":"2023-10-09T11:41:00.202133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:28.230567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305220+0000","last_change":"2023-10-09T11:40:59.307530+0000","last_active":"2023-10-09T11:41:00.305220+0000","last_peered":"2023-10-09T11:41:00.305220+0000","last_clean":"2023-10-09T11:41:00.305220+0000","last_became_active":"2023-10-09T11:40:59.307240+0000","last_became_peered":"2023-10-09T11:40:59.307240+0000","last_unstale":"2023-10-09T11:41:00.305220+0000","last_undegraded":"2023-10-09T11:41:00.305220+0000","last_fullsized":"2023-10-09T11:41:00.305220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205520+0000","last_change":"2023-10-09T11:41:00.205520+0000","last_active":"2023-10-09T11:41:00.205520+0000","last_peered":"2023-10-09T11:41:00.205520+0000","last_clean":"2023-10-09T11:41:00.205520+0000","last_became_active":"2023-10-09T11:41:00.205256+0000","last_became_peered":"2023-10-09T11:41:00.205256+0000","last_unstale":"2023-10-09T11:41:00.205520+0000","last_undegraded":"2023-10-09T11:41:00.205520+0000","last_fullsized":"2023-10-09T11:41:00.205520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:47.838489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.305008+0000","last_change":"2023-10-09T11:40:59.303336+0000","last_active":"2023-10-09T11:40:59.305008+0000","last_peered":"2023-10-09T11:40:59.305008+0000","last_clean":"2023-10-09T11:40:59.305008+0000","last_became_active":"2023-10-09T11:40:59.303065+0000","last_became_peered":"2023-10-09T11:40:59.303065+0000","last_unstale":"2023-10-09T11:40:59.305008+0000","last_undegraded":"2023-10-09T11:40:59.305008+0000","last_fullsized":"2023-10-09T11:40:59.305008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:25.211376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190504+0000","last_change":"2023-10-09T11:41:00.190798+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190504+0000","last_undegraded":"2023-10-09T11:41:00.190504+0000","last_fullsized":"2023-10-09T11:41:00.190504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.303449+0000","last_change":"2023-10-09T11:40:59.300828+0000","last_active":"2023-10-09T11:40:59.303449+0000","last_peered":"2023-10-09T11:40:59.303449+0000","last_clean":"2023-10-09T11:40:59.303449+0000","last_became_active":"2023-10-09T11:40:59.300609+0000","last_became_peered":"2023-10-09T11:40:59.300609+0000","last_unstale":"2023-10-09T11:40:59.303449+0000","last_undegraded":"2023-10-09T11:40:59.303449+0000","last_fullsized":"2023-10-09T11:40:59.303449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:36.893466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191323+0000","last_change":"2023-10-09T11:41:00.191446+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191323+0000","last_undegraded":"2023-10-09T11:41:00.191323+0000","last_fullsized":"2023-10-09T11:41:00.191323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307163+0000","last_change":"2023-10-09T11:40:59.305991+0000","last_active":"2023-10-09T11:40:59.307163+0000","last_peered":"2023-10-09T11:40:59.307163+0000","last_clean":"2023-10-09T11:40:59.307163+0000","last_became_active":"2023-10-09T11:40:59.305696+0000","last_became_peered":"2023-10-09T11:40:59.305696+0000","last_unstale":"2023-10-09T11:40:59.307163+0000","last_undegraded":"2023-10-09T11:40:59.307163+0000","last_fullsized":"2023-10-09T11:40:59.307163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:08.639887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190449+0000","last_change":"2023-10-09T11:41:00.190596+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190449+0000","last_undegraded":"2023-10-09T11:41:00.190449+0000","last_fullsized":"2023-10-09T11:41:00.190449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.306840+0000","last_change":"2023-10-09T11:40:59.304467+0000","last_active":"2023-10-09T11:40:59.306840+0000","last_peered":"2023-10-09T11:40:59.306840+0000","last_clean":"2023-10-09T11:40:59.306840+0000","last_became_active":"2023-10-09T11:40:59.304147+0000","last_became_peered":"2023-10-09T11:40:59.304147+0000","last_unstale":"2023-10-09T11:40:59.306840+0000","last_undegraded":"2023-10-09T11:40:59.306840+0000","last_fullsized":"2023-10-09T11:40:59.306840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:23.168219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203833+0000","last_change":"2023-10-09T11:41:00.198067+0000","last_active":"2023-10-09T11:41:00.203833+0000","last_peered":"2023-10-09T11:41:00.203833+0000","last_clean":"2023-10-09T11:41:00.203833+0000","last_became_active":"2023-10-09T11:41:00.197769+0000","last_became_peered":"2023-10-09T11:41:00.197769+0000","last_unstale":"2023-10-09T11:41:00.203833+0000","last_undegraded":"2023-10-09T11:41:00.203833+0000","last_fullsized":"2023-10-09T11:41:00.203833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:42.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309472+0000","last_change":"2023-10-09T11:40:59.305531+0000","last_active":"2023-10-09T11:40:59.309472+0000","last_peered":"2023-10-09T11:40:59.309472+0000","last_clean":"2023-10-09T11:40:59.309472+0000","last_became_active":"2023-10-09T11:40:59.305268+0000","last_became_peered":"2023-10-09T11:40:59.305268+0000","last_unstale":"2023-10-09T11:40:59.309472+0000","last_undegraded":"2023-10-09T11:40:59.309472+0000","last_fullsized":"2023-10-09T11:40:59.309472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.165900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196125+0000","last_change":"2023-10-09T11:41:00.196506+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196125+0000","last_undegraded":"2023-10-09T11:41:00.196125+0000","last_fullsized":"2023-10-09T11:41:00.196125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"87'2","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298838+0000","last_change":"2023-10-09T11:40:59.304065+0000","last_active":"2023-10-09T11:41:00.298838+0000","last_peered":"2023-10-09T11:41:00.298838+0000","last_clean":"2023-10-09T11:41:00.298838+0000","last_became_active":"2023-10-09T11:40:59.303714+0000","last_became_peered":"2023-10-09T11:40:59.303714+0000","last_unstale":"2023-10-09T11:41:00.298838+0000","last_undegraded":"2023-10-09T11:41:00.298838+0000","last_fullsized":"2023-10-09T11:41:00.298838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191742+0000","last_change":"2023-10-09T11:41:00.191851+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191742+0000","last_undegraded":"2023-10-09T11:41:00.191742+0000","last_fullsized":"2023-10-09T11:41:00.191742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312534+0000","last_change":"2023-10-09T11:40:59.311346+0000","last_active":"2023-10-09T11:40:59.312534+0000","last_peered":"2023-10-09T11:40:59.312534+0000","last_clean":"2023-10-09T11:40:59.312534+0000","last_became_active":"2023-10-09T11:40:59.311075+0000","last_became_peered":"2023-10-09T11:40:59.311075+0000","last_unstale":"2023-10-09T11:40:59.312534+0000","last_undegraded":"2023-10-09T11:40:59.312534+0000","last_fullsized":"2023-10-09T11:40:59.312534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193641+0000","last_change":"2023-10-09T11:41:00.193782+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193641+0000","last_undegraded":"2023-10-09T11:41:00.193641+0000","last_fullsized":"2023-10-09T11:41:00.193641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.304229+0000","last_change":"2023-10-09T11:40:59.303219+0000","last_active":"2023-10-09T11:40:59.304229+0000","last_peered":"2023-10-09T11:40:59.304229+0000","last_clean":"2023-10-09T11:40:59.304229+0000","last_became_active":"2023-10-09T11:40:59.302933+0000","last_became_peered":"2023-10-09T11:40:59.302933+0000","last_unstale":"2023-10-09T11:40:59.304229+0000","last_undegraded":"2023-10-09T11:40:59.304229+0000","last_fullsized":"2023-10-09T11:40:59.304229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:27.987978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205722+0000","last_change":"2023-10-09T11:41:00.200343+0000","last_active":"2023-10-09T11:41:00.205722+0000","last_peered":"2023-10-09T11:41:00.205722+0000","last_clean":"2023-10-09T11:41:00.205722+0000","last_became_active":"2023-10-09T11:41:00.200104+0000","last_became_peered":"2023-10-09T11:41:00.200104+0000","last_unstale":"2023-10-09T11:41:00.205722+0000","last_undegraded":"2023-10-09T11:41:00.205722+0000","last_fullsized":"2023-10-09T11:41:00.205722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:41.980263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190960+0000","last_change":"2023-10-09T11:40:59.307643+0000","last_active":"2023-10-09T11:41:00.190960+0000","last_peered":"2023-10-09T11:41:00.190960+0000","last_clean":"2023-10-09T11:41:00.190960+0000","last_became_active":"2023-10-09T11:40:59.307289+0000","last_became_peered":"2023-10-09T11:40:59.307289+0000","last_unstale":"2023-10-09T11:41:00.190960+0000","last_undegraded":"2023-10-09T11:41:00.190960+0000","last_fullsized":"2023-10-09T11:41:00.190960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:08.218968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190155+0000","last_change":"2023-10-09T11:41:00.190283+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190155+0000","last_undegraded":"2023-10-09T11:41:00.190155+0000","last_fullsized":"2023-10-09T11:41:00.190155+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307364+0000","last_change":"2023-10-09T11:40:59.304273+0000","last_active":"2023-10-09T11:40:59.307364+0000","last_peered":"2023-10-09T11:40:59.307364+0000","last_clean":"2023-10-09T11:40:59.307364+0000","last_became_active":"2023-10-09T11:40:59.303919+0000","last_became_peered":"2023-10-09T11:40:59.303919+0000","last_unstale":"2023-10-09T11:40:59.307364+0000","last_undegraded":"2023-10-09T11:40:59.307364+0000","last_fullsized":"2023-10-09T11:40:59.307364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:48.013168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211595+0000","last_change":"2023-10-09T11:41:00.207662+0000","last_active":"2023-10-09T11:41:00.211595+0000","last_peered":"2023-10-09T11:41:00.211595+0000","last_clean":"2023-10-09T11:41:00.211595+0000","last_became_active":"2023-10-09T11:41:00.207086+0000","last_became_peered":"2023-10-09T11:41:00.207086+0000","last_unstale":"2023-10-09T11:41:00.211595+0000","last_undegraded":"2023-10-09T11:41:00.211595+0000","last_fullsized":"2023-10-09T11:41:00.211595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:06.889859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191114+0000","last_change":"2023-10-09T11:40:59.306512+0000","last_active":"2023-10-09T11:41:00.191114+0000","last_peered":"2023-10-09T11:41:00.191114+0000","last_clean":"2023-10-09T11:41:00.191114+0000","last_became_active":"2023-10-09T11:40:59.306149+0000","last_became_peered":"2023-10-09T11:40:59.306149+0000","last_unstale":"2023-10-09T11:41:00.191114+0000","last_undegraded":"2023-10-09T11:41:00.191114+0000","last_fullsized":"2023-10-09T11:41:00.191114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190529+0000","last_change":"2023-10-09T11:41:00.190657+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190529+0000","last_undegraded":"2023-10-09T11:41:00.190529+0000","last_fullsized":"2023-10-09T11:41:00.190529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311913+0000","last_change":"2023-10-09T11:40:59.308119+0000","last_active":"2023-10-09T11:40:59.311913+0000","last_peered":"2023-10-09T11:40:59.311913+0000","last_clean":"2023-10-09T11:40:59.311913+0000","last_became_active":"2023-10-09T11:40:59.307789+0000","last_became_peered":"2023-10-09T11:40:59.307789+0000","last_unstale":"2023-10-09T11:40:59.311913+0000","last_undegraded":"2023-10-09T11:40:59.311913+0000","last_fullsized":"2023-10-09T11:40:59.311913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200239+0000","last_change":"2023-10-09T11:41:00.191564+0000","last_active":"2023-10-09T11:41:00.200239+0000","last_peered":"2023-10-09T11:41:00.200239+0000","last_clean":"2023-10-09T11:41:00.200239+0000","last_became_active":"2023-10-09T11:41:00.191263+0000","last_became_peered":"2023-10-09T11:41:00.191263+0000","last_unstale":"2023-10-09T11:41:00.200239+0000","last_undegraded":"2023-10-09T11:41:00.200239+0000","last_fullsized":"2023-10-09T11:41:00.200239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310874+0000","last_change":"2023-10-09T11:40:59.307057+0000","last_active":"2023-10-09T11:40:59.310874+0000","last_peered":"2023-10-09T11:40:59.310874+0000","last_clean":"2023-10-09T11:40:59.310874+0000","last_became_active":"2023-10-09T11:40:59.306788+0000","last_became_peered":"2023-10-09T11:40:59.306788+0000","last_unstale":"2023-10-09T11:40:59.310874+0000","last_undegraded":"2023-10-09T11:40:59.310874+0000","last_fullsized":"2023-10-09T11:40:59.310874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:55.363742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191889+0000","last_change":"2023-10-09T11:41:00.192023+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191889+0000","last_undegraded":"2023-10-09T11:41:00.191889+0000","last_fullsized":"2023-10-09T11:41:00.191889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192437+0000","last_change":"2023-10-09T11:40:59.305040+0000","last_active":"2023-10-09T11:41:00.192437+0000","last_peered":"2023-10-09T11:41:00.192437+0000","last_clean":"2023-10-09T11:41:00.192437+0000","last_became_active":"2023-10-09T11:40:59.304676+0000","last_became_peered":"2023-10-09T11:40:59.304676+0000","last_unstale":"2023-10-09T11:41:00.192437+0000","last_undegraded":"2023-10-09T11:41:00.192437+0000","last_fullsized":"2023-10-09T11:41:00.192437+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:36.911436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.293513+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:59.293513+0000","last_peered":"2023-10-09T11:40:59.293513+0000","last_clean":"2023-10-09T11:40:59.293513+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:59.293513+0000","last_undegraded":"2023-10-09T11:40:59.293513+0000","last_fullsized":"2023-10-09T11:40:59.293513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":1675264,"data_stored":1051802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":461946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.33800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.35399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.219}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.248},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1654784,"data_stored":1044927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.377},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.75}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.95199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.57799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":462982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.378},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.432}]}]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:04.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.938+0000 7f6edf7f2700 1 Processor -- start 2023-10-09T11:41:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 -- start start 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed806e7f0 con 0x7f6ed806e380 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80ae680 con 0x7f6ed80a90d0 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.939+0000 7f6edf7f2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80aeee0 con 0x7f6ed80a8d00 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edcd8d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:46140/0 (socket says 172.21.15.26:46140) 2023-10-09T11:41:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 -- 172.21.15.26:0/3240494994 learned_addr learned my addr 172.21.15.26:0/3240494994 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edcd8d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:59362/0 (socket says 172.21.15.26:59362) 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6eddd8f700 1 --1- 172.21.15.26:0/3240494994 >> v1:172.21.15.67:6789/0 conn(0x7f6ed806e380 0x7f6ed80cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51778/0 (socket says 172.21.15.26:51778) 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 -- 172.21.15.26:0/3240494994 >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 msgr2=0x7f6ed806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 --2- 172.21.15.26:0/3240494994 >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 -- 172.21.15.26:0/3240494994 >> v1:172.21.15.67:6789/0 conn(0x7f6ed806e380 legacy=0x7f6ed80cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 -- 172.21.15.26:0/3240494994 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80cf490 con 0x7f6ed80a8d00 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edcd8d700 1 --2- 172.21.15.26:0/3240494994 >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.940+0000 7f6edd58e700 1 --2- 172.21.15.26:0/3240494994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009990 tx=0x7f6ed0009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e51b7e194cbed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6ed7fff700 1 -- 172.21.15.26:0/3240494994 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0009e80 con 0x7f6ed80a8d00 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6ed7fff700 1 -- 172.21.15.26:0/3240494994 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0005c10 con 0x7f6ed80a8d00 2023-10-09T11:41:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6ed7fff700 1 -- 172.21.15.26:0/3240494994 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000b650 con 0x7f6ed80a8d00 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3240494994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 msgr2=0x7f6ed80cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3240494994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009990 tx=0x7f6ed0009220 comp rx=0 tx=0).stop 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3240494994 shutdown_connections 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3240494994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed80a8d00 0x7f6ed80cddf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3240494994 >> v2:172.21.15.67:3300/0 conn(0x7f6ed80a90d0 0x7f6ed806de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3240494994 >> 172.21.15.26:0/3240494994 conn(0x7f6ed806ce80 msgr2=0x7f6ed80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3240494994 shutdown_connections 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.941+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3240494994 wait complete. 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.942+0000 7f6edf7f2700 1 Processor -- start 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.942+0000 7f6edf7f2700 1 -- start start 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ed80a8d00 0x7f6ed80c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ed80a90d0 0x7f6ed815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8151180 con 0x7f6ed80a8d00 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed809bcd0 con 0x7f6ed80a90d0 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edf7f2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed809b0c0 con 0x7f6ed806e380 2023-10-09T11:41:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edd58e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edcd8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ed80a8d00 0x7f6ed80c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edd58e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:46152/0 (socket says 172.21.15.26:46152) 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6edd58e700 1 -- 172.21.15.26:0/3604943080 learned_addr learned my addr 172.21.15.26:0/3604943080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.943+0000 7f6eddd8f700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ed80a90d0 0x7f6ed815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 -- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ed80a90d0 msgr2=0x7f6ed815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ed80a90d0 0x7f6ed815caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 -- 172.21.15.26:0/3604943080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ed80a8d00 msgr2=0x7f6ed80c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ed80a8d00 0x7f6ed80c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 -- 172.21.15.26:0/3604943080 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0093c0 con 0x7f6ed806e380 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edd58e700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000b3c0 tx=0x7f6ed0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011b90 con 0x7f6ed806e380 2023-10-09T11:41:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0011cf0 con 0x7f6ed806e380 2023-10-09T11:41:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed0009480 con 0x7f6ed806e380 2023-10-09T11:41:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed001b640 con 0x7f6ed806e380 2023-10-09T11:41:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.944+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed809b680 con 0x7f6ed806e380 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.945+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed804c3c0 con 0x7f6ed806e380 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.946+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6ed001ba70 con 0x7f6ed806e380 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.946+0000 7f6ed57fa700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 0x7f6ec40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.946+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ed0086280 con 0x7f6ed806e380 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.946+0000 7f6edcd8d700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 0x7f6ec40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.947+0000 7f6edcd8d700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 0x7f6ec40696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ed816d110 tx=0x7f6ecc009120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:04.951+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ed00531a0 con 0x7f6ed806e380 2023-10-09T11:41:05.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.139+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ed809be10 con 0x7f6ec4067200 2023-10-09T11:41:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.148+0000 7f6ed57fa700 1 -- 172.21.15.26:0/3604943080 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287989 (secure 0 0 0) 0x7f6ecc011a20 con 0x7f6ec4067200 2023-10-09T11:41:05.155 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 msgr2=0x7f6ec40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 0x7f6ec40696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ed816d110 tx=0x7f6ecc009120 comp rx=0 tx=0).stop 2023-10-09T11:41:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 msgr2=0x7f6ed809a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000b3c0 tx=0x7f6ed0016000 comp rx=0 tx=0).stop 2023-10-09T11:41:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 shutdown_connections 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ed80a90d0 0x7f6ed815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ec4067200 0x7f6ec40696b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ed806e380 0x7f6ed809a9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 --2- 172.21.15.26:0/3604943080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ed80a8d00 0x7f6ed80c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 >> 172.21.15.26:0/3604943080 conn(0x7f6ed806ce80 msgr2=0x7f6ed80ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.151+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 shutdown_connections 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.152+0000 7f6edf7f2700 1 -- 172.21.15.26:0/3604943080 wait complete. 2023-10-09T11:41:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:05.165 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2023-10-09T11:41:03.188258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408320,"kb_used_data":9536,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566400,"statfs":{"total":773094113280,"available":770627993600,"internally_reserved":0,"allocated":9764864,"data_stored":4846726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904471"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192056+0000","last_change":"2023-10-09T11:41:00.192174+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192056+0000","last_undegraded":"2023-10-09T11:41:00.192056+0000","last_fullsized":"2023-10-09T11:41:00.192056+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196279+0000","last_change":"2023-10-09T11:41:00.196435+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196279+0000","last_undegraded":"2023-10-09T11:41:00.196279+0000","last_fullsized":"2023-10-09T11:41:00.196279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191209+0000","last_change":"2023-10-09T11:41:00.191346+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191209+0000","last_undegraded":"2023-10-09T11:41:00.191209+0000","last_fullsized":"2023-10-09T11:41:00.191209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187559+0000","last_change":"2023-10-09T11:41:00.187689+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187559+0000","last_undegraded":"2023-10-09T11:41:00.187559+0000","last_fullsized":"2023-10-09T11:41:00.187559+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200751+0000","last_change":"2023-10-09T11:41:00.195607+0000","last_active":"2023-10-09T11:41:00.200751+0000","last_peered":"2023-10-09T11:41:00.200751+0000","last_clean":"2023-10-09T11:41:00.200751+0000","last_became_active":"2023-10-09T11:41:00.195342+0000","last_became_peered":"2023-10-09T11:41:00.195342+0000","last_unstale":"2023-10-09T11:41:00.200751+0000","last_undegraded":"2023-10-09T11:41:00.200751+0000","last_fullsized":"2023-10-09T11:41:00.200751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199290+0000","last_change":"2023-10-09T11:41:00.199290+0000","last_active":"2023-10-09T11:41:00.199290+0000","last_peered":"2023-10-09T11:41:00.199290+0000","last_clean":"2023-10-09T11:41:00.199290+0000","last_became_active":"2023-10-09T11:41:00.199006+0000","last_became_peered":"2023-10-09T11:41:00.199006+0000","last_unstale":"2023-10-09T11:41:00.199290+0000","last_undegraded":"2023-10-09T11:41:00.199290+0000","last_fullsized":"2023-10-09T11:41:00.199290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:37.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.197074+0000","last_change":"2023-10-09T11:41:00.197074+0000","last_active":"2023-10-09T11:41:00.197074+0000","last_peered":"2023-10-09T11:41:00.197074+0000","last_clean":"2023-10-09T11:41:00.197074+0000","last_became_active":"2023-10-09T11:41:00.196781+0000","last_became_peered":"2023-10-09T11:41:00.196781+0000","last_unstale":"2023-10-09T11:41:00.197074+0000","last_undegraded":"2023-10-09T11:41:00.197074+0000","last_fullsized":"2023-10-09T11:41:00.197074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:05.170649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199097+0000","last_change":"2023-10-09T11:41:00.199173+0000","last_active":"2023-10-09T11:41:00.199097+0000","last_peered":"2023-10-09T11:41:00.199097+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.196113+0000","last_became_peered":"2023-10-09T11:41:00.196113+0000","last_unstale":"2023-10-09T11:41:00.199097+0000","last_undegraded":"2023-10-09T11:41:00.199097+0000","last_fullsized":"2023-10-09T11:41:00.199097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211312+0000","last_change":"2023-10-09T11:41:00.204730+0000","last_active":"2023-10-09T11:41:00.211312+0000","last_peered":"2023-10-09T11:41:00.211312+0000","last_clean":"2023-10-09T11:41:00.211312+0000","last_became_active":"2023-10-09T11:41:00.204428+0000","last_became_peered":"2023-10-09T11:41:00.204428+0000","last_unstale":"2023-10-09T11:41:00.211312+0000","last_undegraded":"2023-10-09T11:41:00.211312+0000","last_fullsized":"2023-10-09T11:41:00.211312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203902+0000","last_change":"2023-10-09T11:41:00.198185+0000","last_active":"2023-10-09T11:41:00.203902+0000","last_peered":"2023-10-09T11:41:00.203902+0000","last_clean":"2023-10-09T11:41:00.203902+0000","last_became_active":"2023-10-09T11:41:00.197877+0000","last_became_peered":"2023-10-09T11:41:00.197877+0000","last_unstale":"2023-10-09T11:41:00.203902+0000","last_undegraded":"2023-10-09T11:41:00.203902+0000","last_fullsized":"2023-10-09T11:41:00.203902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:20.433153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205889+0000","last_change":"2023-10-09T11:41:00.205889+0000","last_active":"2023-10-09T11:41:00.205889+0000","last_peered":"2023-10-09T11:41:00.205889+0000","last_clean":"2023-10-09T11:41:00.205889+0000","last_became_active":"2023-10-09T11:41:00.205596+0000","last_became_peered":"2023-10-09T11:41:00.205596+0000","last_unstale":"2023-10-09T11:41:00.205889+0000","last_undegraded":"2023-10-09T11:41:00.205889+0000","last_fullsized":"2023-10-09T11:41:00.205889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203639+0000","last_change":"2023-10-09T11:41:00.202214+0000","last_active":"2023-10-09T11:41:00.203639+0000","last_peered":"2023-10-09T11:41:00.203639+0000","last_clean":"2023-10-09T11:41:00.203639+0000","last_became_active":"2023-10-09T11:41:00.201923+0000","last_became_peered":"2023-10-09T11:41:00.201923+0000","last_unstale":"2023-10-09T11:41:00.203639+0000","last_undegraded":"2023-10-09T11:41:00.203639+0000","last_fullsized":"2023-10-09T11:41:00.203639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187145+0000","last_change":"2023-10-09T11:41:00.187599+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187145+0000","last_undegraded":"2023-10-09T11:41:00.187145+0000","last_fullsized":"2023-10-09T11:41:00.187145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190990+0000","last_change":"2023-10-09T11:41:00.191111+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190990+0000","last_undegraded":"2023-10-09T11:41:00.190990+0000","last_fullsized":"2023-10-09T11:41:00.190990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187222+0000","last_change":"2023-10-09T11:41:00.187373+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187222+0000","last_undegraded":"2023-10-09T11:41:00.187222+0000","last_fullsized":"2023-10-09T11:41:00.187222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204159+0000","last_change":"2023-10-09T11:41:00.204159+0000","last_active":"2023-10-09T11:41:00.204159+0000","last_peered":"2023-10-09T11:41:00.204159+0000","last_clean":"2023-10-09T11:41:00.204159+0000","last_became_active":"2023-10-09T11:41:00.203128+0000","last_became_peered":"2023-10-09T11:41:00.203128+0000","last_unstale":"2023-10-09T11:41:00.204159+0000","last_undegraded":"2023-10-09T11:41:00.204159+0000","last_fullsized":"2023-10-09T11:41:00.204159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:13.177318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190268+0000","last_change":"2023-10-09T11:41:00.190411+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190268+0000","last_undegraded":"2023-10-09T11:41:00.190268+0000","last_fullsized":"2023-10-09T11:41:00.190268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187098+0000","last_change":"2023-10-09T11:41:00.187265+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187098+0000","last_undegraded":"2023-10-09T11:41:00.187098+0000","last_fullsized":"2023-10-09T11:41:00.187098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191321+0000","last_change":"2023-10-09T11:41:00.192903+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191321+0000","last_undegraded":"2023-10-09T11:41:00.191321+0000","last_fullsized":"2023-10-09T11:41:00.191321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211342+0000","last_change":"2023-10-09T11:41:00.205012+0000","last_active":"2023-10-09T11:41:00.211342+0000","last_peered":"2023-10-09T11:41:00.211342+0000","last_clean":"2023-10-09T11:41:00.211342+0000","last_became_active":"2023-10-09T11:41:00.204745+0000","last_became_peered":"2023-10-09T11:41:00.204745+0000","last_unstale":"2023-10-09T11:41:00.211342+0000","last_undegraded":"2023-10-09T11:41:00.211342+0000","last_fullsized":"2023-10-09T11:41:00.211342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190948+0000","last_change":"2023-10-09T11:41:00.191089+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190948+0000","last_undegraded":"2023-10-09T11:41:00.190948+0000","last_fullsized":"2023-10-09T11:41:00.190948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199788+0000","last_change":"2023-10-09T11:41:00.199862+0000","last_active":"2023-10-09T11:41:00.199788+0000","last_peered":"2023-10-09T11:41:00.199788+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199592+0000","last_became_peered":"2023-10-09T11:41:00.199592+0000","last_unstale":"2023-10-09T11:41:00.199788+0000","last_undegraded":"2023-10-09T11:41:00.199788+0000","last_fullsized":"2023-10-09T11:41:00.199788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198789+0000","last_change":"2023-10-09T11:41:00.198858+0000","last_active":"2023-10-09T11:41:00.198789+0000","last_peered":"2023-10-09T11:41:00.198789+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.198619+0000","last_became_peered":"2023-10-09T11:41:00.198619+0000","last_unstale":"2023-10-09T11:41:00.198789+0000","last_undegraded":"2023-10-09T11:41:00.198789+0000","last_fullsized":"2023-10-09T11:41:00.198789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200562+0000","last_change":"2023-10-09T11:41:00.200562+0000","last_active":"2023-10-09T11:41:00.200562+0000","last_peered":"2023-10-09T11:41:00.200562+0000","last_clean":"2023-10-09T11:41:00.200562+0000","last_became_active":"2023-10-09T11:41:00.199082+0000","last_became_peered":"2023-10-09T11:41:00.199082+0000","last_unstale":"2023-10-09T11:41:00.200562+0000","last_undegraded":"2023-10-09T11:41:00.200562+0000","last_fullsized":"2023-10-09T11:41:00.200562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203884+0000","last_change":"2023-10-09T11:41:00.197274+0000","last_active":"2023-10-09T11:41:00.203884+0000","last_peered":"2023-10-09T11:41:00.203884+0000","last_clean":"2023-10-09T11:41:00.203884+0000","last_became_active":"2023-10-09T11:41:00.197002+0000","last_became_peered":"2023-10-09T11:41:00.197002+0000","last_unstale":"2023-10-09T11:41:00.203884+0000","last_undegraded":"2023-10-09T11:41:00.203884+0000","last_fullsized":"2023-10-09T11:41:00.203884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191520+0000","last_change":"2023-10-09T11:41:00.191644+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191520+0000","last_undegraded":"2023-10-09T11:41:00.191520+0000","last_fullsized":"2023-10-09T11:41:00.191520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198845+0000","last_change":"2023-10-09T11:41:00.198845+0000","last_active":"2023-10-09T11:41:00.198845+0000","last_peered":"2023-10-09T11:41:00.198845+0000","last_clean":"2023-10-09T11:41:00.198845+0000","last_became_active":"2023-10-09T11:41:00.198566+0000","last_became_peered":"2023-10-09T11:41:00.198566+0000","last_unstale":"2023-10-09T11:41:00.198845+0000","last_undegraded":"2023-10-09T11:41:00.198845+0000","last_fullsized":"2023-10-09T11:41:00.198845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205095+0000","last_change":"2023-10-09T11:41:00.200060+0000","last_active":"2023-10-09T11:41:00.205095+0000","last_peered":"2023-10-09T11:41:00.205095+0000","last_clean":"2023-10-09T11:41:00.205095+0000","last_became_active":"2023-10-09T11:41:00.199755+0000","last_became_peered":"2023-10-09T11:41:00.199755+0000","last_unstale":"2023-10-09T11:41:00.205095+0000","last_undegraded":"2023-10-09T11:41:00.205095+0000","last_fullsized":"2023-10-09T11:41:00.205095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:12.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":5,"reported_epoch":87,"state":"active","last_fresh":"2023-10-09T11:41:00.199898+0000","last_change":"2023-10-09T11:41:00.199898+0000","last_active":"2023-10-09T11:41:00.199898+0000","last_peered":"2023-10-09T11:41:00.199898+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199898+0000","last_became_peered":"2023-10-09T11:41:00.199898+0000","last_unstale":"2023-10-09T11:41:00.199898+0000","last_undegraded":"2023-10-09T11:41:00.199898+0000","last_fullsized":"2023-10-09T11:41:00.199898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191317+0000","last_change":"2023-10-09T11:41:00.191451+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191317+0000","last_undegraded":"2023-10-09T11:41:00.191317+0000","last_fullsized":"2023-10-09T11:41:00.191317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187036+0000","last_change":"2023-10-09T11:41:00.187136+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187036+0000","last_undegraded":"2023-10-09T11:41:00.187036+0000","last_fullsized":"2023-10-09T11:41:00.187036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193811+0000","last_change":"2023-10-09T11:41:00.193927+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193811+0000","last_undegraded":"2023-10-09T11:41:00.193811+0000","last_fullsized":"2023-10-09T11:41:00.193811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192212+0000","last_change":"2023-10-09T11:41:00.192335+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192212+0000","last_undegraded":"2023-10-09T11:41:00.192212+0000","last_fullsized":"2023-10-09T11:41:00.192212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309601+0000","last_change":"2023-10-09T11:40:59.308487+0000","last_active":"2023-10-09T11:40:59.309601+0000","last_peered":"2023-10-09T11:40:59.309601+0000","last_clean":"2023-10-09T11:40:59.309601+0000","last_became_active":"2023-10-09T11:40:59.308214+0000","last_became_peered":"2023-10-09T11:40:59.308214+0000","last_unstale":"2023-10-09T11:40:59.309601+0000","last_undegraded":"2023-10-09T11:40:59.309601+0000","last_fullsized":"2023-10-09T11:40:59.309601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:40.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187352+0000","last_change":"2023-10-09T11:41:00.187486+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187352+0000","last_undegraded":"2023-10-09T11:41:00.187352+0000","last_fullsized":"2023-10-09T11:41:00.187352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192344+0000","last_change":"2023-10-09T11:40:59.305539+0000","last_active":"2023-10-09T11:41:00.192344+0000","last_peered":"2023-10-09T11:41:00.192344+0000","last_clean":"2023-10-09T11:41:00.192344+0000","last_became_active":"2023-10-09T11:40:59.305219+0000","last_became_peered":"2023-10-09T11:40:59.305219+0000","last_unstale":"2023-10-09T11:41:00.192344+0000","last_undegraded":"2023-10-09T11:41:00.192344+0000","last_fullsized":"2023-10-09T11:41:00.192344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:14.227138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192577+0000","last_change":"2023-10-09T11:41:00.192711+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192577+0000","last_undegraded":"2023-10-09T11:41:00.192577+0000","last_fullsized":"2023-10-09T11:41:00.192577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312474+0000","last_change":"2023-10-09T11:40:59.311238+0000","last_active":"2023-10-09T11:40:59.312474+0000","last_peered":"2023-10-09T11:40:59.312474+0000","last_clean":"2023-10-09T11:40:59.312474+0000","last_became_active":"2023-10-09T11:40:59.310971+0000","last_became_peered":"2023-10-09T11:40:59.310971+0000","last_unstale":"2023-10-09T11:40:59.312474+0000","last_undegraded":"2023-10-09T11:40:59.312474+0000","last_fullsized":"2023-10-09T11:40:59.312474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211291+0000","last_change":"2023-10-09T11:41:00.203295+0000","last_active":"2023-10-09T11:41:00.211291+0000","last_peered":"2023-10-09T11:41:00.211291+0000","last_clean":"2023-10-09T11:41:00.211291+0000","last_became_active":"2023-10-09T11:41:00.202916+0000","last_became_peered":"2023-10-09T11:41:00.202916+0000","last_unstale":"2023-10-09T11:41:00.211291+0000","last_undegraded":"2023-10-09T11:41:00.211291+0000","last_fullsized":"2023-10-09T11:41:00.211291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309259+0000","last_change":"2023-10-09T11:40:59.304921+0000","last_active":"2023-10-09T11:40:59.309259+0000","last_peered":"2023-10-09T11:40:59.309259+0000","last_clean":"2023-10-09T11:40:59.309259+0000","last_became_active":"2023-10-09T11:40:59.304647+0000","last_became_peered":"2023-10-09T11:40:59.304647+0000","last_unstale":"2023-10-09T11:40:59.309259+0000","last_undegraded":"2023-10-09T11:40:59.309259+0000","last_fullsized":"2023-10-09T11:40:59.309259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:32.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204348+0000","last_change":"2023-10-09T11:41:00.204348+0000","last_active":"2023-10-09T11:41:00.204348+0000","last_peered":"2023-10-09T11:41:00.204348+0000","last_clean":"2023-10-09T11:41:00.204348+0000","last_became_active":"2023-10-09T11:41:00.204062+0000","last_became_peered":"2023-10-09T11:41:00.204062+0000","last_unstale":"2023-10-09T11:41:00.204348+0000","last_undegraded":"2023-10-09T11:41:00.204348+0000","last_fullsized":"2023-10-09T11:41:00.204348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:38.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310869+0000","last_change":"2023-10-09T11:40:59.309418+0000","last_active":"2023-10-09T11:40:59.310869+0000","last_peered":"2023-10-09T11:40:59.310869+0000","last_clean":"2023-10-09T11:40:59.310869+0000","last_became_active":"2023-10-09T11:40:59.309124+0000","last_became_peered":"2023-10-09T11:40:59.309124+0000","last_unstale":"2023-10-09T11:40:59.310869+0000","last_undegraded":"2023-10-09T11:40:59.310869+0000","last_fullsized":"2023-10-09T11:40:59.310869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:02.793137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201293+0000","last_change":"2023-10-09T11:41:00.201293+0000","last_active":"2023-10-09T11:41:00.201293+0000","last_peered":"2023-10-09T11:41:00.201293+0000","last_clean":"2023-10-09T11:41:00.201293+0000","last_became_active":"2023-10-09T11:41:00.201006+0000","last_became_peered":"2023-10-09T11:41:00.201006+0000","last_unstale":"2023-10-09T11:41:00.201293+0000","last_undegraded":"2023-10-09T11:41:00.201293+0000","last_fullsized":"2023-10-09T11:41:00.201293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:01.783061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309879+0000","last_change":"2023-10-09T11:40:59.309157+0000","last_active":"2023-10-09T11:40:59.309879+0000","last_peered":"2023-10-09T11:40:59.309879+0000","last_clean":"2023-10-09T11:40:59.309879+0000","last_became_active":"2023-10-09T11:40:59.308897+0000","last_became_peered":"2023-10-09T11:40:59.308897+0000","last_unstale":"2023-10-09T11:40:59.309879+0000","last_undegraded":"2023-10-09T11:40:59.309879+0000","last_fullsized":"2023-10-09T11:40:59.309879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.172569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.186949+0000","last_change":"2023-10-09T11:41:00.187132+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.186949+0000","last_undegraded":"2023-10-09T11:41:00.186949+0000","last_fullsized":"2023-10-09T11:41:00.186949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190616+0000","last_change":"2023-10-09T11:40:59.306629+0000","last_active":"2023-10-09T11:41:00.190616+0000","last_peered":"2023-10-09T11:41:00.190616+0000","last_clean":"2023-10-09T11:41:00.190616+0000","last_became_active":"2023-10-09T11:40:59.306323+0000","last_became_peered":"2023-10-09T11:40:59.306323+0000","last_unstale":"2023-10-09T11:41:00.190616+0000","last_undegraded":"2023-10-09T11:41:00.190616+0000","last_fullsized":"2023-10-09T11:41:00.190616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203696+0000","last_change":"2023-10-09T11:41:00.201888+0000","last_active":"2023-10-09T11:41:00.203696+0000","last_peered":"2023-10-09T11:41:00.203696+0000","last_clean":"2023-10-09T11:41:00.203696+0000","last_became_active":"2023-10-09T11:41:00.201618+0000","last_became_peered":"2023-10-09T11:41:00.201618+0000","last_unstale":"2023-10-09T11:41:00.203696+0000","last_undegraded":"2023-10-09T11:41:00.203696+0000","last_fullsized":"2023-10-09T11:41:00.203696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:39.216602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310944+0000","last_change":"2023-10-09T11:40:59.307929+0000","last_active":"2023-10-09T11:40:59.310944+0000","last_peered":"2023-10-09T11:40:59.310944+0000","last_clean":"2023-10-09T11:40:59.310944+0000","last_became_active":"2023-10-09T11:40:59.307659+0000","last_became_peered":"2023-10-09T11:40:59.307659+0000","last_unstale":"2023-10-09T11:40:59.310944+0000","last_undegraded":"2023-10-09T11:40:59.310944+0000","last_fullsized":"2023-10-09T11:40:59.310944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:03.479960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191856+0000","last_change":"2023-10-09T11:41:00.191985+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191856+0000","last_undegraded":"2023-10-09T11:41:00.191856+0000","last_fullsized":"2023-10-09T11:41:00.191856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310815+0000","last_change":"2023-10-09T11:40:59.304810+0000","last_active":"2023-10-09T11:40:59.310815+0000","last_peered":"2023-10-09T11:40:59.310815+0000","last_clean":"2023-10-09T11:40:59.310815+0000","last_became_active":"2023-10-09T11:40:59.304549+0000","last_became_peered":"2023-10-09T11:40:59.304549+0000","last_unstale":"2023-10-09T11:40:59.310815+0000","last_undegraded":"2023-10-09T11:40:59.310815+0000","last_fullsized":"2023-10-09T11:40:59.310815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:08.412199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211386+0000","last_change":"2023-10-09T11:41:00.205378+0000","last_active":"2023-10-09T11:41:00.211386+0000","last_peered":"2023-10-09T11:41:00.211386+0000","last_clean":"2023-10-09T11:41:00.211386+0000","last_became_active":"2023-10-09T11:41:00.205077+0000","last_became_peered":"2023-10-09T11:41:00.205077+0000","last_unstale":"2023-10-09T11:41:00.211386+0000","last_undegraded":"2023-10-09T11:41:00.211386+0000","last_fullsized":"2023-10-09T11:41:00.211386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.308122+0000","last_change":"2023-10-09T11:40:59.305950+0000","last_active":"2023-10-09T11:40:59.308122+0000","last_peered":"2023-10-09T11:40:59.308122+0000","last_clean":"2023-10-09T11:40:59.308122+0000","last_became_active":"2023-10-09T11:40:59.305644+0000","last_became_peered":"2023-10-09T11:40:59.305644+0000","last_unstale":"2023-10-09T11:40:59.308122+0000","last_undegraded":"2023-10-09T11:40:59.308122+0000","last_fullsized":"2023-10-09T11:40:59.308122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211202+0000","last_change":"2023-10-09T11:41:00.208244+0000","last_active":"2023-10-09T11:41:00.211202+0000","last_peered":"2023-10-09T11:41:00.211202+0000","last_clean":"2023-10-09T11:41:00.211202+0000","last_became_active":"2023-10-09T11:41:00.207912+0000","last_became_peered":"2023-10-09T11:41:00.207912+0000","last_unstale":"2023-10-09T11:41:00.211202+0000","last_undegraded":"2023-10-09T11:41:00.211202+0000","last_fullsized":"2023-10-09T11:41:00.211202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"87'3","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304694+0000","last_change":"2023-10-09T11:40:59.303316+0000","last_active":"2023-10-09T11:41:00.304694+0000","last_peered":"2023-10-09T11:41:00.304694+0000","last_clean":"2023-10-09T11:41:00.304694+0000","last_became_active":"2023-10-09T11:40:59.302954+0000","last_became_peered":"2023-10-09T11:40:59.302954+0000","last_unstale":"2023-10-09T11:41:00.304694+0000","last_undegraded":"2023-10-09T11:41:00.304694+0000","last_fullsized":"2023-10-09T11:41:00.304694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:07.142190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208470+0000","last_change":"2023-10-09T11:41:00.208470+0000","last_active":"2023-10-09T11:41:00.208470+0000","last_peered":"2023-10-09T11:41:00.208470+0000","last_clean":"2023-10-09T11:41:00.208470+0000","last_became_active":"2023-10-09T11:41:00.208213+0000","last_became_peered":"2023-10-09T11:41:00.208213+0000","last_unstale":"2023-10-09T11:41:00.208470+0000","last_undegraded":"2023-10-09T11:41:00.208470+0000","last_fullsized":"2023-10-09T11:41:00.208470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"87'6","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.307024+0000","last_change":"2023-10-09T11:40:59.307720+0000","last_active":"2023-10-09T11:41:00.307024+0000","last_peered":"2023-10-09T11:41:00.307024+0000","last_clean":"2023-10-09T11:41:00.307024+0000","last_became_active":"2023-10-09T11:40:59.307437+0000","last_became_peered":"2023-10-09T11:40:59.307437+0000","last_unstale":"2023-10-09T11:41:00.307024+0000","last_undegraded":"2023-10-09T11:41:00.307024+0000","last_fullsized":"2023-10-09T11:41:00.307024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:02.662263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187212+0000","last_change":"2023-10-09T11:41:00.187377+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187212+0000","last_undegraded":"2023-10-09T11:41:00.187212+0000","last_fullsized":"2023-10-09T11:41:00.187212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311366+0000","last_change":"2023-10-09T11:40:59.306793+0000","last_active":"2023-10-09T11:40:59.311366+0000","last_peered":"2023-10-09T11:40:59.311366+0000","last_clean":"2023-10-09T11:40:59.311366+0000","last_became_active":"2023-10-09T11:40:59.306510+0000","last_became_peered":"2023-10-09T11:40:59.306510+0000","last_unstale":"2023-10-09T11:40:59.311366+0000","last_undegraded":"2023-10-09T11:40:59.311366+0000","last_fullsized":"2023-10-09T11:40:59.311366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:37.705035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192936+0000","last_change":"2023-10-09T11:41:00.193063+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192936+0000","last_undegraded":"2023-10-09T11:41:00.192936+0000","last_fullsized":"2023-10-09T11:41:00.192936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312451+0000","last_change":"2023-10-09T11:40:59.309374+0000","last_active":"2023-10-09T11:40:59.312451+0000","last_peered":"2023-10-09T11:40:59.312451+0000","last_clean":"2023-10-09T11:40:59.312451+0000","last_became_active":"2023-10-09T11:40:59.309083+0000","last_became_peered":"2023-10-09T11:40:59.309083+0000","last_unstale":"2023-10-09T11:40:59.312451+0000","last_undegraded":"2023-10-09T11:40:59.312451+0000","last_fullsized":"2023-10-09T11:40:59.312451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:58.469619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204138+0000","last_change":"2023-10-09T11:41:00.201482+0000","last_active":"2023-10-09T11:41:00.204138+0000","last_peered":"2023-10-09T11:41:00.204138+0000","last_clean":"2023-10-09T11:41:00.204138+0000","last_became_active":"2023-10-09T11:41:00.201208+0000","last_became_peered":"2023-10-09T11:41:00.201208+0000","last_unstale":"2023-10-09T11:41:00.204138+0000","last_undegraded":"2023-10-09T11:41:00.204138+0000","last_fullsized":"2023-10-09T11:41:00.204138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200308+0000","last_change":"2023-10-09T11:40:59.307781+0000","last_active":"2023-10-09T11:41:00.200308+0000","last_peered":"2023-10-09T11:41:00.200308+0000","last_clean":"2023-10-09T11:41:00.200308+0000","last_became_active":"2023-10-09T11:40:59.307502+0000","last_became_peered":"2023-10-09T11:40:59.307502+0000","last_unstale":"2023-10-09T11:41:00.200308+0000","last_undegraded":"2023-10-09T11:41:00.200308+0000","last_fullsized":"2023-10-09T11:41:00.200308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191151+0000","last_change":"2023-10-09T11:41:00.191281+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191151+0000","last_undegraded":"2023-10-09T11:41:00.191151+0000","last_fullsized":"2023-10-09T11:41:00.191151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312668+0000","last_change":"2023-10-09T11:40:59.311585+0000","last_active":"2023-10-09T11:40:59.312668+0000","last_peered":"2023-10-09T11:40:59.312668+0000","last_clean":"2023-10-09T11:40:59.312668+0000","last_became_active":"2023-10-09T11:40:59.310224+0000","last_became_peered":"2023-10-09T11:40:59.310224+0000","last_unstale":"2023-10-09T11:40:59.312668+0000","last_undegraded":"2023-10-09T11:40:59.312668+0000","last_fullsized":"2023-10-09T11:40:59.312668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:28.139612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206440+0000","last_change":"2023-10-09T11:41:00.205217+0000","last_active":"2023-10-09T11:41:00.206440+0000","last_peered":"2023-10-09T11:41:00.206440+0000","last_clean":"2023-10-09T11:41:00.206440+0000","last_became_active":"2023-10-09T11:41:00.204945+0000","last_became_peered":"2023-10-09T11:41:00.204945+0000","last_unstale":"2023-10-09T11:41:00.206440+0000","last_undegraded":"2023-10-09T11:41:00.206440+0000","last_fullsized":"2023-10-09T11:41:00.206440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304354+0000","last_change":"2023-10-09T11:40:59.311483+0000","last_active":"2023-10-09T11:41:00.304354+0000","last_peered":"2023-10-09T11:41:00.304354+0000","last_clean":"2023-10-09T11:41:00.304354+0000","last_became_active":"2023-10-09T11:40:59.311249+0000","last_became_peered":"2023-10-09T11:40:59.311249+0000","last_unstale":"2023-10-09T11:41:00.304354+0000","last_undegraded":"2023-10-09T11:41:00.304354+0000","last_fullsized":"2023-10-09T11:41:00.304354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202133+0000","last_change":"2023-10-09T11:41:00.202133+0000","last_active":"2023-10-09T11:41:00.202133+0000","last_peered":"2023-10-09T11:41:00.202133+0000","last_clean":"2023-10-09T11:41:00.202133+0000","last_became_active":"2023-10-09T11:41:00.201841+0000","last_became_peered":"2023-10-09T11:41:00.201841+0000","last_unstale":"2023-10-09T11:41:00.202133+0000","last_undegraded":"2023-10-09T11:41:00.202133+0000","last_fullsized":"2023-10-09T11:41:00.202133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:28.230567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305220+0000","last_change":"2023-10-09T11:40:59.307530+0000","last_active":"2023-10-09T11:41:00.305220+0000","last_peered":"2023-10-09T11:41:00.305220+0000","last_clean":"2023-10-09T11:41:00.305220+0000","last_became_active":"2023-10-09T11:40:59.307240+0000","last_became_peered":"2023-10-09T11:40:59.307240+0000","last_unstale":"2023-10-09T11:41:00.305220+0000","last_undegraded":"2023-10-09T11:41:00.305220+0000","last_fullsized":"2023-10-09T11:41:00.305220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205520+0000","last_change":"2023-10-09T11:41:00.205520+0000","last_active":"2023-10-09T11:41:00.205520+0000","last_peered":"2023-10-09T11:41:00.205520+0000","last_clean":"2023-10-09T11:41:00.205520+0000","last_became_active":"2023-10-09T11:41:00.205256+0000","last_became_peered":"2023-10-09T11:41:00.205256+0000","last_unstale":"2023-10-09T11:41:00.205520+0000","last_undegraded":"2023-10-09T11:41:00.205520+0000","last_fullsized":"2023-10-09T11:41:00.205520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:47.838489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.305008+0000","last_change":"2023-10-09T11:40:59.303336+0000","last_active":"2023-10-09T11:40:59.305008+0000","last_peered":"2023-10-09T11:40:59.305008+0000","last_clean":"2023-10-09T11:40:59.305008+0000","last_became_active":"2023-10-09T11:40:59.303065+0000","last_became_peered":"2023-10-09T11:40:59.303065+0000","last_unstale":"2023-10-09T11:40:59.305008+0000","last_undegraded":"2023-10-09T11:40:59.305008+0000","last_fullsized":"2023-10-09T11:40:59.305008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:25.211376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190504+0000","last_change":"2023-10-09T11:41:00.190798+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190504+0000","last_undegraded":"2023-10-09T11:41:00.190504+0000","last_fullsized":"2023-10-09T11:41:00.190504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.303449+0000","last_change":"2023-10-09T11:40:59.300828+0000","last_active":"2023-10-09T11:40:59.303449+0000","last_peered":"2023-10-09T11:40:59.303449+0000","last_clean":"2023-10-09T11:40:59.303449+0000","last_became_active":"2023-10-09T11:40:59.300609+0000","last_became_peered":"2023-10-09T11:40:59.300609+0000","last_unstale":"2023-10-09T11:40:59.303449+0000","last_undegraded":"2023-10-09T11:40:59.303449+0000","last_fullsized":"2023-10-09T11:40:59.303449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:36.893466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191323+0000","last_change":"2023-10-09T11:41:00.191446+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191323+0000","last_undegraded":"2023-10-09T11:41:00.191323+0000","last_fullsized":"2023-10-09T11:41:00.191323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307163+0000","last_change":"2023-10-09T11:40:59.305991+0000","last_active":"2023-10-09T11:40:59.307163+0000","last_peered":"2023-10-09T11:40:59.307163+0000","last_clean":"2023-10-09T11:40:59.307163+0000","last_became_active":"2023-10-09T11:40:59.305696+0000","last_became_peered":"2023-10-09T11:40:59.305696+0000","last_unstale":"2023-10-09T11:40:59.307163+0000","last_undegraded":"2023-10-09T11:40:59.307163+0000","last_fullsized":"2023-10-09T11:40:59.307163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:08.639887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190449+0000","last_change":"2023-10-09T11:41:00.190596+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190449+0000","last_undegraded":"2023-10-09T11:41:00.190449+0000","last_fullsized":"2023-10-09T11:41:00.190449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.306840+0000","last_change":"2023-10-09T11:40:59.304467+0000","last_active":"2023-10-09T11:40:59.306840+0000","last_peered":"2023-10-09T11:40:59.306840+0000","last_clean":"2023-10-09T11:40:59.306840+0000","last_became_active":"2023-10-09T11:40:59.304147+0000","last_became_peered":"2023-10-09T11:40:59.304147+0000","last_unstale":"2023-10-09T11:40:59.306840+0000","last_undegraded":"2023-10-09T11:40:59.306840+0000","last_fullsized":"2023-10-09T11:40:59.306840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:23.168219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203833+0000","last_change":"2023-10-09T11:41:00.198067+0000","last_active":"2023-10-09T11:41:00.203833+0000","last_peered":"2023-10-09T11:41:00.203833+0000","last_clean":"2023-10-09T11:41:00.203833+0000","last_became_active":"2023-10-09T11:41:00.197769+0000","last_became_peered":"2023-10-09T11:41:00.197769+0000","last_unstale":"2023-10-09T11:41:00.203833+0000","last_undegraded":"2023-10-09T11:41:00.203833+0000","last_fullsized":"2023-10-09T11:41:00.203833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:42.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309472+0000","last_change":"2023-10-09T11:40:59.305531+0000","last_active":"2023-10-09T11:40:59.309472+0000","last_peered":"2023-10-09T11:40:59.309472+0000","last_clean":"2023-10-09T11:40:59.309472+0000","last_became_active":"2023-10-09T11:40:59.305268+0000","last_became_peered":"2023-10-09T11:40:59.305268+0000","last_unstale":"2023-10-09T11:40:59.309472+0000","last_undegraded":"2023-10-09T11:40:59.309472+0000","last_fullsized":"2023-10-09T11:40:59.309472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.165900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196125+0000","last_change":"2023-10-09T11:41:00.196506+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196125+0000","last_undegraded":"2023-10-09T11:41:00.196125+0000","last_fullsized":"2023-10-09T11:41:00.196125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"87'2","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298838+0000","last_change":"2023-10-09T11:40:59.304065+0000","last_active":"2023-10-09T11:41:00.298838+0000","last_peered":"2023-10-09T11:41:00.298838+0000","last_clean":"2023-10-09T11:41:00.298838+0000","last_became_active":"2023-10-09T11:40:59.303714+0000","last_became_peered":"2023-10-09T11:40:59.303714+0000","last_unstale":"2023-10-09T11:41:00.298838+0000","last_undegraded":"2023-10-09T11:41:00.298838+0000","last_fullsized":"2023-10-09T11:41:00.298838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191742+0000","last_change":"2023-10-09T11:41:00.191851+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191742+0000","last_undegraded":"2023-10-09T11:41:00.191742+0000","last_fullsized":"2023-10-09T11:41:00.191742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312534+0000","last_change":"2023-10-09T11:40:59.311346+0000","last_active":"2023-10-09T11:40:59.312534+0000","last_peered":"2023-10-09T11:40:59.312534+0000","last_clean":"2023-10-09T11:40:59.312534+0000","last_became_active":"2023-10-09T11:40:59.311075+0000","last_became_peered":"2023-10-09T11:40:59.311075+0000","last_unstale":"2023-10-09T11:40:59.312534+0000","last_undegraded":"2023-10-09T11:40:59.312534+0000","last_fullsized":"2023-10-09T11:40:59.312534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193641+0000","last_change":"2023-10-09T11:41:00.193782+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193641+0000","last_undegraded":"2023-10-09T11:41:00.193641+0000","last_fullsized":"2023-10-09T11:41:00.193641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.304229+0000","last_change":"2023-10-09T11:40:59.303219+0000","last_active":"2023-10-09T11:40:59.304229+0000","last_peered":"2023-10-09T11:40:59.304229+0000","last_clean":"2023-10-09T11:40:59.304229+0000","last_became_active":"2023-10-09T11:40:59.302933+0000","last_became_peered":"2023-10-09T11:40:59.302933+0000","last_unstale":"2023-10-09T11:40:59.304229+0000","last_undegraded":"2023-10-09T11:40:59.304229+0000","last_fullsized":"2023-10-09T11:40:59.304229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:27.987978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205722+0000","last_change":"2023-10-09T11:41:00.200343+0000","last_active":"2023-10-09T11:41:00.205722+0000","last_peered":"2023-10-09T11:41:00.205722+0000","last_clean":"2023-10-09T11:41:00.205722+0000","last_became_active":"2023-10-09T11:41:00.200104+0000","last_became_peered":"2023-10-09T11:41:00.200104+0000","last_unstale":"2023-10-09T11:41:00.205722+0000","last_undegraded":"2023-10-09T11:41:00.205722+0000","last_fullsized":"2023-10-09T11:41:00.205722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:41.980263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190960+0000","last_change":"2023-10-09T11:40:59.307643+0000","last_active":"2023-10-09T11:41:00.190960+0000","last_peered":"2023-10-09T11:41:00.190960+0000","last_clean":"2023-10-09T11:41:00.190960+0000","last_became_active":"2023-10-09T11:40:59.307289+0000","last_became_peered":"2023-10-09T11:40:59.307289+0000","last_unstale":"2023-10-09T11:41:00.190960+0000","last_undegraded":"2023-10-09T11:41:00.190960+0000","last_fullsized":"2023-10-09T11:41:00.190960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:08.218968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190155+0000","last_change":"2023-10-09T11:41:00.190283+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190155+0000","last_undegraded":"2023-10-09T11:41:00.190155+0000","last_fullsized":"2023-10-09T11:41:00.190155+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307364+0000","last_change":"2023-10-09T11:40:59.304273+0000","last_active":"2023-10-09T11:40:59.307364+0000","last_peered":"2023-10-09T11:40:59.307364+0000","last_clean":"2023-10-09T11:40:59.307364+0000","last_became_active":"2023-10-09T11:40:59.303919+0000","last_became_peered":"2023-10-09T11:40:59.303919+0000","last_unstale":"2023-10-09T11:40:59.307364+0000","last_undegraded":"2023-10-09T11:40:59.307364+0000","last_fullsized":"2023-10-09T11:40:59.307364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:48.013168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211595+0000","last_change":"2023-10-09T11:41:00.207662+0000","last_active":"2023-10-09T11:41:00.211595+0000","last_peered":"2023-10-09T11:41:00.211595+0000","last_clean":"2023-10-09T11:41:00.211595+0000","last_became_active":"2023-10-09T11:41:00.207086+0000","last_became_peered":"2023-10-09T11:41:00.207086+0000","last_unstale":"2023-10-09T11:41:00.211595+0000","last_undegraded":"2023-10-09T11:41:00.211595+0000","last_fullsized":"2023-10-09T11:41:00.211595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:06.889859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191114+0000","last_change":"2023-10-09T11:40:59.306512+0000","last_active":"2023-10-09T11:41:00.191114+0000","last_peered":"2023-10-09T11:41:00.191114+0000","last_clean":"2023-10-09T11:41:00.191114+0000","last_became_active":"2023-10-09T11:40:59.306149+0000","last_became_peered":"2023-10-09T11:40:59.306149+0000","last_unstale":"2023-10-09T11:41:00.191114+0000","last_undegraded":"2023-10-09T11:41:00.191114+0000","last_fullsized":"2023-10-09T11:41:00.191114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190529+0000","last_change":"2023-10-09T11:41:00.190657+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190529+0000","last_undegraded":"2023-10-09T11:41:00.190529+0000","last_fullsized":"2023-10-09T11:41:00.190529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311913+0000","last_change":"2023-10-09T11:40:59.308119+0000","last_active":"2023-10-09T11:40:59.311913+0000","last_peered":"2023-10-09T11:40:59.311913+0000","last_clean":"2023-10-09T11:40:59.311913+0000","last_became_active":"2023-10-09T11:40:59.307789+0000","last_became_peered":"2023-10-09T11:40:59.307789+0000","last_unstale":"2023-10-09T11:40:59.311913+0000","last_undegraded":"2023-10-09T11:40:59.311913+0000","last_fullsized":"2023-10-09T11:40:59.311913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200239+0000","last_change":"2023-10-09T11:41:00.191564+0000","last_active":"2023-10-09T11:41:00.200239+0000","last_peered":"2023-10-09T11:41:00.200239+0000","last_clean":"2023-10-09T11:41:00.200239+0000","last_became_active":"2023-10-09T11:41:00.191263+0000","last_became_peered":"2023-10-09T11:41:00.191263+0000","last_unstale":"2023-10-09T11:41:00.200239+0000","last_undegraded":"2023-10-09T11:41:00.200239+0000","last_fullsized":"2023-10-09T11:41:00.200239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310874+0000","last_change":"2023-10-09T11:40:59.307057+0000","last_active":"2023-10-09T11:40:59.310874+0000","last_peered":"2023-10-09T11:40:59.310874+0000","last_clean":"2023-10-09T11:40:59.310874+0000","last_became_active":"2023-10-09T11:40:59.306788+0000","last_became_peered":"2023-10-09T11:40:59.306788+0000","last_unstale":"2023-10-09T11:40:59.310874+0000","last_undegraded":"2023-10-09T11:40:59.310874+0000","last_fullsized":"2023-10-09T11:40:59.310874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:55.363742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191889+0000","last_change":"2023-10-09T11:41:00.192023+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191889+0000","last_undegraded":"2023-10-09T11:41:00.191889+0000","last_fullsized":"2023-10-09T11:41:00.191889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192437+0000","last_change":"2023-10-09T11:40:59.305040+0000","last_active":"2023-10-09T11:41:00.192437+0000","last_peered":"2023-10-09T11:41:00.192437+0000","last_clean":"2023-10-09T11:41:00.192437+0000","last_became_active":"2023-10-09T11:40:59.304676+0000","last_became_peered":"2023-10-09T11:40:59.304676+0000","last_unstale":"2023-10-09T11:41:00.192437+0000","last_undegraded":"2023-10-09T11:41:00.192437+0000","last_fullsized":"2023-10-09T11:41:00.192437+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:36.911436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.293513+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:59.293513+0000","last_peered":"2023-10-09T11:40:59.293513+0000","last_clean":"2023-10-09T11:40:59.293513+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:59.293513+0000","last_undegraded":"2023-10-09T11:40:59.293513+0000","last_fullsized":"2023-10-09T11:40:59.293513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":1675264,"data_stored":1051802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":461946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.33800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.35399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.219}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.248},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1654784,"data_stored":1044927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.377},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.75}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.95199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.57799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":462982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.378},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.432}]}]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.192056+0000', 'last_change': '2023-10-09T11:41:00.192174+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.192056+0000', 'last_undegraded': '2023-10-09T11:41:00.192056+0000', 'last_fullsized': '2023-10-09T11:41:00.192056+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.196279+0000', 'last_change': '2023-10-09T11:41:00.196435+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.196279+0000', 'last_undegraded': '2023-10-09T11:41:00.196279+0000', 'last_fullsized': '2023-10-09T11:41:00.196279+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-09T11:41:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191209+0000', 'last_change': '2023-10-09T11:41:00.191346+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191209+0000', 'last_undegraded': '2023-10-09T11:41:00.191209+0000', 'last_fullsized': '2023-10-09T11:41:00.191209+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187559+0000', 'last_change': '2023-10-09T11:41:00.187689+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187559+0000', 'last_undegraded': '2023-10-09T11:41:00.187559+0000', 'last_fullsized': '2023-10-09T11:41:00.187559+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187145+0000', 'last_change': '2023-10-09T11:41:00.187599+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187145+0000', 'last_undegraded': '2023-10-09T11:41:00.187145+0000', 'last_fullsized': '2023-10-09T11:41:00.187145+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190990+0000', 'last_change': '2023-10-09T11:41:00.191111+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190990+0000', 'last_undegraded': '2023-10-09T11:41:00.190990+0000', 'last_fullsized': '2023-10-09T11:41:00.190990+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': ['2', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187222+0000', 'last_change': '2023-10-09T11:41:00.187373+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187222+0000', 'last_undegraded': '2023-10-09T11:41:00.187222+0000', 'last_fullsized': '2023-10-09T11:41:00.187222+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-09T11:41:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190268+0000', 'last_change': '2023-10-09T11:41:00.190411+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190268+0000', 'last_undegraded': '2023-10-09T11:41:00.190268+0000', 'last_fullsized': '2023-10-09T11:41:00.190268+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187098+0000', 'last_change': '2023-10-09T11:41:00.187265+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187098+0000', 'last_undegraded': '2023-10-09T11:41:00.187098+0000', 'last_fullsized': '2023-10-09T11:41:00.187098+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191321+0000', 'last_change': '2023-10-09T11:41:00.192903+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191321+0000', 'last_undegraded': '2023-10-09T11:41:00.191321+0000', 'last_fullsized': '2023-10-09T11:41:00.191321+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190948+0000', 'last_change': '2023-10-09T11:41:00.191089+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190948+0000', 'last_undegraded': '2023-10-09T11:41:00.190948+0000', 'last_fullsized': '2023-10-09T11:41:00.190948+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191520+0000', 'last_change': '2023-10-09T11:41:00.191644+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191520+0000', 'last_undegraded': '2023-10-09T11:41:00.191520+0000', 'last_fullsized': '2023-10-09T11:41:00.191520+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 87, 'state': 'active', 'last_fresh': '2023-10-09T11:41:00.199898+0000', 'last_change': '2023-10-09T11:41:00.199898+0000', 'last_active': '2023-10-09T11:41:00.199898+0000', 'last_peered': '2023-10-09T11:41:00.199898+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '2023-10-09T11:41:00.199898+0000', 'last_became_peered': '2023-10-09T11:41:00.199898+0000', 'last_unstale': '2023-10-09T11:41:00.199898+0000', 'last_undegraded': '2023-10-09T11:41:00.199898+0000', 'last_fullsized': '2023-10-09T11:41:00.199898+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191317+0000', 'last_change': '2023-10-09T11:41:00.191451+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191317+0000', 'last_undegraded': '2023-10-09T11:41:00.191317+0000', 'last_fullsized': '2023-10-09T11:41:00.191317+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187036+0000', 'last_change': '2023-10-09T11:41:00.187136+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187036+0000', 'last_undegraded': '2023-10-09T11:41:00.187036+0000', 'last_fullsized': '2023-10-09T11:41:00.187036+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.193811+0000', 'last_change': '2023-10-09T11:41:00.193927+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.193811+0000', 'last_undegraded': '2023-10-09T11:41:00.193811+0000', 'last_fullsized': '2023-10-09T11:41:00.193811+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-09T11:41:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.192212+0000', 'last_change': '2023-10-09T11:41:00.192335+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.192212+0000', 'last_undegraded': '2023-10-09T11:41:00.192212+0000', 'last_fullsized': '2023-10-09T11:41:00.192212+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187352+0000', 'last_change': '2023-10-09T11:41:00.187486+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187352+0000', 'last_undegraded': '2023-10-09T11:41:00.187352+0000', 'last_fullsized': '2023-10-09T11:41:00.187352+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.192577+0000', 'last_change': '2023-10-09T11:41:00.192711+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.192577+0000', 'last_undegraded': '2023-10-09T11:41:00.192577+0000', 'last_fullsized': '2023-10-09T11:41:00.192577+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.186949+0000', 'last_change': '2023-10-09T11:41:00.187132+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.186949+0000', 'last_undegraded': '2023-10-09T11:41:00.186949+0000', 'last_fullsized': '2023-10-09T11:41:00.186949+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191856+0000', 'last_change': '2023-10-09T11:41:00.191985+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191856+0000', 'last_undegraded': '2023-10-09T11:41:00.191856+0000', 'last_fullsized': '2023-10-09T11:41:00.191856+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-09T11:41:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.187212+0000', 'last_change': '2023-10-09T11:41:00.187377+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.187212+0000', 'last_undegraded': '2023-10-09T11:41:00.187212+0000', 'last_fullsized': '2023-10-09T11:41:00.187212+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.192936+0000', 'last_change': '2023-10-09T11:41:00.193063+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.192936+0000', 'last_undegraded': '2023-10-09T11:41:00.192936+0000', 'last_fullsized': '2023-10-09T11:41:00.192936+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191151+0000', 'last_change': '2023-10-09T11:41:00.191281+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191151+0000', 'last_undegraded': '2023-10-09T11:41:00.191151+0000', 'last_fullsized': '2023-10-09T11:41:00.191151+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190504+0000', 'last_change': '2023-10-09T11:41:00.190798+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190504+0000', 'last_undegraded': '2023-10-09T11:41:00.190504+0000', 'last_fullsized': '2023-10-09T11:41:00.190504+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191323+0000', 'last_change': '2023-10-09T11:41:00.191446+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191323+0000', 'last_undegraded': '2023-10-09T11:41:00.191323+0000', 'last_fullsized': '2023-10-09T11:41:00.191323+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-09T11:41:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190449+0000', 'last_change': '2023-10-09T11:41:00.190596+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190449+0000', 'last_undegraded': '2023-10-09T11:41:00.190449+0000', 'last_fullsized': '2023-10-09T11:41:00.190449+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.196125+0000', 'last_change': '2023-10-09T11:41:00.196506+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.196125+0000', 'last_undegraded': '2023-10-09T11:41:00.196125+0000', 'last_fullsized': '2023-10-09T11:41:00.196125+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191742+0000', 'last_change': '2023-10-09T11:41:00.191851+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191742+0000', 'last_undegraded': '2023-10-09T11:41:00.191742+0000', 'last_fullsized': '2023-10-09T11:41:00.191742+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.193641+0000', 'last_change': '2023-10-09T11:41:00.193782+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.193641+0000', 'last_undegraded': '2023-10-09T11:41:00.193641+0000', 'last_fullsized': '2023-10-09T11:41:00.193641+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190155+0000', 'last_change': '2023-10-09T11:41:00.190283+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190155+0000', 'last_undegraded': '2023-10-09T11:41:00.190155+0000', 'last_fullsized': '2023-10-09T11:41:00.190155+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-09T11:41:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.190529+0000', 'last_change': '2023-10-09T11:41:00.190657+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.190529+0000', 'last_undegraded': '2023-10-09T11:41:00.190529+0000', 'last_fullsized': '2023-10-09T11:41:00.190529+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-09T11:41:05.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 87, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:00.191889+0000', 'last_change': '2023-10-09T11:41:00.192023+0000', 'last_active': '2023-10-09T11:40:59.283423+0000', 'last_peered': '2023-10-09T11:40:59.283423+0000', 'last_clean': '2023-10-09T11:40:59.283423+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:00.191889+0000', 'last_undegraded': '2023-10-09T11:41:00.191889+0000', 'last_fullsized': '2023-10-09T11:41:00.191889+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'last_clean_scrub_stamp': '2023-10-09T11:40:59.283423+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:05.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:41:05.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.323+0000 7fb04d6a4700 1 Processor -- start 2023-10-09T11:41:05.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.323+0000 7fb04d6a4700 1 -- start start 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb04d6a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb048153a00 0x7fb04815d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb04d6a4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb048153dd0 0x7fb04815a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb04d6a4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04815d750 con 0x7fb0480cea30 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb04d6a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480cdbc0 con 0x7fb048153a00 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb04d6a4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480cb3d0 con 0x7fb048153dd0 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb048153a00 0x7fb04815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb048153a00 0x7fb04815d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48312/0 (socket says 172.21.15.26:48312) 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 -- 172.21.15.26:0/469440279 learned_addr learned my addr 172.21.15.26:0/469440279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:05.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 -- 172.21.15.26:0/469440279 >> v2:172.21.15.67:3300/0 conn(0x7fb048153dd0 msgr2=0x7fb04815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 --2- 172.21.15.26:0/469440279 >> v2:172.21.15.67:3300/0 conn(0x7fb048153dd0 0x7fb04815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 -- 172.21.15.26:0/469440279 >> v1:172.21.15.67:6789/0 conn(0x7fb0480cea30 legacy=0x7fb0480cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 -- 172.21.15.26:0/469440279 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480cb6b0 con 0x7fb048153a00 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.324+0000 7fb047fff700 1 --2- 172.21.15.26:0/469440279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153a00 0x7fb04815d210 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb0480893a0 tx=0x7fb03c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a22c83e3a87f528 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb046ffd700 1 -- 172.21.15.26:0/469440279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00b820 con 0x7fb048153a00 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb046ffd700 1 -- 172.21.15.26:0/469440279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00b980 con 0x7fb048153a00 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb046ffd700 1 -- 172.21.15.26:0/469440279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00bd20 con 0x7fb048153a00 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 -- 172.21.15.26:0/469440279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153a00 msgr2=0x7fb04815d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/469440279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153a00 0x7fb04815d210 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb0480893a0 tx=0x7fb03c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 -- 172.21.15.26:0/469440279 shutdown_connections 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/469440279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153a00 0x7fb04815d210 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/469440279 >> v2:172.21.15.67:3300/0 conn(0x7fb048153dd0 0x7fb04815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 -- 172.21.15.26:0/469440279 >> 172.21.15.26:0/469440279 conn(0x7fb0480703a0 msgr2=0x7fb0480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 -- 172.21.15.26:0/469440279 shutdown_connections 2023-10-09T11:41:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.325+0000 7fb04d6a4700 1 -- 172.21.15.26:0/469440279 wait complete. 2023-10-09T11:41:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.326+0000 7fb04d6a4700 1 Processor -- start 2023-10-09T11:41:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.326+0000 7fb04d6a4700 1 -- start start 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0480cea30 0x7fb048150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb048153a00 0x7fb0481559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815b680 con 0x7fb048153dd0 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815aa70 con 0x7fb048153a00 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04d6a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815ad50 con 0x7fb0480cea30 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04cea3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04cea3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48320/0 (socket says 172.21.15.26:48320) 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb04cea3700 1 -- 172.21.15.26:0/1522712092 learned_addr learned my addr 172.21.15.26:0/1522712092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb047fff700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0480cea30 0x7fb048150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.327+0000 7fb0477fe700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb048153a00 0x7fb0481559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 -- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0480cea30 msgr2=0x7fb048150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0480cea30 0x7fb048150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 -- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb048153a00 msgr2=0x7fb0481559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb048153a00 0x7fb0481559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 -- 172.21.15.26:0/1522712092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0094f0 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04cea3700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb04000bbb0 tx=0x7fb040009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400092e0 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000c630 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04815b030 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000c9f0 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.328+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04815a660 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.329+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04815b830 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.329+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb040012070 con 0x7fb048153dd0 2023-10-09T11:41:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.330+0000 7fb02ffff700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 0x7fb0340696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.330+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0400845d0 con 0x7fb048153dd0 2023-10-09T11:41:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.330+0000 7fb047fff700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 0x7fb0340696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.331+0000 7fb047fff700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 0x7fb0340696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb0480893a0 tx=0x7fb03c016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.334+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb04815b830 con 0x7fb048153dd0 2023-10-09T11:41:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.609+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb04804c3c0 con 0x7fb048153dd0 2023-10-09T11:41:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.609+0000 7fb02ffff700 1 -- 172.21.15.26:0/1522712092 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1557 (secure 0 0 0) 0x7fb0400515a0 con 0x7fb048153dd0 2023-10-09T11:41:05.611 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:05.611 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":366,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":64},{"state_name":"creating+activating","count":32},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":592086,"bytes_used":2466119680,"bytes_avail":770627993600,"bytes_total":773094113280,"inactive_pgs_ratio":0.32989689707756042,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":58,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":6483}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-09T11:40:49.185634+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 msgr2=0x7fb0340696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 0x7fb0340696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb0480893a0 tx=0x7fb03c016000 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 msgr2=0x7fb048152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb04000bbb0 tx=0x7fb040009840 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 shutdown_connections 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb048153dd0 0x7fb048152c10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb034067200 0x7fb0340696b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0480cea30 0x7fb048150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 --2- 172.21.15.26:0/1522712092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb048153a00 0x7fb0481559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 >> 172.21.15.26:0/1522712092 conn(0x7fb0480703a0 msgr2=0x7fb0480c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 shutdown_connections 2023-10-09T11:41:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.611+0000 7fb04d6a4700 1 -- 172.21.15.26:0/1522712092 wait complete. 2023-10-09T11:41:05.624 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:41:05.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:05.638 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-10-09T11:41:05.636+0000 7f8443240700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:05.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.742+0000 7efedbc50700 1 Processor -- start 2023-10-09T11:41:05.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.742+0000 7efedbc50700 1 -- start start 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efedbc50700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efed40cb5a0 0x7efed40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efedbc50700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efed415a5d0 0x7efed4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efedbc50700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed415ae40 con 0x7efed40cd9e0 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efedbc50700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40d13f0 con 0x7efed40cb5a0 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efedbc50700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed415ab60 con 0x7efed415a5d0 2023-10-09T11:41:05.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efed99ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efed40cb5a0 0x7efed40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efed91eb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efed40cd9e0 0x7efed4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52526/0 (socket says 172.21.15.26:52526) 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.743+0000 7efed91eb700 1 -- 172.21.15.26:0/924446840 learned_addr learned my addr 172.21.15.26:0/924446840 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efeda1ed700 1 --2- 172.21.15.26:0/924446840 >> v2:172.21.15.67:3300/0 conn(0x7efed415a5d0 0x7efed4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed99ec700 1 -- 172.21.15.26:0/924446840 >> v2:172.21.15.67:3300/0 conn(0x7efed415a5d0 msgr2=0x7efed4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed99ec700 1 --2- 172.21.15.26:0/924446840 >> v2:172.21.15.67:3300/0 conn(0x7efed415a5d0 0x7efed4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed99ec700 1 -- 172.21.15.26:0/924446840 >> v1:172.21.15.26:6789/0 conn(0x7efed40cd9e0 legacy=0x7efed4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed99ec700 1 -- 172.21.15.26:0/924446840 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40ccf00 con 0x7efed40cb5a0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed89ea700 1 -- 172.21.15.26:0/924446840 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609138445 0 0) 0x7efed415ae40 con 0x7efed40cd9e0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed99ec700 1 --2- 172.21.15.26:0/924446840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed40cb970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efec4009e60 tx=0x7efec4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0753f386141a68f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed89ea700 1 -- 172.21.15.26:0/924446840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400e070 con 0x7efed40cb5a0 2023-10-09T11:41:05.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed89ea700 1 -- 172.21.15.26:0/924446840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400bbf0 con 0x7efed40cb5a0 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.744+0000 7efed89ea700 1 -- 172.21.15.26:0/924446840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4012430 con 0x7efed40cb5a0 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 -- 172.21.15.26:0/924446840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 msgr2=0x7efed40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 --2- 172.21.15.26:0/924446840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed40cb970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efec4009e60 tx=0x7efec4009780 comp rx=0 tx=0).stop 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 -- 172.21.15.26:0/924446840 shutdown_connections 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 --2- 172.21.15.26:0/924446840 >> v2:172.21.15.67:3300/0 conn(0x7efed415a5d0 0x7efed4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 --2- 172.21.15.26:0/924446840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed40cb970 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 -- 172.21.15.26:0/924446840 >> 172.21.15.26:0/924446840 conn(0x7efed4070e30 msgr2=0x7efed40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 -- 172.21.15.26:0/924446840 shutdown_connections 2023-10-09T11:41:05.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.745+0000 7efedbc50700 1 -- 172.21.15.26:0/924446840 wait complete. 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.746+0000 7efedbc50700 1 Processor -- start 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.746+0000 7efedbc50700 1 -- start start 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efed40cd9e0 0x7efed4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efed415a5d0 0x7efed4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4158fb0 con 0x7efed40cb5a0 2023-10-09T11:41:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4151b40 con 0x7efed415a5d0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed41583e0 con 0x7efed40cd9e0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48350/0 (socket says 172.21.15.26:48350) 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 -- 172.21.15.26:0/3987336835 learned_addr learned my addr 172.21.15.26:0/3987336835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 -- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efed40cd9e0 msgr2=0x7efed4159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efed40cd9e0 0x7efed4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 -- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efed415a5d0 msgr2=0x7efed4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efed415a5d0 0x7efed4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 -- 172.21.15.26:0/3987336835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009a20 con 0x7efed40cb5a0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed99ec700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efec40099f0 tx=0x7efec4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4012ea0 con 0x7efed40cb5a0 2023-10-09T11:41:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4027470 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4027830 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4158680 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.747+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4158c40 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.748+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed404c3c0 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.749+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7efec4024070 con 0x7efed40cb5a0 2023-10-09T11:41:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.749+0000 7efed1ffb700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 0x7efec00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.749+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efec4087170 con 0x7efed40cb5a0 2023-10-09T11:41:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.749+0000 7efed91eb700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 0x7efec00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.750+0000 7efed91eb700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 0x7efec00696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efec80011e0 tx=0x7efec80079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.754+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec4053fb0 con 0x7efed40cb5a0 2023-10-09T11:41:05.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.941+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efed41590f0 con 0x7efec0067200 2023-10-09T11:41:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.950+0000 7efed1ffb700 1 -- 172.21.15.26:0/3987336835 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287989 (secure 0 0 0) 0x7efec80058e0 con 0x7efec0067200 2023-10-09T11:41:05.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 msgr2=0x7efec00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 0x7efec00696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efec80011e0 tx=0x7efec80079d0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 msgr2=0x7efed4151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efec40099f0 tx=0x7efec4019000 comp rx=0 tx=0).stop 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 shutdown_connections 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efed415a5d0 0x7efed4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efed40cb5a0 0x7efed4151600 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067200 0x7efec00696b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 --2- 172.21.15.26:0/3987336835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efed40cd9e0 0x7efed4159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 >> 172.21.15.26:0/3987336835 conn(0x7efed4070e30 msgr2=0x7efed4155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 shutdown_connections 2023-10-09T11:41:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:05.954+0000 7efedbc50700 1 -- 172.21.15.26:0/3987336835 wait complete. 2023-10-09T11:41:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:05.967 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-09T11:41:05.188874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592086,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408320,"kb_used_data":9536,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566400,"statfs":{"total":773094113280,"available":770627993600,"internally_reserved":0,"allocated":9764864,"data_stored":4846726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001388"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192056+0000","last_change":"2023-10-09T11:41:00.192174+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192056+0000","last_undegraded":"2023-10-09T11:41:00.192056+0000","last_fullsized":"2023-10-09T11:41:00.192056+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196279+0000","last_change":"2023-10-09T11:41:00.196435+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196279+0000","last_undegraded":"2023-10-09T11:41:00.196279+0000","last_fullsized":"2023-10-09T11:41:00.196279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191209+0000","last_change":"2023-10-09T11:41:00.191346+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191209+0000","last_undegraded":"2023-10-09T11:41:00.191209+0000","last_fullsized":"2023-10-09T11:41:00.191209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187559+0000","last_change":"2023-10-09T11:41:00.187689+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187559+0000","last_undegraded":"2023-10-09T11:41:00.187559+0000","last_fullsized":"2023-10-09T11:41:00.187559+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200751+0000","last_change":"2023-10-09T11:41:00.195607+0000","last_active":"2023-10-09T11:41:00.200751+0000","last_peered":"2023-10-09T11:41:00.200751+0000","last_clean":"2023-10-09T11:41:00.200751+0000","last_became_active":"2023-10-09T11:41:00.195342+0000","last_became_peered":"2023-10-09T11:41:00.195342+0000","last_unstale":"2023-10-09T11:41:00.200751+0000","last_undegraded":"2023-10-09T11:41:00.200751+0000","last_fullsized":"2023-10-09T11:41:00.200751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199290+0000","last_change":"2023-10-09T11:41:00.199290+0000","last_active":"2023-10-09T11:41:00.199290+0000","last_peered":"2023-10-09T11:41:00.199290+0000","last_clean":"2023-10-09T11:41:00.199290+0000","last_became_active":"2023-10-09T11:41:00.199006+0000","last_became_peered":"2023-10-09T11:41:00.199006+0000","last_unstale":"2023-10-09T11:41:00.199290+0000","last_undegraded":"2023-10-09T11:41:00.199290+0000","last_fullsized":"2023-10-09T11:41:00.199290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:37.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.197074+0000","last_change":"2023-10-09T11:41:00.197074+0000","last_active":"2023-10-09T11:41:00.197074+0000","last_peered":"2023-10-09T11:41:00.197074+0000","last_clean":"2023-10-09T11:41:00.197074+0000","last_became_active":"2023-10-09T11:41:00.196781+0000","last_became_peered":"2023-10-09T11:41:00.196781+0000","last_unstale":"2023-10-09T11:41:00.197074+0000","last_undegraded":"2023-10-09T11:41:00.197074+0000","last_fullsized":"2023-10-09T11:41:00.197074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:05.170649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199097+0000","last_change":"2023-10-09T11:41:00.199173+0000","last_active":"2023-10-09T11:41:00.199097+0000","last_peered":"2023-10-09T11:41:00.199097+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.196113+0000","last_became_peered":"2023-10-09T11:41:00.196113+0000","last_unstale":"2023-10-09T11:41:00.199097+0000","last_undegraded":"2023-10-09T11:41:00.199097+0000","last_fullsized":"2023-10-09T11:41:00.199097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211312+0000","last_change":"2023-10-09T11:41:00.204730+0000","last_active":"2023-10-09T11:41:00.211312+0000","last_peered":"2023-10-09T11:41:00.211312+0000","last_clean":"2023-10-09T11:41:00.211312+0000","last_became_active":"2023-10-09T11:41:00.204428+0000","last_became_peered":"2023-10-09T11:41:00.204428+0000","last_unstale":"2023-10-09T11:41:00.211312+0000","last_undegraded":"2023-10-09T11:41:00.211312+0000","last_fullsized":"2023-10-09T11:41:00.211312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203902+0000","last_change":"2023-10-09T11:41:00.198185+0000","last_active":"2023-10-09T11:41:00.203902+0000","last_peered":"2023-10-09T11:41:00.203902+0000","last_clean":"2023-10-09T11:41:00.203902+0000","last_became_active":"2023-10-09T11:41:00.197877+0000","last_became_peered":"2023-10-09T11:41:00.197877+0000","last_unstale":"2023-10-09T11:41:00.203902+0000","last_undegraded":"2023-10-09T11:41:00.203902+0000","last_fullsized":"2023-10-09T11:41:00.203902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:20.433153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205889+0000","last_change":"2023-10-09T11:41:00.205889+0000","last_active":"2023-10-09T11:41:00.205889+0000","last_peered":"2023-10-09T11:41:00.205889+0000","last_clean":"2023-10-09T11:41:00.205889+0000","last_became_active":"2023-10-09T11:41:00.205596+0000","last_became_peered":"2023-10-09T11:41:00.205596+0000","last_unstale":"2023-10-09T11:41:00.205889+0000","last_undegraded":"2023-10-09T11:41:00.205889+0000","last_fullsized":"2023-10-09T11:41:00.205889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203639+0000","last_change":"2023-10-09T11:41:00.202214+0000","last_active":"2023-10-09T11:41:00.203639+0000","last_peered":"2023-10-09T11:41:00.203639+0000","last_clean":"2023-10-09T11:41:00.203639+0000","last_became_active":"2023-10-09T11:41:00.201923+0000","last_became_peered":"2023-10-09T11:41:00.201923+0000","last_unstale":"2023-10-09T11:41:00.203639+0000","last_undegraded":"2023-10-09T11:41:00.203639+0000","last_fullsized":"2023-10-09T11:41:00.203639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187145+0000","last_change":"2023-10-09T11:41:00.187599+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187145+0000","last_undegraded":"2023-10-09T11:41:00.187145+0000","last_fullsized":"2023-10-09T11:41:00.187145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190990+0000","last_change":"2023-10-09T11:41:00.191111+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190990+0000","last_undegraded":"2023-10-09T11:41:00.190990+0000","last_fullsized":"2023-10-09T11:41:00.190990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187222+0000","last_change":"2023-10-09T11:41:00.187373+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187222+0000","last_undegraded":"2023-10-09T11:41:00.187222+0000","last_fullsized":"2023-10-09T11:41:00.187222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204159+0000","last_change":"2023-10-09T11:41:00.204159+0000","last_active":"2023-10-09T11:41:00.204159+0000","last_peered":"2023-10-09T11:41:00.204159+0000","last_clean":"2023-10-09T11:41:00.204159+0000","last_became_active":"2023-10-09T11:41:00.203128+0000","last_became_peered":"2023-10-09T11:41:00.203128+0000","last_unstale":"2023-10-09T11:41:00.204159+0000","last_undegraded":"2023-10-09T11:41:00.204159+0000","last_fullsized":"2023-10-09T11:41:00.204159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:13.177318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190268+0000","last_change":"2023-10-09T11:41:00.190411+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190268+0000","last_undegraded":"2023-10-09T11:41:00.190268+0000","last_fullsized":"2023-10-09T11:41:00.190268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187098+0000","last_change":"2023-10-09T11:41:00.187265+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187098+0000","last_undegraded":"2023-10-09T11:41:00.187098+0000","last_fullsized":"2023-10-09T11:41:00.187098+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191321+0000","last_change":"2023-10-09T11:41:00.192903+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191321+0000","last_undegraded":"2023-10-09T11:41:00.191321+0000","last_fullsized":"2023-10-09T11:41:00.191321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211342+0000","last_change":"2023-10-09T11:41:00.205012+0000","last_active":"2023-10-09T11:41:00.211342+0000","last_peered":"2023-10-09T11:41:00.211342+0000","last_clean":"2023-10-09T11:41:00.211342+0000","last_became_active":"2023-10-09T11:41:00.204745+0000","last_became_peered":"2023-10-09T11:41:00.204745+0000","last_unstale":"2023-10-09T11:41:00.211342+0000","last_undegraded":"2023-10-09T11:41:00.211342+0000","last_fullsized":"2023-10-09T11:41:00.211342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190948+0000","last_change":"2023-10-09T11:41:00.191089+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190948+0000","last_undegraded":"2023-10-09T11:41:00.190948+0000","last_fullsized":"2023-10-09T11:41:00.190948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199788+0000","last_change":"2023-10-09T11:41:00.199862+0000","last_active":"2023-10-09T11:41:00.199788+0000","last_peered":"2023-10-09T11:41:00.199788+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199592+0000","last_became_peered":"2023-10-09T11:41:00.199592+0000","last_unstale":"2023-10-09T11:41:00.199788+0000","last_undegraded":"2023-10-09T11:41:00.199788+0000","last_fullsized":"2023-10-09T11:41:00.199788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":7,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198789+0000","last_change":"2023-10-09T11:41:00.198858+0000","last_active":"2023-10-09T11:41:00.198789+0000","last_peered":"2023-10-09T11:41:00.198789+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.198619+0000","last_became_peered":"2023-10-09T11:41:00.198619+0000","last_unstale":"2023-10-09T11:41:00.198789+0000","last_undegraded":"2023-10-09T11:41:00.198789+0000","last_fullsized":"2023-10-09T11:41:00.198789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200562+0000","last_change":"2023-10-09T11:41:00.200562+0000","last_active":"2023-10-09T11:41:00.200562+0000","last_peered":"2023-10-09T11:41:00.200562+0000","last_clean":"2023-10-09T11:41:00.200562+0000","last_became_active":"2023-10-09T11:41:00.199082+0000","last_became_peered":"2023-10-09T11:41:00.199082+0000","last_unstale":"2023-10-09T11:41:00.200562+0000","last_undegraded":"2023-10-09T11:41:00.200562+0000","last_fullsized":"2023-10-09T11:41:00.200562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203884+0000","last_change":"2023-10-09T11:41:00.197274+0000","last_active":"2023-10-09T11:41:00.203884+0000","last_peered":"2023-10-09T11:41:00.203884+0000","last_clean":"2023-10-09T11:41:00.203884+0000","last_became_active":"2023-10-09T11:41:00.197002+0000","last_became_peered":"2023-10-09T11:41:00.197002+0000","last_unstale":"2023-10-09T11:41:00.203884+0000","last_undegraded":"2023-10-09T11:41:00.203884+0000","last_fullsized":"2023-10-09T11:41:00.203884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191520+0000","last_change":"2023-10-09T11:41:00.191644+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191520+0000","last_undegraded":"2023-10-09T11:41:00.191520+0000","last_fullsized":"2023-10-09T11:41:00.191520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198845+0000","last_change":"2023-10-09T11:41:00.198845+0000","last_active":"2023-10-09T11:41:00.198845+0000","last_peered":"2023-10-09T11:41:00.198845+0000","last_clean":"2023-10-09T11:41:00.198845+0000","last_became_active":"2023-10-09T11:41:00.198566+0000","last_became_peered":"2023-10-09T11:41:00.198566+0000","last_unstale":"2023-10-09T11:41:00.198845+0000","last_undegraded":"2023-10-09T11:41:00.198845+0000","last_fullsized":"2023-10-09T11:41:00.198845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205095+0000","last_change":"2023-10-09T11:41:00.200060+0000","last_active":"2023-10-09T11:41:00.205095+0000","last_peered":"2023-10-09T11:41:00.205095+0000","last_clean":"2023-10-09T11:41:00.205095+0000","last_became_active":"2023-10-09T11:41:00.199755+0000","last_became_peered":"2023-10-09T11:41:00.199755+0000","last_unstale":"2023-10-09T11:41:00.205095+0000","last_undegraded":"2023-10-09T11:41:00.205095+0000","last_fullsized":"2023-10-09T11:41:00.205095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:12.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":5,"reported_epoch":87,"state":"active","last_fresh":"2023-10-09T11:41:00.199898+0000","last_change":"2023-10-09T11:41:00.199898+0000","last_active":"2023-10-09T11:41:00.199898+0000","last_peered":"2023-10-09T11:41:00.199898+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"2023-10-09T11:41:00.199898+0000","last_became_peered":"2023-10-09T11:41:00.199898+0000","last_unstale":"2023-10-09T11:41:00.199898+0000","last_undegraded":"2023-10-09T11:41:00.199898+0000","last_fullsized":"2023-10-09T11:41:00.199898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191317+0000","last_change":"2023-10-09T11:41:00.191451+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191317+0000","last_undegraded":"2023-10-09T11:41:00.191317+0000","last_fullsized":"2023-10-09T11:41:00.191317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187036+0000","last_change":"2023-10-09T11:41:00.187136+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187036+0000","last_undegraded":"2023-10-09T11:41:00.187036+0000","last_fullsized":"2023-10-09T11:41:00.187036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193811+0000","last_change":"2023-10-09T11:41:00.193927+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193811+0000","last_undegraded":"2023-10-09T11:41:00.193811+0000","last_fullsized":"2023-10-09T11:41:00.193811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192212+0000","last_change":"2023-10-09T11:41:00.192335+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192212+0000","last_undegraded":"2023-10-09T11:41:00.192212+0000","last_fullsized":"2023-10-09T11:41:00.192212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309601+0000","last_change":"2023-10-09T11:40:59.308487+0000","last_active":"2023-10-09T11:40:59.309601+0000","last_peered":"2023-10-09T11:40:59.309601+0000","last_clean":"2023-10-09T11:40:59.309601+0000","last_became_active":"2023-10-09T11:40:59.308214+0000","last_became_peered":"2023-10-09T11:40:59.308214+0000","last_unstale":"2023-10-09T11:40:59.309601+0000","last_undegraded":"2023-10-09T11:40:59.309601+0000","last_fullsized":"2023-10-09T11:40:59.309601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:40.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187352+0000","last_change":"2023-10-09T11:41:00.187486+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187352+0000","last_undegraded":"2023-10-09T11:41:00.187352+0000","last_fullsized":"2023-10-09T11:41:00.187352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192344+0000","last_change":"2023-10-09T11:40:59.305539+0000","last_active":"2023-10-09T11:41:00.192344+0000","last_peered":"2023-10-09T11:41:00.192344+0000","last_clean":"2023-10-09T11:41:00.192344+0000","last_became_active":"2023-10-09T11:40:59.305219+0000","last_became_peered":"2023-10-09T11:40:59.305219+0000","last_unstale":"2023-10-09T11:41:00.192344+0000","last_undegraded":"2023-10-09T11:41:00.192344+0000","last_fullsized":"2023-10-09T11:41:00.192344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:14.227138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192577+0000","last_change":"2023-10-09T11:41:00.192711+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192577+0000","last_undegraded":"2023-10-09T11:41:00.192577+0000","last_fullsized":"2023-10-09T11:41:00.192577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312474+0000","last_change":"2023-10-09T11:40:59.311238+0000","last_active":"2023-10-09T11:40:59.312474+0000","last_peered":"2023-10-09T11:40:59.312474+0000","last_clean":"2023-10-09T11:40:59.312474+0000","last_became_active":"2023-10-09T11:40:59.310971+0000","last_became_peered":"2023-10-09T11:40:59.310971+0000","last_unstale":"2023-10-09T11:40:59.312474+0000","last_undegraded":"2023-10-09T11:40:59.312474+0000","last_fullsized":"2023-10-09T11:40:59.312474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211291+0000","last_change":"2023-10-09T11:41:00.203295+0000","last_active":"2023-10-09T11:41:00.211291+0000","last_peered":"2023-10-09T11:41:00.211291+0000","last_clean":"2023-10-09T11:41:00.211291+0000","last_became_active":"2023-10-09T11:41:00.202916+0000","last_became_peered":"2023-10-09T11:41:00.202916+0000","last_unstale":"2023-10-09T11:41:00.211291+0000","last_undegraded":"2023-10-09T11:41:00.211291+0000","last_fullsized":"2023-10-09T11:41:00.211291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309259+0000","last_change":"2023-10-09T11:40:59.304921+0000","last_active":"2023-10-09T11:40:59.309259+0000","last_peered":"2023-10-09T11:40:59.309259+0000","last_clean":"2023-10-09T11:40:59.309259+0000","last_became_active":"2023-10-09T11:40:59.304647+0000","last_became_peered":"2023-10-09T11:40:59.304647+0000","last_unstale":"2023-10-09T11:40:59.309259+0000","last_undegraded":"2023-10-09T11:40:59.309259+0000","last_fullsized":"2023-10-09T11:40:59.309259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:32.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204348+0000","last_change":"2023-10-09T11:41:00.204348+0000","last_active":"2023-10-09T11:41:00.204348+0000","last_peered":"2023-10-09T11:41:00.204348+0000","last_clean":"2023-10-09T11:41:00.204348+0000","last_became_active":"2023-10-09T11:41:00.204062+0000","last_became_peered":"2023-10-09T11:41:00.204062+0000","last_unstale":"2023-10-09T11:41:00.204348+0000","last_undegraded":"2023-10-09T11:41:00.204348+0000","last_fullsized":"2023-10-09T11:41:00.204348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:38.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310869+0000","last_change":"2023-10-09T11:40:59.309418+0000","last_active":"2023-10-09T11:40:59.310869+0000","last_peered":"2023-10-09T11:40:59.310869+0000","last_clean":"2023-10-09T11:40:59.310869+0000","last_became_active":"2023-10-09T11:40:59.309124+0000","last_became_peered":"2023-10-09T11:40:59.309124+0000","last_unstale":"2023-10-09T11:40:59.310869+0000","last_undegraded":"2023-10-09T11:40:59.310869+0000","last_fullsized":"2023-10-09T11:40:59.310869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:02.793137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201293+0000","last_change":"2023-10-09T11:41:00.201293+0000","last_active":"2023-10-09T11:41:00.201293+0000","last_peered":"2023-10-09T11:41:00.201293+0000","last_clean":"2023-10-09T11:41:00.201293+0000","last_became_active":"2023-10-09T11:41:00.201006+0000","last_became_peered":"2023-10-09T11:41:00.201006+0000","last_unstale":"2023-10-09T11:41:00.201293+0000","last_undegraded":"2023-10-09T11:41:00.201293+0000","last_fullsized":"2023-10-09T11:41:00.201293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:01.783061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309879+0000","last_change":"2023-10-09T11:40:59.309157+0000","last_active":"2023-10-09T11:40:59.309879+0000","last_peered":"2023-10-09T11:40:59.309879+0000","last_clean":"2023-10-09T11:40:59.309879+0000","last_became_active":"2023-10-09T11:40:59.308897+0000","last_became_peered":"2023-10-09T11:40:59.308897+0000","last_unstale":"2023-10-09T11:40:59.309879+0000","last_undegraded":"2023-10-09T11:40:59.309879+0000","last_fullsized":"2023-10-09T11:40:59.309879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.172569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.186949+0000","last_change":"2023-10-09T11:41:00.187132+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.186949+0000","last_undegraded":"2023-10-09T11:41:00.186949+0000","last_fullsized":"2023-10-09T11:41:00.186949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190616+0000","last_change":"2023-10-09T11:40:59.306629+0000","last_active":"2023-10-09T11:41:00.190616+0000","last_peered":"2023-10-09T11:41:00.190616+0000","last_clean":"2023-10-09T11:41:00.190616+0000","last_became_active":"2023-10-09T11:40:59.306323+0000","last_became_peered":"2023-10-09T11:40:59.306323+0000","last_unstale":"2023-10-09T11:41:00.190616+0000","last_undegraded":"2023-10-09T11:41:00.190616+0000","last_fullsized":"2023-10-09T11:41:00.190616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203696+0000","last_change":"2023-10-09T11:41:00.201888+0000","last_active":"2023-10-09T11:41:00.203696+0000","last_peered":"2023-10-09T11:41:00.203696+0000","last_clean":"2023-10-09T11:41:00.203696+0000","last_became_active":"2023-10-09T11:41:00.201618+0000","last_became_peered":"2023-10-09T11:41:00.201618+0000","last_unstale":"2023-10-09T11:41:00.203696+0000","last_undegraded":"2023-10-09T11:41:00.203696+0000","last_fullsized":"2023-10-09T11:41:00.203696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:39.216602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310944+0000","last_change":"2023-10-09T11:40:59.307929+0000","last_active":"2023-10-09T11:40:59.310944+0000","last_peered":"2023-10-09T11:40:59.310944+0000","last_clean":"2023-10-09T11:40:59.310944+0000","last_became_active":"2023-10-09T11:40:59.307659+0000","last_became_peered":"2023-10-09T11:40:59.307659+0000","last_unstale":"2023-10-09T11:40:59.310944+0000","last_undegraded":"2023-10-09T11:40:59.310944+0000","last_fullsized":"2023-10-09T11:40:59.310944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:03.479960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191856+0000","last_change":"2023-10-09T11:41:00.191985+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191856+0000","last_undegraded":"2023-10-09T11:41:00.191856+0000","last_fullsized":"2023-10-09T11:41:00.191856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310815+0000","last_change":"2023-10-09T11:40:59.304810+0000","last_active":"2023-10-09T11:40:59.310815+0000","last_peered":"2023-10-09T11:40:59.310815+0000","last_clean":"2023-10-09T11:40:59.310815+0000","last_became_active":"2023-10-09T11:40:59.304549+0000","last_became_peered":"2023-10-09T11:40:59.304549+0000","last_unstale":"2023-10-09T11:40:59.310815+0000","last_undegraded":"2023-10-09T11:40:59.310815+0000","last_fullsized":"2023-10-09T11:40:59.310815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:08.412199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211386+0000","last_change":"2023-10-09T11:41:00.205378+0000","last_active":"2023-10-09T11:41:00.211386+0000","last_peered":"2023-10-09T11:41:00.211386+0000","last_clean":"2023-10-09T11:41:00.211386+0000","last_became_active":"2023-10-09T11:41:00.205077+0000","last_became_peered":"2023-10-09T11:41:00.205077+0000","last_unstale":"2023-10-09T11:41:00.211386+0000","last_undegraded":"2023-10-09T11:41:00.211386+0000","last_fullsized":"2023-10-09T11:41:00.211386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.308122+0000","last_change":"2023-10-09T11:40:59.305950+0000","last_active":"2023-10-09T11:40:59.308122+0000","last_peered":"2023-10-09T11:40:59.308122+0000","last_clean":"2023-10-09T11:40:59.308122+0000","last_became_active":"2023-10-09T11:40:59.305644+0000","last_became_peered":"2023-10-09T11:40:59.305644+0000","last_unstale":"2023-10-09T11:40:59.308122+0000","last_undegraded":"2023-10-09T11:40:59.308122+0000","last_fullsized":"2023-10-09T11:40:59.308122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211202+0000","last_change":"2023-10-09T11:41:00.208244+0000","last_active":"2023-10-09T11:41:00.211202+0000","last_peered":"2023-10-09T11:41:00.211202+0000","last_clean":"2023-10-09T11:41:00.211202+0000","last_became_active":"2023-10-09T11:41:00.207912+0000","last_became_peered":"2023-10-09T11:41:00.207912+0000","last_unstale":"2023-10-09T11:41:00.211202+0000","last_undegraded":"2023-10-09T11:41:00.211202+0000","last_fullsized":"2023-10-09T11:41:00.211202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"87'3","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304694+0000","last_change":"2023-10-09T11:40:59.303316+0000","last_active":"2023-10-09T11:41:00.304694+0000","last_peered":"2023-10-09T11:41:00.304694+0000","last_clean":"2023-10-09T11:41:00.304694+0000","last_became_active":"2023-10-09T11:40:59.302954+0000","last_became_peered":"2023-10-09T11:40:59.302954+0000","last_unstale":"2023-10-09T11:41:00.304694+0000","last_undegraded":"2023-10-09T11:41:00.304694+0000","last_fullsized":"2023-10-09T11:41:00.304694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:07.142190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208470+0000","last_change":"2023-10-09T11:41:00.208470+0000","last_active":"2023-10-09T11:41:00.208470+0000","last_peered":"2023-10-09T11:41:00.208470+0000","last_clean":"2023-10-09T11:41:00.208470+0000","last_became_active":"2023-10-09T11:41:00.208213+0000","last_became_peered":"2023-10-09T11:41:00.208213+0000","last_unstale":"2023-10-09T11:41:00.208470+0000","last_undegraded":"2023-10-09T11:41:00.208470+0000","last_fullsized":"2023-10-09T11:41:00.208470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"87'6","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.307024+0000","last_change":"2023-10-09T11:40:59.307720+0000","last_active":"2023-10-09T11:41:00.307024+0000","last_peered":"2023-10-09T11:41:00.307024+0000","last_clean":"2023-10-09T11:41:00.307024+0000","last_became_active":"2023-10-09T11:40:59.307437+0000","last_became_peered":"2023-10-09T11:40:59.307437+0000","last_unstale":"2023-10-09T11:41:00.307024+0000","last_undegraded":"2023-10-09T11:41:00.307024+0000","last_fullsized":"2023-10-09T11:41:00.307024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:02.662263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.187212+0000","last_change":"2023-10-09T11:41:00.187377+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.187212+0000","last_undegraded":"2023-10-09T11:41:00.187212+0000","last_fullsized":"2023-10-09T11:41:00.187212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311366+0000","last_change":"2023-10-09T11:40:59.306793+0000","last_active":"2023-10-09T11:40:59.311366+0000","last_peered":"2023-10-09T11:40:59.311366+0000","last_clean":"2023-10-09T11:40:59.311366+0000","last_became_active":"2023-10-09T11:40:59.306510+0000","last_became_peered":"2023-10-09T11:40:59.306510+0000","last_unstale":"2023-10-09T11:40:59.311366+0000","last_undegraded":"2023-10-09T11:40:59.311366+0000","last_fullsized":"2023-10-09T11:40:59.311366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:37.705035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.192936+0000","last_change":"2023-10-09T11:41:00.193063+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.192936+0000","last_undegraded":"2023-10-09T11:41:00.192936+0000","last_fullsized":"2023-10-09T11:41:00.192936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312451+0000","last_change":"2023-10-09T11:40:59.309374+0000","last_active":"2023-10-09T11:40:59.312451+0000","last_peered":"2023-10-09T11:40:59.312451+0000","last_clean":"2023-10-09T11:40:59.312451+0000","last_became_active":"2023-10-09T11:40:59.309083+0000","last_became_peered":"2023-10-09T11:40:59.309083+0000","last_unstale":"2023-10-09T11:40:59.312451+0000","last_undegraded":"2023-10-09T11:40:59.312451+0000","last_fullsized":"2023-10-09T11:40:59.312451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:58.469619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204138+0000","last_change":"2023-10-09T11:41:00.201482+0000","last_active":"2023-10-09T11:41:00.204138+0000","last_peered":"2023-10-09T11:41:00.204138+0000","last_clean":"2023-10-09T11:41:00.204138+0000","last_became_active":"2023-10-09T11:41:00.201208+0000","last_became_peered":"2023-10-09T11:41:00.201208+0000","last_unstale":"2023-10-09T11:41:00.204138+0000","last_undegraded":"2023-10-09T11:41:00.204138+0000","last_fullsized":"2023-10-09T11:41:00.204138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200308+0000","last_change":"2023-10-09T11:40:59.307781+0000","last_active":"2023-10-09T11:41:00.200308+0000","last_peered":"2023-10-09T11:41:00.200308+0000","last_clean":"2023-10-09T11:41:00.200308+0000","last_became_active":"2023-10-09T11:40:59.307502+0000","last_became_peered":"2023-10-09T11:40:59.307502+0000","last_unstale":"2023-10-09T11:41:00.200308+0000","last_undegraded":"2023-10-09T11:41:00.200308+0000","last_fullsized":"2023-10-09T11:41:00.200308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191151+0000","last_change":"2023-10-09T11:41:00.191281+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191151+0000","last_undegraded":"2023-10-09T11:41:00.191151+0000","last_fullsized":"2023-10-09T11:41:00.191151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312668+0000","last_change":"2023-10-09T11:40:59.311585+0000","last_active":"2023-10-09T11:40:59.312668+0000","last_peered":"2023-10-09T11:40:59.312668+0000","last_clean":"2023-10-09T11:40:59.312668+0000","last_became_active":"2023-10-09T11:40:59.310224+0000","last_became_peered":"2023-10-09T11:40:59.310224+0000","last_unstale":"2023-10-09T11:40:59.312668+0000","last_undegraded":"2023-10-09T11:40:59.312668+0000","last_fullsized":"2023-10-09T11:40:59.312668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:28.139612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206440+0000","last_change":"2023-10-09T11:41:00.205217+0000","last_active":"2023-10-09T11:41:00.206440+0000","last_peered":"2023-10-09T11:41:00.206440+0000","last_clean":"2023-10-09T11:41:00.206440+0000","last_became_active":"2023-10-09T11:41:00.204945+0000","last_became_peered":"2023-10-09T11:41:00.204945+0000","last_unstale":"2023-10-09T11:41:00.206440+0000","last_undegraded":"2023-10-09T11:41:00.206440+0000","last_fullsized":"2023-10-09T11:41:00.206440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304354+0000","last_change":"2023-10-09T11:40:59.311483+0000","last_active":"2023-10-09T11:41:00.304354+0000","last_peered":"2023-10-09T11:41:00.304354+0000","last_clean":"2023-10-09T11:41:00.304354+0000","last_became_active":"2023-10-09T11:40:59.311249+0000","last_became_peered":"2023-10-09T11:40:59.311249+0000","last_unstale":"2023-10-09T11:41:00.304354+0000","last_undegraded":"2023-10-09T11:41:00.304354+0000","last_fullsized":"2023-10-09T11:41:00.304354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202133+0000","last_change":"2023-10-09T11:41:00.202133+0000","last_active":"2023-10-09T11:41:00.202133+0000","last_peered":"2023-10-09T11:41:00.202133+0000","last_clean":"2023-10-09T11:41:00.202133+0000","last_became_active":"2023-10-09T11:41:00.201841+0000","last_became_peered":"2023-10-09T11:41:00.201841+0000","last_unstale":"2023-10-09T11:41:00.202133+0000","last_undegraded":"2023-10-09T11:41:00.202133+0000","last_fullsized":"2023-10-09T11:41:00.202133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:28.230567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305220+0000","last_change":"2023-10-09T11:40:59.307530+0000","last_active":"2023-10-09T11:41:00.305220+0000","last_peered":"2023-10-09T11:41:00.305220+0000","last_clean":"2023-10-09T11:41:00.305220+0000","last_became_active":"2023-10-09T11:40:59.307240+0000","last_became_peered":"2023-10-09T11:40:59.307240+0000","last_unstale":"2023-10-09T11:41:00.305220+0000","last_undegraded":"2023-10-09T11:41:00.305220+0000","last_fullsized":"2023-10-09T11:41:00.305220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205520+0000","last_change":"2023-10-09T11:41:00.205520+0000","last_active":"2023-10-09T11:41:00.205520+0000","last_peered":"2023-10-09T11:41:00.205520+0000","last_clean":"2023-10-09T11:41:00.205520+0000","last_became_active":"2023-10-09T11:41:00.205256+0000","last_became_peered":"2023-10-09T11:41:00.205256+0000","last_unstale":"2023-10-09T11:41:00.205520+0000","last_undegraded":"2023-10-09T11:41:00.205520+0000","last_fullsized":"2023-10-09T11:41:00.205520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:47.838489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.305008+0000","last_change":"2023-10-09T11:40:59.303336+0000","last_active":"2023-10-09T11:40:59.305008+0000","last_peered":"2023-10-09T11:40:59.305008+0000","last_clean":"2023-10-09T11:40:59.305008+0000","last_became_active":"2023-10-09T11:40:59.303065+0000","last_became_peered":"2023-10-09T11:40:59.303065+0000","last_unstale":"2023-10-09T11:40:59.305008+0000","last_undegraded":"2023-10-09T11:40:59.305008+0000","last_fullsized":"2023-10-09T11:40:59.305008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:25.211376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190504+0000","last_change":"2023-10-09T11:41:00.190798+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190504+0000","last_undegraded":"2023-10-09T11:41:00.190504+0000","last_fullsized":"2023-10-09T11:41:00.190504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.303449+0000","last_change":"2023-10-09T11:40:59.300828+0000","last_active":"2023-10-09T11:40:59.303449+0000","last_peered":"2023-10-09T11:40:59.303449+0000","last_clean":"2023-10-09T11:40:59.303449+0000","last_became_active":"2023-10-09T11:40:59.300609+0000","last_became_peered":"2023-10-09T11:40:59.300609+0000","last_unstale":"2023-10-09T11:40:59.303449+0000","last_undegraded":"2023-10-09T11:40:59.303449+0000","last_fullsized":"2023-10-09T11:40:59.303449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:36.893466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191323+0000","last_change":"2023-10-09T11:41:00.191446+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191323+0000","last_undegraded":"2023-10-09T11:41:00.191323+0000","last_fullsized":"2023-10-09T11:41:00.191323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307163+0000","last_change":"2023-10-09T11:40:59.305991+0000","last_active":"2023-10-09T11:40:59.307163+0000","last_peered":"2023-10-09T11:40:59.307163+0000","last_clean":"2023-10-09T11:40:59.307163+0000","last_became_active":"2023-10-09T11:40:59.305696+0000","last_became_peered":"2023-10-09T11:40:59.305696+0000","last_unstale":"2023-10-09T11:40:59.307163+0000","last_undegraded":"2023-10-09T11:40:59.307163+0000","last_fullsized":"2023-10-09T11:40:59.307163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:08.639887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190449+0000","last_change":"2023-10-09T11:41:00.190596+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190449+0000","last_undegraded":"2023-10-09T11:41:00.190449+0000","last_fullsized":"2023-10-09T11:41:00.190449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.306840+0000","last_change":"2023-10-09T11:40:59.304467+0000","last_active":"2023-10-09T11:40:59.306840+0000","last_peered":"2023-10-09T11:40:59.306840+0000","last_clean":"2023-10-09T11:40:59.306840+0000","last_became_active":"2023-10-09T11:40:59.304147+0000","last_became_peered":"2023-10-09T11:40:59.304147+0000","last_unstale":"2023-10-09T11:40:59.306840+0000","last_undegraded":"2023-10-09T11:40:59.306840+0000","last_fullsized":"2023-10-09T11:40:59.306840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:23.168219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203833+0000","last_change":"2023-10-09T11:41:00.198067+0000","last_active":"2023-10-09T11:41:00.203833+0000","last_peered":"2023-10-09T11:41:00.203833+0000","last_clean":"2023-10-09T11:41:00.203833+0000","last_became_active":"2023-10-09T11:41:00.197769+0000","last_became_peered":"2023-10-09T11:41:00.197769+0000","last_unstale":"2023-10-09T11:41:00.203833+0000","last_undegraded":"2023-10-09T11:41:00.203833+0000","last_fullsized":"2023-10-09T11:41:00.203833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:42.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.309472+0000","last_change":"2023-10-09T11:40:59.305531+0000","last_active":"2023-10-09T11:40:59.309472+0000","last_peered":"2023-10-09T11:40:59.309472+0000","last_clean":"2023-10-09T11:40:59.309472+0000","last_became_active":"2023-10-09T11:40:59.305268+0000","last_became_peered":"2023-10-09T11:40:59.305268+0000","last_unstale":"2023-10-09T11:40:59.309472+0000","last_undegraded":"2023-10-09T11:40:59.309472+0000","last_fullsized":"2023-10-09T11:40:59.309472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.165900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.196125+0000","last_change":"2023-10-09T11:41:00.196506+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.196125+0000","last_undegraded":"2023-10-09T11:41:00.196125+0000","last_fullsized":"2023-10-09T11:41:00.196125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"87'2","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298838+0000","last_change":"2023-10-09T11:40:59.304065+0000","last_active":"2023-10-09T11:41:00.298838+0000","last_peered":"2023-10-09T11:41:00.298838+0000","last_clean":"2023-10-09T11:41:00.298838+0000","last_became_active":"2023-10-09T11:40:59.303714+0000","last_became_peered":"2023-10-09T11:40:59.303714+0000","last_unstale":"2023-10-09T11:41:00.298838+0000","last_undegraded":"2023-10-09T11:41:00.298838+0000","last_fullsized":"2023-10-09T11:41:00.298838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191742+0000","last_change":"2023-10-09T11:41:00.191851+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191742+0000","last_undegraded":"2023-10-09T11:41:00.191742+0000","last_fullsized":"2023-10-09T11:41:00.191742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.312534+0000","last_change":"2023-10-09T11:40:59.311346+0000","last_active":"2023-10-09T11:40:59.312534+0000","last_peered":"2023-10-09T11:40:59.312534+0000","last_clean":"2023-10-09T11:40:59.312534+0000","last_became_active":"2023-10-09T11:40:59.311075+0000","last_became_peered":"2023-10-09T11:40:59.311075+0000","last_unstale":"2023-10-09T11:40:59.312534+0000","last_undegraded":"2023-10-09T11:40:59.312534+0000","last_fullsized":"2023-10-09T11:40:59.312534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.193641+0000","last_change":"2023-10-09T11:41:00.193782+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.193641+0000","last_undegraded":"2023-10-09T11:41:00.193641+0000","last_fullsized":"2023-10-09T11:41:00.193641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.304229+0000","last_change":"2023-10-09T11:40:59.303219+0000","last_active":"2023-10-09T11:40:59.304229+0000","last_peered":"2023-10-09T11:40:59.304229+0000","last_clean":"2023-10-09T11:40:59.304229+0000","last_became_active":"2023-10-09T11:40:59.302933+0000","last_became_peered":"2023-10-09T11:40:59.302933+0000","last_unstale":"2023-10-09T11:40:59.304229+0000","last_undegraded":"2023-10-09T11:40:59.304229+0000","last_fullsized":"2023-10-09T11:40:59.304229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:27.987978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205722+0000","last_change":"2023-10-09T11:41:00.200343+0000","last_active":"2023-10-09T11:41:00.205722+0000","last_peered":"2023-10-09T11:41:00.205722+0000","last_clean":"2023-10-09T11:41:00.205722+0000","last_became_active":"2023-10-09T11:41:00.200104+0000","last_became_peered":"2023-10-09T11:41:00.200104+0000","last_unstale":"2023-10-09T11:41:00.205722+0000","last_undegraded":"2023-10-09T11:41:00.205722+0000","last_fullsized":"2023-10-09T11:41:00.205722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:41.980263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190960+0000","last_change":"2023-10-09T11:40:59.307643+0000","last_active":"2023-10-09T11:41:00.190960+0000","last_peered":"2023-10-09T11:41:00.190960+0000","last_clean":"2023-10-09T11:41:00.190960+0000","last_became_active":"2023-10-09T11:40:59.307289+0000","last_became_peered":"2023-10-09T11:40:59.307289+0000","last_unstale":"2023-10-09T11:41:00.190960+0000","last_undegraded":"2023-10-09T11:41:00.190960+0000","last_fullsized":"2023-10-09T11:41:00.190960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:08.218968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190155+0000","last_change":"2023-10-09T11:41:00.190283+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190155+0000","last_undegraded":"2023-10-09T11:41:00.190155+0000","last_fullsized":"2023-10-09T11:41:00.190155+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.307364+0000","last_change":"2023-10-09T11:40:59.304273+0000","last_active":"2023-10-09T11:40:59.307364+0000","last_peered":"2023-10-09T11:40:59.307364+0000","last_clean":"2023-10-09T11:40:59.307364+0000","last_became_active":"2023-10-09T11:40:59.303919+0000","last_became_peered":"2023-10-09T11:40:59.303919+0000","last_unstale":"2023-10-09T11:40:59.307364+0000","last_undegraded":"2023-10-09T11:40:59.307364+0000","last_fullsized":"2023-10-09T11:40:59.307364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:48.013168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211595+0000","last_change":"2023-10-09T11:41:00.207662+0000","last_active":"2023-10-09T11:41:00.211595+0000","last_peered":"2023-10-09T11:41:00.211595+0000","last_clean":"2023-10-09T11:41:00.211595+0000","last_became_active":"2023-10-09T11:41:00.207086+0000","last_became_peered":"2023-10-09T11:41:00.207086+0000","last_unstale":"2023-10-09T11:41:00.211595+0000","last_undegraded":"2023-10-09T11:41:00.211595+0000","last_fullsized":"2023-10-09T11:41:00.211595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:06.889859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191114+0000","last_change":"2023-10-09T11:40:59.306512+0000","last_active":"2023-10-09T11:41:00.191114+0000","last_peered":"2023-10-09T11:41:00.191114+0000","last_clean":"2023-10-09T11:41:00.191114+0000","last_became_active":"2023-10-09T11:40:59.306149+0000","last_became_peered":"2023-10-09T11:40:59.306149+0000","last_unstale":"2023-10-09T11:41:00.191114+0000","last_undegraded":"2023-10-09T11:41:00.191114+0000","last_fullsized":"2023-10-09T11:41:00.191114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.190529+0000","last_change":"2023-10-09T11:41:00.190657+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.190529+0000","last_undegraded":"2023-10-09T11:41:00.190529+0000","last_fullsized":"2023-10-09T11:41:00.190529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.311913+0000","last_change":"2023-10-09T11:40:59.308119+0000","last_active":"2023-10-09T11:40:59.311913+0000","last_peered":"2023-10-09T11:40:59.311913+0000","last_clean":"2023-10-09T11:40:59.311913+0000","last_became_active":"2023-10-09T11:40:59.307789+0000","last_became_peered":"2023-10-09T11:40:59.307789+0000","last_unstale":"2023-10-09T11:40:59.311913+0000","last_undegraded":"2023-10-09T11:40:59.311913+0000","last_fullsized":"2023-10-09T11:40:59.311913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200239+0000","last_change":"2023-10-09T11:41:00.191564+0000","last_active":"2023-10-09T11:41:00.200239+0000","last_peered":"2023-10-09T11:41:00.200239+0000","last_clean":"2023-10-09T11:41:00.200239+0000","last_became_active":"2023-10-09T11:41:00.191263+0000","last_became_peered":"2023-10-09T11:41:00.191263+0000","last_unstale":"2023-10-09T11:41:00.200239+0000","last_undegraded":"2023-10-09T11:41:00.200239+0000","last_fullsized":"2023-10-09T11:41:00.200239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.310874+0000","last_change":"2023-10-09T11:40:59.307057+0000","last_active":"2023-10-09T11:40:59.310874+0000","last_peered":"2023-10-09T11:40:59.310874+0000","last_clean":"2023-10-09T11:40:59.310874+0000","last_became_active":"2023-10-09T11:40:59.306788+0000","last_became_peered":"2023-10-09T11:40:59.306788+0000","last_unstale":"2023-10-09T11:40:59.310874+0000","last_undegraded":"2023-10-09T11:40:59.310874+0000","last_fullsized":"2023-10-09T11:40:59.310874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:55.363742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"creating+activating","last_fresh":"2023-10-09T11:41:00.191889+0000","last_change":"2023-10-09T11:41:00.192023+0000","last_active":"2023-10-09T11:40:59.283423+0000","last_peered":"2023-10-09T11:40:59.283423+0000","last_clean":"2023-10-09T11:40:59.283423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:00.191889+0000","last_undegraded":"2023-10-09T11:41:00.191889+0000","last_fullsized":"2023-10-09T11:41:00.191889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"87'1","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192437+0000","last_change":"2023-10-09T11:40:59.305040+0000","last_active":"2023-10-09T11:41:00.192437+0000","last_peered":"2023-10-09T11:41:00.192437+0000","last_clean":"2023-10-09T11:41:00.192437+0000","last_became_active":"2023-10-09T11:40:59.304676+0000","last_became_peered":"2023-10-09T11:40:59.304676+0000","last_unstale":"2023-10-09T11:41:00.192437+0000","last_undegraded":"2023-10-09T11:41:00.192437+0000","last_fullsized":"2023-10-09T11:41:00.192437+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:36.911436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-09T11:40:59.293513+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:40:59.293513+0000","last_peered":"2023-10-09T11:40:59.293513+0000","last_clean":"2023-10-09T11:40:59.293513+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:40:59.293513+0000","last_undegraded":"2023-10-09T11:40:59.293513+0000","last_fullsized":"2023-10-09T11:40:59.293513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1718,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":1675264,"data_stored":1051802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":461946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.33800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.35399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.219}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.248},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303000,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068840,"statfs":{"total":96636764160,"available":96326492160,"internally_reserved":0,"allocated":1654784,"data_stored":1044927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.377},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.75}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.95199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":454559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.57799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":462982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.378},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.432}]}]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:08.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.105+0000 7fa1a0833700 1 Processor -- start 2023-10-09T11:41:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.105+0000 7fa1a0833700 1 -- start start 2023-10-09T11:41:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa1a0833700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 0x7fa19c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa1a0833700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa19c15a400 0x7fa19c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa1a0833700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c15ae40 con 0x7fa19c0cb5a0 2023-10-09T11:41:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa1a0833700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0ce0f0 con 0x7fa19c15a400 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa1a0833700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0cbde0 con 0x7fa19c0cb970 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa19a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa19c0cb5a0 0x7fa19c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52534/0 (socket says 172.21.15.26:52534) 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa19a59c700 1 -- 172.21.15.26:0/1148375359 learned_addr learned my addr 172.21.15.26:0/1148375359 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.106+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1148375359 >> v2:172.21.15.26:3300/0 conn(0x7fa19c15a400 0x7fa19c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa199d9b700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 0x7fa19c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1148375359 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 msgr2=0x7fa19c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 0x7fa19c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1148375359 >> v1:172.21.15.26:6789/0 conn(0x7fa19c0cb5a0 legacy=0x7fa19c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19959a700 1 -- 172.21.15.26:0/1148375359 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673700674 0 0) 0x7fa19c15ae40 con 0x7fa19c0cb5a0 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1148375359 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c15ab60 con 0x7fa19c15a400 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa199d9b700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 0x7fa19c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c156e90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa194009910 tx=0x7fa1940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d75bc59436ba4d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19959a700 1 -- 172.21.15.26:0/1148375359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400b820 con 0x7fa19c15a400 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19959a700 1 -- 172.21.15.26:0/1148375359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19400b980 con 0x7fa19c15a400 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.107+0000 7fa19959a700 1 -- 172.21.15.26:0/1148375359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400bd20 con 0x7fa19c15a400 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 -- 172.21.15.26:0/1148375359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 msgr2=0x7fa19c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c156e90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa194009910 tx=0x7fa1940091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 -- 172.21.15.26:0/1148375359 shutdown_connections 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c156e90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1148375359 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb970 0x7fa19c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 -- 172.21.15.26:0/1148375359 >> 172.21.15.26:0/1148375359 conn(0x7fa19c070e30 msgr2=0x7fa19c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 -- 172.21.15.26:0/1148375359 shutdown_connections 2023-10-09T11:41:09.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.108+0000 7fa1a0833700 1 -- 172.21.15.26:0/1148375359 wait complete. 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.109+0000 7fa1a0833700 1 Processor -- start 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.109+0000 7fa1a0833700 1 -- start start 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb5a0 0x7fa19c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0cb970 0x7fa19c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c16d730 con 0x7fa19c15a400 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c152560 con 0x7fa19c0cb970 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c16ce00 con 0x7fa19c0cb5a0 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48366/0 (socket says 172.21.15.26:48366) 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1870922080 learned_addr learned my addr 172.21.15.26:0/1870922080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19a59c700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb5a0 0x7fa19c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb5a0 msgr2=0x7fa19c152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb5a0 0x7fa19c152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa199d9b700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0cb970 0x7fa19c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0cb970 msgr2=0x7fa19c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0cb970 0x7fa19c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 -- 172.21.15.26:0/1870922080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009420 con 0x7fa19c15a400 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa19ad9d700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa19c06ea60 tx=0x7fa194017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400b820 con 0x7fa19c15a400 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19401a630 con 0x7fa19c15a400 2023-10-09T11:41:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.110+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c16d0e0 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.111+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19401a9f0 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.111+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c16dbc0 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.111+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c16d8a0 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.112+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa19402d440 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.112+0000 7fa1927fc700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 0x7fa17c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.112+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1940866e0 con 0x7fa19c15a400 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.112+0000 7fa19a59c700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 0x7fa17c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.113+0000 7fa19a59c700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 0x7fa17c0696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa18c002180 tx=0x7fa18c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.117+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa194053600 con 0x7fa19c15a400 2023-10-09T11:41:09.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.308+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa19c04c3c0 con 0x7fa17c067200 2023-10-09T11:41:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.317+0000 7fa1927fc700 1 -- 172.21.15.26:0/1870922080 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289036 (secure 0 0 0) 0x7fa19c04c3c0 con 0x7fa17c067200 2023-10-09T11:41:09.322 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 msgr2=0x7fa17c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 0x7fa17c0696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa18c002180 tx=0x7fa18c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 msgr2=0x7fa19c0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa19c06ea60 tx=0x7fa194017000 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 shutdown_connections 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa19c15a400 0x7fa19c0c91f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa17c067200 0x7fa17c0696b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa19c0cb5a0 0x7fa19c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 --2- 172.21.15.26:0/1870922080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0cb970 0x7fa19c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 >> 172.21.15.26:0/1870922080 conn(0x7fa19c070e30 msgr2=0x7fa19c0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 shutdown_connections 2023-10-09T11:41:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.320+0000 7fa1a0833700 1 -- 172.21.15.26:0/1870922080 wait complete. 2023-10-09T11:41:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:09.333 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-10-09T11:41:09.190040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408488,"kb_used_data":9704,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752566232,"statfs":{"total":773094113280,"available":770627821568,"internally_reserved":0,"allocated":9936896,"data_stored":4926228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.003630"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203590+0000","last_change":"2023-10-09T11:41:00.201011+0000","last_active":"2023-10-09T11:41:00.203590+0000","last_peered":"2023-10-09T11:41:00.203590+0000","last_clean":"2023-10-09T11:41:00.203590+0000","last_became_active":"2023-10-09T11:41:00.200617+0000","last_became_peered":"2023-10-09T11:41:00.200617+0000","last_unstale":"2023-10-09T11:41:00.203590+0000","last_undegraded":"2023-10-09T11:41:00.203590+0000","last_fullsized":"2023-10-09T11:41:00.203590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:09.644636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207910+0000","last_change":"2023-10-09T11:41:00.206750+0000","last_active":"2023-10-09T11:41:00.207910+0000","last_peered":"2023-10-09T11:41:00.207910+0000","last_clean":"2023-10-09T11:41:00.207910+0000","last_became_active":"2023-10-09T11:41:00.204096+0000","last_became_peered":"2023-10-09T11:41:00.204096+0000","last_unstale":"2023-10-09T11:41:00.207910+0000","last_undegraded":"2023-10-09T11:41:00.207910+0000","last_fullsized":"2023-10-09T11:41:00.207910+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:42.399046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203633+0000","last_change":"2023-10-09T11:41:00.201143+0000","last_active":"2023-10-09T11:41:00.203633+0000","last_peered":"2023-10-09T11:41:00.203633+0000","last_clean":"2023-10-09T11:41:00.203633+0000","last_became_active":"2023-10-09T11:41:00.200883+0000","last_became_peered":"2023-10-09T11:41:00.200883+0000","last_unstale":"2023-10-09T11:41:00.203633+0000","last_undegraded":"2023-10-09T11:41:00.203633+0000","last_fullsized":"2023-10-09T11:41:00.203633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:03.667012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.196891+0000","last_change":"2023-10-09T11:41:00.194704+0000","last_active":"2023-10-09T11:41:00.196891+0000","last_peered":"2023-10-09T11:41:00.196891+0000","last_clean":"2023-10-09T11:41:00.196891+0000","last_became_active":"2023-10-09T11:41:00.194450+0000","last_became_peered":"2023-10-09T11:41:00.194450+0000","last_unstale":"2023-10-09T11:41:00.196891+0000","last_undegraded":"2023-10-09T11:41:00.196891+0000","last_fullsized":"2023-10-09T11:41:00.196891+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:06.392505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200751+0000","last_change":"2023-10-09T11:41:00.195607+0000","last_active":"2023-10-09T11:41:00.200751+0000","last_peered":"2023-10-09T11:41:00.200751+0000","last_clean":"2023-10-09T11:41:00.200751+0000","last_became_active":"2023-10-09T11:41:00.195342+0000","last_became_peered":"2023-10-09T11:41:00.195342+0000","last_unstale":"2023-10-09T11:41:00.200751+0000","last_undegraded":"2023-10-09T11:41:00.200751+0000","last_fullsized":"2023-10-09T11:41:00.200751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201607+0000","last_change":"2023-10-09T11:41:00.199290+0000","last_active":"2023-10-09T11:41:00.201607+0000","last_peered":"2023-10-09T11:41:00.201607+0000","last_clean":"2023-10-09T11:41:00.201607+0000","last_became_active":"2023-10-09T11:41:00.199006+0000","last_became_peered":"2023-10-09T11:41:00.199006+0000","last_unstale":"2023-10-09T11:41:00.201607+0000","last_undegraded":"2023-10-09T11:41:00.201607+0000","last_fullsized":"2023-10-09T11:41:00.201607+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:37.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201572+0000","last_change":"2023-10-09T11:41:00.197074+0000","last_active":"2023-10-09T11:41:00.201572+0000","last_peered":"2023-10-09T11:41:00.201572+0000","last_clean":"2023-10-09T11:41:00.201572+0000","last_became_active":"2023-10-09T11:41:00.196781+0000","last_became_peered":"2023-10-09T11:41:00.196781+0000","last_unstale":"2023-10-09T11:41:00.201572+0000","last_undegraded":"2023-10-09T11:41:00.201572+0000","last_fullsized":"2023-10-09T11:41:00.201572+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:05.170649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207605+0000","last_change":"2023-10-09T11:41:00.199173+0000","last_active":"2023-10-09T11:41:00.207605+0000","last_peered":"2023-10-09T11:41:00.207605+0000","last_clean":"2023-10-09T11:41:00.207605+0000","last_became_active":"2023-10-09T11:41:00.196113+0000","last_became_peered":"2023-10-09T11:41:00.196113+0000","last_unstale":"2023-10-09T11:41:00.207605+0000","last_undegraded":"2023-10-09T11:41:00.207605+0000","last_fullsized":"2023-10-09T11:41:00.207605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211312+0000","last_change":"2023-10-09T11:41:00.204730+0000","last_active":"2023-10-09T11:41:00.211312+0000","last_peered":"2023-10-09T11:41:00.211312+0000","last_clean":"2023-10-09T11:41:00.211312+0000","last_became_active":"2023-10-09T11:41:00.204428+0000","last_became_peered":"2023-10-09T11:41:00.204428+0000","last_unstale":"2023-10-09T11:41:00.211312+0000","last_undegraded":"2023-10-09T11:41:00.211312+0000","last_fullsized":"2023-10-09T11:41:00.211312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203902+0000","last_change":"2023-10-09T11:41:00.198185+0000","last_active":"2023-10-09T11:41:00.203902+0000","last_peered":"2023-10-09T11:41:00.203902+0000","last_clean":"2023-10-09T11:41:00.203902+0000","last_became_active":"2023-10-09T11:41:00.197877+0000","last_became_peered":"2023-10-09T11:41:00.197877+0000","last_unstale":"2023-10-09T11:41:00.203902+0000","last_undegraded":"2023-10-09T11:41:00.203902+0000","last_fullsized":"2023-10-09T11:41:00.203902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:20.433153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.213908+0000","last_change":"2023-10-09T11:41:00.205889+0000","last_active":"2023-10-09T11:41:00.213908+0000","last_peered":"2023-10-09T11:41:00.213908+0000","last_clean":"2023-10-09T11:41:00.213908+0000","last_became_active":"2023-10-09T11:41:00.205596+0000","last_became_peered":"2023-10-09T11:41:00.205596+0000","last_unstale":"2023-10-09T11:41:00.213908+0000","last_undegraded":"2023-10-09T11:41:00.213908+0000","last_fullsized":"2023-10-09T11:41:00.213908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203639+0000","last_change":"2023-10-09T11:41:00.202214+0000","last_active":"2023-10-09T11:41:00.203639+0000","last_peered":"2023-10-09T11:41:00.203639+0000","last_clean":"2023-10-09T11:41:00.203639+0000","last_became_active":"2023-10-09T11:41:00.201923+0000","last_became_peered":"2023-10-09T11:41:00.201923+0000","last_unstale":"2023-10-09T11:41:00.203639+0000","last_undegraded":"2023-10-09T11:41:00.203639+0000","last_fullsized":"2023-10-09T11:41:00.203639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:37.916185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206376+0000","last_change":"2023-10-09T11:41:00.205362+0000","last_active":"2023-10-09T11:41:00.206376+0000","last_peered":"2023-10-09T11:41:00.206376+0000","last_clean":"2023-10-09T11:41:00.206376+0000","last_became_active":"2023-10-09T11:41:00.205063+0000","last_became_peered":"2023-10-09T11:41:00.205063+0000","last_unstale":"2023-10-09T11:41:00.206376+0000","last_undegraded":"2023-10-09T11:41:00.206376+0000","last_fullsized":"2023-10-09T11:41:00.206376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:58.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206159+0000","last_change":"2023-10-09T11:41:00.203601+0000","last_active":"2023-10-09T11:41:00.206159+0000","last_peered":"2023-10-09T11:41:00.206159+0000","last_clean":"2023-10-09T11:41:00.206159+0000","last_became_active":"2023-10-09T11:41:00.202905+0000","last_became_peered":"2023-10-09T11:41:00.202905+0000","last_unstale":"2023-10-09T11:41:00.206159+0000","last_undegraded":"2023-10-09T11:41:00.206159+0000","last_fullsized":"2023-10-09T11:41:00.206159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:43.808525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203379+0000","last_change":"2023-10-09T11:41:00.199724+0000","last_active":"2023-10-09T11:41:00.203379+0000","last_peered":"2023-10-09T11:41:00.203379+0000","last_clean":"2023-10-09T11:41:00.203379+0000","last_became_active":"2023-10-09T11:41:00.199477+0000","last_became_peered":"2023-10-09T11:41:00.199477+0000","last_unstale":"2023-10-09T11:41:00.203379+0000","last_undegraded":"2023-10-09T11:41:00.203379+0000","last_fullsized":"2023-10-09T11:41:00.203379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208570+0000","last_change":"2023-10-09T11:41:00.204159+0000","last_active":"2023-10-09T11:41:00.208570+0000","last_peered":"2023-10-09T11:41:00.208570+0000","last_clean":"2023-10-09T11:41:00.208570+0000","last_became_active":"2023-10-09T11:41:00.203128+0000","last_became_peered":"2023-10-09T11:41:00.203128+0000","last_unstale":"2023-10-09T11:41:00.208570+0000","last_undegraded":"2023-10-09T11:41:00.208570+0000","last_fullsized":"2023-10-09T11:41:00.208570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:13.177318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207663+0000","last_change":"2023-10-09T11:41:00.202588+0000","last_active":"2023-10-09T11:41:00.207663+0000","last_peered":"2023-10-09T11:41:00.207663+0000","last_clean":"2023-10-09T11:41:00.207663+0000","last_became_active":"2023-10-09T11:41:00.202310+0000","last_became_peered":"2023-10-09T11:41:00.202310+0000","last_unstale":"2023-10-09T11:41:00.207663+0000","last_undegraded":"2023-10-09T11:41:00.207663+0000","last_fullsized":"2023-10-09T11:41:00.207663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:27.752495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.199825+0000","last_change":"2023-10-09T11:41:00.196487+0000","last_active":"2023-10-09T11:41:00.199825+0000","last_peered":"2023-10-09T11:41:00.199825+0000","last_clean":"2023-10-09T11:41:00.199825+0000","last_became_active":"2023-10-09T11:41:00.196228+0000","last_became_peered":"2023-10-09T11:41:00.196228+0000","last_unstale":"2023-10-09T11:41:00.199825+0000","last_undegraded":"2023-10-09T11:41:00.199825+0000","last_fullsized":"2023-10-09T11:41:00.199825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:56.159868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202425+0000","last_change":"2023-10-09T11:41:00.198484+0000","last_active":"2023-10-09T11:41:00.202425+0000","last_peered":"2023-10-09T11:41:00.202425+0000","last_clean":"2023-10-09T11:41:00.202425+0000","last_became_active":"2023-10-09T11:41:00.198190+0000","last_became_peered":"2023-10-09T11:41:00.198190+0000","last_unstale":"2023-10-09T11:41:00.202425+0000","last_undegraded":"2023-10-09T11:41:00.202425+0000","last_fullsized":"2023-10-09T11:41:00.202425+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:04.484709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211342+0000","last_change":"2023-10-09T11:41:00.205012+0000","last_active":"2023-10-09T11:41:00.211342+0000","last_peered":"2023-10-09T11:41:00.211342+0000","last_clean":"2023-10-09T11:41:00.211342+0000","last_became_active":"2023-10-09T11:41:00.204745+0000","last_became_peered":"2023-10-09T11:41:00.204745+0000","last_unstale":"2023-10-09T11:41:00.211342+0000","last_undegraded":"2023-10-09T11:41:00.211342+0000","last_fullsized":"2023-10-09T11:41:00.211342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202209+0000","last_change":"2023-10-09T11:41:00.199624+0000","last_active":"2023-10-09T11:41:00.202209+0000","last_peered":"2023-10-09T11:41:00.202209+0000","last_clean":"2023-10-09T11:41:00.202209+0000","last_became_active":"2023-10-09T11:41:00.199234+0000","last_became_peered":"2023-10-09T11:41:00.199234+0000","last_unstale":"2023-10-09T11:41:00.202209+0000","last_undegraded":"2023-10-09T11:41:00.202209+0000","last_fullsized":"2023-10-09T11:41:00.202209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:28.213760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207522+0000","last_change":"2023-10-09T11:41:00.199862+0000","last_active":"2023-10-09T11:41:00.207522+0000","last_peered":"2023-10-09T11:41:00.207522+0000","last_clean":"2023-10-09T11:41:00.207522+0000","last_became_active":"2023-10-09T11:41:00.199592+0000","last_became_peered":"2023-10-09T11:41:00.199592+0000","last_unstale":"2023-10-09T11:41:00.207522+0000","last_undegraded":"2023-10-09T11:41:00.207522+0000","last_fullsized":"2023-10-09T11:41:00.207522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:49.546259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207653+0000","last_change":"2023-10-09T11:41:00.198858+0000","last_active":"2023-10-09T11:41:00.207653+0000","last_peered":"2023-10-09T11:41:00.207653+0000","last_clean":"2023-10-09T11:41:00.207653+0000","last_became_active":"2023-10-09T11:41:00.198619+0000","last_became_peered":"2023-10-09T11:41:00.198619+0000","last_unstale":"2023-10-09T11:41:00.207653+0000","last_undegraded":"2023-10-09T11:41:00.207653+0000","last_fullsized":"2023-10-09T11:41:00.207653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203325+0000","last_change":"2023-10-09T11:41:00.200562+0000","last_active":"2023-10-09T11:41:00.203325+0000","last_peered":"2023-10-09T11:41:00.203325+0000","last_clean":"2023-10-09T11:41:00.203325+0000","last_became_active":"2023-10-09T11:41:00.199082+0000","last_became_peered":"2023-10-09T11:41:00.199082+0000","last_unstale":"2023-10-09T11:41:00.203325+0000","last_undegraded":"2023-10-09T11:41:00.203325+0000","last_fullsized":"2023-10-09T11:41:00.203325+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203884+0000","last_change":"2023-10-09T11:41:00.197274+0000","last_active":"2023-10-09T11:41:00.203884+0000","last_peered":"2023-10-09T11:41:00.203884+0000","last_clean":"2023-10-09T11:41:00.203884+0000","last_became_active":"2023-10-09T11:41:00.197002+0000","last_became_peered":"2023-10-09T11:41:00.197002+0000","last_unstale":"2023-10-09T11:41:00.203884+0000","last_undegraded":"2023-10-09T11:41:00.203884+0000","last_fullsized":"2023-10-09T11:41:00.203884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207563+0000","last_change":"2023-10-09T11:41:00.200690+0000","last_active":"2023-10-09T11:41:00.207563+0000","last_peered":"2023-10-09T11:41:00.207563+0000","last_clean":"2023-10-09T11:41:00.207563+0000","last_became_active":"2023-10-09T11:41:00.200436+0000","last_became_peered":"2023-10-09T11:41:00.200436+0000","last_unstale":"2023-10-09T11:41:00.207563+0000","last_undegraded":"2023-10-09T11:41:00.207563+0000","last_fullsized":"2023-10-09T11:41:00.207563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:47.914072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201562+0000","last_change":"2023-10-09T11:41:00.198845+0000","last_active":"2023-10-09T11:41:00.201562+0000","last_peered":"2023-10-09T11:41:00.201562+0000","last_clean":"2023-10-09T11:41:00.201562+0000","last_became_active":"2023-10-09T11:41:00.198566+0000","last_became_peered":"2023-10-09T11:41:00.198566+0000","last_unstale":"2023-10-09T11:41:00.201562+0000","last_undegraded":"2023-10-09T11:41:00.201562+0000","last_fullsized":"2023-10-09T11:41:00.201562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205095+0000","last_change":"2023-10-09T11:41:00.200060+0000","last_active":"2023-10-09T11:41:00.205095+0000","last_peered":"2023-10-09T11:41:00.205095+0000","last_clean":"2023-10-09T11:41:00.205095+0000","last_became_active":"2023-10-09T11:41:00.199755+0000","last_became_peered":"2023-10-09T11:41:00.199755+0000","last_unstale":"2023-10-09T11:41:00.205095+0000","last_undegraded":"2023-10-09T11:41:00.205095+0000","last_fullsized":"2023-10-09T11:41:00.205095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:12.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207567+0000","last_change":"2023-10-09T11:41:00.200876+0000","last_active":"2023-10-09T11:41:00.207567+0000","last_peered":"2023-10-09T11:41:00.207567+0000","last_clean":"2023-10-09T11:41:00.207567+0000","last_became_active":"2023-10-09T11:41:00.199898+0000","last_became_peered":"2023-10-09T11:41:00.199898+0000","last_unstale":"2023-10-09T11:41:00.207567+0000","last_undegraded":"2023-10-09T11:41:00.207567+0000","last_fullsized":"2023-10-09T11:41:00.207567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.546270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203107+0000","last_change":"2023-10-09T11:41:00.199011+0000","last_active":"2023-10-09T11:41:00.203107+0000","last_peered":"2023-10-09T11:41:00.203107+0000","last_clean":"2023-10-09T11:41:00.203107+0000","last_became_active":"2023-10-09T11:41:00.198737+0000","last_became_peered":"2023-10-09T11:41:00.198737+0000","last_unstale":"2023-10-09T11:41:00.203107+0000","last_undegraded":"2023-10-09T11:41:00.203107+0000","last_fullsized":"2023-10-09T11:41:00.203107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.197036+0000","last_change":"2023-10-09T11:41:00.195319+0000","last_active":"2023-10-09T11:41:00.197036+0000","last_peered":"2023-10-09T11:41:00.197036+0000","last_clean":"2023-10-09T11:41:00.197036+0000","last_became_active":"2023-10-09T11:41:00.195065+0000","last_became_peered":"2023-10-09T11:41:00.195065+0000","last_unstale":"2023-10-09T11:41:00.197036+0000","last_undegraded":"2023-10-09T11:41:00.197036+0000","last_fullsized":"2023-10-09T11:41:00.197036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:12.728014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207121+0000","last_change":"2023-10-09T11:41:00.205943+0000","last_active":"2023-10-09T11:41:00.207121+0000","last_peered":"2023-10-09T11:41:00.207121+0000","last_clean":"2023-10-09T11:41:00.207121+0000","last_became_active":"2023-10-09T11:41:00.205664+0000","last_became_peered":"2023-10-09T11:41:00.205664+0000","last_unstale":"2023-10-09T11:41:00.207121+0000","last_undegraded":"2023-10-09T11:41:00.207121+0000","last_fullsized":"2023-10-09T11:41:00.207121+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:09.223717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206135+0000","last_change":"2023-10-09T11:41:00.203941+0000","last_active":"2023-10-09T11:41:00.206135+0000","last_peered":"2023-10-09T11:41:00.206135+0000","last_clean":"2023-10-09T11:41:00.206135+0000","last_became_active":"2023-10-09T11:41:00.203647+0000","last_became_peered":"2023-10-09T11:41:00.203647+0000","last_unstale":"2023-10-09T11:41:00.206135+0000","last_undegraded":"2023-10-09T11:41:00.206135+0000","last_fullsized":"2023-10-09T11:41:00.206135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:27.616173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"87'4","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305744+0000","last_change":"2023-10-09T11:40:59.308487+0000","last_active":"2023-10-09T11:41:00.305744+0000","last_peered":"2023-10-09T11:41:00.305744+0000","last_clean":"2023-10-09T11:41:00.305744+0000","last_became_active":"2023-10-09T11:40:59.308214+0000","last_became_peered":"2023-10-09T11:40:59.308214+0000","last_unstale":"2023-10-09T11:41:00.305744+0000","last_undegraded":"2023-10-09T11:41:00.305744+0000","last_fullsized":"2023-10-09T11:41:00.305744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:40.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205529+0000","last_change":"2023-10-09T11:41:00.202392+0000","last_active":"2023-10-09T11:41:00.205529+0000","last_peered":"2023-10-09T11:41:00.205529+0000","last_clean":"2023-10-09T11:41:00.205529+0000","last_became_active":"2023-10-09T11:41:00.202101+0000","last_became_peered":"2023-10-09T11:41:00.202101+0000","last_unstale":"2023-10-09T11:41:00.205529+0000","last_undegraded":"2023-10-09T11:41:00.205529+0000","last_fullsized":"2023-10-09T11:41:00.205529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:35.291231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298641+0000","last_change":"2023-10-09T11:40:59.305539+0000","last_active":"2023-10-09T11:41:00.298641+0000","last_peered":"2023-10-09T11:41:00.298641+0000","last_clean":"2023-10-09T11:41:00.298641+0000","last_became_active":"2023-10-09T11:40:59.305219+0000","last_became_peered":"2023-10-09T11:40:59.305219+0000","last_unstale":"2023-10-09T11:41:00.298641+0000","last_undegraded":"2023-10-09T11:41:00.298641+0000","last_fullsized":"2023-10-09T11:41:00.298641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:14.227138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206922+0000","last_change":"2023-10-09T11:41:00.205229+0000","last_active":"2023-10-09T11:41:00.206922+0000","last_peered":"2023-10-09T11:41:00.206922+0000","last_clean":"2023-10-09T11:41:00.206922+0000","last_became_active":"2023-10-09T11:41:00.204950+0000","last_became_peered":"2023-10-09T11:41:00.204950+0000","last_unstale":"2023-10-09T11:41:00.206922+0000","last_undegraded":"2023-10-09T11:41:00.206922+0000","last_fullsized":"2023-10-09T11:41:00.206922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:15.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298859+0000","last_change":"2023-10-09T11:40:59.311238+0000","last_active":"2023-10-09T11:41:00.298859+0000","last_peered":"2023-10-09T11:41:00.298859+0000","last_clean":"2023-10-09T11:41:00.298859+0000","last_became_active":"2023-10-09T11:40:59.310971+0000","last_became_peered":"2023-10-09T11:40:59.310971+0000","last_unstale":"2023-10-09T11:41:00.298859+0000","last_undegraded":"2023-10-09T11:41:00.298859+0000","last_fullsized":"2023-10-09T11:41:00.298859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211291+0000","last_change":"2023-10-09T11:41:00.203295+0000","last_active":"2023-10-09T11:41:00.211291+0000","last_peered":"2023-10-09T11:41:00.211291+0000","last_clean":"2023-10-09T11:41:00.211291+0000","last_became_active":"2023-10-09T11:41:00.202916+0000","last_became_peered":"2023-10-09T11:41:00.202916+0000","last_unstale":"2023-10-09T11:41:00.211291+0000","last_undegraded":"2023-10-09T11:41:00.211291+0000","last_fullsized":"2023-10-09T11:41:00.211291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304890+0000","last_change":"2023-10-09T11:40:59.304921+0000","last_active":"2023-10-09T11:41:00.304890+0000","last_peered":"2023-10-09T11:41:00.304890+0000","last_clean":"2023-10-09T11:41:00.304890+0000","last_became_active":"2023-10-09T11:40:59.304647+0000","last_became_peered":"2023-10-09T11:40:59.304647+0000","last_unstale":"2023-10-09T11:41:00.304890+0000","last_undegraded":"2023-10-09T11:41:00.304890+0000","last_fullsized":"2023-10-09T11:41:00.304890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:32.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208677+0000","last_change":"2023-10-09T11:41:00.204348+0000","last_active":"2023-10-09T11:41:00.208677+0000","last_peered":"2023-10-09T11:41:00.208677+0000","last_clean":"2023-10-09T11:41:00.208677+0000","last_became_active":"2023-10-09T11:41:00.204062+0000","last_became_peered":"2023-10-09T11:41:00.204062+0000","last_unstale":"2023-10-09T11:41:00.208677+0000","last_undegraded":"2023-10-09T11:41:00.208677+0000","last_fullsized":"2023-10-09T11:41:00.208677+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:38.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305283+0000","last_change":"2023-10-09T11:40:59.309418+0000","last_active":"2023-10-09T11:41:00.305283+0000","last_peered":"2023-10-09T11:41:00.305283+0000","last_clean":"2023-10-09T11:41:00.305283+0000","last_became_active":"2023-10-09T11:40:59.309124+0000","last_became_peered":"2023-10-09T11:40:59.309124+0000","last_unstale":"2023-10-09T11:41:00.305283+0000","last_undegraded":"2023-10-09T11:41:00.305283+0000","last_fullsized":"2023-10-09T11:41:00.305283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:02.793137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205668+0000","last_change":"2023-10-09T11:41:00.201293+0000","last_active":"2023-10-09T11:41:00.205668+0000","last_peered":"2023-10-09T11:41:00.205668+0000","last_clean":"2023-10-09T11:41:00.205668+0000","last_became_active":"2023-10-09T11:41:00.201006+0000","last_became_peered":"2023-10-09T11:41:00.201006+0000","last_unstale":"2023-10-09T11:41:00.205668+0000","last_undegraded":"2023-10-09T11:41:00.205668+0000","last_fullsized":"2023-10-09T11:41:00.205668+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:01.783061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298131+0000","last_change":"2023-10-09T11:40:59.309157+0000","last_active":"2023-10-09T11:41:00.298131+0000","last_peered":"2023-10-09T11:41:00.298131+0000","last_clean":"2023-10-09T11:41:00.298131+0000","last_became_active":"2023-10-09T11:40:59.308897+0000","last_became_peered":"2023-10-09T11:40:59.308897+0000","last_unstale":"2023-10-09T11:41:00.298131+0000","last_undegraded":"2023-10-09T11:41:00.298131+0000","last_fullsized":"2023-10-09T11:41:00.298131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:12.172569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203387+0000","last_change":"2023-10-09T11:41:00.199519+0000","last_active":"2023-10-09T11:41:00.203387+0000","last_peered":"2023-10-09T11:41:00.203387+0000","last_clean":"2023-10-09T11:41:00.203387+0000","last_became_active":"2023-10-09T11:41:00.199236+0000","last_became_peered":"2023-10-09T11:41:00.199236+0000","last_unstale":"2023-10-09T11:41:00.203387+0000","last_undegraded":"2023-10-09T11:41:00.203387+0000","last_fullsized":"2023-10-09T11:41:00.203387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:16.886142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190616+0000","last_change":"2023-10-09T11:40:59.306629+0000","last_active":"2023-10-09T11:41:00.190616+0000","last_peered":"2023-10-09T11:41:00.190616+0000","last_clean":"2023-10-09T11:41:00.190616+0000","last_became_active":"2023-10-09T11:40:59.306323+0000","last_became_peered":"2023-10-09T11:40:59.306323+0000","last_unstale":"2023-10-09T11:41:00.190616+0000","last_undegraded":"2023-10-09T11:41:00.190616+0000","last_fullsized":"2023-10-09T11:41:00.190616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203696+0000","last_change":"2023-10-09T11:41:00.201888+0000","last_active":"2023-10-09T11:41:00.203696+0000","last_peered":"2023-10-09T11:41:00.203696+0000","last_clean":"2023-10-09T11:41:00.203696+0000","last_became_active":"2023-10-09T11:41:00.201618+0000","last_became_peered":"2023-10-09T11:41:00.201618+0000","last_unstale":"2023-10-09T11:41:00.203696+0000","last_undegraded":"2023-10-09T11:41:00.203696+0000","last_fullsized":"2023-10-09T11:41:00.203696+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:39.216602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.194127+0000","last_change":"2023-10-09T11:40:59.307929+0000","last_active":"2023-10-09T11:41:00.194127+0000","last_peered":"2023-10-09T11:41:00.194127+0000","last_clean":"2023-10-09T11:41:00.194127+0000","last_became_active":"2023-10-09T11:40:59.307659+0000","last_became_peered":"2023-10-09T11:40:59.307659+0000","last_unstale":"2023-10-09T11:41:00.194127+0000","last_undegraded":"2023-10-09T11:41:00.194127+0000","last_fullsized":"2023-10-09T11:41:00.194127+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:03.479960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207607+0000","last_change":"2023-10-09T11:41:00.205269+0000","last_active":"2023-10-09T11:41:00.207607+0000","last_peered":"2023-10-09T11:41:00.207607+0000","last_clean":"2023-10-09T11:41:00.207607+0000","last_became_active":"2023-10-09T11:41:00.205024+0000","last_became_peered":"2023-10-09T11:41:00.205024+0000","last_unstale":"2023-10-09T11:41:00.207607+0000","last_undegraded":"2023-10-09T11:41:00.207607+0000","last_fullsized":"2023-10-09T11:41:00.207607+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:31.965628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.192404+0000","last_change":"2023-10-09T11:40:59.304810+0000","last_active":"2023-10-09T11:41:00.192404+0000","last_peered":"2023-10-09T11:41:00.192404+0000","last_clean":"2023-10-09T11:41:00.192404+0000","last_became_active":"2023-10-09T11:40:59.304549+0000","last_became_peered":"2023-10-09T11:40:59.304549+0000","last_unstale":"2023-10-09T11:41:00.192404+0000","last_undegraded":"2023-10-09T11:41:00.192404+0000","last_fullsized":"2023-10-09T11:41:00.192404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:08.412199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211386+0000","last_change":"2023-10-09T11:41:00.205378+0000","last_active":"2023-10-09T11:41:00.211386+0000","last_peered":"2023-10-09T11:41:00.211386+0000","last_clean":"2023-10-09T11:41:00.211386+0000","last_became_active":"2023-10-09T11:41:00.205077+0000","last_became_peered":"2023-10-09T11:41:00.205077+0000","last_unstale":"2023-10-09T11:41:00.211386+0000","last_undegraded":"2023-10-09T11:41:00.211386+0000","last_fullsized":"2023-10-09T11:41:00.211386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:55:12.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.187237+0000","last_change":"2023-10-09T11:40:59.305950+0000","last_active":"2023-10-09T11:41:00.187237+0000","last_peered":"2023-10-09T11:41:00.187237+0000","last_clean":"2023-10-09T11:41:00.187237+0000","last_became_active":"2023-10-09T11:40:59.305644+0000","last_became_peered":"2023-10-09T11:40:59.305644+0000","last_unstale":"2023-10-09T11:41:00.187237+0000","last_undegraded":"2023-10-09T11:41:00.187237+0000","last_fullsized":"2023-10-09T11:41:00.187237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211202+0000","last_change":"2023-10-09T11:41:00.208244+0000","last_active":"2023-10-09T11:41:00.211202+0000","last_peered":"2023-10-09T11:41:00.211202+0000","last_clean":"2023-10-09T11:41:00.211202+0000","last_became_active":"2023-10-09T11:41:00.207912+0000","last_became_peered":"2023-10-09T11:41:00.207912+0000","last_unstale":"2023-10-09T11:41:00.211202+0000","last_undegraded":"2023-10-09T11:41:00.211202+0000","last_fullsized":"2023-10-09T11:41:00.211202+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:15.231888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"87'3","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304812+0000","last_change":"2023-10-09T11:40:59.303316+0000","last_active":"2023-10-09T11:41:00.304812+0000","last_peered":"2023-10-09T11:41:00.304812+0000","last_clean":"2023-10-09T11:41:00.304812+0000","last_became_active":"2023-10-09T11:40:59.302954+0000","last_became_peered":"2023-10-09T11:40:59.302954+0000","last_unstale":"2023-10-09T11:41:00.304812+0000","last_undegraded":"2023-10-09T11:41:00.304812+0000","last_fullsized":"2023-10-09T11:41:00.304812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:07.142190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.214067+0000","last_change":"2023-10-09T11:41:00.208470+0000","last_active":"2023-10-09T11:41:00.214067+0000","last_peered":"2023-10-09T11:41:00.214067+0000","last_clean":"2023-10-09T11:41:00.214067+0000","last_became_active":"2023-10-09T11:41:00.208213+0000","last_became_peered":"2023-10-09T11:41:00.208213+0000","last_unstale":"2023-10-09T11:41:00.214067+0000","last_undegraded":"2023-10-09T11:41:00.214067+0000","last_fullsized":"2023-10-09T11:41:00.214067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"87'6","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.307024+0000","last_change":"2023-10-09T11:40:59.307720+0000","last_active":"2023-10-09T11:41:00.307024+0000","last_peered":"2023-10-09T11:41:00.307024+0000","last_clean":"2023-10-09T11:41:00.307024+0000","last_became_active":"2023-10-09T11:40:59.307437+0000","last_became_peered":"2023-10-09T11:40:59.307437+0000","last_unstale":"2023-10-09T11:41:00.307024+0000","last_undegraded":"2023-10-09T11:41:00.307024+0000","last_fullsized":"2023-10-09T11:41:00.307024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:02.662263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198210+0000","last_change":"2023-10-09T11:41:00.196050+0000","last_active":"2023-10-09T11:41:00.198210+0000","last_peered":"2023-10-09T11:41:00.198210+0000","last_clean":"2023-10-09T11:41:00.198210+0000","last_became_active":"2023-10-09T11:41:00.195754+0000","last_became_peered":"2023-10-09T11:41:00.195754+0000","last_unstale":"2023-10-09T11:41:00.198210+0000","last_undegraded":"2023-10-09T11:41:00.198210+0000","last_fullsized":"2023-10-09T11:41:00.198210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:12.144253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304605+0000","last_change":"2023-10-09T11:40:59.306793+0000","last_active":"2023-10-09T11:41:00.304605+0000","last_peered":"2023-10-09T11:41:00.304605+0000","last_clean":"2023-10-09T11:41:00.304605+0000","last_became_active":"2023-10-09T11:40:59.306510+0000","last_became_peered":"2023-10-09T11:40:59.306510+0000","last_unstale":"2023-10-09T11:41:00.304605+0000","last_undegraded":"2023-10-09T11:41:00.304605+0000","last_fullsized":"2023-10-09T11:41:00.304605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:37.705035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.202633+0000","last_change":"2023-10-09T11:41:00.198573+0000","last_active":"2023-10-09T11:41:00.202633+0000","last_peered":"2023-10-09T11:41:00.202633+0000","last_clean":"2023-10-09T11:41:00.202633+0000","last_became_active":"2023-10-09T11:41:00.198293+0000","last_became_peered":"2023-10-09T11:41:00.198293+0000","last_unstale":"2023-10-09T11:41:00.202633+0000","last_undegraded":"2023-10-09T11:41:00.202633+0000","last_fullsized":"2023-10-09T11:41:00.202633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191657+0000","last_change":"2023-10-09T11:40:59.309374+0000","last_active":"2023-10-09T11:41:00.191657+0000","last_peered":"2023-10-09T11:41:00.191657+0000","last_clean":"2023-10-09T11:41:00.191657+0000","last_became_active":"2023-10-09T11:40:59.309083+0000","last_became_peered":"2023-10-09T11:40:59.309083+0000","last_unstale":"2023-10-09T11:41:00.191657+0000","last_undegraded":"2023-10-09T11:41:00.191657+0000","last_fullsized":"2023-10-09T11:41:00.191657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:58.469619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204138+0000","last_change":"2023-10-09T11:41:00.201482+0000","last_active":"2023-10-09T11:41:00.204138+0000","last_peered":"2023-10-09T11:41:00.204138+0000","last_clean":"2023-10-09T11:41:00.204138+0000","last_became_active":"2023-10-09T11:41:00.201208+0000","last_became_peered":"2023-10-09T11:41:00.201208+0000","last_unstale":"2023-10-09T11:41:00.204138+0000","last_undegraded":"2023-10-09T11:41:00.204138+0000","last_fullsized":"2023-10-09T11:41:00.204138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:35.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200308+0000","last_change":"2023-10-09T11:40:59.307781+0000","last_active":"2023-10-09T11:41:00.200308+0000","last_peered":"2023-10-09T11:41:00.200308+0000","last_clean":"2023-10-09T11:41:00.200308+0000","last_became_active":"2023-10-09T11:40:59.307502+0000","last_became_peered":"2023-10-09T11:40:59.307502+0000","last_unstale":"2023-10-09T11:41:00.200308+0000","last_undegraded":"2023-10-09T11:41:00.200308+0000","last_fullsized":"2023-10-09T11:41:00.200308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207524+0000","last_change":"2023-10-09T11:41:00.206318+0000","last_active":"2023-10-09T11:41:00.207524+0000","last_peered":"2023-10-09T11:41:00.207524+0000","last_clean":"2023-10-09T11:41:00.207524+0000","last_became_active":"2023-10-09T11:41:00.205445+0000","last_became_peered":"2023-10-09T11:41:00.205445+0000","last_unstale":"2023-10-09T11:41:00.207524+0000","last_undegraded":"2023-10-09T11:41:00.207524+0000","last_fullsized":"2023-10-09T11:41:00.207524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:01.759662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"87'8","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.306494+0000","last_change":"2023-10-09T11:40:59.311585+0000","last_active":"2023-10-09T11:41:00.306494+0000","last_peered":"2023-10-09T11:41:00.306494+0000","last_clean":"2023-10-09T11:41:00.306494+0000","last_became_active":"2023-10-09T11:40:59.310224+0000","last_became_peered":"2023-10-09T11:40:59.310224+0000","last_unstale":"2023-10-09T11:41:00.306494+0000","last_undegraded":"2023-10-09T11:41:00.306494+0000","last_fullsized":"2023-10-09T11:41:00.306494+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:28.139612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206440+0000","last_change":"2023-10-09T11:41:00.205217+0000","last_active":"2023-10-09T11:41:00.206440+0000","last_peered":"2023-10-09T11:41:00.206440+0000","last_clean":"2023-10-09T11:41:00.206440+0000","last_became_active":"2023-10-09T11:41:00.204945+0000","last_became_peered":"2023-10-09T11:41:00.204945+0000","last_unstale":"2023-10-09T11:41:00.206440+0000","last_undegraded":"2023-10-09T11:41:00.206440+0000","last_fullsized":"2023-10-09T11:41:00.206440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:08.146939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304354+0000","last_change":"2023-10-09T11:40:59.311483+0000","last_active":"2023-10-09T11:41:00.304354+0000","last_peered":"2023-10-09T11:41:00.304354+0000","last_clean":"2023-10-09T11:41:00.304354+0000","last_became_active":"2023-10-09T11:40:59.311249+0000","last_became_peered":"2023-10-09T11:40:59.311249+0000","last_unstale":"2023-10-09T11:41:00.304354+0000","last_undegraded":"2023-10-09T11:41:00.304354+0000","last_fullsized":"2023-10-09T11:41:00.304354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203520+0000","last_change":"2023-10-09T11:41:00.202133+0000","last_active":"2023-10-09T11:41:00.203520+0000","last_peered":"2023-10-09T11:41:00.203520+0000","last_clean":"2023-10-09T11:41:00.203520+0000","last_became_active":"2023-10-09T11:41:00.201841+0000","last_became_peered":"2023-10-09T11:41:00.201841+0000","last_unstale":"2023-10-09T11:41:00.203520+0000","last_undegraded":"2023-10-09T11:41:00.203520+0000","last_fullsized":"2023-10-09T11:41:00.203520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:28.230567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.305220+0000","last_change":"2023-10-09T11:40:59.307530+0000","last_active":"2023-10-09T11:41:00.305220+0000","last_peered":"2023-10-09T11:41:00.305220+0000","last_clean":"2023-10-09T11:41:00.305220+0000","last_became_active":"2023-10-09T11:40:59.307240+0000","last_became_peered":"2023-10-09T11:40:59.307240+0000","last_unstale":"2023-10-09T11:41:00.305220+0000","last_undegraded":"2023-10-09T11:41:00.305220+0000","last_fullsized":"2023-10-09T11:41:00.305220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:46.884417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.213763+0000","last_change":"2023-10-09T11:41:00.205520+0000","last_active":"2023-10-09T11:41:00.213763+0000","last_peered":"2023-10-09T11:41:00.213763+0000","last_clean":"2023-10-09T11:41:00.213763+0000","last_became_active":"2023-10-09T11:41:00.205256+0000","last_became_peered":"2023-10-09T11:41:00.205256+0000","last_unstale":"2023-10-09T11:41:00.213763+0000","last_undegraded":"2023-10-09T11:41:00.213763+0000","last_fullsized":"2023-10-09T11:41:00.213763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:47.838489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.198376+0000","last_change":"2023-10-09T11:40:59.303336+0000","last_active":"2023-10-09T11:41:00.198376+0000","last_peered":"2023-10-09T11:41:00.198376+0000","last_clean":"2023-10-09T11:41:00.198376+0000","last_became_active":"2023-10-09T11:40:59.303065+0000","last_became_peered":"2023-10-09T11:40:59.303065+0000","last_unstale":"2023-10-09T11:41:00.198376+0000","last_undegraded":"2023-10-09T11:41:00.198376+0000","last_fullsized":"2023-10-09T11:41:00.198376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:25.211376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205504+0000","last_change":"2023-10-09T11:41:00.201551+0000","last_active":"2023-10-09T11:41:00.205504+0000","last_peered":"2023-10-09T11:41:00.205504+0000","last_clean":"2023-10-09T11:41:00.205504+0000","last_became_active":"2023-10-09T11:41:00.201241+0000","last_became_peered":"2023-10-09T11:41:00.201241+0000","last_unstale":"2023-10-09T11:41:00.205504+0000","last_undegraded":"2023-10-09T11:41:00.205504+0000","last_fullsized":"2023-10-09T11:41:00.205504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:18:23.849331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.298799+0000","last_change":"2023-10-09T11:40:59.300828+0000","last_active":"2023-10-09T11:41:00.298799+0000","last_peered":"2023-10-09T11:41:00.298799+0000","last_clean":"2023-10-09T11:41:00.298799+0000","last_became_active":"2023-10-09T11:40:59.300609+0000","last_became_peered":"2023-10-09T11:40:59.300609+0000","last_unstale":"2023-10-09T11:41:00.298799+0000","last_undegraded":"2023-10-09T11:41:00.298799+0000","last_fullsized":"2023-10-09T11:41:00.298799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:36.893466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.208877+0000","last_change":"2023-10-09T11:41:00.208291+0000","last_active":"2023-10-09T11:41:00.208877+0000","last_peered":"2023-10-09T11:41:00.208877+0000","last_clean":"2023-10-09T11:41:00.208877+0000","last_became_active":"2023-10-09T11:41:00.207986+0000","last_became_peered":"2023-10-09T11:41:00.207986+0000","last_unstale":"2023-10-09T11:41:00.208877+0000","last_undegraded":"2023-10-09T11:41:00.208877+0000","last_fullsized":"2023-10-09T11:41:00.208877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:30.309750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.193206+0000","last_change":"2023-10-09T11:40:59.305991+0000","last_active":"2023-10-09T11:41:00.193206+0000","last_peered":"2023-10-09T11:41:00.193206+0000","last_clean":"2023-10-09T11:41:00.193206+0000","last_became_active":"2023-10-09T11:40:59.305696+0000","last_became_peered":"2023-10-09T11:40:59.305696+0000","last_unstale":"2023-10-09T11:41:00.193206+0000","last_undegraded":"2023-10-09T11:41:00.193206+0000","last_fullsized":"2023-10-09T11:41:00.193206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:08.639887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204206+0000","last_change":"2023-10-09T11:41:00.201042+0000","last_active":"2023-10-09T11:41:00.204206+0000","last_peered":"2023-10-09T11:41:00.204206+0000","last_clean":"2023-10-09T11:41:00.204206+0000","last_became_active":"2023-10-09T11:41:00.200759+0000","last_became_peered":"2023-10-09T11:41:00.200759+0000","last_unstale":"2023-10-09T11:41:00.204206+0000","last_undegraded":"2023-10-09T11:41:00.204206+0000","last_fullsized":"2023-10-09T11:41:00.204206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:09.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191822+0000","last_change":"2023-10-09T11:40:59.304467+0000","last_active":"2023-10-09T11:41:00.191822+0000","last_peered":"2023-10-09T11:41:00.191822+0000","last_clean":"2023-10-09T11:41:00.191822+0000","last_became_active":"2023-10-09T11:40:59.304147+0000","last_became_peered":"2023-10-09T11:40:59.304147+0000","last_unstale":"2023-10-09T11:41:00.191822+0000","last_undegraded":"2023-10-09T11:41:00.191822+0000","last_fullsized":"2023-10-09T11:41:00.191822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:23.168219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.203833+0000","last_change":"2023-10-09T11:41:00.198067+0000","last_active":"2023-10-09T11:41:00.203833+0000","last_peered":"2023-10-09T11:41:00.203833+0000","last_clean":"2023-10-09T11:41:00.203833+0000","last_became_active":"2023-10-09T11:41:00.197769+0000","last_became_peered":"2023-10-09T11:41:00.197769+0000","last_unstale":"2023-10-09T11:41:00.203833+0000","last_undegraded":"2023-10-09T11:41:00.203833+0000","last_fullsized":"2023-10-09T11:41:00.203833+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:42.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190178+0000","last_change":"2023-10-09T11:40:59.305531+0000","last_active":"2023-10-09T11:41:00.190178+0000","last_peered":"2023-10-09T11:41:00.190178+0000","last_clean":"2023-10-09T11:41:00.190178+0000","last_became_active":"2023-10-09T11:40:59.305268+0000","last_became_peered":"2023-10-09T11:40:59.305268+0000","last_unstale":"2023-10-09T11:41:00.190178+0000","last_undegraded":"2023-10-09T11:41:00.190178+0000","last_fullsized":"2023-10-09T11:41:00.190178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.165900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207585+0000","last_change":"2023-10-09T11:41:00.204550+0000","last_active":"2023-10-09T11:41:00.207585+0000","last_peered":"2023-10-09T11:41:00.207585+0000","last_clean":"2023-10-09T11:41:00.207585+0000","last_became_active":"2023-10-09T11:41:00.204284+0000","last_became_peered":"2023-10-09T11:41:00.204284+0000","last_unstale":"2023-10-09T11:41:00.207585+0000","last_undegraded":"2023-10-09T11:41:00.207585+0000","last_fullsized":"2023-10-09T11:41:00.207585+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:55.189180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"87'2","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304513+0000","last_change":"2023-10-09T11:40:59.304065+0000","last_active":"2023-10-09T11:41:00.304513+0000","last_peered":"2023-10-09T11:41:00.304513+0000","last_clean":"2023-10-09T11:41:00.304513+0000","last_became_active":"2023-10-09T11:40:59.303714+0000","last_became_peered":"2023-10-09T11:40:59.303714+0000","last_unstale":"2023-10-09T11:41:00.304513+0000","last_undegraded":"2023-10-09T11:41:00.304513+0000","last_fullsized":"2023-10-09T11:41:00.304513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.201511+0000","last_change":"2023-10-09T11:41:00.197661+0000","last_active":"2023-10-09T11:41:00.201511+0000","last_peered":"2023-10-09T11:41:00.201511+0000","last_clean":"2023-10-09T11:41:00.201511+0000","last_became_active":"2023-10-09T11:41:00.197377+0000","last_became_peered":"2023-10-09T11:41:00.197377+0000","last_unstale":"2023-10-09T11:41:00.201511+0000","last_undegraded":"2023-10-09T11:41:00.201511+0000","last_fullsized":"2023-10-09T11:41:00.201511+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:24.172968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.196736+0000","last_change":"2023-10-09T11:40:59.311346+0000","last_active":"2023-10-09T11:41:00.196736+0000","last_peered":"2023-10-09T11:41:00.196736+0000","last_clean":"2023-10-09T11:41:00.196736+0000","last_became_active":"2023-10-09T11:40:59.311075+0000","last_became_peered":"2023-10-09T11:40:59.311075+0000","last_unstale":"2023-10-09T11:41:00.196736+0000","last_undegraded":"2023-10-09T11:41:00.196736+0000","last_fullsized":"2023-10-09T11:41:00.196736+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:11.286816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206801+0000","last_change":"2023-10-09T11:41:00.204666+0000","last_active":"2023-10-09T11:41:00.206801+0000","last_peered":"2023-10-09T11:41:00.206801+0000","last_clean":"2023-10-09T11:41:00.206801+0000","last_became_active":"2023-10-09T11:41:00.204384+0000","last_became_peered":"2023-10-09T11:41:00.204384+0000","last_unstale":"2023-10-09T11:41:00.206801+0000","last_undegraded":"2023-10-09T11:41:00.206801+0000","last_fullsized":"2023-10-09T11:41:00.206801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:08.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190042+0000","last_change":"2023-10-09T11:40:59.303219+0000","last_active":"2023-10-09T11:41:00.190042+0000","last_peered":"2023-10-09T11:41:00.190042+0000","last_clean":"2023-10-09T11:41:00.190042+0000","last_became_active":"2023-10-09T11:40:59.302933+0000","last_became_peered":"2023-10-09T11:40:59.302933+0000","last_unstale":"2023-10-09T11:41:00.190042+0000","last_undegraded":"2023-10-09T11:41:00.190042+0000","last_fullsized":"2023-10-09T11:41:00.190042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:27.987978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.205722+0000","last_change":"2023-10-09T11:41:00.200343+0000","last_active":"2023-10-09T11:41:00.205722+0000","last_peered":"2023-10-09T11:41:00.205722+0000","last_clean":"2023-10-09T11:41:00.205722+0000","last_became_active":"2023-10-09T11:41:00.200104+0000","last_became_peered":"2023-10-09T11:41:00.200104+0000","last_unstale":"2023-10-09T11:41:00.205722+0000","last_undegraded":"2023-10-09T11:41:00.205722+0000","last_fullsized":"2023-10-09T11:41:00.205722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:41.980263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190960+0000","last_change":"2023-10-09T11:40:59.307643+0000","last_active":"2023-10-09T11:41:00.190960+0000","last_peered":"2023-10-09T11:41:00.190960+0000","last_clean":"2023-10-09T11:41:00.190960+0000","last_became_active":"2023-10-09T11:40:59.307289+0000","last_became_peered":"2023-10-09T11:40:59.307289+0000","last_unstale":"2023-10-09T11:41:00.190960+0000","last_undegraded":"2023-10-09T11:41:00.190960+0000","last_fullsized":"2023-10-09T11:41:00.190960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:08.218968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.206624+0000","last_change":"2023-10-09T11:41:00.205636+0000","last_active":"2023-10-09T11:41:00.206624+0000","last_peered":"2023-10-09T11:41:00.206624+0000","last_clean":"2023-10-09T11:41:00.206624+0000","last_became_active":"2023-10-09T11:41:00.205310+0000","last_became_peered":"2023-10-09T11:41:00.205310+0000","last_unstale":"2023-10-09T11:41:00.206624+0000","last_undegraded":"2023-10-09T11:41:00.206624+0000","last_fullsized":"2023-10-09T11:41:00.206624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:03.797886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191017+0000","last_change":"2023-10-09T11:40:59.304273+0000","last_active":"2023-10-09T11:41:00.191017+0000","last_peered":"2023-10-09T11:41:00.191017+0000","last_clean":"2023-10-09T11:41:00.191017+0000","last_became_active":"2023-10-09T11:40:59.303919+0000","last_became_peered":"2023-10-09T11:40:59.303919+0000","last_unstale":"2023-10-09T11:41:00.191017+0000","last_undegraded":"2023-10-09T11:41:00.191017+0000","last_fullsized":"2023-10-09T11:41:00.191017+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:48.013168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.211595+0000","last_change":"2023-10-09T11:41:00.207662+0000","last_active":"2023-10-09T11:41:00.211595+0000","last_peered":"2023-10-09T11:41:00.211595+0000","last_clean":"2023-10-09T11:41:00.211595+0000","last_became_active":"2023-10-09T11:41:00.207086+0000","last_became_peered":"2023-10-09T11:41:00.207086+0000","last_unstale":"2023-10-09T11:41:00.211595+0000","last_undegraded":"2023-10-09T11:41:00.211595+0000","last_fullsized":"2023-10-09T11:41:00.211595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:06.889859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191114+0000","last_change":"2023-10-09T11:40:59.306512+0000","last_active":"2023-10-09T11:41:00.191114+0000","last_peered":"2023-10-09T11:41:00.191114+0000","last_clean":"2023-10-09T11:41:00.191114+0000","last_became_active":"2023-10-09T11:40:59.306149+0000","last_became_peered":"2023-10-09T11:40:59.306149+0000","last_unstale":"2023-10-09T11:41:00.191114+0000","last_undegraded":"2023-10-09T11:41:00.191114+0000","last_fullsized":"2023-10-09T11:41:00.191114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:07.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.207338+0000","last_change":"2023-10-09T11:41:00.206044+0000","last_active":"2023-10-09T11:41:00.207338+0000","last_peered":"2023-10-09T11:41:00.207338+0000","last_clean":"2023-10-09T11:41:00.207338+0000","last_became_active":"2023-10-09T11:41:00.205746+0000","last_became_peered":"2023-10-09T11:41:00.205746+0000","last_unstale":"2023-10-09T11:41:00.207338+0000","last_undegraded":"2023-10-09T11:41:00.207338+0000","last_fullsized":"2023-10-09T11:41:00.207338+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:22.983263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.187897+0000","last_change":"2023-10-09T11:40:59.308119+0000","last_active":"2023-10-09T11:41:00.187897+0000","last_peered":"2023-10-09T11:41:00.187897+0000","last_clean":"2023-10-09T11:41:00.187897+0000","last_became_active":"2023-10-09T11:40:59.307789+0000","last_became_peered":"2023-10-09T11:40:59.307789+0000","last_unstale":"2023-10-09T11:41:00.187897+0000","last_undegraded":"2023-10-09T11:41:00.187897+0000","last_fullsized":"2023-10-09T11:41:00.187897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:43.994332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.200239+0000","last_change":"2023-10-09T11:41:00.191564+0000","last_active":"2023-10-09T11:41:00.200239+0000","last_peered":"2023-10-09T11:41:00.200239+0000","last_clean":"2023-10-09T11:41:00.200239+0000","last_became_active":"2023-10-09T11:41:00.191263+0000","last_became_peered":"2023-10-09T11:41:00.191263+0000","last_unstale":"2023-10-09T11:41:00.200239+0000","last_undegraded":"2023-10-09T11:41:00.200239+0000","last_fullsized":"2023-10-09T11:41:00.200239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:31.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.190895+0000","last_change":"2023-10-09T11:40:59.307057+0000","last_active":"2023-10-09T11:41:00.190895+0000","last_peered":"2023-10-09T11:41:00.190895+0000","last_clean":"2023-10-09T11:41:00.190895+0000","last_became_active":"2023-10-09T11:40:59.306788+0000","last_became_peered":"2023-10-09T11:40:59.306788+0000","last_unstale":"2023-10-09T11:41:00.190895+0000","last_undegraded":"2023-10-09T11:41:00.190895+0000","last_fullsized":"2023-10-09T11:41:00.190895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:55.363742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.204042+0000","last_change":"2023-10-09T11:41:00.200969+0000","last_active":"2023-10-09T11:41:00.204042+0000","last_peered":"2023-10-09T11:41:00.204042+0000","last_clean":"2023-10-09T11:41:00.204042+0000","last_became_active":"2023-10-09T11:41:00.200617+0000","last_became_peered":"2023-10-09T11:41:00.200617+0000","last_unstale":"2023-10-09T11:41:00.204042+0000","last_undegraded":"2023-10-09T11:41:00.204042+0000","last_fullsized":"2023-10-09T11:41:00.204042+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:59.283423+0000","last_clean_scrub_stamp":"2023-10-09T11:40:59.283423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:43.519305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"87'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.304601+0000","last_change":"2023-10-09T11:40:59.305040+0000","last_active":"2023-10-09T11:41:00.304601+0000","last_peered":"2023-10-09T11:41:00.304601+0000","last_clean":"2023-10-09T11:41:00.304601+0000","last_became_active":"2023-10-09T11:40:59.304676+0000","last_became_peered":"2023-10-09T11:40:59.304676+0000","last_unstale":"2023-10-09T11:41:00.304601+0000","last_undegraded":"2023-10-09T11:41:00.304601+0000","last_fullsized":"2023-10-09T11:41:00.304601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:58.278674+0000","last_clean_scrub_stamp":"2023-10-09T11:40:58.278674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:36.911436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T11:41:00.191850+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:00.191850+0000","last_peered":"2023-10-09T11:41:00.191850+0000","last_clean":"2023-10-09T11:41:00.191850+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:00.191850+0000","last_undegraded":"2023-10-09T11:41:00.191850+0000","last_fullsized":"2023-10-09T11:41:00.191850+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542220,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303032,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068808,"statfs":{"total":96636764160,"available":96326459392,"internally_reserved":0,"allocated":1687552,"data_stored":1058090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59599999999999997,"15min":0.70999999999999996},"min":{"1min":0.34300000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.59399999999999997},"min":{"1min":0.33300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70299999999999996,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.74399999999999999},"min":{"1min":0.41999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71199999999999997,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75600000000000001,"5min":1.256,"15min":1.256},"last":0.65800000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65000000000000002,"15min":0.89200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":8.8940000000000001,"15min":8.8940000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71399999999999997,"15min":0.95999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.82899999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.3,"15min":1.3},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.163,"15min":1.163},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76400000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.63},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.626},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":1.369,"15min":1.369},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.624,"15min":0.65400000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72799999999999998,"5min":0.999,"15min":0.999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.56899999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542220,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":468234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":1.153,"15min":1.153},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.503}]},{"osd":2,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73899999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":0.874,"15min":0.874},"last":0.38500000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65700000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":1085440,"data_stored":467610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.38800000000000001,"15min":0.55000000000000004},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.442,"5min":5.0330000000000004,"15min":5.0330000000000004},"last":0.247},{"interface":"front","average":{"1min":0.315,"5min":0.46700000000000003,"15min":0.81499999999999995},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.433,"5min":11.06,"15min":11.06},"last":0.39700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.54200000000000004,"15min":1.016},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.48699999999999999,"15min":0.85099999999999998},"min":{"1min":0.28499999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48499999999999999,"5min":11.935,"15min":11.935},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.47699999999999998,"15min":0.82099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46100000000000002,"5min":11.087,"15min":11.087},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53100000000000003,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":0.314}]},{"osd":4,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.78200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82099999999999995,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.87,"5min":1.528,"15min":1.528},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71399999999999997,"15min":1.03},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":10.939,"15min":10.939},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.77500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85799999999999998,"5min":4.9370000000000003,"15min":4.9370000000000003},"last":0.5}]},{"osd":6,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.73299999999999998,"15min":1.0649999999999999},"min":{"1min":0.38,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":10.975,"15min":10.975},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.745,"15min":1.097},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83099999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.76300000000000001,"15min":1.0960000000000001},"min":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.38800000000000001,"15min":0.55500000000000005},"min":{"1min":0.20899999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.50600000000000001,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.43099999999999999,"15min":0.58499999999999996},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.505,"15min":0.85699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53700000000000003,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.52100000000000002,"15min":0.91300000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":12.589,"15min":12.589},"last":0.38}]},{"osd":3,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.45600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39100000000000001,"15min":0.46800000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56799999999999995,"5min":1.502,"15min":1.502},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.65000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":1.446,"15min":1.446},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.68000000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":1.278,"15min":1.278},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.67700000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90900000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.70099999999999996},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":1.415,"15min":1.415},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":1.639,"15min":1.639},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86799999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64500000000000002,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.48199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.19800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45000000000000001,"5min":1.272,"15min":1.272},"last":0.371},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.372},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":1.246,"15min":1.246},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.54400000000000004,"5min":0.623,"15min":0.623},"last":0.33400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.286,"15min":1.286},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.65300000000000002,"15min":0.64100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":3.843,"15min":3.843},"last":0.47299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1101824,"data_stored":469168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.34300000000000003},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.28999999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79500000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.495},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.54000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542221,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":469270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":1.056,"15min":1.056},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.755},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85499999999999998,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":1.234,"15min":1.234},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83599999999999997,"5min":1.282,"15min":1.282},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.624},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.72399999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.81899999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75900000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.5},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.77100000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.379},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.41799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.75900000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78100000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:09.339 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:41:09.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.499+0000 7f5dd9941700 1 Processor -- start 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.499+0000 7f5dd9941700 1 -- start start 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd9941700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5dd413ffd0 0x7f5dd415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd9941700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5dd406ac00 0x7f5dd406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd9941700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd415a600 con 0x7f5dd413fc00 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd9941700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd406b550 con 0x7f5dd413ffd0 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd9941700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd4159fd0 con 0x7f5dd406ac00 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5dd413fc00 0x7f5dd40cadf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52542/0 (socket says 172.21.15.26:52542) 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd2ffd700 1 -- 172.21.15.26:0/3236463839 learned_addr learned my addr 172.21.15.26:0/3236463839 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5dd413ffd0 0x7f5dd415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd1ffb700 1 -- 172.21.15.26:0/3236463839 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605832430 0 0) 0x7f5dd415a600 con 0x7f5dd413fc00 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.500+0000 7f5dd1ffb700 1 -- 172.21.15.26:0/3236463839 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc0003570 con 0x7f5dd413fc00 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd37fe700 1 --2- 172.21.15.26:0/3236463839 >> v2:172.21.15.67:3300/0 conn(0x7f5dd406ac00 0x7f5dd406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd27fc700 1 -- 172.21.15.26:0/3236463839 >> v2:172.21.15.67:3300/0 conn(0x7f5dd406ac00 msgr2=0x7f5dd406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd27fc700 1 --2- 172.21.15.26:0/3236463839 >> v2:172.21.15.67:3300/0 conn(0x7f5dd406ac00 0x7f5dd406b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd27fc700 1 -- 172.21.15.26:0/3236463839 >> v1:172.21.15.26:6789/0 conn(0x7f5dd413fc00 legacy=0x7f5dd40cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd27fc700 1 -- 172.21.15.26:0/3236463839 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40cb8b0 con 0x7f5dd413ffd0 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd27fc700 1 --2- 172.21.15.26:0/3236463839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd413ffd0 0x7f5dd415aa90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40c39f0 tx=0x7f5dbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654b0262a9e8c81e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd1ffb700 1 -- 172.21.15.26:0/3236463839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011630 con 0x7f5dd413ffd0 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd1ffb700 1 -- 172.21.15.26:0/3236463839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc011790 con 0x7f5dd413ffd0 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd1ffb700 1 -- 172.21.15.26:0/3236463839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011b30 con 0x7f5dd413ffd0 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd9941700 1 -- 172.21.15.26:0/3236463839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd413ffd0 msgr2=0x7f5dd415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3236463839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd413ffd0 0x7f5dd415aa90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40c39f0 tx=0x7f5dbc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd9941700 1 -- 172.21.15.26:0/3236463839 shutdown_connections 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.501+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3236463839 >> v2:172.21.15.67:3300/0 conn(0x7f5dd406ac00 0x7f5dd406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.502+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3236463839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd413ffd0 0x7f5dd415aa90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.502+0000 7f5dd9941700 1 -- 172.21.15.26:0/3236463839 >> 172.21.15.26:0/3236463839 conn(0x7f5dd406e280 msgr2=0x7f5dd40cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.502+0000 7f5dd9941700 1 -- 172.21.15.26:0/3236463839 shutdown_connections 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.502+0000 7f5dd9941700 1 -- 172.21.15.26:0/3236463839 wait complete. 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.503+0000 7f5dd9941700 1 Processor -- start 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.503+0000 7f5dd9941700 1 -- start start 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.503+0000 7f5dd9941700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5dd413fc00 0x7f5dd4158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dd413ffd0 0x7f5dd41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c4680 con 0x7f5dd406ac00 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd416af30 con 0x7f5dd413ffd0 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c75b0 con 0x7f5dd413fc00 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48380/0 (socket says 172.21.15.26:48380) 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 -- 172.21.15.26:0/3055609710 learned_addr learned my addr 172.21.15.26:0/3055609710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 -- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5dd413fc00 msgr2=0x7f5dd4158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5dd413fc00 0x7f5dd4158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 -- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dd413ffd0 msgr2=0x7f5dd41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dd413ffd0 0x7f5dd41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 -- 172.21.15.26:0/3055609710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009420 con 0x7f5dd406ac00 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd2ffd700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400cd30 tx=0x7f5dc4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400ab70 con 0x7f5dd406ac00 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc400acf0 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd4168110 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4007340 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.504+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd416a8e0 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.505+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd404c3c0 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.506+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5dc4007730 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.506+0000 7f5dcaffd700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 0x7f5db40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.506+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5dc4084f10 con 0x7f5dd406ac00 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.507+0000 7f5dd27fc700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 0x7f5db40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.507+0000 7f5dd27fc700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 0x7f5db40696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40c6680 tx=0x7f5dbc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.511+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dc4051eb0 con 0x7f5dd406ac00 2023-10-09T11:41:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.785+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5dd40cbb90 con 0x7f5dd406ac00 2023-10-09T11:41:09.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.789+0000 7f5dcaffd700 1 -- 172.21.15.26:0/3055609710 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5dc400ae60 con 0x7f5dd406ac00 2023-10-09T11:41:09.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 msgr2=0x7f5db40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 0x7f5db40696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40c6680 tx=0x7f5dbc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 msgr2=0x7f5dd40c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400cd30 tx=0x7f5dc4001b10 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 shutdown_connections 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dd413ffd0 0x7f5dd41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dd406ac00 0x7f5dd40c7070 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5db4067200 0x7f5db40696b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 --2- 172.21.15.26:0/3055609710 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5dd413fc00 0x7f5dd4158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 >> 172.21.15.26:0/3055609710 conn(0x7f5dd406e280 msgr2=0x7f5dd40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 shutdown_connections 2023-10-09T11:41:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.791+0000 7f5dd9941700 1 -- 172.21.15.26:0/3055609710 wait complete. 2023-10-09T11:41:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:41:09.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.922+0000 7fafa8e7a700 1 Processor -- start 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.922+0000 7fafa8e7a700 1 -- start start 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa8e7a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafa40b0ba0 0x7fafa40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa8e7a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa415a280 con 0x7fafa40cf200 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa8e7a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa406e180 con 0x7fafa40b07d0 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa8e7a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa406d850 con 0x7fafa40b0ba0 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fafa40cf200 0x7fafa406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39656/0 (socket says 172.21.15.26:39656) 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa1d9b700 1 -- 172.21.15.26:0/1236290542 learned_addr learned my addr 172.21.15.26:0/1236290542 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa2d9d700 1 --2- 172.21.15.26:0/1236290542 >> v2:172.21.15.67:3300/0 conn(0x7fafa40b0ba0 0x7fafa40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa159a700 1 -- 172.21.15.26:0/1236290542 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039642286 0 0) 0x7fafa415a280 con 0x7fafa40cf200 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa159a700 1 -- 172.21.15.26:0/1236290542 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003570 con 0x7fafa40cf200 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa2d9d700 1 -- 172.21.15.26:0/1236290542 >> v1:172.21.15.67:6789/0 conn(0x7fafa40b07d0 legacy=0x7fafa40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa2d9d700 1 -- 172.21.15.26:0/1236290542 >> v1:172.21.15.26:6789/0 conn(0x7fafa40cf200 legacy=0x7fafa406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa2d9d700 1 -- 172.21.15.26:0/1236290542 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa406db30 con 0x7fafa40b0ba0 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.923+0000 7fafa2d9d700 1 --2- 172.21.15.26:0/1236290542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40b0ba0 0x7fafa40c42c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e60 tx=0x7faf9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a506bbdc299615 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa159a700 1 -- 172.21.15.26:0/1236290542 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00e070 con 0x7fafa40b0ba0 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa159a700 1 -- 172.21.15.26:0/1236290542 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00bb60 con 0x7fafa40b0ba0 2023-10-09T11:41:09.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa159a700 1 -- 172.21.15.26:0/1236290542 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012430 con 0x7fafa40b0ba0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 -- 172.21.15.26:0/1236290542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40b0ba0 msgr2=0x7fafa40c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/1236290542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40b0ba0 0x7fafa40c42c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e60 tx=0x7faf9c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 -- 172.21.15.26:0/1236290542 shutdown_connections 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/1236290542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40b0ba0 0x7fafa40c42c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 -- 172.21.15.26:0/1236290542 >> 172.21.15.26:0/1236290542 conn(0x7fafa406ce80 msgr2=0x7fafa40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 -- 172.21.15.26:0/1236290542 shutdown_connections 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.924+0000 7fafa8e7a700 1 -- 172.21.15.26:0/1236290542 wait complete. 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.925+0000 7fafa8e7a700 1 Processor -- start 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.925+0000 7fafa8e7a700 1 -- start start 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fafa40b0ba0 0x7fafa40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40cf200 0x7fafa40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b3c50 con 0x7fafa40b07d0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa409a6b0 con 0x7fafa40cf200 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa8e7a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa409a380 con 0x7fafa40b0ba0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39908/0 (socket says 172.21.15.26:39908) 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa259c700 1 -- 172.21.15.26:0/2665869116 learned_addr learned my addr 172.21.15.26:0/2665869116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa2d9d700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40cf200 0x7fafa40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.926+0000 7fafa1d9b700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fafa40b0ba0 0x7fafa40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 -- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fafa40b0ba0 msgr2=0x7fafa40c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fafa40b0ba0 0x7fafa40c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 -- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40cf200 msgr2=0x7fafa40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40cf200 0x7fafa40b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 -- 172.21.15.26:0/2665869116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009a20 con 0x7fafa40b07d0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa259c700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c4c0 tx=0x7faf9400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94011590 con 0x7fafa40b07d0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94011710 con 0x7fafa40b07d0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40b33b0 con 0x7fafa40b07d0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94011ad0 con 0x7fafa40b07d0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.927+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40b3970 con 0x7fafa40b07d0 2023-10-09T11:41:09.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.928+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa404c3c0 con 0x7fafa40b07d0 2023-10-09T11:41:09.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.928+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7faf9401b3b0 con 0x7fafa40b07d0 2023-10-09T11:41:09.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.929+0000 7faf9a7fc700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 0x7faf840696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.929+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf94083c50 con 0x7fafa40b07d0 2023-10-09T11:41:09.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.929+0000 7fafa1d9b700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 0x7faf840696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.930+0000 7fafa1d9b700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 0x7faf840696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafa4157610 tx=0x7faf8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:09.933+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf94050c20 con 0x7fafa40b07d0 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.169+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafa406de10 con 0x7fafa40b07d0 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.170+0000 7faf9a7fc700 1 -- 172.21.15.26:0/2665869116 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4596 (secure 0 0 0) 0x7faf94017070 con 0x7fafa40b07d0 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 msgr2=0x7faf840696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 0x7faf840696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafa4157610 tx=0x7faf8c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 msgr2=0x7fafa41570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c4c0 tx=0x7faf9400c7d0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 shutdown_connections 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafa40cf200 0x7fafa40b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa40b07d0 0x7fafa41570d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faf84067200 0x7faf840696b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 --2- 172.21.15.26:0/2665869116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fafa40b0ba0 0x7fafa40c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 >> 172.21.15.26:0/2665869116 conn(0x7fafa406ce80 msgr2=0x7fafa4158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 shutdown_connections 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.172+0000 7fafa8e7a700 1 -- 172.21.15.26:0/2665869116 wait complete. 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 58 2023-10-09T11:41:10.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:40:59.697658+0000', 'modified': '2023-10-09T11:41:03.302769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6483}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6483': {'gid': 6483, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/3862079110', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 3862079110}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3862079110}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:41:10.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:41:10.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:41:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.708+0000 7f20953d9700 1 Processor -- start 2023-10-09T11:41:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.708+0000 7f20953d9700 1 -- start start 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f20953d9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f20900cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f20953d9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f209006df60 0x7f20901632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f20953d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20900cc770 con 0x7f20900cee70 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f20953d9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20900b1400 con 0x7f209006df60 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f20953d9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900cbb60 con 0x7f20901595f0 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f20900cee70 0x7f209006d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39660/0 (socket says 172.21.15.26:39660) 2023-10-09T11:41:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208e7fc700 1 -- 172.21.15.26:0/2557251112 learned_addr learned my addr 172.21.15.26:0/2557251112 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2557251112 >> v2:172.21.15.67:3300/0 conn(0x7f209006df60 0x7f20901632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208effd700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f20900cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491614877 0 0) 0x7f20900cc770 con 0x7f20900cee70 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.709+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f207c003570 con 0x7f20900cee70 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778358182 0 0) 0x7f207c003570 con 0x7f20900cee70 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 msgr2=0x7f20900cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f20900cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 >> v2:172.21.15.67:3300/0 conn(0x7f209006df60 msgr2=0x7f20901632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 --2- 172.21.15.26:0/2557251112 >> v2:172.21.15.67:3300/0 conn(0x7f209006df60 0x7f20901632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900cbe40 con 0x7f20900cee70 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f2078001470 con 0x7f20900cee70 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2557251112 >> v2:172.21.15.67:3300/0 conn(0x7f209006df60 0x7f20901632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 >> v1:172.21.15.26:6789/0 conn(0x7f20900cee70 legacy=0x7f209006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f207c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f207c004810 0x7f207c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f207c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900b1400 con 0x7f207c003a60 2023-10-09T11:41:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900cbb60 con 0x7f207c004810 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c00ba60 con 0x7f20901595f0 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f207c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f207c004810 0x7f207c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f207c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 -- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 msgr2=0x7f207c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f207c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 -- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f207c004810 msgr2=0x7f207c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f207c004810 0x7f207c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 -- 172.21.15.26:0/2557251112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c003570 con 0x7f207c003a60 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20901595f0 0x7f207c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.710+0000 7f208effd700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f207c003e70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2088009c30 tx=0x7f20880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4968c7dc5690ab7d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800e710 con 0x7f207c003a60 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800e870 con 0x7f207c003a60 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f208dffb700 1 -- 172.21.15.26:0/2557251112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800ec30 con 0x7f207c003a60 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 -- 172.21.15.26:0/2557251112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 msgr2=0x7f207c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 --2- 172.21.15.26:0/2557251112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f207c003e70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2088009c30 tx=0x7f20880091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f208f7fe700 1 -- 172.21.15.26:0/2557251112 reap_dead start 2023-10-09T11:41:10.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 -- 172.21.15.26:0/2557251112 shutdown_connections 2023-10-09T11:41:10.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 -- 172.21.15.26:0/2557251112 >> 172.21.15.26:0/2557251112 conn(0x7f2090070e70 msgr2=0x7f20900d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 -- 172.21.15.26:0/2557251112 shutdown_connections 2023-10-09T11:41:10.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.711+0000 7f20953d9700 1 -- 172.21.15.26:0/2557251112 wait complete. 2023-10-09T11:41:10.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.712+0000 7f20953d9700 1 Processor -- start 2023-10-09T11:41:10.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.712+0000 7f20953d9700 1 -- start start 2023-10-09T11:41:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900af920 0x7f20901567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 0x7f20900c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900ca450 con 0x7f207c003a60 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900cacd0 con 0x7f20900cb160 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f20953d9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900c89a0 con 0x7f20900af920 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f208effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f208effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39926/0 (socket says 172.21.15.26:39926) 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f208effd700 1 -- 172.21.15.26:0/2372343361 learned_addr learned my addr 172.21.15.26:0/2372343361 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900af920 0x7f20901567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.713+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 0x7f20900c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 -- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900af920 msgr2=0x7f20901567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900af920 0x7f20901567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 -- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 msgr2=0x7f20900c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 0x7f20900c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 -- 172.21.15.26:0/2372343361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900c8c50 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 0x7f20900c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f208effd700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f207c0046d0 tx=0x7f208801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f2086ffd700 1 -- 172.21.15.26:0/2372343361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088022070 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f2086ffd700 1 -- 172.21.15.26:0/2372343361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800e9e0 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900ca680 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f2086ffd700 1 -- 172.21.15.26:0/2372343361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208801c450 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.714+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2090156d30 con 0x7f207c003a60 2023-10-09T11:41:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.715+0000 7f2086ffd700 1 -- 172.21.15.26:0/2372343361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f208801c840 con 0x7f207c003a60 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.716+0000 7f2086ffd700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 0x7f20700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.716+0000 7f2086ffd700 1 -- 172.21.15.26:0/2372343361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2088086120 con 0x7f207c003a60 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.716+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 0x7f20700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.717+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 0x7f20700696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f20900b5580 tx=0x7f20900d0250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.718+0000 7f209e6d1b80 1 Processor -- start 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.718+0000 7f209e6d1b80 1 -- start start 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x55703040c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x5570303e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557030339a70 con 0x5570303e05f0 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557030337270 con 0x55703042d480 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x557030333060 con 0x5570303e2b80 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39932/0 (socket says 172.21.15.26:39932) 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 -- 172.21.15.26:0/2925759462 learned_addr learned my addr 172.21.15.26:0/2925759462 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208effd700 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x55703040c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208f7fe700 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x5570303e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 -- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 msgr2=0x5570303e2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x5570303e2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 -- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 msgr2=0x55703040c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x55703040c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 -- 172.21.15.26:0/2925759462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570301cd270 con 0x5570303e05f0 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f208e7fc700 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2078007600 tx=0x7f2078017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb28084b95d41723 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f206ffff700 1 -- 172.21.15.26:0/2925759462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207801a040 con 0x5570303e05f0 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f206ffff700 1 -- 172.21.15.26:0/2925759462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078015bb0 con 0x5570303e05f0 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.719+0000 7f206ffff700 1 -- 172.21.15.26:0/2925759462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780213c0 con 0x5570303e05f0 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 -- 172.21.15.26:0/2925759462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 msgr2=0x55703042d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2078007600 tx=0x7f2078017000 comp rx=0 tx=0).stop 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 -- 172.21.15.26:0/2925759462 shutdown_connections 2023-10-09T11:41:10.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x5570303e2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x55703040c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/2925759462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x55703042d850 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 -- 172.21.15.26:0/2925759462 >> 172.21.15.26:0/2925759462 conn(0x5570303e40c0 msgr2=0x5570303e48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 -- 172.21.15.26:0/2925759462 shutdown_connections 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.720+0000 7f209e6d1b80 1 -- 172.21.15.26:0/2925759462 wait complete. 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.721+0000 7f209e6d1b80 1 -- start start 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.721+0000 7f209e6d1b80 1 Processor -- start 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x557030412490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x5570304129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570302de890 con 0x5570303e05f0 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570302f9ea0 con 0x55703042d480 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570301b5e30 con 0x5570303e2b80 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f209e6d1b80 10 client.0 _ll_register_callbacks cb 0x5570303a62c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39944/0 (socket says 172.21.15.26:39944) 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 -- 172.21.15.26:0/3565767368 learned_addr learned my addr 172.21.15.26:0/3565767368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x5570304129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208e7fc700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x557030412490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 -- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 msgr2=0x557030412490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x557030412490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 -- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 msgr2=0x5570304129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x5570304129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 -- 172.21.15.26:0/3565767368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20900cbe40 con 0x5570303e05f0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f208effd700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2088056ab0 tx=0x7f208805c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604babdd0ed36fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.722+0000 7f206d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208805dca0 con 0x5570303e05f0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20880562a0 con 0x5570303e05f0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570303d7cd0 con 0x5570303e05f0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f208805d810 con 0x5570303e05f0 2023-10-09T11:41:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 10 client.6654 fetch_fsmap learned FSMap version 58 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55703016ffe0 con 0x5570303e05f0 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088082020 con 0x5570303e05f0 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f208801caf0 con 0x5570303e05f0 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 10 client.6654 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 10 client.6654 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 20 client.6654 populate_metadata read hostname 'smithi026' 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043cb20 0x55703043cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 4 client.6654 mds_command: new command op to 6483 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 --> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570303b4aa0 con 0x55703043cb20 2023-10-09T11:41:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f208e7fc700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043cb20 0x55703043cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.723+0000 7f206d7fa700 10 client.6654 ms_handle_connect on v2:172.21.15.26:6834/3862079110 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f208e7fc700 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043cb20 0x55703043cef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9356611bcad3050 server_cookie=7573f84b4b96290c in_seq=0 out_seq=0 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f206d7fa700 1 -- 172.21.15.26:0/3565767368 <== mds.0 v2:172.21.15.26:6834/3862079110 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5570303b4aa0 con 0x55703043cb20 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f206d7fa700 10 client.6654 handle_command_reply: tid=0 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 client.6654 shutdown 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 msgr2=0x5570304070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2088056ab0 tx=0x7f208805c040 comp rx=0 tx=0).stop 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 shutdown_connections 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043cb20 0x55703043cef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55703042d480 0x5570304129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f206d7fa700 0 client.6654 ms_handle_reset on v2:172.21.15.26:6834/3862079110 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5570303e05f0 0x5570304070e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3565767368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e2b80 0x557030412490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 >> 172.21.15.26:0/3565767368 conn(0x5570303e40c0 msgr2=0x5570303e2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 shutdown_connections 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.724+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3565767368 wait complete. 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.725+0000 7f209e6d1b80 20 client.6654 trim_cache size 0 max 16384 2023-10-09T11:41:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.741+0000 7f209e6d1b80 1 Processor -- start 2023-10-09T11:41:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.741+0000 7f209e6d1b80 1 -- start start 2023-10-09T11:41:10.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x55703043b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703040ffb0 con 0x55703042d480 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703043bfc0 con 0x5570303e2b80 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55703040fa70 con 0x5570303e05f0 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f208f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f208f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39958/0 (socket says 172.21.15.26:39958) 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f208f7fe700 1 -- 172.21.15.26:0/3563998171 learned_addr learned my addr 172.21.15.26:0/3563998171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f208effd700 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x55703043b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.742+0000 7f208e7fc700 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 -- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 msgr2=0x55703043b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x55703043b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 -- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 msgr2=0x5570303e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303e4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 -- 172.21.15.26:0/3563998171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703042c5a0 con 0x55703042d480 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f20800165c0 tx=0x7f208000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e12eb9b000a24f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f2084ff9700 1 -- 172.21.15.26:0/3563998171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000e040 con 0x55703042d480 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f2084ff9700 1 -- 172.21.15.26:0/3563998171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080019430 con 0x55703042d480 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f2084ff9700 1 -- 172.21.15.26:0/3563998171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20800195a0 con 0x55703042d480 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3563998171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 msgr2=0x557030406750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f20800165c0 tx=0x7f208000b040 comp rx=0 tx=0).stop 2023-10-09T11:41:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3563998171 shutdown_connections 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x557030406750 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x55703043b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/3563998171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.743+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3563998171 >> 172.21.15.26:0/3563998171 conn(0x5570303e40c0 msgr2=0x557030412960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.744+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3563998171 shutdown_connections 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.744+0000 7f209e6d1b80 1 -- 172.21.15.26:0/3563998171 wait complete. 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.744+0000 7f209e6d1b80 1 -- start start 2023-10-09T11:41:10.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.744+0000 7f209e6d1b80 1 Processor -- start 2023-10-09T11:41:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x557030407bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703043b4d0 con 0x55703042d480 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703044b7d0 con 0x5570303e2b80 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570303e0350 con 0x5570303e05f0 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f209e6d1b80 10 client.0 _ll_register_callbacks cb 0x5570303a62c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39974/0 (socket says 172.21.15.26:39974) 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 -- 172.21.15.26:0/453718151 learned_addr learned my addr 172.21.15.26:0/453718151 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208e7fc700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208effd700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x557030407bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 -- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 msgr2=0x557030407bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x557030407bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 -- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 msgr2=0x5570303dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303dfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.745+0000 7f208f7fe700 1 -- 172.21.15.26:0/453718151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2080009a20 con 0x55703042d480 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f208f7fe700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2080016bb0 tx=0x7f208001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73373a9a90f5be96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080027070 con 0x55703042d480 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2080016340 con 0x55703042d480 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2078015bb0 con 0x55703042d480 2023-10-09T11:41:10.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f208000e040 con 0x55703042d480 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 10 client.6660 fetch_fsmap learned FSMap version 58 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x557030301780 con 0x55703042d480 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078015bb0 con 0x55703042d480 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2080022680 con 0x55703042d480 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 10 client.6660 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 10 client.6660 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 20 client.6660 populate_metadata read hostname 'smithi026' 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043a580 0x55703043a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 4 client.6660 mds_command: new command op to 6483 tid=0[{"prefix": "status"}] 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 --> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5570302d5e00 con 0x55703043a580 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.746+0000 7f208effd700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043a580 0x55703043a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f206d7fa700 10 client.6660 ms_handle_connect on v2:172.21.15.26:6834/3862079110 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f208effd700 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043a580 0x55703043a950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ade47dea30ceed server_cookie=52a366be80d089ee in_seq=0 out_seq=0 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f206d7fa700 1 -- 172.21.15.26:0/453718151 <== mds.0 v2:172.21.15.26:6834/3862079110 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5570302d5e00 con 0x55703043a580 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f206d7fa700 10 client.6660 handle_command_reply: tid=0 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 client.6660 shutdown 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 msgr2=0x55703048e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2080016bb0 tx=0x7f208001e000 comp rx=0 tx=0).stop 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 shutdown_connections 2023-10-09T11:41:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:6834/3862079110,v1:172.21.15.26:6835/3862079110] conn(0x55703043a580 0x55703043a950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55703042d480 0x55703048e260 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5570303e05f0 0x557030407bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 --2- 172.21.15.26:0/453718151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570303e2b80 0x5570303dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f206d7fa700 0 client.6660 ms_handle_reset on v2:172.21.15.26:6834/3862079110 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 >> 172.21.15.26:0/453718151 conn(0x5570303e40c0 msgr2=0x5570303e48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 shutdown_connections 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 1 -- 172.21.15.26:0/453718151 wait complete. 2023-10-09T11:41:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.747+0000 7f209e6d1b80 20 client.6660 trim_cache size 0 max 16384 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6483, 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:41:10.758 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.458508002, 2023-10-09T11:41:10.759 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 58, 2023-10-09T11:41:10.759 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 88, 2023-10-09T11:41:10.759 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 88, 2023-10-09T11:41:10.759 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 15.483577271 2023-10-09T11:41:10.759 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 msgr2=0x7f20700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 0x7f20700696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f20900b5580 tx=0x7f20900d0250 comp rx=0 tx=0).stop 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 msgr2=0x7f20900c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f207c0046d0 tx=0x7f208801a000 comp rx=0 tx=0).stop 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 shutdown_connections 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20900cb160 0x7f20900c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f207c003a60 0x7f20900c8460 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2070067200 0x7f20700696b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 --2- 172.21.15.26:0/2372343361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20900af920 0x7f20901567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 >> 172.21.15.26:0/2372343361 conn(0x7f2090070e70 msgr2=0x7f20901586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 shutdown_connections 2023-10-09T11:41:10.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.748+0000 7f20953d9700 1 -- 172.21.15.26:0/2372343361 wait complete. 2023-10-09T11:41:10.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:10.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 Processor -- start 2023-10-09T11:41:10.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 -- start start 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4440cb5a0 0x7fb4440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb4440cde50 0x7fb444156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44415ae40 con 0x7fb4440cd9e0 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.880+0000 7fb44ae31700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4440d13f0 con 0x7fb4440cde50 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb44ae31700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44415ab60 con 0x7fb4440cb5a0 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb4440cde50 0x7fb444156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb443fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4440cd9e0 0x7fb444159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39668/0 (socket says 172.21.15.26:39668) 2023-10-09T11:41:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb4440cde50 0x7fb444156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39986/0 (socket says 172.21.15.26:39986) 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb443fff700 1 -- 172.21.15.26:0/2396011317 learned_addr learned my addr 172.21.15.26:0/2396011317 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb448bcd700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4440cb5a0 0x7fb4440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 -- 172.21.15.26:0/2396011317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4440cb5a0 msgr2=0x7fb4440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4440cb5a0 0x7fb4440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 -- 172.21.15.26:0/2396011317 >> v1:172.21.15.26:6789/0 conn(0x7fb4440cd9e0 legacy=0x7fb444159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4437fe700 1 -- 172.21.15.26:0/2396011317 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068506443 0 0) 0x7fb44415ae40 con 0x7fb4440cd9e0 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 -- 172.21.15.26:0/2396011317 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440ccf00 con 0x7fb4440cde50 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4493ce700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cde50 0x7fb444156e90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0098e0 tx=0x7fb42c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ccc58ef84c0cee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4437fe700 1 -- 172.21.15.26:0/2396011317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00b640 con 0x7fb4440cde50 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4437fe700 1 -- 172.21.15.26:0/2396011317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00b7a0 con 0x7fb4440cde50 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.881+0000 7fb4437fe700 1 -- 172.21.15.26:0/2396011317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00bb40 con 0x7fb4440cde50 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 -- 172.21.15.26:0/2396011317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cde50 msgr2=0x7fb444156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cde50 0x7fb444156e90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0098e0 tx=0x7fb42c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 -- 172.21.15.26:0/2396011317 shutdown_connections 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cde50 0x7fb444156e90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 --2- 172.21.15.26:0/2396011317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4440cb5a0 0x7fb4440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 -- 172.21.15.26:0/2396011317 >> 172.21.15.26:0/2396011317 conn(0x7fb444070e30 msgr2=0x7fb4440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 -- 172.21.15.26:0/2396011317 shutdown_connections 2023-10-09T11:41:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.882+0000 7fb44ae31700 1 -- 172.21.15.26:0/2396011317 wait complete. 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.883+0000 7fb44ae31700 1 Processor -- start 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.883+0000 7fb44ae31700 1 -- start start 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4440cd9e0 0x7fb44415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb44415deb0 0x7fb4440b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440ca7a0 con 0x7fb4440cb5a0 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44415da20 con 0x7fb4440cd9e0 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb44ae31700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44415cb70 con 0x7fb44415deb0 2023-10-09T11:41:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40000/0 (socket says 172.21.15.26:40000) 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 -- 172.21.15.26:0/3502758347 learned_addr learned my addr 172.21.15.26:0/3502758347 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 -- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb44415deb0 msgr2=0x7fb4440b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb44415deb0 0x7fb4440b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 -- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4440cd9e0 msgr2=0x7fb44415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4440cd9e0 0x7fb44415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 -- 172.21.15.26:0/3502758347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c009420 con 0x7fb4440cb5a0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.884+0000 7fb448bcd700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00e930 tx=0x7fb43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.885+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00eed0 con 0x7fb4440cb5a0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.885+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00c850 con 0x7fb4440cb5a0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.885+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00cbf0 con 0x7fb4440cb5a0 2023-10-09T11:41:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.885+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44415ce10 con 0x7fb4440cb5a0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.885+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44415d3d0 con 0x7fb4440cb5a0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.886+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb444089590 con 0x7fb4440cb5a0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.886+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb43c013470 con 0x7fb4440cb5a0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.886+0000 7fb440ff9700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 0x7fb4240696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.887+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb43c084c50 con 0x7fb4440cb5a0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.887+0000 7fb443fff700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 0x7fb4240696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.887+0000 7fb443fff700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 0x7fb4240696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb434001560 tx=0x7fb4340016c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:10.891+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb43c051a90 con 0x7fb4440cb5a0 2023-10-09T11:41:11.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.126+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb44404c3c0 con 0x7fb4440cb5a0 2023-10-09T11:41:11.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.127+0000 7fb440ff9700 1 -- 172.21.15.26:0/3502758347 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb43c0550b0 con 0x7fb4440cb5a0 2023-10-09T11:41:11.128 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:11.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 msgr2=0x7fb4240696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 0x7fb4240696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb434001560 tx=0x7fb4340016c0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 msgr2=0x7fb4440ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00e930 tx=0x7fb43c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 shutdown_connections 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb424067200 0x7fb4240696b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb44415deb0 0x7fb4440b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4440cb5a0 0x7fb4440ca260 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 --2- 172.21.15.26:0/3502758347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4440cd9e0 0x7fb44415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 >> 172.21.15.26:0/3502758347 conn(0x7fb444070e30 msgr2=0x7fb4440ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 shutdown_connections 2023-10-09T11:41:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.129+0000 7fb44ae31700 1 -- 172.21.15.26:0/3502758347 wait complete. 2023-10-09T11:41:11.142 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:11.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:11.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:11.143 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:11.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.143 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:11.159 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42121sec preferred_lft 42121sec 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:11.160 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.161 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:11.162 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:41:11.162 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:41:11.162 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:11.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.162 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:11.223 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:41:11.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.224 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:41:11.281 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:41:11.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:41:11.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:41:11.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:41:11.282 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:41:11.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.384 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:41:11.398 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:41:11.398 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:41:11.398 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:11.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.399 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:41:11.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:11.463 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:11.518 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:11.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:11.518 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:11.573 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:41:11.573 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:11.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:11.654 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:11.654 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:11.673 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:11.696 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:41:11.697 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:41:11.697 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:41:11.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:11.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:11.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:11.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:11.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.922+0000 7f8a0b59e700 1 Processor -- start 2023-10-09T11:41:11.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.922+0000 7f8a0b59e700 1 -- start start 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c153c30 0x7f8a0c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a0c0cf110 0x7f8a0c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0b59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c15afd0 con 0x7f8a0c15de50 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0b59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c15b2b0 con 0x7f8a0c0cf110 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15b590 con 0x7f8a0c153c30 2023-10-09T11:41:11.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a0c0cf110 0x7f8a0c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a0c0cf110 0x7f8a0c15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40008/0 (socket says 172.21.15.26:40008) 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a09d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a0c15de50 0x7f8a0c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39682/0 (socket says 172.21.15.26:39682) 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0ad9d700 1 -- 172.21.15.26:0/1790885975 learned_addr learned my addr 172.21.15.26:0/1790885975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.923+0000 7f8a0a59c700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c153c30 0x7f8a0c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0ad9d700 1 -- 172.21.15.26:0/1790885975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c153c30 msgr2=0x7f8a0c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0ad9d700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c153c30 0x7f8a0c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0ad9d700 1 -- 172.21.15.26:0/1790885975 >> v1:172.21.15.26:6789/0 conn(0x7f8a0c15de50 legacy=0x7f8a0c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0959a700 1 -- 172.21.15.26:0/1790885975 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966051026 0 0) 0x7f8a0c15afd0 con 0x7f8a0c15de50 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0ad9d700 1 -- 172.21.15.26:0/1790885975 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c15b870 con 0x7f8a0c0cf110 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0ad9d700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c15c070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009f20 tx=0x7f8a04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223e4f9048ba560c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0959a700 1 -- 172.21.15.26:0/1790885975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400e070 con 0x7f8a0c0cf110 2023-10-09T11:41:11.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0959a700 1 -- 172.21.15.26:0/1790885975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400ba80 con 0x7f8a0c0cf110 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0959a700 1 -- 172.21.15.26:0/1790885975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040092e0 con 0x7f8a0c0cf110 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 -- 172.21.15.26:0/1790885975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c0cf110 msgr2=0x7f8a0c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c15c070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009f20 tx=0x7f8a04009840 comp rx=0 tx=0).stop 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 -- 172.21.15.26:0/1790885975 shutdown_connections 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c15c070 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/1790885975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c153c30 0x7f8a0c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.924+0000 7f8a0b59e700 1 -- 172.21.15.26:0/1790885975 >> 172.21.15.26:0/1790885975 conn(0x7f8a0c0703a0 msgr2=0x7f8a0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.925+0000 7f8a0b59e700 1 -- 172.21.15.26:0/1790885975 shutdown_connections 2023-10-09T11:41:11.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.925+0000 7f8a0b59e700 1 -- 172.21.15.26:0/1790885975 wait complete. 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 Processor -- start 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 -- start start 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c15de50 0x7f8a0c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c86a0 con 0x7f8a0c153c30 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cc150 con 0x7f8a0c0cf110 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.926+0000 7f8a0b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cc3d0 con 0x7f8a0c15de50 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40010/0 (socket says 172.21.15.26:40010) 2023-10-09T11:41:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 -- 172.21.15.26:0/3351168730 learned_addr learned my addr 172.21.15.26:0/3351168730 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a0ad9d700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c15de50 0x7f8a0c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a0a59c700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 -- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c15de50 msgr2=0x7f8a0c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c15de50 0x7f8a0c0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 -- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a0c0cf110 msgr2=0x7f8a0c0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 -- 172.21.15.26:0/3351168730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009ae0 con 0x7f8a0c153c30 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a09d9b700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c5e0 tx=0x7f8a00001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00005a70 con 0x7f8a0c153c30 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00005bd0 con 0x7f8a0c153c30 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0cc6b0 con 0x7f8a0c153c30 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000070d0 con 0x7f8a0c153c30 2023-10-09T11:41:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.927+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0b39d0 con 0x7f8a0c153c30 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.928+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c0ccbd0 con 0x7f8a0c153c30 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.929+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8a000074c0 con 0x7f8a0c153c30 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.929+0000 7f89fa7fc700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 0x7f89ec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.929+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a00083d20 con 0x7f8a0c153c30 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.929+0000 7f8a0a59c700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 0x7f89ec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.930+0000 7f8a0a59c700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 0x7f89ec0696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f89fc006fd0 tx=0x7f89fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:11.933+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a0c0ccbd0 con 0x7f8a0c153c30 2023-10-09T11:41:12.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.171+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a0c0c84e0 con 0x7f8a0c153c30 2023-10-09T11:41:12.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.172+0000 7f89fa7fc700 1 -- 172.21.15.26:0/3351168730 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a0c0c84e0 con 0x7f8a0c153c30 2023-10-09T11:41:12.173 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 msgr2=0x7f89ec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 0x7f89ec0696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f89fc006fd0 tx=0x7f89fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 msgr2=0x7f8a0c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c5e0 tx=0x7f8a00001040 comp rx=0 tx=0).stop 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 shutdown_connections 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89ec067200 0x7f89ec0696b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a0c15de50 0x7f8a0c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a0c0cf110 0x7f8a0c0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 --2- 172.21.15.26:0/3351168730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a0c153c30 0x7f8a0c0cbc10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 >> 172.21.15.26:0/3351168730 conn(0x7f8a0c0703a0 msgr2=0x7f8a0c159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 shutdown_connections 2023-10-09T11:41:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.174+0000 7f8a0b59e700 1 -- 172.21.15.26:0/3351168730 wait complete. 2023-10-09T11:41:12.187 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:12.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:12.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:41:12.187 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:41:12.188 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:12.188 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:12.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:12.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:12.188 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:12.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.188 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:41:12.207 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:41:12.208 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42135sec preferred_lft 42135sec 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.209 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:12.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.211 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:12.277 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:41:12.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.279 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:41:12.338 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:41:12.338 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:12.338 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:12.339 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:12.339 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:12.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:12.342 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:41:12.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.451 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:41:12.467 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:41:12.467 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:41:12.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:12.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:41:12.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:12.533 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:12.590 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:12.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:12.591 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:12.646 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:41:12.646 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:12.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:12.729 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:12.729 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:12.749 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:12.749 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:12.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:12.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:41:12.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:41:12.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:41:12.772 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:12.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:12.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:12.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:41:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.971+0000 7f88ad7a7700 1 Processor -- start 2023-10-09T11:41:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.971+0000 7f88ad7a7700 1 -- start start 2023-10-09T11:41:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88ad7a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88a80cd200 0x7f88a80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88ad7a7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88a80cb320 0x7f88a81509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88ad7a7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a80ce360 con 0x7f88a80caeb0 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88ad7a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80cb780 con 0x7f88a80cd200 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88ad7a7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80cb970 con 0x7f88a80cb320 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88a6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88a80cd200 0x7f88a80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88a6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88a80cd200 0x7f88a80cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40016/0 (socket says 172.21.15.26:40016) 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.972+0000 7f88a6ffd700 1 -- 172.21.15.26:0/210569812 learned_addr learned my addr 172.21.15.26:0/210569812 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a77fe700 1 --2- 172.21.15.26:0/210569812 >> v2:172.21.15.67:3300/0 conn(0x7f88a80cb320 0x7f88a81509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a6ffd700 1 -- 172.21.15.26:0/210569812 >> v2:172.21.15.67:3300/0 conn(0x7f88a80cb320 msgr2=0x7f88a81509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/210569812 >> v2:172.21.15.67:3300/0 conn(0x7f88a80cb320 0x7f88a81509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a6ffd700 1 -- 172.21.15.26:0/210569812 >> v1:172.21.15.67:6789/0 conn(0x7f88a80caeb0 legacy=0x7f88a81502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a6ffd700 1 -- 172.21.15.26:0/210569812 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80cbc50 con 0x7f88a80cd200 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/210569812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cd200 0x7f88a80cd5d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f88a806fbc0 tx=0x7f8898009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b535872145a1fb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a5ffb700 1 -- 172.21.15.26:0/210569812 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898005c10 con 0x7f88a80cd200 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a5ffb700 1 -- 172.21.15.26:0/210569812 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898005d70 con 0x7f88a80cd200 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.973+0000 7f88a5ffb700 1 -- 172.21.15.26:0/210569812 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898006260 con 0x7f88a80cd200 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 -- 172.21.15.26:0/210569812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cd200 msgr2=0x7f88a80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/210569812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cd200 0x7f88a80cd5d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f88a806fbc0 tx=0x7f8898009220 comp rx=0 tx=0).stop 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 -- 172.21.15.26:0/210569812 shutdown_connections 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/210569812 >> v2:172.21.15.67:3300/0 conn(0x7f88a80cb320 0x7f88a81509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/210569812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cd200 0x7f88a80cd5d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 -- 172.21.15.26:0/210569812 >> 172.21.15.26:0/210569812 conn(0x7f88a80999c0 msgr2=0x7f88a8070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 -- 172.21.15.26:0/210569812 shutdown_connections 2023-10-09T11:41:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.974+0000 7f88ad7a7700 1 -- 172.21.15.26:0/210569812 wait complete. 2023-10-09T11:41:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.975+0000 7f88ad7a7700 1 Processor -- start 2023-10-09T11:41:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.975+0000 7f88ad7a7700 1 -- start start 2023-10-09T11:41:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88a80caeb0 0x7f88a8159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 0x7f88a815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815b130 con 0x7f88a80cb320 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815d5b0 con 0x7f88a80cd200 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88ad7a7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815a2a0 con 0x7f88a80caeb0 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40018/0 (socket says 172.21.15.26:40018) 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 -- 172.21.15.26:0/278307301 learned_addr learned my addr 172.21.15.26:0/278307301 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88a80caeb0 0x7f88a8159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a77fe700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 0x7f88a815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 -- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88a80caeb0 msgr2=0x7f88a8159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88a80caeb0 0x7f88a8159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 -- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 msgr2=0x7f88a815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 0x7f88a815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 -- 172.21.15.26:0/278307301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898009480 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a77fe700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 0x7f88a815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f88a67fc700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f889000c5c0 tx=0x7f889000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.976+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890011590 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.977+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890011710 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.977+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890011ad0 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.977+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a815a520 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.977+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a815ab60 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.977+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a815b2e0 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.978+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f889001b3b0 con 0x7f88a80cb320 2023-10-09T11:41:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.978+0000 7f889effd700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 0x7f88880696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.978+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8890083f40 con 0x7f88a80cb320 2023-10-09T11:41:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.979+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 0x7f88880696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.979+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 0x7f88880696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8898009260 tx=0x7f8898016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:12.983+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88a815b2e0 con 0x7f88a80cb320 2023-10-09T11:41:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:13.224+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f88a815b2e0 con 0x7f88a80cb320 2023-10-09T11:41:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.201+0000 7f889effd700 1 -- 172.21.15.26:0/278307301 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 136+0+0 (secure 0 0 0) 0x7f88a815b2e0 con 0x7f88a80cb320 2023-10-09T11:41:14.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 msgr2=0x7f88880696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 0x7f88880696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8898009260 tx=0x7f8898016000 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 msgr2=0x7f88a814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f889000c5c0 tx=0x7f889000c980 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 shutdown_connections 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a80cd200 0x7f88a815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8888067200 0x7f88880696b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88a80caeb0 0x7f88a8159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 --2- 172.21.15.26:0/278307301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80cb320 0x7f88a814dae0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 >> 172.21.15.26:0/278307301 conn(0x7f88a80999c0 msgr2=0x7f88a806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 shutdown_connections 2023-10-09T11:41:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.204+0000 7f88ad7a7700 1 -- 172.21.15.26:0/278307301 wait complete. 2023-10-09T11:41:14.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:41:14.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.345+0000 7fed0359e700 1 Processor -- start 2023-10-09T11:41:14.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.345+0000 7fed0359e700 1 -- start start 2023-10-09T11:41:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed0359e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed0415de50 0x7fed040cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed0359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed040cef40 0x7fed0415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed0359e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed040cf3c0 con 0x7fed04153c30 2023-10-09T11:41:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed0359e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0415afd0 con 0x7fed040cef40 2023-10-09T11:41:14.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed0359e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0415b2b0 con 0x7fed0415de50 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed040cef40 0x7fed0415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed040cef40 0x7fed0415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40020/0 (socket says 172.21.15.26:40020) 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 -- 172.21.15.26:0/3408737240 learned_addr learned my addr 172.21.15.26:0/3408737240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 -- 172.21.15.26:0/3408737240 >> v2:172.21.15.67:3300/0 conn(0x7fed0415de50 msgr2=0x7fed040cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 --2- 172.21.15.26:0/3408737240 >> v2:172.21.15.67:3300/0 conn(0x7fed0415de50 0x7fed040cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 -- 172.21.15.26:0/3408737240 >> v1:172.21.15.67:6789/0 conn(0x7fed04153c30 legacy=0x7fed0415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.346+0000 7fed02d9d700 1 -- 172.21.15.26:0/3408737240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0415b590 con 0x7fed040cef40 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed02d9d700 1 --2- 172.21.15.26:0/3408737240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed040cef40 0x7fed0415c070 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fed040713a0 tx=0x7fecfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd89ea715cd8a8eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0159a700 1 -- 172.21.15.26:0/3408737240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00e070 con 0x7fed040cef40 2023-10-09T11:41:14.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0159a700 1 -- 172.21.15.26:0/3408737240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc00ba10 con 0x7fed040cef40 2023-10-09T11:41:14.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0159a700 1 -- 172.21.15.26:0/3408737240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0092e0 con 0x7fed040cef40 2023-10-09T11:41:14.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 -- 172.21.15.26:0/3408737240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed040cef40 msgr2=0x7fed0415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 --2- 172.21.15.26:0/3408737240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed040cef40 0x7fed0415c070 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fed040713a0 tx=0x7fecfc009840 comp rx=0 tx=0).stop 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 -- 172.21.15.26:0/3408737240 shutdown_connections 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 --2- 172.21.15.26:0/3408737240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed040cef40 0x7fed0415c070 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 --2- 172.21.15.26:0/3408737240 >> v2:172.21.15.67:3300/0 conn(0x7fed0415de50 0x7fed040cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 -- 172.21.15.26:0/3408737240 >> 172.21.15.26:0/3408737240 conn(0x7fed040703a0 msgr2=0x7fed040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 -- 172.21.15.26:0/3408737240 shutdown_connections 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.347+0000 7fed0359e700 1 -- 172.21.15.26:0/3408737240 wait complete. 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 Processor -- start 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 -- start start 2023-10-09T11:41:14.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 0x7fed04140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed04153c30 0x7fed040c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c8a40 con 0x7fed0415de50 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040b1b30 con 0x7fed040cef40 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed0359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed041414a0 con 0x7fed04153c30 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40024/0 (socket says 172.21.15.26:40024) 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.349+0000 7fed02d9d700 1 -- 172.21.15.26:0/1043649178 learned_addr learned my addr 172.21.15.26:0/1043649178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed0259c700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 0x7fed04140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed01d9b700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed04153c30 0x7fed040c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 -- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed04153c30 msgr2=0x7fed040c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed04153c30 0x7fed040c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 -- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 msgr2=0x7fed04140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 0x7fed04140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 -- 172.21.15.26:0/1043649178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc009ae0 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed0259c700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 0x7fed04140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed02d9d700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fed0406eb00 tx=0x7fecfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc012e60 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc01e430 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed040c81a0 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc01e7d0 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.350+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed040c8760 con 0x7fed0415de50 2023-10-09T11:41:14.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.351+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0404c3c0 con 0x7fed0415de50 2023-10-09T11:41:14.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.351+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fecfc01eb80 con 0x7fed0415de50 2023-10-09T11:41:14.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.352+0000 7fecfa7fc700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 0x7fece40696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.352+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fecfc0867f0 con 0x7fed0415de50 2023-10-09T11:41:14.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.352+0000 7fed0259c700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 0x7fece40696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.353+0000 7fed0259c700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 0x7fece40696e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.356+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecfc0536b0 con 0x7fed0415de50 2023-10-09T11:41:14.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.577+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fed040caef0 con 0x7fece4067230 2023-10-09T11:41:14.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.579+0000 7fecfa7fc700 1 -- 172.21.15.26:0/1043649178 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fed040caef0 con 0x7fece4067230 2023-10-09T11:41:14.580 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:41:14.580 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:14.581 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:41:14.581 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:14.581 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 msgr2=0x7fece40696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 0x7fece40696e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 msgr2=0x7fed040c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fed0406eb00 tx=0x7fecfc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 shutdown_connections 2023-10-09T11:41:14.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0415de50 0x7fed040c7b20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed040cef40 0x7fed04140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fece4067230 0x7fece40696e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 --2- 172.21.15.26:0/1043649178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed04153c30 0x7fed040c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 >> 172.21.15.26:0/1043649178 conn(0x7fed040703a0 msgr2=0x7fed040c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 shutdown_connections 2023-10-09T11:41:14.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.580+0000 7fed0359e700 1 -- 172.21.15.26:0/1043649178 wait complete. 2023-10-09T11:41:14.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:14.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.719+0000 7f871d9d8700 1 Processor -- start 2023-10-09T11:41:14.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.719+0000 7f871d9d8700 1 -- start start 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f871d9d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f87180ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f871d9d8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180acc00 con 0x7f871815dfd0 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f871d9d8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180abff0 con 0x7f8718159920 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f871d9d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180ac2d0 con 0x7f8718159550 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f8717fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f871815dfd0 0x7f87180aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39690/0 (socket says 172.21.15.26:39690) 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f8717fff700 1 -- 172.21.15.26:0/1949891273 learned_addr learned my addr 172.21.15.26:0/1949891273 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f871c9d6700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f87180ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704557104 0 0) 0x7f87180acc00 con 0x7f871815dfd0 2023-10-09T11:41:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.720+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8704003570 con 0x7f871815dfd0 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172605267 0 0) 0x7f8704003570 con 0x7f871815dfd0 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 msgr2=0x7f87180ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f87180ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 >> v1:172.21.15.67:6789/0 conn(0x7f8718159920 legacy=0x7f87180ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180ac5b0 con 0x7f871815dfd0 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f8708001470 con 0x7f871815dfd0 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 >> v1:172.21.15.26:6789/0 conn(0x7f871815dfd0 legacy=0x7f87180aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f8704003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704003fd0 0x7f8704004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704004d50 0x7f87040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180ac2d0 con 0x7f8704004d50 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870400bb40 con 0x7f8704003fd0 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870400bd00 con 0x7f8718159550 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704004d50 0x7f87040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871c9d6700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f8704003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f8717fff700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704003fd0 0x7f8704004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 -- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 msgr2=0x7f8704003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8718159550 0x7f8704003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 -- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704003fd0 msgr2=0x7f8704004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8704003fd0 0x7f8704004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 -- 172.21.15.26:0/1949891273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704003570 con 0x7f8704004d50 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.721+0000 7f871d1d7700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704004d50 0x7f87040051c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8710002060 tx=0x7f87100016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b7c586fb347d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100019f0 con 0x7f8704004d50 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000c8b0 con 0x7f8704004d50 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f87177fe700 1 -- 172.21.15.26:0/1949891273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000cc70 con 0x7f8704004d50 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 -- 172.21.15.26:0/1949891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704004d50 msgr2=0x7f87040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 --2- 172.21.15.26:0/1949891273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8704004d50 0x7f87040051c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8710002060 tx=0x7f87100016e0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d1d7700 1 -- 172.21.15.26:0/1949891273 reap_dead start 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 -- 172.21.15.26:0/1949891273 shutdown_connections 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 -- 172.21.15.26:0/1949891273 >> 172.21.15.26:0/1949891273 conn(0x7f871806ce80 msgr2=0x7f87180ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 -- 172.21.15.26:0/1949891273 shutdown_connections 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.722+0000 7f871d9d8700 1 -- 172.21.15.26:0/1949891273 wait complete. 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.723+0000 7f871d9d8700 1 Processor -- start 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 -- start start 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f871814d380 0x7f8718155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87180cc390 0x7f87180cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718156d70 con 0x7f871814cfb0 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718156160 con 0x7f871814d380 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d9d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8718156440 con 0x7f87180cc390 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871c9d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871c9d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40044/0 (socket says 172.21.15.26:40044) 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871c9d6700 1 -- 172.21.15.26:0/950552494 learned_addr learned my addr 172.21.15.26:0/950552494 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f8717fff700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f871814d380 0x7f8718155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.724+0000 7f871d1d7700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87180cc390 0x7f87180cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 -- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87180cc390 msgr2=0x7f87180cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87180cc390 0x7f87180cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 -- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f871814d380 msgr2=0x7f8718155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f871814d380 0x7f8718155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 -- 172.21.15.26:0/950552494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718156720 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871c9d6700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8700006ac0 tx=0x7f87000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000f940 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870000faa0 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8718156a00 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000fe20 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.725+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87180ccd40 con 0x7f871814cfb0 2023-10-09T11:41:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.726+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871804c3c0 con 0x7f871814cfb0 2023-10-09T11:41:14.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.726+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8700014650 con 0x7f871814cfb0 2023-10-09T11:41:14.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.727+0000 7f8714ff9700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 0x7f86f80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.727+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8700018030 con 0x7f871814cfb0 2023-10-09T11:41:14.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.727+0000 7f8717fff700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 0x7f86f80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.727+0000 7f8717fff700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 0x7f86f80696b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f871816cd10 tx=0x7f8708001e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.731+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8700052250 con 0x7f871814cfb0 2023-10-09T11:41:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.923+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f871806e7c0 con 0x7f871814cfb0 2023-10-09T11:41:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.923+0000 7f8714ff9700 1 -- 172.21.15.26:0/950552494 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8700055870 con 0x7f871814cfb0 2023-10-09T11:41:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 msgr2=0x7f86f80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 0x7f86f80696b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f871816cd10 tx=0x7f8708001e70 comp rx=0 tx=0).stop 2023-10-09T11:41:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 msgr2=0x7f87180cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8700006ac0 tx=0x7f87000091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 shutdown_connections 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067200 0x7f86f80696b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87180cc390 0x7f87180cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f871814cfb0 0x7f87180cd400 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 --2- 172.21.15.26:0/950552494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f871814d380 0x7f8718155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 >> 172.21.15.26:0/950552494 conn(0x7f871806ce80 msgr2=0x7f87181533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 shutdown_connections 2023-10-09T11:41:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:14.925+0000 7f871d9d8700 1 -- 172.21.15.26:0/950552494 wait complete. 2023-10-09T11:41:14.939 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-09T11:41:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.059+0000 7f4e5b61a700 1 Processor -- start 2023-10-09T11:41:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.060+0000 7f4e5b61a700 1 -- start start 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.060+0000 7f4e5b61a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e54159530 0x7f4e540ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.060+0000 7f4e5b61a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540ccfd0 con 0x7f4e5406e0e0 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.060+0000 7f4e5b61a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cf0e0 con 0x7f4e5406dc70 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.060+0000 7f4e5b61a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5415a3d0 con 0x7f4e54159530 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e59bb7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e5406e0e0 0x7f4e540cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39694/0 (socket says 172.21.15.26:39694) 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e59bb7700 1 -- 172.21.15.26:0/1495370979 learned_addr learned my addr 172.21.15.26:0/1495370979 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e593b6700 1 --2- 172.21.15.26:0/1495370979 >> v2:172.21.15.67:3300/0 conn(0x7f4e54159530 0x7f4e540ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736311619 0 0) 0x7f4e540ccfd0 con 0x7f4e5406e0e0 2023-10-09T11:41:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c003570 con 0x7f4e5406e0e0 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e593b6700 1 -- 172.21.15.26:0/1495370979 >> v1:172.21.15.67:6789/0 conn(0x7f4e5406dc70 legacy=0x7f4e54159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e593b6700 1 -- 172.21.15.26:0/1495370979 >> v1:172.21.15.26:6789/0 conn(0x7f4e5406e0e0 legacy=0x7f4e540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1350083275 0 0) 0x7f4e3c003570 con 0x7f4e5406e0e0 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e593b6700 1 -- 172.21.15.26:0/1495370979 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5415a6b0 con 0x7f4e54159530 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e593b6700 1 --2- 172.21.15.26:0/1495370979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e54159530 0x7f4e540ceba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009e60 tx=0x7f4e44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7cb4650c5c0e232 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400e070 con 0x7f4e54159530 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400b850 con 0x7f4e54159530 2023-10-09T11:41:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.061+0000 7f4e53fff700 1 -- 172.21.15.26:0/1495370979 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c001470 con 0x7f4e54159530 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 -- 172.21.15.26:0/1495370979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e54159530 msgr2=0x7f4e540ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/1495370979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e54159530 0x7f4e540ceba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009e60 tx=0x7f4e44009780 comp rx=0 tx=0).stop 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 -- 172.21.15.26:0/1495370979 shutdown_connections 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/1495370979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e54159530 0x7f4e540ceba0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 -- 172.21.15.26:0/1495370979 >> 172.21.15.26:0/1495370979 conn(0x7f4e540703a0 msgr2=0x7f4e540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 -- 172.21.15.26:0/1495370979 shutdown_connections 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.062+0000 7f4e5b61a700 1 -- 172.21.15.26:0/1495370979 wait complete. 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.063+0000 7f4e5b61a700 1 Processor -- start 2023-10-09T11:41:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.063+0000 7f4e5b61a700 1 -- start start 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e5406dc70 0x7f4e54152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e5406e0e0 0x7f4e540b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b4970 con 0x7f4e54159530 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b4c50 con 0x7f4e5406e0e0 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e5b61a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b4f30 con 0x7f4e5406dc70 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e59bb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e59bb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40048/0 (socket says 172.21.15.26:40048) 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e59bb7700 1 -- 172.21.15.26:0/2264129453 learned_addr learned my addr 172.21.15.26:0/2264129453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e593b6700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e5406dc70 0x7f4e54152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.064+0000 7f4e58bb5700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e5406e0e0 0x7f4e540b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 -- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e5406dc70 msgr2=0x7f4e54152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e5406dc70 0x7f4e54152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 -- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e5406e0e0 msgr2=0x7f4e540b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e5406e0e0 0x7f4e540b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 -- 172.21.15.26:0/2264129453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009a20 con 0x7f4e54159530 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e59bb7700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cb60 tx=0x7f4e4c001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c001d30 con 0x7f4e54159530 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c007360 con 0x7f4e54159530 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540b5210 con 0x7f4e54159530 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c004830 con 0x7f4e54159530 2023-10-09T11:41:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.065+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540b59f0 con 0x7f4e54159530 2023-10-09T11:41:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.066+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5404c3c0 con 0x7f4e54159530 2023-10-09T11:41:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.066+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4e4c004be0 con 0x7f4e54159530 2023-10-09T11:41:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.067+0000 7f4e517fa700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 0x7f4e400696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.067+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e4c083e30 con 0x7f4e54159530 2023-10-09T11:41:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.067+0000 7f4e593b6700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 0x7f4e400696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.068+0000 7f4e593b6700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 0x7f4e400696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4e440099f0 tx=0x7f4e44017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.071+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e4c050d50 con 0x7f4e54159530 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.296+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4e5415a990 con 0x7f4e40067200 2023-10-09T11:41:15.299 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.298+0000 7f48c13c6700 -1 client.5453 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-09T11:40:44.354235+0000 mtime=2023-10-09T11:40:44.354235+0000 ctime=2023-10-09T11:40:44.361397+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000381635"] has_dir_layout 0x562f397cc600) 2023-10-09T11:41:15.304 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.303+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:15.304 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.303+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:15.304 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.303+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:15.304 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.303+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:15.304 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:15.303+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:15.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.310+0000 7f4e517fa700 1 -- 172.21.15.26:0/2264129453 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+468 (secure 0 0 0) 0x7f4e5415a990 con 0x7f4e40067200 2023-10-09T11:41:15.311 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:15.311 INFO:teuthology.orchestra.run.smithi026.stdout: "mon_addrs": [ 2023-10-09T11:41:15.311 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6789", 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6789", 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6790" 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": { 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "data": [ 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": " 340G", 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_data", 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: "used": " 0 " 2023-10-09T11:41:15.312 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": [ 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": " 340G", 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_metadata", 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: "used": "64.0k" 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:41:15.313 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:15.314 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:15.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 msgr2=0x7f4e400696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 0x7f4e400696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4e440099f0 tx=0x7f4e44017000 comp rx=0 tx=0).stop 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 msgr2=0x7f4e540b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cb60 tx=0x7f4e4c001aa0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 shutdown_connections 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e54159530 0x7f4e540b3480 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e40067200 0x7f4e400696b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e5406dc70 0x7f4e54152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 --2- 172.21.15.26:0/2264129453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e5406e0e0 0x7f4e540b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 >> 172.21.15.26:0/2264129453 conn(0x7f4e540703a0 msgr2=0x7f4e5415ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 shutdown_connections 2023-10-09T11:41:15.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.312+0000 7f4e5b61a700 1 -- 172.21.15.26:0/2264129453 wait complete. 2023-10-09T11:41:15.325 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:15.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:15.371 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:15.417 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:15.417 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:41:15.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:15.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:15.458 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:41:15.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:15.458 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:41:15.513 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:41:15.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:15.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:15.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:41:15.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:15.555 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:41:15.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:15.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.731+0000 7f29b8a69700 1 Processor -- start 2023-10-09T11:41:15.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.731+0000 7f29b8a69700 1 -- start start 2023-10-09T11:41:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b8a69700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b8a69700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b8a69700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40acc00 con 0x7f29b415dfd0 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b8a69700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40abff0 con 0x7f29b4159550 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b8a69700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ac2d0 con 0x7f29b4159920 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b3fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b37fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:57570/0 (socket says 172.21.15.26:57570) 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b37fe700 1 -- 172.21.15.26:0/161629295 learned_addr learned my addr 172.21.15.26:0/161629295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.732+0000 7f29b2ffd700 1 --1- 172.21.15.26:0/161629295 >> v1:172.21.15.67:6789/0 conn(0x7f29b415dfd0 0x7f29b40aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:56184/0 (socket says 172.21.15.26:56184) 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b3fff700 1 -- 172.21.15.26:0/161629295 >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 msgr2=0x7f29b40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b3fff700 1 --2- 172.21.15.26:0/161629295 >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b3fff700 1 -- 172.21.15.26:0/161629295 >> v1:172.21.15.67:6789/0 conn(0x7f29b415dfd0 legacy=0x7f29b40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b3fff700 1 -- 172.21.15.26:0/161629295 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40ac5b0 con 0x7f29b4159920 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b37fe700 1 --2- 172.21.15.26:0/161629295 >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b3fff700 1 --2- 172.21.15.26:0/161629295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40ad090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009e60 tx=0x7f29ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b6136e5a94ee88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b27fc700 1 -- 172.21.15.26:0/161629295 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e070 con 0x7f29b4159920 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b27fc700 1 -- 172.21.15.26:0/161629295 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00bb60 con 0x7f29b4159920 2023-10-09T11:41:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b27fc700 1 -- 172.21.15.26:0/161629295 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac012430 con 0x7f29b4159920 2023-10-09T11:41:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b8a69700 1 -- 172.21.15.26:0/161629295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 msgr2=0x7f29b40ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.733+0000 7f29b8a69700 1 --2- 172.21.15.26:0/161629295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40ad090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009e60 tx=0x7f29ac009780 comp rx=0 tx=0).stop 2023-10-09T11:41:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 -- 172.21.15.26:0/161629295 shutdown_connections 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 --2- 172.21.15.26:0/161629295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40ad090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 --2- 172.21.15.26:0/161629295 >> v2:172.21.15.67:3300/0 conn(0x7f29b4159550 0x7f29b40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 -- 172.21.15.26:0/161629295 >> 172.21.15.26:0/161629295 conn(0x7f29b406ce80 msgr2=0x7f29b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 -- 172.21.15.26:0/161629295 shutdown_connections 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.734+0000 7f29b8a69700 1 -- 172.21.15.26:0/161629295 wait complete. 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.735+0000 7f29b8a69700 1 Processor -- start 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.735+0000 7f29b8a69700 1 -- start start 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 0x7f29b4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4169c30 con 0x7f29b4159550 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c7aa0 con 0x7f29b415dfd0 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c7d20 con 0x7f29b4159920 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40052/0 (socket says 172.21.15.26:40052) 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 -- 172.21.15.26:0/3798953883 learned_addr learned my addr 172.21.15.26:0/3798953883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b3fff700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 0x7f29b4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b2ffd700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 -- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 msgr2=0x7f29b40c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 -- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 msgr2=0x7f29b4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 0x7f29b4151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 -- 172.21.15.26:0/3798953883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40094f0 con 0x7f29b4159550 2023-10-09T11:41:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b3fff700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 0x7f29b4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b37fe700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f29a400ec50 tx=0x7f29a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400c9d0 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400cb30 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4013470 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac009a20 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.736+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40c82e0 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.737+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4169d70 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.738+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f29a4013860 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.738+0000 7f299b7fe700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 0x7f29a00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.738+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29a40851f0 con 0x7f29b4159550 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.738+0000 7f29b2ffd700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 0x7f29a00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.739+0000 7f29b2ffd700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 0x7f29a00696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29b4158d50 tx=0x7f29a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.742+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29a4052030 con 0x7f29b4159550 2023-10-09T11:41:15.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.978+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b404c3c0 con 0x7f29b4159550 2023-10-09T11:41:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.979+0000 7f299b7fe700 1 -- 172.21.15.26:0/3798953883 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f29a4055650 con 0x7f29b4159550 2023-10-09T11:41:15.980 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:15.980 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.980+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 msgr2=0x7f29a00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.980+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 0x7f29a00696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29b4158d50 tx=0x7f29a8009040 comp rx=0 tx=0).stop 2023-10-09T11:41:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.980+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 msgr2=0x7f29b4157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.980+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f29a400ec50 tx=0x7f29a4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 shutdown_connections 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b415dfd0 0x7f29b4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29b4159550 0x7f29b4157ac0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f29a0067200 0x7f29a00696b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 --2- 172.21.15.26:0/3798953883 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b4159920 0x7f29b40c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 >> 172.21.15.26:0/3798953883 conn(0x7f29b406ce80 msgr2=0x7f29b40b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 shutdown_connections 2023-10-09T11:41:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:15.981+0000 7f29b8a69700 1 -- 172.21.15.26:0/3798953883 wait complete. 2023-10-09T11:41:15.984 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 59 2023-10-09T11:41:15.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:16.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.113+0000 7f2ba5b83700 1 Processor -- start 2023-10-09T11:41:16.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.113+0000 7f2ba5b83700 1 -- start start 2023-10-09T11:41:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.113+0000 7f2ba5b83700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ba00cb5a0 0x7f2ba00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2ba5b83700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba00cd9e0 0x7f2ba0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2ba5b83700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba015ae40 con 0x7f2ba00cde50 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2ba5b83700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00d13f0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2ba5b83700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba015ab60 con 0x7f2ba00cd9e0 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ba00cb5a0 0x7f2ba00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ba00cb5a0 0x7f2ba00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40066/0 (socket says 172.21.15.26:40066) 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2585722622 learned_addr learned my addr 172.21.15.26:0/2585722622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2585722622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba00cd9e0 msgr2=0x7f2ba0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9effd700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba00cd9e0 0x7f2ba0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba00cd9e0 0x7f2ba0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2585722622 >> v1:172.21.15.67:6789/0 conn(0x7f2ba00cde50 legacy=0x7f2ba0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2585722622 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00ccf00 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9f7fe700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba00cb970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2b940099b0 tx=0x7f2b94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd2fefc0d79ac2e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9e7fc700 1 -- 172.21.15.26:0/2585722622 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400b820 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9e7fc700 1 -- 172.21.15.26:0/2585722622 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9400b980 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.114+0000 7f2b9e7fc700 1 -- 172.21.15.26:0/2585722622 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400bd20 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2585722622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 msgr2=0x7f2ba00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba00cb970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2b940099b0 tx=0x7f2b94009250 comp rx=0 tx=0).stop 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2585722622 shutdown_connections 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba00cb970 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2585722622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba00cd9e0 0x7f2ba0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2585722622 >> 172.21.15.26:0/2585722622 conn(0x7f2ba0070e30 msgr2=0x7f2ba00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2585722622 shutdown_connections 2023-10-09T11:41:16.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.115+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2585722622 wait complete. 2023-10-09T11:41:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.116+0000 7f2ba5b83700 1 Processor -- start 2023-10-09T11:41:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.116+0000 7f2ba5b83700 1 -- start start 2023-10-09T11:41:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 0x7f2ba01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba0159b20 0x7f2ba0142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0159150 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0155fa0 con 0x7f2ba00cd9e0 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2ba5b83700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0158540 con 0x7f2ba0159b20 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40072/0 (socket says 172.21.15.26:40072) 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2893182077 learned_addr learned my addr 172.21.15.26:0/2893182077 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9effd700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 0x7f2ba01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba0159b20 msgr2=0x7f2ba0142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9ffff700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba0159b20 0x7f2ba0142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba0159b20 0x7f2ba0142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 msgr2=0x7f2ba01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 0x7f2ba01595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9f7fe700 1 -- 172.21.15.26:0/2893182077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940094f0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.117+0000 7f2b9effd700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 0x7f2ba01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2b9f7fe700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009290 tx=0x7f2b94016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011d70 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94020070 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401b6a0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba0158820 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.118+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba0158de0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.119+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba004c3c0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.119+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2b94022030 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.120+0000 7f2b877fe700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 0x7f2b8c0696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.120+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b94086a10 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.120+0000 7f2b9effd700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 0x7f2b8c0696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.121+0000 7f2b9effd700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 0x7f2b8c0696e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00b65b0 tx=0x7f2b90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.124+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b94053850 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.323+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba004c3c0 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.324+0000 7f2b877fe700 1 -- 172.21.15.26:0/2893182077 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f2b94056e70 con 0x7f2ba00cb5a0 2023-10-09T11:41:16.325 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:16.326 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":88,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:01.185353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 msgr2=0x7f2b8c0696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 0x7f2b8c0696e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00b65b0 tx=0x7f2b90008040 comp rx=0 tx=0).stop 2023-10-09T11:41:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 msgr2=0x7f2ba0155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009290 tx=0x7f2b94016000 comp rx=0 tx=0).stop 2023-10-09T11:41:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 shutdown_connections 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2b8c067230 0x7f2b8c0696e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ba0159b20 0x7f2ba0142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba00cb5a0 0x7f2ba0155a60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 --2- 172.21.15.26:0/2893182077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ba00cd9e0 0x7f2ba01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 >> 172.21.15.26:0/2893182077 conn(0x7f2ba0070e30 msgr2=0x7f2ba00b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 shutdown_connections 2023-10-09T11:41:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.326+0000 7f2ba5b83700 1 -- 172.21.15.26:0/2893182077 wait complete. 2023-10-09T11:41:16.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:40:57.451694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:40:58.671124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:16.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:16.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 Processor -- start 2023-10-09T11:41:16.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 -- start start 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b6c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c0ccfd0 con 0x7f3b6c159530 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c15a3d0 con 0x7f3b6c06e0e0 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.461+0000 7f3b71e38700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c15a6b0 con 0x7f3b6c06dc70 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b6c159530 0x7f3b6c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39700/0 (socket says 172.21.15.26:39700) 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6b7fe700 1 -- 172.21.15.26:0/2169227185 learned_addr learned my addr 172.21.15.26:0/2169227185 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375654975 0 0) 0x7f3b6c0ccfd0 con 0x7f3b6c159530 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b54003570 con 0x7f3b6c159530 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6affd700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b6c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686350422 0 0) 0x7f3b54003570 con 0x7f3b6c159530 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 msgr2=0x7f3b6c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b6c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 >> v1:172.21.15.67:6789/0 conn(0x7f3b6c06e0e0 legacy=0x7f3b6c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c15a990 con 0x7f3b6c159530 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3b5c0017f0 con 0x7f3b6c159530 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 >> v1:172.21.15.26:6789/0 conn(0x7f3b6c159530 legacy=0x7f3b6c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b54003a90 0x7f3b54003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b54004d50 0x7f3b540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c15a6b0 con 0x7f3b54004d50 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5400bb70 con 0x7f3b54003a90 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5400bd30 con 0x7f3b6c06dc70 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6bfff700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b54004d50 0x7f3b540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6b7fe700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b54003a90 0x7f3b54003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.462+0000 7f3b6affd700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 -- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 msgr2=0x7f3b54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c06dc70 0x7f3b54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 -- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b54003a90 msgr2=0x7f3b54003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b54003a90 0x7f3b54003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 -- 172.21.15.26:0/2169227185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54003570 con 0x7f3b54004d50 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6bfff700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b54004d50 0x7f3b540051c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3b640018b0 tx=0x7f3b64007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef1a266f7f70b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012420 con 0x7f3b54004d50 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64012580 con 0x7f3b54004d50 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b6a7fc700 1 -- 172.21.15.26:0/2169227185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012920 con 0x7f3b54004d50 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b71e38700 1 -- 172.21.15.26:0/2169227185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b54004d50 msgr2=0x7f3b540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.463+0000 7f3b71e38700 1 --2- 172.21.15.26:0/2169227185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b54004d50 0x7f3b540051c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3b640018b0 tx=0x7f3b64007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.464+0000 7f3b6bfff700 1 -- 172.21.15.26:0/2169227185 reap_dead start 2023-10-09T11:41:16.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.464+0000 7f3b71e38700 1 -- 172.21.15.26:0/2169227185 shutdown_connections 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.464+0000 7f3b71e38700 1 -- 172.21.15.26:0/2169227185 >> 172.21.15.26:0/2169227185 conn(0x7f3b6c0703a0 msgr2=0x7f3b6c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.464+0000 7f3b71e38700 1 -- 172.21.15.26:0/2169227185 shutdown_connections 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.464+0000 7f3b71e38700 1 -- 172.21.15.26:0/2169227185 wait complete. 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.465+0000 7f3b71e38700 1 Processor -- start 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.465+0000 7f3b71e38700 1 -- start start 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b6c14d370 0x7f3b6c0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c16b280 0x7f3b6c14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c7790 con 0x7f3b6c0ca640 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c8310 con 0x7f3b6c14d370 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b71e38700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0ca1f0 con 0x7f3b6c16b280 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40080/0 (socket says 172.21.15.26:40080) 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 -- 172.21.15.26:0/1555833458 learned_addr learned my addr 172.21.15.26:0/1555833458 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6bfff700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c16b280 0x7f3b6c14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6b7fe700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b6c14d370 0x7f3b6c0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 -- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c16b280 msgr2=0x7f3b6c14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c16b280 0x7f3b6c14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 -- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b6c14d370 msgr2=0x7f3b6c0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b6c14d370 0x7f3b6c0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 -- 172.21.15.26:0/1555833458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c14d740 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b6affd700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3b60011b10 tx=0x7f3b600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000f940 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.466+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6000faa0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.467+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0c79e0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.467+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000fe20 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.467+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c0c7fa0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.467+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c0c84a0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.468+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3b60014650 con 0x7f3b6c0ca640 2023-10-09T11:41:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.468+0000 7f3b537fe700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 0x7f3b580696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.468+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b60018030 con 0x7f3b6c0ca640 2023-10-09T11:41:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.468+0000 7f3b6b7fe700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 0x7f3b580696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.469+0000 7f3b6b7fe700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 0x7f3b580696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c002060 tx=0x7f3b5c0021d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.473+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b600522c0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.666+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b6c04c3c0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.667+0000 7f3b537fe700 1 -- 172.21.15.26:0/1555833458 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b600558e0 con 0x7f3b6c0ca640 2023-10-09T11:41:16.669 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 msgr2=0x7f3b580696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 0x7f3b580696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c002060 tx=0x7f3b5c0021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 msgr2=0x7f3b6c16ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3b60011b10 tx=0x7f3b600091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 shutdown_connections 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b58067200 0x7f3b580696b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b6c16b280 0x7f3b6c14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b6c14d370 0x7f3b6c0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 --2- 172.21.15.26:0/1555833458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6c0ca640 0x7f3b6c16ad40 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 >> 172.21.15.26:0/1555833458 conn(0x7f3b6c0703a0 msgr2=0x7f3b6c0c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 shutdown_connections 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.669+0000 7f3b71e38700 1 -- 172.21.15.26:0/1555833458 wait complete. 2023-10-09T11:41:16.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:16.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.802+0000 7f5ae3251700 1 Processor -- start 2023-10-09T11:41:16.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.802+0000 7f5ae3251700 1 -- start start 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae3251700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5adc153dd0 0x7f5adc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae3251700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc15ac50 con 0x7f5adc153a00 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae3251700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc15d010 con 0x7f5adc0cea00 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae3251700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc15af60 con 0x7f5adc153dd0 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae224f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5adc153a00 0x7f5adc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39708/0 (socket says 172.21.15.26:39708) 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae224f700 1 -- 172.21.15.26:0/2904039980 learned_addr learned my addr 172.21.15.26:0/2904039980 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2904039980 >> v2:172.21.15.67:3300/0 conn(0x7f5adc153dd0 0x7f5adc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561817063 0 0) 0x7f5adc15ac50 con 0x7f5adc153a00 2023-10-09T11:41:16.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.803+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac4003570 con 0x7f5adc153a00 2023-10-09T11:41:16.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102395394 0 0) 0x7f5ac4003570 con 0x7f5adc153a00 2023-10-09T11:41:16.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 >> v2:172.21.15.67:3300/0 conn(0x7f5adc153dd0 msgr2=0x7f5adc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 --2- 172.21.15.26:0/2904039980 >> v2:172.21.15.67:3300/0 conn(0x7f5adc153dd0 0x7f5adc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 >> v1:172.21.15.67:6789/0 conn(0x7f5adc0cea00 legacy=0x7f5adc0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc15b240 con 0x7f5adc153a00 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f5acc0017f0 con 0x7f5adc153a00 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 >> v1:172.21.15.26:6789/0 conn(0x7f5adc153a00 legacy=0x7f5adc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 0x7f5ac4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac40051c0 0x7f5ac400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc15af60 con 0x7f5ac4004810 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac400c160 con 0x7f5ac4003a60 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac400c320 con 0x7f5ac40051c0 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 0x7f5ac4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae224f700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae2a50700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac40051c0 0x7f5ac400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 -- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac40051c0 msgr2=0x7f5ac400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac40051c0 0x7f5ac400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 -- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac4003a60 msgr2=0x7f5ac4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 -- 172.21.15.26:0/2904039980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4003570 con 0x7f5ac4004810 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae2a50700 1 -- 172.21.15.26:0/2904039980 reap_dead start 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.804+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 0x7f5ac4004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5adc15e390 tx=0x7f5ad00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300c681abcdc5bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e710 con 0x7f5ac4004810 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000e870 con 0x7f5ac4004810 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae124d700 1 -- 172.21.15.26:0/2904039980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ec30 con 0x7f5ac4004810 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 -- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 msgr2=0x7f5ac4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 0x7f5ac4004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5adc15e390 tx=0x7f5ad00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 -- 172.21.15.26:0/2904039980 shutdown_connections 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2904039980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4004810 0x7f5ac4004c80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 -- 172.21.15.26:0/2904039980 >> 172.21.15.26:0/2904039980 conn(0x7f5adc0703a0 msgr2=0x7f5adc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 -- 172.21.15.26:0/2904039980 shutdown_connections 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.805+0000 7f5ae3251700 1 -- 172.21.15.26:0/2904039980 wait complete. 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.806+0000 7f5ae3251700 1 Processor -- start 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.806+0000 7f5ae3251700 1 -- start start 2023-10-09T11:41:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac4004810 0x7f5adc0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5adc14aa20 0x7f5adc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc06e140 con 0x7f5adc06dcd0 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0cc150 con 0x7f5adc14aa20 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae3251700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0cc3d0 con 0x7f5ac4004810 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae2a50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae2a50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40102/0 (socket says 172.21.15.26:40102) 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae2a50700 1 -- 172.21.15.26:0/2191184587 learned_addr learned my addr 172.21.15.26:0/2191184587 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae224f700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac4004810 0x7f5adc0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.807+0000 7f5ae1a4e700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5adc14aa20 0x7f5adc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 -- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac4004810 msgr2=0x7f5adc0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac4004810 0x7f5adc0cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 -- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5adc14aa20 msgr2=0x7f5adc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5adc14aa20 0x7f5adc06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 -- 172.21.15.26:0/2191184587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0cc6b0 con 0x7f5adc06dcd0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae2a50700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5adc088780 tx=0x7f5ad4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4006b00 con 0x7f5adc06dcd0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4006c80 con 0x7f5adc06dcd0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc0cc990 con 0x7f5adc06dcd0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4007030 con 0x7f5adc06dcd0 2023-10-09T11:41:16.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.808+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc14ae70 con 0x7f5adc06dcd0 2023-10-09T11:41:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.809+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0cceb0 con 0x7f5adc06dcd0 2023-10-09T11:41:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.809+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5ad40073a0 con 0x7f5adc06dcd0 2023-10-09T11:41:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.810+0000 7f5ada7fc700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 0x7f5ac80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.810+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ad4083ff0 con 0x7f5adc06dcd0 2023-10-09T11:41:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.810+0000 7f5ae224f700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 0x7f5ac80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.810+0000 7f5ae224f700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 0x7f5ac80696b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0013d0 tx=0x7f5acc006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:16.814+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5adc0cceb0 con 0x7f5adc06dcd0 2023-10-09T11:41:17.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.006+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5adc0cceb0 con 0x7f5adc06dcd0 2023-10-09T11:41:17.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.006+0000 7f5ada7fc700 1 -- 172.21.15.26:0/2191184587 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5adc0cceb0 con 0x7f5adc06dcd0 2023-10-09T11:41:17.007 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:41:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 msgr2=0x7f5ac80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 0x7f5ac80696b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0013d0 tx=0x7f5acc006040 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 msgr2=0x7f5adc169e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5adc088780 tx=0x7f5ad4007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 shutdown_connections 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5adc06dcd0 0x7f5adc169e10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5ac8067200 0x7f5ac80696b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5ac4004810 0x7f5adc0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 --2- 172.21.15.26:0/2191184587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5adc14aa20 0x7f5adc06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 >> 172.21.15.26:0/2191184587 conn(0x7f5adc0703a0 msgr2=0x7f5adc0c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 shutdown_connections 2023-10-09T11:41:17.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.008+0000 7f5ae3251700 1 -- 172.21.15.26:0/2191184587 wait complete. 2023-10-09T11:41:17.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.142+0000 7f11005da700 1 Processor -- start 2023-10-09T11:41:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.142+0000 7f11005da700 1 -- start start 2023-10-09T11:41:17.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f11005da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f806dc70 0x7f10f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f11005da700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10f806e0e0 0x7f10f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f11005da700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f80ccfd0 con 0x7f10f8159530 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f11005da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f815a3d0 con 0x7f10f806dc70 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f11005da700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f815a6b0 con 0x7f10f806e0e0 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f10fe376700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10f8159530 0x7f10f80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39710/0 (socket says 172.21.15.26:39710) 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f10fe376700 1 -- 172.21.15.26:0/4025582095 learned_addr learned my addr 172.21.15.26:0/4025582095 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f10fdb75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f806dc70 0x7f10f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.143+0000 7f10feb77700 1 --2- 172.21.15.26:0/4025582095 >> v2:172.21.15.67:3300/0 conn(0x7f10f806e0e0 0x7f10f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fd374700 1 -- 172.21.15.26:0/4025582095 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843509523 0 0) 0x7f10f80ccfd0 con 0x7f10f8159530 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fd374700 1 -- 172.21.15.26:0/4025582095 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e0003570 con 0x7f10f8159530 2023-10-09T11:41:17.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fdb75700 1 -- 172.21.15.26:0/4025582095 >> v2:172.21.15.67:3300/0 conn(0x7f10f806e0e0 msgr2=0x7f10f80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fdb75700 1 --2- 172.21.15.26:0/4025582095 >> v2:172.21.15.67:3300/0 conn(0x7f10f806e0e0 0x7f10f80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fdb75700 1 -- 172.21.15.26:0/4025582095 >> v1:172.21.15.26:6789/0 conn(0x7f10f8159530 legacy=0x7f10f80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fdb75700 1 -- 172.21.15.26:0/4025582095 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f815a990 con 0x7f10f806dc70 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fdb75700 1 --2- 172.21.15.26:0/4025582095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f8159900 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cf2b0 tx=0x7f10ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf47cc0108288e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fd374700 1 -- 172.21.15.26:0/4025582095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011630 con 0x7f10f806dc70 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fd374700 1 -- 172.21.15.26:0/4025582095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0117b0 con 0x7f10f806dc70 2023-10-09T11:41:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.144+0000 7f10fd374700 1 -- 172.21.15.26:0/4025582095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec011b30 con 0x7f10f806dc70 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 -- 172.21.15.26:0/4025582095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 msgr2=0x7f10f8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 --2- 172.21.15.26:0/4025582095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f8159900 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cf2b0 tx=0x7f10ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 -- 172.21.15.26:0/4025582095 shutdown_connections 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 --2- 172.21.15.26:0/4025582095 >> v2:172.21.15.67:3300/0 conn(0x7f10f806e0e0 0x7f10f80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 --2- 172.21.15.26:0/4025582095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f8159900 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 -- 172.21.15.26:0/4025582095 >> 172.21.15.26:0/4025582095 conn(0x7f10f80703a0 msgr2=0x7f10f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 -- 172.21.15.26:0/4025582095 shutdown_connections 2023-10-09T11:41:17.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.145+0000 7f11005da700 1 -- 172.21.15.26:0/4025582095 wait complete. 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.146+0000 7f11005da700 1 Processor -- start 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.146+0000 7f11005da700 1 -- start start 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10f806e0e0 0x7f10f814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 0x7f10f81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80b4ba0 con 0x7f10f806dc70 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f816db80 con 0x7f10f8159530 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f816de60 con 0x7f10f806e0e0 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40126/0 (socket says 172.21.15.26:40126) 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 -- 172.21.15.26:0/4012794254 learned_addr learned my addr 172.21.15.26:0/4012794254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fdb75700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10f806e0e0 0x7f10f814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10feb77700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 0x7f10f81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 -- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10f806e0e0 msgr2=0x7f10f814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10f806e0e0 0x7f10f814e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 -- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 msgr2=0x7f10f81530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 0x7f10f81530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 -- 172.21.15.26:0/4012794254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009420 con 0x7f10f806dc70 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10feb77700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 0x7f10f81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10fe376700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f10e800cc40 tx=0x7f10e8001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800a980 con 0x7f10f806dc70 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800aae0 con 0x7f10f806dc70 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f816e140 con 0x7f10f806dc70 2023-10-09T11:41:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800ae80 con 0x7f10f806dc70 2023-10-09T11:41:17.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.147+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f80b22c0 con 0x7f10f806dc70 2023-10-09T11:41:17.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.148+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f804c3c0 con 0x7f10f806dc70 2023-10-09T11:41:17.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.149+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f10e8007300 con 0x7f10f806dc70 2023-10-09T11:41:17.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.149+0000 7f10f67fc700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 0x7f10e40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.149+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10e8084d90 con 0x7f10f806dc70 2023-10-09T11:41:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.149+0000 7f10fdb75700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 0x7f10e40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.150+0000 7f10fdb75700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 0x7f10e40696b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cf2b0 tx=0x7f10ec017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.153+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e8088030 con 0x7f10f806dc70 2023-10-09T11:41:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.346+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10f80ce6a0 con 0x7f10f806dc70 2023-10-09T11:41:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.346+0000 7f10f67fc700 1 -- 172.21.15.26:0/4012794254 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10e8051d30 con 0x7f10f806dc70 2023-10-09T11:41:17.348 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:41:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 msgr2=0x7f10e40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 0x7f10e40696b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f10f80cf2b0 tx=0x7f10ec017000 comp rx=0 tx=0).stop 2023-10-09T11:41:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 msgr2=0x7f10f816d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f10e800cc40 tx=0x7f10e8001a60 comp rx=0 tx=0).stop 2023-10-09T11:41:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 shutdown_connections 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f8159530 0x7f10f81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f806dc70 0x7f10f816d5a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f10e4067200 0x7f10e40696b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 --2- 172.21.15.26:0/4012794254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10f806e0e0 0x7f10f814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 >> 172.21.15.26:0/4012794254 conn(0x7f10f80703a0 msgr2=0x7f10f80cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 shutdown_connections 2023-10-09T11:41:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.348+0000 7f11005da700 1 -- 172.21.15.26:0/4012794254 wait complete. 2023-10-09T11:41:17.362 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:17.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.480+0000 7f801d4f8700 1 Processor -- start 2023-10-09T11:41:17.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.480+0000 7f801d4f8700 1 -- start start 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f801d4f8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80181599e0 0x7f80180ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f801d4f8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f801806e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f801d4f8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80180acc80 con 0x7f8018159610 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f801d4f8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180ac0b0 con 0x7f80181599e0 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f801d4f8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180ac350 con 0x7f80180ad650 2023-10-09T11:41:17.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f8016ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8018159610 0x7f801815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39726/0 (socket says 172.21.15.26:39726) 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f8016ffd700 1 -- 172.21.15.26:0/2545742185 learned_addr learned my addr 172.21.15.26:0/2545742185 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f80167fc700 1 --2- 172.21.15.26:0/2545742185 >> v2:172.21.15.67:3300/0 conn(0x7f80181599e0 0x7f80180ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f80177fe700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f801806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649649002 0 0) 0x7f80180acc80 con 0x7f8018159610 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.481+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8004003570 con 0x7f8018159610 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225193087 0 0) 0x7f8004003570 con 0x7f8018159610 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 msgr2=0x7f801806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f801806e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 >> v2:172.21.15.67:3300/0 conn(0x7f80181599e0 msgr2=0x7f80180ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 --2- 172.21.15.26:0/2545742185 >> v2:172.21.15.67:3300/0 conn(0x7f80181599e0 0x7f80180ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180ac630 con 0x7f8018159610 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f8010001470 con 0x7f8018159610 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 >> v1:172.21.15.26:6789/0 conn(0x7f8018159610 legacy=0x7f801815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8004003a60 0x7f8004003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f8004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f80040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180ac0b0 con 0x7f8004004810 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180ac350 con 0x7f8004003a60 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800400ba60 con 0x7f80180ad650 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f8004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8016ffd700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8004003a60 0x7f8004003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80177fe700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f80040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 -- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 msgr2=0x7f80040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f80040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 -- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8004003a60 msgr2=0x7f8004003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8004003a60 0x7f8004003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 -- 172.21.15.26:0/2545742185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004003570 con 0x7f8004004810 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80177fe700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80180ad650 0x7f80040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f80167fc700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f8004004c80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8000009c30 tx=0x7f80000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac02b4af1b408537 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.482+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000e710 con 0x7f8004004810 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000e870 con 0x7f8004004810 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f8015ffb700 1 -- 172.21.15.26:0/2545742185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000ec30 con 0x7f8004004810 2023-10-09T11:41:17.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 -- 172.21.15.26:0/2545742185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 msgr2=0x7f8004004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 --2- 172.21.15.26:0/2545742185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f8004004c80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8000009c30 tx=0x7f80000091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f80177fe700 1 -- 172.21.15.26:0/2545742185 reap_dead start 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 -- 172.21.15.26:0/2545742185 shutdown_connections 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 -- 172.21.15.26:0/2545742185 >> 172.21.15.26:0/2545742185 conn(0x7f801806ce80 msgr2=0x7f80180ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 -- 172.21.15.26:0/2545742185 shutdown_connections 2023-10-09T11:41:17.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.483+0000 7f801d4f8700 1 -- 172.21.15.26:0/2545742185 wait complete. 2023-10-09T11:41:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.484+0000 7f801d4f8700 1 Processor -- start 2023-10-09T11:41:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.484+0000 7f801d4f8700 1 -- start start 2023-10-09T11:41:17.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 0x7f8018156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8018152540 0x7f8018067de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c9dd0 con 0x7f8004004810 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c91c0 con 0x7f8018152540 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f801d4f8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c94a0 con 0x7f80181520d0 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40146/0 (socket says 172.21.15.26:40146) 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 -- 172.21.15.26:0/1263435621 learned_addr learned my addr 172.21.15.26:0/1263435621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f80177fe700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8018152540 0x7f8018067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f80167fc700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 0x7f8018156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 -- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 msgr2=0x7f8018156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 0x7f8018156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 -- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8018152540 msgr2=0x7f8018067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8018152540 0x7f8018067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f8016ffd700 1 -- 172.21.15.26:0/1263435621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180c9780 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.485+0000 7f80167fc700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 0x7f8018156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f8016ffd700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8010001120 tx=0x7f8010001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010018030 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000f610 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80180c9a60 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000f9b0 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.486+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80180c8de0 con 0x7f8004004810 2023-10-09T11:41:17.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.487+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801804c3c0 con 0x7f8004004810 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.487+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f801001b070 con 0x7f8004004810 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.488+0000 7f800effd700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 0x7f7ff80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.488+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8010019070 con 0x7f8004004810 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.488+0000 7f80167fc700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 0x7f7ff80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.488+0000 7f80167fc700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 0x7f7ff80696b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f80000091e0 tx=0x7f800001a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.492+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80100515e0 con 0x7f8004004810 2023-10-09T11:41:17.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.729+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80180ce8d0 con 0x7f8004004810 2023-10-09T11:41:17.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.730+0000 7f800effd700 1 -- 172.21.15.26:0/1263435621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f8010054c00 con 0x7f8004004810 2023-10-09T11:41:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:17.731 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:17.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 msgr2=0x7f7ff80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 0x7f7ff80696b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f80000091e0 tx=0x7f800001a000 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 msgr2=0x7f80180ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8010001120 tx=0x7f8010001e90 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 shutdown_connections 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8018152540 0x7f8018067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8004004810 0x7f80180ca260 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ff8067200 0x7f7ff80696b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 --2- 172.21.15.26:0/1263435621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80181520d0 0x7f8018156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 >> 172.21.15.26:0/1263435621 conn(0x7f801806ce80 msgr2=0x7f80180affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 shutdown_connections 2023-10-09T11:41:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.732+0000 7f801d4f8700 1 -- 172.21.15.26:0/1263435621 wait complete. 2023-10-09T11:41:17.735 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 59 2023-10-09T11:41:17.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.863+0000 7f4450b54700 1 Processor -- start 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.863+0000 7f4450b54700 1 -- start start 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f4450b54700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f444c15a5d0 0x7f444c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f4450b54700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c15ae40 con 0x7f444c0cb5a0 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f4450b54700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c15ab60 con 0x7f444c0cb970 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f4450b54700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0ce0f0 con 0x7f444c15a5d0 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f444c0cb5a0 0x7f444c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39734/0 (socket says 172.21.15.26:39734) 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444a59c700 1 -- 172.21.15.26:0/4185359008 learned_addr learned my addr 172.21.15.26:0/4185359008 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444ad9d700 1 --2- 172.21.15.26:0/4185359008 >> v2:172.21.15.67:3300/0 conn(0x7f444c15a5d0 0x7f444c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282452145 0 0) 0x7f444c15ae40 con 0x7f444c0cb5a0 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4438003570 con 0x7f444c0cb5a0 2023-10-09T11:41:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144843373 0 0) 0x7f4438003570 con 0x7f444c0cb5a0 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 >> v2:172.21.15.67:3300/0 conn(0x7f444c15a5d0 msgr2=0x7f444c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 --2- 172.21.15.26:0/4185359008 >> v2:172.21.15.67:3300/0 conn(0x7f444c15a5d0 0x7f444c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 >> v1:172.21.15.67:6789/0 conn(0x7f444c0cb970 legacy=0x7f444c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0ccf00 con 0x7f444c0cb5a0 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.864+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f443c001470 con 0x7f444c0cb5a0 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 >> v1:172.21.15.26:6789/0 conn(0x7f444c0cb5a0 legacy=0x7f444c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4438003a60 0x7f4438003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4438004810 0x7f4438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 0x7f443800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0ce0f0 con 0x7f44380051c0 2023-10-09T11:41:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443800c0d0 con 0x7f4438003a60 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443800c290 con 0x7f4438004810 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 0x7f443800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444a59c700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4438003a60 0x7f4438003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f4449d9b700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4438004810 0x7f4438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 -- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4438004810 msgr2=0x7f4438004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4438004810 0x7f4438004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 -- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4438003a60 msgr2=0x7f4438003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4438003a60 0x7f4438003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 -- 172.21.15.26:0/4185359008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438003570 con 0x7f44380051c0 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 -- 172.21.15.26:0/4185359008 reap_dead start 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444ad9d700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 0x7f443800ba60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f444400e210 tx=0x7f444400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46555ad58228d0f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444400eac0 con 0x7f44380051c0 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444400f040 con 0x7f44380051c0 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.865+0000 7f444959a700 1 -- 172.21.15.26:0/4185359008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444400ee70 con 0x7f44380051c0 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 -- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 msgr2=0x7f443800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 0x7f443800ba60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f444400e210 tx=0x7f444400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 -- 172.21.15.26:0/4185359008 shutdown_connections 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 --2- 172.21.15.26:0/4185359008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44380051c0 0x7f443800ba60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 -- 172.21.15.26:0/4185359008 >> 172.21.15.26:0/4185359008 conn(0x7f444c070e30 msgr2=0x7f444c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 -- 172.21.15.26:0/4185359008 shutdown_connections 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.866+0000 7f4450b54700 1 -- 172.21.15.26:0/4185359008 wait complete. 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.867+0000 7f4450b54700 1 Processor -- start 2023-10-09T11:41:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.867+0000 7f4450b54700 1 -- start start 2023-10-09T11:41:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 0x7f444c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 0x7f444c16cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c16d520 con 0x7f444c0af5b0 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c15bd20 con 0x7f444c16cb70 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4450b54700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0afa20 con 0x7f44380051c0 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40158/0 (socket says 172.21.15.26:40158) 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 -- 172.21.15.26:0/3547727811 learned_addr learned my addr 172.21.15.26:0/3547727811 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f444a59c700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 0x7f444c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f444ad9d700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 0x7f444c16cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 -- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 msgr2=0x7f444c0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 0x7f444c0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 -- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 msgr2=0x7f444c16cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 0x7f444c16cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 -- 172.21.15.26:0/3547727811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c15b110 con 0x7f444c0af5b0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f444a59c700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 0x7f444c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f444ad9d700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 0x7f444c16cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.868+0000 7f4449d9b700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4434002950 tx=0x7f4434007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434002e90 con 0x7f444c0af5b0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400f8d0 con 0x7f444c0af5b0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400fc70 con 0x7f444c0af5b0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c15b3f0 con 0x7f444c0af5b0 2023-10-09T11:41:17.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c15b9b0 con 0x7f444c0af5b0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.869+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c04c3c0 con 0x7f444c0af5b0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.870+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f443401c400 con 0x7f444c0af5b0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.870+0000 7f44427fc700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 0x7f442c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.870+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4434084f30 con 0x7f444c0af5b0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.871+0000 7f444a59c700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 0x7f442c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.871+0000 7f444a59c700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 0x7f442c0696b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f443c001ce0 tx=0x7f443c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:17.875+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4434051e20 con 0x7f444c0af5b0 2023-10-09T11:41:18.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.068+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f444c154f30 con 0x7f444c0af5b0 2023-10-09T11:41:18.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.069+0000 7f44427fc700 1 -- 172.21.15.26:0/3547727811 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f4434055440 con 0x7f444c0af5b0 2023-10-09T11:41:18.070 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:18.071 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":88,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:01.185353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 msgr2=0x7f442c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 0x7f442c0696b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f443c001ce0 tx=0x7f443c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 msgr2=0x7f444c1513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4434002950 tx=0x7f4434007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 shutdown_connections 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f444c16cb70 0x7f444c16cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f442c067200 0x7f442c0696b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44380051c0 0x7f444c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 --2- 172.21.15.26:0/3547727811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f444c0af5b0 0x7f444c1513e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 >> 172.21.15.26:0/3547727811 conn(0x7f444c070e30 msgr2=0x7f444c0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 shutdown_connections 2023-10-09T11:41:18.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.071+0000 7f4450b54700 1 -- 172.21.15.26:0/3547727811 wait complete. 2023-10-09T11:41:18.085 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:41:18.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:18.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.202+0000 7f16b4eb2700 1 Processor -- start 2023-10-09T11:41:18.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.202+0000 7f16b4eb2700 1 -- start start 2023-10-09T11:41:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16b4eb2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f16b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16b4eb2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16b00cde50 0x7f16b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16b4eb2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b015ae40 con 0x7f16b00cd9e0 2023-10-09T11:41:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16b4eb2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b00d13f0 con 0x7f16b00cde50 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16b4eb2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b015ab60 con 0x7f16b00cb5a0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16add9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f16b00cd9e0 0x7f16b0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39742/0 (socket says 172.21.15.26:39742) 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.203+0000 7f16add9b700 1 -- 172.21.15.26:0/3828530084 learned_addr learned my addr 172.21.15.26:0/3828530084 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ae59c700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f16b00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3828530084 >> v2:172.21.15.67:3300/0 conn(0x7f16b00cde50 0x7f16b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382017011 0 0) 0x7f16b015ae40 con 0x7f16b00cd9e0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c003570 con 0x7f16b00cd9e0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152409308 0 0) 0x7f169c003570 con 0x7f16b00cd9e0 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 msgr2=0x7f16b00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f16b00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 >> v2:172.21.15.67:3300/0 conn(0x7f16b00cde50 msgr2=0x7f16b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 --2- 172.21.15.26:0/3828530084 >> v2:172.21.15.67:3300/0 conn(0x7f16b00cde50 0x7f16b0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00ccf00 con 0x7f16b00cd9e0 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3828530084 >> v2:172.21.15.67:3300/0 conn(0x7f16b00cde50 0x7f16b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f1698001470 con 0x7f16b00cd9e0 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 >> v1:172.21.15.26:6789/0 conn(0x7f16b00cd9e0 legacy=0x7f16b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f169c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c003fe0 0x7f169c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c004d50 0x7f169c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b015ab60 con 0x7f169c003fe0 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c00ba60 con 0x7f169c004d50 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c00bbd0 con 0x7f16b00cb5a0 2023-10-09T11:41:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16add9b700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c003fe0 0x7f169c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16ae59c700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f169c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.204+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c004d50 0x7f169c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 -- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 msgr2=0x7f169c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16b00cb5a0 0x7f169c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 -- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c004d50 msgr2=0x7f169c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c004d50 0x7f169c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 -- 172.21.15.26:0/3828530084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c003570 con 0x7f169c003fe0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16add9b700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c003fe0 0x7f169c004810 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f169800c3c0 tx=0x7f1698001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8380405ea4305e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800cc30 con 0x7f169c003fe0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800cdb0 con 0x7f169c003fe0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16ad59a700 1 -- 172.21.15.26:0/3828530084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698005b70 con 0x7f169c003fe0 2023-10-09T11:41:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3828530084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c003fe0 msgr2=0x7f169c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3828530084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c003fe0 0x7f169c004810 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f169800c3c0 tx=0x7f1698001e90 comp rx=0 tx=0).stop 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16aed9d700 1 -- 172.21.15.26:0/3828530084 reap_dead start 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3828530084 shutdown_connections 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3828530084 >> 172.21.15.26:0/3828530084 conn(0x7f16b0070e30 msgr2=0x7f16b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3828530084 shutdown_connections 2023-10-09T11:41:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.205+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3828530084 wait complete. 2023-10-09T11:41:18.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 Processor -- start 2023-10-09T11:41:18.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 -- start start 2023-10-09T11:41:18.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c003fe0 0x7f16b015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b015b2a0 0x7f16b0169530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b016a510 con 0x7f16b0169a70 2023-10-09T11:41:18.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b0154d90 con 0x7f16b015b2a0 2023-10-09T11:41:18.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16b4eb2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b00b4510 con 0x7f169c003fe0 2023-10-09T11:41:18.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.207+0000 7f16aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40166/0 (socket says 172.21.15.26:40166) 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 -- 172.21.15.26:0/3407914300 learned_addr learned my addr 172.21.15.26:0/3407914300 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16ae59c700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c003fe0 0x7f16b015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16add9b700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b015b2a0 0x7f16b0169530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 -- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c003fe0 msgr2=0x7f16b015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c003fe0 0x7f16b015bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 -- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b015b2a0 msgr2=0x7f16b0169530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b015b2a0 0x7f16b0169530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 -- 172.21.15.26:0/3407914300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0169f50 con 0x7f16b0169a70 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16aed9d700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16b00d02a0 tx=0x7f16a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a800e040 con 0x7f16b0169a70 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a800f040 con 0x7f16b0169a70 2023-10-09T11:41:18.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b016a230 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a800fdb0 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.208+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b015c210 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.209+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b0154f00 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.210+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f16a8015640 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.210+0000 7f16a67fc700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 0x7f16900696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.210+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16a80854d0 con 0x7f16b0169a70 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.210+0000 7f16ae59c700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 0x7f16900696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.211+0000 7f16ae59c700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 0x7f16900696b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f16b015e4d0 tx=0x7f16a00091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.214+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16a80522e0 con 0x7f16b0169a70 2023-10-09T11:41:18.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.223+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f16a80526b0 con 0x7f16b0169a70 2023-10-09T11:41:18.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.454+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16b004c3c0 con 0x7f16b0169a70 2023-10-09T11:41:18.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.454+0000 7f16a67fc700 1 -- 172.21.15.26:0/3407914300 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f16a8055d70 con 0x7f16b0169a70 2023-10-09T11:41:18.456 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:18.456 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 msgr2=0x7f16900696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 0x7f16900696b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f16b015e4d0 tx=0x7f16a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 msgr2=0x7f16b0159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16b00d02a0 tx=0x7f16a800b040 comp rx=0 tx=0).stop 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 shutdown_connections 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16b0169a70 0x7f16b0159fe0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1690067200 0x7f16900696b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c003fe0 0x7f16b015bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 --2- 172.21.15.26:0/3407914300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b015b2a0 0x7f16b0169530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 >> 172.21.15.26:0/3407914300 conn(0x7f16b0070e30 msgr2=0x7f16b006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 shutdown_connections 2023-10-09T11:41:18.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.456+0000 7f16b4eb2700 1 -- 172.21.15.26:0/3407914300 wait complete. 2023-10-09T11:41:18.459 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 59 2023-10-09T11:41:18.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.587+0000 7ff38b59e700 1 Processor -- start 2023-10-09T11:41:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.587+0000 7ff38b59e700 1 -- start start 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 0x7ff38c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c0c8410 con 0x7ff38c06aaa0 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c15ae70 con 0x7ff38c13fb20 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c06af60 con 0x7ff38c13fef0 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40176/0 (socket says 172.21.15.26:40176) 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 -- 172.21.15.26:0/2336384303 learned_addr learned my addr 172.21.15.26:0/2336384303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38a59c700 1 --2- 172.21.15.26:0/2336384303 >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 0x7ff38c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff389d9b700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 -- 172.21.15.26:0/2336384303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 msgr2=0x7ff38c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 -- 172.21.15.26:0/2336384303 >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 msgr2=0x7ff38c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 --2- 172.21.15.26:0/2336384303 >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 0x7ff38c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38ad9d700 1 -- 172.21.15.26:0/2336384303 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c06b240 con 0x7ff38c06aaa0 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff38a59c700 1 --2- 172.21.15.26:0/2336384303 >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 0x7ff38c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.588+0000 7ff389d9b700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38ad9d700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0695b0 tx=0x7ff38400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9abc0dfef8423c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38959a700 1 -- 172.21.15.26:0/2336384303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400dc50 con 0x7ff38c06aaa0 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38959a700 1 -- 172.21.15.26:0/2336384303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400ddb0 con 0x7ff38c06aaa0 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38959a700 1 -- 172.21.15.26:0/2336384303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840196d0 con 0x7ff38c06aaa0 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 -- 172.21.15.26:0/2336384303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c06aaa0 msgr2=0x7ff38c0c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0695b0 tx=0x7ff38400b4f0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 -- 172.21.15.26:0/2336384303 shutdown_connections 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 --2- 172.21.15.26:0/2336384303 >> v2:172.21.15.67:3300/0 conn(0x7ff38c13fb20 0x7ff38c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c06aaa0 0x7ff38c0c7ed0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 --2- 172.21.15.26:0/2336384303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 -- 172.21.15.26:0/2336384303 >> 172.21.15.26:0/2336384303 conn(0x7ff38c06d170 msgr2=0x7ff38c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 -- 172.21.15.26:0/2336384303 shutdown_connections 2023-10-09T11:41:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.589+0000 7ff38b59e700 1 -- 172.21.15.26:0/2336384303 wait complete. 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.590+0000 7ff38b59e700 1 Processor -- start 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.590+0000 7ff38b59e700 1 -- start start 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff38c06aaa0 0x7ff38c1692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c169830 con 0x7ff38c13fb20 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0afb80 con 0x7ff38c06aaa0 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c156100 con 0x7ff38c13fef0 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff389d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff389d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40192/0 (socket says 172.21.15.26:40192) 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff389d9b700 1 -- 172.21.15.26:0/3282477067 learned_addr learned my addr 172.21.15.26:0/3282477067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38a59c700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff38c06aaa0 0x7ff38c1692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.591+0000 7ff38ad9d700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 -- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 msgr2=0x7ff38c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 -- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff38c06aaa0 msgr2=0x7ff38c1692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff38c06aaa0 0x7ff38c1692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 -- 172.21.15.26:0/3282477067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38400b790 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff38ad9d700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff389d9b700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c850 tx=0x7ff374008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374005a60 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374005bc0 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c0aef70 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011600 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.592+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c0af530 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.593+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c0afcf0 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.593+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff3740119f0 con 0x7ff38c13fb20 2023-10-09T11:41:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.594+0000 7ff3827fc700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 0x7ff36c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.594+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff374084d20 con 0x7ff38c13fb20 2023-10-09T11:41:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.594+0000 7ff38a59c700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 0x7ff36c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.595+0000 7ff38a59c700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 0x7ff36c069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff37c007fd0 tx=0x7ff37c0077c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.598+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff374055500 con 0x7ff38c13fb20 2023-10-09T11:41:18.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.835+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff38c04c3c0 con 0x7ff38c13fb20 2023-10-09T11:41:18.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.836+0000 7ff3827fc700 1 -- 172.21.15.26:0/3282477067 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7ff374055090 con 0x7ff38c13fb20 2023-10-09T11:41:18.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:18.838 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:59.697658+0000","modified":"2023-10-09T11:41:03.302769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6483},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6483":{"gid":6483,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/3862079110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3862079110},{"type":"v1","addr":"172.21.15.26:6835","nonce":3862079110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 msgr2=0x7ff36c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 0x7ff36c069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff37c007fd0 tx=0x7ff37c0077c0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 msgr2=0x7ff38c155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c850 tx=0x7ff374008040 comp rx=0 tx=0).stop 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 shutdown_connections 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff36c067290 0x7ff36c069740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff38c13fef0 0x7ff38c0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff38c06aaa0 0x7ff38c1692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 --2- 172.21.15.26:0/3282477067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c13fb20 0x7ff38c155bc0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 >> 172.21.15.26:0/3282477067 conn(0x7ff38c06d170 msgr2=0x7ff38c0cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 shutdown_connections 2023-10-09T11:41:18.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.838+0000 7ff38b59e700 1 -- 172.21.15.26:0/3282477067 wait complete. 2023-10-09T11:41:18.841 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 59 2023-10-09T11:41:18.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:18.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.969+0000 7fce7b148700 1 Processor -- start 2023-10-09T11:41:18.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.969+0000 7fce7b148700 1 -- start start 2023-10-09T11:41:18.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7b148700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 0x7fce740cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7b148700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7415afd0 con 0x7fce740cef40 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7b148700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7415b2b0 con 0x7fce74153c30 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7b148700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7415b590 con 0x7fce7415de50 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7a947700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fce740cef40 0x7fce7415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39754/0 (socket says 172.21.15.26:39754) 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce7a947700 1 -- 172.21.15.26:0/976703355 learned_addr learned my addr 172.21.15.26:0/976703355 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce79945700 1 --2- 172.21.15.26:0/976703355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 0x7fce740cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216336879 0 0) 0x7fce7415afd0 con 0x7fce740cef40 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.970+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce60003570 con 0x7fce740cef40 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457144483 0 0) 0x7fce7415b2b0 con 0x7fce74153c30 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7415afd0 con 0x7fce74153c30 2023-10-09T11:41:18.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597796292 0 0) 0x7fce60003570 con 0x7fce740cef40 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79945700 1 -- 172.21.15.26:0/976703355 >> v1:172.21.15.67:6789/0 conn(0x7fce74153c30 legacy=0x7fce7415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79945700 1 -- 172.21.15.26:0/976703355 >> v1:172.21.15.26:6789/0 conn(0x7fce740cef40 legacy=0x7fce7415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79945700 1 -- 172.21.15.26:0/976703355 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7415b870 con 0x7fce7415de50 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79945700 1 --2- 172.21.15.26:0/976703355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 0x7fce740cea00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce64009910 tx=0x7fce640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e69a5fe3aa1fed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0017f0 con 0x7fce7415de50 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64011420 con 0x7fce7415de50 2023-10-09T11:41:18.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.971+0000 7fce79144700 1 -- 172.21.15.26:0/976703355 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640117a0 con 0x7fce7415de50 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 -- 172.21.15.26:0/976703355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 msgr2=0x7fce740cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 --2- 172.21.15.26:0/976703355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 0x7fce740cea00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce64009910 tx=0x7fce640091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 -- 172.21.15.26:0/976703355 shutdown_connections 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 --2- 172.21.15.26:0/976703355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce7415de50 0x7fce740cea00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 -- 172.21.15.26:0/976703355 >> 172.21.15.26:0/976703355 conn(0x7fce740703a0 msgr2=0x7fce740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 -- 172.21.15.26:0/976703355 shutdown_connections 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.972+0000 7fce7b148700 1 -- 172.21.15.26:0/976703355 wait complete. 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.973+0000 7fce7b148700 1 Processor -- start 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.973+0000 7fce7b148700 1 -- start start 2023-10-09T11:41:18.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 0x7fce7416ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce74153c30 0x7fce7416c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740b3c90 con 0x7fce7415de50 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740b5620 con 0x7fce74153c30 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740b5900 con 0x7fce740cef40 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40204/0 (socket says 172.21.15.26:40204) 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 -- 172.21.15.26:0/3195755452 learned_addr learned my addr 172.21.15.26:0/3195755452 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce79945700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce74153c30 0x7fce7416c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a146700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 0x7fce7416ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 -- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 msgr2=0x7fce7416ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 0x7fce7416ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 -- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce74153c30 msgr2=0x7fce7416c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce74153c30 0x7fce7416c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 -- 172.21.15.26:0/3195755452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009420 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a146700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 0x7fce7416ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7a947700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00cb70 tx=0x7fce6c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c004dc0 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00a5d0 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00a990 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce740b5be0 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.974+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7416ccd0 con 0x7fce7415de50 2023-10-09T11:41:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.975+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7404c3c0 con 0x7fce7415de50 2023-10-09T11:41:18.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.976+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fce6c00ad00 con 0x7fce7415de50 2023-10-09T11:41:18.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.976+0000 7fce6a7fc700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 0x7fce58069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:18.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.976+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce6c084120 con 0x7fce7415de50 2023-10-09T11:41:18.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.976+0000 7fce7a146700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 0x7fce58069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:18.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.977+0000 7fce7a146700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 0x7fce58069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fce70003990 tx=0x7fce70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:18.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:18.980+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce6c054a90 con 0x7fce7415de50 2023-10-09T11:41:19.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.174+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce74063c30 con 0x7fce7415de50 2023-10-09T11:41:19.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.175+0000 7fce6a7fc700 1 -- 172.21.15.26:0/3195755452 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fce6c054620 con 0x7fce7415de50 2023-10-09T11:41:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:19.177 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":88,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:01.185353+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:57.451694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:58.671124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.177+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 msgr2=0x7fce58069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.177+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 0x7fce58069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fce70003990 tx=0x7fce70009040 comp rx=0 tx=0).stop 2023-10-09T11:41:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.177+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 msgr2=0x7fce740cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.177+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00cb70 tx=0x7fce6c007c70 comp rx=0 tx=0).stop 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 shutdown_connections 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7415de50 0x7fce740cc650 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fce58067290 0x7fce58069740 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce740cef40 0x7fce7416ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 --2- 172.21.15.26:0/3195755452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce74153c30 0x7fce7416c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 >> 172.21.15.26:0/3195755452 conn(0x7fce740703a0 msgr2=0x7fce740c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 shutdown_connections 2023-10-09T11:41:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.178+0000 7fce7b148700 1 -- 172.21.15.26:0/3195755452 wait complete. 2023-10-09T11:41:19.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:41:19.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.310+0000 7f4b917de700 1 Processor -- start 2023-10-09T11:41:19.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.310+0000 7f4b917de700 1 -- start start 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b917de700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b8c0c9d30 0x7f4b8c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b917de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c06c6a0 con 0x7f4b8c15d830 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b917de700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c06cc60 con 0x7f4b8c15d390 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b917de700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8c15dde0 con 0x7f4b8c0c9d30 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b8b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b8c15d830 0x7f4b8c06d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39756/0 (socket says 172.21.15.26:39756) 2023-10-09T11:41:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.311+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/917996198 learned_addr learned my addr 172.21.15.26:0/917996198 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> v2:172.21.15.67:3300/0 conn(0x7f4b8c0c9d30 0x7f4b8c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369269999 0 0) 0x7f4b8c06c6a0 con 0x7f4b8c15d830 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003570 con 0x7f4b8c15d830 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803654226 0 0) 0x7f4b8c06cc60 con 0x7f4b8c15d390 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c06c6a0 con 0x7f4b8c15d390 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788861927 0 0) 0x7f4b78003570 con 0x7f4b8c15d830 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 >> v2:172.21.15.67:3300/0 conn(0x7f4b8c0c9d30 msgr2=0x7f4b8c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 --2- 172.21.15.26:0/917996198 >> v2:172.21.15.67:3300/0 conn(0x7f4b8c0c9d30 0x7f4b8c0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 >> v1:172.21.15.67:6789/0 conn(0x7f4b8c15d390 legacy=0x7f4b8c0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c15e0c0 con 0x7f4b8c15d830 2023-10-09T11:41:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4b7c001470 con 0x7f4b8c15d830 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 >> v1:172.21.15.26:6789/0 conn(0x7f4b8c15d830 legacy=0x7f4b8c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 0x7f4b78003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b780051c0 0x7f4b7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c15dde0 con 0x7f4b78003bf0 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800c160 con 0x7f4b78004810 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800c320 con 0x7f4b780051c0 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> v2:172.21.15.67:3300/0 conn(0x7f4b8c0c9d30 0x7f4b8c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 0x7f4b78003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b8a7fc700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.312+0000 7f4b8b7fe700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b780051c0 0x7f4b7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 -- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b780051c0 msgr2=0x7f4b7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b780051c0 0x7f4b7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 -- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78004810 msgr2=0x7f4b78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78004810 0x7f4b78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 -- 172.21.15.26:0/917996198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78003570 con 0x7f4b78003bf0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/917996198 reap_dead start 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b8affd700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 0x7f4b78003fe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4b840094d0 tx=0x7f4b8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bdb621530d975d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400ebe0 con 0x7f4b78003bf0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8400f040 con 0x7f4b78003bf0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b89ffb700 1 -- 172.21.15.26:0/917996198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84014480 con 0x7f4b78003bf0 2023-10-09T11:41:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 -- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 msgr2=0x7f4b78003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 0x7f4b78003fe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4b840094d0 tx=0x7f4b8400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 -- 172.21.15.26:0/917996198 shutdown_connections 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 --2- 172.21.15.26:0/917996198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b78003bf0 0x7f4b78003fe0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 -- 172.21.15.26:0/917996198 >> 172.21.15.26:0/917996198 conn(0x7f4b8c0675a0 msgr2=0x7f4b8c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 -- 172.21.15.26:0/917996198 shutdown_connections 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.313+0000 7f4b917de700 1 -- 172.21.15.26:0/917996198 wait complete. 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 Processor -- start 2023-10-09T11:41:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 -- start start 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 0x7f4b8c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 0x7f4b8c16a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0af2e0 con 0x7f4b8c16a560 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c16af20 con 0x7f4b78003bf0 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.315+0000 7f4b917de700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0c6b90 con 0x7f4b8c0c5840 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40228/0 (socket says 172.21.15.26:40228) 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/3070844898 learned_addr learned my addr 172.21.15.26:0/3070844898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8a7fc700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 0x7f4b8c16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8affd700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 0x7f4b8c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 msgr2=0x7f4b8c16a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 0x7f4b8c16a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 msgr2=0x7f4b8c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 0x7f4b8c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 -- 172.21.15.26:0/3070844898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0c3e40 con 0x7f4b8c16a560 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8a7fc700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 0x7f4b8c16a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8affd700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 0x7f4b8c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b8b7fe700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c000fd0 tx=0x7f4b7c001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00f8a0 con 0x7f4b8c16a560 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c00fa20 con 0x7f4b8c16a560 2023-10-09T11:41:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c0c5f80 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00fde0 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.316+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c0c6540 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.317+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c04c3c0 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.318+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4b7c0135c0 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.318+0000 7f4b82ffd700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 0x7f4b6c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.318+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b7c084470 con 0x7f4b8c16a560 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.318+0000 7f4b8affd700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 0x7f4b6c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.319+0000 7f4b8affd700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 0x7f4b6c069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0aec00 tx=0x7f4b84019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.322+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b7c0512d0 con 0x7f4b8c16a560 2023-10-09T11:41:19.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.560+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b8c0b2c10 con 0x7f4b8c16a560 2023-10-09T11:41:19.561 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:41:19.560+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:41:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.564+0000 7f4b82ffd700 1 -- 172.21.15.26:0/3070844898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b7c01a020 con 0x7f4b8c16a560 2023-10-09T11:41:19.566 INFO:tasks.ceph.mds.a.smithi026.stderr: -922> 2023-10-09T11:41:05.636+0000 7f8443240700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:19.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 msgr2=0x7f4b6c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 0x7f4b6c069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0aec00 tx=0x7f4b84019000 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 msgr2=0x7f4b8c16a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c000fd0 tx=0x7f4b7c001df0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 shutdown_connections 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b8c16a560 0x7f4b8c16a9e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b78003bf0 0x7f4b8c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4b6c067290 0x7f4b6c069740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 --2- 172.21.15.26:0/3070844898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b8c0c5840 0x7f4b8c16a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 >> 172.21.15.26:0/3070844898 conn(0x7f4b8c0675a0 msgr2=0x7f4b8c1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 shutdown_connections 2023-10-09T11:41:19.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.566+0000 7f4b917de700 1 -- 172.21.15.26:0/3070844898 wait complete. 2023-10-09T11:41:19.569 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:41:19.580 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:41:19.587 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:41:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.700+0000 7fc18b59e700 1 Processor -- start 2023-10-09T11:41:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.700+0000 7fc18b59e700 1 -- start start 2023-10-09T11:41:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18b59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 0x7fc18c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 0x7fc18c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18b59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0acc00 con 0x7fc18c159550 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18b59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0abff0 con 0x7fc18c15dfd0 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0ac2d0 con 0x7fc18c159920 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc18c159550 0x7fc18c0ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35356/0 (socket says 172.21.15.26:35356) 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18a59c700 1 -- 172.21.15.26:0/1850484192 learned_addr learned my addr 172.21.15.26:0/1850484192 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/1850484192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 0x7fc18c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc189d9b700 1 --2- 172.21.15.26:0/1850484192 >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 0x7fc18c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793449072 0 0) 0x7fc18c0acc00 con 0x7fc18c159550 2023-10-09T11:41:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.701+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc178003570 con 0x7fc18c159550 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18ad9d700 1 -- 172.21.15.26:0/1850484192 >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 msgr2=0x7fc18c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3788541890 0 0) 0x7fc178003570 con 0x7fc18c159550 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/1850484192 >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 0x7fc18c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18ad9d700 1 -- 172.21.15.26:0/1850484192 >> v1:172.21.15.26:6789/0 conn(0x7fc18c159550 legacy=0x7fc18c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18ad9d700 1 -- 172.21.15.26:0/1850484192 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0ac5b0 con 0x7fc18c159920 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc189d9b700 1 --2- 172.21.15.26:0/1850484192 >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 0x7fc18c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/1850484192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 0x7fc18c0ad090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc184009e60 tx=0x7fc184009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b3ab34848d1686 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18400e070 con 0x7fc18c159920 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18400b7a0 con 0x7fc18c159920 2023-10-09T11:41:19.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.702+0000 7fc18959a700 1 -- 172.21.15.26:0/1850484192 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c001470 con 0x7fc18c159920 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 -- 172.21.15.26:0/1850484192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 msgr2=0x7fc18c0ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 --2- 172.21.15.26:0/1850484192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 0x7fc18c0ad090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc184009e60 tx=0x7fc184009780 comp rx=0 tx=0).stop 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 -- 172.21.15.26:0/1850484192 shutdown_connections 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 --2- 172.21.15.26:0/1850484192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c159920 0x7fc18c0ad090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 --2- 172.21.15.26:0/1850484192 >> v2:172.21.15.67:3300/0 conn(0x7fc18c15dfd0 0x7fc18c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 -- 172.21.15.26:0/1850484192 >> 172.21.15.26:0/1850484192 conn(0x7fc18c06ce80 msgr2=0x7fc18c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:19.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 -- 172.21.15.26:0/1850484192 shutdown_connections 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.703+0000 7fc18b59e700 1 -- 172.21.15.26:0/1850484192 wait complete. 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.704+0000 7fc18b59e700 1 Processor -- start 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.704+0000 7fc18b59e700 1 -- start start 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 0x7fc18c16d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 0x7fc18c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cec50 con 0x7fc18c159920 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0c9410 con 0x7fc18c159550 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0c7560 con 0x7fc18c15dfd0 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52890/0 (socket says 172.21.15.26:52890) 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 -- 172.21.15.26:0/452704382 learned_addr learned my addr 172.21.15.26:0/452704382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18a59c700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 0x7fc18c16d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 0x7fc18c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 -- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 msgr2=0x7fc18c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 0x7fc18c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 -- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 msgr2=0x7fc18c16d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 0x7fc18c16d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 -- 172.21.15.26:0/452704382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc174009420 con 0x7fc18c159920 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18a59c700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 0x7fc18c16d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 0x7fc18c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc189d9b700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc17400ec80 tx=0x7fc1740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400c9d0 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400cb30 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184009a20 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400ceb0 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.705+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c0c9940 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.706+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c04c3c0 con 0x7fc18c159920 2023-10-09T11:41:19.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.707+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc174013680 con 0x7fc18c159920 2023-10-09T11:41:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.707+0000 7fc1827fc700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 0x7fc16c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.707+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc174084e60 con 0x7fc18c159920 2023-10-09T11:41:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.707+0000 7fc18a59c700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 0x7fc16c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:19.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.708+0000 7fc18a59c700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 0x7fc16c069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc17c005d40 tx=0x7fc17c001580 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:19.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.712+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc174051c70 con 0x7fc18c159920 2023-10-09T11:41:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:19.949+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc18c06e7c0 con 0x7fc18c159920 2023-10-09T11:41:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.564+0000 7fc1827fc700 1 -- 172.21.15.26:0/452704382 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc174055290 con 0x7fc18c159920 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 msgr2=0x7fc16c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 0x7fc16c069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc17c005d40 tx=0x7fc17c001580 comp rx=0 tx=0).stop 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 msgr2=0x7fc18c151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc17400ec80 tx=0x7fc1740091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 shutdown_connections 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc16c067290 0x7fc16c069740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc18c15dfd0 0x7fc18c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc18c159550 0x7fc18c16d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 --2- 172.21.15.26:0/452704382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c159920 0x7fc18c151f00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 >> 172.21.15.26:0/452704382 conn(0x7fc18c06ce80 msgr2=0x7fc18c152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 shutdown_connections 2023-10-09T11:41:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.567+0000 7fc18b59e700 1 -- 172.21.15.26:0/452704382 wait complete. 2023-10-09T11:41:20.582 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:41:20.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.747+0000 7f6088bef700 1 Processor -- start 2023-10-09T11:41:20.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.747+0000 7f6088bef700 1 -- start start 2023-10-09T11:41:20.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6088bef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f608415aa00 0x7f60840cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6088bef700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60840cba10 0x7f60840ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6088bef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60840cf510 con 0x7f60840ced00 2023-10-09T11:41:20.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6088bef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840cbeb0 con 0x7f608415aa00 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6088bef700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840cf7f0 con 0x7f60840cba10 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f60837fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f608415aa00 0x7f60840cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f60837fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f608415aa00 0x7f60840cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52892/0 (socket says 172.21.15.26:52892) 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f60837fe700 1 -- 172.21.15.26:0/921134260 learned_addr learned my addr 172.21.15.26:0/921134260 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.748+0000 7f6082ffd700 1 --2- 172.21.15.26:0/921134260 >> v2:172.21.15.67:3300/0 conn(0x7f60840cba10 0x7f60840ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60837fe700 1 -- 172.21.15.26:0/921134260 >> v2:172.21.15.67:3300/0 conn(0x7f60840cba10 msgr2=0x7f60840ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60837fe700 1 --2- 172.21.15.26:0/921134260 >> v2:172.21.15.67:3300/0 conn(0x7f60840cba10 0x7f60840ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60837fe700 1 -- 172.21.15.26:0/921134260 >> v1:172.21.15.67:6789/0 conn(0x7f60840ced00 legacy=0x7f60840ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60837fe700 1 -- 172.21.15.26:0/921134260 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840cfad0 con 0x7f608415aa00 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60837fe700 1 --2- 172.21.15.26:0/921134260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f608415aa00 0x7f60840cb4d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f60840895d0 tx=0x7f6074009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62180a29282797b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:20.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60827fc700 1 -- 172.21.15.26:0/921134260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074005c10 con 0x7f608415aa00 2023-10-09T11:41:20.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60827fc700 1 -- 172.21.15.26:0/921134260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074005d70 con 0x7f608415aa00 2023-10-09T11:41:20.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f60827fc700 1 -- 172.21.15.26:0/921134260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074006260 con 0x7f608415aa00 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 -- 172.21.15.26:0/921134260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f608415aa00 msgr2=0x7f60840cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 --2- 172.21.15.26:0/921134260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f608415aa00 0x7f60840cb4d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f60840895d0 tx=0x7f6074009220 comp rx=0 tx=0).stop 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 -- 172.21.15.26:0/921134260 shutdown_connections 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 --2- 172.21.15.26:0/921134260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f608415aa00 0x7f60840cb4d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 --2- 172.21.15.26:0/921134260 >> v2:172.21.15.67:3300/0 conn(0x7f60840cba10 0x7f60840ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.749+0000 7f6088bef700 1 -- 172.21.15.26:0/921134260 >> 172.21.15.26:0/921134260 conn(0x7f6084099740 msgr2=0x7f6084070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.750+0000 7f6088bef700 1 -- 172.21.15.26:0/921134260 shutdown_connections 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.750+0000 7f6088bef700 1 -- 172.21.15.26:0/921134260 wait complete. 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 Processor -- start 2023-10-09T11:41:20.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 -- start start 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60840ced00 0x7f60840c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608415aa00 0x7f60841578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608416d830 con 0x7f60840cba10 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608416cc20 con 0x7f608415aa00 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.751+0000 7f6088bef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608416cf00 con 0x7f60840ced00 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52904/0 (socket says 172.21.15.26:52904) 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 -- 172.21.15.26:0/1623777429 learned_addr learned my addr 172.21.15.26:0/1623777429 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 -- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60840ced00 msgr2=0x7f60840c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60840ced00 0x7f60840c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 -- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608415aa00 msgr2=0x7f60841578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608415aa00 0x7f60841578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 -- 172.21.15.26:0/1623777429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074009480 con 0x7f60840cba10 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f60837fe700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f607400b0e0 tx=0x7f6074016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400b900 con 0x7f60840cba10 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074020070 con 0x7f60840cba10 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608416d1e0 con 0x7f60840cba10 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400bc90 con 0x7f60840cba10 2023-10-09T11:41:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.752+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60840b28b0 con 0x7f60840cba10 2023-10-09T11:41:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.753+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60840b2aa0 con 0x7f60840cba10 2023-10-09T11:41:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.754+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6074022030 con 0x7f60840cba10 2023-10-09T11:41:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.754+0000 7f606b7fe700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 0x7f6070069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.754+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6074086690 con 0x7f60840cba10 2023-10-09T11:41:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.754+0000 7f6082ffd700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 0x7f6070069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.755+0000 7f6082ffd700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 0x7f6070069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f60840b2e10 tx=0x7f60780091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:20.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.758+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60740534a0 con 0x7f60840cba10 2023-10-09T11:41:20.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:20.951+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f608404c3c0 con 0x7f60840cba10 2023-10-09T11:41:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.574+0000 7f606b7fe700 1 -- 172.21.15.26:0/1623777429 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6074056ac0 con 0x7f60840cba10 2023-10-09T11:41:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 msgr2=0x7f6070069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 0x7f6070069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f60840b2e10 tx=0x7f60780091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 msgr2=0x7f60840b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f607400b0e0 tx=0x7f6074016000 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 shutdown_connections 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608415aa00 0x7f60841578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60840cba10 0x7f60840b2370 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6070067290 0x7f6070069740 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 --2- 172.21.15.26:0/1623777429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60840ced00 0x7f60840c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 >> 172.21.15.26:0/1623777429 conn(0x7f6084099740 msgr2=0x7f608406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 shutdown_connections 2023-10-09T11:41:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.578+0000 7f6088bef700 1 -- 172.21.15.26:0/1623777429 wait complete. 2023-10-09T11:41:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:41:21.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:41:21.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.722+0000 7fc5008ce700 1 Processor -- start 2023-10-09T11:41:21.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.722+0000 7fc5008ce700 1 -- start start 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc5008ce700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc4fc069420 0x7fc4fc0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc5008ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0cb4d0 con 0x7fc4fc159740 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc5008ce700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0c8340 con 0x7fc4fc159b10 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc5008ce700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c8620 con 0x7fc4fc069420 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc4fa59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4fc159740 0x7fc4fc068d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35362/0 (socket says 172.21.15.26:35362) 2023-10-09T11:41:21.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2842146845 learned_addr learned my addr 172.21.15.26:0/2842146845 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc4fad9d700 1 --2- 172.21.15.26:0/2842146845 >> v2:172.21.15.67:3300/0 conn(0x7fc4fc069420 0x7fc4fc0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645209244 0 0) 0x7fc4fc0cb4d0 con 0x7fc4fc159740 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.723+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e8003570 con 0x7fc4fc159740 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159875681 0 0) 0x7fc4e8003570 con 0x7fc4fc159740 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 >> v2:172.21.15.67:3300/0 conn(0x7fc4fc069420 msgr2=0x7fc4fc0c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 --2- 172.21.15.26:0/2842146845 >> v2:172.21.15.67:3300/0 conn(0x7fc4fc069420 0x7fc4fc0c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 >> v1:172.21.15.67:6789/0 conn(0x7fc4fc159b10 legacy=0x7fc4fc0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0cb160 con 0x7fc4fc159740 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fc4ec0017f0 con 0x7fc4fc159740 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 >> v1:172.21.15.26:6789/0 conn(0x7fc4fc159740 legacy=0x7fc4fc068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4e8004810 0x7fc4e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4e80051c0 0x7fc4e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c8620 con 0x7fc4e8003a60 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e800c0d0 con 0x7fc4e80051c0 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e800c290 con 0x7fc4e8004810 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fad9d700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4e80051c0 0x7fc4e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f9d9b700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4e8004810 0x7fc4e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4e8004810 msgr2=0x7fc4e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4e8004810 0x7fc4e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4e80051c0 msgr2=0x7fc4e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4e80051c0 0x7fc4e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2842146845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8003570 con 0x7fc4e8003a60 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fad9d700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4e80051c0 0x7fc4e800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fad9d700 1 -- 172.21.15.26:0/2842146845 reap_dead start 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4e8003e70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00a930 tx=0x7fc4ec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47e44e189c2b823 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0070d0 con 0x7fc4e8003a60 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec007230 con 0x7fc4e8003a60 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.724+0000 7fc4f959a700 1 -- 172.21.15.26:0/2842146845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0075d0 con 0x7fc4e8003a60 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 -- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 msgr2=0x7fc4e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4e8003e70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00a930 tx=0x7fc4ec0021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 -- 172.21.15.26:0/2842146845 shutdown_connections 2023-10-09T11:41:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2842146845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4e8003e70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 -- 172.21.15.26:0/2842146845 >> 172.21.15.26:0/2842146845 conn(0x7fc4fc0cde40 msgr2=0x7fc4fc0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 -- 172.21.15.26:0/2842146845 shutdown_connections 2023-10-09T11:41:21.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.725+0000 7fc5008ce700 1 -- 172.21.15.26:0/2842146845 wait complete. 2023-10-09T11:41:21.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.726+0000 7fc5008ce700 1 Processor -- start 2023-10-09T11:41:21.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.726+0000 7fc5008ce700 1 -- start start 2023-10-09T11:41:21.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4fc0b0190 0x7fc4fc15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 0x7fc4fc15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc15ca40 con 0x7fc4e8003a60 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c44a0 con 0x7fc4fc15c5c0 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc5008ce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b2a70 con 0x7fc4fc0b0190 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52926/0 (socket says 172.21.15.26:52926) 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2738054956 learned_addr learned my addr 172.21.15.26:0/2738054956 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4f9d9b700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4fc0b0190 0x7fc4fc15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fad9d700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 0x7fc4fc15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4fc0b0190 msgr2=0x7fc4fc15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4fc0b0190 0x7fc4fc15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 msgr2=0x7fc4fc15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 0x7fc4fc15a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 -- 172.21.15.26:0/2738054956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0b2d50 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fad9d700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 0x7fc4fc15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.727+0000 7fc4fa59c700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00a3f0 tx=0x7fc4ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.728+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec001250 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.728+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0017b0 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.728+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0b3030 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.728+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007940 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.728+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc153700 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.729+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc153a70 con 0x7fc4e8003a60 2023-10-09T11:41:21.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.729+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc4ec024070 con 0x7fc4e8003a60 2023-10-09T11:41:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.729+0000 7fc4f27fc700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.730+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fc4ec0871a0 con 0x7fc4e8003a60 2023-10-09T11:41:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.730+0000 7fc4f9d9b700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.730+0000 7fc4f9d9b700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 0x7fc4dc069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4000c00 tx=0x7fc4e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.734+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4ec054160 con 0x7fc4e8003a60 2023-10-09T11:41:21.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:21.927+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4fc04c3c0 con 0x7fc4e8003a60 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.575+0000 7fc4f27fc700 1 -- 172.21.15.26:0/2738054956 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc4ec057780 con 0x7fc4e8003a60 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 msgr2=0x7fc4dc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 0x7fc4dc069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4000c00 tx=0x7fc4e4009040 comp rx=0 tx=0).stop 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 msgr2=0x7fc4fc14c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00a3f0 tx=0x7fc4ec016000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 shutdown_connections 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4fc15c5c0 0x7fc4fc15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4e8003a60 0x7fc4fc14c210 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 --2- 172.21.15.26:0/2738054956 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4fc0b0190 0x7fc4fc15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.579+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 >> 172.21.15.26:0/2738054956 conn(0x7fc4fc0cde40 msgr2=0x7fc4fc1578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.580+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 shutdown_connections 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.580+0000 7fc5008ce700 1 -- 172.21.15.26:0/2738054956 wait complete. 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:41:22.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:41:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.717+0000 7f1dd69aa700 1 Processor -- start 2023-10-09T11:41:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.717+0000 7f1dd69aa700 1 -- start start 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd69aa700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1dd0157930 0x7f1dd00ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd69aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dd00cd2b0 0x7f1dd00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd69aa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00c32a0 con 0x7f1dd00ca2c0 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd69aa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00c9730 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd69aa700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00c4100 con 0x7f1dd0157930 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dd00cd2b0 0x7f1dd00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1dd00cd2b0 0x7f1dd00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52934/0 (socket says 172.21.15.26:52934) 2023-10-09T11:41:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 -- 172.21.15.26:0/1728196536 learned_addr learned my addr 172.21.15.26:0/1728196536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dcffff700 1 --2- 172.21.15.26:0/1728196536 >> v2:172.21.15.67:3300/0 conn(0x7f1dd0157930 0x7f1dd00ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 -- 172.21.15.26:0/1728196536 >> v2:172.21.15.67:3300/0 conn(0x7f1dd0157930 msgr2=0x7f1dd00ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 --2- 172.21.15.26:0/1728196536 >> v2:172.21.15.67:3300/0 conn(0x7f1dd0157930 0x7f1dd00ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 -- 172.21.15.26:0/1728196536 >> v1:172.21.15.67:6789/0 conn(0x7f1dd00ca2c0 legacy=0x7f1dd00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 -- 172.21.15.26:0/1728196536 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00c34f0 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.718+0000 7f1dd4f47700 1 --2- 172.21.15.26:0/1728196536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00ca730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006ab90 tx=0x7f1dc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00dc980d21bb202 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dceffd700 1 -- 172.21.15.26:0/1728196536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800e070 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dceffd700 1 -- 172.21.15.26:0/1728196536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ba10 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dceffd700 1 -- 172.21.15.26:0/1728196536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80092e0 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 -- 172.21.15.26:0/1728196536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd00cd2b0 msgr2=0x7f1dd00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/1728196536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00ca730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006ab90 tx=0x7f1dc8009840 comp rx=0 tx=0).stop 2023-10-09T11:41:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 -- 172.21.15.26:0/1728196536 shutdown_connections 2023-10-09T11:41:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/1728196536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00ca730 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/1728196536 >> v2:172.21.15.67:3300/0 conn(0x7f1dd0157930 0x7f1dd00ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 -- 172.21.15.26:0/1728196536 >> 172.21.15.26:0/1728196536 conn(0x7f1dd0088000 msgr2=0x7f1dd00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 -- 172.21.15.26:0/1728196536 shutdown_connections 2023-10-09T11:41:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.719+0000 7f1dd69aa700 1 -- 172.21.15.26:0/1728196536 wait complete. 2023-10-09T11:41:22.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.720+0000 7f1dd69aa700 1 Processor -- start 2023-10-09T11:41:22.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 -- start start 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dd00ca2c0 0x7f1dd0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b2230 con 0x7f1dd0157930 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b1620 con 0x7f1dd00cd2b0 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd69aa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b1900 con 0x7f1dd00ca2c0 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd4f47700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd4f47700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52936/0 (socket says 172.21.15.26:52936) 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dd4f47700 1 -- 172.21.15.26:0/2434826365 learned_addr learned my addr 172.21.15.26:0/2434826365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dcffff700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dd00ca2c0 0x7f1dd0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.721+0000 7f1dcf7fe700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 -- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dd00ca2c0 msgr2=0x7f1dd0153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dd00ca2c0 0x7f1dd0153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 -- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 msgr2=0x7f1dd00addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 -- 172.21.15.26:0/2434826365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009ae0 con 0x7f1dd0157930 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dcf7fe700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd4f47700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8003000 tx=0x7f1dc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80094e0 con 0x7f1dd0157930 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80092e0 con 0x7f1dd0157930 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00b1be0 con 0x7f1dd0157930 2023-10-09T11:41:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc801d420 con 0x7f1dd0157930 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.722+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd0154340 con 0x7f1dd0157930 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.723+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd00b23e0 con 0x7f1dd0157930 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.723+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1dc801d7d0 con 0x7f1dd0157930 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.724+0000 7f1db7fff700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 0x7f1dbc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.724+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1dc8086030 con 0x7f1dd0157930 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.724+0000 7f1dcffff700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 0x7f1dbc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.725+0000 7f1dcffff700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 0x7f1dbc069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0006fd0 tx=0x7f1dc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.728+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dc80b75a0 con 0x7f1dd0157930 2023-10-09T11:41:22.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.921+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1dd004c3c0 con 0x7f1dd0157930 2023-10-09T11:41:22.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.925+0000 7f1db7fff700 1 -- 172.21.15.26:0/2434826365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1dd00b23e0 con 0x7f1dd0157930 2023-10-09T11:41:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 msgr2=0x7f1dbc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 0x7f1dbc069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0006fd0 tx=0x7f1dc0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 msgr2=0x7f1dd00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8003000 tx=0x7f1dc8017000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 shutdown_connections 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1dd0157930 0x7f1dd00afac0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1dbc067290 0x7f1dbc069740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1dd00ca2c0 0x7f1dd0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 --2- 172.21.15.26:0/2434826365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dd00cd2b0 0x7f1dd00addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 >> 172.21.15.26:0/2434826365 conn(0x7f1dd0088000 msgr2=0x7f1dd0154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 shutdown_connections 2023-10-09T11:41:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:22.927+0000 7f1dd69aa700 1 -- 172.21.15.26:0/2434826365 wait complete. 2023-10-09T11:41:22.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-09T11:41:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.058+0000 7f2173216700 1 Processor -- start 2023-10-09T11:41:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.058+0000 7f2173216700 1 -- start start 2023-10-09T11:41:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2173216700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f216c0cb970 0x7f216c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2173216700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f216c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2173216700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c15ae40 con 0x7f216c0cb5a0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2173216700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0ce0f0 con 0x7f216c0cb970 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2173216700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0d13f0 con 0x7f216c15a400 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2170fb2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f216c0cb5a0 0x7f216c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35368/0 (socket says 172.21.15.26:35368) 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f2170fb2700 1 -- 172.21.15.26:0/3871772980 learned_addr learned my addr 172.21.15.26:0/3871772980 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f21717b3700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f216c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f216bfff700 1 --2- 172.21.15.26:0/3871772980 >> v2:172.21.15.67:3300/0 conn(0x7f216c0cb970 0x7f216c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505830617 0 0) 0x7f216c15ae40 con 0x7f216c0cb5a0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.059+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2158003570 con 0x7f216c0cb5a0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731002568 0 0) 0x7f2158003570 con 0x7f216c0cb5a0 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 msgr2=0x7f216c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f216c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 >> v2:172.21.15.67:3300/0 conn(0x7f216c0cb970 msgr2=0x7f216c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 --2- 172.21.15.26:0/3871772980 >> v2:172.21.15.67:3300/0 conn(0x7f216c0cb970 0x7f216c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c15ab60 con 0x7f216c0cb5a0 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f2164001470 con 0x7f216c0cb5a0 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 >> v1:172.21.15.26:6789/0 conn(0x7f216c0cb5a0 legacy=0x7f216c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158003a60 0x7f2158003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2158004810 0x7f2158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f21580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0ce0f0 con 0x7f2158004810 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215800ba60 con 0x7f2158003a60 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215800bba0 con 0x7f216c15a400 2023-10-09T11:41:23.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2158004810 0x7f2158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f2170fb2700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158003a60 0x7f2158003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f21717b3700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f21580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 -- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 msgr2=0x7f21580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15a400 0x7f21580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 -- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158003a60 msgr2=0x7f2158003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158003a60 0x7f2158003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 -- 172.21.15.26:0/3871772980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158003570 con 0x7f2158004810 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.060+0000 7f216bfff700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2158004810 0x7f2158004c80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e240 tx=0x7f215c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd3dcec5d4db3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00eaf0 con 0x7f2158004810 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c00f040 con 0x7f2158004810 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f216b7fe700 1 -- 172.21.15.26:0/3871772980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00eea0 con 0x7f2158004810 2023-10-09T11:41:23.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 -- 172.21.15.26:0/3871772980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2158004810 msgr2=0x7f2158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 --2- 172.21.15.26:0/3871772980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2158004810 0x7f2158004c80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e240 tx=0x7f215c00b040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f21717b3700 1 -- 172.21.15.26:0/3871772980 reap_dead start 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 -- 172.21.15.26:0/3871772980 shutdown_connections 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 -- 172.21.15.26:0/3871772980 >> 172.21.15.26:0/3871772980 conn(0x7f216c070e30 msgr2=0x7f216c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 -- 172.21.15.26:0/3871772980 shutdown_connections 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.061+0000 7f2173216700 1 -- 172.21.15.26:0/3871772980 wait complete. 2023-10-09T11:41:23.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.062+0000 7f2173216700 1 Processor -- start 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.062+0000 7f2173216700 1 -- start start 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158004810 0x7f216c0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15d090 0x7f216c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c8c30 con 0x7f216c169f10 2023-10-09T11:41:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c16a380 con 0x7f2158004810 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2173216700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c80b0 con 0x7f216c15d090 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f216bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f216bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52946/0 (socket says 172.21.15.26:52946) 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f216bfff700 1 -- 172.21.15.26:0/2251583066 learned_addr learned my addr 172.21.15.26:0/2251583066 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f21717b3700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15d090 0x7f216c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.063+0000 7f2170fb2700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158004810 0x7f216c0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 -- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15d090 msgr2=0x7f216c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15d090 0x7f216c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 -- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158004810 msgr2=0x7f216c0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158004810 0x7f216c0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 -- 172.21.15.26:0/2251583066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0c8390 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f216bfff700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f21580046d0 tx=0x7f215c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c014ea0 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c01d420 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c01d7e0 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0c8670 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.064+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c15da70 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.065+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c063580 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.065+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f215c003040 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.066+0000 7f2168ff9700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 0x7f214c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.066+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f215c086830 con 0x7f216c169f10 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.066+0000 7f2170fb2700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 0x7f214c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.066+0000 7f2170fb2700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 0x7f214c069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ca9e0 tx=0x7f2164001e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.070+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f215c053880 con 0x7f216c169f10 2023-10-09T11:41:23.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.350+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f216c04c3c0 con 0x7f216c169f10 2023-10-09T11:41:23.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.576+0000 7f2168ff9700 1 -- 172.21.15.26:0/2251583066 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v291) v1 ==== 181+0+0 (secure 0 0 0) 0x7f215c018020 con 0x7f216c169f10 2023-10-09T11:41:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.578+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 msgr2=0x7f214c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.578+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 0x7f214c069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ca9e0 tx=0x7f2164001e90 comp rx=0 tx=0).stop 2023-10-09T11:41:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.578+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 msgr2=0x7f216c155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f21580046d0 tx=0x7f215c01a000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 shutdown_connections 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f214c067290 0x7f214c069740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f216c15d090 0x7f216c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2158004810 0x7f216c0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 --2- 172.21.15.26:0/2251583066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f216c169f10 0x7f216c155440 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 >> 172.21.15.26:0/2251583066 conn(0x7f216c070e30 msgr2=0x7f216c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 shutdown_connections 2023-10-09T11:41:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.579+0000 7f2173216700 1 -- 172.21.15.26:0/2251583066 wait complete. 2023-10-09T11:41:23.592 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-09T11:41:23.593 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-09T11:41:23.593 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:41:23.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-09T11:41:23.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.711+0000 7f0476464700 1 Processor -- start 2023-10-09T11:41:23.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.711+0000 7f0476464700 1 -- start start 2023-10-09T11:41:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0476464700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04700cb5a0 0x7f04700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0476464700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 0x7f0470159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0476464700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047015ae40 con 0x7f04700cde50 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0476464700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04700d13f0 con 0x7f04700cb5a0 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0476464700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047015ab60 con 0x7f04700cd9e0 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f046f7fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 0x7f0470159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f046ffff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04700cb5a0 0x7f04700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0474a01700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f04700cde50 0x7f0470156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51036/0 (socket says 172.21.15.26:51036) 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.712+0000 7f0474a01700 1 -- 172.21.15.26:0/4015015466 learned_addr learned my addr 172.21.15.26:0/4015015466 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046ffff700 1 -- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 msgr2=0x7f0470159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046ffff700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 0x7f0470159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046ffff700 1 -- 172.21.15.26:0/4015015466 >> v1:172.21.15.67:6789/0 conn(0x7f04700cde50 legacy=0x7f0470156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046ffff700 1 -- 172.21.15.26:0/4015015466 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04700ccf00 con 0x7f04700cb5a0 2023-10-09T11:41:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046f7fe700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 0x7f0470159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046ffff700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cb5a0 0x7f04700cb970 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f04600098e0 tx=0x7f04600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9135aa746fe63e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046effd700 1 -- 172.21.15.26:0/4015015466 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000b640 con 0x7f04700cb5a0 2023-10-09T11:41:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046effd700 1 -- 172.21.15.26:0/4015015466 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000b7a0 con 0x7f04700cb5a0 2023-10-09T11:41:23.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.713+0000 7f046effd700 1 -- 172.21.15.26:0/4015015466 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000bb40 con 0x7f04700cb5a0 2023-10-09T11:41:23.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 -- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cb5a0 msgr2=0x7f04700cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cb5a0 0x7f04700cb970 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f04600098e0 tx=0x7f04600091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 -- 172.21.15.26:0/4015015466 shutdown_connections 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cb5a0 0x7f04700cb970 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 --2- 172.21.15.26:0/4015015466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cd9e0 0x7f0470159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 -- 172.21.15.26:0/4015015466 >> 172.21.15.26:0/4015015466 conn(0x7f0470070e30 msgr2=0x7f04700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 -- 172.21.15.26:0/4015015466 shutdown_connections 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.714+0000 7f0476464700 1 -- 172.21.15.26:0/4015015466 wait complete. 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.715+0000 7f0476464700 1 Processor -- start 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.715+0000 7f0476464700 1 -- start start 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cb5a0 0x7f047015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cd9e0 0x7f0470156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047015df00 con 0x7f04700c9050 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700ca620 con 0x7f04700cd9e0 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0476464700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700ca190 con 0x7f04700cb5a0 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52952/0 (socket says 172.21.15.26:52952) 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 -- 172.21.15.26:0/1155680160 learned_addr learned my addr 172.21.15.26:0/1155680160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f046f7fe700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cd9e0 0x7f0470156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f046ffff700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cb5a0 0x7f047015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 -- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cb5a0 msgr2=0x7f047015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cb5a0 0x7f047015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 -- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cd9e0 msgr2=0x7f0470156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cd9e0 0x7f0470156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 -- 172.21.15.26:0/1155680160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009420 con 0x7f04700c9050 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0474a01700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f046800cbf0 tx=0x7f04680019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.716+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800a980 con 0x7f04700c9050 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.717+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800aae0 con 0x7f04700c9050 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.717+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0460009420 con 0x7f04700c9050 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.717+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800ae60 con 0x7f04700c9050 2023-10-09T11:41:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.717+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04700c8b00 con 0x7f04700c9050 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.717+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047004c3c0 con 0x7f04700c9050 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.718+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0468007300 con 0x7f04700c9050 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.718+0000 7f0467fff700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 0x7f0450069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.718+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0468084bf0 con 0x7f04700c9050 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.719+0000 7f046ffff700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 0x7f0450069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.719+0000 7f046ffff700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 0x7f0450069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04600093f0 tx=0x7f0460017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.723+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0468051cd0 con 0x7f04700c9050 2023-10-09T11:41:23.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:23.997+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f04700ca300 con 0x7f04700c9050 2023-10-09T11:41:24.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.577+0000 7f0467fff700 1 -- 172.21.15.26:0/1155680160 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v292) v1 ==== 159+0+0 (secure 0 0 0) 0x7f04680552f0 con 0x7f04700c9050 2023-10-09T11:41:24.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.579+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 msgr2=0x7f0450069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.579+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 0x7f0450069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04600093f0 tx=0x7f0460017000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.579+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 msgr2=0x7f047015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.579+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f046800cbf0 tx=0x7f04680019c0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 shutdown_connections 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700c9050 0x7f047015ba80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0450067290 0x7f0450069740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04700cb5a0 0x7f047015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 --2- 172.21.15.26:0/1155680160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04700cd9e0 0x7f0470156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 >> 172.21.15.26:0/1155680160 conn(0x7f0470070e30 msgr2=0x7f04700b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 shutdown_connections 2023-10-09T11:41:24.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.580+0000 7f0476464700 1 -- 172.21.15.26:0/1155680160 wait complete. 2023-10-09T11:41:24.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:24.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.718+0000 7fecf95d1700 1 Processor -- start 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.718+0000 7fecf95d1700 1 -- start start 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf95d1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 0x7fecf40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf95d1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fecf40cb1a0 0x7fecf40cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf95d1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf415e010 con 0x7fecf41598a0 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf95d1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf415d420 con 0x7fecf40cb1a0 2023-10-09T11:41:24.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf95d1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415d6e0 con 0x7fecf41594d0 2023-10-09T11:41:24.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf27fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fecf40cb1a0 0x7fecf40cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf2ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 0x7fecf40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf37fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fecf41598a0 0x7fecf40ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51038/0 (socket says 172.21.15.26:51038) 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.719+0000 7fecf37fe700 1 -- 172.21.15.26:0/3223492516 learned_addr learned my addr 172.21.15.26:0/3223492516 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf27fc700 1 -- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 msgr2=0x7fecf40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf27fc700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 0x7fecf40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf27fc700 1 -- 172.21.15.26:0/3223492516 >> v1:172.21.15.67:6789/0 conn(0x7fecf41598a0 legacy=0x7fecf40ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf27fc700 1 -- 172.21.15.26:0/3223492516 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf415d9c0 con 0x7fecf40cb1a0 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf2ffd700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 0x7fecf40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf27fc700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40cefb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0098e0 tx=0x7fecdc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8121b81714f54ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf1ffb700 1 -- 172.21.15.26:0/3223492516 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00b640 con 0x7fecf40cb1a0 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf1ffb700 1 -- 172.21.15.26:0/3223492516 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00b7a0 con 0x7fecf40cb1a0 2023-10-09T11:41:24.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.720+0000 7fecf1ffb700 1 -- 172.21.15.26:0/3223492516 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00bb40 con 0x7fecf40cb1a0 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 -- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 msgr2=0x7fecf40cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40cefb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0098e0 tx=0x7fecdc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 -- 172.21.15.26:0/3223492516 shutdown_connections 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41594d0 0x7fecf40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 --2- 172.21.15.26:0/3223492516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40cefb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 -- 172.21.15.26:0/3223492516 >> 172.21.15.26:0/3223492516 conn(0x7fecf40703a0 msgr2=0x7fecf4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 -- 172.21.15.26:0/3223492516 shutdown_connections 2023-10-09T11:41:24.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.721+0000 7fecf95d1700 1 -- 172.21.15.26:0/3223492516 wait complete. 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.722+0000 7fecf95d1700 1 Processor -- start 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.722+0000 7fecf95d1700 1 -- start start 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41598a0 0x7fecf415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40b3830 con 0x7fecf41594d0 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40c8fd0 con 0x7fecf40cb1a0 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40c78b0 con 0x7fecf41598a0 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52966/0 (socket says 172.21.15.26:52966) 2023-10-09T11:41:24.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 -- 172.21.15.26:0/94160484 learned_addr learned my addr 172.21.15.26:0/94160484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf2ffd700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf37fe700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41598a0 0x7fecf415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 -- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41598a0 msgr2=0x7fecf415a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41598a0 0x7fecf415a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 -- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 msgr2=0x7fecf40b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 -- 172.21.15.26:0/94160484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009420 con 0x7fecf41594d0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf27fc700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fecf4089600 tx=0x7fecdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc01bda0 con 0x7fecf41594d0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc011420 con 0x7fecf41594d0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.723+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc009420 con 0x7fecf41594d0 2023-10-09T11:41:24.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.724+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0117e0 con 0x7fecf41594d0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.724+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf415b470 con 0x7fecf41594d0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.724+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf404c3c0 con 0x7fecf41594d0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.725+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fecdc011b90 con 0x7fecf41594d0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.725+0000 7feceaffd700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 0x7fecd4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.725+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fecdc085e80 con 0x7fecf41594d0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.726+0000 7fecf2ffd700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 0x7fecd4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.726+0000 7fecf2ffd700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 0x7fecd4069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fecec0093f0 tx=0x7fecec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.730+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecdc052fe0 con 0x7fecf41594d0 2023-10-09T11:41:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.922+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fecf40caf80 con 0x7fecf41594d0 2023-10-09T11:41:24.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.925+0000 7feceaffd700 1 -- 172.21.15.26:0/94160484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fecdc056600 con 0x7fecf41594d0 2023-10-09T11:41:24.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.927+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 msgr2=0x7fecd4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.927+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 0x7fecd4069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fecec0093f0 tx=0x7fecec008040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.927+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 msgr2=0x7fecf4151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.927+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fecf4089600 tx=0x7fecdc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 shutdown_connections 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fecd4067290 0x7fecd4069740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fecf41598a0 0x7fecf415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fecf40cb1a0 0x7fecf40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 --2- 172.21.15.26:0/94160484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecf41594d0 0x7fecf4151c40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 >> 172.21.15.26:0/94160484 conn(0x7fecf40703a0 msgr2=0x7fecf40d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 shutdown_connections 2023-10-09T11:41:24.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:24.928+0000 7fecf95d1700 1 -- 172.21.15.26:0/94160484 wait complete. 2023-10-09T11:41:24.941 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:24.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:24.979 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:25.024 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:25.024 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:41:25.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 Processor -- start 2023-10-09T11:41:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 -- start start 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f197c157550 0x7f197c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c0c8bd0 0x7f197c068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c06ce20 con 0x7f197c0b1c80 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0c9040 con 0x7f197c157550 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.142+0000 7f1982e8c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0686c0 con 0x7f197c0c8bd0 2023-10-09T11:41:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f197c157550 0x7f197c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f197bfff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c0c8bd0 0x7f197c068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1981429700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f197c0b1c80 0x7f197c06d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51042/0 (socket says 172.21.15.26:51042) 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1981429700 1 -- 172.21.15.26:0/1883229003 learned_addr learned my addr 172.21.15.26:0/1883229003 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 -- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c0c8bd0 msgr2=0x7f197c068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 --2- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c0c8bd0 0x7f197c068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 -- 172.21.15.26:0/1883229003 >> v1:172.21.15.67:6789/0 conn(0x7f197c0b1c80 legacy=0x7f197c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 -- 172.21.15.26:0/1883229003 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0c9290 con 0x7f197c157550 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.143+0000 7f1980c28700 1 --2- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c157550 0x7f197c0caa40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19740098e0 tx=0x7f19740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee42b28480a52e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f197b7fe700 1 -- 172.21.15.26:0/1883229003 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400b640 con 0x7f197c157550 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f197b7fe700 1 -- 172.21.15.26:0/1883229003 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400b7a0 con 0x7f197c157550 2023-10-09T11:41:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f197b7fe700 1 -- 172.21.15.26:0/1883229003 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400bb40 con 0x7f197c157550 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 -- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c157550 msgr2=0x7f197c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 --2- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c157550 0x7f197c0caa40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19740098e0 tx=0x7f19740091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 -- 172.21.15.26:0/1883229003 shutdown_connections 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 --2- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c157550 0x7f197c0caa40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 --2- 172.21.15.26:0/1883229003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c0c8bd0 0x7f197c068180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 -- 172.21.15.26:0/1883229003 >> 172.21.15.26:0/1883229003 conn(0x7f197c06f190 msgr2=0x7f197c0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 -- 172.21.15.26:0/1883229003 shutdown_connections 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.144+0000 7f1982e8c700 1 -- 172.21.15.26:0/1883229003 wait complete. 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.145+0000 7f1982e8c700 1 Processor -- start 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.145+0000 7f1982e8c700 1 -- start start 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c0c8bd0 0x7f197c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c157550 0x7f197c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c155630 con 0x7f197c0b1c80 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c15a7b0 con 0x7f197c0c8bd0 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1982e8c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c16b850 con 0x7f197c157550 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1980c28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1980c28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52970/0 (socket says 172.21.15.26:52970) 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1980c28700 1 -- 172.21.15.26:0/525631775 learned_addr learned my addr 172.21.15.26:0/525631775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f1981429700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c157550 0x7f197c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.146+0000 7f197bfff700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c0c8bd0 0x7f197c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 -- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c157550 msgr2=0x7f197c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c157550 0x7f197c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 -- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c0c8bd0 msgr2=0x7f197c14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c0c8bd0 0x7f197c14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 -- 172.21.15.26:0/525631775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009420 con 0x7f197c0b1c80 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1980c28700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f197c06f590 tx=0x7f1974017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197401bb70 con 0x7f197c0b1c80 2023-10-09T11:41:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197401bcd0 con 0x7f197c0b1c80 2023-10-09T11:41:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c16b570 con 0x7f197c0b1c80 2023-10-09T11:41:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974011670 con 0x7f197c0b1c80 2023-10-09T11:41:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.147+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c1552c0 con 0x7f197c0b1c80 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.148+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c04c3c0 con 0x7f197c0b1c80 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.148+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1974011a20 con 0x7f197c0b1c80 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.149+0000 7f1978ff9700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 0x7f195c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.149+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1974085ac0 con 0x7f197c0b1c80 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.149+0000 7f197bfff700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 0x7f195c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.150+0000 7f197bfff700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 0x7f195c069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f197c15cf80 tx=0x7f196c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.153+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1974087e60 con 0x7f197c0b1c80 2023-10-09T11:41:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.392+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f197c06c7d0 con 0x7f197c0b1c80 2023-10-09T11:41:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.393+0000 7f1978ff9700 1 -- 172.21.15.26:0/525631775 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f1974015dd0 con 0x7f197c0b1c80 2023-10-09T11:41:25.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:25.395 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2012684593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2012684593},{"type":"v1","addr":"172.21.15.67:6836","nonce":2012684593}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6037,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/302543928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":302543928},{"type":"v1","addr":"172.21.15.67:6837","nonce":302543928}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3710663351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3710663351},{"type":"v1","addr":"172.21.15.26:6833","nonce":3710663351}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/60939644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":60939644},{"type":"v1","addr":"172.21.15.26:6835","nonce":60939644}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[]} 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 msgr2=0x7f195c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 0x7f195c069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f197c15cf80 tx=0x7f196c00b040 comp rx=0 tx=0).stop 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 msgr2=0x7f197c15a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f197c06f590 tx=0x7f1974017000 comp rx=0 tx=0).stop 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 shutdown_connections 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f195c067290 0x7f195c069740 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f197c157550 0x7f197c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c0b1c80 0x7f197c15a270 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 --2- 172.21.15.26:0/525631775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f197c0c8bd0 0x7f197c14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 >> 172.21.15.26:0/525631775 conn(0x7f197c06f190 msgr2=0x7f197c14f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 shutdown_connections 2023-10-09T11:41:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.395+0000 7f1982e8c700 1 -- 172.21.15.26:0/525631775 wait complete. 2023-10-09T11:41:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 61 2023-10-09T11:41:25.409 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:41:25.409 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:41:25.409 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:41:25.409 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:25.410 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:41:25.410 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:41:25.410 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:41:25.410 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:25.410 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:41:25.410 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:41:25.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:41:25.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:25.411 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:41:25.411 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:41:25.411 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:41:25.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:25.418 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:41:25.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:41:25.419 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:41:25.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:41:25.421 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:41:25.422 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:41:25.422 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:41:25.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:41:25.460 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:41:25.460 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:25.461 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:41:25.461 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:25.464 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:41:25.464 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:25.465 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:41:25.465 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:25.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:41:25.536 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:41:25.536 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:41:25.548 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:41:25.548 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:41:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.589+0000 7f5fd55bf700 1 Processor -- start 2023-10-09T11:41:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.589+0000 7f5fd55bf700 1 -- start start 2023-10-09T11:41:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fd55bf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5fd00a8d00 0x7f5fd00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fd55bf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00aeee0 con 0x7f5fd00a90d0 2023-10-09T11:41:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fd55bf700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00cf490 con 0x7f5fd006e550 2023-10-09T11:41:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fd55bf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00ae680 con 0x7f5fd00a8d00 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fce7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5fd00a90d0 0x7f5fd006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35382/0 (socket says 172.21.15.26:35382) 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fce7fc700 1 -- 172.21.15.26:0/1086498301 learned_addr learned my addr 172.21.15.26:0/1086498301 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fceffd700 1 --2- 172.21.15.26:0/1086498301 >> v2:172.21.15.67:3300/0 conn(0x7f5fd00a8d00 0x7f5fd00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931182897 0 0) 0x7f5fd00aeee0 con 0x7f5fd00a90d0 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fbc003570 con 0x7f5fd00a90d0 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fceffd700 1 -- 172.21.15.26:0/1086498301 >> v1:172.21.15.67:6789/0 conn(0x7f5fd006e550 legacy=0x7f5fd00af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fceffd700 1 -- 172.21.15.26:0/1086498301 >> v1:172.21.15.26:6789/0 conn(0x7f5fd00a90d0 legacy=0x7f5fd006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160895701 0 0) 0x7f5fbc003570 con 0x7f5fd00a90d0 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.590+0000 7f5fceffd700 1 -- 172.21.15.26:0/1086498301 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00ce330 con 0x7f5fd00a8d00 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.591+0000 7f5fceffd700 1 --2- 172.21.15.26:0/1086498301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd00a8d00 0x7f5fd00cddf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00098d0 tx=0x7f5fc0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485ee8a27c7bb74e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.591+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80015f0 con 0x7f5fd00a8d00 2023-10-09T11:41:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.591+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0011420 con 0x7f5fd00a8d00 2023-10-09T11:41:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.591+0000 7f5fcdffb700 1 -- 172.21.15.26:0/1086498301 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00117a0 con 0x7f5fd00a8d00 2023-10-09T11:41:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 -- 172.21.15.26:0/1086498301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd00a8d00 msgr2=0x7f5fd00cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/1086498301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd00a8d00 0x7f5fd00cddf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00098d0 tx=0x7f5fc0009120 comp rx=0 tx=0).stop 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 -- 172.21.15.26:0/1086498301 shutdown_connections 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/1086498301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd00a8d00 0x7f5fd00cddf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 -- 172.21.15.26:0/1086498301 >> 172.21.15.26:0/1086498301 conn(0x7f5fd006ce80 msgr2=0x7f5fd00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 -- 172.21.15.26:0/1086498301 shutdown_connections 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.592+0000 7f5fd55bf700 1 -- 172.21.15.26:0/1086498301 wait complete. 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.593+0000 7f5fd55bf700 1 Processor -- start 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.593+0000 7f5fd55bf700 1 -- start start 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd006e550 0x7f5fd016a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 0x7f5fd0159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0154520 con 0x7f5fd00a90d0 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01567d0 con 0x7f5fd006e550 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fd55bf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd009be10 con 0x7f5fd00a8d00 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fce7fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 0x7f5fd0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53024/0 (socket says 172.21.15.26:53024) 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fceffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd006e550 0x7f5fd016a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 -- 172.21.15.26:0/601833474 learned_addr learned my addr 172.21.15.26:0/601833474 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 -- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 msgr2=0x7f5fd0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 0x7f5fd0159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 -- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd006e550 msgr2=0x7f5fd016a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd006e550 0x7f5fd016a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 -- 172.21.15.26:0/601833474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00093c0 con 0x7f5fd00a90d0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fce7fc700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 0x7f5fd0159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.594+0000 7f5fcf7fe700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c810 tx=0x7f5fc8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.595+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8012630 con 0x7f5fd00a90d0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.595+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc80127b0 con 0x7f5fd00a90d0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.595+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd016aa60 con 0x7f5fd00a90d0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.595+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8012b70 con 0x7f5fd00a90d0 2023-10-09T11:41:25.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.595+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd016b020 con 0x7f5fd00a90d0 2023-10-09T11:41:25.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.596+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd0067830 con 0x7f5fd00a90d0 2023-10-09T11:41:25.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.596+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5fc8003030 con 0x7f5fd00a90d0 2023-10-09T11:41:25.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.597+0000 7f5fc6ffd700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 0x7f5fb0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.597+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5fc8084730 con 0x7f5fd00a90d0 2023-10-09T11:41:25.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.597+0000 7f5fceffd700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 0x7f5fb0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.597+0000 7f5fceffd700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 0x7f5fb0069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009390 tx=0x7f5fc0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.601+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc8051790 con 0x7f5fd00a90d0 2023-10-09T11:41:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:25.811+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5fd004c3c0 con 0x7f5fd00a90d0 2023-10-09T11:41:26.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:26.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:26.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.591+0000 7f5fc6ffd700 1 -- 172.21.15.26:0/601833474 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fc8054db0 con 0x7f5fd00a90d0 2023-10-09T11:41:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 msgr2=0x7f5fb0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 0x7f5fb0069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009390 tx=0x7f5fc0016000 comp rx=0 tx=0).stop 2023-10-09T11:41:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 msgr2=0x7f5fd0153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c810 tx=0x7f5fc8001650 comp rx=0 tx=0).stop 2023-10-09T11:41:26.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 shutdown_connections 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd00a90d0 0x7f5fd0153fe0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd006e550 0x7f5fd016a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5fb0067290 0x7f5fb0069740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 --2- 172.21.15.26:0/601833474 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fd00a8d00 0x7f5fd0159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 >> 172.21.15.26:0/601833474 conn(0x7f5fd006ce80 msgr2=0x7f5fd0155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.593+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 shutdown_connections 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.594+0000 7f5fd55bf700 1 -- 172.21.15.26:0/601833474 wait complete. 2023-10-09T11:41:26.596 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:41:26.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:41:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.730+0000 7f35252dd700 1 Processor -- start 2023-10-09T11:41:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.730+0000 7f35252dd700 1 -- start start 2023-10-09T11:41:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f35252dd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35200b07d0 0x7f35200ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f35252dd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352015a280 con 0x7f35200b0ba0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f35252dd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352006e180 con 0x7f35200cf200 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f35252dd700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352006d850 con 0x7f35200b07d0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f35200b0ba0 0x7f352006ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35398/0 (socket says 172.21.15.26:35398) 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351f7fe700 1 -- 172.21.15.26:0/2177811008 learned_addr learned my addr 172.21.15.26:0/2177811008 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351effd700 1 --2- 172.21.15.26:0/2177811008 >> v2:172.21.15.67:3300/0 conn(0x7f35200b07d0 0x7f35200ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567591057 0 0) 0x7f352015a280 con 0x7f35200b0ba0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f350c003570 con 0x7f35200b0ba0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912521280 0 0) 0x7f350c003570 con 0x7f35200b0ba0 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 >> v2:172.21.15.67:3300/0 conn(0x7f35200b07d0 msgr2=0x7f35200ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 --2- 172.21.15.26:0/2177811008 >> v2:172.21.15.67:3300/0 conn(0x7f35200b07d0 0x7f35200ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 >> v1:172.21.15.67:6789/0 conn(0x7f35200cf200 legacy=0x7f352006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352006db30 con 0x7f35200b0ba0 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3510001470 con 0x7f35200b0ba0 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 >> v1:172.21.15.26:6789/0 conn(0x7f35200b0ba0 legacy=0x7f352006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 0x7f350c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350c004810 0x7f350c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c0051c0 0x7f350c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352006d850 con 0x7f350c003a60 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00c0d0 con 0x7f350c004810 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.731+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00c290 con 0x7f350c0051c0 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 0x7f350c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351e7fc700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350c004810 0x7f350c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 -- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c0051c0 msgr2=0x7f350c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c0051c0 0x7f350c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 -- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350c004810 msgr2=0x7f350c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350c004810 0x7f350c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 -- 172.21.15.26:0/2177811008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c003570 con 0x7f350c003a60 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351f7fe700 1 -- 172.21.15.26:0/2177811008 reap_dead start 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351effd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 0x7f350c003e70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f351800e2d0 tx=0x7f351800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7018b1c88a1eb8af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800eb20 con 0x7f350c003a60 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800f040 con 0x7f350c003a60 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.732+0000 7f351dffb700 1 -- 172.21.15.26:0/2177811008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800eed0 con 0x7f350c003a60 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 -- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 msgr2=0x7f350c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 0x7f350c003e70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f351800e2d0 tx=0x7f351800b040 comp rx=0 tx=0).stop 2023-10-09T11:41:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 -- 172.21.15.26:0/2177811008 shutdown_connections 2023-10-09T11:41:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 --2- 172.21.15.26:0/2177811008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f350c003a60 0x7f350c003e70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 -- 172.21.15.26:0/2177811008 >> 172.21.15.26:0/2177811008 conn(0x7f352006ce80 msgr2=0x7f35200ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 -- 172.21.15.26:0/2177811008 shutdown_connections 2023-10-09T11:41:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.733+0000 7f35252dd700 1 -- 172.21.15.26:0/2177811008 wait complete. 2023-10-09T11:41:26.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.734+0000 7f35252dd700 1 Processor -- start 2023-10-09T11:41:26.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.734+0000 7f35252dd700 1 -- start start 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 0x7f35200c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 0x7f3520157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520157fa0 con 0x7f35200b2620 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200b3350 con 0x7f35201575f0 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200b3630 con 0x7f350c003a60 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53052/0 (socket says 172.21.15.26:53052) 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 -- 172.21.15.26:0/2293666179 learned_addr learned my addr 172.21.15.26:0/2293666179 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351e7fc700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 0x7f3520157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351effd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 0x7f35200c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 -- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 msgr2=0x7f35200c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 0x7f35200c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 -- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 msgr2=0x7f3520157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 0x7f3520157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 -- 172.21.15.26:0/2293666179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200b3910 con 0x7f35200b2620 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351e7fc700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 0x7f3520157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351effd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 0x7f35200c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f351f7fe700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f352006b550 tx=0x7f3510001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510001d30 con 0x7f35200b2620 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510007360 con 0x7f35200b2620 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35200b3bf0 con 0x7f35200b2620 2023-10-09T11:41:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.735+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510004830 con 0x7f35200b2620 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.736+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35200b2fe0 con 0x7f35200b2620 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.736+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352015bae0 con 0x7f35200b2620 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.737+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3510004c20 con 0x7f35200b2620 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.737+0000 7f3516ffd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 0x7f3500069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.737+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3510084300 con 0x7f35200b2620 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.737+0000 7f351effd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 0x7f3500069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.738+0000 7f351effd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 0x7f3500069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f351800e9c0 tx=0x7f351801a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:26.742+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f352015bae0 con 0x7f35200b2620 2023-10-09T11:41:27.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.012+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f352015bae0 con 0x7f35200b2620 2023-10-09T11:41:27.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.012+0000 7f3516ffd700 1 -- 172.21.15.26:0/2293666179 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f352015bae0 con 0x7f35200b2620 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:27.015 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:41:27.018 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.022 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.023 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:27.028 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:41:27.029 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.014+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 msgr2=0x7f3500069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.014+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 0x7f3500069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f351800e9c0 tx=0x7f351801a000 comp rx=0 tx=0).stop 2023-10-09T11:41:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.014+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 msgr2=0x7f35200b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.014+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f352006b550 tx=0x7f3510001aa0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 shutdown_connections 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35200b2620 0x7f35200b2aa0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3500067290 0x7f3500069740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f350c003a60 0x7f35200c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 --2- 172.21.15.26:0/2293666179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35201575f0 0x7f3520157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 >> 172.21.15.26:0/2293666179 conn(0x7f352006ce80 msgr2=0x7f35201583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 shutdown_connections 2023-10-09T11:41:27.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.015+0000 7f35252dd700 1 -- 172.21.15.26:0/2293666179 wait complete. 2023-10-09T11:41:27.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:27.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.149+0000 7fc8e2464700 1 Processor -- start 2023-10-09T11:41:27.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.149+0000 7fc8e2464700 1 -- start start 2023-10-09T11:41:27.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8e2464700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8dc0cf200 0x7fc8dc0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8e2464700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc15a280 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8e2464700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc06e180 con 0x7fc8dc0b0ba0 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8e2464700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc06d850 con 0x7fc8dc0cf200 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8db7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8dc0cf200 0x7fc8dc0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8dbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc8dc0b07d0 0x7fc8dc0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35412/0 (socket says 172.21.15.26:35412) 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8dbfff700 1 -- 172.21.15.26:0/4070182280 learned_addr learned my addr 172.21.15.26:0/4070182280 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8daffd700 1 -- 172.21.15.26:0/4070182280 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539467860 0 0) 0x7fc8dc15a280 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8daffd700 1 -- 172.21.15.26:0/4070182280 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c8003570 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8db7fe700 1 -- 172.21.15.26:0/4070182280 >> v1:172.21.15.67:6789/0 conn(0x7fc8dc0b0ba0 legacy=0x7fc8dc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8db7fe700 1 -- 172.21.15.26:0/4070182280 >> v1:172.21.15.26:6789/0 conn(0x7fc8dc0b07d0 legacy=0x7fc8dc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8db7fe700 1 -- 172.21.15.26:0/4070182280 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc06db30 con 0x7fc8dc0cf200 2023-10-09T11:41:27.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8db7fe700 1 --2- 172.21.15.26:0/4070182280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc0c42c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40098e0 tx=0x7fc8c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dab194f016a141a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8daffd700 1 -- 172.21.15.26:0/4070182280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400b640 con 0x7fc8dc0cf200 2023-10-09T11:41:27.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8daffd700 1 -- 172.21.15.26:0/4070182280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c400b7a0 con 0x7fc8dc0cf200 2023-10-09T11:41:27.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.150+0000 7fc8daffd700 1 -- 172.21.15.26:0/4070182280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400bb40 con 0x7fc8dc0cf200 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 -- 172.21.15.26:0/4070182280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0cf200 msgr2=0x7fc8dc0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 --2- 172.21.15.26:0/4070182280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc0c42c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40098e0 tx=0x7fc8c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 -- 172.21.15.26:0/4070182280 shutdown_connections 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 --2- 172.21.15.26:0/4070182280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc0c42c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 -- 172.21.15.26:0/4070182280 >> 172.21.15.26:0/4070182280 conn(0x7fc8dc06ce80 msgr2=0x7fc8dc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 -- 172.21.15.26:0/4070182280 shutdown_connections 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.151+0000 7fc8e2464700 1 -- 172.21.15.26:0/4070182280 wait complete. 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.152+0000 7fc8e2464700 1 Processor -- start 2023-10-09T11:41:27.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.152+0000 7fc8e2464700 1 -- start start 2023-10-09T11:41:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8dc0b0ba0 0x7fc8dc0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc09ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c6560 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc157890 con 0x7fc8dc0cf200 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e2464700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c7040 con 0x7fc8dc0b0ba0 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53074/0 (socket says 172.21.15.26:53074) 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 -- 172.21.15.26:0/3731972497 learned_addr learned my addr 172.21.15.26:0/3731972497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8e0a01700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc09ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8db7fe700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8dc0b0ba0 0x7fc8dc0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 -- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8dc0b0ba0 msgr2=0x7fc8dc0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8dc0b0ba0 0x7fc8dc0c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 -- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc0cf200 msgr2=0x7fc8dc09ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc09ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.153+0000 7fc8dbfff700 1 -- 172.21.15.26:0/3731972497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009420 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8dbfff700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c790 tx=0x7fc8cc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0072e0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc007440 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0c5fa0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0057f0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.154+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc0c6cd0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.155+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc04c3c0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.155+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc8cc005c20 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.156+0000 7fc8d3fff700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 0x7fc8bc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.156+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc8cc083bb0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.156+0000 7fc8db7fe700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 0x7fc8bc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.156+0000 7fc8db7fe700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 0x7fc8bc069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40093f0 tx=0x7fc8c4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.160+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8cc04b5a0 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.355+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8dc06de10 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.355+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3731972497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+12087 (secure 0 0 0) 0x7fc8cc017020 con 0x7fc8dc0b07d0 2023-10-09T11:41:27.357 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:27.357 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":96,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:26.589820+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 msgr2=0x7fc8bc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 0x7fc8bc069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40093f0 tx=0x7fc8c4017000 comp rx=0 tx=0).stop 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 msgr2=0x7fc8dc157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c790 tx=0x7fc8cc007c80 comp rx=0 tx=0).stop 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 shutdown_connections 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc0cf200 0x7fc8dc09ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.357+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc0b07d0 0x7fc8dc157350 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.358+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc8bc067290 0x7fc8bc069740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.358+0000 7fc8e2464700 1 --2- 172.21.15.26:0/3731972497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8dc0b0ba0 0x7fc8dc0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.358+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 >> 172.21.15.26:0/3731972497 conn(0x7fc8dc06ce80 msgr2=0x7fc8dc068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.358+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 shutdown_connections 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.358+0000 7fc8e2464700 1 -- 172.21.15.26:0/3731972497 wait complete. 2023-10-09T11:41:27.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:41:27.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:27.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.492+0000 7fca0df52700 1 Processor -- start 2023-10-09T11:41:27.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.492+0000 7fca0df52700 1 -- start start 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0df52700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca08153a00 0x7fca08153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0df52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca0815de50 0x7fca0815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0df52700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0815af60 con 0x7fca080cea00 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0df52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0815d010 con 0x7fca0815de50 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0df52700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0815b240 con 0x7fca08153a00 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca0815de50 0x7fca0815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca0815de50 0x7fca0815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53078/0 (socket says 172.21.15.26:53078) 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 -- 172.21.15.26:0/1659304251 learned_addr learned my addr 172.21.15.26:0/1659304251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 -- 172.21.15.26:0/1659304251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca08153a00 msgr2=0x7fca08153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca0cf50700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca08153a00 0x7fca08153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca08153a00 0x7fca08153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 -- 172.21.15.26:0/1659304251 >> v1:172.21.15.67:6789/0 conn(0x7fca080cea00 legacy=0x7fca080cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 -- 172.21.15.26:0/1659304251 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0815b520 con 0x7fca0815de50 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca07fff700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0815de50 0x7fca0815a540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40099b0 tx=0x7fc9f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0e2b64864e4e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.493+0000 7fca077fe700 1 -- 172.21.15.26:0/1659304251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400b820 con 0x7fca0815de50 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca077fe700 1 -- 172.21.15.26:0/1659304251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f400b980 con 0x7fca0815de50 2023-10-09T11:41:27.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca077fe700 1 -- 172.21.15.26:0/1659304251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400bd20 con 0x7fca0815de50 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 -- 172.21.15.26:0/1659304251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0815de50 msgr2=0x7fca0815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0815de50 0x7fca0815a540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40099b0 tx=0x7fc9f4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 -- 172.21.15.26:0/1659304251 shutdown_connections 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca08153a00 0x7fca08153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 --2- 172.21.15.26:0/1659304251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0815de50 0x7fca0815a540 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 -- 172.21.15.26:0/1659304251 >> 172.21.15.26:0/1659304251 conn(0x7fca080703a0 msgr2=0x7fca080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 -- 172.21.15.26:0/1659304251 shutdown_connections 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.494+0000 7fca0df52700 1 -- 172.21.15.26:0/1659304251 wait complete. 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.495+0000 7fca0df52700 1 Processor -- start 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.495+0000 7fca0df52700 1 -- start start 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca080cea00 0x7fca0816ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca0815de50 0x7fca08143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0816ddd0 con 0x7fca08153a00 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0814fbd0 con 0x7fca0815de50 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0df52700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0816d530 con 0x7fca080cea00 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53094/0 (socket says 172.21.15.26:53094) 2023-10-09T11:41:27.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 -- 172.21.15.26:0/898542967 learned_addr learned my addr 172.21.15.26:0/898542967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0d751700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca0815de50 0x7fca08143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca0cf50700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca080cea00 0x7fca0816ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 -- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca080cea00 msgr2=0x7fca0816ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca080cea00 0x7fca0816ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 -- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca0815de50 msgr2=0x7fca08143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca0815de50 0x7fca08143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.496+0000 7fca07fff700 1 -- 172.21.15.26:0/898542967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40094f0 con 0x7fca08153a00 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca07fff700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40030c0 tx=0x7fc9f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011d40 con 0x7fca08153a00 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4020070 con 0x7fca08153a00 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0816d810 con 0x7fca08153a00 2023-10-09T11:41:27.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011ea0 con 0x7fca08153a00 2023-10-09T11:41:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.497+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca081443a0 con 0x7fca08153a00 2023-10-09T11:41:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.498+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0815d3d0 con 0x7fca08153a00 2023-10-09T11:41:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.498+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc9f4022030 con 0x7fca08153a00 2023-10-09T11:41:27.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.499+0000 7fca04ff9700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 0x7fc9ec069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.499+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc9f40864e0 con 0x7fca08153a00 2023-10-09T11:41:27.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.499+0000 7fca0cf50700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 0x7fc9ec069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.499+0000 7fca0cf50700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 0x7fc9ec069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00acb0 tx=0x7fc9fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.503+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9f4053690 con 0x7fca08153a00 2023-10-09T11:41:27.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.695+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca0815d3d0 con 0x7fca08153a00 2023-10-09T11:41:27.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.696+0000 7fca04ff9700 1 -- 172.21.15.26:0/898542967 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9f4086020 con 0x7fca08153a00 2023-10-09T11:41:27.697 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:41:27.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 msgr2=0x7fc9ec069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 0x7fc9ec069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00acb0 tx=0x7fc9fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 msgr2=0x7fca080cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40030c0 tx=0x7fc9f4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 shutdown_connections 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca0815de50 0x7fca08143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc9ec067290 0x7fc9ec069740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca080cea00 0x7fca0816ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 --2- 172.21.15.26:0/898542967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca08153a00 0x7fca080cceb0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 >> 172.21.15.26:0/898542967 conn(0x7fca080703a0 msgr2=0x7fca080b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 shutdown_connections 2023-10-09T11:41:27.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.698+0000 7fca0df52700 1 -- 172.21.15.26:0/898542967 wait complete. 2023-10-09T11:41:27.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:41:27.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.828+0000 7f52280e3700 1 Processor -- start 2023-10-09T11:41:27.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 -- start start 2023-10-09T11:41:27.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52200aee90 0x7f52200a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 0x7f52200b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200ce1a0 con 0x7f52200a8be0 2023-10-09T11:41:27.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200cd5d0 con 0x7f52200aee90 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.829+0000 7f52280e3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200cd870 con 0x7f522006d280 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52200aee90 0x7f52200a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5225e7f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f52200a8be0 0x7f52200ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35424/0 (socket says 172.21.15.26:35424) 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5225e7f700 1 -- 172.21.15.26:0/255311849 learned_addr learned my addr 172.21.15.26:0/255311849 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5226680700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 0x7f52200b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 -- 172.21.15.26:0/255311849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 msgr2=0x7f52200b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 0x7f52200b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 -- 172.21.15.26:0/255311849 >> v1:172.21.15.26:6789/0 conn(0x7f52200a8be0 legacy=0x7f52200ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 -- 172.21.15.26:0/255311849 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200cdb50 con 0x7f52200aee90 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5224e7d700 1 -- 172.21.15.26:0/255311849 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249113340 0 0) 0x7f52200ce1a0 con 0x7f52200a8be0 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5226680700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 0x7f52200b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:27.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f522567e700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52200aee90 0x7f52200a8fb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f52140098d0 tx=0x7f5214009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ffc871e1829c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5224e7d700 1 -- 172.21.15.26:0/255311849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214009e70 con 0x7f52200aee90 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5224e7d700 1 -- 172.21.15.26:0/255311849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5214005c10 con 0x7f52200aee90 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.830+0000 7f5224e7d700 1 -- 172.21.15.26:0/255311849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521400b6e0 con 0x7f52200aee90 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 -- 172.21.15.26:0/255311849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52200aee90 msgr2=0x7f52200a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52200aee90 0x7f52200a8fb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f52140098d0 tx=0x7f5214009120 comp rx=0 tx=0).stop 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 -- 172.21.15.26:0/255311849 shutdown_connections 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f522006d280 0x7f52200b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 --2- 172.21.15.26:0/255311849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52200aee90 0x7f52200a8fb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 -- 172.21.15.26:0/255311849 >> 172.21.15.26:0/255311849 conn(0x7f522006ce80 msgr2=0x7f52200ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 -- 172.21.15.26:0/255311849 shutdown_connections 2023-10-09T11:41:27.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.831+0000 7f52280e3700 1 -- 172.21.15.26:0/255311849 wait complete. 2023-10-09T11:41:27.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.832+0000 7f52280e3700 1 Processor -- start 2023-10-09T11:41:27.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.832+0000 7f52280e3700 1 -- start start 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52200a8be0 0x7f5220167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52200aee90 0x7f52201683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200abc20 con 0x7f522006d280 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200ab8f0 con 0x7f52200aee90 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200aa330 con 0x7f52200a8be0 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53112/0 (socket says 172.21.15.26:53112) 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 -- 172.21.15.26:0/869276530 learned_addr learned my addr 172.21.15.26:0/869276530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 -- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52200a8be0 msgr2=0x7f5220167e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52200a8be0 0x7f5220167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 -- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52200aee90 msgr2=0x7f52201683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52200aee90 0x7f52201683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 -- 172.21.15.26:0/869276530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140093c0 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f5225e7f700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f521800c7e0 tx=0x7f5218007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218007300 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218007460 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200aa610 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.833+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180057f0 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.834+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52200aa8f0 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.835+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522004c3c0 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.835+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5218005c00 con 0x7f522006d280 2023-10-09T11:41:27.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.835+0000 7f521dffb700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 0x7f520c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.835+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5218084360 con 0x7f522006d280 2023-10-09T11:41:27.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.835+0000 7f522567e700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 0x7f520c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.836+0000 7f522567e700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 0x7f520c069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52200af290 tx=0x7f5214016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:27.839+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5218051490 con 0x7f522006d280 2023-10-09T11:41:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.033+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5220067b20 con 0x7f522006d280 2023-10-09T11:41:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.033+0000 7f521dffb700 1 -- 172.21.15.26:0/869276530 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5218054ab0 con 0x7f522006d280 2023-10-09T11:41:28.034 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:28.034 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:41:28.035 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:28.035 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:41:28.035 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:41:28.035 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:28.035 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:41:28.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 msgr2=0x7f520c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 0x7f520c069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52200af290 tx=0x7f5214016000 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 msgr2=0x7f52200a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f521800c7e0 tx=0x7f5218007c80 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 shutdown_connections 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52200aee90 0x7f52201683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f522006d280 0x7f52200a99c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f520c067290 0x7f520c069740 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 --2- 172.21.15.26:0/869276530 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f52200a8be0 0x7f5220167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 >> 172.21.15.26:0/869276530 conn(0x7f522006ce80 msgr2=0x7f52200b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 shutdown_connections 2023-10-09T11:41:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.035+0000 7f52280e3700 1 -- 172.21.15.26:0/869276530 wait complete. 2023-10-09T11:41:28.048 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:41:28.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:41:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.170+0000 7f5385437700 1 Processor -- start 2023-10-09T11:41:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.170+0000 7f5385437700 1 -- start start 2023-10-09T11:41:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f538015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5380068220 0x7f5380159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538015a300 0x7f53800c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538015d9f0 con 0x7f538015a300 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538015d3c0 con 0x7f5380068220 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f5385437700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538015a8f0 con 0x7f5380067e50 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538015a300 0x7f53800c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538015a300 0x7f53800c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53128/0 (socket says 172.21.15.26:53128) 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 -- 172.21.15.26:0/3138534917 learned_addr learned my addr 172.21.15.26:0/3138534917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537effd700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f538015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537e7fc700 1 --2- 172.21.15.26:0/3138534917 >> v2:172.21.15.67:3300/0 conn(0x7f5380068220 0x7f5380159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 -- 172.21.15.26:0/3138534917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 msgr2=0x7f538015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f538015de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 -- 172.21.15.26:0/3138534917 >> v2:172.21.15.67:3300/0 conn(0x7f5380068220 msgr2=0x7f5380159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 --2- 172.21.15.26:0/3138534917 >> v2:172.21.15.67:3300/0 conn(0x7f5380068220 0x7f5380159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 -- 172.21.15.26:0/3138534917 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538015abd0 con 0x7f538015a300 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537f7fe700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538015a300 0x7f53800c8c70 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5380069280 tx=0x7f5370009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a3bdd9137f51b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537dffb700 1 -- 172.21.15.26:0/3138534917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537000e070 con 0x7f538015a300 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537dffb700 1 -- 172.21.15.26:0/3138534917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537000b970 con 0x7f538015a300 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.171+0000 7f537dffb700 1 -- 172.21.15.26:0/3138534917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700092e0 con 0x7f538015a300 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 -- 172.21.15.26:0/3138534917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538015a300 msgr2=0x7f53800c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538015a300 0x7f53800c8c70 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5380069280 tx=0x7f5370009840 comp rx=0 tx=0).stop 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 -- 172.21.15.26:0/3138534917 shutdown_connections 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538015a300 0x7f53800c8c70 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 --2- 172.21.15.26:0/3138534917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f538015de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 --2- 172.21.15.26:0/3138534917 >> v2:172.21.15.67:3300/0 conn(0x7f5380068220 0x7f5380159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 -- 172.21.15.26:0/3138534917 >> 172.21.15.26:0/3138534917 conn(0x7f53800ce4a0 msgr2=0x7f53800ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 -- 172.21.15.26:0/3138534917 shutdown_connections 2023-10-09T11:41:28.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.172+0000 7f5385437700 1 -- 172.21.15.26:0/3138534917 wait complete. 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.173+0000 7f5385437700 1 Processor -- start 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.173+0000 7f5385437700 1 -- start start 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f5380151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015a300 0x7f53800b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c6910 con 0x7f5380068220 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c5d30 con 0x7f538015a300 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f5385437700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c6300 con 0x7f5380067e50 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53142/0 (socket says 172.21.15.26:53142) 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 -- 172.21.15.26:0/1388380259 learned_addr learned my addr 172.21.15.26:0/1388380259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537effd700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f5380151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537f7fe700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015a300 0x7f53800b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 -- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 msgr2=0x7f5380151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f5380151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 -- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015a300 msgr2=0x7f53800b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015a300 0x7f53800b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.174+0000 7f537e7fc700 1 -- 172.21.15.26:0/1388380259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370009ae0 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f537e7fc700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f536800ec80 tx=0x7f53680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800c850 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800c9b0 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538015c400 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800cd50 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.175+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538015c6e0 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.176+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53800c6a80 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.176+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5368013680 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.177+0000 7f5376ffd700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 0x7f5360069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.177+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5368084950 con 0x7f5380068220 2023-10-09T11:41:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.177+0000 7f537effd700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 0x7f5360069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.177+0000 7f537effd700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 0x7f5360069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f53800cccc0 tx=0x7f53780091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.181+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5368051b00 con 0x7f5380068220 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.373+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f538004c3c0 con 0x7f5380068220 2023-10-09T11:41:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.600+0000 7f5376ffd700 1 -- 172.21.15.26:0/1388380259 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v97) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5368055120 con 0x7f5380068220 2023-10-09T11:41:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 msgr2=0x7f5360069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 0x7f5360069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f53800cccc0 tx=0x7f53780091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 msgr2=0x7f53800b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f536800ec80 tx=0x7f53680091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 shutdown_connections 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015a300 0x7f53800b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5360067290 0x7f5360069740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5380067e50 0x7f5380151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 --2- 172.21.15.26:0/1388380259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5380068220 0x7f53800b1250 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 >> 172.21.15.26:0/1388380259 conn(0x7f53800ce4a0 msgr2=0x7f53800c8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 shutdown_connections 2023-10-09T11:41:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.604+0000 7f5385437700 1 -- 172.21.15.26:0/1388380259 wait complete. 2023-10-09T11:41:28.607 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:41:28.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:41:28.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.745+0000 7f98de978700 1 Processor -- start 2023-10-09T11:41:28.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.745+0000 7f98de978700 1 -- start start 2023-10-09T11:41:28.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de978700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de978700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98d80cf110 0x7f98d815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de978700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d815afd0 con 0x7f98d815de50 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de978700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d815b2b0 con 0x7f98d80cf110 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de978700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d815b590 con 0x7f98d8153c30 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de177700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98d80cf110 0x7f98d815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98dd976700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98dd976700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:39646/0 (socket says 172.21.15.26:39646) 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98de177700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98d80cf110 0x7f98d815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:54146/0 (socket says 172.21.15.26:54146) 2023-10-09T11:41:28.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.746+0000 7f98dd976700 1 -- 172.21.15.26:0/2633526052 learned_addr learned my addr 172.21.15.26:0/2633526052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98de177700 1 -- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 msgr2=0x7f98d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98de177700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98de177700 1 -- 172.21.15.26:0/2633526052 >> v1:172.21.15.67:6789/0 conn(0x7f98d815de50 legacy=0x7f98d80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98de177700 1 -- 172.21.15.26:0/2633526052 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d815b870 con 0x7f98d80cf110 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98dd976700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98de177700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d815c070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009e60 tx=0x7f98c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59eddefcb7df4efa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98dc974700 1 -- 172.21.15.26:0/2633526052 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800e070 con 0x7f98d80cf110 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98dc974700 1 -- 172.21.15.26:0/2633526052 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800bb60 con 0x7f98d80cf110 2023-10-09T11:41:28.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.747+0000 7f98dc974700 1 -- 172.21.15.26:0/2633526052 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8012430 con 0x7f98d80cf110 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 -- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 msgr2=0x7f98d815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d815c070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009e60 tx=0x7f98c8009780 comp rx=0 tx=0).stop 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 -- 172.21.15.26:0/2633526052 shutdown_connections 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d815c070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 --2- 172.21.15.26:0/2633526052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 -- 172.21.15.26:0/2633526052 >> 172.21.15.26:0/2633526052 conn(0x7f98d80703a0 msgr2=0x7f98d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 -- 172.21.15.26:0/2633526052 shutdown_connections 2023-10-09T11:41:28.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.748+0000 7f98de978700 1 -- 172.21.15.26:0/2633526052 wait complete. 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.749+0000 7f98de978700 1 Processor -- start 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.749+0000 7f98de978700 1 -- start start 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c8c40 con 0x7f98d815de50 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81534a0 con 0x7f98d80cf110 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de978700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c8030 con 0x7f98d8153c30 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53148/0 (socket says 172.21.15.26:53148) 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 -- 172.21.15.26:0/3787426422 learned_addr learned my addr 172.21.15.26:0/3787426422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98dd976700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98dd175700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 -- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 msgr2=0x7f98d80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 -- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 msgr2=0x7f98d8152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d8152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 -- 172.21.15.26:0/3787426422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00094f0 con 0x7f98d815de50 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98de177700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f98d806eb00 tx=0x7f98c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.750+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8012ea0 con 0x7f98d815de50 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.751+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8027470 con 0x7f98d815de50 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.751+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8027850 con 0x7f98d815de50 2023-10-09T11:41:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.751+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c8009a20 con 0x7f98d815de50 2023-10-09T11:41:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.751+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80c85f0 con 0x7f98d815de50 2023-10-09T11:41:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.752+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80c8db0 con 0x7f98d815de50 2023-10-09T11:41:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.752+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f98c8024070 con 0x7f98d815de50 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.753+0000 7f98d5ffb700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 0x7f98c4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.753+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f98c80872f0 con 0x7f98d815de50 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.753+0000 7f98dd976700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 0x7f98c4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.754+0000 7f98dd976700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 0x7f98c4069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f98d0006d20 tx=0x7f98d0009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.758+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98c8054330 con 0x7f98d815de50 2023-10-09T11:41:28.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:28.952+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f98d804c3c0 con 0x7f98d815de50 2023-10-09T11:41:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.608+0000 7f98d5ffb700 1 -- 172.21.15.26:0/3787426422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v98) v1 ==== 170+0+0 (secure 0 0 0) 0x7f98c8057950 con 0x7f98d815de50 2023-10-09T11:41:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.614+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 msgr2=0x7f98c4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.614+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 0x7f98c4069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f98d0006d20 tx=0x7f98d0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.614+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 msgr2=0x7f98d80b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.614+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f98d806eb00 tx=0x7f98c8019000 comp rx=0 tx=0).stop 2023-10-09T11:41:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 shutdown_connections 2023-10-09T11:41:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98d815de50 0x7f98d80b39d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98d80cf110 0x7f98d8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f98c4067290 0x7f98c4069740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 --2- 172.21.15.26:0/3787426422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f98d8153c30 0x7f98d80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.617+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 >> 172.21.15.26:0/3787426422 conn(0x7f98d80703a0 msgr2=0x7f98d80b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.619+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 shutdown_connections 2023-10-09T11:41:29.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.628+0000 7f98de978700 1 -- 172.21.15.26:0/3787426422 wait complete. 2023-10-09T11:41:29.631 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:41:29.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:41:29.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.771+0000 7f0e574ee700 1 Processor -- start 2023-10-09T11:41:29.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.771+0000 7f0e574ee700 1 -- start start 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e574ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e50159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e574ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e500ccfd0 con 0x7f0e50159530 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e574ee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5015a3d0 con 0x7f0e5006e0e0 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e574ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5015a6b0 con 0x7f0e5006dc70 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e5528a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0e50159530 0x7f0e500ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38512/0 (socket says 172.21.15.26:38512) 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e5528a700 1 -- 172.21.15.26:0/3092943682 learned_addr learned my addr 172.21.15.26:0/3092943682 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e54a89700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e50159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342749173 0 0) 0x7f0e500ccfd0 con 0x7f0e50159530 2023-10-09T11:41:29.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e38003570 con 0x7f0e50159530 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1561097487 0 0) 0x7f0e38003570 con 0x7f0e50159530 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 msgr2=0x7f0e50159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e50159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 >> v1:172.21.15.67:6789/0 conn(0x7f0e5006e0e0 legacy=0x7f0e500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5015a990 con 0x7f0e50159530 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f0e48001470 con 0x7f0e50159530 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 >> v1:172.21.15.26:6789/0 conn(0x7f0e50159530 legacy=0x7f0e500ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e38003a90 0x7f0e38003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e38004d50 0x7f0e380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.772+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5015a6b0 con 0x7f0e38004d50 2023-10-09T11:41:29.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800bb70 con 0x7f0e38003a90 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800bd30 con 0x7f0e5006dc70 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e38004d50 0x7f0e380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e5528a700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e38003a90 0x7f0e38003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e54a89700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 -- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 msgr2=0x7f0e38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e5006dc70 0x7f0e38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 -- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e38003a90 msgr2=0x7f0e38003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e38003a90 0x7f0e38003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 -- 172.21.15.26:0/3092943682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38003570 con 0x7f0e38004d50 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e38004d50 0x7f0e380051c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0e40001fc0 tx=0x7f0e40001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce01686644fb26d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40001980 con 0x7f0e38004d50 2023-10-09T11:41:29.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000c8b0 con 0x7f0e38004d50 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.773+0000 7f0e4ffff700 1 -- 172.21.15.26:0/3092943682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000cc50 con 0x7f0e38004d50 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 -- 172.21.15.26:0/3092943682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e38004d50 msgr2=0x7f0e380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 --2- 172.21.15.26:0/3092943682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e38004d50 0x7f0e380051c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0e40001fc0 tx=0x7f0e40001670 comp rx=0 tx=0).stop 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e55a8b700 1 -- 172.21.15.26:0/3092943682 reap_dead start 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 -- 172.21.15.26:0/3092943682 shutdown_connections 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 -- 172.21.15.26:0/3092943682 >> 172.21.15.26:0/3092943682 conn(0x7f0e500703a0 msgr2=0x7f0e500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 -- 172.21.15.26:0/3092943682 shutdown_connections 2023-10-09T11:41:29.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.774+0000 7f0e574ee700 1 -- 172.21.15.26:0/3092943682 wait complete. 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.775+0000 7f0e574ee700 1 Processor -- start 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.775+0000 7f0e574ee700 1 -- start start 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 0x7f0e500b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e500b5c60 0x7f0e500c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50151c20 con 0x7f0e500c7cd0 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5014d840 con 0x7f0e5014d470 2023-10-09T11:41:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e574ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50151360 con 0x7f0e500b5c60 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59556/0 (socket says 172.21.15.26:59556) 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 -- 172.21.15.26:0/122500739 learned_addr learned my addr 172.21.15.26:0/122500739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e54a89700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e500b5c60 0x7f0e500c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e5528a700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 0x7f0e500b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 -- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e500b5c60 msgr2=0x7f0e500c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e500b5c60 0x7f0e500c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 -- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 msgr2=0x7f0e500b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 0x7f0e500b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 -- 172.21.15.26:0/122500739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e501515d0 con 0x7f0e500c7cd0 2023-10-09T11:41:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e5528a700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 0x7f0e500b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.776+0000 7f0e55a8b700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c6a0 tx=0x7f0e40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000c6d0 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000ca20 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e501518b0 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40006ba0 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50154280 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.777+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50151a40 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.778+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0e40019070 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.778+0000 7f0e4d7fa700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 0x7f0e3c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.778+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0e40086010 con 0x7f0e500c7cd0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.779+0000 7f0e5528a700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 0x7f0e3c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.779+0000 7f0e5528a700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 0x7f0e3c069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000e10 tx=0x7f0e48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:29.783+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e40052f80 con 0x7f0e500c7cd0 2023-10-09T11:41:30.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.021+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0e5004c3c0 con 0x7f0e500c7cd0 2023-10-09T11:41:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.609+0000 7f0e4d7fa700 1 -- 172.21.15.26:0/122500739 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0e40017020 con 0x7f0e500c7cd0 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.616+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 msgr2=0x7f0e3c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.616+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 0x7f0e3c069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000e10 tx=0x7f0e48009040 comp rx=0 tx=0).stop 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.616+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 msgr2=0x7f0e500b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.616+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c6a0 tx=0x7f0e40015000 comp rx=0 tx=0).stop 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 shutdown_connections 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e500c7cd0 0x7f0e500b1290 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e5014d470 0x7f0e500b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0e3c067290 0x7f0e3c069740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 --2- 172.21.15.26:0/122500739 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0e500b5c60 0x7f0e500c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 >> 172.21.15.26:0/122500739 conn(0x7f0e500703a0 msgr2=0x7f0e5015c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.617+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 shutdown_connections 2023-10-09T11:41:30.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.618+0000 7f0e574ee700 1 -- 172.21.15.26:0/122500739 wait complete. 2023-10-09T11:41:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T11:41:30.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:30.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.751+0000 7f3062b01700 1 Processor -- start 2023-10-09T11:41:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.751+0000 7f3062b01700 1 -- start start 2023-10-09T11:41:30.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f3062b01700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f305c0cb5a0 0x7f305c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f3062b01700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c15ae40 con 0x7f305c0cd9e0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f3062b01700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c15ab60 con 0x7f305c15a5d0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f3062b01700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0d13f0 con 0x7f305c0cb5a0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f305bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f305c0cd9e0 0x7f305c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38514/0 (socket says 172.21.15.26:38514) 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f305bfff700 1 -- 172.21.15.26:0/1570853402 learned_addr learned my addr 172.21.15.26:0/1570853402 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.752+0000 7f306089d700 1 --2- 172.21.15.26:0/1570853402 >> v2:172.21.15.67:3300/0 conn(0x7f305c0cb5a0 0x7f305c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049373821 0 0) 0x7f305c15ae40 con 0x7f305c0cd9e0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f304c003570 con 0x7f305c0cd9e0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668392539 0 0) 0x7f304c003570 con 0x7f305c0cd9e0 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 >> v2:172.21.15.67:3300/0 conn(0x7f305c0cb5a0 msgr2=0x7f305c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 --2- 172.21.15.26:0/1570853402 >> v2:172.21.15.67:3300/0 conn(0x7f305c0cb5a0 0x7f305c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 >> v1:172.21.15.67:6789/0 conn(0x7f305c15a5d0 legacy=0x7f305c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0ccf00 con 0x7f305c0cd9e0 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3048001470 con 0x7f305c0cd9e0 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306089d700 1 --2- 172.21.15.26:0/1570853402 >> v2:172.21.15.67:3300/0 conn(0x7f305c0cb5a0 0x7f305c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 >> v1:172.21.15.26:6789/0 conn(0x7f305c0cd9e0 legacy=0x7f305c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c003a60 0x7f304c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f304c004810 0x7f304c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 0x7f304c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c00c0a0 con 0x7f304c0051c0 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c00c210 con 0x7f304c003a60 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c00c3d0 con 0x7f304c004810 2023-10-09T11:41:30.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 0x7f304c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306089d700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c003a60 0x7f304c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305bfff700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f304c004810 0x7f304c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 -- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f304c004810 msgr2=0x7f304c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f304c004810 0x7f304c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 -- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c003a60 msgr2=0x7f304c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c003a60 0x7f304c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 -- 172.21.15.26:0/1570853402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c003570 con 0x7f304c0051c0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f305bfff700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f304c004810 0x7f304c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.753+0000 7f306109e700 1 -- 172.21.15.26:0/1570853402 reap_dead start 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f306109e700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 0x7f304c00ba60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3054001fc0 tx=0x7f3054001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc63abe8b5f2598 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054001950 con 0x7f304c0051c0 2023-10-09T11:41:30.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305400c8b0 con 0x7f304c0051c0 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f305b7fe700 1 -- 172.21.15.26:0/1570853402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400cc50 con 0x7f304c0051c0 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 -- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 msgr2=0x7f304c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 0x7f304c00ba60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3054001fc0 tx=0x7f3054001640 comp rx=0 tx=0).stop 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 -- 172.21.15.26:0/1570853402 shutdown_connections 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 --2- 172.21.15.26:0/1570853402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f304c0051c0 0x7f304c00ba60 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 -- 172.21.15.26:0/1570853402 >> 172.21.15.26:0/1570853402 conn(0x7f305c070e30 msgr2=0x7f305c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 -- 172.21.15.26:0/1570853402 shutdown_connections 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.754+0000 7f3062b01700 1 -- 172.21.15.26:0/1570853402 wait complete. 2023-10-09T11:41:30.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.755+0000 7f3062b01700 1 Processor -- start 2023-10-09T11:41:30.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 -- start start 2023-10-09T11:41:30.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c0051c0 0x7f305c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 0x7f305c16a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c153a60 con 0x7f305c153080 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0c77c0 con 0x7f304c0051c0 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f3062b01700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c1518f0 con 0x7f305c150ac0 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f306109e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f306109e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59568/0 (socket says 172.21.15.26:59568) 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.756+0000 7f306109e700 1 -- 172.21.15.26:0/3495492448 learned_addr learned my addr 172.21.15.26:0/3495492448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306089d700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c0051c0 0x7f305c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f305bfff700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 0x7f305c16a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 -- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 msgr2=0x7f305c16a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 0x7f305c16a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 -- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c0051c0 msgr2=0x7f305c151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c0051c0 0x7f305c151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 -- 172.21.15.26:0/3495492448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0c7a60 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f305bfff700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 0x7f305c16a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f306109e700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f305400c6a0 tx=0x7f3054015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054001950 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054006ba0 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c0b5370 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305401d420 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.757+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c0b5610 con 0x7f305c153080 2023-10-09T11:41:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.758+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c150e90 con 0x7f305c153080 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.759+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3054007030 con 0x7f305c153080 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.759+0000 7f3058ff9700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 0x7f3040069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.759+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3054085840 con 0x7f305c153080 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.759+0000 7f306089d700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 0x7f3040069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.760+0000 7f306089d700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 0x7f3040069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3050006f00 tx=0x7f3050008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.764+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3054052650 con 0x7f305c153080 2023-10-09T11:41:30.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.957+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f305c0c7bf0 con 0x7f305c153080 2023-10-09T11:41:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.958+0000 7f3058ff9700 1 -- 172.21.15.26:0/3495492448 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f3054055c70 con 0x7f305c153080 2023-10-09T11:41:30.960 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:30.960 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":99,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:30.023108+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 msgr2=0x7f3040069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 0x7f3040069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3050006f00 tx=0x7f3050008040 comp rx=0 tx=0).stop 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 msgr2=0x7f305c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f305400c6a0 tx=0x7f3054015000 comp rx=0 tx=0).stop 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 shutdown_connections 2023-10-09T11:41:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f305c153080 0x7f305c153520 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f304c0051c0 0x7f305c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3040067290 0x7f3040069740 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 --2- 172.21.15.26:0/3495492448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f305c150ac0 0x7f305c16a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 >> 172.21.15.26:0/3495492448 conn(0x7f305c070e30 msgr2=0x7f305c1540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.960+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 shutdown_connections 2023-10-09T11:41:30.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:30.961+0000 7f3062b01700 1 -- 172.21.15.26:0/3495492448 wait complete. 2023-10-09T11:41:30.974 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:31.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.092+0000 7f8a7b2d2700 1 Processor -- start 2023-10-09T11:41:31.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.092+0000 7f8a7b2d2700 1 -- start start 2023-10-09T11:41:31.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7b2d2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a740cb5a0 0x7f8a740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7b2d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7415ae40 con 0x7f8a7415a5d0 2023-10-09T11:41:31.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7b2d2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7415ab60 con 0x7f8a740cd9e0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7b2d2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740d13f0 con 0x7f8a740cb5a0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7986f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a7415a5d0 0x7f8a74156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38526/0 (socket says 172.21.15.26:38526) 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7986f700 1 -- 172.21.15.26:0/1355550570 learned_addr learned my addr 172.21.15.26:0/1355550570 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1355550570 >> v2:172.21.15.67:3300/0 conn(0x7f8a740cb5a0 0x7f8a740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006764297 0 0) 0x7f8a7415ae40 con 0x7f8a7415a5d0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a5c003570 con 0x7f8a7415a5d0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963405736 0 0) 0x7f8a5c003570 con 0x7f8a7415a5d0 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 >> v2:172.21.15.67:3300/0 conn(0x7f8a740cb5a0 msgr2=0x7f8a740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 --2- 172.21.15.26:0/1355550570 >> v2:172.21.15.67:3300/0 conn(0x7f8a740cb5a0 0x7f8a740cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 >> v1:172.21.15.67:6789/0 conn(0x7f8a740cd9e0 legacy=0x7f8a74159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740ccf00 con 0x7f8a7415a5d0 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f8a6c001470 con 0x7f8a7415a5d0 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.093+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 >> v1:172.21.15.26:6789/0 conn(0x7f8a7415a5d0 legacy=0x7f8a74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a5c003a60 0x7f8a5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 0x7f8a5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c0051c0 0x7f8a5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c00c0a0 con 0x7f8a5c004810 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c00c210 con 0x7f8a5c003a60 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c00c3d0 con 0x7f8a5c0051c0 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 0x7f8a5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a5c003a60 0x7f8a5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7986f700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c0051c0 0x7f8a5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 -- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c0051c0 msgr2=0x7f8a5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c0051c0 0x7f8a5c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 -- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a5c003a60 msgr2=0x7f8a5c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a5c003a60 0x7f8a5c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 -- 172.21.15.26:0/1355550570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c003570 con 0x7f8a5c004810 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7986f700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c0051c0 0x7f8a5c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a5c003a60 0x7f8a5c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7986f700 1 -- 172.21.15.26:0/1355550570 reap_dead start 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 0x7f8a5c004c80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8a680018b0 tx=0x7f8a68007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ec1420248a8963 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68012420 con 0x7f8a5c004810 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680125a0 con 0x7f8a5c004810 2023-10-09T11:41:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.094+0000 7f8a73fff700 1 -- 172.21.15.26:0/1355550570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68012960 con 0x7f8a5c004810 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 msgr2=0x7f8a5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 0x7f8a5c004c80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8a680018b0 tx=0x7f8a68007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1355550570 shutdown_connections 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1355550570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a5c004810 0x7f8a5c004c80 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1355550570 >> 172.21.15.26:0/1355550570 conn(0x7f8a74070e30 msgr2=0x7f8a740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1355550570 shutdown_connections 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.095+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1355550570 wait complete. 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.096+0000 7f8a7b2d2700 1 Processor -- start 2023-10-09T11:41:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.096+0000 7f8a7b2d2700 1 -- start start 2023-10-09T11:41:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c004810 0x7f8a741512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a7415ca00 0x7f8a740c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b6490 con 0x7f8a740b5670 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a741517f0 con 0x7f8a7415ca00 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7b2d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b5bf0 con 0x7f8a5c004810 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59574/0 (socket says 172.21.15.26:59574) 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 -- 172.21.15.26:0/1327223136 learned_addr learned my addr 172.21.15.26:0/1327223136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c004810 0x7f8a741512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7986f700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a7415ca00 0x7f8a740c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 -- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c004810 msgr2=0x7f8a741512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c004810 0x7f8a741512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 -- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a7415ca00 msgr2=0x7f8a740c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a7415ca00 0x7f8a740c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.097+0000 7f8a7886d700 1 -- 172.21.15.26:0/1327223136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740b5ed0 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a7886d700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00c1e0 tx=0x7f8a68015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800c800 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6800c960 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800cd00 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740b61b0 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.098+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a740c6dd0 con 0x7f8a740b5670 2023-10-09T11:41:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.099+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a741697b0 con 0x7f8a740b5670 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.099+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f8a6801f620 con 0x7f8a740b5670 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.100+0000 7f8a717fa700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 0x7f8a60069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.100+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a68086380 con 0x7f8a740b5670 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.100+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 0x7f8a60069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.101+0000 7f8a7906e700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 0x7f8a60069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a740897e0 tx=0x7f8a6400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.104+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a741697b0 con 0x7f8a740b5670 2023-10-09T11:41:31.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.303+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a741697b0 con 0x7f8a740b5670 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.304+0000 7f8a717fa700 1 -- 172.21.15.26:0/1327223136 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15307 (secure 0 0 0) 0x7f8a741697b0 con 0x7f8a740b5670 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":100,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:31.191074+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 msgr2=0x7f8a60069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 0x7f8a60069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a740897e0 tx=0x7f8a6400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 msgr2=0x7f8a7415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00c1e0 tx=0x7f8a68015000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 shutdown_connections 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a7415ca00 0x7f8a740c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8a60067290 0x7f8a60069740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a5c004810 0x7f8a741512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 --2- 172.21.15.26:0/1327223136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a740b5670 0x7f8a7415c4c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 >> 172.21.15.26:0/1327223136 conn(0x7f8a74070e30 msgr2=0x7f8a74155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 shutdown_connections 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.306+0000 7f8a7b2d2700 1 -- 172.21.15.26:0/1327223136 wait complete. 2023-10-09T11:41:31.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:41:31.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.440+0000 7ffa1e48f700 1 Processor -- start 2023-10-09T11:41:31.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.440+0000 7ffa1e48f700 1 -- start start 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.440+0000 7ffa1e48f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1e48f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa1806dc70 0x7ffa18159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1e48f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa180ccfd0 con 0x7ffa1806e0e0 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1e48f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180cf0e0 con 0x7ffa1806dc70 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1e48f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1815a3d0 con 0x7ffa18159530 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1ca2c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa1806e0e0 0x7ffa180cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38540/0 (socket says 172.21.15.26:38540) 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/3495245690 learned_addr learned my addr 172.21.15.26:0/3495245690 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:31.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333530380 0 0) 0x7ffa180ccfd0 con 0x7ffa1806e0e0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003570 con 0x7ffa1806e0e0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa177fe700 1 --2- 172.21.15.26:0/3495245690 >> v2:172.21.15.67:3300/0 conn(0x7ffa1806dc70 0x7ffa18159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa17fff700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187027717 0 0) 0x7ffa00003570 con 0x7ffa1806e0e0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 msgr2=0x7ffa180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa180ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 >> v2:172.21.15.67:3300/0 conn(0x7ffa1806dc70 msgr2=0x7ffa18159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 --2- 172.21.15.26:0/3495245690 >> v2:172.21.15.67:3300/0 conn(0x7ffa1806dc70 0x7ffa18159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1815a6b0 con 0x7ffa1806e0e0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ffa100017f0 con 0x7ffa1806e0e0 2023-10-09T11:41:31.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 >> v1:172.21.15.26:6789/0 conn(0x7ffa1806e0e0 legacy=0x7ffa180cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa00003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa00003fe0 0x7ffa00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa00004d50 0x7ffa000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180cf0e0 con 0x7ffa00004d50 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1815a3d0 con 0x7ffa00003fe0 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0000ba90 con 0x7ffa18159530 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.441+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa00004d50 0x7ffa000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa177fe700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa00003fe0 0x7ffa00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa17fff700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa00003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 msgr2=0x7ffa00003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa18159530 0x7ffa00003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa00003fe0 msgr2=0x7ffa00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa00003fe0 0x7ffa00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/3495245690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00003570 con 0x7ffa00004d50 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa00004d50 0x7ffa000051c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a940 tx=0x7ffa10002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec8827600b97fee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10012440 con 0x7ffa00004d50 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100125a0 con 0x7ffa00004d50 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.442+0000 7ffa16ffd700 1 -- 172.21.15.26:0/3495245690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10012960 con 0x7ffa00004d50 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 -- 172.21.15.26:0/3495245690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa00004d50 msgr2=0x7ffa000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/3495245690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa00004d50 0x7ffa000051c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a940 tx=0x7ffa10002210 comp rx=0 tx=0).stop 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/3495245690 reap_dead start 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 -- 172.21.15.26:0/3495245690 shutdown_connections 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 -- 172.21.15.26:0/3495245690 >> 172.21.15.26:0/3495245690 conn(0x7ffa180703a0 msgr2=0x7ffa180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 -- 172.21.15.26:0/3495245690 shutdown_connections 2023-10-09T11:41:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.443+0000 7ffa1e48f700 1 -- 172.21.15.26:0/3495245690 wait complete. 2023-10-09T11:41:31.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.444+0000 7ffa1e48f700 1 Processor -- start 2023-10-09T11:41:31.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.444+0000 7ffa1e48f700 1 -- start start 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa180c96f0 0x7ffa180c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa180b43a0 0x7ffa1814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180b4810 con 0x7ffa180b5f50 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180b4af0 con 0x7ffa180b43a0 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180b4dd0 con 0x7ffa180c96f0 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59594/0 (socket says 172.21.15.26:59594) 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/1547970519 learned_addr learned my addr 172.21.15.26:0/1547970519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa17fff700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa180c96f0 0x7ffa180c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa177fe700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa180b43a0 0x7ffa1814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa180c96f0 msgr2=0x7ffa180c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa180c96f0 0x7ffa180c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa180b43a0 msgr2=0x7ffa1814cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa180b43a0 0x7ffa1814cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 -- 172.21.15.26:0/1547970519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1814e800 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1ca2c700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a000 tx=0x7ffa10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10023070 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100017b0 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1814e4d0 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10012440 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.445+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa180b3640 con 0x7ffa180b5f50 2023-10-09T11:41:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.446+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1804c3c0 con 0x7ffa180b5f50 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.447+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ffa10019030 con 0x7ffa180b5f50 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.447+0000 7ff9fffff700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 0x7ffa04069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.448+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa100864d0 con 0x7ffa180b5f50 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.448+0000 7ffa17fff700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 0x7ffa04069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.448+0000 7ffa17fff700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 0x7ffa04069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006f00 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.452+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa100533e0 con 0x7ffa180b5f50 2023-10-09T11:41:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:31.692+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffa1815a990 con 0x7ffa180b5f50 2023-10-09T11:41:32.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.624+0000 7ff9fffff700 1 -- 172.21.15.26:0/1547970519 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffa10056a00 con 0x7ffa180b5f50 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 msgr2=0x7ffa04069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 0x7ffa04069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006f00 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 msgr2=0x7ffa1814d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a000 tx=0x7ffa10015000 comp rx=0 tx=0).stop 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 shutdown_connections 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa180b5f50 0x7ffa1814d430 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa04067290 0x7ffa04069740 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa180c96f0 0x7ffa180c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 --2- 172.21.15.26:0/1547970519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa180b43a0 0x7ffa1814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 >> 172.21.15.26:0/1547970519 conn(0x7ffa180703a0 msgr2=0x7ffa180b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 shutdown_connections 2023-10-09T11:41:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.627+0000 7ffa1e48f700 1 -- 172.21.15.26:0/1547970519 wait complete. 2023-10-09T11:41:32.643 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:41:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.771+0000 7fe563c08700 1 Processor -- start 2023-10-09T11:41:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.771+0000 7fe563c08700 1 -- start start 2023-10-09T11:41:32.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe563c08700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe55c06dc70 0x7fe55c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe563c08700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0ccfd0 con 0x7fe55c06e0e0 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe563c08700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c15a3d0 con 0x7fe55c159530 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe563c08700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c15a6b0 con 0x7fe55c06dc70 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe5621a5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe55c06e0e0 0x7fe55c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38554/0 (socket says 172.21.15.26:38554) 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe5621a5700 1 -- 172.21.15.26:0/1258220291 learned_addr learned my addr 172.21.15.26:0/1258220291 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.772+0000 7fe5611a3700 1 --2- 172.21.15.26:0/1258220291 >> v2:172.21.15.67:3300/0 conn(0x7fe55c06dc70 0x7fe55c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633580975 0 0) 0x7fe55c0ccfd0 con 0x7fe55c06e0e0 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe544003570 con 0x7fe55c06e0e0 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5611a3700 1 -- 172.21.15.26:0/1258220291 >> v1:172.21.15.67:6789/0 conn(0x7fe55c159530 legacy=0x7fe55c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5611a3700 1 -- 172.21.15.26:0/1258220291 >> v1:172.21.15.26:6789/0 conn(0x7fe55c06e0e0 legacy=0x7fe55c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3949638776 0 0) 0x7fe544003570 con 0x7fe55c06e0e0 2023-10-09T11:41:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5611a3700 1 -- 172.21.15.26:0/1258220291 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c15a990 con 0x7fe55c06dc70 2023-10-09T11:41:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5611a3700 1 --2- 172.21.15.26:0/1258220291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c06dc70 0x7fe55c159900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5500098e0 tx=0x7fe5500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ed317b2ae518e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0017f0 con 0x7fe55c06dc70 2023-10-09T11:41:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550011420 con 0x7fe55c06dc70 2023-10-09T11:41:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.773+0000 7fe5609a2700 1 -- 172.21.15.26:0/1258220291 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500117c0 con 0x7fe55c06dc70 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 -- 172.21.15.26:0/1258220291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c06dc70 msgr2=0x7fe55c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 --2- 172.21.15.26:0/1258220291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c06dc70 0x7fe55c159900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5500098e0 tx=0x7fe5500091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 -- 172.21.15.26:0/1258220291 shutdown_connections 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 --2- 172.21.15.26:0/1258220291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c06dc70 0x7fe55c159900 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 -- 172.21.15.26:0/1258220291 >> 172.21.15.26:0/1258220291 conn(0x7fe55c0703a0 msgr2=0x7fe55c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 -- 172.21.15.26:0/1258220291 shutdown_connections 2023-10-09T11:41:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.774+0000 7fe563c08700 1 -- 172.21.15.26:0/1258220291 wait complete. 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.775+0000 7fe563c08700 1 Processor -- start 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.775+0000 7fe563c08700 1 -- start start 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe55c06e0e0 0x7fe55c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 0x7fe55c0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1476b0 con 0x7fe55c06dc70 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b4de0 con 0x7fe55c159530 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe563c08700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b5080 con 0x7fe55c06e0e0 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59598/0 (socket says 172.21.15.26:59598) 2023-10-09T11:41:32.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 -- 172.21.15.26:0/1278519120 learned_addr learned my addr 172.21.15.26:0/1278519120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5621a5700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 0x7fe55c0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5611a3700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe55c06e0e0 0x7fe55c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 -- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe55c06e0e0 msgr2=0x7fe55c0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe55c06e0e0 0x7fe55c0b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 -- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 msgr2=0x7fe55c0b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 0x7fe55c0b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 -- 172.21.15.26:0/1278519120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550009420 con 0x7fe55c06dc70 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5621a5700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 0x7fe55c0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe5619a4700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c590 tx=0x7fe55400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.776+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554011590 con 0x7fe55c06dc70 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.777+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540116f0 con 0x7fe55c06dc70 2023-10-09T11:41:32.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.777+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c0b5360 con 0x7fe55c06dc70 2023-10-09T11:41:32.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.777+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554011ab0 con 0x7fe55c06dc70 2023-10-09T11:41:32.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.777+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c169e60 con 0x7fe55c06dc70 2023-10-09T11:41:32.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.778+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c0b5950 con 0x7fe55c06dc70 2023-10-09T11:41:32.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.778+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe55401b3b0 con 0x7fe55c06dc70 2023-10-09T11:41:32.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.779+0000 7fe559ffb700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 0x7fe548069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.779+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe554084060 con 0x7fe55c06dc70 2023-10-09T11:41:32.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.779+0000 7fe5611a3700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 0x7fe548069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.779+0000 7fe5611a3700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 0x7fe548069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe55c15b450 tx=0x7fe550016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:32.783+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe554050e80 con 0x7fe55c06dc70 2023-10-09T11:41:33.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.020+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe55c04c3c0 con 0x7fe55c06dc70 2023-10-09T11:41:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.629+0000 7fe559ffb700 1 -- 172.21.15.26:0/1278519120 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe554017020 con 0x7fe55c06dc70 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 msgr2=0x7fe548069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 0x7fe548069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe55c15b450 tx=0x7fe550016000 comp rx=0 tx=0).stop 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 msgr2=0x7fe55c147170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c590 tx=0x7fe55400c950 comp rx=0 tx=0).stop 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 shutdown_connections 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe55c159530 0x7fe55c0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c06dc70 0x7fe55c147170 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe548067290 0x7fe548069740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 --2- 172.21.15.26:0/1278519120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe55c06e0e0 0x7fe55c0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 >> 172.21.15.26:0/1278519120 conn(0x7fe55c0703a0 msgr2=0x7fe55c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 shutdown_connections 2023-10-09T11:41:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.631+0000 7fe563c08700 1 -- 172.21.15.26:0/1278519120 wait complete. 2023-10-09T11:41:33.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.768+0000 7f457b31c700 1 Processor -- start 2023-10-09T11:41:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 -- start start 2023-10-09T11:41:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45740a8d00 0x7f45740cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f45740af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45740aeee0 con 0x7f45740a90d0 2023-10-09T11:41:33.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45740ae680 con 0x7f45740a8d00 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f457b31c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45740cf490 con 0x7f457406e550 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f45788b7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45740a90d0 0x7f457406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38558/0 (socket says 172.21.15.26:38558) 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.769+0000 7f45788b7700 1 -- 172.21.15.26:0/168350283 learned_addr learned my addr 172.21.15.26:0/168350283 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f45798b9700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f45740af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f45790b8700 1 --2- 172.21.15.26:0/168350283 >> v2:172.21.15.67:3300/0 conn(0x7f45740a8d00 0x7f45740cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031807267 0 0) 0x7f45740aeee0 con 0x7f45740a90d0 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c003570 con 0x7f45740a90d0 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712402504 0 0) 0x7f455c003570 con 0x7f45740a90d0 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 msgr2=0x7f45740af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f45740af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 >> v2:172.21.15.67:3300/0 conn(0x7f45740a8d00 msgr2=0x7f45740cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 --2- 172.21.15.26:0/168350283 >> v2:172.21.15.67:3300/0 conn(0x7f45740a8d00 0x7f45740cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740ce330 con 0x7f45740a90d0 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f45680015f0 con 0x7f45740a90d0 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 >> v1:172.21.15.26:6789/0 conn(0x7f45740a90d0 legacy=0x7f457406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c003a60 0x7f455c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c004810 0x7f455c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f455c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740ae680 con 0x7f455c003a60 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740cf490 con 0x7f455c004810 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c00ba60 con 0x7f457406e550 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f45790b8700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c003a60 0x7f455c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f45788b7700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c004810 0x7f455c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.770+0000 7f45798b9700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f455c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 -- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 msgr2=0x7f455c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457406e550 0x7f455c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 -- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c004810 msgr2=0x7f455c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c004810 0x7f455c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 -- 172.21.15.26:0/168350283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c003570 con 0x7f455c003a60 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45790b8700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c003a60 0x7f455c003e70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f456c009c20 tx=0x7f456c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0449d59705e424 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c005a00 con 0x7f455c003a60 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c005b60 con 0x7f455c003a60 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f4573fff700 1 -- 172.21.15.26:0/168350283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c00e710 con 0x7f455c003a60 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f457b31c700 1 -- 172.21.15.26:0/168350283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c003a60 msgr2=0x7f455c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f457b31c700 1 --2- 172.21.15.26:0/168350283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c003a60 0x7f455c003e70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f456c009c20 tx=0x7f456c009120 comp rx=0 tx=0).stop 2023-10-09T11:41:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f45798b9700 1 -- 172.21.15.26:0/168350283 reap_dead start 2023-10-09T11:41:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f457b31c700 1 -- 172.21.15.26:0/168350283 shutdown_connections 2023-10-09T11:41:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.771+0000 7f457b31c700 1 -- 172.21.15.26:0/168350283 >> 172.21.15.26:0/168350283 conn(0x7f457406ce80 msgr2=0x7f45740ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.772+0000 7f457b31c700 1 -- 172.21.15.26:0/168350283 shutdown_connections 2023-10-09T11:41:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.772+0000 7f457b31c700 1 -- 172.21.15.26:0/168350283 wait complete. 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.773+0000 7f457b31c700 1 Processor -- start 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.773+0000 7f457b31c700 1 -- start start 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.773+0000 7f457b31c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c003a60 0x7f457416aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.773+0000 7f457b31c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457415bcf0 0x7f457415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574158590 con 0x7f457416de10 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457415d7b0 con 0x7f455c003a60 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457415c6a0 con 0x7f457415bcf0 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59608/0 (socket says 172.21.15.26:59608) 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 -- 172.21.15.26:0/2254457146 learned_addr learned my addr 172.21.15.26:0/2254457146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45790b8700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c003a60 0x7f457416aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45798b9700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457415bcf0 0x7f457415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 -- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457415bcf0 msgr2=0x7f457415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457415bcf0 0x7f457415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 -- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c003a60 msgr2=0x7f457416aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c003a60 0x7f457416aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 -- 172.21.15.26:0/2254457146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457416c0e0 con 0x7f457416de10 2023-10-09T11:41:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45788b7700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f456800fb80 tx=0x7f4568009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45680072e0 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568007440 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457416e280 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45680057f0 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.774+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457416b7b0 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.775+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457415a0a0 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.776+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4568005c00 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.777+0000 7f45717fa700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 0x7f4560069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.777+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4568085490 con 0x7f457416de10 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.777+0000 7f45790b8700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 0x7f4560069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.778+0000 7f45790b8700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 0x7f4560069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f456c00a010 tx=0x7f456c019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:33.781+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4568052370 con 0x7f457416de10 2023-10-09T11:41:34.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.016+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f457415a0a0 con 0x7f457416de10 2023-10-09T11:41:34.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.017+0000 7f45717fa700 1 -- 172.21.15.26:0/2254457146 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f457415a0a0 con 0x7f457416de10 2023-10-09T11:41:34.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:34.019 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 msgr2=0x7f4560069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 0x7f4560069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f456c00a010 tx=0x7f456c019000 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 msgr2=0x7f457414a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f456800fb80 tx=0x7f4568009040 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 shutdown_connections 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4560067290 0x7f4560069740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f457415bcf0 0x7f457415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f455c003a60 0x7f457416aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 --2- 172.21.15.26:0/2254457146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457416de10 0x7f457414a910 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 >> 172.21.15.26:0/2254457146 conn(0x7f457406ce80 msgr2=0x7f457406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 shutdown_connections 2023-10-09T11:41:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.019+0000 7f457b31c700 1 -- 172.21.15.26:0/2254457146 wait complete. 2023-10-09T11:41:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 67 2023-10-09T11:41:34.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.150+0000 7fb93b59e700 1 Processor -- start 2023-10-09T11:41:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.150+0000 7fb93b59e700 1 -- start start 2023-10-09T11:41:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93b59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 0x7fb93c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 0x7fb93c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93b59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c15afd0 con 0x7fb93c15de50 2023-10-09T11:41:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93b59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c15b2b0 con 0x7fb93c153c30 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c15b590 con 0x7fb93c0cf110 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb939d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb93c15de50 0x7fb93c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38564/0 (socket says 172.21.15.26:38564) 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb939d9b700 1 -- 172.21.15.26:0/1526992438 learned_addr learned my addr 172.21.15.26:0/1526992438 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93a59c700 1 --2- 172.21.15.26:0/1526992438 >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 0x7fb93c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93ad9d700 1 --2- 172.21.15.26:0/1526992438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 0x7fb93c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127473266 0 0) 0x7fb93c15afd0 con 0x7fb93c15de50 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.151+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb928003570 con 0x7fb93c15de50 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93ad9d700 1 -- 172.21.15.26:0/1526992438 >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 msgr2=0x7fb93c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837509991 0 0) 0x7fb928003570 con 0x7fb93c15de50 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93ad9d700 1 --2- 172.21.15.26:0/1526992438 >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 0x7fb93c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93ad9d700 1 -- 172.21.15.26:0/1526992438 >> v1:172.21.15.26:6789/0 conn(0x7fb93c15de50 legacy=0x7fb93c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93ad9d700 1 -- 172.21.15.26:0/1526992438 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c15b870 con 0x7fb93c0cf110 2023-10-09T11:41:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93a59c700 1 --2- 172.21.15.26:0/1526992438 >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 0x7fb93c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93ad9d700 1 --2- 172.21.15.26:0/1526992438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 0x7fb93c15c070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009e60 tx=0x7fb92c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bed3a35575e8f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00e070 con 0x7fb93c0cf110 2023-10-09T11:41:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c00b7a0 con 0x7fb93c0cf110 2023-10-09T11:41:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93959a700 1 -- 172.21.15.26:0/1526992438 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924001470 con 0x7fb93c0cf110 2023-10-09T11:41:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93b59e700 1 -- 172.21.15.26:0/1526992438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 msgr2=0x7fb93c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.152+0000 7fb93b59e700 1 --2- 172.21.15.26:0/1526992438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 0x7fb93c15c070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009e60 tx=0x7fb92c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 -- 172.21.15.26:0/1526992438 shutdown_connections 2023-10-09T11:41:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 --2- 172.21.15.26:0/1526992438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c0cf110 0x7fb93c15c070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 --2- 172.21.15.26:0/1526992438 >> v2:172.21.15.67:3300/0 conn(0x7fb93c153c30 0x7fb93c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 -- 172.21.15.26:0/1526992438 >> 172.21.15.26:0/1526992438 conn(0x7fb93c0703a0 msgr2=0x7fb93c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 -- 172.21.15.26:0/1526992438 shutdown_connections 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.153+0000 7fb93b59e700 1 -- 172.21.15.26:0/1526992438 wait complete. 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 Processor -- start 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 -- start start 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb93c153c30 0x7fb93c0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 0x7fb93c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0cb110 con 0x7fb93c0cf110 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0cb3f0 con 0x7fb93c153c30 2023-10-09T11:41:34.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.154+0000 7fb93b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c169b80 con 0x7fb93c15de50 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59622/0 (socket says 172.21.15.26:59622) 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 -- 172.21.15.26:0/3324983467 learned_addr learned my addr 172.21.15.26:0/3324983467 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93ad9d700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 0x7fb93c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb939d9b700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb93c153c30 0x7fb93c0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 -- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 msgr2=0x7fb93c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 0x7fb93c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 -- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb93c153c30 msgr2=0x7fb93c0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb93c153c30 0x7fb93c0cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 -- 172.21.15.26:0/3324983467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934009420 con 0x7fb93c0cf110 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93ad9d700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 0x7fb93c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93a59c700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb93400ec80 tx=0x7fb9340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400c8f0 con 0x7fb93c0cf110 2023-10-09T11:41:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400ca50 con 0x7fb93c0cf110 2023-10-09T11:41:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c009a20 con 0x7fb93c0cf110 2023-10-09T11:41:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400cdd0 con 0x7fb93c0cf110 2023-10-09T11:41:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.155+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c16a140 con 0x7fb93c0cf110 2023-10-09T11:41:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.156+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0cb6d0 con 0x7fb93c0cf110 2023-10-09T11:41:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.157+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb934013680 con 0x7fb93c0cf110 2023-10-09T11:41:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.157+0000 7fb9327fc700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 0x7fb91c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.157+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb934084e20 con 0x7fb93c0cf110 2023-10-09T11:41:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.157+0000 7fb939d9b700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 0x7fb91c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.158+0000 7fb939d9b700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 0x7fb91c069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb93c14b050 tx=0x7fb924001a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.161+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb934051c80 con 0x7fb93c0cf110 2023-10-09T11:41:34.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.355+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb93c04c3c0 con 0x7fb93c0cf110 2023-10-09T11:41:34.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.356+0000 7fb9327fc700 1 -- 172.21.15.26:0/3324983467 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15307 (secure 0 0 0) 0x7fb9340552a0 con 0x7fb93c0cf110 2023-10-09T11:41:34.357 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:34.357 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":100,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:31.191074+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 msgr2=0x7fb91c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 0x7fb91c069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb93c14b050 tx=0x7fb924001a00 comp rx=0 tx=0).stop 2023-10-09T11:41:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 msgr2=0x7fb93c0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb93400ec80 tx=0x7fb9340091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 shutdown_connections 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb91c067290 0x7fb91c069740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb93c15de50 0x7fb93c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb93c0cf110 0x7fb93c0b0310 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 --2- 172.21.15.26:0/3324983467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb93c153c30 0x7fb93c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 >> 172.21.15.26:0/3324983467 conn(0x7fb93c0703a0 msgr2=0x7fb93c0c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 shutdown_connections 2023-10-09T11:41:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.358+0000 7fb93b59e700 1 -- 172.21.15.26:0/3324983467 wait complete. 2023-10-09T11:41:34.371 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:41:34.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.488+0000 7fc4bbf0d700 1 Processor -- start 2023-10-09T11:41:34.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.488+0000 7fc4bbf0d700 1 -- start start 2023-10-09T11:41:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4bbf0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b40cb5a0 0x7fc4b40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4bbf0d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40cd9e0 0x7fc4b4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4bbf0d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b415ae40 con 0x7fc4b40cde50 2023-10-09T11:41:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4bbf0d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b40d13f0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4bbf0d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415ab60 con 0x7fc4b40cd9e0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4b9ca9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b40cb5a0 0x7fc4b40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4b9ca9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b40cb5a0 0x7fc4b40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59624/0 (socket says 172.21.15.26:59624) 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.489+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/2128530538 learned_addr learned my addr 172.21.15.26:0/2128530538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/2128530538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40cd9e0 msgr2=0x7fc4b4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b94a8700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40cd9e0 0x7fc4b4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b9ca9700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40cd9e0 0x7fc4b4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/2128530538 >> v1:172.21.15.67:6789/0 conn(0x7fc4b40cde50 legacy=0x7fc4b4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/2128530538 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40ccf00 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b9ca9700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b40cb970 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009f20 tx=0x7fc4ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4da60a746a20b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b8ca7700 1 -- 172.21.15.26:0/2128530538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00e070 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b8ca7700 1 -- 172.21.15.26:0/2128530538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00ba40 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.490+0000 7fc4b8ca7700 1 -- 172.21.15.26:0/2128530538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0092e0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/2128530538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 msgr2=0x7fc4b40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b40cb970 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009f20 tx=0x7fc4ac009840 comp rx=0 tx=0).stop 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/2128530538 shutdown_connections 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b40cb970 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/2128530538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40cd9e0 0x7fc4b4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/2128530538 >> 172.21.15.26:0/2128530538 conn(0x7fc4b4070e30 msgr2=0x7fc4b40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/2128530538 shutdown_connections 2023-10-09T11:41:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.491+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/2128530538 wait complete. 2023-10-09T11:41:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.492+0000 7fc4bbf0d700 1 Processor -- start 2023-10-09T11:41:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.492+0000 7fc4bbf0d700 1 -- start start 2023-10-09T11:41:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.492+0000 7fc4bbf0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b40cd9e0 0x7fc4b40b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40b61e0 0x7fc4b40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b416afc0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b416b2a0 con 0x7fc4b40cd9e0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b416b580 con 0x7fc4b40b61e0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59632/0 (socket says 172.21.15.26:59632) 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/40709761 learned_addr learned my addr 172.21.15.26:0/40709761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b94a8700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b40cd9e0 0x7fc4b40b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4ba4aa700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40b61e0 0x7fc4b40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40b61e0 msgr2=0x7fc4b40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40b61e0 0x7fc4b40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b40cd9e0 msgr2=0x7fc4b40b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b40cd9e0 0x7fc4b40b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 -- 172.21.15.26:0/40709761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009ae0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b9ca9700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc4b406ea60 tx=0x7fc4ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac012aa0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac012c00 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b416b860 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.493+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac01d420 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.494+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b41537a0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.494+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b404c3c0 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.495+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc4ac01d810 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.495+0000 7fc4b1ffb700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 0x7fc4a0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.495+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4ac086440 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.496+0000 7fc4b94a8700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 0x7fc4a0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.496+0000 7fc4b94a8700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 0x7fc4a0069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40b3050 tx=0x7fc4a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.500+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4ac053090 con 0x7fc4b40cb5a0 2023-10-09T11:41:34.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.689+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4b40cd1e0 con 0x7fc4a0067290 2023-10-09T11:41:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.699+0000 7fc4b1ffb700 1 -- 172.21.15.26:0/40709761 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288199 (secure 0 0 0) 0x7fc4b40cd1e0 con 0x7fc4a0067290 2023-10-09T11:41:34.704 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 msgr2=0x7fc4a0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 0x7fc4a0069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40b3050 tx=0x7fc4a8008040 comp rx=0 tx=0).stop 2023-10-09T11:41:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 msgr2=0x7fc4b4153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc4b406ea60 tx=0x7fc4ac017000 comp rx=0 tx=0).stop 2023-10-09T11:41:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 shutdown_connections 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc4a0067290 0x7fc4a0069740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4b40b61e0 0x7fc4b40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b40cb5a0 0x7fc4b4153260 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 --2- 172.21.15.26:0/40709761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b40cd9e0 0x7fc4b40b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 >> 172.21.15.26:0/40709761 conn(0x7fc4b4070e30 msgr2=0x7fc4b40b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 shutdown_connections 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.702+0000 7fc4bbf0d700 1 -- 172.21.15.26:0/40709761 wait complete. 2023-10-09T11:41:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:34.716 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2023-10-09T11:41:33.195514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590992,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417680,"kb_used_data":10704,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752557040,"statfs":{"total":773094113280,"available":770618408960,"internally_reserved":0,"allocated":10960896,"data_stored":5385035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.585892"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197968+0000","last_change":"2023-10-09T11:41:30.198091+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197968+0000","last_undegraded":"2023-10-09T11:41:30.197968+0000","last_fullsized":"2023-10-09T11:41:30.197968+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208578+0000","last_change":"2023-10-09T11:41:30.205032+0000","last_active":"2023-10-09T11:41:30.208578+0000","last_peered":"2023-10-09T11:41:30.208578+0000","last_clean":"2023-10-09T11:41:30.208578+0000","last_became_active":"2023-10-09T11:41:30.204713+0000","last_became_peered":"2023-10-09T11:41:30.204713+0000","last_unstale":"2023-10-09T11:41:30.208578+0000","last_undegraded":"2023-10-09T11:41:30.208578+0000","last_fullsized":"2023-10-09T11:41:30.208578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:58.606943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213873+0000","last_change":"2023-10-09T11:41:30.213873+0000","last_active":"2023-10-09T11:41:30.213873+0000","last_peered":"2023-10-09T11:41:30.213873+0000","last_clean":"2023-10-09T11:41:30.213873+0000","last_became_active":"2023-10-09T11:41:30.211899+0000","last_became_peered":"2023-10-09T11:41:30.211899+0000","last_unstale":"2023-10-09T11:41:30.213873+0000","last_undegraded":"2023-10-09T11:41:30.213873+0000","last_fullsized":"2023-10-09T11:41:30.213873+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197283+0000","last_change":"2023-10-09T11:41:30.197408+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197283+0000","last_undegraded":"2023-10-09T11:41:30.197283+0000","last_fullsized":"2023-10-09T11:41:30.197283+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.194724+0000","last_change":"2023-10-09T11:41:30.194873+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.194724+0000","last_undegraded":"2023-10-09T11:41:30.194724+0000","last_fullsized":"2023-10-09T11:41:30.194724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195429+0000","last_change":"2023-10-09T11:41:30.195524+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195429+0000","last_undegraded":"2023-10-09T11:41:30.195429+0000","last_fullsized":"2023-10-09T11:41:30.195429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206501+0000","last_change":"2023-10-09T11:41:30.206501+0000","last_active":"2023-10-09T11:41:30.206501+0000","last_peered":"2023-10-09T11:41:30.206501+0000","last_clean":"2023-10-09T11:41:30.206501+0000","last_became_active":"2023-10-09T11:41:30.206209+0000","last_became_peered":"2023-10-09T11:41:30.206209+0000","last_unstale":"2023-10-09T11:41:30.206501+0000","last_undegraded":"2023-10-09T11:41:30.206501+0000","last_fullsized":"2023-10-09T11:41:30.206501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:12.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213958+0000","last_change":"2023-10-09T11:41:30.213958+0000","last_active":"2023-10-09T11:41:30.213958+0000","last_peered":"2023-10-09T11:41:30.213958+0000","last_clean":"2023-10-09T11:41:30.213958+0000","last_became_active":"2023-10-09T11:41:30.211379+0000","last_became_peered":"2023-10-09T11:41:30.211379+0000","last_unstale":"2023-10-09T11:41:30.213958+0000","last_undegraded":"2023-10-09T11:41:30.213958+0000","last_fullsized":"2023-10-09T11:41:30.213958+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200175+0000","last_change":"2023-10-09T11:41:30.200300+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200175+0000","last_undegraded":"2023-10-09T11:41:30.200175+0000","last_fullsized":"2023-10-09T11:41:30.200175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.199321+0000","last_change":"2023-10-09T11:41:30.199460+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.199321+0000","last_undegraded":"2023-10-09T11:41:30.199321+0000","last_fullsized":"2023-10-09T11:41:30.199321+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214475+0000","last_change":"2023-10-09T11:41:30.207113+0000","last_active":"2023-10-09T11:41:30.214475+0000","last_peered":"2023-10-09T11:41:30.214475+0000","last_clean":"2023-10-09T11:41:30.214475+0000","last_became_active":"2023-10-09T11:41:30.206810+0000","last_became_peered":"2023-10-09T11:41:30.206810+0000","last_unstale":"2023-10-09T11:41:30.214475+0000","last_undegraded":"2023-10-09T11:41:30.214475+0000","last_fullsized":"2023-10-09T11:41:30.214475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:00.677277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198585+0000","last_change":"2023-10-09T11:41:30.198699+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198585+0000","last_undegraded":"2023-10-09T11:41:30.198585+0000","last_fullsized":"2023-10-09T11:41:30.198585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211940+0000","last_change":"2023-10-09T11:41:30.211940+0000","last_active":"2023-10-09T11:41:30.211940+0000","last_peered":"2023-10-09T11:41:30.211940+0000","last_clean":"2023-10-09T11:41:30.211940+0000","last_became_active":"2023-10-09T11:41:30.211435+0000","last_became_peered":"2023-10-09T11:41:30.211435+0000","last_unstale":"2023-10-09T11:41:30.211940+0000","last_undegraded":"2023-10-09T11:41:30.211940+0000","last_fullsized":"2023-10-09T11:41:30.211940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212286+0000","last_change":"2023-10-09T11:41:30.212286+0000","last_active":"2023-10-09T11:41:30.212286+0000","last_peered":"2023-10-09T11:41:30.212286+0000","last_clean":"2023-10-09T11:41:30.212286+0000","last_became_active":"2023-10-09T11:41:30.211855+0000","last_became_peered":"2023-10-09T11:41:30.211855+0000","last_unstale":"2023-10-09T11:41:30.212286+0000","last_undegraded":"2023-10-09T11:41:30.212286+0000","last_fullsized":"2023-10-09T11:41:30.212286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195861+0000","last_change":"2023-10-09T11:41:30.195980+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195861+0000","last_undegraded":"2023-10-09T11:41:30.195861+0000","last_fullsized":"2023-10-09T11:41:30.195861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195992+0000","last_change":"2023-10-09T11:41:30.196777+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195992+0000","last_undegraded":"2023-10-09T11:41:30.195992+0000","last_fullsized":"2023-10-09T11:41:30.195992+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215491+0000","last_change":"2023-10-09T11:41:30.213001+0000","last_active":"2023-10-09T11:41:30.215491+0000","last_peered":"2023-10-09T11:41:30.215491+0000","last_clean":"2023-10-09T11:41:30.215491+0000","last_became_active":"2023-10-09T11:41:30.212689+0000","last_became_peered":"2023-10-09T11:41:30.212689+0000","last_unstale":"2023-10-09T11:41:30.215491+0000","last_undegraded":"2023-10-09T11:41:30.215491+0000","last_fullsized":"2023-10-09T11:41:30.215491+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:38.335285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216170+0000","last_change":"2023-10-09T11:41:30.210587+0000","last_active":"2023-10-09T11:41:30.216170+0000","last_peered":"2023-10-09T11:41:30.216170+0000","last_clean":"2023-10-09T11:41:30.216170+0000","last_became_active":"2023-10-09T11:41:30.210309+0000","last_became_peered":"2023-10-09T11:41:30.210309+0000","last_unstale":"2023-10-09T11:41:30.216170+0000","last_undegraded":"2023-10-09T11:41:30.216170+0000","last_fullsized":"2023-10-09T11:41:30.216170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214778+0000","last_change":"2023-10-09T11:41:30.214778+0000","last_active":"2023-10-09T11:41:30.214778+0000","last_peered":"2023-10-09T11:41:30.214778+0000","last_clean":"2023-10-09T11:41:30.214778+0000","last_became_active":"2023-10-09T11:41:30.214420+0000","last_became_peered":"2023-10-09T11:41:30.214420+0000","last_unstale":"2023-10-09T11:41:30.214778+0000","last_undegraded":"2023-10-09T11:41:30.214778+0000","last_fullsized":"2023-10-09T11:41:30.214778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215302+0000","last_change":"2023-10-09T11:41:30.211011+0000","last_active":"2023-10-09T11:41:30.215302+0000","last_peered":"2023-10-09T11:41:30.215302+0000","last_clean":"2023-10-09T11:41:30.215302+0000","last_became_active":"2023-10-09T11:41:30.210577+0000","last_became_peered":"2023-10-09T11:41:30.210577+0000","last_unstale":"2023-10-09T11:41:30.215302+0000","last_undegraded":"2023-10-09T11:41:30.215302+0000","last_fullsized":"2023-10-09T11:41:30.215302+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:23.812282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214638+0000","last_change":"2023-10-09T11:41:30.206829+0000","last_active":"2023-10-09T11:41:30.214638+0000","last_peered":"2023-10-09T11:41:30.214638+0000","last_clean":"2023-10-09T11:41:30.214638+0000","last_became_active":"2023-10-09T11:41:30.206191+0000","last_became_peered":"2023-10-09T11:41:30.206191+0000","last_unstale":"2023-10-09T11:41:30.214638+0000","last_undegraded":"2023-10-09T11:41:30.214638+0000","last_fullsized":"2023-10-09T11:41:30.214638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:03.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.615634+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214555+0000","last_change":"2023-10-09T11:41:30.208259+0000","last_active":"2023-10-09T11:41:30.214555+0000","last_peered":"2023-10-09T11:41:30.214555+0000","last_clean":"2023-10-09T11:41:30.214555+0000","last_became_active":"2023-10-09T11:41:30.207545+0000","last_became_peered":"2023-10-09T11:41:30.207545+0000","last_unstale":"2023-10-09T11:41:30.214555+0000","last_undegraded":"2023-10-09T11:41:30.214555+0000","last_fullsized":"2023-10-09T11:41:30.214555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:00.236671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.614365+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214520+0000","last_change":"2023-10-09T11:41:30.207785+0000","last_active":"2023-10-09T11:41:30.214520+0000","last_peered":"2023-10-09T11:41:30.214520+0000","last_clean":"2023-10-09T11:41:30.214520+0000","last_became_active":"2023-10-09T11:41:30.207389+0000","last_became_peered":"2023-10-09T11:41:30.207389+0000","last_unstale":"2023-10-09T11:41:30.214520+0000","last_undegraded":"2023-10-09T11:41:30.214520+0000","last_fullsized":"2023-10-09T11:41:30.214520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197350+0000","last_change":"2023-10-09T11:41:30.199585+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197350+0000","last_undegraded":"2023-10-09T11:41:30.197350+0000","last_fullsized":"2023-10-09T11:41:30.197350+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196868+0000","last_change":"2023-10-09T11:41:30.196964+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196868+0000","last_undegraded":"2023-10-09T11:41:30.196868+0000","last_fullsized":"2023-10-09T11:41:30.196868+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613142+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215621+0000","last_change":"2023-10-09T11:41:30.213841+0000","last_active":"2023-10-09T11:41:30.215621+0000","last_peered":"2023-10-09T11:41:30.215621+0000","last_clean":"2023-10-09T11:41:30.215621+0000","last_became_active":"2023-10-09T11:41:30.213550+0000","last_became_peered":"2023-10-09T11:41:30.213550+0000","last_unstale":"2023-10-09T11:41:30.215621+0000","last_undegraded":"2023-10-09T11:41:30.215621+0000","last_fullsized":"2023-10-09T11:41:30.215621+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:31.671775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201875+0000","last_change":"2023-10-09T11:41:30.201875+0000","last_active":"2023-10-09T11:41:30.201875+0000","last_peered":"2023-10-09T11:41:30.201875+0000","last_clean":"2023-10-09T11:41:30.201875+0000","last_became_active":"2023-10-09T11:41:30.201565+0000","last_became_peered":"2023-10-09T11:41:30.201565+0000","last_unstale":"2023-10-09T11:41:30.201875+0000","last_undegraded":"2023-10-09T11:41:30.201875+0000","last_fullsized":"2023-10-09T11:41:30.201875+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:30.544630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":7,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203053+0000","last_change":"2023-10-09T11:41:30.203132+0000","last_active":"2023-10-09T11:41:30.203053+0000","last_peered":"2023-10-09T11:41:30.203053+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"2023-10-09T11:41:30.202467+0000","last_became_peered":"2023-10-09T11:41:30.202467+0000","last_unstale":"2023-10-09T11:41:30.203053+0000","last_undegraded":"2023-10-09T11:41:30.203053+0000","last_fullsized":"2023-10-09T11:41:30.203053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:28.546094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198195+0000","last_change":"2023-10-09T11:41:30.198324+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198195+0000","last_undegraded":"2023-10-09T11:41:30.198195+0000","last_fullsized":"2023-10-09T11:41:30.198195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197315+0000","last_change":"2023-10-09T11:41:30.197440+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197315+0000","last_undegraded":"2023-10-09T11:41:30.197315+0000","last_fullsized":"2023-10-09T11:41:30.197315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618361+0000","last_change":"2023-10-09T11:41:29.626042+0000","last_active":"2023-10-09T11:41:30.618361+0000","last_peered":"2023-10-09T11:41:30.618361+0000","last_clean":"2023-10-09T11:41:30.618361+0000","last_became_active":"2023-10-09T11:41:29.625587+0000","last_became_peered":"2023-10-09T11:41:29.625587+0000","last_unstale":"2023-10-09T11:41:30.618361+0000","last_undegraded":"2023-10-09T11:41:30.618361+0000","last_fullsized":"2023-10-09T11:41:30.618361+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:40.925799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216384+0000","last_change":"2023-10-09T11:41:30.213412+0000","last_active":"2023-10-09T11:41:30.216384+0000","last_peered":"2023-10-09T11:41:30.216384+0000","last_clean":"2023-10-09T11:41:30.216384+0000","last_became_active":"2023-10-09T11:41:30.213141+0000","last_became_peered":"2023-10-09T11:41:30.213141+0000","last_unstale":"2023-10-09T11:41:30.216384+0000","last_undegraded":"2023-10-09T11:41:30.216384+0000","last_fullsized":"2023-10-09T11:41:30.216384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:20.601709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202381+0000","last_change":"2023-10-09T11:41:29.629629+0000","last_active":"2023-10-09T11:41:30.202381+0000","last_peered":"2023-10-09T11:41:30.202381+0000","last_clean":"2023-10-09T11:41:30.202381+0000","last_became_active":"2023-10-09T11:41:29.629294+0000","last_became_peered":"2023-10-09T11:41:29.629294+0000","last_unstale":"2023-10-09T11:41:30.202381+0000","last_undegraded":"2023-10-09T11:41:30.202381+0000","last_fullsized":"2023-10-09T11:41:30.202381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:48.066109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197734+0000","last_change":"2023-10-09T11:41:30.197856+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197734+0000","last_undegraded":"2023-10-09T11:41:30.197734+0000","last_fullsized":"2023-10-09T11:41:30.197734+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629816+0000","last_change":"2023-10-09T11:41:29.624723+0000","last_active":"2023-10-09T11:41:29.629816+0000","last_peered":"2023-10-09T11:41:29.629816+0000","last_clean":"2023-10-09T11:41:29.629816+0000","last_became_active":"2023-10-09T11:41:29.624446+0000","last_became_peered":"2023-10-09T11:41:29.624446+0000","last_unstale":"2023-10-09T11:41:29.629816+0000","last_undegraded":"2023-10-09T11:41:29.629816+0000","last_fullsized":"2023-10-09T11:41:29.629816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:24.501718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214087+0000","last_change":"2023-10-09T11:41:30.214087+0000","last_active":"2023-10-09T11:41:30.214087+0000","last_peered":"2023-10-09T11:41:30.214087+0000","last_clean":"2023-10-09T11:41:30.214087+0000","last_became_active":"2023-10-09T11:41:30.212251+0000","last_became_peered":"2023-10-09T11:41:30.212251+0000","last_unstale":"2023-10-09T11:41:30.214087+0000","last_undegraded":"2023-10-09T11:41:30.214087+0000","last_fullsized":"2023-10-09T11:41:30.214087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630635+0000","last_change":"2023-10-09T11:41:29.627113+0000","last_active":"2023-10-09T11:41:29.630635+0000","last_peered":"2023-10-09T11:41:29.630635+0000","last_clean":"2023-10-09T11:41:29.630635+0000","last_became_active":"2023-10-09T11:41:29.626832+0000","last_became_peered":"2023-10-09T11:41:29.626832+0000","last_unstale":"2023-10-09T11:41:29.630635+0000","last_undegraded":"2023-10-09T11:41:29.630635+0000","last_fullsized":"2023-10-09T11:41:29.630635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.078822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196474+0000","last_change":"2023-10-09T11:41:30.196607+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196474+0000","last_undegraded":"2023-10-09T11:41:30.196474+0000","last_fullsized":"2023-10-09T11:41:30.196474+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193718+0000","last_change":"2023-10-09T11:41:29.624687+0000","last_active":"2023-10-09T11:41:30.193718+0000","last_peered":"2023-10-09T11:41:30.193718+0000","last_clean":"2023-10-09T11:41:30.193718+0000","last_became_active":"2023-10-09T11:41:29.622838+0000","last_became_peered":"2023-10-09T11:41:29.622838+0000","last_unstale":"2023-10-09T11:41:30.193718+0000","last_undegraded":"2023-10-09T11:41:30.193718+0000","last_fullsized":"2023-10-09T11:41:30.193718+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:07.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215152+0000","last_change":"2023-10-09T11:41:30.210327+0000","last_active":"2023-10-09T11:41:30.215152+0000","last_peered":"2023-10-09T11:41:30.215152+0000","last_clean":"2023-10-09T11:41:30.215152+0000","last_became_active":"2023-10-09T11:41:30.209999+0000","last_became_peered":"2023-10-09T11:41:30.209999+0000","last_unstale":"2023-10-09T11:41:30.215152+0000","last_undegraded":"2023-10-09T11:41:30.215152+0000","last_fullsized":"2023-10-09T11:41:30.215152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.622757+0000","last_change":"2023-10-09T11:41:29.622757+0000","last_active":"2023-10-09T11:41:29.622757+0000","last_peered":"2023-10-09T11:41:29.622757+0000","last_clean":"2023-10-09T11:41:29.622757+0000","last_became_active":"2023-10-09T11:41:29.622405+0000","last_became_peered":"2023-10-09T11:41:29.622405+0000","last_unstale":"2023-10-09T11:41:29.622757+0000","last_undegraded":"2023-10-09T11:41:29.622757+0000","last_fullsized":"2023-10-09T11:41:29.622757+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:37.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196467+0000","last_change":"2023-10-09T11:41:30.196593+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196467+0000","last_undegraded":"2023-10-09T11:41:30.196467+0000","last_fullsized":"2023-10-09T11:41:30.196467+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197823+0000","last_change":"2023-10-09T11:41:29.626941+0000","last_active":"2023-10-09T11:41:30.197823+0000","last_peered":"2023-10-09T11:41:30.197823+0000","last_clean":"2023-10-09T11:41:30.197823+0000","last_became_active":"2023-10-09T11:41:29.626666+0000","last_became_peered":"2023-10-09T11:41:29.626666+0000","last_unstale":"2023-10-09T11:41:30.197823+0000","last_undegraded":"2023-10-09T11:41:30.197823+0000","last_fullsized":"2023-10-09T11:41:30.197823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:10.194833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206394+0000","last_change":"2023-10-09T11:41:30.206394+0000","last_active":"2023-10-09T11:41:30.206394+0000","last_peered":"2023-10-09T11:41:30.206394+0000","last_clean":"2023-10-09T11:41:30.206394+0000","last_became_active":"2023-10-09T11:41:30.206062+0000","last_became_peered":"2023-10-09T11:41:30.206062+0000","last_unstale":"2023-10-09T11:41:30.206394+0000","last_undegraded":"2023-10-09T11:41:30.206394+0000","last_fullsized":"2023-10-09T11:41:30.206394+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:41.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630515+0000","last_change":"2023-10-09T11:41:29.626745+0000","last_active":"2023-10-09T11:41:29.630515+0000","last_peered":"2023-10-09T11:41:29.630515+0000","last_clean":"2023-10-09T11:41:29.630515+0000","last_became_active":"2023-10-09T11:41:29.626206+0000","last_became_peered":"2023-10-09T11:41:29.626206+0000","last_unstale":"2023-10-09T11:41:29.630515+0000","last_undegraded":"2023-10-09T11:41:29.630515+0000","last_fullsized":"2023-10-09T11:41:29.630515+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:25.951409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201154+0000","last_change":"2023-10-09T11:41:30.201154+0000","last_active":"2023-10-09T11:41:30.201154+0000","last_peered":"2023-10-09T11:41:30.201154+0000","last_clean":"2023-10-09T11:41:30.201154+0000","last_became_active":"2023-10-09T11:41:30.200791+0000","last_became_peered":"2023-10-09T11:41:30.200791+0000","last_unstale":"2023-10-09T11:41:30.201154+0000","last_undegraded":"2023-10-09T11:41:30.201154+0000","last_fullsized":"2023-10-09T11:41:30.201154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630333+0000","last_change":"2023-10-09T11:41:29.626711+0000","last_active":"2023-10-09T11:41:29.630333+0000","last_peered":"2023-10-09T11:41:29.630333+0000","last_clean":"2023-10-09T11:41:29.630333+0000","last_became_active":"2023-10-09T11:41:29.626341+0000","last_became_peered":"2023-10-09T11:41:29.626341+0000","last_unstale":"2023-10-09T11:41:29.630333+0000","last_undegraded":"2023-10-09T11:41:29.630333+0000","last_fullsized":"2023-10-09T11:41:29.630333+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.711584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214896+0000","last_change":"2023-10-09T11:41:30.206248+0000","last_active":"2023-10-09T11:41:30.214896+0000","last_peered":"2023-10-09T11:41:30.214896+0000","last_clean":"2023-10-09T11:41:30.214896+0000","last_became_active":"2023-10-09T11:41:30.205788+0000","last_became_peered":"2023-10-09T11:41:30.205788+0000","last_unstale":"2023-10-09T11:41:30.214896+0000","last_undegraded":"2023-10-09T11:41:30.214896+0000","last_fullsized":"2023-10-09T11:41:30.214896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.624261+0000","last_change":"2023-10-09T11:41:29.624261+0000","last_active":"2023-10-09T11:41:29.624261+0000","last_peered":"2023-10-09T11:41:29.624261+0000","last_clean":"2023-10-09T11:41:29.624261+0000","last_became_active":"2023-10-09T11:41:29.623990+0000","last_became_peered":"2023-10-09T11:41:29.623990+0000","last_unstale":"2023-10-09T11:41:29.624261+0000","last_undegraded":"2023-10-09T11:41:29.624261+0000","last_fullsized":"2023-10-09T11:41:29.624261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:57.602272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612603+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:35.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625454+0000","last_change":"2023-10-09T11:41:29.625454+0000","last_active":"2023-10-09T11:41:29.625454+0000","last_peered":"2023-10-09T11:41:29.625454+0000","last_clean":"2023-10-09T11:41:29.625454+0000","last_became_active":"2023-10-09T11:41:29.624809+0000","last_became_peered":"2023-10-09T11:41:29.624809+0000","last_unstale":"2023-10-09T11:41:29.625454+0000","last_undegraded":"2023-10-09T11:41:29.625454+0000","last_fullsized":"2023-10-09T11:41:29.625454+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:56.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212455+0000","last_change":"2023-10-09T11:41:30.212455+0000","last_active":"2023-10-09T11:41:30.212455+0000","last_peered":"2023-10-09T11:41:30.212455+0000","last_clean":"2023-10-09T11:41:30.212455+0000","last_became_active":"2023-10-09T11:41:30.212151+0000","last_became_peered":"2023-10-09T11:41:30.212151+0000","last_unstale":"2023-10-09T11:41:30.212455+0000","last_undegraded":"2023-10-09T11:41:30.212455+0000","last_fullsized":"2023-10-09T11:41:30.212455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:37.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628591+0000","last_change":"2023-10-09T11:41:29.625291+0000","last_active":"2023-10-09T11:41:29.628591+0000","last_peered":"2023-10-09T11:41:29.628591+0000","last_clean":"2023-10-09T11:41:29.628591+0000","last_became_active":"2023-10-09T11:41:29.624992+0000","last_became_peered":"2023-10-09T11:41:29.624992+0000","last_unstale":"2023-10-09T11:41:29.628591+0000","last_undegraded":"2023-10-09T11:41:29.628591+0000","last_fullsized":"2023-10-09T11:41:29.628591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:50.027818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613794+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:02.911516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629864+0000","last_change":"2023-10-09T11:41:29.626334+0000","last_active":"2023-10-09T11:41:29.629864+0000","last_peered":"2023-10-09T11:41:29.629864+0000","last_clean":"2023-10-09T11:41:29.629864+0000","last_became_active":"2023-10-09T11:41:29.625700+0000","last_became_peered":"2023-10-09T11:41:29.625700+0000","last_unstale":"2023-10-09T11:41:29.629864+0000","last_undegraded":"2023-10-09T11:41:29.629864+0000","last_fullsized":"2023-10-09T11:41:29.629864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:38.376341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612494+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:50.665102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197765+0000","last_change":"2023-10-09T11:41:29.628526+0000","last_active":"2023-10-09T11:41:30.197765+0000","last_peered":"2023-10-09T11:41:30.197765+0000","last_clean":"2023-10-09T11:41:30.197765+0000","last_became_active":"2023-10-09T11:41:29.628346+0000","last_became_peered":"2023-10-09T11:41:29.628346+0000","last_unstale":"2023-10-09T11:41:30.197765+0000","last_undegraded":"2023-10-09T11:41:30.197765+0000","last_fullsized":"2023-10-09T11:41:30.197765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:11.803064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613205+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:44.510367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630825+0000","last_change":"2023-10-09T11:41:29.628993+0000","last_active":"2023-10-09T11:41:29.630825+0000","last_peered":"2023-10-09T11:41:29.630825+0000","last_clean":"2023-10-09T11:41:29.630825+0000","last_became_active":"2023-10-09T11:41:29.628689+0000","last_became_peered":"2023-10-09T11:41:29.628689+0000","last_unstale":"2023-10-09T11:41:29.630825+0000","last_undegraded":"2023-10-09T11:41:29.630825+0000","last_fullsized":"2023-10-09T11:41:29.630825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:47.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195206+0000","last_change":"2023-10-09T11:41:30.195331+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195206+0000","last_undegraded":"2023-10-09T11:41:30.195206+0000","last_fullsized":"2023-10-09T11:41:30.195206+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627947+0000","last_change":"2023-10-09T11:41:29.627947+0000","last_active":"2023-10-09T11:41:29.627947+0000","last_peered":"2023-10-09T11:41:29.627947+0000","last_clean":"2023-10-09T11:41:29.627947+0000","last_became_active":"2023-10-09T11:41:29.627683+0000","last_became_peered":"2023-10-09T11:41:29.627683+0000","last_unstale":"2023-10-09T11:41:29.627947+0000","last_undegraded":"2023-10-09T11:41:29.627947+0000","last_fullsized":"2023-10-09T11:41:29.627947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:34.004467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197755+0000","last_change":"2023-10-09T11:41:30.197903+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197755+0000","last_undegraded":"2023-10-09T11:41:30.197755+0000","last_fullsized":"2023-10-09T11:41:30.197755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625667+0000","last_change":"2023-10-09T11:41:29.622774+0000","last_active":"2023-10-09T11:41:29.625667+0000","last_peered":"2023-10-09T11:41:29.625667+0000","last_clean":"2023-10-09T11:41:29.625667+0000","last_became_active":"2023-10-09T11:41:29.622497+0000","last_became_peered":"2023-10-09T11:41:29.622497+0000","last_unstale":"2023-10-09T11:41:29.625667+0000","last_undegraded":"2023-10-09T11:41:29.625667+0000","last_fullsized":"2023-10-09T11:41:29.625667+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:17.226611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212307+0000","last_change":"2023-10-09T11:41:30.212307+0000","last_active":"2023-10-09T11:41:30.212307+0000","last_peered":"2023-10-09T11:41:30.212307+0000","last_clean":"2023-10-09T11:41:30.212307+0000","last_became_active":"2023-10-09T11:41:30.211263+0000","last_became_peered":"2023-10-09T11:41:30.211263+0000","last_unstale":"2023-10-09T11:41:30.212307+0000","last_undegraded":"2023-10-09T11:41:30.212307+0000","last_fullsized":"2023-10-09T11:41:30.212307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617971+0000","last_change":"2023-10-09T11:41:29.624896+0000","last_active":"2023-10-09T11:41:30.617971+0000","last_peered":"2023-10-09T11:41:30.617971+0000","last_clean":"2023-10-09T11:41:30.617971+0000","last_became_active":"2023-10-09T11:41:29.624643+0000","last_became_peered":"2023-10-09T11:41:29.624643+0000","last_unstale":"2023-10-09T11:41:30.617971+0000","last_undegraded":"2023-10-09T11:41:30.617971+0000","last_fullsized":"2023-10-09T11:41:30.617971+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:40.658382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214279+0000","last_change":"2023-10-09T11:41:30.214279+0000","last_active":"2023-10-09T11:41:30.214279+0000","last_peered":"2023-10-09T11:41:30.214279+0000","last_clean":"2023-10-09T11:41:30.214279+0000","last_became_active":"2023-10-09T11:41:30.212519+0000","last_became_peered":"2023-10-09T11:41:30.212519+0000","last_unstale":"2023-10-09T11:41:30.214279+0000","last_undegraded":"2023-10-09T11:41:30.214279+0000","last_fullsized":"2023-10-09T11:41:30.214279+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628363+0000","last_change":"2023-10-09T11:41:29.623446+0000","last_active":"2023-10-09T11:41:29.628363+0000","last_peered":"2023-10-09T11:41:29.628363+0000","last_clean":"2023-10-09T11:41:29.628363+0000","last_became_active":"2023-10-09T11:41:29.623199+0000","last_became_peered":"2023-10-09T11:41:29.623199+0000","last_unstale":"2023-10-09T11:41:29.628363+0000","last_undegraded":"2023-10-09T11:41:29.628363+0000","last_fullsized":"2023-10-09T11:41:29.628363+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:57.601464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212736+0000","last_change":"2023-10-09T11:41:30.212736+0000","last_active":"2023-10-09T11:41:30.212736+0000","last_peered":"2023-10-09T11:41:30.212736+0000","last_clean":"2023-10-09T11:41:30.212736+0000","last_became_active":"2023-10-09T11:41:30.211249+0000","last_became_peered":"2023-10-09T11:41:30.211249+0000","last_unstale":"2023-10-09T11:41:30.212736+0000","last_undegraded":"2023-10-09T11:41:30.212736+0000","last_fullsized":"2023-10-09T11:41:30.212736+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629881+0000","last_change":"2023-10-09T11:41:29.626531+0000","last_active":"2023-10-09T11:41:29.629881+0000","last_peered":"2023-10-09T11:41:29.629881+0000","last_clean":"2023-10-09T11:41:29.629881+0000","last_became_active":"2023-10-09T11:41:29.626069+0000","last_became_peered":"2023-10-09T11:41:29.626069+0000","last_unstale":"2023-10-09T11:41:29.629881+0000","last_undegraded":"2023-10-09T11:41:29.629881+0000","last_fullsized":"2023-10-09T11:41:29.629881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:57.065033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196825+0000","last_change":"2023-10-09T11:41:30.196943+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196825+0000","last_undegraded":"2023-10-09T11:41:30.196825+0000","last_fullsized":"2023-10-09T11:41:30.196825+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630294+0000","last_change":"2023-10-09T11:41:29.626659+0000","last_active":"2023-10-09T11:41:29.630294+0000","last_peered":"2023-10-09T11:41:29.630294+0000","last_clean":"2023-10-09T11:41:29.630294+0000","last_became_active":"2023-10-09T11:41:29.626359+0000","last_became_peered":"2023-10-09T11:41:29.626359+0000","last_unstale":"2023-10-09T11:41:29.630294+0000","last_undegraded":"2023-10-09T11:41:29.630294+0000","last_fullsized":"2023-10-09T11:41:29.630294+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:15.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213139+0000","last_change":"2023-10-09T11:41:30.213139+0000","last_active":"2023-10-09T11:41:30.213139+0000","last_peered":"2023-10-09T11:41:30.213139+0000","last_clean":"2023-10-09T11:41:30.213139+0000","last_became_active":"2023-10-09T11:41:30.212582+0000","last_became_peered":"2023-10-09T11:41:30.212582+0000","last_unstale":"2023-10-09T11:41:30.213139+0000","last_undegraded":"2023-10-09T11:41:30.213139+0000","last_fullsized":"2023-10-09T11:41:30.213139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629838+0000","last_change":"2023-10-09T11:41:29.628284+0000","last_active":"2023-10-09T11:41:29.629838+0000","last_peered":"2023-10-09T11:41:29.629838+0000","last_clean":"2023-10-09T11:41:29.629838+0000","last_became_active":"2023-10-09T11:41:29.627998+0000","last_became_peered":"2023-10-09T11:41:29.627998+0000","last_unstale":"2023-10-09T11:41:29.629838+0000","last_undegraded":"2023-10-09T11:41:29.629838+0000","last_fullsized":"2023-10-09T11:41:29.629838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:54.858809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612687+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:41.609711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627507+0000","last_change":"2023-10-09T11:41:29.623589+0000","last_active":"2023-10-09T11:41:29.627507+0000","last_peered":"2023-10-09T11:41:29.627507+0000","last_clean":"2023-10-09T11:41:29.627507+0000","last_became_active":"2023-10-09T11:41:29.622865+0000","last_became_peered":"2023-10-09T11:41:29.622865+0000","last_unstale":"2023-10-09T11:41:29.627507+0000","last_undegraded":"2023-10-09T11:41:29.627507+0000","last_fullsized":"2023-10-09T11:41:29.627507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:58.673145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215946+0000","last_change":"2023-10-09T11:41:30.208877+0000","last_active":"2023-10-09T11:41:30.215946+0000","last_peered":"2023-10-09T11:41:30.215946+0000","last_clean":"2023-10-09T11:41:30.215946+0000","last_became_active":"2023-10-09T11:41:30.208587+0000","last_became_peered":"2023-10-09T11:41:30.208587+0000","last_unstale":"2023-10-09T11:41:30.215946+0000","last_undegraded":"2023-10-09T11:41:30.215946+0000","last_fullsized":"2023-10-09T11:41:30.215946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:49.070780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629791+0000","last_change":"2023-10-09T11:41:29.629791+0000","last_active":"2023-10-09T11:41:29.629791+0000","last_peered":"2023-10-09T11:41:29.629791+0000","last_clean":"2023-10-09T11:41:29.629791+0000","last_became_active":"2023-10-09T11:41:29.629499+0000","last_became_peered":"2023-10-09T11:41:29.629499+0000","last_unstale":"2023-10-09T11:41:29.629791+0000","last_undegraded":"2023-10-09T11:41:29.629791+0000","last_fullsized":"2023-10-09T11:41:29.629791+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:30.667105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198280+0000","last_change":"2023-10-09T11:41:30.198399+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198280+0000","last_undegraded":"2023-10-09T11:41:30.198280+0000","last_fullsized":"2023-10-09T11:41:30.198280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202221+0000","last_change":"2023-10-09T11:41:29.626094+0000","last_active":"2023-10-09T11:41:30.202221+0000","last_peered":"2023-10-09T11:41:30.202221+0000","last_clean":"2023-10-09T11:41:30.202221+0000","last_became_active":"2023-10-09T11:41:29.625689+0000","last_became_peered":"2023-10-09T11:41:29.625689+0000","last_unstale":"2023-10-09T11:41:30.202221+0000","last_undegraded":"2023-10-09T11:41:30.202221+0000","last_fullsized":"2023-10-09T11:41:30.202221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:29.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200052+0000","last_change":"2023-10-09T11:41:30.200174+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200052+0000","last_undegraded":"2023-10-09T11:41:30.200052+0000","last_fullsized":"2023-10-09T11:41:30.200052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625772+0000","last_change":"2023-10-09T11:41:29.625772+0000","last_active":"2023-10-09T11:41:29.625772+0000","last_peered":"2023-10-09T11:41:29.625772+0000","last_clean":"2023-10-09T11:41:29.625772+0000","last_became_active":"2023-10-09T11:41:29.625181+0000","last_became_peered":"2023-10-09T11:41:29.625181+0000","last_unstale":"2023-10-09T11:41:29.625772+0000","last_undegraded":"2023-10-09T11:41:29.625772+0000","last_fullsized":"2023-10-09T11:41:29.625772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:29.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215988+0000","last_change":"2023-10-09T11:41:30.208985+0000","last_active":"2023-10-09T11:41:30.215988+0000","last_peered":"2023-10-09T11:41:30.215988+0000","last_clean":"2023-10-09T11:41:30.215988+0000","last_became_active":"2023-10-09T11:41:30.208686+0000","last_became_peered":"2023-10-09T11:41:30.208686+0000","last_unstale":"2023-10-09T11:41:30.215988+0000","last_undegraded":"2023-10-09T11:41:30.215988+0000","last_fullsized":"2023-10-09T11:41:30.215988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.624296+0000","last_change":"2023-10-09T11:41:29.624296+0000","last_active":"2023-10-09T11:41:29.624296+0000","last_peered":"2023-10-09T11:41:29.624296+0000","last_clean":"2023-10-09T11:41:29.624296+0000","last_became_active":"2023-10-09T11:41:29.623669+0000","last_became_peered":"2023-10-09T11:41:29.623669+0000","last_unstale":"2023-10-09T11:41:29.624296+0000","last_undegraded":"2023-10-09T11:41:29.624296+0000","last_fullsized":"2023-10-09T11:41:29.624296+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.232001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208773+0000","last_change":"2023-10-09T11:41:30.205259+0000","last_active":"2023-10-09T11:41:30.208773+0000","last_peered":"2023-10-09T11:41:30.208773+0000","last_clean":"2023-10-09T11:41:30.208773+0000","last_became_active":"2023-10-09T11:41:30.204932+0000","last_became_peered":"2023-10-09T11:41:30.204932+0000","last_unstale":"2023-10-09T11:41:30.208773+0000","last_undegraded":"2023-10-09T11:41:30.208773+0000","last_fullsized":"2023-10-09T11:41:30.208773+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:38.539477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628391+0000","last_change":"2023-10-09T11:41:29.622849+0000","last_active":"2023-10-09T11:41:29.628391+0000","last_peered":"2023-10-09T11:41:29.628391+0000","last_clean":"2023-10-09T11:41:29.628391+0000","last_became_active":"2023-10-09T11:41:29.622558+0000","last_became_peered":"2023-10-09T11:41:29.622558+0000","last_unstale":"2023-10-09T11:41:29.628391+0000","last_undegraded":"2023-10-09T11:41:29.628391+0000","last_fullsized":"2023-10-09T11:41:29.628391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:03.488670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214678+0000","last_change":"2023-10-09T11:41:30.207009+0000","last_active":"2023-10-09T11:41:30.214678+0000","last_peered":"2023-10-09T11:41:30.214678+0000","last_clean":"2023-10-09T11:41:30.214678+0000","last_became_active":"2023-10-09T11:41:30.206529+0000","last_became_peered":"2023-10-09T11:41:30.206529+0000","last_unstale":"2023-10-09T11:41:30.214678+0000","last_undegraded":"2023-10-09T11:41:30.214678+0000","last_fullsized":"2023-10-09T11:41:30.214678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197086+0000","last_change":"2023-10-09T11:41:29.624867+0000","last_active":"2023-10-09T11:41:30.197086+0000","last_peered":"2023-10-09T11:41:30.197086+0000","last_clean":"2023-10-09T11:41:30.197086+0000","last_became_active":"2023-10-09T11:41:29.624541+0000","last_became_peered":"2023-10-09T11:41:29.624541+0000","last_unstale":"2023-10-09T11:41:30.197086+0000","last_undegraded":"2023-10-09T11:41:30.197086+0000","last_fullsized":"2023-10-09T11:41:30.197086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:53.532131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216031+0000","last_change":"2023-10-09T11:41:30.216031+0000","last_active":"2023-10-09T11:41:30.216031+0000","last_peered":"2023-10-09T11:41:30.216031+0000","last_clean":"2023-10-09T11:41:30.216031+0000","last_became_active":"2023-10-09T11:41:30.215746+0000","last_became_peered":"2023-10-09T11:41:30.215746+0000","last_unstale":"2023-10-09T11:41:30.216031+0000","last_undegraded":"2023-10-09T11:41:30.216031+0000","last_fullsized":"2023-10-09T11:41:30.216031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629866+0000","last_change":"2023-10-09T11:41:29.624557+0000","last_active":"2023-10-09T11:41:29.629866+0000","last_peered":"2023-10-09T11:41:29.629866+0000","last_clean":"2023-10-09T11:41:29.629866+0000","last_became_active":"2023-10-09T11:41:29.624236+0000","last_became_peered":"2023-10-09T11:41:29.624236+0000","last_unstale":"2023-10-09T11:41:29.629866+0000","last_undegraded":"2023-10-09T11:41:29.629866+0000","last_fullsized":"2023-10-09T11:41:29.629866+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:01.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201532+0000","last_change":"2023-10-09T11:41:30.201532+0000","last_active":"2023-10-09T11:41:30.201532+0000","last_peered":"2023-10-09T11:41:30.201532+0000","last_clean":"2023-10-09T11:41:30.201532+0000","last_became_active":"2023-10-09T11:41:30.201154+0000","last_became_peered":"2023-10-09T11:41:30.201154+0000","last_unstale":"2023-10-09T11:41:30.201532+0000","last_undegraded":"2023-10-09T11:41:30.201532+0000","last_fullsized":"2023-10-09T11:41:30.201532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:39.734390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627487+0000","last_change":"2023-10-09T11:41:29.623414+0000","last_active":"2023-10-09T11:41:29.627487+0000","last_peered":"2023-10-09T11:41:29.627487+0000","last_clean":"2023-10-09T11:41:29.627487+0000","last_became_active":"2023-10-09T11:41:29.622500+0000","last_became_peered":"2023-10-09T11:41:29.622500+0000","last_unstale":"2023-10-09T11:41:29.627487+0000","last_undegraded":"2023-10-09T11:41:29.627487+0000","last_fullsized":"2023-10-09T11:41:29.627487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:58.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613816+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628141+0000","last_change":"2023-10-09T11:41:29.622285+0000","last_active":"2023-10-09T11:41:29.628141+0000","last_peered":"2023-10-09T11:41:29.628141+0000","last_clean":"2023-10-09T11:41:29.628141+0000","last_became_active":"2023-10-09T11:41:29.621974+0000","last_became_peered":"2023-10-09T11:41:29.621974+0000","last_unstale":"2023-10-09T11:41:29.628141+0000","last_undegraded":"2023-10-09T11:41:29.628141+0000","last_fullsized":"2023-10-09T11:41:29.628141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:53.801322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":227,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.621958+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:29.621958+0000","last_peered":"2023-10-09T11:41:29.621958+0000","last_clean":"2023-10-09T11:41:29.621958+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:29.621958+0000","last_undegraded":"2023-10-09T11:41:29.621958+0000","last_fullsized":"2023-10-09T11:41:29.621958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542225,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":1822720,"data_stored":1120061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.496},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.35099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542225,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.498}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302560,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069280,"statfs":{"total":96636764160,"available":96326942720,"internally_reserved":0,"allocated":1204224,"data_stored":516667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.624},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.64000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298488,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073352,"statfs":{"total":96636764160,"available":96331112448,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:34.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:34.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.875+0000 7f58a3d79700 1 Processor -- start 2023-10-09T11:41:34.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.875+0000 7f58a3d79700 1 -- start start 2023-10-09T11:41:34.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a3d79700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f589c0cb970 0x7f589c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a3d79700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c15ae40 con 0x7f589c15a400 2023-10-09T11:41:34.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a3d79700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c15ab60 con 0x7f589c0cb5a0 2023-10-09T11:41:34.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a3d79700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c0ce0f0 con 0x7f589c0cb970 2023-10-09T11:41:34.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a1314700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f589c0cb970 0x7f589c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a2316700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f589c15a400 0x7f589c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38568/0 (socket says 172.21.15.26:38568) 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.876+0000 7f58a2316700 1 -- 172.21.15.26:0/1094829140 learned_addr learned my addr 172.21.15.26:0/1094829140 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a1314700 1 -- 172.21.15.26:0/1094829140 >> v1:172.21.15.67:6789/0 conn(0x7f589c0cb5a0 legacy=0x7f589c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a1314700 1 -- 172.21.15.26:0/1094829140 >> v1:172.21.15.26:6789/0 conn(0x7f589c15a400 legacy=0x7f589c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a1314700 1 -- 172.21.15.26:0/1094829140 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c0ccf00 con 0x7f589c0cb970 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a0b13700 1 -- 172.21.15.26:0/1094829140 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297391355 0 0) 0x7f589c15ae40 con 0x7f589c15a400 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a1314700 1 --2- 172.21.15.26:0/1094829140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c0cb970 0x7f589c159ec0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f58900098e0 tx=0x7f58900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1616a90ffb1066ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a0b13700 1 -- 172.21.15.26:0/1094829140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890009e80 con 0x7f589c0cb970 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a0b13700 1 -- 172.21.15.26:0/1094829140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000b820 con 0x7f589c0cb970 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a0b13700 1 -- 172.21.15.26:0/1094829140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000bba0 con 0x7f589c0cb970 2023-10-09T11:41:34.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a3d79700 1 -- 172.21.15.26:0/1094829140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c0cb970 msgr2=0x7f589c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a3d79700 1 --2- 172.21.15.26:0/1094829140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c0cb970 0x7f589c159ec0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f58900098e0 tx=0x7f58900091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a3d79700 1 -- 172.21.15.26:0/1094829140 shutdown_connections 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a3d79700 1 --2- 172.21.15.26:0/1094829140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c0cb970 0x7f589c159ec0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.877+0000 7f58a3d79700 1 -- 172.21.15.26:0/1094829140 >> 172.21.15.26:0/1094829140 conn(0x7f589c070e30 msgr2=0x7f589c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.878+0000 7f58a3d79700 1 -- 172.21.15.26:0/1094829140 shutdown_connections 2023-10-09T11:41:34.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.878+0000 7f58a3d79700 1 -- 172.21.15.26:0/1094829140 wait complete. 2023-10-09T11:41:34.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 Processor -- start 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 -- start start 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f589c0cb5a0 0x7f589c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f589c0cb970 0x7f589c16c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c14dd00 con 0x7f589c15a400 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c16d020 con 0x7f589c0cb5a0 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.879+0000 7f58a3d79700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c16d2c0 con 0x7f589c0cb970 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59652/0 (socket says 172.21.15.26:59652) 2023-10-09T11:41:34.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 -- 172.21.15.26:0/3745493472 learned_addr learned my addr 172.21.15.26:0/3745493472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a1314700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f589c0cb970 0x7f589c16c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a1b15700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f589c0cb5a0 0x7f589c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 -- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f589c0cb970 msgr2=0x7f589c16c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f589c0cb970 0x7f589c16c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 -- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f589c0cb5a0 msgr2=0x7f589c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f589c0cb5a0 0x7f589c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 -- 172.21.15.26:0/3745493472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009420 con 0x7f589c15a400 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a2316700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7e0 tx=0x7f5894007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894005c00 con 0x7f589c15a400 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894005d80 con 0x7f589c15a400 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894007320 con 0x7f589c15a400 2023-10-09T11:41:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c16d5a0 con 0x7f589c15a400 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.880+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c16db60 con 0x7f589c15a400 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.881+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589c16dd50 con 0x7f589c15a400 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.882+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f589401b3b0 con 0x7f589c15a400 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.882+0000 7f5899ffb700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 0x7f5888069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.882+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5894083eb0 con 0x7f589c15a400 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.882+0000 7f58a1b15700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 0x7f5888069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.883+0000 7f58a1b15700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 0x7f5888069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f588c007560 tx=0x7f588c009760 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:34.886+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5894050d10 con 0x7f589c15a400 2023-10-09T11:41:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.075+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f589c04c3c0 con 0x7f5888067290 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.084+0000 7f5899ffb700 1 -- 172.21.15.26:0/3745493472 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288199 (secure 0 0 0) 0x7f589c04c3c0 con 0x7f5888067290 2023-10-09T11:41:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 msgr2=0x7f5888069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 0x7f5888069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f588c007560 tx=0x7f588c009760 comp rx=0 tx=0).stop 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 msgr2=0x7f589c0b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7e0 tx=0x7f5894007d90 comp rx=0 tx=0).stop 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 shutdown_connections 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589c15a400 0x7f589c0b22f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f589c0cb5a0 0x7f589c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5888067290 0x7f5888069740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 --2- 172.21.15.26:0/3745493472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f589c0cb970 0x7f589c16c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.087+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 >> 172.21.15.26:0/3745493472 conn(0x7f589c070e30 msgr2=0x7f589c155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.088+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 shutdown_connections 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.088+0000 7f58a3d79700 1 -- 172.21.15.26:0/3745493472 wait complete. 2023-10-09T11:41:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:35.101 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2023-10-09T11:41:33.195514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590992,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417680,"kb_used_data":10704,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752557040,"statfs":{"total":773094113280,"available":770618408960,"internally_reserved":0,"allocated":10960896,"data_stored":5385035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.585892"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197968+0000","last_change":"2023-10-09T11:41:30.198091+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197968+0000","last_undegraded":"2023-10-09T11:41:30.197968+0000","last_fullsized":"2023-10-09T11:41:30.197968+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208578+0000","last_change":"2023-10-09T11:41:30.205032+0000","last_active":"2023-10-09T11:41:30.208578+0000","last_peered":"2023-10-09T11:41:30.208578+0000","last_clean":"2023-10-09T11:41:30.208578+0000","last_became_active":"2023-10-09T11:41:30.204713+0000","last_became_peered":"2023-10-09T11:41:30.204713+0000","last_unstale":"2023-10-09T11:41:30.208578+0000","last_undegraded":"2023-10-09T11:41:30.208578+0000","last_fullsized":"2023-10-09T11:41:30.208578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:58.606943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213873+0000","last_change":"2023-10-09T11:41:30.213873+0000","last_active":"2023-10-09T11:41:30.213873+0000","last_peered":"2023-10-09T11:41:30.213873+0000","last_clean":"2023-10-09T11:41:30.213873+0000","last_became_active":"2023-10-09T11:41:30.211899+0000","last_became_peered":"2023-10-09T11:41:30.211899+0000","last_unstale":"2023-10-09T11:41:30.213873+0000","last_undegraded":"2023-10-09T11:41:30.213873+0000","last_fullsized":"2023-10-09T11:41:30.213873+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197283+0000","last_change":"2023-10-09T11:41:30.197408+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197283+0000","last_undegraded":"2023-10-09T11:41:30.197283+0000","last_fullsized":"2023-10-09T11:41:30.197283+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.194724+0000","last_change":"2023-10-09T11:41:30.194873+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.194724+0000","last_undegraded":"2023-10-09T11:41:30.194724+0000","last_fullsized":"2023-10-09T11:41:30.194724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195429+0000","last_change":"2023-10-09T11:41:30.195524+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195429+0000","last_undegraded":"2023-10-09T11:41:30.195429+0000","last_fullsized":"2023-10-09T11:41:30.195429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206501+0000","last_change":"2023-10-09T11:41:30.206501+0000","last_active":"2023-10-09T11:41:30.206501+0000","last_peered":"2023-10-09T11:41:30.206501+0000","last_clean":"2023-10-09T11:41:30.206501+0000","last_became_active":"2023-10-09T11:41:30.206209+0000","last_became_peered":"2023-10-09T11:41:30.206209+0000","last_unstale":"2023-10-09T11:41:30.206501+0000","last_undegraded":"2023-10-09T11:41:30.206501+0000","last_fullsized":"2023-10-09T11:41:30.206501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:12.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213958+0000","last_change":"2023-10-09T11:41:30.213958+0000","last_active":"2023-10-09T11:41:30.213958+0000","last_peered":"2023-10-09T11:41:30.213958+0000","last_clean":"2023-10-09T11:41:30.213958+0000","last_became_active":"2023-10-09T11:41:30.211379+0000","last_became_peered":"2023-10-09T11:41:30.211379+0000","last_unstale":"2023-10-09T11:41:30.213958+0000","last_undegraded":"2023-10-09T11:41:30.213958+0000","last_fullsized":"2023-10-09T11:41:30.213958+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200175+0000","last_change":"2023-10-09T11:41:30.200300+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200175+0000","last_undegraded":"2023-10-09T11:41:30.200175+0000","last_fullsized":"2023-10-09T11:41:30.200175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.199321+0000","last_change":"2023-10-09T11:41:30.199460+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.199321+0000","last_undegraded":"2023-10-09T11:41:30.199321+0000","last_fullsized":"2023-10-09T11:41:30.199321+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214475+0000","last_change":"2023-10-09T11:41:30.207113+0000","last_active":"2023-10-09T11:41:30.214475+0000","last_peered":"2023-10-09T11:41:30.214475+0000","last_clean":"2023-10-09T11:41:30.214475+0000","last_became_active":"2023-10-09T11:41:30.206810+0000","last_became_peered":"2023-10-09T11:41:30.206810+0000","last_unstale":"2023-10-09T11:41:30.214475+0000","last_undegraded":"2023-10-09T11:41:30.214475+0000","last_fullsized":"2023-10-09T11:41:30.214475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:00.677277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198585+0000","last_change":"2023-10-09T11:41:30.198699+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198585+0000","last_undegraded":"2023-10-09T11:41:30.198585+0000","last_fullsized":"2023-10-09T11:41:30.198585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211940+0000","last_change":"2023-10-09T11:41:30.211940+0000","last_active":"2023-10-09T11:41:30.211940+0000","last_peered":"2023-10-09T11:41:30.211940+0000","last_clean":"2023-10-09T11:41:30.211940+0000","last_became_active":"2023-10-09T11:41:30.211435+0000","last_became_peered":"2023-10-09T11:41:30.211435+0000","last_unstale":"2023-10-09T11:41:30.211940+0000","last_undegraded":"2023-10-09T11:41:30.211940+0000","last_fullsized":"2023-10-09T11:41:30.211940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212286+0000","last_change":"2023-10-09T11:41:30.212286+0000","last_active":"2023-10-09T11:41:30.212286+0000","last_peered":"2023-10-09T11:41:30.212286+0000","last_clean":"2023-10-09T11:41:30.212286+0000","last_became_active":"2023-10-09T11:41:30.211855+0000","last_became_peered":"2023-10-09T11:41:30.211855+0000","last_unstale":"2023-10-09T11:41:30.212286+0000","last_undegraded":"2023-10-09T11:41:30.212286+0000","last_fullsized":"2023-10-09T11:41:30.212286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195861+0000","last_change":"2023-10-09T11:41:30.195980+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195861+0000","last_undegraded":"2023-10-09T11:41:30.195861+0000","last_fullsized":"2023-10-09T11:41:30.195861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195992+0000","last_change":"2023-10-09T11:41:30.196777+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195992+0000","last_undegraded":"2023-10-09T11:41:30.195992+0000","last_fullsized":"2023-10-09T11:41:30.195992+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215491+0000","last_change":"2023-10-09T11:41:30.213001+0000","last_active":"2023-10-09T11:41:30.215491+0000","last_peered":"2023-10-09T11:41:30.215491+0000","last_clean":"2023-10-09T11:41:30.215491+0000","last_became_active":"2023-10-09T11:41:30.212689+0000","last_became_peered":"2023-10-09T11:41:30.212689+0000","last_unstale":"2023-10-09T11:41:30.215491+0000","last_undegraded":"2023-10-09T11:41:30.215491+0000","last_fullsized":"2023-10-09T11:41:30.215491+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:38.335285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216170+0000","last_change":"2023-10-09T11:41:30.210587+0000","last_active":"2023-10-09T11:41:30.216170+0000","last_peered":"2023-10-09T11:41:30.216170+0000","last_clean":"2023-10-09T11:41:30.216170+0000","last_became_active":"2023-10-09T11:41:30.210309+0000","last_became_peered":"2023-10-09T11:41:30.210309+0000","last_unstale":"2023-10-09T11:41:30.216170+0000","last_undegraded":"2023-10-09T11:41:30.216170+0000","last_fullsized":"2023-10-09T11:41:30.216170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214778+0000","last_change":"2023-10-09T11:41:30.214778+0000","last_active":"2023-10-09T11:41:30.214778+0000","last_peered":"2023-10-09T11:41:30.214778+0000","last_clean":"2023-10-09T11:41:30.214778+0000","last_became_active":"2023-10-09T11:41:30.214420+0000","last_became_peered":"2023-10-09T11:41:30.214420+0000","last_unstale":"2023-10-09T11:41:30.214778+0000","last_undegraded":"2023-10-09T11:41:30.214778+0000","last_fullsized":"2023-10-09T11:41:30.214778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215302+0000","last_change":"2023-10-09T11:41:30.211011+0000","last_active":"2023-10-09T11:41:30.215302+0000","last_peered":"2023-10-09T11:41:30.215302+0000","last_clean":"2023-10-09T11:41:30.215302+0000","last_became_active":"2023-10-09T11:41:30.210577+0000","last_became_peered":"2023-10-09T11:41:30.210577+0000","last_unstale":"2023-10-09T11:41:30.215302+0000","last_undegraded":"2023-10-09T11:41:30.215302+0000","last_fullsized":"2023-10-09T11:41:30.215302+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:23.812282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214638+0000","last_change":"2023-10-09T11:41:30.206829+0000","last_active":"2023-10-09T11:41:30.214638+0000","last_peered":"2023-10-09T11:41:30.214638+0000","last_clean":"2023-10-09T11:41:30.214638+0000","last_became_active":"2023-10-09T11:41:30.206191+0000","last_became_peered":"2023-10-09T11:41:30.206191+0000","last_unstale":"2023-10-09T11:41:30.214638+0000","last_undegraded":"2023-10-09T11:41:30.214638+0000","last_fullsized":"2023-10-09T11:41:30.214638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:03.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.615634+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214555+0000","last_change":"2023-10-09T11:41:30.208259+0000","last_active":"2023-10-09T11:41:30.214555+0000","last_peered":"2023-10-09T11:41:30.214555+0000","last_clean":"2023-10-09T11:41:30.214555+0000","last_became_active":"2023-10-09T11:41:30.207545+0000","last_became_peered":"2023-10-09T11:41:30.207545+0000","last_unstale":"2023-10-09T11:41:30.214555+0000","last_undegraded":"2023-10-09T11:41:30.214555+0000","last_fullsized":"2023-10-09T11:41:30.214555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:00.236671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.614365+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214520+0000","last_change":"2023-10-09T11:41:30.207785+0000","last_active":"2023-10-09T11:41:30.214520+0000","last_peered":"2023-10-09T11:41:30.214520+0000","last_clean":"2023-10-09T11:41:30.214520+0000","last_became_active":"2023-10-09T11:41:30.207389+0000","last_became_peered":"2023-10-09T11:41:30.207389+0000","last_unstale":"2023-10-09T11:41:30.214520+0000","last_undegraded":"2023-10-09T11:41:30.214520+0000","last_fullsized":"2023-10-09T11:41:30.214520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197350+0000","last_change":"2023-10-09T11:41:30.199585+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197350+0000","last_undegraded":"2023-10-09T11:41:30.197350+0000","last_fullsized":"2023-10-09T11:41:30.197350+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196868+0000","last_change":"2023-10-09T11:41:30.196964+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196868+0000","last_undegraded":"2023-10-09T11:41:30.196868+0000","last_fullsized":"2023-10-09T11:41:30.196868+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613142+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215621+0000","last_change":"2023-10-09T11:41:30.213841+0000","last_active":"2023-10-09T11:41:30.215621+0000","last_peered":"2023-10-09T11:41:30.215621+0000","last_clean":"2023-10-09T11:41:30.215621+0000","last_became_active":"2023-10-09T11:41:30.213550+0000","last_became_peered":"2023-10-09T11:41:30.213550+0000","last_unstale":"2023-10-09T11:41:30.215621+0000","last_undegraded":"2023-10-09T11:41:30.215621+0000","last_fullsized":"2023-10-09T11:41:30.215621+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:31.671775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201875+0000","last_change":"2023-10-09T11:41:30.201875+0000","last_active":"2023-10-09T11:41:30.201875+0000","last_peered":"2023-10-09T11:41:30.201875+0000","last_clean":"2023-10-09T11:41:30.201875+0000","last_became_active":"2023-10-09T11:41:30.201565+0000","last_became_peered":"2023-10-09T11:41:30.201565+0000","last_unstale":"2023-10-09T11:41:30.201875+0000","last_undegraded":"2023-10-09T11:41:30.201875+0000","last_fullsized":"2023-10-09T11:41:30.201875+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:30.544630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":7,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203053+0000","last_change":"2023-10-09T11:41:30.203132+0000","last_active":"2023-10-09T11:41:30.203053+0000","last_peered":"2023-10-09T11:41:30.203053+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"2023-10-09T11:41:30.202467+0000","last_became_peered":"2023-10-09T11:41:30.202467+0000","last_unstale":"2023-10-09T11:41:30.203053+0000","last_undegraded":"2023-10-09T11:41:30.203053+0000","last_fullsized":"2023-10-09T11:41:30.203053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:28.546094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198195+0000","last_change":"2023-10-09T11:41:30.198324+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198195+0000","last_undegraded":"2023-10-09T11:41:30.198195+0000","last_fullsized":"2023-10-09T11:41:30.198195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197315+0000","last_change":"2023-10-09T11:41:30.197440+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197315+0000","last_undegraded":"2023-10-09T11:41:30.197315+0000","last_fullsized":"2023-10-09T11:41:30.197315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618361+0000","last_change":"2023-10-09T11:41:29.626042+0000","last_active":"2023-10-09T11:41:30.618361+0000","last_peered":"2023-10-09T11:41:30.618361+0000","last_clean":"2023-10-09T11:41:30.618361+0000","last_became_active":"2023-10-09T11:41:29.625587+0000","last_became_peered":"2023-10-09T11:41:29.625587+0000","last_unstale":"2023-10-09T11:41:30.618361+0000","last_undegraded":"2023-10-09T11:41:30.618361+0000","last_fullsized":"2023-10-09T11:41:30.618361+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:40.925799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216384+0000","last_change":"2023-10-09T11:41:30.213412+0000","last_active":"2023-10-09T11:41:30.216384+0000","last_peered":"2023-10-09T11:41:30.216384+0000","last_clean":"2023-10-09T11:41:30.216384+0000","last_became_active":"2023-10-09T11:41:30.213141+0000","last_became_peered":"2023-10-09T11:41:30.213141+0000","last_unstale":"2023-10-09T11:41:30.216384+0000","last_undegraded":"2023-10-09T11:41:30.216384+0000","last_fullsized":"2023-10-09T11:41:30.216384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:20.601709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202381+0000","last_change":"2023-10-09T11:41:29.629629+0000","last_active":"2023-10-09T11:41:30.202381+0000","last_peered":"2023-10-09T11:41:30.202381+0000","last_clean":"2023-10-09T11:41:30.202381+0000","last_became_active":"2023-10-09T11:41:29.629294+0000","last_became_peered":"2023-10-09T11:41:29.629294+0000","last_unstale":"2023-10-09T11:41:30.202381+0000","last_undegraded":"2023-10-09T11:41:30.202381+0000","last_fullsized":"2023-10-09T11:41:30.202381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:48.066109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197734+0000","last_change":"2023-10-09T11:41:30.197856+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197734+0000","last_undegraded":"2023-10-09T11:41:30.197734+0000","last_fullsized":"2023-10-09T11:41:30.197734+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629816+0000","last_change":"2023-10-09T11:41:29.624723+0000","last_active":"2023-10-09T11:41:29.629816+0000","last_peered":"2023-10-09T11:41:29.629816+0000","last_clean":"2023-10-09T11:41:29.629816+0000","last_became_active":"2023-10-09T11:41:29.624446+0000","last_became_peered":"2023-10-09T11:41:29.624446+0000","last_unstale":"2023-10-09T11:41:29.629816+0000","last_undegraded":"2023-10-09T11:41:29.629816+0000","last_fullsized":"2023-10-09T11:41:29.629816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:24.501718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214087+0000","last_change":"2023-10-09T11:41:30.214087+0000","last_active":"2023-10-09T11:41:30.214087+0000","last_peered":"2023-10-09T11:41:30.214087+0000","last_clean":"2023-10-09T11:41:30.214087+0000","last_became_active":"2023-10-09T11:41:30.212251+0000","last_became_peered":"2023-10-09T11:41:30.212251+0000","last_unstale":"2023-10-09T11:41:30.214087+0000","last_undegraded":"2023-10-09T11:41:30.214087+0000","last_fullsized":"2023-10-09T11:41:30.214087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630635+0000","last_change":"2023-10-09T11:41:29.627113+0000","last_active":"2023-10-09T11:41:29.630635+0000","last_peered":"2023-10-09T11:41:29.630635+0000","last_clean":"2023-10-09T11:41:29.630635+0000","last_became_active":"2023-10-09T11:41:29.626832+0000","last_became_peered":"2023-10-09T11:41:29.626832+0000","last_unstale":"2023-10-09T11:41:29.630635+0000","last_undegraded":"2023-10-09T11:41:29.630635+0000","last_fullsized":"2023-10-09T11:41:29.630635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.078822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196474+0000","last_change":"2023-10-09T11:41:30.196607+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196474+0000","last_undegraded":"2023-10-09T11:41:30.196474+0000","last_fullsized":"2023-10-09T11:41:30.196474+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193718+0000","last_change":"2023-10-09T11:41:29.624687+0000","last_active":"2023-10-09T11:41:30.193718+0000","last_peered":"2023-10-09T11:41:30.193718+0000","last_clean":"2023-10-09T11:41:30.193718+0000","last_became_active":"2023-10-09T11:41:29.622838+0000","last_became_peered":"2023-10-09T11:41:29.622838+0000","last_unstale":"2023-10-09T11:41:30.193718+0000","last_undegraded":"2023-10-09T11:41:30.193718+0000","last_fullsized":"2023-10-09T11:41:30.193718+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:07.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215152+0000","last_change":"2023-10-09T11:41:30.210327+0000","last_active":"2023-10-09T11:41:30.215152+0000","last_peered":"2023-10-09T11:41:30.215152+0000","last_clean":"2023-10-09T11:41:30.215152+0000","last_became_active":"2023-10-09T11:41:30.209999+0000","last_became_peered":"2023-10-09T11:41:30.209999+0000","last_unstale":"2023-10-09T11:41:30.215152+0000","last_undegraded":"2023-10-09T11:41:30.215152+0000","last_fullsized":"2023-10-09T11:41:30.215152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.622757+0000","last_change":"2023-10-09T11:41:29.622757+0000","last_active":"2023-10-09T11:41:29.622757+0000","last_peered":"2023-10-09T11:41:29.622757+0000","last_clean":"2023-10-09T11:41:29.622757+0000","last_became_active":"2023-10-09T11:41:29.622405+0000","last_became_peered":"2023-10-09T11:41:29.622405+0000","last_unstale":"2023-10-09T11:41:29.622757+0000","last_undegraded":"2023-10-09T11:41:29.622757+0000","last_fullsized":"2023-10-09T11:41:29.622757+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:37.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196467+0000","last_change":"2023-10-09T11:41:30.196593+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196467+0000","last_undegraded":"2023-10-09T11:41:30.196467+0000","last_fullsized":"2023-10-09T11:41:30.196467+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197823+0000","last_change":"2023-10-09T11:41:29.626941+0000","last_active":"2023-10-09T11:41:30.197823+0000","last_peered":"2023-10-09T11:41:30.197823+0000","last_clean":"2023-10-09T11:41:30.197823+0000","last_became_active":"2023-10-09T11:41:29.626666+0000","last_became_peered":"2023-10-09T11:41:29.626666+0000","last_unstale":"2023-10-09T11:41:30.197823+0000","last_undegraded":"2023-10-09T11:41:30.197823+0000","last_fullsized":"2023-10-09T11:41:30.197823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:10.194833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206394+0000","last_change":"2023-10-09T11:41:30.206394+0000","last_active":"2023-10-09T11:41:30.206394+0000","last_peered":"2023-10-09T11:41:30.206394+0000","last_clean":"2023-10-09T11:41:30.206394+0000","last_became_active":"2023-10-09T11:41:30.206062+0000","last_became_peered":"2023-10-09T11:41:30.206062+0000","last_unstale":"2023-10-09T11:41:30.206394+0000","last_undegraded":"2023-10-09T11:41:30.206394+0000","last_fullsized":"2023-10-09T11:41:30.206394+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:41.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630515+0000","last_change":"2023-10-09T11:41:29.626745+0000","last_active":"2023-10-09T11:41:29.630515+0000","last_peered":"2023-10-09T11:41:29.630515+0000","last_clean":"2023-10-09T11:41:29.630515+0000","last_became_active":"2023-10-09T11:41:29.626206+0000","last_became_peered":"2023-10-09T11:41:29.626206+0000","last_unstale":"2023-10-09T11:41:29.630515+0000","last_undegraded":"2023-10-09T11:41:29.630515+0000","last_fullsized":"2023-10-09T11:41:29.630515+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:25.951409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201154+0000","last_change":"2023-10-09T11:41:30.201154+0000","last_active":"2023-10-09T11:41:30.201154+0000","last_peered":"2023-10-09T11:41:30.201154+0000","last_clean":"2023-10-09T11:41:30.201154+0000","last_became_active":"2023-10-09T11:41:30.200791+0000","last_became_peered":"2023-10-09T11:41:30.200791+0000","last_unstale":"2023-10-09T11:41:30.201154+0000","last_undegraded":"2023-10-09T11:41:30.201154+0000","last_fullsized":"2023-10-09T11:41:30.201154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630333+0000","last_change":"2023-10-09T11:41:29.626711+0000","last_active":"2023-10-09T11:41:29.630333+0000","last_peered":"2023-10-09T11:41:29.630333+0000","last_clean":"2023-10-09T11:41:29.630333+0000","last_became_active":"2023-10-09T11:41:29.626341+0000","last_became_peered":"2023-10-09T11:41:29.626341+0000","last_unstale":"2023-10-09T11:41:29.630333+0000","last_undegraded":"2023-10-09T11:41:29.630333+0000","last_fullsized":"2023-10-09T11:41:29.630333+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.711584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214896+0000","last_change":"2023-10-09T11:41:30.206248+0000","last_active":"2023-10-09T11:41:30.214896+0000","last_peered":"2023-10-09T11:41:30.214896+0000","last_clean":"2023-10-09T11:41:30.214896+0000","last_became_active":"2023-10-09T11:41:30.205788+0000","last_became_peered":"2023-10-09T11:41:30.205788+0000","last_unstale":"2023-10-09T11:41:30.214896+0000","last_undegraded":"2023-10-09T11:41:30.214896+0000","last_fullsized":"2023-10-09T11:41:30.214896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.624261+0000","last_change":"2023-10-09T11:41:29.624261+0000","last_active":"2023-10-09T11:41:29.624261+0000","last_peered":"2023-10-09T11:41:29.624261+0000","last_clean":"2023-10-09T11:41:29.624261+0000","last_became_active":"2023-10-09T11:41:29.623990+0000","last_became_peered":"2023-10-09T11:41:29.623990+0000","last_unstale":"2023-10-09T11:41:29.624261+0000","last_undegraded":"2023-10-09T11:41:29.624261+0000","last_fullsized":"2023-10-09T11:41:29.624261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:57.602272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612603+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:35.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625454+0000","last_change":"2023-10-09T11:41:29.625454+0000","last_active":"2023-10-09T11:41:29.625454+0000","last_peered":"2023-10-09T11:41:29.625454+0000","last_clean":"2023-10-09T11:41:29.625454+0000","last_became_active":"2023-10-09T11:41:29.624809+0000","last_became_peered":"2023-10-09T11:41:29.624809+0000","last_unstale":"2023-10-09T11:41:29.625454+0000","last_undegraded":"2023-10-09T11:41:29.625454+0000","last_fullsized":"2023-10-09T11:41:29.625454+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:56.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212455+0000","last_change":"2023-10-09T11:41:30.212455+0000","last_active":"2023-10-09T11:41:30.212455+0000","last_peered":"2023-10-09T11:41:30.212455+0000","last_clean":"2023-10-09T11:41:30.212455+0000","last_became_active":"2023-10-09T11:41:30.212151+0000","last_became_peered":"2023-10-09T11:41:30.212151+0000","last_unstale":"2023-10-09T11:41:30.212455+0000","last_undegraded":"2023-10-09T11:41:30.212455+0000","last_fullsized":"2023-10-09T11:41:30.212455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:37.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628591+0000","last_change":"2023-10-09T11:41:29.625291+0000","last_active":"2023-10-09T11:41:29.628591+0000","last_peered":"2023-10-09T11:41:29.628591+0000","last_clean":"2023-10-09T11:41:29.628591+0000","last_became_active":"2023-10-09T11:41:29.624992+0000","last_became_peered":"2023-10-09T11:41:29.624992+0000","last_unstale":"2023-10-09T11:41:29.628591+0000","last_undegraded":"2023-10-09T11:41:29.628591+0000","last_fullsized":"2023-10-09T11:41:29.628591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:50.027818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613794+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:02.911516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629864+0000","last_change":"2023-10-09T11:41:29.626334+0000","last_active":"2023-10-09T11:41:29.629864+0000","last_peered":"2023-10-09T11:41:29.629864+0000","last_clean":"2023-10-09T11:41:29.629864+0000","last_became_active":"2023-10-09T11:41:29.625700+0000","last_became_peered":"2023-10-09T11:41:29.625700+0000","last_unstale":"2023-10-09T11:41:29.629864+0000","last_undegraded":"2023-10-09T11:41:29.629864+0000","last_fullsized":"2023-10-09T11:41:29.629864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:38.376341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612494+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:50.665102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197765+0000","last_change":"2023-10-09T11:41:29.628526+0000","last_active":"2023-10-09T11:41:30.197765+0000","last_peered":"2023-10-09T11:41:30.197765+0000","last_clean":"2023-10-09T11:41:30.197765+0000","last_became_active":"2023-10-09T11:41:29.628346+0000","last_became_peered":"2023-10-09T11:41:29.628346+0000","last_unstale":"2023-10-09T11:41:30.197765+0000","last_undegraded":"2023-10-09T11:41:30.197765+0000","last_fullsized":"2023-10-09T11:41:30.197765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:11.803064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613205+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:44.510367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630825+0000","last_change":"2023-10-09T11:41:29.628993+0000","last_active":"2023-10-09T11:41:29.630825+0000","last_peered":"2023-10-09T11:41:29.630825+0000","last_clean":"2023-10-09T11:41:29.630825+0000","last_became_active":"2023-10-09T11:41:29.628689+0000","last_became_peered":"2023-10-09T11:41:29.628689+0000","last_unstale":"2023-10-09T11:41:29.630825+0000","last_undegraded":"2023-10-09T11:41:29.630825+0000","last_fullsized":"2023-10-09T11:41:29.630825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:47.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195206+0000","last_change":"2023-10-09T11:41:30.195331+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195206+0000","last_undegraded":"2023-10-09T11:41:30.195206+0000","last_fullsized":"2023-10-09T11:41:30.195206+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627947+0000","last_change":"2023-10-09T11:41:29.627947+0000","last_active":"2023-10-09T11:41:29.627947+0000","last_peered":"2023-10-09T11:41:29.627947+0000","last_clean":"2023-10-09T11:41:29.627947+0000","last_became_active":"2023-10-09T11:41:29.627683+0000","last_became_peered":"2023-10-09T11:41:29.627683+0000","last_unstale":"2023-10-09T11:41:29.627947+0000","last_undegraded":"2023-10-09T11:41:29.627947+0000","last_fullsized":"2023-10-09T11:41:29.627947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:34.004467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197755+0000","last_change":"2023-10-09T11:41:30.197903+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197755+0000","last_undegraded":"2023-10-09T11:41:30.197755+0000","last_fullsized":"2023-10-09T11:41:30.197755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625667+0000","last_change":"2023-10-09T11:41:29.622774+0000","last_active":"2023-10-09T11:41:29.625667+0000","last_peered":"2023-10-09T11:41:29.625667+0000","last_clean":"2023-10-09T11:41:29.625667+0000","last_became_active":"2023-10-09T11:41:29.622497+0000","last_became_peered":"2023-10-09T11:41:29.622497+0000","last_unstale":"2023-10-09T11:41:29.625667+0000","last_undegraded":"2023-10-09T11:41:29.625667+0000","last_fullsized":"2023-10-09T11:41:29.625667+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:17.226611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212307+0000","last_change":"2023-10-09T11:41:30.212307+0000","last_active":"2023-10-09T11:41:30.212307+0000","last_peered":"2023-10-09T11:41:30.212307+0000","last_clean":"2023-10-09T11:41:30.212307+0000","last_became_active":"2023-10-09T11:41:30.211263+0000","last_became_peered":"2023-10-09T11:41:30.211263+0000","last_unstale":"2023-10-09T11:41:30.212307+0000","last_undegraded":"2023-10-09T11:41:30.212307+0000","last_fullsized":"2023-10-09T11:41:30.212307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617971+0000","last_change":"2023-10-09T11:41:29.624896+0000","last_active":"2023-10-09T11:41:30.617971+0000","last_peered":"2023-10-09T11:41:30.617971+0000","last_clean":"2023-10-09T11:41:30.617971+0000","last_became_active":"2023-10-09T11:41:29.624643+0000","last_became_peered":"2023-10-09T11:41:29.624643+0000","last_unstale":"2023-10-09T11:41:30.617971+0000","last_undegraded":"2023-10-09T11:41:30.617971+0000","last_fullsized":"2023-10-09T11:41:30.617971+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:40.658382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214279+0000","last_change":"2023-10-09T11:41:30.214279+0000","last_active":"2023-10-09T11:41:30.214279+0000","last_peered":"2023-10-09T11:41:30.214279+0000","last_clean":"2023-10-09T11:41:30.214279+0000","last_became_active":"2023-10-09T11:41:30.212519+0000","last_became_peered":"2023-10-09T11:41:30.212519+0000","last_unstale":"2023-10-09T11:41:30.214279+0000","last_undegraded":"2023-10-09T11:41:30.214279+0000","last_fullsized":"2023-10-09T11:41:30.214279+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628363+0000","last_change":"2023-10-09T11:41:29.623446+0000","last_active":"2023-10-09T11:41:29.628363+0000","last_peered":"2023-10-09T11:41:29.628363+0000","last_clean":"2023-10-09T11:41:29.628363+0000","last_became_active":"2023-10-09T11:41:29.623199+0000","last_became_peered":"2023-10-09T11:41:29.623199+0000","last_unstale":"2023-10-09T11:41:29.628363+0000","last_undegraded":"2023-10-09T11:41:29.628363+0000","last_fullsized":"2023-10-09T11:41:29.628363+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:57.601464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212736+0000","last_change":"2023-10-09T11:41:30.212736+0000","last_active":"2023-10-09T11:41:30.212736+0000","last_peered":"2023-10-09T11:41:30.212736+0000","last_clean":"2023-10-09T11:41:30.212736+0000","last_became_active":"2023-10-09T11:41:30.211249+0000","last_became_peered":"2023-10-09T11:41:30.211249+0000","last_unstale":"2023-10-09T11:41:30.212736+0000","last_undegraded":"2023-10-09T11:41:30.212736+0000","last_fullsized":"2023-10-09T11:41:30.212736+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629881+0000","last_change":"2023-10-09T11:41:29.626531+0000","last_active":"2023-10-09T11:41:29.629881+0000","last_peered":"2023-10-09T11:41:29.629881+0000","last_clean":"2023-10-09T11:41:29.629881+0000","last_became_active":"2023-10-09T11:41:29.626069+0000","last_became_peered":"2023-10-09T11:41:29.626069+0000","last_unstale":"2023-10-09T11:41:29.629881+0000","last_undegraded":"2023-10-09T11:41:29.629881+0000","last_fullsized":"2023-10-09T11:41:29.629881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:57.065033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196825+0000","last_change":"2023-10-09T11:41:30.196943+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196825+0000","last_undegraded":"2023-10-09T11:41:30.196825+0000","last_fullsized":"2023-10-09T11:41:30.196825+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630294+0000","last_change":"2023-10-09T11:41:29.626659+0000","last_active":"2023-10-09T11:41:29.630294+0000","last_peered":"2023-10-09T11:41:29.630294+0000","last_clean":"2023-10-09T11:41:29.630294+0000","last_became_active":"2023-10-09T11:41:29.626359+0000","last_became_peered":"2023-10-09T11:41:29.626359+0000","last_unstale":"2023-10-09T11:41:29.630294+0000","last_undegraded":"2023-10-09T11:41:29.630294+0000","last_fullsized":"2023-10-09T11:41:29.630294+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:15.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213139+0000","last_change":"2023-10-09T11:41:30.213139+0000","last_active":"2023-10-09T11:41:30.213139+0000","last_peered":"2023-10-09T11:41:30.213139+0000","last_clean":"2023-10-09T11:41:30.213139+0000","last_became_active":"2023-10-09T11:41:30.212582+0000","last_became_peered":"2023-10-09T11:41:30.212582+0000","last_unstale":"2023-10-09T11:41:30.213139+0000","last_undegraded":"2023-10-09T11:41:30.213139+0000","last_fullsized":"2023-10-09T11:41:30.213139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629838+0000","last_change":"2023-10-09T11:41:29.628284+0000","last_active":"2023-10-09T11:41:29.629838+0000","last_peered":"2023-10-09T11:41:29.629838+0000","last_clean":"2023-10-09T11:41:29.629838+0000","last_became_active":"2023-10-09T11:41:29.627998+0000","last_became_peered":"2023-10-09T11:41:29.627998+0000","last_unstale":"2023-10-09T11:41:29.629838+0000","last_undegraded":"2023-10-09T11:41:29.629838+0000","last_fullsized":"2023-10-09T11:41:29.629838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:54.858809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.612687+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:41.609711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627507+0000","last_change":"2023-10-09T11:41:29.623589+0000","last_active":"2023-10-09T11:41:29.627507+0000","last_peered":"2023-10-09T11:41:29.627507+0000","last_clean":"2023-10-09T11:41:29.627507+0000","last_became_active":"2023-10-09T11:41:29.622865+0000","last_became_peered":"2023-10-09T11:41:29.622865+0000","last_unstale":"2023-10-09T11:41:29.627507+0000","last_undegraded":"2023-10-09T11:41:29.627507+0000","last_fullsized":"2023-10-09T11:41:29.627507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:58.673145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215946+0000","last_change":"2023-10-09T11:41:30.208877+0000","last_active":"2023-10-09T11:41:30.215946+0000","last_peered":"2023-10-09T11:41:30.215946+0000","last_clean":"2023-10-09T11:41:30.215946+0000","last_became_active":"2023-10-09T11:41:30.208587+0000","last_became_peered":"2023-10-09T11:41:30.208587+0000","last_unstale":"2023-10-09T11:41:30.215946+0000","last_undegraded":"2023-10-09T11:41:30.215946+0000","last_fullsized":"2023-10-09T11:41:30.215946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:49.070780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629791+0000","last_change":"2023-10-09T11:41:29.629791+0000","last_active":"2023-10-09T11:41:29.629791+0000","last_peered":"2023-10-09T11:41:29.629791+0000","last_clean":"2023-10-09T11:41:29.629791+0000","last_became_active":"2023-10-09T11:41:29.629499+0000","last_became_peered":"2023-10-09T11:41:29.629499+0000","last_unstale":"2023-10-09T11:41:29.629791+0000","last_undegraded":"2023-10-09T11:41:29.629791+0000","last_fullsized":"2023-10-09T11:41:29.629791+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:30.667105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198280+0000","last_change":"2023-10-09T11:41:30.198399+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198280+0000","last_undegraded":"2023-10-09T11:41:30.198280+0000","last_fullsized":"2023-10-09T11:41:30.198280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202221+0000","last_change":"2023-10-09T11:41:29.626094+0000","last_active":"2023-10-09T11:41:30.202221+0000","last_peered":"2023-10-09T11:41:30.202221+0000","last_clean":"2023-10-09T11:41:30.202221+0000","last_became_active":"2023-10-09T11:41:29.625689+0000","last_became_peered":"2023-10-09T11:41:29.625689+0000","last_unstale":"2023-10-09T11:41:30.202221+0000","last_undegraded":"2023-10-09T11:41:30.202221+0000","last_fullsized":"2023-10-09T11:41:30.202221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:29.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200052+0000","last_change":"2023-10-09T11:41:30.200174+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200052+0000","last_undegraded":"2023-10-09T11:41:30.200052+0000","last_fullsized":"2023-10-09T11:41:30.200052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625772+0000","last_change":"2023-10-09T11:41:29.625772+0000","last_active":"2023-10-09T11:41:29.625772+0000","last_peered":"2023-10-09T11:41:29.625772+0000","last_clean":"2023-10-09T11:41:29.625772+0000","last_became_active":"2023-10-09T11:41:29.625181+0000","last_became_peered":"2023-10-09T11:41:29.625181+0000","last_unstale":"2023-10-09T11:41:29.625772+0000","last_undegraded":"2023-10-09T11:41:29.625772+0000","last_fullsized":"2023-10-09T11:41:29.625772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:29.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215988+0000","last_change":"2023-10-09T11:41:30.208985+0000","last_active":"2023-10-09T11:41:30.215988+0000","last_peered":"2023-10-09T11:41:30.215988+0000","last_clean":"2023-10-09T11:41:30.215988+0000","last_became_active":"2023-10-09T11:41:30.208686+0000","last_became_peered":"2023-10-09T11:41:30.208686+0000","last_unstale":"2023-10-09T11:41:30.215988+0000","last_undegraded":"2023-10-09T11:41:30.215988+0000","last_fullsized":"2023-10-09T11:41:30.215988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.624296+0000","last_change":"2023-10-09T11:41:29.624296+0000","last_active":"2023-10-09T11:41:29.624296+0000","last_peered":"2023-10-09T11:41:29.624296+0000","last_clean":"2023-10-09T11:41:29.624296+0000","last_became_active":"2023-10-09T11:41:29.623669+0000","last_became_peered":"2023-10-09T11:41:29.623669+0000","last_unstale":"2023-10-09T11:41:29.624296+0000","last_undegraded":"2023-10-09T11:41:29.624296+0000","last_fullsized":"2023-10-09T11:41:29.624296+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.232001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208773+0000","last_change":"2023-10-09T11:41:30.205259+0000","last_active":"2023-10-09T11:41:30.208773+0000","last_peered":"2023-10-09T11:41:30.208773+0000","last_clean":"2023-10-09T11:41:30.208773+0000","last_became_active":"2023-10-09T11:41:30.204932+0000","last_became_peered":"2023-10-09T11:41:30.204932+0000","last_unstale":"2023-10-09T11:41:30.208773+0000","last_undegraded":"2023-10-09T11:41:30.208773+0000","last_fullsized":"2023-10-09T11:41:30.208773+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:38.539477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628391+0000","last_change":"2023-10-09T11:41:29.622849+0000","last_active":"2023-10-09T11:41:29.628391+0000","last_peered":"2023-10-09T11:41:29.628391+0000","last_clean":"2023-10-09T11:41:29.628391+0000","last_became_active":"2023-10-09T11:41:29.622558+0000","last_became_peered":"2023-10-09T11:41:29.622558+0000","last_unstale":"2023-10-09T11:41:29.628391+0000","last_undegraded":"2023-10-09T11:41:29.628391+0000","last_fullsized":"2023-10-09T11:41:29.628391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:03.488670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214678+0000","last_change":"2023-10-09T11:41:30.207009+0000","last_active":"2023-10-09T11:41:30.214678+0000","last_peered":"2023-10-09T11:41:30.214678+0000","last_clean":"2023-10-09T11:41:30.214678+0000","last_became_active":"2023-10-09T11:41:30.206529+0000","last_became_peered":"2023-10-09T11:41:30.206529+0000","last_unstale":"2023-10-09T11:41:30.214678+0000","last_undegraded":"2023-10-09T11:41:30.214678+0000","last_fullsized":"2023-10-09T11:41:30.214678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197086+0000","last_change":"2023-10-09T11:41:29.624867+0000","last_active":"2023-10-09T11:41:30.197086+0000","last_peered":"2023-10-09T11:41:30.197086+0000","last_clean":"2023-10-09T11:41:30.197086+0000","last_became_active":"2023-10-09T11:41:29.624541+0000","last_became_peered":"2023-10-09T11:41:29.624541+0000","last_unstale":"2023-10-09T11:41:30.197086+0000","last_undegraded":"2023-10-09T11:41:30.197086+0000","last_fullsized":"2023-10-09T11:41:30.197086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:53.532131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216031+0000","last_change":"2023-10-09T11:41:30.216031+0000","last_active":"2023-10-09T11:41:30.216031+0000","last_peered":"2023-10-09T11:41:30.216031+0000","last_clean":"2023-10-09T11:41:30.216031+0000","last_became_active":"2023-10-09T11:41:30.215746+0000","last_became_peered":"2023-10-09T11:41:30.215746+0000","last_unstale":"2023-10-09T11:41:30.216031+0000","last_undegraded":"2023-10-09T11:41:30.216031+0000","last_fullsized":"2023-10-09T11:41:30.216031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629866+0000","last_change":"2023-10-09T11:41:29.624557+0000","last_active":"2023-10-09T11:41:29.629866+0000","last_peered":"2023-10-09T11:41:29.629866+0000","last_clean":"2023-10-09T11:41:29.629866+0000","last_became_active":"2023-10-09T11:41:29.624236+0000","last_became_peered":"2023-10-09T11:41:29.624236+0000","last_unstale":"2023-10-09T11:41:29.629866+0000","last_undegraded":"2023-10-09T11:41:29.629866+0000","last_fullsized":"2023-10-09T11:41:29.629866+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:01.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201532+0000","last_change":"2023-10-09T11:41:30.201532+0000","last_active":"2023-10-09T11:41:30.201532+0000","last_peered":"2023-10-09T11:41:30.201532+0000","last_clean":"2023-10-09T11:41:30.201532+0000","last_became_active":"2023-10-09T11:41:30.201154+0000","last_became_peered":"2023-10-09T11:41:30.201154+0000","last_unstale":"2023-10-09T11:41:30.201532+0000","last_undegraded":"2023-10-09T11:41:30.201532+0000","last_fullsized":"2023-10-09T11:41:30.201532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:39.734390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627487+0000","last_change":"2023-10-09T11:41:29.623414+0000","last_active":"2023-10-09T11:41:29.627487+0000","last_peered":"2023-10-09T11:41:29.627487+0000","last_clean":"2023-10-09T11:41:29.627487+0000","last_became_active":"2023-10-09T11:41:29.622500+0000","last_became_peered":"2023-10-09T11:41:29.622500+0000","last_unstale":"2023-10-09T11:41:29.627487+0000","last_undegraded":"2023-10-09T11:41:29.627487+0000","last_fullsized":"2023-10-09T11:41:29.627487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:58.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:29.600633+0000","last_change":"2023-10-09T11:41:29.613816+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:29.600633+0000","last_undegraded":"2023-10-09T11:41:29.600633+0000","last_fullsized":"2023-10-09T11:41:29.600633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628141+0000","last_change":"2023-10-09T11:41:29.622285+0000","last_active":"2023-10-09T11:41:29.628141+0000","last_peered":"2023-10-09T11:41:29.628141+0000","last_clean":"2023-10-09T11:41:29.628141+0000","last_became_active":"2023-10-09T11:41:29.621974+0000","last_became_peered":"2023-10-09T11:41:29.621974+0000","last_unstale":"2023-10-09T11:41:29.628141+0000","last_undegraded":"2023-10-09T11:41:29.628141+0000","last_fullsized":"2023-10-09T11:41:29.628141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:53.801322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":227,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.621958+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:29.621958+0000","last_peered":"2023-10-09T11:41:29.621958+0000","last_clean":"2023-10-09T11:41:29.621958+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:29.621958+0000","last_undegraded":"2023-10-09T11:41:29.621958+0000","last_fullsized":"2023-10-09T11:41:29.621958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542225,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":1822720,"data_stored":1120061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.496},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.35099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542225,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.498}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302560,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069280,"statfs":{"total":96636764160,"available":96326942720,"internally_reserved":0,"allocated":1204224,"data_stored":516667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.624},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.64000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298488,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073352,"statfs":{"total":96636764160,"available":96331112448,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:35.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 Processor -- start 2023-10-09T11:41:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 -- start start 2023-10-09T11:41:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb970 0x7f575c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f575c15a400 0x7f575c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c15ae40 con 0x7f575c0cb5a0 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c0ce0f0 con 0x7f575c15a400 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.260+0000 7f57610a6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0cbde0 con 0x7f575c0cb970 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f575c15a400 0x7f575c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f575c15a400 0x7f575c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59658/0 (socket says 172.21.15.26:59658) 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 -- 172.21.15.26:0/1663518700 learned_addr learned my addr 172.21.15.26:0/1663518700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575a59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb970 0x7f575c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f575c0cb5a0 0x7f575c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38584/0 (socket says 172.21.15.26:38584) 2023-10-09T11:41:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 -- 172.21.15.26:0/1663518700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb970 msgr2=0x7f575c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 --2- 172.21.15.26:0/1663518700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb970 0x7f575c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 -- 172.21.15.26:0/1663518700 >> v1:172.21.15.26:6789/0 conn(0x7f575c0cb5a0 legacy=0x7f575c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f5759d9b700 1 -- 172.21.15.26:0/1663518700 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755575030 0 0) 0x7f575c15ae40 con 0x7f575c0cb5a0 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 -- 172.21.15.26:0/1663518700 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c15ab60 con 0x7f575c15a400 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f575b59e700 1 --2- 172.21.15.26:0/1663518700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c156e90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5754009f50 tx=0x7f5754009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abcf1f9ca72f879 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f5759d9b700 1 -- 172.21.15.26:0/1663518700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400e070 con 0x7f575c15a400 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f5759d9b700 1 -- 172.21.15.26:0/1663518700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400b9c0 con 0x7f575c15a400 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.261+0000 7f5759d9b700 1 -- 172.21.15.26:0/1663518700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540092e0 con 0x7f575c15a400 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 -- 172.21.15.26:0/1663518700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 msgr2=0x7f575c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 --2- 172.21.15.26:0/1663518700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c156e90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5754009f50 tx=0x7f5754009840 comp rx=0 tx=0).stop 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 -- 172.21.15.26:0/1663518700 shutdown_connections 2023-10-09T11:41:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 --2- 172.21.15.26:0/1663518700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c156e90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 --2- 172.21.15.26:0/1663518700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb970 0x7f575c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 -- 172.21.15.26:0/1663518700 >> 172.21.15.26:0/1663518700 conn(0x7f575c070e30 msgr2=0x7f575c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 -- 172.21.15.26:0/1663518700 shutdown_connections 2023-10-09T11:41:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.262+0000 7f57610a6700 1 -- 172.21.15.26:0/1663518700 wait complete. 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.263+0000 7f57610a6700 1 Processor -- start 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.263+0000 7f57610a6700 1 -- start start 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 0x7f575c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 0x7f575c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0c7860 con 0x7f575c15a400 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0b5dd0 con 0x7f575c0cb970 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f57610a6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0b60b0 con 0x7f575c0cb5a0 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59660/0 (socket says 172.21.15.26:59660) 2023-10-09T11:41:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 -- 172.21.15.26:0/4250523574 learned_addr learned my addr 172.21.15.26:0/4250523574 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575a59c700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 0x7f575c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575ad9d700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 0x7f575c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 -- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 msgr2=0x7f575c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 0x7f575c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 -- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 msgr2=0x7f575c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 0x7f575c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575b59e700 1 -- 172.21.15.26:0/4250523574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009ae0 con 0x7f575c15a400 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575ad9d700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 0x7f575c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.264+0000 7f575a59c700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 0x7f575c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f575b59e700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f575400b6c0 tx=0x7f5754018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754008c70 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754008dd0 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754026690 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c0c7b00 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.265+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c1571a0 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.266+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c15a800 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.266+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5754003040 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.266+0000 7f5752ffd700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 0x7f573c069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.267+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5754086600 con 0x7f575c15a400 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.267+0000 7f575ad9d700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 0x7f573c069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.267+0000 7f575ad9d700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 0x7f573c069730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f574c007fd0 tx=0x7f574c007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.271+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57540534e0 con 0x7f575c15a400 2023-10-09T11:41:35.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.457+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f575c0c7cf0 con 0x7f573c067280 2023-10-09T11:41:35.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.466+0000 7f5752ffd700 1 -- 172.21.15.26:0/4250523574 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288601 (secure 0 0 0) 0x7f575c0c7cf0 con 0x7f573c067280 2023-10-09T11:41:35.471 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 msgr2=0x7f573c069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 0x7f573c069730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f574c007fd0 tx=0x7f574c007e30 comp rx=0 tx=0).stop 2023-10-09T11:41:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 msgr2=0x7f575c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f575400b6c0 tx=0x7f5754018000 comp rx=0 tx=0).stop 2023-10-09T11:41:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 shutdown_connections 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f575c15a400 0x7f575c153590 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f573c067280 0x7f573c069730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f575c0cb5a0 0x7f575c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 --2- 172.21.15.26:0/4250523574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575c0cb970 0x7f575c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 >> 172.21.15.26:0/4250523574 conn(0x7f575c070e30 msgr2=0x7f575c154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 shutdown_connections 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.469+0000 7f57610a6700 1 -- 172.21.15.26:0/4250523574 wait complete. 2023-10-09T11:41:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:35.483 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-09T11:41:35.196106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417732,"kb_used_data":10756,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556988,"statfs":{"total":773094113280,"available":770618355712,"internally_reserved":0,"allocated":11014144,"data_stored":5405955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001458"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197968+0000","last_change":"2023-10-09T11:41:30.198091+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197968+0000","last_undegraded":"2023-10-09T11:41:30.197968+0000","last_fullsized":"2023-10-09T11:41:30.197968+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208578+0000","last_change":"2023-10-09T11:41:30.205032+0000","last_active":"2023-10-09T11:41:30.208578+0000","last_peered":"2023-10-09T11:41:30.208578+0000","last_clean":"2023-10-09T11:41:30.208578+0000","last_became_active":"2023-10-09T11:41:30.204713+0000","last_became_peered":"2023-10-09T11:41:30.204713+0000","last_unstale":"2023-10-09T11:41:30.208578+0000","last_undegraded":"2023-10-09T11:41:30.208578+0000","last_fullsized":"2023-10-09T11:41:30.208578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:58.606943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213873+0000","last_change":"2023-10-09T11:41:30.213873+0000","last_active":"2023-10-09T11:41:30.213873+0000","last_peered":"2023-10-09T11:41:30.213873+0000","last_clean":"2023-10-09T11:41:30.213873+0000","last_became_active":"2023-10-09T11:41:30.211899+0000","last_became_peered":"2023-10-09T11:41:30.211899+0000","last_unstale":"2023-10-09T11:41:30.213873+0000","last_undegraded":"2023-10-09T11:41:30.213873+0000","last_fullsized":"2023-10-09T11:41:30.213873+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197283+0000","last_change":"2023-10-09T11:41:30.197408+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197283+0000","last_undegraded":"2023-10-09T11:41:30.197283+0000","last_fullsized":"2023-10-09T11:41:30.197283+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.194724+0000","last_change":"2023-10-09T11:41:30.194873+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.194724+0000","last_undegraded":"2023-10-09T11:41:30.194724+0000","last_fullsized":"2023-10-09T11:41:30.194724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195429+0000","last_change":"2023-10-09T11:41:30.195524+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195429+0000","last_undegraded":"2023-10-09T11:41:30.195429+0000","last_fullsized":"2023-10-09T11:41:30.195429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206501+0000","last_change":"2023-10-09T11:41:30.206501+0000","last_active":"2023-10-09T11:41:30.206501+0000","last_peered":"2023-10-09T11:41:30.206501+0000","last_clean":"2023-10-09T11:41:30.206501+0000","last_became_active":"2023-10-09T11:41:30.206209+0000","last_became_peered":"2023-10-09T11:41:30.206209+0000","last_unstale":"2023-10-09T11:41:30.206501+0000","last_undegraded":"2023-10-09T11:41:30.206501+0000","last_fullsized":"2023-10-09T11:41:30.206501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:12.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213958+0000","last_change":"2023-10-09T11:41:30.213958+0000","last_active":"2023-10-09T11:41:30.213958+0000","last_peered":"2023-10-09T11:41:30.213958+0000","last_clean":"2023-10-09T11:41:30.213958+0000","last_became_active":"2023-10-09T11:41:30.211379+0000","last_became_peered":"2023-10-09T11:41:30.211379+0000","last_unstale":"2023-10-09T11:41:30.213958+0000","last_undegraded":"2023-10-09T11:41:30.213958+0000","last_fullsized":"2023-10-09T11:41:30.213958+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200175+0000","last_change":"2023-10-09T11:41:30.200300+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200175+0000","last_undegraded":"2023-10-09T11:41:30.200175+0000","last_fullsized":"2023-10-09T11:41:30.200175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.199321+0000","last_change":"2023-10-09T11:41:30.199460+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.199321+0000","last_undegraded":"2023-10-09T11:41:30.199321+0000","last_fullsized":"2023-10-09T11:41:30.199321+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214475+0000","last_change":"2023-10-09T11:41:30.207113+0000","last_active":"2023-10-09T11:41:30.214475+0000","last_peered":"2023-10-09T11:41:30.214475+0000","last_clean":"2023-10-09T11:41:30.214475+0000","last_became_active":"2023-10-09T11:41:30.206810+0000","last_became_peered":"2023-10-09T11:41:30.206810+0000","last_unstale":"2023-10-09T11:41:30.214475+0000","last_undegraded":"2023-10-09T11:41:30.214475+0000","last_fullsized":"2023-10-09T11:41:30.214475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:00.677277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198585+0000","last_change":"2023-10-09T11:41:30.198699+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198585+0000","last_undegraded":"2023-10-09T11:41:30.198585+0000","last_fullsized":"2023-10-09T11:41:30.198585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211940+0000","last_change":"2023-10-09T11:41:30.211940+0000","last_active":"2023-10-09T11:41:30.211940+0000","last_peered":"2023-10-09T11:41:30.211940+0000","last_clean":"2023-10-09T11:41:30.211940+0000","last_became_active":"2023-10-09T11:41:30.211435+0000","last_became_peered":"2023-10-09T11:41:30.211435+0000","last_unstale":"2023-10-09T11:41:30.211940+0000","last_undegraded":"2023-10-09T11:41:30.211940+0000","last_fullsized":"2023-10-09T11:41:30.211940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212286+0000","last_change":"2023-10-09T11:41:30.212286+0000","last_active":"2023-10-09T11:41:30.212286+0000","last_peered":"2023-10-09T11:41:30.212286+0000","last_clean":"2023-10-09T11:41:30.212286+0000","last_became_active":"2023-10-09T11:41:30.211855+0000","last_became_peered":"2023-10-09T11:41:30.211855+0000","last_unstale":"2023-10-09T11:41:30.212286+0000","last_undegraded":"2023-10-09T11:41:30.212286+0000","last_fullsized":"2023-10-09T11:41:30.212286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195861+0000","last_change":"2023-10-09T11:41:30.195980+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195861+0000","last_undegraded":"2023-10-09T11:41:30.195861+0000","last_fullsized":"2023-10-09T11:41:30.195861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195992+0000","last_change":"2023-10-09T11:41:30.196777+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195992+0000","last_undegraded":"2023-10-09T11:41:30.195992+0000","last_fullsized":"2023-10-09T11:41:30.195992+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215491+0000","last_change":"2023-10-09T11:41:30.213001+0000","last_active":"2023-10-09T11:41:30.215491+0000","last_peered":"2023-10-09T11:41:30.215491+0000","last_clean":"2023-10-09T11:41:30.215491+0000","last_became_active":"2023-10-09T11:41:30.212689+0000","last_became_peered":"2023-10-09T11:41:30.212689+0000","last_unstale":"2023-10-09T11:41:30.215491+0000","last_undegraded":"2023-10-09T11:41:30.215491+0000","last_fullsized":"2023-10-09T11:41:30.215491+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:38.335285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216170+0000","last_change":"2023-10-09T11:41:30.210587+0000","last_active":"2023-10-09T11:41:30.216170+0000","last_peered":"2023-10-09T11:41:30.216170+0000","last_clean":"2023-10-09T11:41:30.216170+0000","last_became_active":"2023-10-09T11:41:30.210309+0000","last_became_peered":"2023-10-09T11:41:30.210309+0000","last_unstale":"2023-10-09T11:41:30.216170+0000","last_undegraded":"2023-10-09T11:41:30.216170+0000","last_fullsized":"2023-10-09T11:41:30.216170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214778+0000","last_change":"2023-10-09T11:41:30.214778+0000","last_active":"2023-10-09T11:41:30.214778+0000","last_peered":"2023-10-09T11:41:30.214778+0000","last_clean":"2023-10-09T11:41:30.214778+0000","last_became_active":"2023-10-09T11:41:30.214420+0000","last_became_peered":"2023-10-09T11:41:30.214420+0000","last_unstale":"2023-10-09T11:41:30.214778+0000","last_undegraded":"2023-10-09T11:41:30.214778+0000","last_fullsized":"2023-10-09T11:41:30.214778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215302+0000","last_change":"2023-10-09T11:41:30.211011+0000","last_active":"2023-10-09T11:41:30.215302+0000","last_peered":"2023-10-09T11:41:30.215302+0000","last_clean":"2023-10-09T11:41:30.215302+0000","last_became_active":"2023-10-09T11:41:30.210577+0000","last_became_peered":"2023-10-09T11:41:30.210577+0000","last_unstale":"2023-10-09T11:41:30.215302+0000","last_undegraded":"2023-10-09T11:41:30.215302+0000","last_fullsized":"2023-10-09T11:41:30.215302+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:23.812282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214638+0000","last_change":"2023-10-09T11:41:30.206829+0000","last_active":"2023-10-09T11:41:30.214638+0000","last_peered":"2023-10-09T11:41:30.214638+0000","last_clean":"2023-10-09T11:41:30.214638+0000","last_became_active":"2023-10-09T11:41:30.206191+0000","last_became_peered":"2023-10-09T11:41:30.206191+0000","last_unstale":"2023-10-09T11:41:30.214638+0000","last_undegraded":"2023-10-09T11:41:30.214638+0000","last_fullsized":"2023-10-09T11:41:30.214638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:03.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210832+0000","last_change":"2023-10-09T11:41:30.206981+0000","last_active":"2023-10-09T11:41:30.210832+0000","last_peered":"2023-10-09T11:41:30.210832+0000","last_clean":"2023-10-09T11:41:30.210832+0000","last_became_active":"2023-10-09T11:41:30.206730+0000","last_became_peered":"2023-10-09T11:41:30.206730+0000","last_unstale":"2023-10-09T11:41:30.210832+0000","last_undegraded":"2023-10-09T11:41:30.210832+0000","last_fullsized":"2023-10-09T11:41:30.210832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214555+0000","last_change":"2023-10-09T11:41:30.208259+0000","last_active":"2023-10-09T11:41:30.214555+0000","last_peered":"2023-10-09T11:41:30.214555+0000","last_clean":"2023-10-09T11:41:30.214555+0000","last_became_active":"2023-10-09T11:41:30.207545+0000","last_became_peered":"2023-10-09T11:41:30.207545+0000","last_unstale":"2023-10-09T11:41:30.214555+0000","last_undegraded":"2023-10-09T11:41:30.214555+0000","last_fullsized":"2023-10-09T11:41:30.214555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:00.236671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210900+0000","last_change":"2023-10-09T11:41:30.207410+0000","last_active":"2023-10-09T11:41:30.210900+0000","last_peered":"2023-10-09T11:41:30.210900+0000","last_clean":"2023-10-09T11:41:30.210900+0000","last_became_active":"2023-10-09T11:41:30.207135+0000","last_became_peered":"2023-10-09T11:41:30.207135+0000","last_unstale":"2023-10-09T11:41:30.210900+0000","last_undegraded":"2023-10-09T11:41:30.210900+0000","last_fullsized":"2023-10-09T11:41:30.210900+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214520+0000","last_change":"2023-10-09T11:41:30.207785+0000","last_active":"2023-10-09T11:41:30.214520+0000","last_peered":"2023-10-09T11:41:30.214520+0000","last_clean":"2023-10-09T11:41:30.214520+0000","last_became_active":"2023-10-09T11:41:30.207389+0000","last_became_peered":"2023-10-09T11:41:30.207389+0000","last_unstale":"2023-10-09T11:41:30.214520+0000","last_undegraded":"2023-10-09T11:41:30.214520+0000","last_fullsized":"2023-10-09T11:41:30.214520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197350+0000","last_change":"2023-10-09T11:41:30.199585+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197350+0000","last_undegraded":"2023-10-09T11:41:30.197350+0000","last_fullsized":"2023-10-09T11:41:30.197350+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196868+0000","last_change":"2023-10-09T11:41:30.196964+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196868+0000","last_undegraded":"2023-10-09T11:41:30.196868+0000","last_fullsized":"2023-10-09T11:41:30.196868+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211409+0000","last_change":"2023-10-09T11:41:30.208814+0000","last_active":"2023-10-09T11:41:30.211409+0000","last_peered":"2023-10-09T11:41:30.211409+0000","last_clean":"2023-10-09T11:41:30.211409+0000","last_became_active":"2023-10-09T11:41:30.208561+0000","last_became_peered":"2023-10-09T11:41:30.208561+0000","last_unstale":"2023-10-09T11:41:30.211409+0000","last_undegraded":"2023-10-09T11:41:30.211409+0000","last_fullsized":"2023-10-09T11:41:30.211409+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:13.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215621+0000","last_change":"2023-10-09T11:41:30.213841+0000","last_active":"2023-10-09T11:41:30.215621+0000","last_peered":"2023-10-09T11:41:30.215621+0000","last_clean":"2023-10-09T11:41:30.215621+0000","last_became_active":"2023-10-09T11:41:30.213550+0000","last_became_peered":"2023-10-09T11:41:30.213550+0000","last_unstale":"2023-10-09T11:41:30.215621+0000","last_undegraded":"2023-10-09T11:41:30.215621+0000","last_fullsized":"2023-10-09T11:41:30.215621+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:31.671775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201875+0000","last_change":"2023-10-09T11:41:30.201875+0000","last_active":"2023-10-09T11:41:30.201875+0000","last_peered":"2023-10-09T11:41:30.201875+0000","last_clean":"2023-10-09T11:41:30.201875+0000","last_became_active":"2023-10-09T11:41:30.201565+0000","last_became_peered":"2023-10-09T11:41:30.201565+0000","last_unstale":"2023-10-09T11:41:30.201875+0000","last_undegraded":"2023-10-09T11:41:30.201875+0000","last_fullsized":"2023-10-09T11:41:30.201875+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:30.544630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":7,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203053+0000","last_change":"2023-10-09T11:41:30.203132+0000","last_active":"2023-10-09T11:41:30.203053+0000","last_peered":"2023-10-09T11:41:30.203053+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"2023-10-09T11:41:30.202467+0000","last_became_peered":"2023-10-09T11:41:30.202467+0000","last_unstale":"2023-10-09T11:41:30.203053+0000","last_undegraded":"2023-10-09T11:41:30.203053+0000","last_fullsized":"2023-10-09T11:41:30.203053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:28.546094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198195+0000","last_change":"2023-10-09T11:41:30.198324+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198195+0000","last_undegraded":"2023-10-09T11:41:30.198195+0000","last_fullsized":"2023-10-09T11:41:30.198195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197315+0000","last_change":"2023-10-09T11:41:30.197440+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197315+0000","last_undegraded":"2023-10-09T11:41:30.197315+0000","last_fullsized":"2023-10-09T11:41:30.197315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618361+0000","last_change":"2023-10-09T11:41:29.626042+0000","last_active":"2023-10-09T11:41:30.618361+0000","last_peered":"2023-10-09T11:41:30.618361+0000","last_clean":"2023-10-09T11:41:30.618361+0000","last_became_active":"2023-10-09T11:41:29.625587+0000","last_became_peered":"2023-10-09T11:41:29.625587+0000","last_unstale":"2023-10-09T11:41:30.618361+0000","last_undegraded":"2023-10-09T11:41:30.618361+0000","last_fullsized":"2023-10-09T11:41:30.618361+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:40.925799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216384+0000","last_change":"2023-10-09T11:41:30.213412+0000","last_active":"2023-10-09T11:41:30.216384+0000","last_peered":"2023-10-09T11:41:30.216384+0000","last_clean":"2023-10-09T11:41:30.216384+0000","last_became_active":"2023-10-09T11:41:30.213141+0000","last_became_peered":"2023-10-09T11:41:30.213141+0000","last_unstale":"2023-10-09T11:41:30.216384+0000","last_undegraded":"2023-10-09T11:41:30.216384+0000","last_fullsized":"2023-10-09T11:41:30.216384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:20.601709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202381+0000","last_change":"2023-10-09T11:41:29.629629+0000","last_active":"2023-10-09T11:41:30.202381+0000","last_peered":"2023-10-09T11:41:30.202381+0000","last_clean":"2023-10-09T11:41:30.202381+0000","last_became_active":"2023-10-09T11:41:29.629294+0000","last_became_peered":"2023-10-09T11:41:29.629294+0000","last_unstale":"2023-10-09T11:41:30.202381+0000","last_undegraded":"2023-10-09T11:41:30.202381+0000","last_fullsized":"2023-10-09T11:41:30.202381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:48.066109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197734+0000","last_change":"2023-10-09T11:41:30.197856+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197734+0000","last_undegraded":"2023-10-09T11:41:30.197734+0000","last_fullsized":"2023-10-09T11:41:30.197734+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629816+0000","last_change":"2023-10-09T11:41:29.624723+0000","last_active":"2023-10-09T11:41:29.629816+0000","last_peered":"2023-10-09T11:41:29.629816+0000","last_clean":"2023-10-09T11:41:29.629816+0000","last_became_active":"2023-10-09T11:41:29.624446+0000","last_became_peered":"2023-10-09T11:41:29.624446+0000","last_unstale":"2023-10-09T11:41:29.629816+0000","last_undegraded":"2023-10-09T11:41:29.629816+0000","last_fullsized":"2023-10-09T11:41:29.629816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:24.501718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214087+0000","last_change":"2023-10-09T11:41:30.214087+0000","last_active":"2023-10-09T11:41:30.214087+0000","last_peered":"2023-10-09T11:41:30.214087+0000","last_clean":"2023-10-09T11:41:30.214087+0000","last_became_active":"2023-10-09T11:41:30.212251+0000","last_became_peered":"2023-10-09T11:41:30.212251+0000","last_unstale":"2023-10-09T11:41:30.214087+0000","last_undegraded":"2023-10-09T11:41:30.214087+0000","last_fullsized":"2023-10-09T11:41:30.214087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630635+0000","last_change":"2023-10-09T11:41:29.627113+0000","last_active":"2023-10-09T11:41:29.630635+0000","last_peered":"2023-10-09T11:41:29.630635+0000","last_clean":"2023-10-09T11:41:29.630635+0000","last_became_active":"2023-10-09T11:41:29.626832+0000","last_became_peered":"2023-10-09T11:41:29.626832+0000","last_unstale":"2023-10-09T11:41:29.630635+0000","last_undegraded":"2023-10-09T11:41:29.630635+0000","last_fullsized":"2023-10-09T11:41:29.630635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.078822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196474+0000","last_change":"2023-10-09T11:41:30.196607+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196474+0000","last_undegraded":"2023-10-09T11:41:30.196474+0000","last_fullsized":"2023-10-09T11:41:30.196474+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193718+0000","last_change":"2023-10-09T11:41:29.624687+0000","last_active":"2023-10-09T11:41:30.193718+0000","last_peered":"2023-10-09T11:41:30.193718+0000","last_clean":"2023-10-09T11:41:30.193718+0000","last_became_active":"2023-10-09T11:41:29.622838+0000","last_became_peered":"2023-10-09T11:41:29.622838+0000","last_unstale":"2023-10-09T11:41:30.193718+0000","last_undegraded":"2023-10-09T11:41:30.193718+0000","last_fullsized":"2023-10-09T11:41:30.193718+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:07.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215152+0000","last_change":"2023-10-09T11:41:30.210327+0000","last_active":"2023-10-09T11:41:30.215152+0000","last_peered":"2023-10-09T11:41:30.215152+0000","last_clean":"2023-10-09T11:41:30.215152+0000","last_became_active":"2023-10-09T11:41:30.209999+0000","last_became_peered":"2023-10-09T11:41:30.209999+0000","last_unstale":"2023-10-09T11:41:30.215152+0000","last_undegraded":"2023-10-09T11:41:30.215152+0000","last_fullsized":"2023-10-09T11:41:30.215152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618397+0000","last_change":"2023-10-09T11:41:29.622757+0000","last_active":"2023-10-09T11:41:30.618397+0000","last_peered":"2023-10-09T11:41:30.618397+0000","last_clean":"2023-10-09T11:41:30.618397+0000","last_became_active":"2023-10-09T11:41:29.622405+0000","last_became_peered":"2023-10-09T11:41:29.622405+0000","last_unstale":"2023-10-09T11:41:30.618397+0000","last_undegraded":"2023-10-09T11:41:30.618397+0000","last_fullsized":"2023-10-09T11:41:30.618397+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:37.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196467+0000","last_change":"2023-10-09T11:41:30.196593+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196467+0000","last_undegraded":"2023-10-09T11:41:30.196467+0000","last_fullsized":"2023-10-09T11:41:30.196467+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197823+0000","last_change":"2023-10-09T11:41:29.626941+0000","last_active":"2023-10-09T11:41:30.197823+0000","last_peered":"2023-10-09T11:41:30.197823+0000","last_clean":"2023-10-09T11:41:30.197823+0000","last_became_active":"2023-10-09T11:41:29.626666+0000","last_became_peered":"2023-10-09T11:41:29.626666+0000","last_unstale":"2023-10-09T11:41:30.197823+0000","last_undegraded":"2023-10-09T11:41:30.197823+0000","last_fullsized":"2023-10-09T11:41:30.197823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:10.194833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206394+0000","last_change":"2023-10-09T11:41:30.206394+0000","last_active":"2023-10-09T11:41:30.206394+0000","last_peered":"2023-10-09T11:41:30.206394+0000","last_clean":"2023-10-09T11:41:30.206394+0000","last_became_active":"2023-10-09T11:41:30.206062+0000","last_became_peered":"2023-10-09T11:41:30.206062+0000","last_unstale":"2023-10-09T11:41:30.206394+0000","last_undegraded":"2023-10-09T11:41:30.206394+0000","last_fullsized":"2023-10-09T11:41:30.206394+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:41.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630515+0000","last_change":"2023-10-09T11:41:29.626745+0000","last_active":"2023-10-09T11:41:29.630515+0000","last_peered":"2023-10-09T11:41:29.630515+0000","last_clean":"2023-10-09T11:41:29.630515+0000","last_became_active":"2023-10-09T11:41:29.626206+0000","last_became_peered":"2023-10-09T11:41:29.626206+0000","last_unstale":"2023-10-09T11:41:29.630515+0000","last_undegraded":"2023-10-09T11:41:29.630515+0000","last_fullsized":"2023-10-09T11:41:29.630515+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:25.951409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201154+0000","last_change":"2023-10-09T11:41:30.201154+0000","last_active":"2023-10-09T11:41:30.201154+0000","last_peered":"2023-10-09T11:41:30.201154+0000","last_clean":"2023-10-09T11:41:30.201154+0000","last_became_active":"2023-10-09T11:41:30.200791+0000","last_became_peered":"2023-10-09T11:41:30.200791+0000","last_unstale":"2023-10-09T11:41:30.201154+0000","last_undegraded":"2023-10-09T11:41:30.201154+0000","last_fullsized":"2023-10-09T11:41:30.201154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630333+0000","last_change":"2023-10-09T11:41:29.626711+0000","last_active":"2023-10-09T11:41:29.630333+0000","last_peered":"2023-10-09T11:41:29.630333+0000","last_clean":"2023-10-09T11:41:29.630333+0000","last_became_active":"2023-10-09T11:41:29.626341+0000","last_became_peered":"2023-10-09T11:41:29.626341+0000","last_unstale":"2023-10-09T11:41:29.630333+0000","last_undegraded":"2023-10-09T11:41:29.630333+0000","last_fullsized":"2023-10-09T11:41:29.630333+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.711584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214896+0000","last_change":"2023-10-09T11:41:30.206248+0000","last_active":"2023-10-09T11:41:30.214896+0000","last_peered":"2023-10-09T11:41:30.214896+0000","last_clean":"2023-10-09T11:41:30.214896+0000","last_became_active":"2023-10-09T11:41:30.205788+0000","last_became_peered":"2023-10-09T11:41:30.205788+0000","last_unstale":"2023-10-09T11:41:30.214896+0000","last_undegraded":"2023-10-09T11:41:30.214896+0000","last_fullsized":"2023-10-09T11:41:30.214896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195064+0000","last_change":"2023-10-09T11:41:29.624261+0000","last_active":"2023-10-09T11:41:30.195064+0000","last_peered":"2023-10-09T11:41:30.195064+0000","last_clean":"2023-10-09T11:41:30.195064+0000","last_became_active":"2023-10-09T11:41:29.623990+0000","last_became_peered":"2023-10-09T11:41:29.623990+0000","last_unstale":"2023-10-09T11:41:30.195064+0000","last_undegraded":"2023-10-09T11:41:30.195064+0000","last_fullsized":"2023-10-09T11:41:30.195064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:57.602272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211391+0000","last_change":"2023-10-09T11:41:30.208315+0000","last_active":"2023-10-09T11:41:30.211391+0000","last_peered":"2023-10-09T11:41:30.211391+0000","last_clean":"2023-10-09T11:41:30.211391+0000","last_became_active":"2023-10-09T11:41:30.208028+0000","last_became_peered":"2023-10-09T11:41:30.208028+0000","last_unstale":"2023-10-09T11:41:30.211391+0000","last_undegraded":"2023-10-09T11:41:30.211391+0000","last_fullsized":"2023-10-09T11:41:30.211391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625454+0000","last_change":"2023-10-09T11:41:29.625454+0000","last_active":"2023-10-09T11:41:29.625454+0000","last_peered":"2023-10-09T11:41:29.625454+0000","last_clean":"2023-10-09T11:41:29.625454+0000","last_became_active":"2023-10-09T11:41:29.624809+0000","last_became_peered":"2023-10-09T11:41:29.624809+0000","last_unstale":"2023-10-09T11:41:29.625454+0000","last_undegraded":"2023-10-09T11:41:29.625454+0000","last_fullsized":"2023-10-09T11:41:29.625454+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:56.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212455+0000","last_change":"2023-10-09T11:41:30.212455+0000","last_active":"2023-10-09T11:41:30.212455+0000","last_peered":"2023-10-09T11:41:30.212455+0000","last_clean":"2023-10-09T11:41:30.212455+0000","last_became_active":"2023-10-09T11:41:30.212151+0000","last_became_peered":"2023-10-09T11:41:30.212151+0000","last_unstale":"2023-10-09T11:41:30.212455+0000","last_undegraded":"2023-10-09T11:41:30.212455+0000","last_fullsized":"2023-10-09T11:41:30.212455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:37.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628591+0000","last_change":"2023-10-09T11:41:29.625291+0000","last_active":"2023-10-09T11:41:29.628591+0000","last_peered":"2023-10-09T11:41:29.628591+0000","last_clean":"2023-10-09T11:41:29.628591+0000","last_became_active":"2023-10-09T11:41:29.624992+0000","last_became_peered":"2023-10-09T11:41:29.624992+0000","last_unstale":"2023-10-09T11:41:29.628591+0000","last_undegraded":"2023-10-09T11:41:29.628591+0000","last_fullsized":"2023-10-09T11:41:29.628591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:50.027818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209237+0000","last_change":"2023-10-09T11:41:30.203371+0000","last_active":"2023-10-09T11:41:30.209237+0000","last_peered":"2023-10-09T11:41:30.209237+0000","last_clean":"2023-10-09T11:41:30.209237+0000","last_became_active":"2023-10-09T11:41:30.203126+0000","last_became_peered":"2023-10-09T11:41:30.203126+0000","last_unstale":"2023-10-09T11:41:30.209237+0000","last_undegraded":"2023-10-09T11:41:30.209237+0000","last_fullsized":"2023-10-09T11:41:30.209237+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629864+0000","last_change":"2023-10-09T11:41:29.626334+0000","last_active":"2023-10-09T11:41:29.629864+0000","last_peered":"2023-10-09T11:41:29.629864+0000","last_clean":"2023-10-09T11:41:29.629864+0000","last_became_active":"2023-10-09T11:41:29.625700+0000","last_became_peered":"2023-10-09T11:41:29.625700+0000","last_unstale":"2023-10-09T11:41:29.629864+0000","last_undegraded":"2023-10-09T11:41:29.629864+0000","last_fullsized":"2023-10-09T11:41:29.629864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:38.376341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212284+0000","last_change":"2023-10-09T11:41:30.211426+0000","last_active":"2023-10-09T11:41:30.212284+0000","last_peered":"2023-10-09T11:41:30.212284+0000","last_clean":"2023-10-09T11:41:30.212284+0000","last_became_active":"2023-10-09T11:41:30.211140+0000","last_became_peered":"2023-10-09T11:41:30.211140+0000","last_unstale":"2023-10-09T11:41:30.212284+0000","last_undegraded":"2023-10-09T11:41:30.212284+0000","last_fullsized":"2023-10-09T11:41:30.212284+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197765+0000","last_change":"2023-10-09T11:41:29.628526+0000","last_active":"2023-10-09T11:41:30.197765+0000","last_peered":"2023-10-09T11:41:30.197765+0000","last_clean":"2023-10-09T11:41:30.197765+0000","last_became_active":"2023-10-09T11:41:29.628346+0000","last_became_peered":"2023-10-09T11:41:29.628346+0000","last_unstale":"2023-10-09T11:41:30.197765+0000","last_undegraded":"2023-10-09T11:41:30.197765+0000","last_fullsized":"2023-10-09T11:41:30.197765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:11.803064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210854+0000","last_change":"2023-10-09T11:41:30.207505+0000","last_active":"2023-10-09T11:41:30.210854+0000","last_peered":"2023-10-09T11:41:30.210854+0000","last_clean":"2023-10-09T11:41:30.210854+0000","last_became_active":"2023-10-09T11:41:30.206861+0000","last_became_peered":"2023-10-09T11:41:30.206861+0000","last_unstale":"2023-10-09T11:41:30.210854+0000","last_undegraded":"2023-10-09T11:41:30.210854+0000","last_fullsized":"2023-10-09T11:41:30.210854+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630825+0000","last_change":"2023-10-09T11:41:29.628993+0000","last_active":"2023-10-09T11:41:29.630825+0000","last_peered":"2023-10-09T11:41:29.630825+0000","last_clean":"2023-10-09T11:41:29.630825+0000","last_became_active":"2023-10-09T11:41:29.628689+0000","last_became_peered":"2023-10-09T11:41:29.628689+0000","last_unstale":"2023-10-09T11:41:29.630825+0000","last_undegraded":"2023-10-09T11:41:29.630825+0000","last_fullsized":"2023-10-09T11:41:29.630825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:47.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195206+0000","last_change":"2023-10-09T11:41:30.195331+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195206+0000","last_undegraded":"2023-10-09T11:41:30.195206+0000","last_fullsized":"2023-10-09T11:41:30.195206+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627947+0000","last_change":"2023-10-09T11:41:29.627947+0000","last_active":"2023-10-09T11:41:29.627947+0000","last_peered":"2023-10-09T11:41:29.627947+0000","last_clean":"2023-10-09T11:41:29.627947+0000","last_became_active":"2023-10-09T11:41:29.627683+0000","last_became_peered":"2023-10-09T11:41:29.627683+0000","last_unstale":"2023-10-09T11:41:29.627947+0000","last_undegraded":"2023-10-09T11:41:29.627947+0000","last_fullsized":"2023-10-09T11:41:29.627947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:34.004467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197755+0000","last_change":"2023-10-09T11:41:30.197903+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197755+0000","last_undegraded":"2023-10-09T11:41:30.197755+0000","last_fullsized":"2023-10-09T11:41:30.197755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625667+0000","last_change":"2023-10-09T11:41:29.622774+0000","last_active":"2023-10-09T11:41:29.625667+0000","last_peered":"2023-10-09T11:41:29.625667+0000","last_clean":"2023-10-09T11:41:29.625667+0000","last_became_active":"2023-10-09T11:41:29.622497+0000","last_became_peered":"2023-10-09T11:41:29.622497+0000","last_unstale":"2023-10-09T11:41:29.625667+0000","last_undegraded":"2023-10-09T11:41:29.625667+0000","last_fullsized":"2023-10-09T11:41:29.625667+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:17.226611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212307+0000","last_change":"2023-10-09T11:41:30.212307+0000","last_active":"2023-10-09T11:41:30.212307+0000","last_peered":"2023-10-09T11:41:30.212307+0000","last_clean":"2023-10-09T11:41:30.212307+0000","last_became_active":"2023-10-09T11:41:30.211263+0000","last_became_peered":"2023-10-09T11:41:30.211263+0000","last_unstale":"2023-10-09T11:41:30.212307+0000","last_undegraded":"2023-10-09T11:41:30.212307+0000","last_fullsized":"2023-10-09T11:41:30.212307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617971+0000","last_change":"2023-10-09T11:41:29.624896+0000","last_active":"2023-10-09T11:41:30.617971+0000","last_peered":"2023-10-09T11:41:30.617971+0000","last_clean":"2023-10-09T11:41:30.617971+0000","last_became_active":"2023-10-09T11:41:29.624643+0000","last_became_peered":"2023-10-09T11:41:29.624643+0000","last_unstale":"2023-10-09T11:41:30.617971+0000","last_undegraded":"2023-10-09T11:41:30.617971+0000","last_fullsized":"2023-10-09T11:41:30.617971+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:40.658382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214279+0000","last_change":"2023-10-09T11:41:30.214279+0000","last_active":"2023-10-09T11:41:30.214279+0000","last_peered":"2023-10-09T11:41:30.214279+0000","last_clean":"2023-10-09T11:41:30.214279+0000","last_became_active":"2023-10-09T11:41:30.212519+0000","last_became_peered":"2023-10-09T11:41:30.212519+0000","last_unstale":"2023-10-09T11:41:30.214279+0000","last_undegraded":"2023-10-09T11:41:30.214279+0000","last_fullsized":"2023-10-09T11:41:30.214279+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628363+0000","last_change":"2023-10-09T11:41:29.623446+0000","last_active":"2023-10-09T11:41:29.628363+0000","last_peered":"2023-10-09T11:41:29.628363+0000","last_clean":"2023-10-09T11:41:29.628363+0000","last_became_active":"2023-10-09T11:41:29.623199+0000","last_became_peered":"2023-10-09T11:41:29.623199+0000","last_unstale":"2023-10-09T11:41:29.628363+0000","last_undegraded":"2023-10-09T11:41:29.628363+0000","last_fullsized":"2023-10-09T11:41:29.628363+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:57.601464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212736+0000","last_change":"2023-10-09T11:41:30.212736+0000","last_active":"2023-10-09T11:41:30.212736+0000","last_peered":"2023-10-09T11:41:30.212736+0000","last_clean":"2023-10-09T11:41:30.212736+0000","last_became_active":"2023-10-09T11:41:30.211249+0000","last_became_peered":"2023-10-09T11:41:30.211249+0000","last_unstale":"2023-10-09T11:41:30.212736+0000","last_undegraded":"2023-10-09T11:41:30.212736+0000","last_fullsized":"2023-10-09T11:41:30.212736+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629881+0000","last_change":"2023-10-09T11:41:29.626531+0000","last_active":"2023-10-09T11:41:29.629881+0000","last_peered":"2023-10-09T11:41:29.629881+0000","last_clean":"2023-10-09T11:41:29.629881+0000","last_became_active":"2023-10-09T11:41:29.626069+0000","last_became_peered":"2023-10-09T11:41:29.626069+0000","last_unstale":"2023-10-09T11:41:29.629881+0000","last_undegraded":"2023-10-09T11:41:29.629881+0000","last_fullsized":"2023-10-09T11:41:29.629881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:57.065033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196825+0000","last_change":"2023-10-09T11:41:30.196943+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196825+0000","last_undegraded":"2023-10-09T11:41:30.196825+0000","last_fullsized":"2023-10-09T11:41:30.196825+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630294+0000","last_change":"2023-10-09T11:41:29.626659+0000","last_active":"2023-10-09T11:41:29.630294+0000","last_peered":"2023-10-09T11:41:29.630294+0000","last_clean":"2023-10-09T11:41:29.630294+0000","last_became_active":"2023-10-09T11:41:29.626359+0000","last_became_peered":"2023-10-09T11:41:29.626359+0000","last_unstale":"2023-10-09T11:41:29.630294+0000","last_undegraded":"2023-10-09T11:41:29.630294+0000","last_fullsized":"2023-10-09T11:41:29.630294+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:15.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213139+0000","last_change":"2023-10-09T11:41:30.213139+0000","last_active":"2023-10-09T11:41:30.213139+0000","last_peered":"2023-10-09T11:41:30.213139+0000","last_clean":"2023-10-09T11:41:30.213139+0000","last_became_active":"2023-10-09T11:41:30.212582+0000","last_became_peered":"2023-10-09T11:41:30.212582+0000","last_unstale":"2023-10-09T11:41:30.213139+0000","last_undegraded":"2023-10-09T11:41:30.213139+0000","last_fullsized":"2023-10-09T11:41:30.213139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629838+0000","last_change":"2023-10-09T11:41:29.628284+0000","last_active":"2023-10-09T11:41:29.629838+0000","last_peered":"2023-10-09T11:41:29.629838+0000","last_clean":"2023-10-09T11:41:29.629838+0000","last_became_active":"2023-10-09T11:41:29.627998+0000","last_became_peered":"2023-10-09T11:41:29.627998+0000","last_unstale":"2023-10-09T11:41:29.629838+0000","last_undegraded":"2023-10-09T11:41:29.629838+0000","last_fullsized":"2023-10-09T11:41:29.629838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:54.858809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210767+0000","last_change":"2023-10-09T11:41:30.204375+0000","last_active":"2023-10-09T11:41:30.210767+0000","last_peered":"2023-10-09T11:41:30.210767+0000","last_clean":"2023-10-09T11:41:30.210767+0000","last_became_active":"2023-10-09T11:41:30.204103+0000","last_became_peered":"2023-10-09T11:41:30.204103+0000","last_unstale":"2023-10-09T11:41:30.210767+0000","last_undegraded":"2023-10-09T11:41:30.210767+0000","last_fullsized":"2023-10-09T11:41:30.210767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:30.104458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627507+0000","last_change":"2023-10-09T11:41:29.623589+0000","last_active":"2023-10-09T11:41:29.627507+0000","last_peered":"2023-10-09T11:41:29.627507+0000","last_clean":"2023-10-09T11:41:29.627507+0000","last_became_active":"2023-10-09T11:41:29.622865+0000","last_became_peered":"2023-10-09T11:41:29.622865+0000","last_unstale":"2023-10-09T11:41:29.627507+0000","last_undegraded":"2023-10-09T11:41:29.627507+0000","last_fullsized":"2023-10-09T11:41:29.627507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:58.673145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215946+0000","last_change":"2023-10-09T11:41:30.208877+0000","last_active":"2023-10-09T11:41:30.215946+0000","last_peered":"2023-10-09T11:41:30.215946+0000","last_clean":"2023-10-09T11:41:30.215946+0000","last_became_active":"2023-10-09T11:41:30.208587+0000","last_became_peered":"2023-10-09T11:41:30.208587+0000","last_unstale":"2023-10-09T11:41:30.215946+0000","last_undegraded":"2023-10-09T11:41:30.215946+0000","last_fullsized":"2023-10-09T11:41:30.215946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:49.070780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618409+0000","last_change":"2023-10-09T11:41:29.629791+0000","last_active":"2023-10-09T11:41:30.618409+0000","last_peered":"2023-10-09T11:41:30.618409+0000","last_clean":"2023-10-09T11:41:30.618409+0000","last_became_active":"2023-10-09T11:41:29.629499+0000","last_became_peered":"2023-10-09T11:41:29.629499+0000","last_unstale":"2023-10-09T11:41:30.618409+0000","last_undegraded":"2023-10-09T11:41:30.618409+0000","last_fullsized":"2023-10-09T11:41:30.618409+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:30.667105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198280+0000","last_change":"2023-10-09T11:41:30.198399+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198280+0000","last_undegraded":"2023-10-09T11:41:30.198280+0000","last_fullsized":"2023-10-09T11:41:30.198280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202221+0000","last_change":"2023-10-09T11:41:29.626094+0000","last_active":"2023-10-09T11:41:30.202221+0000","last_peered":"2023-10-09T11:41:30.202221+0000","last_clean":"2023-10-09T11:41:30.202221+0000","last_became_active":"2023-10-09T11:41:29.625689+0000","last_became_peered":"2023-10-09T11:41:29.625689+0000","last_unstale":"2023-10-09T11:41:30.202221+0000","last_undegraded":"2023-10-09T11:41:30.202221+0000","last_fullsized":"2023-10-09T11:41:30.202221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:29.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200052+0000","last_change":"2023-10-09T11:41:30.200174+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200052+0000","last_undegraded":"2023-10-09T11:41:30.200052+0000","last_fullsized":"2023-10-09T11:41:30.200052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625772+0000","last_change":"2023-10-09T11:41:29.625772+0000","last_active":"2023-10-09T11:41:29.625772+0000","last_peered":"2023-10-09T11:41:29.625772+0000","last_clean":"2023-10-09T11:41:29.625772+0000","last_became_active":"2023-10-09T11:41:29.625181+0000","last_became_peered":"2023-10-09T11:41:29.625181+0000","last_unstale":"2023-10-09T11:41:29.625772+0000","last_undegraded":"2023-10-09T11:41:29.625772+0000","last_fullsized":"2023-10-09T11:41:29.625772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:29.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215988+0000","last_change":"2023-10-09T11:41:30.208985+0000","last_active":"2023-10-09T11:41:30.215988+0000","last_peered":"2023-10-09T11:41:30.215988+0000","last_clean":"2023-10-09T11:41:30.215988+0000","last_became_active":"2023-10-09T11:41:30.208686+0000","last_became_peered":"2023-10-09T11:41:30.208686+0000","last_unstale":"2023-10-09T11:41:30.215988+0000","last_undegraded":"2023-10-09T11:41:30.215988+0000","last_fullsized":"2023-10-09T11:41:30.215988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195918+0000","last_change":"2023-10-09T11:41:29.624296+0000","last_active":"2023-10-09T11:41:30.195918+0000","last_peered":"2023-10-09T11:41:30.195918+0000","last_clean":"2023-10-09T11:41:30.195918+0000","last_became_active":"2023-10-09T11:41:29.623669+0000","last_became_peered":"2023-10-09T11:41:29.623669+0000","last_unstale":"2023-10-09T11:41:30.195918+0000","last_undegraded":"2023-10-09T11:41:30.195918+0000","last_fullsized":"2023-10-09T11:41:30.195918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.232001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208773+0000","last_change":"2023-10-09T11:41:30.205259+0000","last_active":"2023-10-09T11:41:30.208773+0000","last_peered":"2023-10-09T11:41:30.208773+0000","last_clean":"2023-10-09T11:41:30.208773+0000","last_became_active":"2023-10-09T11:41:30.204932+0000","last_became_peered":"2023-10-09T11:41:30.204932+0000","last_unstale":"2023-10-09T11:41:30.208773+0000","last_undegraded":"2023-10-09T11:41:30.208773+0000","last_fullsized":"2023-10-09T11:41:30.208773+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:38.539477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628391+0000","last_change":"2023-10-09T11:41:29.622849+0000","last_active":"2023-10-09T11:41:29.628391+0000","last_peered":"2023-10-09T11:41:29.628391+0000","last_clean":"2023-10-09T11:41:29.628391+0000","last_became_active":"2023-10-09T11:41:29.622558+0000","last_became_peered":"2023-10-09T11:41:29.622558+0000","last_unstale":"2023-10-09T11:41:29.628391+0000","last_undegraded":"2023-10-09T11:41:29.628391+0000","last_fullsized":"2023-10-09T11:41:29.628391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:03.488670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214678+0000","last_change":"2023-10-09T11:41:30.207009+0000","last_active":"2023-10-09T11:41:30.214678+0000","last_peered":"2023-10-09T11:41:30.214678+0000","last_clean":"2023-10-09T11:41:30.214678+0000","last_became_active":"2023-10-09T11:41:30.206529+0000","last_became_peered":"2023-10-09T11:41:30.206529+0000","last_unstale":"2023-10-09T11:41:30.214678+0000","last_undegraded":"2023-10-09T11:41:30.214678+0000","last_fullsized":"2023-10-09T11:41:30.214678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197086+0000","last_change":"2023-10-09T11:41:29.624867+0000","last_active":"2023-10-09T11:41:30.197086+0000","last_peered":"2023-10-09T11:41:30.197086+0000","last_clean":"2023-10-09T11:41:30.197086+0000","last_became_active":"2023-10-09T11:41:29.624541+0000","last_became_peered":"2023-10-09T11:41:29.624541+0000","last_unstale":"2023-10-09T11:41:30.197086+0000","last_undegraded":"2023-10-09T11:41:30.197086+0000","last_fullsized":"2023-10-09T11:41:30.197086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:53.532131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216031+0000","last_change":"2023-10-09T11:41:30.216031+0000","last_active":"2023-10-09T11:41:30.216031+0000","last_peered":"2023-10-09T11:41:30.216031+0000","last_clean":"2023-10-09T11:41:30.216031+0000","last_became_active":"2023-10-09T11:41:30.215746+0000","last_became_peered":"2023-10-09T11:41:30.215746+0000","last_unstale":"2023-10-09T11:41:30.216031+0000","last_undegraded":"2023-10-09T11:41:30.216031+0000","last_fullsized":"2023-10-09T11:41:30.216031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629866+0000","last_change":"2023-10-09T11:41:29.624557+0000","last_active":"2023-10-09T11:41:29.629866+0000","last_peered":"2023-10-09T11:41:29.629866+0000","last_clean":"2023-10-09T11:41:29.629866+0000","last_became_active":"2023-10-09T11:41:29.624236+0000","last_became_peered":"2023-10-09T11:41:29.624236+0000","last_unstale":"2023-10-09T11:41:29.629866+0000","last_undegraded":"2023-10-09T11:41:29.629866+0000","last_fullsized":"2023-10-09T11:41:29.629866+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:01.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201532+0000","last_change":"2023-10-09T11:41:30.201532+0000","last_active":"2023-10-09T11:41:30.201532+0000","last_peered":"2023-10-09T11:41:30.201532+0000","last_clean":"2023-10-09T11:41:30.201532+0000","last_became_active":"2023-10-09T11:41:30.201154+0000","last_became_peered":"2023-10-09T11:41:30.201154+0000","last_unstale":"2023-10-09T11:41:30.201532+0000","last_undegraded":"2023-10-09T11:41:30.201532+0000","last_fullsized":"2023-10-09T11:41:30.201532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:39.734390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627487+0000","last_change":"2023-10-09T11:41:29.623414+0000","last_active":"2023-10-09T11:41:29.627487+0000","last_peered":"2023-10-09T11:41:29.627487+0000","last_clean":"2023-10-09T11:41:29.627487+0000","last_became_active":"2023-10-09T11:41:29.622500+0000","last_became_peered":"2023-10-09T11:41:29.622500+0000","last_unstale":"2023-10-09T11:41:29.627487+0000","last_undegraded":"2023-10-09T11:41:29.627487+0000","last_fullsized":"2023-10-09T11:41:29.627487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:58.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209205+0000","last_change":"2023-10-09T11:41:30.202138+0000","last_active":"2023-10-09T11:41:30.209205+0000","last_peered":"2023-10-09T11:41:30.209205+0000","last_clean":"2023-10-09T11:41:30.209205+0000","last_became_active":"2023-10-09T11:41:30.201860+0000","last_became_peered":"2023-10-09T11:41:30.201860+0000","last_unstale":"2023-10-09T11:41:30.209205+0000","last_undegraded":"2023-10-09T11:41:30.209205+0000","last_fullsized":"2023-10-09T11:41:30.209205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628141+0000","last_change":"2023-10-09T11:41:29.622285+0000","last_active":"2023-10-09T11:41:29.628141+0000","last_peered":"2023-10-09T11:41:29.628141+0000","last_clean":"2023-10-09T11:41:29.628141+0000","last_became_active":"2023-10-09T11:41:29.621974+0000","last_became_peered":"2023-10-09T11:41:29.621974+0000","last_unstale":"2023-10-09T11:41:29.628141+0000","last_undegraded":"2023-10-09T11:41:29.628141+0000","last_fullsized":"2023-10-09T11:41:29.628141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:53.801322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":227,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.621958+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:29.621958+0000","last_peered":"2023-10-09T11:41:29.621958+0000","last_clean":"2023-10-09T11:41:29.621958+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:29.621958+0000","last_undegraded":"2023-10-09T11:41:29.621958+0000","last_fullsized":"2023-10-09T11:41:29.621958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542225,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":1822720,"data_stored":1120061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.496},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.35099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542225,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.498}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":537587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.624},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.64000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298488,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073352,"statfs":{"total":96636764160,"available":96331112448,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:35.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-10-09T11:41:35.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197968+0000', 'last_change': '2023-10-09T11:41:30.198091+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197968+0000', 'last_undegraded': '2023-10-09T11:41:30.197968+0000', 'last_fullsized': '2023-10-09T11:41:30.197968+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197283+0000', 'last_change': '2023-10-09T11:41:30.197408+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197283+0000', 'last_undegraded': '2023-10-09T11:41:30.197283+0000', 'last_fullsized': '2023-10-09T11:41:30.197283+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.194724+0000', 'last_change': '2023-10-09T11:41:30.194873+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.194724+0000', 'last_undegraded': '2023-10-09T11:41:30.194724+0000', 'last_fullsized': '2023-10-09T11:41:30.194724+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.195429+0000', 'last_change': '2023-10-09T11:41:30.195524+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.195429+0000', 'last_undegraded': '2023-10-09T11:41:30.195429+0000', 'last_fullsized': '2023-10-09T11:41:30.195429+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-10-09T11:41:35.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.200175+0000', 'last_change': '2023-10-09T11:41:30.200300+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.200175+0000', 'last_undegraded': '2023-10-09T11:41:30.200175+0000', 'last_fullsized': '2023-10-09T11:41:30.200175+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.199321+0000', 'last_change': '2023-10-09T11:41:30.199460+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.199321+0000', 'last_undegraded': '2023-10-09T11:41:30.199321+0000', 'last_fullsized': '2023-10-09T11:41:30.199321+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.198585+0000', 'last_change': '2023-10-09T11:41:30.198699+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.198585+0000', 'last_undegraded': '2023-10-09T11:41:30.198585+0000', 'last_fullsized': '2023-10-09T11:41:30.198585+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.195861+0000', 'last_change': '2023-10-09T11:41:30.195980+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.195861+0000', 'last_undegraded': '2023-10-09T11:41:30.195861+0000', 'last_fullsized': '2023-10-09T11:41:30.195861+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.195992+0000', 'last_change': '2023-10-09T11:41:30.196777+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.195992+0000', 'last_undegraded': '2023-10-09T11:41:30.195992+0000', 'last_fullsized': '2023-10-09T11:41:30.195992+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-10-09T11:41:35.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197350+0000', 'last_change': '2023-10-09T11:41:30.199585+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197350+0000', 'last_undegraded': '2023-10-09T11:41:30.197350+0000', 'last_fullsized': '2023-10-09T11:41:30.197350+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.196868+0000', 'last_change': '2023-10-09T11:41:30.196964+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.196868+0000', 'last_undegraded': '2023-10-09T11:41:30.196868+0000', 'last_fullsized': '2023-10-09T11:41:30.196868+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.198195+0000', 'last_change': '2023-10-09T11:41:30.198324+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.198195+0000', 'last_undegraded': '2023-10-09T11:41:30.198195+0000', 'last_fullsized': '2023-10-09T11:41:30.198195+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197315+0000', 'last_change': '2023-10-09T11:41:30.197440+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197315+0000', 'last_undegraded': '2023-10-09T11:41:30.197315+0000', 'last_fullsized': '2023-10-09T11:41:30.197315+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197734+0000', 'last_change': '2023-10-09T11:41:30.197856+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197734+0000', 'last_undegraded': '2023-10-09T11:41:30.197734+0000', 'last_fullsized': '2023-10-09T11:41:30.197734+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-10-09T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.196474+0000', 'last_change': '2023-10-09T11:41:30.196607+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.196474+0000', 'last_undegraded': '2023-10-09T11:41:30.196474+0000', 'last_fullsized': '2023-10-09T11:41:30.196474+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.196467+0000', 'last_change': '2023-10-09T11:41:30.196593+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.196467+0000', 'last_undegraded': '2023-10-09T11:41:30.196467+0000', 'last_fullsized': '2023-10-09T11:41:30.196467+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.195206+0000', 'last_change': '2023-10-09T11:41:30.195331+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.195206+0000', 'last_undegraded': '2023-10-09T11:41:30.195206+0000', 'last_fullsized': '2023-10-09T11:41:30.195206+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.197755+0000', 'last_change': '2023-10-09T11:41:30.197903+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.197755+0000', 'last_undegraded': '2023-10-09T11:41:30.197755+0000', 'last_fullsized': '2023-10-09T11:41:30.197755+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.196825+0000', 'last_change': '2023-10-09T11:41:30.196943+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.196825+0000', 'last_undegraded': '2023-10-09T11:41:30.196825+0000', 'last_fullsized': '2023-10-09T11:41:30.196825+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-10-09T11:41:35.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.198280+0000', 'last_change': '2023-10-09T11:41:30.198399+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.198280+0000', 'last_undegraded': '2023-10-09T11:41:30.198280+0000', 'last_fullsized': '2023-10-09T11:41:30.198280+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-10-09T11:41:35.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 99, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:41:30.200052+0000', 'last_change': '2023-10-09T11:41:30.200174+0000', 'last_active': '2023-10-09T11:41:29.600633+0000', 'last_peered': '2023-10-09T11:41:29.600633+0000', 'last_clean': '2023-10-09T11:41:29.600633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:30.200052+0000', 'last_undegraded': '2023-10-09T11:41:30.200052+0000', 'last_fullsized': '2023-10-09T11:41:30.200052+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:29.600633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:35.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:41:35.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.640+0000 7ffa83e13700 1 Processor -- start 2023-10-09T11:41:35.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 -- start start 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa7c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa7c0cbcf0 0x7ffa7c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c0c3380 con 0x7ffa7c1393f0 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c06e010 con 0x7ffa7c0cbcf0 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.641+0000 7ffa83e13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0c2a50 con 0x7ffa7c138bc0 2023-10-09T11:41:35.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa813ae700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa7c1393f0 0x7ffa7c0cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38588/0 (socket says 172.21.15.26:38588) 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa813ae700 1 -- 172.21.15.26:0/1560663283 learned_addr learned my addr 172.21.15.26:0/1560663283 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa81baf700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa7c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875083992 0 0) 0x7ffa7c0c3380 con 0x7ffa7c1393f0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa823b0700 1 --2- 172.21.15.26:0/1560663283 >> v2:172.21.15.67:3300/0 conn(0x7ffa7c0cbcf0 0x7ffa7c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa64004680 con 0x7ffa7c1393f0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501078723 0 0) 0x7ffa64004680 con 0x7ffa7c1393f0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 msgr2=0x7ffa7c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa7c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 >> v2:172.21.15.67:3300/0 conn(0x7ffa7c0cbcf0 msgr2=0x7ffa7c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 --2- 172.21.15.26:0/1560663283 >> v2:172.21.15.67:3300/0 conn(0x7ffa7c0cbcf0 0x7ffa7c0c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0c2d30 con 0x7ffa7c1393f0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ffa70001470 con 0x7ffa7c1393f0 2023-10-09T11:41:35.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 >> v1:172.21.15.26:6789/0 conn(0x7ffa7c1393f0 legacy=0x7ffa7c0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa64004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa64005920 0x7ffa64005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa640062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c06e010 con 0x7ffa64004b70 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0c2a50 con 0x7ffa64005920 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa64003570 con 0x7ffa7c138bc0 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa81baf700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa64004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.642+0000 7ffa813ae700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa64005920 0x7ffa64005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa823b0700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa640062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 -- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 msgr2=0x7ffa640062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c138bc0 0x7ffa640062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 -- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa64005920 msgr2=0x7ffa64005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa64005920 0x7ffa64005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 -- 172.21.15.26:0/1560663283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64004680 con 0x7ffa64004b70 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa81baf700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa64004f80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009c00 tx=0x7ffa740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473ed2d8be0f0bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400e710 con 0x7ffa64004b70 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400e870 con 0x7ffa64004b70 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa80bad700 1 -- 172.21.15.26:0/1560663283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ec30 con 0x7ffa64004b70 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa83e13700 1 -- 172.21.15.26:0/1560663283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 msgr2=0x7ffa64004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa83e13700 1 --2- 172.21.15.26:0/1560663283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa64004f80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009c00 tx=0x7ffa740091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.643+0000 7ffa823b0700 1 -- 172.21.15.26:0/1560663283 reap_dead start 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.644+0000 7ffa83e13700 1 -- 172.21.15.26:0/1560663283 shutdown_connections 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.644+0000 7ffa83e13700 1 -- 172.21.15.26:0/1560663283 >> 172.21.15.26:0/1560663283 conn(0x7ffa7c0ccb60 msgr2=0x7ffa7c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.644+0000 7ffa83e13700 1 -- 172.21.15.26:0/1560663283 shutdown_connections 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.644+0000 7ffa83e13700 1 -- 172.21.15.26:0/1560663283 wait complete. 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 Processor -- start 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 -- start start 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7c12df60 0x7ffa7c13ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 0x7ffa7c165910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c166930 con 0x7ffa64004b70 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c12f150 con 0x7ffa7c12df60 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.645+0000 7ffa83e13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c13b5f0 con 0x7ffa7c13b170 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59686/0 (socket says 172.21.15.26:59686) 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 -- 172.21.15.26:0/2599955910 learned_addr learned my addr 172.21.15.26:0/2599955910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa823b0700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 0x7ffa7c165910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa813ae700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7c12df60 0x7ffa7c13ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 -- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 msgr2=0x7ffa7c165910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 0x7ffa7c165910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 -- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7c12df60 msgr2=0x7ffa7c13ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7c12df60 0x7ffa7c13ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 -- 172.21.15.26:0/2599955910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0c63b0 con 0x7ffa64004b70 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa823b0700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 0x7ffa7c165910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa81baf700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e4b0 tx=0x7ffa7401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74022070 con 0x7ffa64004b70 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400ebf0 con 0x7ffa64004b70 2023-10-09T11:41:35.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c166650 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7401c6c0 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.646+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c0c6040 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.647+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c0c5bc0 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.648+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ffa7401cab0 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.648+0000 7ffa79ffb700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 0x7ffa68069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.648+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa74086330 con 0x7ffa64004b70 2023-10-09T11:41:35.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.648+0000 7ffa813ae700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 0x7ffa68069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.649+0000 7ffa813ae700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 0x7ffa68069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c12c710 tx=0x7ffa70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.653+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7c0c5bc0 con 0x7ffa64004b70 2023-10-09T11:41:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.925+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffa7c0c5bc0 con 0x7ffa64004b70 2023-10-09T11:41:35.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.926+0000 7ffa79ffb700 1 -- 172.21.15.26:0/2599955910 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1521 (secure 0 0 0) 0x7ffa7c0c5bc0 con 0x7ffa64004b70 2023-10-09T11:41:35.927 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:35.927 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":396,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":100,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"creating+activating","count":21}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590992,"bytes_used":2475757568,"bytes_avail":770618355712,"bytes_total":773094113280,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":67,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":6843}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-09T11:40:49.185634+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 msgr2=0x7ffa68069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 0x7ffa68069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c12c710 tx=0x7ffa70009040 comp rx=0 tx=0).stop 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 msgr2=0x7ffa7c0c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e4b0 tx=0x7ffa7401a000 comp rx=0 tx=0).stop 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 shutdown_connections 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa68067290 0x7ffa68069740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa7c13b170 0x7ffa7c165910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa64004b70 0x7ffa7c0c6840 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 --2- 172.21.15.26:0/2599955910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7c12df60 0x7ffa7c13ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 >> 172.21.15.26:0/2599955910 conn(0x7ffa7c0ccb60 msgr2=0x7ffa7c1356d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 shutdown_connections 2023-10-09T11:41:35.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:35.928+0000 7ffa83e13700 1 -- 172.21.15.26:0/2599955910 wait complete. 2023-10-09T11:41:35.933 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-10-09T11:41:35.932+0000 7fb650ea1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:35.942 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:41:35.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.060+0000 7fe98ee45700 1 Processor -- start 2023-10-09T11:41:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.060+0000 7fe98ee45700 1 -- start start 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.060+0000 7fe98ee45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 0x7fe988159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98ee45700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 0x7fe988156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98ee45700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98815ae40 con 0x7fe9880cb5a0 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98ee45700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880ce0f0 con 0x7fe98815a400 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98ee45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880cbde0 con 0x7fe9880cb970 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98d3e2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 0x7fe988156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98d3e2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 0x7fe988156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:42318/0 (socket says 172.21.15.26:42318) 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe987fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 0x7fe988159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe98d3e2700 1 -- 172.21.15.26:0/2090936582 learned_addr learned my addr 172.21.15.26:0/2090936582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe9877fe700 1 -- 172.21.15.26:0/2090936582 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362556317 0 0) 0x7fe98815ae40 con 0x7fe9880cb5a0 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe9877fe700 1 -- 172.21.15.26:0/2090936582 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe974003570 con 0x7fe9880cb5a0 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe987fff700 1 -- 172.21.15.26:0/2090936582 >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 msgr2=0x7fe988156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe987fff700 1 --2- 172.21.15.26:0/2090936582 >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 0x7fe988156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe987fff700 1 -- 172.21.15.26:0/2090936582 >> v1:172.21.15.67:6789/0 conn(0x7fe9880cb5a0 legacy=0x7fe9880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.061+0000 7fe987fff700 1 -- 172.21.15.26:0/2090936582 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98815ab60 con 0x7fe9880cb970 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe987fff700 1 --2- 172.21.15.26:0/2090936582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 0x7fe988159ec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098e0 tx=0x7fe9780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2360d65647ac9e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe9877fe700 1 -- 172.21.15.26:0/2090936582 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978011630 con 0x7fe9880cb970 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe9877fe700 1 -- 172.21.15.26:0/2090936582 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978011790 con 0x7fe9880cb970 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe9877fe700 1 -- 172.21.15.26:0/2090936582 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978011b10 con 0x7fe9880cb970 2023-10-09T11:41:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 -- 172.21.15.26:0/2090936582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 msgr2=0x7fe988159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 --2- 172.21.15.26:0/2090936582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 0x7fe988159ec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098e0 tx=0x7fe9780091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 -- 172.21.15.26:0/2090936582 shutdown_connections 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 --2- 172.21.15.26:0/2090936582 >> v2:172.21.15.67:3300/0 conn(0x7fe98815a400 0x7fe988156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 --2- 172.21.15.26:0/2090936582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb970 0x7fe988159ec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 -- 172.21.15.26:0/2090936582 >> 172.21.15.26:0/2090936582 conn(0x7fe988070e30 msgr2=0x7fe9880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 -- 172.21.15.26:0/2090936582 shutdown_connections 2023-10-09T11:41:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.062+0000 7fe98ee45700 1 -- 172.21.15.26:0/2090936582 wait complete. 2023-10-09T11:41:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.063+0000 7fe98ee45700 1 Processor -- start 2023-10-09T11:41:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 -- start start 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb5a0 0x7fe9880c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 0x7fe9880ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880b43d0 con 0x7fe98815a400 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880c9780 con 0x7fe9880cb970 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98ee45700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988151510 con 0x7fe9880cb5a0 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98d3e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98d3e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59692/0 (socket says 172.21.15.26:59692) 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98d3e2700 1 -- 172.21.15.26:0/869033113 learned_addr learned my addr 172.21.15.26:0/869033113 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe987fff700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 0x7fe9880ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.064+0000 7fe98cbe1700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb5a0 0x7fe9880c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 -- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb5a0 msgr2=0x7fe9880c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb5a0 0x7fe9880c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 -- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 msgr2=0x7fe9880ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 0x7fe9880ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 -- 172.21.15.26:0/869033113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009420 con 0x7fe98815a400 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe987fff700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 0x7fe9880ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98d3e2700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe97000e900 tx=0x7fe970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970013680 con 0x7fe98815a400 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9700137e0 con 0x7fe98815a400 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9880b3f40 con 0x7fe98815a400 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970013ba0 con 0x7fe98815a400 2023-10-09T11:41:36.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.065+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98816a900 con 0x7fe98815a400 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.066+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98804c3c0 con 0x7fe98815a400 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.067+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe97000c460 con 0x7fe98815a400 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.067+0000 7fe984ff9700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 0x7fe968069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.067+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe970084ab0 con 0x7fe98815a400 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.067+0000 7fe98cbe1700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 0x7fe968069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.068+0000 7fe98cbe1700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 0x7fe968069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe9880cf110 tx=0x7fe980002720 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.071+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9700519d0 con 0x7fe98815a400 2023-10-09T11:41:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.261+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9880af2d0 con 0x7fe968067290 2023-10-09T11:41:36.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.270+0000 7fe984ff9700 1 -- 172.21.15.26:0/869033113 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288601 (secure 0 0 0) 0x7fe9880af2d0 con 0x7fe968067290 2023-10-09T11:41:36.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 msgr2=0x7fe968069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 0x7fe968069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe9880cf110 tx=0x7fe980002720 comp rx=0 tx=0).stop 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 msgr2=0x7fe9880ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe97000e900 tx=0x7fe970009250 comp rx=0 tx=0).stop 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 shutdown_connections 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98815a400 0x7fe9880ce9b0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe968067290 0x7fe968069740 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9880cb5a0 0x7fe9880c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 --2- 172.21.15.26:0/869033113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9880cb970 0x7fe9880ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 >> 172.21.15.26:0/869033113 conn(0x7fe988070e30 msgr2=0x7fe9880b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 shutdown_connections 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:36.273+0000 7fe98ee45700 1 -- 172.21.15.26:0/869033113 wait complete. 2023-10-09T11:41:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:36.287 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-09T11:41:35.196106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417732,"kb_used_data":10756,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556988,"statfs":{"total":773094113280,"available":770618355712,"internally_reserved":0,"allocated":11014144,"data_stored":5405955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001458"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197968+0000","last_change":"2023-10-09T11:41:30.198091+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197968+0000","last_undegraded":"2023-10-09T11:41:30.197968+0000","last_fullsized":"2023-10-09T11:41:30.197968+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208578+0000","last_change":"2023-10-09T11:41:30.205032+0000","last_active":"2023-10-09T11:41:30.208578+0000","last_peered":"2023-10-09T11:41:30.208578+0000","last_clean":"2023-10-09T11:41:30.208578+0000","last_became_active":"2023-10-09T11:41:30.204713+0000","last_became_peered":"2023-10-09T11:41:30.204713+0000","last_unstale":"2023-10-09T11:41:30.208578+0000","last_undegraded":"2023-10-09T11:41:30.208578+0000","last_fullsized":"2023-10-09T11:41:30.208578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:58.606943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213873+0000","last_change":"2023-10-09T11:41:30.213873+0000","last_active":"2023-10-09T11:41:30.213873+0000","last_peered":"2023-10-09T11:41:30.213873+0000","last_clean":"2023-10-09T11:41:30.213873+0000","last_became_active":"2023-10-09T11:41:30.211899+0000","last_became_peered":"2023-10-09T11:41:30.211899+0000","last_unstale":"2023-10-09T11:41:30.213873+0000","last_undegraded":"2023-10-09T11:41:30.213873+0000","last_fullsized":"2023-10-09T11:41:30.213873+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197283+0000","last_change":"2023-10-09T11:41:30.197408+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197283+0000","last_undegraded":"2023-10-09T11:41:30.197283+0000","last_fullsized":"2023-10-09T11:41:30.197283+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.194724+0000","last_change":"2023-10-09T11:41:30.194873+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.194724+0000","last_undegraded":"2023-10-09T11:41:30.194724+0000","last_fullsized":"2023-10-09T11:41:30.194724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195429+0000","last_change":"2023-10-09T11:41:30.195524+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195429+0000","last_undegraded":"2023-10-09T11:41:30.195429+0000","last_fullsized":"2023-10-09T11:41:30.195429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206501+0000","last_change":"2023-10-09T11:41:30.206501+0000","last_active":"2023-10-09T11:41:30.206501+0000","last_peered":"2023-10-09T11:41:30.206501+0000","last_clean":"2023-10-09T11:41:30.206501+0000","last_became_active":"2023-10-09T11:41:30.206209+0000","last_became_peered":"2023-10-09T11:41:30.206209+0000","last_unstale":"2023-10-09T11:41:30.206501+0000","last_undegraded":"2023-10-09T11:41:30.206501+0000","last_fullsized":"2023-10-09T11:41:30.206501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:12.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213958+0000","last_change":"2023-10-09T11:41:30.213958+0000","last_active":"2023-10-09T11:41:30.213958+0000","last_peered":"2023-10-09T11:41:30.213958+0000","last_clean":"2023-10-09T11:41:30.213958+0000","last_became_active":"2023-10-09T11:41:30.211379+0000","last_became_peered":"2023-10-09T11:41:30.211379+0000","last_unstale":"2023-10-09T11:41:30.213958+0000","last_undegraded":"2023-10-09T11:41:30.213958+0000","last_fullsized":"2023-10-09T11:41:30.213958+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200175+0000","last_change":"2023-10-09T11:41:30.200300+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200175+0000","last_undegraded":"2023-10-09T11:41:30.200175+0000","last_fullsized":"2023-10-09T11:41:30.200175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.199321+0000","last_change":"2023-10-09T11:41:30.199460+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.199321+0000","last_undegraded":"2023-10-09T11:41:30.199321+0000","last_fullsized":"2023-10-09T11:41:30.199321+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214475+0000","last_change":"2023-10-09T11:41:30.207113+0000","last_active":"2023-10-09T11:41:30.214475+0000","last_peered":"2023-10-09T11:41:30.214475+0000","last_clean":"2023-10-09T11:41:30.214475+0000","last_became_active":"2023-10-09T11:41:30.206810+0000","last_became_peered":"2023-10-09T11:41:30.206810+0000","last_unstale":"2023-10-09T11:41:30.214475+0000","last_undegraded":"2023-10-09T11:41:30.214475+0000","last_fullsized":"2023-10-09T11:41:30.214475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:00.677277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198585+0000","last_change":"2023-10-09T11:41:30.198699+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198585+0000","last_undegraded":"2023-10-09T11:41:30.198585+0000","last_fullsized":"2023-10-09T11:41:30.198585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211940+0000","last_change":"2023-10-09T11:41:30.211940+0000","last_active":"2023-10-09T11:41:30.211940+0000","last_peered":"2023-10-09T11:41:30.211940+0000","last_clean":"2023-10-09T11:41:30.211940+0000","last_became_active":"2023-10-09T11:41:30.211435+0000","last_became_peered":"2023-10-09T11:41:30.211435+0000","last_unstale":"2023-10-09T11:41:30.211940+0000","last_undegraded":"2023-10-09T11:41:30.211940+0000","last_fullsized":"2023-10-09T11:41:30.211940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212286+0000","last_change":"2023-10-09T11:41:30.212286+0000","last_active":"2023-10-09T11:41:30.212286+0000","last_peered":"2023-10-09T11:41:30.212286+0000","last_clean":"2023-10-09T11:41:30.212286+0000","last_became_active":"2023-10-09T11:41:30.211855+0000","last_became_peered":"2023-10-09T11:41:30.211855+0000","last_unstale":"2023-10-09T11:41:30.212286+0000","last_undegraded":"2023-10-09T11:41:30.212286+0000","last_fullsized":"2023-10-09T11:41:30.212286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195861+0000","last_change":"2023-10-09T11:41:30.195980+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195861+0000","last_undegraded":"2023-10-09T11:41:30.195861+0000","last_fullsized":"2023-10-09T11:41:30.195861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195992+0000","last_change":"2023-10-09T11:41:30.196777+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195992+0000","last_undegraded":"2023-10-09T11:41:30.195992+0000","last_fullsized":"2023-10-09T11:41:30.195992+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215491+0000","last_change":"2023-10-09T11:41:30.213001+0000","last_active":"2023-10-09T11:41:30.215491+0000","last_peered":"2023-10-09T11:41:30.215491+0000","last_clean":"2023-10-09T11:41:30.215491+0000","last_became_active":"2023-10-09T11:41:30.212689+0000","last_became_peered":"2023-10-09T11:41:30.212689+0000","last_unstale":"2023-10-09T11:41:30.215491+0000","last_undegraded":"2023-10-09T11:41:30.215491+0000","last_fullsized":"2023-10-09T11:41:30.215491+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:38.335285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216170+0000","last_change":"2023-10-09T11:41:30.210587+0000","last_active":"2023-10-09T11:41:30.216170+0000","last_peered":"2023-10-09T11:41:30.216170+0000","last_clean":"2023-10-09T11:41:30.216170+0000","last_became_active":"2023-10-09T11:41:30.210309+0000","last_became_peered":"2023-10-09T11:41:30.210309+0000","last_unstale":"2023-10-09T11:41:30.216170+0000","last_undegraded":"2023-10-09T11:41:30.216170+0000","last_fullsized":"2023-10-09T11:41:30.216170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214778+0000","last_change":"2023-10-09T11:41:30.214778+0000","last_active":"2023-10-09T11:41:30.214778+0000","last_peered":"2023-10-09T11:41:30.214778+0000","last_clean":"2023-10-09T11:41:30.214778+0000","last_became_active":"2023-10-09T11:41:30.214420+0000","last_became_peered":"2023-10-09T11:41:30.214420+0000","last_unstale":"2023-10-09T11:41:30.214778+0000","last_undegraded":"2023-10-09T11:41:30.214778+0000","last_fullsized":"2023-10-09T11:41:30.214778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215302+0000","last_change":"2023-10-09T11:41:30.211011+0000","last_active":"2023-10-09T11:41:30.215302+0000","last_peered":"2023-10-09T11:41:30.215302+0000","last_clean":"2023-10-09T11:41:30.215302+0000","last_became_active":"2023-10-09T11:41:30.210577+0000","last_became_peered":"2023-10-09T11:41:30.210577+0000","last_unstale":"2023-10-09T11:41:30.215302+0000","last_undegraded":"2023-10-09T11:41:30.215302+0000","last_fullsized":"2023-10-09T11:41:30.215302+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:23.812282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214638+0000","last_change":"2023-10-09T11:41:30.206829+0000","last_active":"2023-10-09T11:41:30.214638+0000","last_peered":"2023-10-09T11:41:30.214638+0000","last_clean":"2023-10-09T11:41:30.214638+0000","last_became_active":"2023-10-09T11:41:30.206191+0000","last_became_peered":"2023-10-09T11:41:30.206191+0000","last_unstale":"2023-10-09T11:41:30.214638+0000","last_undegraded":"2023-10-09T11:41:30.214638+0000","last_fullsized":"2023-10-09T11:41:30.214638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:03.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210832+0000","last_change":"2023-10-09T11:41:30.206981+0000","last_active":"2023-10-09T11:41:30.210832+0000","last_peered":"2023-10-09T11:41:30.210832+0000","last_clean":"2023-10-09T11:41:30.210832+0000","last_became_active":"2023-10-09T11:41:30.206730+0000","last_became_peered":"2023-10-09T11:41:30.206730+0000","last_unstale":"2023-10-09T11:41:30.210832+0000","last_undegraded":"2023-10-09T11:41:30.210832+0000","last_fullsized":"2023-10-09T11:41:30.210832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214555+0000","last_change":"2023-10-09T11:41:30.208259+0000","last_active":"2023-10-09T11:41:30.214555+0000","last_peered":"2023-10-09T11:41:30.214555+0000","last_clean":"2023-10-09T11:41:30.214555+0000","last_became_active":"2023-10-09T11:41:30.207545+0000","last_became_peered":"2023-10-09T11:41:30.207545+0000","last_unstale":"2023-10-09T11:41:30.214555+0000","last_undegraded":"2023-10-09T11:41:30.214555+0000","last_fullsized":"2023-10-09T11:41:30.214555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:00.236671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210900+0000","last_change":"2023-10-09T11:41:30.207410+0000","last_active":"2023-10-09T11:41:30.210900+0000","last_peered":"2023-10-09T11:41:30.210900+0000","last_clean":"2023-10-09T11:41:30.210900+0000","last_became_active":"2023-10-09T11:41:30.207135+0000","last_became_peered":"2023-10-09T11:41:30.207135+0000","last_unstale":"2023-10-09T11:41:30.210900+0000","last_undegraded":"2023-10-09T11:41:30.210900+0000","last_fullsized":"2023-10-09T11:41:30.210900+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214520+0000","last_change":"2023-10-09T11:41:30.207785+0000","last_active":"2023-10-09T11:41:30.214520+0000","last_peered":"2023-10-09T11:41:30.214520+0000","last_clean":"2023-10-09T11:41:30.214520+0000","last_became_active":"2023-10-09T11:41:30.207389+0000","last_became_peered":"2023-10-09T11:41:30.207389+0000","last_unstale":"2023-10-09T11:41:30.214520+0000","last_undegraded":"2023-10-09T11:41:30.214520+0000","last_fullsized":"2023-10-09T11:41:30.214520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197350+0000","last_change":"2023-10-09T11:41:30.199585+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197350+0000","last_undegraded":"2023-10-09T11:41:30.197350+0000","last_fullsized":"2023-10-09T11:41:30.197350+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196868+0000","last_change":"2023-10-09T11:41:30.196964+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196868+0000","last_undegraded":"2023-10-09T11:41:30.196868+0000","last_fullsized":"2023-10-09T11:41:30.196868+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211409+0000","last_change":"2023-10-09T11:41:30.208814+0000","last_active":"2023-10-09T11:41:30.211409+0000","last_peered":"2023-10-09T11:41:30.211409+0000","last_clean":"2023-10-09T11:41:30.211409+0000","last_became_active":"2023-10-09T11:41:30.208561+0000","last_became_peered":"2023-10-09T11:41:30.208561+0000","last_unstale":"2023-10-09T11:41:30.211409+0000","last_undegraded":"2023-10-09T11:41:30.211409+0000","last_fullsized":"2023-10-09T11:41:30.211409+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:13.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215621+0000","last_change":"2023-10-09T11:41:30.213841+0000","last_active":"2023-10-09T11:41:30.215621+0000","last_peered":"2023-10-09T11:41:30.215621+0000","last_clean":"2023-10-09T11:41:30.215621+0000","last_became_active":"2023-10-09T11:41:30.213550+0000","last_became_peered":"2023-10-09T11:41:30.213550+0000","last_unstale":"2023-10-09T11:41:30.215621+0000","last_undegraded":"2023-10-09T11:41:30.215621+0000","last_fullsized":"2023-10-09T11:41:30.215621+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:31.671775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201875+0000","last_change":"2023-10-09T11:41:30.201875+0000","last_active":"2023-10-09T11:41:30.201875+0000","last_peered":"2023-10-09T11:41:30.201875+0000","last_clean":"2023-10-09T11:41:30.201875+0000","last_became_active":"2023-10-09T11:41:30.201565+0000","last_became_peered":"2023-10-09T11:41:30.201565+0000","last_unstale":"2023-10-09T11:41:30.201875+0000","last_undegraded":"2023-10-09T11:41:30.201875+0000","last_fullsized":"2023-10-09T11:41:30.201875+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:30.544630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":7,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203053+0000","last_change":"2023-10-09T11:41:30.203132+0000","last_active":"2023-10-09T11:41:30.203053+0000","last_peered":"2023-10-09T11:41:30.203053+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"2023-10-09T11:41:30.202467+0000","last_became_peered":"2023-10-09T11:41:30.202467+0000","last_unstale":"2023-10-09T11:41:30.203053+0000","last_undegraded":"2023-10-09T11:41:30.203053+0000","last_fullsized":"2023-10-09T11:41:30.203053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:28.546094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198195+0000","last_change":"2023-10-09T11:41:30.198324+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198195+0000","last_undegraded":"2023-10-09T11:41:30.198195+0000","last_fullsized":"2023-10-09T11:41:30.198195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197315+0000","last_change":"2023-10-09T11:41:30.197440+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197315+0000","last_undegraded":"2023-10-09T11:41:30.197315+0000","last_fullsized":"2023-10-09T11:41:30.197315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618361+0000","last_change":"2023-10-09T11:41:29.626042+0000","last_active":"2023-10-09T11:41:30.618361+0000","last_peered":"2023-10-09T11:41:30.618361+0000","last_clean":"2023-10-09T11:41:30.618361+0000","last_became_active":"2023-10-09T11:41:29.625587+0000","last_became_peered":"2023-10-09T11:41:29.625587+0000","last_unstale":"2023-10-09T11:41:30.618361+0000","last_undegraded":"2023-10-09T11:41:30.618361+0000","last_fullsized":"2023-10-09T11:41:30.618361+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:40.925799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216384+0000","last_change":"2023-10-09T11:41:30.213412+0000","last_active":"2023-10-09T11:41:30.216384+0000","last_peered":"2023-10-09T11:41:30.216384+0000","last_clean":"2023-10-09T11:41:30.216384+0000","last_became_active":"2023-10-09T11:41:30.213141+0000","last_became_peered":"2023-10-09T11:41:30.213141+0000","last_unstale":"2023-10-09T11:41:30.216384+0000","last_undegraded":"2023-10-09T11:41:30.216384+0000","last_fullsized":"2023-10-09T11:41:30.216384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:20.601709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202381+0000","last_change":"2023-10-09T11:41:29.629629+0000","last_active":"2023-10-09T11:41:30.202381+0000","last_peered":"2023-10-09T11:41:30.202381+0000","last_clean":"2023-10-09T11:41:30.202381+0000","last_became_active":"2023-10-09T11:41:29.629294+0000","last_became_peered":"2023-10-09T11:41:29.629294+0000","last_unstale":"2023-10-09T11:41:30.202381+0000","last_undegraded":"2023-10-09T11:41:30.202381+0000","last_fullsized":"2023-10-09T11:41:30.202381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:48.066109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197734+0000","last_change":"2023-10-09T11:41:30.197856+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197734+0000","last_undegraded":"2023-10-09T11:41:30.197734+0000","last_fullsized":"2023-10-09T11:41:30.197734+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629816+0000","last_change":"2023-10-09T11:41:29.624723+0000","last_active":"2023-10-09T11:41:29.629816+0000","last_peered":"2023-10-09T11:41:29.629816+0000","last_clean":"2023-10-09T11:41:29.629816+0000","last_became_active":"2023-10-09T11:41:29.624446+0000","last_became_peered":"2023-10-09T11:41:29.624446+0000","last_unstale":"2023-10-09T11:41:29.629816+0000","last_undegraded":"2023-10-09T11:41:29.629816+0000","last_fullsized":"2023-10-09T11:41:29.629816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:24.501718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214087+0000","last_change":"2023-10-09T11:41:30.214087+0000","last_active":"2023-10-09T11:41:30.214087+0000","last_peered":"2023-10-09T11:41:30.214087+0000","last_clean":"2023-10-09T11:41:30.214087+0000","last_became_active":"2023-10-09T11:41:30.212251+0000","last_became_peered":"2023-10-09T11:41:30.212251+0000","last_unstale":"2023-10-09T11:41:30.214087+0000","last_undegraded":"2023-10-09T11:41:30.214087+0000","last_fullsized":"2023-10-09T11:41:30.214087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630635+0000","last_change":"2023-10-09T11:41:29.627113+0000","last_active":"2023-10-09T11:41:29.630635+0000","last_peered":"2023-10-09T11:41:29.630635+0000","last_clean":"2023-10-09T11:41:29.630635+0000","last_became_active":"2023-10-09T11:41:29.626832+0000","last_became_peered":"2023-10-09T11:41:29.626832+0000","last_unstale":"2023-10-09T11:41:29.630635+0000","last_undegraded":"2023-10-09T11:41:29.630635+0000","last_fullsized":"2023-10-09T11:41:29.630635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.078822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196474+0000","last_change":"2023-10-09T11:41:30.196607+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196474+0000","last_undegraded":"2023-10-09T11:41:30.196474+0000","last_fullsized":"2023-10-09T11:41:30.196474+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193718+0000","last_change":"2023-10-09T11:41:29.624687+0000","last_active":"2023-10-09T11:41:30.193718+0000","last_peered":"2023-10-09T11:41:30.193718+0000","last_clean":"2023-10-09T11:41:30.193718+0000","last_became_active":"2023-10-09T11:41:29.622838+0000","last_became_peered":"2023-10-09T11:41:29.622838+0000","last_unstale":"2023-10-09T11:41:30.193718+0000","last_undegraded":"2023-10-09T11:41:30.193718+0000","last_fullsized":"2023-10-09T11:41:30.193718+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:07.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215152+0000","last_change":"2023-10-09T11:41:30.210327+0000","last_active":"2023-10-09T11:41:30.215152+0000","last_peered":"2023-10-09T11:41:30.215152+0000","last_clean":"2023-10-09T11:41:30.215152+0000","last_became_active":"2023-10-09T11:41:30.209999+0000","last_became_peered":"2023-10-09T11:41:30.209999+0000","last_unstale":"2023-10-09T11:41:30.215152+0000","last_undegraded":"2023-10-09T11:41:30.215152+0000","last_fullsized":"2023-10-09T11:41:30.215152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618397+0000","last_change":"2023-10-09T11:41:29.622757+0000","last_active":"2023-10-09T11:41:30.618397+0000","last_peered":"2023-10-09T11:41:30.618397+0000","last_clean":"2023-10-09T11:41:30.618397+0000","last_became_active":"2023-10-09T11:41:29.622405+0000","last_became_peered":"2023-10-09T11:41:29.622405+0000","last_unstale":"2023-10-09T11:41:30.618397+0000","last_undegraded":"2023-10-09T11:41:30.618397+0000","last_fullsized":"2023-10-09T11:41:30.618397+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:37.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196467+0000","last_change":"2023-10-09T11:41:30.196593+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196467+0000","last_undegraded":"2023-10-09T11:41:30.196467+0000","last_fullsized":"2023-10-09T11:41:30.196467+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197823+0000","last_change":"2023-10-09T11:41:29.626941+0000","last_active":"2023-10-09T11:41:30.197823+0000","last_peered":"2023-10-09T11:41:30.197823+0000","last_clean":"2023-10-09T11:41:30.197823+0000","last_became_active":"2023-10-09T11:41:29.626666+0000","last_became_peered":"2023-10-09T11:41:29.626666+0000","last_unstale":"2023-10-09T11:41:30.197823+0000","last_undegraded":"2023-10-09T11:41:30.197823+0000","last_fullsized":"2023-10-09T11:41:30.197823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:10.194833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206394+0000","last_change":"2023-10-09T11:41:30.206394+0000","last_active":"2023-10-09T11:41:30.206394+0000","last_peered":"2023-10-09T11:41:30.206394+0000","last_clean":"2023-10-09T11:41:30.206394+0000","last_became_active":"2023-10-09T11:41:30.206062+0000","last_became_peered":"2023-10-09T11:41:30.206062+0000","last_unstale":"2023-10-09T11:41:30.206394+0000","last_undegraded":"2023-10-09T11:41:30.206394+0000","last_fullsized":"2023-10-09T11:41:30.206394+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:41.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630515+0000","last_change":"2023-10-09T11:41:29.626745+0000","last_active":"2023-10-09T11:41:29.630515+0000","last_peered":"2023-10-09T11:41:29.630515+0000","last_clean":"2023-10-09T11:41:29.630515+0000","last_became_active":"2023-10-09T11:41:29.626206+0000","last_became_peered":"2023-10-09T11:41:29.626206+0000","last_unstale":"2023-10-09T11:41:29.630515+0000","last_undegraded":"2023-10-09T11:41:29.630515+0000","last_fullsized":"2023-10-09T11:41:29.630515+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:25.951409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201154+0000","last_change":"2023-10-09T11:41:30.201154+0000","last_active":"2023-10-09T11:41:30.201154+0000","last_peered":"2023-10-09T11:41:30.201154+0000","last_clean":"2023-10-09T11:41:30.201154+0000","last_became_active":"2023-10-09T11:41:30.200791+0000","last_became_peered":"2023-10-09T11:41:30.200791+0000","last_unstale":"2023-10-09T11:41:30.201154+0000","last_undegraded":"2023-10-09T11:41:30.201154+0000","last_fullsized":"2023-10-09T11:41:30.201154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630333+0000","last_change":"2023-10-09T11:41:29.626711+0000","last_active":"2023-10-09T11:41:29.630333+0000","last_peered":"2023-10-09T11:41:29.630333+0000","last_clean":"2023-10-09T11:41:29.630333+0000","last_became_active":"2023-10-09T11:41:29.626341+0000","last_became_peered":"2023-10-09T11:41:29.626341+0000","last_unstale":"2023-10-09T11:41:29.630333+0000","last_undegraded":"2023-10-09T11:41:29.630333+0000","last_fullsized":"2023-10-09T11:41:29.630333+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.711584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214896+0000","last_change":"2023-10-09T11:41:30.206248+0000","last_active":"2023-10-09T11:41:30.214896+0000","last_peered":"2023-10-09T11:41:30.214896+0000","last_clean":"2023-10-09T11:41:30.214896+0000","last_became_active":"2023-10-09T11:41:30.205788+0000","last_became_peered":"2023-10-09T11:41:30.205788+0000","last_unstale":"2023-10-09T11:41:30.214896+0000","last_undegraded":"2023-10-09T11:41:30.214896+0000","last_fullsized":"2023-10-09T11:41:30.214896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195064+0000","last_change":"2023-10-09T11:41:29.624261+0000","last_active":"2023-10-09T11:41:30.195064+0000","last_peered":"2023-10-09T11:41:30.195064+0000","last_clean":"2023-10-09T11:41:30.195064+0000","last_became_active":"2023-10-09T11:41:29.623990+0000","last_became_peered":"2023-10-09T11:41:29.623990+0000","last_unstale":"2023-10-09T11:41:30.195064+0000","last_undegraded":"2023-10-09T11:41:30.195064+0000","last_fullsized":"2023-10-09T11:41:30.195064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:57.602272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211391+0000","last_change":"2023-10-09T11:41:30.208315+0000","last_active":"2023-10-09T11:41:30.211391+0000","last_peered":"2023-10-09T11:41:30.211391+0000","last_clean":"2023-10-09T11:41:30.211391+0000","last_became_active":"2023-10-09T11:41:30.208028+0000","last_became_peered":"2023-10-09T11:41:30.208028+0000","last_unstale":"2023-10-09T11:41:30.211391+0000","last_undegraded":"2023-10-09T11:41:30.211391+0000","last_fullsized":"2023-10-09T11:41:30.211391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625454+0000","last_change":"2023-10-09T11:41:29.625454+0000","last_active":"2023-10-09T11:41:29.625454+0000","last_peered":"2023-10-09T11:41:29.625454+0000","last_clean":"2023-10-09T11:41:29.625454+0000","last_became_active":"2023-10-09T11:41:29.624809+0000","last_became_peered":"2023-10-09T11:41:29.624809+0000","last_unstale":"2023-10-09T11:41:29.625454+0000","last_undegraded":"2023-10-09T11:41:29.625454+0000","last_fullsized":"2023-10-09T11:41:29.625454+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:56.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212455+0000","last_change":"2023-10-09T11:41:30.212455+0000","last_active":"2023-10-09T11:41:30.212455+0000","last_peered":"2023-10-09T11:41:30.212455+0000","last_clean":"2023-10-09T11:41:30.212455+0000","last_became_active":"2023-10-09T11:41:30.212151+0000","last_became_peered":"2023-10-09T11:41:30.212151+0000","last_unstale":"2023-10-09T11:41:30.212455+0000","last_undegraded":"2023-10-09T11:41:30.212455+0000","last_fullsized":"2023-10-09T11:41:30.212455+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:37.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628591+0000","last_change":"2023-10-09T11:41:29.625291+0000","last_active":"2023-10-09T11:41:29.628591+0000","last_peered":"2023-10-09T11:41:29.628591+0000","last_clean":"2023-10-09T11:41:29.628591+0000","last_became_active":"2023-10-09T11:41:29.624992+0000","last_became_peered":"2023-10-09T11:41:29.624992+0000","last_unstale":"2023-10-09T11:41:29.628591+0000","last_undegraded":"2023-10-09T11:41:29.628591+0000","last_fullsized":"2023-10-09T11:41:29.628591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:50.027818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209237+0000","last_change":"2023-10-09T11:41:30.203371+0000","last_active":"2023-10-09T11:41:30.209237+0000","last_peered":"2023-10-09T11:41:30.209237+0000","last_clean":"2023-10-09T11:41:30.209237+0000","last_became_active":"2023-10-09T11:41:30.203126+0000","last_became_peered":"2023-10-09T11:41:30.203126+0000","last_unstale":"2023-10-09T11:41:30.209237+0000","last_undegraded":"2023-10-09T11:41:30.209237+0000","last_fullsized":"2023-10-09T11:41:30.209237+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629864+0000","last_change":"2023-10-09T11:41:29.626334+0000","last_active":"2023-10-09T11:41:29.629864+0000","last_peered":"2023-10-09T11:41:29.629864+0000","last_clean":"2023-10-09T11:41:29.629864+0000","last_became_active":"2023-10-09T11:41:29.625700+0000","last_became_peered":"2023-10-09T11:41:29.625700+0000","last_unstale":"2023-10-09T11:41:29.629864+0000","last_undegraded":"2023-10-09T11:41:29.629864+0000","last_fullsized":"2023-10-09T11:41:29.629864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:38.376341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212284+0000","last_change":"2023-10-09T11:41:30.211426+0000","last_active":"2023-10-09T11:41:30.212284+0000","last_peered":"2023-10-09T11:41:30.212284+0000","last_clean":"2023-10-09T11:41:30.212284+0000","last_became_active":"2023-10-09T11:41:30.211140+0000","last_became_peered":"2023-10-09T11:41:30.211140+0000","last_unstale":"2023-10-09T11:41:30.212284+0000","last_undegraded":"2023-10-09T11:41:30.212284+0000","last_fullsized":"2023-10-09T11:41:30.212284+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197765+0000","last_change":"2023-10-09T11:41:29.628526+0000","last_active":"2023-10-09T11:41:30.197765+0000","last_peered":"2023-10-09T11:41:30.197765+0000","last_clean":"2023-10-09T11:41:30.197765+0000","last_became_active":"2023-10-09T11:41:29.628346+0000","last_became_peered":"2023-10-09T11:41:29.628346+0000","last_unstale":"2023-10-09T11:41:30.197765+0000","last_undegraded":"2023-10-09T11:41:30.197765+0000","last_fullsized":"2023-10-09T11:41:30.197765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:11.803064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210854+0000","last_change":"2023-10-09T11:41:30.207505+0000","last_active":"2023-10-09T11:41:30.210854+0000","last_peered":"2023-10-09T11:41:30.210854+0000","last_clean":"2023-10-09T11:41:30.210854+0000","last_became_active":"2023-10-09T11:41:30.206861+0000","last_became_peered":"2023-10-09T11:41:30.206861+0000","last_unstale":"2023-10-09T11:41:30.210854+0000","last_undegraded":"2023-10-09T11:41:30.210854+0000","last_fullsized":"2023-10-09T11:41:30.210854+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630825+0000","last_change":"2023-10-09T11:41:29.628993+0000","last_active":"2023-10-09T11:41:29.630825+0000","last_peered":"2023-10-09T11:41:29.630825+0000","last_clean":"2023-10-09T11:41:29.630825+0000","last_became_active":"2023-10-09T11:41:29.628689+0000","last_became_peered":"2023-10-09T11:41:29.628689+0000","last_unstale":"2023-10-09T11:41:29.630825+0000","last_undegraded":"2023-10-09T11:41:29.630825+0000","last_fullsized":"2023-10-09T11:41:29.630825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:47.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.195206+0000","last_change":"2023-10-09T11:41:30.195331+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.195206+0000","last_undegraded":"2023-10-09T11:41:30.195206+0000","last_fullsized":"2023-10-09T11:41:30.195206+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627947+0000","last_change":"2023-10-09T11:41:29.627947+0000","last_active":"2023-10-09T11:41:29.627947+0000","last_peered":"2023-10-09T11:41:29.627947+0000","last_clean":"2023-10-09T11:41:29.627947+0000","last_became_active":"2023-10-09T11:41:29.627683+0000","last_became_peered":"2023-10-09T11:41:29.627683+0000","last_unstale":"2023-10-09T11:41:29.627947+0000","last_undegraded":"2023-10-09T11:41:29.627947+0000","last_fullsized":"2023-10-09T11:41:29.627947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:34.004467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.197755+0000","last_change":"2023-10-09T11:41:30.197903+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.197755+0000","last_undegraded":"2023-10-09T11:41:30.197755+0000","last_fullsized":"2023-10-09T11:41:30.197755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625667+0000","last_change":"2023-10-09T11:41:29.622774+0000","last_active":"2023-10-09T11:41:29.625667+0000","last_peered":"2023-10-09T11:41:29.625667+0000","last_clean":"2023-10-09T11:41:29.625667+0000","last_became_active":"2023-10-09T11:41:29.622497+0000","last_became_peered":"2023-10-09T11:41:29.622497+0000","last_unstale":"2023-10-09T11:41:29.625667+0000","last_undegraded":"2023-10-09T11:41:29.625667+0000","last_fullsized":"2023-10-09T11:41:29.625667+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:17.226611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212307+0000","last_change":"2023-10-09T11:41:30.212307+0000","last_active":"2023-10-09T11:41:30.212307+0000","last_peered":"2023-10-09T11:41:30.212307+0000","last_clean":"2023-10-09T11:41:30.212307+0000","last_became_active":"2023-10-09T11:41:30.211263+0000","last_became_peered":"2023-10-09T11:41:30.211263+0000","last_unstale":"2023-10-09T11:41:30.212307+0000","last_undegraded":"2023-10-09T11:41:30.212307+0000","last_fullsized":"2023-10-09T11:41:30.212307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617971+0000","last_change":"2023-10-09T11:41:29.624896+0000","last_active":"2023-10-09T11:41:30.617971+0000","last_peered":"2023-10-09T11:41:30.617971+0000","last_clean":"2023-10-09T11:41:30.617971+0000","last_became_active":"2023-10-09T11:41:29.624643+0000","last_became_peered":"2023-10-09T11:41:29.624643+0000","last_unstale":"2023-10-09T11:41:30.617971+0000","last_undegraded":"2023-10-09T11:41:30.617971+0000","last_fullsized":"2023-10-09T11:41:30.617971+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:40.658382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214279+0000","last_change":"2023-10-09T11:41:30.214279+0000","last_active":"2023-10-09T11:41:30.214279+0000","last_peered":"2023-10-09T11:41:30.214279+0000","last_clean":"2023-10-09T11:41:30.214279+0000","last_became_active":"2023-10-09T11:41:30.212519+0000","last_became_peered":"2023-10-09T11:41:30.212519+0000","last_unstale":"2023-10-09T11:41:30.214279+0000","last_undegraded":"2023-10-09T11:41:30.214279+0000","last_fullsized":"2023-10-09T11:41:30.214279+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628363+0000","last_change":"2023-10-09T11:41:29.623446+0000","last_active":"2023-10-09T11:41:29.628363+0000","last_peered":"2023-10-09T11:41:29.628363+0000","last_clean":"2023-10-09T11:41:29.628363+0000","last_became_active":"2023-10-09T11:41:29.623199+0000","last_became_peered":"2023-10-09T11:41:29.623199+0000","last_unstale":"2023-10-09T11:41:29.628363+0000","last_undegraded":"2023-10-09T11:41:29.628363+0000","last_fullsized":"2023-10-09T11:41:29.628363+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:57.601464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212736+0000","last_change":"2023-10-09T11:41:30.212736+0000","last_active":"2023-10-09T11:41:30.212736+0000","last_peered":"2023-10-09T11:41:30.212736+0000","last_clean":"2023-10-09T11:41:30.212736+0000","last_became_active":"2023-10-09T11:41:30.211249+0000","last_became_peered":"2023-10-09T11:41:30.211249+0000","last_unstale":"2023-10-09T11:41:30.212736+0000","last_undegraded":"2023-10-09T11:41:30.212736+0000","last_fullsized":"2023-10-09T11:41:30.212736+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629881+0000","last_change":"2023-10-09T11:41:29.626531+0000","last_active":"2023-10-09T11:41:29.629881+0000","last_peered":"2023-10-09T11:41:29.629881+0000","last_clean":"2023-10-09T11:41:29.629881+0000","last_became_active":"2023-10-09T11:41:29.626069+0000","last_became_peered":"2023-10-09T11:41:29.626069+0000","last_unstale":"2023-10-09T11:41:29.629881+0000","last_undegraded":"2023-10-09T11:41:29.629881+0000","last_fullsized":"2023-10-09T11:41:29.629881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:57.065033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.196825+0000","last_change":"2023-10-09T11:41:30.196943+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.196825+0000","last_undegraded":"2023-10-09T11:41:30.196825+0000","last_fullsized":"2023-10-09T11:41:30.196825+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.630294+0000","last_change":"2023-10-09T11:41:29.626659+0000","last_active":"2023-10-09T11:41:29.630294+0000","last_peered":"2023-10-09T11:41:29.630294+0000","last_clean":"2023-10-09T11:41:29.630294+0000","last_became_active":"2023-10-09T11:41:29.626359+0000","last_became_peered":"2023-10-09T11:41:29.626359+0000","last_unstale":"2023-10-09T11:41:29.630294+0000","last_undegraded":"2023-10-09T11:41:29.630294+0000","last_fullsized":"2023-10-09T11:41:29.630294+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:15.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213139+0000","last_change":"2023-10-09T11:41:30.213139+0000","last_active":"2023-10-09T11:41:30.213139+0000","last_peered":"2023-10-09T11:41:30.213139+0000","last_clean":"2023-10-09T11:41:30.213139+0000","last_became_active":"2023-10-09T11:41:30.212582+0000","last_became_peered":"2023-10-09T11:41:30.212582+0000","last_unstale":"2023-10-09T11:41:30.213139+0000","last_undegraded":"2023-10-09T11:41:30.213139+0000","last_fullsized":"2023-10-09T11:41:30.213139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629838+0000","last_change":"2023-10-09T11:41:29.628284+0000","last_active":"2023-10-09T11:41:29.629838+0000","last_peered":"2023-10-09T11:41:29.629838+0000","last_clean":"2023-10-09T11:41:29.629838+0000","last_became_active":"2023-10-09T11:41:29.627998+0000","last_became_peered":"2023-10-09T11:41:29.627998+0000","last_unstale":"2023-10-09T11:41:29.629838+0000","last_undegraded":"2023-10-09T11:41:29.629838+0000","last_fullsized":"2023-10-09T11:41:29.629838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:54.858809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210767+0000","last_change":"2023-10-09T11:41:30.204375+0000","last_active":"2023-10-09T11:41:30.210767+0000","last_peered":"2023-10-09T11:41:30.210767+0000","last_clean":"2023-10-09T11:41:30.210767+0000","last_became_active":"2023-10-09T11:41:30.204103+0000","last_became_peered":"2023-10-09T11:41:30.204103+0000","last_unstale":"2023-10-09T11:41:30.210767+0000","last_undegraded":"2023-10-09T11:41:30.210767+0000","last_fullsized":"2023-10-09T11:41:30.210767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:30.104458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627507+0000","last_change":"2023-10-09T11:41:29.623589+0000","last_active":"2023-10-09T11:41:29.627507+0000","last_peered":"2023-10-09T11:41:29.627507+0000","last_clean":"2023-10-09T11:41:29.627507+0000","last_became_active":"2023-10-09T11:41:29.622865+0000","last_became_peered":"2023-10-09T11:41:29.622865+0000","last_unstale":"2023-10-09T11:41:29.627507+0000","last_undegraded":"2023-10-09T11:41:29.627507+0000","last_fullsized":"2023-10-09T11:41:29.627507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:58.673145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215946+0000","last_change":"2023-10-09T11:41:30.208877+0000","last_active":"2023-10-09T11:41:30.215946+0000","last_peered":"2023-10-09T11:41:30.215946+0000","last_clean":"2023-10-09T11:41:30.215946+0000","last_became_active":"2023-10-09T11:41:30.208587+0000","last_became_peered":"2023-10-09T11:41:30.208587+0000","last_unstale":"2023-10-09T11:41:30.215946+0000","last_undegraded":"2023-10-09T11:41:30.215946+0000","last_fullsized":"2023-10-09T11:41:30.215946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:49.070780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618409+0000","last_change":"2023-10-09T11:41:29.629791+0000","last_active":"2023-10-09T11:41:30.618409+0000","last_peered":"2023-10-09T11:41:30.618409+0000","last_clean":"2023-10-09T11:41:30.618409+0000","last_became_active":"2023-10-09T11:41:29.629499+0000","last_became_peered":"2023-10-09T11:41:29.629499+0000","last_unstale":"2023-10-09T11:41:30.618409+0000","last_undegraded":"2023-10-09T11:41:30.618409+0000","last_fullsized":"2023-10-09T11:41:30.618409+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:30.667105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.198280+0000","last_change":"2023-10-09T11:41:30.198399+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.198280+0000","last_undegraded":"2023-10-09T11:41:30.198280+0000","last_fullsized":"2023-10-09T11:41:30.198280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202221+0000","last_change":"2023-10-09T11:41:29.626094+0000","last_active":"2023-10-09T11:41:30.202221+0000","last_peered":"2023-10-09T11:41:30.202221+0000","last_clean":"2023-10-09T11:41:30.202221+0000","last_became_active":"2023-10-09T11:41:29.625689+0000","last_became_peered":"2023-10-09T11:41:29.625689+0000","last_unstale":"2023-10-09T11:41:30.202221+0000","last_undegraded":"2023-10-09T11:41:30.202221+0000","last_fullsized":"2023-10-09T11:41:30.202221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:29.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":2,"reported_epoch":99,"state":"creating+activating","last_fresh":"2023-10-09T11:41:30.200052+0000","last_change":"2023-10-09T11:41:30.200174+0000","last_active":"2023-10-09T11:41:29.600633+0000","last_peered":"2023-10-09T11:41:29.600633+0000","last_clean":"2023-10-09T11:41:29.600633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:30.200052+0000","last_undegraded":"2023-10-09T11:41:30.200052+0000","last_fullsized":"2023-10-09T11:41:30.200052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.625772+0000","last_change":"2023-10-09T11:41:29.625772+0000","last_active":"2023-10-09T11:41:29.625772+0000","last_peered":"2023-10-09T11:41:29.625772+0000","last_clean":"2023-10-09T11:41:29.625772+0000","last_became_active":"2023-10-09T11:41:29.625181+0000","last_became_peered":"2023-10-09T11:41:29.625181+0000","last_unstale":"2023-10-09T11:41:29.625772+0000","last_undegraded":"2023-10-09T11:41:29.625772+0000","last_fullsized":"2023-10-09T11:41:29.625772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:29.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215988+0000","last_change":"2023-10-09T11:41:30.208985+0000","last_active":"2023-10-09T11:41:30.215988+0000","last_peered":"2023-10-09T11:41:30.215988+0000","last_clean":"2023-10-09T11:41:30.215988+0000","last_became_active":"2023-10-09T11:41:30.208686+0000","last_became_peered":"2023-10-09T11:41:30.208686+0000","last_unstale":"2023-10-09T11:41:30.215988+0000","last_undegraded":"2023-10-09T11:41:30.215988+0000","last_fullsized":"2023-10-09T11:41:30.215988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195918+0000","last_change":"2023-10-09T11:41:29.624296+0000","last_active":"2023-10-09T11:41:30.195918+0000","last_peered":"2023-10-09T11:41:30.195918+0000","last_clean":"2023-10-09T11:41:30.195918+0000","last_became_active":"2023-10-09T11:41:29.623669+0000","last_became_peered":"2023-10-09T11:41:29.623669+0000","last_unstale":"2023-10-09T11:41:30.195918+0000","last_undegraded":"2023-10-09T11:41:30.195918+0000","last_fullsized":"2023-10-09T11:41:30.195918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.232001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208773+0000","last_change":"2023-10-09T11:41:30.205259+0000","last_active":"2023-10-09T11:41:30.208773+0000","last_peered":"2023-10-09T11:41:30.208773+0000","last_clean":"2023-10-09T11:41:30.208773+0000","last_became_active":"2023-10-09T11:41:30.204932+0000","last_became_peered":"2023-10-09T11:41:30.204932+0000","last_unstale":"2023-10-09T11:41:30.208773+0000","last_undegraded":"2023-10-09T11:41:30.208773+0000","last_fullsized":"2023-10-09T11:41:30.208773+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:38.539477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628391+0000","last_change":"2023-10-09T11:41:29.622849+0000","last_active":"2023-10-09T11:41:29.628391+0000","last_peered":"2023-10-09T11:41:29.628391+0000","last_clean":"2023-10-09T11:41:29.628391+0000","last_became_active":"2023-10-09T11:41:29.622558+0000","last_became_peered":"2023-10-09T11:41:29.622558+0000","last_unstale":"2023-10-09T11:41:29.628391+0000","last_undegraded":"2023-10-09T11:41:29.628391+0000","last_fullsized":"2023-10-09T11:41:29.628391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:03.488670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214678+0000","last_change":"2023-10-09T11:41:30.207009+0000","last_active":"2023-10-09T11:41:30.214678+0000","last_peered":"2023-10-09T11:41:30.214678+0000","last_clean":"2023-10-09T11:41:30.214678+0000","last_became_active":"2023-10-09T11:41:30.206529+0000","last_became_peered":"2023-10-09T11:41:30.206529+0000","last_unstale":"2023-10-09T11:41:30.214678+0000","last_undegraded":"2023-10-09T11:41:30.214678+0000","last_fullsized":"2023-10-09T11:41:30.214678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197086+0000","last_change":"2023-10-09T11:41:29.624867+0000","last_active":"2023-10-09T11:41:30.197086+0000","last_peered":"2023-10-09T11:41:30.197086+0000","last_clean":"2023-10-09T11:41:30.197086+0000","last_became_active":"2023-10-09T11:41:29.624541+0000","last_became_peered":"2023-10-09T11:41:29.624541+0000","last_unstale":"2023-10-09T11:41:30.197086+0000","last_undegraded":"2023-10-09T11:41:30.197086+0000","last_fullsized":"2023-10-09T11:41:30.197086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:53.532131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216031+0000","last_change":"2023-10-09T11:41:30.216031+0000","last_active":"2023-10-09T11:41:30.216031+0000","last_peered":"2023-10-09T11:41:30.216031+0000","last_clean":"2023-10-09T11:41:30.216031+0000","last_became_active":"2023-10-09T11:41:30.215746+0000","last_became_peered":"2023-10-09T11:41:30.215746+0000","last_unstale":"2023-10-09T11:41:30.216031+0000","last_undegraded":"2023-10-09T11:41:30.216031+0000","last_fullsized":"2023-10-09T11:41:30.216031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.629866+0000","last_change":"2023-10-09T11:41:29.624557+0000","last_active":"2023-10-09T11:41:29.629866+0000","last_peered":"2023-10-09T11:41:29.629866+0000","last_clean":"2023-10-09T11:41:29.629866+0000","last_became_active":"2023-10-09T11:41:29.624236+0000","last_became_peered":"2023-10-09T11:41:29.624236+0000","last_unstale":"2023-10-09T11:41:29.629866+0000","last_undegraded":"2023-10-09T11:41:29.629866+0000","last_fullsized":"2023-10-09T11:41:29.629866+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:01.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.201532+0000","last_change":"2023-10-09T11:41:30.201532+0000","last_active":"2023-10-09T11:41:30.201532+0000","last_peered":"2023-10-09T11:41:30.201532+0000","last_clean":"2023-10-09T11:41:30.201532+0000","last_became_active":"2023-10-09T11:41:30.201154+0000","last_became_peered":"2023-10-09T11:41:30.201154+0000","last_unstale":"2023-10-09T11:41:30.201532+0000","last_undegraded":"2023-10-09T11:41:30.201532+0000","last_fullsized":"2023-10-09T11:41:30.201532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:39.734390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.627487+0000","last_change":"2023-10-09T11:41:29.623414+0000","last_active":"2023-10-09T11:41:29.627487+0000","last_peered":"2023-10-09T11:41:29.627487+0000","last_clean":"2023-10-09T11:41:29.627487+0000","last_became_active":"2023-10-09T11:41:29.622500+0000","last_became_peered":"2023-10-09T11:41:29.622500+0000","last_unstale":"2023-10-09T11:41:29.627487+0000","last_undegraded":"2023-10-09T11:41:29.627487+0000","last_fullsized":"2023-10-09T11:41:29.627487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:58.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209205+0000","last_change":"2023-10-09T11:41:30.202138+0000","last_active":"2023-10-09T11:41:30.209205+0000","last_peered":"2023-10-09T11:41:30.209205+0000","last_clean":"2023-10-09T11:41:30.209205+0000","last_became_active":"2023-10-09T11:41:30.201860+0000","last_became_peered":"2023-10-09T11:41:30.201860+0000","last_unstale":"2023-10-09T11:41:30.209205+0000","last_undegraded":"2023-10-09T11:41:30.209205+0000","last_fullsized":"2023-10-09T11:41:30.209205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.628141+0000","last_change":"2023-10-09T11:41:29.622285+0000","last_active":"2023-10-09T11:41:29.628141+0000","last_peered":"2023-10-09T11:41:29.628141+0000","last_clean":"2023-10-09T11:41:29.628141+0000","last_became_active":"2023-10-09T11:41:29.621974+0000","last_became_peered":"2023-10-09T11:41:29.621974+0000","last_unstale":"2023-10-09T11:41:29.628141+0000","last_undegraded":"2023-10-09T11:41:29.628141+0000","last_fullsized":"2023-10-09T11:41:29.628141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:53.801322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":227,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T11:41:29.621958+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:29.621958+0000","last_peered":"2023-10-09T11:41:29.621958+0000","last_clean":"2023-10-09T11:41:29.621958+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:29.621958+0000","last_undegraded":"2023-10-09T11:41:29.621958+0000","last_fullsized":"2023-10-09T11:41:29.621958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542225,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303164,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068676,"statfs":{"total":96636764160,"available":96326324224,"internally_reserved":0,"allocated":1822720,"data_stored":1120061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.496},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.39300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.35099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542225,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.498}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302572,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069268,"statfs":{"total":96636764160,"available":96326930432,"internally_reserved":0,"allocated":1216512,"data_stored":522930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.372},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":537587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542226,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.624},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.64000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298488,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073352,"statfs":{"total":96636764160,"available":96331112448,"internally_reserved":0,"allocated":1228800,"data_stored":529693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:39.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:39.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 Processor -- start 2023-10-09T11:41:39.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 -- start start 2023-10-09T11:41:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4240cb5a0 0x7fe4240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe424159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42415ae40 con 0x7fe4240cde50 2023-10-09T11:41:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240d13f0 con 0x7fe4240cb5a0 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe42a9b1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42415ab60 con 0x7fe4240cd9e0 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe428f4e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe4240cde50 0x7fe424156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38604/0 (socket says 172.21.15.26:38604) 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.425+0000 7fe428f4e700 1 -- 172.21.15.26:0/1240845301 learned_addr learned my addr 172.21.15.26:0/1240845301 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe423fff700 1 --2- 172.21.15.26:0/1240845301 >> v2:172.21.15.67:3300/0 conn(0x7fe4240cb5a0 0x7fe4240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe4237fe700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe424159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579307885 0 0) 0x7fe42415ae40 con 0x7fe4240cde50 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe410003570 con 0x7fe4240cde50 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011448081 0 0) 0x7fe410003570 con 0x7fe4240cde50 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 msgr2=0x7fe424159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe424159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 >> v2:172.21.15.67:3300/0 conn(0x7fe4240cb5a0 msgr2=0x7fe4240cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 --2- 172.21.15.26:0/1240845301 >> v2:172.21.15.67:3300/0 conn(0x7fe4240cb5a0 0x7fe4240cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240ccf00 con 0x7fe4240cde50 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fe41c0017f0 con 0x7fe4240cde50 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 >> v1:172.21.15.26:6789/0 conn(0x7fe4240cde50 legacy=0x7fe424156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe410003a60 0x7fe410003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe410004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe410004d50 0x7fe4100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42415ab60 con 0x7fe410004d50 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41000ba60 con 0x7fe410003a60 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41000bba0 con 0x7fe4240cd9e0 2023-10-09T11:41:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe428f4e700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe410004d50 0x7fe4100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe423fff700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe410003a60 0x7fe410003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.426+0000 7fe4237fe700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe410004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 -- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 msgr2=0x7fe410004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4240cd9e0 0x7fe410004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 -- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe410003a60 msgr2=0x7fe410003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe410003a60 0x7fe410003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 -- 172.21.15.26:0/1240845301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410003570 con 0x7fe410004d50 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe428f4e700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe410004d50 0x7fe4100051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00a970 tx=0x7fe41c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4618b780690d1b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c012440 con 0x7fe410004d50 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c0125c0 con 0x7fe410004d50 2023-10-09T11:41:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe422ffd700 1 -- 172.21.15.26:0/1240845301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c012980 con 0x7fe410004d50 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe42a9b1700 1 -- 172.21.15.26:0/1240845301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe410004d50 msgr2=0x7fe4100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.428+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/1240845301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe410004d50 0x7fe4100051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00a970 tx=0x7fe41c002210 comp rx=0 tx=0).stop 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.429+0000 7fe428f4e700 1 -- 172.21.15.26:0/1240845301 reap_dead start 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.429+0000 7fe42a9b1700 1 -- 172.21.15.26:0/1240845301 shutdown_connections 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.429+0000 7fe42a9b1700 1 -- 172.21.15.26:0/1240845301 >> 172.21.15.26:0/1240845301 conn(0x7fe424070e30 msgr2=0x7fe4240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.429+0000 7fe42a9b1700 1 -- 172.21.15.26:0/1240845301 shutdown_connections 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.429+0000 7fe42a9b1700 1 -- 172.21.15.26:0/1240845301 wait complete. 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.430+0000 7fe42a9b1700 1 Processor -- start 2023-10-09T11:41:39.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.430+0000 7fe42a9b1700 1 -- start start 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 0x7fe424156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 0x7fe4241534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c8db0 con 0x7fe42414c260 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c81e0 con 0x7fe424157520 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c8480 con 0x7fe424159510 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59702/0 (socket says 172.21.15.26:59702) 2023-10-09T11:41:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 -- 172.21.15.26:0/3740850386 learned_addr learned my addr 172.21.15.26:0/3740850386 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe4237fe700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 0x7fe424156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe428f4e700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 0x7fe4241534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 -- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 msgr2=0x7fe424156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 0x7fe424156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 -- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 msgr2=0x7fe4241534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 0x7fe4241534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 -- 172.21.15.26:0/3740850386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240c8760 con 0x7fe42414c260 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe428f4e700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 0x7fe4241534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe4237fe700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 0x7fe424156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe423fff700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006ac0 tx=0x7fe40c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00fa10 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00fb70 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240c8a40 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c014440 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.431+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42414c630 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.432+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4240c9090 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.433+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe40c014830 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.433+0000 7fe41bfff700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 0x7fe404069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.433+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe40c018030 con 0x7fe42414c260 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.433+0000 7fe4237fe700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 0x7fe404069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.434+0000 7fe4237fe700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 0x7fe404069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe4140093f0 tx=0x7fe414008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.437+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe40c052320 con 0x7fe42414c260 2023-10-09T11:41:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.631+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4240c8ef0 con 0x7fe404067290 2023-10-09T11:41:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.640+0000 7fe41bfff700 1 -- 172.21.15.26:0/3740850386 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289285 (secure 0 0 0) 0x7fe414009a60 con 0x7fe404067290 2023-10-09T11:41:39.644 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 msgr2=0x7fe404069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 0x7fe404069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe4140093f0 tx=0x7fe414008040 comp rx=0 tx=0).stop 2023-10-09T11:41:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 msgr2=0x7fe424158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006ac0 tx=0x7fe40c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 shutdown_connections 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe424157520 0x7fe4241534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe42414c260 0x7fe424158fd0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe404067290 0x7fe404069740 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 --2- 172.21.15.26:0/3740850386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe424159510 0x7fe424156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 >> 172.21.15.26:0/3740850386 conn(0x7fe424070e30 msgr2=0x7fe4240b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 shutdown_connections 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.643+0000 7fe42a9b1700 1 -- 172.21.15.26:0/3740850386 wait complete. 2023-10-09T11:41:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:41:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2023-10-09T11:41:39.197310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417896,"kb_used_data":10920,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556824,"statfs":{"total":773094113280,"available":770618187776,"internally_reserved":0,"allocated":11182080,"data_stored":5473196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.005178"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210306+0000","last_change":"2023-10-09T11:41:30.209255+0000","last_active":"2023-10-09T11:41:30.210306+0000","last_peered":"2023-10-09T11:41:30.210306+0000","last_clean":"2023-10-09T11:41:30.210306+0000","last_became_active":"2023-10-09T11:41:30.208996+0000","last_became_peered":"2023-10-09T11:41:30.208996+0000","last_unstale":"2023-10-09T11:41:30.210306+0000","last_undegraded":"2023-10-09T11:41:30.210306+0000","last_fullsized":"2023-10-09T11:41:30.210306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:44.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208578+0000","last_change":"2023-10-09T11:41:30.205032+0000","last_active":"2023-10-09T11:41:30.208578+0000","last_peered":"2023-10-09T11:41:30.208578+0000","last_clean":"2023-10-09T11:41:30.208578+0000","last_became_active":"2023-10-09T11:41:30.204713+0000","last_became_peered":"2023-10-09T11:41:30.204713+0000","last_unstale":"2023-10-09T11:41:30.208578+0000","last_undegraded":"2023-10-09T11:41:30.208578+0000","last_fullsized":"2023-10-09T11:41:30.208578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:58.606943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217965+0000","last_change":"2023-10-09T11:41:30.213873+0000","last_active":"2023-10-09T11:41:30.217965+0000","last_peered":"2023-10-09T11:41:30.217965+0000","last_clean":"2023-10-09T11:41:30.217965+0000","last_became_active":"2023-10-09T11:41:30.211899+0000","last_became_peered":"2023-10-09T11:41:30.211899+0000","last_unstale":"2023-10-09T11:41:30.217965+0000","last_undegraded":"2023-10-09T11:41:30.217965+0000","last_fullsized":"2023-10-09T11:41:30.217965+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211918+0000","last_change":"2023-10-09T11:41:30.210792+0000","last_active":"2023-10-09T11:41:30.211918+0000","last_peered":"2023-10-09T11:41:30.211918+0000","last_clean":"2023-10-09T11:41:30.211918+0000","last_became_active":"2023-10-09T11:41:30.210406+0000","last_became_peered":"2023-10-09T11:41:30.210406+0000","last_unstale":"2023-10-09T11:41:30.211918+0000","last_undegraded":"2023-10-09T11:41:30.211918+0000","last_fullsized":"2023-10-09T11:41:30.211918+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:44.627802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.202591+0000","last_change":"2023-10-09T11:41:30.199716+0000","last_active":"2023-10-09T11:41:30.202591+0000","last_peered":"2023-10-09T11:41:30.202591+0000","last_clean":"2023-10-09T11:41:30.202591+0000","last_became_active":"2023-10-09T11:41:30.199451+0000","last_became_peered":"2023-10-09T11:41:30.199451+0000","last_unstale":"2023-10-09T11:41:30.202591+0000","last_undegraded":"2023-10-09T11:41:30.202591+0000","last_fullsized":"2023-10-09T11:41:30.202591+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:08.871621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206966+0000","last_change":"2023-10-09T11:41:30.202938+0000","last_active":"2023-10-09T11:41:30.206966+0000","last_peered":"2023-10-09T11:41:30.206966+0000","last_clean":"2023-10-09T11:41:30.206966+0000","last_became_active":"2023-10-09T11:41:30.202696+0000","last_became_peered":"2023-10-09T11:41:30.202696+0000","last_unstale":"2023-10-09T11:41:30.206966+0000","last_undegraded":"2023-10-09T11:41:30.206966+0000","last_fullsized":"2023-10-09T11:41:30.206966+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:08.699887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209597+0000","last_change":"2023-10-09T11:41:30.206501+0000","last_active":"2023-10-09T11:41:30.209597+0000","last_peered":"2023-10-09T11:41:30.209597+0000","last_clean":"2023-10-09T11:41:30.209597+0000","last_became_active":"2023-10-09T11:41:30.206209+0000","last_became_peered":"2023-10-09T11:41:30.206209+0000","last_unstale":"2023-10-09T11:41:30.209597+0000","last_undegraded":"2023-10-09T11:41:30.209597+0000","last_fullsized":"2023-10-09T11:41:30.209597+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:12.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.218001+0000","last_change":"2023-10-09T11:41:30.213958+0000","last_active":"2023-10-09T11:41:30.218001+0000","last_peered":"2023-10-09T11:41:30.218001+0000","last_clean":"2023-10-09T11:41:30.218001+0000","last_became_active":"2023-10-09T11:41:30.211379+0000","last_became_peered":"2023-10-09T11:41:30.211379+0000","last_unstale":"2023-10-09T11:41:30.218001+0000","last_undegraded":"2023-10-09T11:41:30.218001+0000","last_fullsized":"2023-10-09T11:41:30.218001+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:14.053652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212818+0000","last_change":"2023-10-09T11:41:30.212457+0000","last_active":"2023-10-09T11:41:30.212818+0000","last_peered":"2023-10-09T11:41:30.212818+0000","last_clean":"2023-10-09T11:41:30.212818+0000","last_became_active":"2023-10-09T11:41:30.211927+0000","last_became_peered":"2023-10-09T11:41:30.211927+0000","last_unstale":"2023-10-09T11:41:30.212818+0000","last_undegraded":"2023-10-09T11:41:30.212818+0000","last_fullsized":"2023-10-09T11:41:30.212818+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:37.089836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207387+0000","last_change":"2023-10-09T11:41:30.206364+0000","last_active":"2023-10-09T11:41:30.207387+0000","last_peered":"2023-10-09T11:41:30.207387+0000","last_clean":"2023-10-09T11:41:30.207387+0000","last_became_active":"2023-10-09T11:41:30.206084+0000","last_became_peered":"2023-10-09T11:41:30.206084+0000","last_unstale":"2023-10-09T11:41:30.207387+0000","last_undegraded":"2023-10-09T11:41:30.207387+0000","last_fullsized":"2023-10-09T11:41:30.207387+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.498342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214475+0000","last_change":"2023-10-09T11:41:30.207113+0000","last_active":"2023-10-09T11:41:30.214475+0000","last_peered":"2023-10-09T11:41:30.214475+0000","last_clean":"2023-10-09T11:41:30.214475+0000","last_became_active":"2023-10-09T11:41:30.206810+0000","last_became_peered":"2023-10-09T11:41:30.206810+0000","last_unstale":"2023-10-09T11:41:30.214475+0000","last_undegraded":"2023-10-09T11:41:30.214475+0000","last_fullsized":"2023-10-09T11:41:30.214475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:00.677277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207928+0000","last_change":"2023-10-09T11:41:30.205404+0000","last_active":"2023-10-09T11:41:30.207928+0000","last_peered":"2023-10-09T11:41:30.207928+0000","last_clean":"2023-10-09T11:41:30.207928+0000","last_became_active":"2023-10-09T11:41:30.204109+0000","last_became_peered":"2023-10-09T11:41:30.204109+0000","last_unstale":"2023-10-09T11:41:30.207928+0000","last_undegraded":"2023-10-09T11:41:30.207928+0000","last_fullsized":"2023-10-09T11:41:30.207928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:43.322920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217651+0000","last_change":"2023-10-09T11:41:30.211940+0000","last_active":"2023-10-09T11:41:30.217651+0000","last_peered":"2023-10-09T11:41:30.217651+0000","last_clean":"2023-10-09T11:41:30.217651+0000","last_became_active":"2023-10-09T11:41:30.211435+0000","last_became_peered":"2023-10-09T11:41:30.211435+0000","last_unstale":"2023-10-09T11:41:30.217651+0000","last_undegraded":"2023-10-09T11:41:30.217651+0000","last_fullsized":"2023-10-09T11:41:30.217651+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217826+0000","last_change":"2023-10-09T11:41:30.212286+0000","last_active":"2023-10-09T11:41:30.217826+0000","last_peered":"2023-10-09T11:41:30.217826+0000","last_clean":"2023-10-09T11:41:30.217826+0000","last_became_active":"2023-10-09T11:41:30.211855+0000","last_became_peered":"2023-10-09T11:41:30.211855+0000","last_unstale":"2023-10-09T11:41:30.217826+0000","last_undegraded":"2023-10-09T11:41:30.217826+0000","last_fullsized":"2023-10-09T11:41:30.217826+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:01.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207658+0000","last_change":"2023-10-09T11:41:30.204048+0000","last_active":"2023-10-09T11:41:30.207658+0000","last_peered":"2023-10-09T11:41:30.207658+0000","last_clean":"2023-10-09T11:41:30.207658+0000","last_became_active":"2023-10-09T11:41:30.203805+0000","last_became_peered":"2023-10-09T11:41:30.203805+0000","last_unstale":"2023-10-09T11:41:30.207658+0000","last_undegraded":"2023-10-09T11:41:30.207658+0000","last_fullsized":"2023-10-09T11:41:30.207658+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:11.199504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212213+0000","last_change":"2023-10-09T11:41:30.211457+0000","last_active":"2023-10-09T11:41:30.212213+0000","last_peered":"2023-10-09T11:41:30.212213+0000","last_clean":"2023-10-09T11:41:30.212213+0000","last_became_active":"2023-10-09T11:41:30.211199+0000","last_became_peered":"2023-10-09T11:41:30.211199+0000","last_unstale":"2023-10-09T11:41:30.212213+0000","last_undegraded":"2023-10-09T11:41:30.212213+0000","last_fullsized":"2023-10-09T11:41:30.212213+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:56.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215491+0000","last_change":"2023-10-09T11:41:30.213001+0000","last_active":"2023-10-09T11:41:30.215491+0000","last_peered":"2023-10-09T11:41:30.215491+0000","last_clean":"2023-10-09T11:41:30.215491+0000","last_became_active":"2023-10-09T11:41:30.212689+0000","last_became_peered":"2023-10-09T11:41:30.212689+0000","last_unstale":"2023-10-09T11:41:30.215491+0000","last_undegraded":"2023-10-09T11:41:30.215491+0000","last_fullsized":"2023-10-09T11:41:30.215491+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:38.335285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216170+0000","last_change":"2023-10-09T11:41:30.210587+0000","last_active":"2023-10-09T11:41:30.216170+0000","last_peered":"2023-10-09T11:41:30.216170+0000","last_clean":"2023-10-09T11:41:30.216170+0000","last_became_active":"2023-10-09T11:41:30.210309+0000","last_became_peered":"2023-10-09T11:41:30.210309+0000","last_unstale":"2023-10-09T11:41:30.216170+0000","last_undegraded":"2023-10-09T11:41:30.216170+0000","last_fullsized":"2023-10-09T11:41:30.216170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.218058+0000","last_change":"2023-10-09T11:41:30.214778+0000","last_active":"2023-10-09T11:41:30.218058+0000","last_peered":"2023-10-09T11:41:30.218058+0000","last_clean":"2023-10-09T11:41:30.218058+0000","last_became_active":"2023-10-09T11:41:30.214420+0000","last_became_peered":"2023-10-09T11:41:30.214420+0000","last_unstale":"2023-10-09T11:41:30.218058+0000","last_undegraded":"2023-10-09T11:41:30.218058+0000","last_fullsized":"2023-10-09T11:41:30.218058+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215302+0000","last_change":"2023-10-09T11:41:30.211011+0000","last_active":"2023-10-09T11:41:30.215302+0000","last_peered":"2023-10-09T11:41:30.215302+0000","last_clean":"2023-10-09T11:41:30.215302+0000","last_became_active":"2023-10-09T11:41:30.210577+0000","last_became_peered":"2023-10-09T11:41:30.210577+0000","last_unstale":"2023-10-09T11:41:30.215302+0000","last_undegraded":"2023-10-09T11:41:30.215302+0000","last_fullsized":"2023-10-09T11:41:30.215302+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:23.812282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214638+0000","last_change":"2023-10-09T11:41:30.206829+0000","last_active":"2023-10-09T11:41:30.214638+0000","last_peered":"2023-10-09T11:41:30.214638+0000","last_clean":"2023-10-09T11:41:30.214638+0000","last_became_active":"2023-10-09T11:41:30.206191+0000","last_became_peered":"2023-10-09T11:41:30.206191+0000","last_unstale":"2023-10-09T11:41:30.214638+0000","last_undegraded":"2023-10-09T11:41:30.214638+0000","last_fullsized":"2023-10-09T11:41:30.214638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:03.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210832+0000","last_change":"2023-10-09T11:41:30.206981+0000","last_active":"2023-10-09T11:41:30.210832+0000","last_peered":"2023-10-09T11:41:30.210832+0000","last_clean":"2023-10-09T11:41:30.210832+0000","last_became_active":"2023-10-09T11:41:30.206730+0000","last_became_peered":"2023-10-09T11:41:30.206730+0000","last_unstale":"2023-10-09T11:41:30.210832+0000","last_undegraded":"2023-10-09T11:41:30.210832+0000","last_fullsized":"2023-10-09T11:41:30.210832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214555+0000","last_change":"2023-10-09T11:41:30.208259+0000","last_active":"2023-10-09T11:41:30.214555+0000","last_peered":"2023-10-09T11:41:30.214555+0000","last_clean":"2023-10-09T11:41:30.214555+0000","last_became_active":"2023-10-09T11:41:30.207545+0000","last_became_peered":"2023-10-09T11:41:30.207545+0000","last_unstale":"2023-10-09T11:41:30.214555+0000","last_undegraded":"2023-10-09T11:41:30.214555+0000","last_fullsized":"2023-10-09T11:41:30.214555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:00.236671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210900+0000","last_change":"2023-10-09T11:41:30.207410+0000","last_active":"2023-10-09T11:41:30.210900+0000","last_peered":"2023-10-09T11:41:30.210900+0000","last_clean":"2023-10-09T11:41:30.210900+0000","last_became_active":"2023-10-09T11:41:30.207135+0000","last_became_peered":"2023-10-09T11:41:30.207135+0000","last_unstale":"2023-10-09T11:41:30.210900+0000","last_undegraded":"2023-10-09T11:41:30.210900+0000","last_fullsized":"2023-10-09T11:41:30.210900+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214520+0000","last_change":"2023-10-09T11:41:30.207785+0000","last_active":"2023-10-09T11:41:30.214520+0000","last_peered":"2023-10-09T11:41:30.214520+0000","last_clean":"2023-10-09T11:41:30.214520+0000","last_became_active":"2023-10-09T11:41:30.207389+0000","last_became_peered":"2023-10-09T11:41:30.207389+0000","last_unstale":"2023-10-09T11:41:30.214520+0000","last_undegraded":"2023-10-09T11:41:30.214520+0000","last_fullsized":"2023-10-09T11:41:30.214520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:36:52.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208529+0000","last_change":"2023-10-09T11:41:30.207748+0000","last_active":"2023-10-09T11:41:30.208529+0000","last_peered":"2023-10-09T11:41:30.208529+0000","last_clean":"2023-10-09T11:41:30.208529+0000","last_became_active":"2023-10-09T11:41:30.207201+0000","last_became_peered":"2023-10-09T11:41:30.207201+0000","last_unstale":"2023-10-09T11:41:30.208529+0000","last_undegraded":"2023-10-09T11:41:30.208529+0000","last_fullsized":"2023-10-09T11:41:30.208529+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:11.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207716+0000","last_change":"2023-10-09T11:41:30.203665+0000","last_active":"2023-10-09T11:41:30.207716+0000","last_peered":"2023-10-09T11:41:30.207716+0000","last_clean":"2023-10-09T11:41:30.207716+0000","last_became_active":"2023-10-09T11:41:30.203406+0000","last_became_peered":"2023-10-09T11:41:30.203406+0000","last_unstale":"2023-10-09T11:41:30.207716+0000","last_undegraded":"2023-10-09T11:41:30.207716+0000","last_fullsized":"2023-10-09T11:41:30.207716+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211409+0000","last_change":"2023-10-09T11:41:30.208814+0000","last_active":"2023-10-09T11:41:30.211409+0000","last_peered":"2023-10-09T11:41:30.211409+0000","last_clean":"2023-10-09T11:41:30.211409+0000","last_became_active":"2023-10-09T11:41:30.208561+0000","last_became_peered":"2023-10-09T11:41:30.208561+0000","last_unstale":"2023-10-09T11:41:30.211409+0000","last_undegraded":"2023-10-09T11:41:30.211409+0000","last_fullsized":"2023-10-09T11:41:30.211409+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:13.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215621+0000","last_change":"2023-10-09T11:41:30.213841+0000","last_active":"2023-10-09T11:41:30.215621+0000","last_peered":"2023-10-09T11:41:30.215621+0000","last_clean":"2023-10-09T11:41:30.215621+0000","last_became_active":"2023-10-09T11:41:30.213550+0000","last_became_peered":"2023-10-09T11:41:30.213550+0000","last_unstale":"2023-10-09T11:41:30.215621+0000","last_undegraded":"2023-10-09T11:41:30.215621+0000","last_fullsized":"2023-10-09T11:41:30.215621+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:31.671775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209269+0000","last_change":"2023-10-09T11:41:30.201875+0000","last_active":"2023-10-09T11:41:30.209269+0000","last_peered":"2023-10-09T11:41:30.209269+0000","last_clean":"2023-10-09T11:41:30.209269+0000","last_became_active":"2023-10-09T11:41:30.201565+0000","last_became_peered":"2023-10-09T11:41:30.201565+0000","last_unstale":"2023-10-09T11:41:30.209269+0000","last_undegraded":"2023-10-09T11:41:30.209269+0000","last_fullsized":"2023-10-09T11:41:30.209269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:30.544630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206633+0000","last_change":"2023-10-09T11:41:30.203132+0000","last_active":"2023-10-09T11:41:30.206633+0000","last_peered":"2023-10-09T11:41:30.206633+0000","last_clean":"2023-10-09T11:41:30.206633+0000","last_became_active":"2023-10-09T11:41:30.202467+0000","last_became_peered":"2023-10-09T11:41:30.202467+0000","last_unstale":"2023-10-09T11:41:30.206633+0000","last_undegraded":"2023-10-09T11:41:30.206633+0000","last_fullsized":"2023-10-09T11:41:30.206633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:28.546094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210885+0000","last_change":"2023-10-09T11:41:30.209991+0000","last_active":"2023-10-09T11:41:30.210885+0000","last_peered":"2023-10-09T11:41:30.210885+0000","last_clean":"2023-10-09T11:41:30.210885+0000","last_became_active":"2023-10-09T11:41:30.209740+0000","last_became_peered":"2023-10-09T11:41:30.209740+0000","last_unstale":"2023-10-09T11:41:30.210885+0000","last_undegraded":"2023-10-09T11:41:30.210885+0000","last_fullsized":"2023-10-09T11:41:30.210885+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:09.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207894+0000","last_change":"2023-10-09T11:41:30.203665+0000","last_active":"2023-10-09T11:41:30.207894+0000","last_peered":"2023-10-09T11:41:30.207894+0000","last_clean":"2023-10-09T11:41:30.207894+0000","last_became_active":"2023-10-09T11:41:30.203358+0000","last_became_peered":"2023-10-09T11:41:30.203358+0000","last_unstale":"2023-10-09T11:41:30.207894+0000","last_undegraded":"2023-10-09T11:41:30.207894+0000","last_fullsized":"2023-10-09T11:41:30.207894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.536801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.620793+0000","last_change":"2023-10-09T11:41:29.626042+0000","last_active":"2023-10-09T11:41:30.620793+0000","last_peered":"2023-10-09T11:41:30.620793+0000","last_clean":"2023-10-09T11:41:30.620793+0000","last_became_active":"2023-10-09T11:41:29.625587+0000","last_became_peered":"2023-10-09T11:41:29.625587+0000","last_unstale":"2023-10-09T11:41:30.620793+0000","last_undegraded":"2023-10-09T11:41:30.620793+0000","last_fullsized":"2023-10-09T11:41:30.620793+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:40.925799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.216384+0000","last_change":"2023-10-09T11:41:30.213412+0000","last_active":"2023-10-09T11:41:30.216384+0000","last_peered":"2023-10-09T11:41:30.216384+0000","last_clean":"2023-10-09T11:41:30.216384+0000","last_became_active":"2023-10-09T11:41:30.213141+0000","last_became_peered":"2023-10-09T11:41:30.213141+0000","last_unstale":"2023-10-09T11:41:30.216384+0000","last_undegraded":"2023-10-09T11:41:30.216384+0000","last_fullsized":"2023-10-09T11:41:30.216384+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:20.601709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617160+0000","last_change":"2023-10-09T11:41:29.629629+0000","last_active":"2023-10-09T11:41:30.617160+0000","last_peered":"2023-10-09T11:41:30.617160+0000","last_clean":"2023-10-09T11:41:30.617160+0000","last_became_active":"2023-10-09T11:41:29.629294+0000","last_became_peered":"2023-10-09T11:41:29.629294+0000","last_unstale":"2023-10-09T11:41:30.617160+0000","last_undegraded":"2023-10-09T11:41:30.617160+0000","last_fullsized":"2023-10-09T11:41:30.617160+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:48.066109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207744+0000","last_change":"2023-10-09T11:41:30.205654+0000","last_active":"2023-10-09T11:41:30.207744+0000","last_peered":"2023-10-09T11:41:30.207744+0000","last_clean":"2023-10-09T11:41:30.207744+0000","last_became_active":"2023-10-09T11:41:30.205006+0000","last_became_peered":"2023-10-09T11:41:30.205006+0000","last_unstale":"2023-10-09T11:41:30.207744+0000","last_undegraded":"2023-10-09T11:41:30.207744+0000","last_fullsized":"2023-10-09T11:41:30.207744+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.493340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.619014+0000","last_change":"2023-10-09T11:41:29.624723+0000","last_active":"2023-10-09T11:41:30.619014+0000","last_peered":"2023-10-09T11:41:30.619014+0000","last_clean":"2023-10-09T11:41:30.619014+0000","last_became_active":"2023-10-09T11:41:29.624446+0000","last_became_peered":"2023-10-09T11:41:29.624446+0000","last_unstale":"2023-10-09T11:41:30.619014+0000","last_undegraded":"2023-10-09T11:41:30.619014+0000","last_fullsized":"2023-10-09T11:41:30.619014+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:24.501718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217999+0000","last_change":"2023-10-09T11:41:30.214087+0000","last_active":"2023-10-09T11:41:30.217999+0000","last_peered":"2023-10-09T11:41:30.217999+0000","last_clean":"2023-10-09T11:41:30.217999+0000","last_became_active":"2023-10-09T11:41:30.212251+0000","last_became_peered":"2023-10-09T11:41:30.212251+0000","last_unstale":"2023-10-09T11:41:30.217999+0000","last_undegraded":"2023-10-09T11:41:30.217999+0000","last_fullsized":"2023-10-09T11:41:30.217999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.619005+0000","last_change":"2023-10-09T11:41:29.627113+0000","last_active":"2023-10-09T11:41:30.619005+0000","last_peered":"2023-10-09T11:41:30.619005+0000","last_clean":"2023-10-09T11:41:30.619005+0000","last_became_active":"2023-10-09T11:41:29.626832+0000","last_became_peered":"2023-10-09T11:41:29.626832+0000","last_unstale":"2023-10-09T11:41:30.619005+0000","last_undegraded":"2023-10-09T11:41:30.619005+0000","last_fullsized":"2023-10-09T11:41:30.619005+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.078822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211634+0000","last_change":"2023-10-09T11:41:30.210585+0000","last_active":"2023-10-09T11:41:30.211634+0000","last_peered":"2023-10-09T11:41:30.211634+0000","last_clean":"2023-10-09T11:41:30.211634+0000","last_became_active":"2023-10-09T11:41:30.210327+0000","last_became_peered":"2023-10-09T11:41:30.210327+0000","last_unstale":"2023-10-09T11:41:30.211634+0000","last_undegraded":"2023-10-09T11:41:30.211634+0000","last_fullsized":"2023-10-09T11:41:30.211634+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:28.981612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618371+0000","last_change":"2023-10-09T11:41:29.624687+0000","last_active":"2023-10-09T11:41:30.618371+0000","last_peered":"2023-10-09T11:41:30.618371+0000","last_clean":"2023-10-09T11:41:30.618371+0000","last_became_active":"2023-10-09T11:41:29.622838+0000","last_became_peered":"2023-10-09T11:41:29.622838+0000","last_unstale":"2023-10-09T11:41:30.618371+0000","last_undegraded":"2023-10-09T11:41:30.618371+0000","last_fullsized":"2023-10-09T11:41:30.618371+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:07.695216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215152+0000","last_change":"2023-10-09T11:41:30.210327+0000","last_active":"2023-10-09T11:41:30.215152+0000","last_peered":"2023-10-09T11:41:30.215152+0000","last_clean":"2023-10-09T11:41:30.215152+0000","last_became_active":"2023-10-09T11:41:30.209999+0000","last_became_peered":"2023-10-09T11:41:30.209999+0000","last_unstale":"2023-10-09T11:41:30.215152+0000","last_undegraded":"2023-10-09T11:41:30.215152+0000","last_fullsized":"2023-10-09T11:41:30.215152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618397+0000","last_change":"2023-10-09T11:41:29.622757+0000","last_active":"2023-10-09T11:41:30.618397+0000","last_peered":"2023-10-09T11:41:30.618397+0000","last_clean":"2023-10-09T11:41:30.618397+0000","last_became_active":"2023-10-09T11:41:29.622405+0000","last_became_peered":"2023-10-09T11:41:29.622405+0000","last_unstale":"2023-10-09T11:41:30.618397+0000","last_undegraded":"2023-10-09T11:41:30.618397+0000","last_fullsized":"2023-10-09T11:41:30.618397+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:37.330614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.206775+0000","last_change":"2023-10-09T11:41:30.205792+0000","last_active":"2023-10-09T11:41:30.206775+0000","last_peered":"2023-10-09T11:41:30.206775+0000","last_clean":"2023-10-09T11:41:30.206775+0000","last_became_active":"2023-10-09T11:41:30.204468+0000","last_became_peered":"2023-10-09T11:41:30.204468+0000","last_unstale":"2023-10-09T11:41:30.206775+0000","last_undegraded":"2023-10-09T11:41:30.206775+0000","last_fullsized":"2023-10-09T11:41:30.206775+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:43.455849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197823+0000","last_change":"2023-10-09T11:41:29.626941+0000","last_active":"2023-10-09T11:41:30.197823+0000","last_peered":"2023-10-09T11:41:30.197823+0000","last_clean":"2023-10-09T11:41:30.197823+0000","last_became_active":"2023-10-09T11:41:29.626666+0000","last_became_peered":"2023-10-09T11:41:29.626666+0000","last_unstale":"2023-10-09T11:41:30.197823+0000","last_undegraded":"2023-10-09T11:41:30.197823+0000","last_fullsized":"2023-10-09T11:41:30.197823+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:10.194833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209576+0000","last_change":"2023-10-09T11:41:30.206394+0000","last_active":"2023-10-09T11:41:30.209576+0000","last_peered":"2023-10-09T11:41:30.209576+0000","last_clean":"2023-10-09T11:41:30.209576+0000","last_became_active":"2023-10-09T11:41:30.206062+0000","last_became_peered":"2023-10-09T11:41:30.206062+0000","last_unstale":"2023-10-09T11:41:30.209576+0000","last_undegraded":"2023-10-09T11:41:30.209576+0000","last_fullsized":"2023-10-09T11:41:30.209576+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:41.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.200560+0000","last_change":"2023-10-09T11:41:29.626745+0000","last_active":"2023-10-09T11:41:30.200560+0000","last_peered":"2023-10-09T11:41:30.200560+0000","last_clean":"2023-10-09T11:41:30.200560+0000","last_became_active":"2023-10-09T11:41:29.626206+0000","last_became_peered":"2023-10-09T11:41:29.626206+0000","last_unstale":"2023-10-09T11:41:30.200560+0000","last_undegraded":"2023-10-09T11:41:30.200560+0000","last_fullsized":"2023-10-09T11:41:30.200560+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:25.951409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209171+0000","last_change":"2023-10-09T11:41:30.201154+0000","last_active":"2023-10-09T11:41:30.209171+0000","last_peered":"2023-10-09T11:41:30.209171+0000","last_clean":"2023-10-09T11:41:30.209171+0000","last_became_active":"2023-10-09T11:41:30.200791+0000","last_became_peered":"2023-10-09T11:41:30.200791+0000","last_unstale":"2023-10-09T11:41:30.209171+0000","last_undegraded":"2023-10-09T11:41:30.209171+0000","last_fullsized":"2023-10-09T11:41:30.209171+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:22.544899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195060+0000","last_change":"2023-10-09T11:41:29.626711+0000","last_active":"2023-10-09T11:41:30.195060+0000","last_peered":"2023-10-09T11:41:30.195060+0000","last_clean":"2023-10-09T11:41:30.195060+0000","last_became_active":"2023-10-09T11:41:29.626341+0000","last_became_peered":"2023-10-09T11:41:29.626341+0000","last_unstale":"2023-10-09T11:41:30.195060+0000","last_undegraded":"2023-10-09T11:41:30.195060+0000","last_fullsized":"2023-10-09T11:41:30.195060+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.711584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214896+0000","last_change":"2023-10-09T11:41:30.206248+0000","last_active":"2023-10-09T11:41:30.214896+0000","last_peered":"2023-10-09T11:41:30.214896+0000","last_clean":"2023-10-09T11:41:30.214896+0000","last_became_active":"2023-10-09T11:41:30.205788+0000","last_became_peered":"2023-10-09T11:41:30.205788+0000","last_unstale":"2023-10-09T11:41:30.214896+0000","last_undegraded":"2023-10-09T11:41:30.214896+0000","last_fullsized":"2023-10-09T11:41:30.214896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195064+0000","last_change":"2023-10-09T11:41:29.624261+0000","last_active":"2023-10-09T11:41:30.195064+0000","last_peered":"2023-10-09T11:41:30.195064+0000","last_clean":"2023-10-09T11:41:30.195064+0000","last_became_active":"2023-10-09T11:41:29.623990+0000","last_became_peered":"2023-10-09T11:41:29.623990+0000","last_unstale":"2023-10-09T11:41:30.195064+0000","last_undegraded":"2023-10-09T11:41:30.195064+0000","last_fullsized":"2023-10-09T11:41:30.195064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:57.602272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211391+0000","last_change":"2023-10-09T11:41:30.208315+0000","last_active":"2023-10-09T11:41:30.211391+0000","last_peered":"2023-10-09T11:41:30.211391+0000","last_clean":"2023-10-09T11:41:30.211391+0000","last_became_active":"2023-10-09T11:41:30.208028+0000","last_became_peered":"2023-10-09T11:41:30.208028+0000","last_unstale":"2023-10-09T11:41:30.211391+0000","last_undegraded":"2023-10-09T11:41:30.211391+0000","last_fullsized":"2023-10-09T11:41:30.211391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"99'3","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.619158+0000","last_change":"2023-10-09T11:41:29.625454+0000","last_active":"2023-10-09T11:41:30.619158+0000","last_peered":"2023-10-09T11:41:30.619158+0000","last_clean":"2023-10-09T11:41:30.619158+0000","last_became_active":"2023-10-09T11:41:29.624809+0000","last_became_peered":"2023-10-09T11:41:29.624809+0000","last_unstale":"2023-10-09T11:41:30.619158+0000","last_undegraded":"2023-10-09T11:41:30.619158+0000","last_fullsized":"2023-10-09T11:41:30.619158+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:56.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215421+0000","last_change":"2023-10-09T11:41:30.212455+0000","last_active":"2023-10-09T11:41:30.215421+0000","last_peered":"2023-10-09T11:41:30.215421+0000","last_clean":"2023-10-09T11:41:30.215421+0000","last_became_active":"2023-10-09T11:41:30.212151+0000","last_became_peered":"2023-10-09T11:41:30.212151+0000","last_unstale":"2023-10-09T11:41:30.215421+0000","last_undegraded":"2023-10-09T11:41:30.215421+0000","last_fullsized":"2023-10-09T11:41:30.215421+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:37.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"99'6","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.620617+0000","last_change":"2023-10-09T11:41:29.625291+0000","last_active":"2023-10-09T11:41:30.620617+0000","last_peered":"2023-10-09T11:41:30.620617+0000","last_clean":"2023-10-09T11:41:30.620617+0000","last_became_active":"2023-10-09T11:41:29.624992+0000","last_became_peered":"2023-10-09T11:41:29.624992+0000","last_unstale":"2023-10-09T11:41:30.620617+0000","last_undegraded":"2023-10-09T11:41:30.620617+0000","last_fullsized":"2023-10-09T11:41:30.620617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:50.027818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209237+0000","last_change":"2023-10-09T11:41:30.203371+0000","last_active":"2023-10-09T11:41:30.209237+0000","last_peered":"2023-10-09T11:41:30.209237+0000","last_clean":"2023-10-09T11:41:30.209237+0000","last_became_active":"2023-10-09T11:41:30.203126+0000","last_became_peered":"2023-10-09T11:41:30.203126+0000","last_unstale":"2023-10-09T11:41:30.209237+0000","last_undegraded":"2023-10-09T11:41:30.209237+0000","last_fullsized":"2023-10-09T11:41:30.209237+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:51.032488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.620904+0000","last_change":"2023-10-09T11:41:29.626334+0000","last_active":"2023-10-09T11:41:30.620904+0000","last_peered":"2023-10-09T11:41:30.620904+0000","last_clean":"2023-10-09T11:41:30.620904+0000","last_became_active":"2023-10-09T11:41:29.625700+0000","last_became_peered":"2023-10-09T11:41:29.625700+0000","last_unstale":"2023-10-09T11:41:30.620904+0000","last_undegraded":"2023-10-09T11:41:30.620904+0000","last_fullsized":"2023-10-09T11:41:30.620904+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:38.376341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.212284+0000","last_change":"2023-10-09T11:41:30.211426+0000","last_active":"2023-10-09T11:41:30.212284+0000","last_peered":"2023-10-09T11:41:30.212284+0000","last_clean":"2023-10-09T11:41:30.212284+0000","last_became_active":"2023-10-09T11:41:30.211140+0000","last_became_peered":"2023-10-09T11:41:30.211140+0000","last_unstale":"2023-10-09T11:41:30.212284+0000","last_undegraded":"2023-10-09T11:41:30.212284+0000","last_fullsized":"2023-10-09T11:41:30.212284+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197765+0000","last_change":"2023-10-09T11:41:29.628526+0000","last_active":"2023-10-09T11:41:30.197765+0000","last_peered":"2023-10-09T11:41:30.197765+0000","last_clean":"2023-10-09T11:41:30.197765+0000","last_became_active":"2023-10-09T11:41:29.628346+0000","last_became_peered":"2023-10-09T11:41:29.628346+0000","last_unstale":"2023-10-09T11:41:30.197765+0000","last_undegraded":"2023-10-09T11:41:30.197765+0000","last_fullsized":"2023-10-09T11:41:30.197765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:11.803064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210854+0000","last_change":"2023-10-09T11:41:30.207505+0000","last_active":"2023-10-09T11:41:30.210854+0000","last_peered":"2023-10-09T11:41:30.210854+0000","last_clean":"2023-10-09T11:41:30.210854+0000","last_became_active":"2023-10-09T11:41:30.206861+0000","last_became_peered":"2023-10-09T11:41:30.206861+0000","last_unstale":"2023-10-09T11:41:30.210854+0000","last_undegraded":"2023-10-09T11:41:30.210854+0000","last_fullsized":"2023-10-09T11:41:30.210854+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:26.956079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"99'8","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.619460+0000","last_change":"2023-10-09T11:41:29.628993+0000","last_active":"2023-10-09T11:41:30.619460+0000","last_peered":"2023-10-09T11:41:30.619460+0000","last_clean":"2023-10-09T11:41:30.619460+0000","last_became_active":"2023-10-09T11:41:29.628689+0000","last_became_peered":"2023-10-09T11:41:29.628689+0000","last_unstale":"2023-10-09T11:41:30.619460+0000","last_undegraded":"2023-10-09T11:41:30.619460+0000","last_fullsized":"2023-10-09T11:41:30.619460+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:47.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207230+0000","last_change":"2023-10-09T11:41:30.204727+0000","last_active":"2023-10-09T11:41:30.207230+0000","last_peered":"2023-10-09T11:41:30.207230+0000","last_clean":"2023-10-09T11:41:30.207230+0000","last_became_active":"2023-10-09T11:41:30.204233+0000","last_became_peered":"2023-10-09T11:41:30.204233+0000","last_unstale":"2023-10-09T11:41:30.207230+0000","last_undegraded":"2023-10-09T11:41:30.207230+0000","last_fullsized":"2023-10-09T11:41:30.207230+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:25.096669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618213+0000","last_change":"2023-10-09T11:41:29.627947+0000","last_active":"2023-10-09T11:41:30.618213+0000","last_peered":"2023-10-09T11:41:30.618213+0000","last_clean":"2023-10-09T11:41:30.618213+0000","last_became_active":"2023-10-09T11:41:29.627683+0000","last_became_peered":"2023-10-09T11:41:29.627683+0000","last_unstale":"2023-10-09T11:41:30.618213+0000","last_undegraded":"2023-10-09T11:41:30.618213+0000","last_fullsized":"2023-10-09T11:41:30.618213+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:34.004467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.207709+0000","last_change":"2023-10-09T11:41:30.205289+0000","last_active":"2023-10-09T11:41:30.207709+0000","last_peered":"2023-10-09T11:41:30.207709+0000","last_clean":"2023-10-09T11:41:30.207709+0000","last_became_active":"2023-10-09T11:41:30.205030+0000","last_became_peered":"2023-10-09T11:41:30.205030+0000","last_unstale":"2023-10-09T11:41:30.207709+0000","last_undegraded":"2023-10-09T11:41:30.207709+0000","last_fullsized":"2023-10-09T11:41:30.207709+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:24.060313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.620575+0000","last_change":"2023-10-09T11:41:29.622774+0000","last_active":"2023-10-09T11:41:30.620575+0000","last_peered":"2023-10-09T11:41:30.620575+0000","last_clean":"2023-10-09T11:41:30.620575+0000","last_became_active":"2023-10-09T11:41:29.622497+0000","last_became_peered":"2023-10-09T11:41:29.622497+0000","last_unstale":"2023-10-09T11:41:30.620575+0000","last_undegraded":"2023-10-09T11:41:30.620575+0000","last_fullsized":"2023-10-09T11:41:30.620575+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:17.226611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217827+0000","last_change":"2023-10-09T11:41:30.212307+0000","last_active":"2023-10-09T11:41:30.217827+0000","last_peered":"2023-10-09T11:41:30.217827+0000","last_clean":"2023-10-09T11:41:30.217827+0000","last_became_active":"2023-10-09T11:41:30.211263+0000","last_became_peered":"2023-10-09T11:41:30.211263+0000","last_unstale":"2023-10-09T11:41:30.217827+0000","last_undegraded":"2023-10-09T11:41:30.217827+0000","last_fullsized":"2023-10-09T11:41:30.217827+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:59.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.617971+0000","last_change":"2023-10-09T11:41:29.624896+0000","last_active":"2023-10-09T11:41:30.617971+0000","last_peered":"2023-10-09T11:41:30.617971+0000","last_clean":"2023-10-09T11:41:30.617971+0000","last_became_active":"2023-10-09T11:41:29.624643+0000","last_became_peered":"2023-10-09T11:41:29.624643+0000","last_unstale":"2023-10-09T11:41:30.617971+0000","last_undegraded":"2023-10-09T11:41:30.617971+0000","last_fullsized":"2023-10-09T11:41:30.617971+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:40.658382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.218034+0000","last_change":"2023-10-09T11:41:30.214279+0000","last_active":"2023-10-09T11:41:30.218034+0000","last_peered":"2023-10-09T11:41:30.218034+0000","last_clean":"2023-10-09T11:41:30.218034+0000","last_became_active":"2023-10-09T11:41:30.212519+0000","last_became_peered":"2023-10-09T11:41:30.212519+0000","last_unstale":"2023-10-09T11:41:30.218034+0000","last_undegraded":"2023-10-09T11:41:30.218034+0000","last_fullsized":"2023-10-09T11:41:30.218034+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:26.012102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193745+0000","last_change":"2023-10-09T11:41:29.623446+0000","last_active":"2023-10-09T11:41:30.193745+0000","last_peered":"2023-10-09T11:41:30.193745+0000","last_clean":"2023-10-09T11:41:30.193745+0000","last_became_active":"2023-10-09T11:41:29.623199+0000","last_became_peered":"2023-10-09T11:41:29.623199+0000","last_unstale":"2023-10-09T11:41:30.193745+0000","last_undegraded":"2023-10-09T11:41:30.193745+0000","last_fullsized":"2023-10-09T11:41:30.193745+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:57.601464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217883+0000","last_change":"2023-10-09T11:41:30.212736+0000","last_active":"2023-10-09T11:41:30.217883+0000","last_peered":"2023-10-09T11:41:30.217883+0000","last_clean":"2023-10-09T11:41:30.217883+0000","last_became_active":"2023-10-09T11:41:30.211249+0000","last_became_peered":"2023-10-09T11:41:30.211249+0000","last_unstale":"2023-10-09T11:41:30.217883+0000","last_undegraded":"2023-10-09T11:41:30.217883+0000","last_fullsized":"2023-10-09T11:41:30.217883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:38.970069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618684+0000","last_change":"2023-10-09T11:41:29.626531+0000","last_active":"2023-10-09T11:41:30.618684+0000","last_peered":"2023-10-09T11:41:30.618684+0000","last_clean":"2023-10-09T11:41:30.618684+0000","last_became_active":"2023-10-09T11:41:29.626069+0000","last_became_peered":"2023-10-09T11:41:29.626069+0000","last_unstale":"2023-10-09T11:41:30.618684+0000","last_undegraded":"2023-10-09T11:41:30.618684+0000","last_fullsized":"2023-10-09T11:41:30.618684+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:57.065033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.213687+0000","last_change":"2023-10-09T11:41:30.213219+0000","last_active":"2023-10-09T11:41:30.213687+0000","last_peered":"2023-10-09T11:41:30.213687+0000","last_clean":"2023-10-09T11:41:30.213687+0000","last_became_active":"2023-10-09T11:41:30.212948+0000","last_became_peered":"2023-10-09T11:41:30.212948+0000","last_unstale":"2023-10-09T11:41:30.213687+0000","last_undegraded":"2023-10-09T11:41:30.213687+0000","last_fullsized":"2023-10-09T11:41:30.213687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.257121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.194943+0000","last_change":"2023-10-09T11:41:29.626659+0000","last_active":"2023-10-09T11:41:30.194943+0000","last_peered":"2023-10-09T11:41:30.194943+0000","last_clean":"2023-10-09T11:41:30.194943+0000","last_became_active":"2023-10-09T11:41:29.626359+0000","last_became_peered":"2023-10-09T11:41:29.626359+0000","last_unstale":"2023-10-09T11:41:30.194943+0000","last_undegraded":"2023-10-09T11:41:30.194943+0000","last_fullsized":"2023-10-09T11:41:30.194943+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:15.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.217956+0000","last_change":"2023-10-09T11:41:30.213139+0000","last_active":"2023-10-09T11:41:30.217956+0000","last_peered":"2023-10-09T11:41:30.217956+0000","last_clean":"2023-10-09T11:41:30.217956+0000","last_became_active":"2023-10-09T11:41:30.212582+0000","last_became_peered":"2023-10-09T11:41:30.212582+0000","last_unstale":"2023-10-09T11:41:30.217956+0000","last_undegraded":"2023-10-09T11:41:30.217956+0000","last_fullsized":"2023-10-09T11:41:30.217956+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:57.260734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.196275+0000","last_change":"2023-10-09T11:41:29.628284+0000","last_active":"2023-10-09T11:41:30.196275+0000","last_peered":"2023-10-09T11:41:30.196275+0000","last_clean":"2023-10-09T11:41:30.196275+0000","last_became_active":"2023-10-09T11:41:29.627998+0000","last_became_peered":"2023-10-09T11:41:29.627998+0000","last_unstale":"2023-10-09T11:41:30.196275+0000","last_undegraded":"2023-10-09T11:41:30.196275+0000","last_fullsized":"2023-10-09T11:41:30.196275+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:54.858809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210767+0000","last_change":"2023-10-09T11:41:30.204375+0000","last_active":"2023-10-09T11:41:30.210767+0000","last_peered":"2023-10-09T11:41:30.210767+0000","last_clean":"2023-10-09T11:41:30.210767+0000","last_became_active":"2023-10-09T11:41:30.204103+0000","last_became_peered":"2023-10-09T11:41:30.204103+0000","last_unstale":"2023-10-09T11:41:30.210767+0000","last_undegraded":"2023-10-09T11:41:30.210767+0000","last_fullsized":"2023-10-09T11:41:30.210767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:30.104458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.200673+0000","last_change":"2023-10-09T11:41:29.623589+0000","last_active":"2023-10-09T11:41:30.200673+0000","last_peered":"2023-10-09T11:41:30.200673+0000","last_clean":"2023-10-09T11:41:30.200673+0000","last_became_active":"2023-10-09T11:41:29.622865+0000","last_became_peered":"2023-10-09T11:41:29.622865+0000","last_unstale":"2023-10-09T11:41:30.200673+0000","last_undegraded":"2023-10-09T11:41:30.200673+0000","last_fullsized":"2023-10-09T11:41:30.200673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:58.673145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215946+0000","last_change":"2023-10-09T11:41:30.208877+0000","last_active":"2023-10-09T11:41:30.215946+0000","last_peered":"2023-10-09T11:41:30.215946+0000","last_clean":"2023-10-09T11:41:30.215946+0000","last_became_active":"2023-10-09T11:41:30.208587+0000","last_became_peered":"2023-10-09T11:41:30.208587+0000","last_unstale":"2023-10-09T11:41:30.215946+0000","last_undegraded":"2023-10-09T11:41:30.215946+0000","last_fullsized":"2023-10-09T11:41:30.215946+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:49.070780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.618409+0000","last_change":"2023-10-09T11:41:29.629791+0000","last_active":"2023-10-09T11:41:30.618409+0000","last_peered":"2023-10-09T11:41:30.618409+0000","last_clean":"2023-10-09T11:41:30.618409+0000","last_became_active":"2023-10-09T11:41:29.629499+0000","last_became_peered":"2023-10-09T11:41:29.629499+0000","last_unstale":"2023-10-09T11:41:30.618409+0000","last_undegraded":"2023-10-09T11:41:30.618409+0000","last_fullsized":"2023-10-09T11:41:30.618409+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:30.667105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.211607+0000","last_change":"2023-10-09T11:41:30.210662+0000","last_active":"2023-10-09T11:41:30.211607+0000","last_peered":"2023-10-09T11:41:30.211607+0000","last_clean":"2023-10-09T11:41:30.211607+0000","last_became_active":"2023-10-09T11:41:30.210402+0000","last_became_peered":"2023-10-09T11:41:30.210402+0000","last_unstale":"2023-10-09T11:41:30.211607+0000","last_undegraded":"2023-10-09T11:41:30.211607+0000","last_fullsized":"2023-10-09T11:41:30.211607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:53.019899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T11:41:31.199192+0000","last_change":"2023-10-09T11:41:29.626094+0000","last_active":"2023-10-09T11:41:31.199192+0000","last_peered":"2023-10-09T11:41:31.199192+0000","last_clean":"2023-10-09T11:41:31.199192+0000","last_became_active":"2023-10-09T11:41:29.625689+0000","last_became_peered":"2023-10-09T11:41:29.625689+0000","last_unstale":"2023-10-09T11:41:31.199192+0000","last_undegraded":"2023-10-09T11:41:31.199192+0000","last_fullsized":"2023-10-09T11:41:31.199192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:29.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.210568+0000","last_change":"2023-10-09T11:41:30.208401+0000","last_active":"2023-10-09T11:41:30.210568+0000","last_peered":"2023-10-09T11:41:30.210568+0000","last_clean":"2023-10-09T11:41:30.210568+0000","last_became_active":"2023-10-09T11:41:30.208090+0000","last_became_peered":"2023-10-09T11:41:30.208090+0000","last_unstale":"2023-10-09T11:41:30.210568+0000","last_undegraded":"2023-10-09T11:41:30.210568+0000","last_fullsized":"2023-10-09T11:41:30.210568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.825285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203679+0000","last_change":"2023-10-09T11:41:29.625772+0000","last_active":"2023-10-09T11:41:30.203679+0000","last_peered":"2023-10-09T11:41:30.203679+0000","last_clean":"2023-10-09T11:41:30.203679+0000","last_became_active":"2023-10-09T11:41:29.625181+0000","last_became_peered":"2023-10-09T11:41:29.625181+0000","last_unstale":"2023-10-09T11:41:30.203679+0000","last_undegraded":"2023-10-09T11:41:30.203679+0000","last_fullsized":"2023-10-09T11:41:30.203679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:29.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.215988+0000","last_change":"2023-10-09T11:41:30.208985+0000","last_active":"2023-10-09T11:41:30.215988+0000","last_peered":"2023-10-09T11:41:30.215988+0000","last_clean":"2023-10-09T11:41:30.215988+0000","last_became_active":"2023-10-09T11:41:30.208686+0000","last_became_peered":"2023-10-09T11:41:30.208686+0000","last_unstale":"2023-10-09T11:41:30.215988+0000","last_undegraded":"2023-10-09T11:41:30.215988+0000","last_fullsized":"2023-10-09T11:41:30.215988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:53.330528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.195918+0000","last_change":"2023-10-09T11:41:29.624296+0000","last_active":"2023-10-09T11:41:30.195918+0000","last_peered":"2023-10-09T11:41:30.195918+0000","last_clean":"2023-10-09T11:41:30.195918+0000","last_became_active":"2023-10-09T11:41:29.623669+0000","last_became_peered":"2023-10-09T11:41:29.623669+0000","last_unstale":"2023-10-09T11:41:30.195918+0000","last_undegraded":"2023-10-09T11:41:30.195918+0000","last_fullsized":"2023-10-09T11:41:30.195918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.232001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.208773+0000","last_change":"2023-10-09T11:41:30.205259+0000","last_active":"2023-10-09T11:41:30.208773+0000","last_peered":"2023-10-09T11:41:30.208773+0000","last_clean":"2023-10-09T11:41:30.208773+0000","last_became_active":"2023-10-09T11:41:30.204932+0000","last_became_peered":"2023-10-09T11:41:30.204932+0000","last_unstale":"2023-10-09T11:41:30.208773+0000","last_undegraded":"2023-10-09T11:41:30.208773+0000","last_fullsized":"2023-10-09T11:41:30.208773+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:38.539477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.193854+0000","last_change":"2023-10-09T11:41:29.622849+0000","last_active":"2023-10-09T11:41:30.193854+0000","last_peered":"2023-10-09T11:41:30.193854+0000","last_clean":"2023-10-09T11:41:30.193854+0000","last_became_active":"2023-10-09T11:41:29.622558+0000","last_became_peered":"2023-10-09T11:41:29.622558+0000","last_unstale":"2023-10-09T11:41:30.193854+0000","last_undegraded":"2023-10-09T11:41:30.193854+0000","last_fullsized":"2023-10-09T11:41:30.193854+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:03.488670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.214678+0000","last_change":"2023-10-09T11:41:30.207009+0000","last_active":"2023-10-09T11:41:30.214678+0000","last_peered":"2023-10-09T11:41:30.214678+0000","last_clean":"2023-10-09T11:41:30.214678+0000","last_became_active":"2023-10-09T11:41:30.206529+0000","last_became_peered":"2023-10-09T11:41:30.206529+0000","last_unstale":"2023-10-09T11:41:30.214678+0000","last_undegraded":"2023-10-09T11:41:30.214678+0000","last_fullsized":"2023-10-09T11:41:30.214678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:26.137960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.197086+0000","last_change":"2023-10-09T11:41:29.624867+0000","last_active":"2023-10-09T11:41:30.197086+0000","last_peered":"2023-10-09T11:41:30.197086+0000","last_clean":"2023-10-09T11:41:30.197086+0000","last_became_active":"2023-10-09T11:41:29.624541+0000","last_became_peered":"2023-10-09T11:41:29.624541+0000","last_unstale":"2023-10-09T11:41:30.197086+0000","last_undegraded":"2023-10-09T11:41:30.197086+0000","last_fullsized":"2023-10-09T11:41:30.197086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:53.532131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.220819+0000","last_change":"2023-10-09T11:41:30.216031+0000","last_active":"2023-10-09T11:41:30.220819+0000","last_peered":"2023-10-09T11:41:30.220819+0000","last_clean":"2023-10-09T11:41:30.220819+0000","last_became_active":"2023-10-09T11:41:30.215746+0000","last_became_peered":"2023-10-09T11:41:30.215746+0000","last_unstale":"2023-10-09T11:41:30.220819+0000","last_undegraded":"2023-10-09T11:41:30.220819+0000","last_fullsized":"2023-10-09T11:41:30.220819+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:21.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.194940+0000","last_change":"2023-10-09T11:41:29.624557+0000","last_active":"2023-10-09T11:41:30.194940+0000","last_peered":"2023-10-09T11:41:30.194940+0000","last_clean":"2023-10-09T11:41:30.194940+0000","last_became_active":"2023-10-09T11:41:29.624236+0000","last_became_peered":"2023-10-09T11:41:29.624236+0000","last_unstale":"2023-10-09T11:41:30.194940+0000","last_undegraded":"2023-10-09T11:41:30.194940+0000","last_fullsized":"2023-10-09T11:41:30.194940+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:01.278167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.203227+0000","last_change":"2023-10-09T11:41:30.201532+0000","last_active":"2023-10-09T11:41:30.203227+0000","last_peered":"2023-10-09T11:41:30.203227+0000","last_clean":"2023-10-09T11:41:30.203227+0000","last_became_active":"2023-10-09T11:41:30.201154+0000","last_became_peered":"2023-10-09T11:41:30.201154+0000","last_unstale":"2023-10-09T11:41:30.203227+0000","last_undegraded":"2023-10-09T11:41:30.203227+0000","last_fullsized":"2023-10-09T11:41:30.203227+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:39.734390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.200765+0000","last_change":"2023-10-09T11:41:29.623414+0000","last_active":"2023-10-09T11:41:30.200765+0000","last_peered":"2023-10-09T11:41:30.200765+0000","last_clean":"2023-10-09T11:41:30.200765+0000","last_became_active":"2023-10-09T11:41:29.622500+0000","last_became_peered":"2023-10-09T11:41:29.622500+0000","last_unstale":"2023-10-09T11:41:30.200765+0000","last_undegraded":"2023-10-09T11:41:30.200765+0000","last_fullsized":"2023-10-09T11:41:30.200765+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:58.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.209205+0000","last_change":"2023-10-09T11:41:30.202138+0000","last_active":"2023-10-09T11:41:30.209205+0000","last_peered":"2023-10-09T11:41:30.209205+0000","last_clean":"2023-10-09T11:41:30.209205+0000","last_became_active":"2023-10-09T11:41:30.201860+0000","last_became_peered":"2023-10-09T11:41:30.201860+0000","last_unstale":"2023-10-09T11:41:30.209205+0000","last_undegraded":"2023-10-09T11:41:30.209205+0000","last_fullsized":"2023-10-09T11:41:30.209205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:29.600633+0000","last_clean_scrub_stamp":"2023-10-09T11:41:29.600633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:35.009138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.194507+0000","last_change":"2023-10-09T11:41:29.622285+0000","last_active":"2023-10-09T11:41:30.194507+0000","last_peered":"2023-10-09T11:41:30.194507+0000","last_clean":"2023-10-09T11:41:30.194507+0000","last_became_active":"2023-10-09T11:41:29.621974+0000","last_became_peered":"2023-10-09T11:41:29.621974+0000","last_unstale":"2023-10-09T11:41:30.194507+0000","last_undegraded":"2023-10-09T11:41:30.194507+0000","last_fullsized":"2023-10-09T11:41:30.194507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:28.595962+0000","last_clean_scrub_stamp":"2023-10-09T11:41:28.595962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:53.801322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T11:41:30.204276+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:30.204276+0000","last_peered":"2023-10-09T11:41:30.204276+0000","last_clean":"2023-10-09T11:41:30.204276+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:30.204276+0000","last_undegraded":"2023-10-09T11:41:30.204276+0000","last_fullsized":"2023-10-09T11:41:30.204276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542226,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303184,"kb_used_data":1800,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068656,"statfs":{"total":96636764160,"available":96326303744,"internally_reserved":0,"allocated":1843200,"data_stored":1126937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.497},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.629}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.55100000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.64200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542226,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1245184,"data_stored":536051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1249280,"data_stored":536105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.374},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.623}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.49299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303196,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068644,"statfs":{"total":96636764160,"available":96326291456,"internally_reserved":0,"allocated":1855488,"data_stored":1127997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.371}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.28799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.44},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1241088,"data_stored":535981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.26000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.376},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.315}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.46700000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.44},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":537587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542227,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1241088,"data_stored":535981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542227,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":536557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.433}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.38300000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:39.662 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:41:39.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:41:39.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.822+0000 7f63ccc23700 1 Processor -- start 2023-10-09T11:41:39.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.822+0000 7f63ccc23700 1 -- start start 2023-10-09T11:41:39.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63ccc23700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63c8159530 0x7f63c80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63ccc23700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80ccfd0 con 0x7f63c806dc70 2023-10-09T11:41:39.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63ccc23700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80cf0e0 con 0x7f63c806e0e0 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63ccc23700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c815a3d0 con 0x7f63c8159530 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63c5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f63c806dc70 0x7f63c8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59734/0 (socket says 172.21.15.26:59734) 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63c5d9b700 1 -- 172.21.15.26:0/819998030 learned_addr learned my addr 172.21.15.26:0/819998030 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.823+0000 7f63c659c700 1 --2- 172.21.15.26:0/819998030 >> v2:172.21.15.67:3300/0 conn(0x7f63c8159530 0x7f63c80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c559a700 1 -- 172.21.15.26:0/819998030 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847680140 0 0) 0x7f63c80ccfd0 con 0x7f63c806dc70 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c559a700 1 -- 172.21.15.26:0/819998030 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b4003570 con 0x7f63c806dc70 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c659c700 1 -- 172.21.15.26:0/819998030 >> v1:172.21.15.67:6789/0 conn(0x7f63c806e0e0 legacy=0x7f63c80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c659c700 1 -- 172.21.15.26:0/819998030 >> v1:172.21.15.26:6789/0 conn(0x7f63c806dc70 legacy=0x7f63c8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c659c700 1 -- 172.21.15.26:0/819998030 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c815a6b0 con 0x7f63c8159530 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c659c700 1 --2- 172.21.15.26:0/819998030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c8159530 0x7f63c80ceba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009e60 tx=0x7f63c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3312705332cfa8ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c559a700 1 -- 172.21.15.26:0/819998030 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000e070 con 0x7f63c8159530 2023-10-09T11:41:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c559a700 1 -- 172.21.15.26:0/819998030 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000bb60 con 0x7f63c8159530 2023-10-09T11:41:39.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.824+0000 7f63c559a700 1 -- 172.21.15.26:0/819998030 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0012430 con 0x7f63c8159530 2023-10-09T11:41:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 -- 172.21.15.26:0/819998030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c8159530 msgr2=0x7f63c80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 --2- 172.21.15.26:0/819998030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c8159530 0x7f63c80ceba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009e60 tx=0x7f63c0009780 comp rx=0 tx=0).stop 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 -- 172.21.15.26:0/819998030 shutdown_connections 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 --2- 172.21.15.26:0/819998030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c8159530 0x7f63c80ceba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 -- 172.21.15.26:0/819998030 >> 172.21.15.26:0/819998030 conn(0x7f63c80703a0 msgr2=0x7f63c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 -- 172.21.15.26:0/819998030 shutdown_connections 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.825+0000 7f63ccc23700 1 -- 172.21.15.26:0/819998030 wait complete. 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.826+0000 7f63ccc23700 1 Processor -- start 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.826+0000 7f63ccc23700 1 -- start start 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63c806dc70 0x7f63c8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c806e0e0 0x7f63c80ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c816cfd0 con 0x7f63c8159530 2023-10-09T11:41:39.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c816de30 con 0x7f63c806e0e0 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c816d220 con 0x7f63c806dc70 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45056/0 (socket says 172.21.15.26:45056) 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 -- 172.21.15.26:0/2461514223 learned_addr learned my addr 172.21.15.26:0/2461514223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c5d9b700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c806e0e0 0x7f63c80ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c659c700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63c806dc70 0x7f63c8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 -- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63c806dc70 msgr2=0x7f63c8151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63c806dc70 0x7f63c8151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 -- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c806e0e0 msgr2=0x7f63c80ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c806e0e0 0x7f63c80ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 -- 172.21.15.26:0/2461514223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009a20 con 0x7f63c8159530 2023-10-09T11:41:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63c6d9d700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c560 tx=0x7f63b8007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011590 con 0x7f63c8159530 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8011710 con 0x7f63c8159530 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011ad0 con 0x7f63c8159530 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.827+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c816d500 con 0x7f63c8159530 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.828+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c816dac0 con 0x7f63c8159530 2023-10-09T11:41:39.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.828+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c804c3c0 con 0x7f63c8159530 2023-10-09T11:41:39.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.829+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f63b801b3b0 con 0x7f63c8159530 2023-10-09T11:41:39.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.829+0000 7f63be7fc700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 0x7f63a8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.829+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63b8083ea0 con 0x7f63c8159530 2023-10-09T11:41:39.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.829+0000 7f63c659c700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 0x7f63a8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.830+0000 7f63c659c700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 0x7f63a8069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f63c00097c0 tx=0x7f63c0019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:39.834+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63b8050cc0 con 0x7f63c8159530 2023-10-09T11:41:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.105+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f63c815a990 con 0x7f63c8159530 2023-10-09T11:41:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.109+0000 7f63be7fc700 1 -- 172.21.15.26:0/2461514223 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f63b8017070 con 0x7f63c8159530 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 msgr2=0x7f63a8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 0x7f63a8069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f63c00097c0 tx=0x7f63c0019000 comp rx=0 tx=0).stop 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 msgr2=0x7f63c815e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c560 tx=0x7f63b8007eb0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 shutdown_connections 2023-10-09T11:41:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c8159530 0x7f63c815e390 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f63a8067290 0x7f63a8069740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63c806dc70 0x7f63c8151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 --2- 172.21.15.26:0/2461514223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c806e0e0 0x7f63c80ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 >> 172.21.15.26:0/2461514223 conn(0x7f63c80703a0 msgr2=0x7f63c815ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 shutdown_connections 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.111+0000 7f63ccc23700 1 -- 172.21.15.26:0/2461514223 wait complete. 2023-10-09T11:41:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:41:40.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:40.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.245+0000 7f0b6d8ff700 1 Processor -- start 2023-10-09T11:41:40.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.245+0000 7f0b6d8ff700 1 -- start start 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6d8ff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b68153c30 0x7f0b6815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6d8ff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b6815de50 0x7f0b680cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6d8ff700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680cf3c0 con 0x7f0b680cef40 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6d8ff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6815afd0 con 0x7f0b6815de50 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6d8ff700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6815b2b0 con 0x7f0b68153c30 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b6815de50 0x7f0b680cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b6815de50 0x7f0b680cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45072/0 (socket says 172.21.15.26:45072) 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 -- 172.21.15.26:0/1481838181 learned_addr learned my addr 172.21.15.26:0/1481838181 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b6c8fd700 1 --2- 172.21.15.26:0/1481838181 >> v2:172.21.15.67:3300/0 conn(0x7f0b68153c30 0x7f0b6815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 -- 172.21.15.26:0/1481838181 >> v2:172.21.15.67:3300/0 conn(0x7f0b68153c30 msgr2=0x7f0b6815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 --2- 172.21.15.26:0/1481838181 >> v2:172.21.15.67:3300/0 conn(0x7f0b68153c30 0x7f0b6815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 -- 172.21.15.26:0/1481838181 >> v1:172.21.15.67:6789/0 conn(0x7f0b680cef40 legacy=0x7f0b6806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.246+0000 7f0b67fff700 1 -- 172.21.15.26:0/1481838181 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6815b590 con 0x7f0b6815de50 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b67fff700 1 --2- 172.21.15.26:0/1481838181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b680cea00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806ead0 tx=0x7f0b58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857a31231c797193 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b677fe700 1 -- 172.21.15.26:0/1481838181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800e070 con 0x7f0b6815de50 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b677fe700 1 -- 172.21.15.26:0/1481838181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800ba10 con 0x7f0b6815de50 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b677fe700 1 -- 172.21.15.26:0/1481838181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580092e0 con 0x7f0b6815de50 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/1481838181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 msgr2=0x7f0b680cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/1481838181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b680cea00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806ead0 tx=0x7f0b58009840 comp rx=0 tx=0).stop 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/1481838181 shutdown_connections 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/1481838181 >> v2:172.21.15.67:3300/0 conn(0x7f0b68153c30 0x7f0b6815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/1481838181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b680cea00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/1481838181 >> 172.21.15.26:0/1481838181 conn(0x7f0b680703a0 msgr2=0x7f0b680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/1481838181 shutdown_connections 2023-10-09T11:41:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.247+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/1481838181 wait complete. 2023-10-09T11:41:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.248+0000 7f0b6d8ff700 1 Processor -- start 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 -- start start 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680cef40 0x7f0b680c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 0x7f0b6813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6813f0e0 con 0x7f0b6815de50 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6816e330 con 0x7f0b680cef40 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d8ff700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6816d440 con 0x7f0b68153c30 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d0fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.249+0000 7f0b6d0fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45088/0 (socket says 172.21.15.26:45088) 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 -- 172.21.15.26:0/4141617641 learned_addr learned my addr 172.21.15.26:0/4141617641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6c8fd700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680cef40 0x7f0b680c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b67fff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 0x7f0b6813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 -- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 msgr2=0x7f0b6813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 0x7f0b6813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 -- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680cef40 msgr2=0x7f0b680c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680cef40 0x7f0b680c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 -- 172.21.15.26:0/4141617641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009ae0 con 0x7f0b6815de50 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b67fff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 0x7f0b6813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d0fe700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b4e0 tx=0x7f0b50009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000f510 con 0x7f0b6815de50 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5000f690 con 0x7f0b6815de50 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6816d720 con 0x7f0b6815de50 2023-10-09T11:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000fa50 con 0x7f0b6815de50 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.250+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6816dce0 con 0x7f0b6815de50 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.251+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6804c3c0 con 0x7f0b6815de50 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.252+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0b5001a400 con 0x7f0b6815de50 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.252+0000 7f0b64ff9700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 0x7f0b48069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.252+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b50084510 con 0x7f0b6815de50 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.252+0000 7f0b6c8fd700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 0x7f0b48069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.253+0000 7f0b6c8fd700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 0x7f0b48069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0b60006fd0 tx=0x7f0b60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.256+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b500512f0 con 0x7f0b6815de50 2023-10-09T11:41:40.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.492+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b680b6300 con 0x7f0b6815de50 2023-10-09T11:41:40.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.492+0000 7f0b64ff9700 1 -- 172.21.15.26:0/4141617641 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0b50054910 con 0x7f0b6815de50 2023-10-09T11:41:40.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:40.493 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 msgr2=0x7f0b48069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 0x7f0b48069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0b60006fd0 tx=0x7f0b60008040 comp rx=0 tx=0).stop 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 msgr2=0x7f0b6813eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b4e0 tx=0x7f0b50009060 comp rx=0 tx=0).stop 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 shutdown_connections 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b6815de50 0x7f0b6813eba0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680cef40 0x7f0b680c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0b48067290 0x7f0b48069740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 --2- 172.21.15.26:0/4141617641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b68153c30 0x7f0b6813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 >> 172.21.15.26:0/4141617641 conn(0x7f0b680703a0 msgr2=0x7f0b68151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 shutdown_connections 2023-10-09T11:41:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:40.494+0000 7f0b6d8ff700 1 -- 172.21.15.26:0/4141617641 wait complete. 2023-10-09T11:41:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 67 2023-10-09T11:41:40.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:41:30.023422+0000', 'modified': '2023-10-09T11:41:33.624561+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6843}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6843': {'gid': 6843, 'name': 'b', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6836/1060084620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1060084620}, {'type': 'v1', 'addr': '172.21.15.67:6836', 'nonce': 1060084620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:41:40.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:41:40.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T11:41:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.032+0000 7f1f6adec700 1 Processor -- start 2023-10-09T11:41:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.033+0000 7f1f6adec700 1 -- start start 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.033+0000 7f1f6adec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f640b07d0 0x7f1f640ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.033+0000 7f1f6adec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6415a280 con 0x7f1f640b0ba0 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.033+0000 7f1f6adec700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406e180 con 0x7f1f640cf200 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.033+0000 7f1f6adec700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406d850 con 0x7f1f640b07d0 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f69389700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1f640b0ba0 0x7f1f6406ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59748/0 (socket says 172.21.15.26:59748) 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f69389700 1 -- 172.21.15.26:0/2603069160 learned_addr learned my addr 172.21.15.26:0/2603069160 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f68b88700 1 --2- 172.21.15.26:0/2603069160 >> v2:172.21.15.67:3300/0 conn(0x7f1f640b07d0 0x7f1f640ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820681609 0 0) 0x7f1f6415a280 con 0x7f1f640b0ba0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f50003570 con 0x7f1f640b0ba0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584728380 0 0) 0x7f1f50003570 con 0x7f1f640b0ba0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 >> v2:172.21.15.67:3300/0 conn(0x7f1f640b07d0 msgr2=0x7f1f640ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 --2- 172.21.15.26:0/2603069160 >> v2:172.21.15.67:3300/0 conn(0x7f1f640b07d0 0x7f1f640ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 >> v1:172.21.15.67:6789/0 conn(0x7f1f640cf200 legacy=0x7f1f6406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6406db30 con 0x7f1f640b0ba0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f1f5c0017f0 con 0x7f1f640b0ba0 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 >> v1:172.21.15.26:6789/0 conn(0x7f1f640b0ba0 legacy=0x7f1f6406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50003a60 0x7f1f50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 0x7f1f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f500051c0 0x7f1f5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6406d850 con 0x7f1f50004810 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5000c0d0 con 0x7f1f500051c0 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5000c290 con 0x7f1f50003a60 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f63fff700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 0x7f1f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f68b88700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50003a60 0x7f1f50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.034+0000 7f1f69389700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f500051c0 0x7f1f5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 -- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50003a60 msgr2=0x7f1f50003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50003a60 0x7f1f50003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 -- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f500051c0 msgr2=0x7f1f5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f500051c0 0x7f1f5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 -- 172.21.15.26:0/2603069160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50003570 con 0x7f1f50004810 2023-10-09T11:41:41.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f69389700 1 -- 172.21.15.26:0/2603069160 reap_dead start 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f68b88700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50003a60 0x7f1f50003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f63fff700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 0x7f1f50004c80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0018b0 tx=0x7f1f4c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972adaf52071106c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c012420 con 0x7f1f50004810 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0125a0 con 0x7f1f50004810 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f637fe700 1 -- 172.21.15.26:0/2603069160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c012960 con 0x7f1f50004810 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 -- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 msgr2=0x7f1f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 0x7f1f50004c80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0018b0 tx=0x7f1f4c007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 -- 172.21.15.26:0/2603069160 shutdown_connections 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 --2- 172.21.15.26:0/2603069160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50004810 0x7f1f50004c80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 -- 172.21.15.26:0/2603069160 >> 172.21.15.26:0/2603069160 conn(0x7f1f6406ce80 msgr2=0x7f1f640ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 -- 172.21.15.26:0/2603069160 shutdown_connections 2023-10-09T11:41:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.035+0000 7f1f6adec700 1 -- 172.21.15.26:0/2603069160 wait complete. 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 Processor -- start 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 -- start start 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50004810 0x7f1f640b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64152610 0x7f1f641515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640b25f0 con 0x7f1f64155ba0 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64151ae0 con 0x7f1f64152610 2023-10-09T11:41:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.037+0000 7f1f6adec700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64152af0 con 0x7f1f50004810 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45106/0 (socket says 172.21.15.26:45106) 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 -- 172.21.15.26:0/677172926 learned_addr learned my addr 172.21.15.26:0/677172926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 -- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50004810 msgr2=0x7f1f640b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50004810 0x7f1f640b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 -- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64152610 msgr2=0x7f1f641515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64152610 0x7f1f641515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 -- 172.21.15.26:0/677172926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64152dd0 con 0x7f1f64155ba0 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f69389700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f6406b550 tx=0x7f1f5c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f60ff9700 1 -- 172.21.15.26:0/677172926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00ace0 con 0x7f1f64155ba0 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f60ff9700 1 -- 172.21.15.26:0/677172926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00ae40 con 0x7f1f64155ba0 2023-10-09T11:41:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f641530b0 con 0x7f1f64155ba0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f60ff9700 1 -- 172.21.15.26:0/677172926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c013640 con 0x7f1f64155ba0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.038+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64153670 con 0x7f1f64155ba0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.039+0000 7f1f60ff9700 1 -- 172.21.15.26:0/677172926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1f5c013a30 con 0x7f1f64155ba0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.040+0000 7f1f60ff9700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 0x7f1f44069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.040+0000 7f1f60ff9700 1 -- 172.21.15.26:0/677172926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f5c0853c0 con 0x7f1f64155ba0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.040+0000 7f1f68b88700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 0x7f1f44069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.040+0000 7f1f68b88700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 0x7f1f44069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1f64066170 tx=0x7f1f54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 Processor -- start 2023-10-09T11:41:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 -- start start 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce586a50 0x55d4ce586e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce4dda70 con 0x55d4ce5aff60 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce4db270 con 0x55d4ce586a50 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce4d7060 con 0x55d4ce5d0d00 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f69389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f69389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45110/0 (socket says 172.21.15.26:45110) 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.042+0000 7f1f69389700 1 -- 172.21.15.26:0/2363995323 learned_addr learned my addr 172.21.15.26:0/2363995323 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f68b88700 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce586a50 0x55d4ce586e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f63fff700 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 -- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 msgr2=0x55d4ce5afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 -- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce586a50 msgr2=0x55d4ce586e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce586a50 0x55d4ce586e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 -- 172.21.15.26:0/2363995323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ce371270 con 0x55d4ce5aff60 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f69389700 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c055e70 tx=0x7f1f5c058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5e3bcc1fd96d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f59ffb700 1 -- 172.21.15.26:0/2363995323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c059130 con 0x55d4ce5aff60 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f59ffb700 1 -- 172.21.15.26:0/2363995323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c05ce80 con 0x55d4ce5aff60 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.043+0000 7f1f59ffb700 1 -- 172.21.15.26:0/2363995323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0850c0 con 0x55d4ce5aff60 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- 172.21.15.26:0/2363995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 msgr2=0x55d4ce582cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c055e70 tx=0x7f1f5c058040 comp rx=0 tx=0).stop 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- 172.21.15.26:0/2363995323 shutdown_connections 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce582cf0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce586a50 0x55d4ce586e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/2363995323 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- 172.21.15.26:0/2363995323 >> 172.21.15.26:0/2363995323 conn(0x55d4ce588370 msgr2=0x55d4ce588740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- 172.21.15.26:0/2363995323 shutdown_connections 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- 172.21.15.26:0/2363995323 wait complete. 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 -- start start 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.044+0000 7f1f740e4b80 1 Processor -- start 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5aff60 0x55d4ce5abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5e0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce482890 con 0x55d4ce586a50 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce49dea0 con 0x55d4ce5aff60 2023-10-09T11:41:41.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce359e30 con 0x55d4ce5d0d00 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f740e4b80 10 client.0 _ll_register_callbacks cb 0x55d4ce54a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f68b88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f68b88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45124/0 (socket says 172.21.15.26:45124) 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f68b88700 1 -- 172.21.15.26:0/936626452 learned_addr learned my addr 172.21.15.26:0/936626452 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f69389700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.045+0000 7f1f63fff700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5aff60 0x55d4ce5abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 -- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 msgr2=0x55d4ce5e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 -- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5aff60 msgr2=0x55d4ce5abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5aff60 0x55d4ce5abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 -- 172.21.15.26:0/936626452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64153670 con 0x55d4ce586a50 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f68b88700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006720 tx=0x7f1f54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a363b7b3457634 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011d10 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f5401e040 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4ce57bb70 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f54011e70 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 10 client.6993 fetch_fsmap learned FSMap version 67 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55d4ce313fe0 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ce57bb70 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1f54015690 con 0x55d4ce586a50 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 10 client.6993 fetch_fsmap finished waiting for FSMap version 67 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 10 client.6993 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:41:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.046+0000 7f1f740e4b80 20 client.6993 populate_metadata read hostname 'smithi026' 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cf660 0x55d4ce5cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f740e4b80 4 client.6993 mds_command: new command op to 6843 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 --> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4ce558aa0 con 0x55d4ce5cf660 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f63fff700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cf660 0x55d4ce5cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f42ffd700 10 client.6993 ms_handle_connect on v2:172.21.15.67:6834/1060084620 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.047+0000 7f1f63fff700 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cf660 0x55d4ce5cfa30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29fc6cd4cea8e14a server_cookie=2885ae879ef47688 in_seq=0 out_seq=0 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f42ffd700 1 -- 172.21.15.26:0/936626452 <== mds.0 v2:172.21.15.67:6834/1060084620 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d4ce558aa0 con 0x55d4ce5cf660 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f42ffd700 10 client.6993 handle_command_reply: tid=0 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 client.6993 shutdown 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 msgr2=0x55d4ce5ddc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006720 tx=0x7f1f54016000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 shutdown_connections 2023-10-09T11:41:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cf660 0x55d4ce5cfa30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce5d0d00 0x55d4ce5e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce586a50 0x55d4ce5ddc40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f42ffd700 0 client.6993 ms_handle_reset on v2:172.21.15.67:6834/1060084620 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/936626452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5aff60 0x55d4ce5abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 >> 172.21.15.26:0/936626452 conn(0x55d4ce588370 msgr2=0x55d4ce5cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 shutdown_connections 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.048+0000 7f1f740e4b80 1 -- 172.21.15.26:0/936626452 wait complete. 2023-10-09T11:41:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.049+0000 7f1f740e4b80 20 client.6993 trim_cache size 0 max 16384 2023-10-09T11:41:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.065+0000 7f1f740e4b80 1 Processor -- start 2023-10-09T11:41:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.065+0000 7f1f740e4b80 1 -- start start 2023-10-09T11:41:41.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce5c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce5ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce57bb40 con 0x55d4ce5aff60 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce566510 con 0x55d4ce5d0d00 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce55f410 con 0x55d4ce586a50 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45128/0 (socket says 172.21.15.26:45128) 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 -- 172.21.15.26:0/1611930365 learned_addr learned my addr 172.21.15.26:0/1611930365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 -- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 msgr2=0x55d4ce5c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce5c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 -- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 msgr2=0x55d4ce5ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f69389700 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce5ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce5ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.066+0000 7f1f63fff700 1 -- 172.21.15.26:0/1611930365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ce4a5780 con 0x55d4ce5aff60 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f63fff700 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c0a0 tx=0x7f1f4c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2154d2de0a99d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f5a7fc700 1 -- 172.21.15.26:0/1611930365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c024040 con 0x55d4ce5aff60 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f5a7fc700 1 -- 172.21.15.26:0/1611930365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c001200 con 0x55d4ce5aff60 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f5a7fc700 1 -- 172.21.15.26:0/1611930365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c028250 con 0x55d4ce5aff60 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 -- 172.21.15.26:0/1611930365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 msgr2=0x55d4ce5ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c0a0 tx=0x7f1f4c003000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 -- 172.21.15.26:0/1611930365 shutdown_connections 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce5ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce5c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/1611930365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce5ce3e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 -- 172.21.15.26:0/1611930365 >> 172.21.15.26:0/1611930365 conn(0x55d4ce588370 msgr2=0x55d4ce5b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 -- 172.21.15.26:0/1611930365 shutdown_connections 2023-10-09T11:41:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.067+0000 7f1f740e4b80 1 -- 172.21.15.26:0/1611930365 wait complete. 2023-10-09T11:41:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.068+0000 7f1f740e4b80 1 -- start start 2023-10-09T11:41:41.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.068+0000 7f1f740e4b80 1 Processor -- start 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce588b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce62cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce62d7e0 con 0x55d4ce5aff60 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce627fd0 con 0x55d4ce5d0d00 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ce628460 con 0x55d4ce586a50 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f740e4b80 10 client.0 _ll_register_callbacks cb 0x55d4ce54a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45130/0 (socket says 172.21.15.26:45130) 2023-10-09T11:41:41.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 -- 172.21.15.26:0/851058758 learned_addr learned my addr 172.21.15.26:0/851058758 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f69389700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce62cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 -- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 msgr2=0x55d4ce588b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f68b88700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce588b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce588b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 -- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 msgr2=0x55d4ce62cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce62cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f63fff700 1 -- 172.21.15.26:0/851058758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f50003570 con 0x55d4ce5aff60 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.069+0000 7f1f69389700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce62cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f63fff700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c015040 tx=0x7f1f4c02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378517d127aca58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c024070 con 0x55d4ce5aff60 2023-10-09T11:41:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f4c006a30 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f5c05ce80 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4c006e00 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 10 client.6999 fetch_fsmap learned FSMap version 67 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55d4ce48c470 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c05ce80 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1f4c02f020 con 0x55d4ce5aff60 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 10 client.6999 fetch_fsmap finished waiting for FSMap version 67 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 10 client.6999 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 20 client.6999 populate_metadata read hostname 'smithi026' 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cefa0 0x55d4ce5dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 4 client.6999 mds_command: new command op to 6843 tid=0[{"prefix": "status"}] 2023-10-09T11:41:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 --> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4ce479e00 con 0x55d4ce5cefa0 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.070+0000 7f1f68b88700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cefa0 0x55d4ce5dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f42ffd700 10 client.6999 ms_handle_connect on v2:172.21.15.67:6834/1060084620 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f68b88700 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cefa0 0x55d4ce5dbb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6028589c72ac8b server_cookie=bcc6906d2d5096fb in_seq=0 out_seq=0 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f42ffd700 1 -- 172.21.15.26:0/851058758 <== mds.0 v2:172.21.15.67:6834/1060084620 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d4ce479e00 con 0x55d4ce5cefa0 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f42ffd700 10 client.6999 handle_command_reply: tid=0 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f740e4b80 1 client.6999 shutdown 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 msgr2=0x55d4ce62c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.071+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c015040 tx=0x7f1f4c02b000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 shutdown_connections 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:6834/1060084620,v1:172.21.15.67:6836/1060084620] conn(0x55d4ce5cefa0 0x55d4ce5dbb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4ce5d0d00 0x55d4ce62cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f42ffd700 0 client.6999 ms_handle_reset on v2:172.21.15.67:6834/1060084620 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d4ce586a50 0x55d4ce588b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 --2- 172.21.15.26:0/851058758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4ce5aff60 0x55d4ce62c6d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 >> 172.21.15.26:0/851058758 conn(0x55d4ce588370 msgr2=0x55d4ce5c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 shutdown_connections 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 1 -- 172.21.15.26:0/851058758 wait complete. 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f740e4b80 20 client.6999 trim_cache size 0 max 16384 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:41:41.079 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 6843, 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.462946603000001, 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 67, 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 100, 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 100, 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 15.5221672 2023-10-09T11:41:41.080 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 msgr2=0x7f1f44069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 0x7f1f44069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1f64066170 tx=0x7f1f54008040 comp rx=0 tx=0).stop 2023-10-09T11:41:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 msgr2=0x7f1f64156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f6406b550 tx=0x7f1f5c0021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 shutdown_connections 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f64155ba0 0x7f1f64156020 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f44067290 0x7f1f44069740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f50004810 0x7f1f640b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 --2- 172.21.15.26:0/677172926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64152610 0x7f1f641515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 >> 172.21.15.26:0/677172926 conn(0x7f1f6406ce80 msgr2=0x7f1f640cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 shutdown_connections 2023-10-09T11:41:41.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.072+0000 7f1f6adec700 1 -- 172.21.15.26:0/677172926 wait complete. 2023-10-09T11:41:41.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.203+0000 7f636927f700 1 Processor -- start 2023-10-09T11:41:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.203+0000 7f636927f700 1 -- start start 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f636927f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640cb970 0x7f6364159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f636927f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636415ae40 con 0x7f63640cb5a0 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f636927f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636415ab60 con 0x7f636415a400 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f636927f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640ce0f0 con 0x7f63640cb970 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6362ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f63640cb5a0 0x7f63640cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59762/0 (socket says 172.21.15.26:59762) 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6362ffd700 1 -- 172.21.15.26:0/1580465733 learned_addr learned my addr 172.21.15.26:0/1580465733 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f63627fc700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640cb970 0x7f6364159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562419543 0 0) 0x7f636415ae40 con 0x7f63640cb5a0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6350003570 con 0x7f63640cb5a0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423035013 0 0) 0x7f636415ab60 con 0x7f636415a400 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f636415ae40 con 0x7f636415a400 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2007364463 0 0) 0x7f6350003570 con 0x7f63640cb5a0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640cb970 msgr2=0x7f6364159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640cb970 0x7f6364159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.204+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 >> v1:172.21.15.67:6789/0 conn(0x7f636415a400 legacy=0x7f6364156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640ccf00 con 0x7f63640cb5a0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f635c001470 con 0x7f63640cb5a0 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 >> v1:172.21.15.26:6789/0 conn(0x7f63640cb5a0 legacy=0x7f63640cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6350004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6350004810 0x7f6350004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63500051c0 0x7f635000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640ce0f0 con 0x7f6350003c20 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635000c020 con 0x7f6350004810 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635000c1e0 con 0x7f63500051c0 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f63627fc700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640cb970 0x7f6364159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6350004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f63637fe700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63500051c0 0x7f635000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f63627fc700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6350004810 0x7f6350004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 -- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63500051c0 msgr2=0x7f635000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63500051c0 0x7f635000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 -- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6350004810 msgr2=0x7f6350004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6350004810 0x7f6350004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 -- 172.21.15.26:0/1580465733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350003570 con 0x7f6350003c20 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6350004010 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f635c00c2d0 tx=0x7f635c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb9fd7c187ccd58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00cba0 con 0x7f6350003c20 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00cd00 con 0x7f6350003c20 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.205+0000 7f6361ffb700 1 -- 172.21.15.26:0/1580465733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c005b70 con 0x7f6350003c20 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 -- 172.21.15.26:0/1580465733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 msgr2=0x7f6350004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 --2- 172.21.15.26:0/1580465733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6350004010 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f635c00c2d0 tx=0x7f635c001e10 comp rx=0 tx=0).stop 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f63637fe700 1 -- 172.21.15.26:0/1580465733 reap_dead start 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 -- 172.21.15.26:0/1580465733 shutdown_connections 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 -- 172.21.15.26:0/1580465733 >> 172.21.15.26:0/1580465733 conn(0x7f6364070e30 msgr2=0x7f63640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 -- 172.21.15.26:0/1580465733 shutdown_connections 2023-10-09T11:41:41.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.206+0000 7f636927f700 1 -- 172.21.15.26:0/1580465733 wait complete. 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.207+0000 7f636927f700 1 Processor -- start 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.207+0000 7f636927f700 1 -- start start 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 0x7f63641580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63640c6b40 0x7f63641585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640cbde0 con 0x7f6350003c20 2023-10-09T11:41:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6364152ea0 con 0x7f63640c6b40 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f636927f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6364153420 con 0x7f63640c66d0 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45156/0 (socket says 172.21.15.26:45156) 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 -- 172.21.15.26:0/1864106923 learned_addr learned my addr 172.21.15.26:0/1864106923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f63637fe700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63640c6b40 0x7f63641585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f63627fc700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 0x7f63641580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 -- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 msgr2=0x7f63641580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 0x7f63641580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 -- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63640c6b40 msgr2=0x7f63641585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63640c6b40 0x7f63641585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 -- 172.21.15.26:0/1864106923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6364157020 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f63627fc700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 0x7f63641580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.208+0000 7f6362ffd700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f635c007c90 tx=0x7f635c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.209+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0070d0 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.209+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c007230 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.209+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6364157300 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.209+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0075d0 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.209+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63641578c0 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.210+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636404c3c0 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.210+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f635c019030 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.210+0000 7f635affd700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 0x7f6344069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.210+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f635c085550 con 0x7f6350003c20 2023-10-09T11:41:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.211+0000 7f63627fc700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 0x7f6344069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.211+0000 7f63627fc700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 0x7f6344069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f634c0093f0 tx=0x7f634c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.215+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f635c052420 con 0x7f6350003c20 2023-10-09T11:41:41.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.457+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f636415b8a0 con 0x7f6350003c20 2023-10-09T11:41:41.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.457+0000 7f635affd700 1 -- 172.21.15.26:0/1864106923 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f635c055a40 con 0x7f6350003c20 2023-10-09T11:41:41.458 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 msgr2=0x7f6344069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 0x7f6344069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f634c0093f0 tx=0x7f634c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 msgr2=0x7f6364152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f635c007c90 tx=0x7f635c015000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 shutdown_connections 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63640c6b40 0x7f63641585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6350003c20 0x7f6364152960 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6344067290 0x7f6344069740 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 --2- 172.21.15.26:0/1864106923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63640c66d0 0x7f63641580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 >> 172.21.15.26:0/1864106923 conn(0x7f6364070e30 msgr2=0x7f63641554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 shutdown_connections 2023-10-09T11:41:41.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:41.459+0000 7f636927f700 1 -- 172.21.15.26:0/1864106923 wait complete. 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:41.472 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:41.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.473 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.488 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42091sec preferred_lft 42091sec 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.489 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.490 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:41.491 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:41:41.491 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:41:41.491 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.491 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:41.552 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:41:41.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.554 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:41:41.613 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:41:41.613 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:41.613 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:41:41.613 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:41:41.613 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:41.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:41:41.614 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:41:41.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.715 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:41:41.730 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:41:41.730 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:41:41.730 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:41.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:41:41.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:41.795 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:41.850 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:41.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:41.850 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:41.905 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:41:41.905 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:41.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:41.986 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:41.986 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:42.005 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:42.005 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:42.005 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:42.005 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:42.005 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:42.006 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:42.006 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:42.006 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:42.028 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:42.028 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:41:42.029 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:41:42.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:42.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:42.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.256+0000 7fc494cb7700 1 Processor -- start 2023-10-09T11:41:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.256+0000 7fc494cb7700 1 -- start start 2023-10-09T11:41:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc494cb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc490159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc494cb7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc49015a400 0x7fc490156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc494cb7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49015ae40 con 0x7fc4900cb5a0 2023-10-09T11:41:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc494cb7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900ce0f0 con 0x7fc49015a400 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc494cb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900cbde0 con 0x7fc4900cb970 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4900cb5a0 0x7fc4900cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59774/0 (socket says 172.21.15.26:59774) 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48e59c700 1 -- 172.21.15.26:0/3343995750 learned_addr learned my addr 172.21.15.26:0/3343995750 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605851757 0 0) 0x7fc49015ae40 con 0x7fc4900cb5a0 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc47c003570 con 0x7fc4900cb5a0 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48dd9b700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc490159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.257+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/3343995750 >> v2:172.21.15.67:3300/0 conn(0x7fc49015a400 0x7fc490156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958221864 0 0) 0x7fc47c003570 con 0x7fc4900cb5a0 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 msgr2=0x7fc490159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc490159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 >> v2:172.21.15.67:3300/0 conn(0x7fc49015a400 msgr2=0x7fc490156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 --2- 172.21.15.26:0/3343995750 >> v2:172.21.15.67:3300/0 conn(0x7fc49015a400 0x7fc490156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49015ab60 con 0x7fc4900cb5a0 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fc488001470 con 0x7fc4900cb5a0 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 >> v1:172.21.15.26:6789/0 conn(0x7fc4900cb5a0 legacy=0x7fc4900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c003a90 0x7fc47c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc47c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc47c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900ce0f0 con 0x7fc47c004d50 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900cbde0 con 0x7fc47c003a90 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c00ba90 con 0x7fc4900cb970 2023-10-09T11:41:42.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48e59c700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c003a90 0x7fc47c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc47c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48dd9b700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc47c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 -- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 msgr2=0x7fc47c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4900cb970 0x7fc47c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 -- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c003a90 msgr2=0x7fc47c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c003a90 0x7fc47c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48ed9d700 1 -- 172.21.15.26:0/3343995750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c003570 con 0x7fc47c004d50 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.258+0000 7fc48e59c700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c003a90 0x7fc47c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc47c0051c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e210 tx=0x7fc48000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8820a37c0d51b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000ea60 con 0x7fc47c004d50 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000f040 con 0x7fc47c004d50 2023-10-09T11:41:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc48d59a700 1 -- 172.21.15.26:0/3343995750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000ee10 con 0x7fc47c004d50 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 -- 172.21.15.26:0/3343995750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 msgr2=0x7fc47c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 --2- 172.21.15.26:0/3343995750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc47c0051c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e210 tx=0x7fc48000b040 comp rx=0 tx=0).stop 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc48ed9d700 1 -- 172.21.15.26:0/3343995750 reap_dead start 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 -- 172.21.15.26:0/3343995750 shutdown_connections 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 -- 172.21.15.26:0/3343995750 >> 172.21.15.26:0/3343995750 conn(0x7fc490070e30 msgr2=0x7fc4900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 -- 172.21.15.26:0/3343995750 shutdown_connections 2023-10-09T11:41:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.259+0000 7fc494cb7700 1 -- 172.21.15.26:0/3343995750 wait complete. 2023-10-09T11:41:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.260+0000 7fc494cb7700 1 Processor -- start 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.260+0000 7fc494cb7700 1 -- start start 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4900b40d0 0x7fc4900b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 0x7fc490150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900b4a80 con 0x7fc47c004d50 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c65b0 con 0x7fc4900b40d0 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc494cb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490152270 con 0x7fc490150ac0 2023-10-09T11:41:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45174/0 (socket says 172.21.15.26:45174) 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 -- 172.21.15.26:0/16936410 learned_addr learned my addr 172.21.15.26:0/16936410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48dd9b700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4900b40d0 0x7fc4900b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 0x7fc490150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 -- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 msgr2=0x7fc490150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 0x7fc490150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 -- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4900b40d0 msgr2=0x7fc4900b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4900b40d0 0x7fc4900b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.261+0000 7fc48e59c700 1 -- 172.21.15.26:0/16936410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490152550 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc48ed9d700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 0x7fc490150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc48e59c700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc488007b10 tx=0x7fc488001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800fa20 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800fb80 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc490152830 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4880133f0 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.262+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900c6240 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.263+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49004c3c0 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.263+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc488013760 con 0x7fc47c004d50 2023-10-09T11:41:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.264+0000 7fc4867fc700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 0x7fc470069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.264+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc488084d60 con 0x7fc47c004d50 2023-10-09T11:41:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.264+0000 7fc48dd9b700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 0x7fc470069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.264+0000 7fc48dd9b700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 0x7fc470069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b2b70 tx=0x7fc4780091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.268+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc488051bc0 con 0x7fc47c004d50 2023-10-09T11:41:42.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.507+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4900c6890 con 0x7fc47c004d50 2023-10-09T11:41:42.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.507+0000 7fc4867fc700 1 -- 172.21.15.26:0/16936410 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc4880551e0 con 0x7fc47c004d50 2023-10-09T11:41:42.508 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 msgr2=0x7fc470069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 0x7fc470069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b2b70 tx=0x7fc4780091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 msgr2=0x7fc4900c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc488007b10 tx=0x7fc488001e50 comp rx=0 tx=0).stop 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 shutdown_connections 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc470067290 0x7fc470069740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc490150ac0 0x7fc490150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc47c004d50 0x7fc4900c6a40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 --2- 172.21.15.26:0/16936410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4900b40d0 0x7fc4900b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 >> 172.21.15.26:0/16936410 conn(0x7fc490070e30 msgr2=0x7fc490154910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.509+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 shutdown_connections 2023-10-09T11:41:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:42.510+0000 7fc494cb7700 1 -- 172.21.15.26:0/16936410 wait complete. 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:42.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:42.523 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:42.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.523 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:42.542 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42104sec preferred_lft 42104sec 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.543 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:41:42.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:41:42.545 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:42.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.545 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:42.610 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:41:42.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.611 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:42.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.671 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:41:42.672 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:41:42.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:42.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:42.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:42.672 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:41:42.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.779 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:41:42.794 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:41:42.794 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:41:42.795 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:42.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:41:42.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:42.860 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:42.916 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:42.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:42.916 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:42.972 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:41:42.972 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:42.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:43.052 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:43.053 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:43.071 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:43.071 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:43.071 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:43.071 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:43.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:43.095 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:41:43.095 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:41:43.095 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:41:43.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:43.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:43.096 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:43.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.296+0000 7f4efd56d700 1 Processor -- start 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.296+0000 7f4efd56d700 1 -- start start 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ef8067e50 0x7f4ef815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef8068220 0x7f4ef8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef815a300 0x7f4ef80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef815d9f0 con 0x7f4ef8068220 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef815d3c0 con 0x7f4ef8067e50 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4efd56d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815a8f0 con 0x7f4ef815a300 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef8068220 0x7f4ef8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef8068220 0x7f4ef8159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45182/0 (socket says 172.21.15.26:45182) 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 -- 172.21.15.26:0/320079426 learned_addr learned my addr 172.21.15.26:0/320079426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef77fe700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef815a300 0x7f4ef80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef6ffd700 1 --2- 172.21.15.26:0/320079426 >> v2:172.21.15.67:3300/0 conn(0x7f4ef8067e50 0x7f4ef815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 -- 172.21.15.26:0/320079426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef815a300 msgr2=0x7f4ef80c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef815a300 0x7f4ef80c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 -- 172.21.15.26:0/320079426 >> v2:172.21.15.67:3300/0 conn(0x7f4ef8067e50 msgr2=0x7f4ef815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 --2- 172.21.15.26:0/320079426 >> v2:172.21.15.67:3300/0 conn(0x7f4ef8067e50 0x7f4ef815de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.297+0000 7f4ef67fc700 1 -- 172.21.15.26:0/320079426 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef815abd0 con 0x7f4ef8068220 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4ef67fc700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8068220 0x7f4ef8159dc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8067b60 tx=0x7f4ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b035718c489b80f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4ef5ffb700 1 -- 172.21.15.26:0/320079426 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000b640 con 0x7f4ef8068220 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4ef5ffb700 1 -- 172.21.15.26:0/320079426 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee000b7a0 con 0x7f4ef8068220 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4ef5ffb700 1 -- 172.21.15.26:0/320079426 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000bb60 con 0x7f4ef8068220 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 -- 172.21.15.26:0/320079426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8068220 msgr2=0x7f4ef8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8068220 0x7f4ef8159dc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8067b60 tx=0x7f4ee0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 -- 172.21.15.26:0/320079426 shutdown_connections 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 --2- 172.21.15.26:0/320079426 >> v2:172.21.15.67:3300/0 conn(0x7f4ef8067e50 0x7f4ef815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef815a300 0x7f4ef80c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 --2- 172.21.15.26:0/320079426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef8068220 0x7f4ef8159dc0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 -- 172.21.15.26:0/320079426 >> 172.21.15.26:0/320079426 conn(0x7f4ef80ce4a0 msgr2=0x7f4ef80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 -- 172.21.15.26:0/320079426 shutdown_connections 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.298+0000 7f4efd56d700 1 -- 172.21.15.26:0/320079426 wait complete. 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 Processor -- start 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 -- start start 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef8067e50 0x7f4ef8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef8068220 0x7f4ef80b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c1e70 con 0x7f4ef815a300 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef81522e0 con 0x7f4ef8067e50 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.300+0000 7f4efd56d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c20c0 con 0x7f4ef8068220 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef8067e50 0x7f4ef8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45196/0 (socket says 172.21.15.26:45196) 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 -- 172.21.15.26:0/2327338694 learned_addr learned my addr 172.21.15.26:0/2327338694 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef67fc700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef8068220 0x7f4ef80b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 -- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef8068220 msgr2=0x7f4ef80b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef8068220 0x7f4ef80b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 -- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef8067e50 msgr2=0x7f4ef8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef8067e50 0x7f4ef8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 -- 172.21.15.26:0/2327338694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00094f0 con 0x7f4ef815a300 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4ef77fe700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e90 tx=0x7f4ee800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800cb70 con 0x7f4ef815a300 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800f040 con 0x7f4ef815a300 2023-10-09T11:41:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8014480 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80c23a0 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.301+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80c2960 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.302+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef804c3c0 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.303+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4ee8014830 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.303+0000 7f4eeeffd700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 0x7f4ed8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.303+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ee80855b0 con 0x7f4ef815a300 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.303+0000 7f4ef6ffd700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 0x7f4ed8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.304+0000 7f4ef6ffd700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 0x7f4ed8069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80b4380 tx=0x7f4ef00091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.307+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ee8052300 con 0x7f4ef815a300 2023-10-09T11:41:43.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:43.548+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4ef815d680 con 0x7f4ef815a300 2023-10-09T11:41:44.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.209+0000 7f4eeeffd700 1 -- 172.21.15.26:0/2327338694 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4ee8055920 con 0x7f4ef815a300 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 msgr2=0x7f4ed8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 0x7f4ed8069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80b4380 tx=0x7f4ef00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 msgr2=0x7f4ef81588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e90 tx=0x7f4ee800b040 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 shutdown_connections 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef815a300 0x7f4ef81588a0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef8067e50 0x7f4ef8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ed8067290 0x7f4ed8069740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 --2- 172.21.15.26:0/2327338694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef8068220 0x7f4ef80b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 >> 172.21.15.26:0/2327338694 conn(0x7f4ef80ce4a0 msgr2=0x7f4ef8152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 shutdown_connections 2023-10-09T11:41:44.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.212+0000 7f4efd56d700 1 -- 172.21.15.26:0/2327338694 wait complete. 2023-10-09T11:41:44.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:41:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 Processor -- start 2023-10-09T11:41:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 -- start start 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 0x7fe640159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640067fe0 0x7fe640068460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64006d840 con 0x7fe6401597a0 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400689a0 con 0x7fe640067fe0 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.351+0000 7fe64628a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64015dbc0 con 0x7fe64015d5e0 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640067fe0 0x7fe640068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640067fe0 0x7fe640068460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45198/0 (socket says 172.21.15.26:45198) 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 -- 172.21.15.26:0/4191154178 learned_addr learned my addr 172.21.15.26:0/4191154178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/4191154178 >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 0x7fe640159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 -- 172.21.15.26:0/4191154178 >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 msgr2=0x7fe640159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 --2- 172.21.15.26:0/4191154178 >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 0x7fe640159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 -- 172.21.15.26:0/4191154178 >> v1:172.21.15.67:6789/0 conn(0x7fe6401597a0 legacy=0x7fe6400b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 -- 172.21.15.26:0/4191154178 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64015dea0 con 0x7fe640067fe0 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/4191154178 >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 0x7fe640159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe644827700 1 --2- 172.21.15.26:0/4191154178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640067fe0 0x7fe640068460 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe6400cb080 tx=0x7fe638009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f168b44a601f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe63effd700 1 -- 172.21.15.26:0/4191154178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63800e070 con 0x7fe640067fe0 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe63effd700 1 -- 172.21.15.26:0/4191154178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63800ba10 con 0x7fe640067fe0 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.352+0000 7fe63effd700 1 -- 172.21.15.26:0/4191154178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380092e0 con 0x7fe640067fe0 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 -- 172.21.15.26:0/4191154178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640067fe0 msgr2=0x7fe640068460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 --2- 172.21.15.26:0/4191154178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640067fe0 0x7fe640068460 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe6400cb080 tx=0x7fe638009840 comp rx=0 tx=0).stop 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 -- 172.21.15.26:0/4191154178 shutdown_connections 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 --2- 172.21.15.26:0/4191154178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640067fe0 0x7fe640068460 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 --2- 172.21.15.26:0/4191154178 >> v2:172.21.15.67:3300/0 conn(0x7fe64015d5e0 0x7fe640159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 -- 172.21.15.26:0/4191154178 >> 172.21.15.26:0/4191154178 conn(0x7fe6400ce6b0 msgr2=0x7fe6400ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 -- 172.21.15.26:0/4191154178 shutdown_connections 2023-10-09T11:41:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.353+0000 7fe64628a700 1 -- 172.21.15.26:0/4191154178 wait complete. 2023-10-09T11:41:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.354+0000 7fe64628a700 1 Processor -- start 2023-10-09T11:41:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.354+0000 7fe64628a700 1 -- start start 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 0x7fe64015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 0x7fe6400c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400c8070 con 0x7fe6401597a0 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640145410 con 0x7fe640067fe0 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe64628a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400c7ab0 con 0x7fe64015d5e0 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45212/0 (socket says 172.21.15.26:45212) 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 -- 172.21.15.26:0/1557121276 learned_addr learned my addr 172.21.15.26:0/1557121276 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe644827700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 0x7fe6400c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63ffff700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 0x7fe64015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 -- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 msgr2=0x7fe6400c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 0x7fe6400c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 -- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 msgr2=0x7fe64015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 0x7fe64015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63f7fe700 1 -- 172.21.15.26:0/1557121276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009ae0 con 0x7fe6401597a0 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe644827700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 0x7fe6400c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:44.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.355+0000 7fe63ffff700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 0x7fe64015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c850 tx=0x7fe634008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634011600 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe634011760 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6400c7d90 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634011b00 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.356+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6400b2220 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.357+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6400b1da0 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.357+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe6340073b0 con 0x7fe6401597a0 2023-10-09T11:41:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.358+0000 7fe627fff700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 0x7fe62c069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.358+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe634084a90 con 0x7fe6401597a0 2023-10-09T11:41:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.358+0000 7fe63ffff700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 0x7fe62c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.358+0000 7fe63ffff700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 0x7fe62c069770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe630006fd0 tx=0x7fe630008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.362+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6400b1da0 con 0x7fe6401597a0 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.585+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6400b1da0 con 0x7fe62c0672c0 2023-10-09T11:41:44.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.587+0000 7fe627fff700 1 -- 172.21.15.26:0/1557121276 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe6400b1da0 con 0x7fe62c0672c0 2023-10-09T11:41:44.587 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:41:44.587 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:44.588 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:41:44.588 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:44.588 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 msgr2=0x7fe62c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 0x7fe62c069770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe630006fd0 tx=0x7fe630008040 comp rx=0 tx=0).stop 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 msgr2=0x7fe64015a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c850 tx=0x7fe634008040 comp rx=0 tx=0).stop 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 shutdown_connections 2023-10-09T11:41:44.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe62c0672c0 0x7fe62c069770 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe64015d5e0 0x7fe6400c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe640067fe0 0x7fe64015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 --2- 172.21.15.26:0/1557121276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6401597a0 0x7fe64015a610 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 >> 172.21.15.26:0/1557121276 conn(0x7fe6400ce6b0 msgr2=0x7fe6400ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 shutdown_connections 2023-10-09T11:41:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.589+0000 7fe64628a700 1 -- 172.21.15.26:0/1557121276 wait complete. 2023-10-09T11:41:44.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:44.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.723+0000 7fe833ada700 1 Processor -- start 2023-10-09T11:41:44.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.724+0000 7fe833ada700 1 -- start start 2023-10-09T11:41:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.724+0000 7fe833ada700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 0x7fe82c156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.724+0000 7fe833ada700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c1575a0 con 0x7fe82c1599d0 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.724+0000 7fe833ada700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0b0e40 con 0x7fe82c155b60 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.724+0000 7fe833ada700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c156990 con 0x7fe82c155f30 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe832077700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe82c1599d0 0x7fe82c157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59784/0 (socket says 172.21.15.26:59784) 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe832077700 1 -- 172.21.15.26:0/3484371178 learned_addr learned my addr 172.21.15.26:0/3484371178 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe831075700 1 --2- 172.21.15.26:0/3484371178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 0x7fe82c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904651035 0 0) 0x7fe82c1575a0 con 0x7fe82c1599d0 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe814003570 con 0x7fe82c1599d0 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054161566 0 0) 0x7fe82c0b0e40 con 0x7fe82c155b60 2023-10-09T11:41:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c1575a0 con 0x7fe82c155b60 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe831075700 1 -- 172.21.15.26:0/3484371178 >> v1:172.21.15.67:6789/0 conn(0x7fe82c155b60 legacy=0x7fe82c0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe831075700 1 -- 172.21.15.26:0/3484371178 >> v1:172.21.15.26:6789/0 conn(0x7fe82c1599d0 legacy=0x7fe82c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe831075700 1 -- 172.21.15.26:0/3484371178 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c156c70 con 0x7fe82c155f30 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.725+0000 7fe831075700 1 --2- 172.21.15.26:0/3484371178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 0x7fe82c156380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe820009910 tx=0x7fe8200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af8d07f769dab54e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011630 con 0x7fe82c155f30 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820011790 con 0x7fe82c155f30 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe830874700 1 -- 172.21.15.26:0/3484371178 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011b30 con 0x7fe82c155f30 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 -- 172.21.15.26:0/3484371178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 msgr2=0x7fe82c156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 --2- 172.21.15.26:0/3484371178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 0x7fe82c156380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe820009910 tx=0x7fe8200091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 -- 172.21.15.26:0/3484371178 shutdown_connections 2023-10-09T11:41:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 --2- 172.21.15.26:0/3484371178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155f30 0x7fe82c156380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 -- 172.21.15.26:0/3484371178 >> 172.21.15.26:0/3484371178 conn(0x7fe82c06d170 msgr2=0x7fe82c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 -- 172.21.15.26:0/3484371178 shutdown_connections 2023-10-09T11:41:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.726+0000 7fe833ada700 1 -- 172.21.15.26:0/3484371178 wait complete. 2023-10-09T11:41:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.727+0000 7fe833ada700 1 Processor -- start 2023-10-09T11:41:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.727+0000 7fe833ada700 1 -- start start 2023-10-09T11:41:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155b60 0x7fe82c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe82c155f30 0x7fe82c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0c9d50 con 0x7fe82c1599d0 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0c9140 con 0x7fe82c155f30 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe833ada700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0c9420 con 0x7fe82c155b60 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45220/0 (socket says 172.21.15.26:45220) 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 -- 172.21.15.26:0/3339197271 learned_addr learned my addr 172.21.15.26:0/3339197271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe831876700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155b60 0x7fe82c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe831075700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe82c155f30 0x7fe82c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 -- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155b60 msgr2=0x7fe82c147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155b60 0x7fe82c147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 -- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe82c155f30 msgr2=0x7fe82c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.728+0000 7fe832077700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe82c155f30 0x7fe82c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe832077700 1 -- 172.21.15.26:0/3339197271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009420 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe832077700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00cc20 tx=0x7fe81c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00a850 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00a9d0 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c0c9700 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00ad90 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.729+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c0c8d80 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.730+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c158940 con 0x7fe82c1599d0 2023-10-09T11:41:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.731+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe81c007300 con 0x7fe82c1599d0 2023-10-09T11:41:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.731+0000 7fe829ffb700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 0x7fe818069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.731+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe81c084ef0 con 0x7fe82c1599d0 2023-10-09T11:41:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.731+0000 7fe831876700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 0x7fe818069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.732+0000 7fe831876700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 0x7fe818069740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe824007fd0 tx=0x7fe824007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.735+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe81c051c50 con 0x7fe82c1599d0 2023-10-09T11:41:44.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.927+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe82c04c3c0 con 0x7fe82c1599d0 2023-10-09T11:41:44.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.928+0000 7fe829ffb700 1 -- 172.21.15.26:0/3339197271 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe81c055270 con 0x7fe82c1599d0 2023-10-09T11:41:44.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 msgr2=0x7fe818069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 0x7fe818069740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe824007fd0 tx=0x7fe824007d50 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 msgr2=0x7fe82c153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00cc20 tx=0x7fe81c001a40 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 shutdown_connections 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe82c1599d0 0x7fe82c153be0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe818067290 0x7fe818069740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe82c155b60 0x7fe82c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 --2- 172.21.15.26:0/3339197271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe82c155f30 0x7fe82c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 >> 172.21.15.26:0/3339197271 conn(0x7fe82c06d170 msgr2=0x7fe82c0cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 shutdown_connections 2023-10-09T11:41:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:44.930+0000 7fe833ada700 1 -- 172.21.15.26:0/3339197271 wait complete. 2023-10-09T11:41:44.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T11:41:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.063+0000 7f69d6d4b700 1 Processor -- start 2023-10-09T11:41:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.063+0000 7f69d6d4b700 1 -- start start 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d6d4b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d6d4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69d00cea00 0x7f69d00cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d6d4b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d015ac50 con 0x7f69d0153a00 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d6d4b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d015d010 con 0x7f69d00cea00 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d6d4b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d015af60 con 0x7f69d0153dd0 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d5d49700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69d0153a00 0x7f69d015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59786/0 (socket says 172.21.15.26:59786) 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d5d49700 1 -- 172.21.15.26:0/3772448278 learned_addr learned my addr 172.21.15.26:0/3772448278 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d654a700 1 --2- 172.21.15.26:0/3772448278 >> v2:172.21.15.26:3300/0 conn(0x7f69d00cea00 0x7f69d00cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d5548700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d4d47700 1 -- 172.21.15.26:0/3772448278 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967769195 0 0) 0x7f69d015ac50 con 0x7f69d0153a00 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d4d47700 1 -- 172.21.15.26:0/3772448278 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b8003570 con 0x7f69d0153a00 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d654a700 1 -- 172.21.15.26:0/3772448278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 msgr2=0x7f69d015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d654a700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d654a700 1 -- 172.21.15.26:0/3772448278 >> v1:172.21.15.26:6789/0 conn(0x7f69d0153a00 legacy=0x7f69d015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.064+0000 7f69d654a700 1 -- 172.21.15.26:0/3772448278 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d015b240 con 0x7f69d00cea00 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d654a700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00cee60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009e90 tx=0x7f69c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d847bf463ba1cc38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d4d47700 1 -- 172.21.15.26:0/3772448278 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c000e070 con 0x7f69d00cea00 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d4d47700 1 -- 172.21.15.26:0/3772448278 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c000bb40 con 0x7f69d00cea00 2023-10-09T11:41:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d4d47700 1 -- 172.21.15.26:0/3772448278 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0012430 con 0x7f69d00cea00 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 -- 172.21.15.26:0/3772448278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 msgr2=0x7f69d00cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00cee60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009e90 tx=0x7f69c0009780 comp rx=0 tx=0).stop 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 -- 172.21.15.26:0/3772448278 shutdown_connections 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00cee60 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/3772448278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 -- 172.21.15.26:0/3772448278 >> 172.21.15.26:0/3772448278 conn(0x7f69d00703a0 msgr2=0x7f69d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 -- 172.21.15.26:0/3772448278 shutdown_connections 2023-10-09T11:41:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.065+0000 7f69d6d4b700 1 -- 172.21.15.26:0/3772448278 wait complete. 2023-10-09T11:41:45.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.066+0000 7f69d6d4b700 1 Processor -- start 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 -- start start 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69d0153a00 0x7f69d0158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d0158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00ca140 con 0x7f69d00cea00 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00ccf20 con 0x7f69d0153a00 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d6d4b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00c9530 con 0x7f69d0153dd0 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d5d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d5d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45248/0 (socket says 172.21.15.26:45248) 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d5d49700 1 -- 172.21.15.26:0/2733856268 learned_addr learned my addr 172.21.15.26:0/2733856268 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d5548700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69d0153a00 0x7f69d0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.067+0000 7f69d654a700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d0158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 -- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 msgr2=0x7f69d0158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d0158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 -- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69d0153a00 msgr2=0x7f69d0158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69d0153a00 0x7f69d0158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 -- 172.21.15.26:0/2733856268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0009a20 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d5d49700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f69c800c7c0 tx=0x7f69c8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8005b30 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8005c90 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d00c9810 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8007320 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.068+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d00c9dd0 con 0x7f69d00cea00 2023-10-09T11:41:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.069+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d004c3c0 con 0x7f69d00cea00 2023-10-09T11:41:45.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.070+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f69c801b3b0 con 0x7f69d00cea00 2023-10-09T11:41:45.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.070+0000 7f69cdffb700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 0x7f69bc069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.070+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69c8083fc0 con 0x7f69d00cea00 2023-10-09T11:41:45.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.070+0000 7f69d5548700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 0x7f69bc069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.071+0000 7f69d5548700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 0x7f69bc069770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f69d00b64b0 tx=0x7f69c40091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.074+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69c8050e20 con 0x7f69d00cea00 2023-10-09T11:41:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.301+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d00ca280 con 0x7f69bc0672c0 2023-10-09T11:41:45.307 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:45.306+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:45.307 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:45.306+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:45.307 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:45.306+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:45.307 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:45.306+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:45.307 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:41:45.306+0000 7f48c13c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:41:45.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.313+0000 7f69cdffb700 1 -- 172.21.15.26:0/2733856268 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+470 (secure 0 0 0) 0x7f69c4011a20 con 0x7f69bc0672c0 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "mon_addrs": [ 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6789", 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6789", 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.67:6790" 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": { 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: "data": [ 2023-10-09T11:41:45.314 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365977796608, 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_data", 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 0 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": [ 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "avail": 365977796608, 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs_metadata", 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: "used": 65536 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:45.315 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:41:45.316 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:45.316 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 msgr2=0x7f69bc069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 0x7f69bc069770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f69d00b64b0 tx=0x7f69c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 msgr2=0x7f69d00c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f69c800c7c0 tx=0x7f69c8007e00 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 shutdown_connections 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f69bc0672c0 0x7f69bc069770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69d0153dd0 0x7f69d0158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69d00cea00 0x7f69d00c75e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 --2- 172.21.15.26:0/2733856268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69d0153a00 0x7f69d0158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 >> 172.21.15.26:0/2733856268 conn(0x7f69d00703a0 msgr2=0x7f69d015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 shutdown_connections 2023-10-09T11:41:45.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.315+0000 7f69d6d4b700 1 -- 172.21.15.26:0/2733856268 wait complete. 2023-10-09T11:41:45.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:45.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:45.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:45.406 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:45.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:41:45.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:45.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:45.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:41:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:45.445 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:41:45.501 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:41:45.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:45.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:45.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:41:45.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:45.549 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:41:45.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:45.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 Processor -- start 2023-10-09T11:41:45.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 -- start start 2023-10-09T11:41:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2f4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f415ae40 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f415ab60 con 0x7fe2f40cb970 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.742+0000 7fe2fa2c7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ce0f0 con 0x7fe2f415a5d0 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe2f40cb5a0 0x7fe2f40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59798/0 (socket says 172.21.15.26:59798) 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f3fff700 1 -- 172.21.15.26:0/3357649050 learned_addr learned my addr 172.21.15.26:0/3357649050 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198588230 0 0) 0x7fe2f415ae40 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f8864700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2f4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc003570 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385995531 0 0) 0x7fe2dc003570 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 msgr2=0x7fe2f4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2f4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 >> v1:172.21.15.67:6789/0 conn(0x7fe2f40cb970 legacy=0x7fe2f4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40ccf00 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fe2e4001470 con 0x7fe2f40cb5a0 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 >> v1:172.21.15.26:6789/0 conn(0x7fe2f40cb5a0 legacy=0x7fe2f40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2dc003a90 0x7fe2dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ce0f0 con 0x7fe2dc003a90 2023-10-09T11:41:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00bb70 con 0x7fe2dc004d50 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00bd30 con 0x7fe2f415a5d0 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2dc003a90 0x7fe2dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f8864700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.743+0000 7fe2f37fe700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 -- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 msgr2=0x7fe2dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f415a5d0 0x7fe2dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 -- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc004d50 msgr2=0x7fe2dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 -- 172.21.15.26:0/3357649050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc003570 con 0x7fe2dc003a90 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2dc003a90 0x7fe2dc003ea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400c3c0 tx=0x7fe2e4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbc335a26b0f779 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400cc90 con 0x7fe2dc003a90 2023-10-09T11:41:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e400cdf0 con 0x7fe2dc003a90 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f2ffd700 1 -- 172.21.15.26:0/3357649050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4005b50 con 0x7fe2dc003a90 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/3357649050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2dc003a90 msgr2=0x7fe2dc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/3357649050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2dc003a90 0x7fe2dc003ea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400c3c0 tx=0x7fe2e4001e50 comp rx=0 tx=0).stop 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2f8864700 1 -- 172.21.15.26:0/3357649050 reap_dead start 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/3357649050 shutdown_connections 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.744+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/3357649050 >> 172.21.15.26:0/3357649050 conn(0x7fe2f4070e30 msgr2=0x7fe2f40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.745+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/3357649050 shutdown_connections 2023-10-09T11:41:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.745+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/3357649050 wait complete. 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 Processor -- start 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 -- start start 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc003a90 0x7fe2f40b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f4153110 0x7fe2f4153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415b070 con 0x7fe2f41698e0 2023-10-09T11:41:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4151330 con 0x7fe2dc003a90 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.746+0000 7fe2fa2c7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4153ac0 con 0x7fe2f4153110 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45258/0 (socket says 172.21.15.26:45258) 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 -- 172.21.15.26:0/4099583653 learned_addr learned my addr 172.21.15.26:0/4099583653 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc003a90 0x7fe2f40b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f8864700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f4153110 0x7fe2f4153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 -- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f4153110 msgr2=0x7fe2f4153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f4153110 0x7fe2f4153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 -- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc003a90 msgr2=0x7fe2f40b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc003a90 0x7fe2f40b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 -- 172.21.15.26:0/4099583653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4151760 con 0x7fe2f41698e0 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2f37fe700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002900 tx=0x7fe2e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8013600 con 0x7fe2f41698e0 2023-10-09T11:41:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8013760 con 0x7fe2f41698e0 2023-10-09T11:41:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f4169e30 con 0x7fe2f41698e0 2023-10-09T11:41:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8013b00 con 0x7fe2f41698e0 2023-10-09T11:41:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.747+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f416a3f0 con 0x7fe2f41698e0 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.748+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f415b220 con 0x7fe2f41698e0 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.749+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe2e801c400 con 0x7fe2f41698e0 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.749+0000 7fe2dbfff700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 0x7fe2e0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.749+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e8084db0 con 0x7fe2f41698e0 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.749+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 0x7fe2e0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.750+0000 7fe2f3fff700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 0x7fe2e0069740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007cd0 tx=0x7fe2e4015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.754+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2f415b220 con 0x7fe2f41698e0 2023-10-09T11:41:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.992+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2f415b220 con 0x7fe2f41698e0 2023-10-09T11:41:45.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.993+0000 7fe2dbfff700 1 -- 172.21.15.26:0/4099583653 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe2f415b220 con 0x7fe2f41698e0 2023-10-09T11:41:45.994 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:45.994 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:45.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 msgr2=0x7fe2e0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 0x7fe2e0069740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007cd0 tx=0x7fe2e4015000 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 msgr2=0x7fe2f4150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002900 tx=0x7fe2e8007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 shutdown_connections 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe2e0067290 0x7fe2e0069740 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe2f4153110 0x7fe2f4153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2dc003a90 0x7fe2f40b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 --2- 172.21.15.26:0/4099583653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f41698e0 0x7fe2f4150df0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 >> 172.21.15.26:0/4099583653 conn(0x7fe2f4070e30 msgr2=0x7fe2f40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 shutdown_connections 2023-10-09T11:41:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:45.995+0000 7fe2fa2c7700 1 -- 172.21.15.26:0/4099583653 wait complete. 2023-10-09T11:41:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 68 2023-10-09T11:41:46.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:46.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 Processor -- start 2023-10-09T11:41:46.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 -- start start 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 0x7f8d740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7415ae40 con 0x7f8d740cd9e0 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7415ab60 con 0x7f8d740cde50 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.130+0000 7f8d79abe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740d13f0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d72ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d740cd9e0 0x7f8d74159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59806/0 (socket says 172.21.15.26:59806) 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d72ffd700 1 -- 172.21.15.26:0/4152728820 learned_addr learned my addr 172.21.15.26:0/4152728820 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d737fe700 1 --2- 172.21.15.26:0/4152728820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 0x7f8d740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249130045 0 0) 0x7f8d7415ae40 con 0x7f8d740cd9e0 2023-10-09T11:41:46.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d60003570 con 0x7f8d740cd9e0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237667440 0 0) 0x7f8d7415ab60 con 0x7f8d740cde50 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7415ae40 con 0x7f8d740cde50 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d737fe700 1 -- 172.21.15.26:0/4152728820 >> v1:172.21.15.67:6789/0 conn(0x7f8d740cde50 legacy=0x7f8d74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d737fe700 1 -- 172.21.15.26:0/4152728820 >> v1:172.21.15.26:6789/0 conn(0x7f8d740cd9e0 legacy=0x7f8d74159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d737fe700 1 -- 172.21.15.26:0/4152728820 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740ccf00 con 0x7f8d740cb5a0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d737fe700 1 --2- 172.21.15.26:0/4152728820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 0x7f8d740cb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009e90 tx=0x7f8d64009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fdeb7a22e599ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.131+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400e070 con 0x7f8d740cb5a0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400bb80 con 0x7f8d740cb5a0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d727fc700 1 -- 172.21.15.26:0/4152728820 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64012430 con 0x7f8d740cb5a0 2023-10-09T11:41:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 -- 172.21.15.26:0/4152728820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 msgr2=0x7f8d740cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4152728820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 0x7f8d740cb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009e90 tx=0x7f8d64009780 comp rx=0 tx=0).stop 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 -- 172.21.15.26:0/4152728820 shutdown_connections 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4152728820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d740cb5a0 0x7f8d740cb970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 -- 172.21.15.26:0/4152728820 >> 172.21.15.26:0/4152728820 conn(0x7f8d74070e30 msgr2=0x7f8d740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 -- 172.21.15.26:0/4152728820 shutdown_connections 2023-10-09T11:41:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.132+0000 7f8d79abe700 1 -- 172.21.15.26:0/4152728820 wait complete. 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.133+0000 7f8d79abe700 1 Processor -- start 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.133+0000 7f8d79abe700 1 -- start start 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d740cd9e0 0x7f8d7415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d7415a6f0 0x7f8d74155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74169d30 con 0x7f8d740cb5a0 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415c520 con 0x7f8d740cd9e0 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d79abe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415c800 con 0x7f8d7415a6f0 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45266/0 (socket says 172.21.15.26:45266) 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 -- 172.21.15.26:0/4893804 learned_addr learned my addr 172.21.15.26:0/4893804 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d72ffd700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d740cd9e0 0x7f8d7415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d73fff700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d7415a6f0 0x7f8d74155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 -- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d7415a6f0 msgr2=0x7f8d74155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d7415a6f0 0x7f8d74155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 -- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d740cd9e0 msgr2=0x7f8d7415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d740cd9e0 0x7f8d7415ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.134+0000 7f8d737fe700 1 -- 172.21.15.26:0/4893804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009a20 con 0x7f8d740cb5a0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d737fe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097c0 tx=0x7f8d64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400be40 con 0x7f8d740cb5a0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64027470 con 0x7f8d740cb5a0 2023-10-09T11:41:46.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7415cae0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64027830 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.135+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d740c92e0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.136+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7404c3c0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.136+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f8d64024070 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.137+0000 7f8d6b7fe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 0x7f8d54069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.137+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d64087090 con 0x7f8d740cb5a0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.137+0000 7f8d72ffd700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 0x7f8d54069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.137+0000 7f8d72ffd700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 0x7f8d54069740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8d740c8a10 tx=0x7f8d5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.141+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d64053ef0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.223+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8d64003040 con 0x7f8d740cb5a0 2023-10-09T11:41:46.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.339+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d740cd1e0 con 0x7f8d740cb5a0 2023-10-09T11:41:46.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.340+0000 7f8d6b7fe700 1 -- 172.21.15.26:0/4893804 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15307 (secure 0 0 0) 0x7f8d64057980 con 0x7f8d740cb5a0 2023-10-09T11:41:46.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":100,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:31.191074+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 msgr2=0x7f8d54069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 0x7f8d54069740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8d740c8a10 tx=0x7f8d5c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 msgr2=0x7f8d7415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097c0 tx=0x7f8d64019000 comp rx=0 tx=0).stop 2023-10-09T11:41:46.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 shutdown_connections 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8d54067290 0x7f8d54069740 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8d7415a6f0 0x7f8d74155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d740cb5a0 0x7f8d7415a1b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 --2- 172.21.15.26:0/4893804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d740cd9e0 0x7f8d7415ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 >> 172.21.15.26:0/4893804 conn(0x7f8d74070e30 msgr2=0x7f8d740b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 shutdown_connections 2023-10-09T11:41:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.342+0000 7f8d79abe700 1 -- 172.21.15.26:0/4893804 wait complete. 2023-10-09T11:41:46.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:28.404780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:28.983873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:46.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:46.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 Processor -- start 2023-10-09T11:41:46.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 -- start start 2023-10-09T11:41:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e1006dc70 0x7f1e10159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e1006e0e0 0x7f1e100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e100ccfd0 con 0x7f1e10159530 2023-10-09T11:41:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1015a3d0 con 0x7f1e1006e0e0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e15a37700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1015a6b0 con 0x7f1e1006dc70 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.478+0000 7f1e0effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1e10159530 0x7f1e100ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59816/0 (socket says 172.21.15.26:59816) 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0effd700 1 -- 172.21.15.26:0/1209573928 learned_addr learned my addr 172.21.15.26:0/1209573928 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 --2- 172.21.15.26:0/1209573928 >> v2:172.21.15.26:3300/0 conn(0x7f1e1006e0e0 0x7f1e100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0e7fc700 1 --2- 172.21.15.26:0/1209573928 >> v2:172.21.15.67:3300/0 conn(0x7f1e1006dc70 0x7f1e10159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 -- 172.21.15.26:0/1209573928 >> v2:172.21.15.67:3300/0 conn(0x7f1e1006dc70 msgr2=0x7f1e10159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 --2- 172.21.15.26:0/1209573928 >> v2:172.21.15.67:3300/0 conn(0x7f1e1006dc70 0x7f1e10159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 -- 172.21.15.26:0/1209573928 >> v1:172.21.15.26:6789/0 conn(0x7f1e10159530 legacy=0x7f1e100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 -- 172.21.15.26:0/1209573928 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1015a990 con 0x7f1e1006e0e0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0f7fe700 1 --2- 172.21.15.26:0/1209573928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006e0e0 0x7f1e100cb6f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b66e0 tx=0x7f1e00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387cb263a3557a26 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0dffb700 1 -- 172.21.15.26:0/1209573928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000e070 con 0x7f1e1006e0e0 2023-10-09T11:41:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0dffb700 1 -- 172.21.15.26:0/1209573928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000bb60 con 0x7f1e1006e0e0 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.479+0000 7f1e0dffb700 1 -- 172.21.15.26:0/1209573928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00012430 con 0x7f1e1006e0e0 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 -- 172.21.15.26:0/1209573928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006e0e0 msgr2=0x7f1e100cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 --2- 172.21.15.26:0/1209573928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006e0e0 0x7f1e100cb6f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b66e0 tx=0x7f1e00009780 comp rx=0 tx=0).stop 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 -- 172.21.15.26:0/1209573928 shutdown_connections 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 --2- 172.21.15.26:0/1209573928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006e0e0 0x7f1e100cb6f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 --2- 172.21.15.26:0/1209573928 >> v2:172.21.15.67:3300/0 conn(0x7f1e1006dc70 0x7f1e10159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 -- 172.21.15.26:0/1209573928 >> 172.21.15.26:0/1209573928 conn(0x7f1e100703a0 msgr2=0x7f1e100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 -- 172.21.15.26:0/1209573928 shutdown_connections 2023-10-09T11:41:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.480+0000 7f1e15a37700 1 -- 172.21.15.26:0/1209573928 wait complete. 2023-10-09T11:41:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.481+0000 7f1e15a37700 1 Processor -- start 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.481+0000 7f1e15a37700 1 -- start start 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e1006e0e0 0x7f1e10157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e10159530 0x7f1e10157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b3e40 con 0x7f1e1006dc70 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10149740 con 0x7f1e1006e0e0 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e15a37700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b4c40 con 0x7f1e10159530 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45282/0 (socket says 172.21.15.26:45282) 2023-10-09T11:41:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 -- 172.21.15.26:0/158787691 learned_addr learned my addr 172.21.15.26:0/158787691 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0e7fc700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e1006e0e0 0x7f1e10157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0f7fe700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e10159530 0x7f1e10157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 -- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e10159530 msgr2=0x7f1e10157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e10159530 0x7f1e10157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 -- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e1006e0e0 msgr2=0x7f1e10157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e1006e0e0 0x7f1e10157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.482+0000 7f1e0effd700 1 -- 172.21.15.26:0/158787691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009a20 con 0x7f1e1006dc70 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e0effd700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800c560 tx=0x7f1e08001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08005b30 con 0x7f1e1006dc70 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e08005c90 con 0x7f1e1006dc70 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e100b4030 con 0x7f1e1006dc70 2023-10-09T11:41:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08007320 con 0x7f1e1006dc70 2023-10-09T11:41:46.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.483+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100b45f0 con 0x7f1e1006dc70 2023-10-09T11:41:46.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.484+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1004c3c0 con 0x7f1e1006dc70 2023-10-09T11:41:46.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.484+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e08007690 con 0x7f1e1006dc70 2023-10-09T11:41:46.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.485+0000 7f1e06ffd700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 0x7f1df00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.485+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e080840b0 con 0x7f1e1006dc70 2023-10-09T11:41:46.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.485+0000 7f1e0e7fc700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 0x7f1df00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.485+0000 7f1e0e7fc700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 0x7f1df00697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1e100c7a90 tx=0x7f1df80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.489+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e080b55a0 con 0x7f1e1006dc70 2023-10-09T11:41:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.680+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e1015aca0 con 0x7f1e1006dc70 2023-10-09T11:41:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.681+0000 7f1e06ffd700 1 -- 172.21.15.26:0/158787691 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e080170a0 con 0x7f1e1006dc70 2023-10-09T11:41:46.681 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:41:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 msgr2=0x7f1df00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 0x7f1df00697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1e100c7a90 tx=0x7f1df80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 msgr2=0x7f1e10149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800c560 tx=0x7f1e08001020 comp rx=0 tx=0).stop 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 shutdown_connections 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1df0067320 0x7f1df00697d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e10159530 0x7f1e10157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e1006dc70 0x7f1e10149200 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 --2- 172.21.15.26:0/158787691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e1006e0e0 0x7f1e10157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 >> 172.21.15.26:0/158787691 conn(0x7f1e100703a0 msgr2=0x7f1e10153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 shutdown_connections 2023-10-09T11:41:46.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.683+0000 7f1e15a37700 1 -- 172.21.15.26:0/158787691 wait complete. 2023-10-09T11:41:46.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:46.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 Processor -- start 2023-10-09T11:41:46.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 -- start start 2023-10-09T11:41:46.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f063c159530 0x7f063c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c06dc70 0x7f063c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c06e0e0 0x7f063c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0ccfd0 con 0x7f063c06e0e0 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0cf0e0 con 0x7f063c159530 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.818+0000 7f0641ce6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15a3d0 con 0x7f063c06dc70 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c06e0e0 0x7f063c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c06e0e0 0x7f063c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45294/0 (socket says 172.21.15.26:45294) 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 -- 172.21.15.26:0/1675859899 learned_addr learned my addr 172.21.15.26:0/1675859899 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063affd700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c06dc70 0x7f063c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063b7fe700 1 --2- 172.21.15.26:0/1675859899 >> v2:172.21.15.67:3300/0 conn(0x7f063c159530 0x7f063c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 -- 172.21.15.26:0/1675859899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c06dc70 msgr2=0x7f063c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c06dc70 0x7f063c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 -- 172.21.15.26:0/1675859899 >> v2:172.21.15.67:3300/0 conn(0x7f063c159530 msgr2=0x7f063c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 --2- 172.21.15.26:0/1675859899 >> v2:172.21.15.67:3300/0 conn(0x7f063c159530 0x7f063c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 -- 172.21.15.26:0/1675859899 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c15a6b0 con 0x7f063c06e0e0 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063bfff700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0cb6f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f063c06d630 tx=0x7f0634009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a33802a0d7938ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063a7fc700 1 -- 172.21.15.26:0/1675859899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400e070 con 0x7f063c06e0e0 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063a7fc700 1 -- 172.21.15.26:0/1675859899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400ba50 con 0x7f063c06e0e0 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.819+0000 7f063a7fc700 1 -- 172.21.15.26:0/1675859899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340092e0 con 0x7f063c06e0e0 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 -- 172.21.15.26:0/1675859899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 msgr2=0x7f063c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0cb6f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f063c06d630 tx=0x7f0634009840 comp rx=0 tx=0).stop 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 -- 172.21.15.26:0/1675859899 shutdown_connections 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1675859899 >> v2:172.21.15.67:3300/0 conn(0x7f063c159530 0x7f063c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0cb6f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1675859899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c06dc70 0x7f063c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 -- 172.21.15.26:0/1675859899 >> 172.21.15.26:0/1675859899 conn(0x7f063c0703a0 msgr2=0x7f063c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 -- 172.21.15.26:0/1675859899 shutdown_connections 2023-10-09T11:41:46.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.820+0000 7f0641ce6700 1 -- 172.21.15.26:0/1675859899 wait complete. 2023-10-09T11:41:46.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.821+0000 7f0641ce6700 1 Processor -- start 2023-10-09T11:41:46.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.821+0000 7f0641ce6700 1 -- start start 2023-10-09T11:41:46.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06dc70 0x7f063c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c159530 0x7f063c0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b63f0 con 0x7f063c06e0e0 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b4000 con 0x7f063c06dc70 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f0641ce6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b4880 con 0x7f063c159530 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45310/0 (socket says 172.21.15.26:45310) 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 -- 172.21.15.26:0/1296115928 learned_addr learned my addr 172.21.15.26:0/1296115928 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063b7fe700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06dc70 0x7f063c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063bfff700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c159530 0x7f063c0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 -- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c159530 msgr2=0x7f063c0b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c159530 0x7f063c0b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 -- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06dc70 msgr2=0x7f063c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06dc70 0x7f063c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 -- 172.21.15.26:0/1296115928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009ae0 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.822+0000 7f063affd700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f063000d890 tx=0x7f0630008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000b600 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000b760 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0b6110 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000bae0 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0b4510 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.823+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c04c3c0 con 0x7f063c06e0e0 2023-10-09T11:41:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.824+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f063001e460 con 0x7f063c06e0e0 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.824+0000 7f06237fe700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 0x7f06280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.824+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0630085370 con 0x7f063c06e0e0 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.825+0000 7f063b7fe700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 0x7f06280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.825+0000 7f063b7fe700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 0x7f06280697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:46.829+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0630051fc0 con 0x7f063c06e0e0 2023-10-09T11:41:47.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.020+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f063c0b49c0 con 0x7f063c06e0e0 2023-10-09T11:41:47.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.020+0000 7f06237fe700 1 -- 172.21.15.26:0/1296115928 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06300555e0 con 0x7f063c06e0e0 2023-10-09T11:41:47.021 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:41:47.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 msgr2=0x7f06280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 0x7f06280697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:47.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 msgr2=0x7f063c0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f063000d890 tx=0x7f0630008040 comp rx=0 tx=0).stop 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 shutdown_connections 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0628067320 0x7f06280697d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c159530 0x7f063c0b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06dc70 0x7f063c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 --2- 172.21.15.26:0/1296115928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c06e0e0 0x7f063c0b57e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 >> 172.21.15.26:0/1296115928 conn(0x7f063c0703a0 msgr2=0x7f063c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 shutdown_connections 2023-10-09T11:41:47.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.023+0000 7f0641ce6700 1 -- 172.21.15.26:0/1296115928 wait complete. 2023-10-09T11:41:47.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.157+0000 7f5c33c6f700 1 Processor -- start 2023-10-09T11:41:47.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.157+0000 7f5c33c6f700 1 -- start start 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c33c6f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c2c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c33c6f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5c2c06e0e0 0x7f5c2c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c33c6f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0ccfd0 con 0x7f5c2c159530 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c33c6f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c15a3d0 con 0x7f5c2c06e0e0 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c33c6f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c15a6b0 con 0x7f5c2c06dc70 2023-10-09T11:41:47.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c31a0b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5c2c159530 0x7f5c2c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59818/0 (socket says 172.21.15.26:59818) 2023-10-09T11:41:47.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c31a0b700 1 -- 172.21.15.26:0/3679607026 learned_addr learned my addr 172.21.15.26:0/3679607026 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c3120a700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c2c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c3220c700 1 --2- 172.21.15.26:0/3679607026 >> v2:172.21.15.67:3300/0 conn(0x7f5c2c06e0e0 0x7f5c2c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779693099 0 0) 0x7f5c2c0ccfd0 con 0x7f5c2c159530 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c14003570 con 0x7f5c2c159530 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321309633 0 0) 0x7f5c14003570 con 0x7f5c2c159530 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 msgr2=0x7f5c2c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c2c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 >> v2:172.21.15.67:3300/0 conn(0x7f5c2c06e0e0 msgr2=0x7f5c2c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 --2- 172.21.15.26:0/3679607026 >> v2:172.21.15.67:3300/0 conn(0x7f5c2c06e0e0 0x7f5c2c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c15a990 con 0x7f5c2c159530 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.158+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f5c240017f0 con 0x7f5c2c159530 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 >> v1:172.21.15.26:6789/0 conn(0x7f5c2c159530 legacy=0x7f5c2c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c14004d50 0x7f5c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c15a3d0 con 0x7f5c14003a60 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c15a6b0 con 0x7f5c14004d50 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1400ba60 con 0x7f5c2c06dc70 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c3120a700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c3220c700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c14004d50 0x7f5c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 -- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 msgr2=0x7f5c14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c06dc70 0x7f5c14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 -- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c14004d50 msgr2=0x7f5c140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c14004d50 0x7f5c140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 -- 172.21.15.26:0/3679607026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14003570 con 0x7f5c14003a60 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c14003e70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400a970 tx=0x7f5c2c0ccf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00eed76c7d7ef4e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240070d0 con 0x7f5c14003a60 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24007230 con 0x7f5c14003a60 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.159+0000 7f5c30a09700 1 -- 172.21.15.26:0/3679607026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240075f0 con 0x7f5c14003a60 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 -- 172.21.15.26:0/3679607026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 msgr2=0x7f5c14003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/3679607026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c14003e70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400a970 tx=0x7f5c2c0ccf40 comp rx=0 tx=0).stop 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c3220c700 1 -- 172.21.15.26:0/3679607026 reap_dead start 2023-10-09T11:41:47.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 -- 172.21.15.26:0/3679607026 shutdown_connections 2023-10-09T11:41:47.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 -- 172.21.15.26:0/3679607026 >> 172.21.15.26:0/3679607026 conn(0x7f5c2c0703a0 msgr2=0x7f5c2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 -- 172.21.15.26:0/3679607026 shutdown_connections 2023-10-09T11:41:47.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.160+0000 7f5c33c6f700 1 -- 172.21.15.26:0/3679607026 wait complete. 2023-10-09T11:41:47.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.161+0000 7f5c33c6f700 1 Processor -- start 2023-10-09T11:41:47.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.161+0000 7f5c33c6f700 1 -- start start 2023-10-09T11:41:47.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c0c7790 0x7f5c2c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c2c0b0a20 0x7f5c2c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0c8140 con 0x7f5c14003a60 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0b22b0 con 0x7f5c2c0b0a20 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c33c6f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c140fc0 con 0x7f5c2c0c7790 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45324/0 (socket says 172.21.15.26:45324) 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 -- 172.21.15.26:0/2453716428 learned_addr learned my addr 172.21.15.26:0/2453716428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c3120a700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c0c7790 0x7f5c2c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c3220c700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c2c0b0a20 0x7f5c2c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 -- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c0c7790 msgr2=0x7f5c2c0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c0c7790 0x7f5c2c0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 -- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c2c0b0a20 msgr2=0x7f5c2c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c2c0b0a20 0x7f5c2c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.162+0000 7f5c31a0b700 1 -- 172.21.15.26:0/2453716428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0b13d0 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c31a0b700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400afd0 tx=0x7f5c24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240075b0 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2401f440 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2401f5f0 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c0b16a0 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.163+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c0b1c60 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.164+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c04c3c0 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.164+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5c24025020 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.165+0000 7f5c29ffb700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 0x7f5c180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.165+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c24086d60 con 0x7f5c14003a60 2023-10-09T11:41:47.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.165+0000 7f5c3120a700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 0x7f5c180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.165+0000 7f5c3120a700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 0x7f5c180697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0cc200 tx=0x7f5c200091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.169+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c24053b00 con 0x7f5c14003a60 2023-10-09T11:41:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.363+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c2c15ac70 con 0x7f5c14003a60 2023-10-09T11:41:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.363+0000 7f5c29ffb700 1 -- 172.21.15.26:0/2453716428 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c24057120 con 0x7f5c14003a60 2023-10-09T11:41:47.364 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 msgr2=0x7f5c180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 0x7f5c180697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0cc200 tx=0x7f5c200091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 msgr2=0x7f5c2c140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400afd0 tx=0x7f5c24016000 comp rx=0 tx=0).stop 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 shutdown_connections 2023-10-09T11:41:47.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c2c0b0a20 0x7f5c2c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c14003a60 0x7f5c2c140a80 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5c18067320 0x7f5c180697d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 --2- 172.21.15.26:0/2453716428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c2c0c7790 0x7f5c2c0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 >> 172.21.15.26:0/2453716428 conn(0x7f5c2c0703a0 msgr2=0x7f5c2c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 shutdown_connections 2023-10-09T11:41:47.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.365+0000 7f5c33c6f700 1 -- 172.21.15.26:0/2453716428 wait complete. 2023-10-09T11:41:47.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.497+0000 7fd18aaaa700 1 Processor -- start 2023-10-09T11:41:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.497+0000 7fd18aaaa700 1 -- start start 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd18aaaa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd1840ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd18aaaa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18415a280 con 0x7fd1840cf200 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd18aaaa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18406e180 con 0x7fd1840b0ba0 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd18aaaa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18406d850 con 0x7fd1840b07d0 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd183fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd1840cf200 0x7fd18406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59820/0 (socket says 172.21.15.26:59820) 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd183fff700 1 -- 172.21.15.26:0/1513522771 learned_addr learned my addr 172.21.15.26:0/1513522771 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608974523 0 0) 0x7fd18415a280 con 0x7fd1840cf200 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd188846700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd1840ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd170003570 con 0x7fd1840cf200 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846764498 0 0) 0x7fd170003570 con 0x7fd1840cf200 2023-10-09T11:41:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 msgr2=0x7fd1840ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd1840ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 >> v1:172.21.15.67:6789/0 conn(0x7fd1840b0ba0 legacy=0x7fd18406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18406db30 con 0x7fd1840cf200 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd1740017f0 con 0x7fd1840cf200 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 >> v1:172.21.15.26:6789/0 conn(0x7fd1840cf200 legacy=0x7fd18406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd170003a90 0x7fd170003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd170004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd170004d50 0x7fd1700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18406d850 con 0x7fd170004d50 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17000bb70 con 0x7fd170003a90 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.498+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17000bd30 con 0x7fd1840b07d0 2023-10-09T11:41:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd170004d50 0x7fd1700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd188846700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd170003a90 0x7fd170003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd183fff700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd170004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 -- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 msgr2=0x7fd170004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1840b07d0 0x7fd170004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 -- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd170003a90 msgr2=0x7fd170003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd170003a90 0x7fd170003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 -- 172.21.15.26:0/1513522771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170003570 con 0x7fd170004d50 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd189047700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd170004d50 0x7fd1700051c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0018b0 tx=0x7fd17c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84203d80b107539 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012420 con 0x7fd170004d50 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c012580 con 0x7fd170004d50 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.499+0000 7fd1837fe700 1 -- 172.21.15.26:0/1513522771 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012920 con 0x7fd170004d50 2023-10-09T11:41:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1513522771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd170004d50 msgr2=0x7fd1700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1513522771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd170004d50 0x7fd1700051c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0018b0 tx=0x7fd17c007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd189047700 1 -- 172.21.15.26:0/1513522771 reap_dead start 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1513522771 shutdown_connections 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1513522771 >> 172.21.15.26:0/1513522771 conn(0x7fd18406ce80 msgr2=0x7fd1840ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1513522771 shutdown_connections 2023-10-09T11:41:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.500+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1513522771 wait complete. 2023-10-09T11:41:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.501+0000 7fd18aaaa700 1 Processor -- start 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.501+0000 7fd18aaaa700 1 -- start start 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd184156df0 0x7fd1840c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841571c0 0x7fd1840ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18416a1d0 con 0x7fd18416ce80 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1841698a0 con 0x7fd1841571c0 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd184169b80 con 0x7fd184156df0 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45340/0 (socket says 172.21.15.26:45340) 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 -- 172.21.15.26:0/1592868601 learned_addr learned my addr 172.21.15.26:0/1592868601 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd183fff700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841571c0 0x7fd1840ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd188846700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd184156df0 0x7fd1840c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 -- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd184156df0 msgr2=0x7fd1840c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd184156df0 0x7fd1840c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 -- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841571c0 msgr2=0x7fd1840ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841571c0 0x7fd1840ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 -- 172.21.15.26:0/1592868601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd184169e60 con 0x7fd18416ce80 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd189047700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd17000bb40 tx=0x7fd17c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012420 con 0x7fd18416ce80 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c001200 con 0x7fd18416ce80 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.502+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd184169570 con 0x7fd18416ce80 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.503+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012ea0 con 0x7fd18416ce80 2023-10-09T11:41:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.503+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18415f550 con 0x7fd18416ce80 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.504+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd184169ff0 con 0x7fd18416ce80 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.504+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd17c019070 con 0x7fd18416ce80 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.504+0000 7fd180ff9700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 0x7fd1640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.504+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd17c085ed0 con 0x7fd18416ce80 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.505+0000 7fd188846700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 0x7fd1640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.505+0000 7fd188846700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 0x7fd1640697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd16c006ea0 tx=0x7fd16c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.509+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd17c052b60 con 0x7fd18416ce80 2023-10-09T11:41:47.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.746+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd18404c3c0 con 0x7fd18416ce80 2023-10-09T11:41:47.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.747+0000 7fd180ff9700 1 -- 172.21.15.26:0/1592868601 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fd17c017020 con 0x7fd18416ce80 2023-10-09T11:41:47.748 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:47.748 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 msgr2=0x7fd1640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 0x7fd1640697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd16c006ea0 tx=0x7fd16c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 msgr2=0x7fd18416d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd17000bb40 tx=0x7fd17c015000 comp rx=0 tx=0).stop 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 shutdown_connections 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd18416ce80 0x7fd18416d2f0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd164067320 0x7fd1640697d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd184156df0 0x7fd1840c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 --2- 172.21.15.26:0/1592868601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841571c0 0x7fd1840ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 >> 172.21.15.26:0/1592868601 conn(0x7fd18406ce80 msgr2=0x7fd1840c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 shutdown_connections 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.749+0000 7fd18aaaa700 1 -- 172.21.15.26:0/1592868601 wait complete. 2023-10-09T11:41:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 68 2023-10-09T11:41:47.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.880+0000 7f00692e7700 1 Processor -- start 2023-10-09T11:41:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.880+0000 7f00692e7700 1 -- start start 2023-10-09T11:41:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00692e7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00692e7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00692e7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640ad9a0 con 0x7f006415b500 2023-10-09T11:41:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00692e7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640ac940 con 0x7f0064157190 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00692e7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640acbe0 con 0x7f006415b8d0 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00637fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00627fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f0062ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f006415b500 0x7f00640ceaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:55548/0 (socket says 172.21.15.26:55548) 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00627fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:44102/0 (socket says 172.21.15.26:44102) 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f0062ffd700 1 -- 172.21.15.26:0/2856525241 learned_addr learned my addr 172.21.15.26:0/2856525241 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.881+0000 7f00637fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39136/0 (socket says 172.21.15.26:39136) 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f0061ffb700 1 -- 172.21.15.26:0/2856525241 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202574771 0 0) 0x7f005c001110 con 0x7f006415b500 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f0061ffb700 1 -- 172.21.15.26:0/2856525241 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0050003570 con 0x7f006415b500 2023-10-09T11:41:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00627fc700 1 -- 172.21.15.26:0/2856525241 >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 msgr2=0x7f00641575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00627fc700 1 --2- 172.21.15.26:0/2856525241 >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00627fc700 1 -- 172.21.15.26:0/2856525241 >> v1:172.21.15.67:6789/0 conn(0x7f006415b500 legacy=0x7f00640ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00627fc700 1 -- 172.21.15.26:0/2856525241 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640acec0 con 0x7f006415b8d0 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00637fe700 1 --2- 172.21.15.26:0/2856525241 >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f00627fc700 1 --2- 172.21.15.26:0/2856525241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f004c00dd10 tx=0x7f004c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a5e768896014f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f0061ffb700 1 -- 172.21.15.26:0/2856525241 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c012070 con 0x7f006415b8d0 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f0061ffb700 1 -- 172.21.15.26:0/2856525241 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00de70 con 0x7f006415b8d0 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.882+0000 7f0061ffb700 1 -- 172.21.15.26:0/2856525241 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00fab0 con 0x7f006415b8d0 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 -- 172.21.15.26:0/2856525241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 msgr2=0x7f006415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 --2- 172.21.15.26:0/2856525241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f004c00dd10 tx=0x7f004c00d630 comp rx=0 tx=0).stop 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 -- 172.21.15.26:0/2856525241 shutdown_connections 2023-10-09T11:41:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 --2- 172.21.15.26:0/2856525241 >> v2:172.21.15.67:3300/0 conn(0x7f0064157190 0x7f00641575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 --2- 172.21.15.26:0/2856525241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f006415bd20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 -- 172.21.15.26:0/2856525241 >> 172.21.15.26:0/2856525241 conn(0x7f006406ce80 msgr2=0x7f00640ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 -- 172.21.15.26:0/2856525241 shutdown_connections 2023-10-09T11:41:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.883+0000 7f00692e7700 1 -- 172.21.15.26:0/2856525241 wait complete. 2023-10-09T11:41:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.884+0000 7f00692e7700 1 Processor -- start 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.884+0000 7f00692e7700 1 -- start start 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f006415b500 0x7f00640b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f0064144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b3220 con 0x7f0064157190 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b2610 con 0x7f006415b500 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00692e7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b28f0 con 0x7f006415b8d0 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45352/0 (socket says 172.21.15.26:45352) 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 -- 172.21.15.26:0/2135382122 learned_addr learned my addr 172.21.15.26:0/2135382122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00637fe700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f0064144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f00627fc700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f006415b500 0x7f00640b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 -- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 msgr2=0x7f0064144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f0064144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 -- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f006415b500 msgr2=0x7f00640b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f006415b500 0x7f00640b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 -- 172.21.15.26:0/2135382122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054009a20 con 0x7f0064157190 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.885+0000 7f0062ffd700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7c0 tx=0x7f005c007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.886+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c005b30 con 0x7f0064157190 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.886+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005c90 con 0x7f0064157190 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.886+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c00d8d0 con 0x7f0064157190 2023-10-09T11:41:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.886+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c007320 con 0x7f0064157190 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.886+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640b2eb0 con 0x7f0064157190 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.887+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006404c3c0 con 0x7f0064157190 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.887+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f005c01b3b0 con 0x7f0064157190 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.887+0000 7f005affd700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 0x7f0044069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.888+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f005c084000 con 0x7f0064157190 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.888+0000 7f00627fc700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 0x7f0044069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.888+0000 7f00627fc700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 0x7f0044069800 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0064156c90 tx=0x7f004c01c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:47.892+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f005c0547a0 con 0x7f0064157190 2023-10-09T11:41:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.086+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00640aeb20 con 0x7f0064157190 2023-10-09T11:41:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.087+0000 7f005affd700 1 -- 172.21.15.26:0/2135382122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15307 (secure 0 0 0) 0x7f00640aeb20 con 0x7f0064157190 2023-10-09T11:41:48.087 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:48.087 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":100,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:31.191074+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 msgr2=0x7f0044069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 0x7f0044069800 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0064156c90 tx=0x7f004c01c000 comp rx=0 tx=0).stop 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 msgr2=0x7f00640b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7c0 tx=0x7f005c007c30 comp rx=0 tx=0).stop 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 shutdown_connections 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067350 0x7f0044069800 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415b8d0 0x7f0064144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064157190 0x7f00640b1f50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 --2- 172.21.15.26:0/2135382122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f006415b500 0x7f00640b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.088+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 >> 172.21.15.26:0/2135382122 conn(0x7f006406ce80 msgr2=0x7f00641550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.089+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 shutdown_connections 2023-10-09T11:41:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.089+0000 7f00692e7700 1 -- 172.21.15.26:0/2135382122 wait complete. 2023-10-09T11:41:48.101 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:41:48.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:48.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.220+0000 7fa5ee3e7700 1 Processor -- start 2023-10-09T11:41:48.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.220+0000 7fa5ee3e7700 1 -- start start 2023-10-09T11:41:48.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ee3e7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5e80cb970 0x7fa5e8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ee3e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5e815a400 0x7fa5e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ee3e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e815ae40 con 0x7fa5e80cb5a0 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ee3e7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80ce0f0 con 0x7fa5e815a400 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ee3e7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80d13f0 con 0x7fa5e80cb970 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5e7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5e80cb5a0 0x7fa5e80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59822/0 (socket says 172.21.15.26:59822) 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5e7fff700 1 -- 172.21.15.26:0/1727163600 learned_addr learned my addr 172.21.15.26:0/1727163600 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5ec984700 1 --2- 172.21.15.26:0/1727163600 >> v2:172.21.15.26:3300/0 conn(0x7fa5e815a400 0x7fa5e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.221+0000 7fa5e77fe700 1 --2- 172.21.15.26:0/1727163600 >> v2:172.21.15.67:3300/0 conn(0x7fa5e80cb970 0x7fa5e8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5e6ffd700 1 -- 172.21.15.26:0/1727163600 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405719620 0 0) 0x7fa5e815ae40 con 0x7fa5e80cb5a0 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5ec984700 1 -- 172.21.15.26:0/1727163600 >> v2:172.21.15.67:3300/0 conn(0x7fa5e80cb970 msgr2=0x7fa5e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5ec984700 1 --2- 172.21.15.26:0/1727163600 >> v2:172.21.15.67:3300/0 conn(0x7fa5e80cb970 0x7fa5e8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5ec984700 1 -- 172.21.15.26:0/1727163600 >> v1:172.21.15.26:6789/0 conn(0x7fa5e80cb5a0 legacy=0x7fa5e80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5ec984700 1 -- 172.21.15.26:0/1727163600 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e815ab60 con 0x7fa5e815a400 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5ec984700 1 --2- 172.21.15.26:0/1727163600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e815a400 0x7fa5e8156e90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80d1780 tx=0x7fa5e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f434ae450c6b7b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5e6ffd700 1 -- 172.21.15.26:0/1727163600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000e070 con 0x7fa5e815a400 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5e6ffd700 1 -- 172.21.15.26:0/1727163600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000bb60 con 0x7fa5e815a400 2023-10-09T11:41:48.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.222+0000 7fa5e6ffd700 1 -- 172.21.15.26:0/1727163600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0012430 con 0x7fa5e815a400 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/1727163600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e815a400 msgr2=0x7fa5e8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/1727163600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e815a400 0x7fa5e8156e90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80d1780 tx=0x7fa5e0009780 comp rx=0 tx=0).stop 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/1727163600 shutdown_connections 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/1727163600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e815a400 0x7fa5e8156e90 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/1727163600 >> v2:172.21.15.67:3300/0 conn(0x7fa5e80cb970 0x7fa5e8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/1727163600 >> 172.21.15.26:0/1727163600 conn(0x7fa5e8070e30 msgr2=0x7fa5e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/1727163600 shutdown_connections 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.223+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/1727163600 wait complete. 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.224+0000 7fa5ee3e7700 1 Processor -- start 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.224+0000 7fa5ee3e7700 1 -- start start 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5e80cb5a0 0x7fa5e81512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 0x7fa5e80cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80c91d0 con 0x7fa5e80cb970 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80b4c50 con 0x7fa5e815a400 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ee3e7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80b4970 con 0x7fa5e80cb5a0 2023-10-09T11:41:48.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45370/0 (socket says 172.21.15.26:45370) 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 -- 172.21.15.26:0/2040802775 learned_addr learned my addr 172.21.15.26:0/2040802775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ec984700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 0x7fa5e80cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e7fff700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5e80cb5a0 0x7fa5e81512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 -- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5e80cb5a0 msgr2=0x7fa5e81512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5e80cb5a0 0x7fa5e81512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 -- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 msgr2=0x7fa5e80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 0x7fa5e80cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 -- 172.21.15.26:0/2040802775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009a20 con 0x7fa5e80cb970 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5ec984700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 0x7fa5e80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.225+0000 7fa5e77fe700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ec80 tx=0x7fa5d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.226+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800c9d0 con 0x7fa5e80cb970 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.226+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d800cb30 con 0x7fa5e80cb970 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.226+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e80c8b80 con 0x7fa5e80cb970 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.226+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8013470 con 0x7fa5e80cb970 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.226+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e81517f0 con 0x7fa5e80cb970 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.227+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e804c3c0 con 0x7fa5e80cb970 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.227+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa5d8013820 con 0x7fa5e80cb970 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.227+0000 7fa5dffff700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 0x7fa5c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.228+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5d8085060 con 0x7fa5e80cb970 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.228+0000 7fa5e7fff700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 0x7fa5c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.228+0000 7fa5e7fff700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 0x7fa5c80697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0007fd0 tx=0x7fa5d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.232+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5d8051cf0 con 0x7fa5e80cb970 2023-10-09T11:41:48.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.468+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5e80c9310 con 0x7fa5e80cb970 2023-10-09T11:41:48.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.468+0000 7fa5dffff700 1 -- 172.21.15.26:0/2040802775 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa5d8055310 con 0x7fa5e80cb970 2023-10-09T11:41:48.469 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:48.469 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:48.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 msgr2=0x7fa5c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 0x7fa5c80697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0007fd0 tx=0x7fa5d0009040 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 msgr2=0x7fa5e80cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ec80 tx=0x7fa5d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 shutdown_connections 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5e815a400 0x7fa5e80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5c8067320 0x7fa5c80697d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5e80cb5a0 0x7fa5e81512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 --2- 172.21.15.26:0/2040802775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e80cb970 0x7fa5e80cf200 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 >> 172.21.15.26:0/2040802775 conn(0x7fa5e8070e30 msgr2=0x7fa5e81547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 shutdown_connections 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.471+0000 7fa5ee3e7700 1 -- 172.21.15.26:0/2040802775 wait complete. 2023-10-09T11:41:48.473 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 68 2023-10-09T11:41:48.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.602+0000 7fb191ab2700 1 Processor -- start 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.602+0000 7fb191ab2700 1 -- start start 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb191ab2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb18c0b07d0 0x7fb18c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb191ab2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb18c0b0ba0 0x7fb18c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb191ab2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c15a280 con 0x7fb18c0cf200 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb191ab2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c06e180 con 0x7fb18c0b07d0 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb191ab2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c06d850 con 0x7fb18c0b0ba0 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb18c0b07d0 0x7fb18c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb18c0b07d0 0x7fb18c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45378/0 (socket says 172.21.15.26:45378) 2023-10-09T11:41:48.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 -- 172.21.15.26:0/3931599617 learned_addr learned my addr 172.21.15.26:0/3931599617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18affd700 1 --1- 172.21.15.26:0/3931599617 >> v1:172.21.15.26:6789/0 conn(0x7fb18c0cf200 0x7fb18c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59830/0 (socket says 172.21.15.26:59830) 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 -- 172.21.15.26:0/3931599617 >> v2:172.21.15.67:3300/0 conn(0x7fb18c0b0ba0 msgr2=0x7fb18c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 --2- 172.21.15.26:0/3931599617 >> v2:172.21.15.67:3300/0 conn(0x7fb18c0b0ba0 0x7fb18c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 -- 172.21.15.26:0/3931599617 >> v1:172.21.15.26:6789/0 conn(0x7fb18c0cf200 legacy=0x7fb18c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 -- 172.21.15.26:0/3931599617 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c06db30 con 0x7fb18c0b07d0 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.603+0000 7fb18b7fe700 1 --2- 172.21.15.26:0/3931599617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c0ccac0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0637a0 tx=0x7fb17c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f297d73a530af163 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb18a7fc700 1 -- 172.21.15.26:0/3931599617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c005c10 con 0x7fb18c0b07d0 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb18a7fc700 1 -- 172.21.15.26:0/3931599617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c005d70 con 0x7fb18c0b07d0 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb18a7fc700 1 -- 172.21.15.26:0/3931599617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00b880 con 0x7fb18c0b07d0 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 -- 172.21.15.26:0/3931599617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 msgr2=0x7fb18c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 --2- 172.21.15.26:0/3931599617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c0ccac0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0637a0 tx=0x7fb17c009220 comp rx=0 tx=0).stop 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 -- 172.21.15.26:0/3931599617 shutdown_connections 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 --2- 172.21.15.26:0/3931599617 >> v2:172.21.15.67:3300/0 conn(0x7fb18c0b0ba0 0x7fb18c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 --2- 172.21.15.26:0/3931599617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c0ccac0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 -- 172.21.15.26:0/3931599617 >> 172.21.15.26:0/3931599617 conn(0x7fb18c06ce80 msgr2=0x7fb18c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 -- 172.21.15.26:0/3931599617 shutdown_connections 2023-10-09T11:41:48.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.604+0000 7fb191ab2700 1 -- 172.21.15.26:0/3931599617 wait complete. 2023-10-09T11:41:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.605+0000 7fb191ab2700 1 Processor -- start 2023-10-09T11:41:48.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.605+0000 7fb191ab2700 1 -- start start 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb18c0b0ba0 0x7fb18c16a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb18c0cf200 0x7fb18c09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c16abe0 con 0x7fb18c0b07d0 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c09b920 con 0x7fb18c0b0ba0 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb191ab2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c09aa50 con 0x7fb18c0cf200 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45382/0 (socket says 172.21.15.26:45382) 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 -- 172.21.15.26:0/2315713808 learned_addr learned my addr 172.21.15.26:0/2315713808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 -- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb18c0cf200 msgr2=0x7fb18c09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb18c0cf200 0x7fb18c09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 -- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb18c0b0ba0 msgr2=0x7fb18c16a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb18c0b0ba0 0x7fb18c16a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.606+0000 7fb18b7fe700 1 -- 172.21.15.26:0/2315713808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009480 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb18b7fe700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00b3c0 tx=0x7fb17c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0118a0 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c020070 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c09ad10 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011c70 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.607+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c09b2d0 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.608+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c04c3c0 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.608+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb17c022030 con 0x7fb18c0b07d0 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.609+0000 7fb1737fe700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 0x7fb1780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.609+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb17c0865d0 con 0x7fb18c0b07d0 2023-10-09T11:41:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.609+0000 7fb18affd700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 0x7fb1780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.609+0000 7fb18affd700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 0x7fb1780697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0c8ae0 tx=0x7fb180007b30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.613+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb17c053470 con 0x7fb18c0b07d0 2023-10-09T11:41:48.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.848+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb18c06de10 con 0x7fb18c0b07d0 2023-10-09T11:41:48.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.849+0000 7fb1737fe700 1 -- 172.21.15.26:0/2315713808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb17c056a90 con 0x7fb18c0b07d0 2023-10-09T11:41:48.850 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:48.850 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:30.023422+0000","modified":"2023-10-09T11:41:33.624561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/1060084620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1060084620},{"type":"v1","addr":"172.21.15.67:6836","nonce":1060084620}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:41:48.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 msgr2=0x7fb1780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 0x7fb1780697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0c8ae0 tx=0x7fb180007b30 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 msgr2=0x7fb18c09bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00b3c0 tx=0x7fb17c016000 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 shutdown_connections 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb178067320 0x7fb1780697d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb18c0cf200 0x7fb18c09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb18c0b07d0 0x7fb18c09bdb0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 --2- 172.21.15.26:0/2315713808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb18c0b0ba0 0x7fb18c16a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 >> 172.21.15.26:0/2315713808 conn(0x7fb18c06ce80 msgr2=0x7fb18c159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 shutdown_connections 2023-10-09T11:41:48.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.851+0000 7fb191ab2700 1 -- 172.21.15.26:0/2315713808 wait complete. 2023-10-09T11:41:48.853 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 68 2023-10-09T11:41:48.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.982+0000 7f7179654700 1 Processor -- start 2023-10-09T11:41:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 -- start start 2023-10-09T11:41:48.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71740a8be0 0x7f71740a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f717406d280 0x7f71740b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740ae780 0x7f71740aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740af120 con 0x7f71740a8be0 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740ce1a0 con 0x7f717406d280 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7179654700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740cd5d0 con 0x7f71740ae780 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7172ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71740a8be0 0x7f71740a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7172ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71740a8be0 0x7f71740a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45390/0 (socket says 172.21.15.26:45390) 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.983+0000 7f7172ffd700 1 -- 172.21.15.26:0/3395273660 learned_addr learned my addr 172.21.15.26:0/3395273660 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f71737fe700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740ae780 0x7f71740aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f71727fc700 1 --2- 172.21.15.26:0/3395273660 >> v2:172.21.15.67:3300/0 conn(0x7f717406d280 0x7f71740b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 -- 172.21.15.26:0/3395273660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740ae780 msgr2=0x7f71740aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740ae780 0x7f71740aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 -- 172.21.15.26:0/3395273660 >> v2:172.21.15.67:3300/0 conn(0x7f717406d280 msgr2=0x7f71740b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 --2- 172.21.15.26:0/3395273660 >> v2:172.21.15.67:3300/0 conn(0x7f717406d280 0x7f71740b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 -- 172.21.15.26:0/3395273660 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740cd870 con 0x7f71740a8be0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7172ffd700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71740a8be0 0x7f71740a8fb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f71740b0f60 tx=0x7f7164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329f6a94359f83a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7171ffb700 1 -- 172.21.15.26:0/3395273660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e070 con 0x7f71740a8be0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7171ffb700 1 -- 172.21.15.26:0/3395273660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400bb30 con 0x7f71740a8be0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.984+0000 7f7171ffb700 1 -- 172.21.15.26:0/3395273660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640092e0 con 0x7f71740a8be0 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 -- 172.21.15.26:0/3395273660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71740a8be0 msgr2=0x7f71740a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71740a8be0 0x7f71740a8fb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f71740b0f60 tx=0x7f7164009840 comp rx=0 tx=0).stop 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 -- 172.21.15.26:0/3395273660 shutdown_connections 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740ae780 0x7f71740aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 --2- 172.21.15.26:0/3395273660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71740a8be0 0x7f71740a8fb0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 --2- 172.21.15.26:0/3395273660 >> v2:172.21.15.67:3300/0 conn(0x7f717406d280 0x7f71740b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 -- 172.21.15.26:0/3395273660 >> 172.21.15.26:0/3395273660 conn(0x7f717406ce80 msgr2=0x7f71740ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 -- 172.21.15.26:0/3395273660 shutdown_connections 2023-10-09T11:41:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.985+0000 7f7179654700 1 -- 172.21.15.26:0/3395273660 wait complete. 2023-10-09T11:41:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.986+0000 7f7179654700 1 Processor -- start 2023-10-09T11:41:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.986+0000 7f7179654700 1 -- start start 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740a8be0 0x7f7174155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71740ae780 0x7f71740980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717415b830 con 0x7f717406d280 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717415d2f0 con 0x7f71740ae780 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717415d560 con 0x7f71740a8be0 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45396/0 (socket says 172.21.15.26:45396) 2023-10-09T11:41:48.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 -- 172.21.15.26:0/4080006975 learned_addr learned my addr 172.21.15.26:0/4080006975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 -- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740a8be0 msgr2=0x7f7174155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740a8be0 0x7f7174155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 -- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71740ae780 msgr2=0x7f71740980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f71737fe700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71740ae780 0x7f71740980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71740ae780 0x7f71740980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 -- 172.21.15.26:0/4080006975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009ae0 con 0x7f717406d280 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7172ffd700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f716400b770 tx=0x7f7164018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164008c20 con 0x7f717406d280 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164008d80 con 0x7f717406d280 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717415d840 con 0x7f717406d280 2023-10-09T11:41:48.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716401d670 con 0x7f717406d280 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.987+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7174098630 con 0x7f717406d280 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.988+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717415b620 con 0x7f717406d280 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.989+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7164003040 con 0x7f717406d280 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.989+0000 7f716affd700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 0x7f71540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.989+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7164086870 con 0x7f717406d280 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.989+0000 7f71727fc700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 0x7f71540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.990+0000 7f71727fc700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 0x7f71540697d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f71740a8960 tx=0x7f715c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:48.993+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f717415b620 con 0x7f717406d280 2023-10-09T11:41:49.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.186+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f717415b620 con 0x7f717406d280 2023-10-09T11:41:49.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.187+0000 7f716affd700 1 -- 172.21.15.26:0/4080006975 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15307 (secure 0 0 0) 0x7f717415b620 con 0x7f717406d280 2023-10-09T11:41:49.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:49.188 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":100,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:31.191074+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:28.404780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:28.983873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:49.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 msgr2=0x7f71540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 0x7f71540697d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f71740a8960 tx=0x7f715c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 msgr2=0x7f717415e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f716400b770 tx=0x7f7164018000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 shutdown_connections 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71740ae780 0x7f71740980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f717406d280 0x7f717415e530 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7154067320 0x7f71540697d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 --2- 172.21.15.26:0/4080006975 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71740a8be0 0x7f7174155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 >> 172.21.15.26:0/4080006975 conn(0x7f717406ce80 msgr2=0x7f71740b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 shutdown_connections 2023-10-09T11:41:49.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.189+0000 7f7179654700 1 -- 172.21.15.26:0/4080006975 wait complete. 2023-10-09T11:41:49.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:41:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.321+0000 7f39904ae700 1 Processor -- start 2023-10-09T11:41:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.321+0000 7f39904ae700 1 -- start start 2023-10-09T11:41:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f39904ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39880b0910 0x7f39881579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f39904ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3988157510 con 0x7f3988156f50 2023-10-09T11:41:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f39904ae700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39880ae2f0 con 0x7f3988155b70 2023-10-09T11:41:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f39904ae700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880ae5d0 con 0x7f39880b0910 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39880b0910 0x7f39881579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39880b0910 0x7f39881579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45408/0 (socket says 172.21.15.26:45408) 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 -- 172.21.15.26:0/1259418600 learned_addr learned my addr 172.21.15.26:0/1259418600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 -- 172.21.15.26:0/1259418600 >> v1:172.21.15.67:6789/0 conn(0x7f3988155b70 legacy=0x7f39880b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 -- 172.21.15.26:0/1259418600 >> v1:172.21.15.26:6789/0 conn(0x7f3988156f50 legacy=0x7f3988157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 -- 172.21.15.26:0/1259418600 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880ae8b0 con 0x7f39880b0910 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398da49700 1 --2- 172.21.15.26:0/1259418600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39880b0910 0x7f39881579a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f397c0099b0 tx=0x7f397c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc670795ceee79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398d248700 1 -- 172.21.15.26:0/1259418600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00b860 con 0x7f39880b0910 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398d248700 1 -- 172.21.15.26:0/1259418600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00b9c0 con 0x7f39880b0910 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.323+0000 7f398d248700 1 -- 172.21.15.26:0/1259418600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00bd60 con 0x7f39880b0910 2023-10-09T11:41:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 -- 172.21.15.26:0/1259418600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39880b0910 msgr2=0x7f39881579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 --2- 172.21.15.26:0/1259418600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39880b0910 0x7f39881579a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f397c0099b0 tx=0x7f397c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 -- 172.21.15.26:0/1259418600 shutdown_connections 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 --2- 172.21.15.26:0/1259418600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39880b0910 0x7f39881579a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 -- 172.21.15.26:0/1259418600 >> 172.21.15.26:0/1259418600 conn(0x7f398806d170 msgr2=0x7f39880cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 -- 172.21.15.26:0/1259418600 shutdown_connections 2023-10-09T11:41:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.324+0000 7f39904ae700 1 -- 172.21.15.26:0/1259418600 wait complete. 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.325+0000 7f39904ae700 1 Processor -- start 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.325+0000 7f39904ae700 1 -- start start 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 0x7f39880a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3988156f50 0x7f3988154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398816b5d0 con 0x7f3988155b70 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398816b8b0 con 0x7f39880b0910 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f39904ae700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398816bb90 con 0x7f3988156f50 2023-10-09T11:41:49.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45416/0 (socket says 172.21.15.26:45416) 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 -- 172.21.15.26:0/1020837397 learned_addr learned my addr 172.21.15.26:0/1020837397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398e24a700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 0x7f39880a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398ea4b700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3988156f50 0x7f3988154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 -- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3988156f50 msgr2=0x7f3988154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3988156f50 0x7f3988154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 -- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 msgr2=0x7f39880a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 0x7f39880a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 -- 172.21.15.26:0/1020837397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0094f0 con 0x7f3988155b70 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398e24a700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 0x7f39880a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.326+0000 7f398da49700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f39880cd340 tx=0x7f397c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.327+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011ea0 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.327+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c01a630 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.327+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398816be70 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.327+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c01a9b0 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.327+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398816b260 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.328+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39880a8c70 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.328+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f397c02d440 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.328+0000 7f39867fc700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 0x7f39740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.328+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f397c086790 con 0x7f3988155b70 2023-10-09T11:41:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.329+0000 7f398e24a700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 0x7f39740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.329+0000 7f398e24a700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 0x7f39740697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3980007fd0 tx=0x7f3980009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.333+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39880a8c70 con 0x7f3988155b70 2023-10-09T11:41:49.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.571+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f39880a8c70 con 0x7f3988155b70 2023-10-09T11:41:49.572 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:41:49.572+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:41:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.575+0000 7f39867fc700 1 -- 172.21.15.26:0/1020837397 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39880a8c70 con 0x7f3988155b70 2023-10-09T11:41:49.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 msgr2=0x7f39740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 0x7f39740697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3980007fd0 tx=0x7f3980009040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 msgr2=0x7f3988150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f39880cd340 tx=0x7f397c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 shutdown_connections 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3974067320 0x7f39740697d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3988156f50 0x7f3988154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39880b0910 0x7f39880a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 --2- 172.21.15.26:0/1020837397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3988155b70 0x7f3988150100 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 >> 172.21.15.26:0/1020837397 conn(0x7f398806d170 msgr2=0x7f39881578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 shutdown_connections 2023-10-09T11:41:49.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.578+0000 7f39904ae700 1 -- 172.21.15.26:0/1020837397 wait complete. 2023-10-09T11:41:49.580 INFO:tasks.ceph.mds.b.smithi067.stderr: -889> 2023-10-09T11:41:35.932+0000 7fb650ea1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:49.580 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:41:49.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:41:49.601 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:41:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.711+0000 7f6a2db86700 1 Processor -- start 2023-10-09T11:41:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.711+0000 7f6a2db86700 1 -- start start 2023-10-09T11:41:49.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.712+0000 7f6a2db86700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a280ca2c0 0x7f6a280ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.712+0000 7f6a2db86700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280c32a0 con 0x7f6a280ccba0 2023-10-09T11:41:49.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.712+0000 7f6a2db86700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280c4100 con 0x7f6a28157930 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.712+0000 7f6a2db86700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a280c9730 con 0x7f6a280ca2c0 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a27fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6a280ccba0 0x7f6a280c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52318/0 (socket says 172.21.15.26:52318) 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a27fff700 1 -- 172.21.15.26:0/1899801028 learned_addr learned my addr 172.21.15.26:0/1899801028 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a26ffd700 1 --2- 172.21.15.26:0/1899801028 >> v2:172.21.15.67:3300/0 conn(0x7f6a280ca2c0 0x7f6a280ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018190045 0 0) 0x7f6a280c32a0 con 0x7f6a280ccba0 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a10003570 con 0x7f6a280ccba0 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585456914 0 0) 0x7f6a10003570 con 0x7f6a280ccba0 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 >> v2:172.21.15.67:3300/0 conn(0x7f6a280ca2c0 msgr2=0x7f6a280ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 --2- 172.21.15.26:0/1899801028 >> v2:172.21.15.67:3300/0 conn(0x7f6a280ca2c0 0x7f6a280ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 >> v1:172.21.15.67:6789/0 conn(0x7f6a28157930 legacy=0x7f6a280ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280c34f0 con 0x7f6a280ccba0 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f6a200017f0 con 0x7f6a280ccba0 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 >> v1:172.21.15.26:6789/0 conn(0x7f6a280ccba0 legacy=0x7f6a280c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a10003a60 0x7f6a10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 0x7f6a10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a100051c0 0x7f6a1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280c9730 con 0x7f6a10004810 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1000c160 con 0x7f6a100051c0 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1000c320 con 0x7f6a10003a60 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a26ffd700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 0x7f6a10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a277fe700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a10003a60 0x7f6a10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.713+0000 7f6a27fff700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a100051c0 0x7f6a1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 -- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a10003a60 msgr2=0x7f6a10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a10003a60 0x7f6a10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 -- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a100051c0 msgr2=0x7f6a1000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a100051c0 0x7f6a1000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 -- 172.21.15.26:0/1899801028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10003570 con 0x7f6a10004810 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a27fff700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a100051c0 0x7f6a1000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a27fff700 1 -- 172.21.15.26:0/1899801028 reap_dead start 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a26ffd700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 0x7f6a10004c80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009c00 tx=0x7f6a1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e68de0d74243fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00e710 con 0x7f6a10004810 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00e870 con 0x7f6a10004810 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a267fc700 1 -- 172.21.15.26:0/1899801028 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00ec30 con 0x7f6a10004810 2023-10-09T11:41:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 -- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 msgr2=0x7f6a10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 0x7f6a10004c80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009c00 tx=0x7f6a1c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 -- 172.21.15.26:0/1899801028 shutdown_connections 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 --2- 172.21.15.26:0/1899801028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a10004810 0x7f6a10004c80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 -- 172.21.15.26:0/1899801028 >> 172.21.15.26:0/1899801028 conn(0x7f6a28088000 msgr2=0x7f6a280883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.714+0000 7f6a2db86700 1 -- 172.21.15.26:0/1899801028 shutdown_connections 2023-10-09T11:41:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.715+0000 7f6a2db86700 1 -- 172.21.15.26:0/1899801028 wait complete. 2023-10-09T11:41:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.716+0000 7f6a2db86700 1 Processor -- start 2023-10-09T11:41:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.716+0000 7f6a2db86700 1 -- start start 2023-10-09T11:41:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.716+0000 7f6a2db86700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a10004810 0x7f6a280b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.716+0000 7f6a2db86700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a28153f90 0x7f6a28153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.716+0000 7f6a2db86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a2db86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280ae9c0 con 0x7f6a2815d5b0 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a2db86700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280aeca0 con 0x7f6a10004810 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a2db86700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280b34b0 con 0x7f6a28153f90 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36650/0 (socket says 172.21.15.26:36650) 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 -- 172.21.15.26:0/2866382600 learned_addr learned my addr 172.21.15.26:0/2866382600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a277fe700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a10004810 0x7f6a280b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 -- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a28153f90 msgr2=0x7f6a28153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a28153f90 0x7f6a28153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 -- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a10004810 msgr2=0x7f6a280b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a10004810 0x7f6a280b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 -- 172.21.15.26:0/2866382600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280b3790 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a27fff700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6a28063620 tx=0x7f6a20001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000ebc0 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a280b3a70 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20013420 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.717+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a28153ca0 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.718+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2804c3c0 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.718+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a20013790 con 0x7f6a2815d5b0 2023-10-09T11:41:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.719+0000 7f6a0f7fe700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 0x7f6a140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.719+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6a20084c30 con 0x7f6a2815d5b0 2023-10-09T11:41:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.719+0000 7f6a277fe700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 0x7f6a140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.720+0000 7f6a277fe700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 0x7f6a140697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000f60 tx=0x7f6a18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.723+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a20051870 con 0x7f6a2815d5b0 2023-10-09T11:41:49.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:49.964+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a280aede0 con 0x7f6a2815d5b0 2023-10-09T11:41:50.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.576+0000 7f6a0f7fe700 1 -- 172.21.15.26:0/2866382600 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a20054e90 con 0x7f6a2815d5b0 2023-10-09T11:41:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.578+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 msgr2=0x7f6a140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.578+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 0x7f6a140697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000f60 tx=0x7f6a18009040 comp rx=0 tx=0).stop 2023-10-09T11:41:50.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.578+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 msgr2=0x7f6a2815da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.578+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6a28063620 tx=0x7f6a20001f40 comp rx=0 tx=0).stop 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 shutdown_connections 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2815d5b0 0x7f6a2815da20 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a10004810 0x7f6a280b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a14067320 0x7f6a140697d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 --2- 172.21.15.26:0/2866382600 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a28153f90 0x7f6a28153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 >> 172.21.15.26:0/2866382600 conn(0x7f6a28088000 msgr2=0x7f6a28067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 shutdown_connections 2023-10-09T11:41:50.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.579+0000 7f6a2db86700 1 -- 172.21.15.26:0/2866382600 wait complete. 2023-10-09T11:41:50.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:41:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.720+0000 7f6c8a345700 1 Processor -- start 2023-10-09T11:41:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.720+0000 7f6c8a345700 1 -- start start 2023-10-09T11:41:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c8a345700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c840b1d40 0x7f6c840b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c8a345700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840b0c80 con 0x7f6c84159800 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c8a345700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840b0f60 con 0x7f6c840b24f0 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c8a345700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840d10d0 con 0x7f6c840b1d40 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c88b42700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6c84159800 0x7f6c840b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52324/0 (socket says 172.21.15.26:52324) 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c88b42700 1 -- 172.21.15.26:0/143488509 learned_addr learned my addr 172.21.15.26:0/143488509 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> v2:172.21.15.67:3300/0 conn(0x7f6c840b1d40 0x7f6c840b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115623374 0 0) 0x7f6c840b0c80 con 0x7f6c84159800 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.721+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c6c003570 con 0x7f6c84159800 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129842162 0 0) 0x7f6c6c003570 con 0x7f6c84159800 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 >> v2:172.21.15.67:3300/0 conn(0x7f6c840b1d40 msgr2=0x7f6c840b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 --2- 172.21.15.26:0/143488509 >> v2:172.21.15.67:3300/0 conn(0x7f6c840b1d40 0x7f6c840b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 >> v1:172.21.15.67:6789/0 conn(0x7f6c840b24f0 legacy=0x7f6c841590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840b1240 con 0x7f6c84159800 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f6c78001470 con 0x7f6c84159800 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> v2:172.21.15.67:3300/0 conn(0x7f6c840b1d40 0x7f6c840b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 >> v1:172.21.15.26:6789/0 conn(0x7f6c84159800 legacy=0x7f6c840b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c003a60 0x7f6c6c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c6c004810 0x7f6c6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 0x7f6c6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840d10d0 con 0x7f6c6c0051c0 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c00c050 con 0x7f6c6c004810 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c00c210 con 0x7f6c6c003a60 2023-10-09T11:41:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 0x7f6c6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c88b42700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c6c004810 0x7f6c6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89343700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c003a60 0x7f6c6c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 -- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c003a60 msgr2=0x7f6c6c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c003a60 0x7f6c6c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 -- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c6c004810 msgr2=0x7f6c6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c6c004810 0x7f6c6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 -- 172.21.15.26:0/143488509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c003570 con 0x7f6c6c0051c0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 -- 172.21.15.26:0/143488509 reap_dead start 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.722+0000 7f6c89b44700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 0x7f6c6c00ba60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009df0 tx=0x7f6c740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad5fb508178aa33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74009740 con 0x7f6c6c0051c0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400e920 con 0x7f6c6c0051c0 2023-10-09T11:41:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c83fff700 1 -- 172.21.15.26:0/143488509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400ece0 con 0x7f6c6c0051c0 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 -- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 msgr2=0x7f6c6c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 0x7f6c6c00ba60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009df0 tx=0x7f6c740091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 -- 172.21.15.26:0/143488509 shutdown_connections 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 --2- 172.21.15.26:0/143488509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c6c0051c0 0x7f6c6c00ba60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 -- 172.21.15.26:0/143488509 >> 172.21.15.26:0/143488509 conn(0x7f6c840703a0 msgr2=0x7f6c840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 -- 172.21.15.26:0/143488509 shutdown_connections 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.723+0000 7f6c8a345700 1 -- 172.21.15.26:0/143488509 wait complete. 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.724+0000 7f6c8a345700 1 Processor -- start 2023-10-09T11:41:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.724+0000 7f6c8a345700 1 -- start start 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c0051c0 0x7f6c8415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 0x7f6c84156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415f890 con 0x7f6c840a79c0 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84156750 con 0x7f6c8415e710 2023-10-09T11:41:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c8a345700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415ec80 con 0x7f6c6c0051c0 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c89b44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c89b44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36668/0 (socket says 172.21.15.26:36668) 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c89b44700 1 -- 172.21.15.26:0/3167080343 learned_addr learned my addr 172.21.15.26:0/3167080343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c89343700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c0051c0 0x7f6c8415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.725+0000 7f6c88b42700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 0x7f6c84156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 -- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c0051c0 msgr2=0x7f6c8415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c0051c0 0x7f6c8415fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 -- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 msgr2=0x7f6c84156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 0x7f6c84156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 -- 172.21.15.26:0/3167080343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8415ef60 con 0x7f6c840a79c0 2023-10-09T11:41:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c88b42700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 0x7f6c84156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c89b44700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6c840892f0 tx=0x7f6c7401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74022070 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400ee90 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8415f890 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7401c8b0 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.726+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8415f520 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.727+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8415fa20 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.727+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6c7401cc60 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.728+0000 7f6c817fa700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 0x7f6c700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.728+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6c740864d0 con 0x7f6c840a79c0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.728+0000 7f6c89343700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 0x7f6c700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.729+0000 7f6c89343700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 0x7f6c700697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007de0 tx=0x7f6c7c0016d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.732+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c740531d0 con 0x7f6c840a79c0 2023-10-09T11:41:50.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:50.924+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c8404c3c0 con 0x7f6c840a79c0 2023-10-09T11:41:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.585+0000 7f6c817fa700 1 -- 172.21.15.26:0/3167080343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c740567f0 con 0x7f6c840a79c0 2023-10-09T11:41:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 msgr2=0x7f6c700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 0x7f6c700697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007de0 tx=0x7f6c7c0016d0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 msgr2=0x7f6c840aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6c840892f0 tx=0x7f6c7401a000 comp rx=0 tx=0).stop 2023-10-09T11:41:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 shutdown_connections 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c840a79c0 0x7f6c840aa370 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6c70067320 0x7f6c700697d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c6c0051c0 0x7f6c8415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 --2- 172.21.15.26:0/3167080343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c8415e710 0x7f6c84156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 >> 172.21.15.26:0/3167080343 conn(0x7f6c840703a0 msgr2=0x7f6c840cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.589+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 shutdown_connections 2023-10-09T11:41:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.590+0000 7f6c8a345700 1 -- 172.21.15.26:0/3167080343 wait complete. 2023-10-09T11:41:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:41:51.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:41:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 Processor -- start 2023-10-09T11:41:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 -- start start 2023-10-09T11:41:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 0x7fd4d80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d815d9f0 con 0x7fd4d8067e50 2023-10-09T11:41:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d815e2f0 con 0x7fd4d815a300 2023-10-09T11:41:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.732+0000 7fd4de68d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815d3c0 con 0x7fd4d815de80 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4dcc2a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 0x7fd4d80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:56086/0 (socket says 172.21.15.26:56086) 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 -- 172.21.15.26:0/3620985236 learned_addr learned my addr 172.21.15.26:0/3620985236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 -- 172.21.15.26:0/3620985236 >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 msgr2=0x7fd4d80c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 --2- 172.21.15.26:0/3620985236 >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 0x7fd4d80c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 -- 172.21.15.26:0/3620985236 >> v1:172.21.15.67:6789/0 conn(0x7fd4d8067e50 legacy=0x7fd4d8068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 -- 172.21.15.26:0/3620985236 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d815a8f0 con 0x7fd4d815de80 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4dcc2a700 1 --2- 172.21.15.26:0/3620985236 >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 0x7fd4d80c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.733+0000 7fd4d77fe700 1 --2- 172.21.15.26:0/3620985236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0099b0 tx=0x7fd4cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a082b07446150f5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4d6ffd700 1 -- 172.21.15.26:0/3620985236 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc009ea0 con 0x7fd4d815de80 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4d6ffd700 1 -- 172.21.15.26:0/3620985236 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00b860 con 0x7fd4d815de80 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4d6ffd700 1 -- 172.21.15.26:0/3620985236 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00bc00 con 0x7fd4d815de80 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 -- 172.21.15.26:0/3620985236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 msgr2=0x7fd4d8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 --2- 172.21.15.26:0/3620985236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0099b0 tx=0x7fd4cc009250 comp rx=0 tx=0).stop 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 -- 172.21.15.26:0/3620985236 shutdown_connections 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 --2- 172.21.15.26:0/3620985236 >> v2:172.21.15.67:3300/0 conn(0x7fd4d815a300 0x7fd4d80c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 --2- 172.21.15.26:0/3620985236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d815de80 0x7fd4d8159dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 -- 172.21.15.26:0/3620985236 >> 172.21.15.26:0/3620985236 conn(0x7fd4d80ce4a0 msgr2=0x7fd4d80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 -- 172.21.15.26:0/3620985236 shutdown_connections 2023-10-09T11:41:51.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.734+0000 7fd4de68d700 1 -- 172.21.15.26:0/3620985236 wait complete. 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.735+0000 7fd4de68d700 1 Processor -- start 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 -- start start 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 0x7fd4d81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 0x7fd4d80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8157250 con 0x7fd4d815a300 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80b1fd0 con 0x7fd4d815de80 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4de68d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80b1cf0 con 0x7fd4d8067e50 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36676/0 (socket says 172.21.15.26:36676) 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4d7fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 0x7fd4d81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.736+0000 7fd4d77fe700 1 -- 172.21.15.26:0/1239438651 learned_addr learned my addr 172.21.15.26:0/1239438651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4dcc2a700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 0x7fd4d80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 -- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 msgr2=0x7fd4d81576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 0x7fd4d81576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 -- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 msgr2=0x7fd4d80b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 0x7fd4d80b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 -- 172.21.15.26:0/1239438651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009a20 con 0x7fd4d815a300 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d7fff700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 0x7fd4d81576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4dcc2a700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 0x7fd4d80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:51.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4d77fe700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd4d815d500 tx=0x7fd4cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00bbe0 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc01a450 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc0094f0 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc01a810 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.737+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d8156ee0 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.738+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8156a60 con 0x7fd4d815a300 2023-10-09T11:41:51.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.739+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4cc01abc0 con 0x7fd4d815a300 2023-10-09T11:41:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.739+0000 7fd4bffff700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 0x7fd4c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.739+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fd4cc086460 con 0x7fd4d815a300 2023-10-09T11:41:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.739+0000 7fd4d7fff700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 0x7fd4c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.740+0000 7fd4d7fff700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 0x7fd4c40697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd4d816cf10 tx=0x7fd4c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.743+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4d8156a60 con 0x7fd4d815a300 2023-10-09T11:41:51.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:51.939+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4d8156a60 con 0x7fd4d815a300 2023-10-09T11:41:52.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.588+0000 7fd4bffff700 1 -- 172.21.15.26:0/1239438651 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd4d8156a60 con 0x7fd4d815a300 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 msgr2=0x7fd4c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 0x7fd4c40697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd4d816cf10 tx=0x7fd4c8009040 comp rx=0 tx=0).stop 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 msgr2=0x7fd4d80b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd4d815d500 tx=0x7fd4cc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 shutdown_connections 2023-10-09T11:41:52.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4d815de80 0x7fd4d80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4c4067320 0x7fd4c40697d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4d8067e50 0x7fd4d81576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 --2- 172.21.15.26:0/1239438651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d815a300 0x7fd4d80b3a60 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 >> 172.21.15.26:0/1239438651 conn(0x7fd4d80ce4a0 msgr2=0x7fd4d80c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.591+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 shutdown_connections 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.592+0000 7fd4de68d700 1 -- 172.21.15.26:0/1239438651 wait complete. 2023-10-09T11:41:52.593 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:41:52.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:41:52.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.730+0000 7fca948eb700 1 Processor -- start 2023-10-09T11:41:52.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.730+0000 7fca948eb700 1 -- start start 2023-10-09T11:41:52.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca948eb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca9006e0e0 0x7fca900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca948eb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900ccfd0 con 0x7fca90159530 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca948eb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9015a3d0 con 0x7fca9006dc70 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca948eb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9015a6b0 con 0x7fca9006e0e0 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca8ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca9006e0e0 0x7fca900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca8e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fca90159530 0x7fca900ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52338/0 (socket says 172.21.15.26:52338) 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.731+0000 7fca8e59c700 1 -- 172.21.15.26:0/1520648619 learned_addr learned my addr 172.21.15.26:0/1520648619 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8ed9d700 1 -- 172.21.15.26:0/1520648619 >> v1:172.21.15.67:6789/0 conn(0x7fca9006dc70 legacy=0x7fca90159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8ed9d700 1 -- 172.21.15.26:0/1520648619 >> v1:172.21.15.26:6789/0 conn(0x7fca90159530 legacy=0x7fca900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8ed9d700 1 -- 172.21.15.26:0/1520648619 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9015a990 con 0x7fca9006e0e0 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8d59a700 1 -- 172.21.15.26:0/1520648619 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225123014 0 0) 0x7fca900ccfd0 con 0x7fca90159530 2023-10-09T11:41:52.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8ed9d700 1 --2- 172.21.15.26:0/1520648619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900cb6f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fca880098e0 tx=0x7fca880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757eb298cc05abfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8d59a700 1 -- 172.21.15.26:0/1520648619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88009e80 con 0x7fca9006e0e0 2023-10-09T11:41:52.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8d59a700 1 -- 172.21.15.26:0/1520648619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800b860 con 0x7fca9006e0e0 2023-10-09T11:41:52.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca8d59a700 1 -- 172.21.15.26:0/1520648619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800bbe0 con 0x7fca9006e0e0 2023-10-09T11:41:52.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca948eb700 1 -- 172.21.15.26:0/1520648619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 msgr2=0x7fca900cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.732+0000 7fca948eb700 1 --2- 172.21.15.26:0/1520648619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900cb6f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fca880098e0 tx=0x7fca880091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.733+0000 7fca948eb700 1 -- 172.21.15.26:0/1520648619 shutdown_connections 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.733+0000 7fca948eb700 1 --2- 172.21.15.26:0/1520648619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900cb6f0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.733+0000 7fca948eb700 1 -- 172.21.15.26:0/1520648619 >> 172.21.15.26:0/1520648619 conn(0x7fca900703a0 msgr2=0x7fca900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.733+0000 7fca948eb700 1 -- 172.21.15.26:0/1520648619 shutdown_connections 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.733+0000 7fca948eb700 1 -- 172.21.15.26:0/1520648619 wait complete. 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 Processor -- start 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 -- start start 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 0x7fca900b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 0x7fca90169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b3d80 con 0x7fca9006e0e0 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c80a0 con 0x7fca90159530 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.734+0000 7fca948eb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c8ec0 con 0x7fca9006dc70 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36700/0 (socket says 172.21.15.26:36700) 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 -- 172.21.15.26:0/796388932 learned_addr learned my addr 172.21.15.26:0/796388932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8ed9d700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 0x7fca90169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8e59c700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 0x7fca900b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 -- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 msgr2=0x7fca900b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 0x7fca900b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 -- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 msgr2=0x7fca90169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 0x7fca90169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 -- 172.21.15.26:0/796388932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009420 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8ed9d700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 0x7fca90169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8e59c700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 0x7fca900b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca8dd9b700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c4e0 tx=0x7fca7800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011590 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78011710 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca90169570 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011ad0 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.735+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900c8610 con 0x7fca9006e0e0 2023-10-09T11:41:52.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.736+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9004c3c0 con 0x7fca9006e0e0 2023-10-09T11:41:52.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.737+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fca7801b3b0 con 0x7fca9006e0e0 2023-10-09T11:41:52.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.737+0000 7fca867fc700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 0x7fca700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.737+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fca78083e40 con 0x7fca9006e0e0 2023-10-09T11:41:52.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.737+0000 7fca8e59c700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 0x7fca700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.738+0000 7fca8e59c700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 0x7fca700697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fca80000f80 tx=0x7fca80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.741+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca78050dd0 con 0x7fca9006e0e0 2023-10-09T11:41:52.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.935+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fca9015ac70 con 0x7fca9006e0e0 2023-10-09T11:41:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.939+0000 7fca867fc700 1 -- 172.21.15.26:0/796388932 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca78017020 con 0x7fca9006e0e0 2023-10-09T11:41:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 msgr2=0x7fca700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 0x7fca700697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fca80000f80 tx=0x7fca80009040 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 msgr2=0x7fca900c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c4e0 tx=0x7fca7800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 shutdown_connections 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca90159530 0x7fca90169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca70067320 0x7fca700697d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca9006dc70 0x7fca900b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 --2- 172.21.15.26:0/796388932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca9006e0e0 0x7fca900c7b60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 >> 172.21.15.26:0/796388932 conn(0x7fca900703a0 msgr2=0x7fca900b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 shutdown_connections 2023-10-09T11:41:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:52.941+0000 7fca948eb700 1 -- 172.21.15.26:0/796388932 wait complete. 2023-10-09T11:41:52.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-09T11:41:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.072+0000 7f3439963700 1 Processor -- start 2023-10-09T11:41:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.072+0000 7f3439963700 1 -- start start 2023-10-09T11:41:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3439963700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34340cb5a0 0x7f34340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3439963700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343415ae40 con 0x7f343415a5d0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3439963700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343415ab60 con 0x7f34340cd9e0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3439963700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34340d13f0 con 0x7f34340cb5a0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f34337fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f343415a5d0 0x7f3434156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52346/0 (socket says 172.21.15.26:52346) 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f34337fe700 1 -- 172.21.15.26:0/1425218574 learned_addr learned my addr 172.21.15.26:0/1425218574 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3432ffd700 1 --2- 172.21.15.26:0/1425218574 >> v2:172.21.15.67:3300/0 conn(0x7f34340cb5a0 0x7f34340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967357439 0 0) 0x7f343415ae40 con 0x7f343415a5d0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f341c003570 con 0x7f343415a5d0 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228183661 0 0) 0x7f341c003570 con 0x7f343415a5d0 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 >> v2:172.21.15.67:3300/0 conn(0x7f34340cb5a0 msgr2=0x7f34340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 --2- 172.21.15.26:0/1425218574 >> v2:172.21.15.67:3300/0 conn(0x7f34340cb5a0 0x7f34340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 >> v1:172.21.15.67:6789/0 conn(0x7f34340cd9e0 legacy=0x7f3434159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340ccf00 con 0x7f343415a5d0 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f342c0017f0 con 0x7f343415a5d0 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 >> v1:172.21.15.26:6789/0 conn(0x7f343415a5d0 legacy=0x7f3434156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341c003a60 0x7f341c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f341c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f341c0051c0 0x7f341c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c00c0a0 con 0x7f341c004810 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c00c210 con 0x7f341c0051c0 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.073+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c00c3d0 con 0x7f341c003a60 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f341c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f3432ffd700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341c003a60 0x7f341c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34337fe700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f341c0051c0 0x7f341c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 -- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341c003a60 msgr2=0x7f341c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f341c003a60 0x7f341c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 -- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f341c0051c0 msgr2=0x7f341c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f341c0051c0 0x7f341c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 -- 172.21.15.26:0/1425218574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c003570 con 0x7f341c004810 2023-10-09T11:41:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34337fe700 1 -- 172.21.15.26:0/1425218574 reap_dead start 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f34327fc700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f341c004c80 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f34280018b0 tx=0x7f3428007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658f2fdb20e296b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428012420 con 0x7f341c004810 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34280125a0 con 0x7f341c004810 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.074+0000 7f3431ffb700 1 -- 172.21.15.26:0/1425218574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428012960 con 0x7f341c004810 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 -- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 msgr2=0x7f341c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f341c004c80 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f34280018b0 tx=0x7f3428007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 -- 172.21.15.26:0/1425218574 shutdown_connections 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 --2- 172.21.15.26:0/1425218574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f341c004c80 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 -- 172.21.15.26:0/1425218574 >> 172.21.15.26:0/1425218574 conn(0x7f3434070e30 msgr2=0x7f34340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 -- 172.21.15.26:0/1425218574 shutdown_connections 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.075+0000 7f3439963700 1 -- 172.21.15.26:0/1425218574 wait complete. 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.076+0000 7f3439963700 1 Processor -- start 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.076+0000 7f3439963700 1 -- start start 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f343415b2c0 0x7f34340c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f343415b730 0x7f34340c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343415caf0 con 0x7f341c004810 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340b3fb0 con 0x7f343415b2c0 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343415e280 con 0x7f343415b730 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36728/0 (socket says 172.21.15.26:36728) 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 -- 172.21.15.26:0/4257915945 learned_addr learned my addr 172.21.15.26:0/4257915945 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f34327fc700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f343415b2c0 0x7f34340c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f34337fe700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f343415b730 0x7f34340c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 -- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f343415b730 msgr2=0x7f34340c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f343415b730 0x7f34340c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 -- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f343415b2c0 msgr2=0x7f34340c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f343415b2c0 0x7f34340c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 -- 172.21.15.26:0/4257915945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343415d670 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3432ffd700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3424011d70 tx=0x7f34240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424009e20 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342400fcd0 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.077+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343415d950 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.078+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424014650 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.078+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343415df10 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.079+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34340c8820 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.079+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3424014a80 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.079+0000 7f341affd700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 0x7f34200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.079+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3424018030 con 0x7f341c004810 2023-10-09T11:41:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.079+0000 7f34327fc700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 0x7f34200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.080+0000 7f34327fc700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 0x7f34200697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f34340c72d0 tx=0x7f3428015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.083+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3424052460 con 0x7f341c004810 2023-10-09T11:41:53.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.356+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f343404c3c0 con 0x7f341c004810 2023-10-09T11:41:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.587+0000 7f341affd700 1 -- 172.21.15.26:0/4257915945 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v319) v1 ==== 156+0+0 (secure 0 0 0) 0x7f3424055a80 con 0x7f341c004810 2023-10-09T11:41:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 msgr2=0x7f34200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 0x7f34200697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f34340c72d0 tx=0x7f3428015000 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 msgr2=0x7f343415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3424011d70 tx=0x7f34240091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 shutdown_connections 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3420067320 0x7f34200697d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f343415b730 0x7f34340c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f341c004810 0x7f343415cff0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 --2- 172.21.15.26:0/4257915945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f343415b2c0 0x7f34340c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 >> 172.21.15.26:0/4257915945 conn(0x7f3434070e30 msgr2=0x7f34340b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 shutdown_connections 2023-10-09T11:41:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.590+0000 7f3439963700 1 -- 172.21.15.26:0/4257915945 wait complete. 2023-10-09T11:41:53.603 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-09T11:41:53.603 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-09T11:41:53.603 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:41:53.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-09T11:41:53.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.722+0000 7f80ec6d6700 1 Processor -- start 2023-10-09T11:41:53.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.722+0000 7f80ec6d6700 1 -- start start 2023-10-09T11:41:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ec6d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80e40cb5a0 0x7f80e40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ec6d6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 0x7f80e4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ec6d6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e415ae40 con 0x7f80e40cde50 2023-10-09T11:41:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ec6d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40d13f0 con 0x7f80e40cb5a0 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ec6d6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e415ab60 con 0x7f80e40cd9e0 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80e40cb5a0 0x7f80e40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80e40cb5a0 0x7f80e40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36742/0 (socket says 172.21.15.26:36742) 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 -- 172.21.15.26:0/3335355841 learned_addr learned my addr 172.21.15.26:0/3335355841 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80e9c71700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 0x7f80e4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 -- 172.21.15.26:0/3335355841 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 msgr2=0x7f80e4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 0x7f80e4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 -- 172.21.15.26:0/3335355841 >> v1:172.21.15.67:6789/0 conn(0x7f80e40cde50 legacy=0x7f80e4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 -- 172.21.15.26:0/3335355841 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40ccf00 con 0x7f80e40cb5a0 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80e9c71700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 0x7f80e4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.723+0000 7f80ea472700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cb5a0 0x7f80e40cb970 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f80e00099b0 tx=0x7f80e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a784305112755d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80e9470700 1 -- 172.21.15.26:0/3335355841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000b860 con 0x7f80e40cb5a0 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80e9470700 1 -- 172.21.15.26:0/3335355841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000b9c0 con 0x7f80e40cb5a0 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80e9470700 1 -- 172.21.15.26:0/3335355841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000bd60 con 0x7f80e40cb5a0 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 -- 172.21.15.26:0/3335355841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cb5a0 msgr2=0x7f80e40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cb5a0 0x7f80e40cb970 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f80e00099b0 tx=0x7f80e0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 -- 172.21.15.26:0/3335355841 shutdown_connections 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cb5a0 0x7f80e40cb970 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/3335355841 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e40cd9e0 0x7f80e4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 -- 172.21.15.26:0/3335355841 >> 172.21.15.26:0/3335355841 conn(0x7f80e4070e30 msgr2=0x7f80e40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 -- 172.21.15.26:0/3335355841 shutdown_connections 2023-10-09T11:41:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.724+0000 7f80ec6d6700 1 -- 172.21.15.26:0/3335355841 wait complete. 2023-10-09T11:41:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.725+0000 7f80ec6d6700 1 Processor -- start 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.725+0000 7f80ec6d6700 1 -- start start 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80e40cb5a0 0x7f80e4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 0x7f80e41548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4157d70 con 0x7f80e40cd9e0 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4157160 con 0x7f80e40cb5a0 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ec6d6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4157440 con 0x7f80e4156c60 2023-10-09T11:41:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36758/0 (socket says 172.21.15.26:36758) 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 -- 172.21.15.26:0/1159235693 learned_addr learned my addr 172.21.15.26:0/1159235693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80ea472700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80e40cb5a0 0x7f80e4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80eac73700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 0x7f80e41548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 -- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 msgr2=0x7f80e41548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 0x7f80e41548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 -- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80e40cb5a0 msgr2=0x7f80e4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80e40cb5a0 0x7f80e4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80e9c71700 1 -- 172.21.15.26:0/1159235693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00094f0 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.726+0000 7f80eac73700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 0x7f80e41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80e9c71700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f80d400e8d0 tx=0x7f80d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400ee70 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400c5e0 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e4157720 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400c980 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.727+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e4153670 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.728+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4157f20 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.729+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f80d4025430 con 0x7f80e40cd9e0 2023-10-09T11:41:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.729+0000 7f80da7fc700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 0x7f80c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.729+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f80d4084c60 con 0x7f80e40cd9e0 2023-10-09T11:41:53.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.729+0000 7f80ea472700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 0x7f80c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.730+0000 7f80ea472700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 0x7f80c80697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80e00099b0 tx=0x7f80e0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:53.733+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80d40555f0 con 0x7f80e40cd9e0 2023-10-09T11:41:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.009+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f80e404c3c0 con 0x7f80e40cd9e0 2023-10-09T11:41:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.589+0000 7f80da7fc700 1 -- 172.21.15.26:0/1159235693 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v320) v1 ==== 134+0+0 (secure 0 0 0) 0x7f80d40200c0 con 0x7f80e40cd9e0 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 msgr2=0x7f80c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 0x7f80c80697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80e00099b0 tx=0x7f80e0017000 comp rx=0 tx=0).stop 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 msgr2=0x7f80e40c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f80d400e8d0 tx=0x7f80d4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 shutdown_connections 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80c8067320 0x7f80c80697d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80e4156c60 0x7f80e41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80e40cb5a0 0x7f80e4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 --2- 172.21.15.26:0/1159235693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80e40cd9e0 0x7f80e40c7c40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 >> 172.21.15.26:0/1159235693 conn(0x7f80e4070e30 msgr2=0x7f80e4155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 shutdown_connections 2023-10-09T11:41:54.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.591+0000 7f80ec6d6700 1 -- 172.21.15.26:0/1159235693 wait complete. 2023-10-09T11:41:54.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.730+0000 7f67fc4e6700 1 Processor -- start 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.730+0000 7f67fc4e6700 1 -- start start 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fc4e6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67f406dc70 0x7f67f4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fc4e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67f406e0e0 0x7f67f40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fc4e6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40ccfd0 con 0x7f67f4159530 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fc4e6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f415a3d0 con 0x7f67f406e0e0 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fc4e6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f415a6b0 con 0x7f67f406dc70 2023-10-09T11:41:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67faa83700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67f406e0e0 0x7f67f40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fa282700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f67f4159530 0x7f67f40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52360/0 (socket says 172.21.15.26:52360) 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67fa282700 1 -- 172.21.15.26:0/2861801287 learned_addr learned my addr 172.21.15.26:0/2861801287 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.731+0000 7f67f9a81700 1 --2- 172.21.15.26:0/2861801287 >> v2:172.21.15.67:3300/0 conn(0x7f67f406dc70 0x7f67f4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67faa83700 1 -- 172.21.15.26:0/2861801287 >> v2:172.21.15.67:3300/0 conn(0x7f67f406dc70 msgr2=0x7f67f4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67faa83700 1 --2- 172.21.15.26:0/2861801287 >> v2:172.21.15.67:3300/0 conn(0x7f67f406dc70 0x7f67f4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67faa83700 1 -- 172.21.15.26:0/2861801287 >> v1:172.21.15.26:6789/0 conn(0x7f67f4159530 legacy=0x7f67f40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67faa83700 1 -- 172.21.15.26:0/2861801287 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f415a990 con 0x7f67f406e0e0 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67f9280700 1 -- 172.21.15.26:0/2861801287 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812235838 0 0) 0x7f67f40ccfd0 con 0x7f67f4159530 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67faa83700 1 --2- 172.21.15.26:0/2861801287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f406e0e0 0x7f67f40cb6f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f67f40b66e0 tx=0x7f67ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce137dc68b0252c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67f9280700 1 -- 172.21.15.26:0/2861801287 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00e070 con 0x7f67f406e0e0 2023-10-09T11:41:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67f9280700 1 -- 172.21.15.26:0/2861801287 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec00bb60 con 0x7f67f406e0e0 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67f9280700 1 -- 172.21.15.26:0/2861801287 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec012430 con 0x7f67f406e0e0 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67fc4e6700 1 -- 172.21.15.26:0/2861801287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f406e0e0 msgr2=0x7f67f40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.732+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/2861801287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f406e0e0 0x7f67f40cb6f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f67f40b66e0 tx=0x7f67ec009780 comp rx=0 tx=0).stop 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 -- 172.21.15.26:0/2861801287 shutdown_connections 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/2861801287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f406e0e0 0x7f67f40cb6f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/2861801287 >> v2:172.21.15.67:3300/0 conn(0x7f67f406dc70 0x7f67f4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 -- 172.21.15.26:0/2861801287 >> 172.21.15.26:0/2861801287 conn(0x7f67f40703a0 msgr2=0x7f67f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 -- 172.21.15.26:0/2861801287 shutdown_connections 2023-10-09T11:41:54.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.733+0000 7f67fc4e6700 1 -- 172.21.15.26:0/2861801287 wait complete. 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.734+0000 7f67fc4e6700 1 Processor -- start 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.734+0000 7f67fc4e6700 1 -- start start 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.734+0000 7f67fc4e6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f406dc70 0x7f67f414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.734+0000 7f67fc4e6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f406e0e0 0x7f67f40c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.734+0000 7f67fc4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fc4e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40caa50 con 0x7f67f4159530 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fc4e6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f416ce00 con 0x7f67f406e0e0 2023-10-09T11:41:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fc4e6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f416d0e0 con 0x7f67f406dc70 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36776/0 (socket says 172.21.15.26:36776) 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 -- 172.21.15.26:0/403116882 learned_addr learned my addr 172.21.15.26:0/403116882 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67f9a81700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f406e0e0 0x7f67f40c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fa282700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f406dc70 0x7f67f414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 -- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f406dc70 msgr2=0x7f67f414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f406dc70 0x7f67f414e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 -- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f406e0e0 msgr2=0x7f67f40c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f406e0e0 0x7f67f40c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 -- 172.21.15.26:0/403116882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec009a20 con 0x7f67f4159530 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67faa83700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f67f4089650 tx=0x7f67ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec012e60 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec01d630 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f416d3c0 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01d9f0 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.735+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f416dbc0 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.736+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f404c3c0 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.737+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f67ec024070 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.737+0000 7f67ea7fc700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 0x7f67d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.737+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f67ec0871b0 con 0x7f67f4159530 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.737+0000 7f67fa282700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 0x7f67d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.738+0000 7f67fa282700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 0x7f67d80697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c8f0 tx=0x7f67f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.741+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67ec054140 con 0x7f67f4159530 2023-10-09T11:41:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.937+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67f415ac70 con 0x7f67f4159530 2023-10-09T11:41:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.940+0000 7f67ea7fc700 1 -- 172.21.15.26:0/403116882 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67ec009880 con 0x7f67f4159530 2023-10-09T11:41:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 msgr2=0x7f67d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 0x7f67d80697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c8f0 tx=0x7f67f0009040 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 msgr2=0x7f67f40c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f67f4089650 tx=0x7f67ec019000 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 shutdown_connections 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67f4159530 0x7f67f40c6da0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f67d8067320 0x7f67d80697d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67f406dc70 0x7f67f414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 --2- 172.21.15.26:0/403116882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67f406e0e0 0x7f67f40c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 >> 172.21.15.26:0/403116882 conn(0x7f67f40703a0 msgr2=0x7f67f40ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 shutdown_connections 2023-10-09T11:41:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:54.943+0000 7f67fc4e6700 1 -- 172.21.15.26:0/403116882 wait complete. 2023-10-09T11:41:54.955 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:54.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:54.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:55.041 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:55.042 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:41:55.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.160+0000 7fd3b359e700 1 Processor -- start 2023-10-09T11:41:55.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.160+0000 7fd3b359e700 1 -- start start 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3b4153c30 0x7fd3b415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b359e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b40cf110 0x7fd3b415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b359e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b415afd0 con 0x7fd3b415de50 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b359e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b415b2b0 con 0x7fd3b4153c30 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b359e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b415b590 con 0x7fd3b40cf110 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3b4153c30 0x7fd3b415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3b415de50 0x7fd3b40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52376/0 (socket says 172.21.15.26:52376) 2023-10-09T11:41:55.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b1d9b700 1 -- 172.21.15.26:0/3861017427 learned_addr learned my addr 172.21.15.26:0/3861017427 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b2d9d700 1 --2- 172.21.15.26:0/3861017427 >> v2:172.21.15.67:3300/0 conn(0x7fd3b40cf110 0x7fd3b415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b259c700 1 -- 172.21.15.26:0/3861017427 >> v2:172.21.15.67:3300/0 conn(0x7fd3b40cf110 msgr2=0x7fd3b415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3861017427 >> v2:172.21.15.67:3300/0 conn(0x7fd3b40cf110 0x7fd3b415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b259c700 1 -- 172.21.15.26:0/3861017427 >> v1:172.21.15.26:6789/0 conn(0x7fd3b415de50 legacy=0x7fd3b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.161+0000 7fd3b259c700 1 -- 172.21.15.26:0/3861017427 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b415b870 con 0x7fd3b4153c30 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3861017427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b4153c30 0x7fd3b415a5e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40cdab0 tx=0x7fd3a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631b5ac1255aacb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b159a700 1 -- 172.21.15.26:0/3861017427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011630 con 0x7fd3b4153c30 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b159a700 1 -- 172.21.15.26:0/3861017427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4011790 con 0x7fd3b4153c30 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b159a700 1 -- 172.21.15.26:0/3861017427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011b30 con 0x7fd3b4153c30 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 -- 172.21.15.26:0/3861017427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b4153c30 msgr2=0x7fd3b415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3861017427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b4153c30 0x7fd3b415a5e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40cdab0 tx=0x7fd3a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 -- 172.21.15.26:0/3861017427 shutdown_connections 2023-10-09T11:41:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3861017427 >> v2:172.21.15.67:3300/0 conn(0x7fd3b40cf110 0x7fd3b415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3861017427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b4153c30 0x7fd3b415a5e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 -- 172.21.15.26:0/3861017427 >> 172.21.15.26:0/3861017427 conn(0x7fd3b40703a0 msgr2=0x7fd3b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 -- 172.21.15.26:0/3861017427 shutdown_connections 2023-10-09T11:41:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.162+0000 7fd3b359e700 1 -- 172.21.15.26:0/3861017427 wait complete. 2023-10-09T11:41:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 Processor -- start 2023-10-09T11:41:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 -- start start 2023-10-09T11:41:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 0x7fd3b413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b4153c30 0x7fd3b416a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b416b1a0 con 0x7fd3b415de50 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b416d700 con 0x7fd3b40cf110 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.164+0000 7fd3b359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b416d9e0 con 0x7fd3b4153c30 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36788/0 (socket says 172.21.15.26:36788) 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 -- 172.21.15.26:0/3121713402 learned_addr learned my addr 172.21.15.26:0/3121713402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 0x7fd3b413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b1d9b700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b4153c30 0x7fd3b416a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 -- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b4153c30 msgr2=0x7fd3b416a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b4153c30 0x7fd3b416a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 -- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 msgr2=0x7fd3b413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 0x7fd3b413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 -- 172.21.15.26:0/3121713402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009420 con 0x7fd3b415de50 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 0x7fd3b413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b2d9d700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ceb0 tx=0x7fd3ac007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00ae40 con 0x7fd3b415de50 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac016420 con 0x7fd3b415de50 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b416dcc0 con 0x7fd3b415de50 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0167e0 con 0x7fd3b415de50 2023-10-09T11:41:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.165+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b40b4e30 con 0x7fd3b415de50 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.166+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b404c3c0 con 0x7fd3b415de50 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.167+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd3ac009030 con 0x7fd3b415de50 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.167+0000 7fd3aa7fc700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 0x7fd3940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.167+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd3ac012070 con 0x7fd3b415de50 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.167+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 0x7fd3940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.168+0000 7fd3b259c700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 0x7fd3940697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40030c0 tx=0x7fd3a4016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.171+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3ac04e5a0 con 0x7fd3b415de50 2023-10-09T11:41:55.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.410+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b415bb50 con 0x7fd3b415de50 2023-10-09T11:41:55.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.410+0000 7fd3aa7fc700 1 -- 172.21.15.26:0/3121713402 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fd3ac051f50 con 0x7fd3b415de50 2023-10-09T11:41:55.411 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:55.411 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6358,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2724027045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2724027045},{"type":"v1","addr":"172.21.15.67:6837","nonce":2724027045}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6595,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1820179028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1820179028},{"type":"v1","addr":"172.21.15.67:6836","nonce":1820179028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":6828,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3134150268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3134150268},{"type":"v1","addr":"172.21.15.26:6835","nonce":3134150268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1688713682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1688713682},{"type":"v1","addr":"172.21.15.26:6834","nonce":1688713682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-09T11:41:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 msgr2=0x7fd3940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 0x7fd3940697d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40030c0 tx=0x7fd3a4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 msgr2=0x7fd3b416ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ceb0 tx=0x7fd3ac007870 comp rx=0 tx=0).stop 2023-10-09T11:41:55.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 shutdown_connections 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b415de50 0x7fd3b416ac60 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b40cf110 0x7fd3b413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd394067320 0x7fd3940697d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 --2- 172.21.15.26:0/3121713402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3b4153c30 0x7fd3b416a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 >> 172.21.15.26:0/3121713402 conn(0x7fd3b40703a0 msgr2=0x7fd3b4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 shutdown_connections 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.412+0000 7fd3b359e700 1 -- 172.21.15.26:0/3121713402 wait complete. 2023-10-09T11:41:55.414 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 70 2023-10-09T11:41:55.425 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:41:55.425 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:41:55.426 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:41:55.426 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:55.426 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:41:55.426 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:41:55.426 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:41:55.426 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:55.426 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:41:55.427 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:41:55.427 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:41:55.427 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:55.427 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:41:55.427 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:41:55.427 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:41:55.427 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:55.434 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:41:55.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:41:55.435 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:41:55.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:41:55.438 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:41:55.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:41:55.439 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:41:55.439 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:41:55.477 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:41:55.477 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:55.477 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:41:55.477 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:55.481 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:41:55.481 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:55.482 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:41:55.482 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:55.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:41:55.553 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:41:55.553 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:41:55.568 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:41:55.568 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:41:55.569 INFO:tasks.ceph.mds.d.smithi067.stderr:2023-10-09T11:41:55.568+0000 7f57cf43f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T11:41:55.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.610+0000 7f6e2dcf8700 1 Processor -- start 2023-10-09T11:41:55.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.610+0000 7f6e2dcf8700 1 -- start start 2023-10-09T11:41:55.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e2dcf8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e280c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e2dcf8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e280b0ba0 0x7f6e2806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e2dcf8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2815a280 con 0x7f6e280b07d0 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e2dcf8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2806e180 con 0x7f6e280b0ba0 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e2dcf8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2806d850 con 0x7f6e280cf200 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e280b0ba0 0x7f6e2806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e280b0ba0 0x7f6e2806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36832/0 (socket says 172.21.15.26:36832) 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 -- 172.21.15.26:0/129244893 learned_addr learned my addr 172.21.15.26:0/129244893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e26ffd700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e280c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 -- 172.21.15.26:0/129244893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 msgr2=0x7f6e280c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e280c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 -- 172.21.15.26:0/129244893 >> v1:172.21.15.67:6789/0 conn(0x7f6e280b07d0 legacy=0x7f6e280ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 -- 172.21.15.26:0/129244893 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2806db30 con 0x7f6e280b0ba0 2023-10-09T11:41:55.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e26ffd700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e280c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.611+0000 7f6e27fff700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b0ba0 0x7f6e2806e610 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009f20 tx=0x7f6e20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4766c10a397b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e267fc700 1 -- 172.21.15.26:0/129244893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000e070 con 0x7f6e280b0ba0 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e267fc700 1 -- 172.21.15.26:0/129244893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000ba80 con 0x7f6e280b0ba0 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e267fc700 1 -- 172.21.15.26:0/129244893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e200092e0 con 0x7f6e280b0ba0 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/129244893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b0ba0 msgr2=0x7f6e2806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b0ba0 0x7f6e2806e610 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009f20 tx=0x7f6e20009840 comp rx=0 tx=0).stop 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/129244893 shutdown_connections 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b0ba0 0x7f6e2806e610 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/129244893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e280c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/129244893 >> 172.21.15.26:0/129244893 conn(0x7f6e2806ce80 msgr2=0x7f6e280ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/129244893 shutdown_connections 2023-10-09T11:41:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.612+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/129244893 wait complete. 2023-10-09T11:41:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.613+0000 7f6e2dcf8700 1 Processor -- start 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.613+0000 7f6e2dcf8700 1 -- start start 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e280b0ba0 0x7f6e280b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e2816aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280c55c0 con 0x7f6e280b07d0 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280c6140 con 0x7f6e280b0ba0 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e2dcf8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280b30c0 con 0x7f6e280cf200 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e26ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e280b0ba0 0x7f6e280b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36848/0 (socket says 172.21.15.26:36848) 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e277fe700 1 -- 172.21.15.26:0/2661378607 learned_addr learned my addr 172.21.15.26:0/2661378607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:55.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.614+0000 7f6e27fff700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e2816aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 -- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 msgr2=0x7f6e2816aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e2816aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 -- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e280b0ba0 msgr2=0x7f6e280b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e280b0ba0 0x7f6e280b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 -- 172.21.15.26:0/2661378607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009ae0 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e277fe700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c570 tx=0x7f6e18001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18011590 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e180116f0 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e280c5810 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18011ab0 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.615+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280c5dd0 con 0x7f6e280b07d0 2023-10-09T11:41:55.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.616+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2804c3c0 con 0x7f6e280b07d0 2023-10-09T11:41:55.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.616+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6e1801b3b0 con 0x7f6e280b07d0 2023-10-09T11:41:55.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.617+0000 7f6e0f7fe700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 0x7f6e140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.617+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6e18083c50 con 0x7f6e280b07d0 2023-10-09T11:41:55.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.617+0000 7f6e26ffd700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 0x7f6e140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.617+0000 7f6e26ffd700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 0x7f6e140697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cd710 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.621+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e18050c90 con 0x7f6e280b07d0 2023-10-09T11:41:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:55.830+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6e280c5f90 con 0x7f6e280b07d0 2023-10-09T11:41:56.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:56.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:56.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.602+0000 7f6e0f7fe700 1 -- 172.21.15.26:0/2661378607 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e18017070 con 0x7f6e280b07d0 2023-10-09T11:41:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 msgr2=0x7f6e140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 0x7f6e140697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cd710 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 msgr2=0x7f6e2816a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c570 tx=0x7f6e18001070 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 shutdown_connections 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6e14067320 0x7f6e140697d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6e280cf200 0x7f6e2816aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280b07d0 0x7f6e2816a430 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 --2- 172.21.15.26:0/2661378607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e280b0ba0 0x7f6e280b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 >> 172.21.15.26:0/2661378607 conn(0x7f6e2806ce80 msgr2=0x7f6e280ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 shutdown_connections 2023-10-09T11:41:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.605+0000 7f6e2dcf8700 1 -- 172.21.15.26:0/2661378607 wait complete. 2023-10-09T11:41:56.607 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:41:56.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:41:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.740+0000 7fc7bf59e700 1 Processor -- start 2023-10-09T11:41:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.741+0000 7fc7bf59e700 1 -- start start 2023-10-09T11:41:56.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.741+0000 7fc7bf59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7c0159920 0x7fc7c00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.741+0000 7fc7bf59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00acc00 con 0x7fc7c0159550 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.741+0000 7fc7bf59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00abff0 con 0x7fc7c015dfd0 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.741+0000 7fc7bf59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00ac2d0 con 0x7fc7c0159920 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7c0159920 0x7fc7c00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7be59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc7c0159550 0x7fc7c00ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52390/0 (socket says 172.21.15.26:52390) 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7be59c700 1 -- 172.21.15.26:0/3775634361 learned_addr learned my addr 172.21.15.26:0/3775634361 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bed9d700 1 -- 172.21.15.26:0/3775634361 >> v1:172.21.15.67:6789/0 conn(0x7fc7c015dfd0 legacy=0x7fc7c00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bed9d700 1 -- 172.21.15.26:0/3775634361 >> v1:172.21.15.26:6789/0 conn(0x7fc7c0159550 legacy=0x7fc7c00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bd59a700 1 -- 172.21.15.26:0/3775634361 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294409521 0 0) 0x7fc7c00acc00 con 0x7fc7c0159550 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bed9d700 1 -- 172.21.15.26:0/3775634361 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00ac5b0 con 0x7fc7c0159920 2023-10-09T11:41:56.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bed9d700 1 --2- 172.21.15.26:0/3775634361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159920 0x7fc7c00ad090 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009e60 tx=0x7fc7b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46d3765eaeeb048 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bd59a700 1 -- 172.21.15.26:0/3775634361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b000e070 con 0x7fc7c0159920 2023-10-09T11:41:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bd59a700 1 -- 172.21.15.26:0/3775634361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b000bc30 con 0x7fc7c0159920 2023-10-09T11:41:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.742+0000 7fc7bd59a700 1 -- 172.21.15.26:0/3775634361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0012430 con 0x7fc7c0159920 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 -- 172.21.15.26:0/3775634361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159920 msgr2=0x7fc7c00ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/3775634361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159920 0x7fc7c00ad090 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009e60 tx=0x7fc7b0009780 comp rx=0 tx=0).stop 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 -- 172.21.15.26:0/3775634361 shutdown_connections 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/3775634361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159920 0x7fc7c00ad090 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 -- 172.21.15.26:0/3775634361 >> 172.21.15.26:0/3775634361 conn(0x7fc7c006ce80 msgr2=0x7fc7c00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 -- 172.21.15.26:0/3775634361 shutdown_connections 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.743+0000 7fc7bf59e700 1 -- 172.21.15.26:0/3775634361 wait complete. 2023-10-09T11:41:56.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.744+0000 7fc7bf59e700 1 Processor -- start 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.744+0000 7fc7bf59e700 1 -- start start 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7c0159920 0x7fc7c014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c015dfd0 0x7fc7c0169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0150be0 con 0x7fc7c0159550 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c014e6f0 con 0x7fc7c015dfd0 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b2f90 con 0x7fc7c0159920 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36874/0 (socket says 172.21.15.26:36874) 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 -- 172.21.15.26:0/2840761708 learned_addr learned my addr 172.21.15.26:0/2840761708 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bed9d700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c015dfd0 0x7fc7c0169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 -- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7c0159920 msgr2=0x7fc7c014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7c0159920 0x7fc7c014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 -- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c015dfd0 msgr2=0x7fc7c0169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c015dfd0 0x7fc7c0169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 -- 172.21.15.26:0/2840761708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009a20 con 0x7fc7c0159550 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7be59c700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c810 tx=0x7fc7b8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005b30 con 0x7fc7c0159550 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8005c90 con 0x7fc7c0159550 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.745+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c014e920 con 0x7fc7c0159550 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.746+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8007300 con 0x7fc7c0159550 2023-10-09T11:41:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.746+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c00b2c20 con 0x7fc7c0159550 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.747+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c004c3c0 con 0x7fc7c0159550 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.747+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc7b801b400 con 0x7fc7c0159550 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.747+0000 7fc7b67fc700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 0x7fc7a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.748+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc7b8084320 con 0x7fc7c0159550 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.748+0000 7fc7bdd9b700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 0x7fc7a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.748+0000 7fc7bdd9b700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 0x7fc7a00697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc7c014e050 tx=0x7fc7a8007b40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:56.752+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7b8051480 con 0x7fc7c0159550 2023-10-09T11:41:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.021+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc7c0152f60 con 0x7fc7c0159550 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.021+0000 7fc7b67fc700 1 -- 172.21.15.26:0/2840761708 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc7b8054aa0 con 0x7fc7c0159550 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:41:57.028 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.029 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:41:57.030 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:41:57.031 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.032 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:41:57.033 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:57.034 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:41:57.035 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:41:57.036 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 msgr2=0x7fc7a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 0x7fc7a00697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc7c014e050 tx=0x7fc7a8007b40 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 msgr2=0x7fc7c014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c810 tx=0x7fc7b8007df0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 shutdown_connections 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c015dfd0 0x7fc7c0169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7c0159550 0x7fc7c014e1b0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7a0067320 0x7fc7a00697d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 --2- 172.21.15.26:0/2840761708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7c0159920 0x7fc7c014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 >> 172.21.15.26:0/2840761708 conn(0x7fc7c006ce80 msgr2=0x7fc7c0153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.023+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 shutdown_connections 2023-10-09T11:41:57.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.024+0000 7fc7bf59e700 1 -- 172.21.15.26:0/2840761708 wait complete. 2023-10-09T11:41:57.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 Processor -- start 2023-10-09T11:41:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 -- start start 2023-10-09T11:41:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faf080b0ba0 0x7faf0806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0815a280 con 0x7faf080b07d0 2023-10-09T11:41:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0806e180 con 0x7faf080b0ba0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.158+0000 7faf0dd9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0806d850 con 0x7faf080cf200 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf077fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faf080b07d0 0x7faf080ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52402/0 (socket says 172.21.15.26:52402) 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf077fe700 1 -- 172.21.15.26:0/2264563888 learned_addr learned my addr 172.21.15.26:0/2264563888 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 --2- 172.21.15.26:0/2264563888 >> v2:172.21.15.26:3300/0 conn(0x7faf080b0ba0 0x7faf0806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf06ffd700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf067fc700 1 -- 172.21.15.26:0/2264563888 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218219299 0 0) 0x7faf0815a280 con 0x7faf080b07d0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf067fc700 1 -- 172.21.15.26:0/2264563888 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4003570 con 0x7faf080b07d0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 -- 172.21.15.26:0/2264563888 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 msgr2=0x7faf080c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 -- 172.21.15.26:0/2264563888 >> v1:172.21.15.26:6789/0 conn(0x7faf080b07d0 legacy=0x7faf080ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 -- 172.21.15.26:0/2264563888 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0806db30 con 0x7faf080b0ba0 2023-10-09T11:41:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf06ffd700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf07fff700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf0806e610 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faf00009e60 tx=0x7faf00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4047fc396e25de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf067fc700 1 -- 172.21.15.26:0/2264563888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000e070 con 0x7faf080b0ba0 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf067fc700 1 -- 172.21.15.26:0/2264563888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000bb60 con 0x7faf080b0ba0 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.159+0000 7faf067fc700 1 -- 172.21.15.26:0/2264563888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00012430 con 0x7faf080b0ba0 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 -- 172.21.15.26:0/2264563888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 msgr2=0x7faf0806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf0806e610 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faf00009e60 tx=0x7faf00009780 comp rx=0 tx=0).stop 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 -- 172.21.15.26:0/2264563888 shutdown_connections 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf0806e610 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/2264563888 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 -- 172.21.15.26:0/2264563888 >> 172.21.15.26:0/2264563888 conn(0x7faf0806ce80 msgr2=0x7faf080ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 -- 172.21.15.26:0/2264563888 shutdown_connections 2023-10-09T11:41:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.160+0000 7faf0dd9a700 1 -- 172.21.15.26:0/2264563888 wait complete. 2023-10-09T11:41:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.161+0000 7faf0dd9a700 1 Processor -- start 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.161+0000 7faf0dd9a700 1 -- start start 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf080b07d0 0x7faf080990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c6550 con 0x7faf080b0ba0 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c55c0 con 0x7faf080b07d0 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf0dd9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c5b80 con 0x7faf080cf200 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36878/0 (socket says 172.21.15.26:36878) 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 -- 172.21.15.26:0/4057449830 learned_addr learned my addr 172.21.15.26:0/4057449830 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf07fff700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf077fe700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf080b07d0 0x7faf080990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 -- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 msgr2=0x7faf080afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 -- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf080b07d0 msgr2=0x7faf080990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf080b07d0 0x7faf080990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 -- 172.21.15.26:0/4057449830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009a20 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faf06ffd700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faef000e900 tx=0x7faef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000eea0 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.162+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000c5e0 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.163+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf080b02e0 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.163+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000c980 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.163+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08099a60 con 0x7faf080b0ba0 2023-10-09T11:41:57.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.163+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0804c3c0 con 0x7faf080b0ba0 2023-10-09T11:41:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.164+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faef000cd30 con 0x7faf080b0ba0 2023-10-09T11:41:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.164+0000 7faeff7fe700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 0x7faee80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.164+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faef00848e0 con 0x7faf080b0ba0 2023-10-09T11:41:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.164+0000 7faf077fe700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 0x7faee80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.165+0000 7faf077fe700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 0x7faee80697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faef8001360 tx=0x7faef8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.169+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faef00517b0 con 0x7faf080b0ba0 2023-10-09T11:41:57.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.362+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf080c5cc0 con 0x7faf080b0ba0 2023-10-09T11:41:57.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.363+0000 7faeff7fe700 1 -- 172.21.15.26:0/4057449830 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+12088 (secure 0 0 0) 0x7faef0054dd0 con 0x7faf080b0ba0 2023-10-09T11:41:57.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:57.363 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":108,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:41:56.599616+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 msgr2=0x7faee80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 0x7faee80697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faef8001360 tx=0x7faef8009040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 msgr2=0x7faf080c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faef000e900 tx=0x7faef0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 shutdown_connections 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7faee8067320 0x7faee80697d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf080cf200 0x7faf080afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf080b07d0 0x7faf080990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 --2- 172.21.15.26:0/4057449830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf080b0ba0 0x7faf080c6010 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 >> 172.21.15.26:0/4057449830 conn(0x7faf0806ce80 msgr2=0x7faf0806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 shutdown_connections 2023-10-09T11:41:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.365+0000 7faf0dd9a700 1 -- 172.21.15.26:0/4057449830 wait complete. 2023-10-09T11:41:57.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:41:57.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.499+0000 7fea85b4f700 1 Processor -- start 2023-10-09T11:41:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.499+0000 7fea85b4f700 1 -- start start 2023-10-09T11:41:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea85b4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea8006dc70 0x7fea80159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea85b4f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea8006e0e0 0x7fea800cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea85b4f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea800ccfd0 con 0x7fea80159530 2023-10-09T11:41:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea85b4f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8015a3d0 con 0x7fea8006dc70 2023-10-09T11:41:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea85b4f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8015a6b0 con 0x7fea8006e0e0 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea7effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea8006dc70 0x7fea80159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea7effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea8006dc70 0x7fea80159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36884/0 (socket says 172.21.15.26:36884) 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea7effd700 1 -- 172.21.15.26:0/393422677 learned_addr learned my addr 172.21.15.26:0/393422677 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.500+0000 7fea7ffff700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea8006e0e0 0x7fea800cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7effd700 1 -- 172.21.15.26:0/393422677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea8006e0e0 msgr2=0x7fea800cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7effd700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea8006e0e0 0x7fea800cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7effd700 1 -- 172.21.15.26:0/393422677 >> v1:172.21.15.67:6789/0 conn(0x7fea80159530 legacy=0x7fea800ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7effd700 1 -- 172.21.15.26:0/393422677 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8015a990 con 0x7fea8006dc70 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7effd700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006dc70 0x7fea80159900 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fea740099b0 tx=0x7fea74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7476f5688a23bb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7e7fc700 1 -- 172.21.15.26:0/393422677 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74009ea0 con 0x7fea8006dc70 2023-10-09T11:41:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7e7fc700 1 -- 172.21.15.26:0/393422677 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7400b860 con 0x7fea8006dc70 2023-10-09T11:41:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea7e7fc700 1 -- 172.21.15.26:0/393422677 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400bc00 con 0x7fea8006dc70 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 -- 172.21.15.26:0/393422677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006dc70 msgr2=0x7fea80159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006dc70 0x7fea80159900 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fea740099b0 tx=0x7fea74009250 comp rx=0 tx=0).stop 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 -- 172.21.15.26:0/393422677 shutdown_connections 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea8006e0e0 0x7fea800cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 --2- 172.21.15.26:0/393422677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006dc70 0x7fea80159900 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.501+0000 7fea85b4f700 1 -- 172.21.15.26:0/393422677 >> 172.21.15.26:0/393422677 conn(0x7fea800703a0 msgr2=0x7fea800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.502+0000 7fea85b4f700 1 -- 172.21.15.26:0/393422677 shutdown_connections 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.502+0000 7fea85b4f700 1 -- 172.21.15.26:0/393422677 wait complete. 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.503+0000 7fea85b4f700 1 Processor -- start 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.503+0000 7fea85b4f700 1 -- start start 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.503+0000 7fea85b4f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 0x7fea8014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.503+0000 7fea85b4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.503+0000 7fea85b4f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea80159530 0x7fea800b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea85b4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea800b63c0 con 0x7fea8006e0e0 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea85b4f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80152390 con 0x7fea8006dc70 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea85b4f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea80152670 con 0x7fea80159530 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36888/0 (socket says 172.21.15.26:36888) 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 -- 172.21.15.26:0/123188833 learned_addr learned my addr 172.21.15.26:0/123188833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7ffff700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea80159530 0x7fea800b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7f7fe700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 0x7fea8014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 -- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea80159530 msgr2=0x7fea800b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea80159530 0x7fea800b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 -- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 msgr2=0x7fea8014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 0x7fea8014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 -- 172.21.15.26:0/123188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740094f0 con 0x7fea8006e0e0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7f7fe700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 0x7fea8014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea7effd700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fea80089650 tx=0x7fea74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400bbe0 con 0x7fea8006e0e0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea74011420 con 0x7fea8006e0e0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea80152950 con 0x7fea8006e0e0 2023-10-09T11:41:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea740117c0 con 0x7fea8006e0e0 2023-10-09T11:41:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.504+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea80155f50 con 0x7fea8006e0e0 2023-10-09T11:41:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.505+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea80152e70 con 0x7fea8006e0e0 2023-10-09T11:41:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.506+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fea74011bf0 con 0x7fea8006e0e0 2023-10-09T11:41:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.506+0000 7fea677fe700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 0x7fea6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.506+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fea740862d0 con 0x7fea8006e0e0 2023-10-09T11:41:57.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.506+0000 7fea7f7fe700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 0x7fea6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.507+0000 7fea7f7fe700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 0x7fea6c0697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fea700017a0 tx=0x7fea70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.511+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea80152e70 con 0x7fea8006e0e0 2023-10-09T11:41:57.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.703+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea80152e70 con 0x7fea8006e0e0 2023-10-09T11:41:57.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.704+0000 7fea677fe700 1 -- 172.21.15.26:0/123188833 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea80152e70 con 0x7fea8006e0e0 2023-10-09T11:41:57.704 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 msgr2=0x7fea6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 0x7fea6c0697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fea700017a0 tx=0x7fea70009040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 msgr2=0x7fea80155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fea80089650 tx=0x7fea74017000 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 shutdown_connections 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fea6c067320 0x7fea6c0697d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fea80159530 0x7fea800b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea8006dc70 0x7fea8014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 --2- 172.21.15.26:0/123188833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea8006e0e0 0x7fea80155a10 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 >> 172.21.15.26:0/123188833 conn(0x7fea800703a0 msgr2=0x7fea8015aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 shutdown_connections 2023-10-09T11:41:57.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.706+0000 7fea85b4f700 1 -- 172.21.15.26:0/123188833 wait complete. 2023-10-09T11:41:57.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:41:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.837+0000 7f97457ef700 1 Processor -- start 2023-10-09T11:41:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.837+0000 7f97457ef700 1 -- start start 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f97457ef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97401594d0 0x7f97400cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f97457ef700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97400cb1a0 0x7f97400cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f97457ef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974015e010 con 0x7f97401598a0 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f97457ef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974015d420 con 0x7f97401594d0 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f97457ef700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974015d6e0 con 0x7f97400cb1a0 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97401594d0 0x7f97400cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97401594d0 0x7f97400cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36898/0 (socket says 172.21.15.26:36898) 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 -- 172.21.15.26:0/3544395198 learned_addr learned my addr 172.21.15.26:0/3544395198 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973e7fc700 1 --2- 172.21.15.26:0/3544395198 >> v2:172.21.15.67:3300/0 conn(0x7f97400cb1a0 0x7f97400cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 -- 172.21.15.26:0/3544395198 >> v2:172.21.15.67:3300/0 conn(0x7f97400cb1a0 msgr2=0x7f97400cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 --2- 172.21.15.26:0/3544395198 >> v2:172.21.15.67:3300/0 conn(0x7f97400cb1a0 0x7f97400cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 -- 172.21.15.26:0/3544395198 >> v1:172.21.15.67:6789/0 conn(0x7f97401598a0 legacy=0x7f97400ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.838+0000 7f973effd700 1 -- 172.21.15.26:0/3544395198 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974015d9c0 con 0x7f97401594d0 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f973effd700 1 --2- 172.21.15.26:0/3544395198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97401594d0 0x7f97400cea70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f97400633c0 tx=0x7f9738009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b11250b9911f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f973dffb700 1 -- 172.21.15.26:0/3544395198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800e070 con 0x7f97401594d0 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f973dffb700 1 -- 172.21.15.26:0/3544395198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800ba10 con 0x7f97401594d0 2023-10-09T11:41:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f973dffb700 1 -- 172.21.15.26:0/3544395198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380092e0 con 0x7f97401594d0 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 -- 172.21.15.26:0/3544395198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97401594d0 msgr2=0x7f97400cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 --2- 172.21.15.26:0/3544395198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97401594d0 0x7f97400cea70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f97400633c0 tx=0x7f9738009840 comp rx=0 tx=0).stop 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 -- 172.21.15.26:0/3544395198 shutdown_connections 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 --2- 172.21.15.26:0/3544395198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97401594d0 0x7f97400cea70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 --2- 172.21.15.26:0/3544395198 >> v2:172.21.15.67:3300/0 conn(0x7f97400cb1a0 0x7f97400cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 -- 172.21.15.26:0/3544395198 >> 172.21.15.26:0/3544395198 conn(0x7f97400703a0 msgr2=0x7f9740070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 -- 172.21.15.26:0/3544395198 shutdown_connections 2023-10-09T11:41:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.839+0000 7f97457ef700 1 -- 172.21.15.26:0/3544395198 wait complete. 2023-10-09T11:41:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 Processor -- start 2023-10-09T11:41:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 -- start start 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 0x7f974013fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97401598a0 0x7f9740140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400c8510 con 0x7f97400cb1a0 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400b2250 con 0x7f97401598a0 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f97457ef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97400b1c90 con 0x7f97401594d0 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f973effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f973effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36902/0 (socket says 172.21.15.26:36902) 2023-10-09T11:41:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.841+0000 7f973effd700 1 -- 172.21.15.26:0/4174514882 learned_addr learned my addr 172.21.15.26:0/4174514882 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973f7fe700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97401598a0 0x7f9740140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973e7fc700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 0x7f974013fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 -- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 msgr2=0x7f974013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 0x7f974013fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 -- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97401598a0 msgr2=0x7f9740140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97401598a0 0x7f9740140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 -- 172.21.15.26:0/4174514882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738009ae0 con 0x7f97400cb1a0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973e7fc700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 0x7f974013fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f973effd700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9738009fd0 tx=0x7f9738017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380128d0 con 0x7f97400cb1a0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738012a70 con 0x7f97400cb1a0 2023-10-09T11:41:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97400b1f70 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738012e30 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.842+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97400c8a00 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.843+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97400ce1a0 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.843+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f973801d630 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.844+0000 7f9736ffd700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 0x7f97200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.844+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9738086040 con 0x7f97400cb1a0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.844+0000 7f973e7fc700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 0x7f97200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.845+0000 7f973e7fc700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 0x7f97200697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9740160100 tx=0x7f9728008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:57.848+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97380b75a0 con 0x7f97400cb1a0 2023-10-09T11:41:58.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.043+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f974004c3c0 con 0x7f97400cb1a0 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.044+0000 7f9736ffd700 1 -- 172.21.15.26:0/4174514882 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9738052f10 con 0x7f97400cb1a0 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:41:58.044 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:41:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 msgr2=0x7f97200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 0x7f97200697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9740160100 tx=0x7f9728008040 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 msgr2=0x7f974015f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9738009fd0 tx=0x7f9738017000 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 shutdown_connections 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97401598a0 0x7f9740140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97400cb1a0 0x7f974015f670 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9720067320 0x7f97200697d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 --2- 172.21.15.26:0/4174514882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97401594d0 0x7f974013fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 >> 172.21.15.26:0/4174514882 conn(0x7f97400703a0 msgr2=0x7f9740153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 shutdown_connections 2023-10-09T11:41:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.046+0000 7f97457ef700 1 -- 172.21.15.26:0/4174514882 wait complete. 2023-10-09T11:41:58.058 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:41:58.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:41:58.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.180+0000 7f38dc205700 1 Processor -- start 2023-10-09T11:41:58.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.180+0000 7f38dc205700 1 -- start start 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38dc205700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38d4159940 0x7f38d40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38dc205700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38d406cdb0 0x7f38d40aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38dc205700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40af670 con 0x7f38d40b0e00 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38dc205700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40aa2b0 con 0x7f38d406cdb0 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38dc205700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40b12a0 con 0x7f38d4159940 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38da7a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38d406cdb0 0x7f38d40aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38d97a0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f38d40b0e00 0x7f38d406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52406/0 (socket says 172.21.15.26:52406) 2023-10-09T11:41:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.181+0000 7f38d97a0700 1 -- 172.21.15.26:0/3257537163 learned_addr learned my addr 172.21.15.26:0/3257537163 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38d9fa1700 1 --2- 172.21.15.26:0/3257537163 >> v2:172.21.15.67:3300/0 conn(0x7f38d4159940 0x7f38d40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38da7a2700 1 -- 172.21.15.26:0/3257537163 >> v2:172.21.15.67:3300/0 conn(0x7f38d4159940 msgr2=0x7f38d40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38da7a2700 1 --2- 172.21.15.26:0/3257537163 >> v2:172.21.15.67:3300/0 conn(0x7f38d4159940 0x7f38d40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38da7a2700 1 -- 172.21.15.26:0/3257537163 >> v1:172.21.15.26:6789/0 conn(0x7f38d40b0e00 legacy=0x7f38d406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38da7a2700 1 -- 172.21.15.26:0/3257537163 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4159d10 con 0x7f38d406cdb0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38d8f9f700 1 -- 172.21.15.26:0/3257537163 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455443799 0 0) 0x7f38c8001110 con 0x7f38d40b0e00 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38da7a2700 1 --2- 172.21.15.26:0/3257537163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d40aa740 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f38d406a8b0 tx=0x7f38cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453dd59e2830e74b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38d8f9f700 1 -- 172.21.15.26:0/3257537163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00e070 con 0x7f38d406cdb0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38d8f9f700 1 -- 172.21.15.26:0/3257537163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc00bc30 con 0x7f38d406cdb0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.182+0000 7f38d8f9f700 1 -- 172.21.15.26:0/3257537163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc012430 con 0x7f38d406cdb0 2023-10-09T11:41:58.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 -- 172.21.15.26:0/3257537163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 msgr2=0x7f38d40aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 --2- 172.21.15.26:0/3257537163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d40aa740 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f38d406a8b0 tx=0x7f38cc009780 comp rx=0 tx=0).stop 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 -- 172.21.15.26:0/3257537163 shutdown_connections 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 --2- 172.21.15.26:0/3257537163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d40aa740 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 --2- 172.21.15.26:0/3257537163 >> v2:172.21.15.67:3300/0 conn(0x7f38d4159940 0x7f38d40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 -- 172.21.15.26:0/3257537163 >> 172.21.15.26:0/3257537163 conn(0x7f38d40cd3e0 msgr2=0x7f38d40cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 -- 172.21.15.26:0/3257537163 shutdown_connections 2023-10-09T11:41:58.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.183+0000 7f38dc205700 1 -- 172.21.15.26:0/3257537163 wait complete. 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 Processor -- start 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 -- start start 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38d40b0e00 0x7f38d415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38d4159940 0x7f38d40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40ac7f0 con 0x7f38d406cdb0 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40ad650 con 0x7f38d4159940 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.184+0000 7f38dc205700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415baf0 con 0x7f38d40b0e00 2023-10-09T11:41:58.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36916/0 (socket says 172.21.15.26:36916) 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 -- 172.21.15.26:0/2941224805 learned_addr learned my addr 172.21.15.26:0/2941224805 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 -- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38d40b0e00 msgr2=0x7f38d415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38d40b0e00 0x7f38d415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 -- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38d4159940 msgr2=0x7f38d40adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38d4159940 0x7f38d40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 -- 172.21.15.26:0/2941224805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009a20 con 0x7f38d406cdb0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d9fa1700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f38c400d870 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4009630 con 0x7f38d406cdb0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4009790 con 0x7f38d406cdb0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d40aca40 con 0x7f38d406cdb0 2023-10-09T11:41:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4009b50 con 0x7f38d406cdb0 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.185+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40ad000 con 0x7f38d406cdb0 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.186+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d404c3c0 con 0x7f38d406cdb0 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.187+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f38c4014410 con 0x7f38d406cdb0 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.187+0000 7f38d1ffb700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 0x7f38c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.187+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f38c40851b0 con 0x7f38d406cdb0 2023-10-09T11:41:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.187+0000 7f38d97a0700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 0x7f38c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.188+0000 7f38d97a0700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 0x7f38c00697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f38d41579a0 tx=0x7f38c8001270 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.191+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38c4052190 con 0x7f38d406cdb0 2023-10-09T11:41:58.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.382+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f38d40a9980 con 0x7f38d406cdb0 2023-10-09T11:41:58.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.611+0000 7f38d1ffb700 1 -- 172.21.15.26:0/2941224805 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v109) v1 ==== 138+0+0 (secure 0 0 0) 0x7f38c40557b0 con 0x7f38d406cdb0 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 msgr2=0x7f38c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 0x7f38c00697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f38d41579a0 tx=0x7f38c8001270 comp rx=0 tx=0).stop 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 msgr2=0x7f38d4155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f38c400d870 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 shutdown_connections 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38d4159940 0x7f38d40adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d406cdb0 0x7f38d4155480 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f38c0067320 0x7f38c00697d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 --2- 172.21.15.26:0/2941224805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38d40b0e00 0x7f38d415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 >> 172.21.15.26:0/2941224805 conn(0x7f38d40cd3e0 msgr2=0x7f38d4068c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.615+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 shutdown_connections 2023-10-09T11:41:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.616+0000 7f38dc205700 1 -- 172.21.15.26:0/2941224805 wait complete. 2023-10-09T11:41:58.618 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:41:58.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:41:58.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.757+0000 7f020d0c0700 1 Processor -- start 2023-10-09T11:41:58.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.757+0000 7f020d0c0700 1 -- start start 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020d0c0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0208159530 0x7f02080ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020d0c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f020806dc70 0x7f0208159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020d0c0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080ccfd0 con 0x7f020806e0e0 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020d0c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080cf0e0 con 0x7f020806dc70 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020d0c0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020815a3d0 con 0x7f0208159530 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f020806dc70 0x7f0208159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f020806dc70 0x7f0208159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36920/0 (socket says 172.21.15.26:36920) 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 -- 172.21.15.26:0/2943037138 learned_addr learned my addr 172.21.15.26:0/2943037138 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f0206d9d700 1 --2- 172.21.15.26:0/2943037138 >> v2:172.21.15.67:3300/0 conn(0x7f0208159530 0x7f02080ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 -- 172.21.15.26:0/2943037138 >> v2:172.21.15.67:3300/0 conn(0x7f0208159530 msgr2=0x7f02080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 --2- 172.21.15.26:0/2943037138 >> v2:172.21.15.67:3300/0 conn(0x7f0208159530 0x7f02080ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 -- 172.21.15.26:0/2943037138 >> v1:172.21.15.67:6789/0 conn(0x7f020806e0e0 legacy=0x7f02080cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 -- 172.21.15.26:0/2943037138 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020815a6b0 con 0x7f020806dc70 2023-10-09T11:41:58.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f020659c700 1 --2- 172.21.15.26:0/2943037138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806dc70 0x7f0208159900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f020806d630 tx=0x7f01fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf65ca130cddfa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f0205d9b700 1 -- 172.21.15.26:0/2943037138 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00b860 con 0x7f020806dc70 2023-10-09T11:41:58.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f0205d9b700 1 -- 172.21.15.26:0/2943037138 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00b9c0 con 0x7f020806dc70 2023-10-09T11:41:58.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.758+0000 7f0205d9b700 1 -- 172.21.15.26:0/2943037138 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00bd60 con 0x7f020806dc70 2023-10-09T11:41:58.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 -- 172.21.15.26:0/2943037138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806dc70 msgr2=0x7f0208159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 --2- 172.21.15.26:0/2943037138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806dc70 0x7f0208159900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f020806d630 tx=0x7f01fc009250 comp rx=0 tx=0).stop 2023-10-09T11:41:58.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 -- 172.21.15.26:0/2943037138 shutdown_connections 2023-10-09T11:41:58.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 --2- 172.21.15.26:0/2943037138 >> v2:172.21.15.67:3300/0 conn(0x7f0208159530 0x7f02080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 --2- 172.21.15.26:0/2943037138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806dc70 0x7f0208159900 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 -- 172.21.15.26:0/2943037138 >> 172.21.15.26:0/2943037138 conn(0x7f02080703a0 msgr2=0x7f02080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 -- 172.21.15.26:0/2943037138 shutdown_connections 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.759+0000 7f020d0c0700 1 -- 172.21.15.26:0/2943037138 wait complete. 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.760+0000 7f020d0c0700 1 Processor -- start 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.760+0000 7f020d0c0700 1 -- start start 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020806dc70 0x7f0208153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0208159530 0x7f0208151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020816e210 con 0x7f020806e0e0 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208153a90 con 0x7f020806dc70 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020d0c0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020816d600 con 0x7f0208159530 2023-10-09T11:41:58.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36924/0 (socket says 172.21.15.26:36924) 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 -- 172.21.15.26:0/3438553433 learned_addr learned my addr 172.21.15.26:0/3438553433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f0206d9d700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020806dc70 0x7f0208153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020759e700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0208159530 0x7f0208151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 -- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0208159530 msgr2=0x7f0208151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0208159530 0x7f0208151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 -- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020806dc70 msgr2=0x7f0208153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020806dc70 0x7f0208153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.761+0000 7f020659c700 1 -- 172.21.15.26:0/3438553433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0094f0 con 0x7f020806e0e0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f020659c700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0208089650 tx=0x7f01fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc024440 con 0x7f020806e0e0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0245c0 con 0x7f020806e0e0 2023-10-09T11:41:58.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020816d8e0 con 0x7f020806e0e0 2023-10-09T11:41:58.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc024980 con 0x7f020806e0e0 2023-10-09T11:41:58.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.762+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020816dea0 con 0x7f020806e0e0 2023-10-09T11:41:58.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.763+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02080b3480 con 0x7f020806e0e0 2023-10-09T11:41:58.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.763+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f01fc01a420 con 0x7f020806e0e0 2023-10-09T11:41:58.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.764+0000 7f01eeffd700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 0x7f01f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.764+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f01fc086a70 con 0x7f020806e0e0 2023-10-09T11:41:58.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.764+0000 7f0206d9d700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 0x7f01f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.765+0000 7f0206d9d700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 0x7f01f40697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f01f8006fd0 tx=0x7f01f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.768+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01fc053920 con 0x7f020806e0e0 2023-10-09T11:41:58.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:58.961+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f02080b3480 con 0x7f020806e0e0 2023-10-09T11:41:59.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.615+0000 7f01eeffd700 1 -- 172.21.15.26:0/3438553433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v110) v1 ==== 170+0+0 (secure 0 0 0) 0x7f02080b3480 con 0x7f020806e0e0 2023-10-09T11:41:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 msgr2=0x7f01f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 0x7f01f40697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f01f8006fd0 tx=0x7f01f8008040 comp rx=0 tx=0).stop 2023-10-09T11:41:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 msgr2=0x7f020815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0208089650 tx=0x7f01fc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 shutdown_connections 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f01f4067320 0x7f01f40697d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0208159530 0x7f0208151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020806dc70 0x7f0208153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 --2- 172.21.15.26:0/3438553433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020806e0e0 0x7f020815da00 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.631+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 >> 172.21.15.26:0/3438553433 conn(0x7f02080703a0 msgr2=0x7f02080cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.632+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 shutdown_connections 2023-10-09T11:41:59.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.633+0000 7f020d0c0700 1 -- 172.21.15.26:0/3438553433 wait complete. 2023-10-09T11:41:59.636 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:41:59.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:41:59.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.773+0000 7f6744984700 1 Processor -- start 2023-10-09T11:41:59.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.773+0000 7f6744984700 1 -- start start 2023-10-09T11:41:59.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f6744984700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6740157930 0x7f67400ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f6744984700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67400cd2b0 0x7f67400ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f6744984700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400c32a0 con 0x7f67400ca2c0 2023-10-09T11:41:59.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f6744984700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400c9730 con 0x7f6740157930 2023-10-09T11:41:59.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f6744984700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c4100 con 0x7f67400cd2b0 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f673dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f67400ca2c0 0x7f67400ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60474/0 (socket says 172.21.15.26:60474) 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.774+0000 7f673dd9b700 1 -- 172.21.15.26:0/3991844775 learned_addr learned my addr 172.21.15.26:0/3991844775 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 --2- 172.21.15.26:0/3991844775 >> v2:172.21.15.67:3300/0 conn(0x7f6740157930 0x7f67400ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673ed9d700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67400cd2b0 0x7f67400ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673d59a700 1 -- 172.21.15.26:0/3991844775 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107810244 0 0) 0x7f67400c32a0 con 0x7f67400ca2c0 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673d59a700 1 -- 172.21.15.26:0/3991844775 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c003570 con 0x7f67400ca2c0 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 -- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67400cd2b0 msgr2=0x7f67400ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67400cd2b0 0x7f67400ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 -- 172.21.15.26:0/3991844775 >> v1:172.21.15.26:6789/0 conn(0x7f67400ca2c0 legacy=0x7f67400ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 -- 172.21.15.26:0/3991844775 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400c34f0 con 0x7f6740157930 2023-10-09T11:41:59.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673e59c700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740157930 0x7f67400ab070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6730009e60 tx=0x7f6730009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c19e1845e10850 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673d59a700 1 -- 172.21.15.26:0/3991844775 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000e070 con 0x7f6740157930 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673d59a700 1 -- 172.21.15.26:0/3991844775 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673000bab0 con 0x7f6740157930 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.775+0000 7f673d59a700 1 -- 172.21.15.26:0/3991844775 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000be70 con 0x7f6740157930 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 -- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740157930 msgr2=0x7f67400ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740157930 0x7f67400ab070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6730009e60 tx=0x7f6730009780 comp rx=0 tx=0).stop 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 -- 172.21.15.26:0/3991844775 shutdown_connections 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67400cd2b0 0x7f67400ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 --2- 172.21.15.26:0/3991844775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6740157930 0x7f67400ab070 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 -- 172.21.15.26:0/3991844775 >> 172.21.15.26:0/3991844775 conn(0x7f6740088000 msgr2=0x7f67400883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 -- 172.21.15.26:0/3991844775 shutdown_connections 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.776+0000 7f6744984700 1 -- 172.21.15.26:0/3991844775 wait complete. 2023-10-09T11:41:59.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.777+0000 7f6744984700 1 Processor -- start 2023-10-09T11:41:59.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.777+0000 7f6744984700 1 -- start start 2023-10-09T11:41:59.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400cd2b0 0x7f6740154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 0x7f6740155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400af0c0 con 0x7f67400ca2c0 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400b3640 con 0x7f67400cd2b0 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f6744984700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400b3920 con 0x7f6740157930 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42836/0 (socket says 172.21.15.26:42836) 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 -- 172.21.15.26:0/3887765097 learned_addr learned my addr 172.21.15.26:0/3887765097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673dd9b700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400cd2b0 0x7f6740154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 -- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 msgr2=0x7f6740155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673ed9d700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 0x7f6740155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 0x7f6740155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 -- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400cd2b0 msgr2=0x7f6740154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400cd2b0 0x7f6740154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 -- 172.21.15.26:0/3887765097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009a20 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673ed9d700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 0x7f6740155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.778+0000 7f673e59c700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d30 tx=0x7f6730019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730012d00 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400b3c00 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730012e80 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300276c0 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740140610 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.779+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400b40a0 con 0x7f67400ca2c0 2023-10-09T11:41:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.780+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6730024070 con 0x7f67400ca2c0 2023-10-09T11:41:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.780+0000 7f67367fc700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 0x7f67200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.781+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f67300870f0 con 0x7f67400ca2c0 2023-10-09T11:41:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.781+0000 7f673dd9b700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 0x7f67200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.781+0000 7f673dd9b700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 0x7f67200697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f67400692a0 tx=0x7f6728009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:41:59.785+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6730053de0 con 0x7f67400ca2c0 2023-10-09T11:42:00.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.022+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f674004c3c0 con 0x7f67400ca2c0 2023-10-09T11:42:00.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.626+0000 7f67367fc700 1 -- 172.21.15.26:0/3887765097 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6730057400 con 0x7f67400ca2c0 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 msgr2=0x7f67200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 0x7f67200697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f67400692a0 tx=0x7f6728009040 comp rx=0 tx=0).stop 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 msgr2=0x7f67401400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d30 tx=0x7f6730019000 comp rx=0 tx=0).stop 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 shutdown_connections 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6720067320 0x7f67200697d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6740157930 0x7f6740155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400ca2c0 0x7f67401400d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 --2- 172.21.15.26:0/3887765097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400cd2b0 0x7f6740154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 >> 172.21.15.26:0/3887765097 conn(0x7f6740088000 msgr2=0x7f67400ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 shutdown_connections 2023-10-09T11:42:00.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.629+0000 7f6744984700 1 -- 172.21.15.26:0/3887765097 wait complete. 2023-10-09T11:42:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T11:42:00.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.768+0000 7fd13f61e700 1 Processor -- start 2023-10-09T11:42:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.768+0000 7fd13f61e700 1 -- start start 2023-10-09T11:42:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13f61e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd138159c80 0x7fd1380cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13f61e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd1380cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13f61e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380ce9d0 con 0x7fd1381598b0 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13f61e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380af960 con 0x7fd138159c80 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13f61e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380afc30 con 0x7fd1380cfe70 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.769+0000 7fd13cbb9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd138159c80 0x7fd1380cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd138159c80 0x7fd1380cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42848/0 (socket says 172.21.15.26:42848) 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 -- 172.21.15.26:0/4259411446 learned_addr learned my addr 172.21.15.26:0/4259411446 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13dbbb700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd1380cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 -- 172.21.15.26:0/4259411446 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 msgr2=0x7fd1380cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd1380cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 -- 172.21.15.26:0/4259411446 >> v1:172.21.15.67:6789/0 conn(0x7fd1381598b0 legacy=0x7fd1380af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 -- 172.21.15.26:0/4259411446 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380aff10 con 0x7fd138159c80 2023-10-09T11:42:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13dbbb700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd1380cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd13cbb9700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380cb6f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0099b0 tx=0x7fd12c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1987c9eddffcb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd137fff700 1 -- 172.21.15.26:0/4259411446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00b860 con 0x7fd138159c80 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd137fff700 1 -- 172.21.15.26:0/4259411446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00b9c0 con 0x7fd138159c80 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.770+0000 7fd137fff700 1 -- 172.21.15.26:0/4259411446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00bd60 con 0x7fd138159c80 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 -- 172.21.15.26:0/4259411446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 msgr2=0x7fd1380cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380cb6f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0099b0 tx=0x7fd12c009250 comp rx=0 tx=0).stop 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 -- 172.21.15.26:0/4259411446 shutdown_connections 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd1380cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 --2- 172.21.15.26:0/4259411446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380cb6f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 -- 172.21.15.26:0/4259411446 >> 172.21.15.26:0/4259411446 conn(0x7fd138070e30 msgr2=0x7fd1380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 -- 172.21.15.26:0/4259411446 shutdown_connections 2023-10-09T11:42:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.771+0000 7fd13f61e700 1 -- 172.21.15.26:0/4259411446 wait complete. 2023-10-09T11:42:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.772+0000 7fd13f61e700 1 Processor -- start 2023-10-09T11:42:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.772+0000 7fd13f61e700 1 -- start start 2023-10-09T11:42:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd13814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 0x7fd1380c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380ca0d0 con 0x7fd138159c80 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c94c0 con 0x7fd1381598b0 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13f61e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c97a0 con 0x7fd1380cfe70 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42858/0 (socket says 172.21.15.26:42858) 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 -- 172.21.15.26:0/1512652758 learned_addr learned my addr 172.21.15.26:0/1512652758 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13d3ba700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd13814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 -- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 msgr2=0x7fd13814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd13814a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13cbb9700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 0x7fd1380c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 -- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 msgr2=0x7fd1380c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 0x7fd1380c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13dbbb700 1 -- 172.21.15.26:0/1512652758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c0094f0 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.773+0000 7fd13cbb9700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 0x7fd1380c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd13dbbb700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c880 tx=0x7fd128008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011600 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128011780 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011b40 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380c9a80 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.774+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13814a680 con 0x7fd138159c80 2023-10-09T11:42:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.775+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13804c3c0 con 0x7fd138159c80 2023-10-09T11:42:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.775+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd128018350 con 0x7fd138159c80 2023-10-09T11:42:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.776+0000 7fd1357fa700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 0x7fd1240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.776+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd128084d40 con 0x7fd138159c80 2023-10-09T11:42:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.776+0000 7fd13d3ba700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 0x7fd1240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.776+0000 7fd13d3ba700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 0x7fd1240697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd130007fd0 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.780+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd128055350 con 0x7fd138159c80 2023-10-09T11:42:00.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.976+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1380ce380 con 0x7fd138159c80 2023-10-09T11:42:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.977+0000 7fd1357fa700 1 -- 172.21.15.26:0/1512652758 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fd12801e090 con 0x7fd138159c80 2023-10-09T11:42:00.979 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:00.979 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":111,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:00.022916+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:00.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 msgr2=0x7fd1240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 0x7fd1240697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd130007fd0 tx=0x7fd130009040 comp rx=0 tx=0).stop 2023-10-09T11:42:00.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 msgr2=0x7fd1380c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c880 tx=0x7fd128008040 comp rx=0 tx=0).stop 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 shutdown_connections 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd138159c80 0x7fd1380c6910 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd124067320 0x7fd1240697d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1380cfe70 0x7fd13814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 --2- 172.21.15.26:0/1512652758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1381598b0 0x7fd1380c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 >> 172.21.15.26:0/1512652758 conn(0x7fd138070e30 msgr2=0x7fd1380b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 shutdown_connections 2023-10-09T11:42:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:00.980+0000 7fd13f61e700 1 -- 172.21.15.26:0/1512652758 wait complete. 2023-10-09T11:42:00.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:01.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.111+0000 7ffa22f80700 1 Processor -- start 2023-10-09T11:42:01.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.111+0000 7ffa22f80700 1 -- start start 2023-10-09T11:42:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa22f80700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 0x7ffa1c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa22f80700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c15a280 con 0x7ffa1c0cf200 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa22f80700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c06e180 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa22f80700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c06d850 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa1c0cf200 0x7ffa1c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60486/0 (socket says 172.21.15.26:60486) 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1bfff700 1 -- 172.21.15.26:0/2641292925 learned_addr learned my addr 172.21.15.26:0/2641292925 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa2151d700 1 --2- 172.21.15.26:0/2641292925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 0x7ffa1c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810708065 0 0) 0x7ffa1c15a280 con 0x7ffa1c0cf200 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003570 con 0x7ffa1c0cf200 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986961192 0 0) 0x7ffa1c06e180 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa1c15a280 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa2151d700 1 -- 172.21.15.26:0/2641292925 >> v1:172.21.15.67:6789/0 conn(0x7ffa1c0b07d0 legacy=0x7ffa1c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690402977 0 0) 0x7ffa04003570 con 0x7ffa1c0cf200 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa2151d700 1 -- 172.21.15.26:0/2641292925 >> v1:172.21.15.26:6789/0 conn(0x7ffa1c0cf200 legacy=0x7ffa1c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.112+0000 7ffa2151d700 1 -- 172.21.15.26:0/2641292925 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c06db30 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa2151d700 1 --2- 172.21.15.26:0/2641292925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 0x7ffa1c0c42c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009910 tx=0x7ffa0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e264cb4f059a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10001470 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c011420 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa1b7fe700 1 -- 172.21.15.26:0/2641292925 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0117c0 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 -- 172.21.15.26:0/2641292925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 msgr2=0x7ffa1c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 --2- 172.21.15.26:0/2641292925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 0x7ffa1c0c42c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009910 tx=0x7ffa0c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 -- 172.21.15.26:0/2641292925 shutdown_connections 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 --2- 172.21.15.26:0/2641292925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0b0ba0 0x7ffa1c0c42c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 -- 172.21.15.26:0/2641292925 >> 172.21.15.26:0/2641292925 conn(0x7ffa1c06ce80 msgr2=0x7ffa1c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 -- 172.21.15.26:0/2641292925 shutdown_connections 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.113+0000 7ffa22f80700 1 -- 172.21.15.26:0/2641292925 wait complete. 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.114+0000 7ffa22f80700 1 Processor -- start 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 -- start start 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa1c0b0ba0 0x7ffa1c099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0cf200 0x7ffa1c14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c5e10 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c60f0 con 0x7ffa1c0b0ba0 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa22f80700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c63d0 con 0x7ffa1c0cf200 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.115+0000 7ffa20d1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42864/0 (socket says 172.21.15.26:42864) 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 -- 172.21.15.26:0/1253412000 learned_addr learned my addr 172.21.15.26:0/1253412000 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa1bfff700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa1c0b0ba0 0x7ffa1c099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa2151d700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0cf200 0x7ffa1c14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 -- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0cf200 msgr2=0x7ffa1c14afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0cf200 0x7ffa1c14afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 -- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa1c0b0ba0 msgr2=0x7ffa1c099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa1c0b0ba0 0x7ffa1c099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 -- 172.21.15.26:0/1253412000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009420 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa20d1c700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400cd80 tx=0x7ffa14002c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400aac0 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1400ac20 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14012420 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c0c66b0 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.116+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c0c5b00 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.117+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c071210 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.118+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa140127d0 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.118+0000 7ffa18ff9700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 0x7ffa080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.118+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa14085320 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.118+0000 7ffa1bfff700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 0x7ffa080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.119+0000 7ffa1bfff700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 0x7ffa080697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0ca590 tx=0x7ffa10000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.122+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa14051fb0 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.318+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa1c06de10 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.319+0000 7ffa18ff9700 1 -- 172.21.15.26:0/1253412000 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15316 (secure 0 0 0) 0x7ffa140555d0 con 0x7ffa1c0b07d0 2023-10-09T11:42:01.320 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:01.320 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:01.197470+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 msgr2=0x7ffa080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 0x7ffa080697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0ca590 tx=0x7ffa10000bc0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 msgr2=0x7ffa1c0c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400cd80 tx=0x7ffa14002c30 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 shutdown_connections 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa08067320 0x7ffa080697d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa1c0cf200 0x7ffa1c14afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa1c0b07d0 0x7ffa1c0c55c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 --2- 172.21.15.26:0/1253412000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa1c0b0ba0 0x7ffa1c099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 >> 172.21.15.26:0/1253412000 conn(0x7ffa1c06ce80 msgr2=0x7ffa1c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 shutdown_connections 2023-10-09T11:42:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.321+0000 7ffa22f80700 1 -- 172.21.15.26:0/1253412000 wait complete. 2023-10-09T11:42:01.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:42:01.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.456+0000 7ff2772ae700 1 Processor -- start 2023-10-09T11:42:01.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.457+0000 7ff2772ae700 1 -- start start 2023-10-09T11:42:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.457+0000 7ff2772ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2700ca2c0 0x7ff2700ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.457+0000 7ff2772ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c32a0 con 0x7ff2700ccba0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.457+0000 7ff2772ae700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c4100 con 0x7ff270157930 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.457+0000 7ff2772ae700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700c9730 con 0x7ff2700ca2c0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff274849700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2700ca2c0 0x7ff2700ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff27584b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff2700ccba0 0x7ff2700c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60500/0 (socket says 172.21.15.26:60500) 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff27584b700 1 -- 172.21.15.26:0/3086428308 learned_addr learned my addr 172.21.15.26:0/3086428308 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff274849700 1 -- 172.21.15.26:0/3086428308 >> v1:172.21.15.67:6789/0 conn(0x7ff270157930 legacy=0x7ff2700ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff274849700 1 -- 172.21.15.26:0/3086428308 >> v1:172.21.15.26:6789/0 conn(0x7ff2700ccba0 legacy=0x7ff2700c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff274849700 1 -- 172.21.15.26:0/3086428308 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700c34f0 con 0x7ff2700ca2c0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff26ffff700 1 -- 172.21.15.26:0/3086428308 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478421516 0 0) 0x7ff2700c32a0 con 0x7ff2700ccba0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff274849700 1 --2- 172.21.15.26:0/3086428308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2700ca2c0 0x7ff2700ca730 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff2640098e0 tx=0x7ff2640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a62819c68cddfa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff26ffff700 1 -- 172.21.15.26:0/3086428308 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264009e80 con 0x7ff2700ca2c0 2023-10-09T11:42:01.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff26ffff700 1 -- 172.21.15.26:0/3086428308 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26400b820 con 0x7ff2700ca2c0 2023-10-09T11:42:01.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.458+0000 7ff26ffff700 1 -- 172.21.15.26:0/3086428308 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400bba0 con 0x7ff2700ca2c0 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 -- 172.21.15.26:0/3086428308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2700ca2c0 msgr2=0x7ff2700ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 --2- 172.21.15.26:0/3086428308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2700ca2c0 0x7ff2700ca730 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff2640098e0 tx=0x7ff2640091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 -- 172.21.15.26:0/3086428308 shutdown_connections 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 --2- 172.21.15.26:0/3086428308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2700ca2c0 0x7ff2700ca730 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 -- 172.21.15.26:0/3086428308 >> 172.21.15.26:0/3086428308 conn(0x7ff270088000 msgr2=0x7ff2700883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 -- 172.21.15.26:0/3086428308 shutdown_connections 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.459+0000 7ff2772ae700 1 -- 172.21.15.26:0/3086428308 wait complete. 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.460+0000 7ff2772ae700 1 Processor -- start 2023-10-09T11:42:01.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.460+0000 7ff2772ae700 1 -- start start 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2700ca2c0 0x7ff2701527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2700ccba0 0x7ff2700c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270069480 con 0x7ff270157930 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270069690 con 0x7ff2700ca2c0 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff2772ae700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270069970 con 0x7ff2700ccba0 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42880/0 (socket says 172.21.15.26:42880) 2023-10-09T11:42:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 -- 172.21.15.26:0/1737258434 learned_addr learned my addr 172.21.15.26:0/1737258434 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff274849700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2700ccba0 0x7ff2700c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27504a700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2700ca2c0 0x7ff2701527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 -- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2700ccba0 msgr2=0x7ff2700c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2700ccba0 0x7ff2700c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 -- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2700ca2c0 msgr2=0x7ff2701527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2700ca2c0 0x7ff2701527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 -- 172.21.15.26:0/1737258434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009420 con 0x7ff270157930 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff27584b700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff26000cc90 tx=0x7ff260001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000cea0 con 0x7ff270157930 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.461+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000ab70 con 0x7ff270157930 2023-10-09T11:42:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.462+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2700c73f0 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.462+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2600070f0 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.462+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff270152da0 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.463+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2700c7910 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.463+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff2600074a0 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.463+0000 7ff26d7fa700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 0x7ff25c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.463+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2600850e0 con 0x7ff270157930 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.464+0000 7ff27504a700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 0x7ff25c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.464+0000 7ff27504a700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 0x7ff25c069800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff2680027e0 tx=0x7ff268009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.468+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2700c7910 con 0x7ff270157930 2023-10-09T11:42:01.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:01.706+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2700c7910 con 0x7ff270157930 2023-10-09T11:42:02.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.639+0000 7ff26d7fa700 1 -- 172.21.15.26:0/1737258434 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff2700c7910 con 0x7ff270157930 2023-10-09T11:42:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 msgr2=0x7ff25c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 0x7ff25c069800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff2680027e0 tx=0x7ff268009040 comp rx=0 tx=0).stop 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 msgr2=0x7ff2700c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff26000cc90 tx=0x7ff260001a80 comp rx=0 tx=0).stop 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 shutdown_connections 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff270157930 0x7ff2700c7bf0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2700ca2c0 0x7ff2701527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff25c067350 0x7ff25c069800 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 --2- 172.21.15.26:0/1737258434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2700ccba0 0x7ff2700c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 >> 172.21.15.26:0/1737258434 conn(0x7ff270088000 msgr2=0x7ff270154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 shutdown_connections 2023-10-09T11:42:02.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.642+0000 7ff2772ae700 1 -- 172.21.15.26:0/1737258434 wait complete. 2023-10-09T11:42:02.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:42:02.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.783+0000 7f4e43c78700 1 Processor -- start 2023-10-09T11:42:02.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.783+0000 7f4e43c78700 1 -- start start 2023-10-09T11:42:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e43c78700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e3c06e0e0 0x7f4e3c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e43c78700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0ccfd0 con 0x7f4e3c06dc70 2023-10-09T11:42:02.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e43c78700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c15a3d0 con 0x7f4e3c159530 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e43c78700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c15a6b0 con 0x7f4e3c06e0e0 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e41213700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e3c06dc70 0x7f4e3c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60510/0 (socket says 172.21.15.26:60510) 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.784+0000 7f4e41213700 1 -- 172.21.15.26:0/2013755475 learned_addr learned my addr 172.21.15.26:0/2013755475 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437269032 0 0) 0x7f4e3c0ccfd0 con 0x7f4e3c06dc70 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e42215700 1 --2- 172.21.15.26:0/2013755475 >> v2:172.21.15.67:3300/0 conn(0x7f4e3c06e0e0 0x7f4e3c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e24003570 con 0x7f4e3c06dc70 2023-10-09T11:42:02.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113904930 0 0) 0x7f4e24003570 con 0x7f4e3c06dc70 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 >> v2:172.21.15.67:3300/0 conn(0x7f4e3c06e0e0 msgr2=0x7f4e3c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 --2- 172.21.15.26:0/2013755475 >> v2:172.21.15.67:3300/0 conn(0x7f4e3c06e0e0 0x7f4e3c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 >> v1:172.21.15.67:6789/0 conn(0x7f4e3c159530 legacy=0x7f4e3c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c15a990 con 0x7f4e3c06dc70 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4e30001470 con 0x7f4e3c06dc70 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 >> v1:172.21.15.26:6789/0 conn(0x7f4e3c06dc70 legacy=0x7f4e3c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e24003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e24004810 0x7f4e24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e24005210 0x7f4e2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c15a6b0 con 0x7f4e24003ab0 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2400c130 con 0x7f4e24005210 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2400c2f0 con 0x7f4e24004810 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e24003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41213700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e24004810 0x7f4e24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e42215700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e24005210 0x7f4e2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 -- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e24004810 msgr2=0x7f4e24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e24004810 0x7f4e24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 -- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e24005210 msgr2=0x7f4e2400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e24005210 0x7f4e2400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41a14700 1 -- 172.21.15.26:0/2013755475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24003570 con 0x7f4e24003ab0 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e41213700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e24004810 0x7f4e24004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.785+0000 7f4e42215700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e24005210 0x7f4e2400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e42215700 1 -- 172.21.15.26:0/2013755475 reap_dead start 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e24003ec0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c001fc0 tx=0x7f4e2c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1e605100131406 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c001950 con 0x7f4e24003ab0 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00c8b0 con 0x7f4e24003ab0 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e40a12700 1 -- 172.21.15.26:0/2013755475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00cc50 con 0x7f4e24003ab0 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 -- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 msgr2=0x7f4e24003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e24003ec0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c001fc0 tx=0x7f4e2c001640 comp rx=0 tx=0).stop 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 -- 172.21.15.26:0/2013755475 shutdown_connections 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2013755475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e24003ec0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 -- 172.21.15.26:0/2013755475 >> 172.21.15.26:0/2013755475 conn(0x7f4e3c0703a0 msgr2=0x7f4e3c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 -- 172.21.15.26:0/2013755475 shutdown_connections 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.786+0000 7f4e43c78700 1 -- 172.21.15.26:0/2013755475 wait complete. 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 Processor -- start 2023-10-09T11:42:02.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 -- start start 2023-10-09T11:42:02.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e3c0c8150 0x7f4e3c16cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e3c0d0390 0x7f4e3c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c9500 con 0x7f4e24003ab0 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0d0d40 con 0x7f4e3c0d0390 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e43c78700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c88f0 con 0x7f4e3c0c8150 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e41a14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.788+0000 7f4e41a14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42894/0 (socket says 172.21.15.26:42894) 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 -- 172.21.15.26:0/2095418441 learned_addr learned my addr 172.21.15.26:0/2095418441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41213700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e3c0c8150 0x7f4e3c16cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e42215700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e3c0d0390 0x7f4e3c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 -- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e3c0c8150 msgr2=0x7f4e3c16cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e3c0c8150 0x7f4e3c16cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 -- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e3c0d0390 msgr2=0x7f4e3c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e3c0d0390 0x7f4e3c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 -- 172.21.15.26:0/2095418441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0c8bd0 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e41a14700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c6a0 tx=0x7f4e2c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c001950 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00c6d0 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c0c8eb0 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c026400 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.789+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c0c85c0 con 0x7f4e24003ab0 2023-10-09T11:42:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.790+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c04c3c0 con 0x7f4e24003ab0 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.791+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e2c019030 con 0x7f4e24003ab0 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.791+0000 7f4e39ffb700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 0x7f4e280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.791+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e2c0866f0 con 0x7f4e24003ab0 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.792+0000 7f4e41213700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 0x7f4e280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.792+0000 7f4e41213700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 0x7f4e280697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b1980 tx=0x7f4e30007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:02.796+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e2c0533a0 con 0x7f4e24003ab0 2023-10-09T11:42:03.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.037+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4e3c15ac70 con 0x7f4e24003ab0 2023-10-09T11:42:03.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.644+0000 7f4e39ffb700 1 -- 172.21.15.26:0/2095418441 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4e2c007d70 con 0x7f4e24003ab0 2023-10-09T11:42:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 msgr2=0x7f4e280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 0x7f4e280697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b1980 tx=0x7f4e30007040 comp rx=0 tx=0).stop 2023-10-09T11:42:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 msgr2=0x7f4e3c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c6a0 tx=0x7f4e2c015000 comp rx=0 tx=0).stop 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 shutdown_connections 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e3c0d0390 0x7f4e3c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e24003ab0 0x7f4e3c0b5920 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4e28067320 0x7f4e280697d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 --2- 172.21.15.26:0/2095418441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e3c0c8150 0x7f4e3c16cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 >> 172.21.15.26:0/2095418441 conn(0x7f4e3c0703a0 msgr2=0x7f4e3c153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 shutdown_connections 2023-10-09T11:42:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.647+0000 7f4e43c78700 1 -- 172.21.15.26:0/2095418441 wait complete. 2023-10-09T11:42:03.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.786+0000 7fe63e5cb700 1 Processor -- start 2023-10-09T11:42:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.786+0000 7fe63e5cb700 1 -- start start 2023-10-09T11:42:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe63e5cb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 0x7fe638156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe63e5cb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63815ae40 con 0x7fe6380cb5a0 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe63e5cb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63815ab60 con 0x7fe6380cb970 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe63e5cb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380ce0f0 con 0x7fe63815a5d0 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe637fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6380cb5a0 0x7fe6380cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60514/0 (socket says 172.21.15.26:60514) 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe637fff700 1 -- 172.21.15.26:0/3077211400 learned_addr learned my addr 172.21.15.26:0/3077211400 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.787+0000 7fe63cb68700 1 --2- 172.21.15.26:0/3077211400 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 0x7fe638156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196403892 0 0) 0x7fe63815ae40 con 0x7fe6380cb5a0 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe620003570 con 0x7fe6380cb5a0 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601457302 0 0) 0x7fe63815ab60 con 0x7fe6380cb970 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63815ae40 con 0x7fe6380cb970 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369701980 0 0) 0x7fe620003570 con 0x7fe6380cb5a0 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe63cb68700 1 -- 172.21.15.26:0/3077211400 >> v1:172.21.15.67:6789/0 conn(0x7fe6380cb970 legacy=0x7fe638159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe63cb68700 1 -- 172.21.15.26:0/3077211400 >> v1:172.21.15.26:6789/0 conn(0x7fe6380cb5a0 legacy=0x7fe6380cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe63cb68700 1 -- 172.21.15.26:0/3077211400 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380ccf00 con 0x7fe63815a5d0 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe63cb68700 1 --2- 172.21.15.26:0/3077211400 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 0x7fe638156e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e90 tx=0x7fe630009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5061f241db492621 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000e070 con 0x7fe63815a5d0 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000b870 con 0x7fe63815a5d0 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.788+0000 7fe636ffd700 1 -- 172.21.15.26:0/3077211400 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628001470 con 0x7fe63815a5d0 2023-10-09T11:42:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 -- 172.21.15.26:0/3077211400 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 msgr2=0x7fe638156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/3077211400 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 0x7fe638156e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe630009e90 tx=0x7fe630009780 comp rx=0 tx=0).stop 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 -- 172.21.15.26:0/3077211400 shutdown_connections 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/3077211400 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe63815a5d0 0x7fe638156e90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 -- 172.21.15.26:0/3077211400 >> 172.21.15.26:0/3077211400 conn(0x7fe638070e30 msgr2=0x7fe6380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 -- 172.21.15.26:0/3077211400 shutdown_connections 2023-10-09T11:42:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.789+0000 7fe63e5cb700 1 -- 172.21.15.26:0/3077211400 wait complete. 2023-10-09T11:42:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.790+0000 7fe63e5cb700 1 Processor -- start 2023-10-09T11:42:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.790+0000 7fe63e5cb700 1 -- start start 2023-10-09T11:42:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 0x7fe638151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6380cb970 0x7fe6380b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381547a0 con 0x7fe63815a5d0 2023-10-09T11:42:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380b5c60 con 0x7fe6380cb5a0 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63e5cb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380b5f40 con 0x7fe6380cb970 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42906/0 (socket says 172.21.15.26:42906) 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 -- 172.21.15.26:0/2201491654 learned_addr learned my addr 172.21.15.26:0/2201491654 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe637fff700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 0x7fe638151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe6377fe700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6380cb970 0x7fe6380b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 -- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6380cb970 msgr2=0x7fe6380b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6380cb970 0x7fe6380b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 -- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 msgr2=0x7fe638151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 0x7fe638151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe63cb68700 1 -- 172.21.15.26:0/2201491654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009a20 con 0x7fe63815a5d0 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.791+0000 7fe637fff700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 0x7fe638151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe63cb68700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe63806ea60 tx=0x7fe630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630012d10 con 0x7fe63815a5d0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630012e90 con 0x7fe63815a5d0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380b6220 con 0x7fe63815a5d0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63001e6a0 con 0x7fe63815a5d0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.792+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe638151c50 con 0x7fe63815a5d0 2023-10-09T11:42:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.793+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63804c3c0 con 0x7fe63815a5d0 2023-10-09T11:42:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.793+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe63001ea50 con 0x7fe63815a5d0 2023-10-09T11:42:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.793+0000 7fe61ffff700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 0x7fe6240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.794+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe630087280 con 0x7fe63815a5d0 2023-10-09T11:42:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.794+0000 7fe637fff700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 0x7fe6240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.794+0000 7fe637fff700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 0x7fe6240697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe6280015a0 tx=0x7fe628000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:03.798+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe630053e00 con 0x7fe63815a5d0 2023-10-09T11:42:04.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.034+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6380b3080 con 0x7fe63815a5d0 2023-10-09T11:42:04.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.034+0000 7fe61ffff700 1 -- 172.21.15.26:0/2201491654 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe630057420 con 0x7fe63815a5d0 2023-10-09T11:42:04.036 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:04.036 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7185,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2449545220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2449545220},{"type":"v1","addr":"172.21.15.26:6834","nonce":2449545220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7188,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2511463047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2511463047},{"type":"v1","addr":"172.21.15.26:6835","nonce":2511463047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:04.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 msgr2=0x7fe6240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 0x7fe6240697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe6280015a0 tx=0x7fe628000bc0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 msgr2=0x7fe63815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe63806ea60 tx=0x7fe630017000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 shutdown_connections 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe63815a5d0 0x7fe63815b520 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6380cb5a0 0x7fe638151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe624067320 0x7fe6240697d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 --2- 172.21.15.26:0/2201491654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6380cb970 0x7fe6380b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 >> 172.21.15.26:0/2201491654 conn(0x7fe638070e30 msgr2=0x7fe6380c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 shutdown_connections 2023-10-09T11:42:04.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.036+0000 7fe63e5cb700 1 -- 172.21.15.26:0/2201491654 wait complete. 2023-10-09T11:42:04.040 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 76 2023-10-09T11:42:04.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:04.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.167+0000 7fa684ea7700 1 Processor -- start 2023-10-09T11:42:04.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.167+0000 7fa684ea7700 1 -- start start 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6800cb5a0 0x7fa6800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa680159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa6800cde50 0x7fa68015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6800d13f0 con 0x7fa6800cb5a0 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68015a940 con 0x7fa6800cde50 2023-10-09T11:42:04.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.168+0000 7fa684ea7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015ae40 con 0x7fa6800cd9e0 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6800cb5a0 0x7fa6800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6800cb5a0 0x7fa6800cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42920/0 (socket says 172.21.15.26:42920) 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 -- 172.21.15.26:0/2357659027 learned_addr learned my addr 172.21.15.26:0/2357659027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67ed9d700 1 --2- 172.21.15.26:0/2357659027 >> v2:172.21.15.67:3300/0 conn(0x7fa6800cde50 0x7fa68015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 -- 172.21.15.26:0/2357659027 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 msgr2=0x7fa680159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2357659027 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa680159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 -- 172.21.15.26:0/2357659027 >> v2:172.21.15.67:3300/0 conn(0x7fa6800cde50 msgr2=0x7fa68015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2357659027 >> v2:172.21.15.67:3300/0 conn(0x7fa6800cde50 0x7fa68015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 -- 172.21.15.26:0/2357659027 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68015ab60 con 0x7fa6800cb5a0 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2357659027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800cb5a0 0x7fa6800cb970 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa6800cbeb0 tx=0x7fa678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28073c61c5fe050a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67d59a700 1 -- 172.21.15.26:0/2357659027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67800b820 con 0x7fa6800cb5a0 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67d59a700 1 -- 172.21.15.26:0/2357659027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67800b980 con 0x7fa6800cb5a0 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.169+0000 7fa67d59a700 1 -- 172.21.15.26:0/2357659027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67800bd20 con 0x7fa6800cb5a0 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 -- 172.21.15.26:0/2357659027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800cb5a0 msgr2=0x7fa6800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2357659027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800cb5a0 0x7fa6800cb970 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa6800cbeb0 tx=0x7fa678009250 comp rx=0 tx=0).stop 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 -- 172.21.15.26:0/2357659027 shutdown_connections 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2357659027 >> v2:172.21.15.67:3300/0 conn(0x7fa6800cde50 0x7fa68015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2357659027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800cb5a0 0x7fa6800cb970 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2357659027 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa680159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 -- 172.21.15.26:0/2357659027 >> 172.21.15.26:0/2357659027 conn(0x7fa680070e30 msgr2=0x7fa6800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 -- 172.21.15.26:0/2357659027 shutdown_connections 2023-10-09T11:42:04.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.170+0000 7fa684ea7700 1 -- 172.21.15.26:0/2357659027 wait complete. 2023-10-09T11:42:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.171+0000 7fa684ea7700 1 Processor -- start 2023-10-09T11:42:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.171+0000 7fa684ea7700 1 -- start start 2023-10-09T11:42:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.171+0000 7fa684ea7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6800cb5a0 0x7fa6801695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.171+0000 7fa684ea7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa6800b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b6490 con 0x7fa6800b5900 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b3b40 con 0x7fa6800cb5a0 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b3e20 con 0x7fa6800cd9e0 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42934/0 (socket says 172.21.15.26:42934) 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 -- 172.21.15.26:0/2504632344 learned_addr learned my addr 172.21.15.26:0/2504632344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6800cb5a0 0x7fa6801695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67dd9b700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa6800b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 -- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 msgr2=0x7fa6800b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa6800b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 -- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6800cb5a0 msgr2=0x7fa6801695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6800cb5a0 0x7fa6801695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 -- 172.21.15.26:0/2504632344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780094f0 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa67ed9d700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa67000cdb0 tx=0x7fa6700077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000a9d0 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000ab30 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6800b4100 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670017430 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.172+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6800b46c0 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.173+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68004c3c0 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.174+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa670003020 con 0x7fa6800b5900 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.174+0000 7fa6767fc700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 0x7fa6600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.174+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa670013070 con 0x7fa6800b5900 2023-10-09T11:42:04.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.174+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 0x7fa6600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.175+0000 7fa67e59c700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 0x7fa6600697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa6800cbeb0 tx=0x7fa678017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.178+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa670051bb0 con 0x7fa6800b5900 2023-10-09T11:42:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.374+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6800ccf00 con 0x7fa6800b5900 2023-10-09T11:42:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.375+0000 7fa6767fc700 1 -- 172.21.15.26:0/2504632344 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fa6700078f0 con 0x7fa6800b5900 2023-10-09T11:42:04.377 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:04.377 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:01.197470+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:04.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 msgr2=0x7fa6600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 0x7fa6600697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa6800cbeb0 tx=0x7fa678017000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 msgr2=0x7fa680169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa67000cdb0 tx=0x7fa6700077d0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 shutdown_connections 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6800b5900 0x7fa680169c10 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6800cb5a0 0x7fa6801695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa660067320 0x7fa6600697d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 --2- 172.21.15.26:0/2504632344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6800cd9e0 0x7fa6800b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.377+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 >> 172.21.15.26:0/2504632344 conn(0x7fa680070e30 msgr2=0x7fa6800d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.378+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 shutdown_connections 2023-10-09T11:42:04.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.378+0000 7fa684ea7700 1 -- 172.21.15.26:0/2504632344 wait complete. 2023-10-09T11:42:04.391 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:42:04.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.509+0000 7f80267e1700 1 Processor -- start 2023-10-09T11:42:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.509+0000 7f80267e1700 1 -- start start 2023-10-09T11:42:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80200cb5a0 0x7f80200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cd9e0 0x7f8020159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200cde50 0x7f802015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200d13f0 con 0x7f80200cde50 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802015a940 con 0x7f80200cb5a0 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f80267e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802015ae40 con 0x7f80200cd9e0 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200cde50 0x7f802015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200cde50 0x7f802015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42940/0 (socket says 172.21.15.26:42940) 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 -- 172.21.15.26:0/3064259392 learned_addr learned my addr 172.21.15.26:0/3064259392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f801ffff700 1 --2- 172.21.15.26:0/3064259392 >> v2:172.21.15.67:3300/0 conn(0x7f80200cb5a0 0x7f80200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f801f7fe700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cd9e0 0x7f8020159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 -- 172.21.15.26:0/3064259392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cd9e0 msgr2=0x7f8020159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cd9e0 0x7f8020159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 -- 172.21.15.26:0/3064259392 >> v2:172.21.15.67:3300/0 conn(0x7f80200cb5a0 msgr2=0x7f80200cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 --2- 172.21.15.26:0/3064259392 >> v2:172.21.15.67:3300/0 conn(0x7f80200cb5a0 0x7f80200cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.510+0000 7f8024d7e700 1 -- 172.21.15.26:0/3064259392 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802015ab60 con 0x7f80200cde50 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f8024d7e700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cde50 0x7f802015a400 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8020065120 tx=0x7f8018009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cdf1b8d03d06b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f801effd700 1 -- 172.21.15.26:0/3064259392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800e070 con 0x7f80200cde50 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f801effd700 1 -- 172.21.15.26:0/3064259392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800ba40 con 0x7f80200cde50 2023-10-09T11:42:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f801effd700 1 -- 172.21.15.26:0/3064259392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180092e0 con 0x7f80200cde50 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 -- 172.21.15.26:0/3064259392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cde50 msgr2=0x7f802015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cde50 0x7f802015a400 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8020065120 tx=0x7f8018009840 comp rx=0 tx=0).stop 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 -- 172.21.15.26:0/3064259392 shutdown_connections 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 --2- 172.21.15.26:0/3064259392 >> v2:172.21.15.67:3300/0 conn(0x7f80200cb5a0 0x7f80200cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cde50 0x7f802015a400 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 --2- 172.21.15.26:0/3064259392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cd9e0 0x7f8020159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 -- 172.21.15.26:0/3064259392 >> 172.21.15.26:0/3064259392 conn(0x7f8020070e30 msgr2=0x7f80200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 -- 172.21.15.26:0/3064259392 shutdown_connections 2023-10-09T11:42:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.511+0000 7f80267e1700 1 -- 172.21.15.26:0/3064259392 wait complete. 2023-10-09T11:42:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.512+0000 7f80267e1700 1 Processor -- start 2023-10-09T11:42:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 -- start start 2023-10-09T11:42:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cb5a0 0x7f8020156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200cd9e0 0x7f80200ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c7ee0 con 0x7f8020156cd0 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015b070 con 0x7f80200cd9e0 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f80267e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8020159370 con 0x7f80200cb5a0 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.513+0000 7f8024d7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42944/0 (socket says 172.21.15.26:42944) 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 -- 172.21.15.26:0/2144530319 learned_addr learned my addr 172.21.15.26:0/2144530319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f801ffff700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cb5a0 0x7f8020156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200cd9e0 0x7f80200ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 -- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cb5a0 msgr2=0x7f8020156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cb5a0 0x7f8020156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 -- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200cd9e0 msgr2=0x7f80200ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200cd9e0 0x7f80200ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 -- 172.21.15.26:0/2144530319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009ae0 con 0x7f8020156cd0 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8024d7e700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f802006ea60 tx=0x7f8018018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180032f0 con 0x7f8020156cd0 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8018008ce0 con 0x7f8020156cd0 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020159650 con 0x7f8020156cd0 2023-10-09T11:42:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180256b0 con 0x7f8020156cd0 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.514+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8020159c10 con 0x7f8020156cd0 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.515+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802004c3c0 con 0x7f8020156cd0 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.515+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8018003040 con 0x7f8020156cd0 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.516+0000 7f8017fff700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 0x7f80000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.516+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80180862c0 con 0x7f8020156cd0 2023-10-09T11:42:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.516+0000 7f801ffff700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 0x7f80000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.517+0000 7f801ffff700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 0x7f80000697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.520+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8018052e40 con 0x7f8020156cd0 2023-10-09T11:42:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.709+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80200c8020 con 0x7f8000067320 2023-10-09T11:42:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.718+0000 7f8017fff700 1 -- 172.21.15.26:0/2144530319 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288321 (secure 0 0 0) 0x7f80200c8020 con 0x7f8000067320 2023-10-09T11:42:04.723 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 msgr2=0x7f80000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 0x7f80000697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008008040 comp rx=0 tx=0).stop 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 msgr2=0x7f80200b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f802006ea60 tx=0x7f8018018000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 shutdown_connections 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020156cd0 0x7f80200b0d80 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8000067320 0x7f80000697d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cb5a0 0x7f8020156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 --2- 172.21.15.26:0/2144530319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200cd9e0 0x7f80200ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 >> 172.21.15.26:0/2144530319 conn(0x7f8020070e30 msgr2=0x7f80200d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 shutdown_connections 2023-10-09T11:42:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.721+0000 7f80267e1700 1 -- 172.21.15.26:0/2144530319 wait complete. 2023-10-09T11:42:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:04.735 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-10-09T11:42:03.202911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2422992,"kb_used_data":11920,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551728,"statfs":{"total":773094113280,"available":770612969472,"internally_reserved":0,"allocated":12206080,"data_stored":5932003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.590961"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617278+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:04.786563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203658+0000","last_change":"2023-10-09T11:42:00.203777+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203658+0000","last_undegraded":"2023-10-09T11:42:00.203658+0000","last_fullsized":"2023-10-09T11:42:00.203658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209345+0000","last_change":"2023-10-09T11:42:00.209345+0000","last_active":"2023-10-09T11:42:00.209345+0000","last_peered":"2023-10-09T11:42:00.209345+0000","last_clean":"2023-10-09T11:42:00.209345+0000","last_became_active":"2023-10-09T11:42:00.208655+0000","last_became_peered":"2023-10-09T11:42:00.208655+0000","last_unstale":"2023-10-09T11:42:00.209345+0000","last_undegraded":"2023-10-09T11:42:00.209345+0000","last_fullsized":"2023-10-09T11:42:00.209345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617667+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:51.115035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218958+0000","last_change":"2023-10-09T11:42:00.218958+0000","last_active":"2023-10-09T11:42:00.218958+0000","last_peered":"2023-10-09T11:42:00.218958+0000","last_clean":"2023-10-09T11:42:00.218958+0000","last_became_active":"2023-10-09T11:42:00.218285+0000","last_became_peered":"2023-10-09T11:42:00.218285+0000","last_unstale":"2023-10-09T11:42:00.218958+0000","last_undegraded":"2023-10-09T11:42:00.218958+0000","last_fullsized":"2023-10-09T11:42:00.218958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216107+0000","last_change":"2023-10-09T11:42:00.209299+0000","last_active":"2023-10-09T11:42:00.216107+0000","last_peered":"2023-10-09T11:42:00.216107+0000","last_clean":"2023-10-09T11:42:00.216107+0000","last_became_active":"2023-10-09T11:42:00.208979+0000","last_became_peered":"2023-10-09T11:42:00.208979+0000","last_unstale":"2023-10-09T11:42:00.216107+0000","last_undegraded":"2023-10-09T11:42:00.216107+0000","last_fullsized":"2023-10-09T11:42:00.216107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217413+0000","last_change":"2023-10-09T11:42:00.211559+0000","last_active":"2023-10-09T11:42:00.217413+0000","last_peered":"2023-10-09T11:42:00.217413+0000","last_clean":"2023-10-09T11:42:00.217413+0000","last_became_active":"2023-10-09T11:42:00.211240+0000","last_became_peered":"2023-10-09T11:42:00.211240+0000","last_unstale":"2023-10-09T11:42:00.217413+0000","last_undegraded":"2023-10-09T11:42:00.217413+0000","last_fullsized":"2023-10-09T11:42:00.217413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219175+0000","last_change":"2023-10-09T11:42:00.213660+0000","last_active":"2023-10-09T11:42:00.219175+0000","last_peered":"2023-10-09T11:42:00.219175+0000","last_clean":"2023-10-09T11:42:00.219175+0000","last_became_active":"2023-10-09T11:42:00.213283+0000","last_became_peered":"2023-10-09T11:42:00.213283+0000","last_unstale":"2023-10-09T11:42:00.219175+0000","last_undegraded":"2023-10-09T11:42:00.219175+0000","last_fullsized":"2023-10-09T11:42:00.219175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212819+0000","last_change":"2023-10-09T11:42:00.212819+0000","last_active":"2023-10-09T11:42:00.212819+0000","last_peered":"2023-10-09T11:42:00.212819+0000","last_clean":"2023-10-09T11:42:00.212819+0000","last_became_active":"2023-10-09T11:42:00.212528+0000","last_became_peered":"2023-10-09T11:42:00.212528+0000","last_unstale":"2023-10-09T11:42:00.212819+0000","last_undegraded":"2023-10-09T11:42:00.212819+0000","last_fullsized":"2023-10-09T11:42:00.212819+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203350+0000","last_change":"2023-10-09T11:42:00.203471+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203350+0000","last_undegraded":"2023-10-09T11:42:00.203350+0000","last_fullsized":"2023-10-09T11:42:00.203350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201592+0000","last_change":"2023-10-09T11:42:00.201704+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201592+0000","last_undegraded":"2023-10-09T11:42:00.201592+0000","last_fullsized":"2023-10-09T11:42:00.201592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.206277+0000","last_change":"2023-10-09T11:42:00.206277+0000","last_active":"2023-10-09T11:42:00.206277+0000","last_peered":"2023-10-09T11:42:00.206277+0000","last_clean":"2023-10-09T11:42:00.206277+0000","last_became_active":"2023-10-09T11:42:00.205921+0000","last_became_peered":"2023-10-09T11:42:00.205921+0000","last_unstale":"2023-10-09T11:42:00.206277+0000","last_undegraded":"2023-10-09T11:42:00.206277+0000","last_fullsized":"2023-10-09T11:42:00.206277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617207+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:43.402519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202510+0000","last_change":"2023-10-09T11:42:00.202641+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202510+0000","last_undegraded":"2023-10-09T11:42:00.202510+0000","last_fullsized":"2023-10-09T11:42:00.202510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.616677+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:29.687317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620657+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:36.960165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217334+0000","last_change":"2023-10-09T11:42:00.209841+0000","last_active":"2023-10-09T11:42:00.217334+0000","last_peered":"2023-10-09T11:42:00.217334+0000","last_clean":"2023-10-09T11:42:00.217334+0000","last_became_active":"2023-10-09T11:42:00.209230+0000","last_became_peered":"2023-10-09T11:42:00.209230+0000","last_unstale":"2023-10-09T11:42:00.217334+0000","last_undegraded":"2023-10-09T11:42:00.217334+0000","last_fullsized":"2023-10-09T11:42:00.217334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620564+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:36.586717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201273+0000","last_change":"2023-10-09T11:42:00.201408+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201273+0000","last_undegraded":"2023-10-09T11:42:00.201273+0000","last_fullsized":"2023-10-09T11:42:00.201273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618089+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:43.085894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218780+0000","last_change":"2023-10-09T11:42:00.218780+0000","last_active":"2023-10-09T11:42:00.218780+0000","last_peered":"2023-10-09T11:42:00.218780+0000","last_clean":"2023-10-09T11:42:00.218780+0000","last_became_active":"2023-10-09T11:42:00.218449+0000","last_became_peered":"2023-10-09T11:42:00.218449+0000","last_unstale":"2023-10-09T11:42:00.218780+0000","last_undegraded":"2023-10-09T11:42:00.218780+0000","last_fullsized":"2023-10-09T11:42:00.218780+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201160+0000","last_change":"2023-10-09T11:42:00.201290+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201160+0000","last_undegraded":"2023-10-09T11:42:00.201160+0000","last_fullsized":"2023-10-09T11:42:00.201160+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210628+0000","last_change":"2023-10-09T11:42:00.210628+0000","last_active":"2023-10-09T11:42:00.210628+0000","last_peered":"2023-10-09T11:42:00.210628+0000","last_clean":"2023-10-09T11:42:00.210628+0000","last_became_active":"2023-10-09T11:42:00.210317+0000","last_became_peered":"2023-10-09T11:42:00.210317+0000","last_unstale":"2023-10-09T11:42:00.210628+0000","last_undegraded":"2023-10-09T11:42:00.210628+0000","last_fullsized":"2023-10-09T11:42:00.210628+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201079+0000","last_change":"2023-10-09T11:42:00.201232+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201079+0000","last_undegraded":"2023-10-09T11:42:00.201079+0000","last_fullsized":"2023-10-09T11:42:00.201079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203732+0000","last_change":"2023-10-09T11:42:00.203844+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203732+0000","last_undegraded":"2023-10-09T11:42:00.203732+0000","last_fullsized":"2023-10-09T11:42:00.203732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619822+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:37.205757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618074+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:39.939846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214781+0000","last_change":"2023-10-09T11:42:00.214781+0000","last_active":"2023-10-09T11:42:00.214781+0000","last_peered":"2023-10-09T11:42:00.214781+0000","last_clean":"2023-10-09T11:42:00.214781+0000","last_became_active":"2023-10-09T11:42:00.214525+0000","last_became_peered":"2023-10-09T11:42:00.214525+0000","last_unstale":"2023-10-09T11:42:00.214781+0000","last_undegraded":"2023-10-09T11:42:00.214781+0000","last_fullsized":"2023-10-09T11:42:00.214781+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:07.099338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619361+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.026752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618903+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:10.585162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216982+0000","last_change":"2023-10-09T11:42:00.216982+0000","last_active":"2023-10-09T11:42:00.216982+0000","last_peered":"2023-10-09T11:42:00.216982+0000","last_clean":"2023-10-09T11:42:00.216982+0000","last_became_active":"2023-10-09T11:42:00.216574+0000","last_became_peered":"2023-10-09T11:42:00.216574+0000","last_unstale":"2023-10-09T11:42:00.216982+0000","last_undegraded":"2023-10-09T11:42:00.216982+0000","last_fullsized":"2023-10-09T11:42:00.216982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218148+0000","last_change":"2023-10-09T11:42:00.211866+0000","last_active":"2023-10-09T11:42:00.218148+0000","last_peered":"2023-10-09T11:42:00.218148+0000","last_clean":"2023-10-09T11:42:00.218148+0000","last_became_active":"2023-10-09T11:42:00.211567+0000","last_became_peered":"2023-10-09T11:42:00.211567+0000","last_unstale":"2023-10-09T11:42:00.218148+0000","last_undegraded":"2023-10-09T11:42:00.218148+0000","last_fullsized":"2023-10-09T11:42:00.218148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617614+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:19.337204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"111'4","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640069+0000","last_change":"2023-10-09T11:41:59.632481+0000","last_active":"2023-10-09T11:42:00.640069+0000","last_peered":"2023-10-09T11:42:00.640069+0000","last_clean":"2023-10-09T11:42:00.640069+0000","last_became_active":"2023-10-09T11:41:59.632060+0000","last_became_peered":"2023-10-09T11:41:59.632060+0000","last_unstale":"2023-10-09T11:42:00.640069+0000","last_undegraded":"2023-10-09T11:42:00.640069+0000","last_fullsized":"2023-10-09T11:42:00.640069+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209066+0000","last_change":"2023-10-09T11:42:00.209066+0000","last_active":"2023-10-09T11:42:00.209066+0000","last_peered":"2023-10-09T11:42:00.209066+0000","last_clean":"2023-10-09T11:42:00.209066+0000","last_became_active":"2023-10-09T11:42:00.208807+0000","last_became_peered":"2023-10-09T11:42:00.208807+0000","last_unstale":"2023-10-09T11:42:00.209066+0000","last_undegraded":"2023-10-09T11:42:00.209066+0000","last_fullsized":"2023-10-09T11:42:00.209066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204750+0000","last_change":"2023-10-09T11:41:59.624685+0000","last_active":"2023-10-09T11:42:00.204750+0000","last_peered":"2023-10-09T11:42:00.204750+0000","last_clean":"2023-10-09T11:42:00.204750+0000","last_became_active":"2023-10-09T11:41:59.624425+0000","last_became_peered":"2023-10-09T11:41:59.624425+0000","last_unstale":"2023-10-09T11:42:00.204750+0000","last_undegraded":"2023-10-09T11:42:00.204750+0000","last_fullsized":"2023-10-09T11:42:00.204750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221528+0000","last_change":"2023-10-09T11:42:00.221528+0000","last_active":"2023-10-09T11:42:00.221528+0000","last_peered":"2023-10-09T11:42:00.221528+0000","last_clean":"2023-10-09T11:42:00.221528+0000","last_became_active":"2023-10-09T11:42:00.221296+0000","last_became_peered":"2023-10-09T11:42:00.221296+0000","last_unstale":"2023-10-09T11:42:00.221528+0000","last_undegraded":"2023-10-09T11:42:00.221528+0000","last_fullsized":"2023-10-09T11:42:00.221528+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.241711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631392+0000","last_change":"2023-10-09T11:41:59.625246+0000","last_active":"2023-10-09T11:41:59.631392+0000","last_peered":"2023-10-09T11:41:59.631392+0000","last_clean":"2023-10-09T11:41:59.631392+0000","last_became_active":"2023-10-09T11:41:59.624956+0000","last_became_peered":"2023-10-09T11:41:59.624956+0000","last_unstale":"2023-10-09T11:41:59.631392+0000","last_undegraded":"2023-10-09T11:41:59.631392+0000","last_fullsized":"2023-10-09T11:41:59.631392+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217661+0000","last_change":"2023-10-09T11:42:00.217661+0000","last_active":"2023-10-09T11:42:00.217661+0000","last_peered":"2023-10-09T11:42:00.217661+0000","last_clean":"2023-10-09T11:42:00.217661+0000","last_became_active":"2023-10-09T11:42:00.217406+0000","last_became_peered":"2023-10-09T11:42:00.217406+0000","last_unstale":"2023-10-09T11:42:00.217661+0000","last_undegraded":"2023-10-09T11:42:00.217661+0000","last_fullsized":"2023-10-09T11:42:00.217661+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629218+0000","last_change":"2023-10-09T11:41:59.627331+0000","last_active":"2023-10-09T11:41:59.629218+0000","last_peered":"2023-10-09T11:41:59.629218+0000","last_clean":"2023-10-09T11:41:59.629218+0000","last_became_active":"2023-10-09T11:41:59.627063+0000","last_became_peered":"2023-10-09T11:41:59.627063+0000","last_unstale":"2023-10-09T11:41:59.629218+0000","last_undegraded":"2023-10-09T11:41:59.629218+0000","last_fullsized":"2023-10-09T11:41:59.629218+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:03.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620149+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:06.310527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629274+0000","last_change":"2023-10-09T11:41:59.627978+0000","last_active":"2023-10-09T11:41:59.629274+0000","last_peered":"2023-10-09T11:41:59.629274+0000","last_clean":"2023-10-09T11:41:59.629274+0000","last_became_active":"2023-10-09T11:41:59.627728+0000","last_became_peered":"2023-10-09T11:41:59.627728+0000","last_unstale":"2023-10-09T11:41:59.629274+0000","last_undegraded":"2023-10-09T11:41:59.629274+0000","last_fullsized":"2023-10-09T11:41:59.629274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217382+0000","last_change":"2023-10-09T11:42:00.209626+0000","last_active":"2023-10-09T11:42:00.217382+0000","last_peered":"2023-10-09T11:42:00.217382+0000","last_clean":"2023-10-09T11:42:00.217382+0000","last_became_active":"2023-10-09T11:42:00.209213+0000","last_became_peered":"2023-10-09T11:42:00.209213+0000","last_unstale":"2023-10-09T11:42:00.217382+0000","last_undegraded":"2023-10-09T11:42:00.217382+0000","last_fullsized":"2023-10-09T11:42:00.217382+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629750+0000","last_change":"2023-10-09T11:41:59.629750+0000","last_active":"2023-10-09T11:41:59.629750+0000","last_peered":"2023-10-09T11:41:59.629750+0000","last_clean":"2023-10-09T11:41:59.629750+0000","last_became_active":"2023-10-09T11:41:59.629570+0000","last_became_peered":"2023-10-09T11:41:59.629570+0000","last_unstale":"2023-10-09T11:41:59.629750+0000","last_undegraded":"2023-10-09T11:41:59.629750+0000","last_fullsized":"2023-10-09T11:41:59.629750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219151+0000","last_change":"2023-10-09T11:42:00.213355+0000","last_active":"2023-10-09T11:42:00.219151+0000","last_peered":"2023-10-09T11:42:00.219151+0000","last_clean":"2023-10-09T11:42:00.219151+0000","last_became_active":"2023-10-09T11:42:00.212927+0000","last_became_peered":"2023-10-09T11:42:00.212927+0000","last_unstale":"2023-10-09T11:42:00.219151+0000","last_undegraded":"2023-10-09T11:42:00.219151+0000","last_fullsized":"2023-10-09T11:42:00.219151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.202774+0000","last_change":"2023-10-09T11:41:59.637978+0000","last_active":"2023-10-09T11:42:00.202774+0000","last_peered":"2023-10-09T11:42:00.202774+0000","last_clean":"2023-10-09T11:42:00.202774+0000","last_became_active":"2023-10-09T11:41:59.637664+0000","last_became_peered":"2023-10-09T11:41:59.637664+0000","last_unstale":"2023-10-09T11:42:00.202774+0000","last_undegraded":"2023-10-09T11:42:00.202774+0000","last_fullsized":"2023-10-09T11:42:00.202774+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:08.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202064+0000","last_change":"2023-10-09T11:42:00.202226+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202064+0000","last_undegraded":"2023-10-09T11:42:00.202064+0000","last_fullsized":"2023-10-09T11:42:00.202064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634398+0000","last_change":"2023-10-09T11:41:59.632493+0000","last_active":"2023-10-09T11:41:59.634398+0000","last_peered":"2023-10-09T11:41:59.634398+0000","last_clean":"2023-10-09T11:41:59.634398+0000","last_became_active":"2023-10-09T11:41:59.632168+0000","last_became_peered":"2023-10-09T11:41:59.632168+0000","last_unstale":"2023-10-09T11:41:59.634398+0000","last_undegraded":"2023-10-09T11:41:59.634398+0000","last_fullsized":"2023-10-09T11:41:59.634398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:38.935473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619248+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:02.740000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.637595+0000","last_change":"2023-10-09T11:41:59.632085+0000","last_active":"2023-10-09T11:41:59.637595+0000","last_peered":"2023-10-09T11:41:59.637595+0000","last_clean":"2023-10-09T11:41:59.637595+0000","last_became_active":"2023-10-09T11:41:59.631758+0000","last_became_peered":"2023-10-09T11:41:59.631758+0000","last_unstale":"2023-10-09T11:41:59.637595+0000","last_undegraded":"2023-10-09T11:41:59.637595+0000","last_fullsized":"2023-10-09T11:41:59.637595+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:57.551222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212835+0000","last_change":"2023-10-09T11:42:00.212835+0000","last_active":"2023-10-09T11:42:00.212835+0000","last_peered":"2023-10-09T11:42:00.212835+0000","last_clean":"2023-10-09T11:42:00.212835+0000","last_became_active":"2023-10-09T11:42:00.212518+0000","last_became_peered":"2023-10-09T11:42:00.212518+0000","last_unstale":"2023-10-09T11:42:00.212835+0000","last_undegraded":"2023-10-09T11:42:00.212835+0000","last_fullsized":"2023-10-09T11:42:00.212835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632977+0000","last_change":"2023-10-09T11:41:59.632977+0000","last_active":"2023-10-09T11:41:59.632977+0000","last_peered":"2023-10-09T11:41:59.632977+0000","last_clean":"2023-10-09T11:41:59.632977+0000","last_became_active":"2023-10-09T11:41:59.632684+0000","last_became_peered":"2023-10-09T11:41:59.632684+0000","last_unstale":"2023-10-09T11:41:59.632977+0000","last_undegraded":"2023-10-09T11:41:59.632977+0000","last_fullsized":"2023-10-09T11:41:59.632977+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219167+0000","last_change":"2023-10-09T11:42:00.219167+0000","last_active":"2023-10-09T11:42:00.219167+0000","last_peered":"2023-10-09T11:42:00.219167+0000","last_clean":"2023-10-09T11:42:00.219167+0000","last_became_active":"2023-10-09T11:42:00.218471+0000","last_became_peered":"2023-10-09T11:42:00.218471+0000","last_unstale":"2023-10-09T11:42:00.219167+0000","last_undegraded":"2023-10-09T11:42:00.219167+0000","last_fullsized":"2023-10-09T11:42:00.219167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"111'3","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.637607+0000","last_change":"2023-10-09T11:41:59.630953+0000","last_active":"2023-10-09T11:42:00.637607+0000","last_peered":"2023-10-09T11:42:00.637607+0000","last_clean":"2023-10-09T11:42:00.637607+0000","last_became_active":"2023-10-09T11:41:59.630684+0000","last_became_peered":"2023-10-09T11:41:59.630684+0000","last_unstale":"2023-10-09T11:42:00.637607+0000","last_undegraded":"2023-10-09T11:42:00.637607+0000","last_fullsized":"2023-10-09T11:42:00.637607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220411+0000","last_change":"2023-10-09T11:42:00.220411+0000","last_active":"2023-10-09T11:42:00.220411+0000","last_peered":"2023-10-09T11:42:00.220411+0000","last_clean":"2023-10-09T11:42:00.220411+0000","last_became_active":"2023-10-09T11:42:00.220156+0000","last_became_peered":"2023-10-09T11:42:00.220156+0000","last_unstale":"2023-10-09T11:42:00.220411+0000","last_undegraded":"2023-10-09T11:42:00.220411+0000","last_fullsized":"2023-10-09T11:42:00.220411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:08.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"111'6","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640498+0000","last_change":"2023-10-09T11:41:59.633075+0000","last_active":"2023-10-09T11:42:00.640498+0000","last_peered":"2023-10-09T11:42:00.640498+0000","last_clean":"2023-10-09T11:42:00.640498+0000","last_became_active":"2023-10-09T11:41:59.632787+0000","last_became_peered":"2023-10-09T11:41:59.632787+0000","last_unstale":"2023-10-09T11:42:00.640498+0000","last_undegraded":"2023-10-09T11:42:00.640498+0000","last_fullsized":"2023-10-09T11:42:00.640498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:12.460978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618318+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:28.516478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635800+0000","last_change":"2023-10-09T11:41:59.635800+0000","last_active":"2023-10-09T11:41:59.635800+0000","last_peered":"2023-10-09T11:41:59.635800+0000","last_clean":"2023-10-09T11:41:59.635800+0000","last_became_active":"2023-10-09T11:41:59.635487+0000","last_became_peered":"2023-10-09T11:41:59.635487+0000","last_unstale":"2023-10-09T11:41:59.635800+0000","last_undegraded":"2023-10-09T11:41:59.635800+0000","last_fullsized":"2023-10-09T11:41:59.635800+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:26.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202052+0000","last_change":"2023-10-09T11:42:00.202159+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202052+0000","last_undegraded":"2023-10-09T11:42:00.202052+0000","last_fullsized":"2023-10-09T11:42:00.202052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629190+0000","last_change":"2023-10-09T11:41:59.626882+0000","last_active":"2023-10-09T11:41:59.629190+0000","last_peered":"2023-10-09T11:41:59.629190+0000","last_clean":"2023-10-09T11:41:59.629190+0000","last_became_active":"2023-10-09T11:41:59.626653+0000","last_became_peered":"2023-10-09T11:41:59.626653+0000","last_unstale":"2023-10-09T11:41:59.629190+0000","last_undegraded":"2023-10-09T11:41:59.629190+0000","last_fullsized":"2023-10-09T11:41:59.629190+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.208367+0000","last_change":"2023-10-09T11:42:00.208367+0000","last_active":"2023-10-09T11:42:00.208367+0000","last_peered":"2023-10-09T11:42:00.208367+0000","last_clean":"2023-10-09T11:42:00.208367+0000","last_became_active":"2023-10-09T11:42:00.207838+0000","last_became_peered":"2023-10-09T11:42:00.207838+0000","last_unstale":"2023-10-09T11:42:00.208367+0000","last_undegraded":"2023-10-09T11:42:00.208367+0000","last_fullsized":"2023-10-09T11:42:00.208367+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"111'8","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638449+0000","last_change":"2023-10-09T11:41:59.629160+0000","last_active":"2023-10-09T11:42:00.638449+0000","last_peered":"2023-10-09T11:42:00.638449+0000","last_clean":"2023-10-09T11:42:00.638449+0000","last_became_active":"2023-10-09T11:41:59.628930+0000","last_became_peered":"2023-10-09T11:41:59.628930+0000","last_unstale":"2023-10-09T11:42:00.638449+0000","last_undegraded":"2023-10-09T11:42:00.638449+0000","last_fullsized":"2023-10-09T11:42:00.638449+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:12.328048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214813+0000","last_change":"2023-10-09T11:42:00.214813+0000","last_active":"2023-10-09T11:42:00.214813+0000","last_peered":"2023-10-09T11:42:00.214813+0000","last_clean":"2023-10-09T11:42:00.214813+0000","last_became_active":"2023-10-09T11:42:00.214504+0000","last_became_peered":"2023-10-09T11:42:00.214504+0000","last_unstale":"2023-10-09T11:42:00.214813+0000","last_undegraded":"2023-10-09T11:42:00.214813+0000","last_fullsized":"2023-10-09T11:42:00.214813+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.205279+0000","last_change":"2023-10-09T11:41:59.628234+0000","last_active":"2023-10-09T11:42:00.205279+0000","last_peered":"2023-10-09T11:42:00.205279+0000","last_clean":"2023-10-09T11:42:00.205279+0000","last_became_active":"2023-10-09T11:41:59.627982+0000","last_became_peered":"2023-10-09T11:41:59.627982+0000","last_unstale":"2023-10-09T11:42:00.205279+0000","last_undegraded":"2023-10-09T11:42:00.205279+0000","last_fullsized":"2023-10-09T11:42:00.205279+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:40.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.213778+0000","last_change":"2023-10-09T11:42:00.213778+0000","last_active":"2023-10-09T11:42:00.213778+0000","last_peered":"2023-10-09T11:42:00.213778+0000","last_clean":"2023-10-09T11:42:00.213778+0000","last_became_active":"2023-10-09T11:42:00.213110+0000","last_became_peered":"2023-10-09T11:42:00.213110+0000","last_unstale":"2023-10-09T11:42:00.213778+0000","last_undegraded":"2023-10-09T11:42:00.213778+0000","last_fullsized":"2023-10-09T11:42:00.213778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:22.834787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628159+0000","last_change":"2023-10-09T11:41:59.624967+0000","last_active":"2023-10-09T11:41:59.628159+0000","last_peered":"2023-10-09T11:41:59.628159+0000","last_clean":"2023-10-09T11:41:59.628159+0000","last_became_active":"2023-10-09T11:41:59.624703+0000","last_became_peered":"2023-10-09T11:41:59.624703+0000","last_unstale":"2023-10-09T11:41:59.628159+0000","last_undegraded":"2023-10-09T11:41:59.628159+0000","last_fullsized":"2023-10-09T11:41:59.628159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.895476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617549+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:22.277757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.636944+0000","last_change":"2023-10-09T11:41:59.635012+0000","last_active":"2023-10-09T11:42:00.636944+0000","last_peered":"2023-10-09T11:42:00.636944+0000","last_clean":"2023-10-09T11:42:00.636944+0000","last_became_active":"2023-10-09T11:41:59.634630+0000","last_became_peered":"2023-10-09T11:41:59.634630+0000","last_unstale":"2023-10-09T11:42:00.636944+0000","last_undegraded":"2023-10-09T11:42:00.636944+0000","last_fullsized":"2023-10-09T11:42:00.636944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:21.830413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202791+0000","last_change":"2023-10-09T11:42:00.202917+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202791+0000","last_undegraded":"2023-10-09T11:42:00.202791+0000","last_fullsized":"2023-10-09T11:42:00.202791+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632074+0000","last_change":"2023-10-09T11:41:59.627009+0000","last_active":"2023-10-09T11:41:59.632074+0000","last_peered":"2023-10-09T11:41:59.632074+0000","last_clean":"2023-10-09T11:41:59.632074+0000","last_became_active":"2023-10-09T11:41:59.626708+0000","last_became_peered":"2023-10-09T11:41:59.626708+0000","last_unstale":"2023-10-09T11:41:59.632074+0000","last_undegraded":"2023-10-09T11:41:59.632074+0000","last_fullsized":"2023-10-09T11:41:59.632074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619698+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:41.221201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638734+0000","last_change":"2023-10-09T11:41:59.631402+0000","last_active":"2023-10-09T11:42:00.638734+0000","last_peered":"2023-10-09T11:42:00.638734+0000","last_clean":"2023-10-09T11:42:00.638734+0000","last_became_active":"2023-10-09T11:41:59.630980+0000","last_became_peered":"2023-10-09T11:41:59.630980+0000","last_unstale":"2023-10-09T11:42:00.638734+0000","last_undegraded":"2023-10-09T11:42:00.638734+0000","last_fullsized":"2023-10-09T11:42:00.638734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:10.015929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217404+0000","last_change":"2023-10-09T11:42:00.210737+0000","last_active":"2023-10-09T11:42:00.217404+0000","last_peered":"2023-10-09T11:42:00.217404+0000","last_clean":"2023-10-09T11:42:00.217404+0000","last_became_active":"2023-10-09T11:42:00.209921+0000","last_became_peered":"2023-10-09T11:42:00.209921+0000","last_unstale":"2023-10-09T11:42:00.217404+0000","last_undegraded":"2023-10-09T11:42:00.217404+0000","last_fullsized":"2023-10-09T11:42:00.217404+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632230+0000","last_change":"2023-10-09T11:41:59.632230+0000","last_active":"2023-10-09T11:41:59.632230+0000","last_peered":"2023-10-09T11:41:59.632230+0000","last_clean":"2023-10-09T11:41:59.632230+0000","last_became_active":"2023-10-09T11:41:59.631971+0000","last_became_peered":"2023-10-09T11:41:59.631971+0000","last_unstale":"2023-10-09T11:41:59.632230+0000","last_undegraded":"2023-10-09T11:41:59.632230+0000","last_fullsized":"2023-10-09T11:41:59.632230+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202067+0000","last_change":"2023-10-09T11:42:00.202208+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202067+0000","last_undegraded":"2023-10-09T11:42:00.202067+0000","last_fullsized":"2023-10-09T11:42:00.202067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631307+0000","last_change":"2023-10-09T11:41:59.631307+0000","last_active":"2023-10-09T11:41:59.631307+0000","last_peered":"2023-10-09T11:41:59.631307+0000","last_clean":"2023-10-09T11:41:59.631307+0000","last_became_active":"2023-10-09T11:41:59.630943+0000","last_became_peered":"2023-10-09T11:41:59.630943+0000","last_unstale":"2023-10-09T11:41:59.631307+0000","last_undegraded":"2023-10-09T11:41:59.631307+0000","last_fullsized":"2023-10-09T11:41:59.631307+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:57.854138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219945+0000","last_change":"2023-10-09T11:42:00.219945+0000","last_active":"2023-10-09T11:42:00.219945+0000","last_peered":"2023-10-09T11:42:00.219945+0000","last_clean":"2023-10-09T11:42:00.219945+0000","last_became_active":"2023-10-09T11:42:00.219612+0000","last_became_peered":"2023-10-09T11:42:00.219612+0000","last_unstale":"2023-10-09T11:42:00.219945+0000","last_undegraded":"2023-10-09T11:42:00.219945+0000","last_fullsized":"2023-10-09T11:42:00.219945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628174+0000","last_change":"2023-10-09T11:41:59.625622+0000","last_active":"2023-10-09T11:41:59.628174+0000","last_peered":"2023-10-09T11:41:59.628174+0000","last_clean":"2023-10-09T11:41:59.628174+0000","last_became_active":"2023-10-09T11:41:59.625346+0000","last_became_peered":"2023-10-09T11:41:59.625346+0000","last_unstale":"2023-10-09T11:41:59.628174+0000","last_undegraded":"2023-10-09T11:41:59.628174+0000","last_fullsized":"2023-10-09T11:41:59.628174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:08.373571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217471+0000","last_change":"2023-10-09T11:42:00.210536+0000","last_active":"2023-10-09T11:42:00.217471+0000","last_peered":"2023-10-09T11:42:00.217471+0000","last_clean":"2023-10-09T11:42:00.217471+0000","last_became_active":"2023-10-09T11:42:00.210277+0000","last_became_peered":"2023-10-09T11:42:00.210277+0000","last_unstale":"2023-10-09T11:42:00.217471+0000","last_undegraded":"2023-10-09T11:42:00.217471+0000","last_fullsized":"2023-10-09T11:42:00.217471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631336+0000","last_change":"2023-10-09T11:41:59.631336+0000","last_active":"2023-10-09T11:41:59.631336+0000","last_peered":"2023-10-09T11:41:59.631336+0000","last_clean":"2023-10-09T11:41:59.631336+0000","last_became_active":"2023-10-09T11:41:59.631014+0000","last_became_peered":"2023-10-09T11:41:59.631014+0000","last_unstale":"2023-10-09T11:41:59.631336+0000","last_undegraded":"2023-10-09T11:41:59.631336+0000","last_fullsized":"2023-10-09T11:41:59.631336+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:04.014266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.616820+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:00.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640360+0000","last_change":"2023-10-09T11:41:59.635719+0000","last_active":"2023-10-09T11:41:59.640360+0000","last_peered":"2023-10-09T11:41:59.640360+0000","last_clean":"2023-10-09T11:41:59.640360+0000","last_became_active":"2023-10-09T11:41:59.635402+0000","last_became_peered":"2023-10-09T11:41:59.635402+0000","last_unstale":"2023-10-09T11:41:59.640360+0000","last_undegraded":"2023-10-09T11:41:59.640360+0000","last_fullsized":"2023-10-09T11:41:59.640360+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202476+0000","last_change":"2023-10-09T11:42:00.202589+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202476+0000","last_undegraded":"2023-10-09T11:42:00.202476+0000","last_fullsized":"2023-10-09T11:42:00.202476+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634422+0000","last_change":"2023-10-09T11:41:59.632579+0000","last_active":"2023-10-09T11:41:59.634422+0000","last_peered":"2023-10-09T11:41:59.634422+0000","last_clean":"2023-10-09T11:41:59.634422+0000","last_became_active":"2023-10-09T11:41:59.632268+0000","last_became_peered":"2023-10-09T11:41:59.632268+0000","last_unstale":"2023-10-09T11:41:59.634422+0000","last_undegraded":"2023-10-09T11:41:59.634422+0000","last_fullsized":"2023-10-09T11:41:59.634422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217040+0000","last_change":"2023-10-09T11:42:00.209277+0000","last_active":"2023-10-09T11:42:00.217040+0000","last_peered":"2023-10-09T11:42:00.217040+0000","last_clean":"2023-10-09T11:42:00.217040+0000","last_became_active":"2023-10-09T11:42:00.208952+0000","last_became_peered":"2023-10-09T11:42:00.208952+0000","last_unstale":"2023-10-09T11:42:00.217040+0000","last_undegraded":"2023-10-09T11:42:00.217040+0000","last_fullsized":"2023-10-09T11:42:00.217040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628205+0000","last_change":"2023-10-09T11:41:59.625759+0000","last_active":"2023-10-09T11:41:59.628205+0000","last_peered":"2023-10-09T11:41:59.628205+0000","last_clean":"2023-10-09T11:41:59.628205+0000","last_became_active":"2023-10-09T11:41:59.623565+0000","last_became_peered":"2023-10-09T11:41:59.623565+0000","last_unstale":"2023-10-09T11:41:59.628205+0000","last_undegraded":"2023-10-09T11:41:59.628205+0000","last_fullsized":"2023-10-09T11:41:59.628205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:36.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220642+0000","last_change":"2023-10-09T11:42:00.220642+0000","last_active":"2023-10-09T11:42:00.220642+0000","last_peered":"2023-10-09T11:42:00.220642+0000","last_clean":"2023-10-09T11:42:00.220642+0000","last_became_active":"2023-10-09T11:42:00.220107+0000","last_became_peered":"2023-10-09T11:42:00.220107+0000","last_unstale":"2023-10-09T11:42:00.220642+0000","last_undegraded":"2023-10-09T11:42:00.220642+0000","last_fullsized":"2023-10-09T11:42:00.220642+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629254+0000","last_change":"2023-10-09T11:41:59.627466+0000","last_active":"2023-10-09T11:41:59.629254+0000","last_peered":"2023-10-09T11:41:59.629254+0000","last_clean":"2023-10-09T11:41:59.629254+0000","last_became_active":"2023-10-09T11:41:59.626717+0000","last_became_peered":"2023-10-09T11:41:59.626717+0000","last_unstale":"2023-10-09T11:41:59.629254+0000","last_undegraded":"2023-10-09T11:41:59.629254+0000","last_fullsized":"2023-10-09T11:41:59.629254+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.207614+0000","last_change":"2023-10-09T11:42:00.207614+0000","last_active":"2023-10-09T11:42:00.207614+0000","last_peered":"2023-10-09T11:42:00.207614+0000","last_clean":"2023-10-09T11:42:00.207614+0000","last_became_active":"2023-10-09T11:42:00.207309+0000","last_became_peered":"2023-10-09T11:42:00.207309+0000","last_unstale":"2023-10-09T11:42:00.207614+0000","last_undegraded":"2023-10-09T11:42:00.207614+0000","last_fullsized":"2023-10-09T11:42:00.207614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:58.991113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640269+0000","last_change":"2023-10-09T11:41:59.632416+0000","last_active":"2023-10-09T11:41:59.640269+0000","last_peered":"2023-10-09T11:41:59.640269+0000","last_clean":"2023-10-09T11:41:59.640269+0000","last_became_active":"2023-10-09T11:41:59.632037+0000","last_became_peered":"2023-10-09T11:41:59.632037+0000","last_unstale":"2023-10-09T11:41:59.640269+0000","last_undegraded":"2023-10-09T11:41:59.640269+0000","last_fullsized":"2023-10-09T11:41:59.640269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619966+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:29.230677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.633991+0000","last_change":"2023-10-09T11:41:59.633991+0000","last_active":"2023-10-09T11:41:59.633991+0000","last_peered":"2023-10-09T11:41:59.633991+0000","last_clean":"2023-10-09T11:41:59.633991+0000","last_became_active":"2023-10-09T11:41:59.633652+0000","last_became_peered":"2023-10-09T11:41:59.633652+0000","last_unstale":"2023-10-09T11:41:59.633991+0000","last_undegraded":"2023-10-09T11:41:59.633991+0000","last_fullsized":"2023-10-09T11:41:59.633991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202424+0000","last_change":"2023-10-09T11:42:00.202544+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202424+0000","last_undegraded":"2023-10-09T11:42:00.202424+0000","last_fullsized":"2023-10-09T11:42:00.202424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635843+0000","last_change":"2023-10-09T11:41:59.635108+0000","last_active":"2023-10-09T11:41:59.635843+0000","last_peered":"2023-10-09T11:41:59.635843+0000","last_clean":"2023-10-09T11:41:59.635843+0000","last_became_active":"2023-10-09T11:41:59.634840+0000","last_became_peered":"2023-10-09T11:41:59.634840+0000","last_unstale":"2023-10-09T11:41:59.635843+0000","last_undegraded":"2023-10-09T11:41:59.635843+0000","last_fullsized":"2023-10-09T11:41:59.635843+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:42.570558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220378+0000","last_change":"2023-10-09T11:42:00.220378+0000","last_active":"2023-10-09T11:42:00.220378+0000","last_peered":"2023-10-09T11:42:00.220378+0000","last_clean":"2023-10-09T11:42:00.220378+0000","last_became_active":"2023-10-09T11:42:00.219769+0000","last_became_peered":"2023-10-09T11:42:00.219769+0000","last_unstale":"2023-10-09T11:42:00.220378+0000","last_undegraded":"2023-10-09T11:42:00.220378+0000","last_fullsized":"2023-10-09T11:42:00.220378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:03.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.639802+0000","last_change":"2023-10-09T11:41:59.632436+0000","last_active":"2023-10-09T11:42:00.639802+0000","last_peered":"2023-10-09T11:42:00.639802+0000","last_clean":"2023-10-09T11:42:00.639802+0000","last_became_active":"2023-10-09T11:41:59.632129+0000","last_became_peered":"2023-10-09T11:41:59.632129+0000","last_unstale":"2023-10-09T11:42:00.639802+0000","last_undegraded":"2023-10-09T11:42:00.639802+0000","last_fullsized":"2023-10-09T11:42:00.639802+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.621016+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:59.621016+0000","last_peered":"2023-10-09T11:41:59.621016+0000","last_clean":"2023-10-09T11:41:59.621016+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:59.621016+0000","last_undegraded":"2023-10-09T11:41:59.621016+0000","last_fullsized":"2023-10-09T11:41:59.621016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1188432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.628},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.74399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.434},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.436},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.93000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":1181669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.246},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.222}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1359872,"data_stored":585038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.33900000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.378},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.66100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1388544,"data_stored":598134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:04.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.893+0000 7f85fcc2a700 1 Processor -- start 2023-10-09T11:42:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.893+0000 7f85fcc2a700 1 -- start start 2023-10-09T11:42:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85fcc2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85f80b0ba0 0x7f85f80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85fcc2a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f815a280 con 0x7f85f80cf200 2023-10-09T11:42:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85fcc2a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f806e180 con 0x7f85f80b07d0 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85fcc2a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f806d850 con 0x7f85f80b0ba0 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85f80b0ba0 0x7f85f80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85f80cf200 0x7f85f806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60524/0 (socket says 172.21.15.26:60524) 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f5d9b700 1 -- 172.21.15.26:0/356597333 learned_addr learned my addr 172.21.15.26:0/356597333 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f6d9d700 1 -- 172.21.15.26:0/356597333 >> v1:172.21.15.67:6789/0 conn(0x7f85f80b07d0 legacy=0x7f85f80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f6d9d700 1 -- 172.21.15.26:0/356597333 >> v1:172.21.15.26:6789/0 conn(0x7f85f80cf200 legacy=0x7f85f806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f6d9d700 1 -- 172.21.15.26:0/356597333 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f806db30 con 0x7f85f80b0ba0 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f6d9d700 1 --2- 172.21.15.26:0/356597333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b0ba0 0x7f85f80c42c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f85e80098e0 tx=0x7f85e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af17209b726201f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f559a700 1 -- 172.21.15.26:0/356597333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8009e80 con 0x7f85f80b0ba0 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.894+0000 7f85f559a700 1 -- 172.21.15.26:0/356597333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800b820 con 0x7f85f80b0ba0 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85f559a700 1 -- 172.21.15.26:0/356597333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800bba0 con 0x7f85f80b0ba0 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 -- 172.21.15.26:0/356597333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b0ba0 msgr2=0x7f85f80c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/356597333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b0ba0 0x7f85f80c42c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f85e80098e0 tx=0x7f85e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 -- 172.21.15.26:0/356597333 shutdown_connections 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/356597333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b0ba0 0x7f85f80c42c0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 -- 172.21.15.26:0/356597333 >> 172.21.15.26:0/356597333 conn(0x7f85f806ce80 msgr2=0x7f85f80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 -- 172.21.15.26:0/356597333 shutdown_connections 2023-10-09T11:42:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.895+0000 7f85fcc2a700 1 -- 172.21.15.26:0/356597333 wait complete. 2023-10-09T11:42:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.896+0000 7f85fcc2a700 1 Processor -- start 2023-10-09T11:42:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.896+0000 7f85fcc2a700 1 -- start start 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 0x7f85f81527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85f80cf200 0x7f85f8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8155b80 con 0x7f85f80b07d0 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8153230 con 0x7f85f80b0ba0 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85fcc2a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8151f90 con 0x7f85f80cf200 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42948/0 (socket says 172.21.15.26:42948) 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 -- 172.21.15.26:0/347296690 learned_addr learned my addr 172.21.15.26:0/347296690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f5d9b700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 0x7f85f81527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f6d9d700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85f80cf200 0x7f85f8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 -- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85f80cf200 msgr2=0x7f85f8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85f80cf200 0x7f85f8152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 -- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 msgr2=0x7f85f81527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 0x7f85f81527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f659c700 1 -- 172.21.15.26:0/347296690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8009420 con 0x7f85f80b07d0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.897+0000 7f85f5d9b700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 0x7f85f81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85f659c700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f85f000bc30 tx=0x7f85f0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000c9b0 con 0x7f85f80b07d0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000cb50 con 0x7f85f80b07d0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f81552e0 con 0x7f85f80b07d0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0014410 con 0x7f85f80b07d0 2023-10-09T11:42:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.898+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8155920 con 0x7f85f80b07d0 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.899+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80b1bb0 con 0x7f85f80b07d0 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.899+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f85f0014800 con 0x7f85f80b07d0 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.899+0000 7f85ee7fc700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 0x7f85d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.899+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85f0084eb0 con 0x7f85f80b07d0 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.900+0000 7f85f5d9b700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 0x7f85d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.900+0000 7f85f5d9b700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 0x7f85d80697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f85f80698d0 tx=0x7f85e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:04.904+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85f80b1bb0 con 0x7f85f80b07d0 2023-10-09T11:42:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.091+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85f80b1bb0 con 0x7f85d8067320 2023-10-09T11:42:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.100+0000 7f85ee7fc700 1 -- 172.21.15.26:0/347296690 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288321 (secure 0 0 0) 0x7f85f80b1bb0 con 0x7f85d8067320 2023-10-09T11:42:05.104 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 msgr2=0x7f85d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 0x7f85d80697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f85f80698d0 tx=0x7f85e0009040 comp rx=0 tx=0).stop 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 msgr2=0x7f85f813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f85f000bc30 tx=0x7f85f0009820 comp rx=0 tx=0).stop 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 shutdown_connections 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f85d8067320 0x7f85d80697d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85f80cf200 0x7f85f8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f80b07d0 0x7f85f813e280 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 --2- 172.21.15.26:0/347296690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85f80b0ba0 0x7f85f81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 >> 172.21.15.26:0/347296690 conn(0x7f85f806ce80 msgr2=0x7f85f8068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 shutdown_connections 2023-10-09T11:42:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.103+0000 7f85fcc2a700 1 -- 172.21.15.26:0/347296690 wait complete. 2023-10-09T11:42:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:05.116 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-10-09T11:42:03.202911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2422992,"kb_used_data":11920,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551728,"statfs":{"total":773094113280,"available":770612969472,"internally_reserved":0,"allocated":12206080,"data_stored":5932003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.590961"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617278+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:04.786563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203658+0000","last_change":"2023-10-09T11:42:00.203777+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203658+0000","last_undegraded":"2023-10-09T11:42:00.203658+0000","last_fullsized":"2023-10-09T11:42:00.203658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209345+0000","last_change":"2023-10-09T11:42:00.209345+0000","last_active":"2023-10-09T11:42:00.209345+0000","last_peered":"2023-10-09T11:42:00.209345+0000","last_clean":"2023-10-09T11:42:00.209345+0000","last_became_active":"2023-10-09T11:42:00.208655+0000","last_became_peered":"2023-10-09T11:42:00.208655+0000","last_unstale":"2023-10-09T11:42:00.209345+0000","last_undegraded":"2023-10-09T11:42:00.209345+0000","last_fullsized":"2023-10-09T11:42:00.209345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617667+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:51.115035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218958+0000","last_change":"2023-10-09T11:42:00.218958+0000","last_active":"2023-10-09T11:42:00.218958+0000","last_peered":"2023-10-09T11:42:00.218958+0000","last_clean":"2023-10-09T11:42:00.218958+0000","last_became_active":"2023-10-09T11:42:00.218285+0000","last_became_peered":"2023-10-09T11:42:00.218285+0000","last_unstale":"2023-10-09T11:42:00.218958+0000","last_undegraded":"2023-10-09T11:42:00.218958+0000","last_fullsized":"2023-10-09T11:42:00.218958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216107+0000","last_change":"2023-10-09T11:42:00.209299+0000","last_active":"2023-10-09T11:42:00.216107+0000","last_peered":"2023-10-09T11:42:00.216107+0000","last_clean":"2023-10-09T11:42:00.216107+0000","last_became_active":"2023-10-09T11:42:00.208979+0000","last_became_peered":"2023-10-09T11:42:00.208979+0000","last_unstale":"2023-10-09T11:42:00.216107+0000","last_undegraded":"2023-10-09T11:42:00.216107+0000","last_fullsized":"2023-10-09T11:42:00.216107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217413+0000","last_change":"2023-10-09T11:42:00.211559+0000","last_active":"2023-10-09T11:42:00.217413+0000","last_peered":"2023-10-09T11:42:00.217413+0000","last_clean":"2023-10-09T11:42:00.217413+0000","last_became_active":"2023-10-09T11:42:00.211240+0000","last_became_peered":"2023-10-09T11:42:00.211240+0000","last_unstale":"2023-10-09T11:42:00.217413+0000","last_undegraded":"2023-10-09T11:42:00.217413+0000","last_fullsized":"2023-10-09T11:42:00.217413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219175+0000","last_change":"2023-10-09T11:42:00.213660+0000","last_active":"2023-10-09T11:42:00.219175+0000","last_peered":"2023-10-09T11:42:00.219175+0000","last_clean":"2023-10-09T11:42:00.219175+0000","last_became_active":"2023-10-09T11:42:00.213283+0000","last_became_peered":"2023-10-09T11:42:00.213283+0000","last_unstale":"2023-10-09T11:42:00.219175+0000","last_undegraded":"2023-10-09T11:42:00.219175+0000","last_fullsized":"2023-10-09T11:42:00.219175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212819+0000","last_change":"2023-10-09T11:42:00.212819+0000","last_active":"2023-10-09T11:42:00.212819+0000","last_peered":"2023-10-09T11:42:00.212819+0000","last_clean":"2023-10-09T11:42:00.212819+0000","last_became_active":"2023-10-09T11:42:00.212528+0000","last_became_peered":"2023-10-09T11:42:00.212528+0000","last_unstale":"2023-10-09T11:42:00.212819+0000","last_undegraded":"2023-10-09T11:42:00.212819+0000","last_fullsized":"2023-10-09T11:42:00.212819+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203350+0000","last_change":"2023-10-09T11:42:00.203471+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203350+0000","last_undegraded":"2023-10-09T11:42:00.203350+0000","last_fullsized":"2023-10-09T11:42:00.203350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201592+0000","last_change":"2023-10-09T11:42:00.201704+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201592+0000","last_undegraded":"2023-10-09T11:42:00.201592+0000","last_fullsized":"2023-10-09T11:42:00.201592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.206277+0000","last_change":"2023-10-09T11:42:00.206277+0000","last_active":"2023-10-09T11:42:00.206277+0000","last_peered":"2023-10-09T11:42:00.206277+0000","last_clean":"2023-10-09T11:42:00.206277+0000","last_became_active":"2023-10-09T11:42:00.205921+0000","last_became_peered":"2023-10-09T11:42:00.205921+0000","last_unstale":"2023-10-09T11:42:00.206277+0000","last_undegraded":"2023-10-09T11:42:00.206277+0000","last_fullsized":"2023-10-09T11:42:00.206277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617207+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:43.402519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202510+0000","last_change":"2023-10-09T11:42:00.202641+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202510+0000","last_undegraded":"2023-10-09T11:42:00.202510+0000","last_fullsized":"2023-10-09T11:42:00.202510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.616677+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:29.687317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620657+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:36.960165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217334+0000","last_change":"2023-10-09T11:42:00.209841+0000","last_active":"2023-10-09T11:42:00.217334+0000","last_peered":"2023-10-09T11:42:00.217334+0000","last_clean":"2023-10-09T11:42:00.217334+0000","last_became_active":"2023-10-09T11:42:00.209230+0000","last_became_peered":"2023-10-09T11:42:00.209230+0000","last_unstale":"2023-10-09T11:42:00.217334+0000","last_undegraded":"2023-10-09T11:42:00.217334+0000","last_fullsized":"2023-10-09T11:42:00.217334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620564+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:36.586717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201273+0000","last_change":"2023-10-09T11:42:00.201408+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201273+0000","last_undegraded":"2023-10-09T11:42:00.201273+0000","last_fullsized":"2023-10-09T11:42:00.201273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618089+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:43.085894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218780+0000","last_change":"2023-10-09T11:42:00.218780+0000","last_active":"2023-10-09T11:42:00.218780+0000","last_peered":"2023-10-09T11:42:00.218780+0000","last_clean":"2023-10-09T11:42:00.218780+0000","last_became_active":"2023-10-09T11:42:00.218449+0000","last_became_peered":"2023-10-09T11:42:00.218449+0000","last_unstale":"2023-10-09T11:42:00.218780+0000","last_undegraded":"2023-10-09T11:42:00.218780+0000","last_fullsized":"2023-10-09T11:42:00.218780+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201160+0000","last_change":"2023-10-09T11:42:00.201290+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201160+0000","last_undegraded":"2023-10-09T11:42:00.201160+0000","last_fullsized":"2023-10-09T11:42:00.201160+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210628+0000","last_change":"2023-10-09T11:42:00.210628+0000","last_active":"2023-10-09T11:42:00.210628+0000","last_peered":"2023-10-09T11:42:00.210628+0000","last_clean":"2023-10-09T11:42:00.210628+0000","last_became_active":"2023-10-09T11:42:00.210317+0000","last_became_peered":"2023-10-09T11:42:00.210317+0000","last_unstale":"2023-10-09T11:42:00.210628+0000","last_undegraded":"2023-10-09T11:42:00.210628+0000","last_fullsized":"2023-10-09T11:42:00.210628+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201079+0000","last_change":"2023-10-09T11:42:00.201232+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201079+0000","last_undegraded":"2023-10-09T11:42:00.201079+0000","last_fullsized":"2023-10-09T11:42:00.201079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203732+0000","last_change":"2023-10-09T11:42:00.203844+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203732+0000","last_undegraded":"2023-10-09T11:42:00.203732+0000","last_fullsized":"2023-10-09T11:42:00.203732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619822+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:37.205757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618074+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:39.939846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214781+0000","last_change":"2023-10-09T11:42:00.214781+0000","last_active":"2023-10-09T11:42:00.214781+0000","last_peered":"2023-10-09T11:42:00.214781+0000","last_clean":"2023-10-09T11:42:00.214781+0000","last_became_active":"2023-10-09T11:42:00.214525+0000","last_became_peered":"2023-10-09T11:42:00.214525+0000","last_unstale":"2023-10-09T11:42:00.214781+0000","last_undegraded":"2023-10-09T11:42:00.214781+0000","last_fullsized":"2023-10-09T11:42:00.214781+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:07.099338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619361+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.026752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618903+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:10.585162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216982+0000","last_change":"2023-10-09T11:42:00.216982+0000","last_active":"2023-10-09T11:42:00.216982+0000","last_peered":"2023-10-09T11:42:00.216982+0000","last_clean":"2023-10-09T11:42:00.216982+0000","last_became_active":"2023-10-09T11:42:00.216574+0000","last_became_peered":"2023-10-09T11:42:00.216574+0000","last_unstale":"2023-10-09T11:42:00.216982+0000","last_undegraded":"2023-10-09T11:42:00.216982+0000","last_fullsized":"2023-10-09T11:42:00.216982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218148+0000","last_change":"2023-10-09T11:42:00.211866+0000","last_active":"2023-10-09T11:42:00.218148+0000","last_peered":"2023-10-09T11:42:00.218148+0000","last_clean":"2023-10-09T11:42:00.218148+0000","last_became_active":"2023-10-09T11:42:00.211567+0000","last_became_peered":"2023-10-09T11:42:00.211567+0000","last_unstale":"2023-10-09T11:42:00.218148+0000","last_undegraded":"2023-10-09T11:42:00.218148+0000","last_fullsized":"2023-10-09T11:42:00.218148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617614+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:19.337204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"111'4","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640069+0000","last_change":"2023-10-09T11:41:59.632481+0000","last_active":"2023-10-09T11:42:00.640069+0000","last_peered":"2023-10-09T11:42:00.640069+0000","last_clean":"2023-10-09T11:42:00.640069+0000","last_became_active":"2023-10-09T11:41:59.632060+0000","last_became_peered":"2023-10-09T11:41:59.632060+0000","last_unstale":"2023-10-09T11:42:00.640069+0000","last_undegraded":"2023-10-09T11:42:00.640069+0000","last_fullsized":"2023-10-09T11:42:00.640069+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209066+0000","last_change":"2023-10-09T11:42:00.209066+0000","last_active":"2023-10-09T11:42:00.209066+0000","last_peered":"2023-10-09T11:42:00.209066+0000","last_clean":"2023-10-09T11:42:00.209066+0000","last_became_active":"2023-10-09T11:42:00.208807+0000","last_became_peered":"2023-10-09T11:42:00.208807+0000","last_unstale":"2023-10-09T11:42:00.209066+0000","last_undegraded":"2023-10-09T11:42:00.209066+0000","last_fullsized":"2023-10-09T11:42:00.209066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204750+0000","last_change":"2023-10-09T11:41:59.624685+0000","last_active":"2023-10-09T11:42:00.204750+0000","last_peered":"2023-10-09T11:42:00.204750+0000","last_clean":"2023-10-09T11:42:00.204750+0000","last_became_active":"2023-10-09T11:41:59.624425+0000","last_became_peered":"2023-10-09T11:41:59.624425+0000","last_unstale":"2023-10-09T11:42:00.204750+0000","last_undegraded":"2023-10-09T11:42:00.204750+0000","last_fullsized":"2023-10-09T11:42:00.204750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221528+0000","last_change":"2023-10-09T11:42:00.221528+0000","last_active":"2023-10-09T11:42:00.221528+0000","last_peered":"2023-10-09T11:42:00.221528+0000","last_clean":"2023-10-09T11:42:00.221528+0000","last_became_active":"2023-10-09T11:42:00.221296+0000","last_became_peered":"2023-10-09T11:42:00.221296+0000","last_unstale":"2023-10-09T11:42:00.221528+0000","last_undegraded":"2023-10-09T11:42:00.221528+0000","last_fullsized":"2023-10-09T11:42:00.221528+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.241711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631392+0000","last_change":"2023-10-09T11:41:59.625246+0000","last_active":"2023-10-09T11:41:59.631392+0000","last_peered":"2023-10-09T11:41:59.631392+0000","last_clean":"2023-10-09T11:41:59.631392+0000","last_became_active":"2023-10-09T11:41:59.624956+0000","last_became_peered":"2023-10-09T11:41:59.624956+0000","last_unstale":"2023-10-09T11:41:59.631392+0000","last_undegraded":"2023-10-09T11:41:59.631392+0000","last_fullsized":"2023-10-09T11:41:59.631392+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217661+0000","last_change":"2023-10-09T11:42:00.217661+0000","last_active":"2023-10-09T11:42:00.217661+0000","last_peered":"2023-10-09T11:42:00.217661+0000","last_clean":"2023-10-09T11:42:00.217661+0000","last_became_active":"2023-10-09T11:42:00.217406+0000","last_became_peered":"2023-10-09T11:42:00.217406+0000","last_unstale":"2023-10-09T11:42:00.217661+0000","last_undegraded":"2023-10-09T11:42:00.217661+0000","last_fullsized":"2023-10-09T11:42:00.217661+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629218+0000","last_change":"2023-10-09T11:41:59.627331+0000","last_active":"2023-10-09T11:41:59.629218+0000","last_peered":"2023-10-09T11:41:59.629218+0000","last_clean":"2023-10-09T11:41:59.629218+0000","last_became_active":"2023-10-09T11:41:59.627063+0000","last_became_peered":"2023-10-09T11:41:59.627063+0000","last_unstale":"2023-10-09T11:41:59.629218+0000","last_undegraded":"2023-10-09T11:41:59.629218+0000","last_fullsized":"2023-10-09T11:41:59.629218+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:03.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.620149+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:06.310527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629274+0000","last_change":"2023-10-09T11:41:59.627978+0000","last_active":"2023-10-09T11:41:59.629274+0000","last_peered":"2023-10-09T11:41:59.629274+0000","last_clean":"2023-10-09T11:41:59.629274+0000","last_became_active":"2023-10-09T11:41:59.627728+0000","last_became_peered":"2023-10-09T11:41:59.627728+0000","last_unstale":"2023-10-09T11:41:59.629274+0000","last_undegraded":"2023-10-09T11:41:59.629274+0000","last_fullsized":"2023-10-09T11:41:59.629274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217382+0000","last_change":"2023-10-09T11:42:00.209626+0000","last_active":"2023-10-09T11:42:00.217382+0000","last_peered":"2023-10-09T11:42:00.217382+0000","last_clean":"2023-10-09T11:42:00.217382+0000","last_became_active":"2023-10-09T11:42:00.209213+0000","last_became_peered":"2023-10-09T11:42:00.209213+0000","last_unstale":"2023-10-09T11:42:00.217382+0000","last_undegraded":"2023-10-09T11:42:00.217382+0000","last_fullsized":"2023-10-09T11:42:00.217382+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629750+0000","last_change":"2023-10-09T11:41:59.629750+0000","last_active":"2023-10-09T11:41:59.629750+0000","last_peered":"2023-10-09T11:41:59.629750+0000","last_clean":"2023-10-09T11:41:59.629750+0000","last_became_active":"2023-10-09T11:41:59.629570+0000","last_became_peered":"2023-10-09T11:41:59.629570+0000","last_unstale":"2023-10-09T11:41:59.629750+0000","last_undegraded":"2023-10-09T11:41:59.629750+0000","last_fullsized":"2023-10-09T11:41:59.629750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219151+0000","last_change":"2023-10-09T11:42:00.213355+0000","last_active":"2023-10-09T11:42:00.219151+0000","last_peered":"2023-10-09T11:42:00.219151+0000","last_clean":"2023-10-09T11:42:00.219151+0000","last_became_active":"2023-10-09T11:42:00.212927+0000","last_became_peered":"2023-10-09T11:42:00.212927+0000","last_unstale":"2023-10-09T11:42:00.219151+0000","last_undegraded":"2023-10-09T11:42:00.219151+0000","last_fullsized":"2023-10-09T11:42:00.219151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.202774+0000","last_change":"2023-10-09T11:41:59.637978+0000","last_active":"2023-10-09T11:42:00.202774+0000","last_peered":"2023-10-09T11:42:00.202774+0000","last_clean":"2023-10-09T11:42:00.202774+0000","last_became_active":"2023-10-09T11:41:59.637664+0000","last_became_peered":"2023-10-09T11:41:59.637664+0000","last_unstale":"2023-10-09T11:42:00.202774+0000","last_undegraded":"2023-10-09T11:42:00.202774+0000","last_fullsized":"2023-10-09T11:42:00.202774+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:08.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202064+0000","last_change":"2023-10-09T11:42:00.202226+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202064+0000","last_undegraded":"2023-10-09T11:42:00.202064+0000","last_fullsized":"2023-10-09T11:42:00.202064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634398+0000","last_change":"2023-10-09T11:41:59.632493+0000","last_active":"2023-10-09T11:41:59.634398+0000","last_peered":"2023-10-09T11:41:59.634398+0000","last_clean":"2023-10-09T11:41:59.634398+0000","last_became_active":"2023-10-09T11:41:59.632168+0000","last_became_peered":"2023-10-09T11:41:59.632168+0000","last_unstale":"2023-10-09T11:41:59.634398+0000","last_undegraded":"2023-10-09T11:41:59.634398+0000","last_fullsized":"2023-10-09T11:41:59.634398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:38.935473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619248+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:02.740000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.637595+0000","last_change":"2023-10-09T11:41:59.632085+0000","last_active":"2023-10-09T11:41:59.637595+0000","last_peered":"2023-10-09T11:41:59.637595+0000","last_clean":"2023-10-09T11:41:59.637595+0000","last_became_active":"2023-10-09T11:41:59.631758+0000","last_became_peered":"2023-10-09T11:41:59.631758+0000","last_unstale":"2023-10-09T11:41:59.637595+0000","last_undegraded":"2023-10-09T11:41:59.637595+0000","last_fullsized":"2023-10-09T11:41:59.637595+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:57.551222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212835+0000","last_change":"2023-10-09T11:42:00.212835+0000","last_active":"2023-10-09T11:42:00.212835+0000","last_peered":"2023-10-09T11:42:00.212835+0000","last_clean":"2023-10-09T11:42:00.212835+0000","last_became_active":"2023-10-09T11:42:00.212518+0000","last_became_peered":"2023-10-09T11:42:00.212518+0000","last_unstale":"2023-10-09T11:42:00.212835+0000","last_undegraded":"2023-10-09T11:42:00.212835+0000","last_fullsized":"2023-10-09T11:42:00.212835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632977+0000","last_change":"2023-10-09T11:41:59.632977+0000","last_active":"2023-10-09T11:41:59.632977+0000","last_peered":"2023-10-09T11:41:59.632977+0000","last_clean":"2023-10-09T11:41:59.632977+0000","last_became_active":"2023-10-09T11:41:59.632684+0000","last_became_peered":"2023-10-09T11:41:59.632684+0000","last_unstale":"2023-10-09T11:41:59.632977+0000","last_undegraded":"2023-10-09T11:41:59.632977+0000","last_fullsized":"2023-10-09T11:41:59.632977+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219167+0000","last_change":"2023-10-09T11:42:00.219167+0000","last_active":"2023-10-09T11:42:00.219167+0000","last_peered":"2023-10-09T11:42:00.219167+0000","last_clean":"2023-10-09T11:42:00.219167+0000","last_became_active":"2023-10-09T11:42:00.218471+0000","last_became_peered":"2023-10-09T11:42:00.218471+0000","last_unstale":"2023-10-09T11:42:00.219167+0000","last_undegraded":"2023-10-09T11:42:00.219167+0000","last_fullsized":"2023-10-09T11:42:00.219167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"111'3","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.637607+0000","last_change":"2023-10-09T11:41:59.630953+0000","last_active":"2023-10-09T11:42:00.637607+0000","last_peered":"2023-10-09T11:42:00.637607+0000","last_clean":"2023-10-09T11:42:00.637607+0000","last_became_active":"2023-10-09T11:41:59.630684+0000","last_became_peered":"2023-10-09T11:41:59.630684+0000","last_unstale":"2023-10-09T11:42:00.637607+0000","last_undegraded":"2023-10-09T11:42:00.637607+0000","last_fullsized":"2023-10-09T11:42:00.637607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220411+0000","last_change":"2023-10-09T11:42:00.220411+0000","last_active":"2023-10-09T11:42:00.220411+0000","last_peered":"2023-10-09T11:42:00.220411+0000","last_clean":"2023-10-09T11:42:00.220411+0000","last_became_active":"2023-10-09T11:42:00.220156+0000","last_became_peered":"2023-10-09T11:42:00.220156+0000","last_unstale":"2023-10-09T11:42:00.220411+0000","last_undegraded":"2023-10-09T11:42:00.220411+0000","last_fullsized":"2023-10-09T11:42:00.220411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:08.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"111'6","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640498+0000","last_change":"2023-10-09T11:41:59.633075+0000","last_active":"2023-10-09T11:42:00.640498+0000","last_peered":"2023-10-09T11:42:00.640498+0000","last_clean":"2023-10-09T11:42:00.640498+0000","last_became_active":"2023-10-09T11:41:59.632787+0000","last_became_peered":"2023-10-09T11:41:59.632787+0000","last_unstale":"2023-10-09T11:42:00.640498+0000","last_undegraded":"2023-10-09T11:42:00.640498+0000","last_fullsized":"2023-10-09T11:42:00.640498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:12.460978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.618318+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:28.516478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635800+0000","last_change":"2023-10-09T11:41:59.635800+0000","last_active":"2023-10-09T11:41:59.635800+0000","last_peered":"2023-10-09T11:41:59.635800+0000","last_clean":"2023-10-09T11:41:59.635800+0000","last_became_active":"2023-10-09T11:41:59.635487+0000","last_became_peered":"2023-10-09T11:41:59.635487+0000","last_unstale":"2023-10-09T11:41:59.635800+0000","last_undegraded":"2023-10-09T11:41:59.635800+0000","last_fullsized":"2023-10-09T11:41:59.635800+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:26.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202052+0000","last_change":"2023-10-09T11:42:00.202159+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202052+0000","last_undegraded":"2023-10-09T11:42:00.202052+0000","last_fullsized":"2023-10-09T11:42:00.202052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629190+0000","last_change":"2023-10-09T11:41:59.626882+0000","last_active":"2023-10-09T11:41:59.629190+0000","last_peered":"2023-10-09T11:41:59.629190+0000","last_clean":"2023-10-09T11:41:59.629190+0000","last_became_active":"2023-10-09T11:41:59.626653+0000","last_became_peered":"2023-10-09T11:41:59.626653+0000","last_unstale":"2023-10-09T11:41:59.629190+0000","last_undegraded":"2023-10-09T11:41:59.629190+0000","last_fullsized":"2023-10-09T11:41:59.629190+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.208367+0000","last_change":"2023-10-09T11:42:00.208367+0000","last_active":"2023-10-09T11:42:00.208367+0000","last_peered":"2023-10-09T11:42:00.208367+0000","last_clean":"2023-10-09T11:42:00.208367+0000","last_became_active":"2023-10-09T11:42:00.207838+0000","last_became_peered":"2023-10-09T11:42:00.207838+0000","last_unstale":"2023-10-09T11:42:00.208367+0000","last_undegraded":"2023-10-09T11:42:00.208367+0000","last_fullsized":"2023-10-09T11:42:00.208367+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"111'8","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638449+0000","last_change":"2023-10-09T11:41:59.629160+0000","last_active":"2023-10-09T11:42:00.638449+0000","last_peered":"2023-10-09T11:42:00.638449+0000","last_clean":"2023-10-09T11:42:00.638449+0000","last_became_active":"2023-10-09T11:41:59.628930+0000","last_became_peered":"2023-10-09T11:41:59.628930+0000","last_unstale":"2023-10-09T11:42:00.638449+0000","last_undegraded":"2023-10-09T11:42:00.638449+0000","last_fullsized":"2023-10-09T11:42:00.638449+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:12.328048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214813+0000","last_change":"2023-10-09T11:42:00.214813+0000","last_active":"2023-10-09T11:42:00.214813+0000","last_peered":"2023-10-09T11:42:00.214813+0000","last_clean":"2023-10-09T11:42:00.214813+0000","last_became_active":"2023-10-09T11:42:00.214504+0000","last_became_peered":"2023-10-09T11:42:00.214504+0000","last_unstale":"2023-10-09T11:42:00.214813+0000","last_undegraded":"2023-10-09T11:42:00.214813+0000","last_fullsized":"2023-10-09T11:42:00.214813+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.205279+0000","last_change":"2023-10-09T11:41:59.628234+0000","last_active":"2023-10-09T11:42:00.205279+0000","last_peered":"2023-10-09T11:42:00.205279+0000","last_clean":"2023-10-09T11:42:00.205279+0000","last_became_active":"2023-10-09T11:41:59.627982+0000","last_became_peered":"2023-10-09T11:41:59.627982+0000","last_unstale":"2023-10-09T11:42:00.205279+0000","last_undegraded":"2023-10-09T11:42:00.205279+0000","last_fullsized":"2023-10-09T11:42:00.205279+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:40.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.213778+0000","last_change":"2023-10-09T11:42:00.213778+0000","last_active":"2023-10-09T11:42:00.213778+0000","last_peered":"2023-10-09T11:42:00.213778+0000","last_clean":"2023-10-09T11:42:00.213778+0000","last_became_active":"2023-10-09T11:42:00.213110+0000","last_became_peered":"2023-10-09T11:42:00.213110+0000","last_unstale":"2023-10-09T11:42:00.213778+0000","last_undegraded":"2023-10-09T11:42:00.213778+0000","last_fullsized":"2023-10-09T11:42:00.213778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:22.834787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628159+0000","last_change":"2023-10-09T11:41:59.624967+0000","last_active":"2023-10-09T11:41:59.628159+0000","last_peered":"2023-10-09T11:41:59.628159+0000","last_clean":"2023-10-09T11:41:59.628159+0000","last_became_active":"2023-10-09T11:41:59.624703+0000","last_became_peered":"2023-10-09T11:41:59.624703+0000","last_unstale":"2023-10-09T11:41:59.628159+0000","last_undegraded":"2023-10-09T11:41:59.628159+0000","last_fullsized":"2023-10-09T11:41:59.628159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.895476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.617549+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:22.277757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.636944+0000","last_change":"2023-10-09T11:41:59.635012+0000","last_active":"2023-10-09T11:42:00.636944+0000","last_peered":"2023-10-09T11:42:00.636944+0000","last_clean":"2023-10-09T11:42:00.636944+0000","last_became_active":"2023-10-09T11:41:59.634630+0000","last_became_peered":"2023-10-09T11:41:59.634630+0000","last_unstale":"2023-10-09T11:42:00.636944+0000","last_undegraded":"2023-10-09T11:42:00.636944+0000","last_fullsized":"2023-10-09T11:42:00.636944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:21.830413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202791+0000","last_change":"2023-10-09T11:42:00.202917+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202791+0000","last_undegraded":"2023-10-09T11:42:00.202791+0000","last_fullsized":"2023-10-09T11:42:00.202791+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632074+0000","last_change":"2023-10-09T11:41:59.627009+0000","last_active":"2023-10-09T11:41:59.632074+0000","last_peered":"2023-10-09T11:41:59.632074+0000","last_clean":"2023-10-09T11:41:59.632074+0000","last_became_active":"2023-10-09T11:41:59.626708+0000","last_became_peered":"2023-10-09T11:41:59.626708+0000","last_unstale":"2023-10-09T11:41:59.632074+0000","last_undegraded":"2023-10-09T11:41:59.632074+0000","last_fullsized":"2023-10-09T11:41:59.632074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619698+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:41.221201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638734+0000","last_change":"2023-10-09T11:41:59.631402+0000","last_active":"2023-10-09T11:42:00.638734+0000","last_peered":"2023-10-09T11:42:00.638734+0000","last_clean":"2023-10-09T11:42:00.638734+0000","last_became_active":"2023-10-09T11:41:59.630980+0000","last_became_peered":"2023-10-09T11:41:59.630980+0000","last_unstale":"2023-10-09T11:42:00.638734+0000","last_undegraded":"2023-10-09T11:42:00.638734+0000","last_fullsized":"2023-10-09T11:42:00.638734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:10.015929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217404+0000","last_change":"2023-10-09T11:42:00.210737+0000","last_active":"2023-10-09T11:42:00.217404+0000","last_peered":"2023-10-09T11:42:00.217404+0000","last_clean":"2023-10-09T11:42:00.217404+0000","last_became_active":"2023-10-09T11:42:00.209921+0000","last_became_peered":"2023-10-09T11:42:00.209921+0000","last_unstale":"2023-10-09T11:42:00.217404+0000","last_undegraded":"2023-10-09T11:42:00.217404+0000","last_fullsized":"2023-10-09T11:42:00.217404+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632230+0000","last_change":"2023-10-09T11:41:59.632230+0000","last_active":"2023-10-09T11:41:59.632230+0000","last_peered":"2023-10-09T11:41:59.632230+0000","last_clean":"2023-10-09T11:41:59.632230+0000","last_became_active":"2023-10-09T11:41:59.631971+0000","last_became_peered":"2023-10-09T11:41:59.631971+0000","last_unstale":"2023-10-09T11:41:59.632230+0000","last_undegraded":"2023-10-09T11:41:59.632230+0000","last_fullsized":"2023-10-09T11:41:59.632230+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202067+0000","last_change":"2023-10-09T11:42:00.202208+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202067+0000","last_undegraded":"2023-10-09T11:42:00.202067+0000","last_fullsized":"2023-10-09T11:42:00.202067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631307+0000","last_change":"2023-10-09T11:41:59.631307+0000","last_active":"2023-10-09T11:41:59.631307+0000","last_peered":"2023-10-09T11:41:59.631307+0000","last_clean":"2023-10-09T11:41:59.631307+0000","last_became_active":"2023-10-09T11:41:59.630943+0000","last_became_peered":"2023-10-09T11:41:59.630943+0000","last_unstale":"2023-10-09T11:41:59.631307+0000","last_undegraded":"2023-10-09T11:41:59.631307+0000","last_fullsized":"2023-10-09T11:41:59.631307+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:57.854138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219945+0000","last_change":"2023-10-09T11:42:00.219945+0000","last_active":"2023-10-09T11:42:00.219945+0000","last_peered":"2023-10-09T11:42:00.219945+0000","last_clean":"2023-10-09T11:42:00.219945+0000","last_became_active":"2023-10-09T11:42:00.219612+0000","last_became_peered":"2023-10-09T11:42:00.219612+0000","last_unstale":"2023-10-09T11:42:00.219945+0000","last_undegraded":"2023-10-09T11:42:00.219945+0000","last_fullsized":"2023-10-09T11:42:00.219945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628174+0000","last_change":"2023-10-09T11:41:59.625622+0000","last_active":"2023-10-09T11:41:59.628174+0000","last_peered":"2023-10-09T11:41:59.628174+0000","last_clean":"2023-10-09T11:41:59.628174+0000","last_became_active":"2023-10-09T11:41:59.625346+0000","last_became_peered":"2023-10-09T11:41:59.625346+0000","last_unstale":"2023-10-09T11:41:59.628174+0000","last_undegraded":"2023-10-09T11:41:59.628174+0000","last_fullsized":"2023-10-09T11:41:59.628174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:08.373571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217471+0000","last_change":"2023-10-09T11:42:00.210536+0000","last_active":"2023-10-09T11:42:00.217471+0000","last_peered":"2023-10-09T11:42:00.217471+0000","last_clean":"2023-10-09T11:42:00.217471+0000","last_became_active":"2023-10-09T11:42:00.210277+0000","last_became_peered":"2023-10-09T11:42:00.210277+0000","last_unstale":"2023-10-09T11:42:00.217471+0000","last_undegraded":"2023-10-09T11:42:00.217471+0000","last_fullsized":"2023-10-09T11:42:00.217471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631336+0000","last_change":"2023-10-09T11:41:59.631336+0000","last_active":"2023-10-09T11:41:59.631336+0000","last_peered":"2023-10-09T11:41:59.631336+0000","last_clean":"2023-10-09T11:41:59.631336+0000","last_became_active":"2023-10-09T11:41:59.631014+0000","last_became_peered":"2023-10-09T11:41:59.631014+0000","last_unstale":"2023-10-09T11:41:59.631336+0000","last_undegraded":"2023-10-09T11:41:59.631336+0000","last_fullsized":"2023-10-09T11:41:59.631336+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:04.014266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.616820+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:00.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640360+0000","last_change":"2023-10-09T11:41:59.635719+0000","last_active":"2023-10-09T11:41:59.640360+0000","last_peered":"2023-10-09T11:41:59.640360+0000","last_clean":"2023-10-09T11:41:59.640360+0000","last_became_active":"2023-10-09T11:41:59.635402+0000","last_became_peered":"2023-10-09T11:41:59.635402+0000","last_unstale":"2023-10-09T11:41:59.640360+0000","last_undegraded":"2023-10-09T11:41:59.640360+0000","last_fullsized":"2023-10-09T11:41:59.640360+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202476+0000","last_change":"2023-10-09T11:42:00.202589+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202476+0000","last_undegraded":"2023-10-09T11:42:00.202476+0000","last_fullsized":"2023-10-09T11:42:00.202476+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634422+0000","last_change":"2023-10-09T11:41:59.632579+0000","last_active":"2023-10-09T11:41:59.634422+0000","last_peered":"2023-10-09T11:41:59.634422+0000","last_clean":"2023-10-09T11:41:59.634422+0000","last_became_active":"2023-10-09T11:41:59.632268+0000","last_became_peered":"2023-10-09T11:41:59.632268+0000","last_unstale":"2023-10-09T11:41:59.634422+0000","last_undegraded":"2023-10-09T11:41:59.634422+0000","last_fullsized":"2023-10-09T11:41:59.634422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217040+0000","last_change":"2023-10-09T11:42:00.209277+0000","last_active":"2023-10-09T11:42:00.217040+0000","last_peered":"2023-10-09T11:42:00.217040+0000","last_clean":"2023-10-09T11:42:00.217040+0000","last_became_active":"2023-10-09T11:42:00.208952+0000","last_became_peered":"2023-10-09T11:42:00.208952+0000","last_unstale":"2023-10-09T11:42:00.217040+0000","last_undegraded":"2023-10-09T11:42:00.217040+0000","last_fullsized":"2023-10-09T11:42:00.217040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628205+0000","last_change":"2023-10-09T11:41:59.625759+0000","last_active":"2023-10-09T11:41:59.628205+0000","last_peered":"2023-10-09T11:41:59.628205+0000","last_clean":"2023-10-09T11:41:59.628205+0000","last_became_active":"2023-10-09T11:41:59.623565+0000","last_became_peered":"2023-10-09T11:41:59.623565+0000","last_unstale":"2023-10-09T11:41:59.628205+0000","last_undegraded":"2023-10-09T11:41:59.628205+0000","last_fullsized":"2023-10-09T11:41:59.628205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:36.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220642+0000","last_change":"2023-10-09T11:42:00.220642+0000","last_active":"2023-10-09T11:42:00.220642+0000","last_peered":"2023-10-09T11:42:00.220642+0000","last_clean":"2023-10-09T11:42:00.220642+0000","last_became_active":"2023-10-09T11:42:00.220107+0000","last_became_peered":"2023-10-09T11:42:00.220107+0000","last_unstale":"2023-10-09T11:42:00.220642+0000","last_undegraded":"2023-10-09T11:42:00.220642+0000","last_fullsized":"2023-10-09T11:42:00.220642+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629254+0000","last_change":"2023-10-09T11:41:59.627466+0000","last_active":"2023-10-09T11:41:59.629254+0000","last_peered":"2023-10-09T11:41:59.629254+0000","last_clean":"2023-10-09T11:41:59.629254+0000","last_became_active":"2023-10-09T11:41:59.626717+0000","last_became_peered":"2023-10-09T11:41:59.626717+0000","last_unstale":"2023-10-09T11:41:59.629254+0000","last_undegraded":"2023-10-09T11:41:59.629254+0000","last_fullsized":"2023-10-09T11:41:59.629254+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.207614+0000","last_change":"2023-10-09T11:42:00.207614+0000","last_active":"2023-10-09T11:42:00.207614+0000","last_peered":"2023-10-09T11:42:00.207614+0000","last_clean":"2023-10-09T11:42:00.207614+0000","last_became_active":"2023-10-09T11:42:00.207309+0000","last_became_peered":"2023-10-09T11:42:00.207309+0000","last_unstale":"2023-10-09T11:42:00.207614+0000","last_undegraded":"2023-10-09T11:42:00.207614+0000","last_fullsized":"2023-10-09T11:42:00.207614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:58.991113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640269+0000","last_change":"2023-10-09T11:41:59.632416+0000","last_active":"2023-10-09T11:41:59.640269+0000","last_peered":"2023-10-09T11:41:59.640269+0000","last_clean":"2023-10-09T11:41:59.640269+0000","last_became_active":"2023-10-09T11:41:59.632037+0000","last_became_peered":"2023-10-09T11:41:59.632037+0000","last_unstale":"2023-10-09T11:41:59.640269+0000","last_undegraded":"2023-10-09T11:41:59.640269+0000","last_fullsized":"2023-10-09T11:41:59.640269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:59.610134+0000","last_change":"2023-10-09T11:41:59.619966+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:59.610134+0000","last_undegraded":"2023-10-09T11:41:59.610134+0000","last_fullsized":"2023-10-09T11:41:59.610134+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:29.230677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.633991+0000","last_change":"2023-10-09T11:41:59.633991+0000","last_active":"2023-10-09T11:41:59.633991+0000","last_peered":"2023-10-09T11:41:59.633991+0000","last_clean":"2023-10-09T11:41:59.633991+0000","last_became_active":"2023-10-09T11:41:59.633652+0000","last_became_peered":"2023-10-09T11:41:59.633652+0000","last_unstale":"2023-10-09T11:41:59.633991+0000","last_undegraded":"2023-10-09T11:41:59.633991+0000","last_fullsized":"2023-10-09T11:41:59.633991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202424+0000","last_change":"2023-10-09T11:42:00.202544+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202424+0000","last_undegraded":"2023-10-09T11:42:00.202424+0000","last_fullsized":"2023-10-09T11:42:00.202424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635843+0000","last_change":"2023-10-09T11:41:59.635108+0000","last_active":"2023-10-09T11:41:59.635843+0000","last_peered":"2023-10-09T11:41:59.635843+0000","last_clean":"2023-10-09T11:41:59.635843+0000","last_became_active":"2023-10-09T11:41:59.634840+0000","last_became_peered":"2023-10-09T11:41:59.634840+0000","last_unstale":"2023-10-09T11:41:59.635843+0000","last_undegraded":"2023-10-09T11:41:59.635843+0000","last_fullsized":"2023-10-09T11:41:59.635843+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:42.570558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220378+0000","last_change":"2023-10-09T11:42:00.220378+0000","last_active":"2023-10-09T11:42:00.220378+0000","last_peered":"2023-10-09T11:42:00.220378+0000","last_clean":"2023-10-09T11:42:00.220378+0000","last_became_active":"2023-10-09T11:42:00.219769+0000","last_became_peered":"2023-10-09T11:42:00.219769+0000","last_unstale":"2023-10-09T11:42:00.220378+0000","last_undegraded":"2023-10-09T11:42:00.220378+0000","last_fullsized":"2023-10-09T11:42:00.220378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:03.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.639802+0000","last_change":"2023-10-09T11:41:59.632436+0000","last_active":"2023-10-09T11:42:00.639802+0000","last_peered":"2023-10-09T11:42:00.639802+0000","last_clean":"2023-10-09T11:42:00.639802+0000","last_became_active":"2023-10-09T11:41:59.632129+0000","last_became_peered":"2023-10-09T11:41:59.632129+0000","last_unstale":"2023-10-09T11:42:00.639802+0000","last_undegraded":"2023-10-09T11:42:00.639802+0000","last_fullsized":"2023-10-09T11:42:00.639802+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.621016+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:59.621016+0000","last_peered":"2023-10-09T11:41:59.621016+0000","last_clean":"2023-10-09T11:41:59.621016+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:59.621016+0000","last_undegraded":"2023-10-09T11:41:59.621016+0000","last_fullsized":"2023-10-09T11:41:59.621016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1188432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.628},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.74399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.434},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.436},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.93000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":1181669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.246},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.222}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1359872,"data_stored":585038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.33900000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.311}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.378},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.66100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1388544,"data_stored":598134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:05.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 Processor -- start 2023-10-09T11:42:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 -- start start 2023-10-09T11:42:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a040b1b20 0x7f8a0415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a04161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a04158210 con 0x7f8a04157600 2023-10-09T11:42:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a040cb850 con 0x7f8a040b1b20 2023-10-09T11:42:05.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a0a1a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040cb290 con 0x7f8a041579d0 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.276+0000 7f8a02ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a040b1b20 0x7f8a0415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a037fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a04157600 0x7f8a040b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60528/0 (socket says 172.21.15.26:60528) 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a037fe700 1 -- 172.21.15.26:0/4289994728 learned_addr learned my addr 172.21.15.26:0/4289994728 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a03fff700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a04161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a02ffd700 1 -- 172.21.15.26:0/4289994728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 msgr2=0x7f8a04161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a02ffd700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a04161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a02ffd700 1 -- 172.21.15.26:0/4289994728 >> v1:172.21.15.26:6789/0 conn(0x7f8a04157600 legacy=0x7f8a040b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a02ffd700 1 -- 172.21.15.26:0/4289994728 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040cb570 con 0x7f8a040b1b20 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a027fc700 1 -- 172.21.15.26:0/4289994728 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289544069 0 0) 0x7f8a04158210 con 0x7f8a04157600 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a02ffd700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a040b1b20 0x7f8a0415f2b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098e0 tx=0x7f89f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c832efedef8719c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a027fc700 1 -- 172.21.15.26:0/4289994728 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800b640 con 0x7f8a040b1b20 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a027fc700 1 -- 172.21.15.26:0/4289994728 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800b7a0 con 0x7f8a040b1b20 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.277+0000 7f8a027fc700 1 -- 172.21.15.26:0/4289994728 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800bb40 con 0x7f8a040b1b20 2023-10-09T11:42:05.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/4289994728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a040b1b20 msgr2=0x7f8a0415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a040b1b20 0x7f8a0415f2b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098e0 tx=0x7f89f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/4289994728 shutdown_connections 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a04161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/4289994728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a040b1b20 0x7f8a0415f2b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/4289994728 >> 172.21.15.26:0/4289994728 conn(0x7f8a0406d170 msgr2=0x7f8a040cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/4289994728 shutdown_connections 2023-10-09T11:42:05.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.278+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/4289994728 wait complete. 2023-10-09T11:42:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.279+0000 7f8a0a1a4700 1 Processor -- start 2023-10-09T11:42:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.279+0000 7f8a0a1a4700 1 -- start start 2023-10-09T11:42:05.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 0x7f8a0416a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a0416ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04169e50 con 0x7f8a04157600 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040a9b80 con 0x7f8a040b1b20 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a0a1a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0416d840 con 0x7f8a041579d0 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42972/0 (socket says 172.21.15.26:42972) 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 -- 172.21.15.26:0/1284560437 learned_addr learned my addr 172.21.15.26:0/1284560437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a03fff700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a0416ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a037fe700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 0x7f8a0416a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 -- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 msgr2=0x7f8a0416ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a0416ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 -- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 msgr2=0x7f8a0416a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 0x7f8a0416a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a02ffd700 1 -- 172.21.15.26:0/1284560437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8009420 con 0x7f8a04157600 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a03fff700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a0416ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.280+0000 7f8a037fe700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 0x7f8a0416a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f8a02ffd700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8a0406d610 tx=0x7f89f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800bb20 con 0x7f8a04157600 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8011420 con 0x7f8a04157600 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0416db20 con 0x7f8a04157600 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80117a0 con 0x7f8a04157600 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.281+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a04169ae0 con 0x7f8a04157600 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.282+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0416a000 con 0x7f8a04157600 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.282+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f89f8011b50 con 0x7f8a04157600 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.282+0000 7f89eb7fe700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 0x7f89f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.283+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89f8086370 con 0x7f8a04157600 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.283+0000 7f8a037fe700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 0x7f89f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.283+0000 7f8a037fe700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 0x7f89f00697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f89f40018d0 tx=0x7f89f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.287+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a0416a000 con 0x7f8a04157600 2023-10-09T11:42:05.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.476+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a0404c3c0 con 0x7f89f0067320 2023-10-09T11:42:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.485+0000 7f89eb7fe700 1 -- 172.21.15.26:0/1284560437 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289244 (secure 0 0 0) 0x7f8a0404c3c0 con 0x7f89f0067320 2023-10-09T11:42:05.489 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 msgr2=0x7f89f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 0x7f89f00697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f89f40018d0 tx=0x7f89f4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 msgr2=0x7f8a04149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8a0406d610 tx=0x7f89f8017000 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 shutdown_connections 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f89f0067320 0x7f89f00697d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8a041579d0 0x7f8a0416ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040b1b20 0x7f8a0416a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 --2- 172.21.15.26:0/1284560437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a04157600 0x7f8a04149d90 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 >> 172.21.15.26:0/1284560437 conn(0x7f8a0406d170 msgr2=0x7f8a040c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 shutdown_connections 2023-10-09T11:42:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.488+0000 7f8a0a1a4700 1 -- 172.21.15.26:0/1284560437 wait complete. 2023-10-09T11:42:05.493 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:05.501 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2023-10-09T11:42:05.203610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423068,"kb_used_data":11996,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551652,"statfs":{"total":773094113280,"available":770612891648,"internally_reserved":0,"allocated":12283904,"data_stored":5965116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001534"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218330+0000","last_change":"2023-10-09T11:42:00.212745+0000","last_active":"2023-10-09T11:42:00.218330+0000","last_peered":"2023-10-09T11:42:00.218330+0000","last_clean":"2023-10-09T11:42:00.218330+0000","last_became_active":"2023-10-09T11:42:00.212470+0000","last_became_peered":"2023-10-09T11:42:00.212470+0000","last_unstale":"2023-10-09T11:42:00.218330+0000","last_undegraded":"2023-10-09T11:42:00.218330+0000","last_fullsized":"2023-10-09T11:42:00.218330+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:58.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203658+0000","last_change":"2023-10-09T11:42:00.203777+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203658+0000","last_undegraded":"2023-10-09T11:42:00.203658+0000","last_fullsized":"2023-10-09T11:42:00.203658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209345+0000","last_change":"2023-10-09T11:42:00.209345+0000","last_active":"2023-10-09T11:42:00.209345+0000","last_peered":"2023-10-09T11:42:00.209345+0000","last_clean":"2023-10-09T11:42:00.209345+0000","last_became_active":"2023-10-09T11:42:00.208655+0000","last_became_peered":"2023-10-09T11:42:00.208655+0000","last_unstale":"2023-10-09T11:42:00.209345+0000","last_undegraded":"2023-10-09T11:42:00.209345+0000","last_fullsized":"2023-10-09T11:42:00.209345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219021+0000","last_change":"2023-10-09T11:42:00.216889+0000","last_active":"2023-10-09T11:42:00.219021+0000","last_peered":"2023-10-09T11:42:00.219021+0000","last_clean":"2023-10-09T11:42:00.219021+0000","last_became_active":"2023-10-09T11:42:00.216621+0000","last_became_peered":"2023-10-09T11:42:00.216621+0000","last_unstale":"2023-10-09T11:42:00.219021+0000","last_undegraded":"2023-10-09T11:42:00.219021+0000","last_fullsized":"2023-10-09T11:42:00.219021+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:04.811163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218958+0000","last_change":"2023-10-09T11:42:00.218958+0000","last_active":"2023-10-09T11:42:00.218958+0000","last_peered":"2023-10-09T11:42:00.218958+0000","last_clean":"2023-10-09T11:42:00.218958+0000","last_became_active":"2023-10-09T11:42:00.218285+0000","last_became_peered":"2023-10-09T11:42:00.218285+0000","last_unstale":"2023-10-09T11:42:00.218958+0000","last_undegraded":"2023-10-09T11:42:00.218958+0000","last_fullsized":"2023-10-09T11:42:00.218958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216107+0000","last_change":"2023-10-09T11:42:00.209299+0000","last_active":"2023-10-09T11:42:00.216107+0000","last_peered":"2023-10-09T11:42:00.216107+0000","last_clean":"2023-10-09T11:42:00.216107+0000","last_became_active":"2023-10-09T11:42:00.208979+0000","last_became_peered":"2023-10-09T11:42:00.208979+0000","last_unstale":"2023-10-09T11:42:00.216107+0000","last_undegraded":"2023-10-09T11:42:00.216107+0000","last_fullsized":"2023-10-09T11:42:00.216107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217413+0000","last_change":"2023-10-09T11:42:00.211559+0000","last_active":"2023-10-09T11:42:00.217413+0000","last_peered":"2023-10-09T11:42:00.217413+0000","last_clean":"2023-10-09T11:42:00.217413+0000","last_became_active":"2023-10-09T11:42:00.211240+0000","last_became_peered":"2023-10-09T11:42:00.211240+0000","last_unstale":"2023-10-09T11:42:00.217413+0000","last_undegraded":"2023-10-09T11:42:00.217413+0000","last_fullsized":"2023-10-09T11:42:00.217413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219175+0000","last_change":"2023-10-09T11:42:00.213660+0000","last_active":"2023-10-09T11:42:00.219175+0000","last_peered":"2023-10-09T11:42:00.219175+0000","last_clean":"2023-10-09T11:42:00.219175+0000","last_became_active":"2023-10-09T11:42:00.213283+0000","last_became_peered":"2023-10-09T11:42:00.213283+0000","last_unstale":"2023-10-09T11:42:00.219175+0000","last_undegraded":"2023-10-09T11:42:00.219175+0000","last_fullsized":"2023-10-09T11:42:00.219175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212819+0000","last_change":"2023-10-09T11:42:00.212819+0000","last_active":"2023-10-09T11:42:00.212819+0000","last_peered":"2023-10-09T11:42:00.212819+0000","last_clean":"2023-10-09T11:42:00.212819+0000","last_became_active":"2023-10-09T11:42:00.212528+0000","last_became_peered":"2023-10-09T11:42:00.212528+0000","last_unstale":"2023-10-09T11:42:00.212819+0000","last_undegraded":"2023-10-09T11:42:00.212819+0000","last_fullsized":"2023-10-09T11:42:00.212819+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203350+0000","last_change":"2023-10-09T11:42:00.203471+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203350+0000","last_undegraded":"2023-10-09T11:42:00.203350+0000","last_fullsized":"2023-10-09T11:42:00.203350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201592+0000","last_change":"2023-10-09T11:42:00.201704+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201592+0000","last_undegraded":"2023-10-09T11:42:00.201592+0000","last_fullsized":"2023-10-09T11:42:00.201592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.206277+0000","last_change":"2023-10-09T11:42:00.206277+0000","last_active":"2023-10-09T11:42:00.206277+0000","last_peered":"2023-10-09T11:42:00.206277+0000","last_clean":"2023-10-09T11:42:00.206277+0000","last_became_active":"2023-10-09T11:42:00.205921+0000","last_became_peered":"2023-10-09T11:42:00.205921+0000","last_unstale":"2023-10-09T11:42:00.206277+0000","last_undegraded":"2023-10-09T11:42:00.206277+0000","last_fullsized":"2023-10-09T11:42:00.206277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219171+0000","last_change":"2023-10-09T11:42:00.218436+0000","last_active":"2023-10-09T11:42:00.219171+0000","last_peered":"2023-10-09T11:42:00.219171+0000","last_clean":"2023-10-09T11:42:00.219171+0000","last_became_active":"2023-10-09T11:42:00.217667+0000","last_became_peered":"2023-10-09T11:42:00.217667+0000","last_unstale":"2023-10-09T11:42:00.219171+0000","last_undegraded":"2023-10-09T11:42:00.219171+0000","last_fullsized":"2023-10-09T11:42:00.219171+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:23.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202510+0000","last_change":"2023-10-09T11:42:00.202641+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202510+0000","last_undegraded":"2023-10-09T11:42:00.202510+0000","last_fullsized":"2023-10-09T11:42:00.202510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218932+0000","last_change":"2023-10-09T11:42:00.215628+0000","last_active":"2023-10-09T11:42:00.218932+0000","last_peered":"2023-10-09T11:42:00.218932+0000","last_clean":"2023-10-09T11:42:00.218932+0000","last_became_active":"2023-10-09T11:42:00.213849+0000","last_became_peered":"2023-10-09T11:42:00.213849+0000","last_unstale":"2023-10-09T11:42:00.218932+0000","last_undegraded":"2023-10-09T11:42:00.218932+0000","last_fullsized":"2023-10-09T11:42:00.218932+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:25.244712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215385+0000","last_change":"2023-10-09T11:42:00.211981+0000","last_active":"2023-10-09T11:42:00.215385+0000","last_peered":"2023-10-09T11:42:00.215385+0000","last_clean":"2023-10-09T11:42:00.215385+0000","last_became_active":"2023-10-09T11:42:00.211732+0000","last_became_peered":"2023-10-09T11:42:00.211732+0000","last_unstale":"2023-10-09T11:42:00.215385+0000","last_undegraded":"2023-10-09T11:42:00.215385+0000","last_fullsized":"2023-10-09T11:42:00.215385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217334+0000","last_change":"2023-10-09T11:42:00.209841+0000","last_active":"2023-10-09T11:42:00.217334+0000","last_peered":"2023-10-09T11:42:00.217334+0000","last_clean":"2023-10-09T11:42:00.217334+0000","last_became_active":"2023-10-09T11:42:00.209230+0000","last_became_peered":"2023-10-09T11:42:00.209230+0000","last_unstale":"2023-10-09T11:42:00.217334+0000","last_undegraded":"2023-10-09T11:42:00.217334+0000","last_fullsized":"2023-10-09T11:42:00.217334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218057+0000","last_change":"2023-10-09T11:42:00.217136+0000","last_active":"2023-10-09T11:42:00.218057+0000","last_peered":"2023-10-09T11:42:00.218057+0000","last_clean":"2023-10-09T11:42:00.218057+0000","last_became_active":"2023-10-09T11:42:00.216861+0000","last_became_peered":"2023-10-09T11:42:00.216861+0000","last_unstale":"2023-10-09T11:42:00.218057+0000","last_undegraded":"2023-10-09T11:42:00.218057+0000","last_fullsized":"2023-10-09T11:42:00.218057+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201273+0000","last_change":"2023-10-09T11:42:00.201408+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201273+0000","last_undegraded":"2023-10-09T11:42:00.201273+0000","last_fullsized":"2023-10-09T11:42:00.201273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215199+0000","last_change":"2023-10-09T11:42:00.212063+0000","last_active":"2023-10-09T11:42:00.215199+0000","last_peered":"2023-10-09T11:42:00.215199+0000","last_clean":"2023-10-09T11:42:00.215199+0000","last_became_active":"2023-10-09T11:42:00.211759+0000","last_became_peered":"2023-10-09T11:42:00.211759+0000","last_unstale":"2023-10-09T11:42:00.215199+0000","last_undegraded":"2023-10-09T11:42:00.215199+0000","last_fullsized":"2023-10-09T11:42:00.215199+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218780+0000","last_change":"2023-10-09T11:42:00.218780+0000","last_active":"2023-10-09T11:42:00.218780+0000","last_peered":"2023-10-09T11:42:00.218780+0000","last_clean":"2023-10-09T11:42:00.218780+0000","last_became_active":"2023-10-09T11:42:00.218449+0000","last_became_peered":"2023-10-09T11:42:00.218449+0000","last_unstale":"2023-10-09T11:42:00.218780+0000","last_undegraded":"2023-10-09T11:42:00.218780+0000","last_fullsized":"2023-10-09T11:42:00.218780+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201160+0000","last_change":"2023-10-09T11:42:00.201290+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201160+0000","last_undegraded":"2023-10-09T11:42:00.201160+0000","last_fullsized":"2023-10-09T11:42:00.201160+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210628+0000","last_change":"2023-10-09T11:42:00.210628+0000","last_active":"2023-10-09T11:42:00.210628+0000","last_peered":"2023-10-09T11:42:00.210628+0000","last_clean":"2023-10-09T11:42:00.210628+0000","last_became_active":"2023-10-09T11:42:00.210317+0000","last_became_peered":"2023-10-09T11:42:00.210317+0000","last_unstale":"2023-10-09T11:42:00.210628+0000","last_undegraded":"2023-10-09T11:42:00.210628+0000","last_fullsized":"2023-10-09T11:42:00.210628+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201079+0000","last_change":"2023-10-09T11:42:00.201232+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201079+0000","last_undegraded":"2023-10-09T11:42:00.201079+0000","last_fullsized":"2023-10-09T11:42:00.201079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203732+0000","last_change":"2023-10-09T11:42:00.203844+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203732+0000","last_undegraded":"2023-10-09T11:42:00.203732+0000","last_fullsized":"2023-10-09T11:42:00.203732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218514+0000","last_change":"2023-10-09T11:42:00.218228+0000","last_active":"2023-10-09T11:42:00.218514+0000","last_peered":"2023-10-09T11:42:00.218514+0000","last_clean":"2023-10-09T11:42:00.218514+0000","last_became_active":"2023-10-09T11:42:00.217369+0000","last_became_peered":"2023-10-09T11:42:00.217369+0000","last_unstale":"2023-10-09T11:42:00.218514+0000","last_undegraded":"2023-10-09T11:42:00.218514+0000","last_fullsized":"2023-10-09T11:42:00.218514+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:50.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209811+0000","last_change":"2023-10-09T11:42:00.207233+0000","last_active":"2023-10-09T11:42:00.209811+0000","last_peered":"2023-10-09T11:42:00.209811+0000","last_clean":"2023-10-09T11:42:00.209811+0000","last_became_active":"2023-10-09T11:42:00.206981+0000","last_became_peered":"2023-10-09T11:42:00.206981+0000","last_unstale":"2023-10-09T11:42:00.209811+0000","last_undegraded":"2023-10-09T11:42:00.209811+0000","last_fullsized":"2023-10-09T11:42:00.209811+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:11.020302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214781+0000","last_change":"2023-10-09T11:42:00.214781+0000","last_active":"2023-10-09T11:42:00.214781+0000","last_peered":"2023-10-09T11:42:00.214781+0000","last_clean":"2023-10-09T11:42:00.214781+0000","last_became_active":"2023-10-09T11:42:00.214525+0000","last_became_peered":"2023-10-09T11:42:00.214525+0000","last_unstale":"2023-10-09T11:42:00.214781+0000","last_undegraded":"2023-10-09T11:42:00.214781+0000","last_fullsized":"2023-10-09T11:42:00.214781+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:07.099338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218561+0000","last_change":"2023-10-09T11:42:00.215498+0000","last_active":"2023-10-09T11:42:00.218561+0000","last_peered":"2023-10-09T11:42:00.218561+0000","last_clean":"2023-10-09T11:42:00.218561+0000","last_became_active":"2023-10-09T11:42:00.213777+0000","last_became_peered":"2023-10-09T11:42:00.213777+0000","last_unstale":"2023-10-09T11:42:00.218561+0000","last_undegraded":"2023-10-09T11:42:00.218561+0000","last_fullsized":"2023-10-09T11:42:00.218561+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:35.887788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218218+0000","last_change":"2023-10-09T11:42:00.214975+0000","last_active":"2023-10-09T11:42:00.218218+0000","last_peered":"2023-10-09T11:42:00.218218+0000","last_clean":"2023-10-09T11:42:00.218218+0000","last_became_active":"2023-10-09T11:42:00.214501+0000","last_became_peered":"2023-10-09T11:42:00.214501+0000","last_unstale":"2023-10-09T11:42:00.218218+0000","last_undegraded":"2023-10-09T11:42:00.218218+0000","last_fullsized":"2023-10-09T11:42:00.218218+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:13.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216982+0000","last_change":"2023-10-09T11:42:00.216982+0000","last_active":"2023-10-09T11:42:00.216982+0000","last_peered":"2023-10-09T11:42:00.216982+0000","last_clean":"2023-10-09T11:42:00.216982+0000","last_became_active":"2023-10-09T11:42:00.216574+0000","last_became_peered":"2023-10-09T11:42:00.216574+0000","last_unstale":"2023-10-09T11:42:00.216982+0000","last_undegraded":"2023-10-09T11:42:00.216982+0000","last_fullsized":"2023-10-09T11:42:00.216982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218148+0000","last_change":"2023-10-09T11:42:00.211866+0000","last_active":"2023-10-09T11:42:00.218148+0000","last_peered":"2023-10-09T11:42:00.218148+0000","last_clean":"2023-10-09T11:42:00.218148+0000","last_became_active":"2023-10-09T11:42:00.211567+0000","last_became_peered":"2023-10-09T11:42:00.211567+0000","last_unstale":"2023-10-09T11:42:00.218148+0000","last_undegraded":"2023-10-09T11:42:00.218148+0000","last_fullsized":"2023-10-09T11:42:00.218148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214243+0000","last_change":"2023-10-09T11:42:00.211574+0000","last_active":"2023-10-09T11:42:00.214243+0000","last_peered":"2023-10-09T11:42:00.214243+0000","last_clean":"2023-10-09T11:42:00.214243+0000","last_became_active":"2023-10-09T11:42:00.211327+0000","last_became_peered":"2023-10-09T11:42:00.211327+0000","last_unstale":"2023-10-09T11:42:00.214243+0000","last_undegraded":"2023-10-09T11:42:00.214243+0000","last_fullsized":"2023-10-09T11:42:00.214243+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"111'4","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640069+0000","last_change":"2023-10-09T11:41:59.632481+0000","last_active":"2023-10-09T11:42:00.640069+0000","last_peered":"2023-10-09T11:42:00.640069+0000","last_clean":"2023-10-09T11:42:00.640069+0000","last_became_active":"2023-10-09T11:41:59.632060+0000","last_became_peered":"2023-10-09T11:41:59.632060+0000","last_unstale":"2023-10-09T11:42:00.640069+0000","last_undegraded":"2023-10-09T11:42:00.640069+0000","last_fullsized":"2023-10-09T11:42:00.640069+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209066+0000","last_change":"2023-10-09T11:42:00.209066+0000","last_active":"2023-10-09T11:42:00.209066+0000","last_peered":"2023-10-09T11:42:00.209066+0000","last_clean":"2023-10-09T11:42:00.209066+0000","last_became_active":"2023-10-09T11:42:00.208807+0000","last_became_peered":"2023-10-09T11:42:00.208807+0000","last_unstale":"2023-10-09T11:42:00.209066+0000","last_undegraded":"2023-10-09T11:42:00.209066+0000","last_fullsized":"2023-10-09T11:42:00.209066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204750+0000","last_change":"2023-10-09T11:41:59.624685+0000","last_active":"2023-10-09T11:42:00.204750+0000","last_peered":"2023-10-09T11:42:00.204750+0000","last_clean":"2023-10-09T11:42:00.204750+0000","last_became_active":"2023-10-09T11:41:59.624425+0000","last_became_peered":"2023-10-09T11:41:59.624425+0000","last_unstale":"2023-10-09T11:42:00.204750+0000","last_undegraded":"2023-10-09T11:42:00.204750+0000","last_fullsized":"2023-10-09T11:42:00.204750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221528+0000","last_change":"2023-10-09T11:42:00.221528+0000","last_active":"2023-10-09T11:42:00.221528+0000","last_peered":"2023-10-09T11:42:00.221528+0000","last_clean":"2023-10-09T11:42:00.221528+0000","last_became_active":"2023-10-09T11:42:00.221296+0000","last_became_peered":"2023-10-09T11:42:00.221296+0000","last_unstale":"2023-10-09T11:42:00.221528+0000","last_undegraded":"2023-10-09T11:42:00.221528+0000","last_fullsized":"2023-10-09T11:42:00.221528+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.241711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631392+0000","last_change":"2023-10-09T11:41:59.625246+0000","last_active":"2023-10-09T11:41:59.631392+0000","last_peered":"2023-10-09T11:41:59.631392+0000","last_clean":"2023-10-09T11:41:59.631392+0000","last_became_active":"2023-10-09T11:41:59.624956+0000","last_became_peered":"2023-10-09T11:41:59.624956+0000","last_unstale":"2023-10-09T11:41:59.631392+0000","last_undegraded":"2023-10-09T11:41:59.631392+0000","last_fullsized":"2023-10-09T11:41:59.631392+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217661+0000","last_change":"2023-10-09T11:42:00.217661+0000","last_active":"2023-10-09T11:42:00.217661+0000","last_peered":"2023-10-09T11:42:00.217661+0000","last_clean":"2023-10-09T11:42:00.217661+0000","last_became_active":"2023-10-09T11:42:00.217406+0000","last_became_peered":"2023-10-09T11:42:00.217406+0000","last_unstale":"2023-10-09T11:42:00.217661+0000","last_undegraded":"2023-10-09T11:42:00.217661+0000","last_fullsized":"2023-10-09T11:42:00.217661+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629218+0000","last_change":"2023-10-09T11:41:59.627331+0000","last_active":"2023-10-09T11:41:59.629218+0000","last_peered":"2023-10-09T11:41:59.629218+0000","last_clean":"2023-10-09T11:41:59.629218+0000","last_became_active":"2023-10-09T11:41:59.627063+0000","last_became_peered":"2023-10-09T11:41:59.627063+0000","last_unstale":"2023-10-09T11:41:59.629218+0000","last_undegraded":"2023-10-09T11:41:59.629218+0000","last_fullsized":"2023-10-09T11:41:59.629218+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:03.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217990+0000","last_change":"2023-10-09T11:42:00.216729+0000","last_active":"2023-10-09T11:42:00.217990+0000","last_peered":"2023-10-09T11:42:00.217990+0000","last_clean":"2023-10-09T11:42:00.217990+0000","last_became_active":"2023-10-09T11:42:00.216427+0000","last_became_peered":"2023-10-09T11:42:00.216427+0000","last_unstale":"2023-10-09T11:42:00.217990+0000","last_undegraded":"2023-10-09T11:42:00.217990+0000","last_fullsized":"2023-10-09T11:42:00.217990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629274+0000","last_change":"2023-10-09T11:41:59.627978+0000","last_active":"2023-10-09T11:41:59.629274+0000","last_peered":"2023-10-09T11:41:59.629274+0000","last_clean":"2023-10-09T11:41:59.629274+0000","last_became_active":"2023-10-09T11:41:59.627728+0000","last_became_peered":"2023-10-09T11:41:59.627728+0000","last_unstale":"2023-10-09T11:41:59.629274+0000","last_undegraded":"2023-10-09T11:41:59.629274+0000","last_fullsized":"2023-10-09T11:41:59.629274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217382+0000","last_change":"2023-10-09T11:42:00.209626+0000","last_active":"2023-10-09T11:42:00.217382+0000","last_peered":"2023-10-09T11:42:00.217382+0000","last_clean":"2023-10-09T11:42:00.217382+0000","last_became_active":"2023-10-09T11:42:00.209213+0000","last_became_peered":"2023-10-09T11:42:00.209213+0000","last_unstale":"2023-10-09T11:42:00.217382+0000","last_undegraded":"2023-10-09T11:42:00.217382+0000","last_fullsized":"2023-10-09T11:42:00.217382+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.634870+0000","last_change":"2023-10-09T11:41:59.629750+0000","last_active":"2023-10-09T11:42:00.634870+0000","last_peered":"2023-10-09T11:42:00.634870+0000","last_clean":"2023-10-09T11:42:00.634870+0000","last_became_active":"2023-10-09T11:41:59.629570+0000","last_became_peered":"2023-10-09T11:41:59.629570+0000","last_unstale":"2023-10-09T11:42:00.634870+0000","last_undegraded":"2023-10-09T11:42:00.634870+0000","last_fullsized":"2023-10-09T11:42:00.634870+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219151+0000","last_change":"2023-10-09T11:42:00.213355+0000","last_active":"2023-10-09T11:42:00.219151+0000","last_peered":"2023-10-09T11:42:00.219151+0000","last_clean":"2023-10-09T11:42:00.219151+0000","last_became_active":"2023-10-09T11:42:00.212927+0000","last_became_peered":"2023-10-09T11:42:00.212927+0000","last_unstale":"2023-10-09T11:42:00.219151+0000","last_undegraded":"2023-10-09T11:42:00.219151+0000","last_fullsized":"2023-10-09T11:42:00.219151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.202774+0000","last_change":"2023-10-09T11:41:59.637978+0000","last_active":"2023-10-09T11:42:00.202774+0000","last_peered":"2023-10-09T11:42:00.202774+0000","last_clean":"2023-10-09T11:42:00.202774+0000","last_became_active":"2023-10-09T11:41:59.637664+0000","last_became_peered":"2023-10-09T11:41:59.637664+0000","last_unstale":"2023-10-09T11:42:00.202774+0000","last_undegraded":"2023-10-09T11:42:00.202774+0000","last_fullsized":"2023-10-09T11:42:00.202774+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:08.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202064+0000","last_change":"2023-10-09T11:42:00.202226+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202064+0000","last_undegraded":"2023-10-09T11:42:00.202064+0000","last_fullsized":"2023-10-09T11:42:00.202064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634398+0000","last_change":"2023-10-09T11:41:59.632493+0000","last_active":"2023-10-09T11:41:59.634398+0000","last_peered":"2023-10-09T11:41:59.634398+0000","last_clean":"2023-10-09T11:41:59.634398+0000","last_became_active":"2023-10-09T11:41:59.632168+0000","last_became_peered":"2023-10-09T11:41:59.632168+0000","last_unstale":"2023-10-09T11:41:59.634398+0000","last_undegraded":"2023-10-09T11:41:59.634398+0000","last_fullsized":"2023-10-09T11:41:59.634398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:38.935473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216157+0000","last_change":"2023-10-09T11:42:00.211624+0000","last_active":"2023-10-09T11:42:00.216157+0000","last_peered":"2023-10-09T11:42:00.216157+0000","last_clean":"2023-10-09T11:42:00.216157+0000","last_became_active":"2023-10-09T11:42:00.211380+0000","last_became_peered":"2023-10-09T11:42:00.211380+0000","last_unstale":"2023-10-09T11:42:00.216157+0000","last_undegraded":"2023-10-09T11:42:00.216157+0000","last_fullsized":"2023-10-09T11:42:00.216157+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:31.033042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.637595+0000","last_change":"2023-10-09T11:41:59.632085+0000","last_active":"2023-10-09T11:41:59.637595+0000","last_peered":"2023-10-09T11:41:59.637595+0000","last_clean":"2023-10-09T11:41:59.637595+0000","last_became_active":"2023-10-09T11:41:59.631758+0000","last_became_peered":"2023-10-09T11:41:59.631758+0000","last_unstale":"2023-10-09T11:41:59.637595+0000","last_undegraded":"2023-10-09T11:41:59.637595+0000","last_fullsized":"2023-10-09T11:41:59.637595+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:57.551222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212835+0000","last_change":"2023-10-09T11:42:00.212835+0000","last_active":"2023-10-09T11:42:00.212835+0000","last_peered":"2023-10-09T11:42:00.212835+0000","last_clean":"2023-10-09T11:42:00.212835+0000","last_became_active":"2023-10-09T11:42:00.212518+0000","last_became_peered":"2023-10-09T11:42:00.212518+0000","last_unstale":"2023-10-09T11:42:00.212835+0000","last_undegraded":"2023-10-09T11:42:00.212835+0000","last_fullsized":"2023-10-09T11:42:00.212835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210728+0000","last_change":"2023-10-09T11:41:59.632977+0000","last_active":"2023-10-09T11:42:00.210728+0000","last_peered":"2023-10-09T11:42:00.210728+0000","last_clean":"2023-10-09T11:42:00.210728+0000","last_became_active":"2023-10-09T11:41:59.632684+0000","last_became_peered":"2023-10-09T11:41:59.632684+0000","last_unstale":"2023-10-09T11:42:00.210728+0000","last_undegraded":"2023-10-09T11:42:00.210728+0000","last_fullsized":"2023-10-09T11:42:00.210728+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219167+0000","last_change":"2023-10-09T11:42:00.219167+0000","last_active":"2023-10-09T11:42:00.219167+0000","last_peered":"2023-10-09T11:42:00.219167+0000","last_clean":"2023-10-09T11:42:00.219167+0000","last_became_active":"2023-10-09T11:42:00.218471+0000","last_became_peered":"2023-10-09T11:42:00.218471+0000","last_unstale":"2023-10-09T11:42:00.219167+0000","last_undegraded":"2023-10-09T11:42:00.219167+0000","last_fullsized":"2023-10-09T11:42:00.219167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"111'3","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.637607+0000","last_change":"2023-10-09T11:41:59.630953+0000","last_active":"2023-10-09T11:42:00.637607+0000","last_peered":"2023-10-09T11:42:00.637607+0000","last_clean":"2023-10-09T11:42:00.637607+0000","last_became_active":"2023-10-09T11:41:59.630684+0000","last_became_peered":"2023-10-09T11:41:59.630684+0000","last_unstale":"2023-10-09T11:42:00.637607+0000","last_undegraded":"2023-10-09T11:42:00.637607+0000","last_fullsized":"2023-10-09T11:42:00.637607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220411+0000","last_change":"2023-10-09T11:42:00.220411+0000","last_active":"2023-10-09T11:42:00.220411+0000","last_peered":"2023-10-09T11:42:00.220411+0000","last_clean":"2023-10-09T11:42:00.220411+0000","last_became_active":"2023-10-09T11:42:00.220156+0000","last_became_peered":"2023-10-09T11:42:00.220156+0000","last_unstale":"2023-10-09T11:42:00.220411+0000","last_undegraded":"2023-10-09T11:42:00.220411+0000","last_fullsized":"2023-10-09T11:42:00.220411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:08.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"111'6","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640498+0000","last_change":"2023-10-09T11:41:59.633075+0000","last_active":"2023-10-09T11:42:00.640498+0000","last_peered":"2023-10-09T11:42:00.640498+0000","last_clean":"2023-10-09T11:42:00.640498+0000","last_became_active":"2023-10-09T11:41:59.632787+0000","last_became_peered":"2023-10-09T11:41:59.632787+0000","last_unstale":"2023-10-09T11:42:00.640498+0000","last_undegraded":"2023-10-09T11:42:00.640498+0000","last_fullsized":"2023-10-09T11:42:00.640498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:12.460978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216356+0000","last_change":"2023-10-09T11:42:00.211363+0000","last_active":"2023-10-09T11:42:00.216356+0000","last_peered":"2023-10-09T11:42:00.216356+0000","last_clean":"2023-10-09T11:42:00.216356+0000","last_became_active":"2023-10-09T11:42:00.211096+0000","last_became_peered":"2023-10-09T11:42:00.211096+0000","last_unstale":"2023-10-09T11:42:00.216356+0000","last_undegraded":"2023-10-09T11:42:00.216356+0000","last_fullsized":"2023-10-09T11:42:00.216356+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:49.955853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204696+0000","last_change":"2023-10-09T11:41:59.635800+0000","last_active":"2023-10-09T11:42:00.204696+0000","last_peered":"2023-10-09T11:42:00.204696+0000","last_clean":"2023-10-09T11:42:00.204696+0000","last_became_active":"2023-10-09T11:41:59.635487+0000","last_became_peered":"2023-10-09T11:41:59.635487+0000","last_unstale":"2023-10-09T11:42:00.204696+0000","last_undegraded":"2023-10-09T11:42:00.204696+0000","last_fullsized":"2023-10-09T11:42:00.204696+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:26.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202052+0000","last_change":"2023-10-09T11:42:00.202159+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202052+0000","last_undegraded":"2023-10-09T11:42:00.202052+0000","last_fullsized":"2023-10-09T11:42:00.202052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629190+0000","last_change":"2023-10-09T11:41:59.626882+0000","last_active":"2023-10-09T11:41:59.629190+0000","last_peered":"2023-10-09T11:41:59.629190+0000","last_clean":"2023-10-09T11:41:59.629190+0000","last_became_active":"2023-10-09T11:41:59.626653+0000","last_became_peered":"2023-10-09T11:41:59.626653+0000","last_unstale":"2023-10-09T11:41:59.629190+0000","last_undegraded":"2023-10-09T11:41:59.629190+0000","last_fullsized":"2023-10-09T11:41:59.629190+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.208367+0000","last_change":"2023-10-09T11:42:00.208367+0000","last_active":"2023-10-09T11:42:00.208367+0000","last_peered":"2023-10-09T11:42:00.208367+0000","last_clean":"2023-10-09T11:42:00.208367+0000","last_became_active":"2023-10-09T11:42:00.207838+0000","last_became_peered":"2023-10-09T11:42:00.207838+0000","last_unstale":"2023-10-09T11:42:00.208367+0000","last_undegraded":"2023-10-09T11:42:00.208367+0000","last_fullsized":"2023-10-09T11:42:00.208367+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"111'8","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638449+0000","last_change":"2023-10-09T11:41:59.629160+0000","last_active":"2023-10-09T11:42:00.638449+0000","last_peered":"2023-10-09T11:42:00.638449+0000","last_clean":"2023-10-09T11:42:00.638449+0000","last_became_active":"2023-10-09T11:41:59.628930+0000","last_became_peered":"2023-10-09T11:41:59.628930+0000","last_unstale":"2023-10-09T11:42:00.638449+0000","last_undegraded":"2023-10-09T11:42:00.638449+0000","last_fullsized":"2023-10-09T11:42:00.638449+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:12.328048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214813+0000","last_change":"2023-10-09T11:42:00.214813+0000","last_active":"2023-10-09T11:42:00.214813+0000","last_peered":"2023-10-09T11:42:00.214813+0000","last_clean":"2023-10-09T11:42:00.214813+0000","last_became_active":"2023-10-09T11:42:00.214504+0000","last_became_peered":"2023-10-09T11:42:00.214504+0000","last_unstale":"2023-10-09T11:42:00.214813+0000","last_undegraded":"2023-10-09T11:42:00.214813+0000","last_fullsized":"2023-10-09T11:42:00.214813+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.205279+0000","last_change":"2023-10-09T11:41:59.628234+0000","last_active":"2023-10-09T11:42:00.205279+0000","last_peered":"2023-10-09T11:42:00.205279+0000","last_clean":"2023-10-09T11:42:00.205279+0000","last_became_active":"2023-10-09T11:41:59.627982+0000","last_became_peered":"2023-10-09T11:41:59.627982+0000","last_unstale":"2023-10-09T11:42:00.205279+0000","last_undegraded":"2023-10-09T11:42:00.205279+0000","last_fullsized":"2023-10-09T11:42:00.205279+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:40.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.213778+0000","last_change":"2023-10-09T11:42:00.213778+0000","last_active":"2023-10-09T11:42:00.213778+0000","last_peered":"2023-10-09T11:42:00.213778+0000","last_clean":"2023-10-09T11:42:00.213778+0000","last_became_active":"2023-10-09T11:42:00.213110+0000","last_became_peered":"2023-10-09T11:42:00.213110+0000","last_unstale":"2023-10-09T11:42:00.213778+0000","last_undegraded":"2023-10-09T11:42:00.213778+0000","last_fullsized":"2023-10-09T11:42:00.213778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:22.834787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628159+0000","last_change":"2023-10-09T11:41:59.624967+0000","last_active":"2023-10-09T11:41:59.628159+0000","last_peered":"2023-10-09T11:41:59.628159+0000","last_clean":"2023-10-09T11:41:59.628159+0000","last_became_active":"2023-10-09T11:41:59.624703+0000","last_became_peered":"2023-10-09T11:41:59.624703+0000","last_unstale":"2023-10-09T11:41:59.628159+0000","last_undegraded":"2023-10-09T11:41:59.628159+0000","last_fullsized":"2023-10-09T11:41:59.628159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.895476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.211625+0000","last_change":"2023-10-09T11:42:00.209652+0000","last_active":"2023-10-09T11:42:00.211625+0000","last_peered":"2023-10-09T11:42:00.211625+0000","last_clean":"2023-10-09T11:42:00.211625+0000","last_became_active":"2023-10-09T11:42:00.209400+0000","last_became_peered":"2023-10-09T11:42:00.209400+0000","last_unstale":"2023-10-09T11:42:00.211625+0000","last_undegraded":"2023-10-09T11:42:00.211625+0000","last_fullsized":"2023-10-09T11:42:00.211625+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:29.470981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.636944+0000","last_change":"2023-10-09T11:41:59.635012+0000","last_active":"2023-10-09T11:42:00.636944+0000","last_peered":"2023-10-09T11:42:00.636944+0000","last_clean":"2023-10-09T11:42:00.636944+0000","last_became_active":"2023-10-09T11:41:59.634630+0000","last_became_peered":"2023-10-09T11:41:59.634630+0000","last_unstale":"2023-10-09T11:42:00.636944+0000","last_undegraded":"2023-10-09T11:42:00.636944+0000","last_fullsized":"2023-10-09T11:42:00.636944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:21.830413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202791+0000","last_change":"2023-10-09T11:42:00.202917+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202791+0000","last_undegraded":"2023-10-09T11:42:00.202791+0000","last_fullsized":"2023-10-09T11:42:00.202791+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632074+0000","last_change":"2023-10-09T11:41:59.627009+0000","last_active":"2023-10-09T11:41:59.632074+0000","last_peered":"2023-10-09T11:41:59.632074+0000","last_clean":"2023-10-09T11:41:59.632074+0000","last_became_active":"2023-10-09T11:41:59.626708+0000","last_became_peered":"2023-10-09T11:41:59.626708+0000","last_unstale":"2023-10-09T11:41:59.632074+0000","last_undegraded":"2023-10-09T11:41:59.632074+0000","last_fullsized":"2023-10-09T11:41:59.632074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219099+0000","last_change":"2023-10-09T11:42:00.217901+0000","last_active":"2023-10-09T11:42:00.219099+0000","last_peered":"2023-10-09T11:42:00.219099+0000","last_clean":"2023-10-09T11:42:00.219099+0000","last_became_active":"2023-10-09T11:42:00.217641+0000","last_became_peered":"2023-10-09T11:42:00.217641+0000","last_unstale":"2023-10-09T11:42:00.219099+0000","last_undegraded":"2023-10-09T11:42:00.219099+0000","last_fullsized":"2023-10-09T11:42:00.219099+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:13.332422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638734+0000","last_change":"2023-10-09T11:41:59.631402+0000","last_active":"2023-10-09T11:42:00.638734+0000","last_peered":"2023-10-09T11:42:00.638734+0000","last_clean":"2023-10-09T11:42:00.638734+0000","last_became_active":"2023-10-09T11:41:59.630980+0000","last_became_peered":"2023-10-09T11:41:59.630980+0000","last_unstale":"2023-10-09T11:42:00.638734+0000","last_undegraded":"2023-10-09T11:42:00.638734+0000","last_fullsized":"2023-10-09T11:42:00.638734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:10.015929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217404+0000","last_change":"2023-10-09T11:42:00.210737+0000","last_active":"2023-10-09T11:42:00.217404+0000","last_peered":"2023-10-09T11:42:00.217404+0000","last_clean":"2023-10-09T11:42:00.217404+0000","last_became_active":"2023-10-09T11:42:00.209921+0000","last_became_peered":"2023-10-09T11:42:00.209921+0000","last_unstale":"2023-10-09T11:42:00.217404+0000","last_undegraded":"2023-10-09T11:42:00.217404+0000","last_fullsized":"2023-10-09T11:42:00.217404+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210087+0000","last_change":"2023-10-09T11:41:59.632230+0000","last_active":"2023-10-09T11:42:00.210087+0000","last_peered":"2023-10-09T11:42:00.210087+0000","last_clean":"2023-10-09T11:42:00.210087+0000","last_became_active":"2023-10-09T11:41:59.631971+0000","last_became_peered":"2023-10-09T11:41:59.631971+0000","last_unstale":"2023-10-09T11:42:00.210087+0000","last_undegraded":"2023-10-09T11:42:00.210087+0000","last_fullsized":"2023-10-09T11:42:00.210087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202067+0000","last_change":"2023-10-09T11:42:00.202208+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202067+0000","last_undegraded":"2023-10-09T11:42:00.202067+0000","last_fullsized":"2023-10-09T11:42:00.202067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209902+0000","last_change":"2023-10-09T11:41:59.631307+0000","last_active":"2023-10-09T11:42:00.209902+0000","last_peered":"2023-10-09T11:42:00.209902+0000","last_clean":"2023-10-09T11:42:00.209902+0000","last_became_active":"2023-10-09T11:41:59.630943+0000","last_became_peered":"2023-10-09T11:41:59.630943+0000","last_unstale":"2023-10-09T11:42:00.209902+0000","last_undegraded":"2023-10-09T11:42:00.209902+0000","last_fullsized":"2023-10-09T11:42:00.209902+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:57.854138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219945+0000","last_change":"2023-10-09T11:42:00.219945+0000","last_active":"2023-10-09T11:42:00.219945+0000","last_peered":"2023-10-09T11:42:00.219945+0000","last_clean":"2023-10-09T11:42:00.219945+0000","last_became_active":"2023-10-09T11:42:00.219612+0000","last_became_peered":"2023-10-09T11:42:00.219612+0000","last_unstale":"2023-10-09T11:42:00.219945+0000","last_undegraded":"2023-10-09T11:42:00.219945+0000","last_fullsized":"2023-10-09T11:42:00.219945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628174+0000","last_change":"2023-10-09T11:41:59.625622+0000","last_active":"2023-10-09T11:41:59.628174+0000","last_peered":"2023-10-09T11:41:59.628174+0000","last_clean":"2023-10-09T11:41:59.628174+0000","last_became_active":"2023-10-09T11:41:59.625346+0000","last_became_peered":"2023-10-09T11:41:59.625346+0000","last_unstale":"2023-10-09T11:41:59.628174+0000","last_undegraded":"2023-10-09T11:41:59.628174+0000","last_fullsized":"2023-10-09T11:41:59.628174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:08.373571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217471+0000","last_change":"2023-10-09T11:42:00.210536+0000","last_active":"2023-10-09T11:42:00.217471+0000","last_peered":"2023-10-09T11:42:00.217471+0000","last_clean":"2023-10-09T11:42:00.217471+0000","last_became_active":"2023-10-09T11:42:00.210277+0000","last_became_peered":"2023-10-09T11:42:00.210277+0000","last_unstale":"2023-10-09T11:42:00.217471+0000","last_undegraded":"2023-10-09T11:42:00.217471+0000","last_fullsized":"2023-10-09T11:42:00.217471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638575+0000","last_change":"2023-10-09T11:41:59.631336+0000","last_active":"2023-10-09T11:42:00.638575+0000","last_peered":"2023-10-09T11:42:00.638575+0000","last_clean":"2023-10-09T11:42:00.638575+0000","last_became_active":"2023-10-09T11:41:59.631014+0000","last_became_peered":"2023-10-09T11:41:59.631014+0000","last_unstale":"2023-10-09T11:42:00.638575+0000","last_undegraded":"2023-10-09T11:42:00.638575+0000","last_fullsized":"2023-10-09T11:42:00.638575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:04.014266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218967+0000","last_change":"2023-10-09T11:42:00.215982+0000","last_active":"2023-10-09T11:42:00.218967+0000","last_peered":"2023-10-09T11:42:00.218967+0000","last_clean":"2023-10-09T11:42:00.218967+0000","last_became_active":"2023-10-09T11:42:00.215665+0000","last_became_peered":"2023-10-09T11:42:00.215665+0000","last_unstale":"2023-10-09T11:42:00.218967+0000","last_undegraded":"2023-10-09T11:42:00.218967+0000","last_fullsized":"2023-10-09T11:42:00.218967+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640360+0000","last_change":"2023-10-09T11:41:59.635719+0000","last_active":"2023-10-09T11:41:59.640360+0000","last_peered":"2023-10-09T11:41:59.640360+0000","last_clean":"2023-10-09T11:41:59.640360+0000","last_became_active":"2023-10-09T11:41:59.635402+0000","last_became_peered":"2023-10-09T11:41:59.635402+0000","last_unstale":"2023-10-09T11:41:59.640360+0000","last_undegraded":"2023-10-09T11:41:59.640360+0000","last_fullsized":"2023-10-09T11:41:59.640360+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202476+0000","last_change":"2023-10-09T11:42:00.202589+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202476+0000","last_undegraded":"2023-10-09T11:42:00.202476+0000","last_fullsized":"2023-10-09T11:42:00.202476+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634422+0000","last_change":"2023-10-09T11:41:59.632579+0000","last_active":"2023-10-09T11:41:59.634422+0000","last_peered":"2023-10-09T11:41:59.634422+0000","last_clean":"2023-10-09T11:41:59.634422+0000","last_became_active":"2023-10-09T11:41:59.632268+0000","last_became_peered":"2023-10-09T11:41:59.632268+0000","last_unstale":"2023-10-09T11:41:59.634422+0000","last_undegraded":"2023-10-09T11:41:59.634422+0000","last_fullsized":"2023-10-09T11:41:59.634422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217040+0000","last_change":"2023-10-09T11:42:00.209277+0000","last_active":"2023-10-09T11:42:00.217040+0000","last_peered":"2023-10-09T11:42:00.217040+0000","last_clean":"2023-10-09T11:42:00.217040+0000","last_became_active":"2023-10-09T11:42:00.208952+0000","last_became_peered":"2023-10-09T11:42:00.208952+0000","last_unstale":"2023-10-09T11:42:00.217040+0000","last_undegraded":"2023-10-09T11:42:00.217040+0000","last_fullsized":"2023-10-09T11:42:00.217040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628205+0000","last_change":"2023-10-09T11:41:59.625759+0000","last_active":"2023-10-09T11:41:59.628205+0000","last_peered":"2023-10-09T11:41:59.628205+0000","last_clean":"2023-10-09T11:41:59.628205+0000","last_became_active":"2023-10-09T11:41:59.623565+0000","last_became_peered":"2023-10-09T11:41:59.623565+0000","last_unstale":"2023-10-09T11:41:59.628205+0000","last_undegraded":"2023-10-09T11:41:59.628205+0000","last_fullsized":"2023-10-09T11:41:59.628205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:36.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220642+0000","last_change":"2023-10-09T11:42:00.220642+0000","last_active":"2023-10-09T11:42:00.220642+0000","last_peered":"2023-10-09T11:42:00.220642+0000","last_clean":"2023-10-09T11:42:00.220642+0000","last_became_active":"2023-10-09T11:42:00.220107+0000","last_became_peered":"2023-10-09T11:42:00.220107+0000","last_unstale":"2023-10-09T11:42:00.220642+0000","last_undegraded":"2023-10-09T11:42:00.220642+0000","last_fullsized":"2023-10-09T11:42:00.220642+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629254+0000","last_change":"2023-10-09T11:41:59.627466+0000","last_active":"2023-10-09T11:41:59.629254+0000","last_peered":"2023-10-09T11:41:59.629254+0000","last_clean":"2023-10-09T11:41:59.629254+0000","last_became_active":"2023-10-09T11:41:59.626717+0000","last_became_peered":"2023-10-09T11:41:59.626717+0000","last_unstale":"2023-10-09T11:41:59.629254+0000","last_undegraded":"2023-10-09T11:41:59.629254+0000","last_fullsized":"2023-10-09T11:41:59.629254+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.207614+0000","last_change":"2023-10-09T11:42:00.207614+0000","last_active":"2023-10-09T11:42:00.207614+0000","last_peered":"2023-10-09T11:42:00.207614+0000","last_clean":"2023-10-09T11:42:00.207614+0000","last_became_active":"2023-10-09T11:42:00.207309+0000","last_became_peered":"2023-10-09T11:42:00.207309+0000","last_unstale":"2023-10-09T11:42:00.207614+0000","last_undegraded":"2023-10-09T11:42:00.207614+0000","last_fullsized":"2023-10-09T11:42:00.207614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:58.991113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640269+0000","last_change":"2023-10-09T11:41:59.632416+0000","last_active":"2023-10-09T11:41:59.640269+0000","last_peered":"2023-10-09T11:41:59.640269+0000","last_clean":"2023-10-09T11:41:59.640269+0000","last_became_active":"2023-10-09T11:41:59.632037+0000","last_became_peered":"2023-10-09T11:41:59.632037+0000","last_unstale":"2023-10-09T11:41:59.640269+0000","last_undegraded":"2023-10-09T11:41:59.640269+0000","last_fullsized":"2023-10-09T11:41:59.640269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215477+0000","last_change":"2023-10-09T11:42:00.212726+0000","last_active":"2023-10-09T11:42:00.215477+0000","last_peered":"2023-10-09T11:42:00.215477+0000","last_clean":"2023-10-09T11:42:00.215477+0000","last_became_active":"2023-10-09T11:42:00.212460+0000","last_became_peered":"2023-10-09T11:42:00.212460+0000","last_unstale":"2023-10-09T11:42:00.215477+0000","last_undegraded":"2023-10-09T11:42:00.215477+0000","last_fullsized":"2023-10-09T11:42:00.215477+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210000+0000","last_change":"2023-10-09T11:41:59.633991+0000","last_active":"2023-10-09T11:42:00.210000+0000","last_peered":"2023-10-09T11:42:00.210000+0000","last_clean":"2023-10-09T11:42:00.210000+0000","last_became_active":"2023-10-09T11:41:59.633652+0000","last_became_peered":"2023-10-09T11:41:59.633652+0000","last_unstale":"2023-10-09T11:42:00.210000+0000","last_undegraded":"2023-10-09T11:42:00.210000+0000","last_fullsized":"2023-10-09T11:42:00.210000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202424+0000","last_change":"2023-10-09T11:42:00.202544+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202424+0000","last_undegraded":"2023-10-09T11:42:00.202424+0000","last_fullsized":"2023-10-09T11:42:00.202424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635843+0000","last_change":"2023-10-09T11:41:59.635108+0000","last_active":"2023-10-09T11:41:59.635843+0000","last_peered":"2023-10-09T11:41:59.635843+0000","last_clean":"2023-10-09T11:41:59.635843+0000","last_became_active":"2023-10-09T11:41:59.634840+0000","last_became_peered":"2023-10-09T11:41:59.634840+0000","last_unstale":"2023-10-09T11:41:59.635843+0000","last_undegraded":"2023-10-09T11:41:59.635843+0000","last_fullsized":"2023-10-09T11:41:59.635843+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:42.570558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220378+0000","last_change":"2023-10-09T11:42:00.220378+0000","last_active":"2023-10-09T11:42:00.220378+0000","last_peered":"2023-10-09T11:42:00.220378+0000","last_clean":"2023-10-09T11:42:00.220378+0000","last_became_active":"2023-10-09T11:42:00.219769+0000","last_became_peered":"2023-10-09T11:42:00.219769+0000","last_unstale":"2023-10-09T11:42:00.220378+0000","last_undegraded":"2023-10-09T11:42:00.220378+0000","last_fullsized":"2023-10-09T11:42:00.220378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:03.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.639802+0000","last_change":"2023-10-09T11:41:59.632436+0000","last_active":"2023-10-09T11:42:00.639802+0000","last_peered":"2023-10-09T11:42:00.639802+0000","last_clean":"2023-10-09T11:42:00.639802+0000","last_became_active":"2023-10-09T11:41:59.632129+0000","last_became_peered":"2023-10-09T11:41:59.632129+0000","last_unstale":"2023-10-09T11:42:00.639802+0000","last_undegraded":"2023-10-09T11:42:00.639802+0000","last_fullsized":"2023-10-09T11:42:00.639802+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.621016+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:59.621016+0000","last_peered":"2023-10-09T11:41:59.621016+0000","last_clean":"2023-10-09T11:41:59.621016+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:59.621016+0000","last_undegraded":"2023-10-09T11:41:59.621016+0000","last_fullsized":"2023-10-09T11:41:59.621016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1188432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.628},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.74399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.434},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.436},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.93000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":1181669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.246},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.222}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.26800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.317}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.47699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.28100000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.45500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1388544,"data_stored":598134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:05.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-10-09T11:42:05.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.203658+0000', 'last_change': '2023-10-09T11:42:00.203777+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.203658+0000', 'last_undegraded': '2023-10-09T11:42:00.203658+0000', 'last_fullsized': '2023-10-09T11:42:00.203658+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-10-09T11:42:05.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.203350+0000', 'last_change': '2023-10-09T11:42:00.203471+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.203350+0000', 'last_undegraded': '2023-10-09T11:42:00.203350+0000', 'last_fullsized': '2023-10-09T11:42:00.203350+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.201592+0000', 'last_change': '2023-10-09T11:42:00.201704+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.201592+0000', 'last_undegraded': '2023-10-09T11:42:00.201592+0000', 'last_fullsized': '2023-10-09T11:42:00.201592+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202510+0000', 'last_change': '2023-10-09T11:42:00.202641+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202510+0000', 'last_undegraded': '2023-10-09T11:42:00.202510+0000', 'last_fullsized': '2023-10-09T11:42:00.202510+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.201273+0000', 'last_change': '2023-10-09T11:42:00.201408+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.201273+0000', 'last_undegraded': '2023-10-09T11:42:00.201273+0000', 'last_fullsized': '2023-10-09T11:42:00.201273+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.201160+0000', 'last_change': '2023-10-09T11:42:00.201290+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.201160+0000', 'last_undegraded': '2023-10-09T11:42:00.201160+0000', 'last_fullsized': '2023-10-09T11:42:00.201160+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:42:05.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.201079+0000', 'last_change': '2023-10-09T11:42:00.201232+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.201079+0000', 'last_undegraded': '2023-10-09T11:42:00.201079+0000', 'last_fullsized': '2023-10-09T11:42:00.201079+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.203732+0000', 'last_change': '2023-10-09T11:42:00.203844+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.203732+0000', 'last_undegraded': '2023-10-09T11:42:00.203732+0000', 'last_fullsized': '2023-10-09T11:42:00.203732+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202064+0000', 'last_change': '2023-10-09T11:42:00.202226+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202064+0000', 'last_undegraded': '2023-10-09T11:42:00.202064+0000', 'last_fullsized': '2023-10-09T11:42:00.202064+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202052+0000', 'last_change': '2023-10-09T11:42:00.202159+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202052+0000', 'last_undegraded': '2023-10-09T11:42:00.202052+0000', 'last_fullsized': '2023-10-09T11:42:00.202052+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-10-09T11:42:05.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202791+0000', 'last_change': '2023-10-09T11:42:00.202917+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202791+0000', 'last_undegraded': '2023-10-09T11:42:00.202791+0000', 'last_fullsized': '2023-10-09T11:42:00.202791+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202067+0000', 'last_change': '2023-10-09T11:42:00.202208+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202067+0000', 'last_undegraded': '2023-10-09T11:42:00.202067+0000', 'last_fullsized': '2023-10-09T11:42:00.202067+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202476+0000', 'last_change': '2023-10-09T11:42:00.202589+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202476+0000', 'last_undegraded': '2023-10-09T11:42:00.202476+0000', 'last_fullsized': '2023-10-09T11:42:00.202476+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-10-09T11:42:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 111, 'state': 'creating+activating', 'last_fresh': '2023-10-09T11:42:00.202424+0000', 'last_change': '2023-10-09T11:42:00.202544+0000', 'last_active': '2023-10-09T11:41:59.610134+0000', 'last_peered': '2023-10-09T11:41:59.610134+0000', 'last_clean': '2023-10-09T11:41:59.610134+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:42:00.202424+0000', 'last_undegraded': '2023-10-09T11:42:00.202424+0000', 'last_fullsized': '2023-10-09T11:42:00.202424+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:59.610134+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:42:05.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:42:05.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.660+0000 7fc526c63700 1 Processor -- start 2023-10-09T11:42:05.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.660+0000 7fc526c63700 1 -- start start 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc526c63700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5200cb5a0 0x7fc5200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc526c63700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc52015a5d0 0x7fc520156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc526c63700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52015ae40 con 0x7fc5200cd9e0 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc526c63700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200d13f0 con 0x7fc5200cb5a0 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc526c63700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52015ab60 con 0x7fc52015a5d0 2023-10-09T11:42:05.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc5249ff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5200cb5a0 0x7fc5200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc51ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc5200cd9e0 0x7fc520159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60540/0 (socket says 172.21.15.26:60540) 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc51ffff700 1 -- 172.21.15.26:0/54250980 learned_addr learned my addr 172.21.15.26:0/54250980 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc525200700 1 --2- 172.21.15.26:0/54250980 >> v2:172.21.15.67:3300/0 conn(0x7fc52015a5d0 0x7fc520156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc5249ff700 1 -- 172.21.15.26:0/54250980 >> v2:172.21.15.67:3300/0 conn(0x7fc52015a5d0 msgr2=0x7fc520156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc5249ff700 1 --2- 172.21.15.26:0/54250980 >> v2:172.21.15.67:3300/0 conn(0x7fc52015a5d0 0x7fc520156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc5249ff700 1 -- 172.21.15.26:0/54250980 >> v1:172.21.15.26:6789/0 conn(0x7fc5200cd9e0 legacy=0x7fc520159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.661+0000 7fc51f7fe700 1 -- 172.21.15.26:0/54250980 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605745447 0 0) 0x7fc52015ae40 con 0x7fc5200cd9e0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc5249ff700 1 -- 172.21.15.26:0/54250980 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200ccf00 con 0x7fc5200cb5a0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc5249ff700 1 --2- 172.21.15.26:0/54250980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5200cb5a0 0x7fc5200cb970 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc5140098e0 tx=0x7fc5140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac56d8d8422d994 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc51f7fe700 1 -- 172.21.15.26:0/54250980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514009e80 con 0x7fc5200cb5a0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc51f7fe700 1 -- 172.21.15.26:0/54250980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400b820 con 0x7fc5200cb5a0 2023-10-09T11:42:05.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc51f7fe700 1 -- 172.21.15.26:0/54250980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400bba0 con 0x7fc5200cb5a0 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc526c63700 1 -- 172.21.15.26:0/54250980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5200cb5a0 msgr2=0x7fc5200cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.662+0000 7fc526c63700 1 --2- 172.21.15.26:0/54250980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5200cb5a0 0x7fc5200cb970 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc5140098e0 tx=0x7fc5140091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 -- 172.21.15.26:0/54250980 shutdown_connections 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 --2- 172.21.15.26:0/54250980 >> v2:172.21.15.67:3300/0 conn(0x7fc52015a5d0 0x7fc520156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 --2- 172.21.15.26:0/54250980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5200cb5a0 0x7fc5200cb970 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 -- 172.21.15.26:0/54250980 >> 172.21.15.26:0/54250980 conn(0x7fc520070e30 msgr2=0x7fc5200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 -- 172.21.15.26:0/54250980 shutdown_connections 2023-10-09T11:42:05.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.663+0000 7fc526c63700 1 -- 172.21.15.26:0/54250980 wait complete. 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.664+0000 7fc526c63700 1 Processor -- start 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.664+0000 7fc526c63700 1 -- start start 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5200cb5a0 0x7fc5200b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5200cd9e0 0x7fc520154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520155e00 con 0x7fc52015a5d0 2023-10-09T11:42:05.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200b64e0 con 0x7fc5200cd9e0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201551f0 con 0x7fc5200cb5a0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42986/0 (socket says 172.21.15.26:42986) 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 -- 172.21.15.26:0/2754709399 learned_addr learned my addr 172.21.15.26:0/2754709399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc51ffff700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5200cd9e0 0x7fc520154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc5249ff700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5200cb5a0 0x7fc5200b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 -- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5200cb5a0 msgr2=0x7fc5200b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5200cb5a0 0x7fc5200b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 -- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5200cd9e0 msgr2=0x7fc520154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5200cd9e0 0x7fc520154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 -- 172.21.15.26:0/2754709399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514009420 con 0x7fc52015a5d0 2023-10-09T11:42:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc525200700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc518007f50 tx=0x7fc518009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800ecd0 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800ee50 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5201554d0 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518014670 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.665+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc520155a90 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.667+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520155fb0 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.667+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc5180149e0 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.667+0000 7fc51cff9700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 0x7fc5040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.667+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc518085350 con 0x7fc52015a5d0 2023-10-09T11:42:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.667+0000 7fc5249ff700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 0x7fc5040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.668+0000 7fc5249ff700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 0x7fc5040697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5140093f0 tx=0x7fc514017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.672+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc520155fb0 con 0x7fc52015a5d0 2023-10-09T11:42:05.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.947+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc520156190 con 0x7fc52015a5d0 2023-10-09T11:42:05.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.947+0000 7fc51cff9700 1 -- 172.21.15.26:0/2754709399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1524 (secure 0 0 0) 0x7fc520156190 con 0x7fc52015a5d0 2023-10-09T11:42:05.949 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:05.949 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":426,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":112,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"creating+activating","count":14}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592674,"bytes_used":2481221632,"bytes_avail":770612891648,"bytes_total":773094113280,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":76,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":7203}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-09T11:40:49.185634+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:42:05.949 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-10-09T11:42:05.948+0000 7f15a9e32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 msgr2=0x7fc5040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 0x7fc5040697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5140093f0 tx=0x7fc514017000 comp rx=0 tx=0).stop 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 msgr2=0x7fc520157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc518007f50 tx=0x7fc518009860 comp rx=0 tx=0).stop 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 shutdown_connections 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52015a5d0 0x7fc520157670 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc504067320 0x7fc5040697d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5200cb5a0 0x7fc5200b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 --2- 172.21.15.26:0/2754709399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5200cd9e0 0x7fc520154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 >> 172.21.15.26:0/2754709399 conn(0x7fc520070e30 msgr2=0x7fc5200d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 shutdown_connections 2023-10-09T11:42:05.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:05.949+0000 7fc526c63700 1 -- 172.21.15.26:0/2754709399 wait complete. 2023-10-09T11:42:05.963 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:42:05.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:06.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.081+0000 7ff9f7058700 1 Processor -- start 2023-10-09T11:42:06.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.081+0000 7ff9f7058700 1 -- start start 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f7058700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9f00cb5a0 0x7ff9f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f7058700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f015a5d0 0x7ff9f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f7058700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f015ae40 con 0x7ff9f00cd9e0 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f7058700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f00d13f0 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f7058700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f015ab60 con 0x7ff9f015a5d0 2023-10-09T11:42:06.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f4df4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9f00cb5a0 0x7ff9f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9effff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff9f00cd9e0 0x7ff9f0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60556/0 (socket says 172.21.15.26:60556) 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f4df4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9f00cb5a0 0x7ff9f00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42998/0 (socket says 172.21.15.26:42998) 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9effff700 1 -- 172.21.15.26:0/1588431932 learned_addr learned my addr 172.21.15.26:0/1588431932 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.082+0000 7ff9f55f5700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f015a5d0 0x7ff9f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f4df4700 1 -- 172.21.15.26:0/1588431932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f015a5d0 msgr2=0x7ff9f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f015a5d0 0x7ff9f0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f4df4700 1 -- 172.21.15.26:0/1588431932 >> v1:172.21.15.26:6789/0 conn(0x7ff9f00cd9e0 legacy=0x7ff9f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f4df4700 1 -- 172.21.15.26:0/1588431932 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00ccf00 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f00cb970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e90 tx=0x7ff9e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a820320d1303e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9ef7fe700 1 -- 172.21.15.26:0/1588431932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800e070 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9ef7fe700 1 -- 172.21.15.26:0/1588431932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e800bbf0 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9ef7fe700 1 -- 172.21.15.26:0/1588431932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8012430 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 -- 172.21.15.26:0/1588431932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f00cb5a0 msgr2=0x7ff9f00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f00cb970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e90 tx=0x7ff9e8009780 comp rx=0 tx=0).stop 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 -- 172.21.15.26:0/1588431932 shutdown_connections 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f015a5d0 0x7ff9f0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 --2- 172.21.15.26:0/1588431932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f00cb970 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 -- 172.21.15.26:0/1588431932 >> 172.21.15.26:0/1588431932 conn(0x7ff9f0070e30 msgr2=0x7ff9f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.083+0000 7ff9f7058700 1 -- 172.21.15.26:0/1588431932 shutdown_connections 2023-10-09T11:42:06.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.084+0000 7ff9f7058700 1 -- 172.21.15.26:0/1588431932 wait complete. 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.085+0000 7ff9f7058700 1 Processor -- start 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.085+0000 7ff9f7058700 1 -- start start 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.085+0000 7ff9f7058700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.085+0000 7ff9f7058700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 0x7ff9f016a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f016c100 con 0x7ff9f015a5d0 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f016aed0 con 0x7ff9f00cb5a0 2023-10-09T11:42:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f0158ff0 con 0x7ff9f00cd9e0 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43010/0 (socket says 172.21.15.26:43010) 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 -- 172.21.15.26:0/2545336351 learned_addr learned my addr 172.21.15.26:0/2545336351 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9effff700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 0x7ff9f016a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 -- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 msgr2=0x7ff9f016a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 0x7ff9f016a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 -- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 msgr2=0x7ff9f0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f0156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 -- 172.21.15.26:0/2545336351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8009a20 con 0x7ff9f015a5d0 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9effff700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 0x7ff9f016a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f55f5700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000d860 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00125f0 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0012750 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f016b4f0 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0012b10 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.086+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f016bab0 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.087+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f016c270 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.088+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9e001e460 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.088+0000 7ff9ecff9700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 0x7ff9dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.088+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9e00852d0 con 0x7ff9f015a5d0 2023-10-09T11:42:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.088+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 0x7ff9dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.089+0000 7ff9f4df4700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 0x7ff9dc0697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009fd0 tx=0x7ff9e8019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.092+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9e00559f0 con 0x7ff9f015a5d0 2023-10-09T11:42:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.279+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9f004c3c0 con 0x7ff9dc067320 2023-10-09T11:42:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.288+0000 7ff9ecff9700 1 -- 172.21.15.26:0/2545336351 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289244 (secure 0 0 0) 0x7ff9f004c3c0 con 0x7ff9dc067320 2023-10-09T11:42:06.294 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 msgr2=0x7ff9dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 0x7ff9dc0697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009fd0 tx=0x7ff9e8019000 comp rx=0 tx=0).stop 2023-10-09T11:42:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 msgr2=0x7ff9f0158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000d860 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 shutdown_connections 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9f015a5d0 0x7ff9f0158ab0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f00cb5a0 0x7ff9f0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff9dc067320 0x7ff9dc0697d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 --2- 172.21.15.26:0/2545336351 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9f00cd9e0 0x7ff9f016a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 >> 172.21.15.26:0/2545336351 conn(0x7ff9f0070e30 msgr2=0x7ff9f00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 shutdown_connections 2023-10-09T11:42:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:06.292+0000 7ff9f7058700 1 -- 172.21.15.26:0/2545336351 wait complete. 2023-10-09T11:42:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:06.305 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2023-10-09T11:42:05.203610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423068,"kb_used_data":11996,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551652,"statfs":{"total":773094113280,"available":770612891648,"internally_reserved":0,"allocated":12283904,"data_stored":5965116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001534"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218330+0000","last_change":"2023-10-09T11:42:00.212745+0000","last_active":"2023-10-09T11:42:00.218330+0000","last_peered":"2023-10-09T11:42:00.218330+0000","last_clean":"2023-10-09T11:42:00.218330+0000","last_became_active":"2023-10-09T11:42:00.212470+0000","last_became_peered":"2023-10-09T11:42:00.212470+0000","last_unstale":"2023-10-09T11:42:00.218330+0000","last_undegraded":"2023-10-09T11:42:00.218330+0000","last_fullsized":"2023-10-09T11:42:00.218330+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:58.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203658+0000","last_change":"2023-10-09T11:42:00.203777+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203658+0000","last_undegraded":"2023-10-09T11:42:00.203658+0000","last_fullsized":"2023-10-09T11:42:00.203658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209345+0000","last_change":"2023-10-09T11:42:00.209345+0000","last_active":"2023-10-09T11:42:00.209345+0000","last_peered":"2023-10-09T11:42:00.209345+0000","last_clean":"2023-10-09T11:42:00.209345+0000","last_became_active":"2023-10-09T11:42:00.208655+0000","last_became_peered":"2023-10-09T11:42:00.208655+0000","last_unstale":"2023-10-09T11:42:00.209345+0000","last_undegraded":"2023-10-09T11:42:00.209345+0000","last_fullsized":"2023-10-09T11:42:00.209345+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219021+0000","last_change":"2023-10-09T11:42:00.216889+0000","last_active":"2023-10-09T11:42:00.219021+0000","last_peered":"2023-10-09T11:42:00.219021+0000","last_clean":"2023-10-09T11:42:00.219021+0000","last_became_active":"2023-10-09T11:42:00.216621+0000","last_became_peered":"2023-10-09T11:42:00.216621+0000","last_unstale":"2023-10-09T11:42:00.219021+0000","last_undegraded":"2023-10-09T11:42:00.219021+0000","last_fullsized":"2023-10-09T11:42:00.219021+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:04.811163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218958+0000","last_change":"2023-10-09T11:42:00.218958+0000","last_active":"2023-10-09T11:42:00.218958+0000","last_peered":"2023-10-09T11:42:00.218958+0000","last_clean":"2023-10-09T11:42:00.218958+0000","last_became_active":"2023-10-09T11:42:00.218285+0000","last_became_peered":"2023-10-09T11:42:00.218285+0000","last_unstale":"2023-10-09T11:42:00.218958+0000","last_undegraded":"2023-10-09T11:42:00.218958+0000","last_fullsized":"2023-10-09T11:42:00.218958+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216107+0000","last_change":"2023-10-09T11:42:00.209299+0000","last_active":"2023-10-09T11:42:00.216107+0000","last_peered":"2023-10-09T11:42:00.216107+0000","last_clean":"2023-10-09T11:42:00.216107+0000","last_became_active":"2023-10-09T11:42:00.208979+0000","last_became_peered":"2023-10-09T11:42:00.208979+0000","last_unstale":"2023-10-09T11:42:00.216107+0000","last_undegraded":"2023-10-09T11:42:00.216107+0000","last_fullsized":"2023-10-09T11:42:00.216107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217413+0000","last_change":"2023-10-09T11:42:00.211559+0000","last_active":"2023-10-09T11:42:00.217413+0000","last_peered":"2023-10-09T11:42:00.217413+0000","last_clean":"2023-10-09T11:42:00.217413+0000","last_became_active":"2023-10-09T11:42:00.211240+0000","last_became_peered":"2023-10-09T11:42:00.211240+0000","last_unstale":"2023-10-09T11:42:00.217413+0000","last_undegraded":"2023-10-09T11:42:00.217413+0000","last_fullsized":"2023-10-09T11:42:00.217413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219175+0000","last_change":"2023-10-09T11:42:00.213660+0000","last_active":"2023-10-09T11:42:00.219175+0000","last_peered":"2023-10-09T11:42:00.219175+0000","last_clean":"2023-10-09T11:42:00.219175+0000","last_became_active":"2023-10-09T11:42:00.213283+0000","last_became_peered":"2023-10-09T11:42:00.213283+0000","last_unstale":"2023-10-09T11:42:00.219175+0000","last_undegraded":"2023-10-09T11:42:00.219175+0000","last_fullsized":"2023-10-09T11:42:00.219175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212819+0000","last_change":"2023-10-09T11:42:00.212819+0000","last_active":"2023-10-09T11:42:00.212819+0000","last_peered":"2023-10-09T11:42:00.212819+0000","last_clean":"2023-10-09T11:42:00.212819+0000","last_became_active":"2023-10-09T11:42:00.212528+0000","last_became_peered":"2023-10-09T11:42:00.212528+0000","last_unstale":"2023-10-09T11:42:00.212819+0000","last_undegraded":"2023-10-09T11:42:00.212819+0000","last_fullsized":"2023-10-09T11:42:00.212819+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203350+0000","last_change":"2023-10-09T11:42:00.203471+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203350+0000","last_undegraded":"2023-10-09T11:42:00.203350+0000","last_fullsized":"2023-10-09T11:42:00.203350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201592+0000","last_change":"2023-10-09T11:42:00.201704+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201592+0000","last_undegraded":"2023-10-09T11:42:00.201592+0000","last_fullsized":"2023-10-09T11:42:00.201592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.206277+0000","last_change":"2023-10-09T11:42:00.206277+0000","last_active":"2023-10-09T11:42:00.206277+0000","last_peered":"2023-10-09T11:42:00.206277+0000","last_clean":"2023-10-09T11:42:00.206277+0000","last_became_active":"2023-10-09T11:42:00.205921+0000","last_became_peered":"2023-10-09T11:42:00.205921+0000","last_unstale":"2023-10-09T11:42:00.206277+0000","last_undegraded":"2023-10-09T11:42:00.206277+0000","last_fullsized":"2023-10-09T11:42:00.206277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219171+0000","last_change":"2023-10-09T11:42:00.218436+0000","last_active":"2023-10-09T11:42:00.219171+0000","last_peered":"2023-10-09T11:42:00.219171+0000","last_clean":"2023-10-09T11:42:00.219171+0000","last_became_active":"2023-10-09T11:42:00.217667+0000","last_became_peered":"2023-10-09T11:42:00.217667+0000","last_unstale":"2023-10-09T11:42:00.219171+0000","last_undegraded":"2023-10-09T11:42:00.219171+0000","last_fullsized":"2023-10-09T11:42:00.219171+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:23.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202510+0000","last_change":"2023-10-09T11:42:00.202641+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202510+0000","last_undegraded":"2023-10-09T11:42:00.202510+0000","last_fullsized":"2023-10-09T11:42:00.202510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218932+0000","last_change":"2023-10-09T11:42:00.215628+0000","last_active":"2023-10-09T11:42:00.218932+0000","last_peered":"2023-10-09T11:42:00.218932+0000","last_clean":"2023-10-09T11:42:00.218932+0000","last_became_active":"2023-10-09T11:42:00.213849+0000","last_became_peered":"2023-10-09T11:42:00.213849+0000","last_unstale":"2023-10-09T11:42:00.218932+0000","last_undegraded":"2023-10-09T11:42:00.218932+0000","last_fullsized":"2023-10-09T11:42:00.218932+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:25.244712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215385+0000","last_change":"2023-10-09T11:42:00.211981+0000","last_active":"2023-10-09T11:42:00.215385+0000","last_peered":"2023-10-09T11:42:00.215385+0000","last_clean":"2023-10-09T11:42:00.215385+0000","last_became_active":"2023-10-09T11:42:00.211732+0000","last_became_peered":"2023-10-09T11:42:00.211732+0000","last_unstale":"2023-10-09T11:42:00.215385+0000","last_undegraded":"2023-10-09T11:42:00.215385+0000","last_fullsized":"2023-10-09T11:42:00.215385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217334+0000","last_change":"2023-10-09T11:42:00.209841+0000","last_active":"2023-10-09T11:42:00.217334+0000","last_peered":"2023-10-09T11:42:00.217334+0000","last_clean":"2023-10-09T11:42:00.217334+0000","last_became_active":"2023-10-09T11:42:00.209230+0000","last_became_peered":"2023-10-09T11:42:00.209230+0000","last_unstale":"2023-10-09T11:42:00.217334+0000","last_undegraded":"2023-10-09T11:42:00.217334+0000","last_fullsized":"2023-10-09T11:42:00.217334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218057+0000","last_change":"2023-10-09T11:42:00.217136+0000","last_active":"2023-10-09T11:42:00.218057+0000","last_peered":"2023-10-09T11:42:00.218057+0000","last_clean":"2023-10-09T11:42:00.218057+0000","last_became_active":"2023-10-09T11:42:00.216861+0000","last_became_peered":"2023-10-09T11:42:00.216861+0000","last_unstale":"2023-10-09T11:42:00.218057+0000","last_undegraded":"2023-10-09T11:42:00.218057+0000","last_fullsized":"2023-10-09T11:42:00.218057+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201273+0000","last_change":"2023-10-09T11:42:00.201408+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201273+0000","last_undegraded":"2023-10-09T11:42:00.201273+0000","last_fullsized":"2023-10-09T11:42:00.201273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215199+0000","last_change":"2023-10-09T11:42:00.212063+0000","last_active":"2023-10-09T11:42:00.215199+0000","last_peered":"2023-10-09T11:42:00.215199+0000","last_clean":"2023-10-09T11:42:00.215199+0000","last_became_active":"2023-10-09T11:42:00.211759+0000","last_became_peered":"2023-10-09T11:42:00.211759+0000","last_unstale":"2023-10-09T11:42:00.215199+0000","last_undegraded":"2023-10-09T11:42:00.215199+0000","last_fullsized":"2023-10-09T11:42:00.215199+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218780+0000","last_change":"2023-10-09T11:42:00.218780+0000","last_active":"2023-10-09T11:42:00.218780+0000","last_peered":"2023-10-09T11:42:00.218780+0000","last_clean":"2023-10-09T11:42:00.218780+0000","last_became_active":"2023-10-09T11:42:00.218449+0000","last_became_peered":"2023-10-09T11:42:00.218449+0000","last_unstale":"2023-10-09T11:42:00.218780+0000","last_undegraded":"2023-10-09T11:42:00.218780+0000","last_fullsized":"2023-10-09T11:42:00.218780+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201160+0000","last_change":"2023-10-09T11:42:00.201290+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201160+0000","last_undegraded":"2023-10-09T11:42:00.201160+0000","last_fullsized":"2023-10-09T11:42:00.201160+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210628+0000","last_change":"2023-10-09T11:42:00.210628+0000","last_active":"2023-10-09T11:42:00.210628+0000","last_peered":"2023-10-09T11:42:00.210628+0000","last_clean":"2023-10-09T11:42:00.210628+0000","last_became_active":"2023-10-09T11:42:00.210317+0000","last_became_peered":"2023-10-09T11:42:00.210317+0000","last_unstale":"2023-10-09T11:42:00.210628+0000","last_undegraded":"2023-10-09T11:42:00.210628+0000","last_fullsized":"2023-10-09T11:42:00.210628+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.201079+0000","last_change":"2023-10-09T11:42:00.201232+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.201079+0000","last_undegraded":"2023-10-09T11:42:00.201079+0000","last_fullsized":"2023-10-09T11:42:00.201079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.203732+0000","last_change":"2023-10-09T11:42:00.203844+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.203732+0000","last_undegraded":"2023-10-09T11:42:00.203732+0000","last_fullsized":"2023-10-09T11:42:00.203732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218514+0000","last_change":"2023-10-09T11:42:00.218228+0000","last_active":"2023-10-09T11:42:00.218514+0000","last_peered":"2023-10-09T11:42:00.218514+0000","last_clean":"2023-10-09T11:42:00.218514+0000","last_became_active":"2023-10-09T11:42:00.217369+0000","last_became_peered":"2023-10-09T11:42:00.217369+0000","last_unstale":"2023-10-09T11:42:00.218514+0000","last_undegraded":"2023-10-09T11:42:00.218514+0000","last_fullsized":"2023-10-09T11:42:00.218514+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:50.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209811+0000","last_change":"2023-10-09T11:42:00.207233+0000","last_active":"2023-10-09T11:42:00.209811+0000","last_peered":"2023-10-09T11:42:00.209811+0000","last_clean":"2023-10-09T11:42:00.209811+0000","last_became_active":"2023-10-09T11:42:00.206981+0000","last_became_peered":"2023-10-09T11:42:00.206981+0000","last_unstale":"2023-10-09T11:42:00.209811+0000","last_undegraded":"2023-10-09T11:42:00.209811+0000","last_fullsized":"2023-10-09T11:42:00.209811+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:11.020302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214781+0000","last_change":"2023-10-09T11:42:00.214781+0000","last_active":"2023-10-09T11:42:00.214781+0000","last_peered":"2023-10-09T11:42:00.214781+0000","last_clean":"2023-10-09T11:42:00.214781+0000","last_became_active":"2023-10-09T11:42:00.214525+0000","last_became_peered":"2023-10-09T11:42:00.214525+0000","last_unstale":"2023-10-09T11:42:00.214781+0000","last_undegraded":"2023-10-09T11:42:00.214781+0000","last_fullsized":"2023-10-09T11:42:00.214781+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:07.099338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218561+0000","last_change":"2023-10-09T11:42:00.215498+0000","last_active":"2023-10-09T11:42:00.218561+0000","last_peered":"2023-10-09T11:42:00.218561+0000","last_clean":"2023-10-09T11:42:00.218561+0000","last_became_active":"2023-10-09T11:42:00.213777+0000","last_became_peered":"2023-10-09T11:42:00.213777+0000","last_unstale":"2023-10-09T11:42:00.218561+0000","last_undegraded":"2023-10-09T11:42:00.218561+0000","last_fullsized":"2023-10-09T11:42:00.218561+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:35.887788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218218+0000","last_change":"2023-10-09T11:42:00.214975+0000","last_active":"2023-10-09T11:42:00.218218+0000","last_peered":"2023-10-09T11:42:00.218218+0000","last_clean":"2023-10-09T11:42:00.218218+0000","last_became_active":"2023-10-09T11:42:00.214501+0000","last_became_peered":"2023-10-09T11:42:00.214501+0000","last_unstale":"2023-10-09T11:42:00.218218+0000","last_undegraded":"2023-10-09T11:42:00.218218+0000","last_fullsized":"2023-10-09T11:42:00.218218+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:13.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216982+0000","last_change":"2023-10-09T11:42:00.216982+0000","last_active":"2023-10-09T11:42:00.216982+0000","last_peered":"2023-10-09T11:42:00.216982+0000","last_clean":"2023-10-09T11:42:00.216982+0000","last_became_active":"2023-10-09T11:42:00.216574+0000","last_became_peered":"2023-10-09T11:42:00.216574+0000","last_unstale":"2023-10-09T11:42:00.216982+0000","last_undegraded":"2023-10-09T11:42:00.216982+0000","last_fullsized":"2023-10-09T11:42:00.216982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218148+0000","last_change":"2023-10-09T11:42:00.211866+0000","last_active":"2023-10-09T11:42:00.218148+0000","last_peered":"2023-10-09T11:42:00.218148+0000","last_clean":"2023-10-09T11:42:00.218148+0000","last_became_active":"2023-10-09T11:42:00.211567+0000","last_became_peered":"2023-10-09T11:42:00.211567+0000","last_unstale":"2023-10-09T11:42:00.218148+0000","last_undegraded":"2023-10-09T11:42:00.218148+0000","last_fullsized":"2023-10-09T11:42:00.218148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214243+0000","last_change":"2023-10-09T11:42:00.211574+0000","last_active":"2023-10-09T11:42:00.214243+0000","last_peered":"2023-10-09T11:42:00.214243+0000","last_clean":"2023-10-09T11:42:00.214243+0000","last_became_active":"2023-10-09T11:42:00.211327+0000","last_became_peered":"2023-10-09T11:42:00.211327+0000","last_unstale":"2023-10-09T11:42:00.214243+0000","last_undegraded":"2023-10-09T11:42:00.214243+0000","last_fullsized":"2023-10-09T11:42:00.214243+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"111'4","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640069+0000","last_change":"2023-10-09T11:41:59.632481+0000","last_active":"2023-10-09T11:42:00.640069+0000","last_peered":"2023-10-09T11:42:00.640069+0000","last_clean":"2023-10-09T11:42:00.640069+0000","last_became_active":"2023-10-09T11:41:59.632060+0000","last_became_peered":"2023-10-09T11:41:59.632060+0000","last_unstale":"2023-10-09T11:42:00.640069+0000","last_undegraded":"2023-10-09T11:42:00.640069+0000","last_fullsized":"2023-10-09T11:42:00.640069+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209066+0000","last_change":"2023-10-09T11:42:00.209066+0000","last_active":"2023-10-09T11:42:00.209066+0000","last_peered":"2023-10-09T11:42:00.209066+0000","last_clean":"2023-10-09T11:42:00.209066+0000","last_became_active":"2023-10-09T11:42:00.208807+0000","last_became_peered":"2023-10-09T11:42:00.208807+0000","last_unstale":"2023-10-09T11:42:00.209066+0000","last_undegraded":"2023-10-09T11:42:00.209066+0000","last_fullsized":"2023-10-09T11:42:00.209066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204750+0000","last_change":"2023-10-09T11:41:59.624685+0000","last_active":"2023-10-09T11:42:00.204750+0000","last_peered":"2023-10-09T11:42:00.204750+0000","last_clean":"2023-10-09T11:42:00.204750+0000","last_became_active":"2023-10-09T11:41:59.624425+0000","last_became_peered":"2023-10-09T11:41:59.624425+0000","last_unstale":"2023-10-09T11:42:00.204750+0000","last_undegraded":"2023-10-09T11:42:00.204750+0000","last_fullsized":"2023-10-09T11:42:00.204750+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221528+0000","last_change":"2023-10-09T11:42:00.221528+0000","last_active":"2023-10-09T11:42:00.221528+0000","last_peered":"2023-10-09T11:42:00.221528+0000","last_clean":"2023-10-09T11:42:00.221528+0000","last_became_active":"2023-10-09T11:42:00.221296+0000","last_became_peered":"2023-10-09T11:42:00.221296+0000","last_unstale":"2023-10-09T11:42:00.221528+0000","last_undegraded":"2023-10-09T11:42:00.221528+0000","last_fullsized":"2023-10-09T11:42:00.221528+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.241711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.631392+0000","last_change":"2023-10-09T11:41:59.625246+0000","last_active":"2023-10-09T11:41:59.631392+0000","last_peered":"2023-10-09T11:41:59.631392+0000","last_clean":"2023-10-09T11:41:59.631392+0000","last_became_active":"2023-10-09T11:41:59.624956+0000","last_became_peered":"2023-10-09T11:41:59.624956+0000","last_unstale":"2023-10-09T11:41:59.631392+0000","last_undegraded":"2023-10-09T11:41:59.631392+0000","last_fullsized":"2023-10-09T11:41:59.631392+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217661+0000","last_change":"2023-10-09T11:42:00.217661+0000","last_active":"2023-10-09T11:42:00.217661+0000","last_peered":"2023-10-09T11:42:00.217661+0000","last_clean":"2023-10-09T11:42:00.217661+0000","last_became_active":"2023-10-09T11:42:00.217406+0000","last_became_peered":"2023-10-09T11:42:00.217406+0000","last_unstale":"2023-10-09T11:42:00.217661+0000","last_undegraded":"2023-10-09T11:42:00.217661+0000","last_fullsized":"2023-10-09T11:42:00.217661+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629218+0000","last_change":"2023-10-09T11:41:59.627331+0000","last_active":"2023-10-09T11:41:59.629218+0000","last_peered":"2023-10-09T11:41:59.629218+0000","last_clean":"2023-10-09T11:41:59.629218+0000","last_became_active":"2023-10-09T11:41:59.627063+0000","last_became_peered":"2023-10-09T11:41:59.627063+0000","last_unstale":"2023-10-09T11:41:59.629218+0000","last_undegraded":"2023-10-09T11:41:59.629218+0000","last_fullsized":"2023-10-09T11:41:59.629218+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:03.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217990+0000","last_change":"2023-10-09T11:42:00.216729+0000","last_active":"2023-10-09T11:42:00.217990+0000","last_peered":"2023-10-09T11:42:00.217990+0000","last_clean":"2023-10-09T11:42:00.217990+0000","last_became_active":"2023-10-09T11:42:00.216427+0000","last_became_peered":"2023-10-09T11:42:00.216427+0000","last_unstale":"2023-10-09T11:42:00.217990+0000","last_undegraded":"2023-10-09T11:42:00.217990+0000","last_fullsized":"2023-10-09T11:42:00.217990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629274+0000","last_change":"2023-10-09T11:41:59.627978+0000","last_active":"2023-10-09T11:41:59.629274+0000","last_peered":"2023-10-09T11:41:59.629274+0000","last_clean":"2023-10-09T11:41:59.629274+0000","last_became_active":"2023-10-09T11:41:59.627728+0000","last_became_peered":"2023-10-09T11:41:59.627728+0000","last_unstale":"2023-10-09T11:41:59.629274+0000","last_undegraded":"2023-10-09T11:41:59.629274+0000","last_fullsized":"2023-10-09T11:41:59.629274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217382+0000","last_change":"2023-10-09T11:42:00.209626+0000","last_active":"2023-10-09T11:42:00.217382+0000","last_peered":"2023-10-09T11:42:00.217382+0000","last_clean":"2023-10-09T11:42:00.217382+0000","last_became_active":"2023-10-09T11:42:00.209213+0000","last_became_peered":"2023-10-09T11:42:00.209213+0000","last_unstale":"2023-10-09T11:42:00.217382+0000","last_undegraded":"2023-10-09T11:42:00.217382+0000","last_fullsized":"2023-10-09T11:42:00.217382+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.634870+0000","last_change":"2023-10-09T11:41:59.629750+0000","last_active":"2023-10-09T11:42:00.634870+0000","last_peered":"2023-10-09T11:42:00.634870+0000","last_clean":"2023-10-09T11:42:00.634870+0000","last_became_active":"2023-10-09T11:41:59.629570+0000","last_became_peered":"2023-10-09T11:41:59.629570+0000","last_unstale":"2023-10-09T11:42:00.634870+0000","last_undegraded":"2023-10-09T11:42:00.634870+0000","last_fullsized":"2023-10-09T11:42:00.634870+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219151+0000","last_change":"2023-10-09T11:42:00.213355+0000","last_active":"2023-10-09T11:42:00.219151+0000","last_peered":"2023-10-09T11:42:00.219151+0000","last_clean":"2023-10-09T11:42:00.219151+0000","last_became_active":"2023-10-09T11:42:00.212927+0000","last_became_peered":"2023-10-09T11:42:00.212927+0000","last_unstale":"2023-10-09T11:42:00.219151+0000","last_undegraded":"2023-10-09T11:42:00.219151+0000","last_fullsized":"2023-10-09T11:42:00.219151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.202774+0000","last_change":"2023-10-09T11:41:59.637978+0000","last_active":"2023-10-09T11:42:00.202774+0000","last_peered":"2023-10-09T11:42:00.202774+0000","last_clean":"2023-10-09T11:42:00.202774+0000","last_became_active":"2023-10-09T11:41:59.637664+0000","last_became_peered":"2023-10-09T11:41:59.637664+0000","last_unstale":"2023-10-09T11:42:00.202774+0000","last_undegraded":"2023-10-09T11:42:00.202774+0000","last_fullsized":"2023-10-09T11:42:00.202774+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:08.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202064+0000","last_change":"2023-10-09T11:42:00.202226+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202064+0000","last_undegraded":"2023-10-09T11:42:00.202064+0000","last_fullsized":"2023-10-09T11:42:00.202064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634398+0000","last_change":"2023-10-09T11:41:59.632493+0000","last_active":"2023-10-09T11:41:59.634398+0000","last_peered":"2023-10-09T11:41:59.634398+0000","last_clean":"2023-10-09T11:41:59.634398+0000","last_became_active":"2023-10-09T11:41:59.632168+0000","last_became_peered":"2023-10-09T11:41:59.632168+0000","last_unstale":"2023-10-09T11:41:59.634398+0000","last_undegraded":"2023-10-09T11:41:59.634398+0000","last_fullsized":"2023-10-09T11:41:59.634398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:38.935473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216157+0000","last_change":"2023-10-09T11:42:00.211624+0000","last_active":"2023-10-09T11:42:00.216157+0000","last_peered":"2023-10-09T11:42:00.216157+0000","last_clean":"2023-10-09T11:42:00.216157+0000","last_became_active":"2023-10-09T11:42:00.211380+0000","last_became_peered":"2023-10-09T11:42:00.211380+0000","last_unstale":"2023-10-09T11:42:00.216157+0000","last_undegraded":"2023-10-09T11:42:00.216157+0000","last_fullsized":"2023-10-09T11:42:00.216157+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:31.033042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.637595+0000","last_change":"2023-10-09T11:41:59.632085+0000","last_active":"2023-10-09T11:41:59.637595+0000","last_peered":"2023-10-09T11:41:59.637595+0000","last_clean":"2023-10-09T11:41:59.637595+0000","last_became_active":"2023-10-09T11:41:59.631758+0000","last_became_peered":"2023-10-09T11:41:59.631758+0000","last_unstale":"2023-10-09T11:41:59.637595+0000","last_undegraded":"2023-10-09T11:41:59.637595+0000","last_fullsized":"2023-10-09T11:41:59.637595+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:57.551222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212835+0000","last_change":"2023-10-09T11:42:00.212835+0000","last_active":"2023-10-09T11:42:00.212835+0000","last_peered":"2023-10-09T11:42:00.212835+0000","last_clean":"2023-10-09T11:42:00.212835+0000","last_became_active":"2023-10-09T11:42:00.212518+0000","last_became_peered":"2023-10-09T11:42:00.212518+0000","last_unstale":"2023-10-09T11:42:00.212835+0000","last_undegraded":"2023-10-09T11:42:00.212835+0000","last_fullsized":"2023-10-09T11:42:00.212835+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210728+0000","last_change":"2023-10-09T11:41:59.632977+0000","last_active":"2023-10-09T11:42:00.210728+0000","last_peered":"2023-10-09T11:42:00.210728+0000","last_clean":"2023-10-09T11:42:00.210728+0000","last_became_active":"2023-10-09T11:41:59.632684+0000","last_became_peered":"2023-10-09T11:41:59.632684+0000","last_unstale":"2023-10-09T11:42:00.210728+0000","last_undegraded":"2023-10-09T11:42:00.210728+0000","last_fullsized":"2023-10-09T11:42:00.210728+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219167+0000","last_change":"2023-10-09T11:42:00.219167+0000","last_active":"2023-10-09T11:42:00.219167+0000","last_peered":"2023-10-09T11:42:00.219167+0000","last_clean":"2023-10-09T11:42:00.219167+0000","last_became_active":"2023-10-09T11:42:00.218471+0000","last_became_peered":"2023-10-09T11:42:00.218471+0000","last_unstale":"2023-10-09T11:42:00.219167+0000","last_undegraded":"2023-10-09T11:42:00.219167+0000","last_fullsized":"2023-10-09T11:42:00.219167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"111'3","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.637607+0000","last_change":"2023-10-09T11:41:59.630953+0000","last_active":"2023-10-09T11:42:00.637607+0000","last_peered":"2023-10-09T11:42:00.637607+0000","last_clean":"2023-10-09T11:42:00.637607+0000","last_became_active":"2023-10-09T11:41:59.630684+0000","last_became_peered":"2023-10-09T11:41:59.630684+0000","last_unstale":"2023-10-09T11:42:00.637607+0000","last_undegraded":"2023-10-09T11:42:00.637607+0000","last_fullsized":"2023-10-09T11:42:00.637607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220411+0000","last_change":"2023-10-09T11:42:00.220411+0000","last_active":"2023-10-09T11:42:00.220411+0000","last_peered":"2023-10-09T11:42:00.220411+0000","last_clean":"2023-10-09T11:42:00.220411+0000","last_became_active":"2023-10-09T11:42:00.220156+0000","last_became_peered":"2023-10-09T11:42:00.220156+0000","last_unstale":"2023-10-09T11:42:00.220411+0000","last_undegraded":"2023-10-09T11:42:00.220411+0000","last_fullsized":"2023-10-09T11:42:00.220411+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:08.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"111'6","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640498+0000","last_change":"2023-10-09T11:41:59.633075+0000","last_active":"2023-10-09T11:42:00.640498+0000","last_peered":"2023-10-09T11:42:00.640498+0000","last_clean":"2023-10-09T11:42:00.640498+0000","last_became_active":"2023-10-09T11:41:59.632787+0000","last_became_peered":"2023-10-09T11:41:59.632787+0000","last_unstale":"2023-10-09T11:42:00.640498+0000","last_undegraded":"2023-10-09T11:42:00.640498+0000","last_fullsized":"2023-10-09T11:42:00.640498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:12.460978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216356+0000","last_change":"2023-10-09T11:42:00.211363+0000","last_active":"2023-10-09T11:42:00.216356+0000","last_peered":"2023-10-09T11:42:00.216356+0000","last_clean":"2023-10-09T11:42:00.216356+0000","last_became_active":"2023-10-09T11:42:00.211096+0000","last_became_peered":"2023-10-09T11:42:00.211096+0000","last_unstale":"2023-10-09T11:42:00.216356+0000","last_undegraded":"2023-10-09T11:42:00.216356+0000","last_fullsized":"2023-10-09T11:42:00.216356+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:49.955853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204696+0000","last_change":"2023-10-09T11:41:59.635800+0000","last_active":"2023-10-09T11:42:00.204696+0000","last_peered":"2023-10-09T11:42:00.204696+0000","last_clean":"2023-10-09T11:42:00.204696+0000","last_became_active":"2023-10-09T11:41:59.635487+0000","last_became_peered":"2023-10-09T11:41:59.635487+0000","last_unstale":"2023-10-09T11:42:00.204696+0000","last_undegraded":"2023-10-09T11:42:00.204696+0000","last_fullsized":"2023-10-09T11:42:00.204696+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:26.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202052+0000","last_change":"2023-10-09T11:42:00.202159+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202052+0000","last_undegraded":"2023-10-09T11:42:00.202052+0000","last_fullsized":"2023-10-09T11:42:00.202052+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629190+0000","last_change":"2023-10-09T11:41:59.626882+0000","last_active":"2023-10-09T11:41:59.629190+0000","last_peered":"2023-10-09T11:41:59.629190+0000","last_clean":"2023-10-09T11:41:59.629190+0000","last_became_active":"2023-10-09T11:41:59.626653+0000","last_became_peered":"2023-10-09T11:41:59.626653+0000","last_unstale":"2023-10-09T11:41:59.629190+0000","last_undegraded":"2023-10-09T11:41:59.629190+0000","last_fullsized":"2023-10-09T11:41:59.629190+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.208367+0000","last_change":"2023-10-09T11:42:00.208367+0000","last_active":"2023-10-09T11:42:00.208367+0000","last_peered":"2023-10-09T11:42:00.208367+0000","last_clean":"2023-10-09T11:42:00.208367+0000","last_became_active":"2023-10-09T11:42:00.207838+0000","last_became_peered":"2023-10-09T11:42:00.207838+0000","last_unstale":"2023-10-09T11:42:00.208367+0000","last_undegraded":"2023-10-09T11:42:00.208367+0000","last_fullsized":"2023-10-09T11:42:00.208367+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"111'8","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638449+0000","last_change":"2023-10-09T11:41:59.629160+0000","last_active":"2023-10-09T11:42:00.638449+0000","last_peered":"2023-10-09T11:42:00.638449+0000","last_clean":"2023-10-09T11:42:00.638449+0000","last_became_active":"2023-10-09T11:41:59.628930+0000","last_became_peered":"2023-10-09T11:41:59.628930+0000","last_unstale":"2023-10-09T11:42:00.638449+0000","last_undegraded":"2023-10-09T11:42:00.638449+0000","last_fullsized":"2023-10-09T11:42:00.638449+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:12.328048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214813+0000","last_change":"2023-10-09T11:42:00.214813+0000","last_active":"2023-10-09T11:42:00.214813+0000","last_peered":"2023-10-09T11:42:00.214813+0000","last_clean":"2023-10-09T11:42:00.214813+0000","last_became_active":"2023-10-09T11:42:00.214504+0000","last_became_peered":"2023-10-09T11:42:00.214504+0000","last_unstale":"2023-10-09T11:42:00.214813+0000","last_undegraded":"2023-10-09T11:42:00.214813+0000","last_fullsized":"2023-10-09T11:42:00.214813+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.205279+0000","last_change":"2023-10-09T11:41:59.628234+0000","last_active":"2023-10-09T11:42:00.205279+0000","last_peered":"2023-10-09T11:42:00.205279+0000","last_clean":"2023-10-09T11:42:00.205279+0000","last_became_active":"2023-10-09T11:41:59.627982+0000","last_became_peered":"2023-10-09T11:41:59.627982+0000","last_unstale":"2023-10-09T11:42:00.205279+0000","last_undegraded":"2023-10-09T11:42:00.205279+0000","last_fullsized":"2023-10-09T11:42:00.205279+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:40.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.213778+0000","last_change":"2023-10-09T11:42:00.213778+0000","last_active":"2023-10-09T11:42:00.213778+0000","last_peered":"2023-10-09T11:42:00.213778+0000","last_clean":"2023-10-09T11:42:00.213778+0000","last_became_active":"2023-10-09T11:42:00.213110+0000","last_became_peered":"2023-10-09T11:42:00.213110+0000","last_unstale":"2023-10-09T11:42:00.213778+0000","last_undegraded":"2023-10-09T11:42:00.213778+0000","last_fullsized":"2023-10-09T11:42:00.213778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:22.834787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628159+0000","last_change":"2023-10-09T11:41:59.624967+0000","last_active":"2023-10-09T11:41:59.628159+0000","last_peered":"2023-10-09T11:41:59.628159+0000","last_clean":"2023-10-09T11:41:59.628159+0000","last_became_active":"2023-10-09T11:41:59.624703+0000","last_became_peered":"2023-10-09T11:41:59.624703+0000","last_unstale":"2023-10-09T11:41:59.628159+0000","last_undegraded":"2023-10-09T11:41:59.628159+0000","last_fullsized":"2023-10-09T11:41:59.628159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.895476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.211625+0000","last_change":"2023-10-09T11:42:00.209652+0000","last_active":"2023-10-09T11:42:00.211625+0000","last_peered":"2023-10-09T11:42:00.211625+0000","last_clean":"2023-10-09T11:42:00.211625+0000","last_became_active":"2023-10-09T11:42:00.209400+0000","last_became_peered":"2023-10-09T11:42:00.209400+0000","last_unstale":"2023-10-09T11:42:00.211625+0000","last_undegraded":"2023-10-09T11:42:00.211625+0000","last_fullsized":"2023-10-09T11:42:00.211625+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:29.470981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.636944+0000","last_change":"2023-10-09T11:41:59.635012+0000","last_active":"2023-10-09T11:42:00.636944+0000","last_peered":"2023-10-09T11:42:00.636944+0000","last_clean":"2023-10-09T11:42:00.636944+0000","last_became_active":"2023-10-09T11:41:59.634630+0000","last_became_peered":"2023-10-09T11:41:59.634630+0000","last_unstale":"2023-10-09T11:42:00.636944+0000","last_undegraded":"2023-10-09T11:42:00.636944+0000","last_fullsized":"2023-10-09T11:42:00.636944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:21.830413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202791+0000","last_change":"2023-10-09T11:42:00.202917+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202791+0000","last_undegraded":"2023-10-09T11:42:00.202791+0000","last_fullsized":"2023-10-09T11:42:00.202791+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.632074+0000","last_change":"2023-10-09T11:41:59.627009+0000","last_active":"2023-10-09T11:41:59.632074+0000","last_peered":"2023-10-09T11:41:59.632074+0000","last_clean":"2023-10-09T11:41:59.632074+0000","last_became_active":"2023-10-09T11:41:59.626708+0000","last_became_peered":"2023-10-09T11:41:59.626708+0000","last_unstale":"2023-10-09T11:41:59.632074+0000","last_undegraded":"2023-10-09T11:41:59.632074+0000","last_fullsized":"2023-10-09T11:41:59.632074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219099+0000","last_change":"2023-10-09T11:42:00.217901+0000","last_active":"2023-10-09T11:42:00.219099+0000","last_peered":"2023-10-09T11:42:00.219099+0000","last_clean":"2023-10-09T11:42:00.219099+0000","last_became_active":"2023-10-09T11:42:00.217641+0000","last_became_peered":"2023-10-09T11:42:00.217641+0000","last_unstale":"2023-10-09T11:42:00.219099+0000","last_undegraded":"2023-10-09T11:42:00.219099+0000","last_fullsized":"2023-10-09T11:42:00.219099+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:13.332422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638734+0000","last_change":"2023-10-09T11:41:59.631402+0000","last_active":"2023-10-09T11:42:00.638734+0000","last_peered":"2023-10-09T11:42:00.638734+0000","last_clean":"2023-10-09T11:42:00.638734+0000","last_became_active":"2023-10-09T11:41:59.630980+0000","last_became_peered":"2023-10-09T11:41:59.630980+0000","last_unstale":"2023-10-09T11:42:00.638734+0000","last_undegraded":"2023-10-09T11:42:00.638734+0000","last_fullsized":"2023-10-09T11:42:00.638734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:10.015929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217404+0000","last_change":"2023-10-09T11:42:00.210737+0000","last_active":"2023-10-09T11:42:00.217404+0000","last_peered":"2023-10-09T11:42:00.217404+0000","last_clean":"2023-10-09T11:42:00.217404+0000","last_became_active":"2023-10-09T11:42:00.209921+0000","last_became_peered":"2023-10-09T11:42:00.209921+0000","last_unstale":"2023-10-09T11:42:00.217404+0000","last_undegraded":"2023-10-09T11:42:00.217404+0000","last_fullsized":"2023-10-09T11:42:00.217404+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210087+0000","last_change":"2023-10-09T11:41:59.632230+0000","last_active":"2023-10-09T11:42:00.210087+0000","last_peered":"2023-10-09T11:42:00.210087+0000","last_clean":"2023-10-09T11:42:00.210087+0000","last_became_active":"2023-10-09T11:41:59.631971+0000","last_became_peered":"2023-10-09T11:41:59.631971+0000","last_unstale":"2023-10-09T11:42:00.210087+0000","last_undegraded":"2023-10-09T11:42:00.210087+0000","last_fullsized":"2023-10-09T11:42:00.210087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202067+0000","last_change":"2023-10-09T11:42:00.202208+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202067+0000","last_undegraded":"2023-10-09T11:42:00.202067+0000","last_fullsized":"2023-10-09T11:42:00.202067+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209902+0000","last_change":"2023-10-09T11:41:59.631307+0000","last_active":"2023-10-09T11:42:00.209902+0000","last_peered":"2023-10-09T11:42:00.209902+0000","last_clean":"2023-10-09T11:42:00.209902+0000","last_became_active":"2023-10-09T11:41:59.630943+0000","last_became_peered":"2023-10-09T11:41:59.630943+0000","last_unstale":"2023-10-09T11:42:00.209902+0000","last_undegraded":"2023-10-09T11:42:00.209902+0000","last_fullsized":"2023-10-09T11:42:00.209902+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:57.854138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219945+0000","last_change":"2023-10-09T11:42:00.219945+0000","last_active":"2023-10-09T11:42:00.219945+0000","last_peered":"2023-10-09T11:42:00.219945+0000","last_clean":"2023-10-09T11:42:00.219945+0000","last_became_active":"2023-10-09T11:42:00.219612+0000","last_became_peered":"2023-10-09T11:42:00.219612+0000","last_unstale":"2023-10-09T11:42:00.219945+0000","last_undegraded":"2023-10-09T11:42:00.219945+0000","last_fullsized":"2023-10-09T11:42:00.219945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628174+0000","last_change":"2023-10-09T11:41:59.625622+0000","last_active":"2023-10-09T11:41:59.628174+0000","last_peered":"2023-10-09T11:41:59.628174+0000","last_clean":"2023-10-09T11:41:59.628174+0000","last_became_active":"2023-10-09T11:41:59.625346+0000","last_became_peered":"2023-10-09T11:41:59.625346+0000","last_unstale":"2023-10-09T11:41:59.628174+0000","last_undegraded":"2023-10-09T11:41:59.628174+0000","last_fullsized":"2023-10-09T11:41:59.628174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:08.373571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217471+0000","last_change":"2023-10-09T11:42:00.210536+0000","last_active":"2023-10-09T11:42:00.217471+0000","last_peered":"2023-10-09T11:42:00.217471+0000","last_clean":"2023-10-09T11:42:00.217471+0000","last_became_active":"2023-10-09T11:42:00.210277+0000","last_became_peered":"2023-10-09T11:42:00.210277+0000","last_unstale":"2023-10-09T11:42:00.217471+0000","last_undegraded":"2023-10-09T11:42:00.217471+0000","last_fullsized":"2023-10-09T11:42:00.217471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638575+0000","last_change":"2023-10-09T11:41:59.631336+0000","last_active":"2023-10-09T11:42:00.638575+0000","last_peered":"2023-10-09T11:42:00.638575+0000","last_clean":"2023-10-09T11:42:00.638575+0000","last_became_active":"2023-10-09T11:41:59.631014+0000","last_became_peered":"2023-10-09T11:41:59.631014+0000","last_unstale":"2023-10-09T11:42:00.638575+0000","last_undegraded":"2023-10-09T11:42:00.638575+0000","last_fullsized":"2023-10-09T11:42:00.638575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:04.014266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218967+0000","last_change":"2023-10-09T11:42:00.215982+0000","last_active":"2023-10-09T11:42:00.218967+0000","last_peered":"2023-10-09T11:42:00.218967+0000","last_clean":"2023-10-09T11:42:00.218967+0000","last_became_active":"2023-10-09T11:42:00.215665+0000","last_became_peered":"2023-10-09T11:42:00.215665+0000","last_unstale":"2023-10-09T11:42:00.218967+0000","last_undegraded":"2023-10-09T11:42:00.218967+0000","last_fullsized":"2023-10-09T11:42:00.218967+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640360+0000","last_change":"2023-10-09T11:41:59.635719+0000","last_active":"2023-10-09T11:41:59.640360+0000","last_peered":"2023-10-09T11:41:59.640360+0000","last_clean":"2023-10-09T11:41:59.640360+0000","last_became_active":"2023-10-09T11:41:59.635402+0000","last_became_peered":"2023-10-09T11:41:59.635402+0000","last_unstale":"2023-10-09T11:41:59.640360+0000","last_undegraded":"2023-10-09T11:41:59.640360+0000","last_fullsized":"2023-10-09T11:41:59.640360+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202476+0000","last_change":"2023-10-09T11:42:00.202589+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202476+0000","last_undegraded":"2023-10-09T11:42:00.202476+0000","last_fullsized":"2023-10-09T11:42:00.202476+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.634422+0000","last_change":"2023-10-09T11:41:59.632579+0000","last_active":"2023-10-09T11:41:59.634422+0000","last_peered":"2023-10-09T11:41:59.634422+0000","last_clean":"2023-10-09T11:41:59.634422+0000","last_became_active":"2023-10-09T11:41:59.632268+0000","last_became_peered":"2023-10-09T11:41:59.632268+0000","last_unstale":"2023-10-09T11:41:59.634422+0000","last_undegraded":"2023-10-09T11:41:59.634422+0000","last_fullsized":"2023-10-09T11:41:59.634422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217040+0000","last_change":"2023-10-09T11:42:00.209277+0000","last_active":"2023-10-09T11:42:00.217040+0000","last_peered":"2023-10-09T11:42:00.217040+0000","last_clean":"2023-10-09T11:42:00.217040+0000","last_became_active":"2023-10-09T11:42:00.208952+0000","last_became_peered":"2023-10-09T11:42:00.208952+0000","last_unstale":"2023-10-09T11:42:00.217040+0000","last_undegraded":"2023-10-09T11:42:00.217040+0000","last_fullsized":"2023-10-09T11:42:00.217040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.628205+0000","last_change":"2023-10-09T11:41:59.625759+0000","last_active":"2023-10-09T11:41:59.628205+0000","last_peered":"2023-10-09T11:41:59.628205+0000","last_clean":"2023-10-09T11:41:59.628205+0000","last_became_active":"2023-10-09T11:41:59.623565+0000","last_became_peered":"2023-10-09T11:41:59.623565+0000","last_unstale":"2023-10-09T11:41:59.628205+0000","last_undegraded":"2023-10-09T11:41:59.628205+0000","last_fullsized":"2023-10-09T11:41:59.628205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:36.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220642+0000","last_change":"2023-10-09T11:42:00.220642+0000","last_active":"2023-10-09T11:42:00.220642+0000","last_peered":"2023-10-09T11:42:00.220642+0000","last_clean":"2023-10-09T11:42:00.220642+0000","last_became_active":"2023-10-09T11:42:00.220107+0000","last_became_peered":"2023-10-09T11:42:00.220107+0000","last_unstale":"2023-10-09T11:42:00.220642+0000","last_undegraded":"2023-10-09T11:42:00.220642+0000","last_fullsized":"2023-10-09T11:42:00.220642+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.629254+0000","last_change":"2023-10-09T11:41:59.627466+0000","last_active":"2023-10-09T11:41:59.629254+0000","last_peered":"2023-10-09T11:41:59.629254+0000","last_clean":"2023-10-09T11:41:59.629254+0000","last_became_active":"2023-10-09T11:41:59.626717+0000","last_became_peered":"2023-10-09T11:41:59.626717+0000","last_unstale":"2023-10-09T11:41:59.629254+0000","last_undegraded":"2023-10-09T11:41:59.629254+0000","last_fullsized":"2023-10-09T11:41:59.629254+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.207614+0000","last_change":"2023-10-09T11:42:00.207614+0000","last_active":"2023-10-09T11:42:00.207614+0000","last_peered":"2023-10-09T11:42:00.207614+0000","last_clean":"2023-10-09T11:42:00.207614+0000","last_became_active":"2023-10-09T11:42:00.207309+0000","last_became_peered":"2023-10-09T11:42:00.207309+0000","last_unstale":"2023-10-09T11:42:00.207614+0000","last_undegraded":"2023-10-09T11:42:00.207614+0000","last_fullsized":"2023-10-09T11:42:00.207614+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:58.991113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.640269+0000","last_change":"2023-10-09T11:41:59.632416+0000","last_active":"2023-10-09T11:41:59.640269+0000","last_peered":"2023-10-09T11:41:59.640269+0000","last_clean":"2023-10-09T11:41:59.640269+0000","last_became_active":"2023-10-09T11:41:59.632037+0000","last_became_peered":"2023-10-09T11:41:59.632037+0000","last_unstale":"2023-10-09T11:41:59.640269+0000","last_undegraded":"2023-10-09T11:41:59.640269+0000","last_fullsized":"2023-10-09T11:41:59.640269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215477+0000","last_change":"2023-10-09T11:42:00.212726+0000","last_active":"2023-10-09T11:42:00.215477+0000","last_peered":"2023-10-09T11:42:00.215477+0000","last_clean":"2023-10-09T11:42:00.215477+0000","last_became_active":"2023-10-09T11:42:00.212460+0000","last_became_peered":"2023-10-09T11:42:00.212460+0000","last_unstale":"2023-10-09T11:42:00.215477+0000","last_undegraded":"2023-10-09T11:42:00.215477+0000","last_fullsized":"2023-10-09T11:42:00.215477+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210000+0000","last_change":"2023-10-09T11:41:59.633991+0000","last_active":"2023-10-09T11:42:00.210000+0000","last_peered":"2023-10-09T11:42:00.210000+0000","last_clean":"2023-10-09T11:42:00.210000+0000","last_became_active":"2023-10-09T11:41:59.633652+0000","last_became_peered":"2023-10-09T11:41:59.633652+0000","last_unstale":"2023-10-09T11:42:00.210000+0000","last_undegraded":"2023-10-09T11:42:00.210000+0000","last_fullsized":"2023-10-09T11:42:00.210000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":2,"reported_epoch":111,"state":"creating+activating","last_fresh":"2023-10-09T11:42:00.202424+0000","last_change":"2023-10-09T11:42:00.202544+0000","last_active":"2023-10-09T11:41:59.610134+0000","last_peered":"2023-10-09T11:41:59.610134+0000","last_clean":"2023-10-09T11:41:59.610134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:42:00.202424+0000","last_undegraded":"2023-10-09T11:42:00.202424+0000","last_fullsized":"2023-10-09T11:42:00.202424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.635843+0000","last_change":"2023-10-09T11:41:59.635108+0000","last_active":"2023-10-09T11:41:59.635843+0000","last_peered":"2023-10-09T11:41:59.635843+0000","last_clean":"2023-10-09T11:41:59.635843+0000","last_became_active":"2023-10-09T11:41:59.634840+0000","last_became_peered":"2023-10-09T11:41:59.634840+0000","last_unstale":"2023-10-09T11:41:59.635843+0000","last_undegraded":"2023-10-09T11:41:59.635843+0000","last_fullsized":"2023-10-09T11:41:59.635843+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:42.570558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220378+0000","last_change":"2023-10-09T11:42:00.220378+0000","last_active":"2023-10-09T11:42:00.220378+0000","last_peered":"2023-10-09T11:42:00.220378+0000","last_clean":"2023-10-09T11:42:00.220378+0000","last_became_active":"2023-10-09T11:42:00.219769+0000","last_became_peered":"2023-10-09T11:42:00.219769+0000","last_unstale":"2023-10-09T11:42:00.220378+0000","last_undegraded":"2023-10-09T11:42:00.220378+0000","last_fullsized":"2023-10-09T11:42:00.220378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:03.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.639802+0000","last_change":"2023-10-09T11:41:59.632436+0000","last_active":"2023-10-09T11:42:00.639802+0000","last_peered":"2023-10-09T11:42:00.639802+0000","last_clean":"2023-10-09T11:42:00.639802+0000","last_became_active":"2023-10-09T11:41:59.632129+0000","last_became_peered":"2023-10-09T11:41:59.632129+0000","last_unstale":"2023-10-09T11:42:00.639802+0000","last_undegraded":"2023-10-09T11:42:00.639802+0000","last_fullsized":"2023-10-09T11:42:00.639802+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-09T11:41:59.621016+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:41:59.621016+0000","last_peered":"2023-10-09T11:41:59.621016+0000","last_clean":"2023-10-09T11:41:59.621016+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:41:59.621016+0000","last_undegraded":"2023-10-09T11:41:59.621016+0000","last_fullsized":"2023-10-09T11:41:59.621016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1188432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.628},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.74399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.434},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.751},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":591301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.436},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.93000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":1181669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.246},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.222}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.26800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.317}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.47699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.28100000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.45500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302740,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069100,"statfs":{"total":96636764160,"available":96326758400,"internally_reserved":0,"allocated":1388544,"data_stored":598134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1384448,"data_stored":598064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:09.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:09.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.444+0000 7fd5b359e700 1 Processor -- start 2023-10-09T11:42:09.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.444+0000 7fd5b359e700 1 -- start start 2023-10-09T11:42:09.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b359e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 0x7fd5b415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b359e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b415afd0 con 0x7fd5b40cef40 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b359e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b415b2b0 con 0x7fd5b4153c30 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415b590 con 0x7fd5b415de50 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b1d9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b259c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 0x7fd5b415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b1d9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:55030/0 (socket says 172.21.15.26:55030) 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b1d9b700 1 -- 172.21.15.26:0/3699800842 learned_addr learned my addr 172.21.15.26:0/3699800842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.445+0000 7fd5b2d9d700 1 --1- 172.21.15.26:0/3699800842 >> v1:172.21.15.67:6789/0 conn(0x7fd5b40cef40 0x7fd5b406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:36108/0 (socket says 172.21.15.26:36108) 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b1d9b700 1 -- 172.21.15.26:0/3699800842 >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 msgr2=0x7fd5b415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b1d9b700 1 --2- 172.21.15.26:0/3699800842 >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 0x7fd5b415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b1d9b700 1 -- 172.21.15.26:0/3699800842 >> v1:172.21.15.67:6789/0 conn(0x7fd5b40cef40 legacy=0x7fd5b406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b1d9b700 1 -- 172.21.15.26:0/3699800842 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b415b870 con 0x7fd5b415de50 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b259c700 1 --2- 172.21.15.26:0/3699800842 >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 0x7fd5b415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b1d9b700 1 --2- 172.21.15.26:0/3699800842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0099b0 tx=0x7fd59c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96aa72ab45f54e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b159a700 1 -- 172.21.15.26:0/3699800842 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c009ea0 con 0x7fd5b415de50 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b159a700 1 -- 172.21.15.26:0/3699800842 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00b860 con 0x7fd5b415de50 2023-10-09T11:42:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.446+0000 7fd5b159a700 1 -- 172.21.15.26:0/3699800842 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00bc00 con 0x7fd5b415de50 2023-10-09T11:42:09.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 -- 172.21.15.26:0/3699800842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 msgr2=0x7fd5b40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 --2- 172.21.15.26:0/3699800842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0099b0 tx=0x7fd59c009250 comp rx=0 tx=0).stop 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 -- 172.21.15.26:0/3699800842 shutdown_connections 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 --2- 172.21.15.26:0/3699800842 >> v2:172.21.15.67:3300/0 conn(0x7fd5b4153c30 0x7fd5b415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 --2- 172.21.15.26:0/3699800842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b415de50 0x7fd5b40cea00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 -- 172.21.15.26:0/3699800842 >> 172.21.15.26:0/3699800842 conn(0x7fd5b40703a0 msgr2=0x7fd5b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 -- 172.21.15.26:0/3699800842 shutdown_connections 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.447+0000 7fd5b359e700 1 -- 172.21.15.26:0/3699800842 wait complete. 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.448+0000 7fd5b359e700 1 Processor -- start 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.448+0000 7fd5b359e700 1 -- start start 2023-10-09T11:42:09.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b40cef40 0x7fd5b4152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b4153c30 0x7fd5b40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b3da0 con 0x7fd5b415de50 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b3470 con 0x7fd5b40cef40 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b3750 con 0x7fd5b4153c30 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43018/0 (socket says 172.21.15.26:43018) 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 -- 172.21.15.26:0/1060307516 learned_addr learned my addr 172.21.15.26:0/1060307516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b259c700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b40cef40 0x7fd5b4152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b1d9b700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b4153c30 0x7fd5b40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 -- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b4153c30 msgr2=0x7fd5b40b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b4153c30 0x7fd5b40b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 -- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b40cef40 msgr2=0x7fd5b4152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b40cef40 0x7fd5b4152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 -- 172.21.15.26:0/1060307516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009a20 con 0x7fd5b415de50 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b2d9d700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c4e0 tx=0x7fd5ac007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00ce90 con 0x7fd5b415de50 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac005a70 con 0x7fd5b415de50 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c0094f0 con 0x7fd5b415de50 2023-10-09T11:42:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.449+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac005e10 con 0x7fd5b415de50 2023-10-09T11:42:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.450+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4152950 con 0x7fd5b415de50 2023-10-09T11:42:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.451+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b404c3c0 con 0x7fd5b415de50 2023-10-09T11:42:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.451+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd5ac0072e0 con 0x7fd5b415de50 2023-10-09T11:42:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.451+0000 7fd5aa7fc700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 0x7fd5940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.451+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5ac083f90 con 0x7fd5b415de50 2023-10-09T11:42:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.452+0000 7fd5b259c700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 0x7fd5940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.452+0000 7fd5b259c700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 0x7fd5940697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009fd0 tx=0x7fd5a400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.456+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5ac050c20 con 0x7fd5b415de50 2023-10-09T11:42:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.645+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5b40b35e0 con 0x7fd594067320 2023-10-09T11:42:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.654+0000 7fd5aa7fc700 1 -- 172.21.15.26:0/1060307516 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289756 (secure 0 0 0) 0x7fd5b40b35e0 con 0x7fd594067320 2023-10-09T11:42:09.662 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:09.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 msgr2=0x7fd5940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 0x7fd5940697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009fd0 tx=0x7fd5a400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 msgr2=0x7fd5b406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c4e0 tx=0x7fd5ac007f50 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 shutdown_connections 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5b415de50 0x7fd5b406d790 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b40cef40 0x7fd5b4152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd594067320 0x7fd5940697d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 --2- 172.21.15.26:0/1060307516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5b4153c30 0x7fd5b40b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 >> 172.21.15.26:0/1060307516 conn(0x7fd5b40703a0 msgr2=0x7fd5b40cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.657+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 shutdown_connections 2023-10-09T11:42:09.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.658+0000 7fd5b359e700 1 -- 172.21.15.26:0/1060307516 wait complete. 2023-10-09T11:42:09.667 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:09.671 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-10-09T11:42:09.204621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423208,"kb_used_data":12136,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551512,"statfs":{"total":773094113280,"available":770612748288,"internally_reserved":0,"allocated":12427264,"data_stored":6020164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.006088"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218330+0000","last_change":"2023-10-09T11:42:00.212745+0000","last_active":"2023-10-09T11:42:00.218330+0000","last_peered":"2023-10-09T11:42:00.218330+0000","last_clean":"2023-10-09T11:42:00.218330+0000","last_became_active":"2023-10-09T11:42:00.212470+0000","last_became_peered":"2023-10-09T11:42:00.212470+0000","last_unstale":"2023-10-09T11:42:00.218330+0000","last_undegraded":"2023-10-09T11:42:00.218330+0000","last_fullsized":"2023-10-09T11:42:00.218330+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:58.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217833+0000","last_change":"2023-10-09T11:42:00.216835+0000","last_active":"2023-10-09T11:42:00.217833+0000","last_peered":"2023-10-09T11:42:00.217833+0000","last_clean":"2023-10-09T11:42:00.217833+0000","last_became_active":"2023-10-09T11:42:00.216548+0000","last_became_peered":"2023-10-09T11:42:00.216548+0000","last_unstale":"2023-10-09T11:42:00.217833+0000","last_undegraded":"2023-10-09T11:42:00.217833+0000","last_fullsized":"2023-10-09T11:42:00.217833+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215318+0000","last_change":"2023-10-09T11:42:00.209345+0000","last_active":"2023-10-09T11:42:00.215318+0000","last_peered":"2023-10-09T11:42:00.215318+0000","last_clean":"2023-10-09T11:42:00.215318+0000","last_became_active":"2023-10-09T11:42:00.208655+0000","last_became_peered":"2023-10-09T11:42:00.208655+0000","last_unstale":"2023-10-09T11:42:00.215318+0000","last_undegraded":"2023-10-09T11:42:00.215318+0000","last_fullsized":"2023-10-09T11:42:00.215318+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219021+0000","last_change":"2023-10-09T11:42:00.216889+0000","last_active":"2023-10-09T11:42:00.219021+0000","last_peered":"2023-10-09T11:42:00.219021+0000","last_clean":"2023-10-09T11:42:00.219021+0000","last_became_active":"2023-10-09T11:42:00.216621+0000","last_became_peered":"2023-10-09T11:42:00.216621+0000","last_unstale":"2023-10-09T11:42:00.219021+0000","last_undegraded":"2023-10-09T11:42:00.219021+0000","last_fullsized":"2023-10-09T11:42:00.219021+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:04.811163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221557+0000","last_change":"2023-10-09T11:42:00.218958+0000","last_active":"2023-10-09T11:42:00.221557+0000","last_peered":"2023-10-09T11:42:00.221557+0000","last_clean":"2023-10-09T11:42:00.221557+0000","last_became_active":"2023-10-09T11:42:00.218285+0000","last_became_peered":"2023-10-09T11:42:00.218285+0000","last_unstale":"2023-10-09T11:42:00.221557+0000","last_undegraded":"2023-10-09T11:42:00.221557+0000","last_fullsized":"2023-10-09T11:42:00.221557+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216107+0000","last_change":"2023-10-09T11:42:00.209299+0000","last_active":"2023-10-09T11:42:00.216107+0000","last_peered":"2023-10-09T11:42:00.216107+0000","last_clean":"2023-10-09T11:42:00.216107+0000","last_became_active":"2023-10-09T11:42:00.208979+0000","last_became_peered":"2023-10-09T11:42:00.208979+0000","last_unstale":"2023-10-09T11:42:00.216107+0000","last_undegraded":"2023-10-09T11:42:00.216107+0000","last_fullsized":"2023-10-09T11:42:00.216107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217413+0000","last_change":"2023-10-09T11:42:00.211559+0000","last_active":"2023-10-09T11:42:00.217413+0000","last_peered":"2023-10-09T11:42:00.217413+0000","last_clean":"2023-10-09T11:42:00.217413+0000","last_became_active":"2023-10-09T11:42:00.211240+0000","last_became_peered":"2023-10-09T11:42:00.211240+0000","last_unstale":"2023-10-09T11:42:00.217413+0000","last_undegraded":"2023-10-09T11:42:00.217413+0000","last_fullsized":"2023-10-09T11:42:00.217413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219175+0000","last_change":"2023-10-09T11:42:00.213660+0000","last_active":"2023-10-09T11:42:00.219175+0000","last_peered":"2023-10-09T11:42:00.219175+0000","last_clean":"2023-10-09T11:42:00.219175+0000","last_became_active":"2023-10-09T11:42:00.213283+0000","last_became_peered":"2023-10-09T11:42:00.213283+0000","last_unstale":"2023-10-09T11:42:00.219175+0000","last_undegraded":"2023-10-09T11:42:00.219175+0000","last_fullsized":"2023-10-09T11:42:00.219175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219082+0000","last_change":"2023-10-09T11:42:00.212819+0000","last_active":"2023-10-09T11:42:00.219082+0000","last_peered":"2023-10-09T11:42:00.219082+0000","last_clean":"2023-10-09T11:42:00.219082+0000","last_became_active":"2023-10-09T11:42:00.212528+0000","last_became_peered":"2023-10-09T11:42:00.212528+0000","last_unstale":"2023-10-09T11:42:00.219082+0000","last_undegraded":"2023-10-09T11:42:00.219082+0000","last_fullsized":"2023-10-09T11:42:00.219082+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:57.102644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215409+0000","last_change":"2023-10-09T11:42:00.211466+0000","last_active":"2023-10-09T11:42:00.215409+0000","last_peered":"2023-10-09T11:42:00.215409+0000","last_clean":"2023-10-09T11:42:00.215409+0000","last_became_active":"2023-10-09T11:42:00.211202+0000","last_became_peered":"2023-10-09T11:42:00.211202+0000","last_unstale":"2023-10-09T11:42:00.215409+0000","last_undegraded":"2023-10-09T11:42:00.215409+0000","last_fullsized":"2023-10-09T11:42:00.215409+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.208951+0000","last_change":"2023-10-09T11:42:00.206681+0000","last_active":"2023-10-09T11:42:00.208951+0000","last_peered":"2023-10-09T11:42:00.208951+0000","last_clean":"2023-10-09T11:42:00.208951+0000","last_became_active":"2023-10-09T11:42:00.206412+0000","last_became_peered":"2023-10-09T11:42:00.206412+0000","last_unstale":"2023-10-09T11:42:00.208951+0000","last_undegraded":"2023-10-09T11:42:00.208951+0000","last_fullsized":"2023-10-09T11:42:00.208951+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:45.866151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210610+0000","last_change":"2023-10-09T11:42:00.206277+0000","last_active":"2023-10-09T11:42:00.210610+0000","last_peered":"2023-10-09T11:42:00.210610+0000","last_clean":"2023-10-09T11:42:00.210610+0000","last_became_active":"2023-10-09T11:42:00.205921+0000","last_became_peered":"2023-10-09T11:42:00.205921+0000","last_unstale":"2023-10-09T11:42:00.210610+0000","last_undegraded":"2023-10-09T11:42:00.210610+0000","last_fullsized":"2023-10-09T11:42:00.210610+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:38.759381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219171+0000","last_change":"2023-10-09T11:42:00.218436+0000","last_active":"2023-10-09T11:42:00.219171+0000","last_peered":"2023-10-09T11:42:00.219171+0000","last_clean":"2023-10-09T11:42:00.219171+0000","last_became_active":"2023-10-09T11:42:00.217667+0000","last_became_peered":"2023-10-09T11:42:00.217667+0000","last_unstale":"2023-10-09T11:42:00.219171+0000","last_undegraded":"2023-10-09T11:42:00.219171+0000","last_fullsized":"2023-10-09T11:42:00.219171+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:23.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216068+0000","last_change":"2023-10-09T11:42:00.213909+0000","last_active":"2023-10-09T11:42:00.216068+0000","last_peered":"2023-10-09T11:42:00.216068+0000","last_clean":"2023-10-09T11:42:00.216068+0000","last_became_active":"2023-10-09T11:42:00.213651+0000","last_became_peered":"2023-10-09T11:42:00.213651+0000","last_unstale":"2023-10-09T11:42:00.216068+0000","last_undegraded":"2023-10-09T11:42:00.216068+0000","last_fullsized":"2023-10-09T11:42:00.216068+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:26.651215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218932+0000","last_change":"2023-10-09T11:42:00.215628+0000","last_active":"2023-10-09T11:42:00.218932+0000","last_peered":"2023-10-09T11:42:00.218932+0000","last_clean":"2023-10-09T11:42:00.218932+0000","last_became_active":"2023-10-09T11:42:00.213849+0000","last_became_peered":"2023-10-09T11:42:00.213849+0000","last_unstale":"2023-10-09T11:42:00.218932+0000","last_undegraded":"2023-10-09T11:42:00.218932+0000","last_fullsized":"2023-10-09T11:42:00.218932+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:25.244712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215385+0000","last_change":"2023-10-09T11:42:00.211981+0000","last_active":"2023-10-09T11:42:00.215385+0000","last_peered":"2023-10-09T11:42:00.215385+0000","last_clean":"2023-10-09T11:42:00.215385+0000","last_became_active":"2023-10-09T11:42:00.211732+0000","last_became_peered":"2023-10-09T11:42:00.211732+0000","last_unstale":"2023-10-09T11:42:00.215385+0000","last_undegraded":"2023-10-09T11:42:00.215385+0000","last_fullsized":"2023-10-09T11:42:00.215385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217334+0000","last_change":"2023-10-09T11:42:00.209841+0000","last_active":"2023-10-09T11:42:00.217334+0000","last_peered":"2023-10-09T11:42:00.217334+0000","last_clean":"2023-10-09T11:42:00.217334+0000","last_became_active":"2023-10-09T11:42:00.209230+0000","last_became_peered":"2023-10-09T11:42:00.209230+0000","last_unstale":"2023-10-09T11:42:00.217334+0000","last_undegraded":"2023-10-09T11:42:00.217334+0000","last_fullsized":"2023-10-09T11:42:00.217334+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.491577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218057+0000","last_change":"2023-10-09T11:42:00.217136+0000","last_active":"2023-10-09T11:42:00.218057+0000","last_peered":"2023-10-09T11:42:00.218057+0000","last_clean":"2023-10-09T11:42:00.218057+0000","last_became_active":"2023-10-09T11:42:00.216861+0000","last_became_peered":"2023-10-09T11:42:00.216861+0000","last_unstale":"2023-10-09T11:42:00.218057+0000","last_undegraded":"2023-10-09T11:42:00.218057+0000","last_fullsized":"2023-10-09T11:42:00.218057+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212983+0000","last_change":"2023-10-09T11:42:00.209822+0000","last_active":"2023-10-09T11:42:00.212983+0000","last_peered":"2023-10-09T11:42:00.212983+0000","last_clean":"2023-10-09T11:42:00.212983+0000","last_became_active":"2023-10-09T11:42:00.209012+0000","last_became_peered":"2023-10-09T11:42:00.209012+0000","last_unstale":"2023-10-09T11:42:00.212983+0000","last_undegraded":"2023-10-09T11:42:00.212983+0000","last_fullsized":"2023-10-09T11:42:00.212983+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:10.422705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215199+0000","last_change":"2023-10-09T11:42:00.212063+0000","last_active":"2023-10-09T11:42:00.215199+0000","last_peered":"2023-10-09T11:42:00.215199+0000","last_clean":"2023-10-09T11:42:00.215199+0000","last_became_active":"2023-10-09T11:42:00.211759+0000","last_became_peered":"2023-10-09T11:42:00.211759+0000","last_unstale":"2023-10-09T11:42:00.215199+0000","last_undegraded":"2023-10-09T11:42:00.215199+0000","last_fullsized":"2023-10-09T11:42:00.215199+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220905+0000","last_change":"2023-10-09T11:42:00.218780+0000","last_active":"2023-10-09T11:42:00.220905+0000","last_peered":"2023-10-09T11:42:00.220905+0000","last_clean":"2023-10-09T11:42:00.220905+0000","last_became_active":"2023-10-09T11:42:00.218449+0000","last_became_peered":"2023-10-09T11:42:00.218449+0000","last_unstale":"2023-10-09T11:42:00.220905+0000","last_undegraded":"2023-10-09T11:42:00.220905+0000","last_fullsized":"2023-10-09T11:42:00.220905+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:00.746041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212402+0000","last_change":"2023-10-09T11:42:00.208975+0000","last_active":"2023-10-09T11:42:00.212402+0000","last_peered":"2023-10-09T11:42:00.212402+0000","last_clean":"2023-10-09T11:42:00.212402+0000","last_became_active":"2023-10-09T11:42:00.208226+0000","last_became_peered":"2023-10-09T11:42:00.208226+0000","last_unstale":"2023-10-09T11:42:00.212402+0000","last_undegraded":"2023-10-09T11:42:00.212402+0000","last_fullsized":"2023-10-09T11:42:00.212402+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:03.371607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218674+0000","last_change":"2023-10-09T11:42:00.210628+0000","last_active":"2023-10-09T11:42:00.218674+0000","last_peered":"2023-10-09T11:42:00.218674+0000","last_clean":"2023-10-09T11:42:00.218674+0000","last_became_active":"2023-10-09T11:42:00.210317+0000","last_became_peered":"2023-10-09T11:42:00.210317+0000","last_unstale":"2023-10-09T11:42:00.218674+0000","last_undegraded":"2023-10-09T11:42:00.218674+0000","last_fullsized":"2023-10-09T11:42:00.218674+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210045+0000","last_change":"2023-10-09T11:42:00.207155+0000","last_active":"2023-10-09T11:42:00.210045+0000","last_peered":"2023-10-09T11:42:00.210045+0000","last_clean":"2023-10-09T11:42:00.210045+0000","last_became_active":"2023-10-09T11:42:00.206917+0000","last_became_peered":"2023-10-09T11:42:00.206917+0000","last_unstale":"2023-10-09T11:42:00.210045+0000","last_undegraded":"2023-10-09T11:42:00.210045+0000","last_fullsized":"2023-10-09T11:42:00.210045+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:33.072654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220498+0000","last_change":"2023-10-09T11:42:00.220087+0000","last_active":"2023-10-09T11:42:00.220498+0000","last_peered":"2023-10-09T11:42:00.220498+0000","last_clean":"2023-10-09T11:42:00.220498+0000","last_became_active":"2023-10-09T11:42:00.219776+0000","last_became_peered":"2023-10-09T11:42:00.219776+0000","last_unstale":"2023-10-09T11:42:00.220498+0000","last_undegraded":"2023-10-09T11:42:00.220498+0000","last_fullsized":"2023-10-09T11:42:00.220498+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218514+0000","last_change":"2023-10-09T11:42:00.218228+0000","last_active":"2023-10-09T11:42:00.218514+0000","last_peered":"2023-10-09T11:42:00.218514+0000","last_clean":"2023-10-09T11:42:00.218514+0000","last_became_active":"2023-10-09T11:42:00.217369+0000","last_became_peered":"2023-10-09T11:42:00.217369+0000","last_unstale":"2023-10-09T11:42:00.218514+0000","last_undegraded":"2023-10-09T11:42:00.218514+0000","last_fullsized":"2023-10-09T11:42:00.218514+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:50.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209811+0000","last_change":"2023-10-09T11:42:00.207233+0000","last_active":"2023-10-09T11:42:00.209811+0000","last_peered":"2023-10-09T11:42:00.209811+0000","last_clean":"2023-10-09T11:42:00.209811+0000","last_became_active":"2023-10-09T11:42:00.206981+0000","last_became_peered":"2023-10-09T11:42:00.206981+0000","last_unstale":"2023-10-09T11:42:00.209811+0000","last_undegraded":"2023-10-09T11:42:00.209811+0000","last_fullsized":"2023-10-09T11:42:00.209811+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:11.020302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218294+0000","last_change":"2023-10-09T11:42:00.214781+0000","last_active":"2023-10-09T11:42:00.218294+0000","last_peered":"2023-10-09T11:42:00.218294+0000","last_clean":"2023-10-09T11:42:00.218294+0000","last_became_active":"2023-10-09T11:42:00.214525+0000","last_became_peered":"2023-10-09T11:42:00.214525+0000","last_unstale":"2023-10-09T11:42:00.218294+0000","last_undegraded":"2023-10-09T11:42:00.218294+0000","last_fullsized":"2023-10-09T11:42:00.218294+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:07.099338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218561+0000","last_change":"2023-10-09T11:42:00.215498+0000","last_active":"2023-10-09T11:42:00.218561+0000","last_peered":"2023-10-09T11:42:00.218561+0000","last_clean":"2023-10-09T11:42:00.218561+0000","last_became_active":"2023-10-09T11:42:00.213777+0000","last_became_peered":"2023-10-09T11:42:00.213777+0000","last_unstale":"2023-10-09T11:42:00.218561+0000","last_undegraded":"2023-10-09T11:42:00.218561+0000","last_fullsized":"2023-10-09T11:42:00.218561+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:35.887788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218218+0000","last_change":"2023-10-09T11:42:00.214975+0000","last_active":"2023-10-09T11:42:00.218218+0000","last_peered":"2023-10-09T11:42:00.218218+0000","last_clean":"2023-10-09T11:42:00.218218+0000","last_became_active":"2023-10-09T11:42:00.214501+0000","last_became_peered":"2023-10-09T11:42:00.214501+0000","last_unstale":"2023-10-09T11:42:00.218218+0000","last_undegraded":"2023-10-09T11:42:00.218218+0000","last_fullsized":"2023-10-09T11:42:00.218218+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:13.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219604+0000","last_change":"2023-10-09T11:42:00.216982+0000","last_active":"2023-10-09T11:42:00.219604+0000","last_peered":"2023-10-09T11:42:00.219604+0000","last_clean":"2023-10-09T11:42:00.219604+0000","last_became_active":"2023-10-09T11:42:00.216574+0000","last_became_peered":"2023-10-09T11:42:00.216574+0000","last_unstale":"2023-10-09T11:42:00.219604+0000","last_undegraded":"2023-10-09T11:42:00.219604+0000","last_fullsized":"2023-10-09T11:42:00.219604+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218148+0000","last_change":"2023-10-09T11:42:00.211866+0000","last_active":"2023-10-09T11:42:00.218148+0000","last_peered":"2023-10-09T11:42:00.218148+0000","last_clean":"2023-10-09T11:42:00.218148+0000","last_became_active":"2023-10-09T11:42:00.211567+0000","last_became_peered":"2023-10-09T11:42:00.211567+0000","last_unstale":"2023-10-09T11:42:00.218148+0000","last_undegraded":"2023-10-09T11:42:00.218148+0000","last_fullsized":"2023-10-09T11:42:00.218148+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214243+0000","last_change":"2023-10-09T11:42:00.211574+0000","last_active":"2023-10-09T11:42:00.214243+0000","last_peered":"2023-10-09T11:42:00.214243+0000","last_clean":"2023-10-09T11:42:00.214243+0000","last_became_active":"2023-10-09T11:42:00.211327+0000","last_became_peered":"2023-10-09T11:42:00.211327+0000","last_unstale":"2023-10-09T11:42:00.214243+0000","last_undegraded":"2023-10-09T11:42:00.214243+0000","last_fullsized":"2023-10-09T11:42:00.214243+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640188+0000","last_change":"2023-10-09T11:41:59.632481+0000","last_active":"2023-10-09T11:42:00.640188+0000","last_peered":"2023-10-09T11:42:00.640188+0000","last_clean":"2023-10-09T11:42:00.640188+0000","last_became_active":"2023-10-09T11:41:59.632060+0000","last_became_peered":"2023-10-09T11:41:59.632060+0000","last_unstale":"2023-10-09T11:42:00.640188+0000","last_undegraded":"2023-10-09T11:42:00.640188+0000","last_fullsized":"2023-10-09T11:42:00.640188+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215290+0000","last_change":"2023-10-09T11:42:00.209066+0000","last_active":"2023-10-09T11:42:00.215290+0000","last_peered":"2023-10-09T11:42:00.215290+0000","last_clean":"2023-10-09T11:42:00.215290+0000","last_became_active":"2023-10-09T11:42:00.208807+0000","last_became_peered":"2023-10-09T11:42:00.208807+0000","last_unstale":"2023-10-09T11:42:00.215290+0000","last_undegraded":"2023-10-09T11:42:00.215290+0000","last_fullsized":"2023-10-09T11:42:00.215290+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:41.889247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638000+0000","last_change":"2023-10-09T11:41:59.624685+0000","last_active":"2023-10-09T11:42:00.638000+0000","last_peered":"2023-10-09T11:42:00.638000+0000","last_clean":"2023-10-09T11:42:00.638000+0000","last_became_active":"2023-10-09T11:41:59.624425+0000","last_became_peered":"2023-10-09T11:41:59.624425+0000","last_unstale":"2023-10-09T11:42:00.638000+0000","last_undegraded":"2023-10-09T11:42:00.638000+0000","last_fullsized":"2023-10-09T11:42:00.638000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.223383+0000","last_change":"2023-10-09T11:42:00.221528+0000","last_active":"2023-10-09T11:42:00.223383+0000","last_peered":"2023-10-09T11:42:00.223383+0000","last_clean":"2023-10-09T11:42:00.223383+0000","last_became_active":"2023-10-09T11:42:00.221296+0000","last_became_peered":"2023-10-09T11:42:00.221296+0000","last_unstale":"2023-10-09T11:42:00.223383+0000","last_undegraded":"2023-10-09T11:42:00.223383+0000","last_fullsized":"2023-10-09T11:42:00.223383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:34.241711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.635356+0000","last_change":"2023-10-09T11:41:59.625246+0000","last_active":"2023-10-09T11:42:00.635356+0000","last_peered":"2023-10-09T11:42:00.635356+0000","last_clean":"2023-10-09T11:42:00.635356+0000","last_became_active":"2023-10-09T11:41:59.624956+0000","last_became_peered":"2023-10-09T11:41:59.624956+0000","last_unstale":"2023-10-09T11:42:00.635356+0000","last_undegraded":"2023-10-09T11:42:00.635356+0000","last_fullsized":"2023-10-09T11:42:00.635356+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220694+0000","last_change":"2023-10-09T11:42:00.217661+0000","last_active":"2023-10-09T11:42:00.220694+0000","last_peered":"2023-10-09T11:42:00.220694+0000","last_clean":"2023-10-09T11:42:00.220694+0000","last_became_active":"2023-10-09T11:42:00.217406+0000","last_became_peered":"2023-10-09T11:42:00.217406+0000","last_unstale":"2023-10-09T11:42:00.220694+0000","last_undegraded":"2023-10-09T11:42:00.220694+0000","last_fullsized":"2023-10-09T11:42:00.220694+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:04.813718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.635338+0000","last_change":"2023-10-09T11:41:59.627331+0000","last_active":"2023-10-09T11:42:00.635338+0000","last_peered":"2023-10-09T11:42:00.635338+0000","last_clean":"2023-10-09T11:42:00.635338+0000","last_became_active":"2023-10-09T11:41:59.627063+0000","last_became_peered":"2023-10-09T11:41:59.627063+0000","last_unstale":"2023-10-09T11:42:00.635338+0000","last_undegraded":"2023-10-09T11:42:00.635338+0000","last_fullsized":"2023-10-09T11:42:00.635338+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:03.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217990+0000","last_change":"2023-10-09T11:42:00.216729+0000","last_active":"2023-10-09T11:42:00.217990+0000","last_peered":"2023-10-09T11:42:00.217990+0000","last_clean":"2023-10-09T11:42:00.217990+0000","last_became_active":"2023-10-09T11:42:00.216427+0000","last_became_peered":"2023-10-09T11:42:00.216427+0000","last_unstale":"2023-10-09T11:42:00.217990+0000","last_undegraded":"2023-10-09T11:42:00.217990+0000","last_fullsized":"2023-10-09T11:42:00.217990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:03.259408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638404+0000","last_change":"2023-10-09T11:41:59.627978+0000","last_active":"2023-10-09T11:42:00.638404+0000","last_peered":"2023-10-09T11:42:00.638404+0000","last_clean":"2023-10-09T11:42:00.638404+0000","last_became_active":"2023-10-09T11:41:59.627728+0000","last_became_peered":"2023-10-09T11:41:59.627728+0000","last_unstale":"2023-10-09T11:42:00.638404+0000","last_undegraded":"2023-10-09T11:42:00.638404+0000","last_fullsized":"2023-10-09T11:42:00.638404+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217382+0000","last_change":"2023-10-09T11:42:00.209626+0000","last_active":"2023-10-09T11:42:00.217382+0000","last_peered":"2023-10-09T11:42:00.217382+0000","last_clean":"2023-10-09T11:42:00.217382+0000","last_became_active":"2023-10-09T11:42:00.209213+0000","last_became_peered":"2023-10-09T11:42:00.209213+0000","last_unstale":"2023-10-09T11:42:00.217382+0000","last_undegraded":"2023-10-09T11:42:00.217382+0000","last_fullsized":"2023-10-09T11:42:00.217382+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.634870+0000","last_change":"2023-10-09T11:41:59.629750+0000","last_active":"2023-10-09T11:42:00.634870+0000","last_peered":"2023-10-09T11:42:00.634870+0000","last_clean":"2023-10-09T11:42:00.634870+0000","last_became_active":"2023-10-09T11:41:59.629570+0000","last_became_peered":"2023-10-09T11:41:59.629570+0000","last_unstale":"2023-10-09T11:42:00.634870+0000","last_undegraded":"2023-10-09T11:42:00.634870+0000","last_fullsized":"2023-10-09T11:42:00.634870+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219151+0000","last_change":"2023-10-09T11:42:00.213355+0000","last_active":"2023-10-09T11:42:00.219151+0000","last_peered":"2023-10-09T11:42:00.219151+0000","last_clean":"2023-10-09T11:42:00.219151+0000","last_became_active":"2023-10-09T11:42:00.212927+0000","last_became_peered":"2023-10-09T11:42:00.212927+0000","last_unstale":"2023-10-09T11:42:00.219151+0000","last_undegraded":"2023-10-09T11:42:00.219151+0000","last_fullsized":"2023-10-09T11:42:00.219151+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.202774+0000","last_change":"2023-10-09T11:41:59.637978+0000","last_active":"2023-10-09T11:42:00.202774+0000","last_peered":"2023-10-09T11:42:00.202774+0000","last_clean":"2023-10-09T11:42:00.202774+0000","last_became_active":"2023-10-09T11:41:59.637664+0000","last_became_peered":"2023-10-09T11:41:59.637664+0000","last_unstale":"2023-10-09T11:42:00.202774+0000","last_undegraded":"2023-10-09T11:42:00.202774+0000","last_fullsized":"2023-10-09T11:42:00.202774+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:08.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215435+0000","last_change":"2023-10-09T11:42:00.210678+0000","last_active":"2023-10-09T11:42:00.215435+0000","last_peered":"2023-10-09T11:42:00.215435+0000","last_clean":"2023-10-09T11:42:00.215435+0000","last_became_active":"2023-10-09T11:42:00.210396+0000","last_became_peered":"2023-10-09T11:42:00.210396+0000","last_unstale":"2023-10-09T11:42:00.215435+0000","last_undegraded":"2023-10-09T11:42:00.215435+0000","last_fullsized":"2023-10-09T11:42:00.215435+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204997+0000","last_change":"2023-10-09T11:41:59.632493+0000","last_active":"2023-10-09T11:42:00.204997+0000","last_peered":"2023-10-09T11:42:00.204997+0000","last_clean":"2023-10-09T11:42:00.204997+0000","last_became_active":"2023-10-09T11:41:59.632168+0000","last_became_peered":"2023-10-09T11:41:59.632168+0000","last_unstale":"2023-10-09T11:42:00.204997+0000","last_undegraded":"2023-10-09T11:42:00.204997+0000","last_fullsized":"2023-10-09T11:42:00.204997+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:38.935473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216157+0000","last_change":"2023-10-09T11:42:00.211624+0000","last_active":"2023-10-09T11:42:00.216157+0000","last_peered":"2023-10-09T11:42:00.216157+0000","last_clean":"2023-10-09T11:42:00.216157+0000","last_became_active":"2023-10-09T11:42:00.211380+0000","last_became_peered":"2023-10-09T11:42:00.211380+0000","last_unstale":"2023-10-09T11:42:00.216157+0000","last_undegraded":"2023-10-09T11:42:00.216157+0000","last_fullsized":"2023-10-09T11:42:00.216157+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:31.033042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.205279+0000","last_change":"2023-10-09T11:41:59.632085+0000","last_active":"2023-10-09T11:42:00.205279+0000","last_peered":"2023-10-09T11:42:00.205279+0000","last_clean":"2023-10-09T11:42:00.205279+0000","last_became_active":"2023-10-09T11:41:59.631758+0000","last_became_peered":"2023-10-09T11:41:59.631758+0000","last_unstale":"2023-10-09T11:42:00.205279+0000","last_undegraded":"2023-10-09T11:42:00.205279+0000","last_fullsized":"2023-10-09T11:42:00.205279+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:57.551222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216796+0000","last_change":"2023-10-09T11:42:00.212835+0000","last_active":"2023-10-09T11:42:00.216796+0000","last_peered":"2023-10-09T11:42:00.216796+0000","last_clean":"2023-10-09T11:42:00.216796+0000","last_became_active":"2023-10-09T11:42:00.212518+0000","last_became_peered":"2023-10-09T11:42:00.212518+0000","last_unstale":"2023-10-09T11:42:00.216796+0000","last_undegraded":"2023-10-09T11:42:00.216796+0000","last_fullsized":"2023-10-09T11:42:00.216796+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:44.266623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210728+0000","last_change":"2023-10-09T11:41:59.632977+0000","last_active":"2023-10-09T11:42:00.210728+0000","last_peered":"2023-10-09T11:42:00.210728+0000","last_clean":"2023-10-09T11:42:00.210728+0000","last_became_active":"2023-10-09T11:41:59.632684+0000","last_became_peered":"2023-10-09T11:41:59.632684+0000","last_unstale":"2023-10-09T11:42:00.210728+0000","last_undegraded":"2023-10-09T11:42:00.210728+0000","last_fullsized":"2023-10-09T11:42:00.210728+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:29.280862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221627+0000","last_change":"2023-10-09T11:42:00.219167+0000","last_active":"2023-10-09T11:42:00.221627+0000","last_peered":"2023-10-09T11:42:00.221627+0000","last_clean":"2023-10-09T11:42:00.221627+0000","last_became_active":"2023-10-09T11:42:00.218471+0000","last_became_peered":"2023-10-09T11:42:00.218471+0000","last_unstale":"2023-10-09T11:42:00.221627+0000","last_undegraded":"2023-10-09T11:42:00.221627+0000","last_fullsized":"2023-10-09T11:42:00.221627+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:03.627797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"111'3","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638142+0000","last_change":"2023-10-09T11:41:59.630953+0000","last_active":"2023-10-09T11:42:00.638142+0000","last_peered":"2023-10-09T11:42:00.638142+0000","last_clean":"2023-10-09T11:42:00.638142+0000","last_became_active":"2023-10-09T11:41:59.630684+0000","last_became_peered":"2023-10-09T11:41:59.630684+0000","last_unstale":"2023-10-09T11:42:00.638142+0000","last_undegraded":"2023-10-09T11:42:00.638142+0000","last_fullsized":"2023-10-09T11:42:00.638142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.222098+0000","last_change":"2023-10-09T11:42:00.220411+0000","last_active":"2023-10-09T11:42:00.222098+0000","last_peered":"2023-10-09T11:42:00.222098+0000","last_clean":"2023-10-09T11:42:00.222098+0000","last_became_active":"2023-10-09T11:42:00.220156+0000","last_became_peered":"2023-10-09T11:42:00.220156+0000","last_unstale":"2023-10-09T11:42:00.222098+0000","last_undegraded":"2023-10-09T11:42:00.222098+0000","last_fullsized":"2023-10-09T11:42:00.222098+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:08.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"111'6","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.641834+0000","last_change":"2023-10-09T11:41:59.633075+0000","last_active":"2023-10-09T11:42:00.641834+0000","last_peered":"2023-10-09T11:42:00.641834+0000","last_clean":"2023-10-09T11:42:00.641834+0000","last_became_active":"2023-10-09T11:41:59.632787+0000","last_became_peered":"2023-10-09T11:41:59.632787+0000","last_unstale":"2023-10-09T11:42:00.641834+0000","last_undegraded":"2023-10-09T11:42:00.641834+0000","last_fullsized":"2023-10-09T11:42:00.641834+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:12.460978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216356+0000","last_change":"2023-10-09T11:42:00.211363+0000","last_active":"2023-10-09T11:42:00.216356+0000","last_peered":"2023-10-09T11:42:00.216356+0000","last_clean":"2023-10-09T11:42:00.216356+0000","last_became_active":"2023-10-09T11:42:00.211096+0000","last_became_peered":"2023-10-09T11:42:00.211096+0000","last_unstale":"2023-10-09T11:42:00.216356+0000","last_undegraded":"2023-10-09T11:42:00.216356+0000","last_fullsized":"2023-10-09T11:42:00.216356+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:49.955853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204696+0000","last_change":"2023-10-09T11:41:59.635800+0000","last_active":"2023-10-09T11:42:00.204696+0000","last_peered":"2023-10-09T11:42:00.204696+0000","last_clean":"2023-10-09T11:42:00.204696+0000","last_became_active":"2023-10-09T11:41:59.635487+0000","last_became_peered":"2023-10-09T11:41:59.635487+0000","last_unstale":"2023-10-09T11:42:00.204696+0000","last_undegraded":"2023-10-09T11:42:00.204696+0000","last_fullsized":"2023-10-09T11:42:00.204696+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:26.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216113+0000","last_change":"2023-10-09T11:42:00.213371+0000","last_active":"2023-10-09T11:42:00.216113+0000","last_peered":"2023-10-09T11:42:00.216113+0000","last_clean":"2023-10-09T11:42:00.216113+0000","last_became_active":"2023-10-09T11:42:00.213089+0000","last_became_peered":"2023-10-09T11:42:00.213089+0000","last_unstale":"2023-10-09T11:42:00.216113+0000","last_undegraded":"2023-10-09T11:42:00.216113+0000","last_fullsized":"2023-10-09T11:42:00.216113+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:56.728398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204282+0000","last_change":"2023-10-09T11:41:59.626882+0000","last_active":"2023-10-09T11:42:00.204282+0000","last_peered":"2023-10-09T11:42:00.204282+0000","last_clean":"2023-10-09T11:42:00.204282+0000","last_became_active":"2023-10-09T11:41:59.626653+0000","last_became_peered":"2023-10-09T11:41:59.626653+0000","last_unstale":"2023-10-09T11:42:00.204282+0000","last_undegraded":"2023-10-09T11:42:00.204282+0000","last_fullsized":"2023-10-09T11:42:00.204282+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:30.028669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215347+0000","last_change":"2023-10-09T11:42:00.208367+0000","last_active":"2023-10-09T11:42:00.215347+0000","last_peered":"2023-10-09T11:42:00.215347+0000","last_clean":"2023-10-09T11:42:00.215347+0000","last_became_active":"2023-10-09T11:42:00.207838+0000","last_became_peered":"2023-10-09T11:42:00.207838+0000","last_unstale":"2023-10-09T11:42:00.215347+0000","last_undegraded":"2023-10-09T11:42:00.215347+0000","last_fullsized":"2023-10-09T11:42:00.215347+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:04.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"111'8","reported_seq":18,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638697+0000","last_change":"2023-10-09T11:41:59.629160+0000","last_active":"2023-10-09T11:42:00.638697+0000","last_peered":"2023-10-09T11:42:00.638697+0000","last_clean":"2023-10-09T11:42:00.638697+0000","last_became_active":"2023-10-09T11:41:59.628930+0000","last_became_peered":"2023-10-09T11:41:59.628930+0000","last_unstale":"2023-10-09T11:42:00.638697+0000","last_undegraded":"2023-10-09T11:42:00.638697+0000","last_fullsized":"2023-10-09T11:42:00.638697+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:12.328048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219289+0000","last_change":"2023-10-09T11:42:00.214813+0000","last_active":"2023-10-09T11:42:00.219289+0000","last_peered":"2023-10-09T11:42:00.219289+0000","last_clean":"2023-10-09T11:42:00.219289+0000","last_became_active":"2023-10-09T11:42:00.214504+0000","last_became_peered":"2023-10-09T11:42:00.214504+0000","last_unstale":"2023-10-09T11:42:00.219289+0000","last_undegraded":"2023-10-09T11:42:00.219289+0000","last_fullsized":"2023-10-09T11:42:00.219289+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.637590+0000","last_change":"2023-10-09T11:41:59.628234+0000","last_active":"2023-10-09T11:42:00.637590+0000","last_peered":"2023-10-09T11:42:00.637590+0000","last_clean":"2023-10-09T11:42:00.637590+0000","last_became_active":"2023-10-09T11:41:59.627982+0000","last_became_peered":"2023-10-09T11:41:59.627982+0000","last_unstale":"2023-10-09T11:42:00.637590+0000","last_undegraded":"2023-10-09T11:42:00.637590+0000","last_fullsized":"2023-10-09T11:42:00.637590+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:40.852767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218195+0000","last_change":"2023-10-09T11:42:00.213778+0000","last_active":"2023-10-09T11:42:00.218195+0000","last_peered":"2023-10-09T11:42:00.218195+0000","last_clean":"2023-10-09T11:42:00.218195+0000","last_became_active":"2023-10-09T11:42:00.213110+0000","last_became_peered":"2023-10-09T11:42:00.213110+0000","last_unstale":"2023-10-09T11:42:00.218195+0000","last_undegraded":"2023-10-09T11:42:00.218195+0000","last_fullsized":"2023-10-09T11:42:00.218195+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:22.834787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638119+0000","last_change":"2023-10-09T11:41:59.624967+0000","last_active":"2023-10-09T11:42:00.638119+0000","last_peered":"2023-10-09T11:42:00.638119+0000","last_clean":"2023-10-09T11:42:00.638119+0000","last_became_active":"2023-10-09T11:41:59.624703+0000","last_became_peered":"2023-10-09T11:41:59.624703+0000","last_unstale":"2023-10-09T11:42:00.638119+0000","last_undegraded":"2023-10-09T11:42:00.638119+0000","last_fullsized":"2023-10-09T11:42:00.638119+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.895476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.211625+0000","last_change":"2023-10-09T11:42:00.209652+0000","last_active":"2023-10-09T11:42:00.211625+0000","last_peered":"2023-10-09T11:42:00.211625+0000","last_clean":"2023-10-09T11:42:00.211625+0000","last_became_active":"2023-10-09T11:42:00.209400+0000","last_became_peered":"2023-10-09T11:42:00.209400+0000","last_unstale":"2023-10-09T11:42:00.211625+0000","last_undegraded":"2023-10-09T11:42:00.211625+0000","last_fullsized":"2023-10-09T11:42:00.211625+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:29.470981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.636944+0000","last_change":"2023-10-09T11:41:59.635012+0000","last_active":"2023-10-09T11:42:00.636944+0000","last_peered":"2023-10-09T11:42:00.636944+0000","last_clean":"2023-10-09T11:42:00.636944+0000","last_became_active":"2023-10-09T11:41:59.634630+0000","last_became_peered":"2023-10-09T11:41:59.634630+0000","last_unstale":"2023-10-09T11:42:00.636944+0000","last_undegraded":"2023-10-09T11:42:00.636944+0000","last_fullsized":"2023-10-09T11:42:00.636944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:21.830413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.216093+0000","last_change":"2023-10-09T11:42:00.213234+0000","last_active":"2023-10-09T11:42:00.216093+0000","last_peered":"2023-10-09T11:42:00.216093+0000","last_clean":"2023-10-09T11:42:00.216093+0000","last_became_active":"2023-10-09T11:42:00.212965+0000","last_became_peered":"2023-10-09T11:42:00.212965+0000","last_unstale":"2023-10-09T11:42:00.216093+0000","last_undegraded":"2023-10-09T11:42:00.216093+0000","last_fullsized":"2023-10-09T11:42:00.216093+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.429668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204607+0000","last_change":"2023-10-09T11:41:59.627009+0000","last_active":"2023-10-09T11:42:00.204607+0000","last_peered":"2023-10-09T11:42:00.204607+0000","last_clean":"2023-10-09T11:42:00.204607+0000","last_became_active":"2023-10-09T11:41:59.626708+0000","last_became_peered":"2023-10-09T11:41:59.626708+0000","last_unstale":"2023-10-09T11:42:00.204607+0000","last_undegraded":"2023-10-09T11:42:00.204607+0000","last_fullsized":"2023-10-09T11:42:00.204607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:34.883415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.219099+0000","last_change":"2023-10-09T11:42:00.217901+0000","last_active":"2023-10-09T11:42:00.219099+0000","last_peered":"2023-10-09T11:42:00.219099+0000","last_clean":"2023-10-09T11:42:00.219099+0000","last_became_active":"2023-10-09T11:42:00.217641+0000","last_became_peered":"2023-10-09T11:42:00.217641+0000","last_unstale":"2023-10-09T11:42:00.219099+0000","last_undegraded":"2023-10-09T11:42:00.219099+0000","last_fullsized":"2023-10-09T11:42:00.219099+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:13.332422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638839+0000","last_change":"2023-10-09T11:41:59.631402+0000","last_active":"2023-10-09T11:42:00.638839+0000","last_peered":"2023-10-09T11:42:00.638839+0000","last_clean":"2023-10-09T11:42:00.638839+0000","last_became_active":"2023-10-09T11:41:59.630980+0000","last_became_peered":"2023-10-09T11:41:59.630980+0000","last_unstale":"2023-10-09T11:42:00.638839+0000","last_undegraded":"2023-10-09T11:42:00.638839+0000","last_fullsized":"2023-10-09T11:42:00.638839+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:10.015929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217404+0000","last_change":"2023-10-09T11:42:00.210737+0000","last_active":"2023-10-09T11:42:00.217404+0000","last_peered":"2023-10-09T11:42:00.217404+0000","last_clean":"2023-10-09T11:42:00.217404+0000","last_became_active":"2023-10-09T11:42:00.209921+0000","last_became_peered":"2023-10-09T11:42:00.209921+0000","last_unstale":"2023-10-09T11:42:00.217404+0000","last_undegraded":"2023-10-09T11:42:00.217404+0000","last_fullsized":"2023-10-09T11:42:00.217404+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:30.811131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210087+0000","last_change":"2023-10-09T11:41:59.632230+0000","last_active":"2023-10-09T11:42:00.210087+0000","last_peered":"2023-10-09T11:42:00.210087+0000","last_clean":"2023-10-09T11:42:00.210087+0000","last_became_active":"2023-10-09T11:41:59.631971+0000","last_became_peered":"2023-10-09T11:41:59.631971+0000","last_unstale":"2023-10-09T11:42:00.210087+0000","last_undegraded":"2023-10-09T11:42:00.210087+0000","last_fullsized":"2023-10-09T11:42:00.210087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.212939+0000","last_change":"2023-10-09T11:42:00.208802+0000","last_active":"2023-10-09T11:42:00.212939+0000","last_peered":"2023-10-09T11:42:00.212939+0000","last_clean":"2023-10-09T11:42:00.212939+0000","last_became_active":"2023-10-09T11:42:00.208521+0000","last_became_peered":"2023-10-09T11:42:00.208521+0000","last_unstale":"2023-10-09T11:42:00.212939+0000","last_undegraded":"2023-10-09T11:42:00.212939+0000","last_fullsized":"2023-10-09T11:42:00.212939+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:13.011668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.209902+0000","last_change":"2023-10-09T11:41:59.631307+0000","last_active":"2023-10-09T11:42:00.209902+0000","last_peered":"2023-10-09T11:42:00.209902+0000","last_clean":"2023-10-09T11:42:00.209902+0000","last_became_active":"2023-10-09T11:41:59.630943+0000","last_became_peered":"2023-10-09T11:41:59.630943+0000","last_unstale":"2023-10-09T11:42:00.209902+0000","last_undegraded":"2023-10-09T11:42:00.209902+0000","last_fullsized":"2023-10-09T11:42:00.209902+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:57.854138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.221638+0000","last_change":"2023-10-09T11:42:00.219945+0000","last_active":"2023-10-09T11:42:00.221638+0000","last_peered":"2023-10-09T11:42:00.221638+0000","last_clean":"2023-10-09T11:42:00.221638+0000","last_became_active":"2023-10-09T11:42:00.219612+0000","last_became_peered":"2023-10-09T11:42:00.219612+0000","last_unstale":"2023-10-09T11:42:00.221638+0000","last_undegraded":"2023-10-09T11:42:00.221638+0000","last_fullsized":"2023-10-09T11:42:00.221638+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.857874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.201458+0000","last_change":"2023-10-09T11:41:59.625622+0000","last_active":"2023-10-09T11:42:00.201458+0000","last_peered":"2023-10-09T11:42:00.201458+0000","last_clean":"2023-10-09T11:42:00.201458+0000","last_became_active":"2023-10-09T11:41:59.625346+0000","last_became_peered":"2023-10-09T11:41:59.625346+0000","last_unstale":"2023-10-09T11:42:00.201458+0000","last_undegraded":"2023-10-09T11:42:00.201458+0000","last_fullsized":"2023-10-09T11:42:00.201458+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:08.373571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217471+0000","last_change":"2023-10-09T11:42:00.210536+0000","last_active":"2023-10-09T11:42:00.217471+0000","last_peered":"2023-10-09T11:42:00.217471+0000","last_clean":"2023-10-09T11:42:00.217471+0000","last_became_active":"2023-10-09T11:42:00.210277+0000","last_became_peered":"2023-10-09T11:42:00.210277+0000","last_unstale":"2023-10-09T11:42:00.217471+0000","last_undegraded":"2023-10-09T11:42:00.217471+0000","last_fullsized":"2023-10-09T11:42:00.217471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:33.227729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.638575+0000","last_change":"2023-10-09T11:41:59.631336+0000","last_active":"2023-10-09T11:42:00.638575+0000","last_peered":"2023-10-09T11:42:00.638575+0000","last_clean":"2023-10-09T11:42:00.638575+0000","last_became_active":"2023-10-09T11:41:59.631014+0000","last_became_peered":"2023-10-09T11:41:59.631014+0000","last_unstale":"2023-10-09T11:42:00.638575+0000","last_undegraded":"2023-10-09T11:42:00.638575+0000","last_fullsized":"2023-10-09T11:42:00.638575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:04.014266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218967+0000","last_change":"2023-10-09T11:42:00.215982+0000","last_active":"2023-10-09T11:42:00.218967+0000","last_peered":"2023-10-09T11:42:00.218967+0000","last_clean":"2023-10-09T11:42:00.218967+0000","last_became_active":"2023-10-09T11:42:00.215665+0000","last_became_peered":"2023-10-09T11:42:00.215665+0000","last_unstale":"2023-10-09T11:42:00.218967+0000","last_undegraded":"2023-10-09T11:42:00.218967+0000","last_fullsized":"2023-10-09T11:42:00.218967+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T11:42:01.427603+0000","last_change":"2023-10-09T11:41:59.635719+0000","last_active":"2023-10-09T11:42:01.427603+0000","last_peered":"2023-10-09T11:42:01.427603+0000","last_clean":"2023-10-09T11:42:01.427603+0000","last_became_active":"2023-10-09T11:41:59.635402+0000","last_became_peered":"2023-10-09T11:41:59.635402+0000","last_unstale":"2023-10-09T11:42:01.427603+0000","last_undegraded":"2023-10-09T11:42:01.427603+0000","last_fullsized":"2023-10-09T11:42:01.427603+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:46.443969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.220500+0000","last_change":"2023-10-09T11:42:00.219880+0000","last_active":"2023-10-09T11:42:00.220500+0000","last_peered":"2023-10-09T11:42:00.220500+0000","last_clean":"2023-10-09T11:42:00.220500+0000","last_became_active":"2023-10-09T11:42:00.219637+0000","last_became_peered":"2023-10-09T11:42:00.219637+0000","last_unstale":"2023-10-09T11:42:00.220500+0000","last_undegraded":"2023-10-09T11:42:00.220500+0000","last_fullsized":"2023-10-09T11:42:00.220500+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204359+0000","last_change":"2023-10-09T11:41:59.632579+0000","last_active":"2023-10-09T11:42:00.204359+0000","last_peered":"2023-10-09T11:42:00.204359+0000","last_clean":"2023-10-09T11:42:00.204359+0000","last_became_active":"2023-10-09T11:41:59.632268+0000","last_became_peered":"2023-10-09T11:41:59.632268+0000","last_unstale":"2023-10-09T11:42:00.204359+0000","last_undegraded":"2023-10-09T11:42:00.204359+0000","last_fullsized":"2023-10-09T11:42:00.204359+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:48.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.217040+0000","last_change":"2023-10-09T11:42:00.209277+0000","last_active":"2023-10-09T11:42:00.217040+0000","last_peered":"2023-10-09T11:42:00.217040+0000","last_clean":"2023-10-09T11:42:00.217040+0000","last_became_active":"2023-10-09T11:42:00.208952+0000","last_became_peered":"2023-10-09T11:42:00.208952+0000","last_unstale":"2023-10-09T11:42:00.217040+0000","last_undegraded":"2023-10-09T11:42:00.217040+0000","last_fullsized":"2023-10-09T11:42:00.217040+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:01.904807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.201358+0000","last_change":"2023-10-09T11:41:59.625759+0000","last_active":"2023-10-09T11:42:00.201358+0000","last_peered":"2023-10-09T11:42:00.201358+0000","last_clean":"2023-10-09T11:42:00.201358+0000","last_became_active":"2023-10-09T11:41:59.623565+0000","last_became_peered":"2023-10-09T11:41:59.623565+0000","last_unstale":"2023-10-09T11:42:00.201358+0000","last_undegraded":"2023-10-09T11:42:00.201358+0000","last_fullsized":"2023-10-09T11:42:00.201358+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:36.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.222079+0000","last_change":"2023-10-09T11:42:00.220642+0000","last_active":"2023-10-09T11:42:00.222079+0000","last_peered":"2023-10-09T11:42:00.222079+0000","last_clean":"2023-10-09T11:42:00.222079+0000","last_became_active":"2023-10-09T11:42:00.220107+0000","last_became_peered":"2023-10-09T11:42:00.220107+0000","last_unstale":"2023-10-09T11:42:00.222079+0000","last_undegraded":"2023-10-09T11:42:00.222079+0000","last_fullsized":"2023-10-09T11:42:00.222079+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.204195+0000","last_change":"2023-10-09T11:41:59.627466+0000","last_active":"2023-10-09T11:42:00.204195+0000","last_peered":"2023-10-09T11:42:00.204195+0000","last_clean":"2023-10-09T11:42:00.204195+0000","last_became_active":"2023-10-09T11:41:59.626717+0000","last_became_peered":"2023-10-09T11:41:59.626717+0000","last_unstale":"2023-10-09T11:42:00.204195+0000","last_undegraded":"2023-10-09T11:42:00.204195+0000","last_fullsized":"2023-10-09T11:42:00.204195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:24.240339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.214375+0000","last_change":"2023-10-09T11:42:00.207614+0000","last_active":"2023-10-09T11:42:00.214375+0000","last_peered":"2023-10-09T11:42:00.214375+0000","last_clean":"2023-10-09T11:42:00.214375+0000","last_became_active":"2023-10-09T11:42:00.207309+0000","last_became_peered":"2023-10-09T11:42:00.207309+0000","last_unstale":"2023-10-09T11:42:00.214375+0000","last_undegraded":"2023-10-09T11:42:00.214375+0000","last_fullsized":"2023-10-09T11:42:00.214375+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:58.991113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215102+0000","last_change":"2023-10-09T11:41:59.632416+0000","last_active":"2023-10-09T11:42:00.215102+0000","last_peered":"2023-10-09T11:42:00.215102+0000","last_clean":"2023-10-09T11:42:00.215102+0000","last_became_active":"2023-10-09T11:41:59.632037+0000","last_became_peered":"2023-10-09T11:41:59.632037+0000","last_unstale":"2023-10-09T11:42:00.215102+0000","last_undegraded":"2023-10-09T11:42:00.215102+0000","last_fullsized":"2023-10-09T11:42:00.215102+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:03.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.215477+0000","last_change":"2023-10-09T11:42:00.212726+0000","last_active":"2023-10-09T11:42:00.215477+0000","last_peered":"2023-10-09T11:42:00.215477+0000","last_clean":"2023-10-09T11:42:00.215477+0000","last_became_active":"2023-10-09T11:42:00.212460+0000","last_became_peered":"2023-10-09T11:42:00.212460+0000","last_unstale":"2023-10-09T11:42:00.215477+0000","last_undegraded":"2023-10-09T11:42:00.215477+0000","last_fullsized":"2023-10-09T11:42:00.215477+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:05.994164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.210000+0000","last_change":"2023-10-09T11:41:59.633991+0000","last_active":"2023-10-09T11:42:00.210000+0000","last_peered":"2023-10-09T11:42:00.210000+0000","last_clean":"2023-10-09T11:42:00.210000+0000","last_became_active":"2023-10-09T11:41:59.633652+0000","last_became_peered":"2023-10-09T11:41:59.633652+0000","last_unstale":"2023-10-09T11:42:00.210000+0000","last_undegraded":"2023-10-09T11:42:00.210000+0000","last_fullsized":"2023-10-09T11:42:00.210000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.218018+0000","last_change":"2023-10-09T11:42:00.216931+0000","last_active":"2023-10-09T11:42:00.218018+0000","last_peered":"2023-10-09T11:42:00.218018+0000","last_clean":"2023-10-09T11:42:00.218018+0000","last_became_active":"2023-10-09T11:42:00.216640+0000","last_became_peered":"2023-10-09T11:42:00.216640+0000","last_unstale":"2023-10-09T11:42:00.218018+0000","last_undegraded":"2023-10-09T11:42:00.218018+0000","last_fullsized":"2023-10-09T11:42:00.218018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:23:12.507843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.201559+0000","last_change":"2023-10-09T11:41:59.635108+0000","last_active":"2023-10-09T11:42:00.201559+0000","last_peered":"2023-10-09T11:42:00.201559+0000","last_clean":"2023-10-09T11:42:00.201559+0000","last_became_active":"2023-10-09T11:41:59.634840+0000","last_became_peered":"2023-10-09T11:41:59.634840+0000","last_unstale":"2023-10-09T11:42:00.201559+0000","last_undegraded":"2023-10-09T11:42:00.201559+0000","last_fullsized":"2023-10-09T11:42:00.201559+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:42.570558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.222065+0000","last_change":"2023-10-09T11:42:00.220378+0000","last_active":"2023-10-09T11:42:00.222065+0000","last_peered":"2023-10-09T11:42:00.222065+0000","last_clean":"2023-10-09T11:42:00.222065+0000","last_became_active":"2023-10-09T11:42:00.219769+0000","last_became_peered":"2023-10-09T11:42:00.219769+0000","last_unstale":"2023-10-09T11:42:00.222065+0000","last_undegraded":"2023-10-09T11:42:00.222065+0000","last_fullsized":"2023-10-09T11:42:00.222065+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:59.610134+0000","last_clean_scrub_stamp":"2023-10-09T11:41:59.610134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:03.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.640013+0000","last_change":"2023-10-09T11:41:59.632436+0000","last_active":"2023-10-09T11:42:00.640013+0000","last_peered":"2023-10-09T11:42:00.640013+0000","last_clean":"2023-10-09T11:42:00.640013+0000","last_became_active":"2023-10-09T11:41:59.632129+0000","last_became_peered":"2023-10-09T11:41:59.632129+0000","last_unstale":"2023-10-09T11:42:00.640013+0000","last_undegraded":"2023-10-09T11:42:00.640013+0000","last_fullsized":"2023-10-09T11:42:00.640013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:58.605761+0000","last_clean_scrub_stamp":"2023-10-09T11:41:58.605761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:22.363556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-09T11:42:00.211142+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:42:00.211142+0000","last_peered":"2023-10-09T11:42:00.211142+0000","last_clean":"2023-10-09T11:42:00.211142+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:42:00.211142+0000","last_undegraded":"2023-10-09T11:42:00.211142+0000","last_fullsized":"2023-10-09T11:42:00.211142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303352,"kb_used_data":1968,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068488,"statfs":{"total":96636764160,"available":96326131712,"internally_reserved":0,"allocated":2015232,"data_stored":1196866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.69399999999999995},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.76000000000000001,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":2.6160000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":5.9450000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":1.256},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.88,"15min":8.8940000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.92900000000000005},"min":{"1min":0.49299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91700000000000004,"15min":8.9309999999999992},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77700000000000002,"5min":0.85899999999999999,"15min":2.7629999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.307,"15min":0.307},"max":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":1.3},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.78200000000000003,"15min":1.163},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.76100000000000001,"5min":0.83299999999999996,"15min":1.1419999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82999999999999996,"15min":1.369},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.84199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542232,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302760,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069080,"statfs":{"total":96636764160,"available":96326737920,"internally_reserved":0,"allocated":1409024,"data_stored":605888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.95599999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.60599999999999998},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.153},"last":0.60799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78900000000000003,"5min":0.96099999999999997,"15min":1.1060000000000001},"last":0.78800000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":0.86099999999999999,"15min":0.874},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79700000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76800000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302748,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069092,"statfs":{"total":96636764160,"available":96326750208,"internally_reserved":0,"allocated":1396736,"data_stored":604352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.53000000000000003},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.77200000000000002},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":11.06},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.95699999999999996},"min":{"1min":0.23100000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":15.933999999999999},"last":0.443},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34899999999999998,"15min":0.80500000000000005},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":11.935},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.77900000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":5.0060000000000002},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":1.528},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.98999999999999999},"min":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88400000000000001,"5min":0.90300000000000002,"15min":10.939},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.75900000000000001},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.996,"15min":4.9370000000000003},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":1.0249999999999999},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":10.975},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":1.054},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":11.031000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.628},"min":{"1min":0.44,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63700000000000001,"15min":1.054},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92200000000000004,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":1194720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.53600000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47099999999999997,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.56699999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.81499999999999995},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.251},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.86499999999999999},"min":{"1min":0.26600000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":12.589},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.371,"15min":0.44900000000000001},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.64800000000000002,"15min":1.6739999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":0.57599999999999996,"15min":1.502},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.64300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.446},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.278},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.66600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.92200000000000004,"15min":1.6040000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59299999999999997,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":0.90700000000000003,"15min":1.415},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.93899999999999995,"15min":1.639},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.70599999999999996},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98299999999999998,"15min":1.4770000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.70699999999999996},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":1.288,"5min":1.288,"15min":1.3149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.68400000000000005},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.5629999999999999},"last":0.61299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60999999999999999,"5min":1.272,"15min":1.272},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.59899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.26800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.70299999999999996,"5min":1.246,"15min":1.246},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.317}]},{"osd":4,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77200000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":1.286,"15min":1.286},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":3.843,"15min":3.843},"last":0.47699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89000000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.34200000000000003},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53800000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34300000000000003,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.38700000000000001,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40699999999999997},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.26800000000000002},"max":{"1min":0.58399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.28100000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.48599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.871,"15min":0.873},"last":0.45500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":604422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":1.056},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.69399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.81499999999999995,"15min":3.7400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.73899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.89800000000000002,"15min":3.8519999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.378,"5min":0.313,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82399999999999995,"5min":0.874,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 11:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.61899999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77500000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.89200000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542233,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302756,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069084,"statfs":{"total":96636764160,"available":96326742016,"internally_reserved":0,"allocated":1404928,"data_stored":604464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.61799999999999999,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.373}]},{"osd":1,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.89600000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56799999999999995,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.84799999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70899999999999996,"5min":0.81499999999999995,"15min":1.0189999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.83699999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.48299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.84799999999999998,"15min":0.95999999999999996},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.86899999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.55000000000000004,"5min":0.42799999999999999,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:09.677 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:42:09.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:42:09.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.836+0000 7fd77c75e700 1 Processor -- start 2023-10-09T11:42:09.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.836+0000 7fd77c75e700 1 -- start start 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.837+0000 7fd77c75e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd77413c9b0 0x7fd774069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.837+0000 7fd77c75e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd7740cc6f0 0x7fd774069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.837+0000 7fd77c75e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77406d7b0 con 0x7fd7740cc320 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.837+0000 7fd77c75e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77406f7d0 con 0x7fd7740cc6f0 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.837+0000 7fd77c75e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77406e330 con 0x7fd77413c9b0 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd7740cc6f0 0x7fd774069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd7740cc6f0 0x7fd774069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50444/0 (socket says 172.21.15.26:50444) 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 -- 172.21.15.26:0/3734139085 learned_addr learned my addr 172.21.15.26:0/3734139085 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd779cf9700 1 --2- 172.21.15.26:0/3734139085 >> v2:172.21.15.67:3300/0 conn(0x7fd77413c9b0 0x7fd774069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 -- 172.21.15.26:0/3734139085 >> v2:172.21.15.67:3300/0 conn(0x7fd77413c9b0 msgr2=0x7fd774069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 --2- 172.21.15.26:0/3734139085 >> v2:172.21.15.67:3300/0 conn(0x7fd77413c9b0 0x7fd774069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 -- 172.21.15.26:0/3734139085 >> v1:172.21.15.67:6789/0 conn(0x7fd7740cc320 legacy=0x7fd77413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 -- 172.21.15.26:0/3734139085 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77406da00 con 0x7fd7740cc6f0 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd77acfb700 1 --2- 172.21.15.26:0/3734139085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc6f0 0x7fd774069f40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd7740647f0 tx=0x7fd764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca7031f7ee3dae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd7794f8700 1 -- 172.21.15.26:0/3734139085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764009e70 con 0x7fd7740cc6f0 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd7794f8700 1 -- 172.21.15.26:0/3734139085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400b860 con 0x7fd7740cc6f0 2023-10-09T11:42:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.838+0000 7fd7794f8700 1 -- 172.21.15.26:0/3734139085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400bc00 con 0x7fd7740cc6f0 2023-10-09T11:42:09.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 -- 172.21.15.26:0/3734139085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc6f0 msgr2=0x7fd774069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 --2- 172.21.15.26:0/3734139085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc6f0 0x7fd774069f40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd7740647f0 tx=0x7fd764009250 comp rx=0 tx=0).stop 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 -- 172.21.15.26:0/3734139085 shutdown_connections 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 --2- 172.21.15.26:0/3734139085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc6f0 0x7fd774069f40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 --2- 172.21.15.26:0/3734139085 >> v2:172.21.15.67:3300/0 conn(0x7fd77413c9b0 0x7fd774069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 -- 172.21.15.26:0/3734139085 >> 172.21.15.26:0/3734139085 conn(0x7fd774067f00 msgr2=0x7fd774068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 -- 172.21.15.26:0/3734139085 shutdown_connections 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.839+0000 7fd77c75e700 1 -- 172.21.15.26:0/3734139085 wait complete. 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.840+0000 7fd77c75e700 1 Processor -- start 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.840+0000 7fd77c75e700 1 -- start start 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7740cc6f0 0x7fd77416a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 0x7fd77416aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740af680 con 0x7fd7740cc320 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740aed50 con 0x7fd7740cc6f0 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77c75e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740af030 con 0x7fd77413c9b0 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50454/0 (socket says 172.21.15.26:50454) 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 -- 172.21.15.26:0/902094054 learned_addr learned my addr 172.21.15.26:0/902094054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd779cf9700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7740cc6f0 0x7fd77416a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77acfb700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 0x7fd77416aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 -- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 msgr2=0x7fd77416aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 0x7fd77416aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 -- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7740cc6f0 msgr2=0x7fd77416a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7740cc6f0 0x7fd77416a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 -- 172.21.15.26:0/902094054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640094f0 con 0x7fd7740cc320 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77acfb700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 0x7fd77416aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.841+0000 7fd77a4fa700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cb10 tx=0x7fd76c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.842+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00a760 con 0x7fd7740cc320 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.842+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c00a8e0 con 0x7fd7740cc320 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.842+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740af310 con 0x7fd7740cc320 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.842+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00aca0 con 0x7fd7740cc320 2023-10-09T11:42:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.842+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77416aff0 con 0x7fd7740cc320 2023-10-09T11:42:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.843+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77404c3c0 con 0x7fd7740cc320 2023-10-09T11:42:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.843+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd76c003030 con 0x7fd7740cc320 2023-10-09T11:42:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.843+0000 7fd7727fc700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 0x7fd7600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.843+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd76c084d70 con 0x7fd7740cc320 2023-10-09T11:42:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.844+0000 7fd779cf9700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 0x7fd7600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.844+0000 7fd779cf9700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 0x7fd7600697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd77413cde0 tx=0x7fd768008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:09.848+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd76c051a00 con 0x7fd7740cc320 2023-10-09T11:42:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.120+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd77406dce0 con 0x7fd7740cc320 2023-10-09T11:42:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.124+0000 7fd7727fc700 1 -- 172.21.15.26:0/902094054 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd76c055020 con 0x7fd7740cc320 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 msgr2=0x7fd7600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 0x7fd7600697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd77413cde0 tx=0x7fd768008040 comp rx=0 tx=0).stop 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 msgr2=0x7fd7740ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cb10 tx=0x7fd76c0017b0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 shutdown_connections 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd760067320 0x7fd7600697d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd77413c9b0 0x7fd77416aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7740cc320 0x7fd7740ad320 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 --2- 172.21.15.26:0/902094054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7740cc6f0 0x7fd77416a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.126+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 >> 172.21.15.26:0/902094054 conn(0x7fd774067f00 msgr2=0x7fd7740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.127+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 shutdown_connections 2023-10-09T11:42:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.127+0000 7fd77c75e700 1 -- 172.21.15.26:0/902094054 wait complete. 2023-10-09T11:42:10.131 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:42:10.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:10.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.258+0000 7fa236b9b700 1 Processor -- start 2023-10-09T11:42:10.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.258+0000 7fa236b9b700 1 -- start start 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa236b9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa23015a5d0 0x7fa230156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa236b9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23015ae40 con 0x7fa2300cb970 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa236b9b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23015ab60 con 0x7fa2300cb5a0 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa236b9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2300ce0f0 con 0x7fa23015a5d0 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa235138700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa23015a5d0 0x7fa230156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa22ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa2300cb970 0x7fa230159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43132/0 (socket says 172.21.15.26:43132) 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa22ffff700 1 -- 172.21.15.26:0/3894907046 learned_addr learned my addr 172.21.15.26:0/3894907046 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa22f7fe700 1 -- 172.21.15.26:0/3894907046 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685537700 0 0) 0x7fa23015ae40 con 0x7fa2300cb970 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa22f7fe700 1 -- 172.21.15.26:0/3894907046 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa21c003570 con 0x7fa2300cb970 2023-10-09T11:42:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa235138700 1 -- 172.21.15.26:0/3894907046 >> v1:172.21.15.67:6789/0 conn(0x7fa2300cb5a0 legacy=0x7fa2300cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa235138700 1 -- 172.21.15.26:0/3894907046 >> v1:172.21.15.26:6789/0 conn(0x7fa2300cb970 legacy=0x7fa230159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa235138700 1 -- 172.21.15.26:0/3894907046 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300ccf00 con 0x7fa23015a5d0 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.259+0000 7fa235138700 1 --2- 172.21.15.26:0/3894907046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa230156e90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e60 tx=0x7fa228009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186d75f793021ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa22f7fe700 1 -- 172.21.15.26:0/3894907046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800e070 con 0x7fa23015a5d0 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa22f7fe700 1 -- 172.21.15.26:0/3894907046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800bb60 con 0x7fa23015a5d0 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa22f7fe700 1 -- 172.21.15.26:0/3894907046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228012430 con 0x7fa23015a5d0 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 -- 172.21.15.26:0/3894907046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 msgr2=0x7fa230156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3894907046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa230156e90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e60 tx=0x7fa228009780 comp rx=0 tx=0).stop 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 -- 172.21.15.26:0/3894907046 shutdown_connections 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3894907046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa230156e90 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 -- 172.21.15.26:0/3894907046 >> 172.21.15.26:0/3894907046 conn(0x7fa230070e30 msgr2=0x7fa2300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 -- 172.21.15.26:0/3894907046 shutdown_connections 2023-10-09T11:42:10.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.260+0000 7fa236b9b700 1 -- 172.21.15.26:0/3894907046 wait complete. 2023-10-09T11:42:10.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.261+0000 7fa236b9b700 1 Processor -- start 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.261+0000 7fa236b9b700 1 -- start start 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cb5a0 0x7fa2300af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2300cb970 0x7fa2300b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015c9f0 con 0x7fa23015a5d0 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015d800 con 0x7fa2300cb5a0 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa236b9b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015cbf0 con 0x7fa2300cb970 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa235138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa235138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50472/0 (socket says 172.21.15.26:50472) 2023-10-09T11:42:10.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa235138700 1 -- 172.21.15.26:0/3549097015 learned_addr learned my addr 172.21.15.26:0/3549097015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa234937700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cb5a0 0x7fa2300af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.262+0000 7fa22ffff700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2300cb970 0x7fa2300b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 -- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2300cb970 msgr2=0x7fa2300b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2300cb970 0x7fa2300b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 -- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cb5a0 msgr2=0x7fa2300af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cb5a0 0x7fa2300af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 -- 172.21.15.26:0/3549097015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009a20 con 0x7fa23015a5d0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa235138700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa23006ea60 tx=0x7fa228019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228027470 con 0x7fa23015a5d0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280275f0 con 0x7fa23015a5d0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23015ced0 con 0x7fa23015a5d0 2023-10-09T11:42:10.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280279b0 con 0x7fa23015a5d0 2023-10-09T11:42:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.263+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23015d490 con 0x7fa23015a5d0 2023-10-09T11:42:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.264+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23004c3c0 con 0x7fa23015a5d0 2023-10-09T11:42:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.264+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa228024070 con 0x7fa23015a5d0 2023-10-09T11:42:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.265+0000 7fa22cff9700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 0x7fa2100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.265+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa228087610 con 0x7fa23015a5d0 2023-10-09T11:42:10.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.265+0000 7fa234937700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 0x7fa2100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.265+0000 7fa234937700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 0x7fa2100697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa218003a80 tx=0x7fa218007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.269+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2280542a0 con 0x7fa23015a5d0 2023-10-09T11:42:10.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.508+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa23015d940 con 0x7fa23015a5d0 2023-10-09T11:42:10.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.509+0000 7fa22cff9700 1 -- 172.21.15.26:0/3549097015 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa2280578c0 con 0x7fa23015a5d0 2023-10-09T11:42:10.510 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:10.510 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7185,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2449545220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2449545220},{"type":"v1","addr":"172.21.15.26:6834","nonce":2449545220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7188,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2511463047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2511463047},{"type":"v1","addr":"172.21.15.26:6835","nonce":2511463047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:10.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 msgr2=0x7fa2100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 0x7fa2100697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa218003a80 tx=0x7fa218007ec0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 msgr2=0x7fa2300b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa23006ea60 tx=0x7fa228019000 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 shutdown_connections 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa23015a5d0 0x7fa2300b39f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cb5a0 0x7fa2300af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa210067320 0x7fa2100697d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 --2- 172.21.15.26:0/3549097015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2300cb970 0x7fa2300b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 >> 172.21.15.26:0/3549097015 conn(0x7fa230070e30 msgr2=0x7fa2300b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 shutdown_connections 2023-10-09T11:42:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:10.511+0000 7fa236b9b700 1 -- 172.21.15.26:0/3549097015 wait complete. 2023-10-09T11:42:10.514 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 76 2023-10-09T11:42:10.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:42:00.023232+0000', 'modified': '2023-10-09T11:42:03.639751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7203}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7203': {'gid': 7203, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6836/2194944885', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 2194944885}, {'type': 'v1', 'addr': '172.21.15.67:6836', 'nonce': 2194944885}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:42:10.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:42:10.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T11:42:11.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.050+0000 7fd334caf700 1 Processor -- start 2023-10-09T11:42:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.050+0000 7fd334caf700 1 -- start start 2023-10-09T11:42:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd334caf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd330153c30 0x7fd33015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd334caf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd33015de50 0x7fd3300cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd334caf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33015afd0 con 0x7fd3300cef40 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd334caf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33015b2b0 con 0x7fd330153c30 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd334caf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015b590 con 0x7fd33015de50 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3300cef40 0x7fd33006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43146/0 (socket says 172.21.15.26:43146) 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32ffff700 1 -- 172.21.15.26:0/475207730 learned_addr learned my addr 172.21.15.26:0/475207730 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/475207730 >> v2:172.21.15.67:3300/0 conn(0x7fd330153c30 0x7fd33015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd33015de50 0x7fd3300cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672613281 0 0) 0x7fd33015afd0 con 0x7fd3300cef40 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.051+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003570 con 0x7fd3300cef40 2023-10-09T11:42:11.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 680735951 0 0) 0x7fd318003570 con 0x7fd3300cef40 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd33015de50 msgr2=0x7fd3300cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd33015de50 0x7fd3300cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 >> v2:172.21.15.67:3300/0 conn(0x7fd330153c30 msgr2=0x7fd33015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 --2- 172.21.15.26:0/475207730 >> v2:172.21.15.67:3300/0 conn(0x7fd330153c30 0x7fd33015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33015b870 con 0x7fd3300cef40 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd3280017f0 con 0x7fd3300cef40 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 >> v1:172.21.15.26:6789/0 conn(0x7fd3300cef40 legacy=0x7fd33006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318003a60 0x7fd318003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd318004810 0x7fd318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3180051c0 0x7fd31800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015b2b0 con 0x7fd318004810 2023-10-09T11:42:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33015b590 con 0x7fd318003a60 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31800bfa0 con 0x7fd3180051c0 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd33015de50 0x7fd3300cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/475207730 >> v2:172.21.15.67:3300/0 conn(0x7fd330153c30 0x7fd33015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd318004810 0x7fd318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32ffff700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3180051c0 0x7fd31800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318003a60 0x7fd318003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 -- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3180051c0 msgr2=0x7fd31800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3180051c0 0x7fd31800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 -- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318003a60 msgr2=0x7fd318003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318003a60 0x7fd318003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 -- 172.21.15.26:0/475207730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318003570 con 0x7fd318004810 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.052+0000 7fd32effd700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd318004810 0x7fd318004c80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd324009c50 tx=0x7fd3240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d129cb4ad92ad44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400e710 con 0x7fd318004810 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400e870 con 0x7fd318004810 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd32e7fc700 1 -- 172.21.15.26:0/475207730 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400ec10 con 0x7fd318004810 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 -- 172.21.15.26:0/475207730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd318004810 msgr2=0x7fd318004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 --2- 172.21.15.26:0/475207730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd318004810 0x7fd318004c80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd324009c50 tx=0x7fd3240091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd32ffff700 1 -- 172.21.15.26:0/475207730 reap_dead start 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 -- 172.21.15.26:0/475207730 shutdown_connections 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 -- 172.21.15.26:0/475207730 >> 172.21.15.26:0/475207730 conn(0x7fd3300703a0 msgr2=0x7fd3300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 -- 172.21.15.26:0/475207730 shutdown_connections 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.053+0000 7fd334caf700 1 -- 172.21.15.26:0/475207730 wait complete. 2023-10-09T11:42:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.054+0000 7fd334caf700 1 Processor -- start 2023-10-09T11:42:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.054+0000 7fd334caf700 1 -- start start 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 0x7fd330143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3300b1680 0x7fd3300b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33016d3c0 con 0x7fd3300b5f00 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300b11f0 con 0x7fd318004810 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd334caf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301444d0 con 0x7fd3300b1680 2023-10-09T11:42:11.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50486/0 (socket says 172.21.15.26:50486) 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 -- 172.21.15.26:0/2390903435 learned_addr learned my addr 172.21.15.26:0/2390903435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32effd700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3300b1680 0x7fd3300b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 0x7fd330143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 -- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3300b1680 msgr2=0x7fd3300b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3300b1680 0x7fd3300b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 -- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 msgr2=0x7fd330143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 0x7fd330143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.055+0000 7fd32ffff700 1 -- 172.21.15.26:0/2390903435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300b0ea0 con 0x7fd3300b5f00 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 0x7fd330143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd32ffff700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd33006e800 tx=0x7fd328002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd3177fe700 1 -- 172.21.15.26:0/2390903435 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328001ea0 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd3177fe700 1 -- 172.21.15.26:0/2390903435 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800ad80 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3300ca140 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd3177fe700 1 -- 172.21.15.26:0/2390903435 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328013640 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.056+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300b1af0 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.057+0000 7fd3177fe700 1 -- 172.21.15.26:0/2390903435 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd3280139b0 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.058+0000 7fd3177fe700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 0x7fd31c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.058+0000 7fd3177fe700 1 -- 172.21.15.26:0/2390903435 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3280854e0 con 0x7fd3300b5f00 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.058+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 0x7fd31c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.058+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 0x7fd31c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd320006f00 tx=0x7fd320008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 Processor -- start 2023-10-09T11:42:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 -- start start 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 0x56121ca767d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.060+0000 7fd33f209b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121c9a3a70 con 0x56121ca4a5f0 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121c9a1270 con 0x56121ca4cb80 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56121c99d060 con 0x56121ca97480 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50502/0 (socket says 172.21.15.26:50502) 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 -- 172.21.15.26:0/1921685506 learned_addr learned my addr 172.21.15.26:0/1921685506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 0x56121ca767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 -- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 msgr2=0x56121ca767d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 0x56121ca767d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 -- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 msgr2=0x56121ca4cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca4cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 -- 172.21.15.26:0/1921685506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56121c837270 con 0x56121ca4a5f0 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 0x56121ca767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd32effd700 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e4b0 tx=0x7fd324019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5290409daef0fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd314ff9700 1 -- 172.21.15.26:0/1921685506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324022070 con 0x56121ca4a5f0 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd314ff9700 1 -- 172.21.15.26:0/1921685506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324023040 con 0x56121ca4a5f0 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.061+0000 7fd314ff9700 1 -- 172.21.15.26:0/1921685506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400ebf0 con 0x56121ca4a5f0 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 -- 172.21.15.26:0/1921685506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 msgr2=0x56121ca97850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e4b0 tx=0x7fd324019000 comp rx=0 tx=0).stop 2023-10-09T11:42:11.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 -- 172.21.15.26:0/1921685506 shutdown_connections 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca4cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca97480 0x56121ca767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1921685506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca4a5f0 0x56121ca97850 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 -- 172.21.15.26:0/1921685506 >> 172.21.15.26:0/1921685506 conn(0x56121ca4e0c0 msgr2=0x56121ca4e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 -- 172.21.15.26:0/1921685506 shutdown_connections 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.062+0000 7fd33f209b80 1 -- 172.21.15.26:0/1921685506 wait complete. 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 -- start start 2023-10-09T11:42:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 Processor -- start 2023-10-09T11:42:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121ca70e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca77200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121c948890 con 0x56121ca97480 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121c963ea0 con 0x56121ca4a5f0 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56121c81fe30 con 0x56121ca4cb80 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.063+0000 7fd33f209b80 10 client.0 _ll_register_callbacks cb 0x56121ca102c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50518/0 (socket says 172.21.15.26:50518) 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 -- 172.21.15.26:0/3450999604 learned_addr learned my addr 172.21.15.26:0/3450999604 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121ca70e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32effd700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca77200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 -- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 msgr2=0x56121ca77200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca77200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 -- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 msgr2=0x56121ca70e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121ca70e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 -- 172.21.15.26:0/3450999604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318003570 con 0x56121ca97480 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121ca70e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32effd700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca77200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd32ffff700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd328052330 tx=0x7fd328006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1690e1c8ac5887 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:42:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328070070 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd328056e40 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56121ca41cd0 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd328052170 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd33f209b80 10 client.7374 fetch_fsmap learned FSMap version 76 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x56121c7d9fe0 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328062080 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.064+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd32805b050 con 0x56121ca97480 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 10 client.7374 fetch_fsmap finished waiting for FSMap version 76 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 10 client.7374 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 20 client.7374 populate_metadata read hostname 'smithi026' 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca7c5f0 0x56121ca7c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 4 client.7374 mds_command: new command op to 7203 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 --> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56121ca1eaa0 con 0x56121ca7c5f0 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca7c5f0 0x56121ca7c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd30dffb700 10 client.7374 ms_handle_connect on v2:172.21.15.67:6834/2194944885 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.065+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca7c5f0 0x56121ca7c9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10cf09724daea57e server_cookie=bd27fb36231e5079 in_seq=0 out_seq=0 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd30dffb700 1 -- 172.21.15.26:0/3450999604 <== mds.0 v2:172.21.15.67:6834/2194944885 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56121ca1eaa0 con 0x56121ca7c5f0 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd30dffb700 10 client.7374 handle_command_reply: tid=0 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 client.7374 shutdown 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 msgr2=0x56121caa6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd328052330 tx=0x7fd328006040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 shutdown_connections 2023-10-09T11:42:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca7c5f0 0x56121ca7c9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121caa6710 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd30dffb700 0 client.7374 ms_handle_reset on v2:172.21.15.67:6834/2194944885 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121ca70e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 --2- 172.21.15.26:0/3450999604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca77200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 >> 172.21.15.26:0/3450999604 conn(0x56121ca4e0c0 msgr2=0x56121ca50560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 shutdown_connections 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.066+0000 7fd33f209b80 1 -- 172.21.15.26:0/3450999604 wait complete. 2023-10-09T11:42:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.067+0000 7fd33f209b80 20 client.7374 trim_cache size 0 max 16384 2023-10-09T11:42:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.083+0000 7fd33f209b80 1 Processor -- start 2023-10-09T11:42:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.083+0000 7fd33f209b80 1 -- start start 2023-10-09T11:42:11.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4a5f0 0x56121ca94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca43b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121c7d9fe0 con 0x56121ca97480 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121ca41a40 con 0x56121ca4cb80 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56121ca94c70 con 0x56121ca4a5f0 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50528/0 (socket says 172.21.15.26:50528) 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.084+0000 7fd32ffff700 1 -- 172.21.15.26:0/781025921 learned_addr learned my addr 172.21.15.26:0/781025921 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 -- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4a5f0 msgr2=0x56121ca94400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4a5f0 0x56121ca94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 -- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 msgr2=0x56121ca43b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca43b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 -- 172.21.15.26:0/781025921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56121c96b780 con 0x56121ca97480 2023-10-09T11:42:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd32ffff700 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd328054180 tx=0x7fd32806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8403b08a0c975ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd3157fa700 1 -- 172.21.15.26:0/781025921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328070040 con 0x56121ca97480 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd3157fa700 1 -- 172.21.15.26:0/781025921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328062070 con 0x56121ca97480 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd3157fa700 1 -- 172.21.15.26:0/781025921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328052170 con 0x56121ca97480 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 -- 172.21.15.26:0/781025921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 msgr2=0x56121ca440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd328054180 tx=0x7fd32806b000 comp rx=0 tx=0).stop 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 -- 172.21.15.26:0/781025921 shutdown_connections 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121ca440a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4a5f0 0x56121ca94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 --2- 172.21.15.26:0/781025921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4cb80 0x56121ca43b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 -- 172.21.15.26:0/781025921 >> 172.21.15.26:0/781025921 conn(0x56121ca4e0c0 msgr2=0x56121ca954b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 -- 172.21.15.26:0/781025921 shutdown_connections 2023-10-09T11:42:11.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.085+0000 7fd33f209b80 1 -- 172.21.15.26:0/781025921 wait complete. 2023-10-09T11:42:11.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.086+0000 7fd33f209b80 1 -- start start 2023-10-09T11:42:11.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.086+0000 7fd33f209b80 1 Processor -- start 2023-10-09T11:42:11.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121caf8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121ca71d80 con 0x56121ca97480 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121ca95600 con 0x56121ca4a5f0 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56121caa5cb0 con 0x56121ca4cb80 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd33f209b80 10 client.0 _ll_register_callbacks cb 0x56121ca102c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50538/0 (socket says 172.21.15.26:50538) 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 -- 172.21.15.26:0/1936710188 learned_addr learned my addr 172.21.15.26:0/1936710188 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32effd700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121caf8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 -- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 msgr2=0x56121ca48e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca48e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 -- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 msgr2=0x56121caf8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121caf8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 -- 172.21.15.26:0/1936710188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318003570 con 0x56121ca97480 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32effd700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121caf8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd328055b30 tx=0x7fd32805b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1d1efe3d499bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd30dffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328070040 con 0x56121ca97480 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.087+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd328056e40 con 0x56121ca97480 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd324023040 con 0x56121ca97480 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd328068430 con 0x56121ca97480 2023-10-09T11:42:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 10 client.7380 fetch_fsmap learned FSMap version 76 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x56121c952470 con 0x56121ca97480 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324023040 con 0x56121ca97480 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd32805c940 con 0x56121ca97480 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 10 client.7380 fetch_fsmap finished waiting for FSMap version 76 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 10 client.7380 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 20 client.7380 populate_metadata read hostname 'smithi026' 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca6d600 0x56121cafcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 4 client.7380 mds_command: new command op to 7203 tid=0[{"prefix": "status"}] 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 --> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56121c93fe00 con 0x56121ca6d600 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.088+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca6d600 0x56121cafcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd30dffb700 10 client.7380 ms_handle_connect on v2:172.21.15.67:6834/2194944885 2023-10-09T11:42:11.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca6d600 0x56121cafcec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c0ac4155d85dfc server_cookie=896e2d969b2f8984 in_seq=0 out_seq=0 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd30dffb700 1 -- 172.21.15.26:0/1936710188 <== mds.0 v2:172.21.15.67:6834/2194944885 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56121c93fe00 con 0x56121ca6d600 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd30dffb700 10 client.7380 handle_command_reply: tid=0 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 client.7380 shutdown 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 msgr2=0x56121cafc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd328055b30 tx=0x7fd32805b050 comp rx=0 tx=0).stop 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 shutdown_connections 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:6834/2194944885,v1:172.21.15.67:6836/2194944885] conn(0x56121ca6d600 0x56121cafcec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56121ca97480 0x56121cafc980 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56121ca4a5f0 0x56121caf8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd30dffb700 0 client.7380 ms_handle_reset on v2:172.21.15.67:6834/2194944885 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 --2- 172.21.15.26:0/1936710188 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56121ca4cb80 0x56121ca48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 >> 172.21.15.26:0/1936710188 conn(0x56121ca4e0c0 msgr2=0x56121ca436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 shutdown_connections 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 1 -- 172.21.15.26:0/1936710188 wait complete. 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.089+0000 7fd33f209b80 20 client.7380 trim_cache size 0 max 16384 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 7203, 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:42:11.098 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.464335087, 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 76, 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 112, 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 112, 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 15.519963157999999 2023-10-09T11:42:11.099 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 msgr2=0x7fd31c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 0x7fd31c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd320006f00 tx=0x7fd320008040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 msgr2=0x7fd33016c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd33006e800 tx=0x7fd328002210 comp rx=0 tx=0).stop 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 shutdown_connections 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3300b5f00 0x7fd33016c550 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd318004810 0x7fd330143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd31c067320 0x7fd31c0697d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 --2- 172.21.15.26:0/2390903435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3300b1680 0x7fd3300b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 >> 172.21.15.26:0/2390903435 conn(0x7fd3300703a0 msgr2=0x7fd3300709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 shutdown_connections 2023-10-09T11:42:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.090+0000 7fd334caf700 1 -- 172.21.15.26:0/2390903435 wait complete. 2023-10-09T11:42:11.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.220+0000 7f74f38b0700 1 Processor -- start 2023-10-09T11:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.220+0000 7f74f38b0700 1 -- start start 2023-10-09T11:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f38b0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74ec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f38b0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec15ae40 con 0x7f74ec15a400 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f38b0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec15ab60 con 0x7f74ec0cb5a0 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f38b0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0ce0f0 con 0x7f74ec0cb970 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f1e4d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f74ec15a400 0x7f74ec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43156/0 (socket says 172.21.15.26:43156) 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f1e4d700 1 -- 172.21.15.26:0/214219844 learned_addr learned my addr 172.21.15.26:0/214219844 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74f0e4b700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74ec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.221+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400095846 0 0) 0x7f74ec15ae40 con 0x7f74ec15a400 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d4003570 con 0x7f74ec15a400 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831541610 0 0) 0x7f74ec15ab60 con 0x7f74ec0cb5a0 2023-10-09T11:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ec15ae40 con 0x7f74ec0cb5a0 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3717883966 0 0) 0x7f74d4003570 con 0x7f74ec15a400 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 msgr2=0x7f74ec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74ec159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 >> v1:172.21.15.67:6789/0 conn(0x7f74ec0cb5a0 legacy=0x7f74ec0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0ccf00 con 0x7f74ec15a400 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f74dc0017f0 con 0x7f74ec15a400 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 >> v1:172.21.15.26:6789/0 conn(0x7f74ec15a400 legacy=0x7f74ec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74d4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d4004810 0x7f74d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74d4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0ce0f0 con 0x7f74d4003c20 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d400bc20 con 0x7f74d4004810 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d400bde0 con 0x7f74ec0cb970 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74d4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f0e4b700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d4004810 0x7f74d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f1e4d700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74d4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 -- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 msgr2=0x7f74d4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec0cb970 0x7f74d4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 -- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d4004810 msgr2=0x7f74d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74d4004810 0x7f74d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 -- 172.21.15.26:0/214219844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4003570 con 0x7f74d4003c20 2023-10-09T11:42:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.222+0000 7f74f164c700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74d4004010 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f74e4001a10 tx=0x7f74e4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2fc8e10d9c8ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400c5d0 con 0x7f74d4003c20 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400c730 con 0x7f74d4003c20 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74ebfff700 1 -- 172.21.15.26:0/214219844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400cad0 con 0x7f74d4003c20 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 -- 172.21.15.26:0/214219844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 msgr2=0x7f74d4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 --2- 172.21.15.26:0/214219844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74d4004010 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f74e4001a10 tx=0x7f74e4007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f1e4d700 1 -- 172.21.15.26:0/214219844 reap_dead start 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 -- 172.21.15.26:0/214219844 shutdown_connections 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 -- 172.21.15.26:0/214219844 >> 172.21.15.26:0/214219844 conn(0x7f74ec070e30 msgr2=0x7f74ec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 -- 172.21.15.26:0/214219844 shutdown_connections 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.223+0000 7f74f38b0700 1 -- 172.21.15.26:0/214219844 wait complete. 2023-10-09T11:42:11.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.224+0000 7f74f38b0700 1 Processor -- start 2023-10-09T11:42:11.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.224+0000 7f74f38b0700 1 -- start start 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec151ba0 0x7f74ec15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74ec151340 0x7f74ec153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cbde0 con 0x7f74d4003c20 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15c830 con 0x7f74ec151340 2023-10-09T11:42:11.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f38b0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec152010 con 0x7f74ec151ba0 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f164c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f164c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50550/0 (socket says 172.21.15.26:50550) 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f164c700 1 -- 172.21.15.26:0/1482056930 learned_addr learned my addr 172.21.15.26:0/1482056930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f1e4d700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74ec151340 0x7f74ec153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.225+0000 7f74f0e4b700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec151ba0 0x7f74ec15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 -- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec151ba0 msgr2=0x7f74ec15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec151ba0 0x7f74ec15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 -- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74ec151340 msgr2=0x7f74ec153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74ec151340 0x7f74ec153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 -- 172.21.15.26:0/1482056930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec15b070 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f164c700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3c0 tx=0x7f74e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400c5d0 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4000fe0 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401e650 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec16dc80 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.226+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec16e240 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.227+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec15b200 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.227+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f74e4019070 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.228+0000 7f74e97fa700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 0x7f74d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.228+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74e4086350 con 0x7f74d4003c20 2023-10-09T11:42:11.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.228+0000 7f74f0e4b700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 0x7f74d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.229+0000 7f74f0e4b700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 0x7f74d80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0af9c0 tx=0x7f74e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.232+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74ec15b200 con 0x7f74d4003c20 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.470+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74ec15b200 con 0x7f74d4003c20 2023-10-09T11:42:11.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.470+0000 7f74e97fa700 1 -- 172.21.15.26:0/1482056930 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f74ec15b200 con 0x7f74d4003c20 2023-10-09T11:42:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:11.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.472+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 msgr2=0x7f74d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.472+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 0x7f74d80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0af9c0 tx=0x7f74e0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.472+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 msgr2=0x7f74ec16d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.472+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3c0 tx=0x7f74e4015000 comp rx=0 tx=0).stop 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 shutdown_connections 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74ec151340 0x7f74ec153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d4003c20 0x7f74ec16d670 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f74d8067320 0x7f74d80697d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 --2- 172.21.15.26:0/1482056930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74ec151ba0 0x7f74ec15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 >> 172.21.15.26:0/1482056930 conn(0x7f74ec070e30 msgr2=0x7f74ec0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 shutdown_connections 2023-10-09T11:42:11.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:11.473+0000 7f74f38b0700 1 -- 172.21.15.26:0/1482056930 wait complete. 2023-10-09T11:42:11.486 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:11.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:11.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:42:11.486 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:42:11.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:11.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:11.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:11.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:11.487 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:11.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.487 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:42:11.502 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:11.502 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:11.503 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42061sec preferred_lft 42061sec 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:42:11.504 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:11.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.505 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:11.567 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:42:11.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.568 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:42:11.624 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:42:11.624 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:11.624 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:42:11.625 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:42:11.625 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:11.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:42:11.625 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:42:11.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:42:11.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:42:11.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:42:11.626 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:42:11.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.727 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:42:11.741 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:42:11.741 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:42:11.742 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:11.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:11.742 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:42:11.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:11.807 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:11.862 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:11.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:11.862 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:11.916 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:42:11.916 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:11.916 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:11.997 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:11.997 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:12.016 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:12.038 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:12.038 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:12.038 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:42:12.039 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:42:12.041 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:12.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:12.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.265+0000 7fa5cdd1d700 1 Processor -- start 2023-10-09T11:42:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.265+0000 7fa5cdd1d700 1 -- start start 2023-10-09T11:42:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5cdd1d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5c8153c30 0x7fa5c815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5cdd1d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c815afd0 con 0x7fa5c815de50 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5cdd1d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c815b2b0 con 0x7fa5c80cf110 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5cdd1d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c815b590 con 0x7fa5c8153c30 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5c7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5c815de50 0x7fa5c80cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43162/0 (socket says 172.21.15.26:43162) 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1814942350 learned_addr learned my addr 172.21.15.26:0/1814942350 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5ccd1b700 1 --2- 172.21.15.26:0/1814942350 >> v2:172.21.15.67:3300/0 conn(0x7fa5c8153c30 0x7fa5c815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646379395 0 0) 0x7fa5c815afd0 con 0x7fa5c815de50 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.266+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b0003570 con 0x7fa5c815de50 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435341285 0 0) 0x7fa5c815b2b0 con 0x7fa5c80cf110 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c815afd0 con 0x7fa5c80cf110 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197522146 0 0) 0x7fa5b0003570 con 0x7fa5c815de50 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 >> v2:172.21.15.67:3300/0 conn(0x7fa5c8153c30 msgr2=0x7fa5c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 --2- 172.21.15.26:0/1814942350 >> v2:172.21.15.67:3300/0 conn(0x7fa5c8153c30 0x7fa5c815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 >> v1:172.21.15.67:6789/0 conn(0x7fa5c80cf110 legacy=0x7fa5c815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c815b870 con 0x7fa5c815de50 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fa5bc001470 con 0x7fa5c815de50 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 >> v1:172.21.15.26:6789/0 conn(0x7fa5c815de50 legacy=0x7fa5c80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5b0003bf0 0x7fa5b0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 0x7fa5b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b00051c0 0x7fa5b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c815b590 con 0x7fa5b0004810 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b000c0b0 con 0x7fa5b0003bf0 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b000c270 con 0x7fa5b00051c0 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 0x7fa5b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5ccd1b700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5b0003bf0 0x7fa5b0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5cd51c700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b00051c0 0x7fa5b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b00051c0 msgr2=0x7fa5b000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b00051c0 0x7fa5b000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5b0003bf0 msgr2=0x7fa5b0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5b0003bf0 0x7fa5b0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5cd51c700 1 -- 172.21.15.26:0/1814942350 reap_dead start 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1814942350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0003570 con 0x7fa5b0004810 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 0x7fa5b0004c80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c2d0 tx=0x7fa5c815e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7c7e2d308f480 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00cba0 con 0x7fa5b0004810 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00cd20 con 0x7fa5b0004810 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.267+0000 7fa5c77fe700 1 -- 172.21.15.26:0/1814942350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc005b70 con 0x7fa5b0004810 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 msgr2=0x7fa5b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 0x7fa5b0004c80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c2d0 tx=0x7fa5c815e2d0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1814942350 shutdown_connections 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1814942350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5b0004810 0x7fa5b0004c80 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1814942350 >> 172.21.15.26:0/1814942350 conn(0x7fa5c80703a0 msgr2=0x7fa5c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1814942350 shutdown_connections 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.268+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1814942350 wait complete. 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.269+0000 7fa5cdd1d700 1 Processor -- start 2023-10-09T11:42:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.269+0000 7fa5cdd1d700 1 -- start start 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b0004810 0x7fa5c8151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 0x7fa5c80b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b1fd0 con 0x7fa5c80c9510 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8152490 con 0x7fa5c80b1610 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cdd1d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80cb1f0 con 0x7fa5b0004810 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50558/0 (socket says 172.21.15.26:50558) 2023-10-09T11:42:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1199769607 learned_addr learned my addr 172.21.15.26:0/1199769607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5ccd1b700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b0004810 0x7fa5c8151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cd51c700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 0x7fa5c80b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b0004810 msgr2=0x7fa5c8151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b0004810 0x7fa5c8151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 msgr2=0x7fa5c80b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 0x7fa5c80b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5c7fff700 1 -- 172.21.15.26:0/1199769607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80cb4d0 con 0x7fa5c80c9510 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.270+0000 7fa5cd51c700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 0x7fa5c80b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5c7fff700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc001ed0 tx=0x7fa5bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc000c30 con 0x7fa5c80c9510 2023-10-09T11:42:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc001650 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c80cb7b0 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc007320 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.271+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80cbd70 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.272+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c804c3c0 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.272+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa5bc007690 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.273+0000 7fa5c4ff9700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 0x7fa5b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.273+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5bc085770 con 0x7fa5c80c9510 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.273+0000 7fa5ccd1b700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 0x7fa5b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.273+0000 7fa5ccd1b700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 0x7fa5b40697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80b2300 tx=0x7fa5c000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.277+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5bc0524d0 con 0x7fa5c80c9510 2023-10-09T11:42:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.514+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5c815bb50 con 0x7fa5c80c9510 2023-10-09T11:42:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.514+0000 7fa5c4ff9700 1 -- 172.21.15.26:0/1199769607 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5bc017020 con 0x7fa5c80c9510 2023-10-09T11:42:12.516 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 msgr2=0x7fa5b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 0x7fa5b40697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80b2300 tx=0x7fa5c000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 msgr2=0x7fa5c80c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc001ed0 tx=0x7fa5bc015000 comp rx=0 tx=0).stop 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 shutdown_connections 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c80b1610 0x7fa5c80b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5b4067320 0x7fa5b40697d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5b0004810 0x7fa5c8151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 --2- 172.21.15.26:0/1199769607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c80c9510 0x7fa5c80c9960 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 >> 172.21.15.26:0/1199769607 conn(0x7fa5c80703a0 msgr2=0x7fa5c8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.516+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 shutdown_connections 2023-10-09T11:42:12.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:12.517+0000 7fa5cdd1d700 1 -- 172.21.15.26:0/1199769607 wait complete. 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:12.530 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:12.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.531 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:42:12.549 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:12.550 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42074sec preferred_lft 42074sec 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:12.551 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:12.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.553 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:12.617 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.619 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:42:12.677 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:42:12.677 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:12.678 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:42:12.678 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:42:12.678 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:12.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.678 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:42:12.678 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:42:12.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:42:12.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:42:12.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:42:12.679 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:42:12.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.789 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:42:12.804 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:42:12.804 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:42:12.804 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:12.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:12.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:42:12.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:12.871 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:12.926 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:12.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:12.927 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:12.981 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:42:12.982 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:12.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:13.063 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:13.063 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:13.082 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:42:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:42:13.106 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:13.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:13.106 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:13.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:42:13.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.302+0000 7f1020e25700 1 Processor -- start 2023-10-09T11:42:13.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.302+0000 7f1020e25700 1 -- start start 2023-10-09T11:42:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 0x7f101c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c06dcf0 0x7f101c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f101c159e40 0x7f101c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c0ccfd0 con 0x7f101c159e40 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c15a410 con 0x7f101c159530 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f1020e25700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c15a6f0 con 0x7f101c06dcf0 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f101ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f101c159e40 0x7f101c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f101ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f101c159e40 0x7f101c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50564/0 (socket says 172.21.15.26:50564) 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.303+0000 7f101ad9d700 1 -- 172.21.15.26:0/429165184 learned_addr learned my addr 172.21.15.26:0/429165184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101a59c700 1 --2- 172.21.15.26:0/429165184 >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 0x7f101c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f1019d9b700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c06dcf0 0x7f101c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 -- 172.21.15.26:0/429165184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c06dcf0 msgr2=0x7f101c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c06dcf0 0x7f101c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 -- 172.21.15.26:0/429165184 >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 msgr2=0x7f101c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 --2- 172.21.15.26:0/429165184 >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 0x7f101c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 -- 172.21.15.26:0/429165184 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c15a9d0 con 0x7f101c159e40 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101a59c700 1 --2- 172.21.15.26:0/429165184 >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 0x7f101c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101ad9d700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159e40 0x7f101c0cb6f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f101c06d630 tx=0x7f1014009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3345cc0f8a4ff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101959a700 1 -- 172.21.15.26:0/429165184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101400e070 con 0x7f101c159e40 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101959a700 1 -- 172.21.15.26:0/429165184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101400ba50 con 0x7f101c159e40 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.304+0000 7f101959a700 1 -- 172.21.15.26:0/429165184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10140092e0 con 0x7f101c159e40 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 -- 172.21.15.26:0/429165184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159e40 msgr2=0x7f101c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159e40 0x7f101c0cb6f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f101c06d630 tx=0x7f1014009840 comp rx=0 tx=0).stop 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 -- 172.21.15.26:0/429165184 shutdown_connections 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 --2- 172.21.15.26:0/429165184 >> v2:172.21.15.67:3300/0 conn(0x7f101c159530 0x7f101c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159e40 0x7f101c0cb6f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 --2- 172.21.15.26:0/429165184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c06dcf0 0x7f101c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 -- 172.21.15.26:0/429165184 >> 172.21.15.26:0/429165184 conn(0x7f101c0703a0 msgr2=0x7f101c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 -- 172.21.15.26:0/429165184 shutdown_connections 2023-10-09T11:42:13.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.305+0000 7f1020e25700 1 -- 172.21.15.26:0/429165184 wait complete. 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.306+0000 7f1020e25700 1 Processor -- start 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.306+0000 7f1020e25700 1 -- start start 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f101c06dcf0 0x7f101c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c159e40 0x7f101c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c15ca60 con 0x7f101c159530 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0b44e0 con 0x7f101c06dcf0 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1020e25700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0b47c0 con 0x7f101c159e40 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f101a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f101c06dcf0 0x7f101c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50576/0 (socket says 172.21.15.26:50576) 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 -- 172.21.15.26:0/806606450 learned_addr learned my addr 172.21.15.26:0/806606450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f101ad9d700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c159e40 0x7f101c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 -- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c159e40 msgr2=0x7f101c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c159e40 0x7f101c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 -- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f101c06dcf0 msgr2=0x7f101c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f101c06dcf0 0x7f101c0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 -- 172.21.15.26:0/806606450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1014009ae0 con 0x7f101c159530 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f1019d9b700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f100400d890 tx=0x7f1004008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040125f0 con 0x7f101c159530 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.307+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004012750 con 0x7f101c159530 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.308+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c0b4aa0 con 0x7f101c159530 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.308+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004012af0 con 0x7f101c159530 2023-10-09T11:42:13.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.308+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0c7790 con 0x7f101c159530 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.308+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c0b4c90 con 0x7f101c159530 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.309+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f100401e460 con 0x7f101c159530 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.309+0000 7f10127fc700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 0x7f0ffc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.309+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10040851a0 con 0x7f101c159530 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.310+0000 7f101a59c700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 0x7f0ffc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.310+0000 7f101a59c700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 0x7f0ffc0697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f100c006f00 tx=0x7f100c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.314+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1004051e30 con 0x7f101c159530 2023-10-09T11:42:13.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:13.551+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f101c04c3c0 con 0x7f101c159530 2023-10-09T11:42:14.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.212+0000 7f10127fc700 1 -- 172.21.15.26:0/806606450 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1004055450 con 0x7f101c159530 2023-10-09T11:42:14.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.214+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 msgr2=0x7f0ffc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.214+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 0x7f0ffc0697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f100c006f00 tx=0x7f100c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.214+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 msgr2=0x7f101c0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.214+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f100400d890 tx=0x7f1004008040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 shutdown_connections 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ffc067320 0x7f0ffc0697d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f101c159e40 0x7f101c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f101c06dcf0 0x7f101c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 --2- 172.21.15.26:0/806606450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101c159530 0x7f101c0b2860 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 >> 172.21.15.26:0/806606450 conn(0x7f101c0703a0 msgr2=0x7f101c0c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 shutdown_connections 2023-10-09T11:42:14.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.215+0000 7f1020e25700 1 -- 172.21.15.26:0/806606450 wait complete. 2023-10-09T11:42:14.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.352+0000 7f0651c23700 1 Processor -- start 2023-10-09T11:42:14.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.353+0000 7f0651c23700 1 -- start start 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.353+0000 7f0651c23700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f064c0a8be0 0x7f064c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.353+0000 7f0651c23700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0ce1a0 con 0x7f064c06d280 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.353+0000 7f0651c23700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0cd5d0 con 0x7f064c0aee90 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.353+0000 7f0651c23700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0cd870 con 0x7f064c0a8be0 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f064c06d280 0x7f064c0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43178/0 (socket says 172.21.15.26:43178) 2023-10-09T11:42:14.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064affd700 1 -- 172.21.15.26:0/2416386283 learned_addr learned my addr 172.21.15.26:0/2416386283 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064b7fe700 1 --2- 172.21.15.26:0/2416386283 >> v2:172.21.15.67:3300/0 conn(0x7f064c0a8be0 0x7f064c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858418517 0 0) 0x7f064c0ce1a0 con 0x7f064c06d280 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0634003570 con 0x7f064c06d280 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397624016 0 0) 0x7f0634003570 con 0x7f064c06d280 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 >> v2:172.21.15.67:3300/0 conn(0x7f064c0a8be0 msgr2=0x7f064c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 --2- 172.21.15.26:0/2416386283 >> v2:172.21.15.67:3300/0 conn(0x7f064c0a8be0 0x7f064c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 >> v1:172.21.15.67:6789/0 conn(0x7f064c0aee90 legacy=0x7f064c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0cdb50 con 0x7f064c06d280 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f06400015f0 con 0x7f064c06d280 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 >> v1:172.21.15.26:6789/0 conn(0x7f064c06d280 legacy=0x7f064c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634003a60 0x7f0634003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0cd870 con 0x7f06340051c0 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063400c0d0 con 0x7f0634004810 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063400c290 con 0x7f0634003a60 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064bfff700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064affd700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.354+0000 7f064b7fe700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634003a60 0x7f0634003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 -- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634003a60 msgr2=0x7f0634003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634003a60 0x7f0634003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 -- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634004810 msgr2=0x7f0634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 -- 172.21.15.26:0/2416386283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634003570 con 0x7f06340051c0 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 -- 172.21.15.26:0/2416386283 reap_dead start 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064bfff700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f063400ba60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0644001f90 tx=0x7f0644001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f35310cfd7b9f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644001950 con 0x7f06340051c0 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400c8b0 con 0x7f06340051c0 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f064a7fc700 1 -- 172.21.15.26:0/2416386283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400cc50 con 0x7f06340051c0 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f0651c23700 1 -- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 msgr2=0x7f063400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f0651c23700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f063400ba60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0644001f90 tx=0x7f0644001640 comp rx=0 tx=0).stop 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f0651c23700 1 -- 172.21.15.26:0/2416386283 shutdown_connections 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f0651c23700 1 --2- 172.21.15.26:0/2416386283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.355+0000 7f0651c23700 1 -- 172.21.15.26:0/2416386283 >> 172.21.15.26:0/2416386283 conn(0x7f064c06ce80 msgr2=0x7f064c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.356+0000 7f0651c23700 1 -- 172.21.15.26:0/2416386283 shutdown_connections 2023-10-09T11:42:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.356+0000 7f0651c23700 1 -- 172.21.15.26:0/2416386283 wait complete. 2023-10-09T11:42:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 Processor -- start 2023-10-09T11:42:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 -- start start 2023-10-09T11:42:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 0x7f064c099260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 0x7f064c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0997a0 con 0x7f06340051c0 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c09a5c0 con 0x7f064c0b24f0 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.357+0000 7f0651c23700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0999b0 con 0x7f064c09aa50 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50588/0 (socket says 172.21.15.26:50588) 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 -- 172.21.15.26:0/1245097937 learned_addr learned my addr 172.21.15.26:0/1245097937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064bfff700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 0x7f064c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064affd700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 0x7f064c099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 -- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 msgr2=0x7f064c099260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 0x7f064c099260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 -- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 msgr2=0x7f064c0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 0x7f064c0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 -- 172.21.15.26:0/1245097937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c099c90 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064bfff700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 0x7f064c0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064affd700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 0x7f064c099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f064b7fe700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f063c011a40 tx=0x7f063c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c005c10 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c005d70 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c099f70 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00f900 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.358+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c1594b0 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.359+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c04c3c0 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.360+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f063c00fd30 con 0x7f06340051c0 2023-10-09T11:42:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.360+0000 7f06337fe700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 0x7f06380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.360+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f063c085620 con 0x7f06340051c0 2023-10-09T11:42:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.360+0000 7f064affd700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 0x7f06380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.361+0000 7f064affd700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 0x7f06380697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0640007a30 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.365+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f063c0522b0 con 0x7f06340051c0 2023-10-09T11:42:14.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.586+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f064c09a700 con 0x7f0638067320 2023-10-09T11:42:14.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.588+0000 7f06337fe700 1 -- 172.21.15.26:0/1245097937 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0640007df0 con 0x7f0638067320 2023-10-09T11:42:14.589 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:14.589 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:14.590 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:42:14.590 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:14.590 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 msgr2=0x7f06380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 0x7f06380697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0640007a30 tx=0x7f0640009040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 msgr2=0x7f064c09bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f063c011a40 tx=0x7f063c009120 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 shutdown_connections 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c0b24f0 0x7f064c0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06340051c0 0x7f064c09bd30 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0638067320 0x7f06380697d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 --2- 172.21.15.26:0/1245097937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f064c09aa50 0x7f064c099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 >> 172.21.15.26:0/1245097937 conn(0x7f064c06ce80 msgr2=0x7f064c0ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 shutdown_connections 2023-10-09T11:42:14.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.590+0000 7f0651c23700 1 -- 172.21.15.26:0/1245097937 wait complete. 2023-10-09T11:42:14.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:42:14.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.723+0000 7fe6459ef700 1 Processor -- start 2023-10-09T11:42:14.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.723+0000 7fe6459ef700 1 -- start start 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe6459ef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640159860 0x7fe6400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe6459ef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe6459ef700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400cf510 con 0x7fe6400cbd90 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe6459ef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400d00b0 con 0x7fe640159860 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe6459ef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400cc210 con 0x7fe6400ccfa0 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe63effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640159860 0x7fe6400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe63e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6400cbd90 0x7fe6400cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43186/0 (socket says 172.21.15.26:43186) 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe63effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe640159860 0x7fe6400ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50590/0 (socket says 172.21.15.26:50590) 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.724+0000 7fe63e7fc700 1 -- 172.21.15.26:0/2179989145 learned_addr learned my addr 172.21.15.26:0/2179989145 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63effd700 1 -- 172.21.15.26:0/2179989145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 msgr2=0x7fe6400cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63effd700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63effd700 1 -- 172.21.15.26:0/2179989145 >> v1:172.21.15.26:6789/0 conn(0x7fe6400cbd90 legacy=0x7fe6400cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63dffb700 1 -- 172.21.15.26:0/2179989145 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645360038 0 0) 0x7fe6400cf510 con 0x7fe6400cbd90 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63effd700 1 -- 172.21.15.26:0/2179989145 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400cd960 con 0x7fe640159860 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63effd700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe6400ce220 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe6380098d0 tx=0x7fe638009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f3c6cbed338ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63dffb700 1 -- 172.21.15.26:0/2179989145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638009e70 con 0x7fe640159860 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63dffb700 1 -- 172.21.15.26:0/2179989145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe638005c10 con 0x7fe640159860 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe63dffb700 1 -- 172.21.15.26:0/2179989145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63800b650 con 0x7fe640159860 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 -- 172.21.15.26:0/2179989145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 msgr2=0x7fe6400ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe6400ce220 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe6380098d0 tx=0x7fe638009120 comp rx=0 tx=0).stop 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 -- 172.21.15.26:0/2179989145 shutdown_connections 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2179989145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe6400ce220 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.725+0000 7fe6459ef700 1 -- 172.21.15.26:0/2179989145 >> 172.21.15.26:0/2179989145 conn(0x7fe6400999b0 msgr2=0x7fe640070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.726+0000 7fe6459ef700 1 -- 172.21.15.26:0/2179989145 shutdown_connections 2023-10-09T11:42:14.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.726+0000 7fe6459ef700 1 -- 172.21.15.26:0/2179989145 wait complete. 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.727+0000 7fe6459ef700 1 Processor -- start 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.727+0000 7fe6459ef700 1 -- start start 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.727+0000 7fe6459ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6400cbd90 0x7fe640158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.727+0000 7fe6459ef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.727+0000 7fe6459ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe6459ef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64009c020 con 0x7fe640159860 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe6459ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640159150 con 0x7fe6400cbd90 2023-10-09T11:42:14.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe6459ef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400c9400 con 0x7fe6400ccfa0 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50598/0 (socket says 172.21.15.26:50598) 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 -- 172.21.15.26:0/2051534459 learned_addr learned my addr 172.21.15.26:0/2051534459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63e7fc700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63effd700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6400cbd90 0x7fe640158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 -- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 msgr2=0x7fe6400ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 -- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6400cbd90 msgr2=0x7fe640158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6400cbd90 0x7fe640158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 -- 172.21.15.26:0/2051534459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380093c0 con 0x7fe640159860 2023-10-09T11:42:14.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63e7fc700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe63f7fe700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe63000a380 tx=0x7fe630007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630015440 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6300155a0 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6400c96e0 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630015960 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.728+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6400c90d0 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.729+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64009bdf0 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.730+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe63000d440 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.730+0000 7fe636ffd700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 0x7fe6200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.730+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe630085800 con 0x7fe640159860 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.730+0000 7fe63effd700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 0x7fe6200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.731+0000 7fe63effd700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 0x7fe6200697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe638009160 tx=0x7fe638016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.735+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe64009bdf0 con 0x7fe640159860 2023-10-09T11:42:14.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.927+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe64009bdf0 con 0x7fe640159860 2023-10-09T11:42:14.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.927+0000 7fe636ffd700 1 -- 172.21.15.26:0/2051534459 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe64009bdf0 con 0x7fe640159860 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 msgr2=0x7fe6200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 0x7fe6200697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe638009160 tx=0x7fe638016000 comp rx=0 tx=0).stop 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 msgr2=0x7fe64015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe63000a380 tx=0x7fe630007900 comp rx=0 tx=0).stop 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 shutdown_connections 2023-10-09T11:42:14.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.929+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe640159860 0x7fe64015bd80 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6400cbd90 0x7fe640158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe620067320 0x7fe6200697d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 --2- 172.21.15.26:0/2051534459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe6400ccfa0 0x7fe6400ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 >> 172.21.15.26:0/2051534459 conn(0x7fe6400999b0 msgr2=0x7fe6400b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 shutdown_connections 2023-10-09T11:42:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:14.930+0000 7fe6459ef700 1 -- 172.21.15.26:0/2051534459 wait complete. 2023-10-09T11:42:14.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.061+0000 7f12a5d8d700 1 Processor -- start 2023-10-09T11:42:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.061+0000 7f12a5d8d700 1 -- start start 2023-10-09T11:42:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a5d8d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f12a00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a5d8d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a015afd0 con 0x7f12a0153c30 2023-10-09T11:42:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a5d8d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a015b2b0 con 0x7f12a00cef40 2023-10-09T11:42:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a5d8d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a015b590 con 0x7f12a015de50 2023-10-09T11:42:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a4d8b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f12a0153c30 0x7f12a015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43196/0 (socket says 172.21.15.26:43196) 2023-10-09T11:42:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f12a4d8b700 1 -- 172.21.15.26:0/382055747 learned_addr learned my addr 172.21.15.26:0/382055747 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916642566 0 0) 0x7f12a015afd0 con 0x7f12a0153c30 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c003570 con 0x7f12a0153c30 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.062+0000 7f129ffff700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f12a00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771099024 0 0) 0x7f128c003570 con 0x7f12a0153c30 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 msgr2=0x7f12a00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f12a00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 >> v1:172.21.15.67:6789/0 conn(0x7f12a00cef40 legacy=0x7f12a015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a015b870 con 0x7f12a0153c30 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f1298001470 con 0x7f12a0153c30 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 >> v1:172.21.15.26:6789/0 conn(0x7f12a0153c30 legacy=0x7f12a015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f128c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128c004010 0x7f128c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f128c004d50 0x7f128c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a015b590 con 0x7f128c004010 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c00bbf0 con 0x7f128c004d50 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c00bdb0 con 0x7f12a015de50 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128c004010 0x7f128c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f12a4d8b700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f128c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f12a558c700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f128c004d50 0x7f128c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 -- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 msgr2=0x7f128c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12a015de50 0x7f128c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 -- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f128c004d50 msgr2=0x7f128c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f128c004d50 0x7f128c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 -- 172.21.15.26:0/382055747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c003570 con 0x7f128c004010 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.063+0000 7f129ffff700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128c004010 0x7f128c004810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f12900094d0 tx=0x7f129000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e48aefc52c78c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000ea90 con 0x7f128c004010 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000f040 con 0x7f128c004010 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f129f7fe700 1 -- 172.21.15.26:0/382055747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000ee40 con 0x7f128c004010 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 -- 172.21.15.26:0/382055747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128c004010 msgr2=0x7f128c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/382055747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128c004010 0x7f128c004810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f12900094d0 tx=0x7f129000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a558c700 1 -- 172.21.15.26:0/382055747 reap_dead start 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 -- 172.21.15.26:0/382055747 shutdown_connections 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 -- 172.21.15.26:0/382055747 >> 172.21.15.26:0/382055747 conn(0x7f12a00703a0 msgr2=0x7f12a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 -- 172.21.15.26:0/382055747 shutdown_connections 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.064+0000 7f12a5d8d700 1 -- 172.21.15.26:0/382055747 wait complete. 2023-10-09T11:42:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.065+0000 7f12a5d8d700 1 Processor -- start 2023-10-09T11:42:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.065+0000 7f12a5d8d700 1 -- start start 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f128c004010 0x7f12a0150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a00cc5c0 0x7f12a00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c81d0 con 0x7f12a00b1cb0 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00ccf70 con 0x7f12a00cc5c0 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a5d8d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c75e0 con 0x7f128c004010 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a558c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a558c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50620/0 (socket says 172.21.15.26:50620) 2023-10-09T11:42:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a558c700 1 -- 172.21.15.26:0/113373786 learned_addr learned my addr 172.21.15.26:0/113373786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f12a4d8b700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f128c004010 0x7f12a0150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.066+0000 7f129ffff700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a00cc5c0 0x7f12a00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 -- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f128c004010 msgr2=0x7f12a0150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f128c004010 0x7f12a0150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 -- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a00cc5c0 msgr2=0x7f12a00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a00cc5c0 0x7f12a00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 -- 172.21.15.26:0/113373786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00c78a0 con 0x7f12a00b1cb0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a558c700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f12a0159c60 tx=0x7f1288007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288006a30 con 0x7f12a00b1cb0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288006bb0 con 0x7f12a00b1cb0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a00c7b80 con 0x7f12a00b1cb0 2023-10-09T11:42:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288007030 con 0x7f12a00b1cb0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.067+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a00b2690 con 0x7f12a00b1cb0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.068+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a00c8380 con 0x7f12a00b1cb0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.068+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f12880073a0 con 0x7f12a00b1cb0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.069+0000 7f129cff9700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 0x7f12800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.069+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1288084210 con 0x7f12a00b1cb0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.069+0000 7f12a4d8b700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 0x7f12800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.070+0000 7f12a4d8b700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 0x7f12800697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1298000e50 tx=0x7f1298001e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.073+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a00c8380 con 0x7f12a00b1cb0 2023-10-09T11:42:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.298+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a00c8380 con 0x7f1280067320 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.300+0000 7f129cff9700 1 -- 172.21.15.26:0/113373786 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f12a00c8380 con 0x7f1280067320 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:15.301 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.301+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 msgr2=0x7f12800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.301+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 0x7f12800697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1298000e50 tx=0x7f1298001e50 comp rx=0 tx=0).stop 2023-10-09T11:42:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 msgr2=0x7f12a00b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f12a0159c60 tx=0x7f1288007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 shutdown_connections 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a00b1cb0 0x7f12a00b2150 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1280067320 0x7f12800697d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f128c004010 0x7f12a0150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 --2- 172.21.15.26:0/113373786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a00cc5c0 0x7f12a00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 >> 172.21.15.26:0/113373786 conn(0x7f12a00703a0 msgr2=0x7f12a00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 shutdown_connections 2023-10-09T11:42:15.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.302+0000 7f12a5d8d700 1 -- 172.21.15.26:0/113373786 wait complete. 2023-10-09T11:42:15.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001023389 2023-10-09T11:42:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.434+0000 7fd5316d2700 1 Processor -- start 2023-10-09T11:42:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.434+0000 7fd5316d2700 1 -- start start 2023-10-09T11:42:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd5316d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c159530 0x7fd52c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd5316d2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd52c06dc70 0x7fd52c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd5316d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c0ccfd0 con 0x7fd52c06e0e0 2023-10-09T11:42:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd5316d2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c0cf0e0 con 0x7fd52c06dc70 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd5316d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c15a3d0 con 0x7fd52c159530 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd52a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd52c06dc70 0x7fd52c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd52a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd52c06dc70 0x7fd52c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50622/0 (socket says 172.21.15.26:50622) 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.435+0000 7fd52a7fc700 1 -- 172.21.15.26:0/3126139876 learned_addr learned my addr 172.21.15.26:0/3126139876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52affd700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c159530 0x7fd52c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52a7fc700 1 -- 172.21.15.26:0/3126139876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c159530 msgr2=0x7fd52c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52a7fc700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c159530 0x7fd52c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52a7fc700 1 -- 172.21.15.26:0/3126139876 >> v1:172.21.15.26:6789/0 conn(0x7fd52c06e0e0 legacy=0x7fd52c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52a7fc700 1 -- 172.21.15.26:0/3126139876 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c15a6b0 con 0x7fd52c06dc70 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd529ffb700 1 -- 172.21.15.26:0/3126139876 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420422603 0 0) 0x7fd52c0ccfd0 con 0x7fd52c06e0e0 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd52a7fc700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c159900 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd5140099b0 tx=0x7fd514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320ba51a6cdaffcb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd529ffb700 1 -- 172.21.15.26:0/3126139876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400b860 con 0x7fd52c06dc70 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd529ffb700 1 -- 172.21.15.26:0/3126139876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400b9c0 con 0x7fd52c06dc70 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.436+0000 7fd529ffb700 1 -- 172.21.15.26:0/3126139876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400bd60 con 0x7fd52c06dc70 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 -- 172.21.15.26:0/3126139876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 msgr2=0x7fd52c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c159900 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd5140099b0 tx=0x7fd514009250 comp rx=0 tx=0).stop 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 -- 172.21.15.26:0/3126139876 shutdown_connections 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c159530 0x7fd52c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 --2- 172.21.15.26:0/3126139876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c159900 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 -- 172.21.15.26:0/3126139876 >> 172.21.15.26:0/3126139876 conn(0x7fd52c0703a0 msgr2=0x7fd52c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 -- 172.21.15.26:0/3126139876 shutdown_connections 2023-10-09T11:42:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.437+0000 7fd5316d2700 1 -- 172.21.15.26:0/3126139876 wait complete. 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.438+0000 7fd5316d2700 1 Processor -- start 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.438+0000 7fd5316d2700 1 -- start start 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c06e0e0 0x7fd52c0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 0x7fd52c16c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c86a0 con 0x7fd52c06dc70 2023-10-09T11:42:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c8980 con 0x7fd52c159530 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd5316d2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c8c60 con 0x7fd52c06e0e0 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50638/0 (socket says 172.21.15.26:50638) 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 -- 172.21.15.26:0/4171452557 learned_addr learned my addr 172.21.15.26:0/4171452557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 -- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c06e0e0 msgr2=0x7fd52c0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52b7fe700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 0x7fd52c16c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52a7fc700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c06e0e0 0x7fd52c0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c06e0e0 0x7fd52c0cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 -- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 msgr2=0x7fd52c16c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 0x7fd52c16c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 -- 172.21.15.26:0/4171452557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140094f0 con 0x7fd52c06dc70 2023-10-09T11:42:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52b7fe700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 0x7fd52c16c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd52affd700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d860 tx=0x7fd524008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.439+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524009610 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.440+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524009770 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.440+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c0c8f40 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.440+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524009b30 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.440+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c157570 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.440+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c04c3c0 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.441+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd52401e460 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.441+0000 7fd522ffd700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 0x7fd50c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.441+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5240852e0 con 0x7fd52c06dc70 2023-10-09T11:42:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.442+0000 7fd52a7fc700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 0x7fd50c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.442+0000 7fd52a7fc700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 0x7fd50c0697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd5140099b0 tx=0x7fd514017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.446+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd524051f70 con 0x7fd52c06dc70 2023-10-09T11:42:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:15.670+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001023389", "target": ["mon-mgr", ""]}) v1 -- 0x7fd52c0c8af0 con 0x7fd50c067320 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.247+0000 7fd522ffd700 1 -- 172.21.15.26:0/4171452557 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fd52c0c8af0 con 0x7fd50c067320 2023-10-09T11:42:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.252+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 msgr2=0x7fd50c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.252+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 0x7fd50c0697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd5140099b0 tx=0x7fd514017000 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.252+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 msgr2=0x7fd52c157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.252+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d860 tx=0x7fd524008040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 shutdown_connections 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c159530 0x7fd52c16c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c06dc70 0x7fd52c157030 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd50c067320 0x7fd50c0697d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 --2- 172.21.15.26:0/4171452557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd52c06e0e0 0x7fd52c0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 >> 172.21.15.26:0/4171452557 conn(0x7fd52c0703a0 msgr2=0x7fd52c15f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.253+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 shutdown_connections 2023-10-09T11:42:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.254+0000 7fd5316d2700 1 -- 172.21.15.26:0/4171452557 wait complete. 2023-10-09T11:42:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T11:42:18.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001023390 2023-10-09T11:42:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.400+0000 7f768b2d5700 1 Processor -- start 2023-10-09T11:42:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.400+0000 7f768b2d5700 1 -- start start 2023-10-09T11:42:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f768b2d5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f768413c9b0 0x7f7684069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f768b2d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f7684069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f768b2d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768406d7b0 con 0x7f76840cc320 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f768b2d5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768406f7d0 con 0x7f768413c9b0 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f768b2d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768406e330 con 0x7f76840cc6f0 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f7689071700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f76840cc320 0x7f768413c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43212/0 (socket says 172.21.15.26:43212) 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f7689071700 1 -- 172.21.15.26:0/315109926 learned_addr learned my addr 172.21.15.26:0/315109926 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f7689872700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f7684069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891310981 0 0) 0x7f768406d7b0 con 0x7f76840cc320 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f7688870700 1 --2- 172.21.15.26:0/315109926 >> v2:172.21.15.67:3300/0 conn(0x7f768413c9b0 0x7f7684069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7670003570 con 0x7f76840cc320 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699430171 0 0) 0x7f7670003570 con 0x7f76840cc320 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 msgr2=0x7f7684069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f7684069f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 >> v2:172.21.15.67:3300/0 conn(0x7f768413c9b0 msgr2=0x7f7684069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.401+0000 7f767bfff700 1 --2- 172.21.15.26:0/315109926 >> v2:172.21.15.67:3300/0 conn(0x7f768413c9b0 0x7f7684069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768406da00 con 0x7f76840cc320 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f7680001470 con 0x7f76840cc320 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 >> v1:172.21.15.26:6789/0 conn(0x7f76840cc320 legacy=0x7f768413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670003a60 0x7f7670003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7670004810 0x7f7670004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f76700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768406f7d0 con 0x7f7670004810 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768406e330 con 0x7f7670003a60 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767000ba60 con 0x7f76840cc6f0 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7670004810 0x7f7670004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7689071700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670003a60 0x7f7670003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7689872700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f76700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 -- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 msgr2=0x7f76700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76840cc6f0 0x7f76700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 -- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670003a60 msgr2=0x7f7670003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670003a60 0x7f7670003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 -- 172.21.15.26:0/315109926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670003570 con 0x7f7670004810 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f7688870700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7670004810 0x7f7670004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7674009c00 tx=0x7f76740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac4c3dbad1bf7c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400e710 con 0x7f7670004810 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400e870 con 0x7f7670004810 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.402+0000 7f767bfff700 1 -- 172.21.15.26:0/315109926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400ec30 con 0x7f7670004810 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 -- 172.21.15.26:0/315109926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7670004810 msgr2=0x7f7670004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 --2- 172.21.15.26:0/315109926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7670004810 0x7f7670004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7674009c00 tx=0x7f76740091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f7689872700 1 -- 172.21.15.26:0/315109926 reap_dead start 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 -- 172.21.15.26:0/315109926 shutdown_connections 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 -- 172.21.15.26:0/315109926 >> 172.21.15.26:0/315109926 conn(0x7f7684067f00 msgr2=0x7f7684068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 -- 172.21.15.26:0/315109926 shutdown_connections 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.403+0000 7f768b2d5700 1 -- 172.21.15.26:0/315109926 wait complete. 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.404+0000 7f768b2d5700 1 Processor -- start 2023-10-09T11:42:18.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.404+0000 7f768b2d5700 1 -- start start 2023-10-09T11:42:18.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670004810 0x7f768416d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f768413b810 0x7f7684169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768416d350 con 0x7f7684136db0 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768416a200 con 0x7f7670004810 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f768b2d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768416a4e0 con 0x7f768413b810 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50660/0 (socket says 172.21.15.26:50660) 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 -- 172.21.15.26:0/1826272784 learned_addr learned my addr 172.21.15.26:0/1826272784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689071700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670004810 0x7f768416d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7688870700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f768413b810 0x7f7684169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 -- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f768413b810 msgr2=0x7f7684169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f768413b810 0x7f7684169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 -- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670004810 msgr2=0x7f768416d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670004810 0x7f768416d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.405+0000 7f7689872700 1 -- 172.21.15.26:0/1826272784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768416cfe0 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f7689872700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f768406aa30 tx=0x7f767c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00e040 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00f040 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768416dd20 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00fd70 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.406+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7684169e80 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.407+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768404c3c0 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.407+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f767c015640 con 0x7f7684136db0 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.408+0000 7f76797fa700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 0x7f76680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.408+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f767c0857d0 con 0x7f7684136db0 2023-10-09T11:42:18.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.408+0000 7f7689071700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 0x7f76680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.409+0000 7f7689071700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 0x7f76680697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7684142f40 tx=0x7f7680001e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.412+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f767c051f90 con 0x7f7684136db0 2023-10-09T11:42:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:18.633+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001023390", "target": ["mon-mgr", ""]}) v1 -- 0x7f768406dce0 con 0x7f7668067320 2023-10-09T11:42:20.948 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-10-09T11:42:20.947+0000 7fe902fad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:21.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.285+0000 7f76797fa700 1 -- 172.21.15.26:0/1826272784 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f768406dce0 con 0x7f7668067320 2023-10-09T11:42:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 msgr2=0x7f76680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 0x7f76680697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7684142f40 tx=0x7f7680001e90 comp rx=0 tx=0).stop 2023-10-09T11:42:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 msgr2=0x7f7684069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f768406aa30 tx=0x7f767c00b040 comp rx=0 tx=0).stop 2023-10-09T11:42:21.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 shutdown_connections 2023-10-09T11:42:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684136db0 0x7f7684069680 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7670004810 0x7f768416d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7668067320 0x7f76680697d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 --2- 172.21.15.26:0/1826272784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f768413b810 0x7f7684169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.291+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 >> 172.21.15.26:0/1826272784 conn(0x7f7684067f00 msgr2=0x7f7684153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.294+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 shutdown_connections 2023-10-09T11:42:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.294+0000 7f768b2d5700 1 -- 172.21.15.26:0/1826272784 wait complete. 2023-10-09T11:42:21.298 INFO:teuthology.orchestra.run.smithi026.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T11:42:21.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.436+0000 7f39b0a25700 1 Processor -- start 2023-10-09T11:42:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.436+0000 7f39b0a25700 1 -- start start 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39b0a25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39ac157600 0x7f39ac0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39b0a25700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac158210 con 0x7f39ac1579d0 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39b0a25700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac0cb290 con 0x7f39ac0ccba0 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39b0a25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ac0cb850 con 0x7f39ac157600 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39aa59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39ac157600 0x7f39ac0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39a9d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f39ac1579d0 0x7f39ac1586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51162/0 (socket says 172.21.15.26:51162) 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39aa59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39ac157600 0x7f39ac0b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47324/0 (socket says 172.21.15.26:47324) 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39a9d9b700 1 -- 172.21.15.26:0/3603470087 learned_addr learned my addr 172.21.15.26:0/3603470087 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39aa59c700 1 -- 172.21.15.26:0/3603470087 >> v1:172.21.15.67:6789/0 conn(0x7f39ac0ccba0 legacy=0x7f39ac158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.437+0000 7f39aa59c700 1 -- 172.21.15.26:0/3603470087 >> v1:172.21.15.26:6789/0 conn(0x7f39ac1579d0 legacy=0x7f39ac1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39aa59c700 1 -- 172.21.15.26:0/3603470087 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0cb570 con 0x7f39ac157600 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39a959a700 1 -- 172.21.15.26:0/3603470087 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326346438 0 0) 0x7f39ac158210 con 0x7f39ac1579d0 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39aa59c700 1 --2- 172.21.15.26:0/3603470087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0b1410 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f399c0098e0 tx=0x7f399c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8454562be87b7e5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39a959a700 1 -- 172.21.15.26:0/3603470087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c009e80 con 0x7f39ac157600 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39a959a700 1 -- 172.21.15.26:0/3603470087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00b860 con 0x7f39ac157600 2023-10-09T11:42:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39a959a700 1 -- 172.21.15.26:0/3603470087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00bbe0 con 0x7f39ac157600 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 -- 172.21.15.26:0/3603470087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 msgr2=0x7f39ac0b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 --2- 172.21.15.26:0/3603470087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0b1410 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f399c0098e0 tx=0x7f399c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 -- 172.21.15.26:0/3603470087 shutdown_connections 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 --2- 172.21.15.26:0/3603470087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0b1410 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 -- 172.21.15.26:0/3603470087 >> 172.21.15.26:0/3603470087 conn(0x7f39ac06d170 msgr2=0x7f39ac0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 -- 172.21.15.26:0/3603470087 shutdown_connections 2023-10-09T11:42:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.438+0000 7f39b0a25700 1 -- 172.21.15.26:0/3603470087 wait complete. 2023-10-09T11:42:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 Processor -- start 2023-10-09T11:42:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 -- start start 2023-10-09T11:42:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39ac0ccba0 0x7f39ac145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ac1579d0 0x7f39ac15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac147840 con 0x7f39ac157600 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac146370 con 0x7f39ac1579d0 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39b0a25700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac153850 con 0x7f39ac0ccba0 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.440+0000 7f39a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47334/0 (socket says 172.21.15.26:47334) 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 -- 172.21.15.26:0/2051216745 learned_addr learned my addr 172.21.15.26:0/2051216745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39aa59c700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39ac0ccba0 0x7f39ac145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39aad9d700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ac1579d0 0x7f39ac15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 -- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39ac0ccba0 msgr2=0x7f39ac145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39ac0ccba0 0x7f39ac145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 -- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ac1579d0 msgr2=0x7f39ac15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ac1579d0 0x7f39ac15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 -- 172.21.15.26:0/2051216745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c009420 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39a9d9b700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c560 tx=0x7f39a0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0005b30 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0005c90 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac146950 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0007320 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.441+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac146f10 con 0x7f39ac157600 2023-10-09T11:42:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.442+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac1479f0 con 0x7f39ac157600 2023-10-09T11:42:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.443+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f39a001b3b0 con 0x7f39ac157600 2023-10-09T11:42:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.443+0000 7f399a7fc700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 0x7f398c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.443+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f39a0084740 con 0x7f39ac157600 2023-10-09T11:42:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.443+0000 7f39aa59c700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 0x7f398c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.444+0000 7f39aa59c700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 0x7f398c0697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f399c0093f0 tx=0x7f399c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.448+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ac1479f0 con 0x7f39ac157600 2023-10-09T11:42:21.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.666+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f39ac04c3c0 con 0x7f398c067320 2023-10-09T11:42:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.668+0000 7f399a7fc700 1 -- 172.21.15.26:0/2051216745 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f39ac04c3c0 con 0x7f398c067320 2023-10-09T11:42:21.669 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000001023389" 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000001023390" 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:21.670 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:21.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 msgr2=0x7f398c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 0x7f398c0697d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f399c0093f0 tx=0x7f399c017000 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 msgr2=0x7f39ac0afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c560 tx=0x7f39a0000fe0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 shutdown_connections 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ac1579d0 0x7f39ac15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f398c067320 0x7f398c0697d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39ac0ccba0 0x7f39ac145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 --2- 172.21.15.26:0/2051216745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39ac157600 0x7f39ac0afbc0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 >> 172.21.15.26:0/2051216745 conn(0x7f39ac06d170 msgr2=0x7f39ac15a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:21.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 shutdown_connections 2023-10-09T11:42:21.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.670+0000 7f39b0a25700 1 -- 172.21.15.26:0/2051216745 wait complete. 2023-10-09T11:42:21.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001023389 --yes-i-really-mean-it 2023-10-09T11:42:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.804+0000 7fc0ececc700 1 Processor -- start 2023-10-09T11:42:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.804+0000 7fc0ececc700 1 -- start start 2023-10-09T11:42:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0ececc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0e815ca10 0x7fc0e815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0ececc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 0x7fc0e80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0ececc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e806de30 con 0x7fc0e815cde0 2023-10-09T11:42:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0ececc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80cc9f0 con 0x7fc0e815ca10 2023-10-09T11:42:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0ececc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e806d850 con 0x7fc0e80cc030 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0e815ca10 0x7fc0e815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0e815cde0 0x7fc0e815d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51172/0 (socket says 172.21.15.26:51172) 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e5d9b700 1 -- 172.21.15.26:0/4105736415 learned_addr learned my addr 172.21.15.26:0/4105736415 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e6d9d700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 0x7fc0e80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e659c700 1 -- 172.21.15.26:0/4105736415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 msgr2=0x7fc0e80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e659c700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 0x7fc0e80cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e659c700 1 -- 172.21.15.26:0/4105736415 >> v1:172.21.15.26:6789/0 conn(0x7fc0e815cde0 legacy=0x7fc0e815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e659c700 1 -- 172.21.15.26:0/4105736415 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e815a060 con 0x7fc0e815ca10 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e559a700 1 -- 172.21.15.26:0/4105736415 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591714979 0 0) 0x7fc0e806de30 con 0x7fc0e815cde0 2023-10-09T11:42:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.805+0000 7fc0e6d9d700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 0x7fc0e80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0e659c700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e815ca10 0x7fc0e815ad50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098d0 tx=0x7fc0d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b7e7ab84b60eed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0e559a700 1 -- 172.21.15.26:0/4105736415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8009e70 con 0x7fc0e815ca10 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0e559a700 1 -- 172.21.15.26:0/4105736415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8005c10 con 0x7fc0e815ca10 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0e559a700 1 -- 172.21.15.26:0/4105736415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800b650 con 0x7fc0e815ca10 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 -- 172.21.15.26:0/4105736415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e815ca10 msgr2=0x7fc0e815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e815ca10 0x7fc0e815ad50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098d0 tx=0x7fc0d8009120 comp rx=0 tx=0).stop 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 -- 172.21.15.26:0/4105736415 shutdown_connections 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e80cc030 0x7fc0e80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 --2- 172.21.15.26:0/4105736415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e815ca10 0x7fc0e815ad50 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 -- 172.21.15.26:0/4105736415 >> 172.21.15.26:0/4105736415 conn(0x7fc0e8067dd0 msgr2=0x7fc0e80681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 -- 172.21.15.26:0/4105736415 shutdown_connections 2023-10-09T11:42:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.806+0000 7fc0ececc700 1 -- 172.21.15.26:0/4105736415 wait complete. 2023-10-09T11:42:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.807+0000 7fc0ececc700 1 Processor -- start 2023-10-09T11:42:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 -- start start 2023-10-09T11:42:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 0x7fc0e815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 0x7fc0e81482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8150840 con 0x7fc0e80cc030 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e814f990 con 0x7fc0e815ca10 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0ececc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8151b70 con 0x7fc0e815cde0 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0e659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0e659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47362/0 (socket says 172.21.15.26:47362) 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.808+0000 7fc0e659c700 1 -- 172.21.15.26:0/3038084639 learned_addr learned my addr 172.21.15.26:0/3038084639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e5d9b700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 0x7fc0e815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e6d9d700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 0x7fc0e81482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 -- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 msgr2=0x7fc0e81482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 0x7fc0e81482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 -- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 msgr2=0x7fc0e815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 0x7fc0e815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 -- 172.21.15.26:0/3038084639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80093c0 con 0x7fc0e80cc030 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e5d9b700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 0x7fc0e815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e6d9d700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 0x7fc0e81482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0e659c700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc0e806fdd0 tx=0x7fc0d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8006390 con 0x7fc0e80cc030 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d80064f0 con 0x7fc0e80cc030 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e814fc30 con 0x7fc0e80cc030 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80068b0 con 0x7fc0e80cc030 2023-10-09T11:42:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.809+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e81501f0 con 0x7fc0e80cc030 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.810+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e804c3c0 con 0x7fc0e80cc030 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.811+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc0d801a420 con 0x7fc0e80cc030 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.811+0000 7fc0d67fc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 0x7fc0c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.811+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fc0d8086c70 con 0x7fc0e80cc030 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.811+0000 7fc0e5d9b700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 0x7fc0c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.812+0000 7fc0e5d9b700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 0x7fc0c80697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc0e815c450 tx=0x7fc0dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:21.815+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0d8053200 con 0x7fc0e80cc030 2023-10-09T11:42:22.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:22.038+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001023389", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0e815df10 con 0x7fc0c8067320 2023-10-09T11:42:22.044 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:42:22.043+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:42:22.049 INFO:tasks.ceph.mds.a.smithi026.stderr: -37> 2023-10-09T11:42:20.947+0000 7fe902fad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:22.077 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:42:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.079+0000 7fc0d67fc700 1 -- 172.21.15.26:0/3038084639 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fc0dc001c50 con 0x7fc0c8067320 2023-10-09T11:42:25.081 INFO:teuthology.orchestra.run.smithi026.stdout:metadata pool: cephfs.volume_0000000001023389.meta data pool: ['cephfs.volume_0000000001023389.data'] removed 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 msgr2=0x7fc0c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 0x7fc0c80697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc0e815c450 tx=0x7fc0dc009040 comp rx=0 tx=0).stop 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 msgr2=0x7fc0e8151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc0e806fdd0 tx=0x7fc0d8016000 comp rx=0 tx=0).stop 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 shutdown_connections 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0c8067320 0x7fc0c80697d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0e815cde0 0x7fc0e81482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e80cc030 0x7fc0e8151630 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 --2- 172.21.15.26:0/3038084639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0e815ca10 0x7fc0e815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 >> 172.21.15.26:0/3038084639 conn(0x7fc0e8067dd0 msgr2=0x7fc0e815ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.082+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 shutdown_connections 2023-10-09T11:42:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.083+0000 7fc0ececc700 1 -- 172.21.15.26:0/3038084639 wait complete. 2023-10-09T11:42:25.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001023390 --yes-i-really-mean-it 2023-10-09T11:42:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.227+0000 7f5d73ed8700 1 Processor -- start 2023-10-09T11:42:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.227+0000 7f5d73ed8700 1 -- start start 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d73ed8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d73ed8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d6c06a110 0x7f5d6c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d73ed8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c06d7b0 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d73ed8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c06a590 con 0x7f5d6c06a110 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d73ed8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c06f7d0 con 0x7f5d6c0cc320 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d6c06a110 0x7f5d6c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d71473700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5d6c0cc6f0 0x7f5d6c069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51182/0 (socket says 172.21.15.26:51182) 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d71473700 1 -- 172.21.15.26:0/2669816132 learned_addr learned my addr 172.21.15.26:0/2669816132 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d71c74700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 -- 172.21.15.26:0/2669816132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 msgr2=0x7f5d6c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 -- 172.21.15.26:0/2669816132 >> v1:172.21.15.26:6789/0 conn(0x7f5d6c0cc6f0 legacy=0x7f5d6c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 -- 172.21.15.26:0/2669816132 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c06e330 con 0x7f5d6c06a110 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d70c72700 1 -- 172.21.15.26:0/2669816132 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721350179 0 0) 0x7f5d6c06d7b0 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d72475700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c06a110 0x7f5d6c13c7e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009e60 tx=0x7f5d64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480072948ac46ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d70c72700 1 -- 172.21.15.26:0/2669816132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400e070 con 0x7f5d6c06a110 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d70c72700 1 -- 172.21.15.26:0/2669816132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400bc30 con 0x7f5d6c06a110 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.228+0000 7f5d70c72700 1 -- 172.21.15.26:0/2669816132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64012430 con 0x7f5d6c06a110 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 -- 172.21.15.26:0/2669816132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c06a110 msgr2=0x7f5d6c13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c06a110 0x7f5d6c13c7e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009e60 tx=0x7f5d64009780 comp rx=0 tx=0).stop 2023-10-09T11:42:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 -- 172.21.15.26:0/2669816132 shutdown_connections 2023-10-09T11:42:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c06a110 0x7f5d6c13c7e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/2669816132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 -- 172.21.15.26:0/2669816132 >> 172.21.15.26:0/2669816132 conn(0x7f5d6c067f00 msgr2=0x7f5d6c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 -- 172.21.15.26:0/2669816132 shutdown_connections 2023-10-09T11:42:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.229+0000 7f5d73ed8700 1 -- 172.21.15.26:0/2669816132 wait complete. 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.230+0000 7f5d73ed8700 1 Processor -- start 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.230+0000 7f5d73ed8700 1 -- start start 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6c06a110 0x7f5d6c159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c16d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b0a30 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0afe20 con 0x7f5d6c06a110 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d73ed8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b0100 con 0x7f5d6c0cc320 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47374/0 (socket says 172.21.15.26:47374) 2023-10-09T11:42:25.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 -- 172.21.15.26:0/23442221 learned_addr learned my addr 172.21.15.26:0/23442221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d71473700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c16d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d71c74700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6c06a110 0x7f5d6c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 -- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 msgr2=0x7f5d6c16d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c16d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 -- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6c06a110 msgr2=0x7f5d6c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6c06a110 0x7f5d6c159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.231+0000 7f5d72475700 1 -- 172.21.15.26:0/23442221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009a20 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d72475700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5d64013000 tx=0x7f5d64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64012e50 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6401d630 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c0b03e0 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6401da10 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.232+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0ad620 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.233+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c04c3c0 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.233+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5d64024070 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.234+0000 7f5d61ffb700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 0x7f5d500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.234+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f5d64087910 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.234+0000 7f5d71c74700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 0x7f5d500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.235+0000 7f5d71c74700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 0x7f5d500697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5d68006fd0 tx=0x7f5d68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.238+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d640541c0 con 0x7f5d6c0cc6f0 2023-10-09T11:42:25.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:25.458+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001023390", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d6c06da00 con 0x7f5d50067320 2023-10-09T11:42:25.464 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:42:25.463+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:42:25.489 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:42:26.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:26.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:28.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.475+0000 7f5d61ffb700 1 -- 172.21.15.26:0/23442221 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f5d6c06da00 con 0x7f5d50067320 2023-10-09T11:42:28.476 INFO:teuthology.orchestra.run.smithi026.stdout:metadata pool: cephfs.volume_0000000001023390.meta data pool: ['cephfs.volume_0000000001023390.data'] removed 2023-10-09T11:42:28.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.477+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 msgr2=0x7f5d500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.477+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 0x7f5d500697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5d68006fd0 tx=0x7f5d68008040 comp rx=0 tx=0).stop 2023-10-09T11:42:28.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.477+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 msgr2=0x7f5d6c16d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.477+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5d64013000 tx=0x7f5d64019000 comp rx=0 tx=0).stop 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 shutdown_connections 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d6c0cc6f0 0x7f5d6c16d800 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6c06a110 0x7f5d6c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d50067320 0x7f5d500697d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 --2- 172.21.15.26:0/23442221 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d6c0cc320 0x7f5d6c16d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 >> 172.21.15.26:0/23442221 conn(0x7f5d6c067f00 msgr2=0x7f5d6c0682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 shutdown_connections 2023-10-09T11:42:28.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.478+0000 7f5d73ed8700 1 -- 172.21.15.26:0/23442221 wait complete. 2023-10-09T11:42:28.494 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:28.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:28.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:28.584 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:28.584 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:42:28.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:28.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:28.636 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:42:28.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:28.636 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:42:28.651 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:42:28.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:28.652 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:28.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:42:28.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:28.692 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:42:28.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.870+0000 7f01596ec700 1 Processor -- start 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.870+0000 7f01596ec700 1 -- start start 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01596ec700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540ae020 0x7f0154157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01596ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01540abfd0 0x7f01541575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01596ec700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0154069f10 con 0x7f01540abc00 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01596ec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01540aeb20 con 0x7f01540abfd0 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01596ec700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0154157b00 con 0x7f01540ae020 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01540abfd0 0x7f01541575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01540abfd0 0x7f01541575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47398/0 (socket says 172.21.15.26:47398) 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 -- 172.21.15.26:0/2884865180 learned_addr learned my addr 172.21.15.26:0/2884865180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01527fc700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540ae020 0x7f0154157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 -- 172.21.15.26:0/2884865180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540ae020 msgr2=0x7f0154157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540ae020 0x7f0154157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 -- 172.21.15.26:0/2884865180 >> v1:172.21.15.67:6789/0 conn(0x7f01540abc00 legacy=0x7f01540ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.871+0000 7f01537fe700 1 -- 172.21.15.26:0/2884865180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540ccde0 con 0x7f01540abfd0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01537fe700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540abfd0 0x7f01541575c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0144009f20 tx=0x7f0144009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9ab38e029bff47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f0151ffb700 1 -- 172.21.15.26:0/2884865180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400e070 con 0x7f01540abfd0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f0151ffb700 1 -- 172.21.15.26:0/2884865180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400ba40 con 0x7f01540abfd0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f0151ffb700 1 -- 172.21.15.26:0/2884865180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440092e0 con 0x7f01540abfd0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 -- 172.21.15.26:0/2884865180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540abfd0 msgr2=0x7f01541575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540abfd0 0x7f01541575c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0144009f20 tx=0x7f0144009840 comp rx=0 tx=0).stop 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 -- 172.21.15.26:0/2884865180 shutdown_connections 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540abfd0 0x7f01541575c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 --2- 172.21.15.26:0/2884865180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540ae020 0x7f0154157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 -- 172.21.15.26:0/2884865180 >> 172.21.15.26:0/2884865180 conn(0x7f01540c9640 msgr2=0x7f01540cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 -- 172.21.15.26:0/2884865180 shutdown_connections 2023-10-09T11:42:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.872+0000 7f01596ec700 1 -- 172.21.15.26:0/2884865180 wait complete. 2023-10-09T11:42:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.873+0000 7f01596ec700 1 Processor -- start 2023-10-09T11:42:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 -- start start 2023-10-09T11:42:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01540abc00 0x7f015415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540abfd0 0x7f01540c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c5420 con 0x7f01540ae020 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c4810 con 0x7f01540abc00 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01596ec700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c4af0 con 0x7f01540abfd0 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47402/0 (socket says 172.21.15.26:47402) 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01537fe700 1 -- 172.21.15.26:0/3294015024 learned_addr learned my addr 172.21.15.26:0/3294015024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f0152ffd700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01540abc00 0x7f015415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.874+0000 7f01527fc700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540abfd0 0x7f01540c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 -- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540abfd0 msgr2=0x7f01540c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540abfd0 0x7f01540c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 -- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01540abc00 msgr2=0x7f015415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01540abc00 0x7f015415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 -- 172.21.15.26:0/3294015024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144009ae0 con 0x7f01540ae020 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01537fe700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f015406dd40 tx=0x7f0144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144012d00 con 0x7f01540ae020 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144012e60 con 0x7f01540ae020 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01540c4dd0 con 0x7f01540ae020 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014401d670 con 0x7f01540ae020 2023-10-09T11:42:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.875+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015415b850 con 0x7f01540ae020 2023-10-09T11:42:28.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.876+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01540c55d0 con 0x7f01540ae020 2023-10-09T11:42:28.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.877+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f014401da60 con 0x7f01540ae020 2023-10-09T11:42:28.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.877+0000 7f014affd700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 0x7f01340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.877+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f0144086650 con 0x7f01540ae020 2023-10-09T11:42:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.877+0000 7f0152ffd700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 0x7f01340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.878+0000 7f0152ffd700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 0x7f01340697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f014c003a30 tx=0x7f014c007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:28.881+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0144053120 con 0x7f01540ae020 2023-10-09T11:42:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.121+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f015404c3c0 con 0x7f01540ae020 2023-10-09T11:42:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.122+0000 7f014affd700 1 -- 172.21.15.26:0/3294015024 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0144056740 con 0x7f01540ae020 2023-10-09T11:42:29.123 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:29.123 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7464,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2194541951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2194541951},{"type":"v1","addr":"172.21.15.26:6835","nonce":2194541951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2429868541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2429868541},{"type":"v1","addr":"172.21.15.26:6834","nonce":2429868541}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 msgr2=0x7f01340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 0x7f01340697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f014c003a30 tx=0x7f014c007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 msgr2=0x7f01540c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f015406dd40 tx=0x7f0144017000 comp rx=0 tx=0).stop 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 shutdown_connections 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01540ae020 0x7f01540c2230 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01540abc00 0x7f015415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0134067320 0x7f01340697d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 --2- 172.21.15.26:0/3294015024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01540abfd0 0x7f01540c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 >> 172.21.15.26:0/3294015024 conn(0x7f01540c9640 msgr2=0x7f0154156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 shutdown_connections 2023-10-09T11:42:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.124+0000 7f01596ec700 1 -- 172.21.15.26:0/3294015024 wait complete. 2023-10-09T11:42:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 85 2023-10-09T11:42:29.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 Processor -- start 2023-10-09T11:42:29.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 -- start start 2023-10-09T11:42:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb80cde50 0x7f6bb8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb815ae40 con 0x7f6bb80cd9e0 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80d13f0 con 0x7f6bb80cde50 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.256+0000 7f6bbddf9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb815ab60 con 0x7f6bb80cb5a0 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb80cde50 0x7f6bb8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb80cde50 0x7f6bb8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47410/0 (socket says 172.21.15.26:47410) 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 -- 172.21.15.26:0/4172186427 learned_addr learned my addr 172.21.15.26:0/4172186427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb77fe700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 -- 172.21.15.26:0/4172186427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 msgr2=0x7f6bb80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 -- 172.21.15.26:0/4172186427 >> v1:172.21.15.67:6789/0 conn(0x7f6bb80cd9e0 legacy=0x7f6bb8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 -- 172.21.15.26:0/4172186427 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80ccf00 con 0x7f6bb80cde50 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb77fe700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:29.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb7fff700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80cde50 0x7f6bb8156e90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009f20 tx=0x7f6bb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f43476f7737f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb67fc700 1 -- 172.21.15.26:0/4172186427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000e070 con 0x7f6bb80cde50 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb67fc700 1 -- 172.21.15.26:0/4172186427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000ba80 con 0x7f6bb80cde50 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.257+0000 7f6bb67fc700 1 -- 172.21.15.26:0/4172186427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00092e0 con 0x7f6bb80cde50 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 -- 172.21.15.26:0/4172186427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80cde50 msgr2=0x7f6bb8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80cde50 0x7f6bb8156e90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009f20 tx=0x7f6bb0009840 comp rx=0 tx=0).stop 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 -- 172.21.15.26:0/4172186427 shutdown_connections 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80cde50 0x7f6bb8156e90 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/4172186427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 -- 172.21.15.26:0/4172186427 >> 172.21.15.26:0/4172186427 conn(0x7f6bb8070e30 msgr2=0x7f6bb80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 -- 172.21.15.26:0/4172186427 shutdown_connections 2023-10-09T11:42:29.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.258+0000 7f6bbddf9700 1 -- 172.21.15.26:0/4172186427 wait complete. 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.259+0000 7f6bbddf9700 1 Processor -- start 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.259+0000 7f6bbddf9700 1 -- start start 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6bb80cd9e0 0x7f6bb8156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80ca670 con 0x7f6bb815c730 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c95d0 con 0x7f6bb80cd9e0 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bbddf9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c98b0 con 0x7f6bb80cb5a0 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47416/0 (socket says 172.21.15.26:47416) 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 -- 172.21.15.26:0/3978438873 learned_addr learned my addr 172.21.15.26:0/3978438873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb77fe700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb6ffd700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6bb80cd9e0 0x7f6bb8156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 -- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 msgr2=0x7f6bb80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 -- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6bb80cd9e0 msgr2=0x7f6bb8156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6bb80cd9e0 0x7f6bb8156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 -- 172.21.15.26:0/3978438873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009ae0 con 0x7f6bb815c730 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.260+0000 7f6bb7fff700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6bb806ea60 tx=0x7f6bb0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.261+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0008dd0 con 0x7f6bb815c730 2023-10-09T11:42:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.261+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb001d420 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.261+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80c9b90 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.261+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb001d7e0 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.261+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb80ca150 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.262+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb80ca370 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.262+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6bb0003040 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.262+0000 7f6b9f7fe700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 0x7f6ba40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.262+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f6bb0086be0 con 0x7f6bb815c730 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.263+0000 7f6bb77fe700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 0x7f6ba40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.263+0000 7f6bb77fe700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 0x7f6ba40697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8006fd0 tx=0x7f6ba8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.267+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bb00536b0 con 0x7f6bb815c730 2023-10-09T11:42:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.458+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb804c3c0 con 0x7f6bb815c730 2023-10-09T11:42:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.459+0000 7f6b9f7fe700 1 -- 172.21.15.26:0/3978438873 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f6bb0008f30 con 0x7f6bb815c730 2023-10-09T11:42:29.461 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:29.461 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":126,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:28.468473+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6832/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6835/2511463047":"2023-10-10T11:42:22.044737+0000","172.21.15.26:6833/2511463047":"2023-10-10T11:42:22.044737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.461+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 msgr2=0x7f6ba40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.461+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 0x7f6ba40697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8006fd0 tx=0x7f6ba8008040 comp rx=0 tx=0).stop 2023-10-09T11:42:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.461+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 msgr2=0x7f6bb80cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.461+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6bb806ea60 tx=0x7f6bb0018000 comp rx=0 tx=0).stop 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 shutdown_connections 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb815c730 0x7f6bb80cedb0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6ba4067320 0x7f6ba40697d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6bb80cb5a0 0x7f6bb80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 --2- 172.21.15.26:0/3978438873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6bb80cd9e0 0x7f6bb8156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 >> 172.21.15.26:0/3978438873 conn(0x7f6bb8070e30 msgr2=0x7f6bb80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 shutdown_connections 2023-10-09T11:42:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.462+0000 7f6bbddf9700 1 -- 172.21.15.26:0/3978438873 wait complete. 2023-10-09T11:42:29.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:58.413063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:58.991356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:42:29.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:29.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.595+0000 7eff95bf3700 1 Processor -- start 2023-10-09T11:42:29.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.595+0000 7eff95bf3700 1 -- start start 2023-10-09T11:42:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff95bf3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff90159530 0x7eff900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff95bf3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff90159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff95bf3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff900ccfd0 con 0x7eff9006e0e0 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff95bf3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff900cf0e0 con 0x7eff90159530 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff95bf3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9015a3d0 con 0x7eff9006dc70 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff8ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7eff9006e0e0 0x7eff900cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51196/0 (socket says 172.21.15.26:51196) 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff8ffff700 1 -- 172.21.15.26:0/130801770 learned_addr learned my addr 172.21.15.26:0/130801770 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/130801770 >> v2:172.21.15.67:3300/0 conn(0x7eff90159530 0x7eff900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.596+0000 7eff8effd700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff90159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839123573 0 0) 0x7eff900ccfd0 con 0x7eff9006e0e0 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff78003570 con 0x7eff9006e0e0 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8f7fe700 1 -- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 msgr2=0x7eff90159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff90159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8f7fe700 1 -- 172.21.15.26:0/130801770 >> v1:172.21.15.26:6789/0 conn(0x7eff9006e0e0 legacy=0x7eff900cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306864109 0 0) 0x7eff78003570 con 0x7eff9006e0e0 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8f7fe700 1 -- 172.21.15.26:0/130801770 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9015a6b0 con 0x7eff90159530 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8effd700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff90159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900ceba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7eff800098e0 tx=0x7eff800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79636aa776524fad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80011630 con 0x7eff90159530 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80011790 con 0x7eff90159530 2023-10-09T11:42:29.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.597+0000 7eff8e7fc700 1 -- 172.21.15.26:0/130801770 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80011b10 con 0x7eff90159530 2023-10-09T11:42:29.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 -- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 msgr2=0x7eff900ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900ceba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7eff800098e0 tx=0x7eff800091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 -- 172.21.15.26:0/130801770 shutdown_connections 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900ceba0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 --2- 172.21.15.26:0/130801770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff90159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 -- 172.21.15.26:0/130801770 >> 172.21.15.26:0/130801770 conn(0x7eff900703a0 msgr2=0x7eff900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 -- 172.21.15.26:0/130801770 shutdown_connections 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.598+0000 7eff95bf3700 1 -- 172.21.15.26:0/130801770 wait complete. 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.599+0000 7eff95bf3700 1 Processor -- start 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.599+0000 7eff95bf3700 1 -- start start 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff901440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900b37d0 con 0x7eff9006e0e0 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c8370 con 0x7eff90159530 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff95bf3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c8650 con 0x7eff9006dc70 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47428/0 (socket says 172.21.15.26:47428) 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 -- 172.21.15.26:0/3836488181 learned_addr learned my addr 172.21.15.26:0/3836488181 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8ffff700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff901440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 -- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 msgr2=0x7eff901440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff901440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 -- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 msgr2=0x7eff900c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 -- 172.21.15.26:0/3836488181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009420 con 0x7eff9006e0e0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8ffff700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff901440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.600+0000 7eff8effd700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7eff8400ec80 tx=0x7eff840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400c9d0 con 0x7eff9006e0e0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400cb30 con 0x7eff9006e0e0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff80009420 con 0x7eff9006e0e0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400ceb0 con 0x7eff9006e0e0 2023-10-09T11:42:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff900c8c10 con 0x7eff9006e0e0 2023-10-09T11:42:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.601+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9004c3c0 con 0x7eff9006e0e0 2023-10-09T11:42:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.602+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff84013680 con 0x7eff9006e0e0 2023-10-09T11:42:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.602+0000 7eff777fe700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 0x7eff7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.603+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7eff84085170 con 0x7eff9006e0e0 2023-10-09T11:42:29.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.603+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 0x7eff7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.603+0000 7eff8f7fe700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 0x7eff7c0697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7eff800091e0 tx=0x7eff80017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.607+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff84051d50 con 0x7eff9006e0e0 2023-10-09T11:42:29.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.803+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff9015a990 con 0x7eff9006e0e0 2023-10-09T11:42:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.803+0000 7eff777fe700 1 -- 172.21.15.26:0/3836488181 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff84055370 con 0x7eff9006e0e0 2023-10-09T11:42:29.805 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 msgr2=0x7eff7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 0x7eff7c0697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7eff800091e0 tx=0x7eff80017000 comp rx=0 tx=0).stop 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 msgr2=0x7eff900c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7eff8400ec80 tx=0x7eff840091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 shutdown_connections 2023-10-09T11:42:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff90159530 0x7eff900c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff7c067320 0x7eff7c0697d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff9006dc70 0x7eff901440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 --2- 172.21.15.26:0/3836488181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff9006e0e0 0x7eff900c7790 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.805+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 >> 172.21.15.26:0/3836488181 conn(0x7eff900703a0 msgr2=0x7eff900b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.806+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 shutdown_connections 2023-10-09T11:42:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.806+0000 7eff95bf3700 1 -- 172.21.15.26:0/3836488181 wait complete. 2023-10-09T11:42:29.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.938+0000 7f4a21b22700 1 Processor -- start 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 -- start start 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1c06dc70 0x7f4a1c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a1c06e0e0 0x7f4a1c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0ccfd0 con 0x7f4a1c159530 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c15a3d0 con 0x7f4a1c06dc70 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a21b22700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c15a6b0 con 0x7f4a1c06e0e0 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.939+0000 7f4a1affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1c06dc70 0x7f4a1c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1c06dc70 0x7f4a1c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53122/0 (socket says 172.21.15.26:53122) 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 -- 172.21.15.26:0/1801967535 learned_addr learned my addr 172.21.15.26:0/1801967535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1bfff700 1 --2- 172.21.15.26:0/1801967535 >> v2:172.21.15.67:3300/0 conn(0x7f4a1c06e0e0 0x7f4a1c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 -- 172.21.15.26:0/1801967535 >> v2:172.21.15.67:3300/0 conn(0x7f4a1c06e0e0 msgr2=0x7f4a1c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 --2- 172.21.15.26:0/1801967535 >> v2:172.21.15.67:3300/0 conn(0x7f4a1c06e0e0 0x7f4a1c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 -- 172.21.15.26:0/1801967535 >> v1:172.21.15.67:6789/0 conn(0x7f4a1c159530 legacy=0x7f4a1c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 -- 172.21.15.26:0/1801967535 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c15a990 con 0x7f4a1c06dc70 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1affd700 1 --2- 172.21.15.26:0/1801967535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c159900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0cf2b0 tx=0x7f4a10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4f5f5876c042d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1a7fc700 1 -- 172.21.15.26:0/1801967535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000b820 con 0x7f4a1c06dc70 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1a7fc700 1 -- 172.21.15.26:0/1801967535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000b980 con 0x7f4a1c06dc70 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.940+0000 7f4a1a7fc700 1 -- 172.21.15.26:0/1801967535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000bd20 con 0x7f4a1c06dc70 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 -- 172.21.15.26:0/1801967535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 msgr2=0x7f4a1c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 --2- 172.21.15.26:0/1801967535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c159900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0cf2b0 tx=0x7f4a10009250 comp rx=0 tx=0).stop 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 -- 172.21.15.26:0/1801967535 shutdown_connections 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 --2- 172.21.15.26:0/1801967535 >> v2:172.21.15.67:3300/0 conn(0x7f4a1c06e0e0 0x7f4a1c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 --2- 172.21.15.26:0/1801967535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c159900 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 -- 172.21.15.26:0/1801967535 >> 172.21.15.26:0/1801967535 conn(0x7f4a1c0703a0 msgr2=0x7f4a1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 -- 172.21.15.26:0/1801967535 shutdown_connections 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.941+0000 7f4a21b22700 1 -- 172.21.15.26:0/1801967535 wait complete. 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.942+0000 7f4a21b22700 1 Processor -- start 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.942+0000 7f4a21b22700 1 -- start start 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a1c06e0e0 0x7f4a1c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1c159530 0x7f4a1c0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0caa90 con 0x7f4a1c06dc70 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b6380 con 0x7f4a1c159530 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a21b22700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b4a00 con 0x7f4a1c06e0e0 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53134/0 (socket says 172.21.15.26:53134) 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 -- 172.21.15.26:0/623178944 learned_addr learned my addr 172.21.15.26:0/623178944 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1bfff700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1c159530 0x7f4a1c0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 -- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a1c06e0e0 msgr2=0x7f4a1c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a1c06e0e0 0x7f4a1c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 -- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1c159530 msgr2=0x7f4a1c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1c159530 0x7f4a1c0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 -- 172.21.15.26:0/623178944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100094f0 con 0x7f4a1c06dc70 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a1b7fe700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00b5e0 tx=0x7f4a0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.943+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00f510 con 0x7f4a1c06dc70 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.944+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00f690 con 0x7f4a1c06dc70 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.944+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c15de20 con 0x7f4a1c06dc70 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.944+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00fa50 con 0x7f4a1c06dc70 2023-10-09T11:42:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.944+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c15d7d0 con 0x7f4a1c06dc70 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.944+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c04c3c0 con 0x7f4a1c06dc70 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.945+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a0c01a400 con 0x7f4a1c06dc70 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.945+0000 7f4a037fe700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 0x7f4a080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.945+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f4a0c0847c0 con 0x7f4a1c06dc70 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.946+0000 7f4a1affd700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 0x7f4a080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.946+0000 7f4a1affd700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 0x7f4a080697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0cf2b0 tx=0x7f4a10016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:29.950+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a0c0514a0 con 0x7f4a1c06dc70 2023-10-09T11:42:30.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.140+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a1c0ce6a0 con 0x7f4a1c06dc70 2023-10-09T11:42:30.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.140+0000 7f4a037fe700 1 -- 172.21.15.26:0/623178944 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a0c054ac0 con 0x7f4a1c06dc70 2023-10-09T11:42:30.141 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 msgr2=0x7f4a080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 0x7f4a080697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0cf2b0 tx=0x7f4a10016000 comp rx=0 tx=0).stop 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 msgr2=0x7f4a1c0c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00b5e0 tx=0x7f4a0c009120 comp rx=0 tx=0).stop 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 shutdown_connections 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1c159530 0x7f4a1c0b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1c06dc70 0x7f4a1c0c7790 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a08067320 0x7f4a080697d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 --2- 172.21.15.26:0/623178944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a1c06e0e0 0x7f4a1c0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 >> 172.21.15.26:0/623178944 conn(0x7f4a1c0703a0 msgr2=0x7f4a1c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 shutdown_connections 2023-10-09T11:42:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.142+0000 7f4a21b22700 1 -- 172.21.15.26:0/623178944 wait complete. 2023-10-09T11:42:30.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:42:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.276+0000 7fd4ac822700 1 Processor -- start 2023-10-09T11:42:30.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 -- start start 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4a80ccfa0 0x7fd4a80cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80cf510 con 0x7fd4a80cbd90 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80cc1e0 con 0x7fd4a80ccfa0 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.277+0000 7fd4ac822700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80cd960 con 0x7fd4a8159860 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53150/0 (socket says 172.21.15.26:53150) 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 -- 172.21.15.26:0/1441658117 learned_addr learned my addr 172.21.15.26:0/1441658117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a659c700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a6d9d700 1 --2- 172.21.15.26:0/1441658117 >> v2:172.21.15.67:3300/0 conn(0x7fd4a80ccfa0 0x7fd4a80cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 -- 172.21.15.26:0/1441658117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 msgr2=0x7fd4a80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 -- 172.21.15.26:0/1441658117 >> v2:172.21.15.67:3300/0 conn(0x7fd4a80ccfa0 msgr2=0x7fd4a80cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1441658117 >> v2:172.21.15.67:3300/0 conn(0x7fd4a80ccfa0 0x7fd4a80cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 -- 172.21.15.26:0/1441658117 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80ce900 con 0x7fd4a80cbd90 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8071320 tx=0x7fd490009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fc5a40f123b0d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a559a700 1 -- 172.21.15.26:0/1441658117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490005c10 con 0x7fd4a80cbd90 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a559a700 1 -- 172.21.15.26:0/1441658117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490005d70 con 0x7fd4a80cbd90 2023-10-09T11:42:30.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.278+0000 7fd4a559a700 1 -- 172.21.15.26:0/1441658117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b880 con 0x7fd4a80cbd90 2023-10-09T11:42:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 -- 172.21.15.26:0/1441658117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 msgr2=0x7fd4a80cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8071320 tx=0x7fd490009220 comp rx=0 tx=0).stop 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 -- 172.21.15.26:0/1441658117 shutdown_connections 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1441658117 >> v2:172.21.15.67:3300/0 conn(0x7fd4a80ccfa0 0x7fd4a80cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1441658117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a80cf9a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 -- 172.21.15.26:0/1441658117 >> 172.21.15.26:0/1441658117 conn(0x7fd4a80999b0 msgr2=0x7fd4a8070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 -- 172.21.15.26:0/1441658117 shutdown_connections 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.279+0000 7fd4ac822700 1 -- 172.21.15.26:0/1441658117 wait complete. 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.280+0000 7fd4ac822700 1 Processor -- start 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.280+0000 7fd4ac822700 1 -- start start 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 0x7fd4a80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a809c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a816a930 con 0x7fd4a80cbd90 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80ca650 con 0x7fd4a80ccfa0 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4ac822700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a809ac90 con 0x7fd4a8159860 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53156/0 (socket says 172.21.15.26:53156) 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 -- 172.21.15.26:0/1410445957 learned_addr learned my addr 172.21.15.26:0/1410445957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 0x7fd4a80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a6d9d700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a809c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 -- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 msgr2=0x7fd4a809c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a809c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 -- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 msgr2=0x7fd4a80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 0x7fd4a80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 -- 172.21.15.26:0/1410445957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490009480 con 0x7fd4a80cbd90 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 0x7fd4a80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.281+0000 7fd4a659c700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d870 tx=0x7fd4a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.282+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0009630 con 0x7fd4a80cbd90 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.282+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0009790 con 0x7fd4a80cbd90 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.282+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0009b50 con 0x7fd4a80cbd90 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.282+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a80ca090 con 0x7fd4a80cbd90 2023-10-09T11:42:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.282+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a809a920 con 0x7fd4a80cbd90 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.283+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a804c3c0 con 0x7fd4a80cbd90 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.283+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4a0014410 con 0x7fd4a80cbd90 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.283+0000 7fd49e7fc700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.283+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fd4a00855c0 con 0x7fd4a80cbd90 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.284+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.284+0000 7fd4a5d9b700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 0x7fd4880697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd490009260 tx=0x7fd490016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.288+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4a00521a0 con 0x7fd4a80cbd90 2023-10-09T11:42:30.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.482+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4a809af70 con 0x7fd4a80cbd90 2023-10-09T11:42:30.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.483+0000 7fd49e7fc700 1 -- 172.21.15.26:0/1410445957 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4a00557c0 con 0x7fd4a80cbd90 2023-10-09T11:42:30.484 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:42:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 msgr2=0x7fd4880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 0x7fd4880697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd490009260 tx=0x7fd490016000 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 msgr2=0x7fd4a816a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d870 tx=0x7fd4a0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 shutdown_connections 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd488067320 0x7fd4880697d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4a8159860 0x7fd4a809c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a80cbd90 0x7fd4a816a3f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 --2- 172.21.15.26:0/1410445957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a80ccfa0 0x7fd4a80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 >> 172.21.15.26:0/1410445957 conn(0x7fd4a80999b0 msgr2=0x7fd4a815c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 shutdown_connections 2023-10-09T11:42:30.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.485+0000 7fd4ac822700 1 -- 172.21.15.26:0/1410445957 wait complete. 2023-10-09T11:42:30.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.616+0000 7fb1e6ef9700 1 Processor -- start 2023-10-09T11:42:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.616+0000 7fb1e6ef9700 1 -- start start 2023-10-09T11:42:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e6ef9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e0153c30 0x7fb1e015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e6ef9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1e00cf110 0x7fb1e015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e6ef9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e015afd0 con 0x7fb1e015de50 2023-10-09T11:42:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e6ef9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e015b2b0 con 0x7fb1e00cf110 2023-10-09T11:42:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e6ef9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e015b590 con 0x7fb1e0153c30 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e56f6700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb1e015de50 0x7fb1e00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38018/0 (socket says 172.21.15.26:38018) 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e56f6700 1 -- 172.21.15.26:0/39486619 learned_addr learned my addr 172.21.15.26:0/39486619 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e66f8700 1 --2- 172.21.15.26:0/39486619 >> v2:172.21.15.67:3300/0 conn(0x7fb1e00cf110 0x7fb1e015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e5ef7700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e0153c30 0x7fb1e015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.617+0000 7fb1e4ef5700 1 -- 172.21.15.26:0/39486619 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362212234 0 0) 0x7fb1e015afd0 con 0x7fb1e015de50 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e4ef5700 1 -- 172.21.15.26:0/39486619 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c8003570 con 0x7fb1e015de50 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e66f8700 1 -- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e0153c30 msgr2=0x7fb1e015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e66f8700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e0153c30 0x7fb1e015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e66f8700 1 -- 172.21.15.26:0/39486619 >> v1:172.21.15.26:6789/0 conn(0x7fb1e015de50 legacy=0x7fb1e00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e66f8700 1 -- 172.21.15.26:0/39486619 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e015b870 con 0x7fb1e00cf110 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e66f8700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00cf110 0x7fb1e015c070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80098e0 tx=0x7fb1d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea0dbe5eb0a19ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e4ef5700 1 -- 172.21.15.26:0/39486619 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011630 con 0x7fb1e00cf110 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e4ef5700 1 -- 172.21.15.26:0/39486619 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8011790 con 0x7fb1e00cf110 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.618+0000 7fb1e4ef5700 1 -- 172.21.15.26:0/39486619 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011b10 con 0x7fb1e00cf110 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00cf110 msgr2=0x7fb1e015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00cf110 0x7fb1e015c070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80098e0 tx=0x7fb1d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/39486619 shutdown_connections 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00cf110 0x7fb1e015c070 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/39486619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e0153c30 0x7fb1e015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/39486619 >> 172.21.15.26:0/39486619 conn(0x7fb1e00703a0 msgr2=0x7fb1e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/39486619 shutdown_connections 2023-10-09T11:42:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.619+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/39486619 wait complete. 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.620+0000 7fb1e6ef9700 1 Processor -- start 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.620+0000 7fb1e6ef9700 1 -- start start 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.620+0000 7fb1e6ef9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e00cf110 0x7fb1e0146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 0x7fb1e00b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e016a1f0 con 0x7fb1e0153c30 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0146560 con 0x7fb1e015de50 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00c8da0 con 0x7fb1e00cf110 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53164/0 (socket says 172.21.15.26:53164) 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 -- 172.21.15.26:0/3685687970 learned_addr learned my addr 172.21.15.26:0/3685687970 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e66f8700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 0x7fb1e00b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 -- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e00cf110 msgr2=0x7fb1e0146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e5ef7700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e00cf110 0x7fb1e0146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e00cf110 0x7fb1e0146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 -- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 msgr2=0x7fb1e00b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 0x7fb1e00b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 -- 172.21.15.26:0/3685687970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009420 con 0x7fb1e0153c30 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e66f8700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 0x7fb1e00b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e56f6700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c580 tx=0x7fb1d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4005b30 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4005c90 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e0169c30 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4007320 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.621+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e00c8a30 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.622+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e00c8890 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.623+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb1d4007690 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.623+0000 7fb1ddffb700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 0x7fb1cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.623+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fb1d40841d0 con 0x7fb1e0153c30 2023-10-09T11:42:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.623+0000 7fb1e5ef7700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 0x7fb1cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.624+0000 7fb1e5ef7700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 0x7fb1cc0697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00076c0 tx=0x7fb1d000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.628+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1e00c8890 con 0x7fb1e0153c30 2023-10-09T11:42:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.867+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1e00c8890 con 0x7fb1e0153c30 2023-10-09T11:42:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.867+0000 7fb1ddffb700 1 -- 172.21.15.26:0/3685687970 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb1e00c8890 con 0x7fb1e0153c30 2023-10-09T11:42:30.869 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:30.869 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7464,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2194541951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2194541951},{"type":"v1","addr":"172.21.15.26:6835","nonce":2194541951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2429868541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2429868541},{"type":"v1","addr":"172.21.15.26:6834","nonce":2429868541}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:30.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 msgr2=0x7fb1cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 0x7fb1cc0697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00076c0 tx=0x7fb1d000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 msgr2=0x7fb1e01691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c580 tx=0x7fb1d4007df0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 shutdown_connections 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e015de50 0x7fb1e00b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb1cc067320 0x7fb1cc0697d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e00cf110 0x7fb1e0146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 --2- 172.21.15.26:0/3685687970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1e0153c30 0x7fb1e01691e0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 >> 172.21.15.26:0/3685687970 conn(0x7fb1e00703a0 msgr2=0x7fb1e00c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 shutdown_connections 2023-10-09T11:42:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:30.870+0000 7fb1e6ef9700 1 -- 172.21.15.26:0/3685687970 wait complete. 2023-10-09T11:42:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 85 2023-10-09T11:42:30.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:31.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.000+0000 7fd55b806700 1 Processor -- start 2023-10-09T11:42:31.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.000+0000 7fd55b806700 1 -- start start 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd55b806700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 0x7fd5540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd55b806700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 0x7fd554156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd55b806700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55415ae40 con 0x7fd5540cd9e0 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd55b806700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5540d13f0 con 0x7fd5540cb5a0 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd55b806700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415ab60 con 0x7fd55415a5d0 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd558da1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd5540cd9e0 0x7fd554159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38022/0 (socket says 172.21.15.26:38022) 2023-10-09T11:42:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.001+0000 7fd558da1700 1 -- 172.21.15.26:0/615350684 learned_addr learned my addr 172.21.15.26:0/615350684 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd5595a2700 1 --2- 172.21.15.26:0/615350684 >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 0x7fd5540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 --2- 172.21.15.26:0/615350684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 0x7fd554156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710371359 0 0) 0x7fd55415ae40 con 0x7fd5540cd9e0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c003570 con 0x7fd5540cd9e0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670616836 0 0) 0x7fd53c003570 con 0x7fd5540cd9e0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 -- 172.21.15.26:0/615350684 >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 msgr2=0x7fd5540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 --2- 172.21.15.26:0/615350684 >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 0x7fd5540cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 -- 172.21.15.26:0/615350684 >> v1:172.21.15.26:6789/0 conn(0x7fd5540cd9e0 legacy=0x7fd554159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 -- 172.21.15.26:0/615350684 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540ccf00 con 0x7fd55415a5d0 2023-10-09T11:42:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd5595a2700 1 --2- 172.21.15.26:0/615350684 >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 0x7fd5540cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd559da3700 1 --2- 172.21.15.26:0/615350684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 0x7fd554156e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009910 tx=0x7fd54c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6448cea5becc1b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548001470 con 0x7fd55415a5d0 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c011420 con 0x7fd55415a5d0 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.002+0000 7fd553fff700 1 -- 172.21.15.26:0/615350684 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0117c0 con 0x7fd55415a5d0 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 -- 172.21.15.26:0/615350684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 msgr2=0x7fd554156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 --2- 172.21.15.26:0/615350684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 0x7fd554156e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009910 tx=0x7fd54c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 -- 172.21.15.26:0/615350684 shutdown_connections 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 --2- 172.21.15.26:0/615350684 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd55415a5d0 0x7fd554156e90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 --2- 172.21.15.26:0/615350684 >> v2:172.21.15.67:3300/0 conn(0x7fd5540cb5a0 0x7fd5540cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 -- 172.21.15.26:0/615350684 >> 172.21.15.26:0/615350684 conn(0x7fd554070e30 msgr2=0x7fd5540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 -- 172.21.15.26:0/615350684 shutdown_connections 2023-10-09T11:42:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.003+0000 7fd55b806700 1 -- 172.21.15.26:0/615350684 wait complete. 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.004+0000 7fd55b806700 1 Processor -- start 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.004+0000 7fd55b806700 1 -- start start 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 0x7fd554153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd55415a5d0 0x7fd554159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b4410 con 0x7fd5540cb5a0 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b49d0 con 0x7fd55415a5d0 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd55b806700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415def0 con 0x7fd5540cd9e0 2023-10-09T11:42:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53168/0 (socket says 172.21.15.26:53168) 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 -- 172.21.15.26:0/2771758992 learned_addr learned my addr 172.21.15.26:0/2771758992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd559da3700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd55415a5d0 0x7fd554159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd558da1700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 0x7fd554153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 -- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 msgr2=0x7fd554153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 0x7fd554153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 -- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd55415a5d0 msgr2=0x7fd554159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd55415a5d0 0x7fd554159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.005+0000 7fd5595a2700 1 -- 172.21.15.26:0/2771758992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009a20 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd558da1700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 0x7fd554153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd5595a2700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c1a0 tx=0x7fd54400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400cd90 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400f040 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c009420 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544014690 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.006+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5540b4660 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.007+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5540b4cb0 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.007+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd544014a00 con 0x7fd5540cb5a0 2023-10-09T11:42:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.008+0000 7fd5517fa700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 0x7fd5400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.008+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fd544085c20 con 0x7fd5540cb5a0 2023-10-09T11:42:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.008+0000 7fd558da1700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 0x7fd5400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.008+0000 7fd558da1700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 0x7fd5400697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5480015e0 tx=0x7fd548001550 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.012+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5440526f0 con 0x7fd5540cb5a0 2023-10-09T11:42:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.207+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5540b2e70 con 0x7fd5540cb5a0 2023-10-09T11:42:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.208+0000 7fd5517fa700 1 -- 172.21.15.26:0/2771758992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15575 (secure 0 0 0) 0x7fd544014cb0 con 0x7fd5540cb5a0 2023-10-09T11:42:31.210 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:31.210 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":126,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:28.468473+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6832/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6835/2511463047":"2023-10-10T11:42:22.044737+0000","172.21.15.26:6833/2511463047":"2023-10-10T11:42:22.044737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 msgr2=0x7fd5400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 0x7fd5400697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5480015e0 tx=0x7fd548001550 comp rx=0 tx=0).stop 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 msgr2=0x7fd55415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c1a0 tx=0x7fd54400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 shutdown_connections 2023-10-09T11:42:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd55415a5d0 0x7fd554159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5540cb5a0 0x7fd55415d810 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd540067320 0x7fd5400697d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 --2- 172.21.15.26:0/2771758992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5540cd9e0 0x7fd554153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 >> 172.21.15.26:0/2771758992 conn(0x7fd554070e30 msgr2=0x7fd5540b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 shutdown_connections 2023-10-09T11:42:31.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.210+0000 7fd55b806700 1 -- 172.21.15.26:0/2771758992 wait complete. 2023-10-09T11:42:31.224 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:42:31.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:31.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.341+0000 7f275fe54700 1 Processor -- start 2023-10-09T11:42:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.341+0000 7f275fe54700 1 -- start start 2023-10-09T11:42:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275fe54700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27580a8be0 0x7f27580a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275fe54700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275806d280 0x7f27580b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275fe54700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580ce1a0 con 0x7f27580ae780 2023-10-09T11:42:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275fe54700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580cd5d0 con 0x7f275806d280 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275fe54700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580cd870 con 0x7f27580a8be0 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275d3ef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275806d280 0x7f27580b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275e3f1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f27580ae780 0x7f27580aeba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38026/0 (socket says 172.21.15.26:38026) 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275d3ef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275806d280 0x7f27580b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53182/0 (socket says 172.21.15.26:53182) 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.342+0000 7f275e3f1700 1 -- 172.21.15.26:0/3460451404 learned_addr learned my addr 172.21.15.26:0/3460451404 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275dbf0700 1 --2- 172.21.15.26:0/3460451404 >> v2:172.21.15.67:3300/0 conn(0x7f27580a8be0 0x7f27580a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275d3ef700 1 -- 172.21.15.26:0/3460451404 >> v2:172.21.15.67:3300/0 conn(0x7f27580a8be0 msgr2=0x7f27580a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275d3ef700 1 --2- 172.21.15.26:0/3460451404 >> v2:172.21.15.67:3300/0 conn(0x7f27580a8be0 0x7f27580a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275d3ef700 1 -- 172.21.15.26:0/3460451404 >> v1:172.21.15.26:6789/0 conn(0x7f27580ae780 legacy=0x7f27580aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275cbee700 1 -- 172.21.15.26:0/3460451404 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636908341 0 0) 0x7f27580ce1a0 con 0x7f27580ae780 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275d3ef700 1 -- 172.21.15.26:0/3460451404 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580cdb50 con 0x7f275806d280 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275d3ef700 1 --2- 172.21.15.26:0/3460451404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275806d280 0x7f27580b08c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f275806a9e0 tx=0x7f274c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d75bfb2c53abf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275cbee700 1 -- 172.21.15.26:0/3460451404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c005c10 con 0x7f275806d280 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275cbee700 1 -- 172.21.15.26:0/3460451404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c005d70 con 0x7f275806d280 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.343+0000 7f275cbee700 1 -- 172.21.15.26:0/3460451404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c006260 con 0x7f275806d280 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 -- 172.21.15.26:0/3460451404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275806d280 msgr2=0x7f27580b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 --2- 172.21.15.26:0/3460451404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275806d280 0x7f27580b08c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f275806a9e0 tx=0x7f274c009120 comp rx=0 tx=0).stop 2023-10-09T11:42:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 -- 172.21.15.26:0/3460451404 shutdown_connections 2023-10-09T11:42:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 --2- 172.21.15.26:0/3460451404 >> v2:172.21.15.67:3300/0 conn(0x7f27580a8be0 0x7f27580a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 --2- 172.21.15.26:0/3460451404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275806d280 0x7f27580b08c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 -- 172.21.15.26:0/3460451404 >> 172.21.15.26:0/3460451404 conn(0x7f275806ce80 msgr2=0x7f27580ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 -- 172.21.15.26:0/3460451404 shutdown_connections 2023-10-09T11:42:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.344+0000 7f275fe54700 1 -- 172.21.15.26:0/3460451404 wait complete. 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.345+0000 7f275fe54700 1 Processor -- start 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.345+0000 7f275fe54700 1 -- start start 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f275806d280 0x7f2758156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27580a8be0 0x7f2758099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275809a1c0 con 0x7f27580ae780 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275809a4a0 con 0x7f275806d280 2023-10-09T11:42:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275fe54700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275809a780 con 0x7f27580a8be0 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53196/0 (socket says 172.21.15.26:53196) 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 -- 172.21.15.26:0/1177818448 learned_addr learned my addr 172.21.15.26:0/1177818448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275dbf0700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f275806d280 0x7f2758156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275d3ef700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27580a8be0 0x7f2758099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 -- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27580a8be0 msgr2=0x7f2758099700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27580a8be0 0x7f2758099700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 -- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f275806d280 msgr2=0x7f2758156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f275806d280 0x7f2758156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 -- 172.21.15.26:0/1177818448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0093c0 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f275e3f1700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f275000c7e0 tx=0x7f2750007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750005c00 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.346+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005d80 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.347+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750007320 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.347+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580a9050 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.347+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275809c060 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.348+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275806b6b0 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.348+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f275001b3b0 con 0x7f27580ae780 2023-10-09T11:42:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.348+0000 7f2755ffb700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 0x7f27440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.349+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f2750084160 con 0x7f27580ae780 2023-10-09T11:42:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.349+0000 7f275dbf0700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 0x7f27440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.349+0000 7f275dbf0700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 0x7f27440697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2748007680 tx=0x7f27480098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.353+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2750050d40 con 0x7f27580ae780 2023-10-09T11:42:31.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.591+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f275804c3c0 con 0x7f27580ae780 2023-10-09T11:42:31.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.591+0000 7f2755ffb700 1 -- 172.21.15.26:0/1177818448 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2750017090 con 0x7f27580ae780 2023-10-09T11:42:31.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:31.593 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7464,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2194541951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2194541951},{"type":"v1","addr":"172.21.15.26:6835","nonce":2194541951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2429868541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2429868541},{"type":"v1","addr":"172.21.15.26:6834","nonce":2429868541}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.593+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 msgr2=0x7f27440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.593+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 0x7f27440697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2748007680 tx=0x7f27480098d0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 msgr2=0x7f27580b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f275000c7e0 tx=0x7f2750007d90 comp rx=0 tx=0).stop 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 shutdown_connections 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27580ae780 0x7f27580b2e30 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f275806d280 0x7f2758156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2744067320 0x7f27440697d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 --2- 172.21.15.26:0/1177818448 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27580a8be0 0x7f2758099700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 >> 172.21.15.26:0/1177818448 conn(0x7f275806ce80 msgr2=0x7f27581598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 shutdown_connections 2023-10-09T11:42:31.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.594+0000 7f275fe54700 1 -- 172.21.15.26:0/1177818448 wait complete. 2023-10-09T11:42:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 85 2023-10-09T11:42:31.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:31.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.725+0000 7f66ea54e700 1 Processor -- start 2023-10-09T11:42:31.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 -- start start 2023-10-09T11:42:31.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66e4159c80 0x7f66e40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40ce9d0 con 0x7f66e41598b0 2023-10-09T11:42:31.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40af960 con 0x7f66e4159c80 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66ea54e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40afc30 con 0x7f66e40cfe70 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66e37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66e4159c80 0x7f66e40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66e3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66e41598b0 0x7f66e40af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38034/0 (socket says 172.21.15.26:38034) 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.726+0000 7f66e3fff700 1 -- 172.21.15.26:0/3876701984 learned_addr learned my addr 172.21.15.26:0/3876701984 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e37fe700 1 -- 172.21.15.26:0/3876701984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 msgr2=0x7f66e40cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e8aeb700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e37fe700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e40cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e2ffd700 1 -- 172.21.15.26:0/3876701984 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165487362 0 0) 0x7f66e40ce9d0 con 0x7f66e41598b0 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e37fe700 1 -- 172.21.15.26:0/3876701984 >> v1:172.21.15.26:6789/0 conn(0x7f66e41598b0 legacy=0x7f66e40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e37fe700 1 -- 172.21.15.26:0/3876701984 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40aff10 con 0x7f66e4159c80 2023-10-09T11:42:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e37fe700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e4159c80 0x7f66e40cb6f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f66d80098e0 tx=0x7f66d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e49b17ef722b306 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e2ffd700 1 -- 172.21.15.26:0/3876701984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8009e80 con 0x7f66e4159c80 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e2ffd700 1 -- 172.21.15.26:0/3876701984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800b860 con 0x7f66e4159c80 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.727+0000 7f66e2ffd700 1 -- 172.21.15.26:0/3876701984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800bbe0 con 0x7f66e4159c80 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 -- 172.21.15.26:0/3876701984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e4159c80 msgr2=0x7f66e40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e4159c80 0x7f66e40cb6f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f66d80098e0 tx=0x7f66d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 -- 172.21.15.26:0/3876701984 shutdown_connections 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e40cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 --2- 172.21.15.26:0/3876701984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e4159c80 0x7f66e40cb6f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 -- 172.21.15.26:0/3876701984 >> 172.21.15.26:0/3876701984 conn(0x7f66e4070e30 msgr2=0x7f66e40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 -- 172.21.15.26:0/3876701984 shutdown_connections 2023-10-09T11:42:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.728+0000 7f66ea54e700 1 -- 172.21.15.26:0/3876701984 wait complete. 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.729+0000 7f66ea54e700 1 Processor -- start 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.729+0000 7f66ea54e700 1 -- start start 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e4169800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e4159c80 0x7f66e416cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e416ac80 con 0x7f66e41598b0 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c8f40 con 0x7f66e4159c80 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66ea54e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c9220 con 0x7f66e40cfe70 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53204/0 (socket says 172.21.15.26:53204) 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 -- 172.21.15.26:0/1472968967 learned_addr learned my addr 172.21.15.26:0/1472968967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e8aeb700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e4159c80 0x7f66e416cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e3fff700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e4169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 -- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 msgr2=0x7f66e4169800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e4169800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 -- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e4159c80 msgr2=0x7f66e416cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e4159c80 0x7f66e416cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 -- 172.21.15.26:0/1472968967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8009420 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66e37fe700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f66e406cd60 tx=0x7f66d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.730+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800b9d0 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.731+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800bb50 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.731+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40c9500 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.731+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8025670 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.731+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e414e130 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.732+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e414e380 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.732+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f66d8023070 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.732+0000 7f66cbfff700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 0x7f66d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.733+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f66d8086420 con 0x7f66e41598b0 2023-10-09T11:42:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.733+0000 7f66e3fff700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 0x7f66d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.733+0000 7f66e3fff700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 0x7f66d00697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007fd0 tx=0x7f66d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.737+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66d8053000 con 0x7f66e41598b0 2023-10-09T11:42:31.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.973+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66e404c3c0 con 0x7f66e41598b0 2023-10-09T11:42:31.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.974+0000 7f66cbfff700 1 -- 172.21.15.26:0/1472968967 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f66d8056620 con 0x7f66e41598b0 2023-10-09T11:42:31.976 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:31.976 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7464,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2194541951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2194541951},{"type":"v1","addr":"172.21.15.26:6835","nonce":2194541951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2429868541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2429868541},{"type":"v1","addr":"172.21.15.26:6834","nonce":2429868541}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:00.023232+0000","modified":"2023-10-09T11:42:03.639751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7203":{"gid":7203,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/2194944885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2194944885},{"type":"v1","addr":"172.21.15.67:6836","nonce":2194944885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:42:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 msgr2=0x7f66d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 0x7f66d00697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007fd0 tx=0x7f66d4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 msgr2=0x7f66e4169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f66e406cd60 tx=0x7f66d8017000 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 shutdown_connections 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e4159c80 0x7f66e416cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f66d0067320 0x7f66d00697d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66e40cfe70 0x7f66e4169800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 --2- 172.21.15.26:0/1472968967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e41598b0 0x7f66e4169d40 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 >> 172.21.15.26:0/1472968967 conn(0x7f66e4070e30 msgr2=0x7f66e4155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 shutdown_connections 2023-10-09T11:42:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:31.976+0000 7f66ea54e700 1 -- 172.21.15.26:0/1472968967 wait complete. 2023-10-09T11:42:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 85 2023-10-09T11:42:31.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.107+0000 7fe22b59e700 1 Processor -- start 2023-10-09T11:42:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.107+0000 7fe22b59e700 1 -- start start 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe22c15de50 0x7fe22c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22b59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0cf3c0 con 0x7fe22c153c30 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22b59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c15afd0 con 0x7fe22c0cef40 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22b59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c15b2b0 con 0x7fe22c15de50 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe223fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe22c15de50 0x7fe22c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe22c153c30 0x7fe22c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38044/0 (socket says 172.21.15.26:38044) 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe22a59c700 1 -- 172.21.15.26:0/1981287320 learned_addr learned my addr 172.21.15.26:0/1981287320 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe223fff700 1 -- 172.21.15.26:0/1981287320 >> v1:172.21.15.67:6789/0 conn(0x7fe22c0cef40 legacy=0x7fe22c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe223fff700 1 -- 172.21.15.26:0/1981287320 >> v1:172.21.15.26:6789/0 conn(0x7fe22c153c30 legacy=0x7fe22c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe229d9b700 1 -- 172.21.15.26:0/1981287320 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124995634 0 0) 0x7fe22c0cf3c0 con 0x7fe22c153c30 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.108+0000 7fe223fff700 1 -- 172.21.15.26:0/1981287320 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c15b590 con 0x7fe22c15de50 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe223fff700 1 --2- 172.21.15.26:0/1981287320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15de50 0x7fe22c0cea00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe2140098e0 tx=0x7fe2140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d3c9fd9d9664df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe229d9b700 1 -- 172.21.15.26:0/1981287320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214009e80 con 0x7fe22c15de50 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe229d9b700 1 -- 172.21.15.26:0/1981287320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21400b860 con 0x7fe22c15de50 2023-10-09T11:42:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe229d9b700 1 -- 172.21.15.26:0/1981287320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400bbe0 con 0x7fe22c15de50 2023-10-09T11:42:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 -- 172.21.15.26:0/1981287320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15de50 msgr2=0x7fe22c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 --2- 172.21.15.26:0/1981287320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15de50 0x7fe22c0cea00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe2140098e0 tx=0x7fe2140091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 -- 172.21.15.26:0/1981287320 shutdown_connections 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 --2- 172.21.15.26:0/1981287320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c15de50 0x7fe22c0cea00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 -- 172.21.15.26:0/1981287320 >> 172.21.15.26:0/1981287320 conn(0x7fe22c0703a0 msgr2=0x7fe22c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 -- 172.21.15.26:0/1981287320 shutdown_connections 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.109+0000 7fe22b59e700 1 -- 172.21.15.26:0/1981287320 wait complete. 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.110+0000 7fe22b59e700 1 Processor -- start 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.110+0000 7fe22b59e700 1 -- start start 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe22c153c30 0x7fe22c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 0x7fe22c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c9170 con 0x7fe22c0cef40 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c8840 con 0x7fe22c15de50 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22b59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c8b20 con 0x7fe22c153c30 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53216/0 (socket says 172.21.15.26:53216) 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22a59c700 1 -- 172.21.15.26:0/235324707 learned_addr learned my addr 172.21.15.26:0/235324707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22ad9d700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 0x7fe22c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe223fff700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe22c153c30 0x7fe22c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.111+0000 7fe22a59c700 1 -- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe22c153c30 msgr2=0x7fe22c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22a59c700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe22c153c30 0x7fe22c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22a59c700 1 -- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 msgr2=0x7fe22c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22a59c700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 0x7fe22c0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22a59c700 1 -- 172.21.15.26:0/235324707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe214009420 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22ad9d700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 0x7fe22c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22a59c700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00c810 tx=0x7fe21c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c005c00 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c005d60 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0c8e00 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007340 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.112+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0c97c0 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.113+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c1535d0 con 0x7fe22c0cef40 2023-10-09T11:42:32.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.113+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe21c01b400 con 0x7fe22c0cef40 2023-10-09T11:42:32.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.114+0000 7fe2227fc700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 0x7fe20c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.114+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fe21c0847b0 con 0x7fe22c0cef40 2023-10-09T11:42:32.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.114+0000 7fe223fff700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 0x7fe20c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.115+0000 7fe223fff700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 0x7fe20c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2140091e0 tx=0x7fe214017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.118+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe21c051430 con 0x7fe22c0cef40 2023-10-09T11:42:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.314+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe22c0c9450 con 0x7fe22c0cef40 2023-10-09T11:42:32.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.314+0000 7fe2227fc700 1 -- 172.21.15.26:0/235324707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15575 (secure 0 0 0) 0x7fe21c054a50 con 0x7fe22c0cef40 2023-10-09T11:42:32.316 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:32.316 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":126,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:28.468473+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:58.413063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:58.991356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6834/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6832/2449545220":"2023-10-10T11:42:25.464367+0000","172.21.15.26:6835/2511463047":"2023-10-10T11:42:22.044737+0000","172.21.15.26:6833/2511463047":"2023-10-10T11:42:22.044737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 msgr2=0x7fe20c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 0x7fe20c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2140091e0 tx=0x7fe214017000 comp rx=0 tx=0).stop 2023-10-09T11:42:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 msgr2=0x7fe22c153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00c810 tx=0x7fe21c007d90 comp rx=0 tx=0).stop 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 shutdown_connections 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe22c15de50 0x7fe22c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22c0cef40 0x7fe22c153090 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe20c067320 0x7fe20c0697d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 --2- 172.21.15.26:0/235324707 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe22c153c30 0x7fe22c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.316+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 >> 172.21.15.26:0/235324707 conn(0x7fe22c0703a0 msgr2=0x7fe22c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.317+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 shutdown_connections 2023-10-09T11:42:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.317+0000 7fe22b59e700 1 -- 172.21.15.26:0/235324707 wait complete. 2023-10-09T11:42:32.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:42:32.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.448+0000 7fbfc2915700 1 Processor -- start 2023-10-09T11:42:32.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.448+0000 7fbfc2915700 1 -- start start 2023-10-09T11:42:32.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc2915700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc2915700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc15ae40 con 0x7fbfbc15a400 2023-10-09T11:42:32.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc2915700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc15ab60 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc2915700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0ce0f0 con 0x7fbfbc0cb970 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc0eb2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbfbc15a400 0x7fbfbc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38058/0 (socket says 172.21.15.26:38058) 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfc0eb2700 1 -- 172.21.15.26:0/2566244677 learned_addr learned my addr 172.21.15.26:0/2566244677 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/2566244677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.449+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522813091 0 0) 0x7fbfbc15ae40 con 0x7fbfbc15a400 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa8003570 con 0x7fbfbc15a400 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253109369 0 0) 0x7fbfbc15ab60 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfbc15ae40 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbb7fe700 1 -- 172.21.15.26:0/2566244677 >> v1:172.21.15.67:6789/0 conn(0x7fbfbc0cb5a0 legacy=0x7fbfbc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbb7fe700 1 -- 172.21.15.26:0/2566244677 >> v1:172.21.15.26:6789/0 conn(0x7fbfbc15a400 legacy=0x7fbfbc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 390944503 0 0) 0x7fbfa8003570 con 0x7fbfbc15a400 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbb7fe700 1 -- 172.21.15.26:0/2566244677 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0ccf00 con 0x7fbfbc0cb970 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/2566244677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc159ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009910 tx=0x7fbfac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9683e7598186124e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40017f0 con 0x7fbfbc0cb970 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac011420 con 0x7fbfbc0cb970 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.450+0000 7fbfbaffd700 1 -- 172.21.15.26:0/2566244677 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0117a0 con 0x7fbfbc0cb970 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 -- 172.21.15.26:0/2566244677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 msgr2=0x7fbfbc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 --2- 172.21.15.26:0/2566244677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc159ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009910 tx=0x7fbfac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 -- 172.21.15.26:0/2566244677 shutdown_connections 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 --2- 172.21.15.26:0/2566244677 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc159ec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 -- 172.21.15.26:0/2566244677 >> 172.21.15.26:0/2566244677 conn(0x7fbfbc070e30 msgr2=0x7fbfbc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 -- 172.21.15.26:0/2566244677 shutdown_connections 2023-10-09T11:42:32.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.451+0000 7fbfc2915700 1 -- 172.21.15.26:0/2566244677 wait complete. 2023-10-09T11:42:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.452+0000 7fbfc2915700 1 Processor -- start 2023-10-09T11:42:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.452+0000 7fbfc2915700 1 -- start start 2023-10-09T11:42:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 0x7fbfbc1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0cbde0 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0b5540 con 0x7fbfbc15a400 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0b4b70 con 0x7fbfbc0cb970 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53228/0 (socket says 172.21.15.26:53228) 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 -- 172.21.15.26:0/896358527 learned_addr learned my addr 172.21.15.26:0/896358527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc0eb2700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 0x7fbfbc1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 -- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 msgr2=0x7fbfbc15cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc15cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 -- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 msgr2=0x7fbfbc1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 0x7fbfbc1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 -- 172.21.15.26:0/896358527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac009420 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc0eb2700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 0x7fbfbc1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc15cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfbbfff700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c790 tx=0x7fbfa4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4010510 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4010670 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc0b3f60 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4010a10 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.453+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc0b4800 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.454+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc0b4360 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.455+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbfa401b400 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.455+0000 7fbfb3fff700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.455+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fbfa4084b70 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.455+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.456+0000 7fbfbb7fe700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 0x7fbf9c0697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0091e0 tx=0x7fbfac016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.459+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa4051750 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.696+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbfbc04c3c0 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.697 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:42:32.696+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:42:32.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.700+0000 7fbfb3fff700 1 -- 172.21.15.26:0/896358527 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbfa4054d70 con 0x7fbfbc0cb5a0 2023-10-09T11:42:32.703 INFO:tasks.ceph.mds.b.smithi067.stderr: -1499> 2023-10-09T11:42:05.948+0000 7f15a9e32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 msgr2=0x7fbf9c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 0x7fbf9c0697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0091e0 tx=0x7fbfac016000 comp rx=0 tx=0).stop 2023-10-09T11:42:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 msgr2=0x7fbfbc0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c790 tx=0x7fbfa4007e10 comp rx=0 tx=0).stop 2023-10-09T11:42:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 shutdown_connections 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfbc15a400 0x7fbfbc1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc0cb5a0 0x7fbfbc0b5000 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf9c067320 0x7fbf9c0697d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 --2- 172.21.15.26:0/896358527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbfbc0cb970 0x7fbfbc15cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 >> 172.21.15.26:0/896358527 conn(0x7fbfbc070e30 msgr2=0x7fbfbc0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 shutdown_connections 2023-10-09T11:42:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.702+0000 7fbfc2915700 1 -- 172.21.15.26:0/896358527 wait complete. 2023-10-09T11:42:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:42:32.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:42:32.728 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:42:32.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.836+0000 7f0a926d3700 1 Processor -- start 2023-10-09T11:42:32.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.836+0000 7f0a926d3700 1 -- start start 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a926d3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a926d3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a926d3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0ccfd0 con 0x7f0a8c159530 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a926d3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c15a3d0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a926d3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c15a6b0 con 0x7f0a8c06dc70 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53244/0 (socket says 172.21.15.26:53244) 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 -- 172.21.15.26:0/768987908 learned_addr learned my addr 172.21.15.26:0/768987908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a8b7fe700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 -- 172.21.15.26:0/768987908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 msgr2=0x7f0a8c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 -- 172.21.15.26:0/768987908 >> v1:172.21.15.67:6789/0 conn(0x7f0a8c159530 legacy=0x7f0a8c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 -- 172.21.15.26:0/768987908 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c15a990 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a8b7fe700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a90c70700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009f20 tx=0x7f0a84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6403fd3df3bf9cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a8affd700 1 -- 172.21.15.26:0/768987908 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400e070 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a8affd700 1 -- 172.21.15.26:0/768987908 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400ba80 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.837+0000 7f0a8affd700 1 -- 172.21.15.26:0/768987908 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840092e0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 -- 172.21.15.26:0/768987908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 msgr2=0x7f0a8c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009f20 tx=0x7f0a84009840 comp rx=0 tx=0).stop 2023-10-09T11:42:32.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 -- 172.21.15.26:0/768987908 shutdown_connections 2023-10-09T11:42:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c0cb6f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 --2- 172.21.15.26:0/768987908 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 -- 172.21.15.26:0/768987908 >> 172.21.15.26:0/768987908 conn(0x7f0a8c0703a0 msgr2=0x7f0a8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 -- 172.21.15.26:0/768987908 shutdown_connections 2023-10-09T11:42:32.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.838+0000 7f0a926d3700 1 -- 172.21.15.26:0/768987908 wait complete. 2023-10-09T11:42:32.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.839+0000 7f0a926d3700 1 Processor -- start 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.839+0000 7f0a926d3700 1 -- start start 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 0x7f0a8c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c144590 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c144240 con 0x7f0a8c159530 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a926d3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c158750 con 0x7f0a8c06dc70 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53252/0 (socket says 172.21.15.26:53252) 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 -- 172.21.15.26:0/451826186 learned_addr learned my addr 172.21.15.26:0/451826186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a90c70700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 0x7f0a8c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8bfff700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 -- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 msgr2=0x7f0a8c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 -- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 msgr2=0x7f0a8c0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 0x7f0a8c0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 -- 172.21.15.26:0/451826186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84009ae0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a90c70700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 0x7f0a8c0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.840+0000 7f0a8b7fe700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000e8d0 tx=0x7f0a80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.841+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000ee70 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.841+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8000c5e0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.841+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c158a30 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.841+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000c980 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.841+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c1560a0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.842+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c04c3c0 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.842+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a80013410 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.842+0000 7f0a73fff700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 0x7f0a780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.842+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0a80084c70 con 0x7f0a8c06e0e0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.843+0000 7f0a8bfff700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 0x7f0a780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.843+0000 7f0a8bfff700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 0x7f0a780697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0037c0 tx=0x7f0a7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:32.847+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a800516f0 con 0x7f0a8c06e0e0 2023-10-09T11:42:33.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.087+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a8c1446d0 con 0x7f0a8c06e0e0 2023-10-09T11:42:33.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.703+0000 7f0a73fff700 1 -- 172.21.15.26:0/451826186 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a80054d10 con 0x7f0a8c06e0e0 2023-10-09T11:42:33.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 msgr2=0x7f0a780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 0x7f0a780697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0037c0 tx=0x7f0a7c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 msgr2=0x7f0a8c155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000e8d0 tx=0x7f0a80008040 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 shutdown_connections 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8c159530 0x7f0a8c0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0a78067320 0x7f0a780697d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a8c06dc70 0x7f0a8c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 --2- 172.21.15.26:0/451826186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a8c06e0e0 0x7f0a8c155b60 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 >> 172.21.15.26:0/451826186 conn(0x7f0a8c0703a0 msgr2=0x7f0a8c1550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 shutdown_connections 2023-10-09T11:42:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.706+0000 7f0a926d3700 1 -- 172.21.15.26:0/451826186 wait complete. 2023-10-09T11:42:33.722 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:42:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.850+0000 7f16072af700 1 Processor -- start 2023-10-09T11:42:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.850+0000 7f16072af700 1 -- start start 2023-10-09T11:42:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160015cb90 0x7f16000c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f160015dc10 0x7f160006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 0x7f16000c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16000ccdf0 con 0x7f160015dc10 2023-10-09T11:42:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16000c9b20 con 0x7f160006cbe0 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16072af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160006d040 con 0x7f160015cb90 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f160015dc10 0x7f160006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f160015dc10 0x7f160006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53256/0 (socket says 172.21.15.26:53256) 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 -- 172.21.15.26:0/577214442 learned_addr learned my addr 172.21.15.26:0/577214442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1606aae700 1 --2- 172.21.15.26:0/577214442 >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 0x7f16000c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16062ad700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160015cb90 0x7f16000c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 -- 172.21.15.26:0/577214442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160015cb90 msgr2=0x7f16000c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160015cb90 0x7f16000c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 -- 172.21.15.26:0/577214442 >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 msgr2=0x7f16000c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 --2- 172.21.15.26:0/577214442 >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 0x7f16000c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 -- 172.21.15.26:0/577214442 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000c2fa0 con 0x7f160015dc10 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1606aae700 1 --2- 172.21.15.26:0/577214442 >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 0x7f16000c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f1605aac700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160006c6a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f160006d760 tx=0x7f15f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6147428d95a9516e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16052ab700 1 -- 172.21.15.26:0/577214442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400b860 con 0x7f160015dc10 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16052ab700 1 -- 172.21.15.26:0/577214442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400b9c0 con 0x7f160015dc10 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.851+0000 7f16052ab700 1 -- 172.21.15.26:0/577214442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400bd60 con 0x7f160015dc10 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 -- 172.21.15.26:0/577214442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 msgr2=0x7f160006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160006c6a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f160006d760 tx=0x7f15f4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 -- 172.21.15.26:0/577214442 shutdown_connections 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 --2- 172.21.15.26:0/577214442 >> v2:172.21.15.67:3300/0 conn(0x7f160006cbe0 0x7f16000c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160015cb90 0x7f16000c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 --2- 172.21.15.26:0/577214442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160006c6a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 -- 172.21.15.26:0/577214442 >> 172.21.15.26:0/577214442 conn(0x7f16000cd230 msgr2=0x7f16000cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 -- 172.21.15.26:0/577214442 shutdown_connections 2023-10-09T11:42:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.852+0000 7f16072af700 1 -- 172.21.15.26:0/577214442 wait complete. 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.853+0000 7f16072af700 1 Processor -- start 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.853+0000 7f16072af700 1 -- start start 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 0x7f160013f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 0x7f16000c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1600156af0 con 0x7f160015dc10 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160016d140 con 0x7f160015cb90 2023-10-09T11:42:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16072af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160013dfa0 con 0x7f160006cbe0 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53268/0 (socket says 172.21.15.26:53268) 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 -- 172.21.15.26:0/1958130740 learned_addr learned my addr 172.21.15.26:0/1958130740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16062ad700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 0x7f160013f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1605aac700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 0x7f16000c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 -- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 msgr2=0x7f160013f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 0x7f160013f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 -- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 msgr2=0x7f16000c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 0x7f16000c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 -- 172.21.15.26:0/1958130740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40094f0 con 0x7f160015dc10 2023-10-09T11:42:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f16062ad700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 0x7f160013f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1605aac700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 0x7f16000c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.854+0000 7f1606aae700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f15f800a380 tx=0x7f15f8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800ae10 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f800d650 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800da10 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160013fb70 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1600156d40 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.855+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160016d2f0 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.856+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f15f8015440 con 0x7f160015dc10 2023-10-09T11:42:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.856+0000 7f15fe7fc700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 0x7f15ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.856+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f15f80856f0 con 0x7f160015dc10 2023-10-09T11:42:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.857+0000 7f16062ad700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 0x7f15ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.857+0000 7f16062ad700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 0x7f15ec0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f15f000ab70 tx=0x7f15f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:33.861+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f160016d2f0 con 0x7f160015dc10 2023-10-09T11:42:34.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.053+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f160016d2f0 con 0x7f160015dc10 2023-10-09T11:42:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.705+0000 7f15fe7fc700 1 -- 172.21.15.26:0/1958130740 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f160016d2f0 con 0x7f160015dc10 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 msgr2=0x7f15ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 0x7f15ec0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f15f000ab70 tx=0x7f15f0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 msgr2=0x7f160013e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f15f800a380 tx=0x7f15f8007900 comp rx=0 tx=0).stop 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 shutdown_connections 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f160015dc10 0x7f160013e6b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f15ec067320 0x7f15ec0697d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160006cbe0 0x7f160013f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 --2- 172.21.15.26:0/1958130740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160015cb90 0x7f16000c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 >> 172.21.15.26:0/1958130740 conn(0x7f16000cd230 msgr2=0x7f160015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 shutdown_connections 2023-10-09T11:42:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.709+0000 7f16072af700 1 -- 172.21.15.26:0/1958130740 wait complete. 2023-10-09T11:42:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:42:34.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:42:34.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.856+0000 7fa8e7590700 1 Processor -- start 2023-10-09T11:42:34.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.856+0000 7fa8e7590700 1 -- start start 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e7590700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e0159770 0x7fa8e006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e7590700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8e00cacb0 0x7fa8e00c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e7590700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e006d740 con 0x7fa8e006c6a0 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e7590700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e0159b40 con 0x7fa8e00cacb0 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e7590700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e006cb30 con 0x7fa8e0159770 2023-10-09T11:42:34.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e6d8f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8e00cacb0 0x7fa8e00c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e5d8d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa8e006c6a0 0x7fa8e00ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38060/0 (socket says 172.21.15.26:38060) 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e5d8d700 1 -- 172.21.15.26:0/1032432451 learned_addr learned my addr 172.21.15.26:0/1032432451 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.857+0000 7fa8e658e700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e0159770 0x7fa8e006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e6d8f700 1 -- 172.21.15.26:0/1032432451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e0159770 msgr2=0x7fa8e006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e6d8f700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e0159770 0x7fa8e006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e6d8f700 1 -- 172.21.15.26:0/1032432451 >> v1:172.21.15.26:6789/0 conn(0x7fa8e006c6a0 legacy=0x7fa8e00ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e6d8f700 1 -- 172.21.15.26:0/1032432451 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e006ce10 con 0x7fa8e00cacb0 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e558c700 1 -- 172.21.15.26:0/1032432451 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302940762 0 0) 0x7fa8e006d740 con 0x7fa8e006c6a0 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e6d8f700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e00c7010 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098e0 tx=0x7fa8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94577f6b2780f9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e558c700 1 -- 172.21.15.26:0/1032432451 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8009e80 con 0x7fa8e00cacb0 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e558c700 1 -- 172.21.15.26:0/1032432451 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800b860 con 0x7fa8e00cacb0 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e558c700 1 -- 172.21.15.26:0/1032432451 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800bbe0 con 0x7fa8e00cacb0 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e7590700 1 -- 172.21.15.26:0/1032432451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 msgr2=0x7fa8e00c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.858+0000 7fa8e7590700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e00c7010 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098e0 tx=0x7fa8d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 -- 172.21.15.26:0/1032432451 shutdown_connections 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e00c7010 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 --2- 172.21.15.26:0/1032432451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e0159770 0x7fa8e006dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 -- 172.21.15.26:0/1032432451 >> 172.21.15.26:0/1032432451 conn(0x7fa8e006e790 msgr2=0x7fa8e006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 -- 172.21.15.26:0/1032432451 shutdown_connections 2023-10-09T11:42:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.859+0000 7fa8e7590700 1 -- 172.21.15.26:0/1032432451 wait complete. 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 Processor -- start 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 -- start start 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e006c6a0 0x7fa8e0144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0159770 0x7fa8e015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0144b60 con 0x7fa8e00cacb0 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015d610 con 0x7fa8e0159770 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e7590700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0144dd0 con 0x7fa8e006c6a0 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.860+0000 7fa8e5d8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53288/0 (socket says 172.21.15.26:53288) 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 -- 172.21.15.26:0/2150221062 learned_addr learned my addr 172.21.15.26:0/2150221062 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e658e700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e006c6a0 0x7fa8e0144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 -- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e006c6a0 msgr2=0x7fa8e0144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e006c6a0 0x7fa8e0144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 -- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0159770 msgr2=0x7fa8e015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e6d8f700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0159770 0x7fa8e015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0159770 0x7fa8e015bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 -- 172.21.15.26:0/2150221062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8009420 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e5d8d700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400c7e0 tx=0x7fa8d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4005b30 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d4005c90 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4007300 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e01450b0 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.861+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e015d8f0 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.862+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e01452f0 con 0x7fa8e00cacb0 2023-10-09T11:42:34.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.863+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8d401b400 con 0x7fa8e00cacb0 2023-10-09T11:42:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.863+0000 7fa8de7fc700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 0x7fa8cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.863+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5525+0+0 (secure 0 0 0) 0x7fa8d4084650 con 0x7fa8e00cacb0 2023-10-09T11:42:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.863+0000 7fa8e658e700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 0x7fa8cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.864+0000 7fa8e658e700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 0x7fa8cc0697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009fd0 tx=0x7fa8d000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:34.867+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8e01452f0 con 0x7fa8e00cacb0 2023-10-09T11:42:35.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.060+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8e01452f0 con 0x7fa8e00cacb0 2023-10-09T11:42:35.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.710+0000 7fa8de7fc700 1 -- 172.21.15.26:0/2150221062 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8e01452f0 con 0x7fa8e00cacb0 2023-10-09T11:42:35.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 msgr2=0x7fa8cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 0x7fa8cc0697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009fd0 tx=0x7fa8d000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 msgr2=0x7fa8e015f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400c7e0 tx=0x7fa8d4007df0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 shutdown_connections 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0159770 0x7fa8e015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa8cc067320 0x7fa8cc0697d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8e006c6a0 0x7fa8e0144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 --2- 172.21.15.26:0/2150221062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8e00cacb0 0x7fa8e015f9d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 >> 172.21.15.26:0/2150221062 conn(0x7fa8e006e790 msgr2=0x7fa8e00c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:35.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 shutdown_connections 2023-10-09T11:42:35.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.713+0000 7fa8e7590700 1 -- 172.21.15.26:0/2150221062 wait complete. 2023-10-09T11:42:35.716 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:42:35.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:42:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.853+0000 7f28328dc700 1 Processor -- start 2023-10-09T11:42:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.853+0000 7f28328dc700 1 -- start start 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28328dc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f282c15dfd0 0x7f282c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28328dc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0acc00 con 0x7f282c159920 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28328dc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0abff0 con 0x7f282c159550 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28328dc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0ac2d0 con 0x7f282c15dfd0 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28320db700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f282c159920 0x7f282c0ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38062/0 (socket says 172.21.15.26:38062) 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28320db700 1 -- 172.21.15.26:0/227523293 learned_addr learned my addr 172.21.15.26:0/227523293 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.854+0000 7f28310d9700 1 --2- 172.21.15.26:0/227523293 >> v2:172.21.15.67:3300/0 conn(0x7f282c15dfd0 0x7f282c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774122320 0 0) 0x7f282c0acc00 con 0x7f282c159920 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2814003570 con 0x7f282c159920 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905790808 0 0) 0x7f2814003570 con 0x7f282c159920 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 >> v2:172.21.15.67:3300/0 conn(0x7f282c15dfd0 msgr2=0x7f282c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 --2- 172.21.15.26:0/227523293 >> v2:172.21.15.67:3300/0 conn(0x7f282c15dfd0 0x7f282c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 >> v1:172.21.15.67:6789/0 conn(0x7f282c159550 legacy=0x7f282c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0ac5b0 con 0x7f282c159920 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f2824001470 con 0x7f282c159920 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 >> v1:172.21.15.26:6789/0 conn(0x7f282c159920 legacy=0x7f282c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2814003a60 0x7f2814003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2814004810 0x7f2814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f281400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0ac2d0 con 0x7f28140051c0 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281400c0b0 con 0x7f2814004810 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281400c270 con 0x7f2814003a60 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f281400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28318da700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2814003a60 0x7f2814003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28310d9700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2814004810 0x7f2814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 -- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2814003a60 msgr2=0x7f2814003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2814003a60 0x7f2814003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 -- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2814004810 msgr2=0x7f2814004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2814004810 0x7f2814004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 -- 172.21.15.26:0/227523293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814003570 con 0x7f28140051c0 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.855+0000 7f28320db700 1 -- 172.21.15.26:0/227523293 reap_dead start 2023-10-09T11:42:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28320db700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f281400ba60 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f282400c2d0 tx=0x7f2824001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48927e9d71248311 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400cba0 con 0x7f28140051c0 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282400cd40 con 0x7f28140051c0 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28308d8700 1 -- 172.21.15.26:0/227523293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824005b70 con 0x7f28140051c0 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 -- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 msgr2=0x7f281400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f281400ba60 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f282400c2d0 tx=0x7f2824001da0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 -- 172.21.15.26:0/227523293 shutdown_connections 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 --2- 172.21.15.26:0/227523293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f281400ba60 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 -- 172.21.15.26:0/227523293 >> 172.21.15.26:0/227523293 conn(0x7f282c06ce80 msgr2=0x7f282c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 -- 172.21.15.26:0/227523293 shutdown_connections 2023-10-09T11:42:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.856+0000 7f28328dc700 1 -- 172.21.15.26:0/227523293 wait complete. 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.857+0000 7f28328dc700 1 Processor -- start 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.857+0000 7f28328dc700 1 -- start start 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f282c0cadb0 0x7f282c1699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f282c169ef0 0x7f282c16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0cd140 con 0x7f28140051c0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c16a880 con 0x7f282c169ef0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28328dc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0b1830 con 0x7f282c0cadb0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28318da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28318da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53304/0 (socket says 172.21.15.26:53304) 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28318da700 1 -- 172.21.15.26:0/673648557 learned_addr learned my addr 172.21.15.26:0/673648557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28320db700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f282c169ef0 0x7f282c16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28310d9700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f282c0cadb0 0x7f282c1699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28318da700 1 -- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f282c0cadb0 msgr2=0x7f282c1699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.858+0000 7f28318da700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f282c0cadb0 0x7f282c1699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28318da700 1 -- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f282c169ef0 msgr2=0x7f282c16a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28318da700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f282c169ef0 0x7f282c16a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28318da700 1 -- 172.21.15.26:0/673648557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0b1b10 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28318da700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebc0 tx=0x7f281c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0019e0 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c001b40 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c14c960 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00c780 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.859+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c0cd330 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.860+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c04c3c0 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.860+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f281c00cbb0 con 0x7f28140051c0 2023-10-09T11:42:35.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.861+0000 7f2829ffb700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 0x7f28180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.861+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f281c084e90 con 0x7f28140051c0 2023-10-09T11:42:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.861+0000 7f28310d9700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 0x7f28180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.861+0000 7f28310d9700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 0x7f28180697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f282c16cf00 tx=0x7f28200091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:35.865+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f281c051d70 con 0x7f28140051c0 2023-10-09T11:42:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.057+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f282c06e7c0 con 0x7f28140051c0 2023-10-09T11:42:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.061+0000 7f2829ffb700 1 -- 172.21.15.26:0/673648557 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f281c0860a0 con 0x7f28140051c0 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 msgr2=0x7f28180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 0x7f28180697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f282c16cf00 tx=0x7f28200091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 msgr2=0x7f282c14cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebc0 tx=0x7f281c0016d0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 shutdown_connections 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f282c169ef0 0x7f282c16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28140051c0 0x7f282c14cfe0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2818067320 0x7f28180697d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 --2- 172.21.15.26:0/673648557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f282c0cadb0 0x7f282c1699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 >> 172.21.15.26:0/673648557 conn(0x7f282c06ce80 msgr2=0x7f282c1550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 shutdown_connections 2023-10-09T11:42:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.063+0000 7f28328dc700 1 -- 172.21.15.26:0/673648557 wait complete. 2023-10-09T11:42:36.076 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-09T11:42:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.195+0000 7f78b091c700 1 Processor -- start 2023-10-09T11:42:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.195+0000 7f78b091c700 1 -- start start 2023-10-09T11:42:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.196+0000 7f78b091c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78ac0cbe00 0x7f78ac1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.196+0000 7f78b091c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac0ce9d0 con 0x7f78ac159c80 2023-10-09T11:42:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.196+0000 7f78b091c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac0af960 con 0x7f78ac1598b0 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.196+0000 7f78b091c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac0afc30 con 0x7f78ac0cbe00 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78aad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78ac0cbe00 0x7f78ac1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a9d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f78ac159c80 0x7f78ac0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38064/0 (socket says 172.21.15.26:38064) 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a9d9b700 1 -- 172.21.15.26:0/1841393772 learned_addr learned my addr 172.21.15.26:0/1841393772 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240115122 0 0) 0x7f78ac0ce9d0 con 0x7f78ac159c80 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7898003570 con 0x7f78ac159c80 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521730546 0 0) 0x7f78ac0af960 con 0x7f78ac1598b0 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ac0ce9d0 con 0x7f78ac1598b0 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78aad9d700 1 -- 172.21.15.26:0/1841393772 >> v1:172.21.15.67:6789/0 conn(0x7f78ac1598b0 legacy=0x7f78ac0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78aad9d700 1 -- 172.21.15.26:0/1841393772 >> v1:172.21.15.26:6789/0 conn(0x7f78ac159c80 legacy=0x7f78ac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78aad9d700 1 -- 172.21.15.26:0/1841393772 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0aff10 con 0x7f78ac0cbe00 2023-10-09T11:42:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78aad9d700 1 --2- 172.21.15.26:0/1841393772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac0cbe00 0x7f78ac1645a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009e60 tx=0x7f78a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52383488875da0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400e070 con 0x7f78ac0cbe00 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400bab0 con 0x7f78ac0cbe00 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.197+0000 7f78a959a700 1 -- 172.21.15.26:0/1841393772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400be70 con 0x7f78ac0cbe00 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 -- 172.21.15.26:0/1841393772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac0cbe00 msgr2=0x7f78ac1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 --2- 172.21.15.26:0/1841393772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac0cbe00 0x7f78ac1645a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009e60 tx=0x7f78a4009780 comp rx=0 tx=0).stop 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 -- 172.21.15.26:0/1841393772 shutdown_connections 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 --2- 172.21.15.26:0/1841393772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac0cbe00 0x7f78ac1645a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 -- 172.21.15.26:0/1841393772 >> 172.21.15.26:0/1841393772 conn(0x7f78ac070e30 msgr2=0x7f78ac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 -- 172.21.15.26:0/1841393772 shutdown_connections 2023-10-09T11:42:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.198+0000 7f78b091c700 1 -- 172.21.15.26:0/1841393772 wait complete. 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.199+0000 7f78b091c700 1 Processor -- start 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.199+0000 7f78b091c700 1 -- start start 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78ac0cbe00 0x7f78ac155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac159c80 0x7f78ac15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac15b150 con 0x7f78ac1598b0 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac155860 con 0x7f78ac159c80 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac158b90 con 0x7f78ac0cbe00 2023-10-09T11:42:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53314/0 (socket says 172.21.15.26:53314) 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 -- 172.21.15.26:0/1769385519 learned_addr learned my addr 172.21.15.26:0/1769385519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 -- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78ac0cbe00 msgr2=0x7f78ac155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78ac0cbe00 0x7f78ac155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 -- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac159c80 msgr2=0x7f78ac15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac159c80 0x7f78ac15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 -- 172.21.15.26:0/1769385519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009a20 con 0x7f78ac1598b0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a9d9b700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f789400c7c0 tx=0x7f7894007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894005b30 con 0x7f78ac1598b0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894005c90 con 0x7f78ac1598b0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac158e70 con 0x7f78ac1598b0 2023-10-09T11:42:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.200+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940072e0 con 0x7f78ac1598b0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.201+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac15de10 con 0x7f78ac1598b0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.201+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac04c3c0 con 0x7f78ac1598b0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.202+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7894007650 con 0x7f78ac1598b0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.202+0000 7f78a27fc700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 0x7f788c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.202+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f7894083e50 con 0x7f78ac1598b0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.202+0000 7f78aa59c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 0x7f788c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.203+0000 7f78aa59c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 0x7f788c0697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f789c0026f0 tx=0x7f789c0079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.207+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f789404b5a0 con 0x7f78ac1598b0 2023-10-09T11:42:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.489+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7f78ac0ce380 con 0x7f78ac1598b0 2023-10-09T11:42:36.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.712+0000 7f78a27fc700 1 -- 172.21.15.26:0/1769385519 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v359) v1 ==== 131+0+0 (secure 0 0 0) 0x7f7894017020 con 0x7f78ac1598b0 2023-10-09T11:42:36.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 msgr2=0x7f788c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 0x7f788c0697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f789c0026f0 tx=0x7f789c0079d0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 msgr2=0x7f78ac15d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f789400c7c0 tx=0x7f7894007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 shutdown_connections 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac159c80 0x7f78ac15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.714+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f788c067320 0x7f788c0697d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.715+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78ac0cbe00 0x7f78ac155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.715+0000 7f78b091c700 1 --2- 172.21.15.26:0/1769385519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78ac1598b0 0x7f78ac15d8d0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.715+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 >> 172.21.15.26:0/1769385519 conn(0x7f78ac070e30 msgr2=0x7f78ac0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.715+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 shutdown_connections 2023-10-09T11:42:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.715+0000 7f78b091c700 1 -- 172.21.15.26:0/1769385519 wait complete. 2023-10-09T11:42:36.728 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-09T11:42:36.729 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-09T11:42:36.729 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:42:36.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-09T11:42:36.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.848+0000 7ff27dff2700 1 Processor -- start 2023-10-09T11:42:36.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.848+0000 7ff27dff2700 1 -- start start 2023-10-09T11:42:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff27dff2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2781598b0 0x7ff2780af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff27dff2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780ce9d0 con 0x7ff2780af790 2023-10-09T11:42:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff27dff2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780afc30 con 0x7ff278159c80 2023-10-09T11:42:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff27dff2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780aff10 con 0x7ff2781598b0 2023-10-09T11:42:36.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff2777fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2781598b0 0x7ff2780af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff277fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff2780af790 0x7ff278163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38074/0 (socket says 172.21.15.26:38074) 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.849+0000 7ff277fff700 1 -- 172.21.15.26:0/1810945804 learned_addr learned my addr 172.21.15.26:0/1810945804 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2767fc700 1 -- 172.21.15.26:0/1810945804 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452668337 0 0) 0x7ff2780ce9d0 con 0x7ff2780af790 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2767fc700 1 -- 172.21.15.26:0/1810945804 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff260003570 con 0x7ff2780af790 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2777fe700 1 -- 172.21.15.26:0/1810945804 >> v1:172.21.15.67:6789/0 conn(0x7ff278159c80 legacy=0x7ff2780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2777fe700 1 -- 172.21.15.26:0/1810945804 >> v1:172.21.15.26:6789/0 conn(0x7ff2780af790 legacy=0x7ff278163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2777fe700 1 -- 172.21.15.26:0/1810945804 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780ce380 con 0x7ff2781598b0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2777fe700 1 --2- 172.21.15.26:0/1810945804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780af250 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff2680098e0 tx=0x7ff2680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be1932fbd87e331 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2767fc700 1 -- 172.21.15.26:0/1810945804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800b640 con 0x7ff2781598b0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2767fc700 1 -- 172.21.15.26:0/1810945804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800b7a0 con 0x7ff2781598b0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.850+0000 7ff2767fc700 1 -- 172.21.15.26:0/1810945804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800bb40 con 0x7ff2781598b0 2023-10-09T11:42:36.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 -- 172.21.15.26:0/1810945804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 msgr2=0x7ff2780af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 --2- 172.21.15.26:0/1810945804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780af250 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff2680098e0 tx=0x7ff2680091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 -- 172.21.15.26:0/1810945804 shutdown_connections 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 --2- 172.21.15.26:0/1810945804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780af250 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 -- 172.21.15.26:0/1810945804 >> 172.21.15.26:0/1810945804 conn(0x7ff278070e30 msgr2=0x7ff2780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 -- 172.21.15.26:0/1810945804 shutdown_connections 2023-10-09T11:42:36.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.851+0000 7ff27dff2700 1 -- 172.21.15.26:0/1810945804 wait complete. 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.852+0000 7ff27dff2700 1 Processor -- start 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.852+0000 7ff27dff2700 1 -- start start 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2780af790 0x7ff27815fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 0x7ff27814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c8c40 con 0x7ff2781598b0 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c7d90 con 0x7ff278159c80 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff27dff2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c8030 con 0x7ff2780af790 2023-10-09T11:42:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53342/0 (socket says 172.21.15.26:53342) 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 -- 172.21.15.26:0/937169350 learned_addr learned my addr 172.21.15.26:0/937169350 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff277fff700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 0x7ff27814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 -- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2780af790 msgr2=0x7ff27815fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff2777fe700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2780af790 0x7ff27815fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2780af790 0x7ff27815fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 -- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 msgr2=0x7ff27814e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 0x7ff27814e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 -- 172.21.15.26:0/937169350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009420 con 0x7ff2781598b0 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff277fff700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 0x7ff27814e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff276ffd700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c510 tx=0x7ff26c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.853+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c011590 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.854+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c011710 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.854+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2780c8310 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.854+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c011ad0 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.854+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780c88d0 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.854+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780c8df0 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.855+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff26c01b3b0 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.855+0000 7ff25f7fe700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 0x7ff2640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.855+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7ff26c083f90 con 0x7ff2781598b0 2023-10-09T11:42:36.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.856+0000 7ff2777fe700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 0x7ff2640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:36.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.856+0000 7ff2777fe700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 0x7ff2640697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff268003080 tx=0x7ff268017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:36.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:36.860+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2780c8df0 con 0x7ff2781598b0 2023-10-09T11:42:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.132+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7ff27804c3c0 con 0x7ff2781598b0 2023-10-09T11:42:37.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.717+0000 7ff25f7fe700 1 -- 172.21.15.26:0/937169350 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v360) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff26c017020 con 0x7ff2781598b0 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 msgr2=0x7ff2640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 0x7ff2640697d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff268003080 tx=0x7ff268017000 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 msgr2=0x7ff2780c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c510 tx=0x7ff26c00c8d0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 shutdown_connections 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278159c80 0x7ff27814e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff264067320 0x7ff2640697d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2780af790 0x7ff27815fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 --2- 172.21.15.26:0/937169350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2781598b0 0x7ff2780c7850 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 >> 172.21.15.26:0/937169350 conn(0x7ff278070e30 msgr2=0x7ff2780cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 shutdown_connections 2023-10-09T11:42:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.719+0000 7ff27dff2700 1 -- 172.21.15.26:0/937169350 wait complete. 2023-10-09T11:42:37.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:42:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.862+0000 7fe26793f700 1 Processor -- start 2023-10-09T11:42:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.862+0000 7fe26793f700 1 -- start start 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe26793f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe260159530 0x7fe2600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe26793f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe26006e0e0 0x7fe2600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe26793f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2600ccfd0 con 0x7fe26006dc70 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe26793f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600cf0e0 con 0x7fe260159530 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe26793f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26015a3d0 con 0x7fe26006e0e0 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe260159530 0x7fe2600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe260159530 0x7fe2600ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53344/0 (socket says 172.21.15.26:53344) 2023-10-09T11:42:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 -- 172.21.15.26:0/1698193555 learned_addr learned my addr 172.21.15.26:0/1698193555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe265edc700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe26006e0e0 0x7fe2600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 -- 172.21.15.26:0/1698193555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe26006e0e0 msgr2=0x7fe2600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe26006e0e0 0x7fe2600cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 -- 172.21.15.26:0/1698193555 >> v1:172.21.15.67:6789/0 conn(0x7fe26006dc70 legacy=0x7fe260159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.863+0000 7fe2656db700 1 -- 172.21.15.26:0/1698193555 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26015a6b0 con 0x7fe260159530 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe2656db700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe260159530 0x7fe2600ceba0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe250009f20 tx=0x7fe250009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffae0614f56e5978 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe25ffff700 1 -- 172.21.15.26:0/1698193555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000e070 con 0x7fe260159530 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe25ffff700 1 -- 172.21.15.26:0/1698193555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000ba40 con 0x7fe260159530 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe25ffff700 1 -- 172.21.15.26:0/1698193555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2500092e0 con 0x7fe260159530 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 -- 172.21.15.26:0/1698193555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe260159530 msgr2=0x7fe2600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe260159530 0x7fe2600ceba0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe250009f20 tx=0x7fe250009840 comp rx=0 tx=0).stop 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 -- 172.21.15.26:0/1698193555 shutdown_connections 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe26006e0e0 0x7fe2600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 --2- 172.21.15.26:0/1698193555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe260159530 0x7fe2600ceba0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 -- 172.21.15.26:0/1698193555 >> 172.21.15.26:0/1698193555 conn(0x7fe2600703a0 msgr2=0x7fe2600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 -- 172.21.15.26:0/1698193555 shutdown_connections 2023-10-09T11:42:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.864+0000 7fe26793f700 1 -- 172.21.15.26:0/1698193555 wait complete. 2023-10-09T11:42:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 Processor -- start 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 -- start start 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe26006dc70 0x7fe260151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe260159530 0x7fe2600cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600b4cf0 con 0x7fe26006e0e0 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.866+0000 7fe26793f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600c8cb0 con 0x7fe26006dc70 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe26793f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601699d0 con 0x7fe260159530 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53348/0 (socket says 172.21.15.26:53348) 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 -- 172.21.15.26:0/2165711304 learned_addr learned my addr 172.21.15.26:0/2165711304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe2656db700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe26006dc70 0x7fe260151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe265edc700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe260159530 0x7fe2600cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 -- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe260159530 msgr2=0x7fe2600cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe260159530 0x7fe2600cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 -- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe26006dc70 msgr2=0x7fe260151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe26006dc70 0x7fe260151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 -- 172.21.15.26:0/2165711304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250009ae0 con 0x7fe26006e0e0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe264eda700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c600 tx=0x7fe254007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011590 con 0x7fe26006e0e0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011710 con 0x7fe26006e0e0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe260152340 con 0x7fe26006e0e0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011ad0 con 0x7fe26006e0e0 2023-10-09T11:42:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.867+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2600c8410 con 0x7fe26006e0e0 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.868+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2600b4e60 con 0x7fe26006e0e0 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.869+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe25401c460 con 0x7fe26006e0e0 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.869+0000 7fe25d7fa700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 0x7fe24c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.869+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fe254084800 con 0x7fe26006e0e0 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.869+0000 7fe2656db700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 0x7fe24c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:37.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.870+0000 7fe2656db700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 0x7fe24c0697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe250009880 tx=0x7fe250017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:37.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:37.874+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2600b4e60 con 0x7fe26006e0e0 2023-10-09T11:42:38.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.066+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe2600b4e30 con 0x7fe26006e0e0 2023-10-09T11:42:38.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.070+0000 7fe25d7fa700 1 -- 172.21.15.26:0/2165711304 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe2540516e0 con 0x7fe26006e0e0 2023-10-09T11:42:38.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 msgr2=0x7fe24c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 0x7fe24c0697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe250009880 tx=0x7fe250017000 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 msgr2=0x7fe2600cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c600 tx=0x7fe254007f60 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 shutdown_connections 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe24c067320 0x7fe24c0697d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe260159530 0x7fe2600cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe26006dc70 0x7fe260151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 --2- 172.21.15.26:0/2165711304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe26006e0e0 0x7fe2600cb4b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 >> 172.21.15.26:0/2165711304 conn(0x7fe2600703a0 msgr2=0x7fe26015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 shutdown_connections 2023-10-09T11:42:38.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.072+0000 7fe26793f700 1 -- 172.21.15.26:0/2165711304 wait complete. 2023-10-09T11:42:38.085 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:38.086 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:38.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:38.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:38.163 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:42:38.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.282+0000 7fdf6a6af700 1 Processor -- start 2023-10-09T11:42:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.282+0000 7fdf6a6af700 1 -- start start 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf6a6af700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdf640d0780 0x7fdf640d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf6a6af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640ced70 con 0x7fdf640ce7b0 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf6a6af700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640cf050 con 0x7fdf641599e0 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf6a6af700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf640cf330 con 0x7fdf640d0780 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf637fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf640ce7b0 0x7fdf641592d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38090/0 (socket says 172.21.15.26:38090) 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf637fe700 1 -- 172.21.15.26:0/1252443611 learned_addr learned my addr 172.21.15.26:0/1252443611 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf63fff700 1 --2- 172.21.15.26:0/1252443611 >> v2:172.21.15.67:3300/0 conn(0x7fdf640d0780 0x7fdf640d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647133402 0 0) 0x7fdf640ced70 con 0x7fdf640ce7b0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf50003570 con 0x7fdf640ce7b0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2516789030 0 0) 0x7fdf50003570 con 0x7fdf640ce7b0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 >> v2:172.21.15.67:3300/0 conn(0x7fdf640d0780 msgr2=0x7fdf640d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 --2- 172.21.15.26:0/1252443611 >> v2:172.21.15.67:3300/0 conn(0x7fdf640d0780 0x7fdf640d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 >> v1:172.21.15.67:6789/0 conn(0x7fdf641599e0 legacy=0x7fdf640b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640cf610 con 0x7fdf640ce7b0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fdf54001470 con 0x7fdf640ce7b0 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 >> v1:172.21.15.26:6789/0 conn(0x7fdf640ce7b0 legacy=0x7fdf641592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.283+0000 7fdf62ffd700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf50003a60 0x7fdf50003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf500051c0 0x7fdf5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640cf330 con 0x7fdf50004810 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5000c050 con 0x7fdf50003a60 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5000c210 con 0x7fdf500051c0 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf63fff700 1 --2- 172.21.15.26:0/1252443611 >> v2:172.21.15.67:3300/0 conn(0x7fdf640d0780 0x7fdf640d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf68c4c700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf500051c0 0x7fdf5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf63fff700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf50003a60 0x7fdf50003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 -- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf500051c0 msgr2=0x7fdf5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf500051c0 0x7fdf5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 -- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf50003a60 msgr2=0x7fdf50003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf50003a60 0x7fdf50003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 -- 172.21.15.26:0/1252443611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50003570 con 0x7fdf50004810 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf68c4c700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf500051c0 0x7fdf5000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf68c4c700 1 -- 172.21.15.26:0/1252443611 reap_dead start 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf637fe700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf50004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c3c0 tx=0x7fdf54001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd72726993d6842 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400cc90 con 0x7fdf50004810 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5400ce10 con 0x7fdf50004810 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.284+0000 7fdf62ffd700 1 -- 172.21.15.26:0/1252443611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005b70 con 0x7fdf50004810 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 -- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 msgr2=0x7fdf50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf50004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c3c0 tx=0x7fdf54001e70 comp rx=0 tx=0).stop 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 -- 172.21.15.26:0/1252443611 shutdown_connections 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/1252443611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf50004c80 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 -- 172.21.15.26:0/1252443611 >> 172.21.15.26:0/1252443611 conn(0x7fdf640703a0 msgr2=0x7fdf640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 -- 172.21.15.26:0/1252443611 shutdown_connections 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.285+0000 7fdf6a6af700 1 -- 172.21.15.26:0/1252443611 wait complete. 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.286+0000 7fdf6a6af700 1 Processor -- start 2023-10-09T11:42:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.286+0000 7fdf6a6af700 1 -- start start 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf6414cd20 0x7fdf6414d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 0x7fdf640b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640b4100 con 0x7fdf50004810 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640b34f0 con 0x7fdf640b4590 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf6a6af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640b37d0 con 0x7fdf6414cd20 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53376/0 (socket says 172.21.15.26:53376) 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 -- 172.21.15.26:0/3001960252 learned_addr learned my addr 172.21.15.26:0/3001960252 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf637fe700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf6414cd20 0x7fdf6414d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 -- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf6414cd20 msgr2=0x7fdf6414d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf6414cd20 0x7fdf6414d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 -- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 msgr2=0x7fdf640b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf68c4c700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 0x7fdf640b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 0x7fdf640b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 -- 172.21.15.26:0/3001960252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640b3ab0 con 0x7fdf50004810 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf68c4c700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 0x7fdf640b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.287+0000 7fdf63fff700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0119f0 tx=0x7fdf4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.288+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00f8e0 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.288+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c00fa40 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.288+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf640b3d90 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.288+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00fdc0 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.288+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf64157100 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.289+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6404c3c0 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.289+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdf4c015670 con 0x7fdf50004810 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.289+0000 7fdf5bfff700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 0x7fdf440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.289+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fdf4c0853e0 con 0x7fdf50004810 2023-10-09T11:42:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.290+0000 7fdf637fe700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 0x7fdf440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.290+0000 7fdf637fe700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 0x7fdf440697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400d010 tx=0x7fdf54015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.294+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf4c0522c0 con 0x7fdf50004810 2023-10-09T11:42:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.531+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf640cf8f0 con 0x7fdf50004810 2023-10-09T11:42:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.532+0000 7fdf5bfff700 1 -- 172.21.15.26:0/3001960252 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fdf4c0558e0 con 0x7fdf50004810 2023-10-09T11:42:38.533 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:38.534 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2077827618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2077827618},{"type":"v1","addr":"172.21.15.67:6837","nonce":2077827618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7464,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2194541951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2194541951},{"type":"v1","addr":"172.21.15.26:6835","nonce":2194541951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2429868541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2429868541},{"type":"v1","addr":"172.21.15.26:6834","nonce":2429868541}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/102887358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":102887358},{"type":"v1","addr":"172.21.15.67:6836","nonce":102887358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 msgr2=0x7fdf440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 0x7fdf440697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400d010 tx=0x7fdf54015000 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 msgr2=0x7fdf64156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0119f0 tx=0x7fdf4c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 shutdown_connections 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf640b4590 0x7fdf640b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf50004810 0x7fdf64156bc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf44067320 0x7fdf440697d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 --2- 172.21.15.26:0/3001960252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf6414cd20 0x7fdf6414d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 >> 172.21.15.26:0/3001960252 conn(0x7fdf640703a0 msgr2=0x7fdf640b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 shutdown_connections 2023-10-09T11:42:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.534+0000 7fdf6a6af700 1 -- 172.21.15.26:0/3001960252 wait complete. 2023-10-09T11:42:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 87 2023-10-09T11:42:38.548 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:42:38.548 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:42:38.548 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:42:38.548 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:38.548 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:42:38.549 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:42:38.549 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:42:38.549 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:38.549 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:42:38.549 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:42:38.549 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:42:38.549 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:38.550 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:42:38.550 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:42:38.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:42:38.550 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:38.557 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:42:38.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:42:38.558 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:42:38.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:42:38.561 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:42:38.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:42:38.561 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:42:38.562 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:42:38.600 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:42:38.600 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:38.601 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:42:38.601 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:38.603 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:42:38.604 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:38.604 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:42:38.604 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:38.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:42:38.676 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:42:38.676 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:42:38.688 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:42:38.688 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:42:38.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.728+0000 7f80d0813700 1 Processor -- start 2023-10-09T11:42:38.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.728+0000 7f80d0813700 1 -- start start 2023-10-09T11:42:38.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80d0813700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80cc15acd0 0x7f80cc155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80d0813700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80cc0c7fb0 0x7f80cc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80d0813700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc15a840 con 0x7f80cc06ae50 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80d0813700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc156930 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80d0813700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0c8520 con 0x7f80cc15acd0 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80cc0c7fb0 0x7f80cc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80cc0c7fb0 0x7f80cc1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53426/0 (socket says 172.21.15.26:53426) 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f80cc06ae50 0x7f80cc0c78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38114/0 (socket says 172.21.15.26:38114) 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cad9d700 1 -- 172.21.15.26:0/33461741 learned_addr learned my addr 172.21.15.26:0/33461741 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80ca59c700 1 --2- 172.21.15.26:0/33461741 >> v2:172.21.15.67:3300/0 conn(0x7f80cc15acd0 0x7f80cc155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 -- 172.21.15.26:0/33461741 >> v2:172.21.15.67:3300/0 conn(0x7f80cc15acd0 msgr2=0x7f80cc155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 --2- 172.21.15.26:0/33461741 >> v2:172.21.15.67:3300/0 conn(0x7f80cc15acd0 0x7f80cc155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 -- 172.21.15.26:0/33461741 >> v1:172.21.15.26:6789/0 conn(0x7f80cc06ae50 legacy=0x7f80cc0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 -- 172.21.15.26:0/33461741 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc15a1f0 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80c9d9b700 1 -- 172.21.15.26:0/33461741 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898141265 0 0) 0x7f80cc15a840 con 0x7f80cc06ae50 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80cb59e700 1 --2- 172.21.15.26:0/33461741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc1563f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ce000 tx=0x7f80c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb66ca94c5639b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.729+0000 7f80c9d9b700 1 -- 172.21.15.26:0/33461741 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400e070 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80c9d9b700 1 -- 172.21.15.26:0/33461741 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400bb60 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80c9d9b700 1 -- 172.21.15.26:0/33461741 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4012430 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 -- 172.21.15.26:0/33461741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 msgr2=0x7f80cc1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 --2- 172.21.15.26:0/33461741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc1563f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ce000 tx=0x7f80c4009780 comp rx=0 tx=0).stop 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 -- 172.21.15.26:0/33461741 shutdown_connections 2023-10-09T11:42:38.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 --2- 172.21.15.26:0/33461741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc1563f0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 --2- 172.21.15.26:0/33461741 >> v2:172.21.15.67:3300/0 conn(0x7f80cc15acd0 0x7f80cc155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 -- 172.21.15.26:0/33461741 >> 172.21.15.26:0/33461741 conn(0x7f80cc06e280 msgr2=0x7f80cc0cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 -- 172.21.15.26:0/33461741 shutdown_connections 2023-10-09T11:42:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.730+0000 7f80d0813700 1 -- 172.21.15.26:0/33461741 wait complete. 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.731+0000 7f80d0813700 1 Processor -- start 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 -- start start 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80cc06ae50 0x7f80cc0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80cc15acd0 0x7f80cc167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc168b90 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c20f0 con 0x7f80cc15acd0 2023-10-09T11:42:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80d0813700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c4440 con 0x7f80cc06ae50 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.732+0000 7f80ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53432/0 (socket says 172.21.15.26:53432) 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80cad9d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80cc06ae50 0x7f80cc0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 -- 172.21.15.26:0/120001014 learned_addr learned my addr 172.21.15.26:0/120001014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80cb59e700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80cc15acd0 0x7f80cc167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 -- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80cc06ae50 msgr2=0x7f80cc0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80cc06ae50 0x7f80cc0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 -- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80cc15acd0 msgr2=0x7f80cc167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80cc15acd0 0x7f80cc167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 -- 172.21.15.26:0/120001014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4009a20 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80ca59c700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f80c000e900 tx=0x7f80c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0013680 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c00137e0 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc0c4720 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0013ba0 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.733+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc0c1d80 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.735+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc0c2260 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.735+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f80c00253d0 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.736+0000 7f80b2ffd700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 0x7f80b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.736+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f80c0085210 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.736+0000 7f80cad9d700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 0x7f80b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.737+0000 7f80cad9d700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 0x7f80b80697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f80cc1655d0 tx=0x7f80bc007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.740+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80c0052170 con 0x7f80cc0c7fb0 2023-10-09T11:42:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:38.950+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f80cc04c3c0 con 0x7f80cc0c7fb0 2023-10-09T11:42:39.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.734+0000 7f80b2ffd700 1 -- 172.21.15.26:0/120001014 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f80c0055790 con 0x7f80cc0c7fb0 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 msgr2=0x7f80b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 0x7f80b80697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f80cc1655d0 tx=0x7f80bc007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 msgr2=0x7f80cc167a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f80c000e900 tx=0x7f80c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 shutdown_connections 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80cc15acd0 0x7f80cc167fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f80b8067320 0x7f80b80697d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80cc06ae50 0x7f80cc0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 --2- 172.21.15.26:0/120001014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80cc0c7fb0 0x7f80cc167a80 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 >> 172.21.15.26:0/120001014 conn(0x7f80cc06e280 msgr2=0x7f80cc0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 shutdown_connections 2023-10-09T11:42:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.737+0000 7f80d0813700 1 -- 172.21.15.26:0/120001014 wait complete. 2023-10-09T11:42:39.740 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:42:39.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:42:39.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.877+0000 7fd501d4b700 1 Processor -- start 2023-10-09T11:42:39.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.877+0000 7fd501d4b700 1 -- start start 2023-10-09T11:42:39.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0cb5a0 0x7fd4fc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 0x7fd4fc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4fc0cde50 0x7fd4fc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc0d13f0 con 0x7fd4fc0cde50 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15a940 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd501d4b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15ae40 con 0x7fd4fc0cb5a0 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd4fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4fc0cde50 0x7fd4fc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd4fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4fc0cde50 0x7fd4fc15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48654/0 (socket says 172.21.15.26:48654) 2023-10-09T11:42:39.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.878+0000 7fd4fbfff700 1 -- 172.21.15.26:0/2773392137 learned_addr learned my addr 172.21.15.26:0/2773392137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4faffd700 1 --2- 172.21.15.26:0/2773392137 >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 0x7fd4fc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fb7fe700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0cb5a0 0x7fd4fc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 -- 172.21.15.26:0/2773392137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0cb5a0 msgr2=0x7fd4fc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0cb5a0 0x7fd4fc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 -- 172.21.15.26:0/2773392137 >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 msgr2=0x7fd4fc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 --2- 172.21.15.26:0/2773392137 >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 0x7fd4fc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 -- 172.21.15.26:0/2773392137 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc15ab60 con 0x7fd4fc0cde50 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4faffd700 1 --2- 172.21.15.26:0/2773392137 >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 0x7fd4fc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fbfff700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cde50 0x7fd4fc15a400 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06ea90 tx=0x7fd4f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3cde762d6f5373 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fa7fc700 1 -- 172.21.15.26:0/2773392137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400e070 con 0x7fd4fc0cde50 2023-10-09T11:42:39.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fa7fc700 1 -- 172.21.15.26:0/2773392137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400ba40 con 0x7fd4fc0cde50 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd4fa7fc700 1 -- 172.21.15.26:0/2773392137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40092e0 con 0x7fd4fc0cde50 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd501d4b700 1 -- 172.21.15.26:0/2773392137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cde50 msgr2=0x7fd4fc15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.879+0000 7fd501d4b700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cde50 0x7fd4fc15a400 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06ea90 tx=0x7fd4f4009840 comp rx=0 tx=0).stop 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 -- 172.21.15.26:0/2773392137 shutdown_connections 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cde50 0x7fd4fc15a400 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 --2- 172.21.15.26:0/2773392137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0cb5a0 0x7fd4fc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 --2- 172.21.15.26:0/2773392137 >> v2:172.21.15.67:3300/0 conn(0x7fd4fc0cd9e0 0x7fd4fc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 -- 172.21.15.26:0/2773392137 >> 172.21.15.26:0/2773392137 conn(0x7fd4fc070e30 msgr2=0x7fd4fc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 -- 172.21.15.26:0/2773392137 shutdown_connections 2023-10-09T11:42:39.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.880+0000 7fd501d4b700 1 -- 172.21.15.26:0/2773392137 wait complete. 2023-10-09T11:42:39.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.881+0000 7fd501d4b700 1 Processor -- start 2023-10-09T11:42:39.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.881+0000 7fd501d4b700 1 -- start start 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4fc0cb5a0 0x7fd4fc156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0c91f0 0x7fd4fc0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c77c0 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c8060 con 0x7fd4fc0cb5a0 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15ca70 con 0x7fd4fc0c91f0 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48664/0 (socket says 172.21.15.26:48664) 2023-10-09T11:42:39.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 -- 172.21.15.26:0/3736291035 learned_addr learned my addr 172.21.15.26:0/3736291035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4fbfff700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0c91f0 0x7fd4fc0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4fb7fe700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4fc0cb5a0 0x7fd4fc156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 -- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0c91f0 msgr2=0x7fd4fc0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0c91f0 0x7fd4fc0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 -- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4fc0cb5a0 msgr2=0x7fd4fc156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4fc0cb5a0 0x7fd4fc156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 -- 172.21.15.26:0/3736291035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009ae0 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4faffd700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c860 tx=0x7fd4f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0011600 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0011760 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0c7a10 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.882+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0011b20 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.883+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc156760 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.884+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc04c3c0 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.884+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4f00193b0 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.884+0000 7fd4e37fe700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 0x7fd4e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:39.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.884+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd4f0084960 con 0x7fd4fc0cd9e0 2023-10-09T11:42:39.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.884+0000 7fd4fb7fe700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 0x7fd4e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:39.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.885+0000 7fd4fb7fe700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 0x7fd4e80697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00acb0 tx=0x7fd4ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:39.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:39.889+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4f0051830 con 0x7fd4fc0cd9e0 2023-10-09T11:42:40.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.158+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd4fc0ccf00 con 0x7fd4fc0cd9e0 2023-10-09T11:42:40.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.159+0000 7fd4e37fe700 1 -- 172.21.15.26:0/3736291035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd4f001f090 con 0x7fd4fc0cd9e0 2023-10-09T11:42:40.160 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:40.160 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:42:40.160 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:42:40.160 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.161 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:42:40.162 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.164 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.165 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.166 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.168 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.169 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:42:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.171 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:42:40.172 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:42:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:42:40.175 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 msgr2=0x7fd4e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 0x7fd4e80697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00acb0 tx=0x7fd4ec008040 comp rx=0 tx=0).stop 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 msgr2=0x7fd4fc15c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c860 tx=0x7fd4f0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 shutdown_connections 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd4e8067320 0x7fd4e80697d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd4fc0c91f0 0x7fd4fc0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4fc0cb5a0 0x7fd4fc156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 --2- 172.21.15.26:0/3736291035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0cd9e0 0x7fd4fc15c0f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 >> 172.21.15.26:0/3736291035 conn(0x7fd4fc070e30 msgr2=0x7fd4fc0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 shutdown_connections 2023-10-09T11:42:40.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.161+0000 7fd501d4b700 1 -- 172.21.15.26:0/3736291035 wait complete. 2023-10-09T11:42:40.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.296+0000 7f70480ce700 1 Processor -- start 2023-10-09T11:42:40.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.296+0000 7f70480ce700 1 -- start start 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f70480ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70400cb5a0 0x7f70400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f70480ce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f7040156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f70480ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704015ae40 con 0x7f70400cd9e0 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f70480ce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400d13f0 con 0x7f70400cb5a0 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f70480ce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704015ab60 con 0x7f704015a5d0 2023-10-09T11:42:40.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f7045e6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70400cb5a0 0x7f70400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f7045669700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70400cd9e0 0x7f7040159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58428/0 (socket says 172.21.15.26:58428) 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f7045669700 1 -- 172.21.15.26:0/517770807 learned_addr learned my addr 172.21.15.26:0/517770807 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.297+0000 7f704666b700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f7040156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7045e6a700 1 -- 172.21.15.26:0/517770807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 msgr2=0x7f7040156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7045e6a700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f7040156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7045e6a700 1 -- 172.21.15.26:0/517770807 >> v1:172.21.15.26:6789/0 conn(0x7f70400cd9e0 legacy=0x7f7040159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7045e6a700 1 -- 172.21.15.26:0/517770807 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400ccf00 con 0x7f70400cb5a0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7044e68700 1 -- 172.21.15.26:0/517770807 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168891792 0 0) 0x7f704015ae40 con 0x7f70400cd9e0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7045e6a700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70400cb970 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7038009e90 tx=0x7f7038009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3ab1b765ec0c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7044e68700 1 -- 172.21.15.26:0/517770807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800e070 con 0x7f70400cb5a0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7044e68700 1 -- 172.21.15.26:0/517770807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800bbf0 con 0x7f70400cb5a0 2023-10-09T11:42:40.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f7044e68700 1 -- 172.21.15.26:0/517770807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038012430 con 0x7f70400cb5a0 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f70480ce700 1 -- 172.21.15.26:0/517770807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 msgr2=0x7f70400cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.298+0000 7f70480ce700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70400cb970 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7038009e90 tx=0x7f7038009780 comp rx=0 tx=0).stop 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 -- 172.21.15.26:0/517770807 shutdown_connections 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f7040156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 --2- 172.21.15.26:0/517770807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70400cb970 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 -- 172.21.15.26:0/517770807 >> 172.21.15.26:0/517770807 conn(0x7f7040070e30 msgr2=0x7f70400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 -- 172.21.15.26:0/517770807 shutdown_connections 2023-10-09T11:42:40.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.299+0000 7f70480ce700 1 -- 172.21.15.26:0/517770807 wait complete. 2023-10-09T11:42:40.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 Processor -- start 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 -- start start 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 0x7f70400c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f70401523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040152100 con 0x7f70400cb5a0 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040151820 con 0x7f70400cd9e0 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.300+0000 7f70480ce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400c8640 con 0x7f704015a5d0 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48682/0 (socket says 172.21.15.26:48682) 2023-10-09T11:42:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 -- 172.21.15.26:0/1339059514 learned_addr learned my addr 172.21.15.26:0/1339059514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045669700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 0x7f70400c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f704666b700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f70401523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 -- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 msgr2=0x7f70401523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f70401523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 -- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 msgr2=0x7f70400c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 0x7f70400c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 -- 172.21.15.26:0/1339059514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009a20 con 0x7f70400cb5a0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045669700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 0x7f70400c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f7045e6a700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f703800b6c0 tx=0x7f7038019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038012e20 con 0x7f70400cb5a0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703801d630 con 0x7f70400cb5a0 2023-10-09T11:42:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70400c8920 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703801d9f0 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.301+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70401532a0 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.302+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704004c3c0 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.303+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7038024070 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.303+0000 7f703dffb700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 0x7f702c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.303+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7038086ff0 con 0x7f70400cb5a0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.303+0000 7f7045669700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 0x7f702c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.304+0000 7f7045669700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 0x7f702c0697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f704006fd20 tx=0x7f7034009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.307+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7038057a20 con 0x7f70400cb5a0 2023-10-09T11:42:40.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.501+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70400d1200 con 0x7f70400cb5a0 2023-10-09T11:42:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.502+0000 7f703dffb700 1 -- 172.21.15.26:0/1339059514 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f70380575b0 con 0x7f70400cb5a0 2023-10-09T11:42:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:40.503 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":134,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:39.732433+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 msgr2=0x7f702c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 0x7f702c0697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f704006fd20 tx=0x7f7034009040 comp rx=0 tx=0).stop 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 msgr2=0x7f70401512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f703800b6c0 tx=0x7f7038019000 comp rx=0 tx=0).stop 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 shutdown_connections 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f702c067320 0x7f702c0697d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f704015a5d0 0x7f70401523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70400cb5a0 0x7f70401512e0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 --2- 172.21.15.26:0/1339059514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70400cd9e0 0x7f70400c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 >> 172.21.15.26:0/1339059514 conn(0x7f7040070e30 msgr2=0x7f70400b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 shutdown_connections 2023-10-09T11:42:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.504+0000 7f70480ce700 1 -- 172.21.15.26:0/1339059514 wait complete. 2023-10-09T11:42:40.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:42:40.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:40.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.638+0000 7f289e1cd700 1 Processor -- start 2023-10-09T11:42:40.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.638+0000 7f289e1cd700 1 -- start start 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f289e1cd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f28980ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f289e1cd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980cf510 con 0x7f28980ccfa0 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f289e1cd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980cc1e0 con 0x7f28980cbd90 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f289e1cd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980d00b0 con 0x7f2898159860 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f2897fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28980ccfa0 0x7f28980cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58438/0 (socket says 172.21.15.26:58438) 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.639+0000 7f2897fff700 1 -- 172.21.15.26:0/3768130294 learned_addr learned my addr 172.21.15.26:0/3768130294 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28977fe700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f28980ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482027344 0 0) 0x7f28980cf510 con 0x7f28980ccfa0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2880003570 con 0x7f28980ccfa0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230490806 0 0) 0x7f2880003570 con 0x7f28980ccfa0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 msgr2=0x7f28980ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f28980ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 >> v1:172.21.15.67:6789/0 conn(0x7f28980cbd90 legacy=0x7f28980cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980ce900 con 0x7f28980ccfa0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f28900017f0 con 0x7f28980ccfa0 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 >> v1:172.21.15.26:6789/0 conn(0x7f28980ccfa0 legacy=0x7f28980cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f2880003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2880003fd0 0x7f2880004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f28800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980d00b0 con 0x7f2880004d50 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288000bb40 con 0x7f2880003fd0 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288000bd00 con 0x7f2898159860 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2897fff700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f28800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f28977fe700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f2880003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2896ffd700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2880003fd0 0x7f2880004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2897fff700 1 -- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 msgr2=0x7f2880003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2897fff700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898159860 0x7f2880003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2897fff700 1 -- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2880003fd0 msgr2=0x7f2880004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.640+0000 7f2897fff700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2880003fd0 0x7f2880004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f2897fff700 1 -- 172.21.15.26:0/3768130294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880003570 con 0x7f2880004d50 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f2897fff700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f28800051c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f289000a950 tx=0x7f28900021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1feaadea510f9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900070d0 con 0x7f2880004d50 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890007250 con 0x7f2880004d50 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f28967fc700 1 -- 172.21.15.26:0/3768130294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890007610 con 0x7f2880004d50 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 -- 172.21.15.26:0/3768130294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 msgr2=0x7f28800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 --2- 172.21.15.26:0/3768130294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f28800051c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f289000a950 tx=0x7f28900021f0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f2897fff700 1 -- 172.21.15.26:0/3768130294 reap_dead start 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 -- 172.21.15.26:0/3768130294 shutdown_connections 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 -- 172.21.15.26:0/3768130294 >> 172.21.15.26:0/3768130294 conn(0x7f28980999b0 msgr2=0x7f2898070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 -- 172.21.15.26:0/3768130294 shutdown_connections 2023-10-09T11:42:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.641+0000 7f289e1cd700 1 -- 172.21.15.26:0/3768130294 wait complete. 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 Processor -- start 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 -- start start 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898158a50 0x7f28981693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2898158ec0 0x7f2898169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980c80d0 con 0x7f2880004d50 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980c9fb0 con 0x7f2898158ec0 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.643+0000 7f289e1cd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2898169f40 con 0x7f2898158a50 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48708/0 (socket says 172.21.15.26:48708) 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 -- 172.21.15.26:0/1677292379 learned_addr learned my addr 172.21.15.26:0/1677292379 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f2896ffd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898158a50 0x7f28981693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f2897fff700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2898158ec0 0x7f2898169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 -- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898158a50 msgr2=0x7f28981693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898158a50 0x7f28981693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 -- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2898158ec0 msgr2=0x7f2898169930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2898158ec0 0x7f2898169930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 -- 172.21.15.26:0/1677292379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289816a220 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f28977fe700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2888011b10 tx=0x7f2888009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888005c10 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888005d70 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28980c7a80 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800fa10 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.644+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289806eb30 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.645+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289804c3c0 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.646+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2888006050 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.646+0000 7f287f7fe700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 0x7f28840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.646+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2888085310 con 0x7f2880004d50 2023-10-09T11:42:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.646+0000 7f2896ffd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 0x7f28840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.647+0000 7f2896ffd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 0x7f28840697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f288c007ab0 tx=0x7f288c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.650+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28880523f0 con 0x7f2880004d50 2023-10-09T11:42:40.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.842+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28980cebe0 con 0x7f2880004d50 2023-10-09T11:42:40.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.842+0000 7f287f7fe700 1 -- 172.21.15.26:0/1677292379 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2888055a10 con 0x7f2880004d50 2023-10-09T11:42:40.843 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 msgr2=0x7f28840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 0x7f28840697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f288c007ab0 tx=0x7f288c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 msgr2=0x7f289815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2888011b10 tx=0x7f2888009120 comp rx=0 tx=0).stop 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 shutdown_connections 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2898158ec0 0x7f2898169930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880004d50 0x7f289815b3a0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2884067320 0x7f28840697d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 --2- 172.21.15.26:0/1677292379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2898158a50 0x7f28981693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 >> 172.21.15.26:0/1677292379 conn(0x7f28980999b0 msgr2=0x7f28980c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 shutdown_connections 2023-10-09T11:42:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.844+0000 7f289e1cd700 1 -- 172.21.15.26:0/1677292379 wait complete. 2023-10-09T11:42:40.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:42:40.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.976+0000 7f4ac0ac1700 1 Processor -- start 2023-10-09T11:42:40.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.976+0000 7f4ac0ac1700 1 -- start start 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ac0ac1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4abc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ac0ac1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4abc0cd9e0 0x7f4abc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ac0ac1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4abc15ae40 con 0x7f4abc0cde50 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ac0ac1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4abc0d13f0 con 0x7f4abc0cd9e0 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ac0ac1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc15ab60 con 0x7f4abc0cb5a0 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4abad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4abc0cde50 0x7f4abc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58448/0 (socket says 172.21.15.26:58448) 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4abad9d700 1 -- 172.21.15.26:0/164858181 learned_addr learned my addr 172.21.15.26:0/164858181 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4aba59c700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4abc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/164858181 >> v2:172.21.15.67:3300/0 conn(0x7f4abc0cd9e0 0x7f4abc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239218010 0 0) 0x7f4abc15ae40 con 0x7f4abc0cde50 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa8003570 con 0x7f4abc0cde50 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3083849315 0 0) 0x7f4aa8003570 con 0x7f4abc0cde50 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 msgr2=0x7f4abc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4abc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 >> v2:172.21.15.67:3300/0 conn(0x7f4abc0cd9e0 msgr2=0x7f4abc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 --2- 172.21.15.26:0/164858181 >> v2:172.21.15.67:3300/0 conn(0x7f4abc0cd9e0 0x7f4abc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0ccf00 con 0x7f4abc0cde50 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4ab4001470 con 0x7f4abc0cde50 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.977+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 >> v1:172.21.15.26:6789/0 conn(0x7f4abc0cde50 legacy=0x7f4abc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4aa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4aa8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aa8004d50 0x7f4aa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc15ab60 con 0x7f4aa8003a60 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa800ba60 con 0x7f4aa8004d50 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa800bba0 con 0x7f4abc0cb5a0 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4aa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4abad9d700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aa8004d50 0x7f4aa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4aa8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 -- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 msgr2=0x7f4aa8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0cb5a0 0x7f4aa8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 -- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aa8004d50 msgr2=0x7f4aa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aa8004d50 0x7f4aa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 -- 172.21.15.26:0/164858181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8003570 con 0x7f4aa8003a60 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4aba59c700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4aa8003e70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e210 tx=0x7f4aac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f16ac0496a1be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00ea60 con 0x7f4aa8003a60 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00f040 con 0x7f4aa8003a60 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.978+0000 7f4ab959a700 1 -- 172.21.15.26:0/164858181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00ee10 con 0x7f4aa8003a60 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/164858181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 msgr2=0x7f4aa8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/164858181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4aa8003e70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e210 tx=0x7f4aac00b040 comp rx=0 tx=0).stop 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4abad9d700 1 -- 172.21.15.26:0/164858181 reap_dead start 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/164858181 shutdown_connections 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/164858181 >> 172.21.15.26:0/164858181 conn(0x7f4abc070e30 msgr2=0x7f4abc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/164858181 shutdown_connections 2023-10-09T11:42:40.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.979+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/164858181 wait complete. 2023-10-09T11:42:40.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.980+0000 7f4ac0ac1700 1 Processor -- start 2023-10-09T11:42:40.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.980+0000 7f4ac0ac1700 1 -- start start 2023-10-09T11:42:40.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 0x7f4abc0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 0x7f4abc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc155400 con 0x7f4aa8003a60 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0c6e30 con 0x7f4abc0c9800 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc169650 con 0x7f4abc0c6480 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48716/0 (socket says 172.21.15.26:48716) 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 -- 172.21.15.26:0/842925128 learned_addr learned my addr 172.21.15.26:0/842925128 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4abad9d700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 0x7f4abc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 0x7f4abc0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 -- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 msgr2=0x7f4abc0c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 0x7f4abc0c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 -- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 msgr2=0x7f4abc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 0x7f4abc0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 -- 172.21.15.26:0/842925128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc169930 con 0x7f4aa8003a60 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4abad9d700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 0x7f4abc0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 0x7f4abc0c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4aba59c700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8004730 tx=0x7f4aac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac01d420 con 0x7f4aa8003a60 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac01d5a0 con 0x7f4aa8003a60 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc169c10 con 0x7f4aa8003a60 2023-10-09T11:42:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.981+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac01d960 con 0x7f4aa8003a60 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.982+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc16a1d0 con 0x7f4aa8003a60 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.983+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc04c3c0 con 0x7f4aa8003a60 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.983+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4aac003040 con 0x7f4aa8003a60 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.983+0000 7f4ab27fc700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 0x7f4a9c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.984+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4aac086e80 con 0x7f4aa8003a60 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.984+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 0x7f4a9c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.984+0000 7f4ab9d9b700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 0x7f4a9c0697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4006d60 tx=0x7f4aa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:40.988+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aac053d50 con 0x7f4aa8003a60 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.182+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4abc0cd1e0 con 0x7f4aa8003a60 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.182+0000 7f4ab27fc700 1 -- 172.21.15.26:0/842925128 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4aac018090 con 0x7f4aa8003a60 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 msgr2=0x7f4a9c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 0x7f4a9c0697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4006d60 tx=0x7f4aa4008040 comp rx=0 tx=0).stop 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 msgr2=0x7f4abc154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8004730 tx=0x7f4aac01a000 comp rx=0 tx=0).stop 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 shutdown_connections 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0c9800 0x7f4abc0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa8003a60 0x7f4abc154ec0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a9c067320 0x7f4a9c0697d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 --2- 172.21.15.26:0/842925128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4abc0c6480 0x7f4abc0c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 >> 172.21.15.26:0/842925128 conn(0x7f4abc070e30 msgr2=0x7f4abc0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 shutdown_connections 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.184+0000 7f4ac0ac1700 1 -- 172.21.15.26:0/842925128 wait complete. 2023-10-09T11:42:41.198 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:42:41.198 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:42:41.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.319+0000 7fbbec74c700 1 Processor -- start 2023-10-09T11:42:41.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.319+0000 7fbbec74c700 1 -- start start 2023-10-09T11:42:41.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbec74c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbec74c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbe40caeb0 0x7fbbe40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbec74c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40ce360 con 0x7fbbe41502c0 2023-10-09T11:42:41.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbec74c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe4150e00 con 0x7fbbe40caeb0 2023-10-09T11:42:41.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbec74c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40cb970 con 0x7fbbe40cd200 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbe9ce7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbe40caeb0 0x7fbbe40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbe9ce7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbe40caeb0 0x7fbbe40cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48718/0 (socket says 172.21.15.26:48718) 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.320+0000 7fbbe9ce7700 1 -- 172.21.15.26:0/3405482544 learned_addr learned my addr 172.21.15.26:0/3405482544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbea4e8700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe9ce7700 1 -- 172.21.15.26:0/3405482544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 msgr2=0x7fbbe40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe9ce7700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe9ce7700 1 -- 172.21.15.26:0/3405482544 >> v1:172.21.15.67:6789/0 conn(0x7fbbe41502c0 legacy=0x7fbbe41506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe9ce7700 1 -- 172.21.15.26:0/3405482544 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40cbc50 con 0x7fbbe40caeb0 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbea4e8700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe9ce7700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe40caeb0 0x7fbbe40cb320 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80099b0 tx=0x7fbbd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e938a479e68dbaa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe94e6700 1 -- 172.21.15.26:0/3405482544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800b860 con 0x7fbbe40caeb0 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe94e6700 1 -- 172.21.15.26:0/3405482544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b9c0 con 0x7fbbe40caeb0 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.321+0000 7fbbe94e6700 1 -- 172.21.15.26:0/3405482544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800bd60 con 0x7fbbe40caeb0 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 -- 172.21.15.26:0/3405482544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe40caeb0 msgr2=0x7fbbe40cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe40caeb0 0x7fbbe40cb320 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80099b0 tx=0x7fbbd8009250 comp rx=0 tx=0).stop 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 -- 172.21.15.26:0/3405482544 shutdown_connections 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 --2- 172.21.15.26:0/3405482544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe40caeb0 0x7fbbe40cb320 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 -- 172.21.15.26:0/3405482544 >> 172.21.15.26:0/3405482544 conn(0x7fbbe40999c0 msgr2=0x7fbbe4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 -- 172.21.15.26:0/3405482544 shutdown_connections 2023-10-09T11:42:41.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.322+0000 7fbbec74c700 1 -- 172.21.15.26:0/3405482544 wait complete. 2023-10-09T11:42:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.323+0000 7fbbec74c700 1 Processor -- start 2023-10-09T11:42:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.323+0000 7fbbec74c700 1 -- start start 2023-10-09T11:42:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40caeb0 0x7fbbe4154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe41550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4154d50 con 0x7fbbe41502c0 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41574e0 con 0x7fbbe40caeb0 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41533e0 con 0x7fbbe40cd200 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48726/0 (socket says 172.21.15.26:48726) 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 -- 172.21.15.26:0/714313619 learned_addr learned my addr 172.21.15.26:0/714313619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbea4e8700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40caeb0 0x7fbbe4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 -- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 msgr2=0x7fbbe41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe41550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 -- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40caeb0 msgr2=0x7fbbe4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40caeb0 0x7fbbe4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 -- 172.21.15.26:0/714313619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80094f0 con 0x7fbbe41502c0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbeace9700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c4c0 tx=0x7fbbdc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011590 con 0x7fbbe41502c0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc011710 con 0x7fbbe41502c0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe4152740 con 0x7fbbe41502c0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011ad0 con 0x7fbbe41502c0 2023-10-09T11:42:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.324+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4153070 con 0x7fbbe41502c0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.325+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4152bf0 con 0x7fbbe41502c0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.326+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbbdc01b3b0 con 0x7fbbe41502c0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.326+0000 7fbbe27fc700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 0x7fbbd00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.326+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbbdc083da0 con 0x7fbbe41502c0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.326+0000 7fbbea4e8700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 0x7fbbd00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.327+0000 7fbbea4e8700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 0x7fbbd00697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009fd0 tx=0x7fbbd400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.330+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbe4152bf0 con 0x7fbbe41502c0 2023-10-09T11:42:41.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.525+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbbe4152bf0 con 0x7fbbe41502c0 2023-10-09T11:42:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.740+0000 7fbbe27fc700 1 -- 172.21.15.26:0/714313619 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbbe4152bf0 con 0x7fbbe41502c0 2023-10-09T11:42:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.744+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 msgr2=0x7fbbd00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.744+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 0x7fbbd00697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009fd0 tx=0x7fbbd400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.744+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 msgr2=0x7fbbe4155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.744+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c4c0 tx=0x7fbbdc007f50 comp rx=0 tx=0).stop 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 shutdown_connections 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe41502c0 0x7fbbe4155600 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40caeb0 0x7fbbe4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbbd0067320 0x7fbbd00697d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 --2- 172.21.15.26:0/714313619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbbe40cd200 0x7fbbe41550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 >> 172.21.15.26:0/714313619 conn(0x7fbbe40999c0 msgr2=0x7fbbe406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 shutdown_connections 2023-10-09T11:42:41.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.745+0000 7fbbec74c700 1 -- 172.21.15.26:0/714313619 wait complete. 2023-10-09T11:42:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:42:41.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:42:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.886+0000 7f4500bb7700 1 Processor -- start 2023-10-09T11:42:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.886+0000 7f4500bb7700 1 -- start start 2023-10-09T11:42:41.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f4500bb7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44fc0b05a0 0x7f44fc0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f4500bb7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44fc0cec90 0x7f44fc0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f4500bb7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc06e560 con 0x7f44fc0c3ad0 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f4500bb7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc06e260 con 0x7f44fc0cec90 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f4500bb7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0c8ef0 con 0x7f44fc0b05a0 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f44faffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44fc0cec90 0x7f44fc0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f44faffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44fc0cec90 0x7f44fc0c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48734/0 (socket says 172.21.15.26:48734) 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f44fbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f44fc0c3ad0 0x7f44fc06e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58464/0 (socket says 172.21.15.26:58464) 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.887+0000 7f44faffd700 1 -- 172.21.15.26:0/3406564748 learned_addr learned my addr 172.21.15.26:0/3406564748 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44fb7fe700 1 --2- 172.21.15.26:0/3406564748 >> v2:172.21.15.67:3300/0 conn(0x7f44fc0b05a0 0x7f44fc0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44faffd700 1 -- 172.21.15.26:0/3406564748 >> v2:172.21.15.67:3300/0 conn(0x7f44fc0b05a0 msgr2=0x7f44fc0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44faffd700 1 --2- 172.21.15.26:0/3406564748 >> v2:172.21.15.67:3300/0 conn(0x7f44fc0b05a0 0x7f44fc0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44faffd700 1 -- 172.21.15.26:0/3406564748 >> v1:172.21.15.26:6789/0 conn(0x7f44fc0c3ad0 legacy=0x7f44fc06e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44faffd700 1 -- 172.21.15.26:0/3406564748 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0c3240 con 0x7f44fc0cec90 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44fa7fc700 1 -- 172.21.15.26:0/3406564748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182213760 0 0) 0x7f44fc06e560 con 0x7f44fc0c3ad0 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44faffd700 1 --2- 172.21.15.26:0/3406564748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c89b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06ba30 tx=0x7f44f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e79de006bdfb4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44fa7fc700 1 -- 172.21.15.26:0/3406564748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0009e70 con 0x7f44fc0cec90 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44fa7fc700 1 -- 172.21.15.26:0/3406564748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f000b860 con 0x7f44fc0cec90 2023-10-09T11:42:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.888+0000 7f44fa7fc700 1 -- 172.21.15.26:0/3406564748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000bc00 con 0x7f44fc0cec90 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 -- 172.21.15.26:0/3406564748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 msgr2=0x7f44fc0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 --2- 172.21.15.26:0/3406564748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c89b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06ba30 tx=0x7f44f0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 -- 172.21.15.26:0/3406564748 shutdown_connections 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 --2- 172.21.15.26:0/3406564748 >> v2:172.21.15.67:3300/0 conn(0x7f44fc0b05a0 0x7f44fc0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 --2- 172.21.15.26:0/3406564748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c89b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 -- 172.21.15.26:0/3406564748 >> 172.21.15.26:0/3406564748 conn(0x7f44fc088000 msgr2=0x7f44fc0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 -- 172.21.15.26:0/3406564748 shutdown_connections 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.889+0000 7f4500bb7700 1 -- 172.21.15.26:0/3406564748 wait complete. 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.890+0000 7f4500bb7700 1 Processor -- start 2023-10-09T11:42:41.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.890+0000 7f4500bb7700 1 -- start start 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 0x7f44fc0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 0x7f44fc156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc156470 con 0x7f44fc0cec90 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0c7fe0 con 0x7f44fc0b05a0 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f4500bb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0c82c0 con 0x7f44fc0c3ad0 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48738/0 (socket says 172.21.15.26:48738) 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 -- 172.21.15.26:0/1506556246 learned_addr learned my addr 172.21.15.26:0/1506556246 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44faffd700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 0x7f44fc156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fb7fe700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 0x7f44fc0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 -- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 msgr2=0x7f44fc156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 0x7f44fc156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 -- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 msgr2=0x7f44fc0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 0x7f44fc0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 -- 172.21.15.26:0/1506556246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00094f0 con 0x7f44fc0cec90 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44faffd700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 0x7f44fc156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fb7fe700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 0x7f44fc0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.891+0000 7f44fbfff700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cd50 tx=0x7f44f4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.892+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4005df0 con 0x7f44fc0cec90 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.892+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400a960 con 0x7f44fc0cec90 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.892+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc156100 con 0x7f44fc0cec90 2023-10-09T11:42:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.892+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400ad20 con 0x7f44fc0cec90 2023-10-09T11:42:41.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.892+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0c5960 con 0x7f44fc0cec90 2023-10-09T11:42:41.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.893+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc1565e0 con 0x7f44fc0cec90 2023-10-09T11:42:41.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.893+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f44f4007300 con 0x7f44fc0cec90 2023-10-09T11:42:41.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.893+0000 7f44e37fe700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 0x7f44e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.894+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f44f4084ca0 con 0x7f44fc0cec90 2023-10-09T11:42:41.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.894+0000 7f44fb7fe700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 0x7f44e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.894+0000 7f44fb7fe700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 0x7f44e80697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006ea0 tx=0x7f44ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:41.898+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f4051b90 con 0x7f44fc0cec90 2023-10-09T11:42:42.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.093+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44fc04c3c0 con 0x7f44fc0cec90 2023-10-09T11:42:42.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.745+0000 7f44e37fe700 1 -- 172.21.15.26:0/1506556246 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44f40551b0 con 0x7f44fc0cec90 2023-10-09T11:42:42.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.753+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 msgr2=0x7f44e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.753+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 0x7f44e80697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006ea0 tx=0x7f44ec008040 comp rx=0 tx=0).stop 2023-10-09T11:42:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.753+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 msgr2=0x7f44fc0c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.753+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cd50 tx=0x7f44f4001b10 comp rx=0 tx=0).stop 2023-10-09T11:42:42.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 shutdown_connections 2023-10-09T11:42:42.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44fc0cec90 0x7f44fc0c7470 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44fc0b05a0 0x7f44fc0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f44e8067320 0x7f44e80697d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 --2- 172.21.15.26:0/1506556246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44fc0c3ad0 0x7f44fc156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.756+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 >> 172.21.15.26:0/1506556246 conn(0x7f44fc088000 msgr2=0x7f44fc158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:42.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.759+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 shutdown_connections 2023-10-09T11:42:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.760+0000 7f4500bb7700 1 -- 172.21.15.26:0/1506556246 wait complete. 2023-10-09T11:42:42.769 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:42:42.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:42:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.907+0000 7f61c13a2700 1 Processor -- start 2023-10-09T11:42:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.907+0000 7f61c13a2700 1 -- start start 2023-10-09T11:42:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c13a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61bc153dd0 0x7f61bc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c13a2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61bc0cea00 0x7f61bc0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c13a2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15ac50 con 0x7f61bc153a00 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c13a2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc15d010 con 0x7f61bc153dd0 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c13a2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0cf3e0 con 0x7f61bc0cea00 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61bb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61bc153dd0 0x7f61bc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61bb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61bc153dd0 0x7f61bc15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48742/0 (socket says 172.21.15.26:48742) 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61bb7fe700 1 -- 172.21.15.26:0/35634864 learned_addr learned my addr 172.21.15.26:0/35634864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.908+0000 7f61c0ba1700 1 --2- 172.21.15.26:0/35634864 >> v2:172.21.15.67:3300/0 conn(0x7f61bc0cea00 0x7f61bc0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61bb7fe700 1 -- 172.21.15.26:0/35634864 >> v2:172.21.15.67:3300/0 conn(0x7f61bc0cea00 msgr2=0x7f61bc0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61bb7fe700 1 --2- 172.21.15.26:0/35634864 >> v2:172.21.15.67:3300/0 conn(0x7f61bc0cea00 0x7f61bc0ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61bb7fe700 1 -- 172.21.15.26:0/35634864 >> v1:172.21.15.67:6789/0 conn(0x7f61bc153a00 legacy=0x7f61bc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61bb7fe700 1 -- 172.21.15.26:0/35634864 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc15af60 con 0x7f61bc153dd0 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61bb7fe700 1 --2- 172.21.15.26:0/35634864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153dd0 0x7f61bc15de50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0d03b0 tx=0x7f61b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc18694ddcf428ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61baffd700 1 -- 172.21.15.26:0/35634864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0009e70 con 0x7f61bc153dd0 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61baffd700 1 -- 172.21.15.26:0/35634864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b000b860 con 0x7f61bc153dd0 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.909+0000 7f61baffd700 1 -- 172.21.15.26:0/35634864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000bc00 con 0x7f61bc153dd0 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 -- 172.21.15.26:0/35634864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153dd0 msgr2=0x7f61bc15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 --2- 172.21.15.26:0/35634864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153dd0 0x7f61bc15de50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0d03b0 tx=0x7f61b0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 -- 172.21.15.26:0/35634864 shutdown_connections 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 --2- 172.21.15.26:0/35634864 >> v2:172.21.15.67:3300/0 conn(0x7f61bc0cea00 0x7f61bc0ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 --2- 172.21.15.26:0/35634864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153dd0 0x7f61bc15de50 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 -- 172.21.15.26:0/35634864 >> 172.21.15.26:0/35634864 conn(0x7f61bc0703a0 msgr2=0x7f61bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 -- 172.21.15.26:0/35634864 shutdown_connections 2023-10-09T11:42:42.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.910+0000 7f61c13a2700 1 -- 172.21.15.26:0/35634864 wait complete. 2023-10-09T11:42:42.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.911+0000 7f61c13a2700 1 Processor -- start 2023-10-09T11:42:42.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.911+0000 7f61c13a2700 1 -- start start 2023-10-09T11:42:42.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 0x7f61bc16cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 0x7f61bc144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0c85d0 con 0x7f61bc153a00 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc16d610 con 0x7f61bc153dd0 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc16d8f0 con 0x7f61bc0cea00 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48748/0 (socket says 172.21.15.26:48748) 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 -- 172.21.15.26:0/974293561 learned_addr learned my addr 172.21.15.26:0/974293561 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c0ba1700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 0x7f61bc144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 -- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 msgr2=0x7f61bc16cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bbfff700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 0x7f61bc16cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 0x7f61bc16cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 -- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 msgr2=0x7f61bc144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 0x7f61bc144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 -- 172.21.15.26:0/974293561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00094f0 con 0x7f61bc153a00 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c0ba1700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 0x7f61bc144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bbfff700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 0x7f61bc16cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61bb7fe700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f61bc06eb00 tx=0x7f61b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0011420 con 0x7f61bc153a00 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0011580 con 0x7f61bc153a00 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc16dbd0 con 0x7f61bc153a00 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0011940 con 0x7f61bc153a00 2023-10-09T11:42:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.912+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc1453b0 con 0x7f61bc153a00 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.913+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc0cbd40 con 0x7f61bc153a00 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.914+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f61b002c3b0 con 0x7f61bc153a00 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.914+0000 7f61a3fff700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 0x7f61a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.914+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f61b0086240 con 0x7f61bc153a00 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.915+0000 7f61bbfff700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 0x7f61a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.915+0000 7f61bbfff700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 0x7f61a80697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f61bc1536e0 tx=0x7f61ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:42.919+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61bc0cbd40 con 0x7f61bc153a00 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.155+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f61bc0cbd40 con 0x7f61bc153a00 2023-10-09T11:42:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.791+0000 7f61a3fff700 1 -- 172.21.15.26:0/974293561 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7f61bc0cbd40 con 0x7f61bc153a00 2023-10-09T11:42:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.796+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 msgr2=0x7f61a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.796+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 0x7f61a80697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f61bc1536e0 tx=0x7f61ac009040 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.796+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 msgr2=0x7f61bc0c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.796+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f61bc06eb00 tx=0x7f61b0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 shutdown_connections 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61bc153dd0 0x7f61bc144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f61a8067320 0x7f61a80697d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61bc0cea00 0x7f61bc16cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 --2- 172.21.15.26:0/974293561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc153a00 0x7f61bc0c8090 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 >> 172.21.15.26:0/974293561 conn(0x7f61bc0703a0 msgr2=0x7f61bc1509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 shutdown_connections 2023-10-09T11:42:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.797+0000 7f61c13a2700 1 -- 172.21.15.26:0/974293561 wait complete. 2023-10-09T11:42:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 24 and data pool 25 2023-10-09T11:42:43.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.935+0000 7fcbb15de700 1 Processor -- start 2023-10-09T11:42:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.935+0000 7fcbb15de700 1 -- start start 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbb15de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcbac06d490 0x7fcbac06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbb15de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac06ddf0 con 0x7fcbac0703a0 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbb15de700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac06c740 con 0x7fcbac159790 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbb15de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac06c9b0 con 0x7fcbac06d490 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbab7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcbac06d490 0x7fcbac06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbaa7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcbac0703a0 0x7fcbac0c7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58478/0 (socket says 172.21.15.26:58478) 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbab7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcbac06d490 0x7fcbac06d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48760/0 (socket says 172.21.15.26:48760) 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbaa7fc700 1 -- 172.21.15.26:0/2223022597 learned_addr learned my addr 172.21.15.26:0/2223022597 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbab7fe700 1 -- 172.21.15.26:0/2223022597 >> v1:172.21.15.67:6789/0 conn(0x7fcbac159790 legacy=0x7fcbac06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbab7fe700 1 -- 172.21.15.26:0/2223022597 >> v1:172.21.15.26:6789/0 conn(0x7fcbac0703a0 legacy=0x7fcbac0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcbab7fe700 1 -- 172.21.15.26:0/2223022597 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac06cc90 con 0x7fcbac06d490 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.936+0000 7fcba9ffb700 1 -- 172.21.15.26:0/2223022597 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375492502 0 0) 0x7fcbac06ddf0 con 0x7fcbac0703a0 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbab7fe700 1 --2- 172.21.15.26:0/2223022597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac06d490 0x7fcbac06d8b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e60 tx=0x7fcb9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512fa95d5b732767 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcba9ffb700 1 -- 172.21.15.26:0/2223022597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00e070 con 0x7fcbac06d490 2023-10-09T11:42:43.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcba9ffb700 1 -- 172.21.15.26:0/2223022597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00bbf0 con 0x7fcbac06d490 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcba9ffb700 1 -- 172.21.15.26:0/2223022597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c012430 con 0x7fcbac06d490 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 -- 172.21.15.26:0/2223022597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac06d490 msgr2=0x7fcbac06d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 --2- 172.21.15.26:0/2223022597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac06d490 0x7fcbac06d8b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e60 tx=0x7fcb9c009780 comp rx=0 tx=0).stop 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 -- 172.21.15.26:0/2223022597 shutdown_connections 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 --2- 172.21.15.26:0/2223022597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac06d490 0x7fcbac06d8b0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 -- 172.21.15.26:0/2223022597 >> 172.21.15.26:0/2223022597 conn(0x7fcbac06ecd0 msgr2=0x7fcbac06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 -- 172.21.15.26:0/2223022597 shutdown_connections 2023-10-09T11:42:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.937+0000 7fcbb15de700 1 -- 172.21.15.26:0/2223022597 wait complete. 2023-10-09T11:42:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 Processor -- start 2023-10-09T11:42:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 -- start start 2023-10-09T11:42:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbac06d490 0x7fcbac14c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 0x7fcbac157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15bd10 con 0x7fcbac0703a0 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15bf00 con 0x7fcbac06d490 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbb15de700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15c1e0 con 0x7fcbac159790 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbaa7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbaa7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48772/0 (socket says 172.21.15.26:48772) 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.939+0000 7fcbaa7fc700 1 -- 172.21.15.26:0/256393610 learned_addr learned my addr 172.21.15.26:0/256393610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaaffd700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbac06d490 0x7fcbac14c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbab7fe700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 0x7fcbac157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 -- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 msgr2=0x7fcbac157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 0x7fcbac157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 -- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbac06d490 msgr2=0x7fcbac14c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbac06d490 0x7fcbac14c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 -- 172.21.15.26:0/256393610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009a20 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbab7fe700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 0x7fcbac157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbaa7fc700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c5b0 tx=0x7fcb94001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94005b30 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94005c90 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac15c4c0 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007300 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.940+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac15ca80 con 0x7fcbac0703a0 2023-10-09T11:42:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.941+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac04c3c0 con 0x7fcbac0703a0 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.941+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb9401b3b0 con 0x7fcbac0703a0 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.942+0000 7fcba2ffd700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 0x7fcb8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.942+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb94084150 con 0x7fcbac0703a0 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.942+0000 7fcbaaffd700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 0x7fcb8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.943+0000 7fcbaaffd700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 0x7fcb8c0697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcba4003a30 tx=0x7fcba4007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:43.946+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb94050de0 con 0x7fcbac0703a0 2023-10-09T11:42:44.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.139+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbac0b2820 con 0x7fcbac0703a0 2023-10-09T11:42:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.140+0000 7fcba2ffd700 1 -- 172.21.15.26:0/256393610 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fcb94054400 con 0x7fcbac0703a0 2023-10-09T11:42:44.142 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:44.142 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":137,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:43.157203+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:42.124868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:44.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.142+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 msgr2=0x7fcb8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.142+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 0x7fcb8c0697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcba4003a30 tx=0x7fcba4007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.142+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 msgr2=0x7fcbac157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.142+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c5b0 tx=0x7fcb94001070 comp rx=0 tx=0).stop 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 shutdown_connections 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcb8c067320 0x7fcb8c0697d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcbac159790 0x7fcbac157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbac06d490 0x7fcbac14c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 --2- 172.21.15.26:0/256393610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbac0703a0 0x7fcbac157760 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 >> 172.21.15.26:0/256393610 conn(0x7fcbac06ecd0 msgr2=0x7fcbac0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 shutdown_connections 2023-10-09T11:42:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.143+0000 7fcbb15de700 1 -- 172.21.15.26:0/256393610 wait complete. 2023-10-09T11:42:44.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.275+0000 7f55ef59e700 1 Processor -- start 2023-10-09T11:42:44.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.275+0000 7f55ef59e700 1 -- start start 2023-10-09T11:42:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ef59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55f0164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ef59e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f015afd0 con 0x7f55f0153c30 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ef59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f015b2b0 con 0x7f55f015de50 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ef59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f015b590 con 0x7f55f00cf110 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ee59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f55f0153c30 0x7f55f015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58494/0 (socket says 172.21.15.26:58494) 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ee59c700 1 -- 172.21.15.26:0/1361181231 learned_addr learned my addr 172.21.15.26:0/1361181231 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55eed9d700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55f0164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952376430 0 0) 0x7f55f015afd0 con 0x7f55f0153c30 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.276+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55dc003570 con 0x7f55f0153c30 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677766066 0 0) 0x7f55dc003570 con 0x7f55f0153c30 2023-10-09T11:42:44.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 msgr2=0x7f55f0164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55f0164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 >> v1:172.21.15.67:6789/0 conn(0x7f55f015de50 legacy=0x7f55f00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f015b870 con 0x7f55f0153c30 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f55e00017f0 con 0x7f55f0153c30 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 >> v1:172.21.15.26:6789/0 conn(0x7f55f0153c30 legacy=0x7f55f015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55dc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55dc003fd0 0x7f55dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55dc004d50 0x7f55dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f015b590 con 0x7f55dc004d50 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc00bb40 con 0x7f55dc003fd0 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc00bd00 con 0x7f55f00cf110 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55dc004d50 0x7f55dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55ee59c700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55dc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55edd9b700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55dc003fd0 0x7f55dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 -- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 msgr2=0x7f55dc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55f00cf110 0x7f55dc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 -- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55dc003fd0 msgr2=0x7f55dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55dc003fd0 0x7f55dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 -- 172.21.15.26:0/1361181231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc003570 con 0x7f55dc004d50 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.277+0000 7f55eed9d700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55dc004d50 0x7f55dc0051c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009c00 tx=0x7f55e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bb7bf61aa37ba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800e710 con 0x7f55dc004d50 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800e870 con 0x7f55dc004d50 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ed59a700 1 -- 172.21.15.26:0/1361181231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800ec30 con 0x7f55dc004d50 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ef59e700 1 -- 172.21.15.26:0/1361181231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55dc004d50 msgr2=0x7f55dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ef59e700 1 --2- 172.21.15.26:0/1361181231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55dc004d50 0x7f55dc0051c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009c00 tx=0x7f55e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55eed9d700 1 -- 172.21.15.26:0/1361181231 reap_dead start 2023-10-09T11:42:44.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ef59e700 1 -- 172.21.15.26:0/1361181231 shutdown_connections 2023-10-09T11:42:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ef59e700 1 -- 172.21.15.26:0/1361181231 >> 172.21.15.26:0/1361181231 conn(0x7f55f00703a0 msgr2=0x7f55f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.278+0000 7f55ef59e700 1 -- 172.21.15.26:0/1361181231 shutdown_connections 2023-10-09T11:42:44.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.279+0000 7f55ef59e700 1 -- 172.21.15.26:0/1361181231 wait complete. 2023-10-09T11:42:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 Processor -- start 2023-10-09T11:42:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 -- start start 2023-10-09T11:42:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55dc004d50 0x7f55f00b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f00b3cc0 0x7f55f00c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00b6120 con 0x7f55f0152e40 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00c9900 con 0x7f55f00b3cc0 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55ef59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00b5e40 con 0x7f55dc004d50 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.280+0000 7f55eed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48788/0 (socket says 172.21.15.26:48788) 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55ee59c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55dc004d50 0x7f55f00b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 -- 172.21.15.26:0/79698370 learned_addr learned my addr 172.21.15.26:0/79698370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:44.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55edd9b700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f00b3cc0 0x7f55f00c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 -- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55dc004d50 msgr2=0x7f55f00b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55dc004d50 0x7f55f00b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 -- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f00b3cc0 msgr2=0x7f55f00c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f00b3cc0 0x7f55f00c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 -- 172.21.15.26:0/79698370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00c92b0 con 0x7f55f0152e40 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55eed9d700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e4b0 tx=0x7f55e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8022070 con 0x7f55f0152e40 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800ebf0 con 0x7f55f0152e40 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f00c9590 con 0x7f55f0152e40 2023-10-09T11:42:44.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800e710 con 0x7f55f0152e40 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.281+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00b4130 con 0x7f55f0152e40 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.282+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00c9a90 con 0x7f55f0152e40 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.282+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55e801c930 con 0x7f55f0152e40 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.283+0000 7f55e67fc700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 0x7f55d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.283+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55e8000e40 con 0x7f55f0152e40 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.283+0000 7f55ee59c700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 0x7f55d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.284+0000 7f55ee59c700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 0x7f55d00697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f55e000a0e0 tx=0x7f55f0159c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.287+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55e8053490 con 0x7f55f0152e40 2023-10-09T11:42:44.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.482+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55f00b4320 con 0x7f55f0152e40 2023-10-09T11:42:44.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.483+0000 7f55e67fc700 1 -- 172.21.15.26:0/79698370 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f55e8056ab0 con 0x7f55f0152e40 2023-10-09T11:42:44.484 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:44.484 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":137,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:43.157203+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:42.124868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 msgr2=0x7f55d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 0x7f55d00697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f55e000a0e0 tx=0x7f55f0159c60 comp rx=0 tx=0).stop 2023-10-09T11:42:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 msgr2=0x7f55f0169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e4b0 tx=0x7f55e801a000 comp rx=0 tx=0).stop 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 shutdown_connections 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55f0152e40 0x7f55f0169900 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55d0067320 0x7f55d00697d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55dc004d50 0x7f55f00b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 --2- 172.21.15.26:0/79698370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f00b3cc0 0x7f55f00c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 >> 172.21.15.26:0/79698370 conn(0x7f55f00703a0 msgr2=0x7f55f00c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 shutdown_connections 2023-10-09T11:42:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.485+0000 7f55ef59e700 1 -- 172.21.15.26:0/79698370 wait complete. 2023-10-09T11:42:44.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:42:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.619+0000 7f75b4a1b700 1 Processor -- start 2023-10-09T11:42:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.619+0000 7f75b4a1b700 1 -- start start 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75b4a1b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75b006dc70 0x7f75b0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75b4a1b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75b006e0e0 0x7f75b00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75b4a1b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00ccfd0 con 0x7f75b0159530 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75b4a1b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b015a3d0 con 0x7f75b006e0e0 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75b4a1b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b015a6b0 con 0x7f75b006dc70 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75ae59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f75b0159530 0x7f75b00ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58502/0 (socket says 172.21.15.26:58502) 2023-10-09T11:42:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75ae59c700 1 -- 172.21.15.26:0/2633274150 learned_addr learned my addr 172.21.15.26:0/2633274150 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 --2- 172.21.15.26:0/2633274150 >> v2:172.21.15.26:3300/0 conn(0x7f75b006e0e0 0x7f75b00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75add9b700 1 --2- 172.21.15.26:0/2633274150 >> v2:172.21.15.67:3300/0 conn(0x7f75b006dc70 0x7f75b0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75ad59a700 1 -- 172.21.15.26:0/2633274150 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609677471 0 0) 0x7f75b00ccfd0 con 0x7f75b0159530 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75ad59a700 1 -- 172.21.15.26:0/2633274150 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f759c003570 con 0x7f75b0159530 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 -- 172.21.15.26:0/2633274150 >> v2:172.21.15.67:3300/0 conn(0x7f75b006dc70 msgr2=0x7f75b0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 --2- 172.21.15.26:0/2633274150 >> v2:172.21.15.67:3300/0 conn(0x7f75b006dc70 0x7f75b0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 -- 172.21.15.26:0/2633274150 >> v1:172.21.15.26:6789/0 conn(0x7f75b0159530 legacy=0x7f75b00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 -- 172.21.15.26:0/2633274150 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b015a990 con 0x7f75b006e0e0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.620+0000 7f75aed9d700 1 --2- 172.21.15.26:0/2633274150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b006e0e0 0x7f75b00cb6f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f75b00b66e0 tx=0x7f75a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c16c827a7036690 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75ad59a700 1 -- 172.21.15.26:0/2633274150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800e070 con 0x7f75b006e0e0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75ad59a700 1 -- 172.21.15.26:0/2633274150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a800bab0 con 0x7f75b006e0e0 2023-10-09T11:42:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75ad59a700 1 -- 172.21.15.26:0/2633274150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800be30 con 0x7f75b006e0e0 2023-10-09T11:42:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 -- 172.21.15.26:0/2633274150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b006e0e0 msgr2=0x7f75b00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/2633274150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b006e0e0 0x7f75b00cb6f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f75b00b66e0 tx=0x7f75a8009780 comp rx=0 tx=0).stop 2023-10-09T11:42:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 -- 172.21.15.26:0/2633274150 shutdown_connections 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/2633274150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b006e0e0 0x7f75b00cb6f0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/2633274150 >> v2:172.21.15.67:3300/0 conn(0x7f75b006dc70 0x7f75b0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 -- 172.21.15.26:0/2633274150 >> 172.21.15.26:0/2633274150 conn(0x7f75b00703a0 msgr2=0x7f75b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 -- 172.21.15.26:0/2633274150 shutdown_connections 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.621+0000 7f75b4a1b700 1 -- 172.21.15.26:0/2633274150 wait complete. 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.622+0000 7f75b4a1b700 1 Processor -- start 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.622+0000 7f75b4a1b700 1 -- start start 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75b006dc70 0x7f75b00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 0x7f75b00b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b013dcf0 con 0x7f75b0159530 2023-10-09T11:42:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b013df00 con 0x7f75b006dc70 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75b4a1b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b013e1e0 con 0x7f75b006e0e0 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48812/0 (socket says 172.21.15.26:48812) 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75aed9d700 1 -- 172.21.15.26:0/583656617 learned_addr learned my addr 172.21.15.26:0/583656617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75ae59c700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75b006dc70 0x7f75b00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.623+0000 7f75add9b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 0x7f75b00b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 -- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 msgr2=0x7f75b00b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 0x7f75b00b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 -- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75b006dc70 msgr2=0x7f75b00cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75b006dc70 0x7f75b00cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 -- 172.21.15.26:0/583656617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8009a20 con 0x7f75b0159530 2023-10-09T11:42:44.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75add9b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 0x7f75b00b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75aed9d700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f75b0089650 tx=0x7f75a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8012cd0 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8021070 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b013e4c0 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8026680 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.624+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b0151590 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.625+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b013e9e0 con 0x7f75b0159530 2023-10-09T11:42:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.625+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f75a8023030 con 0x7f75b0159530 2023-10-09T11:42:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.626+0000 7f75a67fc700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 0x7f75900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.626+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75a8086e10 con 0x7f75b0159530 2023-10-09T11:42:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.626+0000 7f75ae59c700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 0x7f75900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.626+0000 7f75ae59c700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 0x7f75900697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f75a00058d0 tx=0x7f75a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.630+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75b013e9e0 con 0x7f75b0159530 2023-10-09T11:42:44.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:44.871+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f75b013e9e0 con 0x7f75b0159530 2023-10-09T11:42:45.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.796+0000 7f75a67fc700 1 -- 172.21.15.26:0/583656617 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7f75b013e9e0 con 0x7f75b0159530 2023-10-09T11:42:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.798+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 msgr2=0x7f75900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.798+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 0x7f75900697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f75a00058d0 tx=0x7f75a0009040 comp rx=0 tx=0).stop 2023-10-09T11:42:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 msgr2=0x7f75b0140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f75b0089650 tx=0x7f75a8019000 comp rx=0 tx=0).stop 2023-10-09T11:42:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 shutdown_connections 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b0159530 0x7f75b0140290 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75b006dc70 0x7f75b00cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7590067320 0x7f75900697d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 --2- 172.21.15.26:0/583656617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75b006e0e0 0x7f75b00b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 >> 172.21.15.26:0/583656617 conn(0x7f75b00703a0 msgr2=0x7f75b01549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 shutdown_connections 2023-10-09T11:42:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.799+0000 7f75b4a1b700 1 -- 172.21.15.26:0/583656617 wait complete. 2023-10-09T11:42:45.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:42:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.943+0000 7fe46f6dd700 1 Processor -- start 2023-10-09T11:42:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.943+0000 7fe46f6dd700 1 -- start start 2023-10-09T11:42:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 0x7fe4680ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 0x7fe468159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe46806e0e0 0x7fe4680cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680ccfd0 con 0x7fe46806e0e0 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680cf0e0 con 0x7fe468159530 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46f6dd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46815a3d0 con 0x7fe46806dc70 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe46806e0e0 0x7fe4680cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe46806e0e0 0x7fe4680cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48822/0 (socket says 172.21.15.26:48822) 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 -- 172.21.15.26:0/1758793948 learned_addr learned my addr 172.21.15.26:0/1758793948 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46d479700 1 --2- 172.21.15.26:0/1758793948 >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 0x7fe4680ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46cc78700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 0x7fe468159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 -- 172.21.15.26:0/1758793948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 msgr2=0x7fe468159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 0x7fe468159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 -- 172.21.15.26:0/1758793948 >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 msgr2=0x7fe4680ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 --2- 172.21.15.26:0/1758793948 >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 0x7fe4680ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 -- 172.21.15.26:0/1758793948 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46815a6b0 con 0x7fe46806e0e0 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46d479700 1 --2- 172.21.15.26:0/1758793948 >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 0x7fe4680ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46cc78700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 0x7fe468159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe46dc7a700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe4680cb6f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe46806d630 tx=0x7fe460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7813f1faead6f44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe45ffff700 1 -- 172.21.15.26:0/1758793948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000b860 con 0x7fe46806e0e0 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe45ffff700 1 -- 172.21.15.26:0/1758793948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b9c0 con 0x7fe46806e0e0 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.944+0000 7fe45ffff700 1 -- 172.21.15.26:0/1758793948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000bd60 con 0x7fe46806e0e0 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 -- 172.21.15.26:0/1758793948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 msgr2=0x7fe4680cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe4680cb6f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe46806d630 tx=0x7fe460009250 comp rx=0 tx=0).stop 2023-10-09T11:42:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 -- 172.21.15.26:0/1758793948 shutdown_connections 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/1758793948 >> v2:172.21.15.67:3300/0 conn(0x7fe468159530 0x7fe4680ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe4680cb6f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/1758793948 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe46806dc70 0x7fe468159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 -- 172.21.15.26:0/1758793948 >> 172.21.15.26:0/1758793948 conn(0x7fe4680703a0 msgr2=0x7fe4680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 -- 172.21.15.26:0/1758793948 shutdown_connections 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.945+0000 7fe46f6dd700 1 -- 172.21.15.26:0/1758793948 wait complete. 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.946+0000 7fe46f6dd700 1 Processor -- start 2023-10-09T11:42:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.946+0000 7fe46f6dd700 1 -- start start 2023-10-09T11:42:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46806dc70 0x7fe4681512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe468159530 0x7fe4680b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680b6360 con 0x7fe46806e0e0 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c9750 con 0x7fe46806dc70 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46f6dd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681517e0 con 0x7fe468159530 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48830/0 (socket says 172.21.15.26:48830) 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 -- 172.21.15.26:0/948234238 learned_addr learned my addr 172.21.15.26:0/948234238 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46d479700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46806dc70 0x7fe4681512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46dc7a700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe468159530 0x7fe4680b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 -- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe468159530 msgr2=0x7fe4680b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe468159530 0x7fe4680b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 -- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46806dc70 msgr2=0x7fe4681512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46806dc70 0x7fe4681512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.947+0000 7fe46cc78700 1 -- 172.21.15.26:0/948234238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600094f0 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe46cc78700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c8b0 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458011600 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458011760 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46816a1b0 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458011b00 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.948+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46816a770 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.949+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680c98e0 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.949+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe458018350 con 0x7fe46806e0e0 2023-10-09T11:42:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.949+0000 7fe45d7fa700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 0x7fe44c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.950+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe458084ba0 con 0x7fe46806e0e0 2023-10-09T11:42:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.950+0000 7fe46d479700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 0x7fe44c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.950+0000 7fe46d479700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 0x7fe44c069800 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe46400f600 tx=0x7fe4640077b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:45.954+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe458051720 con 0x7fe46806e0e0 2023-10-09T11:42:46.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.190+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe46815a990 con 0x7fe46806e0e0 2023-10-09T11:42:46.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.800+0000 7fe45d7fa700 1 -- 172.21.15.26:0/948234238 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe458054d40 con 0x7fe46806e0e0 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 msgr2=0x7fe44c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 0x7fe44c069800 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe46400f600 tx=0x7fe4640077b0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 msgr2=0x7fe468169930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c8b0 tx=0x7fe458008040 comp rx=0 tx=0).stop 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 shutdown_connections 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe44c067350 0x7fe44c069800 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe468159530 0x7fe4680b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46806dc70 0x7fe4681512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 --2- 172.21.15.26:0/948234238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe46806e0e0 0x7fe468169930 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 >> 172.21.15.26:0/948234238 conn(0x7fe4680703a0 msgr2=0x7fe4681540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 shutdown_connections 2023-10-09T11:42:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.802+0000 7fe46f6dd700 1 -- 172.21.15.26:0/948234238 wait complete. 2023-10-09T11:42:46.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:46.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.938+0000 7f8714178700 1 Processor -- start 2023-10-09T11:42:46.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.938+0000 7f8714178700 1 -- start start 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 0x7f870c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f870c0cd9e0 0x7f870c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 0x7f870c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c0d13f0 con 0x7f870c0cd9e0 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c15ae40 con 0x7f870c0cb5a0 2023-10-09T11:42:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8714178700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c15ab60 con 0x7f870c15a400 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8711713700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f870c0cd9e0 0x7f870c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8711713700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f870c0cd9e0 0x7f870c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48838/0 (socket says 172.21.15.26:48838) 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8711713700 1 -- 172.21.15.26:0/3106294969 learned_addr learned my addr 172.21.15.26:0/3106294969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8711f14700 1 --2- 172.21.15.26:0/3106294969 >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 0x7f870c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.939+0000 7f8712715700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 0x7f870c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 -- 172.21.15.26:0/3106294969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 msgr2=0x7f870c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 0x7f870c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 -- 172.21.15.26:0/3106294969 >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 msgr2=0x7f870c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 --2- 172.21.15.26:0/3106294969 >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 0x7f870c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 -- 172.21.15.26:0/3106294969 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0ccf00 con 0x7f870c0cd9e0 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711f14700 1 --2- 172.21.15.26:0/3106294969 >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 0x7f870c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:46.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8712715700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 0x7f870c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8711713700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0cd9e0 0x7f870c159ec0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f87000099b0 tx=0x7f8700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b6e60cc09af1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8710f12700 1 -- 172.21.15.26:0/3106294969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000b820 con 0x7f870c0cd9e0 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8710f12700 1 -- 172.21.15.26:0/3106294969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870000b980 con 0x7f870c0cd9e0 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8710f12700 1 -- 172.21.15.26:0/3106294969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000bd20 con 0x7f870c0cd9e0 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8714178700 1 -- 172.21.15.26:0/3106294969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0cd9e0 msgr2=0x7f870c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8714178700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0cd9e0 0x7f870c159ec0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f87000099b0 tx=0x7f8700009250 comp rx=0 tx=0).stop 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.940+0000 7f8714178700 1 -- 172.21.15.26:0/3106294969 shutdown_connections 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 --2- 172.21.15.26:0/3106294969 >> v2:172.21.15.67:3300/0 conn(0x7f870c0cb5a0 0x7f870c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c15a400 0x7f870c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 --2- 172.21.15.26:0/3106294969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0cd9e0 0x7f870c159ec0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 -- 172.21.15.26:0/3106294969 >> 172.21.15.26:0/3106294969 conn(0x7f870c070e30 msgr2=0x7f870c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:46.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 -- 172.21.15.26:0/3106294969 shutdown_connections 2023-10-09T11:42:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.941+0000 7f8714178700 1 -- 172.21.15.26:0/3106294969 wait complete. 2023-10-09T11:42:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.942+0000 7f8714178700 1 Processor -- start 2023-10-09T11:42:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.942+0000 7f8714178700 1 -- start start 2023-10-09T11:42:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.942+0000 7f8714178700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 0x7f870c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 0x7f870c14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1512f0 con 0x7f870c15a400 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c150410 con 0x7f870c0cb5a0 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1506e0 con 0x7f870c0cd9e0 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48846/0 (socket says 172.21.15.26:48846) 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 -- 172.21.15.26:0/1802196568 learned_addr learned my addr 172.21.15.26:0/1802196568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8711f14700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 0x7f870c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8711713700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 0x7f870c14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 -- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 msgr2=0x7f870c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 0x7f870c14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 -- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 msgr2=0x7f870c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 0x7f870c151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 -- 172.21.15.26:0/1802196568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000094f0 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8711f14700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 0x7f870c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8711713700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 0x7f870c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8712715700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8704007f30 tx=0x7f8704009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400dc80 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400f040 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c1509c0 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.943+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704015690 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.944+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c150f80 con 0x7f870c15a400 2023-10-09T11:42:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.944+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c151460 con 0x7f870c15a400 2023-10-09T11:42:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.945+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f870401e3b0 con 0x7f870c15a400 2023-10-09T11:42:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.945+0000 7f8709ffb700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 0x7f86f8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.945+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87040851c0 con 0x7f870c15a400 2023-10-09T11:42:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.945+0000 7f8711f14700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 0x7f86f8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.946+0000 7f8711f14700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 0x7f86f8069800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f86fc006f00 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:46.950+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8704051d40 con 0x7f870c15a400 2023-10-09T11:42:47.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.185+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f870c04c3c0 con 0x7f870c15a400 2023-10-09T11:42:47.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.186+0000 7f8709ffb700 1 -- 172.21.15.26:0/1802196568 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f8704055360 con 0x7f870c15a400 2023-10-09T11:42:47.188 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:47.188 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":92,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:46.795352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 msgr2=0x7f86f8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 0x7f86f8069800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f86fc006f00 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 msgr2=0x7f870c14e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8704007f30 tx=0x7f8704009930 comp rx=0 tx=0).stop 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 shutdown_connections 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c15a400 0x7f870c14e050 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f870c0cb5a0 0x7f870c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86f8067350 0x7f86f8069800 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 --2- 172.21.15.26:0/1802196568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f870c0cd9e0 0x7f870c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 >> 172.21.15.26:0/1802196568 conn(0x7f870c070e30 msgr2=0x7f870c155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 shutdown_connections 2023-10-09T11:42:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.188+0000 7f8714178700 1 -- 172.21.15.26:0/1802196568 wait complete. 2023-10-09T11:42:47.191 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 92 2023-10-09T11:42:47.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:47.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.321+0000 7f3c60c4a700 1 Processor -- start 2023-10-09T11:42:47.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.321+0000 7f3c60c4a700 1 -- start start 2023-10-09T11:42:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c60c4a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c5c15acd0 0x7f3c5c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c60c4a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c15a840 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c60c4a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0c8520 con 0x7f3c5c06ae50 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c60c4a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c15a1f0 con 0x7f3c5c15acd0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c5bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c5c0c7fb0 0x7f3c5c1563f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58504/0 (socket says 172.21.15.26:58504) 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c5bfff700 1 -- 172.21.15.26:0/272299627 learned_addr learned my addr 172.21.15.26:0/272299627 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/272299627 >> v2:172.21.15.67:3300/0 conn(0x7f3c5c15acd0 0x7f3c5c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465962888 0 0) 0x7f3c5c15a840 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.322+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c48003570 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203373656 0 0) 0x7f3c48003570 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 >> v2:172.21.15.67:3300/0 conn(0x7f3c5c15acd0 msgr2=0x7f3c5c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 --2- 172.21.15.26:0/272299627 >> v2:172.21.15.67:3300/0 conn(0x7f3c5c15acd0 0x7f3c5c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 >> v1:172.21.15.67:6789/0 conn(0x7f3c5c06ae50 legacy=0x7f3c5c0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c15a4d0 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3c540017f0 con 0x7f3c5c0c7fb0 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/272299627 >> v2:172.21.15.67:3300/0 conn(0x7f3c5c15acd0 0x7f3c5c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 >> v1:172.21.15.26:6789/0 conn(0x7f3c5c0c7fb0 legacy=0x7f3c5c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c48003a60 0x7f3c48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c48004810 0x7f3c48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c4800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15a1f0 con 0x7f3c480051c0 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800e2e0 con 0x7f3c48003a60 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800e4a0 con 0x7f3c48004810 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c4800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5b7fe700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c48003a60 0x7f3c48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c48004810 0x7f3c48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 -- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c48004810 msgr2=0x7f3c48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c48004810 0x7f3c48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 -- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c48003a60 msgr2=0x7f3c48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c48003a60 0x7f3c48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 -- 172.21.15.26:0/272299627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48003570 con 0x7f3c480051c0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c48004810 0x7f3c48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 -- 172.21.15.26:0/272299627 reap_dead start 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5bfff700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c4800dc70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400a900 tx=0x7f3c540021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6c53f266482a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.323+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540070d0 con 0x7f3c480051c0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54007230 con 0x7f3c480051c0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c5affd700 1 -- 172.21.15.26:0/272299627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540075d0 con 0x7f3c480051c0 2023-10-09T11:42:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 -- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 msgr2=0x7f3c4800dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c4800dc70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400a900 tx=0x7f3c540021d0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 -- 172.21.15.26:0/272299627 shutdown_connections 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/272299627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c4800dc70 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 -- 172.21.15.26:0/272299627 >> 172.21.15.26:0/272299627 conn(0x7f3c5c06e280 msgr2=0x7f3c5c0cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 -- 172.21.15.26:0/272299627 shutdown_connections 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.324+0000 7f3c60c4a700 1 -- 172.21.15.26:0/272299627 wait complete. 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.325+0000 7f3c60c4a700 1 Processor -- start 2023-10-09T11:42:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.325+0000 7f3c60c4a700 1 -- start start 2023-10-09T11:42:47.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c5c06d090 0x7f3c5c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c5c0688d0 0x7f3c5c068d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0692b0 con 0x7f3c480051c0 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1574d0 con 0x7f3c5c06d090 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c60c4a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c165040 con 0x7f3c5c0688d0 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48870/0 (socket says 172.21.15.26:48870) 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5b7fe700 1 -- 172.21.15.26:0/1893461520 learned_addr learned my addr 172.21.15.26:0/1893461520 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c5c06d090 0x7f3c5c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5bfff700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c5c0688d0 0x7f3c5c068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5b7fe700 1 -- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c5c0688d0 msgr2=0x7f3c5c068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.326+0000 7f3c5b7fe700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c5c0688d0 0x7f3c5c068d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c5b7fe700 1 -- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c5c06d090 msgr2=0x7f3c5c156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c5b7fe700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c5c06d090 0x7f3c5c156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c5b7fe700 1 -- 172.21.15.26:0/1893461520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c165320 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c5b7fe700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0029d0 tx=0x7f3c4c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00f6c0 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00f820 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c165600 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00fbe0 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.327+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c1520b0 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.328+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c04c3c0 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.328+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c4c01c400 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.329+0000 7f3c53fff700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 0x7f3c3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.329+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c4c085040 con 0x7f3c480051c0 2023-10-09T11:42:47.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.329+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 0x7f3c3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.329+0000 7f3c52ffd700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 0x7f3c3c0697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c06cb50 tx=0x7f3c44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.334+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4c051d80 con 0x7f3c480051c0 2023-10-09T11:42:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.527+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c0ce030 con 0x7f3c480051c0 2023-10-09T11:42:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.528+0000 7f3c53fff700 1 -- 172.21.15.26:0/1893461520 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f3c4c0553a0 con 0x7f3c480051c0 2023-10-09T11:42:47.529 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:47.530 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":138,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:44.768839+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:42.124868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 msgr2=0x7f3c3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 0x7f3c3c0697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c06cb50 tx=0x7f3c44008040 comp rx=0 tx=0).stop 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 msgr2=0x7f3c5c151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0029d0 tx=0x7f3c4c007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 shutdown_connections 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c3c067320 0x7f3c3c0697d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c5c0688d0 0x7f3c5c068d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c480051c0 0x7f3c5c151b70 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 --2- 172.21.15.26:0/1893461520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c5c06d090 0x7f3c5c156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 >> 172.21.15.26:0/1893461520 conn(0x7f3c5c06e280 msgr2=0x7f3c5c0c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 shutdown_connections 2023-10-09T11:42:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.530+0000 7f3c60c4a700 1 -- 172.21.15.26:0/1893461520 wait complete. 2023-10-09T11:42:47.544 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:42:47.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:47.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.662+0000 7f2501451700 1 Processor -- start 2023-10-09T11:42:47.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.662+0000 7f2501451700 1 -- start start 2023-10-09T11:42:47.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f2501451700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc0cf180 0x7f24fc0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f2501451700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc0cb1a0 0x7f24fc0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f2501451700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc15e010 con 0x7f24fc1594d0 2023-10-09T11:42:47.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f2501451700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc15d420 con 0x7f24fc0cf180 2023-10-09T11:42:47.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f2501451700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15d6e0 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc0cf180 0x7f24fc0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc0cf180 0x7f24fc0ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48874/0 (socket says 172.21.15.26:48874) 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 -- 172.21.15.26:0/232469920 learned_addr learned my addr 172.21.15.26:0/232469920 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc0cb1a0 0x7f24fc0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 -- 172.21.15.26:0/232469920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc0cb1a0 msgr2=0x7f24fc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc0cb1a0 0x7f24fc0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 -- 172.21.15.26:0/232469920 >> v1:172.21.15.67:6789/0 conn(0x7f24fc1594d0 legacy=0x7f24fc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.663+0000 7f24fa7fc700 1 -- 172.21.15.26:0/232469920 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc15d9c0 con 0x7f24fc0cf180 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f24fa7fc700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cf180 0x7f24fc0ccfc0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f24e40099b0 tx=0x7f24e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4583816a633df48a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f24f9ffb700 1 -- 172.21.15.26:0/232469920 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400b820 con 0x7f24fc0cf180 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f24f9ffb700 1 -- 172.21.15.26:0/232469920 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400b980 con 0x7f24fc0cf180 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f24f9ffb700 1 -- 172.21.15.26:0/232469920 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400bd20 con 0x7f24fc0cf180 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 -- 172.21.15.26:0/232469920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cf180 msgr2=0x7f24fc0ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cf180 0x7f24fc0ccfc0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f24e40099b0 tx=0x7f24e4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 -- 172.21.15.26:0/232469920 shutdown_connections 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc0cb1a0 0x7f24fc0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 --2- 172.21.15.26:0/232469920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cf180 0x7f24fc0ccfc0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 -- 172.21.15.26:0/232469920 >> 172.21.15.26:0/232469920 conn(0x7f24fc0703a0 msgr2=0x7f24fc070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 -- 172.21.15.26:0/232469920 shutdown_connections 2023-10-09T11:42:47.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.664+0000 7f2501451700 1 -- 172.21.15.26:0/232469920 wait complete. 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 Processor -- start 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 -- start start 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc0cf180 0x7f24fc169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 0x7f24fc0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0c8390 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc16e6f0 con 0x7f24fc0cf180 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.666+0000 7f2501451700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc16a060 con 0x7f24fc1594d0 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48886/0 (socket says 172.21.15.26:48886) 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 -- 172.21.15.26:0/2247660060 learned_addr learned my addr 172.21.15.26:0/2247660060 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 0x7f24fc0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24fa7fc700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc0cf180 0x7f24fc169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 -- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 msgr2=0x7f24fc0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 0x7f24fc0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 -- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc0cf180 msgr2=0x7f24fc169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc0cf180 0x7f24fc169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 -- 172.21.15.26:0/2247660060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40094f0 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 0x7f24fc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24faffd700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f24f400b5e0 tx=0x7f24f4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400f510 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400f670 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0c7780 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400fa30 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.667+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc0c7d40 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.668+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc04c3c0 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.669+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24f401a400 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.669+0000 7f24f2ffd700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 0x7f24dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.669+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f24f4084660 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.669+0000 7f24fa7fc700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 0x7f24dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.670+0000 7f24fa7fc700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 0x7f24dc0697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0cacb0 tx=0x7f24e4016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.674+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f4051470 con 0x7f24fc0cb1a0 2023-10-09T11:42:47.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.864+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24fc0c84d0 con 0x7f24dc067320 2023-10-09T11:42:47.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.874+0000 7f24f2ffd700 1 -- 172.21.15.26:0/2247660060 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289752 (secure 0 0 0) 0x7f24e400baf0 con 0x7f24dc067320 2023-10-09T11:42:47.878 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 msgr2=0x7f24dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 0x7f24dc0697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0cacb0 tx=0x7f24e4016000 comp rx=0 tx=0).stop 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 msgr2=0x7f24fc16e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f24f400b5e0 tx=0x7f24f4009120 comp rx=0 tx=0).stop 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 shutdown_connections 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24dc067320 0x7f24dc0697d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc1594d0 0x7f24fc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc0cb1a0 0x7f24fc16e1b0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 --2- 172.21.15.26:0/2247660060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc0cf180 0x7f24fc169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 >> 172.21.15.26:0/2247660060 conn(0x7f24fc0703a0 msgr2=0x7f24fc0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 shutdown_connections 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:47.877+0000 7f2501451700 1 -- 172.21.15.26:0/2247660060 wait complete. 2023-10-09T11:42:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:47.890 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T11:42:47.214249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425836,"kb_used_data":14764,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548884,"statfs":{"total":773094113280,"available":770610057216,"internally_reserved":0,"allocated":15118336,"data_stored":7388220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.473328"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795459+0000","last_change":"2023-10-09T11:42:43.791792+0000","last_active":"2023-10-09T11:42:43.795459+0000","last_peered":"2023-10-09T11:42:43.795459+0000","last_clean":"2023-10-09T11:42:43.795459+0000","last_became_active":"2023-10-09T11:42:43.791532+0000","last_became_peered":"2023-10-09T11:42:43.791532+0000","last_unstale":"2023-10-09T11:42:43.795459+0000","last_undegraded":"2023-10-09T11:42:43.795459+0000","last_fullsized":"2023-10-09T11:42:43.795459+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:58.096668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789391+0000","last_change":"2023-10-09T11:42:43.786691+0000","last_active":"2023-10-09T11:42:43.789391+0000","last_peered":"2023-10-09T11:42:43.789391+0000","last_clean":"2023-10-09T11:42:43.789391+0000","last_became_active":"2023-10-09T11:42:43.786381+0000","last_became_peered":"2023-10-09T11:42:43.786381+0000","last_unstale":"2023-10-09T11:42:43.789391+0000","last_undegraded":"2023-10-09T11:42:43.789391+0000","last_fullsized":"2023-10-09T11:42:43.789391+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.370383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780006+0000","last_change":"2023-10-09T11:42:43.780006+0000","last_active":"2023-10-09T11:42:43.780006+0000","last_peered":"2023-10-09T11:42:43.780006+0000","last_clean":"2023-10-09T11:42:43.780006+0000","last_became_active":"2023-10-09T11:42:43.779736+0000","last_became_peered":"2023-10-09T11:42:43.779736+0000","last_unstale":"2023-10-09T11:42:43.780006+0000","last_undegraded":"2023-10-09T11:42:43.780006+0000","last_fullsized":"2023-10-09T11:42:43.780006+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:46.145162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789154+0000","last_change":"2023-10-09T11:42:43.786657+0000","last_active":"2023-10-09T11:42:43.789154+0000","last_peered":"2023-10-09T11:42:43.789154+0000","last_clean":"2023-10-09T11:42:43.789154+0000","last_became_active":"2023-10-09T11:42:43.786341+0000","last_became_peered":"2023-10-09T11:42:43.786341+0000","last_unstale":"2023-10-09T11:42:43.789154+0000","last_undegraded":"2023-10-09T11:42:43.789154+0000","last_fullsized":"2023-10-09T11:42:43.789154+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:25.674671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789410+0000","last_change":"2023-10-09T11:42:43.789410+0000","last_active":"2023-10-09T11:42:43.789410+0000","last_peered":"2023-10-09T11:42:43.789410+0000","last_clean":"2023-10-09T11:42:43.789410+0000","last_became_active":"2023-10-09T11:42:43.789029+0000","last_became_peered":"2023-10-09T11:42:43.789029+0000","last_unstale":"2023-10-09T11:42:43.789410+0000","last_undegraded":"2023-10-09T11:42:43.789410+0000","last_fullsized":"2023-10-09T11:42:43.789410+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:18.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791903+0000","last_change":"2023-10-09T11:42:43.791903+0000","last_active":"2023-10-09T11:42:43.791903+0000","last_peered":"2023-10-09T11:42:43.791903+0000","last_clean":"2023-10-09T11:42:43.791903+0000","last_became_active":"2023-10-09T11:42:43.791411+0000","last_became_peered":"2023-10-09T11:42:43.791411+0000","last_unstale":"2023-10-09T11:42:43.791903+0000","last_undegraded":"2023-10-09T11:42:43.791903+0000","last_fullsized":"2023-10-09T11:42:43.791903+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:26.690398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795506+0000","last_change":"2023-10-09T11:42:43.790328+0000","last_active":"2023-10-09T11:42:43.795506+0000","last_peered":"2023-10-09T11:42:43.795506+0000","last_clean":"2023-10-09T11:42:43.795506+0000","last_became_active":"2023-10-09T11:42:43.790024+0000","last_became_peered":"2023-10-09T11:42:43.790024+0000","last_unstale":"2023-10-09T11:42:43.795506+0000","last_undegraded":"2023-10-09T11:42:43.795506+0000","last_fullsized":"2023-10-09T11:42:43.795506+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:38.448732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786994+0000","last_change":"2023-10-09T11:42:43.783975+0000","last_active":"2023-10-09T11:42:43.786994+0000","last_peered":"2023-10-09T11:42:43.786994+0000","last_clean":"2023-10-09T11:42:43.786994+0000","last_became_active":"2023-10-09T11:42:43.783198+0000","last_became_peered":"2023-10-09T11:42:43.783198+0000","last_unstale":"2023-10-09T11:42:43.786994+0000","last_undegraded":"2023-10-09T11:42:43.786994+0000","last_fullsized":"2023-10-09T11:42:43.786994+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.819788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787558+0000","last_change":"2023-10-09T11:42:43.782810+0000","last_active":"2023-10-09T11:42:43.787558+0000","last_peered":"2023-10-09T11:42:43.787558+0000","last_clean":"2023-10-09T11:42:43.787558+0000","last_became_active":"2023-10-09T11:42:43.782529+0000","last_became_peered":"2023-10-09T11:42:43.782529+0000","last_unstale":"2023-10-09T11:42:43.787558+0000","last_undegraded":"2023-10-09T11:42:43.787558+0000","last_fullsized":"2023-10-09T11:42:43.787558+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:44.199394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.783363+0000","last_change":"2023-10-09T11:42:43.783363+0000","last_active":"2023-10-09T11:42:43.783363+0000","last_peered":"2023-10-09T11:42:43.783363+0000","last_clean":"2023-10-09T11:42:43.783363+0000","last_became_active":"2023-10-09T11:42:43.783069+0000","last_became_peered":"2023-10-09T11:42:43.783069+0000","last_unstale":"2023-10-09T11:42:43.783363+0000","last_undegraded":"2023-10-09T11:42:43.783363+0000","last_fullsized":"2023-10-09T11:42:43.783363+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796485+0000","last_change":"2023-10-09T11:42:43.791680+0000","last_active":"2023-10-09T11:42:43.796485+0000","last_peered":"2023-10-09T11:42:43.796485+0000","last_clean":"2023-10-09T11:42:43.796485+0000","last_became_active":"2023-10-09T11:42:43.791402+0000","last_became_peered":"2023-10-09T11:42:43.791402+0000","last_unstale":"2023-10-09T11:42:43.796485+0000","last_undegraded":"2023-10-09T11:42:43.796485+0000","last_fullsized":"2023-10-09T11:42:43.796485+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:19.221844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799119+0000","last_change":"2023-10-09T11:42:43.792311+0000","last_active":"2023-10-09T11:42:43.799119+0000","last_peered":"2023-10-09T11:42:43.799119+0000","last_clean":"2023-10-09T11:42:43.799119+0000","last_became_active":"2023-10-09T11:42:43.792008+0000","last_became_peered":"2023-10-09T11:42:43.792008+0000","last_unstale":"2023-10-09T11:42:43.799119+0000","last_undegraded":"2023-10-09T11:42:43.799119+0000","last_fullsized":"2023-10-09T11:42:43.799119+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:48.348978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789526+0000","last_change":"2023-10-09T11:42:43.784968+0000","last_active":"2023-10-09T11:42:43.789526+0000","last_peered":"2023-10-09T11:42:43.789526+0000","last_clean":"2023-10-09T11:42:43.789526+0000","last_became_active":"2023-10-09T11:42:43.784708+0000","last_became_peered":"2023-10-09T11:42:43.784708+0000","last_unstale":"2023-10-09T11:42:43.789526+0000","last_undegraded":"2023-10-09T11:42:43.789526+0000","last_fullsized":"2023-10-09T11:42:43.789526+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:16.002122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786176+0000","last_change":"2023-10-09T11:42:43.780415+0000","last_active":"2023-10-09T11:42:43.786176+0000","last_peered":"2023-10-09T11:42:43.786176+0000","last_clean":"2023-10-09T11:42:43.786176+0000","last_became_active":"2023-10-09T11:42:43.780159+0000","last_became_peered":"2023-10-09T11:42:43.780159+0000","last_unstale":"2023-10-09T11:42:43.786176+0000","last_undegraded":"2023-10-09T11:42:43.786176+0000","last_fullsized":"2023-10-09T11:42:43.786176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:03.102007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.798978+0000","last_change":"2023-10-09T11:42:43.792300+0000","last_active":"2023-10-09T11:42:43.798978+0000","last_peered":"2023-10-09T11:42:43.798978+0000","last_clean":"2023-10-09T11:42:43.798978+0000","last_became_active":"2023-10-09T11:42:43.792007+0000","last_became_peered":"2023-10-09T11:42:43.792007+0000","last_unstale":"2023-10-09T11:42:43.798978+0000","last_undegraded":"2023-10-09T11:42:43.798978+0000","last_fullsized":"2023-10-09T11:42:43.798978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:19.221844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786975+0000","last_change":"2023-10-09T11:42:43.783185+0000","last_active":"2023-10-09T11:42:43.786975+0000","last_peered":"2023-10-09T11:42:43.786975+0000","last_clean":"2023-10-09T11:42:43.786975+0000","last_became_active":"2023-10-09T11:42:43.782824+0000","last_became_peered":"2023-10-09T11:42:43.782824+0000","last_unstale":"2023-10-09T11:42:43.786975+0000","last_undegraded":"2023-10-09T11:42:43.786975+0000","last_fullsized":"2023-10-09T11:42:43.786975+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:50.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788516+0000","last_change":"2023-10-09T11:42:43.788516+0000","last_active":"2023-10-09T11:42:43.788516+0000","last_peered":"2023-10-09T11:42:43.788516+0000","last_clean":"2023-10-09T11:42:43.788516+0000","last_became_active":"2023-10-09T11:42:43.788206+0000","last_became_peered":"2023-10-09T11:42:43.788206+0000","last_unstale":"2023-10-09T11:42:43.788516+0000","last_undegraded":"2023-10-09T11:42:43.788516+0000","last_fullsized":"2023-10-09T11:42:43.788516+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:27.241678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.793212+0000","last_change":"2023-10-09T11:42:43.790935+0000","last_active":"2023-10-09T11:42:43.793212+0000","last_peered":"2023-10-09T11:42:43.793212+0000","last_clean":"2023-10-09T11:42:43.793212+0000","last_became_active":"2023-10-09T11:42:43.790642+0000","last_became_peered":"2023-10-09T11:42:43.790642+0000","last_unstale":"2023-10-09T11:42:43.793212+0000","last_undegraded":"2023-10-09T11:42:43.793212+0000","last_fullsized":"2023-10-09T11:42:43.793212+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:38.948704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780196+0000","last_change":"2023-10-09T11:42:43.780196+0000","last_active":"2023-10-09T11:42:43.780196+0000","last_peered":"2023-10-09T11:42:43.780196+0000","last_clean":"2023-10-09T11:42:43.780196+0000","last_became_active":"2023-10-09T11:42:43.779934+0000","last_became_peered":"2023-10-09T11:42:43.779934+0000","last_unstale":"2023-10-09T11:42:43.780196+0000","last_undegraded":"2023-10-09T11:42:43.780196+0000","last_fullsized":"2023-10-09T11:42:43.780196+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:10.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789161+0000","last_change":"2023-10-09T11:42:43.789161+0000","last_active":"2023-10-09T11:42:43.789161+0000","last_peered":"2023-10-09T11:42:43.789161+0000","last_clean":"2023-10-09T11:42:43.789161+0000","last_became_active":"2023-10-09T11:42:43.788905+0000","last_became_peered":"2023-10-09T11:42:43.788905+0000","last_unstale":"2023-10-09T11:42:43.789161+0000","last_undegraded":"2023-10-09T11:42:43.789161+0000","last_fullsized":"2023-10-09T11:42:43.789161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:26.508731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788742+0000","last_change":"2023-10-09T11:42:43.788742+0000","last_active":"2023-10-09T11:42:43.788742+0000","last_peered":"2023-10-09T11:42:43.788742+0000","last_clean":"2023-10-09T11:42:43.788742+0000","last_became_active":"2023-10-09T11:42:43.788375+0000","last_became_peered":"2023-10-09T11:42:43.788375+0000","last_unstale":"2023-10-09T11:42:43.788742+0000","last_undegraded":"2023-10-09T11:42:43.788742+0000","last_fullsized":"2023-10-09T11:42:43.788742+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:24.163940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779582+0000","last_change":"2023-10-09T11:42:43.779582+0000","last_active":"2023-10-09T11:42:43.779582+0000","last_peered":"2023-10-09T11:42:43.779582+0000","last_clean":"2023-10-09T11:42:43.779582+0000","last_became_active":"2023-10-09T11:42:43.779315+0000","last_became_peered":"2023-10-09T11:42:43.779315+0000","last_unstale":"2023-10-09T11:42:43.779582+0000","last_undegraded":"2023-10-09T11:42:43.779582+0000","last_fullsized":"2023-10-09T11:42:43.779582+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:10.276631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782427+0000","last_change":"2023-10-09T11:42:43.782427+0000","last_active":"2023-10-09T11:42:43.782427+0000","last_peered":"2023-10-09T11:42:43.782427+0000","last_clean":"2023-10-09T11:42:43.782427+0000","last_became_active":"2023-10-09T11:42:43.782171+0000","last_became_peered":"2023-10-09T11:42:43.782171+0000","last_unstale":"2023-10-09T11:42:43.782427+0000","last_undegraded":"2023-10-09T11:42:43.782427+0000","last_fullsized":"2023-10-09T11:42:43.782427+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:24.859229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786020+0000","last_change":"2023-10-09T11:42:43.780732+0000","last_active":"2023-10-09T11:42:43.786020+0000","last_peered":"2023-10-09T11:42:43.786020+0000","last_clean":"2023-10-09T11:42:43.786020+0000","last_became_active":"2023-10-09T11:42:43.780396+0000","last_became_peered":"2023-10-09T11:42:43.780396+0000","last_unstale":"2023-10-09T11:42:43.786020+0000","last_undegraded":"2023-10-09T11:42:43.786020+0000","last_fullsized":"2023-10-09T11:42:43.786020+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:39.402168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791110+0000","last_change":"2023-10-09T11:42:43.788758+0000","last_active":"2023-10-09T11:42:43.791110+0000","last_peered":"2023-10-09T11:42:43.791110+0000","last_clean":"2023-10-09T11:42:43.791110+0000","last_became_active":"2023-10-09T11:42:43.788468+0000","last_became_peered":"2023-10-09T11:42:43.788468+0000","last_unstale":"2023-10-09T11:42:43.791110+0000","last_undegraded":"2023-10-09T11:42:43.791110+0000","last_fullsized":"2023-10-09T11:42:43.791110+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:38.077454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.792497+0000","last_change":"2023-10-09T11:42:43.788558+0000","last_active":"2023-10-09T11:42:43.792497+0000","last_peered":"2023-10-09T11:42:43.792497+0000","last_clean":"2023-10-09T11:42:43.792497+0000","last_became_active":"2023-10-09T11:42:43.788242+0000","last_became_peered":"2023-10-09T11:42:43.788242+0000","last_unstale":"2023-10-09T11:42:43.792497+0000","last_undegraded":"2023-10-09T11:42:43.792497+0000","last_fullsized":"2023-10-09T11:42:43.792497+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:37.827900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791565+0000","last_change":"2023-10-09T11:42:43.791565+0000","last_active":"2023-10-09T11:42:43.791565+0000","last_peered":"2023-10-09T11:42:43.791565+0000","last_clean":"2023-10-09T11:42:43.791565+0000","last_became_active":"2023-10-09T11:42:43.791309+0000","last_became_peered":"2023-10-09T11:42:43.791309+0000","last_unstale":"2023-10-09T11:42:43.791565+0000","last_undegraded":"2023-10-09T11:42:43.791565+0000","last_fullsized":"2023-10-09T11:42:43.791565+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:59.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782217+0000","last_change":"2023-10-09T11:42:43.782217+0000","last_active":"2023-10-09T11:42:43.782217+0000","last_peered":"2023-10-09T11:42:43.782217+0000","last_clean":"2023-10-09T11:42:43.782217+0000","last_became_active":"2023-10-09T11:42:43.781818+0000","last_became_peered":"2023-10-09T11:42:43.781818+0000","last_unstale":"2023-10-09T11:42:43.782217+0000","last_undegraded":"2023-10-09T11:42:43.782217+0000","last_fullsized":"2023-10-09T11:42:43.782217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.370383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799075+0000","last_change":"2023-10-09T11:42:43.793031+0000","last_active":"2023-10-09T11:42:43.799075+0000","last_peered":"2023-10-09T11:42:43.799075+0000","last_clean":"2023-10-09T11:42:43.799075+0000","last_became_active":"2023-10-09T11:42:43.792761+0000","last_became_peered":"2023-10-09T11:42:43.792761+0000","last_unstale":"2023-10-09T11:42:43.799075+0000","last_undegraded":"2023-10-09T11:42:43.799075+0000","last_fullsized":"2023-10-09T11:42:43.799075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:03.102007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796300+0000","last_change":"2023-10-09T11:42:43.794427+0000","last_active":"2023-10-09T11:42:43.796300+0000","last_peered":"2023-10-09T11:42:43.796300+0000","last_clean":"2023-10-09T11:42:43.796300+0000","last_became_active":"2023-10-09T11:42:43.794059+0000","last_became_peered":"2023-10-09T11:42:43.794059+0000","last_unstale":"2023-10-09T11:42:43.796300+0000","last_undegraded":"2023-10-09T11:42:43.796300+0000","last_fullsized":"2023-10-09T11:42:43.796300+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:20.533298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788115+0000","last_change":"2023-10-09T11:42:43.788115+0000","last_active":"2023-10-09T11:42:43.788115+0000","last_peered":"2023-10-09T11:42:43.788115+0000","last_clean":"2023-10-09T11:42:43.788115+0000","last_became_active":"2023-10-09T11:42:43.787841+0000","last_became_peered":"2023-10-09T11:42:43.787841+0000","last_unstale":"2023-10-09T11:42:43.788115+0000","last_undegraded":"2023-10-09T11:42:43.788115+0000","last_fullsized":"2023-10-09T11:42:43.788115+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:10.890359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784132+0000","last_change":"2023-10-09T11:42:43.784132+0000","last_active":"2023-10-09T11:42:43.784132+0000","last_peered":"2023-10-09T11:42:43.784132+0000","last_clean":"2023-10-09T11:42:43.784132+0000","last_became_active":"2023-10-09T11:42:43.783877+0000","last_became_peered":"2023-10-09T11:42:43.783877+0000","last_unstale":"2023-10-09T11:42:43.784132+0000","last_undegraded":"2023-10-09T11:42:43.784132+0000","last_fullsized":"2023-10-09T11:42:43.784132+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:10.058414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785848+0000","last_change":"2023-10-09T11:42:43.780990+0000","last_active":"2023-10-09T11:42:43.785848+0000","last_peered":"2023-10-09T11:42:43.785848+0000","last_clean":"2023-10-09T11:42:43.785848+0000","last_became_active":"2023-10-09T11:42:43.780683+0000","last_became_peered":"2023-10-09T11:42:43.780683+0000","last_unstale":"2023-10-09T11:42:43.785848+0000","last_undegraded":"2023-10-09T11:42:43.785848+0000","last_fullsized":"2023-10-09T11:42:43.785848+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:01.257367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800871+0000","last_change":"2023-10-09T11:42:42.759076+0000","last_active":"2023-10-09T11:42:43.800871+0000","last_peered":"2023-10-09T11:42:43.800871+0000","last_clean":"2023-10-09T11:42:43.800871+0000","last_became_active":"2023-10-09T11:42:42.758642+0000","last_became_peered":"2023-10-09T11:42:42.758642+0000","last_unstale":"2023-10-09T11:42:43.800871+0000","last_undegraded":"2023-10-09T11:42:43.800871+0000","last_fullsized":"2023-10-09T11:42:43.800871+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:31.834958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785847+0000","last_change":"2023-10-09T11:42:43.785847+0000","last_active":"2023-10-09T11:42:43.785847+0000","last_peered":"2023-10-09T11:42:43.785847+0000","last_clean":"2023-10-09T11:42:43.785847+0000","last_became_active":"2023-10-09T11:42:43.785351+0000","last_became_peered":"2023-10-09T11:42:43.785351+0000","last_unstale":"2023-10-09T11:42:43.785847+0000","last_undegraded":"2023-10-09T11:42:43.785847+0000","last_fullsized":"2023-10-09T11:42:43.785847+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:34.836630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800115+0000","last_change":"2023-10-09T11:42:42.757291+0000","last_active":"2023-10-09T11:42:43.800115+0000","last_peered":"2023-10-09T11:42:43.800115+0000","last_clean":"2023-10-09T11:42:43.800115+0000","last_became_active":"2023-10-09T11:42:42.756994+0000","last_became_peered":"2023-10-09T11:42:42.756994+0000","last_unstale":"2023-10-09T11:42:43.800115+0000","last_undegraded":"2023-10-09T11:42:43.800115+0000","last_fullsized":"2023-10-09T11:42:43.800115+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:26.236919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789872+0000","last_change":"2023-10-09T11:42:43.786470+0000","last_active":"2023-10-09T11:42:43.789872+0000","last_peered":"2023-10-09T11:42:43.789872+0000","last_clean":"2023-10-09T11:42:43.789872+0000","last_became_active":"2023-10-09T11:42:43.786088+0000","last_became_peered":"2023-10-09T11:42:43.786088+0000","last_unstale":"2023-10-09T11:42:43.789872+0000","last_undegraded":"2023-10-09T11:42:43.789872+0000","last_fullsized":"2023-10-09T11:42:43.789872+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:46.982136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800979+0000","last_change":"2023-10-09T11:42:42.763083+0000","last_active":"2023-10-09T11:42:43.800979+0000","last_peered":"2023-10-09T11:42:43.800979+0000","last_clean":"2023-10-09T11:42:43.800979+0000","last_became_active":"2023-10-09T11:42:42.762823+0000","last_became_peered":"2023-10-09T11:42:42.762823+0000","last_unstale":"2023-10-09T11:42:43.800979+0000","last_undegraded":"2023-10-09T11:42:43.800979+0000","last_fullsized":"2023-10-09T11:42:43.800979+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:02.097248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787467+0000","last_change":"2023-10-09T11:42:43.782977+0000","last_active":"2023-10-09T11:42:43.787467+0000","last_peered":"2023-10-09T11:42:43.787467+0000","last_clean":"2023-10-09T11:42:43.787467+0000","last_became_active":"2023-10-09T11:42:43.782673+0000","last_became_peered":"2023-10-09T11:42:43.782673+0000","last_unstale":"2023-10-09T11:42:43.787467+0000","last_undegraded":"2023-10-09T11:42:43.787467+0000","last_fullsized":"2023-10-09T11:42:43.787467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:20.901352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801089+0000","last_change":"2023-10-09T11:42:42.758261+0000","last_active":"2023-10-09T11:42:43.801089+0000","last_peered":"2023-10-09T11:42:43.801089+0000","last_clean":"2023-10-09T11:42:43.801089+0000","last_became_active":"2023-10-09T11:42:42.758004+0000","last_became_peered":"2023-10-09T11:42:42.758004+0000","last_unstale":"2023-10-09T11:42:43.801089+0000","last_undegraded":"2023-10-09T11:42:43.801089+0000","last_fullsized":"2023-10-09T11:42:43.801089+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779179+0000","last_change":"2023-10-09T11:42:43.779179+0000","last_active":"2023-10-09T11:42:43.779179+0000","last_peered":"2023-10-09T11:42:43.779179+0000","last_clean":"2023-10-09T11:42:43.779179+0000","last_became_active":"2023-10-09T11:42:43.778820+0000","last_became_peered":"2023-10-09T11:42:43.778820+0000","last_unstale":"2023-10-09T11:42:43.779179+0000","last_undegraded":"2023-10-09T11:42:43.779179+0000","last_fullsized":"2023-10-09T11:42:43.779179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:26.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780257+0000","last_change":"2023-10-09T11:42:42.763483+0000","last_active":"2023-10-09T11:42:43.780257+0000","last_peered":"2023-10-09T11:42:43.780257+0000","last_clean":"2023-10-09T11:42:43.780257+0000","last_became_active":"2023-10-09T11:42:42.763170+0000","last_became_peered":"2023-10-09T11:42:42.763170+0000","last_unstale":"2023-10-09T11:42:43.780257+0000","last_undegraded":"2023-10-09T11:42:43.780257+0000","last_fullsized":"2023-10-09T11:42:43.780257+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:00.151148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.790078+0000","last_change":"2023-10-09T11:42:43.787347+0000","last_active":"2023-10-09T11:42:43.790078+0000","last_peered":"2023-10-09T11:42:43.790078+0000","last_clean":"2023-10-09T11:42:43.790078+0000","last_became_active":"2023-10-09T11:42:43.787065+0000","last_became_peered":"2023-10-09T11:42:43.787065+0000","last_unstale":"2023-10-09T11:42:43.790078+0000","last_undegraded":"2023-10-09T11:42:43.790078+0000","last_fullsized":"2023-10-09T11:42:43.790078+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:26.305223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800919+0000","last_change":"2023-10-09T11:42:42.764509+0000","last_active":"2023-10-09T11:42:43.800919+0000","last_peered":"2023-10-09T11:42:43.800919+0000","last_clean":"2023-10-09T11:42:43.800919+0000","last_became_active":"2023-10-09T11:42:42.764193+0000","last_became_peered":"2023-10-09T11:42:42.764193+0000","last_unstale":"2023-10-09T11:42:43.800919+0000","last_undegraded":"2023-10-09T11:42:43.800919+0000","last_fullsized":"2023-10-09T11:42:43.800919+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:00.686209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796562+0000","last_change":"2023-10-09T11:42:43.791740+0000","last_active":"2023-10-09T11:42:43.796562+0000","last_peered":"2023-10-09T11:42:43.796562+0000","last_clean":"2023-10-09T11:42:43.796562+0000","last_became_active":"2023-10-09T11:42:43.791457+0000","last_became_peered":"2023-10-09T11:42:43.791457+0000","last_unstale":"2023-10-09T11:42:43.796562+0000","last_undegraded":"2023-10-09T11:42:43.796562+0000","last_fullsized":"2023-10-09T11:42:43.796562+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:12.260107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784894+0000","last_change":"2023-10-09T11:42:42.765643+0000","last_active":"2023-10-09T11:42:43.784894+0000","last_peered":"2023-10-09T11:42:43.784894+0000","last_clean":"2023-10-09T11:42:43.784894+0000","last_became_active":"2023-10-09T11:42:42.765433+0000","last_became_peered":"2023-10-09T11:42:42.765433+0000","last_unstale":"2023-10-09T11:42:43.784894+0000","last_undegraded":"2023-10-09T11:42:43.784894+0000","last_fullsized":"2023-10-09T11:42:43.784894+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:09.082647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787024+0000","last_change":"2023-10-09T11:42:43.787024+0000","last_active":"2023-10-09T11:42:43.787024+0000","last_peered":"2023-10-09T11:42:43.787024+0000","last_clean":"2023-10-09T11:42:43.787024+0000","last_became_active":"2023-10-09T11:42:43.786756+0000","last_became_peered":"2023-10-09T11:42:43.786756+0000","last_unstale":"2023-10-09T11:42:43.787024+0000","last_undegraded":"2023-10-09T11:42:43.787024+0000","last_fullsized":"2023-10-09T11:42:43.787024+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:32.149221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780633+0000","last_change":"2023-10-09T11:42:42.757331+0000","last_active":"2023-10-09T11:42:43.780633+0000","last_peered":"2023-10-09T11:42:43.780633+0000","last_clean":"2023-10-09T11:42:43.780633+0000","last_became_active":"2023-10-09T11:42:42.757032+0000","last_became_peered":"2023-10-09T11:42:42.757032+0000","last_unstale":"2023-10-09T11:42:43.780633+0000","last_undegraded":"2023-10-09T11:42:43.780633+0000","last_fullsized":"2023-10-09T11:42:43.780633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:25.503972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787968+0000","last_change":"2023-10-09T11:42:43.784748+0000","last_active":"2023-10-09T11:42:43.787968+0000","last_peered":"2023-10-09T11:42:43.787968+0000","last_clean":"2023-10-09T11:42:43.787968+0000","last_became_active":"2023-10-09T11:42:43.783873+0000","last_became_peered":"2023-10-09T11:42:43.783873+0000","last_unstale":"2023-10-09T11:42:43.787968+0000","last_undegraded":"2023-10-09T11:42:43.787968+0000","last_fullsized":"2023-10-09T11:42:43.787968+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:48:54.455598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.761922+0000","last_change":"2023-10-09T11:42:42.760180+0000","last_active":"2023-10-09T11:42:42.761922+0000","last_peered":"2023-10-09T11:42:42.761922+0000","last_clean":"2023-10-09T11:42:42.761922+0000","last_became_active":"2023-10-09T11:42:42.759868+0000","last_became_peered":"2023-10-09T11:42:42.759868+0000","last_unstale":"2023-10-09T11:42:42.761922+0000","last_undegraded":"2023-10-09T11:42:42.761922+0000","last_fullsized":"2023-10-09T11:42:42.761922+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:51.407774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791830+0000","last_change":"2023-10-09T11:42:43.787871+0000","last_active":"2023-10-09T11:42:43.791830+0000","last_peered":"2023-10-09T11:42:43.791830+0000","last_clean":"2023-10-09T11:42:43.791830+0000","last_became_active":"2023-10-09T11:42:43.787553+0000","last_became_peered":"2023-10-09T11:42:43.787553+0000","last_unstale":"2023-10-09T11:42:43.791830+0000","last_undegraded":"2023-10-09T11:42:43.791830+0000","last_fullsized":"2023-10-09T11:42:43.791830+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:16.370730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800687+0000","last_change":"2023-10-09T11:42:42.765825+0000","last_active":"2023-10-09T11:42:43.800687+0000","last_peered":"2023-10-09T11:42:43.800687+0000","last_clean":"2023-10-09T11:42:43.800687+0000","last_became_active":"2023-10-09T11:42:42.765550+0000","last_became_peered":"2023-10-09T11:42:42.765550+0000","last_unstale":"2023-10-09T11:42:43.800687+0000","last_undegraded":"2023-10-09T11:42:43.800687+0000","last_fullsized":"2023-10-09T11:42:43.800687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:16.710671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779418+0000","last_change":"2023-10-09T11:42:43.779418+0000","last_active":"2023-10-09T11:42:43.779418+0000","last_peered":"2023-10-09T11:42:43.779418+0000","last_clean":"2023-10-09T11:42:43.779418+0000","last_became_active":"2023-10-09T11:42:43.778966+0000","last_became_peered":"2023-10-09T11:42:43.778966+0000","last_unstale":"2023-10-09T11:42:43.779418+0000","last_undegraded":"2023-10-09T11:42:43.779418+0000","last_fullsized":"2023-10-09T11:42:43.779418+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:19.567673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800714+0000","last_change":"2023-10-09T11:42:42.762886+0000","last_active":"2023-10-09T11:42:43.800714+0000","last_peered":"2023-10-09T11:42:43.800714+0000","last_clean":"2023-10-09T11:42:43.800714+0000","last_became_active":"2023-10-09T11:42:42.762592+0000","last_became_peered":"2023-10-09T11:42:42.762592+0000","last_unstale":"2023-10-09T11:42:43.800714+0000","last_undegraded":"2023-10-09T11:42:43.800714+0000","last_fullsized":"2023-10-09T11:42:43.800714+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:28.928276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784539+0000","last_change":"2023-10-09T11:42:43.784539+0000","last_active":"2023-10-09T11:42:43.784539+0000","last_peered":"2023-10-09T11:42:43.784539+0000","last_clean":"2023-10-09T11:42:43.784539+0000","last_became_active":"2023-10-09T11:42:43.784243+0000","last_became_peered":"2023-10-09T11:42:43.784243+0000","last_unstale":"2023-10-09T11:42:43.784539+0000","last_undegraded":"2023-10-09T11:42:43.784539+0000","last_fullsized":"2023-10-09T11:42:43.784539+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:58.084169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.802875+0000","last_change":"2023-10-09T11:42:42.765633+0000","last_active":"2023-10-09T11:42:43.802875+0000","last_peered":"2023-10-09T11:42:43.802875+0000","last_clean":"2023-10-09T11:42:43.802875+0000","last_became_active":"2023-10-09T11:42:42.765343+0000","last_became_peered":"2023-10-09T11:42:42.765343+0000","last_unstale":"2023-10-09T11:42:43.802875+0000","last_undegraded":"2023-10-09T11:42:43.802875+0000","last_fullsized":"2023-10-09T11:42:43.802875+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.699823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791332+0000","last_change":"2023-10-09T11:42:43.788604+0000","last_active":"2023-10-09T11:42:43.791332+0000","last_peered":"2023-10-09T11:42:43.791332+0000","last_clean":"2023-10-09T11:42:43.791332+0000","last_became_active":"2023-10-09T11:42:43.788305+0000","last_became_peered":"2023-10-09T11:42:43.788305+0000","last_unstale":"2023-10-09T11:42:43.791332+0000","last_undegraded":"2023-10-09T11:42:43.791332+0000","last_fullsized":"2023-10-09T11:42:43.791332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:26.638220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.764025+0000","last_change":"2023-10-09T11:42:42.758856+0000","last_active":"2023-10-09T11:42:42.764025+0000","last_peered":"2023-10-09T11:42:42.764025+0000","last_clean":"2023-10-09T11:42:42.764025+0000","last_became_active":"2023-10-09T11:42:42.758558+0000","last_became_peered":"2023-10-09T11:42:42.758558+0000","last_unstale":"2023-10-09T11:42:42.764025+0000","last_undegraded":"2023-10-09T11:42:42.764025+0000","last_fullsized":"2023-10-09T11:42:42.764025+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:37.815029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786830+0000","last_change":"2023-10-09T11:42:43.781260+0000","last_active":"2023-10-09T11:42:43.786830+0000","last_peered":"2023-10-09T11:42:43.786830+0000","last_clean":"2023-10-09T11:42:43.786830+0000","last_became_active":"2023-10-09T11:42:43.780962+0000","last_became_peered":"2023-10-09T11:42:43.780962+0000","last_unstale":"2023-10-09T11:42:43.786830+0000","last_undegraded":"2023-10-09T11:42:43.786830+0000","last_fullsized":"2023-10-09T11:42:43.786830+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:16.002122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.773619+0000","last_change":"2023-10-09T11:42:42.752566+0000","last_active":"2023-10-09T11:42:43.773619+0000","last_peered":"2023-10-09T11:42:43.773619+0000","last_clean":"2023-10-09T11:42:43.773619+0000","last_became_active":"2023-10-09T11:42:42.752279+0000","last_became_peered":"2023-10-09T11:42:42.752279+0000","last_unstale":"2023-10-09T11:42:43.773619+0000","last_undegraded":"2023-10-09T11:42:43.773619+0000","last_fullsized":"2023-10-09T11:42:43.773619+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:29.188094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786382+0000","last_change":"2023-10-09T11:42:43.786382+0000","last_active":"2023-10-09T11:42:43.786382+0000","last_peered":"2023-10-09T11:42:43.786382+0000","last_clean":"2023-10-09T11:42:43.786382+0000","last_became_active":"2023-10-09T11:42:43.786098+0000","last_became_peered":"2023-10-09T11:42:43.786098+0000","last_unstale":"2023-10-09T11:42:43.786382+0000","last_undegraded":"2023-10-09T11:42:43.786382+0000","last_fullsized":"2023-10-09T11:42:43.786382+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:26.021366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"137'8","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.803405+0000","last_change":"2023-10-09T11:42:42.765590+0000","last_active":"2023-10-09T11:42:43.803405+0000","last_peered":"2023-10-09T11:42:43.803405+0000","last_clean":"2023-10-09T11:42:43.803405+0000","last_became_active":"2023-10-09T11:42:42.765333+0000","last_became_peered":"2023-10-09T11:42:42.765333+0000","last_unstale":"2023-10-09T11:42:43.803405+0000","last_undegraded":"2023-10-09T11:42:43.803405+0000","last_fullsized":"2023-10-09T11:42:43.803405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:13.493138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782800+0000","last_change":"2023-10-09T11:42:43.782800+0000","last_active":"2023-10-09T11:42:43.782800+0000","last_peered":"2023-10-09T11:42:43.782800+0000","last_clean":"2023-10-09T11:42:43.782800+0000","last_became_active":"2023-10-09T11:42:43.782488+0000","last_became_peered":"2023-10-09T11:42:43.782488+0000","last_unstale":"2023-10-09T11:42:43.782800+0000","last_undegraded":"2023-10-09T11:42:43.782800+0000","last_fullsized":"2023-10-09T11:42:43.782800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:51.325606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.774768+0000","last_change":"2023-10-09T11:42:42.763649+0000","last_active":"2023-10-09T11:42:43.774768+0000","last_peered":"2023-10-09T11:42:43.774768+0000","last_clean":"2023-10-09T11:42:43.774768+0000","last_became_active":"2023-10-09T11:42:42.763197+0000","last_became_peered":"2023-10-09T11:42:42.763197+0000","last_unstale":"2023-10-09T11:42:43.774768+0000","last_undegraded":"2023-10-09T11:42:43.774768+0000","last_fullsized":"2023-10-09T11:42:43.774768+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:30.295991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786124+0000","last_change":"2023-10-09T11:42:43.778517+0000","last_active":"2023-10-09T11:42:43.786124+0000","last_peered":"2023-10-09T11:42:43.786124+0000","last_clean":"2023-10-09T11:42:43.786124+0000","last_became_active":"2023-10-09T11:42:43.778257+0000","last_became_peered":"2023-10-09T11:42:43.778257+0000","last_unstale":"2023-10-09T11:42:43.786124+0000","last_undegraded":"2023-10-09T11:42:43.786124+0000","last_fullsized":"2023-10-09T11:42:43.786124+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:29.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801822+0000","last_change":"2023-10-09T11:42:42.757067+0000","last_active":"2023-10-09T11:42:43.801822+0000","last_peered":"2023-10-09T11:42:43.801822+0000","last_clean":"2023-10-09T11:42:43.801822+0000","last_became_active":"2023-10-09T11:42:42.756748+0000","last_became_peered":"2023-10-09T11:42:42.756748+0000","last_unstale":"2023-10-09T11:42:43.801822+0000","last_undegraded":"2023-10-09T11:42:43.801822+0000","last_fullsized":"2023-10-09T11:42:43.801822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:25.279514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796183+0000","last_change":"2023-10-09T11:42:43.791307+0000","last_active":"2023-10-09T11:42:43.796183+0000","last_peered":"2023-10-09T11:42:43.796183+0000","last_clean":"2023-10-09T11:42:43.796183+0000","last_became_active":"2023-10-09T11:42:43.791019+0000","last_became_peered":"2023-10-09T11:42:43.791019+0000","last_unstale":"2023-10-09T11:42:43.796183+0000","last_undegraded":"2023-10-09T11:42:43.796183+0000","last_fullsized":"2023-10-09T11:42:43.796183+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:12.091337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801727+0000","last_change":"2023-10-09T11:42:42.767031+0000","last_active":"2023-10-09T11:42:43.801727+0000","last_peered":"2023-10-09T11:42:43.801727+0000","last_clean":"2023-10-09T11:42:43.801727+0000","last_became_active":"2023-10-09T11:42:42.766801+0000","last_became_peered":"2023-10-09T11:42:42.766801+0000","last_unstale":"2023-10-09T11:42:43.801727+0000","last_undegraded":"2023-10-09T11:42:43.801727+0000","last_fullsized":"2023-10-09T11:42:43.801727+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:08.826070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789375+0000","last_change":"2023-10-09T11:42:43.786828+0000","last_active":"2023-10-09T11:42:43.789375+0000","last_peered":"2023-10-09T11:42:43.789375+0000","last_clean":"2023-10-09T11:42:43.789375+0000","last_became_active":"2023-10-09T11:42:43.786467+0000","last_became_peered":"2023-10-09T11:42:43.786467+0000","last_unstale":"2023-10-09T11:42:43.789375+0000","last_undegraded":"2023-10-09T11:42:43.789375+0000","last_fullsized":"2023-10-09T11:42:43.789375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:29.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780971+0000","last_change":"2023-10-09T11:42:42.759529+0000","last_active":"2023-10-09T11:42:43.780971+0000","last_peered":"2023-10-09T11:42:43.780971+0000","last_clean":"2023-10-09T11:42:43.780971+0000","last_became_active":"2023-10-09T11:42:42.759042+0000","last_became_peered":"2023-10-09T11:42:42.759042+0000","last_unstale":"2023-10-09T11:42:43.780971+0000","last_undegraded":"2023-10-09T11:42:43.780971+0000","last_fullsized":"2023-10-09T11:42:43.780971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.365624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785936+0000","last_change":"2023-10-09T11:42:43.785936+0000","last_active":"2023-10-09T11:42:43.785936+0000","last_peered":"2023-10-09T11:42:43.785936+0000","last_clean":"2023-10-09T11:42:43.785936+0000","last_became_active":"2023-10-09T11:42:43.785594+0000","last_became_peered":"2023-10-09T11:42:43.785594+0000","last_unstale":"2023-10-09T11:42:43.785936+0000","last_undegraded":"2023-10-09T11:42:43.785936+0000","last_fullsized":"2023-10-09T11:42:43.785936+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:40.584785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800271+0000","last_change":"2023-10-09T11:42:42.766079+0000","last_active":"2023-10-09T11:42:43.800271+0000","last_peered":"2023-10-09T11:42:43.800271+0000","last_clean":"2023-10-09T11:42:43.800271+0000","last_became_active":"2023-10-09T11:42:42.765787+0000","last_became_peered":"2023-10-09T11:42:42.765787+0000","last_unstale":"2023-10-09T11:42:43.800271+0000","last_undegraded":"2023-10-09T11:42:43.800271+0000","last_fullsized":"2023-10-09T11:42:43.800271+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:37.072695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791309+0000","last_change":"2023-10-09T11:42:43.788014+0000","last_active":"2023-10-09T11:42:43.791309+0000","last_peered":"2023-10-09T11:42:43.791309+0000","last_clean":"2023-10-09T11:42:43.791309+0000","last_became_active":"2023-10-09T11:42:43.787092+0000","last_became_peered":"2023-10-09T11:42:43.787092+0000","last_unstale":"2023-10-09T11:42:43.791309+0000","last_undegraded":"2023-10-09T11:42:43.791309+0000","last_fullsized":"2023-10-09T11:42:43.791309+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:38.077454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.761932+0000","last_change":"2023-10-09T11:42:42.760106+0000","last_active":"2023-10-09T11:42:42.761932+0000","last_peered":"2023-10-09T11:42:42.761932+0000","last_clean":"2023-10-09T11:42:42.761932+0000","last_became_active":"2023-10-09T11:42:42.759817+0000","last_became_peered":"2023-10-09T11:42:42.759817+0000","last_unstale":"2023-10-09T11:42:42.761932+0000","last_undegraded":"2023-10-09T11:42:42.761932+0000","last_fullsized":"2023-10-09T11:42:42.761932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:38.884090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799168+0000","last_change":"2023-10-09T11:42:43.793568+0000","last_active":"2023-10-09T11:42:43.799168+0000","last_peered":"2023-10-09T11:42:43.799168+0000","last_clean":"2023-10-09T11:42:43.799168+0000","last_became_active":"2023-10-09T11:42:43.793340+0000","last_became_peered":"2023-10-09T11:42:43.793340+0000","last_unstale":"2023-10-09T11:42:43.799168+0000","last_undegraded":"2023-10-09T11:42:43.799168+0000","last_fullsized":"2023-10-09T11:42:43.799168+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:26.638220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.767274+0000","last_change":"2023-10-09T11:42:42.766041+0000","last_active":"2023-10-09T11:42:42.767274+0000","last_peered":"2023-10-09T11:42:42.767274+0000","last_clean":"2023-10-09T11:42:42.767274+0000","last_became_active":"2023-10-09T11:42:42.765768+0000","last_became_peered":"2023-10-09T11:42:42.765768+0000","last_unstale":"2023-10-09T11:42:42.767274+0000","last_undegraded":"2023-10-09T11:42:42.767274+0000","last_fullsized":"2023-10-09T11:42:42.767274+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:47.344219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784692+0000","last_change":"2023-10-09T11:42:43.784692+0000","last_active":"2023-10-09T11:42:43.784692+0000","last_peered":"2023-10-09T11:42:43.784692+0000","last_clean":"2023-10-09T11:42:43.784692+0000","last_became_active":"2023-10-09T11:42:43.784435+0000","last_became_peered":"2023-10-09T11:42:43.784435+0000","last_unstale":"2023-10-09T11:42:43.784692+0000","last_undegraded":"2023-10-09T11:42:43.784692+0000","last_fullsized":"2023-10-09T11:42:43.784692+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:20.901352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772153+0000","last_change":"2023-10-09T11:42:42.760039+0000","last_active":"2023-10-09T11:42:43.772153+0000","last_peered":"2023-10-09T11:42:43.772153+0000","last_clean":"2023-10-09T11:42:43.772153+0000","last_became_active":"2023-10-09T11:42:42.759737+0000","last_became_peered":"2023-10-09T11:42:42.759737+0000","last_unstale":"2023-10-09T11:42:43.772153+0000","last_undegraded":"2023-10-09T11:42:43.772153+0000","last_fullsized":"2023-10-09T11:42:43.772153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:27.370388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782689+0000","last_change":"2023-10-09T11:42:43.782689+0000","last_active":"2023-10-09T11:42:43.782689+0000","last_peered":"2023-10-09T11:42:43.782689+0000","last_clean":"2023-10-09T11:42:43.782689+0000","last_became_active":"2023-10-09T11:42:43.782226+0000","last_became_peered":"2023-10-09T11:42:43.782226+0000","last_unstale":"2023-10-09T11:42:43.782689+0000","last_undegraded":"2023-10-09T11:42:43.782689+0000","last_fullsized":"2023-10-09T11:42:43.782689+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:44.199394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799913+0000","last_change":"2023-10-09T11:42:42.760012+0000","last_active":"2023-10-09T11:42:43.799913+0000","last_peered":"2023-10-09T11:42:43.799913+0000","last_clean":"2023-10-09T11:42:43.799913+0000","last_became_active":"2023-10-09T11:42:42.759689+0000","last_became_peered":"2023-10-09T11:42:42.759689+0000","last_unstale":"2023-10-09T11:42:43.799913+0000","last_undegraded":"2023-10-09T11:42:43.799913+0000","last_fullsized":"2023-10-09T11:42:43.799913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:29.188094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.792145+0000","last_change":"2023-10-09T11:42:43.792145+0000","last_active":"2023-10-09T11:42:43.792145+0000","last_peered":"2023-10-09T11:42:43.792145+0000","last_clean":"2023-10-09T11:42:43.792145+0000","last_became_active":"2023-10-09T11:42:43.791864+0000","last_became_peered":"2023-10-09T11:42:43.791864+0000","last_unstale":"2023-10-09T11:42:43.792145+0000","last_undegraded":"2023-10-09T11:42:43.792145+0000","last_fullsized":"2023-10-09T11:42:43.792145+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:57.794425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.769020+0000","last_change":"2023-10-09T11:42:42.764983+0000","last_active":"2023-10-09T11:42:42.769020+0000","last_peered":"2023-10-09T11:42:42.769020+0000","last_clean":"2023-10-09T11:42:42.769020+0000","last_became_active":"2023-10-09T11:42:42.764719+0000","last_became_peered":"2023-10-09T11:42:42.764719+0000","last_unstale":"2023-10-09T11:42:42.769020+0000","last_undegraded":"2023-10-09T11:42:42.769020+0000","last_fullsized":"2023-10-09T11:42:42.769020+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:56.847429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785690+0000","last_change":"2023-10-09T11:42:43.779811+0000","last_active":"2023-10-09T11:42:43.785690+0000","last_peered":"2023-10-09T11:42:43.785690+0000","last_clean":"2023-10-09T11:42:43.785690+0000","last_became_active":"2023-10-09T11:42:43.779527+0000","last_became_peered":"2023-10-09T11:42:43.779527+0000","last_unstale":"2023-10-09T11:42:43.785690+0000","last_undegraded":"2023-10-09T11:42:43.785690+0000","last_fullsized":"2023-10-09T11:42:43.785690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:09.799824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.769041+0000","last_change":"2023-10-09T11:42:42.766795+0000","last_active":"2023-10-09T11:42:42.769041+0000","last_peered":"2023-10-09T11:42:42.769041+0000","last_clean":"2023-10-09T11:42:42.769041+0000","last_became_active":"2023-10-09T11:42:42.766489+0000","last_became_peered":"2023-10-09T11:42:42.766489+0000","last_unstale":"2023-10-09T11:42:42.769041+0000","last_undegraded":"2023-10-09T11:42:42.769041+0000","last_fullsized":"2023-10-09T11:42:42.769041+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:39.634335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787516+0000","last_change":"2023-10-09T11:42:43.783048+0000","last_active":"2023-10-09T11:42:43.787516+0000","last_peered":"2023-10-09T11:42:43.787516+0000","last_clean":"2023-10-09T11:42:43.787516+0000","last_became_active":"2023-10-09T11:42:43.782764+0000","last_became_peered":"2023-10-09T11:42:43.782764+0000","last_unstale":"2023-10-09T11:42:43.787516+0000","last_undegraded":"2023-10-09T11:42:43.787516+0000","last_fullsized":"2023-10-09T11:42:43.787516+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:55.451733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.774714+0000","last_change":"2023-10-09T11:42:42.757001+0000","last_active":"2023-10-09T11:42:43.774714+0000","last_peered":"2023-10-09T11:42:43.774714+0000","last_clean":"2023-10-09T11:42:43.774714+0000","last_became_active":"2023-10-09T11:42:42.756755+0000","last_became_peered":"2023-10-09T11:42:42.756755+0000","last_unstale":"2023-10-09T11:42:43.774714+0000","last_undegraded":"2023-10-09T11:42:43.774714+0000","last_fullsized":"2023-10-09T11:42:43.774714+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:24.525564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795256+0000","last_change":"2023-10-09T11:42:43.791319+0000","last_active":"2023-10-09T11:42:43.795256+0000","last_peered":"2023-10-09T11:42:43.795256+0000","last_clean":"2023-10-09T11:42:43.795256+0000","last_became_active":"2023-10-09T11:42:43.790998+0000","last_became_peered":"2023-10-09T11:42:43.790998+0000","last_unstale":"2023-10-09T11:42:43.795256+0000","last_undegraded":"2023-10-09T11:42:43.795256+0000","last_fullsized":"2023-10-09T11:42:43.795256+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:03.008751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772151+0000","last_change":"2023-10-09T11:42:42.758482+0000","last_active":"2023-10-09T11:42:43.772151+0000","last_peered":"2023-10-09T11:42:43.772151+0000","last_clean":"2023-10-09T11:42:43.772151+0000","last_became_active":"2023-10-09T11:42:42.758248+0000","last_became_peered":"2023-10-09T11:42:42.758248+0000","last_unstale":"2023-10-09T11:42:43.772151+0000","last_undegraded":"2023-10-09T11:42:43.772151+0000","last_fullsized":"2023-10-09T11:42:43.772151+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795411+0000","last_change":"2023-10-09T11:42:43.792657+0000","last_active":"2023-10-09T11:42:43.795411+0000","last_peered":"2023-10-09T11:42:43.795411+0000","last_clean":"2023-10-09T11:42:43.795411+0000","last_became_active":"2023-10-09T11:42:43.792297+0000","last_became_peered":"2023-10-09T11:42:43.792297+0000","last_unstale":"2023-10-09T11:42:43.795411+0000","last_undegraded":"2023-10-09T11:42:43.795411+0000","last_fullsized":"2023-10-09T11:42:43.795411+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:36.396921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772651+0000","last_change":"2023-10-09T11:42:42.757150+0000","last_active":"2023-10-09T11:42:43.772651+0000","last_peered":"2023-10-09T11:42:43.772651+0000","last_clean":"2023-10-09T11:42:43.772651+0000","last_became_active":"2023-10-09T11:42:42.756878+0000","last_became_peered":"2023-10-09T11:42:42.756878+0000","last_unstale":"2023-10-09T11:42:43.772651+0000","last_undegraded":"2023-10-09T11:42:43.772651+0000","last_fullsized":"2023-10-09T11:42:43.772651+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787217+0000","last_change":"2023-10-09T11:42:43.782916+0000","last_active":"2023-10-09T11:42:43.787217+0000","last_peered":"2023-10-09T11:42:43.787217+0000","last_clean":"2023-10-09T11:42:43.787217+0000","last_became_active":"2023-10-09T11:42:43.782611+0000","last_became_peered":"2023-10-09T11:42:43.782611+0000","last_unstale":"2023-10-09T11:42:43.787217+0000","last_undegraded":"2023-10-09T11:42:43.787217+0000","last_fullsized":"2023-10-09T11:42:43.787217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:38.448732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.781243+0000","last_change":"2023-10-09T11:42:42.757346+0000","last_active":"2023-10-09T11:42:43.781243+0000","last_peered":"2023-10-09T11:42:43.781243+0000","last_clean":"2023-10-09T11:42:43.781243+0000","last_became_active":"2023-10-09T11:42:42.756398+0000","last_became_peered":"2023-10-09T11:42:42.756398+0000","last_unstale":"2023-10-09T11:42:43.781243+0000","last_undegraded":"2023-10-09T11:42:43.781243+0000","last_fullsized":"2023-10-09T11:42:43.781243+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788545+0000","last_change":"2023-10-09T11:42:43.788545+0000","last_active":"2023-10-09T11:42:43.788545+0000","last_peered":"2023-10-09T11:42:43.788545+0000","last_clean":"2023-10-09T11:42:43.788545+0000","last_became_active":"2023-10-09T11:42:43.788244+0000","last_became_peered":"2023-10-09T11:42:43.788244+0000","last_unstale":"2023-10-09T11:42:43.788545+0000","last_undegraded":"2023-10-09T11:42:43.788545+0000","last_fullsized":"2023-10-09T11:42:43.788545+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:04.898620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.767231+0000","last_change":"2023-10-09T11:42:42.766432+0000","last_active":"2023-10-09T11:42:42.767231+0000","last_peered":"2023-10-09T11:42:42.767231+0000","last_clean":"2023-10-09T11:42:42.767231+0000","last_became_active":"2023-10-09T11:42:42.766160+0000","last_became_peered":"2023-10-09T11:42:42.766160+0000","last_unstale":"2023-10-09T11:42:42.767231+0000","last_undegraded":"2023-10-09T11:42:42.767231+0000","last_fullsized":"2023-10-09T11:42:42.767231+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:24.669912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.783597+0000","last_change":"2023-10-09T11:42:43.783597+0000","last_active":"2023-10-09T11:42:43.783597+0000","last_peered":"2023-10-09T11:42:43.783597+0000","last_clean":"2023-10-09T11:42:43.783597+0000","last_became_active":"2023-10-09T11:42:43.783221+0000","last_became_peered":"2023-10-09T11:42:43.783221+0000","last_unstale":"2023-10-09T11:42:43.783597+0000","last_undegraded":"2023-10-09T11:42:43.783597+0000","last_fullsized":"2023-10-09T11:42:43.783597+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:10.341556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784903+0000","last_change":"2023-10-09T11:42:42.760261+0000","last_active":"2023-10-09T11:42:43.784903+0000","last_peered":"2023-10-09T11:42:43.784903+0000","last_clean":"2023-10-09T11:42:43.784903+0000","last_became_active":"2023-10-09T11:42:42.759761+0000","last_became_peered":"2023-10-09T11:42:42.759761+0000","last_unstale":"2023-10-09T11:42:43.784903+0000","last_undegraded":"2023-10-09T11:42:43.784903+0000","last_fullsized":"2023-10-09T11:42:43.784903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:42.344826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":258,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785714+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:42:43.785714+0000","last_peered":"2023-10-09T11:42:43.785714+0000","last_clean":"2023-10-09T11:42:43.785714+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:42:43.785714+0000","last_undegraded":"2023-10-09T11:42:43.785714+0000","last_fullsized":"2023-10-09T11:42:43.785714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542240,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1363473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.68000000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.77300000000000002,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":2.6160000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":5.9450000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.256},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.83299999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.90200000000000002},"min":{"1min":0.54600000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":8.9309999999999992},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.71099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58899999999999997,"15min":0.68200000000000005},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.3},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.749,"15min":1.163},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":1.1419999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.61499999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":1.369},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.64500000000000002},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.84199999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.47399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542240,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":779289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.73899999999999999,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.86499999999999999,"15min":1.153},"last":0.67600000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":0.81299999999999994},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.48299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.81200000000000006,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":1.1060000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.874},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.626},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":1.0069999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.93000000000000005},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":774537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.51000000000000001},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46500000000000002,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.73199999999999998},"min":{"1min":0.28100000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":11.06},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.374,"15min":0.90100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":15.933999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.76200000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.621,"5min":0.621,"15min":11.935},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.73699999999999999},"min":{"1min":0.29599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53500000000000003,"5min":0.76400000000000001,"15min":11.087},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.56000000000000005},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":5.0060000000000002},"last":0.39800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61899999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88800000000000001,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":1.528},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.94999999999999996},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85799999999999998,"5min":0.88400000000000001,"15min":10.939},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78900000000000003,"5min":0.996,"15min":4.9370000000000003},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.98399999999999999},"min":{"1min":0.40899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":10.975},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":1.012},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":1.0129999999999999},"min":{"1min":0.48799999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1363391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.51400000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.47399999999999998,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.54700000000000004},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.77000000000000002},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.371,"15min":0.81399999999999995},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.71499999999999997,"15min":12.589},"last":0.25}]},{"osd":3,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":1.6739999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.44900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":1.502},"last":0.29599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.63700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.446},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.66200000000000003},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.1970000000000001,"15min":1.278},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.67100000000000004},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.639},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.627,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.077,"5min":1.288,"15min":1.3149999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.038,"15min":1.5629999999999999},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":773667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.27700000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60999999999999999,"15min":1.272},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.75,"15min":0.75},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.65500000000000003,"5min":0.70299999999999996,"15min":1.246},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.443}]},{"osd":5,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":0.92700000000000005,"15min":2.1579999999999999},"last":0.372},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":1.286},"last":0.52400000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":3.843,"15min":3.843},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":1.3149999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.41499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":773195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.25900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54600000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.53800000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.88},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.73199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76900000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80400000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.502,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.871,"15min":0.873},"last":0.77500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542241,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":781379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":1.056},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.68000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73599999999999999,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80200000000000005,"5min":0.84499999999999997,"15min":1.234},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.58799999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.282},"last":0.878}]},{"osd":7,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.65600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.89500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542241,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":779289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.84899999999999998,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.98099999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.53500000000000003},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.621},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.95999999999999996},"last":0.622}]},{"osd":4,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:47.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.049+0000 7f54746bd700 1 Processor -- start 2023-10-09T11:42:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.049+0000 7f54746bd700 1 -- start start 2023-10-09T11:42:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.049+0000 7f54746bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f546c0cb5a0 0x7f546c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.049+0000 7f54746bd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c15ae40 con 0x7f546c0cd9e0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f54746bd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c15ab60 con 0x7f546c15a5d0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f54746bd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0d13f0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5472459700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f546c0cb5a0 0x7f546c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471c58700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f546c0cd9e0 0x7f546c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58512/0 (socket says 172.21.15.26:58512) 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471c58700 1 -- 172.21.15.26:0/3977068653 learned_addr learned my addr 172.21.15.26:0/3977068653 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5472459700 1 -- 172.21.15.26:0/3977068653 >> v1:172.21.15.67:6789/0 conn(0x7f546c15a5d0 legacy=0x7f546c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5472459700 1 -- 172.21.15.26:0/3977068653 >> v1:172.21.15.26:6789/0 conn(0x7f546c0cd9e0 legacy=0x7f546c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5472459700 1 -- 172.21.15.26:0/3977068653 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0ccf00 con 0x7f546c0cb5a0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471457700 1 -- 172.21.15.26:0/3977068653 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069539949 0 0) 0x7f546c15ae40 con 0x7f546c0cd9e0 2023-10-09T11:42:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5472459700 1 --2- 172.21.15.26:0/3977068653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c0cb970 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5464009910 tx=0x7f54640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb4366f39f328cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471457700 1 -- 172.21.15.26:0/3977068653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400b7e0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471457700 1 -- 172.21.15.26:0/3977068653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400b940 con 0x7f546c0cb5a0 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.050+0000 7f5471457700 1 -- 172.21.15.26:0/3977068653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400bce0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 -- 172.21.15.26:0/3977068653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 msgr2=0x7f546c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 --2- 172.21.15.26:0/3977068653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c0cb970 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5464009910 tx=0x7f54640091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 -- 172.21.15.26:0/3977068653 shutdown_connections 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 --2- 172.21.15.26:0/3977068653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c0cb970 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 -- 172.21.15.26:0/3977068653 >> 172.21.15.26:0/3977068653 conn(0x7f546c070e30 msgr2=0x7f546c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 -- 172.21.15.26:0/3977068653 shutdown_connections 2023-10-09T11:42:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.051+0000 7f54746bd700 1 -- 172.21.15.26:0/3977068653 wait complete. 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.052+0000 7f54746bd700 1 Processor -- start 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.052+0000 7f54746bd700 1 -- start start 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f546c0cd9e0 0x7f546c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f546c15a5d0 0x7f546c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c158120 con 0x7f546c0cb5a0 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c158f40 con 0x7f546c0cd9e0 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c158330 con 0x7f546c15a5d0 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48910/0 (socket says 172.21.15.26:48910) 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 -- 172.21.15.26:0/4121902693 learned_addr learned my addr 172.21.15.26:0/4121902693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 -- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f546c15a5d0 msgr2=0x7f546c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f546c15a5d0 0x7f546c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 -- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f546c0cd9e0 msgr2=0x7f546c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f546c0cd9e0 0x7f546c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 -- 172.21.15.26:0/4121902693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009420 con 0x7f546c0cb5a0 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f5472459700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f54640030c0 tx=0x7f5464016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464011dd0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5464020070 con 0x7f546c0cb5a0 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c158610 con 0x7f546c0cb5a0 2023-10-09T11:42:48.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546401b6a0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c158bd0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.054+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c04c3c0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.056+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5464022030 con 0x7f546c0cb5a0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.056+0000 7f546a7fc700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 0x7f54580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.056+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5464086c40 con 0x7f546c0cb5a0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.056+0000 7f5471c58700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 0x7f54580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.056+0000 7f5471c58700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 0x7f54580697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f54600011e0 tx=0x7f54600079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.061+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54640539e0 con 0x7f546c0cb5a0 2023-10-09T11:42:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.247+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f546c04c3c0 con 0x7f5458067320 2023-10-09T11:42:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.256+0000 7f546a7fc700 1 -- 172.21.15.26:0/4121902693 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289752 (secure 0 0 0) 0x7f546c04c3c0 con 0x7f5458067320 2023-10-09T11:42:48.260 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 msgr2=0x7f54580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 0x7f54580697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f54600011e0 tx=0x7f54600079d0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 msgr2=0x7f546c152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f54640030c0 tx=0x7f5464016000 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 shutdown_connections 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5458067320 0x7f54580697d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f546c15a5d0 0x7f546c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f546c0cb5a0 0x7f546c152820 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 --2- 172.21.15.26:0/4121902693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f546c0cd9e0 0x7f546c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 >> 172.21.15.26:0/4121902693 conn(0x7f546c070e30 msgr2=0x7f546c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 shutdown_connections 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.259+0000 7f54746bd700 1 -- 172.21.15.26:0/4121902693 wait complete. 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:42:48.271 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T11:42:47.214249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425836,"kb_used_data":14764,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548884,"statfs":{"total":773094113280,"available":770610057216,"internally_reserved":0,"allocated":15118336,"data_stored":7388220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.473328"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795459+0000","last_change":"2023-10-09T11:42:43.791792+0000","last_active":"2023-10-09T11:42:43.795459+0000","last_peered":"2023-10-09T11:42:43.795459+0000","last_clean":"2023-10-09T11:42:43.795459+0000","last_became_active":"2023-10-09T11:42:43.791532+0000","last_became_peered":"2023-10-09T11:42:43.791532+0000","last_unstale":"2023-10-09T11:42:43.795459+0000","last_undegraded":"2023-10-09T11:42:43.795459+0000","last_fullsized":"2023-10-09T11:42:43.795459+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:58.096668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789391+0000","last_change":"2023-10-09T11:42:43.786691+0000","last_active":"2023-10-09T11:42:43.789391+0000","last_peered":"2023-10-09T11:42:43.789391+0000","last_clean":"2023-10-09T11:42:43.789391+0000","last_became_active":"2023-10-09T11:42:43.786381+0000","last_became_peered":"2023-10-09T11:42:43.786381+0000","last_unstale":"2023-10-09T11:42:43.789391+0000","last_undegraded":"2023-10-09T11:42:43.789391+0000","last_fullsized":"2023-10-09T11:42:43.789391+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.370383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780006+0000","last_change":"2023-10-09T11:42:43.780006+0000","last_active":"2023-10-09T11:42:43.780006+0000","last_peered":"2023-10-09T11:42:43.780006+0000","last_clean":"2023-10-09T11:42:43.780006+0000","last_became_active":"2023-10-09T11:42:43.779736+0000","last_became_peered":"2023-10-09T11:42:43.779736+0000","last_unstale":"2023-10-09T11:42:43.780006+0000","last_undegraded":"2023-10-09T11:42:43.780006+0000","last_fullsized":"2023-10-09T11:42:43.780006+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:46.145162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789154+0000","last_change":"2023-10-09T11:42:43.786657+0000","last_active":"2023-10-09T11:42:43.789154+0000","last_peered":"2023-10-09T11:42:43.789154+0000","last_clean":"2023-10-09T11:42:43.789154+0000","last_became_active":"2023-10-09T11:42:43.786341+0000","last_became_peered":"2023-10-09T11:42:43.786341+0000","last_unstale":"2023-10-09T11:42:43.789154+0000","last_undegraded":"2023-10-09T11:42:43.789154+0000","last_fullsized":"2023-10-09T11:42:43.789154+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:25.674671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789410+0000","last_change":"2023-10-09T11:42:43.789410+0000","last_active":"2023-10-09T11:42:43.789410+0000","last_peered":"2023-10-09T11:42:43.789410+0000","last_clean":"2023-10-09T11:42:43.789410+0000","last_became_active":"2023-10-09T11:42:43.789029+0000","last_became_peered":"2023-10-09T11:42:43.789029+0000","last_unstale":"2023-10-09T11:42:43.789410+0000","last_undegraded":"2023-10-09T11:42:43.789410+0000","last_fullsized":"2023-10-09T11:42:43.789410+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:18.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791903+0000","last_change":"2023-10-09T11:42:43.791903+0000","last_active":"2023-10-09T11:42:43.791903+0000","last_peered":"2023-10-09T11:42:43.791903+0000","last_clean":"2023-10-09T11:42:43.791903+0000","last_became_active":"2023-10-09T11:42:43.791411+0000","last_became_peered":"2023-10-09T11:42:43.791411+0000","last_unstale":"2023-10-09T11:42:43.791903+0000","last_undegraded":"2023-10-09T11:42:43.791903+0000","last_fullsized":"2023-10-09T11:42:43.791903+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:26.690398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795506+0000","last_change":"2023-10-09T11:42:43.790328+0000","last_active":"2023-10-09T11:42:43.795506+0000","last_peered":"2023-10-09T11:42:43.795506+0000","last_clean":"2023-10-09T11:42:43.795506+0000","last_became_active":"2023-10-09T11:42:43.790024+0000","last_became_peered":"2023-10-09T11:42:43.790024+0000","last_unstale":"2023-10-09T11:42:43.795506+0000","last_undegraded":"2023-10-09T11:42:43.795506+0000","last_fullsized":"2023-10-09T11:42:43.795506+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:38.448732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786994+0000","last_change":"2023-10-09T11:42:43.783975+0000","last_active":"2023-10-09T11:42:43.786994+0000","last_peered":"2023-10-09T11:42:43.786994+0000","last_clean":"2023-10-09T11:42:43.786994+0000","last_became_active":"2023-10-09T11:42:43.783198+0000","last_became_peered":"2023-10-09T11:42:43.783198+0000","last_unstale":"2023-10-09T11:42:43.786994+0000","last_undegraded":"2023-10-09T11:42:43.786994+0000","last_fullsized":"2023-10-09T11:42:43.786994+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.819788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787558+0000","last_change":"2023-10-09T11:42:43.782810+0000","last_active":"2023-10-09T11:42:43.787558+0000","last_peered":"2023-10-09T11:42:43.787558+0000","last_clean":"2023-10-09T11:42:43.787558+0000","last_became_active":"2023-10-09T11:42:43.782529+0000","last_became_peered":"2023-10-09T11:42:43.782529+0000","last_unstale":"2023-10-09T11:42:43.787558+0000","last_undegraded":"2023-10-09T11:42:43.787558+0000","last_fullsized":"2023-10-09T11:42:43.787558+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:44.199394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.783363+0000","last_change":"2023-10-09T11:42:43.783363+0000","last_active":"2023-10-09T11:42:43.783363+0000","last_peered":"2023-10-09T11:42:43.783363+0000","last_clean":"2023-10-09T11:42:43.783363+0000","last_became_active":"2023-10-09T11:42:43.783069+0000","last_became_peered":"2023-10-09T11:42:43.783069+0000","last_unstale":"2023-10-09T11:42:43.783363+0000","last_undegraded":"2023-10-09T11:42:43.783363+0000","last_fullsized":"2023-10-09T11:42:43.783363+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:30.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796485+0000","last_change":"2023-10-09T11:42:43.791680+0000","last_active":"2023-10-09T11:42:43.796485+0000","last_peered":"2023-10-09T11:42:43.796485+0000","last_clean":"2023-10-09T11:42:43.796485+0000","last_became_active":"2023-10-09T11:42:43.791402+0000","last_became_peered":"2023-10-09T11:42:43.791402+0000","last_unstale":"2023-10-09T11:42:43.796485+0000","last_undegraded":"2023-10-09T11:42:43.796485+0000","last_fullsized":"2023-10-09T11:42:43.796485+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:19.221844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799119+0000","last_change":"2023-10-09T11:42:43.792311+0000","last_active":"2023-10-09T11:42:43.799119+0000","last_peered":"2023-10-09T11:42:43.799119+0000","last_clean":"2023-10-09T11:42:43.799119+0000","last_became_active":"2023-10-09T11:42:43.792008+0000","last_became_peered":"2023-10-09T11:42:43.792008+0000","last_unstale":"2023-10-09T11:42:43.799119+0000","last_undegraded":"2023-10-09T11:42:43.799119+0000","last_fullsized":"2023-10-09T11:42:43.799119+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:48.348978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789526+0000","last_change":"2023-10-09T11:42:43.784968+0000","last_active":"2023-10-09T11:42:43.789526+0000","last_peered":"2023-10-09T11:42:43.789526+0000","last_clean":"2023-10-09T11:42:43.789526+0000","last_became_active":"2023-10-09T11:42:43.784708+0000","last_became_peered":"2023-10-09T11:42:43.784708+0000","last_unstale":"2023-10-09T11:42:43.789526+0000","last_undegraded":"2023-10-09T11:42:43.789526+0000","last_fullsized":"2023-10-09T11:42:43.789526+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:16.002122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786176+0000","last_change":"2023-10-09T11:42:43.780415+0000","last_active":"2023-10-09T11:42:43.786176+0000","last_peered":"2023-10-09T11:42:43.786176+0000","last_clean":"2023-10-09T11:42:43.786176+0000","last_became_active":"2023-10-09T11:42:43.780159+0000","last_became_peered":"2023-10-09T11:42:43.780159+0000","last_unstale":"2023-10-09T11:42:43.786176+0000","last_undegraded":"2023-10-09T11:42:43.786176+0000","last_fullsized":"2023-10-09T11:42:43.786176+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:03.102007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.798978+0000","last_change":"2023-10-09T11:42:43.792300+0000","last_active":"2023-10-09T11:42:43.798978+0000","last_peered":"2023-10-09T11:42:43.798978+0000","last_clean":"2023-10-09T11:42:43.798978+0000","last_became_active":"2023-10-09T11:42:43.792007+0000","last_became_peered":"2023-10-09T11:42:43.792007+0000","last_unstale":"2023-10-09T11:42:43.798978+0000","last_undegraded":"2023-10-09T11:42:43.798978+0000","last_fullsized":"2023-10-09T11:42:43.798978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:19.221844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786975+0000","last_change":"2023-10-09T11:42:43.783185+0000","last_active":"2023-10-09T11:42:43.786975+0000","last_peered":"2023-10-09T11:42:43.786975+0000","last_clean":"2023-10-09T11:42:43.786975+0000","last_became_active":"2023-10-09T11:42:43.782824+0000","last_became_peered":"2023-10-09T11:42:43.782824+0000","last_unstale":"2023-10-09T11:42:43.786975+0000","last_undegraded":"2023-10-09T11:42:43.786975+0000","last_fullsized":"2023-10-09T11:42:43.786975+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:50.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788516+0000","last_change":"2023-10-09T11:42:43.788516+0000","last_active":"2023-10-09T11:42:43.788516+0000","last_peered":"2023-10-09T11:42:43.788516+0000","last_clean":"2023-10-09T11:42:43.788516+0000","last_became_active":"2023-10-09T11:42:43.788206+0000","last_became_peered":"2023-10-09T11:42:43.788206+0000","last_unstale":"2023-10-09T11:42:43.788516+0000","last_undegraded":"2023-10-09T11:42:43.788516+0000","last_fullsized":"2023-10-09T11:42:43.788516+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:27.241678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.793212+0000","last_change":"2023-10-09T11:42:43.790935+0000","last_active":"2023-10-09T11:42:43.793212+0000","last_peered":"2023-10-09T11:42:43.793212+0000","last_clean":"2023-10-09T11:42:43.793212+0000","last_became_active":"2023-10-09T11:42:43.790642+0000","last_became_peered":"2023-10-09T11:42:43.790642+0000","last_unstale":"2023-10-09T11:42:43.793212+0000","last_undegraded":"2023-10-09T11:42:43.793212+0000","last_fullsized":"2023-10-09T11:42:43.793212+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:38.948704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780196+0000","last_change":"2023-10-09T11:42:43.780196+0000","last_active":"2023-10-09T11:42:43.780196+0000","last_peered":"2023-10-09T11:42:43.780196+0000","last_clean":"2023-10-09T11:42:43.780196+0000","last_became_active":"2023-10-09T11:42:43.779934+0000","last_became_peered":"2023-10-09T11:42:43.779934+0000","last_unstale":"2023-10-09T11:42:43.780196+0000","last_undegraded":"2023-10-09T11:42:43.780196+0000","last_fullsized":"2023-10-09T11:42:43.780196+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:10.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789161+0000","last_change":"2023-10-09T11:42:43.789161+0000","last_active":"2023-10-09T11:42:43.789161+0000","last_peered":"2023-10-09T11:42:43.789161+0000","last_clean":"2023-10-09T11:42:43.789161+0000","last_became_active":"2023-10-09T11:42:43.788905+0000","last_became_peered":"2023-10-09T11:42:43.788905+0000","last_unstale":"2023-10-09T11:42:43.789161+0000","last_undegraded":"2023-10-09T11:42:43.789161+0000","last_fullsized":"2023-10-09T11:42:43.789161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:26.508731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788742+0000","last_change":"2023-10-09T11:42:43.788742+0000","last_active":"2023-10-09T11:42:43.788742+0000","last_peered":"2023-10-09T11:42:43.788742+0000","last_clean":"2023-10-09T11:42:43.788742+0000","last_became_active":"2023-10-09T11:42:43.788375+0000","last_became_peered":"2023-10-09T11:42:43.788375+0000","last_unstale":"2023-10-09T11:42:43.788742+0000","last_undegraded":"2023-10-09T11:42:43.788742+0000","last_fullsized":"2023-10-09T11:42:43.788742+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:24.163940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779582+0000","last_change":"2023-10-09T11:42:43.779582+0000","last_active":"2023-10-09T11:42:43.779582+0000","last_peered":"2023-10-09T11:42:43.779582+0000","last_clean":"2023-10-09T11:42:43.779582+0000","last_became_active":"2023-10-09T11:42:43.779315+0000","last_became_peered":"2023-10-09T11:42:43.779315+0000","last_unstale":"2023-10-09T11:42:43.779582+0000","last_undegraded":"2023-10-09T11:42:43.779582+0000","last_fullsized":"2023-10-09T11:42:43.779582+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:10.276631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782427+0000","last_change":"2023-10-09T11:42:43.782427+0000","last_active":"2023-10-09T11:42:43.782427+0000","last_peered":"2023-10-09T11:42:43.782427+0000","last_clean":"2023-10-09T11:42:43.782427+0000","last_became_active":"2023-10-09T11:42:43.782171+0000","last_became_peered":"2023-10-09T11:42:43.782171+0000","last_unstale":"2023-10-09T11:42:43.782427+0000","last_undegraded":"2023-10-09T11:42:43.782427+0000","last_fullsized":"2023-10-09T11:42:43.782427+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:24.859229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786020+0000","last_change":"2023-10-09T11:42:43.780732+0000","last_active":"2023-10-09T11:42:43.786020+0000","last_peered":"2023-10-09T11:42:43.786020+0000","last_clean":"2023-10-09T11:42:43.786020+0000","last_became_active":"2023-10-09T11:42:43.780396+0000","last_became_peered":"2023-10-09T11:42:43.780396+0000","last_unstale":"2023-10-09T11:42:43.786020+0000","last_undegraded":"2023-10-09T11:42:43.786020+0000","last_fullsized":"2023-10-09T11:42:43.786020+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:39.402168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791110+0000","last_change":"2023-10-09T11:42:43.788758+0000","last_active":"2023-10-09T11:42:43.791110+0000","last_peered":"2023-10-09T11:42:43.791110+0000","last_clean":"2023-10-09T11:42:43.791110+0000","last_became_active":"2023-10-09T11:42:43.788468+0000","last_became_peered":"2023-10-09T11:42:43.788468+0000","last_unstale":"2023-10-09T11:42:43.791110+0000","last_undegraded":"2023-10-09T11:42:43.791110+0000","last_fullsized":"2023-10-09T11:42:43.791110+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:38.077454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.792497+0000","last_change":"2023-10-09T11:42:43.788558+0000","last_active":"2023-10-09T11:42:43.792497+0000","last_peered":"2023-10-09T11:42:43.792497+0000","last_clean":"2023-10-09T11:42:43.792497+0000","last_became_active":"2023-10-09T11:42:43.788242+0000","last_became_peered":"2023-10-09T11:42:43.788242+0000","last_unstale":"2023-10-09T11:42:43.792497+0000","last_undegraded":"2023-10-09T11:42:43.792497+0000","last_fullsized":"2023-10-09T11:42:43.792497+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:37.827900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791565+0000","last_change":"2023-10-09T11:42:43.791565+0000","last_active":"2023-10-09T11:42:43.791565+0000","last_peered":"2023-10-09T11:42:43.791565+0000","last_clean":"2023-10-09T11:42:43.791565+0000","last_became_active":"2023-10-09T11:42:43.791309+0000","last_became_peered":"2023-10-09T11:42:43.791309+0000","last_unstale":"2023-10-09T11:42:43.791565+0000","last_undegraded":"2023-10-09T11:42:43.791565+0000","last_fullsized":"2023-10-09T11:42:43.791565+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:59.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782217+0000","last_change":"2023-10-09T11:42:43.782217+0000","last_active":"2023-10-09T11:42:43.782217+0000","last_peered":"2023-10-09T11:42:43.782217+0000","last_clean":"2023-10-09T11:42:43.782217+0000","last_became_active":"2023-10-09T11:42:43.781818+0000","last_became_peered":"2023-10-09T11:42:43.781818+0000","last_unstale":"2023-10-09T11:42:43.782217+0000","last_undegraded":"2023-10-09T11:42:43.782217+0000","last_fullsized":"2023-10-09T11:42:43.782217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.370383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799075+0000","last_change":"2023-10-09T11:42:43.793031+0000","last_active":"2023-10-09T11:42:43.799075+0000","last_peered":"2023-10-09T11:42:43.799075+0000","last_clean":"2023-10-09T11:42:43.799075+0000","last_became_active":"2023-10-09T11:42:43.792761+0000","last_became_peered":"2023-10-09T11:42:43.792761+0000","last_unstale":"2023-10-09T11:42:43.799075+0000","last_undegraded":"2023-10-09T11:42:43.799075+0000","last_fullsized":"2023-10-09T11:42:43.799075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:03.102007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796300+0000","last_change":"2023-10-09T11:42:43.794427+0000","last_active":"2023-10-09T11:42:43.796300+0000","last_peered":"2023-10-09T11:42:43.796300+0000","last_clean":"2023-10-09T11:42:43.796300+0000","last_became_active":"2023-10-09T11:42:43.794059+0000","last_became_peered":"2023-10-09T11:42:43.794059+0000","last_unstale":"2023-10-09T11:42:43.796300+0000","last_undegraded":"2023-10-09T11:42:43.796300+0000","last_fullsized":"2023-10-09T11:42:43.796300+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:20.533298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788115+0000","last_change":"2023-10-09T11:42:43.788115+0000","last_active":"2023-10-09T11:42:43.788115+0000","last_peered":"2023-10-09T11:42:43.788115+0000","last_clean":"2023-10-09T11:42:43.788115+0000","last_became_active":"2023-10-09T11:42:43.787841+0000","last_became_peered":"2023-10-09T11:42:43.787841+0000","last_unstale":"2023-10-09T11:42:43.788115+0000","last_undegraded":"2023-10-09T11:42:43.788115+0000","last_fullsized":"2023-10-09T11:42:43.788115+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:10.890359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784132+0000","last_change":"2023-10-09T11:42:43.784132+0000","last_active":"2023-10-09T11:42:43.784132+0000","last_peered":"2023-10-09T11:42:43.784132+0000","last_clean":"2023-10-09T11:42:43.784132+0000","last_became_active":"2023-10-09T11:42:43.783877+0000","last_became_peered":"2023-10-09T11:42:43.783877+0000","last_unstale":"2023-10-09T11:42:43.784132+0000","last_undegraded":"2023-10-09T11:42:43.784132+0000","last_fullsized":"2023-10-09T11:42:43.784132+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:10.058414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785848+0000","last_change":"2023-10-09T11:42:43.780990+0000","last_active":"2023-10-09T11:42:43.785848+0000","last_peered":"2023-10-09T11:42:43.785848+0000","last_clean":"2023-10-09T11:42:43.785848+0000","last_became_active":"2023-10-09T11:42:43.780683+0000","last_became_peered":"2023-10-09T11:42:43.780683+0000","last_unstale":"2023-10-09T11:42:43.785848+0000","last_undegraded":"2023-10-09T11:42:43.785848+0000","last_fullsized":"2023-10-09T11:42:43.785848+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:01.257367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800871+0000","last_change":"2023-10-09T11:42:42.759076+0000","last_active":"2023-10-09T11:42:43.800871+0000","last_peered":"2023-10-09T11:42:43.800871+0000","last_clean":"2023-10-09T11:42:43.800871+0000","last_became_active":"2023-10-09T11:42:42.758642+0000","last_became_peered":"2023-10-09T11:42:42.758642+0000","last_unstale":"2023-10-09T11:42:43.800871+0000","last_undegraded":"2023-10-09T11:42:43.800871+0000","last_fullsized":"2023-10-09T11:42:43.800871+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:31.834958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785847+0000","last_change":"2023-10-09T11:42:43.785847+0000","last_active":"2023-10-09T11:42:43.785847+0000","last_peered":"2023-10-09T11:42:43.785847+0000","last_clean":"2023-10-09T11:42:43.785847+0000","last_became_active":"2023-10-09T11:42:43.785351+0000","last_became_peered":"2023-10-09T11:42:43.785351+0000","last_unstale":"2023-10-09T11:42:43.785847+0000","last_undegraded":"2023-10-09T11:42:43.785847+0000","last_fullsized":"2023-10-09T11:42:43.785847+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:34.836630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800115+0000","last_change":"2023-10-09T11:42:42.757291+0000","last_active":"2023-10-09T11:42:43.800115+0000","last_peered":"2023-10-09T11:42:43.800115+0000","last_clean":"2023-10-09T11:42:43.800115+0000","last_became_active":"2023-10-09T11:42:42.756994+0000","last_became_peered":"2023-10-09T11:42:42.756994+0000","last_unstale":"2023-10-09T11:42:43.800115+0000","last_undegraded":"2023-10-09T11:42:43.800115+0000","last_fullsized":"2023-10-09T11:42:43.800115+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:26.236919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789872+0000","last_change":"2023-10-09T11:42:43.786470+0000","last_active":"2023-10-09T11:42:43.789872+0000","last_peered":"2023-10-09T11:42:43.789872+0000","last_clean":"2023-10-09T11:42:43.789872+0000","last_became_active":"2023-10-09T11:42:43.786088+0000","last_became_peered":"2023-10-09T11:42:43.786088+0000","last_unstale":"2023-10-09T11:42:43.789872+0000","last_undegraded":"2023-10-09T11:42:43.789872+0000","last_fullsized":"2023-10-09T11:42:43.789872+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:46.982136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800979+0000","last_change":"2023-10-09T11:42:42.763083+0000","last_active":"2023-10-09T11:42:43.800979+0000","last_peered":"2023-10-09T11:42:43.800979+0000","last_clean":"2023-10-09T11:42:43.800979+0000","last_became_active":"2023-10-09T11:42:42.762823+0000","last_became_peered":"2023-10-09T11:42:42.762823+0000","last_unstale":"2023-10-09T11:42:43.800979+0000","last_undegraded":"2023-10-09T11:42:43.800979+0000","last_fullsized":"2023-10-09T11:42:43.800979+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:02.097248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787467+0000","last_change":"2023-10-09T11:42:43.782977+0000","last_active":"2023-10-09T11:42:43.787467+0000","last_peered":"2023-10-09T11:42:43.787467+0000","last_clean":"2023-10-09T11:42:43.787467+0000","last_became_active":"2023-10-09T11:42:43.782673+0000","last_became_peered":"2023-10-09T11:42:43.782673+0000","last_unstale":"2023-10-09T11:42:43.787467+0000","last_undegraded":"2023-10-09T11:42:43.787467+0000","last_fullsized":"2023-10-09T11:42:43.787467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:20.901352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801089+0000","last_change":"2023-10-09T11:42:42.758261+0000","last_active":"2023-10-09T11:42:43.801089+0000","last_peered":"2023-10-09T11:42:43.801089+0000","last_clean":"2023-10-09T11:42:43.801089+0000","last_became_active":"2023-10-09T11:42:42.758004+0000","last_became_peered":"2023-10-09T11:42:42.758004+0000","last_unstale":"2023-10-09T11:42:43.801089+0000","last_undegraded":"2023-10-09T11:42:43.801089+0000","last_fullsized":"2023-10-09T11:42:43.801089+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779179+0000","last_change":"2023-10-09T11:42:43.779179+0000","last_active":"2023-10-09T11:42:43.779179+0000","last_peered":"2023-10-09T11:42:43.779179+0000","last_clean":"2023-10-09T11:42:43.779179+0000","last_became_active":"2023-10-09T11:42:43.778820+0000","last_became_peered":"2023-10-09T11:42:43.778820+0000","last_unstale":"2023-10-09T11:42:43.779179+0000","last_undegraded":"2023-10-09T11:42:43.779179+0000","last_fullsized":"2023-10-09T11:42:43.779179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:26.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780257+0000","last_change":"2023-10-09T11:42:42.763483+0000","last_active":"2023-10-09T11:42:43.780257+0000","last_peered":"2023-10-09T11:42:43.780257+0000","last_clean":"2023-10-09T11:42:43.780257+0000","last_became_active":"2023-10-09T11:42:42.763170+0000","last_became_peered":"2023-10-09T11:42:42.763170+0000","last_unstale":"2023-10-09T11:42:43.780257+0000","last_undegraded":"2023-10-09T11:42:43.780257+0000","last_fullsized":"2023-10-09T11:42:43.780257+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:00.151148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.790078+0000","last_change":"2023-10-09T11:42:43.787347+0000","last_active":"2023-10-09T11:42:43.790078+0000","last_peered":"2023-10-09T11:42:43.790078+0000","last_clean":"2023-10-09T11:42:43.790078+0000","last_became_active":"2023-10-09T11:42:43.787065+0000","last_became_peered":"2023-10-09T11:42:43.787065+0000","last_unstale":"2023-10-09T11:42:43.790078+0000","last_undegraded":"2023-10-09T11:42:43.790078+0000","last_fullsized":"2023-10-09T11:42:43.790078+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:26.305223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800919+0000","last_change":"2023-10-09T11:42:42.764509+0000","last_active":"2023-10-09T11:42:43.800919+0000","last_peered":"2023-10-09T11:42:43.800919+0000","last_clean":"2023-10-09T11:42:43.800919+0000","last_became_active":"2023-10-09T11:42:42.764193+0000","last_became_peered":"2023-10-09T11:42:42.764193+0000","last_unstale":"2023-10-09T11:42:43.800919+0000","last_undegraded":"2023-10-09T11:42:43.800919+0000","last_fullsized":"2023-10-09T11:42:43.800919+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:00.686209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796562+0000","last_change":"2023-10-09T11:42:43.791740+0000","last_active":"2023-10-09T11:42:43.796562+0000","last_peered":"2023-10-09T11:42:43.796562+0000","last_clean":"2023-10-09T11:42:43.796562+0000","last_became_active":"2023-10-09T11:42:43.791457+0000","last_became_peered":"2023-10-09T11:42:43.791457+0000","last_unstale":"2023-10-09T11:42:43.796562+0000","last_undegraded":"2023-10-09T11:42:43.796562+0000","last_fullsized":"2023-10-09T11:42:43.796562+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:12.260107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784894+0000","last_change":"2023-10-09T11:42:42.765643+0000","last_active":"2023-10-09T11:42:43.784894+0000","last_peered":"2023-10-09T11:42:43.784894+0000","last_clean":"2023-10-09T11:42:43.784894+0000","last_became_active":"2023-10-09T11:42:42.765433+0000","last_became_peered":"2023-10-09T11:42:42.765433+0000","last_unstale":"2023-10-09T11:42:43.784894+0000","last_undegraded":"2023-10-09T11:42:43.784894+0000","last_fullsized":"2023-10-09T11:42:43.784894+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:09.082647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787024+0000","last_change":"2023-10-09T11:42:43.787024+0000","last_active":"2023-10-09T11:42:43.787024+0000","last_peered":"2023-10-09T11:42:43.787024+0000","last_clean":"2023-10-09T11:42:43.787024+0000","last_became_active":"2023-10-09T11:42:43.786756+0000","last_became_peered":"2023-10-09T11:42:43.786756+0000","last_unstale":"2023-10-09T11:42:43.787024+0000","last_undegraded":"2023-10-09T11:42:43.787024+0000","last_fullsized":"2023-10-09T11:42:43.787024+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:32.149221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780633+0000","last_change":"2023-10-09T11:42:42.757331+0000","last_active":"2023-10-09T11:42:43.780633+0000","last_peered":"2023-10-09T11:42:43.780633+0000","last_clean":"2023-10-09T11:42:43.780633+0000","last_became_active":"2023-10-09T11:42:42.757032+0000","last_became_peered":"2023-10-09T11:42:42.757032+0000","last_unstale":"2023-10-09T11:42:43.780633+0000","last_undegraded":"2023-10-09T11:42:43.780633+0000","last_fullsized":"2023-10-09T11:42:43.780633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:25.503972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787968+0000","last_change":"2023-10-09T11:42:43.784748+0000","last_active":"2023-10-09T11:42:43.787968+0000","last_peered":"2023-10-09T11:42:43.787968+0000","last_clean":"2023-10-09T11:42:43.787968+0000","last_became_active":"2023-10-09T11:42:43.783873+0000","last_became_peered":"2023-10-09T11:42:43.783873+0000","last_unstale":"2023-10-09T11:42:43.787968+0000","last_undegraded":"2023-10-09T11:42:43.787968+0000","last_fullsized":"2023-10-09T11:42:43.787968+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:48:54.455598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.761922+0000","last_change":"2023-10-09T11:42:42.760180+0000","last_active":"2023-10-09T11:42:42.761922+0000","last_peered":"2023-10-09T11:42:42.761922+0000","last_clean":"2023-10-09T11:42:42.761922+0000","last_became_active":"2023-10-09T11:42:42.759868+0000","last_became_peered":"2023-10-09T11:42:42.759868+0000","last_unstale":"2023-10-09T11:42:42.761922+0000","last_undegraded":"2023-10-09T11:42:42.761922+0000","last_fullsized":"2023-10-09T11:42:42.761922+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:51.407774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791830+0000","last_change":"2023-10-09T11:42:43.787871+0000","last_active":"2023-10-09T11:42:43.791830+0000","last_peered":"2023-10-09T11:42:43.791830+0000","last_clean":"2023-10-09T11:42:43.791830+0000","last_became_active":"2023-10-09T11:42:43.787553+0000","last_became_peered":"2023-10-09T11:42:43.787553+0000","last_unstale":"2023-10-09T11:42:43.791830+0000","last_undegraded":"2023-10-09T11:42:43.791830+0000","last_fullsized":"2023-10-09T11:42:43.791830+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:16.370730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800687+0000","last_change":"2023-10-09T11:42:42.765825+0000","last_active":"2023-10-09T11:42:43.800687+0000","last_peered":"2023-10-09T11:42:43.800687+0000","last_clean":"2023-10-09T11:42:43.800687+0000","last_became_active":"2023-10-09T11:42:42.765550+0000","last_became_peered":"2023-10-09T11:42:42.765550+0000","last_unstale":"2023-10-09T11:42:43.800687+0000","last_undegraded":"2023-10-09T11:42:43.800687+0000","last_fullsized":"2023-10-09T11:42:43.800687+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:16.710671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.779418+0000","last_change":"2023-10-09T11:42:43.779418+0000","last_active":"2023-10-09T11:42:43.779418+0000","last_peered":"2023-10-09T11:42:43.779418+0000","last_clean":"2023-10-09T11:42:43.779418+0000","last_became_active":"2023-10-09T11:42:43.778966+0000","last_became_peered":"2023-10-09T11:42:43.778966+0000","last_unstale":"2023-10-09T11:42:43.779418+0000","last_undegraded":"2023-10-09T11:42:43.779418+0000","last_fullsized":"2023-10-09T11:42:43.779418+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:19.567673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800714+0000","last_change":"2023-10-09T11:42:42.762886+0000","last_active":"2023-10-09T11:42:43.800714+0000","last_peered":"2023-10-09T11:42:43.800714+0000","last_clean":"2023-10-09T11:42:43.800714+0000","last_became_active":"2023-10-09T11:42:42.762592+0000","last_became_peered":"2023-10-09T11:42:42.762592+0000","last_unstale":"2023-10-09T11:42:43.800714+0000","last_undegraded":"2023-10-09T11:42:43.800714+0000","last_fullsized":"2023-10-09T11:42:43.800714+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:28.928276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784539+0000","last_change":"2023-10-09T11:42:43.784539+0000","last_active":"2023-10-09T11:42:43.784539+0000","last_peered":"2023-10-09T11:42:43.784539+0000","last_clean":"2023-10-09T11:42:43.784539+0000","last_became_active":"2023-10-09T11:42:43.784243+0000","last_became_peered":"2023-10-09T11:42:43.784243+0000","last_unstale":"2023-10-09T11:42:43.784539+0000","last_undegraded":"2023-10-09T11:42:43.784539+0000","last_fullsized":"2023-10-09T11:42:43.784539+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:58.084169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.802875+0000","last_change":"2023-10-09T11:42:42.765633+0000","last_active":"2023-10-09T11:42:43.802875+0000","last_peered":"2023-10-09T11:42:43.802875+0000","last_clean":"2023-10-09T11:42:43.802875+0000","last_became_active":"2023-10-09T11:42:42.765343+0000","last_became_peered":"2023-10-09T11:42:42.765343+0000","last_unstale":"2023-10-09T11:42:43.802875+0000","last_undegraded":"2023-10-09T11:42:43.802875+0000","last_fullsized":"2023-10-09T11:42:43.802875+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.699823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791332+0000","last_change":"2023-10-09T11:42:43.788604+0000","last_active":"2023-10-09T11:42:43.791332+0000","last_peered":"2023-10-09T11:42:43.791332+0000","last_clean":"2023-10-09T11:42:43.791332+0000","last_became_active":"2023-10-09T11:42:43.788305+0000","last_became_peered":"2023-10-09T11:42:43.788305+0000","last_unstale":"2023-10-09T11:42:43.791332+0000","last_undegraded":"2023-10-09T11:42:43.791332+0000","last_fullsized":"2023-10-09T11:42:43.791332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:26.638220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.764025+0000","last_change":"2023-10-09T11:42:42.758856+0000","last_active":"2023-10-09T11:42:42.764025+0000","last_peered":"2023-10-09T11:42:42.764025+0000","last_clean":"2023-10-09T11:42:42.764025+0000","last_became_active":"2023-10-09T11:42:42.758558+0000","last_became_peered":"2023-10-09T11:42:42.758558+0000","last_unstale":"2023-10-09T11:42:42.764025+0000","last_undegraded":"2023-10-09T11:42:42.764025+0000","last_fullsized":"2023-10-09T11:42:42.764025+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:37.815029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786830+0000","last_change":"2023-10-09T11:42:43.781260+0000","last_active":"2023-10-09T11:42:43.786830+0000","last_peered":"2023-10-09T11:42:43.786830+0000","last_clean":"2023-10-09T11:42:43.786830+0000","last_became_active":"2023-10-09T11:42:43.780962+0000","last_became_peered":"2023-10-09T11:42:43.780962+0000","last_unstale":"2023-10-09T11:42:43.786830+0000","last_undegraded":"2023-10-09T11:42:43.786830+0000","last_fullsized":"2023-10-09T11:42:43.786830+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:16.002122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.773619+0000","last_change":"2023-10-09T11:42:42.752566+0000","last_active":"2023-10-09T11:42:43.773619+0000","last_peered":"2023-10-09T11:42:43.773619+0000","last_clean":"2023-10-09T11:42:43.773619+0000","last_became_active":"2023-10-09T11:42:42.752279+0000","last_became_peered":"2023-10-09T11:42:42.752279+0000","last_unstale":"2023-10-09T11:42:43.773619+0000","last_undegraded":"2023-10-09T11:42:43.773619+0000","last_fullsized":"2023-10-09T11:42:43.773619+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:29.188094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786382+0000","last_change":"2023-10-09T11:42:43.786382+0000","last_active":"2023-10-09T11:42:43.786382+0000","last_peered":"2023-10-09T11:42:43.786382+0000","last_clean":"2023-10-09T11:42:43.786382+0000","last_became_active":"2023-10-09T11:42:43.786098+0000","last_became_peered":"2023-10-09T11:42:43.786098+0000","last_unstale":"2023-10-09T11:42:43.786382+0000","last_undegraded":"2023-10-09T11:42:43.786382+0000","last_fullsized":"2023-10-09T11:42:43.786382+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:26.021366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"137'8","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.803405+0000","last_change":"2023-10-09T11:42:42.765590+0000","last_active":"2023-10-09T11:42:43.803405+0000","last_peered":"2023-10-09T11:42:43.803405+0000","last_clean":"2023-10-09T11:42:43.803405+0000","last_became_active":"2023-10-09T11:42:42.765333+0000","last_became_peered":"2023-10-09T11:42:42.765333+0000","last_unstale":"2023-10-09T11:42:43.803405+0000","last_undegraded":"2023-10-09T11:42:43.803405+0000","last_fullsized":"2023-10-09T11:42:43.803405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:13.493138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782800+0000","last_change":"2023-10-09T11:42:43.782800+0000","last_active":"2023-10-09T11:42:43.782800+0000","last_peered":"2023-10-09T11:42:43.782800+0000","last_clean":"2023-10-09T11:42:43.782800+0000","last_became_active":"2023-10-09T11:42:43.782488+0000","last_became_peered":"2023-10-09T11:42:43.782488+0000","last_unstale":"2023-10-09T11:42:43.782800+0000","last_undegraded":"2023-10-09T11:42:43.782800+0000","last_fullsized":"2023-10-09T11:42:43.782800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:51.325606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.774768+0000","last_change":"2023-10-09T11:42:42.763649+0000","last_active":"2023-10-09T11:42:43.774768+0000","last_peered":"2023-10-09T11:42:43.774768+0000","last_clean":"2023-10-09T11:42:43.774768+0000","last_became_active":"2023-10-09T11:42:42.763197+0000","last_became_peered":"2023-10-09T11:42:42.763197+0000","last_unstale":"2023-10-09T11:42:43.774768+0000","last_undegraded":"2023-10-09T11:42:43.774768+0000","last_fullsized":"2023-10-09T11:42:43.774768+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:30.295991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.786124+0000","last_change":"2023-10-09T11:42:43.778517+0000","last_active":"2023-10-09T11:42:43.786124+0000","last_peered":"2023-10-09T11:42:43.786124+0000","last_clean":"2023-10-09T11:42:43.786124+0000","last_became_active":"2023-10-09T11:42:43.778257+0000","last_became_peered":"2023-10-09T11:42:43.778257+0000","last_unstale":"2023-10-09T11:42:43.786124+0000","last_undegraded":"2023-10-09T11:42:43.786124+0000","last_fullsized":"2023-10-09T11:42:43.786124+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:29.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801822+0000","last_change":"2023-10-09T11:42:42.757067+0000","last_active":"2023-10-09T11:42:43.801822+0000","last_peered":"2023-10-09T11:42:43.801822+0000","last_clean":"2023-10-09T11:42:43.801822+0000","last_became_active":"2023-10-09T11:42:42.756748+0000","last_became_peered":"2023-10-09T11:42:42.756748+0000","last_unstale":"2023-10-09T11:42:43.801822+0000","last_undegraded":"2023-10-09T11:42:43.801822+0000","last_fullsized":"2023-10-09T11:42:43.801822+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:25.279514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.796183+0000","last_change":"2023-10-09T11:42:43.791307+0000","last_active":"2023-10-09T11:42:43.796183+0000","last_peered":"2023-10-09T11:42:43.796183+0000","last_clean":"2023-10-09T11:42:43.796183+0000","last_became_active":"2023-10-09T11:42:43.791019+0000","last_became_peered":"2023-10-09T11:42:43.791019+0000","last_unstale":"2023-10-09T11:42:43.796183+0000","last_undegraded":"2023-10-09T11:42:43.796183+0000","last_fullsized":"2023-10-09T11:42:43.796183+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:12.091337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.801727+0000","last_change":"2023-10-09T11:42:42.767031+0000","last_active":"2023-10-09T11:42:43.801727+0000","last_peered":"2023-10-09T11:42:43.801727+0000","last_clean":"2023-10-09T11:42:43.801727+0000","last_became_active":"2023-10-09T11:42:42.766801+0000","last_became_peered":"2023-10-09T11:42:42.766801+0000","last_unstale":"2023-10-09T11:42:43.801727+0000","last_undegraded":"2023-10-09T11:42:43.801727+0000","last_fullsized":"2023-10-09T11:42:43.801727+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:08.826070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.789375+0000","last_change":"2023-10-09T11:42:43.786828+0000","last_active":"2023-10-09T11:42:43.789375+0000","last_peered":"2023-10-09T11:42:43.789375+0000","last_clean":"2023-10-09T11:42:43.789375+0000","last_became_active":"2023-10-09T11:42:43.786467+0000","last_became_peered":"2023-10-09T11:42:43.786467+0000","last_unstale":"2023-10-09T11:42:43.789375+0000","last_undegraded":"2023-10-09T11:42:43.789375+0000","last_fullsized":"2023-10-09T11:42:43.789375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:29.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.780971+0000","last_change":"2023-10-09T11:42:42.759529+0000","last_active":"2023-10-09T11:42:43.780971+0000","last_peered":"2023-10-09T11:42:43.780971+0000","last_clean":"2023-10-09T11:42:43.780971+0000","last_became_active":"2023-10-09T11:42:42.759042+0000","last_became_peered":"2023-10-09T11:42:42.759042+0000","last_unstale":"2023-10-09T11:42:43.780971+0000","last_undegraded":"2023-10-09T11:42:43.780971+0000","last_fullsized":"2023-10-09T11:42:43.780971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.365624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785936+0000","last_change":"2023-10-09T11:42:43.785936+0000","last_active":"2023-10-09T11:42:43.785936+0000","last_peered":"2023-10-09T11:42:43.785936+0000","last_clean":"2023-10-09T11:42:43.785936+0000","last_became_active":"2023-10-09T11:42:43.785594+0000","last_became_peered":"2023-10-09T11:42:43.785594+0000","last_unstale":"2023-10-09T11:42:43.785936+0000","last_undegraded":"2023-10-09T11:42:43.785936+0000","last_fullsized":"2023-10-09T11:42:43.785936+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:40.584785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.800271+0000","last_change":"2023-10-09T11:42:42.766079+0000","last_active":"2023-10-09T11:42:43.800271+0000","last_peered":"2023-10-09T11:42:43.800271+0000","last_clean":"2023-10-09T11:42:43.800271+0000","last_became_active":"2023-10-09T11:42:42.765787+0000","last_became_peered":"2023-10-09T11:42:42.765787+0000","last_unstale":"2023-10-09T11:42:43.800271+0000","last_undegraded":"2023-10-09T11:42:43.800271+0000","last_fullsized":"2023-10-09T11:42:43.800271+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:37.072695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.791309+0000","last_change":"2023-10-09T11:42:43.788014+0000","last_active":"2023-10-09T11:42:43.791309+0000","last_peered":"2023-10-09T11:42:43.791309+0000","last_clean":"2023-10-09T11:42:43.791309+0000","last_became_active":"2023-10-09T11:42:43.787092+0000","last_became_peered":"2023-10-09T11:42:43.787092+0000","last_unstale":"2023-10-09T11:42:43.791309+0000","last_undegraded":"2023-10-09T11:42:43.791309+0000","last_fullsized":"2023-10-09T11:42:43.791309+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:38.077454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.761932+0000","last_change":"2023-10-09T11:42:42.760106+0000","last_active":"2023-10-09T11:42:42.761932+0000","last_peered":"2023-10-09T11:42:42.761932+0000","last_clean":"2023-10-09T11:42:42.761932+0000","last_became_active":"2023-10-09T11:42:42.759817+0000","last_became_peered":"2023-10-09T11:42:42.759817+0000","last_unstale":"2023-10-09T11:42:42.761932+0000","last_undegraded":"2023-10-09T11:42:42.761932+0000","last_fullsized":"2023-10-09T11:42:42.761932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:38.884090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799168+0000","last_change":"2023-10-09T11:42:43.793568+0000","last_active":"2023-10-09T11:42:43.799168+0000","last_peered":"2023-10-09T11:42:43.799168+0000","last_clean":"2023-10-09T11:42:43.799168+0000","last_became_active":"2023-10-09T11:42:43.793340+0000","last_became_peered":"2023-10-09T11:42:43.793340+0000","last_unstale":"2023-10-09T11:42:43.799168+0000","last_undegraded":"2023-10-09T11:42:43.799168+0000","last_fullsized":"2023-10-09T11:42:43.799168+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:26.638220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.767274+0000","last_change":"2023-10-09T11:42:42.766041+0000","last_active":"2023-10-09T11:42:42.767274+0000","last_peered":"2023-10-09T11:42:42.767274+0000","last_clean":"2023-10-09T11:42:42.767274+0000","last_became_active":"2023-10-09T11:42:42.765768+0000","last_became_peered":"2023-10-09T11:42:42.765768+0000","last_unstale":"2023-10-09T11:42:42.767274+0000","last_undegraded":"2023-10-09T11:42:42.767274+0000","last_fullsized":"2023-10-09T11:42:42.767274+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:47.344219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784692+0000","last_change":"2023-10-09T11:42:43.784692+0000","last_active":"2023-10-09T11:42:43.784692+0000","last_peered":"2023-10-09T11:42:43.784692+0000","last_clean":"2023-10-09T11:42:43.784692+0000","last_became_active":"2023-10-09T11:42:43.784435+0000","last_became_peered":"2023-10-09T11:42:43.784435+0000","last_unstale":"2023-10-09T11:42:43.784692+0000","last_undegraded":"2023-10-09T11:42:43.784692+0000","last_fullsized":"2023-10-09T11:42:43.784692+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:20.901352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772153+0000","last_change":"2023-10-09T11:42:42.760039+0000","last_active":"2023-10-09T11:42:43.772153+0000","last_peered":"2023-10-09T11:42:43.772153+0000","last_clean":"2023-10-09T11:42:43.772153+0000","last_became_active":"2023-10-09T11:42:42.759737+0000","last_became_peered":"2023-10-09T11:42:42.759737+0000","last_unstale":"2023-10-09T11:42:43.772153+0000","last_undegraded":"2023-10-09T11:42:43.772153+0000","last_fullsized":"2023-10-09T11:42:43.772153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:27.370388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.782689+0000","last_change":"2023-10-09T11:42:43.782689+0000","last_active":"2023-10-09T11:42:43.782689+0000","last_peered":"2023-10-09T11:42:43.782689+0000","last_clean":"2023-10-09T11:42:43.782689+0000","last_became_active":"2023-10-09T11:42:43.782226+0000","last_became_peered":"2023-10-09T11:42:43.782226+0000","last_unstale":"2023-10-09T11:42:43.782689+0000","last_undegraded":"2023-10-09T11:42:43.782689+0000","last_fullsized":"2023-10-09T11:42:43.782689+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:44.199394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"137'2","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.799913+0000","last_change":"2023-10-09T11:42:42.760012+0000","last_active":"2023-10-09T11:42:43.799913+0000","last_peered":"2023-10-09T11:42:43.799913+0000","last_clean":"2023-10-09T11:42:43.799913+0000","last_became_active":"2023-10-09T11:42:42.759689+0000","last_became_peered":"2023-10-09T11:42:42.759689+0000","last_unstale":"2023-10-09T11:42:43.799913+0000","last_undegraded":"2023-10-09T11:42:43.799913+0000","last_fullsized":"2023-10-09T11:42:43.799913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:29.188094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.792145+0000","last_change":"2023-10-09T11:42:43.792145+0000","last_active":"2023-10-09T11:42:43.792145+0000","last_peered":"2023-10-09T11:42:43.792145+0000","last_clean":"2023-10-09T11:42:43.792145+0000","last_became_active":"2023-10-09T11:42:43.791864+0000","last_became_peered":"2023-10-09T11:42:43.791864+0000","last_unstale":"2023-10-09T11:42:43.792145+0000","last_undegraded":"2023-10-09T11:42:43.792145+0000","last_fullsized":"2023-10-09T11:42:43.792145+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:57.794425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.769020+0000","last_change":"2023-10-09T11:42:42.764983+0000","last_active":"2023-10-09T11:42:42.769020+0000","last_peered":"2023-10-09T11:42:42.769020+0000","last_clean":"2023-10-09T11:42:42.769020+0000","last_became_active":"2023-10-09T11:42:42.764719+0000","last_became_peered":"2023-10-09T11:42:42.764719+0000","last_unstale":"2023-10-09T11:42:42.769020+0000","last_undegraded":"2023-10-09T11:42:42.769020+0000","last_fullsized":"2023-10-09T11:42:42.769020+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:56.847429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785690+0000","last_change":"2023-10-09T11:42:43.779811+0000","last_active":"2023-10-09T11:42:43.785690+0000","last_peered":"2023-10-09T11:42:43.785690+0000","last_clean":"2023-10-09T11:42:43.785690+0000","last_became_active":"2023-10-09T11:42:43.779527+0000","last_became_peered":"2023-10-09T11:42:43.779527+0000","last_unstale":"2023-10-09T11:42:43.785690+0000","last_undegraded":"2023-10-09T11:42:43.785690+0000","last_fullsized":"2023-10-09T11:42:43.785690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:09.799824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.769041+0000","last_change":"2023-10-09T11:42:42.766795+0000","last_active":"2023-10-09T11:42:42.769041+0000","last_peered":"2023-10-09T11:42:42.769041+0000","last_clean":"2023-10-09T11:42:42.769041+0000","last_became_active":"2023-10-09T11:42:42.766489+0000","last_became_peered":"2023-10-09T11:42:42.766489+0000","last_unstale":"2023-10-09T11:42:42.769041+0000","last_undegraded":"2023-10-09T11:42:42.769041+0000","last_fullsized":"2023-10-09T11:42:42.769041+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:39.634335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787516+0000","last_change":"2023-10-09T11:42:43.783048+0000","last_active":"2023-10-09T11:42:43.787516+0000","last_peered":"2023-10-09T11:42:43.787516+0000","last_clean":"2023-10-09T11:42:43.787516+0000","last_became_active":"2023-10-09T11:42:43.782764+0000","last_became_peered":"2023-10-09T11:42:43.782764+0000","last_unstale":"2023-10-09T11:42:43.787516+0000","last_undegraded":"2023-10-09T11:42:43.787516+0000","last_fullsized":"2023-10-09T11:42:43.787516+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:55.451733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.774714+0000","last_change":"2023-10-09T11:42:42.757001+0000","last_active":"2023-10-09T11:42:43.774714+0000","last_peered":"2023-10-09T11:42:43.774714+0000","last_clean":"2023-10-09T11:42:43.774714+0000","last_became_active":"2023-10-09T11:42:42.756755+0000","last_became_peered":"2023-10-09T11:42:42.756755+0000","last_unstale":"2023-10-09T11:42:43.774714+0000","last_undegraded":"2023-10-09T11:42:43.774714+0000","last_fullsized":"2023-10-09T11:42:43.774714+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:24.525564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795256+0000","last_change":"2023-10-09T11:42:43.791319+0000","last_active":"2023-10-09T11:42:43.795256+0000","last_peered":"2023-10-09T11:42:43.795256+0000","last_clean":"2023-10-09T11:42:43.795256+0000","last_became_active":"2023-10-09T11:42:43.790998+0000","last_became_peered":"2023-10-09T11:42:43.790998+0000","last_unstale":"2023-10-09T11:42:43.795256+0000","last_undegraded":"2023-10-09T11:42:43.795256+0000","last_fullsized":"2023-10-09T11:42:43.795256+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:03.008751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772151+0000","last_change":"2023-10-09T11:42:42.758482+0000","last_active":"2023-10-09T11:42:43.772151+0000","last_peered":"2023-10-09T11:42:43.772151+0000","last_clean":"2023-10-09T11:42:43.772151+0000","last_became_active":"2023-10-09T11:42:42.758248+0000","last_became_peered":"2023-10-09T11:42:42.758248+0000","last_unstale":"2023-10-09T11:42:43.772151+0000","last_undegraded":"2023-10-09T11:42:43.772151+0000","last_fullsized":"2023-10-09T11:42:43.772151+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.795411+0000","last_change":"2023-10-09T11:42:43.792657+0000","last_active":"2023-10-09T11:42:43.795411+0000","last_peered":"2023-10-09T11:42:43.795411+0000","last_clean":"2023-10-09T11:42:43.795411+0000","last_became_active":"2023-10-09T11:42:43.792297+0000","last_became_peered":"2023-10-09T11:42:43.792297+0000","last_unstale":"2023-10-09T11:42:43.795411+0000","last_undegraded":"2023-10-09T11:42:43.795411+0000","last_fullsized":"2023-10-09T11:42:43.795411+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:36.396921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.772651+0000","last_change":"2023-10-09T11:42:42.757150+0000","last_active":"2023-10-09T11:42:43.772651+0000","last_peered":"2023-10-09T11:42:43.772651+0000","last_clean":"2023-10-09T11:42:43.772651+0000","last_became_active":"2023-10-09T11:42:42.756878+0000","last_became_peered":"2023-10-09T11:42:42.756878+0000","last_unstale":"2023-10-09T11:42:43.772651+0000","last_undegraded":"2023-10-09T11:42:43.772651+0000","last_fullsized":"2023-10-09T11:42:43.772651+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.787217+0000","last_change":"2023-10-09T11:42:43.782916+0000","last_active":"2023-10-09T11:42:43.787217+0000","last_peered":"2023-10-09T11:42:43.787217+0000","last_clean":"2023-10-09T11:42:43.787217+0000","last_became_active":"2023-10-09T11:42:43.782611+0000","last_became_peered":"2023-10-09T11:42:43.782611+0000","last_unstale":"2023-10-09T11:42:43.787217+0000","last_undegraded":"2023-10-09T11:42:43.787217+0000","last_fullsized":"2023-10-09T11:42:43.787217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:38.448732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.781243+0000","last_change":"2023-10-09T11:42:42.757346+0000","last_active":"2023-10-09T11:42:43.781243+0000","last_peered":"2023-10-09T11:42:43.781243+0000","last_clean":"2023-10-09T11:42:43.781243+0000","last_became_active":"2023-10-09T11:42:42.756398+0000","last_became_peered":"2023-10-09T11:42:42.756398+0000","last_unstale":"2023-10-09T11:42:43.781243+0000","last_undegraded":"2023-10-09T11:42:43.781243+0000","last_fullsized":"2023-10-09T11:42:43.781243+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.788545+0000","last_change":"2023-10-09T11:42:43.788545+0000","last_active":"2023-10-09T11:42:43.788545+0000","last_peered":"2023-10-09T11:42:43.788545+0000","last_clean":"2023-10-09T11:42:43.788545+0000","last_became_active":"2023-10-09T11:42:43.788244+0000","last_became_peered":"2023-10-09T11:42:43.788244+0000","last_unstale":"2023-10-09T11:42:43.788545+0000","last_undegraded":"2023-10-09T11:42:43.788545+0000","last_fullsized":"2023-10-09T11:42:43.788545+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:04.898620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T11:42:42.767231+0000","last_change":"2023-10-09T11:42:42.766432+0000","last_active":"2023-10-09T11:42:42.767231+0000","last_peered":"2023-10-09T11:42:42.767231+0000","last_clean":"2023-10-09T11:42:42.767231+0000","last_became_active":"2023-10-09T11:42:42.766160+0000","last_became_peered":"2023-10-09T11:42:42.766160+0000","last_unstale":"2023-10-09T11:42:42.767231+0000","last_undegraded":"2023-10-09T11:42:42.767231+0000","last_fullsized":"2023-10-09T11:42:42.767231+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:24.669912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.783597+0000","last_change":"2023-10-09T11:42:43.783597+0000","last_active":"2023-10-09T11:42:43.783597+0000","last_peered":"2023-10-09T11:42:43.783597+0000","last_clean":"2023-10-09T11:42:43.783597+0000","last_became_active":"2023-10-09T11:42:43.783221+0000","last_became_peered":"2023-10-09T11:42:43.783221+0000","last_unstale":"2023-10-09T11:42:43.783597+0000","last_undegraded":"2023-10-09T11:42:43.783597+0000","last_fullsized":"2023-10-09T11:42:43.783597+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:42.739963+0000","last_clean_scrub_stamp":"2023-10-09T11:42:42.739963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:10.341556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.784903+0000","last_change":"2023-10-09T11:42:42.760261+0000","last_active":"2023-10-09T11:42:43.784903+0000","last_peered":"2023-10-09T11:42:43.784903+0000","last_clean":"2023-10-09T11:42:43.784903+0000","last_became_active":"2023-10-09T11:42:42.759761+0000","last_became_peered":"2023-10-09T11:42:42.759761+0000","last_unstale":"2023-10-09T11:42:43.784903+0000","last_undegraded":"2023-10-09T11:42:43.784903+0000","last_fullsized":"2023-10-09T11:42:43.784903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:41.735204+0000","last_clean_scrub_stamp":"2023-10-09T11:42:41.735204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:42.344826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":258,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T11:42:43.785714+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:42:43.785714+0000","last_peered":"2023-10-09T11:42:43.785714+0000","last_clean":"2023-10-09T11:42:43.785714+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:42:43.785714+0000","last_undegraded":"2023-10-09T11:42:43.785714+0000","last_fullsized":"2023-10-09T11:42:43.785714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542240,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1363473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.68000000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.77300000000000002,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":2.6160000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":5.9450000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.256},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.83299999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.90200000000000002},"min":{"1min":0.54600000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":8.9309999999999992},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.71099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58899999999999997,"15min":0.68200000000000005},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.3},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.749,"15min":1.163},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":1.1419999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.61499999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":1.369},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.64500000000000002},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.84199999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.47399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542240,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":779289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.73899999999999999,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.86499999999999999,"15min":1.153},"last":0.67600000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":0.81299999999999994},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.48299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.81200000000000006,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":1.1060000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.874},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.626},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":1.0069999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.93000000000000005},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":774537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.51000000000000001},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46500000000000002,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.73199999999999998},"min":{"1min":0.28100000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":11.06},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.374,"15min":0.90100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":15.933999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.76200000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.621,"5min":0.621,"15min":11.935},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.73699999999999999},"min":{"1min":0.29599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53500000000000003,"5min":0.76400000000000001,"15min":11.087},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.56000000000000005},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":5.0060000000000002},"last":0.39800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61899999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88800000000000001,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":1.528},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.94999999999999996},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85799999999999998,"5min":0.88400000000000001,"15min":10.939},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78900000000000003,"5min":0.996,"15min":4.9370000000000003},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.98399999999999999},"min":{"1min":0.40899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":10.975},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":1.012},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":1.0129999999999999},"min":{"1min":0.48799999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1363391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.51400000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.47399999999999998,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.54700000000000004},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.77000000000000002},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.371,"15min":0.81399999999999995},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.71499999999999997,"15min":12.589},"last":0.25}]},{"osd":3,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":1.6739999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.44900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":1.502},"last":0.29599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.63700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.446},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.66200000000000003},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.1970000000000001,"15min":1.278},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.67100000000000004},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.639},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.627,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.077,"5min":1.288,"15min":1.3149999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.038,"15min":1.5629999999999999},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":773667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.27700000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60999999999999999,"15min":1.272},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.75,"15min":0.75},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.65500000000000003,"5min":0.70299999999999996,"15min":1.246},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.443}]},{"osd":5,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":0.92700000000000005,"15min":2.1579999999999999},"last":0.372},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":1.286},"last":0.52400000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":3.843,"15min":3.843},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":1.3149999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.41499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":773195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.25900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54600000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.53800000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.88},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.73199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76900000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80400000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.502,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.871,"15min":0.873},"last":0.77500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542241,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":781379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":1.056},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.68000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73599999999999999,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80200000000000005,"5min":0.84499999999999997,"15min":1.234},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.58799999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.282},"last":0.878}]},{"osd":7,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.65600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.89500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542241,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1740800,"data_stored":779289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.84899999999999998,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.98099999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.53500000000000003},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.621},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.95999999999999996},"last":0.622}]},{"osd":4,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:48.277 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:42:48.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:42:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.437+0000 7fa4a5797700 1 Processor -- start 2023-10-09T11:42:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 -- start start 2023-10-09T11:42:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4a00c8800 0x7fa4a00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00b1150 0x7fa4a00ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00adbc0 con 0x7fa4a00c8bd0 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00c9d30 con 0x7fa4a00c8800 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa4a5797700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00acfb0 con 0x7fa4a00b1150 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.438+0000 7fa49effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4a00c8800 0x7fa4a00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4a00c8800 0x7fa4a00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48918/0 (socket says 172.21.15.26:48918) 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 -- 172.21.15.26:0/3000850759 learned_addr learned my addr 172.21.15.26:0/3000850759 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49f7fe700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00b1150 0x7fa4a00ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 -- 172.21.15.26:0/3000850759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00b1150 msgr2=0x7fa4a00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00b1150 0x7fa4a00ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 -- 172.21.15.26:0/3000850759 >> v1:172.21.15.67:6789/0 conn(0x7fa4a00c8bd0 legacy=0x7fa4a00b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 -- 172.21.15.26:0/3000850759 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00ad290 con 0x7fa4a00c8800 2023-10-09T11:42:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49effd700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00c8800 0x7fa4a00c94e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa4900099b0 tx=0x7fa490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b618339f056c10ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49dffb700 1 -- 172.21.15.26:0/3000850759 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000b820 con 0x7fa4a00c8800 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49dffb700 1 -- 172.21.15.26:0/3000850759 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49000b980 con 0x7fa4a00c8800 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.439+0000 7fa49dffb700 1 -- 172.21.15.26:0/3000850759 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000bd20 con 0x7fa4a00c8800 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 -- 172.21.15.26:0/3000850759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00c8800 msgr2=0x7fa4a00c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00c8800 0x7fa4a00c94e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa4900099b0 tx=0x7fa490009250 comp rx=0 tx=0).stop 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 -- 172.21.15.26:0/3000850759 shutdown_connections 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00b1150 0x7fa4a00ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3000850759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00c8800 0x7fa4a00c94e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 -- 172.21.15.26:0/3000850759 >> 172.21.15.26:0/3000850759 conn(0x7fa4a006d170 msgr2=0x7fa4a00cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 -- 172.21.15.26:0/3000850759 shutdown_connections 2023-10-09T11:42:48.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.440+0000 7fa4a5797700 1 -- 172.21.15.26:0/3000850759 wait complete. 2023-10-09T11:42:48.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.441+0000 7fa4a5797700 1 Processor -- start 2023-10-09T11:42:48.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.441+0000 7fa4a5797700 1 -- start start 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4a00c8800 0x7fa4a0155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00c8bd0 0x7fa4a0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a84c0 con 0x7fa4a00b1150 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0156560 con 0x7fa4a00c8800 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a8780 con 0x7fa4a00c8bd0 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48932/0 (socket says 172.21.15.26:48932) 2023-10-09T11:42:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 -- 172.21.15.26:0/3320312817 learned_addr learned my addr 172.21.15.26:0/3320312817 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 -- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00c8bd0 msgr2=0x7fa4a0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00c8bd0 0x7fa4a0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 -- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4a00c8800 msgr2=0x7fa4a0155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4a00c8800 0x7fa4a0155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 -- 172.21.15.26:0/3320312817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900094f0 con 0x7fa4a00b1150 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa49effd700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa490009290 tx=0x7fa490016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49001b450 con 0x7fa4a00b1150 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa490020070 con 0x7fa4a00b1150 2023-10-09T11:42:48.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a00a63c0 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.442+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49001b820 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.443+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a0155fa0 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.443+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a004c3c0 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.444+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa490022030 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.444+0000 7fa486ffd700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 0x7fa48c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.444+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa490086a40 con 0x7fa4a00b1150 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.445+0000 7fa49e7fc700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 0x7fa48c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.445+0000 7fa49e7fc700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 0x7fa48c0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ab610 tx=0x7fa494006ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.449+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4900537a0 con 0x7fa4a00b1150 2023-10-09T11:42:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.721+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa4a004c3c0 con 0x7fa4a00b1150 2023-10-09T11:42:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.724+0000 7fa486ffd700 1 -- 172.21.15.26:0/3320312817 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa490056dc0 con 0x7fa4a00b1150 2023-10-09T11:42:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 msgr2=0x7fa48c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 0x7fa48c0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ab610 tx=0x7fa494006ce0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 msgr2=0x7fa4a01519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa490009290 tx=0x7fa490016000 comp rx=0 tx=0).stop 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 shutdown_connections 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa48c067320 0x7fa48c0697d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4a00c8bd0 0x7fa4a0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00b1150 0x7fa4a01519c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 --2- 172.21.15.26:0/3320312817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4a00c8800 0x7fa4a0155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 >> 172.21.15.26:0/3320312817 conn(0x7fa4a006d170 msgr2=0x7fa4a00ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 shutdown_connections 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.727+0000 7fa4a5797700 1 -- 172.21.15.26:0/3320312817 wait complete. 2023-10-09T11:42:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:42:48.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:48.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.859+0000 7fbaeff02700 1 Processor -- start 2023-10-09T11:42:48.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.859+0000 7fbaeff02700 1 -- start start 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaeff02700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae81599a0 0x7fbae806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaeff02700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae806b230 0x7fbae80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaeff02700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80c7f50 con 0x7fbae81595d0 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaeff02700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae806bd00 con 0x7fbae806b230 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaeff02700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae806b740 con 0x7fbae81599a0 2023-10-09T11:42:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae806b230 0x7fbae80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaedc9e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbae81595d0 0x7fbae80675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58514/0 (socket says 172.21.15.26:58514) 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaedc9e700 1 -- 172.21.15.26:0/2028604631 learned_addr learned my addr 172.21.15.26:0/2028604631 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaed49d700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae81599a0 0x7fbae806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 -- 172.21.15.26:0/2028604631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae81599a0 msgr2=0x7fbae806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae81599a0 0x7fbae806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 -- 172.21.15.26:0/2028604631 >> v1:172.21.15.26:6789/0 conn(0x7fbae81595d0 legacy=0x7fbae80675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaecc9c700 1 -- 172.21.15.26:0/2028604631 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094756036 0 0) 0x7fbae80c7f50 con 0x7fbae81595d0 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 -- 172.21.15.26:0/2028604631 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae806ba20 con 0x7fbae806b230 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaee49f700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae806b230 0x7fbae80c83e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fbae00098e0 tx=0x7fbae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cca94b89caa1813 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaecc9c700 1 -- 172.21.15.26:0/2028604631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0009e80 con 0x7fbae806b230 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaecc9c700 1 -- 172.21.15.26:0/2028604631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000b860 con 0x7fbae806b230 2023-10-09T11:42:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.860+0000 7fbaecc9c700 1 -- 172.21.15.26:0/2028604631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000bbe0 con 0x7fbae806b230 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 -- 172.21.15.26:0/2028604631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae806b230 msgr2=0x7fbae80c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae806b230 0x7fbae80c83e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fbae00098e0 tx=0x7fbae00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 -- 172.21.15.26:0/2028604631 shutdown_connections 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae806b230 0x7fbae80c83e0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 --2- 172.21.15.26:0/2028604631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae81599a0 0x7fbae806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 -- 172.21.15.26:0/2028604631 >> 172.21.15.26:0/2028604631 conn(0x7fbae80cd400 msgr2=0x7fbae80cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 -- 172.21.15.26:0/2028604631 shutdown_connections 2023-10-09T11:42:48.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.861+0000 7fbaeff02700 1 -- 172.21.15.26:0/2028604631 wait complete. 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.862+0000 7fbaeff02700 1 Processor -- start 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.862+0000 7fbaeff02700 1 -- start start 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 0x7fbae8168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 0x7fbae80c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80b01a0 con 0x7fbae81595d0 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8169410 con 0x7fbae81599a0 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaeff02700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80b03f0 con 0x7fbae806b230 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48952/0 (socket says 172.21.15.26:48952) 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 -- 172.21.15.26:0/3224302702 learned_addr learned my addr 172.21.15.26:0/3224302702 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaedc9e700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 0x7fbae8168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaee49f700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 0x7fbae80c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 -- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 msgr2=0x7fbae8168ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 0x7fbae8168ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 -- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 msgr2=0x7fbae80c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 0x7fbae80c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 -- 172.21.15.26:0/3224302702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009420 con 0x7fbae81595d0 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaedc9e700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 0x7fbae8168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaee49f700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 0x7fbae80c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.863+0000 7fbaed49d700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c880 tx=0x7fbadc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.864+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011600 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.864+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc011780 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.864+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011b40 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.864+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80b06d0 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.864+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae80b0c90 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.865+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae80b0eb0 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.865+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbadc018360 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.865+0000 7fbae5ffb700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 0x7fbad40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.865+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbadc084a90 con 0x7fbae81595d0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.865+0000 7fbaedc9e700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 0x7fbad40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.866+0000 7fbaedc9e700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 0x7fbad40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbad800d270 tx=0x7fbad8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:48.870+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbadc051610 con 0x7fbae81595d0 2023-10-09T11:42:49.076 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-10-09T11:42:49.076+0000 7fae022ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:49.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.104+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbae804c3c0 con 0x7fbae81595d0 2023-10-09T11:42:49.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.105+0000 7fbae5ffb700 1 -- 172.21.15.26:0/3224302702 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fbadc015090 con 0x7fbae81595d0 2023-10-09T11:42:49.105 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:49.106 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":92,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:46.795352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:42:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 msgr2=0x7fbad40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 0x7fbad40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbad800d270 tx=0x7fbad8009040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 msgr2=0x7fbae80b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c880 tx=0x7fbadc008040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 shutdown_connections 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbae81599a0 0x7fbae80c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbad4067320 0x7fbad40697d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbae806b230 0x7fbae8168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 --2- 172.21.15.26:0/3224302702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae81595d0 0x7fbae80b2870 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 >> 172.21.15.26:0/3224302702 conn(0x7fbae80cd400 msgr2=0x7fbae80c21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 shutdown_connections 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.107+0000 7fbaeff02700 1 -- 172.21.15.26:0/3224302702 wait complete. 2023-10-09T11:42:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 92 2023-10-09T11:42:49.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:42:43.157517+0000', 'modified': '2023-10-09T11:42:46.795352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7635}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7635': {'gid': 7635, 'name': 'c', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/2852535167', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 2852535167}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 2852535167}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:42:49.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:42:49.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:42:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.644+0000 7efee4e64700 1 Processor -- start 2023-10-09T11:42:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.644+0000 7efee4e64700 1 -- start start 2023-10-09T11:42:49.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efee4e64700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efee015a5d0 0x7efee0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efee4e64700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee015ae40 con 0x7efee00cb5a0 2023-10-09T11:42:49.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efee4e64700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee015ab60 con 0x7efee00cb970 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efee4e64700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00ce0f0 con 0x7efee015a5d0 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efede59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efee00cb5a0 0x7efee00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58524/0 (socket says 172.21.15.26:58524) 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efede59c700 1 -- 172.21.15.26:0/278725235 learned_addr learned my addr 172.21.15.26:0/278725235 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.645+0000 7efeded9d700 1 --2- 172.21.15.26:0/278725235 >> v2:172.21.15.67:3300/0 conn(0x7efee015a5d0 0x7efee0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734287458 0 0) 0x7efee015ae40 con 0x7efee00cb5a0 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efecc003570 con 0x7efee00cb5a0 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241917720 0 0) 0x7efee015ab60 con 0x7efee00cb970 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee015ae40 con 0x7efee00cb970 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efeded9d700 1 -- 172.21.15.26:0/278725235 >> v1:172.21.15.67:6789/0 conn(0x7efee00cb970 legacy=0x7efee0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efeded9d700 1 -- 172.21.15.26:0/278725235 >> v1:172.21.15.26:6789/0 conn(0x7efee00cb5a0 legacy=0x7efee00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efeded9d700 1 -- 172.21.15.26:0/278725235 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00ccf00 con 0x7efee015a5d0 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efeded9d700 1 --2- 172.21.15.26:0/278725235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee015a5d0 0x7efee0156e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efed80098e0 tx=0x7efed80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a98610709b32f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8011630 con 0x7efee015a5d0 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed8011790 con 0x7efee015a5d0 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.646+0000 7efedd59a700 1 -- 172.21.15.26:0/278725235 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8011b10 con 0x7efee015a5d0 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 -- 172.21.15.26:0/278725235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee015a5d0 msgr2=0x7efee0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 --2- 172.21.15.26:0/278725235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee015a5d0 0x7efee0156e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efed80098e0 tx=0x7efed80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 -- 172.21.15.26:0/278725235 shutdown_connections 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 --2- 172.21.15.26:0/278725235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee015a5d0 0x7efee0156e90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 -- 172.21.15.26:0/278725235 >> 172.21.15.26:0/278725235 conn(0x7efee0070e30 msgr2=0x7efee00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 -- 172.21.15.26:0/278725235 shutdown_connections 2023-10-09T11:42:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.647+0000 7efee4e64700 1 -- 172.21.15.26:0/278725235 wait complete. 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.648+0000 7efee4e64700 1 Processor -- start 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.648+0000 7efee4e64700 1 -- start start 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee00cb5a0 0x7efee0155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efee00cb970 0x7efee00c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00c8ab0 con 0x7efee015a5d0 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00c8ca0 con 0x7efee00cb5a0 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00c8f80 con 0x7efee00cb970 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48954/0 (socket says 172.21.15.26:48954) 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 -- 172.21.15.26:0/2257526790 learned_addr learned my addr 172.21.15.26:0/2257526790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efede59c700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee00cb5a0 0x7efee0155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeddd9b700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efee00cb970 0x7efee00c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 -- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efee00cb970 msgr2=0x7efee00c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efee00cb970 0x7efee00c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 -- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee00cb5a0 msgr2=0x7efee0155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee00cb5a0 0x7efee0155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 -- 172.21.15.26:0/2257526790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8009420 con 0x7efee015a5d0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efeded9d700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efee006ea60 tx=0x7efed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efed67fc700 1 -- 172.21.15.26:0/2257526790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8011b10 con 0x7efee015a5d0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efed67fc700 1 -- 172.21.15.26:0/2257526790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed801a430 con 0x7efee015a5d0 2023-10-09T11:42:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efed67fc700 1 -- 172.21.15.26:0/2257526790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed801a7b0 con 0x7efee015a5d0 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee00c9260 con 0x7efee015a5d0 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.649+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee00c9820 con 0x7efee015a5d0 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.651+0000 7efed67fc700 1 -- 172.21.15.26:0/2257526790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efed801ab20 con 0x7efee015a5d0 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.651+0000 7efed67fc700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 0x7efec0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.651+0000 7efed67fc700 1 -- 172.21.15.26:0/2257526790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efed8086190 con 0x7efee015a5d0 2023-10-09T11:42:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.651+0000 7efede59c700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 0x7efec0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.652+0000 7efede59c700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 0x7efec0069800 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efed0005c50 tx=0x7efed0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.653+0000 7efeee15cb80 1 Processor -- start 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.653+0000 7efeee15cb80 1 -- start start 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7702a50 0x5594c7702e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c772bf60 0x5594c76fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c7659a70 con 0x5594c774cd00 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c7657270 con 0x5594c772bf60 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594c7653060 con 0x5594c7702a50 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39980/0 (socket says 172.21.15.26:39980) 2023-10-09T11:42:49.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 -- 172.21.15.26:0/3733750222 learned_addr learned my addr 172.21.15.26:0/3733750222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efede59c700 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7702a50 0x5594c7702e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeded9d700 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c772bf60 0x5594c76fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 -- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7702a50 msgr2=0x5594c7702e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7702a50 0x5594c7702e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 -- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c772bf60 msgr2=0x5594c76fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c772bf60 0x5594c76fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 -- 172.21.15.26:0/3733750222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c74ed270 con 0x5594c774cd00 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.654+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7efec80037e0 tx=0x7efec8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72244e0f929d514 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efebf7fe700 1 -- 172.21.15.26:0/3733750222 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8002700 con 0x5594c774cd00 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efebf7fe700 1 -- 172.21.15.26:0/3733750222 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8002860 con 0x5594c774cd00 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efebf7fe700 1 -- 172.21.15.26:0/3733750222 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8002be0 con 0x5594c774cd00 2023-10-09T11:42:49.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 -- 172.21.15.26:0/3733750222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 msgr2=0x5594c772ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7efec80037e0 tx=0x7efec8007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 -- 172.21.15.26:0/3733750222 shutdown_connections 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c772bf60 0x5594c76fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7702a50 0x5594c7702e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3733750222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c774cd00 0x5594c772ba20 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 -- 172.21.15.26:0/3733750222 >> 172.21.15.26:0/3733750222 conn(0x5594c7704370 msgr2=0x5594c7704740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 -- 172.21.15.26:0/3733750222 shutdown_connections 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.655+0000 7efeee15cb80 1 -- 172.21.15.26:0/3733750222 wait complete. 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.656+0000 7efeee15cb80 1 -- start start 2023-10-09T11:42:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.656+0000 7efeee15cb80 1 Processor -- start 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76fe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c774cd00 0x5594c775b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c75fe890 con 0x5594c772bf60 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c7619ea0 con 0x5594c7702a50 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594c74d5e30 con 0x5594c774cd00 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeee15cb80 10 client.0 _ll_register_callbacks cb 0x5594c76c6110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39994/0 (socket says 172.21.15.26:39994) 2023-10-09T11:42:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 -- 172.21.15.26:0/1004304132 learned_addr learned my addr 172.21.15.26:0/1004304132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efede59c700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeded9d700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c774cd00 0x5594c775b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 -- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c774cd00 msgr2=0x5594c775b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c774cd00 0x5594c775b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 -- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 msgr2=0x5594c76fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76fe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 -- 172.21.15.26:0/1004304132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee015ae40 con 0x5594c772bf60 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efeddd9b700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efec8000c00 tx=0x7efec8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e8229540cee1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.657+0000 7efebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8006a30 con 0x5594c772bf60 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efec8006b90 con 0x5594c772bf60 2023-10-09T11:42:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594c76f7b70 con 0x5594c772bf60 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7efec8007030 con 0x5594c772bf60 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 10 client.7788 fetch_fsmap learned FSMap version 92 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x5594c748ffe0 con 0x5594c772bf60 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec802e070 con 0x5594c772bf60 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efec8012070 con 0x5594c772bf60 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 10 client.7788 fetch_fsmap finished waiting for FSMap version 92 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 10 client.7788 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 20 client.7788 populate_metadata read hostname 'smithi026' 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c7744560 0x5594c7744930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 4 client.7788 mds_command: new command op to 7635 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 --> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594c76d4aa0 con 0x5594c7744560 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.658+0000 7efede59c700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c7744560 0x5594c7744930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efebcff9700 10 client.7788 ms_handle_connect on v2:172.21.15.26:6833/2852535167 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efede59c700 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c7744560 0x5594c7744930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489b8dff16a1d9c9 server_cookie=14c1a8c61958722d in_seq=0 out_seq=0 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efebcff9700 1 -- 172.21.15.26:0/1004304132 <== mds.0 v2:172.21.15.26:6833/2852535167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5594c76d4aa0 con 0x5594c7744560 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efebcff9700 10 client.7788 handle_command_reply: tid=0 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 client.7788 shutdown 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 msgr2=0x5594c7749c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efec8000c00 tx=0x7efec8018000 comp rx=0 tx=0).stop 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 shutdown_connections 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c7744560 0x5594c7744930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c774cd00 0x5594c775b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efebcff9700 0 client.7788 ms_handle_reset on v2:172.21.15.26:6833/2852535167 2023-10-09T11:42:49.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 --2- 172.21.15.26:0/1004304132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c7749c20 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 >> 172.21.15.26:0/1004304132 conn(0x5594c7704370 msgr2=0x5594c76ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 shutdown_connections 2023-10-09T11:42:49.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.659+0000 7efeee15cb80 1 -- 172.21.15.26:0/1004304132 wait complete. 2023-10-09T11:42:49.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.660+0000 7efeee15cb80 20 client.7788 trim_cache size 0 max 16384 2023-10-09T11:42:49.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 Processor -- start 2023-10-09T11:42:49.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 -- start start 2023-10-09T11:42:49.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76ffb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 0x5594c7743b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c775bc20 con 0x5594c772bf60 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c77431a0 con 0x5594c7702a50 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594c776b9a0 con 0x5594c7744560 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.677+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40000/0 (socket says 172.21.15.26:40000) 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 -- 172.21.15.26:0/3619819823 learned_addr learned my addr 172.21.15.26:0/3619819823 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efede59c700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76ffb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeded9d700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 0x5594c7743b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 -- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 msgr2=0x5594c7743b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 0x5594c7743b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 -- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 msgr2=0x5594c76ffb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76ffb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 -- 172.21.15.26:0/3619819823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c7621780 con 0x5594c772bf60 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeded9d700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 0x5594c7743b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efeddd9b700 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efec8003dd0 tx=0x7efec8021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28218ad243bc432a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efebffff700 1 -- 172.21.15.26:0/3619819823 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8002d50 con 0x5594c772bf60 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efebffff700 1 -- 172.21.15.26:0/3619819823 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec802e070 con 0x5594c772bf60 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.678+0000 7efebffff700 1 -- 172.21.15.26:0/3619819823 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8006a30 con 0x5594c772bf60 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- 172.21.15.26:0/3619819823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 msgr2=0x5594c77435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efec8003dd0 tx=0x7efec8021040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- 172.21.15.26:0/3619819823 shutdown_connections 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c7744560 0x5594c7743b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c76ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 --2- 172.21.15.26:0/3619819823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c772bf60 0x5594c77435f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- 172.21.15.26:0/3619819823 >> 172.21.15.26:0/3619819823 conn(0x5594c7704370 msgr2=0x5594c774a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- 172.21.15.26:0/3619819823 shutdown_connections 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- 172.21.15.26:0/3619819823 wait complete. 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 -- start start 2023-10-09T11:42:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.679+0000 7efeee15cb80 1 Processor -- start 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c7745b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c772bf60 0x5594c77a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c7745400 con 0x5594c7744560 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c77001d0 con 0x5594c7702a50 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594c77456a0 con 0x5594c772bf60 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeee15cb80 10 client.0 _ll_register_callbacks cb 0x5594c76c6110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40010/0 (socket says 172.21.15.26:40010) 2023-10-09T11:42:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeded9d700 1 -- 172.21.15.26:0/814040578 learned_addr learned my addr 172.21.15.26:0/814040578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efeddd9b700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c772bf60 0x5594c77a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.680+0000 7efede59c700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c7745b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 -- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c772bf60 msgr2=0x5594c77a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c772bf60 0x5594c77a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 -- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 msgr2=0x5594c7745b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c7745b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 -- 172.21.15.26:0/814040578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594c748ffe0 con 0x5594c7744560 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeded9d700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7efed80567e0 tx=0x7efed801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa7e907d2cd11b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8056ae0 con 0x5594c7744560 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efed8059d30 con 0x5594c7744560 2023-10-09T11:42:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efec8002860 con 0x5594c7744560 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7efed805da80 con 0x5594c7744560 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 10 client.7794 fetch_fsmap learned FSMap version 92 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x5594c7608470 con 0x5594c7744560 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8002860 con 0x5594c7744560 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efed805d5f0 con 0x5594c7744560 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 10 client.7794 fetch_fsmap finished waiting for FSMap version 92 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 10 client.7794 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 20 client.7794 populate_metadata read hostname 'smithi026' 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c774cd00 0x5594c774d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 4 client.7794 mds_command: new command op to 7635 tid=0[{"prefix": "status"}] 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.681+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 --> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5594c75f5e00 con 0x5594c774cd00 2023-10-09T11:42:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efede59c700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c774cd00 0x5594c774d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efebcff9700 10 client.7794 ms_handle_connect on v2:172.21.15.26:6833/2852535167 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efede59c700 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c774cd00 0x5594c774d6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05fb535f568cc4f server_cookie=db21f5b738915ecf in_seq=0 out_seq=0 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efebcff9700 1 -- 172.21.15.26:0/814040578 <== mds.0 v2:172.21.15.26:6833/2852535167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5594c75f5e00 con 0x5594c774cd00 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efebcff9700 10 client.7794 handle_command_reply: tid=0 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 client.7794 shutdown 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 msgr2=0x5594c775d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7efed80567e0 tx=0x7efed801f040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 shutdown_connections 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:6833/2852535167,v1:172.21.15.26:6835/2852535167] conn(0x5594c774cd00 0x5594c774d6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5594c7744560 0x5594c775d530 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594c7702a50 0x5594c7745b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efebcff9700 0 client.7794 ms_handle_reset on v2:172.21.15.26:6833/2852535167 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 --2- 172.21.15.26:0/814040578 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5594c772bf60 0x5594c77a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 >> 172.21.15.26:0/814040578 conn(0x5594c7704370 msgr2=0x5594c774a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 shutdown_connections 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.682+0000 7efeee15cb80 1 -- 172.21.15.26:0/814040578 wait complete. 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efeee15cb80 20 client.7794 trim_cache size 0 max 16384 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:42:49.690 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 7635, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.8937059740000004, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 92, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 138, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 138, 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 11.004993326999999 2023-10-09T11:42:49.691 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:42:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 msgr2=0x7efec0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 0x7efec0069800 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efed0005c50 tx=0x7efed0009040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 msgr2=0x7efee01524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efee006ea60 tx=0x7efed8017000 comp rx=0 tx=0).stop 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 shutdown_connections 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee015a5d0 0x7efee01524f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efee00cb5a0 0x7efee0155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efec0067350 0x7efec0069800 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 --2- 172.21.15.26:0/2257526790 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efee00cb970 0x7efee00c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 >> 172.21.15.26:0/2257526790 conn(0x7efee0070e30 msgr2=0x7efee00c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 shutdown_connections 2023-10-09T11:42:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.683+0000 7efee4e64700 1 -- 172.21.15.26:0/2257526790 wait complete. 2023-10-09T11:42:49.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.813+0000 7f9cab587700 1 Processor -- start 2023-10-09T11:42:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 -- start start 2023-10-09T11:42:49.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca40a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ca406d280 0x7f9ca40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca40ce1a0 con 0x7f9ca40ae780 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca40cd5d0 con 0x7f9ca406d280 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9cab587700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40cd870 con 0x7f9ca40a8be0 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.814+0000 7f9ca8b22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ca406d280 0x7f9ca40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ca406d280 0x7f9ca40b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40016/0 (socket says 172.21.15.26:40016) 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 -- 172.21.15.26:0/2486998365 learned_addr learned my addr 172.21.15.26:0/2486998365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca9323700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca40a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 -- 172.21.15.26:0/2486998365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 msgr2=0x7f9ca40a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca40a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 -- 172.21.15.26:0/2486998365 >> v1:172.21.15.67:6789/0 conn(0x7f9ca40ae780 legacy=0x7f9ca40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 -- 172.21.15.26:0/2486998365 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca40cdb50 con 0x7f9ca406d280 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca8b22700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca406d280 0x7f9ca40b08c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009990 tx=0x7f9c98009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6364fcca688e1e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca3fff700 1 -- 172.21.15.26:0/2486998365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98009e80 con 0x7f9ca406d280 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca3fff700 1 -- 172.21.15.26:0/2486998365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98005c10 con 0x7f9ca406d280 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.815+0000 7f9ca3fff700 1 -- 172.21.15.26:0/2486998365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800b6e0 con 0x7f9ca406d280 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 -- 172.21.15.26:0/2486998365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca406d280 msgr2=0x7f9ca40b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca406d280 0x7f9ca40b08c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009990 tx=0x7f9c98009220 comp rx=0 tx=0).stop 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 -- 172.21.15.26:0/2486998365 shutdown_connections 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca40a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 --2- 172.21.15.26:0/2486998365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca406d280 0x7f9ca40b08c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 -- 172.21.15.26:0/2486998365 >> 172.21.15.26:0/2486998365 conn(0x7f9ca406ce80 msgr2=0x7f9ca40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 -- 172.21.15.26:0/2486998365 shutdown_connections 2023-10-09T11:42:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.816+0000 7f9cab587700 1 -- 172.21.15.26:0/2486998365 wait complete. 2023-10-09T11:42:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.817+0000 7f9cab587700 1 Processor -- start 2023-10-09T11:42:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.817+0000 7f9cab587700 1 -- start start 2023-10-09T11:42:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ca406d280 0x7f9ca409a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca4153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca409b200 con 0x7f9ca40ae780 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4098d20 con 0x7f9ca406d280 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9cab587700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca409af20 con 0x7f9ca40a8be0 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40024/0 (socket says 172.21.15.26:40024) 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 -- 172.21.15.26:0/705003054 learned_addr learned my addr 172.21.15.26:0/705003054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9323700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ca406d280 0x7f9ca409a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca8b22700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 -- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 msgr2=0x7f9ca4153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca4153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 -- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ca406d280 msgr2=0x7f9ca409a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ca406d280 0x7f9ca409a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 -- 172.21.15.26:0/705003054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98009480 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca8b22700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca4153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.818+0000 7f9ca9b24700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c4f0 tx=0x7f9c9c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.819+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011590 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.819+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c011710 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.819+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca40986d0 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.819+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011ad0 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.819+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca409abe0 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.820+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4098530 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.820+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9c9c01b3b0 con 0x7f9ca40ae780 2023-10-09T11:42:49.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.821+0000 7f9ca17fa700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.821+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c9c0840b0 con 0x7f9ca40ae780 2023-10-09T11:42:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.821+0000 7f9ca9323700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.821+0000 7f9ca9323700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 0x7f9c900697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c940094d0 tx=0x7f9c9400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:49.825+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca4098530 con 0x7f9ca40ae780 2023-10-09T11:42:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.063+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ca4098530 con 0x7f9ca40ae780 2023-10-09T11:42:50.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.063+0000 7f9ca17fa700 1 -- 172.21.15.26:0/705003054 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ca4098530 con 0x7f9ca40ae780 2023-10-09T11:42:50.064 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.065+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 msgr2=0x7f9c900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.065+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 0x7f9c900697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c940094d0 tx=0x7f9c9400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.065+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 msgr2=0x7f9ca40b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.065+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c4f0 tx=0x7f9c9c007f50 comp rx=0 tx=0).stop 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 shutdown_connections 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ca40ae780 0x7f9ca40b14e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ca406d280 0x7f9ca409a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9c90067320 0x7f9c900697d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 --2- 172.21.15.26:0/705003054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ca40a8be0 0x7f9ca4153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 >> 172.21.15.26:0/705003054 conn(0x7f9ca406ce80 msgr2=0x7f9ca40b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 shutdown_connections 2023-10-09T11:42:50.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.066+0000 7f9cab587700 1 -- 172.21.15.26:0/705003054 wait complete. 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:50.078 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:50.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.079 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:42:50.094 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:50.094 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:50.094 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:50.094 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.094 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:42:50.095 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42022sec preferred_lft 42022sec 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.096 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:50.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.097 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:50.157 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:42:50.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.159 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:42:50.215 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:42:50.216 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:50.216 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:42:50.216 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:42:50.216 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:50.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.216 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:42:50.216 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:42:50.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:42:50.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:42:50.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:42:50.217 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:42:50.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.318 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:42:50.333 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:42:50.333 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:42:50.333 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:50.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:50.399 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:50.454 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:50.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:50.455 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:50.508 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:42:50.509 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:50.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:50.590 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:50.590 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:50.631 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:50.632 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:42:50.632 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:42:50.632 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:42:50.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:50.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:50.633 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:50.698 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.858+0000 7f92f3197700 1 Processor -- start 2023-10-09T11:42:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.858+0000 7f92f3197700 1 -- start start 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f3197700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 0x7f92ec15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f3197700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 0x7f92ec15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f3197700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec15afd0 con 0x7f92ec15de50 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f3197700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec15b2b0 con 0x7f92ec153c30 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f3197700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec15b590 con 0x7f92ec0cf110 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f1994700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f92ec15de50 0x7f92ec0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39072/0 (socket says 172.21.15.26:39072) 2023-10-09T11:42:50.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f1994700 1 -- 172.21.15.26:0/1853017706 learned_addr learned my addr 172.21.15.26:0/1853017706 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f2195700 1 --2- 172.21.15.26:0/1853017706 >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 0x7f92ec15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f2996700 1 --2- 172.21.15.26:0/1853017706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 0x7f92ec15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796340606 0 0) 0x7f92ec15afd0 con 0x7f92ec15de50 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d8003570 con 0x7f92ec15de50 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.859+0000 7f92f2996700 1 -- 172.21.15.26:0/1853017706 >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 msgr2=0x7f92ec15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f2996700 1 --2- 172.21.15.26:0/1853017706 >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 0x7f92ec15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f2996700 1 -- 172.21.15.26:0/1853017706 >> v1:172.21.15.26:6789/0 conn(0x7f92ec15de50 legacy=0x7f92ec0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599040958 0 0) 0x7f92d8003570 con 0x7f92ec15de50 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f2996700 1 -- 172.21.15.26:0/1853017706 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec15b870 con 0x7f92ec0cf110 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f2195700 1 --2- 172.21.15.26:0/1853017706 >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 0x7f92ec15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f2996700 1 --2- 172.21.15.26:0/1853017706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 0x7f92ec15c070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e60 tx=0x7f92e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce8052075b378f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e400e070 con 0x7f92ec0cf110 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e400b7a0 con 0x7f92ec0cf110 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f1193700 1 -- 172.21.15.26:0/1853017706 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc001470 con 0x7f92ec0cf110 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f3197700 1 -- 172.21.15.26:0/1853017706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 msgr2=0x7f92ec15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.860+0000 7f92f3197700 1 --2- 172.21.15.26:0/1853017706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 0x7f92ec15c070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e60 tx=0x7f92e4009780 comp rx=0 tx=0).stop 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 -- 172.21.15.26:0/1853017706 shutdown_connections 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 --2- 172.21.15.26:0/1853017706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec0cf110 0x7f92ec15c070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 --2- 172.21.15.26:0/1853017706 >> v2:172.21.15.67:3300/0 conn(0x7f92ec153c30 0x7f92ec15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 -- 172.21.15.26:0/1853017706 >> 172.21.15.26:0/1853017706 conn(0x7f92ec0703a0 msgr2=0x7f92ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 -- 172.21.15.26:0/1853017706 shutdown_connections 2023-10-09T11:42:50.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.861+0000 7f92f3197700 1 -- 172.21.15.26:0/1853017706 wait complete. 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.862+0000 7f92f3197700 1 Processor -- start 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.862+0000 7f92f3197700 1 -- start start 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.862+0000 7f92f3197700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.862+0000 7f92f3197700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92ec153c30 0x7f92ec0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.862+0000 7f92f3197700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec15de50 0x7f92ec0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f3197700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0cb110 con 0x7f92ec0cf110 2023-10-09T11:42:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f3197700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0cb3f0 con 0x7f92ec153c30 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f3197700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec169b80 con 0x7f92ec15de50 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40032/0 (socket says 172.21.15.26:40032) 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 -- 172.21.15.26:0/2570015768 learned_addr learned my addr 172.21.15.26:0/2570015768 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2996700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec15de50 0x7f92ec0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f1994700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92ec153c30 0x7f92ec0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 -- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec15de50 msgr2=0x7f92ec0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec15de50 0x7f92ec0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 -- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92ec153c30 msgr2=0x7f92ec0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92ec153c30 0x7f92ec0cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 -- 172.21.15.26:0/2570015768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8009420 con 0x7f92ec0cf110 2023-10-09T11:42:50.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f2195700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f92e800ec80 tx=0x7f92e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800c9d0 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e800cb30 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e4009a20 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800ceb0 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.863+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec16a140 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.864+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec0cb6d0 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.865+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f92e8013680 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.865+0000 7f92e27fc700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 0x7f92d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.865+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92e8085140 con 0x7f92ec0cf110 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.865+0000 7f92f1994700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 0x7f92d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.866+0000 7f92f1994700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 0x7f92d00697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0011e0 tx=0x7f92dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:50.870+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92e8051dd0 con 0x7f92ec0cf110 2023-10-09T11:42:51.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.107+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92ec16a300 con 0x7f92ec0cf110 2023-10-09T11:42:51.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.108+0000 7f92e27fc700 1 -- 172.21.15.26:0/2570015768 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f92e80553f0 con 0x7f92ec0cf110 2023-10-09T11:42:51.108 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.109+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 msgr2=0x7f92d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.109+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 0x7f92d00697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0011e0 tx=0x7f92dc009040 comp rx=0 tx=0).stop 2023-10-09T11:42:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.109+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 msgr2=0x7f92ec0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.109+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f92e800ec80 tx=0x7f92e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 shutdown_connections 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f92d0067320 0x7f92d00697d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92ec15de50 0x7f92ec0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec0cf110 0x7f92ec0b0310 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 --2- 172.21.15.26:0/2570015768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92ec153c30 0x7f92ec0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 >> 172.21.15.26:0/2570015768 conn(0x7f92ec0703a0 msgr2=0x7f92ec0c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 shutdown_connections 2023-10-09T11:42:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.110+0000 7f92f3197700 1 -- 172.21.15.26:0/2570015768 wait complete. 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:51.122 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:51.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.123 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:51.142 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42036sec preferred_lft 42036sec 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:42:51.143 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:42:51.144 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:42:51.145 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:51.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.145 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:51.212 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:42:51.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.214 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:51.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:42:51.273 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:42:51.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.380 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:42:51.396 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:42:51.396 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:42:51.396 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:51.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:42:51.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:51.462 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:51.517 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:51.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:51.518 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:51.572 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:42:51.573 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:51.573 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:51.654 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:51.654 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:51.673 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:51.674 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:42:51.695 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:51.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:51.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:51.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:42:51.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:42:51.696 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:42:51.697 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:51.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:51.697 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:51.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:42:51.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.896+0000 7f90fe0e1700 1 Processor -- start 2023-10-09T11:42:51.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 -- start start 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90f806dcf0 0x7f90f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80ccfd0 con 0x7f90f8159530 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f815a410 con 0x7f90f806dcf0 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.897+0000 7f90fe0e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f815a6f0 con 0x7f90f8159e40 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f6ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90f806dcf0 0x7f90f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:49914/0 (socket says 172.21.15.26:49914) 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f77fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f90f8159530 0x7f90f80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:49346/0 (socket says 172.21.15.26:49346) 2023-10-09T11:42:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 -- 172.21.15.26:0/4130657897 learned_addr learned my addr 172.21.15.26:0/4130657897 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f67fc700 1 -- 172.21.15.26:0/4130657897 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635513605 0 0) 0x7f90f80ccfd0 con 0x7f90f8159530 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 -- 172.21.15.26:0/4130657897 >> v2:172.21.15.67:3300/0 conn(0x7f90f806dcf0 msgr2=0x7f90f8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 --2- 172.21.15.26:0/4130657897 >> v2:172.21.15.67:3300/0 conn(0x7f90f806dcf0 0x7f90f8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 -- 172.21.15.26:0/4130657897 >> v1:172.21.15.67:6789/0 conn(0x7f90f8159530 legacy=0x7f90f80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 -- 172.21.15.26:0/4130657897 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f815a9d0 con 0x7f90f8159e40 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f7fff700 1 --2- 172.21.15.26:0/4130657897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009f20 tx=0x7f90f0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ee123d9c26d5cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f67fc700 1 -- 172.21.15.26:0/4130657897 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000e070 con 0x7f90f8159e40 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f67fc700 1 -- 172.21.15.26:0/4130657897 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000b9d0 con 0x7f90f8159e40 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.898+0000 7f90f67fc700 1 -- 172.21.15.26:0/4130657897 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00092e0 con 0x7f90f8159e40 2023-10-09T11:42:51.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 -- 172.21.15.26:0/4130657897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 msgr2=0x7f90f80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/4130657897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009f20 tx=0x7f90f0009840 comp rx=0 tx=0).stop 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 -- 172.21.15.26:0/4130657897 shutdown_connections 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/4130657897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159e40 0x7f90f80cb6f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/4130657897 >> v2:172.21.15.67:3300/0 conn(0x7f90f806dcf0 0x7f90f8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 -- 172.21.15.26:0/4130657897 >> 172.21.15.26:0/4130657897 conn(0x7f90f80703a0 msgr2=0x7f90f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 -- 172.21.15.26:0/4130657897 shutdown_connections 2023-10-09T11:42:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.899+0000 7f90fe0e1700 1 -- 172.21.15.26:0/4130657897 wait complete. 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.900+0000 7f90fe0e1700 1 Processor -- start 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.900+0000 7f90fe0e1700 1 -- start start 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f806dcf0 0x7f90f814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159530 0x7f90f80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b3480 con 0x7f90f8159e40 2023-10-09T11:42:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b36d0 con 0x7f90f806dcf0 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90fe0e1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b39b0 con 0x7f90f8159530 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40040/0 (socket says 172.21.15.26:40040) 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 -- 172.21.15.26:0/3926641286 learned_addr learned my addr 172.21.15.26:0/3926641286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f77fe700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f806dcf0 0x7f90f814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f6ffd700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159530 0x7f90f80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 -- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159530 msgr2=0x7f90f80b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159530 0x7f90f80b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 -- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f806dcf0 msgr2=0x7f90f814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f806dcf0 0x7f90f814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 -- 172.21.15.26:0/3926641286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009ae0 con 0x7f90f8159e40 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90f7fff700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f90f80caf20 tx=0x7f90f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.901+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0008b10 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.902+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0008c70 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.902+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f80b3c90 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.902+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0025460 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.902+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f80b4250 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.903+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f804c3c0 con 0x7f90f8159e40 2023-10-09T11:42:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.903+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f90f0003040 con 0x7f90f8159e40 2023-10-09T11:42:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.903+0000 7f90df7fe700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 0x7f90e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.903+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90f0086900 con 0x7f90f8159e40 2023-10-09T11:42:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.904+0000 7f90f77fe700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 0x7f90e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.904+0000 7f90f77fe700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 0x7f90e40697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007fd0 tx=0x7f90e8007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:51.908+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90f0053480 con 0x7f90f8159e40 2023-10-09T11:42:52.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.149+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90f815acb0 con 0x7f90f8159e40 2023-10-09T11:42:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.816+0000 7f90df7fe700 1 -- 172.21.15.26:0/3926641286 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 136+0+0 (secure 0 0 0) 0x7f90f0056aa0 con 0x7f90f8159e40 2023-10-09T11:42:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 msgr2=0x7f90e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 0x7f90e40697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007fd0 tx=0x7f90e8007d50 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 msgr2=0x7f90f80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f90f80caf20 tx=0x7f90f0018000 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 shutdown_connections 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90f8159e40 0x7f90f80b2620 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f806dcf0 0x7f90f814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f90e4067320 0x7f90e40697d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 --2- 172.21.15.26:0/3926641286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90f8159530 0x7f90f80b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 >> 172.21.15.26:0/3926641286 conn(0x7f90f80703a0 msgr2=0x7f90f81541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 shutdown_connections 2023-10-09T11:42:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.819+0000 7f90fe0e1700 1 -- 172.21.15.26:0/3926641286 wait complete. 2023-10-09T11:42:52.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.957+0000 7f8be8216700 1 Processor -- start 2023-10-09T11:42:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 -- start start 2023-10-09T11:42:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8be00cb5a0 0x7f8be00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8be00cd9e0 0x7f8be0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be015ae40 con 0x7f8be015a400 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be00d13f0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.958+0000 7f8be8216700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be015ab60 con 0x7f8be00cb5a0 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8be00cd9e0 0x7f8be0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8be00cd9e0 0x7f8be0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40056/0 (socket says 172.21.15.26:40056) 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 -- 172.21.15.26:0/2820273617 learned_addr learned my addr 172.21.15.26:0/2820273617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be5fb2700 1 --2- 172.21.15.26:0/2820273617 >> v2:172.21.15.67:3300/0 conn(0x7f8be00cb5a0 0x7f8be00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 -- 172.21.15.26:0/2820273617 >> v2:172.21.15.67:3300/0 conn(0x7f8be00cb5a0 msgr2=0x7f8be00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 --2- 172.21.15.26:0/2820273617 >> v2:172.21.15.67:3300/0 conn(0x7f8be00cb5a0 0x7f8be00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 -- 172.21.15.26:0/2820273617 >> v1:172.21.15.67:6789/0 conn(0x7f8be015a400 legacy=0x7f8be0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 -- 172.21.15.26:0/2820273617 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00ccf00 con 0x7f8be00cd9e0 2023-10-09T11:42:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be57b1700 1 --2- 172.21.15.26:0/2820273617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be0159ec0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0099b0 tx=0x7f8bdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb329b9ee269baf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be4fb0700 1 -- 172.21.15.26:0/2820273617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc009ea0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be4fb0700 1 -- 172.21.15.26:0/2820273617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00b820 con 0x7f8be00cd9e0 2023-10-09T11:42:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.959+0000 7f8be4fb0700 1 -- 172.21.15.26:0/2820273617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00bbc0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 -- 172.21.15.26:0/2820273617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 msgr2=0x7f8be0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 --2- 172.21.15.26:0/2820273617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be0159ec0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0099b0 tx=0x7f8bdc009250 comp rx=0 tx=0).stop 2023-10-09T11:42:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 -- 172.21.15.26:0/2820273617 shutdown_connections 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 --2- 172.21.15.26:0/2820273617 >> v2:172.21.15.67:3300/0 conn(0x7f8be00cb5a0 0x7f8be00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 --2- 172.21.15.26:0/2820273617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be0159ec0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 -- 172.21.15.26:0/2820273617 >> 172.21.15.26:0/2820273617 conn(0x7f8be0070e30 msgr2=0x7f8be00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 -- 172.21.15.26:0/2820273617 shutdown_connections 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.960+0000 7f8be8216700 1 -- 172.21.15.26:0/2820273617 wait complete. 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.961+0000 7f8be8216700 1 Processor -- start 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.961+0000 7f8be8216700 1 -- start start 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 0x7f8be0150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be015a400 0x7f8be015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0151ae0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be015fdd0 con 0x7f8be015a400 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be8216700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0150aa0 con 0x7f8be00cb5a0 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40058/0 (socket says 172.21.15.26:40058) 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 -- 172.21.15.26:0/3163162309 learned_addr learned my addr 172.21.15.26:0/3163162309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be5fb2700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 0x7f8be0150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be67b3700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be015a400 0x7f8be015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 -- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 msgr2=0x7f8be0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 0x7f8be0150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 -- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be015a400 msgr2=0x7f8be015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be015a400 0x7f8be015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 -- 172.21.15.26:0/3163162309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0094f0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be5fb2700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 0x7f8be0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8be57b1700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0094c0 tx=0x7f8bdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.962+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00bba0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.963+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc011420 con 0x7f8be00cd9e0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.963+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be015f1c0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.963+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0117e0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.963+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be015f780 con 0x7f8be00cd9e0 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.964+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be004c3c0 con 0x7f8be00cd9e0 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.964+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8bdc011b90 con 0x7f8be00cd9e0 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.965+0000 7f8bd5ffb700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 0x7f8bc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.965+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bdc086690 con 0x7f8be00cd9e0 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.965+0000 7f8be5fb2700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 0x7f8bc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.965+0000 7f8be5fb2700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 0x7f8bc40697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009d80 tx=0x7f8bd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:52.969+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bdc0532e0 con 0x7f8be00cd9e0 2023-10-09T11:42:53.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.192+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8be00cd250 con 0x7f8bc4067320 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.194+0000 7f8bd5ffb700 1 -- 172.21.15.26:0/3163162309 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8be00cd250 con 0x7f8bc4067320 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:53.194 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:53.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 msgr2=0x7f8bc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 0x7f8bc40697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009d80 tx=0x7f8bd0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 msgr2=0x7f8be015e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0094c0 tx=0x7f8bdc017000 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 shutdown_connections 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be015a400 0x7f8be015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bc4067320 0x7f8bc40697d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8be00cb5a0 0x7f8be0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 --2- 172.21.15.26:0/3163162309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00cd9e0 0x7f8be015e600 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 >> 172.21.15.26:0/3163162309 conn(0x7f8be0070e30 msgr2=0x7f8be00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 shutdown_connections 2023-10-09T11:42:53.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.196+0000 7f8be8216700 1 -- 172.21.15.26:0/3163162309 wait complete. 2023-10-09T11:42:53.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:42:53.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.329+0000 7f011fb4e700 1 Processor -- start 2023-10-09T11:42:53.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.329+0000 7f011fb4e700 1 -- start start 2023-10-09T11:42:53.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011fb4e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 0x7f01180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011fb4e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011fb4e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180ccfd0 con 0x7f011806e0e0 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011fb4e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180cf0e0 con 0x7f0118159530 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011fb4e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011815a3d0 con 0x7f011806dc70 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011e0eb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f011806e0e0 0x7f01180cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39086/0 (socket says 172.21.15.26:39086) 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.330+0000 7f011e0eb700 1 -- 172.21.15.26:0/73579924 learned_addr learned my addr 172.21.15.26:0/73579924 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d8ea700 1 --2- 172.21.15.26:0/73579924 >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 0x7f01180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 --2- 172.21.15.26:0/73579924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011c8e8700 1 -- 172.21.15.26:0/73579924 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614093648 0 0) 0x7f01180ccfd0 con 0x7f011806e0e0 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011c8e8700 1 -- 172.21.15.26:0/73579924 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0100003570 con 0x7f011806e0e0 2023-10-09T11:42:53.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 -- 172.21.15.26:0/73579924 >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 msgr2=0x7f01180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 --2- 172.21.15.26:0/73579924 >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 0x7f01180ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 -- 172.21.15.26:0/73579924 >> v1:172.21.15.26:6789/0 conn(0x7f011806e0e0 legacy=0x7f01180cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 -- 172.21.15.26:0/73579924 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011815a6b0 con 0x7f011806dc70 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d8ea700 1 --2- 172.21.15.26:0/73579924 >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 0x7f01180ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011d0e9700 1 --2- 172.21.15.26:0/73579924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118159900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f010c0098e0 tx=0x7f010c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7fc2cdbd9e28d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011c8e8700 1 -- 172.21.15.26:0/73579924 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011630 con 0x7f011806dc70 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011c8e8700 1 -- 172.21.15.26:0/73579924 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c011790 con 0x7f011806dc70 2023-10-09T11:42:53.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.331+0000 7f011c8e8700 1 -- 172.21.15.26:0/73579924 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011b10 con 0x7f011806dc70 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 -- 172.21.15.26:0/73579924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 msgr2=0x7f0118159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 --2- 172.21.15.26:0/73579924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118159900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f010c0098e0 tx=0x7f010c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 -- 172.21.15.26:0/73579924 shutdown_connections 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 --2- 172.21.15.26:0/73579924 >> v2:172.21.15.67:3300/0 conn(0x7f0118159530 0x7f01180ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 --2- 172.21.15.26:0/73579924 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118159900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 -- 172.21.15.26:0/73579924 >> 172.21.15.26:0/73579924 conn(0x7f01180703a0 msgr2=0x7f01180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 -- 172.21.15.26:0/73579924 shutdown_connections 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.332+0000 7f011fb4e700 1 -- 172.21.15.26:0/73579924 wait complete. 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.333+0000 7f011fb4e700 1 Processor -- start 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.333+0000 7f011fb4e700 1 -- start start 2023-10-09T11:42:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 0x7f011815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180c9b50 con 0x7f011806e0e0 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180c9870 con 0x7f0118159530 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011fb4e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b54b0 con 0x7f011806dc70 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40060/0 (socket says 172.21.15.26:40060) 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 -- 172.21.15.26:0/3966335316 learned_addr learned my addr 172.21.15.26:0/3966335316 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011e0eb700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 0x7f011815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d8ea700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 -- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 msgr2=0x7f0118153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 -- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 msgr2=0x7f011815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 0x7f011815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d0e9700 1 -- 172.21.15.26:0/3966335316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108009a20 con 0x7f011806e0e0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011d8ea700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.334+0000 7f011e0eb700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 0x7f011815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f011d0e9700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f011815a510 tx=0x7f010c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011b10 con 0x7f011806e0e0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c000cc0 con 0x7f011806e0e0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c01a680 con 0x7f011806e0e0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c009420 con 0x7f011806e0e0 2023-10-09T11:42:53.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.335+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180b5a70 con 0x7f011806e0e0 2023-10-09T11:42:53.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.336+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01180b5310 con 0x7f011806e0e0 2023-10-09T11:42:53.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.337+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f010c01aa70 con 0x7f011806e0e0 2023-10-09T11:42:53.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.337+0000 7f0115ffb700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 0x7f01040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.337+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f010c086920 con 0x7f011806e0e0 2023-10-09T11:42:53.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.337+0000 7f011d8ea700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 0x7f01040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.338+0000 7f011d8ea700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 0x7f01040697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f01080099f0 tx=0x7f010800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.341+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01180b5310 con 0x7f011806e0e0 2023-10-09T11:42:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.533+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f01180b5310 con 0x7f011806e0e0 2023-10-09T11:42:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.533+0000 7f0115ffb700 1 -- 172.21.15.26:0/3966335316 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01180b5310 con 0x7f011806e0e0 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 msgr2=0x7f01040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 0x7f01040697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f01080099f0 tx=0x7f010800b040 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 msgr2=0x7f01180c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f011815a510 tx=0x7f010c017000 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 shutdown_connections 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0118159530 0x7f011815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0104067320 0x7f01040697d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011806dc70 0x7f0118153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 --2- 172.21.15.26:0/3966335316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011806e0e0 0x7f01180c8f00 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 >> 172.21.15.26:0/3966335316 conn(0x7f01180703a0 msgr2=0x7f01180d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 shutdown_connections 2023-10-09T11:42:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.535+0000 7f011fb4e700 1 -- 172.21.15.26:0/3966335316 wait complete. 2023-10-09T11:42:53.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:42:53.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:53.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:53.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:42:53.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:53.583 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:42:53.638 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:42:53.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:53.639 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:53.681 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:42:53.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:53.682 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:42:53.739 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:42:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:53.740 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:42:53.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:42:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T11:42:53.754 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:42:53.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:53.755 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:42:53.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:42:53.797 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T11:42:53.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000601189 --yes-i-really-mean-it 2023-10-09T11:42:53.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 Processor -- start 2023-10-09T11:42:53.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 -- start start 2023-10-09T11:42:53.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad4157460 0x7f7ad406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad40c7180 0x7f7ad40c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad406d3e0 con 0x7f7ad4157830 2023-10-09T11:42:53.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad406ddb0 con 0x7f7ad4157460 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.921+0000 7f7ad950c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c7ad0 con 0x7f7ad40c7180 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad4157460 0x7f7ad406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad4157460 0x7f7ad406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40064/0 (socket says 172.21.15.26:40064) 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/2530137069 learned_addr learned my addr 172.21.15.26:0/2530137069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad40c7180 0x7f7ad40c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/2530137069 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad40c7180 msgr2=0x7f7ad40c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad40c7180 0x7f7ad40c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/2530137069 >> v1:172.21.15.67:6789/0 conn(0x7f7ad4157830 legacy=0x7f7ad40c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/2530137069 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad406c7d0 con 0x7f7ad4157460 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157460 0x7f7ad406d870 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099b0 tx=0x7f7ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d33cb7af242eee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/2530137069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4009ea0 con 0x7f7ad4157460 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/2530137069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400b860 con 0x7f7ad4157460 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.922+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/2530137069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400bc00 con 0x7f7ad4157460 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 -- 172.21.15.26:0/2530137069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157460 msgr2=0x7f7ad406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157460 0x7f7ad406d870 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099b0 tx=0x7f7ac4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 -- 172.21.15.26:0/2530137069 shutdown_connections 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad40c7180 0x7f7ad40c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 --2- 172.21.15.26:0/2530137069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157460 0x7f7ad406d870 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 -- 172.21.15.26:0/2530137069 >> 172.21.15.26:0/2530137069 conn(0x7f7ad406edb0 msgr2=0x7f7ad406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 -- 172.21.15.26:0/2530137069 shutdown_connections 2023-10-09T11:42:53.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.923+0000 7f7ad950c700 1 -- 172.21.15.26:0/2530137069 wait complete. 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.924+0000 7f7ad950c700 1 Processor -- start 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.924+0000 7f7ad950c700 1 -- start start 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 0x7f7ad4157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 0x7f7ad41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40b2aa0 con 0x7f7ad4157830 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41581b0 con 0x7f7ad40c7180 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad950c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415a3b0 con 0x7f7ad4157460 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40080/0 (socket says 172.21.15.26:40080) 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 -- 172.21.15.26:0/1997384774 learned_addr learned my addr 172.21.15.26:0/1997384774 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 0x7f7ad4157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad27fc700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 0x7f7ad41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 -- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 msgr2=0x7f7ad41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 0x7f7ad41464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 -- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 msgr2=0x7f7ad4157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 0x7f7ad4157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 -- 172.21.15.26:0/1997384774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40094f0 con 0x7f7ad4157830 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 0x7f7ad4157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad27fc700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 0x7f7ad41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.925+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e90 tx=0x7f7acc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.926+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00cbc0 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.926+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00f040 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.926+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad415a6b0 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.926+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc014480 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.926+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad4152a40 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.927+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad415ae50 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.927+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7acc0147f0 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.927+0000 7f7abaffd700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 0x7f7ac00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.927+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7acc085a80 con 0x7f7ad4157830 2023-10-09T11:42:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.928+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 0x7f7ac00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.928+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 0x7f7ac00697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099b0 tx=0x7f7ac4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:53.932+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ad415ae50 con 0x7f7ad4157830 2023-10-09T11:42:54.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:54.158+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000601189", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7ad415ae50 con 0x7f7ac0067320 2023-10-09T11:42:56.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:56.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.838+0000 7f7abaffd700 1 -- 172.21.15.26:0/1997384774 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f7ad415ae50 con 0x7f7ac0067320 2023-10-09T11:42:56.839 INFO:teuthology.orchestra.run.smithi026.stdout:FS volume 'cephfs' renamed to 'volume_0000000000601189' 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 msgr2=0x7f7ac00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 0x7f7ac00697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099b0 tx=0x7f7ac4017000 comp rx=0 tx=0).stop 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 msgr2=0x7f7ad41595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e90 tx=0x7f7acc00b040 comp rx=0 tx=0).stop 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 shutdown_connections 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad4157830 0x7f7ad41595d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ad40c7180 0x7f7ad4157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7ac0067320 0x7f7ac00697d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 --2- 172.21.15.26:0/1997384774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ad4157460 0x7f7ad41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 >> 172.21.15.26:0/1997384774 conn(0x7f7ad406edb0 msgr2=0x7f7ad40c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 shutdown_connections 2023-10-09T11:42:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.841+0000 7f7ad950c700 1 -- 172.21.15.26:0/1997384774 wait complete. 2023-10-09T11:42:56.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:56.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.984+0000 7f304df5b700 1 Processor -- start 2023-10-09T11:42:56.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.984+0000 7f304df5b700 1 -- start start 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f304df5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30481598b0 0x7f30480af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f304df5b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480ce9d0 con 0x7f30480af790 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f304df5b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480afc30 con 0x7f3048159c80 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f304df5b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30480aff10 con 0x7f30481598b0 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f30477fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30481598b0 0x7f30480af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f30477fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30481598b0 0x7f30480af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40084/0 (socket says 172.21.15.26:40084) 2023-10-09T11:42:56.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f30477fe700 1 -- 172.21.15.26:0/2815008700 learned_addr learned my addr 172.21.15.26:0/2815008700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.985+0000 7f3047fff700 1 --1- 172.21.15.26:0/2815008700 >> v1:172.21.15.26:6789/0 conn(0x7f30480af790 0x7f3048163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39100/0 (socket says 172.21.15.26:39100) 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30477fe700 1 -- 172.21.15.26:0/2815008700 >> v1:172.21.15.67:6789/0 conn(0x7f3048159c80 legacy=0x7f30480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30477fe700 1 -- 172.21.15.26:0/2815008700 >> v1:172.21.15.26:6789/0 conn(0x7f30480af790 legacy=0x7f3048163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30477fe700 1 -- 172.21.15.26:0/2815008700 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480ce380 con 0x7f30481598b0 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30467fc700 1 -- 172.21.15.26:0/2815008700 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930751581 0 0) 0x7f30480ce9d0 con 0x7f30480af790 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30477fe700 1 --2- 172.21.15.26:0/2815008700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30481598b0 0x7f30480af250 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f30380099b0 tx=0x7f3038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb75ae140856eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30467fc700 1 -- 172.21.15.26:0/2815008700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800b860 con 0x7f30481598b0 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30467fc700 1 -- 172.21.15.26:0/2815008700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800b9c0 con 0x7f30481598b0 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f30467fc700 1 -- 172.21.15.26:0/2815008700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800bd60 con 0x7f30481598b0 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f304df5b700 1 -- 172.21.15.26:0/2815008700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30481598b0 msgr2=0x7f30480af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.986+0000 7f304df5b700 1 --2- 172.21.15.26:0/2815008700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30481598b0 0x7f30480af250 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f30380099b0 tx=0x7f3038009250 comp rx=0 tx=0).stop 2023-10-09T11:42:56.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.987+0000 7f304df5b700 1 -- 172.21.15.26:0/2815008700 shutdown_connections 2023-10-09T11:42:56.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.987+0000 7f304df5b700 1 --2- 172.21.15.26:0/2815008700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30481598b0 0x7f30480af250 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.987+0000 7f304df5b700 1 -- 172.21.15.26:0/2815008700 >> 172.21.15.26:0/2815008700 conn(0x7f3048070e30 msgr2=0x7f30480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:56.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.987+0000 7f304df5b700 1 -- 172.21.15.26:0/2815008700 shutdown_connections 2023-10-09T11:42:56.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.987+0000 7f304df5b700 1 -- 172.21.15.26:0/2815008700 wait complete. 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.988+0000 7f304df5b700 1 Processor -- start 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.988+0000 7f304df5b700 1 -- start start 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30480af790 0x7f3048151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 0x7f30480b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480b4ec0 con 0x7f3048159c80 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304813dc20 con 0x7f30481598b0 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30480b4a30 con 0x7f30480af790 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40088/0 (socket says 172.21.15.26:40088) 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 -- 172.21.15.26:0/3175066744 learned_addr learned my addr 172.21.15.26:0/3175066744 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f30477fe700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30480af790 0x7f3048151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3046ffd700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 0x7f30480b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 -- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30480af790 msgr2=0x7f3048151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30480af790 0x7f3048151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 -- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 msgr2=0x7f30480b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 0x7f30480b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 -- 172.21.15.26:0/3175066744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380094f0 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3046ffd700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 0x7f30480b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f3047fff700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f304000cd80 tx=0x7f3040001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000ce80 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040005df0 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3048151f80 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.989+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000ab30 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.990+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30480b43e0 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.991+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304804c3c0 con 0x7f3048159c80 2023-10-09T11:42:56.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.991+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30400070f0 con 0x7f3048159c80 2023-10-09T11:42:56.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.991+0000 7f302f7fe700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 0x7f30340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.992+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f3040084d30 con 0x7f3048159c80 2023-10-09T11:42:56.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.992+0000 7f30477fe700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 0x7f30340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.992+0000 7f30477fe700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 0x7f30340697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f30380099b0 tx=0x7f3038017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:56.996+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30400519f0 con 0x7f3048159c80 2023-10-09T11:42:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.215+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f30480c6740 con 0x7f3034067320 2023-10-09T11:42:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.217+0000 7f302f7fe700 1 -- 172.21.15.26:0/3175066744 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f30480c6740 con 0x7f3034067320 2023-10-09T11:42:57.217 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:42:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:42:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000000601189" 2023-10-09T11:42:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:42:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:42:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 msgr2=0x7f30340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 0x7f30340697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f30380099b0 tx=0x7f3038017000 comp rx=0 tx=0).stop 2023-10-09T11:42:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 msgr2=0x7f304814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f304000cd80 tx=0x7f3040001ae0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 shutdown_connections 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3048159c80 0x7f304814ebe0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3034067320 0x7f30340697d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30480af790 0x7f3048151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 --2- 172.21.15.26:0/3175066744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30481598b0 0x7f30480b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 >> 172.21.15.26:0/3175066744 conn(0x7f3048070e30 msgr2=0x7f30480b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.219+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 shutdown_connections 2023-10-09T11:42:57.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.220+0000 7f304df5b700 1 -- 172.21.15.26:0/3175066744 wait complete. 2023-10-09T11:42:57.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:57.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.351+0000 7fbd1aff4700 1 Processor -- start 2023-10-09T11:42:57.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.351+0000 7fbd1aff4700 1 -- start start 2023-10-09T11:42:57.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd14159550 0x7fbd140ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 0x7fbd140aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd14159920 0x7fbd140ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140acc00 con 0x7fbd14159920 2023-10-09T11:42:57.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140abff0 con 0x7fbd1415dfd0 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1aff4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140ac2d0 con 0x7fbd14159550 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1a7f3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd14159920 0x7fbd140ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1a7f3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd14159920 0x7fbd140ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40090/0 (socket says 172.21.15.26:40090) 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1a7f3700 1 -- 172.21.15.26:0/407932810 learned_addr learned my addr 172.21.15.26:0/407932810 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd1a7f3700 1 -- 172.21.15.26:0/407932810 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd14159550 msgr2=0x7fbd140ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd19ff2700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd14159550 0x7fbd140ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.352+0000 7fbd197f1700 1 --2- 172.21.15.26:0/407932810 >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 0x7fbd140aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1a7f3700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd14159550 0x7fbd140ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1a7f3700 1 -- 172.21.15.26:0/407932810 >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 msgr2=0x7fbd140aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1a7f3700 1 --2- 172.21.15.26:0/407932810 >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 0x7fbd140aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1a7f3700 1 -- 172.21.15.26:0/407932810 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140ac5b0 con 0x7fbd14159920 2023-10-09T11:42:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd197f1700 1 --2- 172.21.15.26:0/407932810 >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 0x7fbd140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1a7f3700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd140ad090 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406b120 tx=0x7fbd0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f066ec5028c9e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd18ff0700 1 -- 172.21.15.26:0/407932810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00b860 con 0x7fbd14159920 2023-10-09T11:42:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd18ff0700 1 -- 172.21.15.26:0/407932810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00b9c0 con 0x7fbd14159920 2023-10-09T11:42:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd18ff0700 1 -- 172.21.15.26:0/407932810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00bd60 con 0x7fbd14159920 2023-10-09T11:42:57.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 -- 172.21.15.26:0/407932810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 msgr2=0x7fbd140ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd140ad090 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406b120 tx=0x7fbd0c009250 comp rx=0 tx=0).stop 2023-10-09T11:42:57.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 -- 172.21.15.26:0/407932810 shutdown_connections 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd140ad090 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/407932810 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd14159550 0x7fbd140ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/407932810 >> v2:172.21.15.67:3300/0 conn(0x7fbd1415dfd0 0x7fbd140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.353+0000 7fbd1aff4700 1 -- 172.21.15.26:0/407932810 >> 172.21.15.26:0/407932810 conn(0x7fbd1406ce80 msgr2=0x7fbd140ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.354+0000 7fbd1aff4700 1 -- 172.21.15.26:0/407932810 shutdown_connections 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.354+0000 7fbd1aff4700 1 -- 172.21.15.26:0/407932810 wait complete. 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 Processor -- start 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 -- start start 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 0x7fbd1416d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 0x7fbd14152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415dc60 con 0x7fbd14159920 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14158e00 con 0x7fbd14159550 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd1aff4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1416e4b0 con 0x7fbd1415dfd0 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.355+0000 7fbd197f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40100/0 (socket says 172.21.15.26:40100) 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 -- 172.21.15.26:0/1145741311 learned_addr learned my addr 172.21.15.26:0/1145741311 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd19ff2700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 0x7fbd1416d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd1a7f3700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 0x7fbd14152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 -- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 msgr2=0x7fbd14152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 0x7fbd14152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 -- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 msgr2=0x7fbd1416d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 0x7fbd1416d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 -- 172.21.15.26:0/1145741311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0094f0 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd19ff2700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 0x7fbd1416d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd1a7f3700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 0x7fbd14152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd197f1700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c850 tx=0x7fbd08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08011600 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08011780 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08011b40 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1416dc10 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.356+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1416e1d0 con 0x7fbd14159920 2023-10-09T11:42:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.357+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd140cf350 con 0x7fbd14159920 2023-10-09T11:42:57.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.358+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbd08010350 con 0x7fbd14159920 2023-10-09T11:42:57.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.358+0000 7fbd11ffb700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 0x7fbd000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.358+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fbd08084c70 con 0x7fbd14159920 2023-10-09T11:42:57.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.358+0000 7fbd19ff2700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 0x7fbd000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.359+0000 7fbd19ff2700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 0x7fbd000697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e5a0 tx=0x7fbd04007710 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.362+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd080517a0 con 0x7fbd14159920 2023-10-09T11:42:57.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.600+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd140acd90 con 0x7fbd14159920 2023-10-09T11:42:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.600+0000 7fbd11ffb700 1 -- 172.21.15.26:0/1145741311 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fbd0801e090 con 0x7fbd14159920 2023-10-09T11:42:57.601 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:57.601 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:54.820383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000601189","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:42:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 msgr2=0x7fbd000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 0x7fbd000697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e5a0 tx=0x7fbd04007710 comp rx=0 tx=0).stop 2023-10-09T11:42:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 msgr2=0x7fbd141588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c850 tx=0x7fbd08008040 comp rx=0 tx=0).stop 2023-10-09T11:42:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 shutdown_connections 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd00067320 0x7fbd000697d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd1415dfd0 0x7fbd14152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd14159550 0x7fbd1416d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 --2- 172.21.15.26:0/1145741311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14159920 0x7fbd141588c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 >> 172.21.15.26:0/1145741311 conn(0x7fbd1406ce80 msgr2=0x7fbd140b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 shutdown_connections 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.603+0000 7fbd1aff4700 1 -- 172.21.15.26:0/1145741311 wait complete. 2023-10-09T11:42:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 94 2023-10-09T11:42:57.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.733+0000 7f3fd4115700 1 Processor -- start 2023-10-09T11:42:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 -- start start 2023-10-09T11:42:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fcc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fcc0cfe70 0x7f3fcc0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc0ce9d0 con 0x7f3fcc1598b0 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0af960 con 0x7f3fcc0cfe70 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd4115700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0afc30 con 0x7f3fcc159c80 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.734+0000 7f3fd1eb1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3fcc1598b0 0x7f3fcc0af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39106/0 (socket says 172.21.15.26:39106) 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd1eb1700 1 -- 172.21.15.26:0/515015896 learned_addr learned my addr 172.21.15.26:0/515015896 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd16b0700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fcc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181206268 0 0) 0x7f3fcc0ce9d0 con 0x7f3fcc1598b0 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd26b2700 1 --2- 172.21.15.26:0/515015896 >> v2:172.21.15.67:3300/0 conn(0x7f3fcc0cfe70 0x7f3fcc0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb4003570 con 0x7f3fcc1598b0 2023-10-09T11:42:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69758113 0 0) 0x7f3fb4003570 con 0x7f3fcc1598b0 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 msgr2=0x7f3fcc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fcc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 >> v2:172.21.15.67:3300/0 conn(0x7f3fcc0cfe70 msgr2=0x7f3fcc0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 --2- 172.21.15.26:0/515015896 >> v2:172.21.15.67:3300/0 conn(0x7f3fcc0cfe70 0x7f3fcc0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0aff10 con 0x7f3fcc1598b0 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3fbc001470 con 0x7f3fcc1598b0 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 >> v1:172.21.15.26:6789/0 conn(0x7f3fcc1598b0 legacy=0x7f3fcc0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fb4003a60 0x7f3fb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0af960 con 0x7f3fb4003a60 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0afc30 con 0x7f3fb4004d50 2023-10-09T11:42:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb400ba60 con 0x7f3fcc159c80 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fb4003a60 0x7f3fb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd16b0700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.735+0000 7f3fd26b2700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 -- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 msgr2=0x7f3fb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fcc159c80 0x7f3fb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 -- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb4004d50 msgr2=0x7f3fb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 -- 172.21.15.26:0/515015896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4003570 con 0x7f3fb4003a60 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fb4003a60 0x7f3fb4003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c3c0 tx=0x7f3fbc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfd1ad1c5e657d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00cc30 con 0x7f3fb4003a60 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00cdb0 con 0x7f3fb4003a60 2023-10-09T11:42:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd0eaf700 1 -- 172.21.15.26:0/515015896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc005b70 con 0x7f3fb4003a60 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd4115700 1 -- 172.21.15.26:0/515015896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fb4003a60 msgr2=0x7f3fb4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd4115700 1 --2- 172.21.15.26:0/515015896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fb4003a60 0x7f3fb4003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c3c0 tx=0x7f3fbc001e90 comp rx=0 tx=0).stop 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd26b2700 1 -- 172.21.15.26:0/515015896 reap_dead start 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd4115700 1 -- 172.21.15.26:0/515015896 shutdown_connections 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.736+0000 7f3fd4115700 1 -- 172.21.15.26:0/515015896 >> 172.21.15.26:0/515015896 conn(0x7f3fcc070e30 msgr2=0x7f3fcc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.737+0000 7f3fd4115700 1 -- 172.21.15.26:0/515015896 shutdown_connections 2023-10-09T11:42:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.737+0000 7f3fd4115700 1 -- 172.21.15.26:0/515015896 wait complete. 2023-10-09T11:42:57.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 Processor -- start 2023-10-09T11:42:57.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 -- start start 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 0x7f3fcc1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 0x7f3fcc13a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc13aae0 con 0x7f3fcc0c9040 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0c7fa0 con 0x7f3fcc0c77c0 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.738+0000 7f3fd4115700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0c8280 con 0x7f3fb4003a60 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40114/0 (socket says 172.21.15.26:40114) 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 -- 172.21.15.26:0/3170953972 learned_addr learned my addr 172.21.15.26:0/3170953972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 0x7f3fcc1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd16b0700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 0x7f3fcc13a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 -- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 msgr2=0x7f3fcc1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 0x7f3fcc1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 -- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 msgr2=0x7f3fcc13a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 0x7f3fcc13a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 -- 172.21.15.26:0/3170953972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0c8560 con 0x7f3fcc0c9040 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 0x7f3fcc1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd16b0700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 0x7f3fcc13a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd26b2700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0d0290 tx=0x7f3fc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400e040 con 0x7f3fcc0c9040 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400f040 con 0x7f3fcc0c9040 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0c8840 con 0x7f3fcc0c9040 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400fe20 con 0x7f3fcc0c9040 2023-10-09T11:42:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.739+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc0c7c30 con 0x7f3fcc0c9040 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.740+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0c8d40 con 0x7f3fcc0c9040 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.741+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fc4015640 con 0x7f3fcc0c9040 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.741+0000 7f3fc9ffb700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 0x7f3fb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.741+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f3fc40855a0 con 0x7f3fcc0c9040 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.741+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 0x7f3fb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.742+0000 7f3fd1eb1700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 0x7f3fb80697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001ed0 tx=0x7f3fbc015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.746+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fc4052090 con 0x7f3fcc0c9040 2023-10-09T11:42:57.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.942+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fcc04c3c0 con 0x7f3fcc0c9040 2023-10-09T11:42:57.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.943+0000 7f3fc9ffb700 1 -- 172.21.15.26:0/3170953972 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f3fc40556b0 con 0x7f3fcc0c9040 2023-10-09T11:42:57.943 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:57.944 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":141,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:56.829403+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000601189.meta","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000601189"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000601189.data","create_time":"2023-10-09T11:42:42.124868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000601189"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 msgr2=0x7f3fb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 0x7f3fb80697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001ed0 tx=0x7f3fbc015000 comp rx=0 tx=0).stop 2023-10-09T11:42:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 msgr2=0x7f3fcc0b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0d0290 tx=0x7f3fc400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 shutdown_connections 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fcc0c9040 0x7f3fcc0b54c0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3fb8067320 0x7f3fb80697d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fb4003a60 0x7f3fcc1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 --2- 172.21.15.26:0/3170953972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fcc0c77c0 0x7f3fcc13a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 >> 172.21.15.26:0/3170953972 conn(0x7f3fcc070e30 msgr2=0x7f3fcc14df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 shutdown_connections 2023-10-09T11:42:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:57.945+0000 7f3fd4115700 1 -- 172.21.15.26:0/3170953972 wait complete. 2023-10-09T11:42:57.957 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:57.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:57.993 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:58.036 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:58.036 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.155+0000 7efdd6457700 1 Processor -- start 2023-10-09T11:42:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.155+0000 7efdd6457700 1 -- start start 2023-10-09T11:42:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd6457700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 0x7efdd00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd6457700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 0x7efdd006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd6457700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd015a280 con 0x7efdd00b07d0 2023-10-09T11:42:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd6457700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd006e180 con 0x7efdd00cf200 2023-10-09T11:42:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd6457700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd006d850 con 0x7efdd00b0ba0 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdd49f4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 0x7efdd006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdcf7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 0x7efdd00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdcffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efdd00b07d0 0x7efdd00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:49386/0 (socket says 172.21.15.26:49386) 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdcffff700 1 -- 172.21.15.26:0/4050691161 learned_addr learned my addr 172.21.15.26:0/4050691161 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdceffd700 1 -- 172.21.15.26:0/4050691161 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452905692 0 0) 0x7efdd015a280 con 0x7efdd00b07d0 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.156+0000 7efdceffd700 1 -- 172.21.15.26:0/4050691161 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb8003570 con 0x7efdd00b07d0 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd49f4700 1 -- 172.21.15.26:0/4050691161 >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 msgr2=0x7efdd00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd49f4700 1 --2- 172.21.15.26:0/4050691161 >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 0x7efdd00c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd49f4700 1 -- 172.21.15.26:0/4050691161 >> v1:172.21.15.67:6789/0 conn(0x7efdd00b07d0 legacy=0x7efdd00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd49f4700 1 -- 172.21.15.26:0/4050691161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd006db30 con 0x7efdd00b0ba0 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdcf7fe700 1 --2- 172.21.15.26:0/4050691161 >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 0x7efdd00c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd49f4700 1 --2- 172.21.15.26:0/4050691161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 0x7efdd006e610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009e60 tx=0x7efdc8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10696d46b19ce3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdceffd700 1 -- 172.21.15.26:0/4050691161 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800e070 con 0x7efdd00b0ba0 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdceffd700 1 -- 172.21.15.26:0/4050691161 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800bab0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdceffd700 1 -- 172.21.15.26:0/4050691161 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800be30 con 0x7efdd00b0ba0 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd6457700 1 -- 172.21.15.26:0/4050691161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 msgr2=0x7efdd006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.157+0000 7efdd6457700 1 --2- 172.21.15.26:0/4050691161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 0x7efdd006e610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009e60 tx=0x7efdc8009780 comp rx=0 tx=0).stop 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 -- 172.21.15.26:0/4050691161 shutdown_connections 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 --2- 172.21.15.26:0/4050691161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b0ba0 0x7efdd006e610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 --2- 172.21.15.26:0/4050691161 >> v2:172.21.15.67:3300/0 conn(0x7efdd00cf200 0x7efdd00c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 -- 172.21.15.26:0/4050691161 >> 172.21.15.26:0/4050691161 conn(0x7efdd006ce80 msgr2=0x7efdd00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 -- 172.21.15.26:0/4050691161 shutdown_connections 2023-10-09T11:42:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.158+0000 7efdd6457700 1 -- 172.21.15.26:0/4050691161 wait complete. 2023-10-09T11:42:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.159+0000 7efdd6457700 1 Processor -- start 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.159+0000 7efdd6457700 1 -- start start 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b07d0 0x7efdd01443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 0x7efdd009a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c6f30 con 0x7efdd00b0ba0 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c6320 con 0x7efdd00cf200 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00c6600 con 0x7efdd00b07d0 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40116/0 (socket says 172.21.15.26:40116) 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 -- 172.21.15.26:0/1616441757 learned_addr learned my addr 172.21.15.26:0/1616441757 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd49f4700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 0x7efdd009a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcffff700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b07d0 0x7efdd01443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 -- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b07d0 msgr2=0x7efdd01443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b07d0 0x7efdd01443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 -- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 msgr2=0x7efdd009a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 0x7efdd009a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 -- 172.21.15.26:0/1616441757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009420 con 0x7efdd00b0ba0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd49f4700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 0x7efdd009a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdcf7fe700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ec80 tx=0x7efdc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000c9d0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000cb30 con 0x7efdd00b0ba0 2023-10-09T11:42:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc8009a20 con 0x7efdd00b0ba0 2023-10-09T11:42:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000ceb0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.160+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd00c6bc0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.161+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd01699e0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.162+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efdc0013680 con 0x7efdd00b0ba0 2023-10-09T11:42:58.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.162+0000 7efdb7fff700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 0x7efdbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.162+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7efdc0085110 con 0x7efdd00b0ba0 2023-10-09T11:42:58.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.162+0000 7efdcffff700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 0x7efdbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.163+0000 7efdcffff700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 0x7efdbc0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c00 tx=0x7efdc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.166+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdd01699e0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.404+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdd01699e0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.405+0000 7efdb7fff700 1 -- 172.21.15.26:0/1616441757 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4612 (secure 0 0 0) 0x7efdd01699e0 con 0x7efdd00b0ba0 2023-10-09T11:42:58.405 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:58.406 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:54.820383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000601189","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:42:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 msgr2=0x7efdbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 0x7efdbc0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c00 tx=0x7efdc4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 msgr2=0x7efdd00c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ec80 tx=0x7efdc00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 shutdown_connections 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdd00cf200 0x7efdd009a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efdbc067320 0x7efdbc0697d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efdd00b07d0 0x7efdd01443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 --2- 172.21.15.26:0/1616441757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdd00b0ba0 0x7efdd00c8130 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 >> 172.21.15.26:0/1616441757 conn(0x7efdd006ce80 msgr2=0x7efdd00ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 shutdown_connections 2023-10-09T11:42:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.407+0000 7efdd6457700 1 -- 172.21.15.26:0/1616441757 wait complete. 2023-10-09T11:42:58.409 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 94 2023-10-09T11:42:58.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:58.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.538+0000 7f2d17449700 1 Processor -- start 2023-10-09T11:42:58.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.538+0000 7f2d17449700 1 -- start start 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d17449700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d100cb5a0 0x7f2d100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d17449700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d1015a5d0 0x7f2d10156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d17449700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1015ae40 con 0x7f2d100cd9e0 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d17449700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100d13f0 con 0x7f2d100cb5a0 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d17449700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015ab60 con 0x7f2d1015a5d0 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d149e4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d100cd9e0 0x7f2d10159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39122/0 (socket says 172.21.15.26:39122) 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.539+0000 7f2d149e4700 1 -- 172.21.15.26:0/3063275222 learned_addr learned my addr 172.21.15.26:0/3063275222 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3063275222 >> v2:172.21.15.67:3300/0 conn(0x7f2d100cb5a0 0x7f2d100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d159e6700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d1015a5d0 0x7f2d10156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610532815 0 0) 0x7f2d1015ae40 con 0x7f2d100cd9e0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf8003570 con 0x7f2d100cd9e0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 -- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d1015a5d0 msgr2=0x7f2d10156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d1015a5d0 0x7f2d10156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 -- 172.21.15.26:0/3063275222 >> v1:172.21.15.26:6789/0 conn(0x7f2d100cd9e0 legacy=0x7f2d10159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011143029 0 0) 0x7f2cf8003570 con 0x7f2d100cd9e0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 -- 172.21.15.26:0/3063275222 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100ccf00 con 0x7f2d100cb5a0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cb5a0 0x7f2d100cb970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009e90 tx=0x7f2d00009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c81cf4f2aa7849 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000e070 con 0x7f2d100cb5a0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000b870 con 0x7f2d100cb5a0 2023-10-09T11:42:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.540+0000 7f2d0ffff700 1 -- 172.21.15.26:0/3063275222 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04001470 con 0x7f2d100cb5a0 2023-10-09T11:42:58.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 -- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cb5a0 msgr2=0x7f2d100cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cb5a0 0x7f2d100cb970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009e90 tx=0x7f2d00009780 comp rx=0 tx=0).stop 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 -- 172.21.15.26:0/3063275222 shutdown_connections 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d1015a5d0 0x7f2d10156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 --2- 172.21.15.26:0/3063275222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cb5a0 0x7f2d100cb970 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 -- 172.21.15.26:0/3063275222 >> 172.21.15.26:0/3063275222 conn(0x7f2d10070e30 msgr2=0x7f2d100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 -- 172.21.15.26:0/3063275222 shutdown_connections 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.541+0000 7f2d17449700 1 -- 172.21.15.26:0/3063275222 wait complete. 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.542+0000 7f2d17449700 1 Processor -- start 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.542+0000 7f2d17449700 1 -- start start 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 0x7f2d100c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 0x7f2d10169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1016a050 con 0x7f2d1015a5d0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c8b20 con 0x7f2d100cd9e0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d17449700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c7860 con 0x7f2d100cb5a0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40126/0 (socket says 172.21.15.26:40126) 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 -- 172.21.15.26:0/3248922497 learned_addr learned my addr 172.21.15.26:0/3248922497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 0x7f2d100c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d149e4700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 0x7f2d10169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 -- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 msgr2=0x7f2d100c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 0x7f2d100c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 -- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 msgr2=0x7f2d10169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 0x7f2d10169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.543+0000 7f2d159e6700 1 -- 172.21.15.26:0/3248922497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00009a20 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d149e4700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 0x7f2d10169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 0x7f2d100c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d159e6700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e8d0 tx=0x7f2d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800ee70 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800c850 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100c7b00 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800cc50 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.544+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d100c8140 con 0x7f2d1015a5d0 2023-10-09T11:42:58.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.545+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004c3c0 con 0x7f2d1015a5d0 2023-10-09T11:42:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.545+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d08013680 con 0x7f2d1015a5d0 2023-10-09T11:42:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.546+0000 7f2d0d7fa700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 0x7f2cfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.546+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2d08084e80 con 0x7f2d1015a5d0 2023-10-09T11:42:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.546+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 0x7f2cfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.547+0000 7f2d151e5700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 0x7f2cfc0697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000b840 tx=0x7f2d00017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.550+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d08051ac0 con 0x7f2d1015a5d0 2023-10-09T11:42:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.744+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d1006ca30 con 0x7f2d1015a5d0 2023-10-09T11:42:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.745+0000 7f2d0d7fa700 1 -- 172.21.15.26:0/3248922497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f2d080550e0 con 0x7f2d1015a5d0 2023-10-09T11:42:58.746 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:42:58.746 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":141,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:56.829403+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000601189.meta","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000601189"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000601189.data","create_time":"2023-10-09T11:42:42.124868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000601189"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.747+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 msgr2=0x7f2cfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.747+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 0x7f2cfc0697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000b840 tx=0x7f2d00017000 comp rx=0 tx=0).stop 2023-10-09T11:42:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.747+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 msgr2=0x7f2d100c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.747+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e8d0 tx=0x7f2d080091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 shutdown_connections 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d1015a5d0 0x7f2d100c85e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2cfc067320 0x7f2cfc0697d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d100cb5a0 0x7f2d100c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 --2- 172.21.15.26:0/3248922497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100cd9e0 0x7f2d10169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 >> 172.21.15.26:0/3248922497 conn(0x7f2d10070e30 msgr2=0x7f2d100b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 shutdown_connections 2023-10-09T11:42:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.748+0000 7f2d17449700 1 -- 172.21.15.26:0/3248922497 wait complete. 2023-10-09T11:42:58.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs.volume_0000000000601189.meta', 'create_time': '2023-10-09T11:42:41.556400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000601189'}}}, {'pool': 25, 'pool_name': 'cephfs.volume_0000000000601189.data', 'create_time': '2023-10-09T11:42:42.124868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000601189'}}}] 2023-10-09T11:42:58.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.883+0000 7fc832f48700 1 Processor -- start 2023-10-09T11:42:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.883+0000 7fc832f48700 1 -- start start 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82c153a00 0x7fc82c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc82c0cea00 0x7fc82c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c0cf3c0 con 0x7fc82c153a00 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c15af60 con 0x7fc82c0cea00 2023-10-09T11:42:58.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832f48700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c15b240 con 0x7fc82c15de50 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82c153a00 0x7fc82c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc82c153a00 0x7fc82c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40136/0 (socket says 172.21.15.26:40136) 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 -- 172.21.15.26:0/2777161170 learned_addr learned my addr 172.21.15.26:0/2777161170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831745700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc832747700 1 --2- 172.21.15.26:0/2777161170 >> v2:172.21.15.67:3300/0 conn(0x7fc82c0cea00 0x7fc82c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 -- 172.21.15.26:0/2777161170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 msgr2=0x7fc82c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 -- 172.21.15.26:0/2777161170 >> v2:172.21.15.67:3300/0 conn(0x7fc82c0cea00 msgr2=0x7fc82c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 --2- 172.21.15.26:0/2777161170 >> v2:172.21.15.67:3300/0 conn(0x7fc82c0cea00 0x7fc82c0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831f46700 1 -- 172.21.15.26:0/2777161170 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c15b520 con 0x7fc82c153a00 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.884+0000 7fc831745700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:58.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc831f46700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c153a00 0x7fc82c153dd0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc824009f20 tx=0x7fc824009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635cac95251bd03c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc830f44700 1 -- 172.21.15.26:0/2777161170 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400e070 con 0x7fc82c153a00 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc830f44700 1 -- 172.21.15.26:0/2777161170 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82400ba40 con 0x7fc82c153a00 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc830f44700 1 -- 172.21.15.26:0/2777161170 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240092e0 con 0x7fc82c153a00 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 -- 172.21.15.26:0/2777161170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c153a00 msgr2=0x7fc82c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c153a00 0x7fc82c153dd0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc824009f20 tx=0x7fc824009840 comp rx=0 tx=0).stop 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 -- 172.21.15.26:0/2777161170 shutdown_connections 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 --2- 172.21.15.26:0/2777161170 >> v2:172.21.15.67:3300/0 conn(0x7fc82c0cea00 0x7fc82c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c153a00 0x7fc82c153dd0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 --2- 172.21.15.26:0/2777161170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 -- 172.21.15.26:0/2777161170 >> 172.21.15.26:0/2777161170 conn(0x7fc82c0703a0 msgr2=0x7fc82c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 -- 172.21.15.26:0/2777161170 shutdown_connections 2023-10-09T11:42:58.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.885+0000 7fc832f48700 1 -- 172.21.15.26:0/2777161170 wait complete. 2023-10-09T11:42:58.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 Processor -- start 2023-10-09T11:42:58.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 -- start start 2023-10-09T11:42:58.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82c153a00 0x7fc82c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c140500 con 0x7fc82c0cea00 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0cbae0 con 0x7fc82c153a00 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc832f48700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0b60c0 con 0x7fc82c15de50 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc831f46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc831f46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40144/0 (socket says 172.21.15.26:40144) 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.887+0000 7fc831f46700 1 -- 172.21.15.26:0/2435621845 learned_addr learned my addr 172.21.15.26:0/2435621845 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc832747700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831745700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82c153a00 0x7fc82c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 -- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 msgr2=0x7fc82c0b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c0b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 -- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82c153a00 msgr2=0x7fc82c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82c153a00 0x7fc82c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 -- 172.21.15.26:0/2435621845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009ae0 con 0x7fc82c0cea00 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc831f46700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc82c06eb00 tx=0x7fc824018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824008930 con 0x7fc82c0cea00 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824008a90 con 0x7fc82c0cea00 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c0cb1b0 con 0x7fc82c0cea00 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824008e30 con 0x7fc82c0cea00 2023-10-09T11:42:58.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.888+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c0cb770 con 0x7fc82c0cea00 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.889+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c04c3c0 con 0x7fc82c0cea00 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.890+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc824003040 con 0x7fc82c0cea00 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.890+0000 7fc829ffb700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 0x7fc8180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.890+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fc824086a60 con 0x7fc82c0cea00 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.890+0000 7fc831745700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 0x7fc8180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.891+0000 7fc831745700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 0x7fc8180697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc820006f00 tx=0x7fc820008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:58.894+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc824053590 con 0x7fc82c0cea00 2023-10-09T11:42:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.084+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc82c15b800 con 0x7fc82c0cea00 2023-10-09T11:42:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.085+0000 7fc829ffb700 1 -- 172.21.15.26:0/2435621845 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc824021020 con 0x7fc82c0cea00 2023-10-09T11:42:59.086 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:42:59.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 msgr2=0x7fc8180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 0x7fc8180697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc820006f00 tx=0x7fc820008040 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 msgr2=0x7fc82c13ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc82c06eb00 tx=0x7fc824018000 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 shutdown_connections 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc818067320 0x7fc8180697d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc82c15de50 0x7fc82c0b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c0cea00 0x7fc82c13ffc0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 --2- 172.21.15.26:0/2435621845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82c153a00 0x7fc82c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 >> 172.21.15.26:0/2435621845 conn(0x7fc82c0703a0 msgr2=0x7fc82c15bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 shutdown_connections 2023-10-09T11:42:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.087+0000 7fc832f48700 1 -- 172.21.15.26:0/2435621845 wait complete. 2023-10-09T11:42:59.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000601189.meta pg_num 2023-10-09T11:42:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.221+0000 7ffbcf1a4700 1 Processor -- start 2023-10-09T11:42:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.221+0000 7ffbcf1a4700 1 -- start start 2023-10-09T11:42:59.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcf1a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbc806dc70 0x7ffbc8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcf1a4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffbc806e0e0 0x7ffbc80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcf1a4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc80ccfd0 con 0x7ffbc8159530 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcf1a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc815a3d0 con 0x7ffbc806dc70 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcf1a4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc815a6b0 con 0x7ffbc806e0e0 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbc806dc70 0x7ffbc8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbc806dc70 0x7ffbc8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40154/0 (socket says 172.21.15.26:40154) 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 -- 172.21.15.26:0/2123368752 learned_addr learned my addr 172.21.15.26:0/2123368752 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbcd741700 1 --2- 172.21.15.26:0/2123368752 >> v2:172.21.15.67:3300/0 conn(0x7ffbc806e0e0 0x7ffbc80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 -- 172.21.15.26:0/2123368752 >> v2:172.21.15.67:3300/0 conn(0x7ffbc806e0e0 msgr2=0x7ffbc80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 --2- 172.21.15.26:0/2123368752 >> v2:172.21.15.67:3300/0 conn(0x7ffbc806e0e0 0x7ffbc80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 -- 172.21.15.26:0/2123368752 >> v1:172.21.15.67:6789/0 conn(0x7ffbc8159530 legacy=0x7ffbc80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 -- 172.21.15.26:0/2123368752 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc815a990 con 0x7ffbc806dc70 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.222+0000 7ffbc7fff700 1 --2- 172.21.15.26:0/2123368752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc806dc70 0x7ffbc8159900 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80cf2b0 tx=0x7ffbb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f0a9f0e8881de8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbc77fe700 1 -- 172.21.15.26:0/2123368752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400b820 con 0x7ffbc806dc70 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbc77fe700 1 -- 172.21.15.26:0/2123368752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400b980 con 0x7ffbc806dc70 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbc77fe700 1 -- 172.21.15.26:0/2123368752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400bd20 con 0x7ffbc806dc70 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/2123368752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc806dc70 msgr2=0x7ffbc8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/2123368752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc806dc70 0x7ffbc8159900 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80cf2b0 tx=0x7ffbb4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/2123368752 shutdown_connections 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/2123368752 >> v2:172.21.15.67:3300/0 conn(0x7ffbc806e0e0 0x7ffbc80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/2123368752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc806dc70 0x7ffbc8159900 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/2123368752 >> 172.21.15.26:0/2123368752 conn(0x7ffbc80703a0 msgr2=0x7ffbc80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/2123368752 shutdown_connections 2023-10-09T11:42:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.223+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/2123368752 wait complete. 2023-10-09T11:42:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.224+0000 7ffbcf1a4700 1 Processor -- start 2023-10-09T11:42:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.224+0000 7ffbcf1a4700 1 -- start start 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffbc806dc70 0x7ffbc80c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbc806e0e0 0x7ffbc8147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80ca630 con 0x7ffbc8159530 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c7cd0 con 0x7ffbc806e0e0 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcf1a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80b3480 con 0x7ffbc806dc70 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcd741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcd741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40160/0 (socket says 172.21.15.26:40160) 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbcd741700 1 -- 172.21.15.26:0/3039443331 learned_addr learned my addr 172.21.15.26:0/3039443331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbc7fff700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbc806e0e0 0x7ffbc8147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.225+0000 7ffbccf40700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffbc806dc70 0x7ffbc80c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 -- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffbc806dc70 msgr2=0x7ffbc80c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffbc806dc70 0x7ffbc80c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 -- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbc806e0e0 msgr2=0x7ffbc8147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbc806e0e0 0x7ffbc8147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 -- 172.21.15.26:0/3039443331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb40094f0 con 0x7ffbc8159530 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcd741700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000ceb0 tx=0x7ffbc0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000ad90 con 0x7ffbc8159530 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0016430 con 0x7ffbc8159530 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00167d0 con 0x7ffbc8159530 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc80b3760 con 0x7ffbc8159530 2023-10-09T11:42:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.226+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc80b3da0 con 0x7ffbc8159530 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.227+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc804c3c0 con 0x7ffbc8159530 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.227+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffbc0003020 con 0x7ffbc8159530 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.228+0000 7ffbc4ff9700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 0x7ffbac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.228+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7ffbc0012070 con 0x7ffbc8159530 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.228+0000 7ffbccf40700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 0x7ffbac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.228+0000 7ffbccf40700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 0x7ffbac0697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009af0 tx=0x7ffbbc009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.232+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbc0052700 con 0x7ffbc8159530 2023-10-09T11:42:59.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.425+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000601189.meta", "var": "pg_num"} v 0) v1 -- 0x7ffbc815ac70 con 0x7ffbc8159530 2023-10-09T11:42:59.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.426+0000 7ffbc4ff9700 1 -- 172.21.15.26:0/3039443331 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000601189.meta", "var": "pg_num"}]=0 v141) v1 ==== 124+0+11 (secure 0 0 0) 0x7ffbc0055d20 con 0x7ffbc8159530 2023-10-09T11:42:59.426 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:42:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 msgr2=0x7ffbac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 0x7ffbac0697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009af0 tx=0x7ffbbc009060 comp rx=0 tx=0).stop 2023-10-09T11:42:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 msgr2=0x7ffbc80cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000ceb0 tx=0x7ffbc0007870 comp rx=0 tx=0).stop 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 shutdown_connections 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc8159530 0x7ffbc80cd460 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffbac067320 0x7ffbac0697d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffbc806dc70 0x7ffbc80c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 --2- 172.21.15.26:0/3039443331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbc806e0e0 0x7ffbc8147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.427+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 >> 172.21.15.26:0/3039443331 conn(0x7ffbc80703a0 msgr2=0x7ffbc80cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.428+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 shutdown_connections 2023-10-09T11:42:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.428+0000 7ffbcf1a4700 1 -- 172.21.15.26:0/3039443331 wait complete. 2023-10-09T11:42:59.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000601189.data pg_num 2023-10-09T11:42:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.562+0000 7f3bc8117700 1 Processor -- start 2023-10-09T11:42:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 -- start start 2023-10-09T11:42:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bc0159530 0x7f3bc00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006dc70 0x7f3bc0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 0x7f3bc00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00ccfd0 con 0x7f3bc0159530 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00cf0e0 con 0x7f3bc006e0e0 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc8117700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015a3d0 con 0x7f3bc006dc70 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.563+0000 7f3bc5eb3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bc0159530 0x7f3bc00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bc0159530 0x7f3bc00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40174/0 (socket says 172.21.15.26:40174) 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2394126544 learned_addr learned my addr 172.21.15.26:0/2394126544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc56b2700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006dc70 0x7f3bc0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc66b4700 1 --2- 172.21.15.26:0/2394126544 >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 0x7f3bc00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2394126544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006dc70 msgr2=0x7f3bc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006dc70 0x7f3bc0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2394126544 >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 msgr2=0x7f3bc00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2394126544 >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 0x7f3bc00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2394126544 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc015a6b0 con 0x7f3bc0159530 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc66b4700 1 --2- 172.21.15.26:0/2394126544 >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 0x7f3bc00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc0159530 0x7f3bc00ceba0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0089880 tx=0x7f3bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fff2d529402ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc4eb1700 1 -- 172.21.15.26:0/2394126544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0009e70 con 0x7f3bc0159530 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc4eb1700 1 -- 172.21.15.26:0/2394126544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000b860 con 0x7f3bc0159530 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.564+0000 7f3bc4eb1700 1 -- 172.21.15.26:0/2394126544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000bc00 con 0x7f3bc0159530 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 -- 172.21.15.26:0/2394126544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc0159530 msgr2=0x7f3bc00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc0159530 0x7f3bc00ceba0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0089880 tx=0x7f3bb0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 -- 172.21.15.26:0/2394126544 shutdown_connections 2023-10-09T11:42:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2394126544 >> v2:172.21.15.67:3300/0 conn(0x7f3bc006e0e0 0x7f3bc00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc0159530 0x7f3bc00ceba0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2394126544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006dc70 0x7f3bc0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 -- 172.21.15.26:0/2394126544 >> 172.21.15.26:0/2394126544 conn(0x7f3bc00703a0 msgr2=0x7f3bc00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 -- 172.21.15.26:0/2394126544 shutdown_connections 2023-10-09T11:42:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.565+0000 7f3bc8117700 1 -- 172.21.15.26:0/2394126544 wait complete. 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.566+0000 7f3bc8117700 1 Processor -- start 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.566+0000 7f3bc8117700 1 -- start start 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006e0e0 0x7f3bc00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 0x7f3bc00b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c8840 con 0x7f3bc006dc70 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c7c30 con 0x7f3bc0159530 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c7f10 con 0x7f3bc006e0e0 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40184/0 (socket says 172.21.15.26:40184) 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2407693090 learned_addr learned my addr 172.21.15.26:0/2407693090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc56b2700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006e0e0 0x7f3bc00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc66b4700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 0x7f3bc00b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006e0e0 msgr2=0x7f3bc00b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006e0e0 0x7f3bc00b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 msgr2=0x7f3bc00b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 0x7f3bc00b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 -- 172.21.15.26:0/2407693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00094f0 con 0x7f3bc006dc70 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc66b4700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 0x7f3bc00b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc5eb3700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009290 tx=0x7f3bb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000bbe0 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb001f070 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00266b0 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.567+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc00c81f0 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.568+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00b5890 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.569+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc004c3c0 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.569+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3bb0026a60 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.569+0000 7f3bbdffb700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 0x7f3bac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.569+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f3bb0021070 con 0x7f3bc006dc70 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.570+0000 7f3bc56b2700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 0x7f3bac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.570+0000 7f3bc56b2700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 0x7f3bac0697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b6510 tx=0x7f3bb4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.574+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bb0053530 con 0x7f3bc006dc70 2023-10-09T11:42:59.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.768+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000601189.data", "var": "pg_num"} v 0) v1 -- 0x7f3bc015a990 con 0x7f3bc006dc70 2023-10-09T11:42:59.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.768+0000 7f3bbdffb700 1 -- 172.21.15.26:0/2407693090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000601189.data", "var": "pg_num"}]=0 v141) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3bb00150c0 con 0x7f3bc006dc70 2023-10-09T11:42:59.768 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:42:59.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 msgr2=0x7f3bac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 0x7f3bac0697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b6510 tx=0x7f3bb4008040 comp rx=0 tx=0).stop 2023-10-09T11:42:59.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 msgr2=0x7f3bc00b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009290 tx=0x7f3bb0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:59.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 shutdown_connections 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0159530 0x7f3bc00b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bc006dc70 0x7f3bc00b3480 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3bac067320 0x7f3bac0697d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 --2- 172.21.15.26:0/2407693090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc006e0e0 0x7f3bc00b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 >> 172.21.15.26:0/2407693090 conn(0x7f3bc00703a0 msgr2=0x7f3bc0153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 shutdown_connections 2023-10-09T11:42:59.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.770+0000 7f3bc8117700 1 -- 172.21.15.26:0/2407693090 wait complete. 2023-10-09T11:42:59.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:59.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.903+0000 7f225e2da700 1 Processor -- start 2023-10-09T11:42:59.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.903+0000 7f225e2da700 1 -- start start 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225e2da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22580cb970 0x7f2258159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225e2da700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f225815a400 0x7f2258156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225e2da700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225815ae40 con 0x7f22580cb5a0 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225e2da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580ce0f0 con 0x7f22580cb970 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225e2da700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580d13f0 con 0x7f225815a400 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22580cb970 0x7f2258159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22580cb970 0x7f2258159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34236/0 (socket says 172.21.15.26:34236) 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 -- 172.21.15.26:0/2455824877 learned_addr learned my addr 172.21.15.26:0/2455824877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f225c877700 1 --2- 172.21.15.26:0/2455824877 >> v2:172.21.15.67:3300/0 conn(0x7f225815a400 0x7f2258156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 -- 172.21.15.26:0/2455824877 >> v2:172.21.15.67:3300/0 conn(0x7f225815a400 msgr2=0x7f2258156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 --2- 172.21.15.26:0/2455824877 >> v2:172.21.15.67:3300/0 conn(0x7f225815a400 0x7f2258156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 -- 172.21.15.26:0/2455824877 >> v1:172.21.15.67:6789/0 conn(0x7f22580cb5a0 legacy=0x7f22580cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 -- 172.21.15.26:0/2455824877 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225815ab60 con 0x7f22580cb970 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.904+0000 7f22577fe700 1 --2- 172.21.15.26:0/2455824877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb970 0x7f2258159ec0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f22580ccdf0 tx=0x7f2248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527add7cb6dcdbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f2256ffd700 1 -- 172.21.15.26:0/2455824877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248009e70 con 0x7f22580cb970 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f2256ffd700 1 -- 172.21.15.26:0/2455824877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800b860 con 0x7f22580cb970 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f2256ffd700 1 -- 172.21.15.26:0/2455824877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800bc00 con 0x7f22580cb970 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 -- 172.21.15.26:0/2455824877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb970 msgr2=0x7f2258159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 --2- 172.21.15.26:0/2455824877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb970 0x7f2258159ec0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f22580ccdf0 tx=0x7f2248009250 comp rx=0 tx=0).stop 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 -- 172.21.15.26:0/2455824877 shutdown_connections 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 --2- 172.21.15.26:0/2455824877 >> v2:172.21.15.67:3300/0 conn(0x7f225815a400 0x7f2258156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 --2- 172.21.15.26:0/2455824877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb970 0x7f2258159ec0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 -- 172.21.15.26:0/2455824877 >> 172.21.15.26:0/2455824877 conn(0x7f2258070e30 msgr2=0x7f22580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 -- 172.21.15.26:0/2455824877 shutdown_connections 2023-10-09T11:42:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.905+0000 7f225e2da700 1 -- 172.21.15.26:0/2455824877 wait complete. 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.906+0000 7f225e2da700 1 Processor -- start 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 -- start start 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22580cb970 0x7f2258152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225815a400 0x7f2258154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580c8940 con 0x7f22580cb5a0 2023-10-09T11:42:59.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580c7d30 con 0x7f225815a400 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225e2da700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580c8010 con 0x7f22580cb970 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f2257fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f2257fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34248/0 (socket says 172.21.15.26:34248) 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f2257fff700 1 -- 172.21.15.26:0/1946760320 learned_addr learned my addr 172.21.15.26:0/1946760320 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f22577fe700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22580cb970 0x7f2258152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.907+0000 7f225c877700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225815a400 0x7f2258154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 -- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22580cb970 msgr2=0x7f2258152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22580cb970 0x7f2258152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 -- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225815a400 msgr2=0x7f2258154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225815a400 0x7f2258154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 -- 172.21.15.26:0/1946760320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480094f0 con 0x7f22580cb5a0 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f2257fff700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c790 tx=0x7f224c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011590 con 0x7f22580cb5a0 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c0116f0 con 0x7f22580cb5a0 2023-10-09T11:42:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580c82f0 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011ab0 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.908+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2258153190 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.909+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225804c3c0 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.909+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f224c01b3b0 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.910+0000 7f223ffff700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 0x7f22440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.910+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f224c084180 con 0x7f22580cb5a0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.910+0000 7f22577fe700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 0x7f22440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.910+0000 7f22577fe700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 0x7f22440697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f22580ccdf0 tx=0x7f2248017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:42:59.914+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f224c050d80 con 0x7f22580cb5a0 2023-10-09T11:43:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.152+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22580ccf00 con 0x7f22580cb5a0 2023-10-09T11:43:00.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.153+0000 7f223ffff700 1 -- 172.21.15.26:0/1946760320 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f224c017090 con 0x7f22580cb5a0 2023-10-09T11:43:00.153 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:00.153 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:54.820383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000601189","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:43:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.154+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 msgr2=0x7f22440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.154+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 0x7f22440697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f22580ccdf0 tx=0x7f2248017000 comp rx=0 tx=0).stop 2023-10-09T11:43:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.154+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 msgr2=0x7f2258152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.154+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c790 tx=0x7f224c007f40 comp rx=0 tx=0).stop 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 shutdown_connections 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225815a400 0x7f2258154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22580cb5a0 0x7f2258152c50 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2244067320 0x7f22440697d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 --2- 172.21.15.26:0/1946760320 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22580cb970 0x7f2258152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 >> 172.21.15.26:0/1946760320 conn(0x7f2258070e30 msgr2=0x7f22580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 shutdown_connections 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.155+0000 7f225e2da700 1 -- 172.21.15.26:0/1946760320 wait complete. 2023-10-09T11:43:00.156 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 94 2023-10-09T11:43:00.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.286+0000 7f42c679a700 1 Processor -- start 2023-10-09T11:43:00.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.286+0000 7f42c679a700 1 -- start start 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42c679a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42c00cb5a0 0x7f42c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42c679a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c015ae40 con 0x7f42c015a5d0 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42c679a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c015ab60 con 0x7f42c00cd9e0 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42c679a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c00d13f0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42c00cb5a0 0x7f42c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42c00cb5a0 0x7f42c00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34262/0 (socket says 172.21.15.26:34262) 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42bffff700 1 -- 172.21.15.26:0/4024088134 learned_addr learned my addr 172.21.15.26:0/4024088134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.287+0000 7f42c4d37700 1 --1- 172.21.15.26:0/4024088134 >> v1:172.21.15.26:6789/0 conn(0x7f42c015a5d0 0x7f42c0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45296/0 (socket says 172.21.15.26:45296) 2023-10-09T11:43:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42bffff700 1 -- 172.21.15.26:0/4024088134 >> v1:172.21.15.67:6789/0 conn(0x7f42c00cd9e0 legacy=0x7f42c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42bffff700 1 -- 172.21.15.26:0/4024088134 >> v1:172.21.15.26:6789/0 conn(0x7f42c015a5d0 legacy=0x7f42c0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42bffff700 1 -- 172.21.15.26:0/4024088134 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00ccf00 con 0x7f42c00cb5a0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42beffd700 1 -- 172.21.15.26:0/4024088134 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870062886 0 0) 0x7f42c015ae40 con 0x7f42c015a5d0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42bffff700 1 --2- 172.21.15.26:0/4024088134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00cb970 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f42b00099e0 tx=0x7f42b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7c9865f400ffcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42beffd700 1 -- 172.21.15.26:0/4024088134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000b820 con 0x7f42c00cb5a0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42beffd700 1 -- 172.21.15.26:0/4024088134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000b980 con 0x7f42c00cb5a0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42beffd700 1 -- 172.21.15.26:0/4024088134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000bd20 con 0x7f42c00cb5a0 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42c679a700 1 -- 172.21.15.26:0/4024088134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 msgr2=0x7f42c00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42c679a700 1 --2- 172.21.15.26:0/4024088134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00cb970 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f42b00099e0 tx=0x7f42b0009250 comp rx=0 tx=0).stop 2023-10-09T11:43:00.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.288+0000 7f42c679a700 1 -- 172.21.15.26:0/4024088134 shutdown_connections 2023-10-09T11:43:00.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.289+0000 7f42c679a700 1 --2- 172.21.15.26:0/4024088134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00cb970 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.289+0000 7f42c679a700 1 -- 172.21.15.26:0/4024088134 >> 172.21.15.26:0/4024088134 conn(0x7f42c0070e30 msgr2=0x7f42c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.289+0000 7f42c679a700 1 -- 172.21.15.26:0/4024088134 shutdown_connections 2023-10-09T11:43:00.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.289+0000 7f42c679a700 1 -- 172.21.15.26:0/4024088134 wait complete. 2023-10-09T11:43:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.290+0000 7f42c679a700 1 Processor -- start 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.290+0000 7f42c679a700 1 -- start start 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.290+0000 7f42c679a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 0x7f42c01512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 0x7f42c00b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00c89b0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0151810 con 0x7f42c00cd9e0 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00b5c70 con 0x7f42c015a5d0 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34268/0 (socket says 172.21.15.26:34268) 2023-10-09T11:43:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 -- 172.21.15.26:0/21171527 learned_addr learned my addr 172.21.15.26:0/21171527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c4d37700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 0x7f42c00b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 -- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 msgr2=0x7f42c00b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bf7fe700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 0x7f42c01512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 0x7f42c00b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 -- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 msgr2=0x7f42c01512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 0x7f42c01512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 -- 172.21.15.26:0/21171527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b00094f0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c4d37700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 0x7f42c00b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bf7fe700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 0x7f42c01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42bffff700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f42c006ea60 tx=0x7f42b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b001f070 con 0x7f42c00cb5a0 2023-10-09T11:43:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000baf0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c00c7da0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0025420 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.291+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c00c8360 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.292+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c004c3c0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.293+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f42b0023070 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.293+0000 7f42b7fff700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 0x7f42a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.293+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f42b0086340 con 0x7f42c00cb5a0 2023-10-09T11:43:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.293+0000 7f42bf7fe700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 0x7f42a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.294+0000 7f42bf7fe700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 0x7f42a00697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c8db0 tx=0x7f42a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.297+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42b0052f80 con 0x7f42c00cb5a0 2023-10-09T11:43:00.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.494+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42c00cd1e0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.494+0000 7f42b7fff700 1 -- 172.21.15.26:0/21171527 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f42b00565a0 con 0x7f42c00cb5a0 2023-10-09T11:43:00.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:00.495 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":141,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:56.829403+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000601189.meta","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000601189"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000601189.data","create_time":"2023-10-09T11:42:42.124868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000601189"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 msgr2=0x7f42a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 0x7f42a00697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c8db0 tx=0x7f42a8009040 comp rx=0 tx=0).stop 2023-10-09T11:43:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 msgr2=0x7f42c00c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f42c006ea60 tx=0x7f42b0017000 comp rx=0 tx=0).stop 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 shutdown_connections 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f42a0067320 0x7f42a00697d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f42c015a5d0 0x7f42c00b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42c00cb5a0 0x7f42c00c77c0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 --2- 172.21.15.26:0/21171527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42c00cd9e0 0x7f42c01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 >> 172.21.15.26:0/21171527 conn(0x7f42c0070e30 msgr2=0x7f42c00cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 shutdown_connections 2023-10-09T11:43:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.496+0000 7f42c679a700 1 -- 172.21.15.26:0/21171527 wait complete. 2023-10-09T11:43:00.509 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000601189 and related pools 2023-10-09T11:43:00.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:00.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.627+0000 7f442759e700 1 Processor -- start 2023-10-09T11:43:00.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.627+0000 7f442759e700 1 -- start start 2023-10-09T11:43:00.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f442759e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44280cf110 0x7f4428164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f442759e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442815afd0 con 0x7f442815de50 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f442759e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442815b2b0 con 0x7f4428153c30 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f442759e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442815b590 con 0x7f44280cf110 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f4425d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f442815de50 0x7f44280cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45300/0 (socket says 172.21.15.26:45300) 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f4425d9b700 1 -- 172.21.15.26:0/1384456812 learned_addr learned my addr 172.21.15.26:0/1384456812 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f4426d9d700 1 --2- 172.21.15.26:0/1384456812 >> v2:172.21.15.67:3300/0 conn(0x7f44280cf110 0x7f4428164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.628+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253743423 0 0) 0x7f442815afd0 con 0x7f442815de50 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4414003570 con 0x7f442815de50 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156589461 0 0) 0x7f442815b2b0 con 0x7f4428153c30 2023-10-09T11:43:00.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442815afd0 con 0x7f4428153c30 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f4426d9d700 1 -- 172.21.15.26:0/1384456812 >> v1:172.21.15.67:6789/0 conn(0x7f4428153c30 legacy=0x7f442815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f4426d9d700 1 -- 172.21.15.26:0/1384456812 >> v1:172.21.15.26:6789/0 conn(0x7f442815de50 legacy=0x7f44280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135523597 0 0) 0x7f4414003570 con 0x7f442815de50 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f4426d9d700 1 -- 172.21.15.26:0/1384456812 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442815b870 con 0x7f44280cf110 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f4426d9d700 1 --2- 172.21.15.26:0/1384456812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44280cf110 0x7f4428164600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4420009e60 tx=0x7f4420009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f129dd48227cba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442000e070 con 0x7f44280cf110 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442000b7a0 con 0x7f44280cf110 2023-10-09T11:43:00.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.629+0000 7f442559a700 1 -- 172.21.15.26:0/1384456812 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410001470 con 0x7f44280cf110 2023-10-09T11:43:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 -- 172.21.15.26:0/1384456812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44280cf110 msgr2=0x7f4428164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 --2- 172.21.15.26:0/1384456812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44280cf110 0x7f4428164600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4420009e60 tx=0x7f4420009780 comp rx=0 tx=0).stop 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 -- 172.21.15.26:0/1384456812 shutdown_connections 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 --2- 172.21.15.26:0/1384456812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44280cf110 0x7f4428164600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 -- 172.21.15.26:0/1384456812 >> 172.21.15.26:0/1384456812 conn(0x7f44280703a0 msgr2=0x7f44280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 -- 172.21.15.26:0/1384456812 shutdown_connections 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.630+0000 7f442759e700 1 -- 172.21.15.26:0/1384456812 wait complete. 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.631+0000 7f442759e700 1 Processor -- start 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.631+0000 7f442759e700 1 -- start start 2023-10-09T11:43:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 0x7f442816d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f442815de50 0x7f44280cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c93d0 con 0x7f4428153c30 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c9f10 con 0x7f442815de50 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44281515a0 con 0x7f44280cf110 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34284/0 (socket says 172.21.15.26:34284) 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 -- 172.21.15.26:0/4252370795 learned_addr learned my addr 172.21.15.26:0/4252370795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4426d9d700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f442815de50 0x7f44280cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442659c700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 0x7f442816d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 -- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 msgr2=0x7f442816d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 0x7f442816d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 -- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f442815de50 msgr2=0x7f44280cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f442815de50 0x7f44280cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 -- 172.21.15.26:0/4252370795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420009a20 con 0x7f4428153c30 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442659c700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 0x7f442816d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f4425d9b700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f441000cb90 tx=0x7f4410001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410001d20 con 0x7f4428153c30 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410007360 con 0x7f4428153c30 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44280c95e0 con 0x7f4428153c30 2023-10-09T11:43:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.632+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410004830 con 0x7f4428153c30 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.633+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44280c9ba0 con 0x7f4428153c30 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.633+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442804c3c0 con 0x7f4428153c30 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.634+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4410004ba0 con 0x7f4428153c30 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.634+0000 7f441e7fc700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 0x7f44080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.634+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f4410084150 con 0x7f4428153c30 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.634+0000 7f442659c700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 0x7f44080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.635+0000 7f442659c700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 0x7f44080697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4418007fd0 tx=0x7f4418009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.639+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4410050d90 con 0x7f4428153c30 2023-10-09T11:43:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.873+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44280caef0 con 0x7f4428153c30 2023-10-09T11:43:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.873+0000 7f441e7fc700 1 -- 172.21.15.26:0/4252370795 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f44100543b0 con 0x7f4428153c30 2023-10-09T11:43:00.874 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:00.874 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:54.820383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000601189","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 msgr2=0x7f44080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 0x7f44080697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4418007fd0 tx=0x7f4418009040 comp rx=0 tx=0).stop 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 msgr2=0x7f4428151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f441000cb90 tx=0x7f4410001ab0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 shutdown_connections 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f442815de50 0x7f44280cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4408067320 0x7f44080697d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44280cf110 0x7f442816d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 --2- 172.21.15.26:0/4252370795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4428153c30 0x7f4428151060 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 >> 172.21.15.26:0/4252370795 conn(0x7f44280703a0 msgr2=0x7f4428070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 shutdown_connections 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:00.875+0000 7f442759e700 1 -- 172.21.15.26:0/4252370795 wait complete. 2023-10-09T11:43:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 94 2023-10-09T11:43:00.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:01.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.006+0000 7f8bdaf01700 1 Processor -- start 2023-10-09T11:43:01.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.006+0000 7f8bdaf01700 1 -- start start 2023-10-09T11:43:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bdaf01700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd40cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bdaf01700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd40cc690 0x7f8bd40c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bdaf01700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd40c3690 con 0x7f8bd40c4c70 2023-10-09T11:43:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bdaf01700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd40c3970 con 0x7f8bd40cc690 2023-10-09T11:43:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bdaf01700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40c3c50 con 0x7f8bd40cce90 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bd3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd40cc690 0x7f8bd40c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bd949e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8bd40c4c70 0x7f8bd40b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45304/0 (socket says 172.21.15.26:45304) 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bd949e700 1 -- 172.21.15.26:0/3990304719 learned_addr learned my addr 172.21.15.26:0/3990304719 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bd3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bd40cc690 0x7f8bd40c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34296/0 (socket says 172.21.15.26:34296) 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.007+0000 7f8bd8c9d700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd40cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd3fff700 1 -- 172.21.15.26:0/3990304719 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 msgr2=0x7f8bd40cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd40cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd3fff700 1 -- 172.21.15.26:0/3990304719 >> v1:172.21.15.26:6789/0 conn(0x7f8bd40c4c70 legacy=0x7f8bd40b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd3fff700 1 -- 172.21.15.26:0/3990304719 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd40c3f30 con 0x7f8bd40cc690 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd37fe700 1 -- 172.21.15.26:0/3990304719 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984247830 0 0) 0x7f8bd40c3690 con 0x7f8bd40c4c70 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40cc690 0x7f8bd40c4730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098e0 tx=0x7f8bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2674a4adcdfd0d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd37fe700 1 -- 172.21.15.26:0/3990304719 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400b640 con 0x7f8bd40cc690 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd37fe700 1 -- 172.21.15.26:0/3990304719 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400b7a0 con 0x7f8bd40cc690 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bd37fe700 1 -- 172.21.15.26:0/3990304719 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400bb40 con 0x7f8bd40cc690 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bdaf01700 1 -- 172.21.15.26:0/3990304719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40cc690 msgr2=0x7f8bd40c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.008+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40cc690 0x7f8bd40c4730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098e0 tx=0x7f8bc40091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 -- 172.21.15.26:0/3990304719 shutdown_connections 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd40cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/3990304719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40cc690 0x7f8bd40c4730 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 -- 172.21.15.26:0/3990304719 >> 172.21.15.26:0/3990304719 conn(0x7f8bd406ce80 msgr2=0x7f8bd40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 -- 172.21.15.26:0/3990304719 shutdown_connections 2023-10-09T11:43:01.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.009+0000 7f8bdaf01700 1 -- 172.21.15.26:0/3990304719 wait complete. 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.010+0000 7f8bdaf01700 1 Processor -- start 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.010+0000 7f8bdaf01700 1 -- start start 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 0x7f8bd41694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b0cb0 con 0x7f8bd40c4c70 2023-10-09T11:43:01.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40c7af0 con 0x7f8bd40cc690 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4169a00 con 0x7f8bd40cce90 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34312/0 (socket says 172.21.15.26:34312) 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 -- 172.21.15.26:0/644896441 learned_addr learned my addr 172.21.15.26:0/644896441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 0x7f8bd41694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd949e700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 -- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 msgr2=0x7f8bd415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 -- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 msgr2=0x7f8bd41694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 0x7f8bd41694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 -- 172.21.15.26:0/644896441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4009420 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 0x7f8bd41694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd8c9d700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00ea00 tx=0x7f8bbc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00c850 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00c9b0 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4169c60 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00cd30 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.011+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4169ff0 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.012+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd40c7dd0 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.013+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8bbc013680 con 0x7f8bd40c4c70 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.013+0000 7f8bd0ff9700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 0x7f8bb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.013+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f8bbc085300 con 0x7f8bd40c4c70 2023-10-09T11:43:01.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.013+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 0x7f8bb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.014+0000 7f8bd3fff700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 0x7f8bb40697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4003080 tx=0x7f8bc4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.017+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bbc051f40 con 0x7f8bd40c4c70 2023-10-09T11:43:01.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.254+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bd416a460 con 0x7f8bd40c4c70 2023-10-09T11:43:01.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.255+0000 7f8bd0ff9700 1 -- 172.21.15.26:0/644896441 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f8bbc055560 con 0x7f8bd40c4c70 2023-10-09T11:43:01.255 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:01.255 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:43.157517+0000","modified":"2023-10-09T11:42:54.820383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7635":{"gid":7635,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/2852535167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2852535167},{"type":"v1","addr":"172.21.15.26:6835","nonce":2852535167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000601189","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 msgr2=0x7f8bb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 0x7f8bb40697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4003080 tx=0x7f8bc4017000 comp rx=0 tx=0).stop 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 msgr2=0x7f8bd409be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00ea00 tx=0x7f8bbc009120 comp rx=0 tx=0).stop 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 shutdown_connections 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8bb4067320 0x7f8bb40697d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bd40cce90 0x7f8bd415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bd40c4c70 0x7f8bd409be50 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 --2- 172.21.15.26:0/644896441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bd40cc690 0x7f8bd41694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 >> 172.21.15.26:0/644896441 conn(0x7f8bd406ce80 msgr2=0x7f8bd4159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 shutdown_connections 2023-10-09T11:43:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.257+0000 7f8bdaf01700 1 -- 172.21.15.26:0/644896441 wait complete. 2023-10-09T11:43:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 94 2023-10-09T11:43:01.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:01.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.388+0000 7fb905fe1700 1 Processor -- start 2023-10-09T11:43:01.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.388+0000 7fb905fe1700 1 -- start start 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb905fe1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb905fe1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90015ae40 con 0x7fb90015a400 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb905fe1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90015ab60 con 0x7fb9000cb5a0 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb905fe1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000ce0f0 con 0x7fb9000cb970 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb90015a400 0x7fb900156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45316/0 (socket says 172.21.15.26:45316) 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fffff700 1 -- 172.21.15.26:0/1243867599 learned_addr learned my addr 172.21.15.26:0/1243867599 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1243867599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654696643 0 0) 0x7fb90015ae40 con 0x7fb90015a400 2023-10-09T11:43:01.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e8003570 con 0x7fb90015a400 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012889371 0 0) 0x7fb90015ab60 con 0x7fb9000cb5a0 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb90015ae40 con 0x7fb9000cb5a0 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8feffd700 1 -- 172.21.15.26:0/1243867599 >> v1:172.21.15.67:6789/0 conn(0x7fb9000cb5a0 legacy=0x7fb9000cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8feffd700 1 -- 172.21.15.26:0/1243867599 >> v1:172.21.15.26:6789/0 conn(0x7fb90015a400 legacy=0x7fb900156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.389+0000 7fb8feffd700 1 -- 172.21.15.26:0/1243867599 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000ccf00 con 0x7fb9000cb970 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1243867599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900159ec0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009910 tx=0x7fb8f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc15a800138c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011630 con 0x7fb9000cb970 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4011790 con 0x7fb9000cb970 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb8fe7fc700 1 -- 172.21.15.26:0/1243867599 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011b30 con 0x7fb9000cb970 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 -- 172.21.15.26:0/1243867599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 msgr2=0x7fb900159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1243867599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900159ec0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009910 tx=0x7fb8f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 -- 172.21.15.26:0/1243867599 shutdown_connections 2023-10-09T11:43:01.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1243867599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900159ec0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 -- 172.21.15.26:0/1243867599 >> 172.21.15.26:0/1243867599 conn(0x7fb900070e30 msgr2=0x7fb9000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 -- 172.21.15.26:0/1243867599 shutdown_connections 2023-10-09T11:43:01.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.390+0000 7fb905fe1700 1 -- 172.21.15.26:0/1243867599 wait complete. 2023-10-09T11:43:01.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 Processor -- start 2023-10-09T11:43:01.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 -- start start 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 0x7fb90016b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cbde0 con 0x7fb90015a400 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90015cf60 con 0x7fb9000cb5a0 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb905fe1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90016b750 con 0x7fb9000cb970 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34326/0 (socket says 172.21.15.26:34326) 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.392+0000 7fb8fffff700 1 -- 172.21.15.26:0/1237546644 learned_addr learned my addr 172.21.15.26:0/1237546644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 0x7fb90016b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 -- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 msgr2=0x7fb900153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 -- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 msgr2=0x7fb90016b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 0x7fb90016b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 -- 172.21.15.26:0/1237546644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4009420 con 0x7fb90015a400 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 0x7fb90016b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8fffff700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800cc80 tx=0x7fb8f8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ce90 con 0x7fb90015a400 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800ab70 con 0x7fb90015a400 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80070f0 con 0x7fb90015a400 2023-10-09T11:43:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9000b4c90 con 0x7fb90015a400 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.393+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90015cbf0 con 0x7fb90015a400 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.394+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90015d0f0 con 0x7fb90015a400 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.394+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb8f80074a0 con 0x7fb90015a400 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.395+0000 7fb8e77fe700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 0x7fb8ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.395+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb8f8085190 con 0x7fb90015a400 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.395+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 0x7fb8ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.396+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 0x7fb8ec0697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0007fd0 tx=0x7fb8f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.399+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8f8051e50 con 0x7fb90015a400 2023-10-09T11:43:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.594+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb90004c3c0 con 0x7fb90015a400 2023-10-09T11:43:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.595+0000 7fb8e77fe700 1 -- 172.21.15.26:0/1237546644 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fb8f8055470 con 0x7fb90015a400 2023-10-09T11:43:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:01.595 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":141,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:42:56.829403+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000601189.meta","create_time":"2023-10-09T11:42:41.556400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000601189"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000601189.data","create_time":"2023-10-09T11:42:42.124868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000601189"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:01.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 msgr2=0x7fb8ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 0x7fb8ec0697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0007fd0 tx=0x7fb8f0009040 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 msgr2=0x7fb9000b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800cc80 tx=0x7fb8f8001ae0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 shutdown_connections 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb90015a400 0x7fb9000b4240 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9000cb5a0 0x7fb90016b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb8ec067320 0x7fb8ec0697d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 --2- 172.21.15.26:0/1237546644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9000cb970 0x7fb900153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 >> 172.21.15.26:0/1237546644 conn(0x7fb900070e30 msgr2=0x7fb9000cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 shutdown_connections 2023-10-09T11:43:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.597+0000 7fb905fe1700 1 -- 172.21.15.26:0/1237546644 wait complete. 2023-10-09T11:43:01.609 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000601189 2023-10-09T11:43:01.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.728+0000 7fdf7fb2c700 1 Processor -- start 2023-10-09T11:43:01.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.728+0000 7fdf7fb2c700 1 -- start start 2023-10-09T11:43:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7fb2c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf7815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7fb2c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdf78159b70 0x7fdf780b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7fb2c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7806d840 con 0x7fdf78067fe0 2023-10-09T11:43:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7fb2c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7815dbc0 con 0x7fdf78159b70 2023-10-09T11:43:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7fb2c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815dea0 con 0x7fdf781597a0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7e0c9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdf78067fe0 0x7fdf780699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45320/0 (socket says 172.21.15.26:45320) 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.729+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/1119761046 learned_addr learned my addr 172.21.15.26:0/1119761046 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d0c7700 1 --2- 172.21.15.26:0/1119761046 >> v2:172.21.15.67:3300/0 conn(0x7fdf78159b70 0x7fdf780b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf7815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476266750 0 0) 0x7fdf7806d840 con 0x7fdf78067fe0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf60003570 con 0x7fdf78067fe0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2085427285 0 0) 0x7fdf60003570 con 0x7fdf78067fe0 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 msgr2=0x7fdf7815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf7815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 >> v2:172.21.15.67:3300/0 conn(0x7fdf78159b70 msgr2=0x7fdf780b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 --2- 172.21.15.26:0/1119761046 >> v2:172.21.15.67:3300/0 conn(0x7fdf78159b70 0x7fdf780b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7815e180 con 0x7fdf78067fe0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fdf70001470 con 0x7fdf78067fe0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 >> v1:172.21.15.26:6789/0 conn(0x7fdf78067fe0 legacy=0x7fdf780699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf60003a60 0x7fdf60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60004d50 0x7fdf600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815dbc0 con 0x7fdf60003a60 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815dea0 con 0x7fdf60004d50 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6000ba60 con 0x7fdf781597a0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf60003a60 0x7fdf60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d0c7700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7e0c9700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60004d50 0x7fdf600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 -- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 msgr2=0x7fdf60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf781597a0 0x7fdf60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 -- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60004d50 msgr2=0x7fdf600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60004d50 0x7fdf600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.730+0000 7fdf7d8c8700 1 -- 172.21.15.26:0/1119761046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60003570 con 0x7fdf60003a60 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf60003a60 0x7fdf60003e70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e210 tx=0x7fdf6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b69c26e0b3817d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800ea60 con 0x7fdf60003a60 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800f040 con 0x7fdf60003a60 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7c8c6700 1 -- 172.21.15.26:0/1119761046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800ee10 con 0x7fdf60003a60 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/1119761046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf60003a60 msgr2=0x7fdf60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/1119761046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf60003a60 0x7fdf60003e70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e210 tx=0x7fdf6800b040 comp rx=0 tx=0).stop 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/1119761046 reap_dead start 2023-10-09T11:43:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/1119761046 shutdown_connections 2023-10-09T11:43:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/1119761046 >> 172.21.15.26:0/1119761046 conn(0x7fdf780ce6b0 msgr2=0x7fdf780ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/1119761046 shutdown_connections 2023-10-09T11:43:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.731+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/1119761046 wait complete. 2023-10-09T11:43:01.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 Processor -- start 2023-10-09T11:43:01.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 -- start start 2023-10-09T11:43:01.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60003a60 0x7fdf781479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf780b2e40 0x7fdf780b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf780b37f0 con 0x7fdf7815c050 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815ca10 con 0x7fdf60003a60 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7fb2c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7816ccf0 con 0x7fdf780b2e40 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7e0c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7e0c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34338/0 (socket says 172.21.15.26:34338) 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.733+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/2672061949 learned_addr learned my addr 172.21.15.26:0/2672061949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7d0c7700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf780b2e40 0x7fdf780b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60003a60 0x7fdf781479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf780b2e40 msgr2=0x7fdf780b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf780b2e40 0x7fdf780b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60003a60 msgr2=0x7fdf781479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60003a60 0x7fdf781479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 -- 172.21.15.26:0/2672061949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7816cfd0 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7e0c9700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fdf78067e10 tx=0x7fdf700014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70012590 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf700126f0 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70012ab0 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7816d2b0 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.734+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7816d870 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.735+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7804c3c0 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.736+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdf7001d460 con 0x7fdf7815c050 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.736+0000 7fdf75ffb700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 0x7fdf640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.736+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fdf70084a40 con 0x7fdf7815c050 2023-10-09T11:43:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.736+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 0x7fdf640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.737+0000 7fdf7d8c8700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 0x7fdf640697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800afd0 tx=0x7fdf6801a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.740+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf70051680 con 0x7fdf7815c050 2023-10-09T11:43:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.978+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000601189"} v 0) v1 -- 0x7fdf7815e460 con 0x7fdf7815c050 2023-10-09T11:43:01.979 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:43:01.979+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:43:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.983+0000 7fdf75ffb700 1 -- 172.21.15.26:0/2672061949 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000601189"}]=0 volume_0000000000601189 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 195+0+0 (secure 0 0 0) 0x7fdf70054ca0 con 0x7fdf7815c050 2023-10-09T11:43:01.984 INFO:tasks.ceph.mds.c.smithi026.stderr: -741> 2023-10-09T11:42:49.076+0000 7fae022ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 msgr2=0x7fdf640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 0x7fdf640697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800afd0 tx=0x7fdf6801a000 comp rx=0 tx=0).stop 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 msgr2=0x7fdf7815c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fdf78067e10 tx=0x7fdf700014e0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 shutdown_connections 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf7815c050 0x7fdf7815c4d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf60003a60 0x7fdf781479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fdf64067320 0x7fdf640697d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 --2- 172.21.15.26:0/2672061949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf780b2e40 0x7fdf780b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 >> 172.21.15.26:0/2672061949 conn(0x7fdf780ce6b0 msgr2=0x7fdf780cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 shutdown_connections 2023-10-09T11:43:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:01.985+0000 7fdf7fb2c700 1 -- 172.21.15.26:0/2672061949 wait complete. 2023-10-09T11:43:01.987 INFO:teuthology.orchestra.run.smithi026.stderr:volume_0000000000601189 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:43:02.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000601189 --yes-i-really-mean-it 2023-10-09T11:43:02.009 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:43:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.125+0000 7fe87d7df700 1 Processor -- start 2023-10-09T11:43:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.125+0000 7fe87d7df700 1 -- start start 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8780cc320 0x7fe87813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe87813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe878069a00 0x7fe878069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87806d7b0 con 0x7fe878069a00 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87806e330 con 0x7fe8780cc320 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe87d7df700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87806da00 con 0x7fe8780cc6f0 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe878069a00 0x7fe878069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe878069a00 0x7fe878069e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34364/0 (socket says 172.21.15.26:34364) 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 -- 172.21.15.26:0/994042212 learned_addr learned my addr 172.21.15.26:0/994042212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8767fc700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe87813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe876ffd700 1 --2- 172.21.15.26:0/994042212 >> v2:172.21.15.67:3300/0 conn(0x7fe8780cc320 0x7fe87813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 -- 172.21.15.26:0/994042212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 msgr2=0x7fe87813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe87813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 -- 172.21.15.26:0/994042212 >> v2:172.21.15.67:3300/0 conn(0x7fe8780cc320 msgr2=0x7fe87813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 --2- 172.21.15.26:0/994042212 >> v2:172.21.15.67:3300/0 conn(0x7fe8780cc320 0x7fe87813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 -- 172.21.15.26:0/994042212 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87806dce0 con 0x7fe878069a00 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe8777fe700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe878069e80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe8780cf510 tx=0x7fe870009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748d8b4d1f346b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe875ffb700 1 -- 172.21.15.26:0/994042212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000e070 con 0x7fe878069a00 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe875ffb700 1 -- 172.21.15.26:0/994042212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000b970 con 0x7fe878069a00 2023-10-09T11:43:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.126+0000 7fe875ffb700 1 -- 172.21.15.26:0/994042212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8700092e0 con 0x7fe878069a00 2023-10-09T11:43:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 -- 172.21.15.26:0/994042212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 msgr2=0x7fe878069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe878069e80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe8780cf510 tx=0x7fe870009840 comp rx=0 tx=0).stop 2023-10-09T11:43:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 -- 172.21.15.26:0/994042212 shutdown_connections 2023-10-09T11:43:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 --2- 172.21.15.26:0/994042212 >> v2:172.21.15.67:3300/0 conn(0x7fe8780cc320 0x7fe87813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe878069e80 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 --2- 172.21.15.26:0/994042212 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe87813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 -- 172.21.15.26:0/994042212 >> 172.21.15.26:0/994042212 conn(0x7fe878067f00 msgr2=0x7fe878068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 -- 172.21.15.26:0/994042212 shutdown_connections 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.127+0000 7fe87d7df700 1 -- 172.21.15.26:0/994042212 wait complete. 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.128+0000 7fe87d7df700 1 Processor -- start 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.128+0000 7fe87d7df700 1 -- start start 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 0x7fe8780c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe8780c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815dab0 con 0x7fe878069a00 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815d1a0 con 0x7fe8780cc320 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe87d7df700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815d460 con 0x7fe8780cc6f0 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34368/0 (socket says 172.21.15.26:34368) 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 -- 172.21.15.26:0/2829675431 learned_addr learned my addr 172.21.15.26:0/2829675431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe8777fe700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe8780c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe8767fc700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 0x7fe8780c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 -- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 msgr2=0x7fe8780c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe8780c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 -- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 msgr2=0x7fe8780c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 0x7fe8780c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe876ffd700 1 -- 172.21.15.26:0/2829675431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009ae0 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.129+0000 7fe8767fc700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 0x7fe8780c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe876ffd700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe86800ec80 tx=0x7fe8680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800c850 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800c9b0 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87815d740 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800cd50 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.130+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87816d3c0 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.131+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87815dd90 con 0x7fe878069a00 2023-10-09T11:43:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.131+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe868013680 con 0x7fe878069a00 2023-10-09T11:43:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.131+0000 7fe86effd700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 0x7fe8580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.131+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fe868085340 con 0x7fe878069a00 2023-10-09T11:43:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.132+0000 7fe8767fc700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 0x7fe8580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.132+0000 7fe8767fc700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 0x7fe8580697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe8780c8350 tx=0x7fe860008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.136+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe868051f30 con 0x7fe878069a00 2023-10-09T11:43:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.375+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000601189", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8780685b0 con 0x7fe878069a00 2023-10-09T11:43:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.984+0000 7fe86effd700 1 -- 172.21.15.26:0/2829675431 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000601189", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe868055550 con 0x7fe878069a00 2023-10-09T11:43:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 msgr2=0x7fe8580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 0x7fe8580697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe8780c8350 tx=0x7fe860008040 comp rx=0 tx=0).stop 2023-10-09T11:43:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 msgr2=0x7fe8781532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe86800ec80 tx=0x7fe8680091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 shutdown_connections 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe858067320 0x7fe8580697d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8780cc6f0 0x7fe8780c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878069a00 0x7fe8781532b0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 --2- 172.21.15.26:0/2829675431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8780cc320 0x7fe8780c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 >> 172.21.15.26:0/2829675431 conn(0x7fe878067f00 msgr2=0x7fe8780b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 shutdown_connections 2023-10-09T11:43:02.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:02.986+0000 7fe87d7df700 1 -- 172.21.15.26:0/2829675431 wait complete. 2023-10-09T11:43:03.002 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000601189.meta cephfs.volume_0000000000601189.meta --yes-i-really-really-mean-it 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 Processor -- start 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 -- start start 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 0x7f56140cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f56140cd770 0x7f56141591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140cf330 con 0x7f56140b04f0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140cdbd0 con 0x7f56140cd770 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.174+0000 7f5618ab1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140cead0 con 0x7f56140cb880 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f5612d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f56140cd770 0x7f56141591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f561259c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 0x7f56140cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f5609d9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f56140b04f0 0x7f56140cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:33410/0 (socket says 172.21.15.26:33410) 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f5609d9b700 1 -- 172.21.15.26:0/4197360890 learned_addr learned my addr 172.21.15.26:0/4197360890 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f561259c700 1 -- 172.21.15.26:0/4197360890 >> v2:172.21.15.67:3300/0 conn(0x7f56140cd770 msgr2=0x7f56141591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f561259c700 1 --2- 172.21.15.26:0/4197360890 >> v2:172.21.15.67:3300/0 conn(0x7f56140cd770 0x7f56141591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f561259c700 1 -- 172.21.15.26:0/4197360890 >> v1:172.21.15.67:6789/0 conn(0x7f56140b04f0 legacy=0x7f56140cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.175+0000 7f561259c700 1 -- 172.21.15.26:0/4197360890 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140cddd0 con 0x7f56140cb880 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f561259c700 1 --2- 172.21.15.26:0/4197360890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 0x7f56140cbc50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56040098e0 tx=0x7f56040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97611ce07405af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5611d9b700 1 -- 172.21.15.26:0/4197360890 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400b640 con 0x7f56140cb880 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5611d9b700 1 -- 172.21.15.26:0/4197360890 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400b7a0 con 0x7f56140cb880 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5611d9b700 1 -- 172.21.15.26:0/4197360890 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400bb40 con 0x7f56140cb880 2023-10-09T11:43:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 -- 172.21.15.26:0/4197360890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 msgr2=0x7f56140cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 --2- 172.21.15.26:0/4197360890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 0x7f56140cbc50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56040098e0 tx=0x7f56040091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 -- 172.21.15.26:0/4197360890 shutdown_connections 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 --2- 172.21.15.26:0/4197360890 >> v2:172.21.15.67:3300/0 conn(0x7f56140cd770 0x7f56141591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 --2- 172.21.15.26:0/4197360890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cb880 0x7f56140cbc50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 -- 172.21.15.26:0/4197360890 >> 172.21.15.26:0/4197360890 conn(0x7f56140703a0 msgr2=0x7f56140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 -- 172.21.15.26:0/4197360890 shutdown_connections 2023-10-09T11:43:03.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.176+0000 7f5618ab1700 1 -- 172.21.15.26:0/4197360890 wait complete. 2023-10-09T11:43:03.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 Processor -- start 2023-10-09T11:43:03.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 -- start start 2023-10-09T11:43:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56140b04f0 0x7f5614147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cd770 0x7f56140b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561416b090 con 0x7f56140cb880 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614167bc0 con 0x7f56140b04f0 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5618ab1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5614167ea0 con 0x7f56140cd770 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5609d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5609d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34372/0 (socket says 172.21.15.26:34372) 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f5609d9b700 1 -- 172.21.15.26:0/790368835 learned_addr learned my addr 172.21.15.26:0/790368835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.178+0000 7f561259c700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56140b04f0 0x7f5614147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5612d9d700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cd770 0x7f56140b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 -- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cd770 msgr2=0x7f56140b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cd770 0x7f56140b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 -- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56140b04f0 msgr2=0x7f5614147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56140b04f0 0x7f5614147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 -- 172.21.15.26:0/790368835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009420 con 0x7f56140cb880 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.179+0000 7f5609d9b700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c590 tx=0x7f55fc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc005b30 con 0x7f56140cb880 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc005cb0 con 0x7f56140cb880 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614168180 con 0x7f56140cb880 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc007320 con 0x7f56140cb880 2023-10-09T11:43:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614168740 con 0x7f56140cb880 2023-10-09T11:43:03.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.180+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561404c3c0 con 0x7f56140cb880 2023-10-09T11:43:03.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.181+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55fc01b3b0 con 0x7f56140cb880 2023-10-09T11:43:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.181+0000 7f560affd700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.181+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f55fc083fb0 con 0x7f56140cb880 2023-10-09T11:43:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.182+0000 7f561259c700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.182+0000 7f561259c700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 0x7f55f40697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f56040091e0 tx=0x7f5604017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.186+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55fc050ba0 con 0x7f56140cb880 2023-10-09T11:43:03.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.376+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000601189.meta", "pool2": "cephfs.volume_0000000000601189.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56140ce680 con 0x7f56140cb880 2023-10-09T11:43:03.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.987+0000 7f560affd700 1 -- 172.21.15.26:0/790368835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000601189.meta", "pool2": "cephfs.volume_0000000000601189.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000601189.meta' removed v143) v1 ==== 241+0+0 (secure 0 0 0) 0x7f55fc017020 con 0x7f56140cb880 2023-10-09T11:43:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 msgr2=0x7f55f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 0x7f55f40697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f56040091e0 tx=0x7f5604017000 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 msgr2=0x7f56140c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c590 tx=0x7f55fc007f90 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 shutdown_connections 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f56140cd770 0x7f56140b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56140b04f0 0x7f5614147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 --2- 172.21.15.26:0/790368835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56140cb880 0x7f56140c9120 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 >> 172.21.15.26:0/790368835 conn(0x7f56140703a0 msgr2=0x7f56140b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 shutdown_connections 2023-10-09T11:43:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:03.990+0000 7f5618ab1700 1 -- 172.21.15.26:0/790368835 wait complete. 2023-10-09T11:43:03.992 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs.volume_0000000000601189.meta' removed 2023-10-09T11:43:04.004 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000601189.data cephfs.volume_0000000000601189.data --yes-i-really-really-mean-it 2023-10-09T11:43:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 Processor -- start 2023-10-09T11:43:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 -- start start 2023-10-09T11:43:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f8006dcf0 0x7f1f80159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f80159e40 0x7f1f800cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800ccfd0 con 0x7f1f80159530 2023-10-09T11:43:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8015a410 con 0x7f1f8006dcf0 2023-10-09T11:43:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.130+0000 7f1f85787700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8015a6f0 con 0x7f1f80159e40 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f8006dcf0 0x7f1f80159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f80159e40 0x7f1f800cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f8006dcf0 0x7f1f80159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:39074/0 (socket says 172.21.15.26:39074) 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 -- 172.21.15.26:0/1411736781 learned_addr learned my addr 172.21.15.26:0/1411736781 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7effd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1f80159530 0x7f1f800ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:33414/0 (socket says 172.21.15.26:33414) 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 -- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f80159e40 msgr2=0x7f1f800cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 --2- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f80159e40 0x7f1f800cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 -- 172.21.15.26:0/1411736781 >> v1:172.21.15.67:6789/0 conn(0x7f1f80159530 legacy=0x7f1f800ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 -- 172.21.15.26:0/1411736781 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8015a9d0 con 0x7f1f8006dcf0 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7dffb700 1 -- 172.21.15.26:0/1411736781 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169733524 0 0) 0x7f1f800ccfd0 con 0x7f1f80159530 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.131+0000 7f1f7e7fc700 1 --2- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f8006dcf0 0x7f1f80159900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1f740099b0 tx=0x7f1f74009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22aa9be9d31a34da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f7dffb700 1 -- 172.21.15.26:0/1411736781 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74009ea0 con 0x7f1f8006dcf0 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f7dffb700 1 -- 172.21.15.26:0/1411736781 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400b860 con 0x7f1f8006dcf0 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f7dffb700 1 -- 172.21.15.26:0/1411736781 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400bc00 con 0x7f1f8006dcf0 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 -- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f8006dcf0 msgr2=0x7f1f80159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 --2- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f8006dcf0 0x7f1f80159900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1f740099b0 tx=0x7f1f74009250 comp rx=0 tx=0).stop 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 -- 172.21.15.26:0/1411736781 shutdown_connections 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 --2- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f80159e40 0x7f1f800cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 --2- 172.21.15.26:0/1411736781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f8006dcf0 0x7f1f80159900 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 -- 172.21.15.26:0/1411736781 >> 172.21.15.26:0/1411736781 conn(0x7f1f800703a0 msgr2=0x7f1f800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 -- 172.21.15.26:0/1411736781 shutdown_connections 2023-10-09T11:43:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.132+0000 7f1f85787700 1 -- 172.21.15.26:0/1411736781 wait complete. 2023-10-09T11:43:04.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.133+0000 7f1f85787700 1 Processor -- start 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.133+0000 7f1f85787700 1 -- start start 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 0x7f1f8014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f80159530 0x7f1f8014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8014e8e0 con 0x7f1f80159e40 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b3dc0 con 0x7f1f80159530 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f85787700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b40a0 con 0x7f1f8006dcf0 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34384/0 (socket says 172.21.15.26:34384) 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/3663673337 learned_addr learned my addr 172.21.15.26:0/3663673337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:04.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f7effd700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 0x7f1f8014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.134+0000 7f1f7e7fc700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f80159530 0x7f1f8014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 msgr2=0x7f1f8014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 0x7f1f8014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f80159530 msgr2=0x7f1f8014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f80159530 0x7f1f8014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/3663673337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740094f0 con 0x7f1f80159e40 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7effd700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 0x7f1f8014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f7f7fe700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800e8d0 tx=0x7f1f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78013680 con 0x7f1f80159e40 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f780137e0 con 0x7f1f80159e40 2023-10-09T11:43:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800b4380 con 0x7f1f80159e40 2023-10-09T11:43:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78013ba0 con 0x7f1f80159e40 2023-10-09T11:43:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.135+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8015dbe0 con 0x7f1f80159e40 2023-10-09T11:43:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.136+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8004c3c0 con 0x7f1f80159e40 2023-10-09T11:43:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.136+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f780123d0 con 0x7f1f80159e40 2023-10-09T11:43:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.137+0000 7f1f66ffd700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.137+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5394+0+0 (secure 0 0 0) 0x7f1f78084bc0 con 0x7f1f80159e40 2023-10-09T11:43:04.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.137+0000 7f1f7effd700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.137+0000 7f1f7effd700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 0x7f1f6c0697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1f70001560 tx=0x7f1f70005c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.141+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f78051980 con 0x7f1f80159e40 2023-10-09T11:43:04.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:04.333+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000601189.data", "pool2": "cephfs.volume_0000000000601189.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f8015acb0 con 0x7f1f80159e40 2023-10-09T11:43:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.218+0000 7f1f66ffd700 1 -- 172.21.15.26:0/3663673337 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000601189.data", "pool2": "cephfs.volume_0000000000601189.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000601189.data' removed v144) v1 ==== 241+0+0 (secure 0 0 0) 0x7f1f78054fa0 con 0x7f1f80159e40 2023-10-09T11:43:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 msgr2=0x7f1f6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 0x7f1f6c0697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1f70001560 tx=0x7f1f70005c90 comp rx=0 tx=0).stop 2023-10-09T11:43:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 msgr2=0x7f1f8016a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800e8d0 tx=0x7f1f780091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 shutdown_connections 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f80159e40 0x7f1f8016a0d0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1f6c067320 0x7f1f6c0697d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f8006dcf0 0x7f1f8014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 --2- 172.21.15.26:0/3663673337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f80159530 0x7f1f8014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 >> 172.21.15.26:0/3663673337 conn(0x7f1f800703a0 msgr2=0x7f1f800c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 shutdown_connections 2023-10-09T11:43:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.221+0000 7f1f85787700 1 -- 172.21.15.26:0/3663673337 wait complete. 2023-10-09T11:43:05.223 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs.volume_0000000000601189.data' removed 2023-10-09T11:43:05.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:43:05.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.372+0000 7fbd9a4af700 1 Processor -- start 2023-10-09T11:43:05.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.372+0000 7fbd9a4af700 1 -- start start 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.373+0000 7fbd9a4af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd941645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.373+0000 7fbd9a4af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940cc270 con 0x7fbd940ab190 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.373+0000 7fbd9a4af700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940a9cf0 con 0x7fbd94159970 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.373+0000 7fbd9a4af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940ac6e0 con 0x7fbd940ad850 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd8bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd940ab190 0x7fbd940ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45334/0 (socket says 172.21.15.26:45334) 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd8bfff700 1 -- 172.21.15.26:0/3509450481 learned_addr learned my addr 172.21.15.26:0/3509450481 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:05.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd98a4c700 1 --2- 172.21.15.26:0/3509450481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd941645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936016275 0 0) 0x7fbd940cc270 con 0x7fbd940ab190 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd80003570 con 0x7fbd940ab190 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987071922 0 0) 0x7fbd940a9cf0 con 0x7fbd94159970 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd940cc270 con 0x7fbd94159970 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3509450481 >> v1:172.21.15.67:6789/0 conn(0x7fbd94159970 legacy=0x7fbd940abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3509450481 >> v1:172.21.15.26:6789/0 conn(0x7fbd940ab190 legacy=0x7fbd940ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3509450481 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940ac9c0 con 0x7fbd940ad850 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.374+0000 7fbd98a4c700 1 --2- 172.21.15.26:0/3509450481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd941645b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e90 tx=0x7fbd8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aff0aa5d02e7084 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00e070 con 0x7fbd940ad850 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00bb80 con 0x7fbd940ad850 2023-10-09T11:43:05.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd937fe700 1 -- 172.21.15.26:0/3509450481 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c012430 con 0x7fbd940ad850 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3509450481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 msgr2=0x7fbd941645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3509450481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd941645b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009e90 tx=0x7fbd8c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3509450481 shutdown_connections 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3509450481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd941645b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3509450481 >> 172.21.15.26:0/3509450481 conn(0x7fbd9406d170 msgr2=0x7fbd940cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3509450481 shutdown_connections 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.375+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3509450481 wait complete. 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.376+0000 7fbd9a4af700 1 Processor -- start 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.376+0000 7fbd9a4af700 1 -- start start 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd940ab190 0x7fbd9416d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd9416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9416d710 con 0x7fbd94159970 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9416d9f0 con 0x7fbd940ab190 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd9a4af700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9416dcd0 con 0x7fbd940ad850 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd98a4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd98a4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34392/0 (socket says 172.21.15.26:34392) 2023-10-09T11:43:05.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3007712009 learned_addr learned my addr 172.21.15.26:0/3007712009 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd8bfff700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd9416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.377+0000 7fbd93fff700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd940ab190 0x7fbd9416d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 msgr2=0x7fbd9416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd9416a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd940ab190 msgr2=0x7fbd9416d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd940ab190 0x7fbd9416d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 -- 172.21.15.26:0/3007712009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009a20 con 0x7fbd94159970 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd98a4c700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c013000 tx=0x7fbd8c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c012e30 con 0x7fbd94159970 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c01b420 con 0x7fbd94159970 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940c4b60 con 0x7fbd94159970 2023-10-09T11:43:05.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c01b7e0 con 0x7fbd94159970 2023-10-09T11:43:05.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.378+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9415c0e0 con 0x7fbd94159970 2023-10-09T11:43:05.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.379+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9404c3c0 con 0x7fbd94159970 2023-10-09T11:43:05.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.379+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbd8c01bb50 con 0x7fbd94159970 2023-10-09T11:43:05.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.380+0000 7fbd90ff9700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 0x7fbd740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.380+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbd8c086620 con 0x7fbd94159970 2023-10-09T11:43:05.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.380+0000 7fbd93fff700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 0x7fbd740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.381+0000 7fbd93fff700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 0x7fbd740697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbd84007fd0 tx=0x7fbd84007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.385+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd8c0534a0 con 0x7fbd94159970 2023-10-09T11:43:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.579+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbd940acca0 con 0x7fbd94159970 2023-10-09T11:43:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.582+0000 7fbd90ff9700 1 -- 172.21.15.26:0/3007712009 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd8c056ac0 con 0x7fbd94159970 2023-10-09T11:43:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 msgr2=0x7fbd740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 0x7fbd740697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbd84007fd0 tx=0x7fbd84007d10 comp rx=0 tx=0).stop 2023-10-09T11:43:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 msgr2=0x7fbd940c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c013000 tx=0x7fbd8c019000 comp rx=0 tx=0).stop 2023-10-09T11:43:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 shutdown_connections 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd94159970 0x7fbd940c26c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd940ab190 0x7fbd9416d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd74067320 0x7fbd740697d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 --2- 172.21.15.26:0/3007712009 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd940ad850 0x7fbd9416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 >> 172.21.15.26:0/3007712009 conn(0x7fbd9406d170 msgr2=0x7fbd94157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 shutdown_connections 2023-10-09T11:43:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.584+0000 7fbd9a4af700 1 -- 172.21.15.26:0/3007712009 wait complete. 2023-10-09T11:43:05.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-09T11:43:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.716+0000 7fb3b8165700 1 Processor -- start 2023-10-09T11:43:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.716+0000 7fb3b8165700 1 -- start start 2023-10-09T11:43:05.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b8165700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3b01599a0 0x7fb3b006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b8165700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb3b00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b8165700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b00c7f50 con 0x7fb3b01595d0 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b8165700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b006bd00 con 0x7fb3b01599a0 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b8165700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b006b740 con 0x7fb3b006b230 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b5f01700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb3b01595d0 0x7fb3b00675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45336/0 (socket says 172.21.15.26:45336) 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b5f01700 1 -- 172.21.15.26:0/2776522181 learned_addr learned my addr 172.21.15.26:0/2776522181 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863857758 0 0) 0x7fb3b00c7f50 con 0x7fb3b01595d0 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.717+0000 7fb3b6702700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb3b00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 --2- 172.21.15.26:0/2776522181 >> v2:172.21.15.67:3300/0 conn(0x7fb3b01599a0 0x7fb3b006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb39c003570 con 0x7fb3b01595d0 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1749264488 0 0) 0x7fb39c003570 con 0x7fb3b01595d0 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 msgr2=0x7fb3b00c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb3b00c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 >> v2:172.21.15.67:3300/0 conn(0x7fb3b01599a0 msgr2=0x7fb3b006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 --2- 172.21.15.26:0/2776522181 >> v2:172.21.15.67:3300/0 conn(0x7fb3b01599a0 0x7fb3b006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b006ba20 con 0x7fb3b01595d0 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb3ac001470 con 0x7fb3b01595d0 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 >> v1:172.21.15.26:6789/0 conn(0x7fb3b01595d0 legacy=0x7fb3b00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c003a60 0x7fb39c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb39c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b006b740 con 0x7fb39c004810 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c00ba60 con 0x7fb39c003a60 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c00bba0 con 0x7fb3b006b230 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5f01700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c003a60 0x7fb39c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b6702700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb39c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 -- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 msgr2=0x7fb39c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b006b230 0x7fb39c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 -- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c003a60 msgr2=0x7fb39c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c003a60 0x7fb39c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.718+0000 7fb3b5700700 1 -- 172.21.15.26:0/2776522181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c003570 con 0x7fb39c004810 2023-10-09T11:43:05.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b5700700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009c30 tx=0x7fb3a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7394dafa955028b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000e710 con 0x7fb39c004810 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a000e870 con 0x7fb39c004810 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b4eff700 1 -- 172.21.15.26:0/2776522181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000ec30 con 0x7fb39c004810 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 -- 172.21.15.26:0/2776522181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 msgr2=0x7fb39c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 --2- 172.21.15.26:0/2776522181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009c30 tx=0x7fb3a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b6702700 1 -- 172.21.15.26:0/2776522181 reap_dead start 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 -- 172.21.15.26:0/2776522181 shutdown_connections 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 -- 172.21.15.26:0/2776522181 >> 172.21.15.26:0/2776522181 conn(0x7fb3b00cd400 msgr2=0x7fb3b00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 -- 172.21.15.26:0/2776522181 shutdown_connections 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.719+0000 7fb3b8165700 1 -- 172.21.15.26:0/2776522181 wait complete. 2023-10-09T11:43:05.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.720+0000 7fb3b8165700 1 Processor -- start 2023-10-09T11:43:05.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.720+0000 7fb3b8165700 1 -- start start 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c004810 0x7fb3b0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b015b170 0x7fb3b015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b00b2fb0 con 0x7fb3b00b0a40 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b015bb20 con 0x7fb39c004810 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b8165700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b00b13f0 con 0x7fb3b015b170 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b6702700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b6702700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34408/0 (socket says 172.21.15.26:34408) 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b6702700 1 -- 172.21.15.26:0/3840511356 learned_addr learned my addr 172.21.15.26:0/3840511356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b5f01700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c004810 0x7fb3b0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.721+0000 7fb3b5700700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b015b170 0x7fb3b015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 -- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b015b170 msgr2=0x7fb3b015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b015b170 0x7fb3b015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 -- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c004810 msgr2=0x7fb3b0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c004810 0x7fb3b0155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 -- 172.21.15.26:0/3840511356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b015c960 con 0x7fb3b00b0a40 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b6702700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009d70 tx=0x7fb3a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800e040 con 0x7fb3b00b0a40 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800f040 con 0x7fb3b00b0a40 2023-10-09T11:43:05.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b015cdf0 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800fda0 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.722+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b015c030 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.723+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b015caf0 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.723+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb3a8015640 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.724+0000 7fb3a5ffb700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 0x7fb3940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.724+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb3a80850c0 con 0x7fb3b00b0a40 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.724+0000 7fb3b5f01700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 0x7fb3940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.725+0000 7fb3b5f01700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 0x7fb3940697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac001d20 tx=0x7fb3ac001e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.728+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3a8051f40 con 0x7fb3b00b0a40 2023-10-09T11:43:05.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:05.999+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7fb3b004c3c0 con 0x7fb3b00b0a40 2023-10-09T11:43:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.222+0000 7fb3a5ffb700 1 -- 172.21.15.26:0/3840511356 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v388) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb3a8055560 con 0x7fb3b00b0a40 2023-10-09T11:43:06.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 msgr2=0x7fb3940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 0x7fb3940697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac001d20 tx=0x7fb3ac001e90 comp rx=0 tx=0).stop 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 msgr2=0x7fb3b00b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009d70 tx=0x7fb3a800b040 comp rx=0 tx=0).stop 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 shutdown_connections 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b00b0a40 0x7fb3b00b0eb0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb39c004810 0x7fb3b0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb394067320 0x7fb3940697d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 --2- 172.21.15.26:0/3840511356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3b015b170 0x7fb3b015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 >> 172.21.15.26:0/3840511356 conn(0x7fb3b00cd400 msgr2=0x7fb3b0067720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 shutdown_connections 2023-10-09T11:43:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.224+0000 7fb3b8165700 1 -- 172.21.15.26:0/3840511356 wait complete. 2023-10-09T11:43:06.237 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ok 2023-10-09T11:43:06.237 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) That renaming volume fails without --yes-i-really-mean-it flag. 2023-10-09T11:43:06.237 INFO:tasks.cephfs_test_runner:test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:43:06.238 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-09T11:43:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.357+0000 7f541fa1e700 1 Processor -- start 2023-10-09T11:43:06.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.357+0000 7f541fa1e700 1 -- start start 2023-10-09T11:43:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5418143200 0x7f5418159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 0x7f541815a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 0x7f541806cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54181171e0 con 0x7f5418143200 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541806c7d0 con 0x7f54180c3250 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541fa1e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541815ac60 con 0x7f541815a850 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541d7ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5418143200 0x7f5418159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541d7ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5418143200 0x7f5418159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34414/0 (socket says 172.21.15.26:34414) 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.358+0000 7f541d7ba700 1 -- 172.21.15.26:0/4001814495 learned_addr learned my addr 172.21.15.26:0/4001814495 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541cfb9700 1 --2- 172.21.15.26:0/4001814495 >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 0x7f541815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 -- 172.21.15.26:0/4001814495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 msgr2=0x7f541806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541dfbb700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 0x7f541806cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 0x7f541806cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 -- 172.21.15.26:0/4001814495 >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 msgr2=0x7f541815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 --2- 172.21.15.26:0/4001814495 >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 0x7f541815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 -- 172.21.15.26:0/4001814495 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180c37a0 con 0x7f5418143200 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541cfb9700 1 --2- 172.21.15.26:0/4001814495 >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 0x7f541815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541dfbb700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 0x7f541806cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541d7ba700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5418143200 0x7f5418159dd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f541806a2b0 tx=0x7f5410009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d3ce0c87acab60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f5417fff700 1 -- 172.21.15.26:0/4001814495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000e070 con 0x7f5418143200 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f5417fff700 1 -- 172.21.15.26:0/4001814495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541000ba50 con 0x7f5418143200 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f5417fff700 1 -- 172.21.15.26:0/4001814495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100092e0 con 0x7f5418143200 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541fa1e700 1 -- 172.21.15.26:0/4001814495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5418143200 msgr2=0x7f5418159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.359+0000 7f541fa1e700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5418143200 0x7f5418159dd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f541806a2b0 tx=0x7f5410009840 comp rx=0 tx=0).stop 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 -- 172.21.15.26:0/4001814495 shutdown_connections 2023-10-09T11:43:06.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f541815a850 0x7f541806cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 --2- 172.21.15.26:0/4001814495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5418143200 0x7f5418159dd0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 --2- 172.21.15.26:0/4001814495 >> v2:172.21.15.67:3300/0 conn(0x7f54180c3250 0x7f541815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 -- 172.21.15.26:0/4001814495 >> 172.21.15.26:0/4001814495 conn(0x7f54180ccb60 msgr2=0x7f54180ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 -- 172.21.15.26:0/4001814495 shutdown_connections 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.360+0000 7f541fa1e700 1 -- 172.21.15.26:0/4001814495 wait complete. 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.361+0000 7f541fa1e700 1 Processor -- start 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.361+0000 7f541fa1e700 1 -- start start 2023-10-09T11:43:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54180c3250 0x7f541815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5418143200 0x7f541815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541815bdd0 con 0x7f541815a850 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541815c0b0 con 0x7f5418143200 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541fa1e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541815c390 con 0x7f54180c3250 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34422/0 (socket says 172.21.15.26:34422) 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 -- 172.21.15.26:0/2798549082 learned_addr learned my addr 172.21.15.26:0/2798549082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541cfb9700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5418143200 0x7f541815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541d7ba700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54180c3250 0x7f541815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 -- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54180c3250 msgr2=0x7f541815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54180c3250 0x7f541815af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 -- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5418143200 msgr2=0x7f541815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5418143200 0x7f541815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 -- 172.21.15.26:0/2798549082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410009ae0 con 0x7f541815a850 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.362+0000 7f541dfbb700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f540800c850 tx=0x7f5408008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.363+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011600 con 0x7f541815a850 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.363+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408011760 con 0x7f541815a850 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.363+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541815c670 con 0x7f541815a850 2023-10-09T11:43:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.363+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011b20 con 0x7f541815a850 2023-10-09T11:43:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.363+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541815ce70 con 0x7f541815a850 2023-10-09T11:43:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.364+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541804c3c0 con 0x7f541815a850 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.364+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5408018350 con 0x7f541815a850 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.364+0000 7f54157fa700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 0x7f54040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.365+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5408084870 con 0x7f541815a850 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.365+0000 7f541d7ba700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 0x7f54040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.365+0000 7f541d7ba700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 0x7f54040697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5410009880 tx=0x7f5410018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.369+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5408055180 con 0x7f541815a850 2023-10-09T11:43:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:06.640+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f54180cc090 con 0x7f541815a850 2023-10-09T11:43:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.226+0000 7f54157fa700 1 -- 172.21.15.26:0/2798549082 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v389) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5408054d10 con 0x7f541815a850 2023-10-09T11:43:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.228+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 msgr2=0x7f54040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.228+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 0x7f54040697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5410009880 tx=0x7f5410018000 comp rx=0 tx=0).stop 2023-10-09T11:43:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 msgr2=0x7f541815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f540800c850 tx=0x7f5408008040 comp rx=0 tx=0).stop 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 shutdown_connections 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f541815a850 0x7f541815a180 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5404067320 0x7f54040697d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54180c3250 0x7f541815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 --2- 172.21.15.26:0/2798549082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5418143200 0x7f541815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 >> 172.21.15.26:0/2798549082 conn(0x7f54180ccb60 msgr2=0x7f541806b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 shutdown_connections 2023-10-09T11:43:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.229+0000 7f541fa1e700 1 -- 172.21.15.26:0/2798549082 wait complete. 2023-10-09T11:43:07.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:43:07.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.368+0000 7fb0e8c49700 1 Processor -- start 2023-10-09T11:43:07.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.368+0000 7fb0e8c49700 1 -- start start 2023-10-09T11:43:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e8c49700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0e4159530 0x7fb0e40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e8c49700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40ccfd0 con 0x7fb0e406dc70 2023-10-09T11:43:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e8c49700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40cf0e0 con 0x7fb0e406e0e0 2023-10-09T11:43:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e8c49700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e415a3d0 con 0x7fb0e4159530 2023-10-09T11:43:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb0e406dc70 0x7fb0e4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45350/0 (socket says 172.21.15.26:45350) 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e1d9b700 1 -- 172.21.15.26:0/2503622238 learned_addr learned my addr 172.21.15.26:0/2503622238 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e259c700 1 --2- 172.21.15.26:0/2503622238 >> v2:172.21.15.67:3300/0 conn(0x7fb0e4159530 0x7fb0e40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.369+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340997791 0 0) 0x7fb0e40ccfd0 con 0x7fb0e406dc70 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e406dc70 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4098714806 0 0) 0x7fb0d0003570 con 0x7fb0e406dc70 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 >> v2:172.21.15.67:3300/0 conn(0x7fb0e4159530 msgr2=0x7fb0e40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 --2- 172.21.15.26:0/2503622238 >> v2:172.21.15.67:3300/0 conn(0x7fb0e4159530 0x7fb0e40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 >> v1:172.21.15.67:6789/0 conn(0x7fb0e406e0e0 legacy=0x7fb0e40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e415a6b0 con 0x7fb0e406dc70 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb0cc001470 con 0x7fb0e406dc70 2023-10-09T11:43:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 >> v1:172.21.15.26:6789/0 conn(0x7fb0e406dc70 legacy=0x7fb0e4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d0003ab0 0x7fb0d0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e415a3d0 con 0x7fb0d0005210 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c130 con 0x7fb0d0003ab0 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c2f0 con 0x7fb0d0004810 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e259c700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d0003ab0 0x7fb0d0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e1d9b700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 -- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d0004810 msgr2=0x7fb0d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 -- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d0003ab0 msgr2=0x7fb0d0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d0003ab0 0x7fb0d0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 -- 172.21.15.26:0/2503622238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0003570 con 0x7fb0d0005210 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.370+0000 7fb0e2d9d700 1 -- 172.21.15.26:0/2503622238 reap_dead start 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e2d9d700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0d000ba60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc001fc0 tx=0x7fb0dc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a605722f4703c612 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc001950 con 0x7fb0d0005210 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00c8b0 con 0x7fb0d0005210 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e159a700 1 -- 172.21.15.26:0/2503622238 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00cc90 con 0x7fb0d0005210 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 -- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 msgr2=0x7fb0d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0d000ba60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc001fc0 tx=0x7fb0dc001640 comp rx=0 tx=0).stop 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 -- 172.21.15.26:0/2503622238 shutdown_connections 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/2503622238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0d000ba60 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 -- 172.21.15.26:0/2503622238 >> 172.21.15.26:0/2503622238 conn(0x7fb0e40703a0 msgr2=0x7fb0e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 -- 172.21.15.26:0/2503622238 shutdown_connections 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.371+0000 7fb0e8c49700 1 -- 172.21.15.26:0/2503622238 wait complete. 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.372+0000 7fb0e8c49700 1 Processor -- start 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.372+0000 7fb0e8c49700 1 -- start start 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 0x7fb0e40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0e40b41a0 0x7fb0e40b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40b4b80 con 0x7fb0d0005210 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40ca610 con 0x7fb0e40c8ab0 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e8c49700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40ca180 con 0x7fb0e40b41a0 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34440/0 (socket says 172.21.15.26:34440) 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 -- 172.21.15.26:0/3145119365 learned_addr learned my addr 172.21.15.26:0/3145119365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e2d9d700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0e40b41a0 0x7fb0e40b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e1d9b700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 0x7fb0e40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 -- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0e40b41a0 msgr2=0x7fb0e40b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0e40b41a0 0x7fb0e40b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.373+0000 7fb0e259c700 1 -- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 msgr2=0x7fb0e40c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e259c700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 0x7fb0e40c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e259c700 1 -- 172.21.15.26:0/3145119365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4153340 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e1d9b700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 0x7fb0e40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e259c700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4011b10 tx=0x7fb0d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400f940 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400faa0 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e40c9570 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400fe20 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.374+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e40c9b30 con 0x7fb0d0005210 2023-10-09T11:43:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.375+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e404c3c0 con 0x7fb0d0005210 2023-10-09T11:43:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.375+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb0d4014650 con 0x7fb0d0005210 2023-10-09T11:43:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.376+0000 7fb0da7fc700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 0x7fb0c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.376+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb0d4018030 con 0x7fb0d0005210 2023-10-09T11:43:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.376+0000 7fb0e1d9b700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 0x7fb0c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.376+0000 7fb0e1d9b700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 0x7fb0c40697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc001e90 tx=0x7fb0cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.380+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d40522d0 con 0x7fb0d0005210 2023-10-09T11:43:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.572+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb0e415a990 con 0x7fb0d0005210 2023-10-09T11:43:07.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.576+0000 7fb0da7fc700 1 -- 172.21.15.26:0/3145119365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0d40558f0 con 0x7fb0d0005210 2023-10-09T11:43:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 msgr2=0x7fb0c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 0x7fb0c40697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc001e90 tx=0x7fb0cc009040 comp rx=0 tx=0).stop 2023-10-09T11:43:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 msgr2=0x7fb0e4152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4011b10 tx=0x7fb0d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 shutdown_connections 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb0c4067320 0x7fb0c40697d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0e40b41a0 0x7fb0e40b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d0005210 0x7fb0e4152e00 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 --2- 172.21.15.26:0/3145119365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0e40c8ab0 0x7fb0e40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 >> 172.21.15.26:0/3145119365 conn(0x7fb0e40703a0 msgr2=0x7fb0e40cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 shutdown_connections 2023-10-09T11:43:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.578+0000 7fb0e8c49700 1 -- 172.21.15.26:0/3145119365 wait complete. 2023-10-09T11:43:07.590 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:43:07.590 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:07.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:07.679 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:43:07.679 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:43:07.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:07.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.798+0000 7f08678cc700 1 Processor -- start 2023-10-09T11:43:07.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.798+0000 7f08678cc700 1 -- start start 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f08678cc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f086015a5d0 0x7f0860156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f08678cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086015ae40 con 0x7f08600cb5a0 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f08678cc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086015ab60 con 0x7f08600cb970 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f08678cc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600ce0f0 con 0x7f086015a5d0 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f0865668700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f08600cb5a0 0x7f08600cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45358/0 (socket says 172.21.15.26:45358) 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.799+0000 7f0865668700 1 -- 172.21.15.26:0/2260905396 learned_addr learned my addr 172.21.15.26:0/2260905396 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865e69700 1 --2- 172.21.15.26:0/2260905396 >> v2:172.21.15.67:3300/0 conn(0x7f086015a5d0 0x7f0860156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399068872 0 0) 0x7f086015ae40 con 0x7f08600cb5a0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0848003570 con 0x7f08600cb5a0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138588589 0 0) 0x7f0848003570 con 0x7f08600cb5a0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 >> v2:172.21.15.67:3300/0 conn(0x7f086015a5d0 msgr2=0x7f0860156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 --2- 172.21.15.26:0/2260905396 >> v2:172.21.15.67:3300/0 conn(0x7f086015a5d0 0x7f0860156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 >> v1:172.21.15.67:6789/0 conn(0x7f08600cb970 legacy=0x7f0860159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600ccf00 con 0x7f08600cb5a0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f08500017f0 con 0x7f08600cb5a0 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 >> v1:172.21.15.26:6789/0 conn(0x7f08600cb5a0 legacy=0x7f08600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 0x7f0848003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848004810 0x7f0848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08480051c0 0x7f084800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600ce0f0 con 0x7f0848003a60 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084800c0d0 con 0x7f0848004810 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084800c290 con 0x7f08480051c0 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 0x7f0848003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0864e67700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848004810 0x7f0848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 -- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08480051c0 msgr2=0x7f084800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08480051c0 0x7f084800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 -- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848004810 msgr2=0x7f0848004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848004810 0x7f0848004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865668700 1 -- 172.21.15.26:0/2260905396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848003570 con 0x7f0848003a60 2023-10-09T11:43:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.800+0000 7f0865e69700 1 -- 172.21.15.26:0/2260905396 reap_dead start 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f0865668700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 0x7f0848003e70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f085000a930 tx=0x7f08500021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56babed8a1d026f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500070d0 con 0x7f0848003a60 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850007250 con 0x7f0848003a60 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f085ffff700 1 -- 172.21.15.26:0/2260905396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850007610 con 0x7f0848003a60 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 -- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 msgr2=0x7f0848003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 0x7f0848003e70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f085000a930 tx=0x7f08500021d0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 -- 172.21.15.26:0/2260905396 shutdown_connections 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 --2- 172.21.15.26:0/2260905396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0848003a60 0x7f0848003e70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 -- 172.21.15.26:0/2260905396 >> 172.21.15.26:0/2260905396 conn(0x7f0860070e30 msgr2=0x7f08600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 -- 172.21.15.26:0/2260905396 shutdown_connections 2023-10-09T11:43:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.801+0000 7f08678cc700 1 -- 172.21.15.26:0/2260905396 wait complete. 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.802+0000 7f08678cc700 1 Processor -- start 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.802+0000 7f08678cc700 1 -- start start 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 0x7f086015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08600c88a0 0x7f086016cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b35c0 con 0x7f08600c8430 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b38a0 con 0x7f0848003a60 2023-10-09T11:43:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f08678cc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b3b80 con 0x7f08600c88a0 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f0864e67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f0864e67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34448/0 (socket says 172.21.15.26:34448) 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.803+0000 7f0864e67700 1 -- 172.21.15.26:0/1949554239 learned_addr learned my addr 172.21.15.26:0/1949554239 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0865668700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 0x7f086015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0865e69700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08600c88a0 0x7f086016cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 -- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08600c88a0 msgr2=0x7f086016cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08600c88a0 0x7f086016cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 -- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 msgr2=0x7f086015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 0x7f086015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 -- 172.21.15.26:0/1949554239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600b3e60 con 0x7f08600c8430 2023-10-09T11:43:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0865668700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 0x7f086015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f0864e67700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f085400e840 tx=0x7f0854009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854013630 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854013790 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854013b50 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600b4140 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.804+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086015e3a0 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.805+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086004c3c0 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.806+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f085401c400 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.806+0000 7f085d7fa700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 0x7f084c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.806+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0854084a60 con 0x7f08600c8430 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.806+0000 7f0865668700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 0x7f084c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.807+0000 7f0865668700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 0x7f084c0697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f085000afd0 tx=0x7f0850016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:07.810+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0854051ab0 con 0x7f08600c8430 2023-10-09T11:43:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.047+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08600cc2e0 con 0x7f08600c8430 2023-10-09T11:43:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.048+0000 7f085d7fa700 1 -- 172.21.15.26:0/1949554239 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f08540550d0 con 0x7f08600c8430 2023-10-09T11:43:08.048 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:08.048 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":96,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/273643885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":273643885},{"type":"v1","addr":"172.21.15.67:6837","nonce":273643885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2699952712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2699952712},{"type":"v1","addr":"172.21.15.67:6836","nonce":2699952712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7632,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/469306489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":469306489},{"type":"v1","addr":"172.21.15.26:6834","nonce":469306489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7929,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3309594607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3309594607},{"type":"v1","addr":"172.21.15.26:6835","nonce":3309594607}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[]} 2023-10-09T11:43:08.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 msgr2=0x7f084c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 0x7f084c0697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f085000afd0 tx=0x7f0850016000 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 msgr2=0x7f086015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f085400e840 tx=0x7f0854009040 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 shutdown_connections 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f084c067320 0x7f084c0697d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08600c88a0 0x7f086016cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0848003a60 0x7f086015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 --2- 172.21.15.26:0/1949554239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08600c8430 0x7f086015bd30 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 >> 172.21.15.26:0/1949554239 conn(0x7f0860070e30 msgr2=0x7f08600cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 shutdown_connections 2023-10-09T11:43:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.050+0000 7f08678cc700 1 -- 172.21.15.26:0/1949554239 wait complete. 2023-10-09T11:43:08.052 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 96 2023-10-09T11:43:08.062 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:43:08.062 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:43:08.063 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:43:08.063 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:08.063 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:43:08.063 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:43:08.063 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:43:08.063 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:08.064 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:43:08.064 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:43:08.064 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:43:08.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:08.064 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:43:08.064 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:43:08.064 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:43:08.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:08.073 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:43:08.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:43:08.074 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:43:08.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:43:08.075 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:43:08.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:43:08.076 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:43:08.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:43:08.115 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:43:08.116 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:08.116 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:43:08.116 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:08.118 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:43:08.119 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:08.119 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:43:08.119 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:08.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:43:08.191 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:43:08.191 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:43:08.203 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:43:08.204 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:43:08.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.247+0000 7f64ece13700 1 Processor -- start 2023-10-09T11:43:08.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.247+0000 7f64ece13700 1 -- start start 2023-10-09T11:43:08.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ece13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 0x7f64e80cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:08.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ece13700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80aeee0 con 0x7f64e80a90d0 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ece13700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80cf490 con 0x7f64e806e550 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ece13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80ae680 con 0x7f64e80a8d00 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ddd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f64e80a90d0 0x7f64e806de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45372/0 (socket says 172.21.15.26:45372) 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64ddd9b700 1 -- 172.21.15.26:0/719865074 learned_addr learned my addr 172.21.15.26:0/719865074 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.248+0000 7f64e659c700 1 --2- 172.21.15.26:0/719865074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 0x7f64e80cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890754963 0 0) 0x7f64e80aeee0 con 0x7f64e80a90d0 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d4003570 con 0x7f64e80a90d0 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842164154 0 0) 0x7f64e80cf490 con 0x7f64e806e550 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e80aeee0 con 0x7f64e806e550 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e659c700 1 -- 172.21.15.26:0/719865074 >> v1:172.21.15.67:6789/0 conn(0x7f64e806e550 legacy=0x7f64e80af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e659c700 1 -- 172.21.15.26:0/719865074 >> v1:172.21.15.26:6789/0 conn(0x7f64e80a90d0 legacy=0x7f64e806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e659c700 1 -- 172.21.15.26:0/719865074 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80ce330 con 0x7f64e80a8d00 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e659c700 1 --2- 172.21.15.26:0/719865074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 0x7f64e80cddf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009900 tx=0x7f64d8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622ef7d96a695cae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8005c10 con 0x7f64e80a8d00 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8005d70 con 0x7f64e80a8d00 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.249+0000 7f64e5d9b700 1 -- 172.21.15.26:0/719865074 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8006260 con 0x7f64e80a8d00 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 -- 172.21.15.26:0/719865074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 msgr2=0x7f64e80cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 --2- 172.21.15.26:0/719865074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 0x7f64e80cddf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009900 tx=0x7f64d8009120 comp rx=0 tx=0).stop 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 -- 172.21.15.26:0/719865074 shutdown_connections 2023-10-09T11:43:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 --2- 172.21.15.26:0/719865074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e80a8d00 0x7f64e80cddf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 -- 172.21.15.26:0/719865074 >> 172.21.15.26:0/719865074 conn(0x7f64e806ce80 msgr2=0x7f64e80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 -- 172.21.15.26:0/719865074 shutdown_connections 2023-10-09T11:43:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.250+0000 7f64ece13700 1 -- 172.21.15.26:0/719865074 wait complete. 2023-10-09T11:43:08.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.251+0000 7f64ece13700 1 Processor -- start 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.251+0000 7f64ece13700 1 -- start start 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e806e550 0x7f64e80b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e80a8d00 0x7f64e816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e816aa20 con 0x7f64e80a90d0 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80b24b0 con 0x7f64e80a8d00 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ece13700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8159670 con 0x7f64e806e550 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34490/0 (socket says 172.21.15.26:34490) 2023-10-09T11:43:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 -- 172.21.15.26:0/1284725496 learned_addr learned my addr 172.21.15.26:0/1284725496 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64ddd9b700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e80a8d00 0x7f64e816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e659c700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e806e550 0x7f64e80b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 -- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e806e550 msgr2=0x7f64e80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e806e550 0x7f64e80b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 -- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e80a8d00 msgr2=0x7f64e816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e80a8d00 0x7f64e816a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 -- 172.21.15.26:0/1284725496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80093c0 con 0x7f64e80a90d0 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.252+0000 7f64e6d9d700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c860 tx=0x7f64e0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0002030 con 0x7f64e80a90d0 2023-10-09T11:43:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e00021b0 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80b18a0 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0012630 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e80b1e60 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.253+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e80b2640 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.254+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f64e0012a20 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.254+0000 7f64deffd700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 0x7f64c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.254+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f64e00848b0 con 0x7f64e80a90d0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.254+0000 7f64e659c700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 0x7f64c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.255+0000 7f64e659c700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 0x7f64c80697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009390 tx=0x7f64d8016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.259+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64e0051840 con 0x7f64e80a90d0 2023-10-09T11:43:08.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:08.469+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f64e804c3c0 con 0x7f64e80a90d0 2023-10-09T11:43:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.241+0000 7f64deffd700 1 -- 172.21.15.26:0/1284725496 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) v1 ==== 97+0+0 (secure 0 0 0) 0x7f64e0054e60 con 0x7f64e80a90d0 2023-10-09T11:43:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 msgr2=0x7f64c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 0x7f64c80697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009390 tx=0x7f64d8016000 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 msgr2=0x7f64e8159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c860 tx=0x7f64e0002700 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 shutdown_connections 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64e80a90d0 0x7f64e8159130 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f64c8067320 0x7f64c80697d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64e806e550 0x7f64e80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 --2- 172.21.15.26:0/1284725496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e80a8d00 0x7f64e816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 >> 172.21.15.26:0/1284725496 conn(0x7f64e806ce80 msgr2=0x7f64e815eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 shutdown_connections 2023-10-09T11:43:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.244+0000 7f64ece13700 1 -- 172.21.15.26:0/1284725496 wait complete. 2023-10-09T11:43:09.247 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:43:09.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:43:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.381+0000 7f3319b3e700 1 Processor -- start 2023-10-09T11:43:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.381+0000 7f3319b3e700 1 -- start start 2023-10-09T11:43:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f3319b3e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33140cb5a0 0x7f33140cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f3319b3e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33140cd9e0 0x7f3314159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f3319b3e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331415ae40 con 0x7f331415a400 2023-10-09T11:43:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f3319b3e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140d13f0 con 0x7f33140cb5a0 2023-10-09T11:43:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f3319b3e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331415ab60 con 0x7f33140cd9e0 2023-10-09T11:43:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f33137fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33140cb5a0 0x7f33140cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f33137fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33140cb5a0 0x7f33140cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34492/0 (socket says 172.21.15.26:34492) 2023-10-09T11:43:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.382+0000 7f33137fe700 1 -- 172.21.15.26:0/3951134065 learned_addr learned my addr 172.21.15.26:0/3951134065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f3312ffd700 1 --2- 172.21.15.26:0/3951134065 >> v2:172.21.15.67:3300/0 conn(0x7f33140cd9e0 0x7f3314159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33137fe700 1 -- 172.21.15.26:0/3951134065 >> v2:172.21.15.67:3300/0 conn(0x7f33140cd9e0 msgr2=0x7f3314159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33137fe700 1 --2- 172.21.15.26:0/3951134065 >> v2:172.21.15.67:3300/0 conn(0x7f33140cd9e0 0x7f3314159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33137fe700 1 -- 172.21.15.26:0/3951134065 >> v1:172.21.15.67:6789/0 conn(0x7f331415a400 legacy=0x7f3314156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33137fe700 1 -- 172.21.15.26:0/3951134065 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140ccf00 con 0x7f33140cb5a0 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33137fe700 1 --2- 172.21.15.26:0/3951134065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cb5a0 0x7f33140cb970 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f33040099b0 tx=0x7f3304009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba525185fb996c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33127fc700 1 -- 172.21.15.26:0/3951134065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400b820 con 0x7f33140cb5a0 2023-10-09T11:43:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33127fc700 1 -- 172.21.15.26:0/3951134065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400b980 con 0x7f33140cb5a0 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.383+0000 7f33127fc700 1 -- 172.21.15.26:0/3951134065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400bd20 con 0x7f33140cb5a0 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 -- 172.21.15.26:0/3951134065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cb5a0 msgr2=0x7f33140cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 --2- 172.21.15.26:0/3951134065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cb5a0 0x7f33140cb970 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f33040099b0 tx=0x7f3304009250 comp rx=0 tx=0).stop 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 -- 172.21.15.26:0/3951134065 shutdown_connections 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 --2- 172.21.15.26:0/3951134065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cb5a0 0x7f33140cb970 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 --2- 172.21.15.26:0/3951134065 >> v2:172.21.15.67:3300/0 conn(0x7f33140cd9e0 0x7f3314159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 -- 172.21.15.26:0/3951134065 >> 172.21.15.26:0/3951134065 conn(0x7f3314070e30 msgr2=0x7f33140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 -- 172.21.15.26:0/3951134065 shutdown_connections 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.384+0000 7f3319b3e700 1 -- 172.21.15.26:0/3951134065 wait complete. 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.385+0000 7f3319b3e700 1 Processor -- start 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.385+0000 7f3319b3e700 1 -- start start 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33140cb5a0 0x7f331414f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f331415a400 0x7f331416d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314151f50 con 0x7f33140cd9e0 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331414fc70 con 0x7f331415a400 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331414ff50 con 0x7f33140cb5a0 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34496/0 (socket says 172.21.15.26:34496) 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 -- 172.21.15.26:0/424503987 learned_addr learned my addr 172.21.15.26:0/424503987 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 -- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33140cb5a0 msgr2=0x7f331414f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f33137fe700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33140cb5a0 0x7f331414f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3313fff700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f331415a400 0x7f331416d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33140cb5a0 0x7f331414f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 -- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f331415a400 msgr2=0x7f331416d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f331415a400 0x7f331416d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 -- 172.21.15.26:0/424503987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040094f0 con 0x7f33140cd9e0 2023-10-09T11:43:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3312ffd700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f330800d890 tx=0x7f3308008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080125f0 con 0x7f33140cd9e0 2023-10-09T11:43:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308012770 con 0x7f33140cd9e0 2023-10-09T11:43:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3314150230 con 0x7f33140cd9e0 2023-10-09T11:43:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308012b30 con 0x7f33140cd9e0 2023-10-09T11:43:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.386+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331414f940 con 0x7f33140cd9e0 2023-10-09T11:43:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.387+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331404c3c0 con 0x7f33140cd9e0 2023-10-09T11:43:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.388+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f330801e460 con 0x7f33140cd9e0 2023-10-09T11:43:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.388+0000 7f32fb7fe700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 0x7f33000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.388+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3308085020 con 0x7f33140cd9e0 2023-10-09T11:43:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.388+0000 7f33137fe700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 0x7f33000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.389+0000 7f33137fe700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 0x7f33000697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f33040099b0 tx=0x7f3304017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.393+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3308052000 con 0x7f33140cd9e0 2023-10-09T11:43:09.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.666+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f33140cd1e0 con 0x7f33140cd9e0 2023-10-09T11:43:09.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.667+0000 7f32fb7fe700 1 -- 172.21.15.26:0/424503987 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3308055620 con 0x7f33140cd9e0 2023-10-09T11:43:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:09.668 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:43:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:43:09.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:43:09.669 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:09.671 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.672 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.673 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.674 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:43:09.675 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.676 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.677 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.678 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.680 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:43:09.681 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:43:09.682 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:09.683 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.683 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:09.683 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:43:09.683 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:43:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 msgr2=0x7f33000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 0x7f33000697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f33040099b0 tx=0x7f3304017000 comp rx=0 tx=0).stop 2023-10-09T11:43:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 msgr2=0x7f331416ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f330800d890 tx=0x7f3308008040 comp rx=0 tx=0).stop 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 shutdown_connections 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f331415a400 0x7f331416d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3300067320 0x7f33000697d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33140cb5a0 0x7f331414f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 --2- 172.21.15.26:0/424503987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33140cd9e0 0x7f331416ce70 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 >> 172.21.15.26:0/424503987 conn(0x7f3314070e30 msgr2=0x7f33141554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 shutdown_connections 2023-10-09T11:43:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.669+0000 7f3319b3e700 1 -- 172.21.15.26:0/424503987 wait complete. 2023-10-09T11:43:09.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:09.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.804+0000 7fc2a2e7b700 1 Processor -- start 2023-10-09T11:43:09.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.804+0000 7fc2a2e7b700 1 -- start start 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc29c153c30 0x7fc29c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 0x7fc29c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc29c0cef40 0x7fc29c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c15afd0 con 0x7fc29c0cef40 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c15b2b0 con 0x7fc29c153c30 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a2e7b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15b590 con 0x7fc29c15de50 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc29c0cef40 0x7fc29c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc29c0cef40 0x7fc29c06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48974/0 (socket says 172.21.15.26:48974) 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 -- 172.21.15.26:0/453913735 learned_addr learned my addr 172.21.15.26:0/453913735 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a1e79700 1 --2- 172.21.15.26:0/453913735 >> v2:172.21.15.67:3300/0 conn(0x7fc29c153c30 0x7fc29c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a1678700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 0x7fc29c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 -- 172.21.15.26:0/453913735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 msgr2=0x7fc29c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 0x7fc29c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 -- 172.21.15.26:0/453913735 >> v2:172.21.15.67:3300/0 conn(0x7fc29c153c30 msgr2=0x7fc29c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 --2- 172.21.15.26:0/453913735 >> v2:172.21.15.67:3300/0 conn(0x7fc29c153c30 0x7fc29c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a267a700 1 -- 172.21.15.26:0/453913735 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c15b870 con 0x7fc29c0cef40 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.805+0000 7fc2a1678700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 0x7fc29c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a267a700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c0cef40 0x7fc29c06d790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc29c06ead0 tx=0x7fc294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d209eb37ca616b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a0e77700 1 -- 172.21.15.26:0/453913735 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294009e70 con 0x7fc29c0cef40 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a0e77700 1 -- 172.21.15.26:0/453913735 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400b860 con 0x7fc29c0cef40 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a0e77700 1 -- 172.21.15.26:0/453913735 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400bc00 con 0x7fc29c0cef40 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/453913735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c0cef40 msgr2=0x7fc29c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c0cef40 0x7fc29c06d790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc29c06ead0 tx=0x7fc294009250 comp rx=0 tx=0).stop 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/453913735 shutdown_connections 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/453913735 >> v2:172.21.15.67:3300/0 conn(0x7fc29c153c30 0x7fc29c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c0cef40 0x7fc29c06d790 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/453913735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c15de50 0x7fc29c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/453913735 >> 172.21.15.26:0/453913735 conn(0x7fc29c0703a0 msgr2=0x7fc29c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/453913735 shutdown_connections 2023-10-09T11:43:09.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.806+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/453913735 wait complete. 2023-10-09T11:43:09.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.807+0000 7fc2a2e7b700 1 Processor -- start 2023-10-09T11:43:09.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 -- start start 2023-10-09T11:43:09.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c0cef40 0x7fc29c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc29c15de50 0x7fc29c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c14f770 con 0x7fc29c153c30 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c14d680 con 0x7fc29c15de50 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a2e7b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c152db0 con 0x7fc29c0cef40 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a1678700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a1678700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48986/0 (socket says 172.21.15.26:48986) 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.808+0000 7fc2a1678700 1 -- 172.21.15.26:0/489241036 learned_addr learned my addr 172.21.15.26:0/489241036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1e79700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c0cef40 0x7fc29c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a267a700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc29c15de50 0x7fc29c150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 -- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c0cef40 msgr2=0x7fc29c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c0cef40 0x7fc29c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 -- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc29c15de50 msgr2=0x7fc29c150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc29c15de50 0x7fc29c150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 -- 172.21.15.26:0/489241036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940094f0 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a1678700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc29000d890 tx=0x7fc290008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900125f0 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290012750 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c153090 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290012af0 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.809+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c153370 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.810+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c04c3c0 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.811+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc290014430 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.811+0000 7fc299ffb700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 0x7fc288069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.811+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc290084ba0 con 0x7fc29c153c30 2023-10-09T11:43:09.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.811+0000 7fc2a1e79700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 0x7fc288069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:09.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.812+0000 7fc2a1e79700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 0x7fc288069800 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00f570 tx=0x7fc28c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:09.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:09.815+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc290051b80 con 0x7fc29c153c30 2023-10-09T11:43:10.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.011+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc29c15bb50 con 0x7fc29c153c30 2023-10-09T11:43:10.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.012+0000 7fc299ffb700 1 -- 172.21.15.26:0/489241036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+12096 (secure 0 0 0) 0x7fc29006be60 con 0x7fc29c153c30 2023-10-09T11:43:10.013 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:10.013 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":149,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:09.240564+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:10.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 msgr2=0x7fc288069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 0x7fc288069800 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00f570 tx=0x7fc28c00b040 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 msgr2=0x7fc29c14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc29000d890 tx=0x7fc290008040 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 shutdown_connections 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc29c15de50 0x7fc29c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc288067350 0x7fc288069800 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc29c0cef40 0x7fc29c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 --2- 172.21.15.26:0/489241036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc29c153c30 0x7fc29c14fc00 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 >> 172.21.15.26:0/489241036 conn(0x7fc29c0703a0 msgr2=0x7fc29c15c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 shutdown_connections 2023-10-09T11:43:10.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.014+0000 7fc2a2e7b700 1 -- 172.21.15.26:0/489241036 wait complete. 2023-10-09T11:43:10.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:43:10.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:43:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.148+0000 7fd9df7e8700 1 Processor -- start 2023-10-09T11:43:10.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 -- start start 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d806de30 con 0x7fd9d815cde0 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80cc9b0 con 0x7fd9d80cc030 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.149+0000 7fd9df7e8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d806d850 con 0x7fd9d815ca10 2023-10-09T11:43:10.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9ddd85700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9ddd85700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:44202/0 (socket says 172.21.15.26:44202) 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dcd83700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd9d815cde0 0x7fd9d815d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:38666/0 (socket says 172.21.15.26:38666) 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:40556/0 (socket says 172.21.15.26:40556) 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9ddd85700 1 -- 172.21.15.26:0/1102245796 learned_addr learned my addr 172.21.15.26:0/1102245796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 -- 172.21.15.26:0/1102245796 >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 msgr2=0x7fd9d80cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9d7fff700 1 -- 172.21.15.26:0/1102245796 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843971222 0 0) 0x7fd9d806de30 con 0x7fd9d815cde0 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 --2- 172.21.15.26:0/1102245796 >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 -- 172.21.15.26:0/1102245796 >> v1:172.21.15.67:6789/0 conn(0x7fd9d815cde0 legacy=0x7fd9d815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9dd584700 1 -- 172.21.15.26:0/1102245796 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d815a060 con 0x7fd9d815ca10 2023-10-09T11:43:10.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.150+0000 7fd9ddd85700 1 --2- 172.21.15.26:0/1102245796 >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9dd584700 1 --2- 172.21.15.26:0/1102245796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009eb0 tx=0x7fd9c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c93a1106e19b7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9d7fff700 1 -- 172.21.15.26:0/1102245796 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800e070 con 0x7fd9d815ca10 2023-10-09T11:43:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9d7fff700 1 -- 172.21.15.26:0/1102245796 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800bc30 con 0x7fd9d815ca10 2023-10-09T11:43:10.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9d7fff700 1 -- 172.21.15.26:0/1102245796 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8012430 con 0x7fd9d815ca10 2023-10-09T11:43:10.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 -- 172.21.15.26:0/1102245796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 msgr2=0x7fd9d815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/1102245796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009eb0 tx=0x7fd9c8009780 comp rx=0 tx=0).stop 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 -- 172.21.15.26:0/1102245796 shutdown_connections 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/1102245796 >> v2:172.21.15.67:3300/0 conn(0x7fd9d80cc030 0x7fd9d80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/1102245796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d815ad50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 -- 172.21.15.26:0/1102245796 >> 172.21.15.26:0/1102245796 conn(0x7fd9d8067dd0 msgr2=0x7fd9d80681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 -- 172.21.15.26:0/1102245796 shutdown_connections 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.151+0000 7fd9df7e8700 1 -- 172.21.15.26:0/1102245796 wait complete. 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.152+0000 7fd9df7e8700 1 Processor -- start 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.152+0000 7fd9df7e8700 1 -- start start 2023-10-09T11:43:10.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80cc030 0x7fd9d814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d80b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d816a510 con 0x7fd9d815cde0 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d816b340 con 0x7fd9d80cc030 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9df7e8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d814fe70 con 0x7fd9d815ca10 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9ddd85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.153+0000 7fd9ddd85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48992/0 (socket says 172.21.15.26:48992) 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 -- 172.21.15.26:0/673215139 learned_addr learned my addr 172.21.15.26:0/673215139 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9dd584700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80cc030 0x7fd9d814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9dcd83700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d80b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 -- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 msgr2=0x7fd9d80b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d80b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 -- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80cc030 msgr2=0x7fd9d814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80cc030 0x7fd9d814d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 -- 172.21.15.26:0/673215139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00094f0 con 0x7fd9d815cde0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9ddd85700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000ec50 tx=0x7fd9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000c850 con 0x7fd9d815cde0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000c9b0 con 0x7fd9d815cde0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000cd50 con 0x7fd9d815cde0 2023-10-09T11:43:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c8009a20 con 0x7fd9d815cde0 2023-10-09T11:43:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.154+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80b2700 con 0x7fd9d815cde0 2023-10-09T11:43:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.155+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d80cbdf0 con 0x7fd9d815cde0 2023-10-09T11:43:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.156+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd9d0013680 con 0x7fd9d815cde0 2023-10-09T11:43:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.156+0000 7fd9d57fa700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 0x7fd9c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.156+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd9d0084b00 con 0x7fd9d815cde0 2023-10-09T11:43:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.156+0000 7fd9dd584700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 0x7fd9c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.157+0000 7fd9dd584700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 0x7fd9c40697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009eb0 tx=0x7fd9c8019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.160+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d0086e60 con 0x7fd9d815cde0 2023-10-09T11:43:10.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.353+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9d804c3f0 con 0x7fd9d815cde0 2023-10-09T11:43:10.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.353+0000 7fd9d57fa700 1 -- 172.21.15.26:0/673215139 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9d00200a0 con 0x7fd9d815cde0 2023-10-09T11:43:10.354 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 msgr2=0x7fd9c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 0x7fd9c40697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009eb0 tx=0x7fd9c8019000 comp rx=0 tx=0).stop 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 msgr2=0x7fd9d80b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000ec50 tx=0x7fd9d0009250 comp rx=0 tx=0).stop 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 shutdown_connections 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d815cde0 0x7fd9d80b1d80 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80cc030 0x7fd9d814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd9c4067320 0x7fd9c40697d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 --2- 172.21.15.26:0/673215139 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9d815ca10 0x7fd9d80b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 >> 172.21.15.26:0/673215139 conn(0x7fd9d8067dd0 msgr2=0x7fd9d814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 shutdown_connections 2023-10-09T11:43:10.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.355+0000 7fd9df7e8700 1 -- 172.21.15.26:0/673215139 wait complete. 2023-10-09T11:43:10.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:43:10.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.487+0000 7fc3513e6700 1 Processor -- start 2023-10-09T11:43:10.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.487+0000 7fc3513e6700 1 -- start start 2023-10-09T11:43:10.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.487+0000 7fc3513e6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc34c0cb5a0 0x7fc34c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.487+0000 7fc3513e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc34c15a5d0 0x7fc34c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc3513e6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c15ae40 con 0x7fc34c0cd9e0 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc3513e6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0d13f0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc3513e6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c15ab60 con 0x7fc34c0cb5a0 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc34c15a5d0 0x7fc34c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc34c15a5d0 0x7fc34c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49008/0 (socket says 172.21.15.26:49008) 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 -- 172.21.15.26:0/216063528 learned_addr learned my addr 172.21.15.26:0/216063528 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34affd700 1 --2- 172.21.15.26:0/216063528 >> v2:172.21.15.67:3300/0 conn(0x7fc34c0cb5a0 0x7fc34c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 -- 172.21.15.26:0/216063528 >> v2:172.21.15.67:3300/0 conn(0x7fc34c0cb5a0 msgr2=0x7fc34c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 --2- 172.21.15.26:0/216063528 >> v2:172.21.15.67:3300/0 conn(0x7fc34c0cb5a0 0x7fc34c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 -- 172.21.15.26:0/216063528 >> v1:172.21.15.67:6789/0 conn(0x7fc34c0cd9e0 legacy=0x7fc34c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 -- 172.21.15.26:0/216063528 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0ccf00 con 0x7fc34c15a5d0 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc34b7fe700 1 --2- 172.21.15.26:0/216063528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c156e90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc344009f20 tx=0x7fc344009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c6e2e8fb9e9135 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc349ffb700 1 -- 172.21.15.26:0/216063528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400e070 con 0x7fc34c15a5d0 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc349ffb700 1 -- 172.21.15.26:0/216063528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400ba00 con 0x7fc34c15a5d0 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.488+0000 7fc349ffb700 1 -- 172.21.15.26:0/216063528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440092e0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 -- 172.21.15.26:0/216063528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 msgr2=0x7fc34c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 --2- 172.21.15.26:0/216063528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c156e90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc344009f20 tx=0x7fc344009840 comp rx=0 tx=0).stop 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 -- 172.21.15.26:0/216063528 shutdown_connections 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 --2- 172.21.15.26:0/216063528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c156e90 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 --2- 172.21.15.26:0/216063528 >> v2:172.21.15.67:3300/0 conn(0x7fc34c0cb5a0 0x7fc34c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 -- 172.21.15.26:0/216063528 >> 172.21.15.26:0/216063528 conn(0x7fc34c070e30 msgr2=0x7fc34c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 -- 172.21.15.26:0/216063528 shutdown_connections 2023-10-09T11:43:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.489+0000 7fc3513e6700 1 -- 172.21.15.26:0/216063528 wait complete. 2023-10-09T11:43:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.490+0000 7fc3513e6700 1 Processor -- start 2023-10-09T11:43:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.490+0000 7fc3513e6700 1 -- start start 2023-10-09T11:43:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc34c0cb5a0 0x7fc34c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc34c0cd9e0 0x7fc34c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c16dda0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0b5b20 con 0x7fc34c0cb5a0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc3513e6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0b5e00 con 0x7fc34c0cd9e0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49010/0 (socket says 172.21.15.26:49010) 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 -- 172.21.15.26:0/2384911753 learned_addr learned my addr 172.21.15.26:0/2384911753 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34affd700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc34c0cb5a0 0x7fc34c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34a7fc700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc34c0cd9e0 0x7fc34c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 -- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc34c0cd9e0 msgr2=0x7fc34c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc34c0cd9e0 0x7fc34c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 -- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc34c0cb5a0 msgr2=0x7fc34c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc34c0cb5a0 0x7fc34c1521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.491+0000 7fc34b7fe700 1 -- 172.21.15.26:0/2384911753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009ae0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc34b7fe700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc34c06ea60 tx=0x7fc344017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440032f0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344012e60 con 0x7fc34c15a5d0 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c0b60e0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34401d650 con 0x7fc34c15a5d0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.492+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c1545a0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.493+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c04c3c0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.493+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc34401da80 con 0x7fc34c15a5d0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.493+0000 7fc342ffd700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 0x7fc32c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.494+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc344086320 con 0x7fc34c15a5d0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.494+0000 7fc34affd700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 0x7fc32c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.494+0000 7fc34affd700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 0x7fc32c0697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0b35a0 tx=0x7fc33c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.498+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3440531f0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.693+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc34c15a3b0 con 0x7fc34c15a5d0 2023-10-09T11:43:10.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.694+0000 7fc342ffd700 1 -- 172.21.15.26:0/2384911753 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc344056810 con 0x7fc34c15a5d0 2023-10-09T11:43:10.695 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:10.695 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:43:10.696 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:10.696 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:43:10.696 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:43:10.696 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:10.696 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:43:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 msgr2=0x7fc32c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 0x7fc32c0697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0b35a0 tx=0x7fc33c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 msgr2=0x7fc34c16cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc34c06ea60 tx=0x7fc344017000 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 shutdown_connections 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc34c15a5d0 0x7fc34c16cf60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc34c0cb5a0 0x7fc34c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc32c067320 0x7fc32c0697d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 --2- 172.21.15.26:0/2384911753 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc34c0cd9e0 0x7fc34c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 >> 172.21.15.26:0/2384911753 conn(0x7fc34c070e30 msgr2=0x7fc34c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 shutdown_connections 2023-10-09T11:43:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.696+0000 7fc3513e6700 1 -- 172.21.15.26:0/2384911753 wait complete. 2023-10-09T11:43:10.709 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:43:10.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:43:10.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.831+0000 7efe56ba2700 1 Processor -- start 2023-10-09T11:43:10.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.832+0000 7efe56ba2700 1 -- start start 2023-10-09T11:43:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.832+0000 7efe56ba2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efe50159800 0x7efe500b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.832+0000 7efe56ba2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe500b0c80 con 0x7efe500b24f0 2023-10-09T11:43:10.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.832+0000 7efe56ba2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe500b0f60 con 0x7efe500b1d40 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.832+0000 7efe56ba2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe500d10d0 con 0x7efe50159800 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe55ba0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe500b24f0 0x7efe501590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39902/0 (socket says 172.21.15.26:39902) 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe55ba0700 1 -- 172.21.15.26:0/464777412 learned_addr learned my addr 172.21.15.26:0/464777412 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe5539f700 1 --2- 172.21.15.26:0/464777412 >> v2:172.21.15.67:3300/0 conn(0x7efe50159800 0x7efe500b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819224225 0 0) 0x7efe500b0c80 con 0x7efe500b24f0 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe38003570 con 0x7efe500b24f0 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979142705 0 0) 0x7efe38003570 con 0x7efe500b24f0 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 >> v2:172.21.15.67:3300/0 conn(0x7efe50159800 msgr2=0x7efe500b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 --2- 172.21.15.26:0/464777412 >> v2:172.21.15.67:3300/0 conn(0x7efe50159800 0x7efe500b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 >> v1:172.21.15.67:6789/0 conn(0x7efe500b1d40 legacy=0x7efe500b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500b1240 con 0x7efe500b24f0 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7efe48001470 con 0x7efe500b24f0 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 >> v1:172.21.15.26:6789/0 conn(0x7efe500b24f0 legacy=0x7efe501590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe38003a60 0x7efe38003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe38004810 0x7efe38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500d10d0 con 0x7efe380051c0 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3800c050 con 0x7efe38003a60 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3800c210 con 0x7efe38004810 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe563a1700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe5539f700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe38004810 0x7efe38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.833+0000 7efe55ba0700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe38003a60 0x7efe38003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 -- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe38004810 msgr2=0x7efe38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe38004810 0x7efe38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 -- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe38003a60 msgr2=0x7efe38003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe38003a60 0x7efe38003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 -- 172.21.15.26:0/464777412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38003570 con 0x7efe380051c0 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 -- 172.21.15.26:0/464777412 reap_dead start 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe563a1700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe3800ba60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efe400020a0 tx=0x7efe400016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc07977fbcbc1fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400019e0 con 0x7efe380051c0 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4000c8b0 con 0x7efe380051c0 2023-10-09T11:43:10.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe54b9e700 1 -- 172.21.15.26:0/464777412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4000cc50 con 0x7efe380051c0 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe56ba2700 1 -- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 msgr2=0x7efe3800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.834+0000 7efe56ba2700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe3800ba60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efe400020a0 tx=0x7efe400016d0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.835+0000 7efe56ba2700 1 -- 172.21.15.26:0/464777412 shutdown_connections 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.835+0000 7efe56ba2700 1 --2- 172.21.15.26:0/464777412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe3800ba60 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.835+0000 7efe56ba2700 1 -- 172.21.15.26:0/464777412 >> 172.21.15.26:0/464777412 conn(0x7efe500703a0 msgr2=0x7efe500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.835+0000 7efe56ba2700 1 -- 172.21.15.26:0/464777412 shutdown_connections 2023-10-09T11:43:10.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.835+0000 7efe56ba2700 1 -- 172.21.15.26:0/464777412 wait complete. 2023-10-09T11:43:10.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 Processor -- start 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 -- start start 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe5014cf30 0x7efe5014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 0x7efe50169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5014e770 con 0x7efe380051c0 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5016b280 con 0x7efe501699b0 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.836+0000 7efe56ba2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5014d8e0 con 0x7efe5014cf30 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49020/0 (socket says 172.21.15.26:49020) 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 -- 172.21.15.26:0/2979909258 learned_addr learned my addr 172.21.15.26:0/2979909258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe563a1700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 0x7efe50169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe5539f700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe5014cf30 0x7efe5014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 -- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe5014cf30 msgr2=0x7efe5014d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe5014cf30 0x7efe5014d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 -- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 msgr2=0x7efe50169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 0x7efe50169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 -- 172.21.15.26:0/2979909258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5016a670 con 0x7efe380051c0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe563a1700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 0x7efe50169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe55ba0700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efe480073f0 tx=0x7efe48001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48018030 con 0x7efe380051c0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800f870 con 0x7efe380051c0 2023-10-09T11:43:10.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5016a950 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800fc30 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.837+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5016af10 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.839+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5004c3c0 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.839+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efe4801b070 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.839+0000 7efe4dffb700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 0x7efe3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.839+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efe48019070 con 0x7efe380051c0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.839+0000 7efe5539f700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 0x7efe3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.840+0000 7efe5539f700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 0x7efe3c0697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efe500cfee0 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:10.844+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe480517b0 con 0x7efe380051c0 2023-10-09T11:43:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.042+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe500b1520 con 0x7efe380051c0 2023-10-09T11:43:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.248+0000 7efe4dffb700 1 -- 172.21.15.26:0/2979909258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe48054dd0 con 0x7efe380051c0 2023-10-09T11:43:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 msgr2=0x7efe3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 0x7efe3c0697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efe500cfee0 tx=0x7efe44008040 comp rx=0 tx=0).stop 2023-10-09T11:43:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 msgr2=0x7efe500b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efe480073f0 tx=0x7efe48001e70 comp rx=0 tx=0).stop 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 shutdown_connections 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe501699b0 0x7efe50169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe380051c0 0x7efe500b5cc0 secure :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efe480073f0 tx=0x7efe48001e70 comp rx=0 tx=0).stop 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe3c067320 0x7efe3c0697d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 --2- 172.21.15.26:0/2979909258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe5014cf30 0x7efe5014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.251+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 >> 172.21.15.26:0/2979909258 conn(0x7efe500703a0 msgr2=0x7efe501560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.252+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 shutdown_connections 2023-10-09T11:43:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.252+0000 7efe56ba2700 1 -- 172.21.15.26:0/2979909258 wait complete. 2023-10-09T11:43:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:43:11.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:43:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.393+0000 7fc7f2098700 1 Processor -- start 2023-10-09T11:43:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.393+0000 7fc7f2098700 1 -- start start 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f2098700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 0x7fc7ec159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f2098700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7ec0cea00 0x7fc7ec0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f2098700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec0ccfa0 con 0x7fc7ec159380 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f2098700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0cf3c0 con 0x7fc7ec0cea00 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f2098700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0cb880 con 0x7fc7ec0cb3f0 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f1897700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7ec0cea00 0x7fc7ec0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f1096700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc7ec159380 0x7fc7ec15dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39910/0 (socket says 172.21.15.26:39910) 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f1096700 1 -- 172.21.15.26:0/4227348614 learned_addr learned my addr 172.21.15.26:0/4227348614 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.394+0000 7fc7f0895700 1 --2- 172.21.15.26:0/4227348614 >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 0x7fc7ec159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f1897700 1 -- 172.21.15.26:0/4227348614 >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 msgr2=0x7fc7ec159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f1897700 1 --2- 172.21.15.26:0/4227348614 >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 0x7fc7ec159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f1897700 1 -- 172.21.15.26:0/4227348614 >> v1:172.21.15.26:6789/0 conn(0x7fc7ec159380 legacy=0x7fc7ec15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f1897700 1 -- 172.21.15.26:0/4227348614 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0cbb60 con 0x7fc7ec0cea00 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7ebfff700 1 -- 172.21.15.26:0/4227348614 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755739404 0 0) 0x7fc7ec0ccfa0 con 0x7fc7ec159380 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f0895700 1 --2- 172.21.15.26:0/4227348614 >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 0x7fc7ec159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f1897700 1 --2- 172.21.15.26:0/4227348614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec0cee80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0c7590 tx=0x7fc7dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ec777a55ae158 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7ebfff700 1 -- 172.21.15.26:0/4227348614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00e070 con 0x7fc7ec0cea00 2023-10-09T11:43:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7ebfff700 1 -- 172.21.15.26:0/4227348614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00bc30 con 0x7fc7ec0cea00 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7ebfff700 1 -- 172.21.15.26:0/4227348614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc012430 con 0x7fc7ec0cea00 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 -- 172.21.15.26:0/4227348614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec0cea00 msgr2=0x7fc7ec0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 --2- 172.21.15.26:0/4227348614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec0cee80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0c7590 tx=0x7fc7dc009780 comp rx=0 tx=0).stop 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 -- 172.21.15.26:0/4227348614 shutdown_connections 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 --2- 172.21.15.26:0/4227348614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec0cee80 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 --2- 172.21.15.26:0/4227348614 >> v2:172.21.15.67:3300/0 conn(0x7fc7ec0cb3f0 0x7fc7ec159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.395+0000 7fc7f2098700 1 -- 172.21.15.26:0/4227348614 >> 172.21.15.26:0/4227348614 conn(0x7fc7ec0703a0 msgr2=0x7fc7ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.396+0000 7fc7f2098700 1 -- 172.21.15.26:0/4227348614 shutdown_connections 2023-10-09T11:43:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.396+0000 7fc7f2098700 1 -- 172.21.15.26:0/4227348614 wait complete. 2023-10-09T11:43:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 Processor -- start 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 -- start start 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7ec0cb3f0 0x7fc7ec14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec152130 con 0x7fc7ec159380 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec151520 con 0x7fc7ec0cea00 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.397+0000 7fc7f2098700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec151800 con 0x7fc7ec0cb3f0 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49042/0 (socket says 172.21.15.26:49042) 2023-10-09T11:43:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 -- 172.21.15.26:0/1051785660 learned_addr learned my addr 172.21.15.26:0/1051785660 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f0895700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1096700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7ec0cb3f0 0x7fc7ec14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 -- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7ec0cb3f0 msgr2=0x7fc7ec14ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7ec0cb3f0 0x7fc7ec14ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 -- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7ec0cea00 msgr2=0x7fc7ec1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 -- 172.21.15.26:0/1051785660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009a20 con 0x7fc7ec159380 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f1897700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec06eb50 tx=0x7fc7dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc01d630 con 0x7fc7ec159380 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc01d790 con 0x7fc7ec159380 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec151ae0 con 0x7fc7ec159380 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc01db50 con 0x7fc7ec159380 2023-10-09T11:43:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.398+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec0c7ec0 con 0x7fc7ec159380 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.399+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec04c3c0 con 0x7fc7ec159380 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.400+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc7dc024070 con 0x7fc7ec159380 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.400+0000 7fc7e97fa700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 0x7fc7d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.400+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fc7dc0873f0 con 0x7fc7ec159380 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.401+0000 7fc7f1096700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 0x7fc7d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.401+0000 7fc7f1096700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 0x7fc7d80697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c8f0 tx=0x7fc7e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.405+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7dc054220 con 0x7fc7ec159380 2023-10-09T11:43:11.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:11.599+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc7ec0cbe40 con 0x7fc7ec159380 2023-10-09T11:43:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.255+0000 7fc7e97fa700 1 -- 172.21.15.26:0/1051785660 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc7dc057840 con 0x7fc7ec159380 2023-10-09T11:43:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.260+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 msgr2=0x7fc7d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.260+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 0x7fc7d80697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c8f0 tx=0x7fc7e4009040 comp rx=0 tx=0).stop 2023-10-09T11:43:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.260+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 msgr2=0x7fc7ec150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.260+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec06eb50 tx=0x7fc7dc019000 comp rx=0 tx=0).stop 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 shutdown_connections 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ec159380 0x7fc7ec150a60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc7d8067320 0x7fc7d80697d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7ec0cb3f0 0x7fc7ec14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 --2- 172.21.15.26:0/1051785660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7ec0cea00 0x7fc7ec1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 >> 172.21.15.26:0/1051785660 conn(0x7fc7ec0703a0 msgr2=0x7fc7ec0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 shutdown_connections 2023-10-09T11:43:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.263+0000 7fc7f2098700 1 -- 172.21.15.26:0/1051785660 wait complete. 2023-10-09T11:43:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:43:12.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:43:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 Processor -- start 2023-10-09T11:43:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 -- start start 2023-10-09T11:43:12.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 0x7f55380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f553806e0e0 0x7f55380cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380ccfd0 con 0x7f553806dc70 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55380cf0e0 con 0x7f553806e0e0 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.414+0000 7f553d980700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553815a3d0 con 0x7f5538159530 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f553806e0e0 0x7f55380cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55367fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f553806dc70 0x7f5538159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39914/0 (socket says 172.21.15.26:39914) 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f553806e0e0 0x7f55380cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49054/0 (socket says 172.21.15.26:49054) 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55367fc700 1 -- 172.21.15.26:0/3678535571 learned_addr learned my addr 172.21.15.26:0/3678535571 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 0x7f55380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 -- 172.21.15.26:0/3678535571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 msgr2=0x7f55380ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 0x7f55380ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 -- 172.21.15.26:0/3678535571 >> v1:172.21.15.26:6789/0 conn(0x7f553806dc70 legacy=0x7f5538159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 -- 172.21.15.26:0/3678535571 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553815a6b0 con 0x7f553806e0e0 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5535ffb700 1 -- 172.21.15.26:0/3678535571 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243507549 0 0) 0x7f55380ccfd0 con 0x7f553806dc70 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 0x7f55380ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f55377fe700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553806e0e0 0x7f55380cb6f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5530009e60 tx=0x7f5530009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f13d71aa2d1f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5535ffb700 1 -- 172.21.15.26:0/3678535571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000e070 con 0x7f553806e0e0 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5535ffb700 1 -- 172.21.15.26:0/3678535571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000bc30 con 0x7f553806e0e0 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.415+0000 7f5535ffb700 1 -- 172.21.15.26:0/3678535571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530012430 con 0x7f553806e0e0 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 -- 172.21.15.26:0/3678535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553806e0e0 msgr2=0x7f55380cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553806e0e0 0x7f55380cb6f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5530009e60 tx=0x7f5530009780 comp rx=0 tx=0).stop 2023-10-09T11:43:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 -- 172.21.15.26:0/3678535571 shutdown_connections 2023-10-09T11:43:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553806e0e0 0x7f55380cb6f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 --2- 172.21.15.26:0/3678535571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5538159530 0x7f55380ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 -- 172.21.15.26:0/3678535571 >> 172.21.15.26:0/3678535571 conn(0x7f55380703a0 msgr2=0x7f55380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 -- 172.21.15.26:0/3678535571 shutdown_connections 2023-10-09T11:43:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.416+0000 7f553d980700 1 -- 172.21.15.26:0/3678535571 wait complete. 2023-10-09T11:43:12.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.417+0000 7f553d980700 1 Processor -- start 2023-10-09T11:43:12.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.417+0000 7f553d980700 1 -- start start 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 0x7f5538158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 0x7f5538146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538158e50 con 0x7f5538159530 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c8ee0 con 0x7f553806dc70 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f553d980700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5538158b70 con 0x7f553806e0e0 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49068/0 (socket says 172.21.15.26:49068) 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 -- 172.21.15.26:0/3812411199 learned_addr learned my addr 172.21.15.26:0/3812411199 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55367fc700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 0x7f5538146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 0x7f5538158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 -- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 msgr2=0x7f5538146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 0x7f5538146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 -- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 msgr2=0x7f5538158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 0x7f5538158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55377fe700 1 -- 172.21.15.26:0/3812411199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530009a20 con 0x7f5538159530 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f55367fc700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 0x7f5538146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.418+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 0x7f5538158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f55377fe700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5530013000 tx=0x7f5530019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553001e630 con 0x7f5538159530 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553001e790 con 0x7f5538159530 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553001eb50 con 0x7f5538159530 2023-10-09T11:43:12.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55380c8890 con 0x7f5538159530 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.419+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55381559e0 con 0x7f5538159530 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.420+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553804c3c0 con 0x7f5538159530 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.420+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5530024070 con 0x7f5538159530 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.421+0000 7f552effd700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 0x7f55180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.421+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f55300875a0 con 0x7f5538159530 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.421+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 0x7f55180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:12.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.421+0000 7f5536ffd700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 0x7f55180697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5528006fd0 tx=0x7f5528008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:12.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.425+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5530054290 con 0x7f5538159530 2023-10-09T11:43:12.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:12.662+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f553815a990 con 0x7f5538159530 2023-10-09T11:43:13.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.257+0000 7f552effd700 1 -- 172.21.15.26:0/3812411199 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v98) v1 ==== 174+0+0 (secure 0 0 0) 0x7f55300578b0 con 0x7f5538159530 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.265+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 msgr2=0x7f55180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.265+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 0x7f55180697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5528006fd0 tx=0x7f5528008040 comp rx=0 tx=0).stop 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.265+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 msgr2=0x7f55380cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.265+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5530013000 tx=0x7f5530019000 comp rx=0 tx=0).stop 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 shutdown_connections 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5538159530 0x7f55380cb430 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f553806dc70 0x7f5538158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5518067320 0x7f55180697d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 --2- 172.21.15.26:0/3812411199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f553806e0e0 0x7f5538146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 >> 172.21.15.26:0/3812411199 conn(0x7f55380703a0 msgr2=0x7f55380b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:13.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.267+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 shutdown_connections 2023-10-09T11:43:13.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.268+0000 7f553d980700 1 -- 172.21.15.26:0/3812411199 wait complete. 2023-10-09T11:43:13.276 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 26 and data pool 27 2023-10-09T11:43:13.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.419+0000 7f3a434f4700 1 Processor -- start 2023-10-09T11:43:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.419+0000 7f3a434f4700 1 -- start start 2023-10-09T11:43:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a434f4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a434f4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 0x7f3a3c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a434f4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3c15a280 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a434f4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c06e180 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a434f4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0cd540 con 0x7f3a3c0cf200 2023-10-09T11:43:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a41290700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a40a8f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 0x7f3a3c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a41290700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:44292/0 (socket says 172.21.15.26:44292) 2023-10-09T11:43:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a41290700 1 -- 172.21.15.26:0/2553003156 learned_addr learned my addr 172.21.15.26:0/2553003156 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.420+0000 7f3a41a91700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3a3c0b0ba0 0x7f3a3c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:38696/0 (socket says 172.21.15.26:38696) 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a41290700 1 -- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 msgr2=0x7f3a3c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a41290700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 0x7f3a3c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a41290700 1 -- 172.21.15.26:0/2553003156 >> v1:172.21.15.67:6789/0 conn(0x7f3a3c0b0ba0 legacy=0x7f3a3c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a41290700 1 -- 172.21.15.26:0/2553003156 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c06d850 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a40a8f700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 0x7f3a3c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a41290700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009f70 tx=0x7f3a2c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eead84eac93073e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a3bfff700 1 -- 172.21.15.26:0/2553003156 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00e070 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a3bfff700 1 -- 172.21.15.26:0/2553003156 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00bab0 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.421+0000 7f3a3bfff700 1 -- 172.21.15.26:0/2553003156 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0092e0 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 -- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0b07d0 msgr2=0x7f3a3c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009f70 tx=0x7f3a2c009840 comp rx=0 tx=0).stop 2023-10-09T11:43:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 -- 172.21.15.26:0/2553003156 shutdown_connections 2023-10-09T11:43:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0b07d0 0x7f3a3c0ccac0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 --2- 172.21.15.26:0/2553003156 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0cf200 0x7f3a3c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 -- 172.21.15.26:0/2553003156 >> 172.21.15.26:0/2553003156 conn(0x7f3a3c06ce80 msgr2=0x7f3a3c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 -- 172.21.15.26:0/2553003156 shutdown_connections 2023-10-09T11:43:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.422+0000 7f3a434f4700 1 -- 172.21.15.26:0/2553003156 wait complete. 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.423+0000 7f3a434f4700 1 Processor -- start 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.423+0000 7f3a434f4700 1 -- start start 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0b07d0 0x7f3a3c0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0cf200 0x7f3a3c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0c55c0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b12d0 con 0x7f3a3c0cf200 2023-10-09T11:43:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a434f4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b1e50 con 0x7f3a3c0b07d0 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49084/0 (socket says 172.21.15.26:49084) 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 -- 172.21.15.26:0/3859669422 learned_addr learned my addr 172.21.15.26:0/3859669422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a41290700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0b07d0 0x7f3a3c0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a41a91700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0cf200 0x7f3a3c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 -- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0b07d0 msgr2=0x7f3a3c0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0b07d0 0x7f3a3c0b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 -- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0cf200 msgr2=0x7f3a3c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.424+0000 7f3a40a8f700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0cf200 0x7f3a3c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a40a8f700 1 -- 172.21.15.26:0/3859669422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009420 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a40a8f700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000ecb0 tx=0x7f3a300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000c850 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3000c9b0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c009ae0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000cd30 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.425+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c0b1520 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.426+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c04c3c0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.426+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3a30013680 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.427+0000 7f3a397fa700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 0x7f3a280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.427+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a30084e40 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.427+0000 7f3a41290700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 0x7f3a280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.428+0000 7f3a41290700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 0x7f3a280697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009880 tx=0x7f3a2c018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.431+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a30055560 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.628+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a3c0b1fc0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.629+0000 7f3a397fa700 1 -- 172.21.15.26:0/3859669422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f3a300550f0 con 0x7f3a3c0b0ba0 2023-10-09T11:43:13.631 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:13.631 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":152,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:12.664380+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 msgr2=0x7f3a280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 0x7f3a280697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009880 tx=0x7f3a2c018000 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 msgr2=0x7f3a3c0b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000ecb0 tx=0x7f3a300091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 shutdown_connections 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c0cf200 0x7f3a3c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a28067320 0x7f3a280697d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a3c0b07d0 0x7f3a3c0b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 --2- 172.21.15.26:0/3859669422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3c0b0ba0 0x7f3a3c0b3470 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 >> 172.21.15.26:0/3859669422 conn(0x7f3a3c06ce80 msgr2=0x7f3a3c0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 shutdown_connections 2023-10-09T11:43:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.631+0000 7f3a434f4700 1 -- 172.21.15.26:0/3859669422 wait complete. 2023-10-09T11:43:13.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:13.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.762+0000 7f918569c700 1 Processor -- start 2023-10-09T11:43:13.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.762+0000 7f918569c700 1 -- start start 2023-10-09T11:43:13.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f918569c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f9180159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f918569c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918015ae40 con 0x7f918015a400 2023-10-09T11:43:13.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f918569c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918015ab60 con 0x7f91800cb5a0 2023-10-09T11:43:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f918569c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91800ce0f0 con 0x7f91800cb970 2023-10-09T11:43:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f917f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f918015a400 0x7f9180156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39924/0 (socket says 172.21.15.26:39924) 2023-10-09T11:43:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f917f7fe700 1 -- 172.21.15.26:0/3767280507 learned_addr learned my addr 172.21.15.26:0/3767280507 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:13.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f917e7fc700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f9180159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314951206 0 0) 0x7f918015ae40 con 0x7f918015a400 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.763+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c003570 con 0x7f918015a400 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221581764 0 0) 0x7f916c003570 con 0x7f918015a400 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 msgr2=0x7f9180159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f9180159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 >> v1:172.21.15.67:6789/0 conn(0x7f91800cb5a0 legacy=0x7f91800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800ccf00 con 0x7f918015a400 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f91780017f0 con 0x7f918015a400 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 >> v1:172.21.15.26:6789/0 conn(0x7f918015a400 legacy=0x7f9180156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f916c003a90 0x7f916c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f916c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c004d50 0x7f916c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91800ce0f0 con 0x7f916c003a90 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00bba0 con 0x7f916c004d50 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00bd60 con 0x7f91800cb970 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f916c003a90 0x7f916c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917e7fc700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f916c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917f7fe700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c004d50 0x7f916c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 -- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 msgr2=0x7f916c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800cb970 0x7f916c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 -- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c004d50 msgr2=0x7f916c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c004d50 0x7f916c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 -- 172.21.15.26:0/3767280507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c003570 con 0x7f916c003a90 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917f7fe700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c004d50 0x7f916c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917effd700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f916c003a90 0x7f916c003ea0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f91700018b0 tx=0x7f9170007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f072a4ec2d54f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012420 con 0x7f916c003a90 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170012580 con 0x7f916c003a90 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.764+0000 7f917dffb700 1 -- 172.21.15.26:0/3767280507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012920 con 0x7f916c003a90 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 -- 172.21.15.26:0/3767280507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f916c003a90 msgr2=0x7f916c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 --2- 172.21.15.26:0/3767280507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f916c003a90 0x7f916c003ea0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f91700018b0 tx=0x7f9170007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f917f7fe700 1 -- 172.21.15.26:0/3767280507 reap_dead start 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 -- 172.21.15.26:0/3767280507 shutdown_connections 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 -- 172.21.15.26:0/3767280507 >> 172.21.15.26:0/3767280507 conn(0x7f9180070e30 msgr2=0x7f91800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 -- 172.21.15.26:0/3767280507 shutdown_connections 2023-10-09T11:43:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.765+0000 7f918569c700 1 -- 172.21.15.26:0/3767280507 wait complete. 2023-10-09T11:43:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.766+0000 7f918569c700 1 Processor -- start 2023-10-09T11:43:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.766+0000 7f918569c700 1 -- start start 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c003a90 0x7f91801523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800af250 0x7f91800af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91800cbde0 con 0x7f9180151f90 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180152cd0 con 0x7f916c003a90 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f918569c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91800afc10 con 0x7f91800af250 2023-10-09T11:43:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49114/0 (socket says 172.21.15.26:49114) 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 -- 172.21.15.26:0/2579381209 learned_addr learned my addr 172.21.15.26:0/2579381209 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917f7fe700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800af250 0x7f91800af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917effd700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c003a90 0x7f91801523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 -- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800af250 msgr2=0x7f91800af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800af250 0x7f91800af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.767+0000 7f917e7fc700 1 -- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c003a90 msgr2=0x7f91801523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f917e7fc700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c003a90 0x7f91801523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f917e7fc700 1 -- 172.21.15.26:0/2579381209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800c8910 con 0x7f9180151f90 2023-10-09T11:43:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f917e7fc700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f9168011d70 tx=0x7f91680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168009e20 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800fcd0 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91800ca320 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168014650 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.768+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91800c8350 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.769+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91800ca4b0 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.769+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9168014a80 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.770+0000 7f9176ffd700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 0x7f91600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.770+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9168018030 con 0x7f9180151f90 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.770+0000 7f917effd700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 0x7f91600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.770+0000 7f917effd700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 0x7f91600697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f91700018b0 tx=0x7f9170015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.774+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9168052220 con 0x7f9180151f90 2023-10-09T11:43:13.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.968+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f918004c3c0 con 0x7f9180151f90 2023-10-09T11:43:13.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.969+0000 7f9176ffd700 1 -- 172.21.15.26:0/2579381209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f9168055840 con 0x7f9180151f90 2023-10-09T11:43:13.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:13.970 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":152,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:12.664380+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 msgr2=0x7f91600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 0x7f91600697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f91700018b0 tx=0x7f9170015000 comp rx=0 tx=0).stop 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 msgr2=0x7f91801596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f9168011d70 tx=0x7f91680091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 shutdown_connections 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9160067320 0x7f91600697d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91800af250 0x7f91800af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916c003a90 0x7f91801523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 --2- 172.21.15.26:0/2579381209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180151f90 0x7f91801596d0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:13.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 >> 172.21.15.26:0/2579381209 conn(0x7f9180070e30 msgr2=0x7f91800d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:13.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 shutdown_connections 2023-10-09T11:43:13.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:13.971+0000 7f918569c700 1 -- 172.21.15.26:0/2579381209 wait complete. 2023-10-09T11:43:13.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:43:14.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.105+0000 7f8c39d29700 1 Processor -- start 2023-10-09T11:43:14.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.105+0000 7f8c39d29700 1 -- start start 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c39d29700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 0x7f8c34151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c39d29700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c34157ca0 0x7f8c34158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c39d29700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3415b1c0 con 0x7f8c341518a0 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c39d29700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3415ba60 con 0x7f8c34157ca0 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c39d29700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c341589d0 con 0x7f8c340b2bc0 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c34157ca0 0x7f8c34158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c337fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8c341518a0 0x7f8c340b24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39926/0 (socket says 172.21.15.26:39926) 2023-10-09T11:43:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c337fe700 1 -- 172.21.15.26:0/654806752 learned_addr learned my addr 172.21.15.26:0/654806752 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.106+0000 7f8c33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c34157ca0 0x7f8c34158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49120/0 (socket says 172.21.15.26:49120) 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c32ffd700 1 --2- 172.21.15.26:0/654806752 >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 0x7f8c34151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c33fff700 1 -- 172.21.15.26:0/654806752 >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 msgr2=0x7f8c34151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c33fff700 1 --2- 172.21.15.26:0/654806752 >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 0x7f8c34151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c33fff700 1 -- 172.21.15.26:0/654806752 >> v1:172.21.15.26:6789/0 conn(0x7f8c341518a0 legacy=0x7f8c340b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c33fff700 1 -- 172.21.15.26:0/654806752 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3415b410 con 0x7f8c34157ca0 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c327fc700 1 -- 172.21.15.26:0/654806752 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246786373 0 0) 0x7f8c3415b1c0 con 0x7f8c341518a0 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c32ffd700 1 --2- 172.21.15.26:0/654806752 >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 0x7f8c34151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c33fff700 1 --2- 172.21.15.26:0/654806752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34158140 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f8c3406a500 tx=0x7f8c2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dc58136ac4cab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c327fc700 1 -- 172.21.15.26:0/654806752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00e070 con 0x7f8c34157ca0 2023-10-09T11:43:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c327fc700 1 -- 172.21.15.26:0/654806752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c00bc30 con 0x7f8c34157ca0 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.107+0000 7f8c327fc700 1 -- 172.21.15.26:0/654806752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c012430 con 0x7f8c34157ca0 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 -- 172.21.15.26:0/654806752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 msgr2=0x7f8c34158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 --2- 172.21.15.26:0/654806752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34158140 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f8c3406a500 tx=0x7f8c2c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 -- 172.21.15.26:0/654806752 shutdown_connections 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 --2- 172.21.15.26:0/654806752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34158140 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 --2- 172.21.15.26:0/654806752 >> v2:172.21.15.67:3300/0 conn(0x7f8c340b2bc0 0x7f8c34151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 -- 172.21.15.26:0/654806752 >> 172.21.15.26:0/654806752 conn(0x7f8c3406d7b0 msgr2=0x7f8c3406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 -- 172.21.15.26:0/654806752 shutdown_connections 2023-10-09T11:43:14.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.108+0000 7f8c39d29700 1 -- 172.21.15.26:0/654806752 wait complete. 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.109+0000 7f8c39d29700 1 Processor -- start 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.109+0000 7f8c39d29700 1 -- start start 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c340b2bc0 0x7f8c3416a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c341518a0 0x7f8c34152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3414a830 con 0x7f8c34157ca0 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3416a950 con 0x7f8c340b2bc0 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c39d29700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3416aba0 con 0x7f8c341518a0 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49126/0 (socket says 172.21.15.26:49126) 2023-10-09T11:43:14.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 -- 172.21.15.26:0/91088976 learned_addr learned my addr 172.21.15.26:0/91088976 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c337fe700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c340b2bc0 0x7f8c3416a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c32ffd700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c341518a0 0x7f8c34152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 -- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c341518a0 msgr2=0x7f8c34152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c341518a0 0x7f8c34152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 -- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c340b2bc0 msgr2=0x7f8c3416a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c340b2bc0 0x7f8c3416a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.110+0000 7f8c33fff700 1 -- 172.21.15.26:0/91088976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009a20 con 0x7f8c34157ca0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c33fff700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c01e630 con 0x7f8c34157ca0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c01e7b0 con 0x7f8c34157ca0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3416ae80 con 0x7f8c34157ca0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c01eb70 con 0x7f8c34157ca0 2023-10-09T11:43:14.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.111+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3416b210 con 0x7f8c34157ca0 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.112+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3404c3c0 con 0x7f8c34157ca0 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.112+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8c2c024070 con 0x7f8c34157ca0 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.112+0000 7f8c1b7fe700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 0x7f8c20069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.113+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c2c087430 con 0x7f8c34157ca0 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.113+0000 7f8c337fe700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 0x7f8c20069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:14.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.113+0000 7f8c337fe700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 0x7f8c20069800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007fd0 tx=0x7f8c24007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:14.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.117+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c2c0540c0 con 0x7f8c34157ca0 2023-10-09T11:43:14.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:14.357+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8c3415b6f0 con 0x7f8c34157ca0 2023-10-09T11:43:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.279+0000 7f8c1b7fe700 1 -- 172.21.15.26:0/91088976 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c2c0576e0 con 0x7f8c34157ca0 2023-10-09T11:43:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 msgr2=0x7f8c20069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 0x7f8c20069800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007fd0 tx=0x7f8c24007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 msgr2=0x7f8c34152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c019000 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 shutdown_connections 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c34157ca0 0x7f8c34152780 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c340b2bc0 0x7f8c3416a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8c20067350 0x7f8c20069800 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 --2- 172.21.15.26:0/91088976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c341518a0 0x7f8c34152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 >> 172.21.15.26:0/91088976 conn(0x7f8c3406d7b0 msgr2=0x7f8c3406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:15.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 shutdown_connections 2023-10-09T11:43:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.282+0000 7f8c39d29700 1 -- 172.21.15.26:0/91088976 wait complete. 2023-10-09T11:43:15.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:43:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.426+0000 7f6f5a153700 1 Processor -- start 2023-10-09T11:43:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.426+0000 7f6f5a153700 1 -- start start 2023-10-09T11:43:15.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f5a153700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f54159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f5a153700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f5406e0e0 0x7f6f540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f5a153700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540ccfd0 con 0x7f6f54159530 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f5a153700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5415a3d0 con 0x7f6f5406e0e0 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f5a153700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415a6b0 con 0x7f6f5406dc70 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f53fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f5406e0e0 0x7f6f540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f537fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6f54159530 0x7f6f540ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:38720/0 (socket says 172.21.15.26:38720) 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f537fe700 1 -- 172.21.15.26:0/3734738749 learned_addr learned my addr 172.21.15.26:0/3734738749 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.427+0000 7f6f52ffd700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f54159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f53fff700 1 -- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 msgr2=0x7f6f54159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f53fff700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f54159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f53fff700 1 -- 172.21.15.26:0/3734738749 >> v1:172.21.15.67:6789/0 conn(0x7f6f54159530 legacy=0x7f6f540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f53fff700 1 -- 172.21.15.26:0/3734738749 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5415a990 con 0x7f6f5406e0e0 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f53fff700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406e0e0 0x7f6f540cb6f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009e60 tx=0x7f6f4c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15eb642aca4d4d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:15.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f527fc700 1 -- 172.21.15.26:0/3734738749 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00e070 con 0x7f6f5406e0e0 2023-10-09T11:43:15.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f527fc700 1 -- 172.21.15.26:0/3734738749 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00bb60 con 0x7f6f5406e0e0 2023-10-09T11:43:15.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.428+0000 7f6f527fc700 1 -- 172.21.15.26:0/3734738749 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c012430 con 0x7f6f5406e0e0 2023-10-09T11:43:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 -- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406e0e0 msgr2=0x7f6f540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406e0e0 0x7f6f540cb6f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009e60 tx=0x7f6f4c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 -- 172.21.15.26:0/3734738749 shutdown_connections 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406e0e0 0x7f6f540cb6f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3734738749 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f54159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 -- 172.21.15.26:0/3734738749 >> 172.21.15.26:0/3734738749 conn(0x7f6f540703a0 msgr2=0x7f6f540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 -- 172.21.15.26:0/3734738749 shutdown_connections 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.429+0000 7f6f5a153700 1 -- 172.21.15.26:0/3734738749 wait complete. 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.430+0000 7f6f5a153700 1 Processor -- start 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.430+0000 7f6f5a153700 1 -- start start 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f540b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 0x7f6f54152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540b2750 con 0x7f6f5406e0e0 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540b39c0 con 0x7f6f54159530 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f5a153700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540b4490 con 0x7f6f5406dc70 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49142/0 (socket says 172.21.15.26:49142) 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3190311089 learned_addr learned my addr 172.21.15.26:0/3190311089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f537fe700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f540b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f53fff700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 0x7f6f54152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 msgr2=0x7f6f540b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f540b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 msgr2=0x7f6f54152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 0x7f6f54152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3190311089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009a20 con 0x7f6f5406e0e0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.431+0000 7f6f53fff700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 0x7f6f54152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f52ffd700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800ec80 tx=0x7f6f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800c850 con 0x7f6f5406e0e0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800c9b0 con 0x7f6f5406e0e0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f540b0720 con 0x7f6f5406e0e0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800cd50 con 0x7f6f5406e0e0 2023-10-09T11:43:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.432+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f540b41b0 con 0x7f6f5406e0e0 2023-10-09T11:43:15.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.433+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f540b08b0 con 0x7f6f5406e0e0 2023-10-09T11:43:15.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.433+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6f48013680 con 0x7f6f5406e0e0 2023-10-09T11:43:15.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.434+0000 7f6f3b7fe700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 0x7f6f400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:15.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.434+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f48084f30 con 0x7f6f5406e0e0 2023-10-09T11:43:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.434+0000 7f6f537fe700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 0x7f6f400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:15.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.435+0000 7f6f537fe700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 0x7f6f400697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6f44001950 tx=0x7f6f44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.438+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f48051bc0 con 0x7f6f5406e0e0 2023-10-09T11:43:15.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:15.678+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f5404c3c0 con 0x7f6f5406e0e0 2023-10-09T11:43:16.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.280+0000 7f6f3b7fe700 1 -- 172.21.15.26:0/3190311089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f480551e0 con 0x7f6f5406e0e0 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 msgr2=0x7f6f400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 0x7f6f400697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6f44001950 tx=0x7f6f44009040 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 msgr2=0x7f6f540b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800ec80 tx=0x7f6f480091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 shutdown_connections 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f54159530 0x7f6f54152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6f40067320 0x7f6f400697d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f5406dc70 0x7f6f540b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 --2- 172.21.15.26:0/3190311089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5406e0e0 0x7f6f540b3480 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 >> 172.21.15.26:0/3190311089 conn(0x7f6f540703a0 msgr2=0x7f6f54070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:16.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 shutdown_connections 2023-10-09T11:43:16.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.283+0000 7f6f5a153700 1 -- 172.21.15.26:0/3190311089 wait complete. 2023-10-09T11:43:16.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.423+0000 7fa4e31fc700 1 Processor -- start 2023-10-09T11:43:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.423+0000 7fa4e31fc700 1 -- start start 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4e31fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4e31fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa4dc0cde50 0x7fa4dc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4e31fc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc15ae40 con 0x7fa4dc0cd9e0 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4e31fc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0d13f0 con 0x7fa4dc0cde50 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4e31fc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc15ab60 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4dbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa4dc0cd9e0 0x7fa4dc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39930/0 (socket says 172.21.15.26:39930) 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.424+0000 7fa4dbfff700 1 -- 172.21.15.26:0/1068666955 learned_addr learned my addr 172.21.15.26:0/1068666955 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/1068666955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e1799700 1 --2- 172.21.15.26:0/1068666955 >> v2:172.21.15.67:3300/0 conn(0x7fa4dc0cde50 0x7fa4dc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4db7fe700 1 -- 172.21.15.26:0/1068666955 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200747816 0 0) 0x7fa4dc15ae40 con 0x7fa4dc0cd9e0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4db7fe700 1 -- 172.21.15.26:0/1068666955 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c4003570 con 0x7fa4dc0cd9e0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 -- 172.21.15.26:0/1068666955 >> v2:172.21.15.67:3300/0 conn(0x7fa4dc0cde50 msgr2=0x7fa4dc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/1068666955 >> v2:172.21.15.67:3300/0 conn(0x7fa4dc0cde50 0x7fa4dc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 -- 172.21.15.26:0/1068666955 >> v1:172.21.15.26:6789/0 conn(0x7fa4dc0cd9e0 legacy=0x7fa4dc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 -- 172.21.15.26:0/1068666955 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0ccf00 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/1068666955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc0cb970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0098e0 tx=0x7fa4cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c11bed079c60b13d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4db7fe700 1 -- 172.21.15.26:0/1068666955 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011630 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4db7fe700 1 -- 172.21.15.26:0/1068666955 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc011790 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.425+0000 7fa4db7fe700 1 -- 172.21.15.26:0/1068666955 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011b30 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 -- 172.21.15.26:0/1068666955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 msgr2=0x7fa4dc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/1068666955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc0cb970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0098e0 tx=0x7fa4cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 -- 172.21.15.26:0/1068666955 shutdown_connections 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/1068666955 >> v2:172.21.15.67:3300/0 conn(0x7fa4dc0cde50 0x7fa4dc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/1068666955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc0cb970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 -- 172.21.15.26:0/1068666955 >> 172.21.15.26:0/1068666955 conn(0x7fa4dc070e30 msgr2=0x7fa4dc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 -- 172.21.15.26:0/1068666955 shutdown_connections 2023-10-09T11:43:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.426+0000 7fa4e31fc700 1 -- 172.21.15.26:0/1068666955 wait complete. 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.427+0000 7fa4e31fc700 1 Processor -- start 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.427+0000 7fa4e31fc700 1 -- start start 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4dc0cd9e0 0x7fa4dc0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b43e0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0caa70 con 0x7fa4dc0cd9e0 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e31fc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b3ab0 con 0x7fa4dc0cb5a0 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49148/0 (socket says 172.21.15.26:49148) 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 -- 172.21.15.26:0/587305782 learned_addr learned my addr 172.21.15.26:0/587305782 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4dbfff700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4dc0cd9e0 0x7fa4dc0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 -- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 msgr2=0x7fa4dc14fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc14fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 -- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4dc0cd9e0 msgr2=0x7fa4dc0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4dc0cd9e0 0x7fa4dc0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.428+0000 7fa4e1799700 1 -- 172.21.15.26:0/587305782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009420 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4e1799700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009df0 tx=0x7fa4d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400caa0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d400f040 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc0b3d90 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400ce70 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.429+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc1501a0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.430+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc04c3c0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.430+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa4d4014690 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.431+0000 7fa4d8ff9700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 0x7fa4c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.431+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4d4085610 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.431+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 0x7fa4c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.431+0000 7fa4e0f98700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 0x7fa4c80697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0091e0 tx=0x7fa4cc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.435+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4d4055c20 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.674+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4dc0cd1e0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.675+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/587305782 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fa4d40557b0 con 0x7fa4dc0c59f0 2023-10-09T11:43:16.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:16.676 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":101,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 msgr2=0x7fa4c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 0x7fa4c80697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0091e0 tx=0x7fa4cc017000 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 msgr2=0x7fa4dc0c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009df0 tx=0x7fa4d400b040 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 shutdown_connections 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0c59f0 0x7fa4dc0c5e90 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa4c8067320 0x7fa4c80697d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4dc0cb5a0 0x7fa4dc14fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 --2- 172.21.15.26:0/587305782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4dc0cd9e0 0x7fa4dc0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 >> 172.21.15.26:0/587305782 conn(0x7fa4dc070e30 msgr2=0x7fa4dc0af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 shutdown_connections 2023-10-09T11:43:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.677+0000 7fa4e31fc700 1 -- 172.21.15.26:0/587305782 wait complete. 2023-10-09T11:43:16.680 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 101 2023-10-09T11:43:16.691 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:16.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.808+0000 7fa89c343700 1 Processor -- start 2023-10-09T11:43:16.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.808+0000 7fa89c343700 1 -- start start 2023-10-09T11:43:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89c343700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8940cb5a0 0x7fa8940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89c343700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa89415a5d0 0x7fa894156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89c343700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89415ae40 con 0x7fa8940cd9e0 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89c343700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940d13f0 con 0x7fa89415a5d0 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89c343700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89415ab60 con 0x7fa8940cb5a0 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89a8e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa89415a5d0 0x7fa894156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89a8e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa89415a5d0 0x7fa894156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49158/0 (socket says 172.21.15.26:49158) 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89a8e0700 1 -- 172.21.15.26:0/2034695941 learned_addr learned my addr 172.21.15.26:0/2034695941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.809+0000 7fa89a0df700 1 --2- 172.21.15.26:0/2034695941 >> v2:172.21.15.67:3300/0 conn(0x7fa8940cb5a0 0x7fa8940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89a8e0700 1 -- 172.21.15.26:0/2034695941 >> v2:172.21.15.67:3300/0 conn(0x7fa8940cb5a0 msgr2=0x7fa8940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89a8e0700 1 --2- 172.21.15.26:0/2034695941 >> v2:172.21.15.67:3300/0 conn(0x7fa8940cb5a0 0x7fa8940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89a8e0700 1 -- 172.21.15.26:0/2034695941 >> v1:172.21.15.67:6789/0 conn(0x7fa8940cd9e0 legacy=0x7fa894159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa8990dd700 1 -- 172.21.15.26:0/2034695941 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25222470 0 0) 0x7fa89415ae40 con 0x7fa8940cd9e0 2023-10-09T11:43:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89a8e0700 1 -- 172.21.15.26:0/2034695941 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940ccf00 con 0x7fa89415a5d0 2023-10-09T11:43:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89a8e0700 1 --2- 172.21.15.26:0/2034695941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89415a5d0 0x7fa894156e90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0099b0 tx=0x7fa88c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb72fe42078e55b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa8990dd700 1 -- 172.21.15.26:0/2034695941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c009ea0 con 0x7fa89415a5d0 2023-10-09T11:43:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa8990dd700 1 -- 172.21.15.26:0/2034695941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c00b820 con 0x7fa89415a5d0 2023-10-09T11:43:16.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa8990dd700 1 -- 172.21.15.26:0/2034695941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00bbc0 con 0x7fa89415a5d0 2023-10-09T11:43:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89c343700 1 -- 172.21.15.26:0/2034695941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89415a5d0 msgr2=0x7fa894156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.810+0000 7fa89c343700 1 --2- 172.21.15.26:0/2034695941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89415a5d0 0x7fa894156e90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0099b0 tx=0x7fa88c009250 comp rx=0 tx=0).stop 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 -- 172.21.15.26:0/2034695941 shutdown_connections 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 --2- 172.21.15.26:0/2034695941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89415a5d0 0x7fa894156e90 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 --2- 172.21.15.26:0/2034695941 >> v2:172.21.15.67:3300/0 conn(0x7fa8940cb5a0 0x7fa8940cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 -- 172.21.15.26:0/2034695941 >> 172.21.15.26:0/2034695941 conn(0x7fa894070e30 msgr2=0x7fa8940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 -- 172.21.15.26:0/2034695941 shutdown_connections 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.811+0000 7fa89c343700 1 -- 172.21.15.26:0/2034695941 wait complete. 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 Processor -- start 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 -- start start 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8940cd9e0 0x7fa894159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa89415a5d0 0x7fa894169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.812+0000 7fa89c343700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940b6500 con 0x7fa8940cb5a0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89c343700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940c9140 con 0x7fa8940cd9e0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89c343700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940c9990 con 0x7fa89415a5d0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49174/0 (socket says 172.21.15.26:49174) 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 -- 172.21.15.26:0/1196192792 learned_addr learned my addr 172.21.15.26:0/1196192792 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a8e0700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa89415a5d0 0x7fa894169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa8998de700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8940cd9e0 0x7fa894159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 -- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa89415a5d0 msgr2=0x7fa894169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa89415a5d0 0x7fa894169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 -- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8940cd9e0 msgr2=0x7fa894159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8940cd9e0 0x7fa894159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 -- 172.21.15.26:0/1196192792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0094f0 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89a0df700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa884009ef0 tx=0x7fa88400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400cc50 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400f040 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8940b6220 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884014480 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.813+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8940c93f0 con 0x7fa8940cb5a0 2023-10-09T11:43:16.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.814+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940c9c70 con 0x7fa8940cb5a0 2023-10-09T11:43:16.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.815+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8840147f0 con 0x7fa8940cb5a0 2023-10-09T11:43:16.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.815+0000 7fa8927fc700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 0x7fa8800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:16.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.815+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa884085810 con 0x7fa8940cb5a0 2023-10-09T11:43:16.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.815+0000 7fa8998de700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 0x7fa8800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:16.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.816+0000 7fa8998de700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 0x7fa8800697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa8940cf120 tx=0x7fa888009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:16.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:16.819+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa884052390 con 0x7fa8940cb5a0 2023-10-09T11:43:17.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.015+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8940b5fd0 con 0x7fa8940cb5a0 2023-10-09T11:43:17.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.016+0000 7fa8927fc700 1 -- 172.21.15.26:0/1196192792 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fa8840559b0 con 0x7fa8940cb5a0 2023-10-09T11:43:17.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:17.018 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":153,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:14.265321+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 msgr2=0x7fa8800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 0x7fa8800697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa8940cf120 tx=0x7fa888009040 comp rx=0 tx=0).stop 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 msgr2=0x7fa894156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa884009ef0 tx=0x7fa88400b040 comp rx=0 tx=0).stop 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 shutdown_connections 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa880067320 0x7fa8800697d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa89415a5d0 0x7fa894169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8940cb5a0 0x7fa894156c60 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 --2- 172.21.15.26:0/1196192792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8940cd9e0 0x7fa894159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 >> 172.21.15.26:0/1196192792 conn(0x7fa894070e30 msgr2=0x7fa8940cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 shutdown_connections 2023-10-09T11:43:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.018+0000 7fa89c343700 1 -- 172.21.15.26:0/1196192792 wait complete. 2023-10-09T11:43:17.032 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:43:17.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.150+0000 7fcf0716c700 1 Processor -- start 2023-10-09T11:43:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.150+0000 7fcf0716c700 1 -- start start 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcf0716c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 0x7fcf00158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcf0716c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf00150c90 0x7fcf000af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcf0716c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf00158c80 con 0x7fcf0015a0c0 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcf0716c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0015afc0 con 0x7fcf00150c90 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcf0716c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000af820 con 0x7fcf001508c0 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcefffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf00150c90 0x7fcf000af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcefffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf00150c90 0x7fcf000af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49176/0 (socket says 172.21.15.26:49176) 2023-10-09T11:43:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.151+0000 7fcefffff700 1 -- 172.21.15.26:0/243832749 learned_addr learned my addr 172.21.15.26:0/243832749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcf04f08700 1 --2- 172.21.15.26:0/243832749 >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 0x7fcf00158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcefffff700 1 -- 172.21.15.26:0/243832749 >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 msgr2=0x7fcf00158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcefffff700 1 --2- 172.21.15.26:0/243832749 >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 0x7fcf00158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcefffff700 1 -- 172.21.15.26:0/243832749 >> v1:172.21.15.67:6789/0 conn(0x7fcf0015a0c0 legacy=0x7fcf0015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcefffff700 1 -- 172.21.15.26:0/243832749 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00155710 con 0x7fcf00150c90 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcf04f08700 1 --2- 172.21.15.26:0/243832749 >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 0x7fcf00158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcefffff700 1 --2- 172.21.15.26:0/243832749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf000af2e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcf000aed00 tx=0x7fcef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154ed428ff5aa65c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fceff7fe700 1 -- 172.21.15.26:0/243832749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400b7e0 con 0x7fcf00150c90 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fceff7fe700 1 -- 172.21.15.26:0/243832749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef400b940 con 0x7fcf00150c90 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fceff7fe700 1 -- 172.21.15.26:0/243832749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400bce0 con 0x7fcf00150c90 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcf0716c700 1 -- 172.21.15.26:0/243832749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 msgr2=0x7fcf000af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.152+0000 7fcf0716c700 1 --2- 172.21.15.26:0/243832749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf000af2e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcf000aed00 tx=0x7fcef4009250 comp rx=0 tx=0).stop 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 -- 172.21.15.26:0/243832749 shutdown_connections 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 --2- 172.21.15.26:0/243832749 >> v2:172.21.15.67:3300/0 conn(0x7fcf001508c0 0x7fcf00158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 --2- 172.21.15.26:0/243832749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf000af2e0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 -- 172.21.15.26:0/243832749 >> 172.21.15.26:0/243832749 conn(0x7fcf000cded0 msgr2=0x7fcf0006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 -- 172.21.15.26:0/243832749 shutdown_connections 2023-10-09T11:43:17.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.153+0000 7fcf0716c700 1 -- 172.21.15.26:0/243832749 wait complete. 2023-10-09T11:43:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.154+0000 7fcf0716c700 1 Processor -- start 2023-10-09T11:43:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.154+0000 7fcf0716c700 1 -- start start 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 0x7fcf000c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 0x7fcf0006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00151580 con 0x7fcf00150c90 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b15c0 con 0x7fcf0015a0c0 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000c2820 con 0x7fcf001508c0 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49178/0 (socket says 172.21.15.26:49178) 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 -- 172.21.15.26:0/2869497154 learned_addr learned my addr 172.21.15.26:0/2869497154 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf04f08700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 0x7fcf000c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf05709700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 0x7fcf0006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 -- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 msgr2=0x7fcf000c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 0x7fcf000c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 -- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 msgr2=0x7fcf0006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 0x7fcf0006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 -- 172.21.15.26:0/2869497154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40094f0 con 0x7fcf00150c90 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf04f08700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 0x7fcf000c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf05709700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 0x7fcf0006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefffff700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcef40030c0 tx=0x7fcef4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef401b680 con 0x7fcf00150c90 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef401b7e0 con 0x7fcf00150c90 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf000c2b00 con 0x7fcf00150c90 2023-10-09T11:43:17.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef401bb80 con 0x7fcf00150c90 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.155+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf00151210 con 0x7fcf00150c90 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.156+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000707a0 con 0x7fcf00150c90 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.157+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcef401c450 con 0x7fcf00150c90 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.157+0000 7fcefcff9700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.157+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcef4086ac0 con 0x7fcf00150c90 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.157+0000 7fcf04f08700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.158+0000 7fcf04f08700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 0x7fceec0697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcef0006fd0 tx=0x7fcef0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.162+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcef4053710 con 0x7fcf00150c90 2023-10-09T11:43:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.355+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf0004c3c0 con 0x7fceec067320 2023-10-09T11:43:17.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.364+0000 7fcefcff9700 1 -- 172.21.15.26:0/2869497154 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289734 (secure 0 0 0) 0x7fcf0004c3c0 con 0x7fceec067320 2023-10-09T11:43:17.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:17.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 msgr2=0x7fceec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 0x7fceec0697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcef0006fd0 tx=0x7fcef0008040 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 msgr2=0x7fcf0014d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcef40030c0 tx=0x7fcef4016000 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 shutdown_connections 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf0015a0c0 0x7fcf0006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fceec067320 0x7fceec0697d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf001508c0 0x7fcf000c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 --2- 172.21.15.26:0/2869497154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf00150c90 0x7fcf0014d8b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 >> 172.21.15.26:0/2869497154 conn(0x7fcf000cded0 msgr2=0x7fcf00150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 shutdown_connections 2023-10-09T11:43:17.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.368+0000 7fcf0716c700 1 -- 172.21.15.26:0/2869497154 wait complete. 2023-10-09T11:43:17.373 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:43:17.381 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2023-10-09T11:43:17.220952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427400,"kb_used_data":16328,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547320,"statfs":{"total":773094113280,"available":770608455680,"internally_reserved":0,"allocated":16719872,"data_stored":8118500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.966381"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287325+0000","last_change":"2023-10-09T11:43:13.284974+0000","last_active":"2023-10-09T11:43:13.287325+0000","last_peered":"2023-10-09T11:43:13.287325+0000","last_clean":"2023-10-09T11:43:13.287325+0000","last_became_active":"2023-10-09T11:43:13.281688+0000","last_became_peered":"2023-10-09T11:43:13.281688+0000","last_unstale":"2023-10-09T11:43:13.287325+0000","last_undegraded":"2023-10-09T11:43:13.287325+0000","last_fullsized":"2023-10-09T11:43:13.287325+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:51.359875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288019+0000","last_change":"2023-10-09T11:43:13.284338+0000","last_active":"2023-10-09T11:43:13.288019+0000","last_peered":"2023-10-09T11:43:13.288019+0000","last_clean":"2023-10-09T11:43:13.288019+0000","last_became_active":"2023-10-09T11:43:13.283997+0000","last_became_peered":"2023-10-09T11:43:13.283997+0000","last_unstale":"2023-10-09T11:43:13.288019+0000","last_undegraded":"2023-10-09T11:43:13.288019+0000","last_fullsized":"2023-10-09T11:43:13.288019+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:55.529866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287474+0000","last_change":"2023-10-09T11:43:13.283850+0000","last_active":"2023-10-09T11:43:13.287474+0000","last_peered":"2023-10-09T11:43:13.287474+0000","last_clean":"2023-10-09T11:43:13.287474+0000","last_became_active":"2023-10-09T11:43:13.283588+0000","last_became_peered":"2023-10-09T11:43:13.283588+0000","last_unstale":"2023-10-09T11:43:13.287474+0000","last_undegraded":"2023-10-09T11:43:13.287474+0000","last_fullsized":"2023-10-09T11:43:13.287474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286877+0000","last_change":"2023-10-09T11:43:13.282800+0000","last_active":"2023-10-09T11:43:13.286877+0000","last_peered":"2023-10-09T11:43:13.286877+0000","last_clean":"2023-10-09T11:43:13.286877+0000","last_became_active":"2023-10-09T11:43:13.282498+0000","last_became_peered":"2023-10-09T11:43:13.282498+0000","last_unstale":"2023-10-09T11:43:13.286877+0000","last_undegraded":"2023-10-09T11:43:13.286877+0000","last_fullsized":"2023-10-09T11:43:13.286877+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:53.740720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281197+0000","last_change":"2023-10-09T11:43:13.279523+0000","last_active":"2023-10-09T11:43:13.281197+0000","last_peered":"2023-10-09T11:43:13.281197+0000","last_clean":"2023-10-09T11:43:13.281197+0000","last_became_active":"2023-10-09T11:43:13.278887+0000","last_became_peered":"2023-10-09T11:43:13.278887+0000","last_unstale":"2023-10-09T11:43:13.281197+0000","last_undegraded":"2023-10-09T11:43:13.281197+0000","last_fullsized":"2023-10-09T11:43:13.281197+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:48.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276258+0000","last_change":"2023-10-09T11:43:13.272883+0000","last_active":"2023-10-09T11:43:13.276258+0000","last_peered":"2023-10-09T11:43:13.276258+0000","last_clean":"2023-10-09T11:43:13.276258+0000","last_became_active":"2023-10-09T11:43:13.271641+0000","last_became_peered":"2023-10-09T11:43:13.271641+0000","last_unstale":"2023-10-09T11:43:13.276258+0000","last_undegraded":"2023-10-09T11:43:13.276258+0000","last_fullsized":"2023-10-09T11:43:13.276258+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:45.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287203+0000","last_change":"2023-10-09T11:43:13.283181+0000","last_active":"2023-10-09T11:43:13.287203+0000","last_peered":"2023-10-09T11:43:13.287203+0000","last_clean":"2023-10-09T11:43:13.287203+0000","last_became_active":"2023-10-09T11:43:13.282917+0000","last_became_peered":"2023-10-09T11:43:13.282917+0000","last_unstale":"2023-10-09T11:43:13.287203+0000","last_undegraded":"2023-10-09T11:43:13.287203+0000","last_fullsized":"2023-10-09T11:43:13.287203+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:22.890313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279446+0000","last_change":"2023-10-09T11:43:13.278436+0000","last_active":"2023-10-09T11:43:13.279446+0000","last_peered":"2023-10-09T11:43:13.279446+0000","last_clean":"2023-10-09T11:43:13.279446+0000","last_became_active":"2023-10-09T11:43:13.278163+0000","last_became_peered":"2023-10-09T11:43:13.278163+0000","last_unstale":"2023-10-09T11:43:13.279446+0000","last_undegraded":"2023-10-09T11:43:13.279446+0000","last_fullsized":"2023-10-09T11:43:13.279446+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:56.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276578+0000","last_change":"2023-10-09T11:43:13.273450+0000","last_active":"2023-10-09T11:43:13.276578+0000","last_peered":"2023-10-09T11:43:13.276578+0000","last_clean":"2023-10-09T11:43:13.276578+0000","last_became_active":"2023-10-09T11:43:13.273105+0000","last_became_peered":"2023-10-09T11:43:13.273105+0000","last_unstale":"2023-10-09T11:43:13.276578+0000","last_undegraded":"2023-10-09T11:43:13.276578+0000","last_fullsized":"2023-10-09T11:43:13.276578+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.274212+0000","last_change":"2023-10-09T11:43:13.270068+0000","last_active":"2023-10-09T11:43:13.274212+0000","last_peered":"2023-10-09T11:43:13.274212+0000","last_clean":"2023-10-09T11:43:13.274212+0000","last_became_active":"2023-10-09T11:43:13.269590+0000","last_became_peered":"2023-10-09T11:43:13.269590+0000","last_unstale":"2023-10-09T11:43:13.274212+0000","last_undegraded":"2023-10-09T11:43:13.274212+0000","last_fullsized":"2023-10-09T11:43:13.274212+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:39.351978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288853+0000","last_change":"2023-10-09T11:43:13.288223+0000","last_active":"2023-10-09T11:43:13.288853+0000","last_peered":"2023-10-09T11:43:13.288853+0000","last_clean":"2023-10-09T11:43:13.288853+0000","last_became_active":"2023-10-09T11:43:13.287873+0000","last_became_peered":"2023-10-09T11:43:13.287873+0000","last_unstale":"2023-10-09T11:43:13.288853+0000","last_undegraded":"2023-10-09T11:43:13.288853+0000","last_fullsized":"2023-10-09T11:43:13.288853+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287601+0000","last_change":"2023-10-09T11:43:13.280033+0000","last_active":"2023-10-09T11:43:13.287601+0000","last_peered":"2023-10-09T11:43:13.287601+0000","last_clean":"2023-10-09T11:43:13.287601+0000","last_became_active":"2023-10-09T11:43:13.279641+0000","last_became_peered":"2023-10-09T11:43:13.279641+0000","last_unstale":"2023-10-09T11:43:13.287601+0000","last_undegraded":"2023-10-09T11:43:13.287601+0000","last_fullsized":"2023-10-09T11:43:13.287601+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287491+0000","last_change":"2023-10-09T11:43:13.272451+0000","last_active":"2023-10-09T11:43:13.287491+0000","last_peered":"2023-10-09T11:43:13.287491+0000","last_clean":"2023-10-09T11:43:13.287491+0000","last_became_active":"2023-10-09T11:43:13.272165+0000","last_became_peered":"2023-10-09T11:43:13.272165+0000","last_unstale":"2023-10-09T11:43:13.287491+0000","last_undegraded":"2023-10-09T11:43:13.287491+0000","last_fullsized":"2023-10-09T11:43:13.287491+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276994+0000","last_change":"2023-10-09T11:43:13.272270+0000","last_active":"2023-10-09T11:43:13.276994+0000","last_peered":"2023-10-09T11:43:13.276994+0000","last_clean":"2023-10-09T11:43:13.276994+0000","last_became_active":"2023-10-09T11:43:13.271910+0000","last_became_peered":"2023-10-09T11:43:13.271910+0000","last_unstale":"2023-10-09T11:43:13.276994+0000","last_undegraded":"2023-10-09T11:43:13.276994+0000","last_fullsized":"2023-10-09T11:43:13.276994+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:13.305495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283319+0000","last_change":"2023-10-09T11:43:13.274003+0000","last_active":"2023-10-09T11:43:13.283319+0000","last_peered":"2023-10-09T11:43:13.283319+0000","last_clean":"2023-10-09T11:43:13.283319+0000","last_became_active":"2023-10-09T11:43:13.272732+0000","last_became_peered":"2023-10-09T11:43:13.272732+0000","last_unstale":"2023-10-09T11:43:13.283319+0000","last_undegraded":"2023-10-09T11:43:13.283319+0000","last_fullsized":"2023-10-09T11:43:13.283319+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:39.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275616+0000","last_change":"2023-10-09T11:43:13.271615+0000","last_active":"2023-10-09T11:43:13.275616+0000","last_peered":"2023-10-09T11:43:13.275616+0000","last_clean":"2023-10-09T11:43:13.275616+0000","last_became_active":"2023-10-09T11:43:13.269283+0000","last_became_peered":"2023-10-09T11:43:13.269283+0000","last_unstale":"2023-10-09T11:43:13.275616+0000","last_undegraded":"2023-10-09T11:43:13.275616+0000","last_fullsized":"2023-10-09T11:43:13.275616+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:47.007582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285657+0000","last_change":"2023-10-09T11:43:13.282744+0000","last_active":"2023-10-09T11:43:13.285657+0000","last_peered":"2023-10-09T11:43:13.285657+0000","last_clean":"2023-10-09T11:43:13.285657+0000","last_became_active":"2023-10-09T11:43:13.282086+0000","last_became_peered":"2023-10-09T11:43:13.282086+0000","last_unstale":"2023-10-09T11:43:13.285657+0000","last_undegraded":"2023-10-09T11:43:13.285657+0000","last_fullsized":"2023-10-09T11:43:13.285657+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:43.949855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275645+0000","last_change":"2023-10-09T11:43:13.272134+0000","last_active":"2023-10-09T11:43:13.275645+0000","last_peered":"2023-10-09T11:43:13.275645+0000","last_clean":"2023-10-09T11:43:13.275645+0000","last_became_active":"2023-10-09T11:43:13.271857+0000","last_became_peered":"2023-10-09T11:43:13.271857+0000","last_unstale":"2023-10-09T11:43:13.275645+0000","last_undegraded":"2023-10-09T11:43:13.275645+0000","last_fullsized":"2023-10-09T11:43:13.275645+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:19.613323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279253+0000","last_change":"2023-10-09T11:43:13.278063+0000","last_active":"2023-10-09T11:43:13.279253+0000","last_peered":"2023-10-09T11:43:13.279253+0000","last_clean":"2023-10-09T11:43:13.279253+0000","last_became_active":"2023-10-09T11:43:13.277802+0000","last_became_peered":"2023-10-09T11:43:13.277802+0000","last_unstale":"2023-10-09T11:43:13.279253+0000","last_undegraded":"2023-10-09T11:43:13.279253+0000","last_fullsized":"2023-10-09T11:43:13.279253+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:20.971631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276286+0000","last_change":"2023-10-09T11:43:13.270828+0000","last_active":"2023-10-09T11:43:13.276286+0000","last_peered":"2023-10-09T11:43:13.276286+0000","last_clean":"2023-10-09T11:43:13.276286+0000","last_became_active":"2023-10-09T11:43:13.270493+0000","last_became_peered":"2023-10-09T11:43:13.270493+0000","last_unstale":"2023-10-09T11:43:13.276286+0000","last_undegraded":"2023-10-09T11:43:13.276286+0000","last_fullsized":"2023-10-09T11:43:13.276286+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:13.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289107+0000","last_change":"2023-10-09T11:43:13.285919+0000","last_active":"2023-10-09T11:43:13.289107+0000","last_peered":"2023-10-09T11:43:13.289107+0000","last_clean":"2023-10-09T11:43:13.289107+0000","last_became_active":"2023-10-09T11:43:13.285633+0000","last_became_peered":"2023-10-09T11:43:13.285633+0000","last_unstale":"2023-10-09T11:43:13.289107+0000","last_undegraded":"2023-10-09T11:43:13.289107+0000","last_fullsized":"2023-10-09T11:43:13.289107+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:13.881984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.282489+0000","last_change":"2023-10-09T11:43:13.278711+0000","last_active":"2023-10-09T11:43:13.282489+0000","last_peered":"2023-10-09T11:43:13.282489+0000","last_clean":"2023-10-09T11:43:13.282489+0000","last_became_active":"2023-10-09T11:43:13.278431+0000","last_became_peered":"2023-10-09T11:43:13.278431+0000","last_unstale":"2023-10-09T11:43:13.282489+0000","last_undegraded":"2023-10-09T11:43:13.282489+0000","last_fullsized":"2023-10-09T11:43:13.282489+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:59.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.282564+0000","last_change":"2023-10-09T11:43:13.279056+0000","last_active":"2023-10-09T11:43:13.282564+0000","last_peered":"2023-10-09T11:43:13.282564+0000","last_clean":"2023-10-09T11:43:13.282564+0000","last_became_active":"2023-10-09T11:43:13.276910+0000","last_became_peered":"2023-10-09T11:43:13.276910+0000","last_unstale":"2023-10-09T11:43:13.282564+0000","last_undegraded":"2023-10-09T11:43:13.282564+0000","last_fullsized":"2023-10-09T11:43:13.282564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:53.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288746+0000","last_change":"2023-10-09T11:43:13.286110+0000","last_active":"2023-10-09T11:43:13.288746+0000","last_peered":"2023-10-09T11:43:13.288746+0000","last_clean":"2023-10-09T11:43:13.288746+0000","last_became_active":"2023-10-09T11:43:13.285824+0000","last_became_peered":"2023-10-09T11:43:13.285824+0000","last_unstale":"2023-10-09T11:43:13.288746+0000","last_undegraded":"2023-10-09T11:43:13.288746+0000","last_fullsized":"2023-10-09T11:43:13.288746+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.714469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276405+0000","last_change":"2023-10-09T11:43:13.271662+0000","last_active":"2023-10-09T11:43:13.276405+0000","last_peered":"2023-10-09T11:43:13.276405+0000","last_clean":"2023-10-09T11:43:13.276405+0000","last_became_active":"2023-10-09T11:43:13.271347+0000","last_became_peered":"2023-10-09T11:43:13.271347+0000","last_unstale":"2023-10-09T11:43:13.276405+0000","last_undegraded":"2023-10-09T11:43:13.276405+0000","last_fullsized":"2023-10-09T11:43:13.276405+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287352+0000","last_change":"2023-10-09T11:43:13.284994+0000","last_active":"2023-10-09T11:43:13.287352+0000","last_peered":"2023-10-09T11:43:13.287352+0000","last_clean":"2023-10-09T11:43:13.287352+0000","last_became_active":"2023-10-09T11:43:13.283391+0000","last_became_peered":"2023-10-09T11:43:13.283391+0000","last_unstale":"2023-10-09T11:43:13.287352+0000","last_undegraded":"2023-10-09T11:43:13.287352+0000","last_fullsized":"2023-10-09T11:43:13.287352+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:55.876890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287607+0000","last_change":"2023-10-09T11:43:13.280146+0000","last_active":"2023-10-09T11:43:13.287607+0000","last_peered":"2023-10-09T11:43:13.287607+0000","last_clean":"2023-10-09T11:43:13.287607+0000","last_became_active":"2023-10-09T11:43:13.279657+0000","last_became_peered":"2023-10-09T11:43:13.279657+0000","last_unstale":"2023-10-09T11:43:13.287607+0000","last_undegraded":"2023-10-09T11:43:13.287607+0000","last_fullsized":"2023-10-09T11:43:13.287607+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:39.683778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283300+0000","last_change":"2023-10-09T11:43:13.276128+0000","last_active":"2023-10-09T11:43:13.283300+0000","last_peered":"2023-10-09T11:43:13.283300+0000","last_clean":"2023-10-09T11:43:13.283300+0000","last_became_active":"2023-10-09T11:43:13.275853+0000","last_became_peered":"2023-10-09T11:43:13.275853+0000","last_unstale":"2023-10-09T11:43:13.283300+0000","last_undegraded":"2023-10-09T11:43:13.283300+0000","last_fullsized":"2023-10-09T11:43:13.283300+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:49.076173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287644+0000","last_change":"2023-10-09T11:43:13.280268+0000","last_active":"2023-10-09T11:43:13.287644+0000","last_peered":"2023-10-09T11:43:13.287644+0000","last_clean":"2023-10-09T11:43:13.287644+0000","last_became_active":"2023-10-09T11:43:13.278704+0000","last_became_peered":"2023-10-09T11:43:13.278704+0000","last_unstale":"2023-10-09T11:43:13.287644+0000","last_undegraded":"2023-10-09T11:43:13.287644+0000","last_fullsized":"2023-10-09T11:43:13.287644+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:39.785131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276633+0000","last_change":"2023-10-09T11:43:13.273492+0000","last_active":"2023-10-09T11:43:13.276633+0000","last_peered":"2023-10-09T11:43:13.276633+0000","last_clean":"2023-10-09T11:43:13.276633+0000","last_became_active":"2023-10-09T11:43:13.273065+0000","last_became_peered":"2023-10-09T11:43:13.273065+0000","last_unstale":"2023-10-09T11:43:13.276633+0000","last_undegraded":"2023-10-09T11:43:13.276633+0000","last_fullsized":"2023-10-09T11:43:13.276633+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:49.076173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286460+0000","last_change":"2023-10-09T11:43:13.283252+0000","last_active":"2023-10-09T11:43:13.286460+0000","last_peered":"2023-10-09T11:43:13.286460+0000","last_clean":"2023-10-09T11:43:13.286460+0000","last_became_active":"2023-10-09T11:43:13.282968+0000","last_became_peered":"2023-10-09T11:43:13.282968+0000","last_unstale":"2023-10-09T11:43:13.286460+0000","last_undegraded":"2023-10-09T11:43:13.286460+0000","last_fullsized":"2023-10-09T11:43:13.286460+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:51.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277816+0000","last_change":"2023-10-09T11:43:13.273973+0000","last_active":"2023-10-09T11:43:13.277816+0000","last_peered":"2023-10-09T11:43:13.277816+0000","last_clean":"2023-10-09T11:43:13.277816+0000","last_became_active":"2023-10-09T11:43:13.273651+0000","last_became_peered":"2023-10-09T11:43:13.273651+0000","last_unstale":"2023-10-09T11:43:13.277816+0000","last_undegraded":"2023-10-09T11:43:13.277816+0000","last_fullsized":"2023-10-09T11:43:13.277816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:49.823921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276642+0000","last_change":"2023-10-09T11:43:13.273470+0000","last_active":"2023-10-09T11:43:13.276642+0000","last_peered":"2023-10-09T11:43:13.276642+0000","last_clean":"2023-10-09T11:43:13.276642+0000","last_became_active":"2023-10-09T11:43:13.273136+0000","last_became_peered":"2023-10-09T11:43:13.273136+0000","last_unstale":"2023-10-09T11:43:13.276642+0000","last_undegraded":"2023-10-09T11:43:13.276642+0000","last_fullsized":"2023-10-09T11:43:13.276642+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:12.759211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":14,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290876+0000","last_change":"2023-10-09T11:43:12.271342+0000","last_active":"2023-10-09T11:43:13.290876+0000","last_peered":"2023-10-09T11:43:13.290876+0000","last_clean":"2023-10-09T11:43:13.290876+0000","last_became_active":"2023-10-09T11:43:12.271068+0000","last_became_peered":"2023-10-09T11:43:12.271068+0000","last_unstale":"2023-10-09T11:43:13.290876+0000","last_undegraded":"2023-10-09T11:43:13.290876+0000","last_fullsized":"2023-10-09T11:43:13.290876+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.906058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275299+0000","last_change":"2023-10-09T11:43:13.273658+0000","last_active":"2023-10-09T11:43:13.275299+0000","last_peered":"2023-10-09T11:43:13.275299+0000","last_clean":"2023-10-09T11:43:13.275299+0000","last_became_active":"2023-10-09T11:43:13.273355+0000","last_became_peered":"2023-10-09T11:43:13.273355+0000","last_unstale":"2023-10-09T11:43:13.275299+0000","last_undegraded":"2023-10-09T11:43:13.275299+0000","last_fullsized":"2023-10-09T11:43:13.275299+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.781902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283674+0000","last_change":"2023-10-09T11:43:12.272735+0000","last_active":"2023-10-09T11:43:13.283674+0000","last_peered":"2023-10-09T11:43:13.283674+0000","last_clean":"2023-10-09T11:43:13.283674+0000","last_became_active":"2023-10-09T11:43:12.271346+0000","last_became_peered":"2023-10-09T11:43:12.271346+0000","last_unstale":"2023-10-09T11:43:13.283674+0000","last_undegraded":"2023-10-09T11:43:13.283674+0000","last_fullsized":"2023-10-09T11:43:13.283674+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:26.356079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285568+0000","last_change":"2023-10-09T11:43:13.282803+0000","last_active":"2023-10-09T11:43:13.285568+0000","last_peered":"2023-10-09T11:43:13.285568+0000","last_clean":"2023-10-09T11:43:13.285568+0000","last_became_active":"2023-10-09T11:43:13.282504+0000","last_became_peered":"2023-10-09T11:43:13.282504+0000","last_unstale":"2023-10-09T11:43:13.285568+0000","last_undegraded":"2023-10-09T11:43:13.285568+0000","last_fullsized":"2023-10-09T11:43:13.285568+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:42.316355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289489+0000","last_change":"2023-10-09T11:43:12.275736+0000","last_active":"2023-10-09T11:43:13.289489+0000","last_peered":"2023-10-09T11:43:13.289489+0000","last_clean":"2023-10-09T11:43:13.289489+0000","last_became_active":"2023-10-09T11:43:12.275419+0000","last_became_peered":"2023-10-09T11:43:12.275419+0000","last_unstale":"2023-10-09T11:43:13.289489+0000","last_undegraded":"2023-10-09T11:43:13.289489+0000","last_fullsized":"2023-10-09T11:43:13.289489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.142984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277999+0000","last_change":"2023-10-09T11:43:13.276020+0000","last_active":"2023-10-09T11:43:13.277999+0000","last_peered":"2023-10-09T11:43:13.277999+0000","last_clean":"2023-10-09T11:43:13.277999+0000","last_became_active":"2023-10-09T11:43:13.275747+0000","last_became_peered":"2023-10-09T11:43:13.275747+0000","last_unstale":"2023-10-09T11:43:13.277999+0000","last_undegraded":"2023-10-09T11:43:13.277999+0000","last_fullsized":"2023-10-09T11:43:13.277999+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:41.919801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287188+0000","last_change":"2023-10-09T11:43:12.278893+0000","last_active":"2023-10-09T11:43:13.287188+0000","last_peered":"2023-10-09T11:43:13.287188+0000","last_clean":"2023-10-09T11:43:13.287188+0000","last_became_active":"2023-10-09T11:43:12.278647+0000","last_became_peered":"2023-10-09T11:43:12.278647+0000","last_unstale":"2023-10-09T11:43:13.287188+0000","last_undegraded":"2023-10-09T11:43:13.287188+0000","last_fullsized":"2023-10-09T11:43:13.287188+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.465253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288161+0000","last_change":"2023-10-09T11:43:13.283457+0000","last_active":"2023-10-09T11:43:13.288161+0000","last_peered":"2023-10-09T11:43:13.288161+0000","last_clean":"2023-10-09T11:43:13.288161+0000","last_became_active":"2023-10-09T11:43:13.283115+0000","last_became_peered":"2023-10-09T11:43:13.283115+0000","last_unstale":"2023-10-09T11:43:13.288161+0000","last_undegraded":"2023-10-09T11:43:13.288161+0000","last_fullsized":"2023-10-09T11:43:13.288161+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:01.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.280017+0000","last_change":"2023-10-09T11:43:12.272210+0000","last_active":"2023-10-09T11:43:13.280017+0000","last_peered":"2023-10-09T11:43:13.280017+0000","last_clean":"2023-10-09T11:43:13.280017+0000","last_became_active":"2023-10-09T11:43:12.271906+0000","last_became_peered":"2023-10-09T11:43:12.271906+0000","last_unstale":"2023-10-09T11:43:13.280017+0000","last_undegraded":"2023-10-09T11:43:13.280017+0000","last_fullsized":"2023-10-09T11:43:13.280017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:38.965993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276231+0000","last_change":"2023-10-09T11:43:13.272568+0000","last_active":"2023-10-09T11:43:13.276231+0000","last_peered":"2023-10-09T11:43:13.276231+0000","last_clean":"2023-10-09T11:43:13.276231+0000","last_became_active":"2023-10-09T11:43:13.272274+0000","last_became_peered":"2023-10-09T11:43:13.272274+0000","last_unstale":"2023-10-09T11:43:13.276231+0000","last_undegraded":"2023-10-09T11:43:13.276231+0000","last_fullsized":"2023-10-09T11:43:13.276231+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:20.526799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260846+0000","last_change":"2023-10-09T11:43:12.268933+0000","last_active":"2023-10-09T11:43:13.260846+0000","last_peered":"2023-10-09T11:43:13.260846+0000","last_clean":"2023-10-09T11:43:13.260846+0000","last_became_active":"2023-10-09T11:43:12.268635+0000","last_became_peered":"2023-10-09T11:43:12.268635+0000","last_unstale":"2023-10-09T11:43:13.260846+0000","last_undegraded":"2023-10-09T11:43:13.260846+0000","last_fullsized":"2023-10-09T11:43:13.260846+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:03.340520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290543+0000","last_change":"2023-10-09T11:43:13.287750+0000","last_active":"2023-10-09T11:43:13.290543+0000","last_peered":"2023-10-09T11:43:13.290543+0000","last_clean":"2023-10-09T11:43:13.290543+0000","last_became_active":"2023-10-09T11:43:13.287461+0000","last_became_peered":"2023-10-09T11:43:13.287461+0000","last_unstale":"2023-10-09T11:43:13.290543+0000","last_undegraded":"2023-10-09T11:43:13.290543+0000","last_fullsized":"2023-10-09T11:43:13.290543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:02.596006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261210+0000","last_change":"2023-10-09T11:43:12.270418+0000","last_active":"2023-10-09T11:43:13.261210+0000","last_peered":"2023-10-09T11:43:13.261210+0000","last_clean":"2023-10-09T11:43:13.261210+0000","last_became_active":"2023-10-09T11:43:12.270155+0000","last_became_peered":"2023-10-09T11:43:12.270155+0000","last_unstale":"2023-10-09T11:43:13.261210+0000","last_undegraded":"2023-10-09T11:43:13.261210+0000","last_fullsized":"2023-10-09T11:43:13.261210+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:48.071563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283404+0000","last_change":"2023-10-09T11:43:13.277840+0000","last_active":"2023-10-09T11:43:13.283404+0000","last_peered":"2023-10-09T11:43:13.283404+0000","last_clean":"2023-10-09T11:43:13.283404+0000","last_became_active":"2023-10-09T11:43:13.277352+0000","last_became_peered":"2023-10-09T11:43:13.277352+0000","last_unstale":"2023-10-09T11:43:13.283404+0000","last_undegraded":"2023-10-09T11:43:13.283404+0000","last_fullsized":"2023-10-09T11:43:13.283404+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:29.207301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261892+0000","last_change":"2023-10-09T11:43:12.270241+0000","last_active":"2023-10-09T11:43:13.261892+0000","last_peered":"2023-10-09T11:43:13.261892+0000","last_clean":"2023-10-09T11:43:13.261892+0000","last_became_active":"2023-10-09T11:43:12.269970+0000","last_became_peered":"2023-10-09T11:43:12.269970+0000","last_unstale":"2023-10-09T11:43:13.261892+0000","last_undegraded":"2023-10-09T11:43:13.261892+0000","last_fullsized":"2023-10-09T11:43:13.261892+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:50.261427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289060+0000","last_change":"2023-10-09T11:43:13.288624+0000","last_active":"2023-10-09T11:43:13.289060+0000","last_peered":"2023-10-09T11:43:13.289060+0000","last_clean":"2023-10-09T11:43:13.289060+0000","last_became_active":"2023-10-09T11:43:13.288342+0000","last_became_peered":"2023-10-09T11:43:13.288342+0000","last_unstale":"2023-10-09T11:43:13.289060+0000","last_undegraded":"2023-10-09T11:43:13.289060+0000","last_fullsized":"2023-10-09T11:43:13.289060+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:55.529866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261461+0000","last_change":"2023-10-09T11:43:12.274239+0000","last_active":"2023-10-09T11:43:13.261461+0000","last_peered":"2023-10-09T11:43:13.261461+0000","last_clean":"2023-10-09T11:43:13.261461+0000","last_became_active":"2023-10-09T11:43:12.273895+0000","last_became_peered":"2023-10-09T11:43:12.273895+0000","last_unstale":"2023-10-09T11:43:13.261461+0000","last_undegraded":"2023-10-09T11:43:13.261461+0000","last_fullsized":"2023-10-09T11:43:13.261461+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:11.754601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290957+0000","last_change":"2023-10-09T11:43:13.288622+0000","last_active":"2023-10-09T11:43:13.290957+0000","last_peered":"2023-10-09T11:43:13.290957+0000","last_clean":"2023-10-09T11:43:13.290957+0000","last_became_active":"2023-10-09T11:43:13.288327+0000","last_became_peered":"2023-10-09T11:43:13.288327+0000","last_unstale":"2023-10-09T11:43:13.290957+0000","last_undegraded":"2023-10-09T11:43:13.290957+0000","last_fullsized":"2023-10-09T11:43:13.290957+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:09.419862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288149+0000","last_change":"2023-10-09T11:43:12.276272+0000","last_active":"2023-10-09T11:43:13.288149+0000","last_peered":"2023-10-09T11:43:13.288149+0000","last_clean":"2023-10-09T11:43:13.288149+0000","last_became_active":"2023-10-09T11:43:12.275999+0000","last_became_peered":"2023-10-09T11:43:12.275999+0000","last_unstale":"2023-10-09T11:43:13.288149+0000","last_undegraded":"2023-10-09T11:43:13.288149+0000","last_fullsized":"2023-10-09T11:43:13.288149+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:14.129911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276857+0000","last_change":"2023-10-09T11:43:13.273021+0000","last_active":"2023-10-09T11:43:13.276857+0000","last_peered":"2023-10-09T11:43:13.276857+0000","last_clean":"2023-10-09T11:43:13.276857+0000","last_became_active":"2023-10-09T11:43:13.272782+0000","last_became_peered":"2023-10-09T11:43:13.272782+0000","last_unstale":"2023-10-09T11:43:13.276857+0000","last_undegraded":"2023-10-09T11:43:13.276857+0000","last_fullsized":"2023-10-09T11:43:13.276857+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:50.674385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.291161+0000","last_change":"2023-10-09T11:43:12.278694+0000","last_active":"2023-10-09T11:43:13.291161+0000","last_peered":"2023-10-09T11:43:13.291161+0000","last_clean":"2023-10-09T11:43:13.291161+0000","last_became_active":"2023-10-09T11:43:12.278417+0000","last_became_peered":"2023-10-09T11:43:12.278417+0000","last_unstale":"2023-10-09T11:43:13.291161+0000","last_undegraded":"2023-10-09T11:43:13.291161+0000","last_fullsized":"2023-10-09T11:43:13.291161+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:19.522190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281292+0000","last_change":"2023-10-09T11:43:13.280221+0000","last_active":"2023-10-09T11:43:13.281292+0000","last_peered":"2023-10-09T11:43:13.281292+0000","last_clean":"2023-10-09T11:43:13.281292+0000","last_became_active":"2023-10-09T11:43:13.279836+0000","last_became_peered":"2023-10-09T11:43:13.279836+0000","last_unstale":"2023-10-09T11:43:13.281292+0000","last_undegraded":"2023-10-09T11:43:13.281292+0000","last_fullsized":"2023-10-09T11:43:13.281292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:04.592860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285302+0000","last_change":"2023-10-09T11:43:12.269459+0000","last_active":"2023-10-09T11:43:13.285302+0000","last_peered":"2023-10-09T11:43:13.285302+0000","last_clean":"2023-10-09T11:43:13.285302+0000","last_became_active":"2023-10-09T11:43:12.269156+0000","last_became_peered":"2023-10-09T11:43:12.269156+0000","last_unstale":"2023-10-09T11:43:13.285302+0000","last_undegraded":"2023-10-09T11:43:13.285302+0000","last_fullsized":"2023-10-09T11:43:13.285302+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:54.525256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.273579+0000","last_change":"2023-10-09T11:43:13.269513+0000","last_active":"2023-10-09T11:43:13.273579+0000","last_peered":"2023-10-09T11:43:13.273579+0000","last_clean":"2023-10-09T11:43:13.273579+0000","last_became_active":"2023-10-09T11:43:13.269204+0000","last_became_peered":"2023-10-09T11:43:13.269204+0000","last_unstale":"2023-10-09T11:43:13.273579+0000","last_undegraded":"2023-10-09T11:43:13.273579+0000","last_fullsized":"2023-10-09T11:43:13.273579+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:44.709112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.262019+0000","last_change":"2023-10-09T11:43:12.277112+0000","last_active":"2023-10-09T11:43:13.262019+0000","last_peered":"2023-10-09T11:43:13.262019+0000","last_clean":"2023-10-09T11:43:13.262019+0000","last_became_active":"2023-10-09T11:43:12.276808+0000","last_became_peered":"2023-10-09T11:43:12.276808+0000","last_unstale":"2023-10-09T11:43:13.262019+0000","last_undegraded":"2023-10-09T11:43:13.262019+0000","last_fullsized":"2023-10-09T11:43:13.262019+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:19.829496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283269+0000","last_change":"2023-10-09T11:43:13.273468+0000","last_active":"2023-10-09T11:43:13.283269+0000","last_peered":"2023-10-09T11:43:13.283269+0000","last_clean":"2023-10-09T11:43:13.283269+0000","last_became_active":"2023-10-09T11:43:13.273016+0000","last_became_peered":"2023-10-09T11:43:13.273016+0000","last_unstale":"2023-10-09T11:43:13.283269+0000","last_undegraded":"2023-10-09T11:43:13.283269+0000","last_fullsized":"2023-10-09T11:43:13.283269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.263926+0000","last_change":"2023-10-09T11:43:12.272583+0000","last_active":"2023-10-09T11:43:13.263926+0000","last_peered":"2023-10-09T11:43:13.263926+0000","last_clean":"2023-10-09T11:43:13.263926+0000","last_became_active":"2023-10-09T11:43:12.270997+0000","last_became_peered":"2023-10-09T11:43:12.270997+0000","last_unstale":"2023-10-09T11:43:13.263926+0000","last_undegraded":"2023-10-09T11:43:13.263926+0000","last_fullsized":"2023-10-09T11:43:13.263926+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:28.202692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277896+0000","last_change":"2023-10-09T11:43:13.273704+0000","last_active":"2023-10-09T11:43:13.277896+0000","last_peered":"2023-10-09T11:43:13.277896+0000","last_clean":"2023-10-09T11:43:13.277896+0000","last_became_active":"2023-10-09T11:43:13.273414+0000","last_became_peered":"2023-10-09T11:43:13.273414+0000","last_unstale":"2023-10-09T11:43:13.277896+0000","last_undegraded":"2023-10-09T11:43:13.277896+0000","last_fullsized":"2023-10-09T11:43:13.277896+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:07.633203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289119+0000","last_change":"2023-10-09T11:43:12.275287+0000","last_active":"2023-10-09T11:43:13.289119+0000","last_peered":"2023-10-09T11:43:13.289119+0000","last_clean":"2023-10-09T11:43:13.289119+0000","last_became_active":"2023-10-09T11:43:12.275053+0000","last_became_peered":"2023-10-09T11:43:12.275053+0000","last_unstale":"2023-10-09T11:43:13.289119+0000","last_undegraded":"2023-10-09T11:43:13.289119+0000","last_fullsized":"2023-10-09T11:43:13.289119+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:26.600558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281068+0000","last_change":"2023-10-09T11:43:13.273934+0000","last_active":"2023-10-09T11:43:13.281068+0000","last_peered":"2023-10-09T11:43:13.281068+0000","last_clean":"2023-10-09T11:43:13.281068+0000","last_became_active":"2023-10-09T11:43:13.273654+0000","last_became_peered":"2023-10-09T11:43:13.273654+0000","last_unstale":"2023-10-09T11:43:13.281068+0000","last_undegraded":"2023-10-09T11:43:13.281068+0000","last_fullsized":"2023-10-09T11:43:13.281068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:39.683778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.278941+0000","last_change":"2023-10-09T11:43:12.271631+0000","last_active":"2023-10-09T11:43:13.278941+0000","last_peered":"2023-10-09T11:43:13.278941+0000","last_clean":"2023-10-09T11:43:13.278941+0000","last_became_active":"2023-10-09T11:43:12.271337+0000","last_became_peered":"2023-10-09T11:43:12.271337+0000","last_unstale":"2023-10-09T11:43:13.278941+0000","last_undegraded":"2023-10-09T11:43:13.278941+0000","last_fullsized":"2023-10-09T11:43:13.278941+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:52.362297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276378+0000","last_change":"2023-10-09T11:43:13.271528+0000","last_active":"2023-10-09T11:43:13.276378+0000","last_peered":"2023-10-09T11:43:13.276378+0000","last_clean":"2023-10-09T11:43:13.276378+0000","last_became_active":"2023-10-09T11:43:13.270938+0000","last_became_peered":"2023-10-09T11:43:13.270938+0000","last_unstale":"2023-10-09T11:43:13.276378+0000","last_undegraded":"2023-10-09T11:43:13.276378+0000","last_fullsized":"2023-10-09T11:43:13.276378+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281574+0000","last_change":"2023-10-09T11:43:12.269105+0000","last_active":"2023-10-09T11:43:13.281574+0000","last_peered":"2023-10-09T11:43:13.281574+0000","last_clean":"2023-10-09T11:43:13.281574+0000","last_became_active":"2023-10-09T11:43:12.268816+0000","last_became_peered":"2023-10-09T11:43:12.268816+0000","last_unstale":"2023-10-09T11:43:13.281574+0000","last_undegraded":"2023-10-09T11:43:13.281574+0000","last_fullsized":"2023-10-09T11:43:13.281574+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.142984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286741+0000","last_change":"2023-10-09T11:43:13.282245+0000","last_active":"2023-10-09T11:43:13.286741+0000","last_peered":"2023-10-09T11:43:13.286741+0000","last_clean":"2023-10-09T11:43:13.286741+0000","last_became_active":"2023-10-09T11:43:13.280935+0000","last_became_peered":"2023-10-09T11:43:13.280935+0000","last_unstale":"2023-10-09T11:43:13.286741+0000","last_undegraded":"2023-10-09T11:43:13.286741+0000","last_fullsized":"2023-10-09T11:43:13.286741+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:55.111554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283360+0000","last_change":"2023-10-09T11:43:12.272408+0000","last_active":"2023-10-09T11:43:13.283360+0000","last_peered":"2023-10-09T11:43:13.283360+0000","last_clean":"2023-10-09T11:43:13.283360+0000","last_became_active":"2023-10-09T11:43:12.272117+0000","last_became_peered":"2023-10-09T11:43:12.272117+0000","last_unstale":"2023-10-09T11:43:13.283360+0000","last_undegraded":"2023-10-09T11:43:13.283360+0000","last_fullsized":"2023-10-09T11:43:13.283360+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:00.511919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286686+0000","last_change":"2023-10-09T11:43:13.283897+0000","last_active":"2023-10-09T11:43:13.286686+0000","last_peered":"2023-10-09T11:43:13.286686+0000","last_clean":"2023-10-09T11:43:13.286686+0000","last_became_active":"2023-10-09T11:43:13.283632+0000","last_became_peered":"2023-10-09T11:43:13.283632+0000","last_unstale":"2023-10-09T11:43:13.286686+0000","last_undegraded":"2023-10-09T11:43:13.286686+0000","last_fullsized":"2023-10-09T11:43:13.286686+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.193030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.266124+0000","last_change":"2023-10-09T11:43:12.267233+0000","last_active":"2023-10-09T11:43:13.266124+0000","last_peered":"2023-10-09T11:43:13.266124+0000","last_clean":"2023-10-09T11:43:13.266124+0000","last_became_active":"2023-10-09T11:43:12.266896+0000","last_became_peered":"2023-10-09T11:43:12.266896+0000","last_unstale":"2023-10-09T11:43:13.266124+0000","last_undegraded":"2023-10-09T11:43:13.266124+0000","last_fullsized":"2023-10-09T11:43:13.266124+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:26.356079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275674+0000","last_change":"2023-10-09T11:43:13.270495+0000","last_active":"2023-10-09T11:43:13.275674+0000","last_peered":"2023-10-09T11:43:13.275674+0000","last_clean":"2023-10-09T11:43:13.275674+0000","last_became_active":"2023-10-09T11:43:13.270222+0000","last_became_peered":"2023-10-09T11:43:13.270222+0000","last_unstale":"2023-10-09T11:43:13.275674+0000","last_undegraded":"2023-10-09T11:43:13.275674+0000","last_fullsized":"2023-10-09T11:43:13.275674+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:15.095719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.284562+0000","last_change":"2023-10-09T11:43:12.270034+0000","last_active":"2023-10-09T11:43:13.284562+0000","last_peered":"2023-10-09T11:43:13.284562+0000","last_clean":"2023-10-09T11:43:13.284562+0000","last_became_active":"2023-10-09T11:43:12.269728+0000","last_became_peered":"2023-10-09T11:43:12.269728+0000","last_unstale":"2023-10-09T11:43:13.284562+0000","last_undegraded":"2023-10-09T11:43:13.284562+0000","last_fullsized":"2023-10-09T11:43:13.284562+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:08.415252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283269+0000","last_change":"2023-10-09T11:43:13.278330+0000","last_active":"2023-10-09T11:43:13.283269+0000","last_peered":"2023-10-09T11:43:13.283269+0000","last_clean":"2023-10-09T11:43:13.283269+0000","last_became_active":"2023-10-09T11:43:13.278061+0000","last_became_peered":"2023-10-09T11:43:13.278061+0000","last_unstale":"2023-10-09T11:43:13.283269+0000","last_undegraded":"2023-10-09T11:43:13.283269+0000","last_fullsized":"2023-10-09T11:43:13.283269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:28.182403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.264297+0000","last_change":"2023-10-09T11:43:12.274613+0000","last_active":"2023-10-09T11:43:13.264297+0000","last_peered":"2023-10-09T11:43:13.264297+0000","last_clean":"2023-10-09T11:43:13.264297+0000","last_became_active":"2023-10-09T11:43:12.274341+0000","last_became_peered":"2023-10-09T11:43:12.274341+0000","last_unstale":"2023-10-09T11:43:13.264297+0000","last_undegraded":"2023-10-09T11:43:13.264297+0000","last_fullsized":"2023-10-09T11:43:13.264297+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.915192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281766+0000","last_change":"2023-10-09T11:43:13.280038+0000","last_active":"2023-10-09T11:43:13.281766+0000","last_peered":"2023-10-09T11:43:13.281766+0000","last_clean":"2023-10-09T11:43:13.281766+0000","last_became_active":"2023-10-09T11:43:13.279752+0000","last_became_peered":"2023-10-09T11:43:13.279752+0000","last_unstale":"2023-10-09T11:43:13.281766+0000","last_undegraded":"2023-10-09T11:43:13.281766+0000","last_fullsized":"2023-10-09T11:43:13.281766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:28.182403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.263853+0000","last_change":"2023-10-09T11:43:12.276499+0000","last_active":"2023-10-09T11:43:13.263853+0000","last_peered":"2023-10-09T11:43:13.263853+0000","last_clean":"2023-10-09T11:43:13.263853+0000","last_became_active":"2023-10-09T11:43:12.276217+0000","last_became_peered":"2023-10-09T11:43:12.276217+0000","last_unstale":"2023-10-09T11:43:13.263853+0000","last_undegraded":"2023-10-09T11:43:13.263853+0000","last_fullsized":"2023-10-09T11:43:13.263853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:18.608713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271796+0000","last_change":"2023-10-09T11:43:13.268866+0000","last_active":"2023-10-09T11:43:13.271796+0000","last_peered":"2023-10-09T11:43:13.271796+0000","last_clean":"2023-10-09T11:43:13.271796+0000","last_became_active":"2023-10-09T11:43:13.268590+0000","last_became_peered":"2023-10-09T11:43:13.268590+0000","last_unstale":"2023-10-09T11:43:13.271796+0000","last_undegraded":"2023-10-09T11:43:13.271796+0000","last_fullsized":"2023-10-09T11:43:13.271796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:24.613918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.262175+0000","last_change":"2023-10-09T11:43:12.271967+0000","last_active":"2023-10-09T11:43:13.262175+0000","last_peered":"2023-10-09T11:43:13.262175+0000","last_clean":"2023-10-09T11:43:13.262175+0000","last_became_active":"2023-10-09T11:43:12.271524+0000","last_became_peered":"2023-10-09T11:43:12.271524+0000","last_unstale":"2023-10-09T11:43:13.262175+0000","last_undegraded":"2023-10-09T11:43:13.262175+0000","last_fullsized":"2023-10-09T11:43:13.262175+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:58.705359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287549+0000","last_change":"2023-10-09T11:43:13.278473+0000","last_active":"2023-10-09T11:43:13.287549+0000","last_peered":"2023-10-09T11:43:13.287549+0000","last_clean":"2023-10-09T11:43:13.287549+0000","last_became_active":"2023-10-09T11:43:13.278175+0000","last_became_peered":"2023-10-09T11:43:13.278175+0000","last_unstale":"2023-10-09T11:43:13.287549+0000","last_undegraded":"2023-10-09T11:43:13.287549+0000","last_fullsized":"2023-10-09T11:43:13.287549+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288407+0000","last_change":"2023-10-09T11:43:12.267892+0000","last_active":"2023-10-09T11:43:13.288407+0000","last_peered":"2023-10-09T11:43:13.288407+0000","last_clean":"2023-10-09T11:43:13.288407+0000","last_became_active":"2023-10-09T11:43:12.267614+0000","last_became_peered":"2023-10-09T11:43:12.267614+0000","last_unstale":"2023-10-09T11:43:13.288407+0000","last_undegraded":"2023-10-09T11:43:13.288407+0000","last_fullsized":"2023-10-09T11:43:13.288407+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:07.323679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.284903+0000","last_change":"2023-10-09T11:43:13.275180+0000","last_active":"2023-10-09T11:43:13.284903+0000","last_peered":"2023-10-09T11:43:13.284903+0000","last_clean":"2023-10-09T11:43:13.284903+0000","last_became_active":"2023-10-09T11:43:13.274552+0000","last_became_peered":"2023-10-09T11:43:13.274552+0000","last_unstale":"2023-10-09T11:43:13.284903+0000","last_undegraded":"2023-10-09T11:43:13.284903+0000","last_fullsized":"2023-10-09T11:43:13.284903+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:17.526833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271213+0000","last_change":"2023-10-09T11:43:12.278571+0000","last_active":"2023-10-09T11:43:13.271213+0000","last_peered":"2023-10-09T11:43:13.271213+0000","last_clean":"2023-10-09T11:43:13.271213+0000","last_became_active":"2023-10-09T11:43:12.278274+0000","last_became_peered":"2023-10-09T11:43:12.278274+0000","last_unstale":"2023-10-09T11:43:13.271213+0000","last_undegraded":"2023-10-09T11:43:13.271213+0000","last_fullsized":"2023-10-09T11:43:13.271213+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:47.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276424+0000","last_change":"2023-10-09T11:43:13.271575+0000","last_active":"2023-10-09T11:43:13.276424+0000","last_peered":"2023-10-09T11:43:13.276424+0000","last_clean":"2023-10-09T11:43:13.276424+0000","last_became_active":"2023-10-09T11:43:13.270592+0000","last_became_peered":"2023-10-09T11:43:13.270592+0000","last_unstale":"2023-10-09T11:43:13.276424+0000","last_undegraded":"2023-10-09T11:43:13.276424+0000","last_fullsized":"2023-10-09T11:43:13.276424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261539+0000","last_change":"2023-10-09T11:43:12.269563+0000","last_active":"2023-10-09T11:43:13.261539+0000","last_peered":"2023-10-09T11:43:13.261539+0000","last_clean":"2023-10-09T11:43:13.261539+0000","last_became_active":"2023-10-09T11:43:12.269233+0000","last_became_peered":"2023-10-09T11:43:12.269233+0000","last_unstale":"2023-10-09T11:43:13.261539+0000","last_undegraded":"2023-10-09T11:43:13.261539+0000","last_fullsized":"2023-10-09T11:43:13.261539+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:31.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279907+0000","last_change":"2023-10-09T11:43:13.277980+0000","last_active":"2023-10-09T11:43:13.279907+0000","last_peered":"2023-10-09T11:43:13.279907+0000","last_clean":"2023-10-09T11:43:13.279907+0000","last_became_active":"2023-10-09T11:43:13.276990+0000","last_became_peered":"2023-10-09T11:43:13.276990+0000","last_unstale":"2023-10-09T11:43:13.279907+0000","last_undegraded":"2023-10-09T11:43:13.279907+0000","last_fullsized":"2023-10-09T11:43:13.279907+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:32.990643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.266227+0000","last_change":"2023-10-09T11:43:12.265669+0000","last_active":"2023-10-09T11:43:13.266227+0000","last_peered":"2023-10-09T11:43:13.266227+0000","last_clean":"2023-10-09T11:43:13.266227+0000","last_became_active":"2023-10-09T11:43:12.265395+0000","last_became_peered":"2023-10-09T11:43:12.265395+0000","last_unstale":"2023-10-09T11:43:13.266227+0000","last_undegraded":"2023-10-09T11:43:13.266227+0000","last_fullsized":"2023-10-09T11:43:13.266227+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:54.809113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287481+0000","last_change":"2023-10-09T11:43:13.285402+0000","last_active":"2023-10-09T11:43:13.287481+0000","last_peered":"2023-10-09T11:43:13.287481+0000","last_clean":"2023-10-09T11:43:13.287481+0000","last_became_active":"2023-10-09T11:43:13.285087+0000","last_became_peered":"2023-10-09T11:43:13.285087+0000","last_unstale":"2023-10-09T11:43:13.287481+0000","last_undegraded":"2023-10-09T11:43:13.287481+0000","last_fullsized":"2023-10-09T11:43:13.287481+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.463080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271995+0000","last_change":"2023-10-09T11:43:12.275875+0000","last_active":"2023-10-09T11:43:13.271995+0000","last_peered":"2023-10-09T11:43:13.271995+0000","last_clean":"2023-10-09T11:43:13.271995+0000","last_became_active":"2023-10-09T11:43:12.275562+0000","last_became_peered":"2023-10-09T11:43:12.275562+0000","last_unstale":"2023-10-09T11:43:13.271995+0000","last_undegraded":"2023-10-09T11:43:13.271995+0000","last_fullsized":"2023-10-09T11:43:13.271995+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:03.588250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287846+0000","last_change":"2023-10-09T11:43:13.283409+0000","last_active":"2023-10-09T11:43:13.287846+0000","last_peered":"2023-10-09T11:43:13.287846+0000","last_clean":"2023-10-09T11:43:13.287846+0000","last_became_active":"2023-10-09T11:43:13.280624+0000","last_became_peered":"2023-10-09T11:43:13.280624+0000","last_unstale":"2023-10-09T11:43:13.287846+0000","last_undegraded":"2023-10-09T11:43:13.287846+0000","last_fullsized":"2023-10-09T11:43:13.287846+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260953+0000","last_change":"2023-10-09T11:43:12.271574+0000","last_active":"2023-10-09T11:43:13.260953+0000","last_peered":"2023-10-09T11:43:13.260953+0000","last_clean":"2023-10-09T11:43:13.260953+0000","last_became_active":"2023-10-09T11:43:12.271243+0000","last_became_peered":"2023-10-09T11:43:12.271243+0000","last_unstale":"2023-10-09T11:43:13.260953+0000","last_undegraded":"2023-10-09T11:43:13.260953+0000","last_fullsized":"2023-10-09T11:43:13.260953+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:23.609309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283249+0000","last_change":"2023-10-09T11:43:13.273289+0000","last_active":"2023-10-09T11:43:13.283249+0000","last_peered":"2023-10-09T11:43:13.283249+0000","last_clean":"2023-10-09T11:43:13.283249+0000","last_became_active":"2023-10-09T11:43:13.272679+0000","last_became_peered":"2023-10-09T11:43:13.272679+0000","last_unstale":"2023-10-09T11:43:13.283249+0000","last_undegraded":"2023-10-09T11:43:13.283249+0000","last_fullsized":"2023-10-09T11:43:13.283249+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261978+0000","last_change":"2023-10-09T11:43:12.271307+0000","last_active":"2023-10-09T11:43:13.261978+0000","last_peered":"2023-10-09T11:43:13.261978+0000","last_clean":"2023-10-09T11:43:13.261978+0000","last_became_active":"2023-10-09T11:43:12.271012+0000","last_became_peered":"2023-10-09T11:43:12.271012+0000","last_unstale":"2023-10-09T11:43:13.261978+0000","last_undegraded":"2023-10-09T11:43:13.261978+0000","last_fullsized":"2023-10-09T11:43:13.261978+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275707+0000","last_change":"2023-10-09T11:43:13.269344+0000","last_active":"2023-10-09T11:43:13.275707+0000","last_peered":"2023-10-09T11:43:13.275707+0000","last_clean":"2023-10-09T11:43:13.275707+0000","last_became_active":"2023-10-09T11:43:13.269097+0000","last_became_peered":"2023-10-09T11:43:13.269097+0000","last_unstale":"2023-10-09T11:43:13.275707+0000","last_undegraded":"2023-10-09T11:43:13.275707+0000","last_fullsized":"2023-10-09T11:43:13.275707+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:39.785131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260774+0000","last_change":"2023-10-09T11:43:12.275131+0000","last_active":"2023-10-09T11:43:13.260774+0000","last_peered":"2023-10-09T11:43:13.260774+0000","last_clean":"2023-10-09T11:43:13.260774+0000","last_became_active":"2023-10-09T11:43:12.274857+0000","last_became_peered":"2023-10-09T11:43:12.274857+0000","last_unstale":"2023-10-09T11:43:13.260774+0000","last_undegraded":"2023-10-09T11:43:13.260774+0000","last_fullsized":"2023-10-09T11:43:13.260774+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:38.303715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277014+0000","last_change":"2023-10-09T11:43:13.273184+0000","last_active":"2023-10-09T11:43:13.277014+0000","last_peered":"2023-10-09T11:43:13.277014+0000","last_clean":"2023-10-09T11:43:13.277014+0000","last_became_active":"2023-10-09T11:43:13.272864+0000","last_became_peered":"2023-10-09T11:43:13.272864+0000","last_unstale":"2023-10-09T11:43:13.277014+0000","last_undegraded":"2023-10-09T11:43:13.277014+0000","last_fullsized":"2023-10-09T11:43:13.277014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:29.448695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287761+0000","last_change":"2023-10-09T11:43:12.271082+0000","last_active":"2023-10-09T11:43:13.287761+0000","last_peered":"2023-10-09T11:43:13.287761+0000","last_clean":"2023-10-09T11:43:13.287761+0000","last_became_active":"2023-10-09T11:43:12.270784+0000","last_became_peered":"2023-10-09T11:43:12.270784+0000","last_unstale":"2023-10-09T11:43:13.287761+0000","last_undegraded":"2023-10-09T11:43:13.287761+0000","last_fullsized":"2023-10-09T11:43:13.287761+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:19.170515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.272806+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:43:13.272806+0000","last_peered":"2023-10-09T11:43:13.272806+0000","last_clean":"2023-10-09T11:43:13.272806+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:43:13.272806+0000","last_undegraded":"2023-10-09T11:43:13.272806+0000","last_fullsized":"2023-10-09T11:43:13.272806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2539520,"data_stored":1458548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.68000000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.77300000000000002,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":2.6160000000000001},"last":0.42999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":5.9450000000000003},"last":0.5},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.256},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.83299999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.90200000000000002},"min":{"1min":0.54600000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":8.9309999999999992},"last":0.374}]},{"osd":3,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.71099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58899999999999997,"15min":0.68200000000000005},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.3},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.749,"15min":1.163},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":1.1419999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.61499999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":1.369},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.64500000000000002},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.84199999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.621}]}]},{"osd":6,"up_from":14,"seq":60129542246,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":867198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.73899999999999999,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.86499999999999999,"15min":1.153},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":0.81299999999999994},"last":0.69299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.48299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.81200000000000006,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":1.1060000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.874},"last":2.895}]},{"osd":4,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.751},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":1.0069999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.93000000000000005},"last":0.85299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.51000000000000001},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46500000000000002,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.73199999999999998},"min":{"1min":0.28100000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":11.06},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.374,"15min":0.90100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":15.933999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.76200000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.621,"5min":0.621,"15min":11.935},"last":2.1960000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.73699999999999999},"min":{"1min":0.29599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53500000000000003,"5min":0.76400000000000001,"15min":11.087},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.56000000000000005},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":5.0060000000000002},"last":0.70099999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61899999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88800000000000001,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":3.4830000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":1.528},"last":3.5739999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.94999999999999996},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85799999999999998,"5min":0.88400000000000001,"15min":10.939},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78900000000000003,"5min":0.996,"15min":4.9370000000000003},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.98399999999999999},"min":{"1min":0.40899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":10.975},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":1.012},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":1.72},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":1.0129999999999999},"min":{"1min":0.48799999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1457102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.51400000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.47399999999999998,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.54700000000000004},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.77000000000000002},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.371,"15min":0.81399999999999995},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.71499999999999997,"15min":12.589},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":1.6739999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.44900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":1.502},"last":0.28799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.63700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.446},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.66200000000000003},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.1970000000000001,"15min":1.278},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.67100000000000004},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.639},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.627,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.077,"5min":1.288,"15min":1.3149999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.038,"15min":1.5629999999999999},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":866644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.27700000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60999999999999999,"15min":1.272},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.29299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.38},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.75,"15min":0.75},"last":0.27400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.65500000000000003,"5min":0.70299999999999996,"15min":1.246},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":0.92700000000000005,"15min":2.1579999999999999},"last":0.496},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":1.286},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":3.843,"15min":3.843},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":1.3149999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.25900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54600000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.53800000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.73199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76900000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.502,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.871,"15min":0.873},"last":0.73899999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303292,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068548,"statfs":{"total":96636764160,"available":96326193152,"internally_reserved":0,"allocated":1953792,"data_stored":868284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":1.056},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.68000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73599999999999999,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80200000000000005,"5min":0.84499999999999997,"15min":1.234},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.58799999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.5},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.282},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.65600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.65300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":867198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.84899999999999998,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.98099999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.53500000000000003},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.621},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.95999999999999996},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:43:17.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:17.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.539+0000 7f81934a4700 1 Processor -- start 2023-10-09T11:43:17.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.539+0000 7f81934a4700 1 -- start start 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.540+0000 7f81934a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.540+0000 7f81934a4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f818c0a90d0 0x7f818c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.540+0000 7f81934a4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c06e7f0 con 0x7f818c06e380 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.540+0000 7f81934a4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0ae680 con 0x7f818c0a90d0 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.540+0000 7f81934a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0aeee0 con 0x7f818c0a8d00 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f818c0a90d0 0x7f818c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8191240700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f818c0a90d0 0x7f818c06de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:44390/0 (socket says 172.21.15.26:44390) 2023-10-09T11:43:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8191a41700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f818c06e380 0x7f818c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:38758/0 (socket says 172.21.15.26:38758) 2023-10-09T11:43:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 -- 172.21.15.26:0/1327366571 learned_addr learned my addr 172.21.15.26:0/1327366571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 -- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 msgr2=0x7f818c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 --2- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 -- 172.21.15.26:0/1327366571 >> v1:172.21.15.67:6789/0 conn(0x7f818c06e380 legacy=0x7f818c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 -- 172.21.15.26:0/1327366571 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0cf490 con 0x7f818c0a90d0 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f818bfff700 1 -- 172.21.15.26:0/1327366571 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303336273 0 0) 0x7f818c06e7f0 con 0x7f818c06e380 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f8190a3f700 1 --2- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c0a90d0 0x7f818c06de40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8180009990 tx=0x7f8180009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81fd32aea42242d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f818bfff700 1 -- 172.21.15.26:0/1327366571 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180009e80 con 0x7f818c0a90d0 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f818bfff700 1 -- 172.21.15.26:0/1327366571 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180005c10 con 0x7f818c0a90d0 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.541+0000 7f818bfff700 1 -- 172.21.15.26:0/1327366571 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000b650 con 0x7f818c0a90d0 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 -- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c0a90d0 msgr2=0x7f818c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 --2- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c0a90d0 0x7f818c06de40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8180009990 tx=0x7f8180009220 comp rx=0 tx=0).stop 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 -- 172.21.15.26:0/1327366571 shutdown_connections 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 --2- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 --2- 172.21.15.26:0/1327366571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c0a90d0 0x7f818c06de40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 -- 172.21.15.26:0/1327366571 >> 172.21.15.26:0/1327366571 conn(0x7f818c06ce80 msgr2=0x7f818c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 -- 172.21.15.26:0/1327366571 shutdown_connections 2023-10-09T11:43:17.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.542+0000 7f81934a4700 1 -- 172.21.15.26:0/1327366571 wait complete. 2023-10-09T11:43:17.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.543+0000 7f81934a4700 1 Processor -- start 2023-10-09T11:43:17.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.543+0000 7f81934a4700 1 -- start start 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c06e380 0x7f818c09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15c610 con 0x7f818c0a90d0 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15c8f0 con 0x7f818c06e380 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f81934a4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15cbd0 con 0x7f818c0a8d00 2023-10-09T11:43:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f8191a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f8191a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49182/0 (socket says 172.21.15.26:49182) 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f8191a41700 1 -- 172.21.15.26:0/2233728326 learned_addr learned my addr 172.21.15.26:0/2233728326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f8191240700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c06e380 0x7f818c09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.544+0000 7f8190a3f700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 -- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 msgr2=0x7f818c0980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 -- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c06e380 msgr2=0x7f818c09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c06e380 0x7f818c09af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 -- 172.21.15.26:0/2233728326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009480 con 0x7f818c0a90d0 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8190a3f700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f8191a41700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f817c001eb0 tx=0x7f817c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c005a70 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c005bd0 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0070d0 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c15ceb0 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.545+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c15bc80 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.546+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c04c3c0 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.546+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f817c007480 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.547+0000 7f81897fa700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 0x7f81780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.547+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f817c084100 con 0x7f818c0a90d0 2023-10-09T11:43:17.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.547+0000 7f8191240700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 0x7f81780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.547+0000 7f8191240700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 0x7f81780697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f818c068280 tx=0x7f818400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.551+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f817c050d90 con 0x7f818c0a90d0 2023-10-09T11:43:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.738+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f818c0ca230 con 0x7f8178067320 2023-10-09T11:43:17.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.747+0000 7f81897fa700 1 -- 172.21.15.26:0/2233728326 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289734 (secure 0 0 0) 0x7f818c0ca230 con 0x7f8178067320 2023-10-09T11:43:17.752 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 msgr2=0x7f81780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 0x7f81780697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f818c068280 tx=0x7f818400b040 comp rx=0 tx=0).stop 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 msgr2=0x7f818c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f817c001eb0 tx=0x7f817c007d10 comp rx=0 tx=0).stop 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 shutdown_connections 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c0a90d0 0x7f818c0ce520 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f818c06e380 0x7f818c09af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8178067320 0x7f81780697d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 --2- 172.21.15.26:0/2233728326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f818c0a8d00 0x7f818c0980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 >> 172.21.15.26:0/2233728326 conn(0x7f818c06ce80 msgr2=0x7f818c15ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 shutdown_connections 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.751+0000 7f81934a4700 1 -- 172.21.15.26:0/2233728326 wait complete. 2023-10-09T11:43:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:43:17.764 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2023-10-09T11:43:17.220952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427400,"kb_used_data":16328,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547320,"statfs":{"total":773094113280,"available":770608455680,"internally_reserved":0,"allocated":16719872,"data_stored":8118500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.966381"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287325+0000","last_change":"2023-10-09T11:43:13.284974+0000","last_active":"2023-10-09T11:43:13.287325+0000","last_peered":"2023-10-09T11:43:13.287325+0000","last_clean":"2023-10-09T11:43:13.287325+0000","last_became_active":"2023-10-09T11:43:13.281688+0000","last_became_peered":"2023-10-09T11:43:13.281688+0000","last_unstale":"2023-10-09T11:43:13.287325+0000","last_undegraded":"2023-10-09T11:43:13.287325+0000","last_fullsized":"2023-10-09T11:43:13.287325+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:51.359875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288019+0000","last_change":"2023-10-09T11:43:13.284338+0000","last_active":"2023-10-09T11:43:13.288019+0000","last_peered":"2023-10-09T11:43:13.288019+0000","last_clean":"2023-10-09T11:43:13.288019+0000","last_became_active":"2023-10-09T11:43:13.283997+0000","last_became_peered":"2023-10-09T11:43:13.283997+0000","last_unstale":"2023-10-09T11:43:13.288019+0000","last_undegraded":"2023-10-09T11:43:13.288019+0000","last_fullsized":"2023-10-09T11:43:13.288019+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:55.529866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287474+0000","last_change":"2023-10-09T11:43:13.283850+0000","last_active":"2023-10-09T11:43:13.287474+0000","last_peered":"2023-10-09T11:43:13.287474+0000","last_clean":"2023-10-09T11:43:13.287474+0000","last_became_active":"2023-10-09T11:43:13.283588+0000","last_became_peered":"2023-10-09T11:43:13.283588+0000","last_unstale":"2023-10-09T11:43:13.287474+0000","last_undegraded":"2023-10-09T11:43:13.287474+0000","last_fullsized":"2023-10-09T11:43:13.287474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286877+0000","last_change":"2023-10-09T11:43:13.282800+0000","last_active":"2023-10-09T11:43:13.286877+0000","last_peered":"2023-10-09T11:43:13.286877+0000","last_clean":"2023-10-09T11:43:13.286877+0000","last_became_active":"2023-10-09T11:43:13.282498+0000","last_became_peered":"2023-10-09T11:43:13.282498+0000","last_unstale":"2023-10-09T11:43:13.286877+0000","last_undegraded":"2023-10-09T11:43:13.286877+0000","last_fullsized":"2023-10-09T11:43:13.286877+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:53.740720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281197+0000","last_change":"2023-10-09T11:43:13.279523+0000","last_active":"2023-10-09T11:43:13.281197+0000","last_peered":"2023-10-09T11:43:13.281197+0000","last_clean":"2023-10-09T11:43:13.281197+0000","last_became_active":"2023-10-09T11:43:13.278887+0000","last_became_peered":"2023-10-09T11:43:13.278887+0000","last_unstale":"2023-10-09T11:43:13.281197+0000","last_undegraded":"2023-10-09T11:43:13.281197+0000","last_fullsized":"2023-10-09T11:43:13.281197+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:48.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276258+0000","last_change":"2023-10-09T11:43:13.272883+0000","last_active":"2023-10-09T11:43:13.276258+0000","last_peered":"2023-10-09T11:43:13.276258+0000","last_clean":"2023-10-09T11:43:13.276258+0000","last_became_active":"2023-10-09T11:43:13.271641+0000","last_became_peered":"2023-10-09T11:43:13.271641+0000","last_unstale":"2023-10-09T11:43:13.276258+0000","last_undegraded":"2023-10-09T11:43:13.276258+0000","last_fullsized":"2023-10-09T11:43:13.276258+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:45.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287203+0000","last_change":"2023-10-09T11:43:13.283181+0000","last_active":"2023-10-09T11:43:13.287203+0000","last_peered":"2023-10-09T11:43:13.287203+0000","last_clean":"2023-10-09T11:43:13.287203+0000","last_became_active":"2023-10-09T11:43:13.282917+0000","last_became_peered":"2023-10-09T11:43:13.282917+0000","last_unstale":"2023-10-09T11:43:13.287203+0000","last_undegraded":"2023-10-09T11:43:13.287203+0000","last_fullsized":"2023-10-09T11:43:13.287203+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:22.890313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279446+0000","last_change":"2023-10-09T11:43:13.278436+0000","last_active":"2023-10-09T11:43:13.279446+0000","last_peered":"2023-10-09T11:43:13.279446+0000","last_clean":"2023-10-09T11:43:13.279446+0000","last_became_active":"2023-10-09T11:43:13.278163+0000","last_became_peered":"2023-10-09T11:43:13.278163+0000","last_unstale":"2023-10-09T11:43:13.279446+0000","last_undegraded":"2023-10-09T11:43:13.279446+0000","last_fullsized":"2023-10-09T11:43:13.279446+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:56.469863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276578+0000","last_change":"2023-10-09T11:43:13.273450+0000","last_active":"2023-10-09T11:43:13.276578+0000","last_peered":"2023-10-09T11:43:13.276578+0000","last_clean":"2023-10-09T11:43:13.276578+0000","last_became_active":"2023-10-09T11:43:13.273105+0000","last_became_peered":"2023-10-09T11:43:13.273105+0000","last_unstale":"2023-10-09T11:43:13.276578+0000","last_undegraded":"2023-10-09T11:43:13.276578+0000","last_fullsized":"2023-10-09T11:43:13.276578+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.274212+0000","last_change":"2023-10-09T11:43:13.270068+0000","last_active":"2023-10-09T11:43:13.274212+0000","last_peered":"2023-10-09T11:43:13.274212+0000","last_clean":"2023-10-09T11:43:13.274212+0000","last_became_active":"2023-10-09T11:43:13.269590+0000","last_became_peered":"2023-10-09T11:43:13.269590+0000","last_unstale":"2023-10-09T11:43:13.274212+0000","last_undegraded":"2023-10-09T11:43:13.274212+0000","last_fullsized":"2023-10-09T11:43:13.274212+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:39.351978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288853+0000","last_change":"2023-10-09T11:43:13.288223+0000","last_active":"2023-10-09T11:43:13.288853+0000","last_peered":"2023-10-09T11:43:13.288853+0000","last_clean":"2023-10-09T11:43:13.288853+0000","last_became_active":"2023-10-09T11:43:13.287873+0000","last_became_peered":"2023-10-09T11:43:13.287873+0000","last_unstale":"2023-10-09T11:43:13.288853+0000","last_undegraded":"2023-10-09T11:43:13.288853+0000","last_fullsized":"2023-10-09T11:43:13.288853+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287601+0000","last_change":"2023-10-09T11:43:13.280033+0000","last_active":"2023-10-09T11:43:13.287601+0000","last_peered":"2023-10-09T11:43:13.287601+0000","last_clean":"2023-10-09T11:43:13.287601+0000","last_became_active":"2023-10-09T11:43:13.279641+0000","last_became_peered":"2023-10-09T11:43:13.279641+0000","last_unstale":"2023-10-09T11:43:13.287601+0000","last_undegraded":"2023-10-09T11:43:13.287601+0000","last_fullsized":"2023-10-09T11:43:13.287601+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287491+0000","last_change":"2023-10-09T11:43:13.272451+0000","last_active":"2023-10-09T11:43:13.287491+0000","last_peered":"2023-10-09T11:43:13.287491+0000","last_clean":"2023-10-09T11:43:13.287491+0000","last_became_active":"2023-10-09T11:43:13.272165+0000","last_became_peered":"2023-10-09T11:43:13.272165+0000","last_unstale":"2023-10-09T11:43:13.287491+0000","last_undegraded":"2023-10-09T11:43:13.287491+0000","last_fullsized":"2023-10-09T11:43:13.287491+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276994+0000","last_change":"2023-10-09T11:43:13.272270+0000","last_active":"2023-10-09T11:43:13.276994+0000","last_peered":"2023-10-09T11:43:13.276994+0000","last_clean":"2023-10-09T11:43:13.276994+0000","last_became_active":"2023-10-09T11:43:13.271910+0000","last_became_peered":"2023-10-09T11:43:13.271910+0000","last_unstale":"2023-10-09T11:43:13.276994+0000","last_undegraded":"2023-10-09T11:43:13.276994+0000","last_fullsized":"2023-10-09T11:43:13.276994+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:13.305495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283319+0000","last_change":"2023-10-09T11:43:13.274003+0000","last_active":"2023-10-09T11:43:13.283319+0000","last_peered":"2023-10-09T11:43:13.283319+0000","last_clean":"2023-10-09T11:43:13.283319+0000","last_became_active":"2023-10-09T11:43:13.272732+0000","last_became_peered":"2023-10-09T11:43:13.272732+0000","last_unstale":"2023-10-09T11:43:13.283319+0000","last_undegraded":"2023-10-09T11:43:13.283319+0000","last_fullsized":"2023-10-09T11:43:13.283319+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:39.340362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275616+0000","last_change":"2023-10-09T11:43:13.271615+0000","last_active":"2023-10-09T11:43:13.275616+0000","last_peered":"2023-10-09T11:43:13.275616+0000","last_clean":"2023-10-09T11:43:13.275616+0000","last_became_active":"2023-10-09T11:43:13.269283+0000","last_became_peered":"2023-10-09T11:43:13.269283+0000","last_unstale":"2023-10-09T11:43:13.275616+0000","last_undegraded":"2023-10-09T11:43:13.275616+0000","last_fullsized":"2023-10-09T11:43:13.275616+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:47.007582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285657+0000","last_change":"2023-10-09T11:43:13.282744+0000","last_active":"2023-10-09T11:43:13.285657+0000","last_peered":"2023-10-09T11:43:13.285657+0000","last_clean":"2023-10-09T11:43:13.285657+0000","last_became_active":"2023-10-09T11:43:13.282086+0000","last_became_peered":"2023-10-09T11:43:13.282086+0000","last_unstale":"2023-10-09T11:43:13.285657+0000","last_undegraded":"2023-10-09T11:43:13.285657+0000","last_fullsized":"2023-10-09T11:43:13.285657+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:43.949855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275645+0000","last_change":"2023-10-09T11:43:13.272134+0000","last_active":"2023-10-09T11:43:13.275645+0000","last_peered":"2023-10-09T11:43:13.275645+0000","last_clean":"2023-10-09T11:43:13.275645+0000","last_became_active":"2023-10-09T11:43:13.271857+0000","last_became_peered":"2023-10-09T11:43:13.271857+0000","last_unstale":"2023-10-09T11:43:13.275645+0000","last_undegraded":"2023-10-09T11:43:13.275645+0000","last_fullsized":"2023-10-09T11:43:13.275645+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:19.613323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279253+0000","last_change":"2023-10-09T11:43:13.278063+0000","last_active":"2023-10-09T11:43:13.279253+0000","last_peered":"2023-10-09T11:43:13.279253+0000","last_clean":"2023-10-09T11:43:13.279253+0000","last_became_active":"2023-10-09T11:43:13.277802+0000","last_became_peered":"2023-10-09T11:43:13.277802+0000","last_unstale":"2023-10-09T11:43:13.279253+0000","last_undegraded":"2023-10-09T11:43:13.279253+0000","last_fullsized":"2023-10-09T11:43:13.279253+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:20.971631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276286+0000","last_change":"2023-10-09T11:43:13.270828+0000","last_active":"2023-10-09T11:43:13.276286+0000","last_peered":"2023-10-09T11:43:13.276286+0000","last_clean":"2023-10-09T11:43:13.276286+0000","last_became_active":"2023-10-09T11:43:13.270493+0000","last_became_peered":"2023-10-09T11:43:13.270493+0000","last_unstale":"2023-10-09T11:43:13.276286+0000","last_undegraded":"2023-10-09T11:43:13.276286+0000","last_fullsized":"2023-10-09T11:43:13.276286+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:56:13.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289107+0000","last_change":"2023-10-09T11:43:13.285919+0000","last_active":"2023-10-09T11:43:13.289107+0000","last_peered":"2023-10-09T11:43:13.289107+0000","last_clean":"2023-10-09T11:43:13.289107+0000","last_became_active":"2023-10-09T11:43:13.285633+0000","last_became_peered":"2023-10-09T11:43:13.285633+0000","last_unstale":"2023-10-09T11:43:13.289107+0000","last_undegraded":"2023-10-09T11:43:13.289107+0000","last_fullsized":"2023-10-09T11:43:13.289107+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:13.881984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.282489+0000","last_change":"2023-10-09T11:43:13.278711+0000","last_active":"2023-10-09T11:43:13.282489+0000","last_peered":"2023-10-09T11:43:13.282489+0000","last_clean":"2023-10-09T11:43:13.282489+0000","last_became_active":"2023-10-09T11:43:13.278431+0000","last_became_peered":"2023-10-09T11:43:13.278431+0000","last_unstale":"2023-10-09T11:43:13.282489+0000","last_undegraded":"2023-10-09T11:43:13.282489+0000","last_fullsized":"2023-10-09T11:43:13.282489+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:59.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.282564+0000","last_change":"2023-10-09T11:43:13.279056+0000","last_active":"2023-10-09T11:43:13.282564+0000","last_peered":"2023-10-09T11:43:13.282564+0000","last_clean":"2023-10-09T11:43:13.282564+0000","last_became_active":"2023-10-09T11:43:13.276910+0000","last_became_peered":"2023-10-09T11:43:13.276910+0000","last_unstale":"2023-10-09T11:43:13.282564+0000","last_undegraded":"2023-10-09T11:43:13.282564+0000","last_fullsized":"2023-10-09T11:43:13.282564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:53.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288746+0000","last_change":"2023-10-09T11:43:13.286110+0000","last_active":"2023-10-09T11:43:13.288746+0000","last_peered":"2023-10-09T11:43:13.288746+0000","last_clean":"2023-10-09T11:43:13.288746+0000","last_became_active":"2023-10-09T11:43:13.285824+0000","last_became_peered":"2023-10-09T11:43:13.285824+0000","last_unstale":"2023-10-09T11:43:13.288746+0000","last_undegraded":"2023-10-09T11:43:13.288746+0000","last_fullsized":"2023-10-09T11:43:13.288746+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.714469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276405+0000","last_change":"2023-10-09T11:43:13.271662+0000","last_active":"2023-10-09T11:43:13.276405+0000","last_peered":"2023-10-09T11:43:13.276405+0000","last_clean":"2023-10-09T11:43:13.276405+0000","last_became_active":"2023-10-09T11:43:13.271347+0000","last_became_peered":"2023-10-09T11:43:13.271347+0000","last_unstale":"2023-10-09T11:43:13.276405+0000","last_undegraded":"2023-10-09T11:43:13.276405+0000","last_fullsized":"2023-10-09T11:43:13.276405+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287352+0000","last_change":"2023-10-09T11:43:13.284994+0000","last_active":"2023-10-09T11:43:13.287352+0000","last_peered":"2023-10-09T11:43:13.287352+0000","last_clean":"2023-10-09T11:43:13.287352+0000","last_became_active":"2023-10-09T11:43:13.283391+0000","last_became_peered":"2023-10-09T11:43:13.283391+0000","last_unstale":"2023-10-09T11:43:13.287352+0000","last_undegraded":"2023-10-09T11:43:13.287352+0000","last_fullsized":"2023-10-09T11:43:13.287352+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:55.876890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287607+0000","last_change":"2023-10-09T11:43:13.280146+0000","last_active":"2023-10-09T11:43:13.287607+0000","last_peered":"2023-10-09T11:43:13.287607+0000","last_clean":"2023-10-09T11:43:13.287607+0000","last_became_active":"2023-10-09T11:43:13.279657+0000","last_became_peered":"2023-10-09T11:43:13.279657+0000","last_unstale":"2023-10-09T11:43:13.287607+0000","last_undegraded":"2023-10-09T11:43:13.287607+0000","last_fullsized":"2023-10-09T11:43:13.287607+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:39.683778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283300+0000","last_change":"2023-10-09T11:43:13.276128+0000","last_active":"2023-10-09T11:43:13.283300+0000","last_peered":"2023-10-09T11:43:13.283300+0000","last_clean":"2023-10-09T11:43:13.283300+0000","last_became_active":"2023-10-09T11:43:13.275853+0000","last_became_peered":"2023-10-09T11:43:13.275853+0000","last_unstale":"2023-10-09T11:43:13.283300+0000","last_undegraded":"2023-10-09T11:43:13.283300+0000","last_fullsized":"2023-10-09T11:43:13.283300+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:49.076173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287644+0000","last_change":"2023-10-09T11:43:13.280268+0000","last_active":"2023-10-09T11:43:13.287644+0000","last_peered":"2023-10-09T11:43:13.287644+0000","last_clean":"2023-10-09T11:43:13.287644+0000","last_became_active":"2023-10-09T11:43:13.278704+0000","last_became_peered":"2023-10-09T11:43:13.278704+0000","last_unstale":"2023-10-09T11:43:13.287644+0000","last_undegraded":"2023-10-09T11:43:13.287644+0000","last_fullsized":"2023-10-09T11:43:13.287644+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:39.785131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276633+0000","last_change":"2023-10-09T11:43:13.273492+0000","last_active":"2023-10-09T11:43:13.276633+0000","last_peered":"2023-10-09T11:43:13.276633+0000","last_clean":"2023-10-09T11:43:13.276633+0000","last_became_active":"2023-10-09T11:43:13.273065+0000","last_became_peered":"2023-10-09T11:43:13.273065+0000","last_unstale":"2023-10-09T11:43:13.276633+0000","last_undegraded":"2023-10-09T11:43:13.276633+0000","last_fullsized":"2023-10-09T11:43:13.276633+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:49.076173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286460+0000","last_change":"2023-10-09T11:43:13.283252+0000","last_active":"2023-10-09T11:43:13.286460+0000","last_peered":"2023-10-09T11:43:13.286460+0000","last_clean":"2023-10-09T11:43:13.286460+0000","last_became_active":"2023-10-09T11:43:13.282968+0000","last_became_peered":"2023-10-09T11:43:13.282968+0000","last_unstale":"2023-10-09T11:43:13.286460+0000","last_undegraded":"2023-10-09T11:43:13.286460+0000","last_fullsized":"2023-10-09T11:43:13.286460+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:51.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277816+0000","last_change":"2023-10-09T11:43:13.273973+0000","last_active":"2023-10-09T11:43:13.277816+0000","last_peered":"2023-10-09T11:43:13.277816+0000","last_clean":"2023-10-09T11:43:13.277816+0000","last_became_active":"2023-10-09T11:43:13.273651+0000","last_became_peered":"2023-10-09T11:43:13.273651+0000","last_unstale":"2023-10-09T11:43:13.277816+0000","last_undegraded":"2023-10-09T11:43:13.277816+0000","last_fullsized":"2023-10-09T11:43:13.277816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:49.823921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276642+0000","last_change":"2023-10-09T11:43:13.273470+0000","last_active":"2023-10-09T11:43:13.276642+0000","last_peered":"2023-10-09T11:43:13.276642+0000","last_clean":"2023-10-09T11:43:13.276642+0000","last_became_active":"2023-10-09T11:43:13.273136+0000","last_became_peered":"2023-10-09T11:43:13.273136+0000","last_unstale":"2023-10-09T11:43:13.276642+0000","last_undegraded":"2023-10-09T11:43:13.276642+0000","last_fullsized":"2023-10-09T11:43:13.276642+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:12.759211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"152'4","reported_seq":14,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290876+0000","last_change":"2023-10-09T11:43:12.271342+0000","last_active":"2023-10-09T11:43:13.290876+0000","last_peered":"2023-10-09T11:43:13.290876+0000","last_clean":"2023-10-09T11:43:13.290876+0000","last_became_active":"2023-10-09T11:43:12.271068+0000","last_became_peered":"2023-10-09T11:43:12.271068+0000","last_unstale":"2023-10-09T11:43:13.290876+0000","last_undegraded":"2023-10-09T11:43:13.290876+0000","last_fullsized":"2023-10-09T11:43:13.290876+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:07.906058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275299+0000","last_change":"2023-10-09T11:43:13.273658+0000","last_active":"2023-10-09T11:43:13.275299+0000","last_peered":"2023-10-09T11:43:13.275299+0000","last_clean":"2023-10-09T11:43:13.275299+0000","last_became_active":"2023-10-09T11:43:13.273355+0000","last_became_peered":"2023-10-09T11:43:13.273355+0000","last_unstale":"2023-10-09T11:43:13.275299+0000","last_undegraded":"2023-10-09T11:43:13.275299+0000","last_fullsized":"2023-10-09T11:43:13.275299+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.781902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283674+0000","last_change":"2023-10-09T11:43:12.272735+0000","last_active":"2023-10-09T11:43:13.283674+0000","last_peered":"2023-10-09T11:43:13.283674+0000","last_clean":"2023-10-09T11:43:13.283674+0000","last_became_active":"2023-10-09T11:43:12.271346+0000","last_became_peered":"2023-10-09T11:43:12.271346+0000","last_unstale":"2023-10-09T11:43:13.283674+0000","last_undegraded":"2023-10-09T11:43:13.283674+0000","last_fullsized":"2023-10-09T11:43:13.283674+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:26.356079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285568+0000","last_change":"2023-10-09T11:43:13.282803+0000","last_active":"2023-10-09T11:43:13.285568+0000","last_peered":"2023-10-09T11:43:13.285568+0000","last_clean":"2023-10-09T11:43:13.285568+0000","last_became_active":"2023-10-09T11:43:13.282504+0000","last_became_peered":"2023-10-09T11:43:13.282504+0000","last_unstale":"2023-10-09T11:43:13.285568+0000","last_undegraded":"2023-10-09T11:43:13.285568+0000","last_fullsized":"2023-10-09T11:43:13.285568+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:42.316355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289489+0000","last_change":"2023-10-09T11:43:12.275736+0000","last_active":"2023-10-09T11:43:13.289489+0000","last_peered":"2023-10-09T11:43:13.289489+0000","last_clean":"2023-10-09T11:43:13.289489+0000","last_became_active":"2023-10-09T11:43:12.275419+0000","last_became_peered":"2023-10-09T11:43:12.275419+0000","last_unstale":"2023-10-09T11:43:13.289489+0000","last_undegraded":"2023-10-09T11:43:13.289489+0000","last_fullsized":"2023-10-09T11:43:13.289489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.142984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277999+0000","last_change":"2023-10-09T11:43:13.276020+0000","last_active":"2023-10-09T11:43:13.277999+0000","last_peered":"2023-10-09T11:43:13.277999+0000","last_clean":"2023-10-09T11:43:13.277999+0000","last_became_active":"2023-10-09T11:43:13.275747+0000","last_became_peered":"2023-10-09T11:43:13.275747+0000","last_unstale":"2023-10-09T11:43:13.277999+0000","last_undegraded":"2023-10-09T11:43:13.277999+0000","last_fullsized":"2023-10-09T11:43:13.277999+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:41.919801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287188+0000","last_change":"2023-10-09T11:43:12.278893+0000","last_active":"2023-10-09T11:43:13.287188+0000","last_peered":"2023-10-09T11:43:13.287188+0000","last_clean":"2023-10-09T11:43:13.287188+0000","last_became_active":"2023-10-09T11:43:12.278647+0000","last_became_peered":"2023-10-09T11:43:12.278647+0000","last_unstale":"2023-10-09T11:43:13.287188+0000","last_undegraded":"2023-10-09T11:43:13.287188+0000","last_fullsized":"2023-10-09T11:43:13.287188+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.465253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288161+0000","last_change":"2023-10-09T11:43:13.283457+0000","last_active":"2023-10-09T11:43:13.288161+0000","last_peered":"2023-10-09T11:43:13.288161+0000","last_clean":"2023-10-09T11:43:13.288161+0000","last_became_active":"2023-10-09T11:43:13.283115+0000","last_became_peered":"2023-10-09T11:43:13.283115+0000","last_unstale":"2023-10-09T11:43:13.288161+0000","last_undegraded":"2023-10-09T11:43:13.288161+0000","last_fullsized":"2023-10-09T11:43:13.288161+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:01.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.280017+0000","last_change":"2023-10-09T11:43:12.272210+0000","last_active":"2023-10-09T11:43:13.280017+0000","last_peered":"2023-10-09T11:43:13.280017+0000","last_clean":"2023-10-09T11:43:13.280017+0000","last_became_active":"2023-10-09T11:43:12.271906+0000","last_became_peered":"2023-10-09T11:43:12.271906+0000","last_unstale":"2023-10-09T11:43:13.280017+0000","last_undegraded":"2023-10-09T11:43:13.280017+0000","last_fullsized":"2023-10-09T11:43:13.280017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:38.965993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276231+0000","last_change":"2023-10-09T11:43:13.272568+0000","last_active":"2023-10-09T11:43:13.276231+0000","last_peered":"2023-10-09T11:43:13.276231+0000","last_clean":"2023-10-09T11:43:13.276231+0000","last_became_active":"2023-10-09T11:43:13.272274+0000","last_became_peered":"2023-10-09T11:43:13.272274+0000","last_unstale":"2023-10-09T11:43:13.276231+0000","last_undegraded":"2023-10-09T11:43:13.276231+0000","last_fullsized":"2023-10-09T11:43:13.276231+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:20.526799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260846+0000","last_change":"2023-10-09T11:43:12.268933+0000","last_active":"2023-10-09T11:43:13.260846+0000","last_peered":"2023-10-09T11:43:13.260846+0000","last_clean":"2023-10-09T11:43:13.260846+0000","last_became_active":"2023-10-09T11:43:12.268635+0000","last_became_peered":"2023-10-09T11:43:12.268635+0000","last_unstale":"2023-10-09T11:43:13.260846+0000","last_undegraded":"2023-10-09T11:43:13.260846+0000","last_fullsized":"2023-10-09T11:43:13.260846+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:03.340520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290543+0000","last_change":"2023-10-09T11:43:13.287750+0000","last_active":"2023-10-09T11:43:13.290543+0000","last_peered":"2023-10-09T11:43:13.290543+0000","last_clean":"2023-10-09T11:43:13.290543+0000","last_became_active":"2023-10-09T11:43:13.287461+0000","last_became_peered":"2023-10-09T11:43:13.287461+0000","last_unstale":"2023-10-09T11:43:13.290543+0000","last_undegraded":"2023-10-09T11:43:13.290543+0000","last_fullsized":"2023-10-09T11:43:13.290543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:02.596006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261210+0000","last_change":"2023-10-09T11:43:12.270418+0000","last_active":"2023-10-09T11:43:13.261210+0000","last_peered":"2023-10-09T11:43:13.261210+0000","last_clean":"2023-10-09T11:43:13.261210+0000","last_became_active":"2023-10-09T11:43:12.270155+0000","last_became_peered":"2023-10-09T11:43:12.270155+0000","last_unstale":"2023-10-09T11:43:13.261210+0000","last_undegraded":"2023-10-09T11:43:13.261210+0000","last_fullsized":"2023-10-09T11:43:13.261210+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:48.071563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283404+0000","last_change":"2023-10-09T11:43:13.277840+0000","last_active":"2023-10-09T11:43:13.283404+0000","last_peered":"2023-10-09T11:43:13.283404+0000","last_clean":"2023-10-09T11:43:13.283404+0000","last_became_active":"2023-10-09T11:43:13.277352+0000","last_became_peered":"2023-10-09T11:43:13.277352+0000","last_unstale":"2023-10-09T11:43:13.283404+0000","last_undegraded":"2023-10-09T11:43:13.283404+0000","last_fullsized":"2023-10-09T11:43:13.283404+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:29.207301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261892+0000","last_change":"2023-10-09T11:43:12.270241+0000","last_active":"2023-10-09T11:43:13.261892+0000","last_peered":"2023-10-09T11:43:13.261892+0000","last_clean":"2023-10-09T11:43:13.261892+0000","last_became_active":"2023-10-09T11:43:12.269970+0000","last_became_peered":"2023-10-09T11:43:12.269970+0000","last_unstale":"2023-10-09T11:43:13.261892+0000","last_undegraded":"2023-10-09T11:43:13.261892+0000","last_fullsized":"2023-10-09T11:43:13.261892+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:50.261427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289060+0000","last_change":"2023-10-09T11:43:13.288624+0000","last_active":"2023-10-09T11:43:13.289060+0000","last_peered":"2023-10-09T11:43:13.289060+0000","last_clean":"2023-10-09T11:43:13.289060+0000","last_became_active":"2023-10-09T11:43:13.288342+0000","last_became_peered":"2023-10-09T11:43:13.288342+0000","last_unstale":"2023-10-09T11:43:13.289060+0000","last_undegraded":"2023-10-09T11:43:13.289060+0000","last_fullsized":"2023-10-09T11:43:13.289060+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:55.529866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261461+0000","last_change":"2023-10-09T11:43:12.274239+0000","last_active":"2023-10-09T11:43:13.261461+0000","last_peered":"2023-10-09T11:43:13.261461+0000","last_clean":"2023-10-09T11:43:13.261461+0000","last_became_active":"2023-10-09T11:43:12.273895+0000","last_became_peered":"2023-10-09T11:43:12.273895+0000","last_unstale":"2023-10-09T11:43:13.261461+0000","last_undegraded":"2023-10-09T11:43:13.261461+0000","last_fullsized":"2023-10-09T11:43:13.261461+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:11.754601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.290957+0000","last_change":"2023-10-09T11:43:13.288622+0000","last_active":"2023-10-09T11:43:13.290957+0000","last_peered":"2023-10-09T11:43:13.290957+0000","last_clean":"2023-10-09T11:43:13.290957+0000","last_became_active":"2023-10-09T11:43:13.288327+0000","last_became_peered":"2023-10-09T11:43:13.288327+0000","last_unstale":"2023-10-09T11:43:13.290957+0000","last_undegraded":"2023-10-09T11:43:13.290957+0000","last_fullsized":"2023-10-09T11:43:13.290957+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:09.419862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"152'3","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288149+0000","last_change":"2023-10-09T11:43:12.276272+0000","last_active":"2023-10-09T11:43:13.288149+0000","last_peered":"2023-10-09T11:43:13.288149+0000","last_clean":"2023-10-09T11:43:13.288149+0000","last_became_active":"2023-10-09T11:43:12.275999+0000","last_became_peered":"2023-10-09T11:43:12.275999+0000","last_unstale":"2023-10-09T11:43:13.288149+0000","last_undegraded":"2023-10-09T11:43:13.288149+0000","last_fullsized":"2023-10-09T11:43:13.288149+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:14.129911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276857+0000","last_change":"2023-10-09T11:43:13.273021+0000","last_active":"2023-10-09T11:43:13.276857+0000","last_peered":"2023-10-09T11:43:13.276857+0000","last_clean":"2023-10-09T11:43:13.276857+0000","last_became_active":"2023-10-09T11:43:13.272782+0000","last_became_peered":"2023-10-09T11:43:13.272782+0000","last_unstale":"2023-10-09T11:43:13.276857+0000","last_undegraded":"2023-10-09T11:43:13.276857+0000","last_fullsized":"2023-10-09T11:43:13.276857+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:50.674385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"152'6","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.291161+0000","last_change":"2023-10-09T11:43:12.278694+0000","last_active":"2023-10-09T11:43:13.291161+0000","last_peered":"2023-10-09T11:43:13.291161+0000","last_clean":"2023-10-09T11:43:13.291161+0000","last_became_active":"2023-10-09T11:43:12.278417+0000","last_became_peered":"2023-10-09T11:43:12.278417+0000","last_unstale":"2023-10-09T11:43:13.291161+0000","last_undegraded":"2023-10-09T11:43:13.291161+0000","last_fullsized":"2023-10-09T11:43:13.291161+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:19.522190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281292+0000","last_change":"2023-10-09T11:43:13.280221+0000","last_active":"2023-10-09T11:43:13.281292+0000","last_peered":"2023-10-09T11:43:13.281292+0000","last_clean":"2023-10-09T11:43:13.281292+0000","last_became_active":"2023-10-09T11:43:13.279836+0000","last_became_peered":"2023-10-09T11:43:13.279836+0000","last_unstale":"2023-10-09T11:43:13.281292+0000","last_undegraded":"2023-10-09T11:43:13.281292+0000","last_fullsized":"2023-10-09T11:43:13.281292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:04.592860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.285302+0000","last_change":"2023-10-09T11:43:12.269459+0000","last_active":"2023-10-09T11:43:13.285302+0000","last_peered":"2023-10-09T11:43:13.285302+0000","last_clean":"2023-10-09T11:43:13.285302+0000","last_became_active":"2023-10-09T11:43:12.269156+0000","last_became_peered":"2023-10-09T11:43:12.269156+0000","last_unstale":"2023-10-09T11:43:13.285302+0000","last_undegraded":"2023-10-09T11:43:13.285302+0000","last_fullsized":"2023-10-09T11:43:13.285302+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:54.525256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.273579+0000","last_change":"2023-10-09T11:43:13.269513+0000","last_active":"2023-10-09T11:43:13.273579+0000","last_peered":"2023-10-09T11:43:13.273579+0000","last_clean":"2023-10-09T11:43:13.273579+0000","last_became_active":"2023-10-09T11:43:13.269204+0000","last_became_peered":"2023-10-09T11:43:13.269204+0000","last_unstale":"2023-10-09T11:43:13.273579+0000","last_undegraded":"2023-10-09T11:43:13.273579+0000","last_fullsized":"2023-10-09T11:43:13.273579+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:44.709112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.262019+0000","last_change":"2023-10-09T11:43:12.277112+0000","last_active":"2023-10-09T11:43:13.262019+0000","last_peered":"2023-10-09T11:43:13.262019+0000","last_clean":"2023-10-09T11:43:13.262019+0000","last_became_active":"2023-10-09T11:43:12.276808+0000","last_became_peered":"2023-10-09T11:43:12.276808+0000","last_unstale":"2023-10-09T11:43:13.262019+0000","last_undegraded":"2023-10-09T11:43:13.262019+0000","last_fullsized":"2023-10-09T11:43:13.262019+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:19.829496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283269+0000","last_change":"2023-10-09T11:43:13.273468+0000","last_active":"2023-10-09T11:43:13.283269+0000","last_peered":"2023-10-09T11:43:13.283269+0000","last_clean":"2023-10-09T11:43:13.283269+0000","last_became_active":"2023-10-09T11:43:13.273016+0000","last_became_peered":"2023-10-09T11:43:13.273016+0000","last_unstale":"2023-10-09T11:43:13.283269+0000","last_undegraded":"2023-10-09T11:43:13.283269+0000","last_fullsized":"2023-10-09T11:43:13.283269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:39.850056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.263926+0000","last_change":"2023-10-09T11:43:12.272583+0000","last_active":"2023-10-09T11:43:13.263926+0000","last_peered":"2023-10-09T11:43:13.263926+0000","last_clean":"2023-10-09T11:43:13.263926+0000","last_became_active":"2023-10-09T11:43:12.270997+0000","last_became_peered":"2023-10-09T11:43:12.270997+0000","last_unstale":"2023-10-09T11:43:13.263926+0000","last_undegraded":"2023-10-09T11:43:13.263926+0000","last_fullsized":"2023-10-09T11:43:13.263926+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:28.202692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277896+0000","last_change":"2023-10-09T11:43:13.273704+0000","last_active":"2023-10-09T11:43:13.277896+0000","last_peered":"2023-10-09T11:43:13.277896+0000","last_clean":"2023-10-09T11:43:13.277896+0000","last_became_active":"2023-10-09T11:43:13.273414+0000","last_became_peered":"2023-10-09T11:43:13.273414+0000","last_unstale":"2023-10-09T11:43:13.277896+0000","last_undegraded":"2023-10-09T11:43:13.277896+0000","last_fullsized":"2023-10-09T11:43:13.277896+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:07.633203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"152'8","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.289119+0000","last_change":"2023-10-09T11:43:12.275287+0000","last_active":"2023-10-09T11:43:13.289119+0000","last_peered":"2023-10-09T11:43:13.289119+0000","last_clean":"2023-10-09T11:43:13.289119+0000","last_became_active":"2023-10-09T11:43:12.275053+0000","last_became_peered":"2023-10-09T11:43:12.275053+0000","last_unstale":"2023-10-09T11:43:13.289119+0000","last_undegraded":"2023-10-09T11:43:13.289119+0000","last_fullsized":"2023-10-09T11:43:13.289119+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:26.600558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281068+0000","last_change":"2023-10-09T11:43:13.273934+0000","last_active":"2023-10-09T11:43:13.281068+0000","last_peered":"2023-10-09T11:43:13.281068+0000","last_clean":"2023-10-09T11:43:13.281068+0000","last_became_active":"2023-10-09T11:43:13.273654+0000","last_became_peered":"2023-10-09T11:43:13.273654+0000","last_unstale":"2023-10-09T11:43:13.281068+0000","last_undegraded":"2023-10-09T11:43:13.281068+0000","last_fullsized":"2023-10-09T11:43:13.281068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:39.683778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.278941+0000","last_change":"2023-10-09T11:43:12.271631+0000","last_active":"2023-10-09T11:43:13.278941+0000","last_peered":"2023-10-09T11:43:13.278941+0000","last_clean":"2023-10-09T11:43:13.278941+0000","last_became_active":"2023-10-09T11:43:12.271337+0000","last_became_peered":"2023-10-09T11:43:12.271337+0000","last_unstale":"2023-10-09T11:43:13.278941+0000","last_undegraded":"2023-10-09T11:43:13.278941+0000","last_fullsized":"2023-10-09T11:43:13.278941+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:52.362297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276378+0000","last_change":"2023-10-09T11:43:13.271528+0000","last_active":"2023-10-09T11:43:13.276378+0000","last_peered":"2023-10-09T11:43:13.276378+0000","last_clean":"2023-10-09T11:43:13.276378+0000","last_became_active":"2023-10-09T11:43:13.270938+0000","last_became_peered":"2023-10-09T11:43:13.270938+0000","last_unstale":"2023-10-09T11:43:13.276378+0000","last_undegraded":"2023-10-09T11:43:13.276378+0000","last_fullsized":"2023-10-09T11:43:13.276378+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281574+0000","last_change":"2023-10-09T11:43:12.269105+0000","last_active":"2023-10-09T11:43:13.281574+0000","last_peered":"2023-10-09T11:43:13.281574+0000","last_clean":"2023-10-09T11:43:13.281574+0000","last_became_active":"2023-10-09T11:43:12.268816+0000","last_became_peered":"2023-10-09T11:43:12.268816+0000","last_unstale":"2023-10-09T11:43:13.281574+0000","last_undegraded":"2023-10-09T11:43:13.281574+0000","last_fullsized":"2023-10-09T11:43:13.281574+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.142984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286741+0000","last_change":"2023-10-09T11:43:13.282245+0000","last_active":"2023-10-09T11:43:13.286741+0000","last_peered":"2023-10-09T11:43:13.286741+0000","last_clean":"2023-10-09T11:43:13.286741+0000","last_became_active":"2023-10-09T11:43:13.280935+0000","last_became_peered":"2023-10-09T11:43:13.280935+0000","last_unstale":"2023-10-09T11:43:13.286741+0000","last_undegraded":"2023-10-09T11:43:13.286741+0000","last_fullsized":"2023-10-09T11:43:13.286741+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:55.111554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283360+0000","last_change":"2023-10-09T11:43:12.272408+0000","last_active":"2023-10-09T11:43:13.283360+0000","last_peered":"2023-10-09T11:43:13.283360+0000","last_clean":"2023-10-09T11:43:13.283360+0000","last_became_active":"2023-10-09T11:43:12.272117+0000","last_became_peered":"2023-10-09T11:43:12.272117+0000","last_unstale":"2023-10-09T11:43:13.283360+0000","last_undegraded":"2023-10-09T11:43:13.283360+0000","last_fullsized":"2023-10-09T11:43:13.283360+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:00.511919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.286686+0000","last_change":"2023-10-09T11:43:13.283897+0000","last_active":"2023-10-09T11:43:13.286686+0000","last_peered":"2023-10-09T11:43:13.286686+0000","last_clean":"2023-10-09T11:43:13.286686+0000","last_became_active":"2023-10-09T11:43:13.283632+0000","last_became_peered":"2023-10-09T11:43:13.283632+0000","last_unstale":"2023-10-09T11:43:13.286686+0000","last_undegraded":"2023-10-09T11:43:13.286686+0000","last_fullsized":"2023-10-09T11:43:13.286686+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.193030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.266124+0000","last_change":"2023-10-09T11:43:12.267233+0000","last_active":"2023-10-09T11:43:13.266124+0000","last_peered":"2023-10-09T11:43:13.266124+0000","last_clean":"2023-10-09T11:43:13.266124+0000","last_became_active":"2023-10-09T11:43:12.266896+0000","last_became_peered":"2023-10-09T11:43:12.266896+0000","last_unstale":"2023-10-09T11:43:13.266124+0000","last_undegraded":"2023-10-09T11:43:13.266124+0000","last_fullsized":"2023-10-09T11:43:13.266124+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:26.356079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275674+0000","last_change":"2023-10-09T11:43:13.270495+0000","last_active":"2023-10-09T11:43:13.275674+0000","last_peered":"2023-10-09T11:43:13.275674+0000","last_clean":"2023-10-09T11:43:13.275674+0000","last_became_active":"2023-10-09T11:43:13.270222+0000","last_became_peered":"2023-10-09T11:43:13.270222+0000","last_unstale":"2023-10-09T11:43:13.275674+0000","last_undegraded":"2023-10-09T11:43:13.275674+0000","last_fullsized":"2023-10-09T11:43:13.275674+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:15.095719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.284562+0000","last_change":"2023-10-09T11:43:12.270034+0000","last_active":"2023-10-09T11:43:13.284562+0000","last_peered":"2023-10-09T11:43:13.284562+0000","last_clean":"2023-10-09T11:43:13.284562+0000","last_became_active":"2023-10-09T11:43:12.269728+0000","last_became_peered":"2023-10-09T11:43:12.269728+0000","last_unstale":"2023-10-09T11:43:13.284562+0000","last_undegraded":"2023-10-09T11:43:13.284562+0000","last_fullsized":"2023-10-09T11:43:13.284562+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:08.415252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283269+0000","last_change":"2023-10-09T11:43:13.278330+0000","last_active":"2023-10-09T11:43:13.283269+0000","last_peered":"2023-10-09T11:43:13.283269+0000","last_clean":"2023-10-09T11:43:13.283269+0000","last_became_active":"2023-10-09T11:43:13.278061+0000","last_became_peered":"2023-10-09T11:43:13.278061+0000","last_unstale":"2023-10-09T11:43:13.283269+0000","last_undegraded":"2023-10-09T11:43:13.283269+0000","last_fullsized":"2023-10-09T11:43:13.283269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:28.182403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.264297+0000","last_change":"2023-10-09T11:43:12.274613+0000","last_active":"2023-10-09T11:43:13.264297+0000","last_peered":"2023-10-09T11:43:13.264297+0000","last_clean":"2023-10-09T11:43:13.264297+0000","last_became_active":"2023-10-09T11:43:12.274341+0000","last_became_peered":"2023-10-09T11:43:12.274341+0000","last_unstale":"2023-10-09T11:43:13.264297+0000","last_undegraded":"2023-10-09T11:43:13.264297+0000","last_fullsized":"2023-10-09T11:43:13.264297+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.915192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.281766+0000","last_change":"2023-10-09T11:43:13.280038+0000","last_active":"2023-10-09T11:43:13.281766+0000","last_peered":"2023-10-09T11:43:13.281766+0000","last_clean":"2023-10-09T11:43:13.281766+0000","last_became_active":"2023-10-09T11:43:13.279752+0000","last_became_peered":"2023-10-09T11:43:13.279752+0000","last_unstale":"2023-10-09T11:43:13.281766+0000","last_undegraded":"2023-10-09T11:43:13.281766+0000","last_fullsized":"2023-10-09T11:43:13.281766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:28.182403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.263853+0000","last_change":"2023-10-09T11:43:12.276499+0000","last_active":"2023-10-09T11:43:13.263853+0000","last_peered":"2023-10-09T11:43:13.263853+0000","last_clean":"2023-10-09T11:43:13.263853+0000","last_became_active":"2023-10-09T11:43:12.276217+0000","last_became_peered":"2023-10-09T11:43:12.276217+0000","last_unstale":"2023-10-09T11:43:13.263853+0000","last_undegraded":"2023-10-09T11:43:13.263853+0000","last_fullsized":"2023-10-09T11:43:13.263853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:18.608713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271796+0000","last_change":"2023-10-09T11:43:13.268866+0000","last_active":"2023-10-09T11:43:13.271796+0000","last_peered":"2023-10-09T11:43:13.271796+0000","last_clean":"2023-10-09T11:43:13.271796+0000","last_became_active":"2023-10-09T11:43:13.268590+0000","last_became_peered":"2023-10-09T11:43:13.268590+0000","last_unstale":"2023-10-09T11:43:13.271796+0000","last_undegraded":"2023-10-09T11:43:13.271796+0000","last_fullsized":"2023-10-09T11:43:13.271796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:24.613918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.262175+0000","last_change":"2023-10-09T11:43:12.271967+0000","last_active":"2023-10-09T11:43:13.262175+0000","last_peered":"2023-10-09T11:43:13.262175+0000","last_clean":"2023-10-09T11:43:13.262175+0000","last_became_active":"2023-10-09T11:43:12.271524+0000","last_became_peered":"2023-10-09T11:43:12.271524+0000","last_unstale":"2023-10-09T11:43:13.262175+0000","last_undegraded":"2023-10-09T11:43:13.262175+0000","last_fullsized":"2023-10-09T11:43:13.262175+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:58.705359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287549+0000","last_change":"2023-10-09T11:43:13.278473+0000","last_active":"2023-10-09T11:43:13.287549+0000","last_peered":"2023-10-09T11:43:13.287549+0000","last_clean":"2023-10-09T11:43:13.287549+0000","last_became_active":"2023-10-09T11:43:13.278175+0000","last_became_peered":"2023-10-09T11:43:13.278175+0000","last_unstale":"2023-10-09T11:43:13.287549+0000","last_undegraded":"2023-10-09T11:43:13.287549+0000","last_fullsized":"2023-10-09T11:43:13.287549+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:56.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"152'2","reported_seq":12,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.288407+0000","last_change":"2023-10-09T11:43:12.267892+0000","last_active":"2023-10-09T11:43:13.288407+0000","last_peered":"2023-10-09T11:43:13.288407+0000","last_clean":"2023-10-09T11:43:13.288407+0000","last_became_active":"2023-10-09T11:43:12.267614+0000","last_became_peered":"2023-10-09T11:43:12.267614+0000","last_unstale":"2023-10-09T11:43:13.288407+0000","last_undegraded":"2023-10-09T11:43:13.288407+0000","last_fullsized":"2023-10-09T11:43:13.288407+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:07.323679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.284903+0000","last_change":"2023-10-09T11:43:13.275180+0000","last_active":"2023-10-09T11:43:13.284903+0000","last_peered":"2023-10-09T11:43:13.284903+0000","last_clean":"2023-10-09T11:43:13.284903+0000","last_became_active":"2023-10-09T11:43:13.274552+0000","last_became_peered":"2023-10-09T11:43:13.274552+0000","last_unstale":"2023-10-09T11:43:13.284903+0000","last_undegraded":"2023-10-09T11:43:13.284903+0000","last_fullsized":"2023-10-09T11:43:13.284903+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:17.526833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271213+0000","last_change":"2023-10-09T11:43:12.278571+0000","last_active":"2023-10-09T11:43:13.271213+0000","last_peered":"2023-10-09T11:43:13.271213+0000","last_clean":"2023-10-09T11:43:13.271213+0000","last_became_active":"2023-10-09T11:43:12.278274+0000","last_became_peered":"2023-10-09T11:43:12.278274+0000","last_unstale":"2023-10-09T11:43:13.271213+0000","last_undegraded":"2023-10-09T11:43:13.271213+0000","last_fullsized":"2023-10-09T11:43:13.271213+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:47.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.276424+0000","last_change":"2023-10-09T11:43:13.271575+0000","last_active":"2023-10-09T11:43:13.276424+0000","last_peered":"2023-10-09T11:43:13.276424+0000","last_clean":"2023-10-09T11:43:13.276424+0000","last_became_active":"2023-10-09T11:43:13.270592+0000","last_became_peered":"2023-10-09T11:43:13.270592+0000","last_unstale":"2023-10-09T11:43:13.276424+0000","last_undegraded":"2023-10-09T11:43:13.276424+0000","last_fullsized":"2023-10-09T11:43:13.276424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261539+0000","last_change":"2023-10-09T11:43:12.269563+0000","last_active":"2023-10-09T11:43:13.261539+0000","last_peered":"2023-10-09T11:43:13.261539+0000","last_clean":"2023-10-09T11:43:13.261539+0000","last_became_active":"2023-10-09T11:43:12.269233+0000","last_became_peered":"2023-10-09T11:43:12.269233+0000","last_unstale":"2023-10-09T11:43:13.261539+0000","last_undegraded":"2023-10-09T11:43:13.261539+0000","last_fullsized":"2023-10-09T11:43:13.261539+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:31.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.279907+0000","last_change":"2023-10-09T11:43:13.277980+0000","last_active":"2023-10-09T11:43:13.279907+0000","last_peered":"2023-10-09T11:43:13.279907+0000","last_clean":"2023-10-09T11:43:13.279907+0000","last_became_active":"2023-10-09T11:43:13.276990+0000","last_became_peered":"2023-10-09T11:43:13.276990+0000","last_unstale":"2023-10-09T11:43:13.279907+0000","last_undegraded":"2023-10-09T11:43:13.279907+0000","last_fullsized":"2023-10-09T11:43:13.279907+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:32.990643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.266227+0000","last_change":"2023-10-09T11:43:12.265669+0000","last_active":"2023-10-09T11:43:13.266227+0000","last_peered":"2023-10-09T11:43:13.266227+0000","last_clean":"2023-10-09T11:43:13.266227+0000","last_became_active":"2023-10-09T11:43:12.265395+0000","last_became_peered":"2023-10-09T11:43:12.265395+0000","last_unstale":"2023-10-09T11:43:13.266227+0000","last_undegraded":"2023-10-09T11:43:13.266227+0000","last_fullsized":"2023-10-09T11:43:13.266227+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:54.809113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287481+0000","last_change":"2023-10-09T11:43:13.285402+0000","last_active":"2023-10-09T11:43:13.287481+0000","last_peered":"2023-10-09T11:43:13.287481+0000","last_clean":"2023-10-09T11:43:13.287481+0000","last_became_active":"2023-10-09T11:43:13.285087+0000","last_became_peered":"2023-10-09T11:43:13.285087+0000","last_unstale":"2023-10-09T11:43:13.287481+0000","last_undegraded":"2023-10-09T11:43:13.287481+0000","last_fullsized":"2023-10-09T11:43:13.287481+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.463080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.271995+0000","last_change":"2023-10-09T11:43:12.275875+0000","last_active":"2023-10-09T11:43:13.271995+0000","last_peered":"2023-10-09T11:43:13.271995+0000","last_clean":"2023-10-09T11:43:13.271995+0000","last_became_active":"2023-10-09T11:43:12.275562+0000","last_became_peered":"2023-10-09T11:43:12.275562+0000","last_unstale":"2023-10-09T11:43:13.271995+0000","last_undegraded":"2023-10-09T11:43:13.271995+0000","last_fullsized":"2023-10-09T11:43:13.271995+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:03.588250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287846+0000","last_change":"2023-10-09T11:43:13.283409+0000","last_active":"2023-10-09T11:43:13.287846+0000","last_peered":"2023-10-09T11:43:13.287846+0000","last_clean":"2023-10-09T11:43:13.287846+0000","last_became_active":"2023-10-09T11:43:13.280624+0000","last_became_peered":"2023-10-09T11:43:13.280624+0000","last_unstale":"2023-10-09T11:43:13.287846+0000","last_undegraded":"2023-10-09T11:43:13.287846+0000","last_fullsized":"2023-10-09T11:43:13.287846+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:27.302925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260953+0000","last_change":"2023-10-09T11:43:12.271574+0000","last_active":"2023-10-09T11:43:13.260953+0000","last_peered":"2023-10-09T11:43:13.260953+0000","last_clean":"2023-10-09T11:43:13.260953+0000","last_became_active":"2023-10-09T11:43:12.271243+0000","last_became_peered":"2023-10-09T11:43:12.271243+0000","last_unstale":"2023-10-09T11:43:13.260953+0000","last_undegraded":"2023-10-09T11:43:13.260953+0000","last_fullsized":"2023-10-09T11:43:13.260953+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:23.609309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.283249+0000","last_change":"2023-10-09T11:43:13.273289+0000","last_active":"2023-10-09T11:43:13.283249+0000","last_peered":"2023-10-09T11:43:13.283249+0000","last_clean":"2023-10-09T11:43:13.283249+0000","last_became_active":"2023-10-09T11:43:13.272679+0000","last_became_peered":"2023-10-09T11:43:13.272679+0000","last_unstale":"2023-10-09T11:43:13.283249+0000","last_undegraded":"2023-10-09T11:43:13.283249+0000","last_fullsized":"2023-10-09T11:43:13.283249+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:20.834106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.261978+0000","last_change":"2023-10-09T11:43:12.271307+0000","last_active":"2023-10-09T11:43:13.261978+0000","last_peered":"2023-10-09T11:43:13.261978+0000","last_clean":"2023-10-09T11:43:13.261978+0000","last_became_active":"2023-10-09T11:43:12.271012+0000","last_became_peered":"2023-10-09T11:43:12.271012+0000","last_unstale":"2023-10-09T11:43:13.261978+0000","last_undegraded":"2023-10-09T11:43:13.261978+0000","last_fullsized":"2023-10-09T11:43:13.261978+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:38.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.275707+0000","last_change":"2023-10-09T11:43:13.269344+0000","last_active":"2023-10-09T11:43:13.275707+0000","last_peered":"2023-10-09T11:43:13.275707+0000","last_clean":"2023-10-09T11:43:13.275707+0000","last_became_active":"2023-10-09T11:43:13.269097+0000","last_became_peered":"2023-10-09T11:43:13.269097+0000","last_unstale":"2023-10-09T11:43:13.275707+0000","last_undegraded":"2023-10-09T11:43:13.275707+0000","last_fullsized":"2023-10-09T11:43:13.275707+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:39.785131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.260774+0000","last_change":"2023-10-09T11:43:12.275131+0000","last_active":"2023-10-09T11:43:13.260774+0000","last_peered":"2023-10-09T11:43:13.260774+0000","last_clean":"2023-10-09T11:43:13.260774+0000","last_became_active":"2023-10-09T11:43:12.274857+0000","last_became_peered":"2023-10-09T11:43:12.274857+0000","last_unstale":"2023-10-09T11:43:13.260774+0000","last_undegraded":"2023-10-09T11:43:13.260774+0000","last_fullsized":"2023-10-09T11:43:13.260774+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:38.303715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.277014+0000","last_change":"2023-10-09T11:43:13.273184+0000","last_active":"2023-10-09T11:43:13.277014+0000","last_peered":"2023-10-09T11:43:13.277014+0000","last_clean":"2023-10-09T11:43:13.277014+0000","last_became_active":"2023-10-09T11:43:13.272864+0000","last_became_peered":"2023-10-09T11:43:13.272864+0000","last_unstale":"2023-10-09T11:43:13.277014+0000","last_undegraded":"2023-10-09T11:43:13.277014+0000","last_fullsized":"2023-10-09T11:43:13.277014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:12.248463+0000","last_clean_scrub_stamp":"2023-10-09T11:43:12.248463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:29.448695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"152'1","reported_seq":11,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.287761+0000","last_change":"2023-10-09T11:43:12.271082+0000","last_active":"2023-10-09T11:43:13.287761+0000","last_peered":"2023-10-09T11:43:13.287761+0000","last_clean":"2023-10-09T11:43:13.287761+0000","last_became_active":"2023-10-09T11:43:12.270784+0000","last_became_peered":"2023-10-09T11:43:12.270784+0000","last_unstale":"2023-10-09T11:43:13.287761+0000","last_undegraded":"2023-10-09T11:43:13.287761+0000","last_fullsized":"2023-10-09T11:43:13.287761+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:11.243854+0000","last_clean_scrub_stamp":"2023-10-09T11:43:11.243854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:19.170515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-09T11:43:13.272806+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:43:13.272806+0000","last_peered":"2023-10-09T11:43:13.272806+0000","last_clean":"2023-10-09T11:43:13.272806+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:43:13.272806+0000","last_undegraded":"2023-10-09T11:43:13.272806+0000","last_fullsized":"2023-10-09T11:43:13.272806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542246,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2539520,"data_stored":1458548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.68000000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.77300000000000002,"5min":0.81899999999999995,"15min":5.8700000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52300000000000002,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":2.6160000000000001},"last":0.42999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":5.9450000000000003},"last":0.5},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.86799999999999999,"15min":1.256},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.83299999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.90200000000000002},"min":{"1min":0.54600000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":8.9309999999999992},"last":0.374}]},{"osd":3,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.71099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58899999999999997,"15min":0.68200000000000005},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.3},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.749,"15min":1.163},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.83199999999999996,"15min":1.1419999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.61499999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":1.369},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.64500000000000002},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.314},"max":{"1min":0.84199999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.621}]}]},{"osd":6,"up_from":14,"seq":60129542246,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":867198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.73899999999999999,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.86499999999999999,"15min":1.153},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.78800000000000003,"15min":0.92800000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":0.81299999999999994},"last":0.69299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.48299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.81200000000000006,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.88800000000000001,"15min":1.1060000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.874},"last":2.895}]},{"osd":4,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.751},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63500000000000001,"15min":0.65500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":1.0069999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.93000000000000005},"last":0.85299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068560,"statfs":{"total":96636764160,"available":96326205440,"internally_reserved":0,"allocated":1941504,"data_stored":866700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.51000000000000001},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.46500000000000002,"5min":0.57399999999999995,"15min":5.0330000000000004},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.73199999999999998},"min":{"1min":0.28100000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":11.06},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.374,"15min":0.90100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":15.933999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.76200000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.621,"5min":0.621,"15min":11.935},"last":2.1960000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.73699999999999999},"min":{"1min":0.29599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53500000000000003,"5min":0.76400000000000001,"15min":11.087},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39700000000000002,"15min":0.56000000000000005},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":5.0060000000000002},"last":0.70099999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61899999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88800000000000001,"5min":0.94799999999999995,"15min":4.9720000000000004},"last":3.4830000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84199999999999997,"5min":0.92500000000000004,"15min":1.528},"last":3.5739999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.94999999999999996},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85799999999999998,"5min":0.88400000000000001,"15min":10.939},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78900000000000003,"5min":0.996,"15min":4.9370000000000003},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.98399999999999999},"min":{"1min":0.40899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":10.975},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":1.012},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.89500000000000002,"15min":1.4930000000000001},"last":1.72},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":1.0129999999999999},"min":{"1min":0.48799999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":0.95699999999999996,"15min":11.000999999999999},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303856,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067984,"statfs":{"total":96636764160,"available":96325615616,"internally_reserved":0,"allocated":2531328,"data_stored":1457102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.51400000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.47399999999999998,"5min":0.53400000000000003,"15min":3.8650000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.54700000000000004},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.77000000000000002},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.371,"15min":0.81399999999999995},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.71499999999999997,"15min":12.589},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":1.6739999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.44900000000000001},"min":{"1min":0.23200000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":1.502},"last":0.28799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.63700000000000001},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.446},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.66200000000000003},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.1970000000000001,"15min":1.278},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.68600000000000005},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.67100000000000004},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.639},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.627,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.077,"5min":1.288,"15min":1.3149999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.038,"15min":1.5629999999999999},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":866644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.27700000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60999999999999999,"15min":1.272},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.29299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.251,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.38},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54800000000000004,"5min":0.75,"15min":0.75},"last":0.27400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.65500000000000003,"5min":0.70299999999999996,"15min":1.246},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":0.92700000000000005,"15min":2.1579999999999999},"last":0.496},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.874,"5min":0.874,"15min":1.286},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":3.843,"15min":3.843},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":1.3149999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303284,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068556,"statfs":{"total":96636764160,"available":96326201344,"internally_reserved":0,"allocated":1945600,"data_stored":866826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.25900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54600000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.53800000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.38800000000000001,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.73199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76900000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.502,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.871,"15min":0.873},"last":0.73899999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303292,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068548,"statfs":{"total":96636764160,"available":96326193152,"internally_reserved":0,"allocated":1953792,"data_stored":868284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":1.056},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.68000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73599999999999999,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80200000000000005,"5min":0.84499999999999997,"15min":1.234},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.58799999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.86299999999999999,"15min":1.0229999999999999},"last":0.5},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.282},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.65600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.65300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":1937408,"data_stored":867198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.84899999999999998,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.98099999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.53500000000000003},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.623,"15min":0.621},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.95999999999999996},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:43:17.770 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:43:17.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:43:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.929+0000 7f00e285f700 1 Processor -- start 2023-10-09T11:43:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.929+0000 7f00e285f700 1 -- start start 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00dc159530 0x7f00dc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00dc06dc70 0x7f00dc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc0ccfd0 con 0x7f00dc159530 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc0cf0e0 con 0x7f00dc06dc70 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e285f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc15a3d0 con 0x7f00dc06e0e0 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00dc159530 0x7f00dc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00dc159530 0x7f00dc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49192/0 (socket says 172.21.15.26:49192) 2023-10-09T11:43:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 -- 172.21.15.26:0/3322952805 learned_addr learned my addr 172.21.15.26:0/3322952805 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00db7fe700 1 --2- 172.21.15.26:0/3322952805 >> v2:172.21.15.67:3300/0 conn(0x7f00dc06dc70 0x7f00dc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00e0dfc700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 -- 172.21.15.26:0/3322952805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 msgr2=0x7f00dc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 -- 172.21.15.26:0/3322952805 >> v2:172.21.15.67:3300/0 conn(0x7f00dc06dc70 msgr2=0x7f00dc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 --2- 172.21.15.26:0/3322952805 >> v2:172.21.15.67:3300/0 conn(0x7f00dc06dc70 0x7f00dc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.930+0000 7f00dbfff700 1 -- 172.21.15.26:0/3322952805 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc15a6b0 con 0x7f00dc159530 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00dbfff700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0ceba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b66e0 tx=0x7f00cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109f94caf7453662 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00daffd700 1 -- 172.21.15.26:0/3322952805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc009e70 con 0x7f00dc159530 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00daffd700 1 -- 172.21.15.26:0/3322952805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00b860 con 0x7f00dc159530 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00daffd700 1 -- 172.21.15.26:0/3322952805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00bc00 con 0x7f00dc159530 2023-10-09T11:43:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 -- 172.21.15.26:0/3322952805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 msgr2=0x7f00dc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0ceba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b66e0 tx=0x7f00cc009250 comp rx=0 tx=0).stop 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 -- 172.21.15.26:0/3322952805 shutdown_connections 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 --2- 172.21.15.26:0/3322952805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0ceba0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 --2- 172.21.15.26:0/3322952805 >> v2:172.21.15.67:3300/0 conn(0x7f00dc06dc70 0x7f00dc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 -- 172.21.15.26:0/3322952805 >> 172.21.15.26:0/3322952805 conn(0x7f00dc0703a0 msgr2=0x7f00dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 -- 172.21.15.26:0/3322952805 shutdown_connections 2023-10-09T11:43:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.931+0000 7f00e285f700 1 -- 172.21.15.26:0/3322952805 wait complete. 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.932+0000 7f00e285f700 1 Processor -- start 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 -- start start 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 0x7f00dc151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc16ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc151fc0 con 0x7f00dc159530 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0caad0 con 0x7f00dc06dc70 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.933+0000 7f00e285f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc15cd40 con 0x7f00dc06e0e0 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49200/0 (socket says 172.21.15.26:49200) 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 -- 172.21.15.26:0/1275816722 learned_addr learned my addr 172.21.15.26:0/1275816722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00db7fe700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc16ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00dbfff700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 0x7f00dc151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 -- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 msgr2=0x7f00dc16ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc16ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 -- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 msgr2=0x7f00dc151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 0x7f00dc151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 -- 172.21.15.26:0/1275816722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0094f0 con 0x7f00dc159530 2023-10-09T11:43:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00dbfff700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 0x7f00dc151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e0dfc700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f00d4007f30 tx=0x7f00d40098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400ecf0 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400ee50 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc15d4f0 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4014670 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.934+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc15dab0 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.935+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc04c3c0 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.936+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00d40149e0 con 0x7f00dc159530 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.936+0000 7f00c3fff700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 0x7f00c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.936+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00d4085420 con 0x7f00dc159530 2023-10-09T11:43:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.936+0000 7f00dbfff700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 0x7f00c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.937+0000 7f00dbfff700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 0x7f00c80697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b66e0 tx=0x7f00cc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:17.940+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00d40520b0 con 0x7f00dc159530 2023-10-09T11:43:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.210+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f00dc15a990 con 0x7f00dc159530 2023-10-09T11:43:18.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.214+0000 7f00c3fff700 1 -- 172.21.15.26:0/1275816722 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f00d40556d0 con 0x7f00dc159530 2023-10-09T11:43:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.216+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 msgr2=0x7f00c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.216+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 0x7f00c80697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b66e0 tx=0x7f00cc017000 comp rx=0 tx=0).stop 2023-10-09T11:43:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.216+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 msgr2=0x7f00dc0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.216+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f00d4007f30 tx=0x7f00d40098e0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 shutdown_connections 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00dc159530 0x7f00dc0c9fe0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00dc06dc70 0x7f00dc151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00c8067320 0x7f00c80697d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 --2- 172.21.15.26:0/1275816722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00dc06e0e0 0x7f00dc16ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 >> 172.21.15.26:0/1275816722 conn(0x7f00dc0703a0 msgr2=0x7f00dc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 shutdown_connections 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.217+0000 7f00e285f700 1 -- 172.21.15.26:0/1275816722 wait complete. 2023-10-09T11:43:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:43:18.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.348+0000 7f82937d8700 1 Processor -- start 2023-10-09T11:43:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 -- start start 2023-10-09T11:43:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f828c0cb5a0 0x7f828c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f828c0cde50 0x7f828c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0d13f0 con 0x7f828c0cde50 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c15a940 con 0x7f828c0cb5a0 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.349+0000 7f82937d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15ae40 con 0x7f828c0cd9e0 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f828c0cde50 0x7f828c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f828c0cde50 0x7f828c15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49206/0 (socket says 172.21.15.26:49206) 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 -- 172.21.15.26:0/405662097 learned_addr learned my addr 172.21.15.26:0/405662097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291574700 1 --2- 172.21.15.26:0/405662097 >> v2:172.21.15.67:3300/0 conn(0x7f828c0cb5a0 0x7f828c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8290d73700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 -- 172.21.15.26:0/405662097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 msgr2=0x7f828c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 -- 172.21.15.26:0/405662097 >> v2:172.21.15.67:3300/0 conn(0x7f828c0cb5a0 msgr2=0x7f828c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 --2- 172.21.15.26:0/405662097 >> v2:172.21.15.67:3300/0 conn(0x7f828c0cb5a0 0x7f828c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 -- 172.21.15.26:0/405662097 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c15ab60 con 0x7f828c0cde50 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f8291d75700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c0cde50 0x7f828c15a400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f828c065120 tx=0x7f8284009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc28d70be9dc2c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f828bfff700 1 -- 172.21.15.26:0/405662097 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400e070 con 0x7f828c0cde50 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f828bfff700 1 -- 172.21.15.26:0/405662097 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400ba40 con 0x7f828c0cde50 2023-10-09T11:43:18.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.350+0000 7f828bfff700 1 -- 172.21.15.26:0/405662097 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840092e0 con 0x7f828c0cde50 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 -- 172.21.15.26:0/405662097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c0cde50 msgr2=0x7f828c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c0cde50 0x7f828c15a400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f828c065120 tx=0x7f8284009840 comp rx=0 tx=0).stop 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 -- 172.21.15.26:0/405662097 shutdown_connections 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 --2- 172.21.15.26:0/405662097 >> v2:172.21.15.67:3300/0 conn(0x7f828c0cb5a0 0x7f828c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c0cde50 0x7f828c15a400 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 --2- 172.21.15.26:0/405662097 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 -- 172.21.15.26:0/405662097 >> 172.21.15.26:0/405662097 conn(0x7f828c070e30 msgr2=0x7f828c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 -- 172.21.15.26:0/405662097 shutdown_connections 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.351+0000 7f82937d8700 1 -- 172.21.15.26:0/405662097 wait complete. 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.352+0000 7f82937d8700 1 Processor -- start 2023-10-09T11:43:18.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.352+0000 7f82937d8700 1 -- start start 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 0x7f828c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0c8c20 con 0x7f828c15dc20 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c159770 con 0x7f828c0cb5a0 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f82937d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15e0a0 con 0x7f828c0cd9e0 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49208/0 (socket says 172.21.15.26:49208) 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 -- 172.21.15.26:0/2088139848 learned_addr learned my addr 172.21.15.26:0/2088139848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291574700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 0x7f828c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8290d73700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 -- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 msgr2=0x7f828c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 -- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 msgr2=0x7f828c169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 0x7f828c169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 -- 172.21.15.26:0/2088139848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009ae0 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291574700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 0x7f828c169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8290d73700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.353+0000 7f8291d75700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f828c06ea60 tx=0x7f8284018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.354+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840032f0 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.354+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284008e40 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.354+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c16a520 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.354+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840256b0 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.354+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c158ed0 con 0x7f828c15dc20 2023-10-09T11:43:18.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.355+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c0c8d90 con 0x7f828c15dc20 2023-10-09T11:43:18.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.355+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8284003040 con 0x7f828c15dc20 2023-10-09T11:43:18.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.355+0000 7f82897fa700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 0x7f82780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:18.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.355+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82840863e0 con 0x7f828c15dc20 2023-10-09T11:43:18.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.356+0000 7f8291574700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 0x7f82780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:18.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.356+0000 7f8291574700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 0x7f82780697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:18.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.360+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f828c0c8d90 con 0x7f828c15dc20 2023-10-09T11:43:18.581 INFO:tasks.ceph.mds.d.smithi067.stderr:2023-10-09T11:43:18.581+0000 7fe0c193a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.598+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f828c0c8d90 con 0x7f828c15dc20 2023-10-09T11:43:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.598+0000 7f82897fa700 1 -- 172.21.15.26:0/2088139848 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4600 (secure 0 0 0) 0x7f828c0c8d90 con 0x7f828c15dc20 2023-10-09T11:43:18.600 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:18.600 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":101,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 msgr2=0x7f82780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 0x7f82780697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 msgr2=0x7f828c157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f828c06ea60 tx=0x7f8284018000 comp rx=0 tx=0).stop 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 shutdown_connections 2023-10-09T11:43:18.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f828c15dc20 0x7f828c157e70 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f828c0cb5a0 0x7f828c169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8278067320 0x7f82780697d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 --2- 172.21.15.26:0/2088139848 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f828c0cd9e0 0x7f828c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 >> 172.21.15.26:0/2088139848 conn(0x7f828c070e30 msgr2=0x7f828c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 shutdown_connections 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:18.600+0000 7f82937d8700 1 -- 172.21.15.26:0/2088139848 wait complete. 2023-10-09T11:43:18.603 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 101 2023-10-09T11:43:19.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:43:12.664683+0000', 'modified': '2023-10-09T11:43:16.278142+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7992}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7992': {'gid': 7992, 'name': 'd', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6836/3007773785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 3007773785}, {'type': 'v1', 'addr': '172.21.15.67:6836', 'nonce': 3007773785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:43:19.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:43:19.016 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:43:19.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.142+0000 7f3e5147d700 1 Processor -- start 2023-10-09T11:43:19.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.142+0000 7f3e5147d700 1 -- start start 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e5147d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c153c30 0x7f3e4c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e5147d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e4c15de50 0x7f3e4c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e5147d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c15afd0 con 0x7f3e4c0cef40 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e5147d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15b2b0 con 0x7f3e4c15de50 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e5147d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c15b590 con 0x7f3e4c153c30 2023-10-09T11:43:19.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e4c15de50 0x7f3e4c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e50c7c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e4c0cef40 0x7f3e4c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39934/0 (socket says 172.21.15.26:39934) 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e50c7c700 1 -- 172.21.15.26:0/21432481 learned_addr learned my addr 172.21.15.26:0/21432481 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c153c30 0x7f3e4c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/21432481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c153c30 msgr2=0x7f3e4c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c153c30 0x7f3e4c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.143+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/21432481 >> v1:172.21.15.26:6789/0 conn(0x7f3e4c0cef40 legacy=0x7f3e4c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/21432481 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c15b870 con 0x7f3e4c15de50 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4affd700 1 -- 172.21.15.26:0/21432481 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203497999 0 0) 0x7f3e4c15afd0 con 0x7f3e4c0cef40 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cea00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098e0 tx=0x7f3e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0885b022dff066f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4affd700 1 -- 172.21.15.26:0/21432481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34009e80 con 0x7f3e4c15de50 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4affd700 1 -- 172.21.15.26:0/21432481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400b860 con 0x7f3e4c15de50 2023-10-09T11:43:19.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e4affd700 1 -- 172.21.15.26:0/21432481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bbe0 con 0x7f3e4c15de50 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 -- 172.21.15.26:0/21432481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c15de50 msgr2=0x7f3e4c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cea00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098e0 tx=0x7f3e340091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 -- 172.21.15.26:0/21432481 shutdown_connections 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c153c30 0x7f3e4c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 --2- 172.21.15.26:0/21432481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cea00 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 -- 172.21.15.26:0/21432481 >> 172.21.15.26:0/21432481 conn(0x7f3e4c0703a0 msgr2=0x7f3e4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 -- 172.21.15.26:0/21432481 shutdown_connections 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.144+0000 7f3e5147d700 1 -- 172.21.15.26:0/21432481 wait complete. 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.146+0000 7f3e5147d700 1 Processor -- start 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.146+0000 7f3e5147d700 1 -- start start 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.146+0000 7f3e5147d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c0cef40 0x7f3e4c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c9ed0 con 0x7f3e4c153c30 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ca360 con 0x7f3e4c15de50 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c92c0 con 0x7f3e4c0cef40 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49226/0 (socket says 172.21.15.26:49226) 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/2004498435 learned_addr learned my addr 172.21.15.26:0/2004498435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c0cef40 0x7f3e4c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c0cef40 msgr2=0x7f3e4c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c0cef40 0x7f3e4c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 msgr2=0x7f3e4c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/2004498435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009420 con 0x7f3e4c153c30 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c06eb00 tx=0x7f3e34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e43fff700 1 -- 172.21.15.26:0/2004498435 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400b9d0 con 0x7f3e4c153c30 2023-10-09T11:43:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e43fff700 1 -- 172.21.15.26:0/2004498435 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400bb70 con 0x7f3e4c153c30 2023-10-09T11:43:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0c95a0 con 0x7f3e4c153c30 2023-10-09T11:43:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e43fff700 1 -- 172.21.15.26:0/2004498435 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34025670 con 0x7f3e4c153c30 2023-10-09T11:43:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.147+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0c9b60 con 0x7f3e4c153c30 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.149+0000 7f3e43fff700 1 -- 172.21.15.26:0/2004498435 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3e34023070 con 0x7f3e4c153c30 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.149+0000 7f3e43fff700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 0x7f3e2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.149+0000 7f3e43fff700 1 -- 172.21.15.26:0/2004498435 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e34086270 con 0x7f3e4c153c30 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.149+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 0x7f3e2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.150+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 0x7f3e2c0697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.151+0000 7f3e5b9d7b80 1 Processor -- start 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.151+0000 7f3e5b9d7b80 1 -- start start 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820984f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x558209804ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820975ba70 con 0x55820984f480 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558209759270 con 0x558209804b80 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x558209755060 con 0x5582098025f0 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49230/0 (socket says 172.21.15.26:49230) 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 -- 172.21.15.26:0/1424887379 learned_addr learned my addr 172.21.15.26:0/1424887379 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820984f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x558209804ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 -- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 msgr2=0x55820984f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820984f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 -- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 msgr2=0x558209804ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x558209804ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 -- 172.21.15.26:0/1424887379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582095ef270 con 0x55820984f480 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x558209804ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.152+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c010c90 tx=0x7f3e3c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a08742bd9fbcb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e417fa700 1 -- 172.21.15.26:0/1424887379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c017be0 con 0x55820984f480 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e417fa700 1 -- 172.21.15.26:0/1424887379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c017d40 con 0x55820984f480 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e417fa700 1 -- 172.21.15.26:0/1424887379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0146a0 con 0x55820984f480 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/1424887379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 msgr2=0x55820982e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c010c90 tx=0x7f3e3c015000 comp rx=0 tx=0).stop 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/1424887379 shutdown_connections 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x558209804ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820982e7d0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/1424887379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820984f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/1424887379 >> 172.21.15.26:0/1424887379 conn(0x5582098060c0 msgr2=0x5582098068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/1424887379 shutdown_connections 2023-10-09T11:43:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.153+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/1424887379 wait complete. 2023-10-09T11:43:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.154+0000 7f3e5b9d7b80 1 -- start start 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.154+0000 7f3e5b9d7b80 1 Processor -- start 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820982d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55820984f480 0x558209828830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558209700890 con 0x558209804b80 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820971bea0 con 0x55820984f480 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582095d7e30 con 0x5582098025f0 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e5b9d7b80 10 client.0 _ll_register_callbacks cb 0x5582097c82c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49242/0 (socket says 172.21.15.26:49242) 2023-10-09T11:43:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3365750033 learned_addr learned my addr 172.21.15.26:0/3365750033 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55820984f480 0x558209828830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820982d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 msgr2=0x55820982d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820982d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55820984f480 msgr2=0x558209828830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55820984f480 0x558209828830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3365750033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c00e040 con 0x558209804b80 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f3e34056970 tx=0x7f3e34086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3648046e8b7d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e2a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.155+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34056c70 con 0x558209804b80 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e34059e10 con 0x558209804b80 2023-10-09T11:43:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582097f9cd0 con 0x558209804b80 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e3405db60 con 0x558209804b80 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 10 client.8115 fetch_fsmap learned FSMap version 101 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x558209591fe0 con 0x558209804b80 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582097f9cd0 con 0x558209804b80 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3e34057bd0 con 0x558209804b80 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 10 client.8115 fetch_fsmap finished waiting for FSMap version 101 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 10 client.8115 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 20 client.8115 populate_metadata read hostname 'smithi026' 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820984e550 0x55820984e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 4 client.8115 mds_command: new command op to 7992 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 --> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582097d6aa0 con 0x55820984e550 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.156+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820984e550 0x55820984e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e2a7fc700 10 client.8115 ms_handle_connect on v2:172.21.15.67:6834/3007773785 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820984e550 0x55820984e920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4217ec8858f541b4 server_cookie=b3f3d9b1cce5c93b in_seq=0 out_seq=0 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/3365750033 <== mds.0 v2:172.21.15.67:6834/3007773785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5582097d6aa0 con 0x55820984e550 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e2a7fc700 10 client.8115 handle_command_reply: tid=0 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 client.8115 shutdown 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 msgr2=0x55820985f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f3e34056970 tx=0x7f3e34086040 comp rx=0 tx=0).stop 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 shutdown_connections 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820984e550 0x55820984e920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55820984f480 0x558209828830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x55820982d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e2a7fc700 0 client.8115 ms_handle_reset on v2:172.21.15.67:6834/3007773785 2023-10-09T11:43:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3365750033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820985f000 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.157+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 >> 172.21.15.26:0/3365750033 conn(0x5582098060c0 msgr2=0x558209808530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.158+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 shutdown_connections 2023-10-09T11:43:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.158+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3365750033 wait complete. 2023-10-09T11:43:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.158+0000 7f3e5b9d7b80 20 client.8115 trim_cache size 0 max 16384 2023-10-09T11:43:19.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.174+0000 7f3e5b9d7b80 1 Processor -- start 2023-10-09T11:43:19.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 -- start start 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 0x558209801eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55820984f480 0x55820982bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820982d2e0 con 0x558209804b80 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820984b930 con 0x5582098025f0 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55820984d150 con 0x55820984f480 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49244/0 (socket says 172.21.15.26:49244) 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.175+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3868155293 learned_addr learned my addr 172.21.15.26:0/3868155293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 0x558209801eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55820984f480 0x55820982bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55820984f480 msgr2=0x55820982bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55820984f480 0x55820982bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 msgr2=0x558209801eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 0x558209801eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 -- 172.21.15.26:0/3868155293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558209723780 con 0x558209804b80 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 0x558209801eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009fd0 tx=0x7f3e3406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4607e86aca38fcb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e41ffb700 1 -- 172.21.15.26:0/3868155293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3405db60 con 0x558209804b80 2023-10-09T11:43:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e41ffb700 1 -- 172.21.15.26:0/3868155293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34059e10 con 0x558209804b80 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e41ffb700 1 -- 172.21.15.26:0/3868155293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34056c70 con 0x558209804b80 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.176+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3868155293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 msgr2=0x55820984d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009fd0 tx=0x7f3e3406b000 comp rx=0 tx=0).stop 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3868155293 shutdown_connections 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55820984f480 0x55820982bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5582098025f0 0x558209801eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/3868155293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558209804b80 0x55820984d5e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3868155293 >> 172.21.15.26:0/3868155293 conn(0x5582098060c0 msgr2=0x55820982d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3868155293 shutdown_connections 2023-10-09T11:43:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/3868155293 wait complete. 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 -- start start 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.177+0000 7f3e5b9d7b80 1 Processor -- start 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x5582098b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x55820985e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820982f2b0 con 0x55820984f480 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582098604d0 con 0x558209804b80 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x558209801470 con 0x5582098025f0 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e5b9d7b80 10 client.0 _ll_register_callbacks cb 0x5582097c82c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49248/0 (socket says 172.21.15.26:49248) 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 -- 172.21.15.26:0/2578853392 learned_addr learned my addr 172.21.15.26:0/2578853392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x5582098b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e4b7fe700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x55820985e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 -- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 msgr2=0x5582098b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x5582098b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 -- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 msgr2=0x55820985e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x55820985e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.178+0000 7f3e50c7c700 1 -- 172.21.15.26:0/2578853392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558209591fe0 con 0x55820984f480 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e50c7c700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x558209805230 tx=0x7f3e44009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c96b9e944b8e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44004bb0 con 0x55820984f480 2023-10-09T11:43:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e44004d10 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e3c017d40 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e440076e0 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 10 client.8121 fetch_fsmap learned FSMap version 101 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x55820970a470 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c017d40 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3e4401d030 con 0x55820984f480 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 10 client.8121 fetch_fsmap finished waiting for FSMap version 101 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 10 client.8121 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 20 client.8121 populate_metadata read hostname 'smithi026' 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820985f720 0x55820985faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 4 client.8121 mds_command: new command op to 7992 tid=0[{"prefix": "status"}] 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 --> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582096f7e00 con 0x55820985f720 2023-10-09T11:43:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.179+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820985f720 0x55820985faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e4bfff700 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820985f720 0x55820985faf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb5de1c853b03e8d server_cookie=890cf02d3ca6cc21 in_seq=0 out_seq=0 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e2a7fc700 10 client.8121 ms_handle_connect on v2:172.21.15.67:6834/3007773785 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e2a7fc700 1 -- 172.21.15.26:0/2578853392 <== mds.0 v2:172.21.15.67:6834/3007773785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x5582096f7e00 con 0x55820985f720 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e2a7fc700 10 client.8121 handle_command_reply: tid=0 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 client.8121 shutdown 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 msgr2=0x55820985e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x558209805230 tx=0x7f3e44009040 comp rx=0 tx=0).stop 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 shutdown_connections 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:6834/3007773785,v1:172.21.15.67:6836/3007773785] conn(0x55820985f720 0x55820985faf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55820984f480 0x55820985e8f0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5582098025f0 0x5582098b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e2a7fc700 0 client.8121 ms_handle_reset on v2:172.21.15.67:6834/3007773785 2023-10-09T11:43:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 --2- 172.21.15.26:0/2578853392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558209804b80 0x55820985e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 >> 172.21.15.26:0/2578853392 conn(0x5582098060c0 msgr2=0x55820982d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 shutdown_connections 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 1 -- 172.21.15.26:0/2578853392 wait complete. 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.180+0000 7f3e5b9d7b80 20 client.8121 trim_cache size 0 max 16384 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 7992, 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:43:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9253805560000004, 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 101, 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 153, 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 153, 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 10.975893064999999 2023-10-09T11:43:19.189 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 msgr2=0x7f3e2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 0x7f3e2c0697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 msgr2=0x7f3e4c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c06eb00 tx=0x7f3e34017000 comp rx=0 tx=0).stop 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 shutdown_connections 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e4c15de50 0x7f3e4c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e2c067320 0x7f3e2c0697d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e4c0cef40 0x7f3e4c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 --2- 172.21.15.26:0/2004498435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c153c30 0x7f3e4c0cc0e0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 >> 172.21.15.26:0/2004498435 conn(0x7f3e4c0703a0 msgr2=0x7f3e4c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 shutdown_connections 2023-10-09T11:43:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.181+0000 7f3e5147d700 1 -- 172.21.15.26:0/2004498435 wait complete. 2023-10-09T11:43:19.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:19.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.312+0000 7f86e0b92700 1 Processor -- start 2023-10-09T11:43:19.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.312+0000 7f86e0b92700 1 -- start start 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86e0b92700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86dc0cb970 0x7f86dc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86e0b92700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 0x7f86dc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86e0b92700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc15ae40 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86e0b92700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0ce0f0 con 0x7f86dc0cb970 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86e0b92700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0d13f0 con 0x7f86dc15a400 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86dc0cb970 0x7f86dc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86dc0cb970 0x7f86dc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49264/0 (socket says 172.21.15.26:49264) 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 -- 172.21.15.26:0/2057365150 learned_addr learned my addr 172.21.15.26:0/2057365150 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86dad9d700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 0x7f86dc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 -- 172.21.15.26:0/2057365150 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 msgr2=0x7f86dc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 0x7f86dc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 -- 172.21.15.26:0/2057365150 >> v1:172.21.15.67:6789/0 conn(0x7f86dc0cb5a0 legacy=0x7f86dc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 -- 172.21.15.26:0/2057365150 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc15ab60 con 0x7f86dc0cb970 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86dad9d700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 0x7f86dc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d9d9b700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb970 0x7f86dc159ec0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f86c40099b0 tx=0x7f86c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1225014e2e5d9ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d959a700 1 -- 172.21.15.26:0/2057365150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400b860 con 0x7f86dc0cb970 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d959a700 1 -- 172.21.15.26:0/2057365150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400b9c0 con 0x7f86dc0cb970 2023-10-09T11:43:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.313+0000 7f86d959a700 1 -- 172.21.15.26:0/2057365150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400bd60 con 0x7f86dc0cb970 2023-10-09T11:43:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 -- 172.21.15.26:0/2057365150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb970 msgr2=0x7f86dc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb970 0x7f86dc159ec0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f86c40099b0 tx=0x7f86c4009250 comp rx=0 tx=0).stop 2023-10-09T11:43:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 -- 172.21.15.26:0/2057365150 shutdown_connections 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc15a400 0x7f86dc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 --2- 172.21.15.26:0/2057365150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb970 0x7f86dc159ec0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 -- 172.21.15.26:0/2057365150 >> 172.21.15.26:0/2057365150 conn(0x7f86dc070e30 msgr2=0x7f86dc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 -- 172.21.15.26:0/2057365150 shutdown_connections 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.314+0000 7f86e0b92700 1 -- 172.21.15.26:0/2057365150 wait complete. 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.315+0000 7f86e0b92700 1 Processor -- start 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.315+0000 7f86e0b92700 1 -- start start 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc0cb970 0x7f86dc155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86dc15a400 0x7f86dc155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1583b0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1577a0 con 0x7f86dc15a400 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86e0b92700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc157a80 con 0x7f86dc0cb970 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49270/0 (socket says 172.21.15.26:49270) 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 -- 172.21.15.26:0/3804840442 learned_addr learned my addr 172.21.15.26:0/3804840442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86d9d9b700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc0cb970 0x7f86dc155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86dad9d700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86dc15a400 0x7f86dc155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 -- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc0cb970 msgr2=0x7f86dc155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc0cb970 0x7f86dc155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 -- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86dc15a400 msgr2=0x7f86dc155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86dc15a400 0x7f86dc155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 -- 172.21.15.26:0/3804840442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40094f0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.316+0000 7f86da59c700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c590 tx=0x7f86cc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.317+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc011590 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.317+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0116f0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.317+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc157d60 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.317+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc011ab0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.317+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc1504d0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.318+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc158200 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.318+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f86cc01b3b0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.318+0000 7f86d27fc700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 0x7f86bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.318+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86cc084220 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.318+0000 7f86d9d9b700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 0x7f86bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:19.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.319+0000 7f86d9d9b700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 0x7f86bc0697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f86c40099b0 tx=0x7f86c4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:19.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.323+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86cc050eb0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.560+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86dc04c3c0 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.560+0000 7f86d27fc700 1 -- 172.21.15.26:0/3804840442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86cc017060 con 0x7f86dc0cb5a0 2023-10-09T11:43:19.562 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:19.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 msgr2=0x7f86bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 0x7f86bc0697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f86c40099b0 tx=0x7f86c4017000 comp rx=0 tx=0).stop 2023-10-09T11:43:19.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 msgr2=0x7f86dc154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:19.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c590 tx=0x7f86cc00c950 comp rx=0 tx=0).stop 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 shutdown_connections 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86dc15a400 0x7f86dc155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86dc0cb5a0 0x7f86dc154bf0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f86bc067320 0x7f86bc0697d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 --2- 172.21.15.26:0/3804840442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86dc0cb970 0x7f86dc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 >> 172.21.15.26:0/3804840442 conn(0x7f86dc070e30 msgr2=0x7f86dc0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 shutdown_connections 2023-10-09T11:43:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:19.562+0000 7f86e0b92700 1 -- 172.21.15.26:0/3804840442 wait complete. 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:19.576 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:19.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.577 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:43:19.592 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:43:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41993sec preferred_lft 41993sec 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:43:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:19.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.595 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:43:19.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.658 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:43:19.714 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:43:19.714 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:19.714 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:43:19.714 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:43:19.715 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:19.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:43:19.715 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:43:19.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.815 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:43:19.830 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:43:19.830 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:43:19.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:19.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:19.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:43:19.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:19.895 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:19.950 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:19.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:19.950 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:20.005 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:43:20.005 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:20.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:20.087 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:20.087 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:20.106 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:20.128 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:20.128 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:20.128 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:43:20.129 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:43:20.130 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:20.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:20.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:20.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.355+0000 7ff6fbdd4700 1 Processor -- start 2023-10-09T11:43:20.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.355+0000 7ff6fbdd4700 1 -- start start 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6fbdd4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6f4155b70 0x7ff6f40b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6fbdd4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4157510 con 0x7ff6f40add80 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6fbdd4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40ae2f0 con 0x7ff6f41589b0 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6fbdd4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40ae5d0 con 0x7ff6f4155b70 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f9b70700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6f4155b70 0x7ff6f40b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f936f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6f40add80 0x7ff6f4155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35236/0 (socket says 172.21.15.26:35236) 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f936f700 1 -- 172.21.15.26:0/2008565976 learned_addr learned my addr 172.21.15.26:0/2008565976 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f9b70700 1 -- 172.21.15.26:0/2008565976 >> v1:172.21.15.67:6789/0 conn(0x7ff6f41589b0 legacy=0x7ff6f4156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f9b70700 1 -- 172.21.15.26:0/2008565976 >> v1:172.21.15.26:6789/0 conn(0x7ff6f40add80 legacy=0x7ff6f4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f9b70700 1 -- 172.21.15.26:0/2008565976 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40ae8b0 con 0x7ff6f4155b70 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.356+0000 7ff6f8b6e700 1 -- 172.21.15.26:0/2008565976 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20077077 0 0) 0x7ff6f4157510 con 0x7ff6f40add80 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6f9b70700 1 --2- 172.21.15.26:0/2008565976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f40b0200 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009e60 tx=0x7ff6e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1ac0ba2e5b86f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6f8b6e700 1 -- 172.21.15.26:0/2008565976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400e070 con 0x7ff6f4155b70 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6f8b6e700 1 -- 172.21.15.26:0/2008565976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e400bc30 con 0x7ff6f4155b70 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6f8b6e700 1 -- 172.21.15.26:0/2008565976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4012430 con 0x7ff6f4155b70 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/2008565976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 msgr2=0x7ff6f40b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/2008565976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f40b0200 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009e60 tx=0x7ff6e4009780 comp rx=0 tx=0).stop 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/2008565976 shutdown_connections 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/2008565976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f40b0200 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/2008565976 >> 172.21.15.26:0/2008565976 conn(0x7ff6f406d170 msgr2=0x7ff6f40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/2008565976 shutdown_connections 2023-10-09T11:43:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.357+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/2008565976 wait complete. 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 Processor -- start 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 -- start start 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6f40add80 0x7ff6f4149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6f41589b0 0x7ff6f414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f414f120 con 0x7ff6f4155b70 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f414e230 con 0x7ff6f41589b0 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6fbdd4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f414e510 con 0x7ff6f40add80 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.359+0000 7ff6f936f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36316/0 (socket says 172.21.15.26:36316) 2023-10-09T11:43:20.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 -- 172.21.15.26:0/1958138825 learned_addr learned my addr 172.21.15.26:0/1958138825 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f9b70700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6f40add80 0x7ff6f4149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6fa371700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6f41589b0 0x7ff6f414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 -- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6f40add80 msgr2=0x7ff6f4149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6f40add80 0x7ff6f4149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 -- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6f41589b0 msgr2=0x7ff6f414c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6f41589b0 0x7ff6f414c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 -- 172.21.15.26:0/1958138825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009a20 con 0x7ff6f4155b70 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f936f700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c5e0 tx=0x7ff6e8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8005b30 con 0x7ff6f4155b70 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8005c90 con 0x7ff6f4155b70 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f414e7f0 con 0x7ff6f4155b70 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8007300 con 0x7ff6f4155b70 2023-10-09T11:43:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.360+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f414edb0 con 0x7ff6f4155b70 2023-10-09T11:43:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.361+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f404c3c0 con 0x7ff6f4155b70 2023-10-09T11:43:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.362+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff6e801b3b0 con 0x7ff6f4155b70 2023-10-09T11:43:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.362+0000 7ff6f1ffb700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.362+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6e8084050 con 0x7ff6f4155b70 2023-10-09T11:43:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.362+0000 7ff6f9b70700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.363+0000 7ff6f9b70700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 0x7ff6e00697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009e60 tx=0x7ff6e4019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:20.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.367+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6e8050ce0 con 0x7ff6f4155b70 2023-10-09T11:43:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.609+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6f414f260 con 0x7ff6f4155b70 2023-10-09T11:43:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.609+0000 7ff6f1ffb700 1 -- 172.21.15.26:0/1958138825 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6e8017070 con 0x7ff6f4155b70 2023-10-09T11:43:20.611 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 msgr2=0x7ff6e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 0x7ff6e00697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009e60 tx=0x7ff6e4019000 comp rx=0 tx=0).stop 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 msgr2=0x7ff6f413fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c5e0 tx=0x7ff6e8000fe0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 shutdown_connections 2023-10-09T11:43:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6f41589b0 0x7ff6f414c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff6e0067320 0x7ff6e00697d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6f40add80 0x7ff6f4149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 --2- 172.21.15.26:0/1958138825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6f4155b70 0x7ff6f413fbd0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 >> 172.21.15.26:0/1958138825 conn(0x7ff6f406d170 msgr2=0x7ff6f4154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.611+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 shutdown_connections 2023-10-09T11:43:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:20.612+0000 7ff6fbdd4700 1 -- 172.21.15.26:0/1958138825 wait complete. 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:20.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:20.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.626 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:43:20.645 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42006sec preferred_lft 42006sec 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.646 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:43:20.647 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:20.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.648 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:20.712 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:43:20.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.714 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:43:20.772 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:43:20.772 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:20.772 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:43:20.772 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:43:20.772 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:20.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:43:20.773 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:43:20.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.882 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:43:20.897 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:43:20.897 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:43:20.897 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:20.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:20.897 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:43:20.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:20.963 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:21.019 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:21.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:21.019 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:21.074 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:43:21.074 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:21.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:21.155 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:21.156 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:21.174 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:21.174 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:21.174 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:21.175 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:21.175 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:21.175 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:21.175 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:21.175 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:21.196 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:21.197 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:21.197 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:21.197 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:43:21.197 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:43:21.197 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:43:21.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:21.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:21.198 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:21.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:43:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.392+0000 7fb46ac19700 1 Processor -- start 2023-10-09T11:43:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.392+0000 7fb46ac19700 1 -- start start 2023-10-09T11:43:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb46ac19700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 0x7fb46406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb46ac19700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46406d050 con 0x7fb464159940 2023-10-09T11:43:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb46ac19700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640af670 con 0x7fb4640aa740 2023-10-09T11:43:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb46ac19700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640aa2b0 con 0x7fb46406c6a0 2023-10-09T11:43:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb4689b5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb464159940 0x7fb4640b08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35252/0 (socket says 172.21.15.26:35252) 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.393+0000 7fb4689b5700 1 -- 172.21.15.26:0/2159589931 learned_addr learned my addr 172.21.15.26:0/2159589931 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb463fff700 1 --2- 172.21.15.26:0/2159589931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 0x7fb46406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759481101 0 0) 0x7fb46406d050 con 0x7fb464159940 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c003570 con 0x7fb464159940 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485944060 0 0) 0x7fb45c001490 con 0x7fb4640aa740 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46406d050 con 0x7fb4640aa740 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb463fff700 1 -- 172.21.15.26:0/2159589931 >> v1:172.21.15.67:6789/0 conn(0x7fb4640aa740 legacy=0x7fb4640aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb463fff700 1 -- 172.21.15.26:0/2159589931 >> v1:172.21.15.26:6789/0 conn(0x7fb464159940 legacy=0x7fb4640b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb463fff700 1 -- 172.21.15.26:0/2159589931 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640b12a0 con 0x7fb46406c6a0 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb463fff700 1 --2- 172.21.15.26:0/2159589931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 0x7fb46406cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb458009910 tx=0x7fb4580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d1a8f30c128cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458011630 con 0x7fb46406c6a0 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458011790 con 0x7fb46406c6a0 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.394+0000 7fb4637fe700 1 -- 172.21.15.26:0/2159589931 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458011b30 con 0x7fb46406c6a0 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 -- 172.21.15.26:0/2159589931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 msgr2=0x7fb46406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 --2- 172.21.15.26:0/2159589931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 0x7fb46406cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb458009910 tx=0x7fb4580091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 -- 172.21.15.26:0/2159589931 shutdown_connections 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 --2- 172.21.15.26:0/2159589931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb46406c6a0 0x7fb46406cb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 -- 172.21.15.26:0/2159589931 >> 172.21.15.26:0/2159589931 conn(0x7fb4640cd3e0 msgr2=0x7fb4640cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 -- 172.21.15.26:0/2159589931 shutdown_connections 2023-10-09T11:43:21.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.395+0000 7fb46ac19700 1 -- 172.21.15.26:0/2159589931 wait complete. 2023-10-09T11:43:21.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.396+0000 7fb46ac19700 1 Processor -- start 2023-10-09T11:43:21.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.396+0000 7fb46ac19700 1 -- start start 2023-10-09T11:43:21.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 0x7fb4641577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:21.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:21.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb464159940 0x7fb4640c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464157d00 con 0x7fb4640aa740 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46416aca0 con 0x7fb46406c6a0 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb46ac19700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640c2180 con 0x7fb464159940 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb4689b5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 0x7fb4641577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36324/0 (socket says 172.21.15.26:36324) 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 -- 172.21.15.26:0/4045226617 learned_addr learned my addr 172.21.15.26:0/4045226617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb4691b6700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb464159940 0x7fb4640c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 -- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb464159940 msgr2=0x7fb4640c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb464159940 0x7fb4640c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 -- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 msgr2=0x7fb4641577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:21.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 0x7fb4641577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.397+0000 7fb463fff700 1 -- 172.21.15.26:0/4045226617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458009420 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb4689b5700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 0x7fb4641577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb463fff700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb458009f00 tx=0x7fb458017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45801f070 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458002f70 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458011900 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46415d7a0 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.398+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46415dd60 con 0x7fb4640aa740 2023-10-09T11:43:21.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.399+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46404c3c0 con 0x7fb4640aa740 2023-10-09T11:43:21.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.399+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb458023070 con 0x7fb4640aa740 2023-10-09T11:43:21.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.400+0000 7fb460ff9700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 0x7fb4500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:21.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.400+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb458085ed0 con 0x7fb4640aa740 2023-10-09T11:43:21.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.400+0000 7fb4689b5700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 0x7fb4500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:21.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.400+0000 7fb4689b5700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 0x7fb4500697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ae570 tx=0x7fb454009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:21.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.404+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb458052b60 con 0x7fb4640aa740 2023-10-09T11:43:21.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:21.640+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb4640685b0 con 0x7fb4640aa740 2023-10-09T11:43:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.297+0000 7fb460ff9700 1 -- 172.21.15.26:0/4045226617 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v102) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb4580150c0 con 0x7fb4640aa740 2023-10-09T11:43:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 msgr2=0x7fb4500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 0x7fb4500697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ae570 tx=0x7fb454009040 comp rx=0 tx=0).stop 2023-10-09T11:43:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 msgr2=0x7fb46416a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb458009f00 tx=0x7fb458017000 comp rx=0 tx=0).stop 2023-10-09T11:43:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 shutdown_connections 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb450067320 0x7fb4500697d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb464159940 0x7fb4640c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.299+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb46406c6a0 0x7fb4641577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.300+0000 7fb46ac19700 1 --2- 172.21.15.26:0/4045226617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4640aa740 0x7fb46416a760 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.300+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 >> 172.21.15.26:0/4045226617 conn(0x7fb4640cd3e0 msgr2=0x7fb4640aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.300+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 shutdown_connections 2023-10-09T11:43:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.300+0000 7fb46ac19700 1 -- 172.21.15.26:0/4045226617 wait complete. 2023-10-09T11:43:22.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:43:22.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.437+0000 7fadc5a91700 1 Processor -- start 2023-10-09T11:43:22.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.437+0000 7fadc5a91700 1 -- start start 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc5a91700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fadc015dfd0 0x7fadc00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc5a91700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00acc00 con 0x7fadc0159550 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc5a91700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00abff0 con 0x7fadc0159920 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc5a91700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00ac2d0 con 0x7fadc015dfd0 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc4a8f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fadc0159550 0x7fadc00ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35256/0 (socket says 172.21.15.26:35256) 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadc4a8f700 1 -- 172.21.15.26:0/3839163647 learned_addr learned my addr 172.21.15.26:0/3839163647 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadbffff700 1 --2- 172.21.15.26:0/3839163647 >> v2:172.21.15.67:3300/0 conn(0x7fadc015dfd0 0x7fadc00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181607676 0 0) 0x7fadc00acc00 con 0x7fadc0159550 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.438+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadac003570 con 0x7fadc0159550 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54927220 0 0) 0x7fadc00abff0 con 0x7fadc0159920 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc00acc00 con 0x7fadc0159920 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929595190 0 0) 0x7fadac003570 con 0x7fadc0159550 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 >> v2:172.21.15.67:3300/0 conn(0x7fadc015dfd0 msgr2=0x7fadc00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 --2- 172.21.15.26:0/3839163647 >> v2:172.21.15.67:3300/0 conn(0x7fadc015dfd0 0x7fadc00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 >> v1:172.21.15.67:6789/0 conn(0x7fadc0159920 legacy=0x7fadc00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00ac5b0 con 0x7fadc0159550 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fada8001470 con 0x7fadc0159550 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 >> v1:172.21.15.26:6789/0 conn(0x7fadc0159550 legacy=0x7fadc00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadac003c40 0x7fadac004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadac004810 0x7fadac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00ac2d0 con 0x7fadac005210 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac00c130 con 0x7fadac004810 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac00c2c0 con 0x7fadac003c40 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadbffff700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadac004810 0x7fadac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc4a8f700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadac003c40 0x7fadac004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 -- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadac003c40 msgr2=0x7fadac004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadac003c40 0x7fadac004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 -- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadac004810 msgr2=0x7fadac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadac004810 0x7fadac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 -- 172.21.15.26:0/3839163647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac003570 con 0x7fadac005210 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 -- 172.21.15.26:0/3839163647 reap_dead start 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.439+0000 7fadc5290700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadac00ba60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fadb8002150 tx=0x7fadb80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8a53831cb9d616 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800c940 con 0x7fadac005210 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb800caa0 con 0x7fadac005210 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadbf7fe700 1 -- 172.21.15.26:0/3839163647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800cc10 con 0x7fadac005210 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 -- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 msgr2=0x7fadac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadac00ba60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fadb8002150 tx=0x7fadb80017a0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 -- 172.21.15.26:0/3839163647 shutdown_connections 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 --2- 172.21.15.26:0/3839163647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadac00ba60 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 -- 172.21.15.26:0/3839163647 >> 172.21.15.26:0/3839163647 conn(0x7fadc006ce80 msgr2=0x7fadc00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:22.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 -- 172.21.15.26:0/3839163647 shutdown_connections 2023-10-09T11:43:22.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.440+0000 7fadc5a91700 1 -- 172.21.15.26:0/3839163647 wait complete. 2023-10-09T11:43:22.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.441+0000 7fadc5a91700 1 Processor -- start 2023-10-09T11:43:22.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.441+0000 7fadc5a91700 1 -- start start 2023-10-09T11:43:22.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadc00ad090 0x7fadc00ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadc0169d80 0x7fadc016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc016af50 con 0x7fadac005210 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00ada40 con 0x7fadc00ad090 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5a91700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c7d50 con 0x7fadc0169d80 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36334/0 (socket says 172.21.15.26:36334) 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 -- 172.21.15.26:0/347154821 learned_addr learned my addr 172.21.15.26:0/347154821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadbffff700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadc00ad090 0x7fadc00ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc5290700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadc0169d80 0x7fadc016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 -- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadc0169d80 msgr2=0x7fadc016a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadc0169d80 0x7fadc016a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 -- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadc00ad090 msgr2=0x7fadc00ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadc00ad090 0x7fadc00ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.442+0000 7fadc4a8f700 1 -- 172.21.15.26:0/347154821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc016ab00 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadc4a8f700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fada8001400 tx=0x7fada8001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8012560 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada80126c0 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00c7700 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8012a80 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.443+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0152570 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.444+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00c7560 con 0x7fadac005210 2023-10-09T11:43:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.444+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fada801d460 con 0x7fadac005210 2023-10-09T11:43:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.445+0000 7fadbcff9700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 0x7fada0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.445+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fada8084be0 con 0x7fadac005210 2023-10-09T11:43:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.445+0000 7fadbffff700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 0x7fada0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.446+0000 7fadbffff700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 0x7fada0069800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fadc0067ee0 tx=0x7fadb00091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.449+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadc00c7560 con 0x7fadac005210 2023-10-09T11:43:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.672+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fadc00c7e90 con 0x7fada0067350 2023-10-09T11:43:22.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.674+0000 7fadbcff9700 1 -- 172.21.15.26:0/347154821 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fadb0019070 con 0x7fada0067350 2023-10-09T11:43:22.675 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:43:22.675 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:22.676 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:43:22.676 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:22.676 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:43:22.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 msgr2=0x7fada0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 0x7fada0069800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fadc0067ee0 tx=0x7fadb00091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 msgr2=0x7fadc0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fada8001400 tx=0x7fada8001d20 comp rx=0 tx=0).stop 2023-10-09T11:43:22.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 shutdown_connections 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fada0067350 0x7fada0069800 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadc0169d80 0x7fadc016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadac005210 0x7fadc0152030 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 --2- 172.21.15.26:0/347154821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadc00ad090 0x7fadc00ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 >> 172.21.15.26:0/347154821 conn(0x7fadc006ce80 msgr2=0x7fadc0152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 shutdown_connections 2023-10-09T11:43:22.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.676+0000 7fadc5a91700 1 -- 172.21.15.26:0/347154821 wait complete. 2023-10-09T11:43:22.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:43:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.810+0000 7f558e62b700 1 Processor -- start 2023-10-09T11:43:22.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.810+0000 7f558e62b700 1 -- start start 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f558e62b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f5588156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f558e62b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55881575a0 con 0x7f5588155b60 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f558e62b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880b0e40 con 0x7f55881599d0 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f558e62b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588156990 con 0x7f5588155f30 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f5587fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5588155b60 0x7f55880b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35272/0 (socket says 172.21.15.26:35272) 2023-10-09T11:43:22.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.811+0000 7f5587fff700 1 -- 172.21.15.26:0/399358406 learned_addr learned my addr 172.21.15.26:0/399358406 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f55877fe700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f5588156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300121353 0 0) 0x7f55881575a0 con 0x7f5588155b60 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5570003570 con 0x7f5588155b60 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396666565 0 0) 0x7f5570003570 con 0x7f5588155b60 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 msgr2=0x7f5588156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f5588156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 >> v1:172.21.15.67:6789/0 conn(0x7f55881599d0 legacy=0x7f5588157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588156c70 con 0x7f5588155b60 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f5578001470 con 0x7f5588155b60 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 >> v1:172.21.15.26:6789/0 conn(0x7f5588155b60 legacy=0x7f55880b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f5570003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5570004810 0x7f5570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f55700051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588156990 con 0x7f5570003a90 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557000bb60 con 0x7f5570004810 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557000bd20 con 0x7f5588155f30 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f5570003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f55877fe700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5570004810 0x7f5570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f558cbc8700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f55700051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 -- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 msgr2=0x7f55700051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5588155f30 0x7f55700051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 -- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5570004810 msgr2=0x7f5570004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5570004810 0x7f5570004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f5587fff700 1 -- 172.21.15.26:0/399358406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570003570 con 0x7f5570003a90 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.812+0000 7f55877fe700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5570004810 0x7f5570004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f5587fff700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f5570003ea0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f557800c3c0 tx=0x7f5578001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7d87e064d49900 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800cc90 con 0x7f5570003a90 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557800cdf0 con 0x7f5570003a90 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f5586ffd700 1 -- 172.21.15.26:0/399358406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578005b70 con 0x7f5570003a90 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 -- 172.21.15.26:0/399358406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 msgr2=0x7f5570003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 --2- 172.21.15.26:0/399358406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f5570003ea0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f557800c3c0 tx=0x7f5578001e50 comp rx=0 tx=0).stop 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558cbc8700 1 -- 172.21.15.26:0/399358406 reap_dead start 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 -- 172.21.15.26:0/399358406 shutdown_connections 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 -- 172.21.15.26:0/399358406 >> 172.21.15.26:0/399358406 conn(0x7f558806d170 msgr2=0x7f55880cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 -- 172.21.15.26:0/399358406 shutdown_connections 2023-10-09T11:43:22.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.813+0000 7f558e62b700 1 -- 172.21.15.26:0/399358406 wait complete. 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.814+0000 7f558e62b700 1 Processor -- start 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 -- start start 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558814f2a0 0x7f55880c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55880c5af0 0x7f55880c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881495b0 con 0x7f5570003a90 2023-10-09T11:43:22.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558814f740 con 0x7f558814f2a0 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558e62b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558814fa20 con 0x7f55880c5af0 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f5587fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f5587fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36360/0 (socket says 172.21.15.26:36360) 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f5587fff700 1 -- 172.21.15.26:0/3656831929 learned_addr learned my addr 172.21.15.26:0/3656831929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f55877fe700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558814f2a0 0x7f55880c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.815+0000 7f558cbc8700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55880c5af0 0x7f55880c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 -- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55880c5af0 msgr2=0x7f55880c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55880c5af0 0x7f55880c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 -- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558814f2a0 msgr2=0x7f55880c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558814f2a0 0x7f55880c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 -- 172.21.15.26:0/3656831929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558814fd00 con 0x7f5570003a90 2023-10-09T11:43:22.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f5587fff700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f5578001e90 tx=0x7f5578015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780070d0 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578007290 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5588140690 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578007650 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.816+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55880c6710 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.817+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5588140b30 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.817+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5578019070 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.818+0000 7f556ffff700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 0x7f55740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.818+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5578086450 con 0x7f5570003a90 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.818+0000 7f55877fe700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 0x7f55740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:22.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.819+0000 7f55877fe700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 0x7f55740697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f557c006dc0 tx=0x7f557c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:22.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:22.822+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55780530e0 con 0x7f5570003a90 2023-10-09T11:43:23.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.016+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5588140ce0 con 0x7f5570003a90 2023-10-09T11:43:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.016+0000 7f556ffff700 1 -- 172.21.15.26:0/3656831929 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5578056700 con 0x7f5570003a90 2023-10-09T11:43:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 msgr2=0x7f55740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 0x7f55740697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f557c006dc0 tx=0x7f557c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 msgr2=0x7f558814ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f5578001e90 tx=0x7f5578015000 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 shutdown_connections 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5574067320 0x7f55740697d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55880c5af0 0x7f55880c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5570003a90 0x7f558814ed60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 --2- 172.21.15.26:0/3656831929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558814f2a0 0x7f55880c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 >> 172.21.15.26:0/3656831929 conn(0x7f558806d170 msgr2=0x7f558806adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 shutdown_connections 2023-10-09T11:43:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.018+0000 7f558e62b700 1 -- 172.21.15.26:0/3656831929 wait complete. 2023-10-09T11:43:23.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000439590 2023-10-09T11:43:23.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.186+0000 7f5d9abd4700 1 Processor -- start 2023-10-09T11:43:23.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.186+0000 7f5d9abd4700 1 -- start start 2023-10-09T11:43:23.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d9abd4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d94159530 0x7f5d940ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d9abd4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d9406e0e0 0x7f5d940cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d9abd4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940ccfd0 con 0x7f5d9406dc70 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d9abd4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940cf0e0 con 0x7f5d94159530 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d9abd4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9415a3d0 con 0x7f5d9406e0e0 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d94159530 0x7f5d940ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d93fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5d9406dc70 0x7f5d94159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35282/0 (socket says 172.21.15.26:35282) 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d93fff700 1 -- 172.21.15.26:0/489982738 learned_addr learned my addr 172.21.15.26:0/489982738 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d99171700 1 --2- 172.21.15.26:0/489982738 >> v2:172.21.15.67:3300/0 conn(0x7f5d9406e0e0 0x7f5d940cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 -- 172.21.15.26:0/489982738 >> v2:172.21.15.67:3300/0 conn(0x7f5d9406e0e0 msgr2=0x7f5d940cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 --2- 172.21.15.26:0/489982738 >> v2:172.21.15.67:3300/0 conn(0x7f5d9406e0e0 0x7f5d940cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 -- 172.21.15.26:0/489982738 >> v1:172.21.15.26:6789/0 conn(0x7f5d9406dc70 legacy=0x7f5d94159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 -- 172.21.15.26:0/489982738 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9415a6b0 con 0x7f5d94159530 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d937fe700 1 -- 172.21.15.26:0/489982738 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761392767 0 0) 0x7f5d940ccfd0 con 0x7f5d9406dc70 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.187+0000 7f5d98970700 1 --2- 172.21.15.26:0/489982738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d94159530 0x7f5d940ceba0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5d940caef0 tx=0x7f5d880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49777b7d60edbaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d937fe700 1 -- 172.21.15.26:0/489982738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800b6b0 con 0x7f5d94159530 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d937fe700 1 -- 172.21.15.26:0/489982738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800b810 con 0x7f5d94159530 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d937fe700 1 -- 172.21.15.26:0/489982738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800bbb0 con 0x7f5d94159530 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 -- 172.21.15.26:0/489982738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d94159530 msgr2=0x7f5d940ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 --2- 172.21.15.26:0/489982738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d94159530 0x7f5d940ceba0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5d940caef0 tx=0x7f5d880091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 -- 172.21.15.26:0/489982738 shutdown_connections 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 --2- 172.21.15.26:0/489982738 >> v2:172.21.15.67:3300/0 conn(0x7f5d9406e0e0 0x7f5d940cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 --2- 172.21.15.26:0/489982738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d94159530 0x7f5d940ceba0 secure :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5d940caef0 tx=0x7f5d880091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 -- 172.21.15.26:0/489982738 >> 172.21.15.26:0/489982738 conn(0x7f5d940703a0 msgr2=0x7f5d940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:23.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 -- 172.21.15.26:0/489982738 shutdown_connections 2023-10-09T11:43:23.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.188+0000 7f5d9abd4700 1 -- 172.21.15.26:0/489982738 wait complete. 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.189+0000 7f5d9abd4700 1 Processor -- start 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 -- start start 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d9406dc70 0x7f5d941423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d9406e0e0 0x7f5d940d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d940d0910 0x7f5d940c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415e190 con 0x7f5d9406e0e0 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940d0d90 con 0x7f5d940d0910 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d9abd4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c8fb0 con 0x7f5d9406dc70 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d9406e0e0 0x7f5d940d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d9406e0e0 0x7f5d940d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36384/0 (socket says 172.21.15.26:36384) 2023-10-09T11:43:23.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.190+0000 7f5d93fff700 1 -- 172.21.15.26:0/1800596195 learned_addr learned my addr 172.21.15.26:0/1800596195 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d99171700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d940d0910 0x7f5d940c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d98970700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d9406dc70 0x7f5d941423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 -- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d9406dc70 msgr2=0x7f5d941423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d9406dc70 0x7f5d941423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 -- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d940d0910 msgr2=0x7f5d940c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d940d0910 0x7f5d940c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 -- 172.21.15.26:0/1800596195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88009420 con 0x7f5d9406e0e0 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d99171700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d940d0910 0x7f5d940c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d98970700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d9406dc70 0x7f5d941423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d93fff700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d9406e0e0 0x7f5d940d03d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c810 tx=0x7f5d80007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80005b30 con 0x7f5d9406e0e0 2023-10-09T11:43:23.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80005c90 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d9abd4700 1 -- 172.21.15.26:0/1800596195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d940c83a0 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800072e0 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.191+0000 7f5d9abd4700 1 -- 172.21.15.26:0/1800596195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940c8960 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.192+0000 7f5d9abd4700 1 -- 172.21.15.26:0/1800596195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9404c3c0 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.193+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5d80007690 con 0x7f5d9406e0e0 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.193+0000 7f5d90ff9700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d78067320 0x7f5d780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.193+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d80084040 con 0x7f5d9406e0e0 2023-10-09T11:43:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.193+0000 7f5d98970700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d78067320 0x7f5d780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.194+0000 7f5d98970700 1 --2- 172.21.15.26:0/1800596195 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d78067320 0x7f5d780697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5d940d1730 tx=0x7f5d88017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.197+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d8004b5a0 con 0x7f5d9406e0e0 2023-10-09T11:43:23.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.420+0000 7f5d9abd4700 1 -- 172.21.15.26:0/1800596195 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000439590", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d940c90f0 con 0x7f5d78067320 2023-10-09T11:43:23.423 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:43:23.422+0000 7f48c13c6700 -1 mgr.server reply reply (1) Operation not permitted WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-09T11:43:23.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.422+0000 7f5d90ff9700 1 -- 172.21.15.26:0/1800596195 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: -1 WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue.) v1 ==== 283+0+0 (secure 0 0 0) 0x7f5d940c90f0 con 0x7f5d78067320 2023-10-09T11:43:23.425 INFO:teuthology.orchestra.run.smithi026.stderr:Error EPERM: WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-09T11:43:23.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:43:23.428 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:43:23.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:23.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:23.506 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:43:23.506 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:43:23.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:43:23.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:23.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:43:23.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:23.549 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:43:23.605 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:43:23.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:43:23.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:23.643 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:43:23.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:23.643 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:43:23.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 Processor -- start 2023-10-09T11:43:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 -- start start 2023-10-09T11:43:23.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef180aca30 0x7fef18069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806b740 con 0x7fef180ad960 2023-10-09T11:43:23.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806b2b0 con 0x7fef180ace00 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.818+0000 7fef1ea43700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef18157bc0 con 0x7fef180aca30 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef1cfe0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef180ad960 0x7fef18157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35286/0 (socket says 172.21.15.26:35286) 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef1cfe0700 1 -- 172.21.15.26:0/3028121590 learned_addr learned my addr 172.21.15.26:0/3028121590 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef17fff700 1 --2- 172.21.15.26:0/3028121590 >> v2:172.21.15.67:3300/0 conn(0x7fef180aca30 0x7fef18069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430645765 0 0) 0x7fef10001490 con 0x7fef180ad960 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef04003570 con 0x7fef180ad960 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272445187 0 0) 0x7fef1806b2b0 con 0x7fef180ace00 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef10001490 con 0x7fef180ace00 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698979223 0 0) 0x7fef04003570 con 0x7fef180ad960 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 >> v2:172.21.15.67:3300/0 conn(0x7fef180aca30 msgr2=0x7fef18069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 --2- 172.21.15.26:0/3028121590 >> v2:172.21.15.67:3300/0 conn(0x7fef180aca30 0x7fef18069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 >> v1:172.21.15.67:6789/0 conn(0x7fef180ace00 legacy=0x7fef180ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1806a6a0 con 0x7fef180ad960 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fef10001980 con 0x7fef180ad960 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 >> v1:172.21.15.26:6789/0 conn(0x7fef180ad960 legacy=0x7fef18157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 0x7fef04004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04004810 0x7fef04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef04005210 0x7fef0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18157bc0 con 0x7fef04003c40 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04014910 con 0x7fef04005210 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef04014ad0 con 0x7fef04004810 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.819+0000 7fef17fff700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 0x7fef04004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef1cfe0700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef04005210 0x7fef0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef177fe700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04004810 0x7fef04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 -- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04004810 msgr2=0x7fef04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04004810 0x7fef04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 -- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef04005210 msgr2=0x7fef0400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef04005210 0x7fef0400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef1cfe0700 1 -- 172.21.15.26:0/3028121590 reap_dead start 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 -- 172.21.15.26:0/3028121590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04003570 con 0x7fef04003c40 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef17fff700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 0x7fef04004030 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c00 tx=0x7fef000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18a836133476057 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000e710 con 0x7fef04003c40 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0000e870 con 0x7fef04003c40 2023-10-09T11:43:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.820+0000 7fef16ffd700 1 -- 172.21.15.26:0/3028121590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000ec30 con 0x7fef04003c40 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 -- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 msgr2=0x7fef04004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 0x7fef04004030 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c00 tx=0x7fef000091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 -- 172.21.15.26:0/3028121590 shutdown_connections 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 --2- 172.21.15.26:0/3028121590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef04003c40 0x7fef04004030 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 -- 172.21.15.26:0/3028121590 >> 172.21.15.26:0/3028121590 conn(0x7fef1806d120 msgr2=0x7fef180cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 -- 172.21.15.26:0/3028121590 shutdown_connections 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.821+0000 7fef1ea43700 1 -- 172.21.15.26:0/3028121590 wait complete. 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.822+0000 7fef1ea43700 1 Processor -- start 2023-10-09T11:43:23.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.822+0000 7fef1ea43700 1 -- start start 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04003c40 0x7fef18150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef180ca1a0 0x7fef180ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18150d70 con 0x7fef180a5540 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180a7310 con 0x7fef180ca1a0 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180cab50 con 0x7fef04003c40 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36406/0 (socket says 172.21.15.26:36406) 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 -- 172.21.15.26:0/694939616 learned_addr learned my addr 172.21.15.26:0/694939616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef17fff700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04003c40 0x7fef18150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef177fe700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef180ca1a0 0x7fef180ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 -- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04003c40 msgr2=0x7fef18150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04003c40 0x7fef18150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 -- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef180ca1a0 msgr2=0x7fef180ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef180ca1a0 0x7fef180ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 -- 172.21.15.26:0/694939616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180a6e80 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1cfe0700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fef10002250 tx=0x7fef1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000aa20 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1000aba0 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef180a6270 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100133f0 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.823+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef180a6830 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.824+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180a7010 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.825+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fef10013820 con 0x7fef180a5540 2023-10-09T11:43:23.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.825+0000 7fef0ffff700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 0x7feef80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:23.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.825+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef10085080 con 0x7fef180a5540 2023-10-09T11:43:23.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.825+0000 7fef17fff700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 0x7feef80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:23.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.826+0000 7fef17fff700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 0x7feef80697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef0000a010 tx=0x7fef0001a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:23.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:23.829+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef10051d10 con 0x7fef180a5540 2023-10-09T11:43:24.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.067+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef1804c3c0 con 0x7fef180a5540 2023-10-09T11:43:24.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.067+0000 7fef0ffff700 1 -- 172.21.15.26:0/694939616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fef10055330 con 0x7fef180a5540 2023-10-09T11:43:24.069 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 msgr2=0x7feef80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 0x7feef80697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef0000a010 tx=0x7fef0001a000 comp rx=0 tx=0).stop 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 msgr2=0x7fef180a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fef10002250 tx=0x7fef1000a060 comp rx=0 tx=0).stop 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 shutdown_connections 2023-10-09T11:43:24.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef180a5540 0x7fef180a59b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feef8067320 0x7feef80697d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef04003c40 0x7fef18150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 --2- 172.21.15.26:0/694939616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef180ca1a0 0x7fef180ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.069+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 >> 172.21.15.26:0/694939616 conn(0x7fef1806d120 msgr2=0x7fef180b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.070+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 shutdown_connections 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.070+0000 7fef1ea43700 1 -- 172.21.15.26:0/694939616 wait complete. 2023-10-09T11:43:24.072 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 102 2023-10-09T11:43:24.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.200+0000 7fd17c2b6700 1 Processor -- start 2023-10-09T11:43:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.200+0000 7fd17c2b6700 1 -- start start 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17c2b6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17c2b6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17415ae40 con 0x7fd1740cb5a0 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17c2b6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17415ab60 con 0x7fd1740cb970 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17c2b6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ce0f0 con 0x7fd17415a5d0 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17a052700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd1740cb5a0 0x7fd1740cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35296/0 (socket says 172.21.15.26:35296) 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17a052700 1 -- 172.21.15.26:0/3130018559 learned_addr learned my addr 172.21.15.26:0/3130018559 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441544715 0 0) 0x7fd17415ae40 con 0x7fd1740cb5a0 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd17a853700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.201+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd15c003570 con 0x7fd1740cb5a0 2023-10-09T11:43:24.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567422043 0 0) 0x7fd15c003570 con 0x7fd1740cb5a0 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 msgr2=0x7fd174156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd174156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 >> v1:172.21.15.67:6789/0 conn(0x7fd1740cb970 legacy=0x7fd174159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740ccf00 con 0x7fd1740cb5a0 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd1640017f0 con 0x7fd1740cb5a0 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 >> v1:172.21.15.26:6789/0 conn(0x7fd1740cb5a0 legacy=0x7fd1740cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd15c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd15c004010 0x7fd15c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15c004d50 0x7fd15c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ce0f0 con 0x7fd15c004010 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c00bbf0 con 0x7fd15c004d50 2023-10-09T11:43:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c00bdb0 con 0x7fd17415a5d0 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd15c004010 0x7fd15c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd17a853700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15c004d50 0x7fd15c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd17a052700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd15c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 -- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 msgr2=0x7fd15c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd17415a5d0 0x7fd15c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 -- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15c004d50 msgr2=0x7fd15c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15c004d50 0x7fd15c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 -- 172.21.15.26:0/3130018559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c003570 con 0x7fd15c004010 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.202+0000 7fd179851700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd15c004010 0x7fd15c004810 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd168001880 tx=0x7fd168007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea26109529839e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168012420 con 0x7fd15c004010 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd168012580 con 0x7fd15c004010 2023-10-09T11:43:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd179050700 1 -- 172.21.15.26:0/3130018559 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168012920 con 0x7fd15c004010 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 -- 172.21.15.26:0/3130018559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd15c004010 msgr2=0x7fd15c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/3130018559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd15c004010 0x7fd15c004810 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd168001880 tx=0x7fd168007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17a853700 1 -- 172.21.15.26:0/3130018559 reap_dead start 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 -- 172.21.15.26:0/3130018559 shutdown_connections 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 -- 172.21.15.26:0/3130018559 >> 172.21.15.26:0/3130018559 conn(0x7fd174070e30 msgr2=0x7fd1740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 -- 172.21.15.26:0/3130018559 shutdown_connections 2023-10-09T11:43:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.203+0000 7fd17c2b6700 1 -- 172.21.15.26:0/3130018559 wait complete. 2023-10-09T11:43:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.204+0000 7fd17c2b6700 1 Processor -- start 2023-10-09T11:43:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.204+0000 7fd17c2b6700 1 -- start start 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 0x7fd174154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1740c77c0 0x7fd1740c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c7370 con 0x7fd1740c6990 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd174158080 con 0x7fd1740c77c0 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17c2b6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c8b00 con 0x7fd15c004010 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36432/0 (socket says 172.21.15.26:36432) 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 -- 172.21.15.26:0/1036832288 learned_addr learned my addr 172.21.15.26:0/1036832288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd179851700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1740c77c0 0x7fd1740c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a052700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 0x7fd174154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 -- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 msgr2=0x7fd174154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 0x7fd174154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 -- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1740c77c0 msgr2=0x7fd1740c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1740c77c0 0x7fd1740c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a853700 1 -- 172.21.15.26:0/1036832288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740c8260 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.205+0000 7fd17a052700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 0x7fd174154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd17a853700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd16c006f00 tx=0x7fd16c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00f830 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c00f990 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740c8540 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00fd30 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.206+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1741582b0 con 0x7fd1740c6990 2023-10-09T11:43:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.207+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1741584d0 con 0x7fd1740c6990 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.207+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd16c014650 con 0x7fd1740c6990 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.208+0000 7fd1727fc700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.208+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd16c085280 con 0x7fd1740c6990 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.208+0000 7fd17a052700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.208+0000 7fd17a052700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 0x7fd1600697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd164001920 tx=0x7fd164006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.212+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd16c051f90 con 0x7fd1740c6990 2023-10-09T11:43:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.405+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd17404c3c0 con 0x7fd1740c6990 2023-10-09T11:43:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.406+0000 7fd1727fc700 1 -- 172.21.15.26:0/1036832288 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fd16c0555b0 con 0x7fd1740c6990 2023-10-09T11:43:24.408 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:24.408 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":153,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:14.265321+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:24.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 msgr2=0x7fd1600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 0x7fd1600697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd164001920 tx=0x7fd164006040 comp rx=0 tx=0).stop 2023-10-09T11:43:24.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 msgr2=0x7fd1740c6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd16c006f00 tx=0x7fd16c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 shutdown_connections 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1740c6990 0x7fd1740c6e30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd160067320 0x7fd1600697d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd15c004010 0x7fd174154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 --2- 172.21.15.26:0/1036832288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1740c77c0 0x7fd1740c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.408+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 >> 172.21.15.26:0/1036832288 conn(0x7fd174070e30 msgr2=0x7fd1740b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.409+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 shutdown_connections 2023-10-09T11:43:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.409+0000 7fd17c2b6700 1 -- 172.21.15.26:0/1036832288 wait complete. 2023-10-09T11:43:24.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:43:11.074096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:43:11.630780+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:43:24.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:43:24.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.543+0000 7f7e091a0700 1 Processor -- start 2023-10-09T11:43:24.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.543+0000 7f7e091a0700 1 -- start start 2023-10-09T11:43:24.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e091a0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e0406d250 0x7f7e040aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e091a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e040ceac0 0x7f7e040af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e091a0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e040ac840 con 0x7f7e04157420 2023-10-09T11:43:24.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e091a0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040abf50 con 0x7f7e0406d250 2023-10-09T11:43:24.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e091a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e040aea60 con 0x7f7e040ceac0 2023-10-09T11:43:24.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e037fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e0406d250 0x7f7e040aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e03fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7e04157420 0x7f7e040b13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:39628/0 (socket says 172.21.15.26:39628) 2023-10-09T11:43:24.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e03fff700 1 -- 172.21.15.26:0/238443690 learned_addr learned my addr 172.21.15.26:0/238443690 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:24.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e0899f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e040ceac0 0x7f7e040af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e037fe700 1 -- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e040ceac0 msgr2=0x7f7e040af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e037fe700 1 --2- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e040ceac0 0x7f7e040af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e037fe700 1 -- 172.21.15.26:0/238443690 >> v1:172.21.15.67:6789/0 conn(0x7f7e04157420 legacy=0x7f7e040b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.544+0000 7f7e037fe700 1 -- 172.21.15.26:0/238443690 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040ac1f0 con 0x7f7e0406d250 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e037fe700 1 --2- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e0406d250 0x7f7e040aefa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7df80098e0 tx=0x7f7df80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26233d438e89ea6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e02ffd700 1 -- 172.21.15.26:0/238443690 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800b640 con 0x7f7e0406d250 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e02ffd700 1 -- 172.21.15.26:0/238443690 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800b7a0 con 0x7f7e0406d250 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e02ffd700 1 -- 172.21.15.26:0/238443690 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800bb40 con 0x7f7e0406d250 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 -- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e0406d250 msgr2=0x7f7e040aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 --2- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e0406d250 0x7f7e040aefa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7df80098e0 tx=0x7f7df80091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 -- 172.21.15.26:0/238443690 shutdown_connections 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 --2- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e040ceac0 0x7f7e040af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 --2- 172.21.15.26:0/238443690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e0406d250 0x7f7e040aefa0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 -- 172.21.15.26:0/238443690 >> 172.21.15.26:0/238443690 conn(0x7f7e0406ce80 msgr2=0x7f7e040ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 -- 172.21.15.26:0/238443690 shutdown_connections 2023-10-09T11:43:24.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.545+0000 7f7e091a0700 1 -- 172.21.15.26:0/238443690 wait complete. 2023-10-09T11:43:24.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.546+0000 7f7e091a0700 1 Processor -- start 2023-10-09T11:43:24.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 -- start start 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0406d250 0x7f7e0416dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e040ceac0 0x7f7e04098d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0409a220 con 0x7f7e04157420 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04099610 con 0x7f7e040ceac0 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e091a0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e040998f0 con 0x7f7e0406d250 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e0899f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e0899f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36448/0 (socket says 172.21.15.26:36448) 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e0899f700 1 -- 172.21.15.26:0/1495962838 learned_addr learned my addr 172.21.15.26:0/1495962838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e03fff700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0406d250 0x7f7e0416dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.547+0000 7f7e037fe700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e040ceac0 0x7f7e04098d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 -- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0406d250 msgr2=0x7f7e0416dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0406d250 0x7f7e0416dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 -- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e040ceac0 msgr2=0x7f7e04098d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e040ceac0 0x7f7e04098d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 -- 172.21.15.26:0/1495962838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009420 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e0899f700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009e90 tx=0x7f7dfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00cb70 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00f040 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e04099bd0 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc014480 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.548+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e04099270 con 0x7f7e04157420 2023-10-09T11:43:24.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.549+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0404c3c0 con 0x7f7e04157420 2023-10-09T11:43:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.550+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7dfc014830 con 0x7f7e04157420 2023-10-09T11:43:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.550+0000 7f7debfff700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 0x7f7df00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.550+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dfc085800 con 0x7f7e04157420 2023-10-09T11:43:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.550+0000 7f7e03fff700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 0x7f7df00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.551+0000 7f7e03fff700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 0x7f7df00697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7df4004fc0 tx=0x7f7df4007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.555+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dfc052380 con 0x7f7e04157420 2023-10-09T11:43:24.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.745+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e040ac4d0 con 0x7f7e04157420 2023-10-09T11:43:24.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.746+0000 7f7debfff700 1 -- 172.21.15.26:0/1495962838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dfc0559a0 con 0x7f7e04157420 2023-10-09T11:43:24.747 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 msgr2=0x7f7df00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 0x7f7df00697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7df4004fc0 tx=0x7f7df4007eb0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 msgr2=0x7f7e040691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009e90 tx=0x7f7dfc00b040 comp rx=0 tx=0).stop 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 shutdown_connections 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e04157420 0x7f7e040691e0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7df0067320 0x7f7df00697d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e0406d250 0x7f7e0416dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 --2- 172.21.15.26:0/1495962838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e040ceac0 0x7f7e04098d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 >> 172.21.15.26:0/1495962838 conn(0x7f7e0406ce80 msgr2=0x7f7e040cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 shutdown_connections 2023-10-09T11:43:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.748+0000 7f7e091a0700 1 -- 172.21.15.26:0/1495962838 wait complete. 2023-10-09T11:43:24.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:43:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.881+0000 7f03e4c62700 1 Processor -- start 2023-10-09T11:43:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.881+0000 7f03e4c62700 1 -- start start 2023-10-09T11:43:24.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e006dc70 0x7f03e0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 0x7f03e00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00ccfd0 con 0x7f03e006dc70 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00cf0e0 con 0x7f03e006e0e0 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.882+0000 7f03e4c62700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015a3d0 con 0x7f03e0159530 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e006dc70 0x7f03e0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e006dc70 0x7f03e0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36464/0 (socket says 172.21.15.26:36464) 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 -- 172.21.15.26:0/3406081527 learned_addr learned my addr 172.21.15.26:0/3406081527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03de59c700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ded9d700 1 --2- 172.21.15.26:0/3406081527 >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 0x7f03e00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 -- 172.21.15.26:0/3406081527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 msgr2=0x7f03e00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 -- 172.21.15.26:0/3406081527 >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 msgr2=0x7f03e00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/3406081527 >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 0x7f03e00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 -- 172.21.15.26:0/3406081527 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e015a6b0 con 0x7f03e006dc70 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ded9d700 1 --2- 172.21.15.26:0/3406081527 >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 0x7f03e00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e0159900 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f03e0089880 tx=0x7f03c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7290737f08dd1d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03dd59a700 1 -- 172.21.15.26:0/3406081527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800b860 con 0x7f03e006dc70 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03dd59a700 1 -- 172.21.15.26:0/3406081527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800b9c0 con 0x7f03e006dc70 2023-10-09T11:43:24.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.883+0000 7f03dd59a700 1 -- 172.21.15.26:0/3406081527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800bd60 con 0x7f03e006dc70 2023-10-09T11:43:24.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 -- 172.21.15.26:0/3406081527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 msgr2=0x7f03e0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e0159900 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f03e0089880 tx=0x7f03c8009250 comp rx=0 tx=0).stop 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 -- 172.21.15.26:0/3406081527 shutdown_connections 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 --2- 172.21.15.26:0/3406081527 >> v2:172.21.15.67:3300/0 conn(0x7f03e006e0e0 0x7f03e00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 --2- 172.21.15.26:0/3406081527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e0159900 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 -- 172.21.15.26:0/3406081527 >> 172.21.15.26:0/3406081527 conn(0x7f03e00703a0 msgr2=0x7f03e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 -- 172.21.15.26:0/3406081527 shutdown_connections 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.884+0000 7f03e4c62700 1 -- 172.21.15.26:0/3406081527 wait complete. 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.885+0000 7f03e4c62700 1 Processor -- start 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.885+0000 7f03e4c62700 1 -- start start 2023-10-09T11:43:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 0x7f03e00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015c440 con 0x7f03e006dc70 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e016a3d0 con 0x7f03e006e0e0 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03e4c62700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015c650 con 0x7f03e0159530 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36476/0 (socket says 172.21.15.26:36476) 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 -- 172.21.15.26:0/2834092635 learned_addr learned my addr 172.21.15.26:0/2834092635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 0x7f03e00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 -- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 msgr2=0x7f03e00cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 -- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 msgr2=0x7f03e00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 0x7f03e00cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 -- 172.21.15.26:0/2834092635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80094f0 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 0x7f03e00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03de59c700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009fa0 tx=0x7f03d0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.886+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000ed20 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.887+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000ee80 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.887+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e0169aa0 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.887+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0014670 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.887+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e016a060 con 0x7f03e006dc70 2023-10-09T11:43:24.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.888+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e004c3c0 con 0x7f03e006dc70 2023-10-09T11:43:24.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.888+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f03d00149e0 con 0x7f03e006dc70 2023-10-09T11:43:24.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.888+0000 7f03d67fc700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 0x7f03c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:24.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.889+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03d0085420 con 0x7f03e006dc70 2023-10-09T11:43:24.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.889+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 0x7f03c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:24.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.889+0000 7f03ddd9b700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 0x7f03c00697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f03e0089880 tx=0x7f03c8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:24.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:24.893+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03d00520b0 con 0x7f03e006dc70 2023-10-09T11:43:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.083+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03e015a990 con 0x7f03e006dc70 2023-10-09T11:43:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.084+0000 7f03d67fc700 1 -- 172.21.15.26:0/2834092635 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03d00556d0 con 0x7f03e006dc70 2023-10-09T11:43:25.085 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:43:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.085+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 msgr2=0x7f03c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.085+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 0x7f03c00697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f03e0089880 tx=0x7f03c8017000 comp rx=0 tx=0).stop 2023-10-09T11:43:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.085+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 msgr2=0x7f03e015bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.085+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009fa0 tx=0x7f03d0009880 comp rx=0 tx=0).stop 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 shutdown_connections 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f03c0067320 0x7f03c00697d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03e0159530 0x7f03e00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e006dc70 0x7f03e015bf00 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 --2- 172.21.15.26:0/2834092635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e006e0e0 0x7f03e00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 >> 172.21.15.26:0/2834092635 conn(0x7f03e00703a0 msgr2=0x7f03e0155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 shutdown_connections 2023-10-09T11:43:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.086+0000 7f03e4c62700 1 -- 172.21.15.26:0/2834092635 wait complete. 2023-10-09T11:43:25.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:43:25.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.219+0000 7f6b57870700 1 Processor -- start 2023-10-09T11:43:25.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b57870700 1 -- start start 2023-10-09T11:43:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b57870700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 0x7f6b500ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b57870700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b500c32a0 con 0x7f6b500ca2c0 2023-10-09T11:43:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b57870700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b500c4100 con 0x7f6b500cd2b0 2023-10-09T11:43:25.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b57870700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500c9730 con 0x7f6b50157930 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b54e0b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b500ca2c0 0x7f6b500ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35312/0 (socket says 172.21.15.26:35312) 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.220+0000 7f6b54e0b700 1 -- 172.21.15.26:0/319239222 learned_addr learned my addr 172.21.15.26:0/319239222 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b5560c700 1 --2- 172.21.15.26:0/319239222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 0x7f6b500ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329920686 0 0) 0x7f6b500c32a0 con 0x7f6b500ca2c0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b38003570 con 0x7f6b500ca2c0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837731806 0 0) 0x7f6b500c4100 con 0x7f6b500cd2b0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b500c32a0 con 0x7f6b500cd2b0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b5560c700 1 -- 172.21.15.26:0/319239222 >> v1:172.21.15.67:6789/0 conn(0x7f6b500cd2b0 legacy=0x7f6b500c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b5560c700 1 -- 172.21.15.26:0/319239222 >> v1:172.21.15.26:6789/0 conn(0x7f6b500ca2c0 legacy=0x7f6b500ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b5560c700 1 -- 172.21.15.26:0/319239222 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500c34f0 con 0x7f6b50157930 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b5560c700 1 --2- 172.21.15.26:0/319239222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 0x7f6b500ab070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009e90 tx=0x7f6b40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd19d1389f8a18c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000e070 con 0x7f6b50157930 2023-10-09T11:43:25.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000bb80 con 0x7f6b50157930 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.221+0000 7f6b4ffff700 1 -- 172.21.15.26:0/319239222 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40012430 con 0x7f6b50157930 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 -- 172.21.15.26:0/319239222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 msgr2=0x7f6b500ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 --2- 172.21.15.26:0/319239222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 0x7f6b500ab070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009e90 tx=0x7f6b40009780 comp rx=0 tx=0).stop 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 -- 172.21.15.26:0/319239222 shutdown_connections 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 --2- 172.21.15.26:0/319239222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b50157930 0x7f6b500ab070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 -- 172.21.15.26:0/319239222 >> 172.21.15.26:0/319239222 conn(0x7f6b50088000 msgr2=0x7f6b500883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 -- 172.21.15.26:0/319239222 shutdown_connections 2023-10-09T11:43:25.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.222+0000 7f6b57870700 1 -- 172.21.15.26:0/319239222 wait complete. 2023-10-09T11:43:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.223+0000 7f6b57870700 1 Processor -- start 2023-10-09T11:43:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.223+0000 7f6b57870700 1 -- start start 2023-10-09T11:43:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b500ca2c0 0x7f6b5006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 0x7f6b50153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5006d7b0 con 0x7f6b50157930 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5006e610 con 0x7f6b500cd2b0 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b57870700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5006efe0 con 0x7f6b500ca2c0 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36480/0 (socket says 172.21.15.26:36480) 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 -- 172.21.15.26:0/1327418126 learned_addr learned my addr 172.21.15.26:0/1327418126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b54e0b700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 0x7f6b50153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b5560c700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b500ca2c0 0x7f6b5006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 -- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b500ca2c0 msgr2=0x7f6b5006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b500ca2c0 0x7f6b5006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 -- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 msgr2=0x7f6b50153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 0x7f6b50153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b55e0d700 1 -- 172.21.15.26:0/1327418126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40009a20 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.224+0000 7f6b54e0b700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 0x7f6b50153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b55e0d700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c590 tx=0x7f6b48007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011590 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b480116f0 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5006da00 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011a90 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.225+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5006dfc0 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.226+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5004c3c0 con 0x7f6b50157930 2023-10-09T11:43:25.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.226+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b4801c460 con 0x7f6b50157930 2023-10-09T11:43:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.226+0000 7f6b4d7fa700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 0x7f6b3c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.227+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b48084a30 con 0x7f6b50157930 2023-10-09T11:43:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.227+0000 7f6b5560c700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 0x7f6b3c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.227+0000 7f6b5560c700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 0x7f6b3c069800 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097c0 tx=0x7f6b40019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.231+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b480516c0 con 0x7f6b50157930 2023-10-09T11:43:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.425+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b500cca70 con 0x7f6b50157930 2023-10-09T11:43:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.426+0000 7f6b4d7fa700 1 -- 172.21.15.26:0/1327418126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b48054ce0 con 0x7f6b50157930 2023-10-09T11:43:25.427 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:43:25.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 msgr2=0x7f6b3c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 0x7f6b3c069800 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097c0 tx=0x7f6b40019000 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 msgr2=0x7f6b500ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c590 tx=0x7f6b48007d50 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 shutdown_connections 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b50157930 0x7f6b500ae300 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6b3c067350 0x7f6b3c069800 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b500ca2c0 0x7f6b5006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 --2- 172.21.15.26:0/1327418126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b500cd2b0 0x7f6b50153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 >> 172.21.15.26:0/1327418126 conn(0x7f6b50088000 msgr2=0x7f6b50155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 shutdown_connections 2023-10-09T11:43:25.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.428+0000 7f6b57870700 1 -- 172.21.15.26:0/1327418126 wait complete. 2023-10-09T11:43:25.441 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:25.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.561+0000 7fd21db22700 1 Processor -- start 2023-10-09T11:43:25.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.561+0000 7fd21db22700 1 -- start start 2023-10-09T11:43:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.561+0000 7fd21db22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd21815a5d0 0x7fd218156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.561+0000 7fd21db22700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21815ae40 con 0x7fd2180cb5a0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd21db22700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21815ab60 con 0x7fd2180cb970 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd21db22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180ce0f0 con 0x7fd21815a5d0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd217fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd21815a5d0 0x7fd218156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2177fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2180cb5a0 0x7fd2180cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35328/0 (socket says 172.21.15.26:35328) 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2177fe700 1 -- 172.21.15.26:0/3557955017 learned_addr learned my addr 172.21.15.26:0/3557955017 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd217fff700 1 -- 172.21.15.26:0/3557955017 >> v1:172.21.15.67:6789/0 conn(0x7fd2180cb970 legacy=0x7fd218159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd217fff700 1 -- 172.21.15.26:0/3557955017 >> v1:172.21.15.26:6789/0 conn(0x7fd2180cb5a0 legacy=0x7fd2180cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd217fff700 1 -- 172.21.15.26:0/3557955017 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180ccf00 con 0x7fd21815a5d0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2167fc700 1 -- 172.21.15.26:0/3557955017 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007745402 0 0) 0x7fd21815ae40 con 0x7fd2180cb5a0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd217fff700 1 --2- 172.21.15.26:0/3557955017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21815a5d0 0x7fd218156e90 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd210009e60 tx=0x7fd210009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70ee0d4675c737a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2167fc700 1 -- 172.21.15.26:0/3557955017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000e070 con 0x7fd21815a5d0 2023-10-09T11:43:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2167fc700 1 -- 172.21.15.26:0/3557955017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21000bc30 con 0x7fd21815a5d0 2023-10-09T11:43:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.562+0000 7fd2167fc700 1 -- 172.21.15.26:0/3557955017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210012430 con 0x7fd21815a5d0 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 -- 172.21.15.26:0/3557955017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21815a5d0 msgr2=0x7fd218156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 --2- 172.21.15.26:0/3557955017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21815a5d0 0x7fd218156e90 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd210009e60 tx=0x7fd210009780 comp rx=0 tx=0).stop 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 -- 172.21.15.26:0/3557955017 shutdown_connections 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 --2- 172.21.15.26:0/3557955017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd21815a5d0 0x7fd218156e90 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 -- 172.21.15.26:0/3557955017 >> 172.21.15.26:0/3557955017 conn(0x7fd218070e30 msgr2=0x7fd2180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 -- 172.21.15.26:0/3557955017 shutdown_connections 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.563+0000 7fd21db22700 1 -- 172.21.15.26:0/3557955017 wait complete. 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.564+0000 7fd21db22700 1 Processor -- start 2023-10-09T11:43:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.564+0000 7fd21db22700 1 -- start start 2023-10-09T11:43:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 0x7fd2180c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd21815a5d0 0x7fd2180b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180b6190 con 0x7fd2180cb970 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815cd50 con 0x7fd2180cb5a0 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd21db22700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815d030 con 0x7fd21815a5d0 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36504/0 (socket says 172.21.15.26:36504) 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 -- 172.21.15.26:0/1377911608 learned_addr learned my addr 172.21.15.26:0/1377911608 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd217fff700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd21815a5d0 0x7fd2180b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd2177fe700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 0x7fd2180c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 -- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd21815a5d0 msgr2=0x7fd2180b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd21815a5d0 0x7fd2180b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 -- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 msgr2=0x7fd2180c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 0x7fd2180c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd216ffd700 1 -- 172.21.15.26:0/1377911608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009a20 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.565+0000 7fd2177fe700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 0x7fd2180c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd216ffd700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c590 tx=0x7fd20c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011590 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0116f0 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21815d310 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011ab0 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.566+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21815d8d0 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.567+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180c80c0 con 0x7fd2180cb970 2023-10-09T11:43:25.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.567+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd20c01b3b0 con 0x7fd2180cb970 2023-10-09T11:43:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.567+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 0x7fd2040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.568+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd20c084220 con 0x7fd2180cb970 2023-10-09T11:43:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.568+0000 7fd2177fe700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 0x7fd2040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.568+0000 7fd2177fe700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 0x7fd2040697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd2080011e0 tx=0x7fd208009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.572+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2180c80c0 con 0x7fd2180cb970 2023-10-09T11:43:25.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.808+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2180c80c0 con 0x7fd2180cb970 2023-10-09T11:43:25.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.808+0000 7fd1ff7fe700 1 -- 172.21.15.26:0/1377911608 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7fd2180c80c0 con 0x7fd2180cb970 2023-10-09T11:43:25.810 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:25.810 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 msgr2=0x7fd2040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 0x7fd2040697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd2080011e0 tx=0x7fd208009040 comp rx=0 tx=0).stop 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 msgr2=0x7fd2180b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c590 tx=0x7fd20c00c950 comp rx=0 tx=0).stop 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 shutdown_connections 2023-10-09T11:43:25.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd204067320 0x7fd2040697d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd21815a5d0 0x7fd2180b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cb5a0 0x7fd2180c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 --2- 172.21.15.26:0/1377911608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2180cb970 0x7fd2180b5710 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.810+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 >> 172.21.15.26:0/1377911608 conn(0x7fd218070e30 msgr2=0x7fd2180b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.811+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 shutdown_connections 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.811+0000 7fd21db22700 1 -- 172.21.15.26:0/1377911608 wait complete. 2023-10-09T11:43:25.813 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 102 2023-10-09T11:43:25.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:25.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.941+0000 7f9a1b32c700 1 Processor -- start 2023-10-09T11:43:25.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.941+0000 7f9a1b32c700 1 -- start start 2023-10-09T11:43:25.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a1b32c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a140cb970 0x7f9a14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a1b32c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a14156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a1b32c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1415ae40 con 0x7f9a140cb5a0 2023-10-09T11:43:25.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a1b32c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140ce0f0 con 0x7f9a140cb970 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a1b32c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140d13f0 con 0x7f9a1415a400 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a188c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a140cb970 0x7f9a14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a190c8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a140cb5a0 0x7f9a140cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35338/0 (socket says 172.21.15.26:35338) 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.942+0000 7f9a190c8700 1 -- 172.21.15.26:0/3798124764 learned_addr learned my addr 172.21.15.26:0/3798124764 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a198c9700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a14156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a188c7700 1 -- 172.21.15.26:0/3798124764 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 msgr2=0x7f9a14156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a188c7700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a14156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a188c7700 1 -- 172.21.15.26:0/3798124764 >> v1:172.21.15.26:6789/0 conn(0x7f9a140cb5a0 legacy=0x7f9a140cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a13fff700 1 -- 172.21.15.26:0/3798124764 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318312668 0 0) 0x7f9a1415ae40 con 0x7f9a140cb5a0 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a188c7700 1 -- 172.21.15.26:0/3798124764 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1415ab60 con 0x7f9a140cb970 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a188c7700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb970 0x7f9a14159ec0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d3a36e8a05ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a13fff700 1 -- 172.21.15.26:0/3798124764 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08009e80 con 0x7f9a140cb970 2023-10-09T11:43:25.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a13fff700 1 -- 172.21.15.26:0/3798124764 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800b860 con 0x7f9a140cb970 2023-10-09T11:43:25.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a13fff700 1 -- 172.21.15.26:0/3798124764 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800bbe0 con 0x7f9a140cb970 2023-10-09T11:43:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 -- 172.21.15.26:0/3798124764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb970 msgr2=0x7f9a14159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb970 0x7f9a14159ec0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 -- 172.21.15.26:0/3798124764 shutdown_connections 2023-10-09T11:43:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a14156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/3798124764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb970 0x7f9a14159ec0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.943+0000 7f9a1b32c700 1 -- 172.21.15.26:0/3798124764 >> 172.21.15.26:0/3798124764 conn(0x7f9a14070e30 msgr2=0x7f9a140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.944+0000 7f9a1b32c700 1 -- 172.21.15.26:0/3798124764 shutdown_connections 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.944+0000 7f9a1b32c700 1 -- 172.21.15.26:0/3798124764 wait complete. 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.945+0000 7f9a1b32c700 1 Processor -- start 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.945+0000 7f9a1b32c700 1 -- start start 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.945+0000 7f9a1b32c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.945+0000 7f9a1b32c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 0x7f9a14155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a1416ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141555e0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140c88c0 con 0x7f9a140cb970 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141546f0 con 0x7f9a1415a400 2023-10-09T11:43:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36518/0 (socket says 172.21.15.26:36518) 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 -- 172.21.15.26:0/1514136412 learned_addr learned my addr 172.21.15.26:0/1514136412 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a198c9700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a1416ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a188c7700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 0x7f9a14155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 -- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 msgr2=0x7f9a1416ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a1416ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 -- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 msgr2=0x7f9a14155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 0x7f9a14155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 -- 172.21.15.26:0/1514136412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009420 con 0x7f9a140cb5a0 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a198c9700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a1416ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a188c7700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 0x7f9a14155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a190c8700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400cd80 tx=0x7f9a04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400ab10 con 0x7f9a140cb5a0 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400ac70 con 0x7f9a140cb5a0 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a141549d0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040070f0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.946+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a14154f90 con 0x7f9a140cb5a0 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.947+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1404c3c0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.948+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9a040074e0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.948+0000 7f9a117fa700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 0x7f9a000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.949+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a040851e0 con 0x7f9a140cb5a0 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.949+0000 7f9a188c7700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 0x7f9a000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.949+0000 7f9a188c7700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 0x7f9a000697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9a080091e0 tx=0x7f9a08017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:25.953+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a04051eb0 con 0x7f9a140cb5a0 2023-10-09T11:43:26.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.148+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a1406ca30 con 0x7f9a140cb5a0 2023-10-09T11:43:26.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.149+0000 7f9a117fa700 1 -- 172.21.15.26:0/1514136412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f9a040554d0 con 0x7f9a140cb5a0 2023-10-09T11:43:26.150 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":153,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:14.265321+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 msgr2=0x7f9a000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 0x7f9a000697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9a080091e0 tx=0x7f9a08017000 comp rx=0 tx=0).stop 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 msgr2=0x7f9a140c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400cd80 tx=0x7f9a04001ae0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 shutdown_connections 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9a00067320 0x7f9a000697d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a1415a400 0x7f9a1416ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a140cb5a0 0x7f9a140c8380 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 --2- 172.21.15.26:0/1514136412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a140cb970 0x7f9a14155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 >> 172.21.15.26:0/1514136412 conn(0x7f9a14070e30 msgr2=0x7f9a140b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 shutdown_connections 2023-10-09T11:43:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.151+0000 7f9a1b32c700 1 -- 172.21.15.26:0/1514136412 wait complete. 2023-10-09T11:43:26.165 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:43:26.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.283+0000 7f16a2d61700 1 Processor -- start 2023-10-09T11:43:26.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.283+0000 7f16a2d61700 1 -- start start 2023-10-09T11:43:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.283+0000 7f16a2d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f169c1595d0 0x7f169c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a2d61700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c0675a0 0x7f169c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a2d61700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0c7f50 con 0x7f169c06b230 2023-10-09T11:43:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a2d61700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c06bd00 con 0x7f169c1595d0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a2d61700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c06b740 con 0x7f169c0675a0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f169c1595d0 0x7f169c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f169c1595d0 0x7f169c1599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36530/0 (socket says 172.21.15.26:36530) 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 -- 172.21.15.26:0/1480345469 learned_addr learned my addr 172.21.15.26:0/1480345469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f169bfff700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c0675a0 0x7f169c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 -- 172.21.15.26:0/1480345469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c0675a0 msgr2=0x7f169c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c0675a0 0x7f169c06acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 -- 172.21.15.26:0/1480345469 >> v1:172.21.15.67:6789/0 conn(0x7f169c06b230 legacy=0x7f169c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 -- 172.21.15.26:0/1480345469 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06ba20 con 0x7f169c1595d0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f16a0afd700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c1595d0 0x7f169c1599a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f16840099b0 tx=0x7f1684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c5dd38b96adcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f169b7fe700 1 -- 172.21.15.26:0/1480345469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400b860 con 0x7f169c1595d0 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f169b7fe700 1 -- 172.21.15.26:0/1480345469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400b9c0 con 0x7f169c1595d0 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.284+0000 7f169b7fe700 1 -- 172.21.15.26:0/1480345469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400bd60 con 0x7f169c1595d0 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 -- 172.21.15.26:0/1480345469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c1595d0 msgr2=0x7f169c1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c1595d0 0x7f169c1599a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f16840099b0 tx=0x7f1684009250 comp rx=0 tx=0).stop 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 -- 172.21.15.26:0/1480345469 shutdown_connections 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c1595d0 0x7f169c1599a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1480345469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c0675a0 0x7f169c06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 -- 172.21.15.26:0/1480345469 >> 172.21.15.26:0/1480345469 conn(0x7f169c0cd400 msgr2=0x7f169c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 -- 172.21.15.26:0/1480345469 shutdown_connections 2023-10-09T11:43:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.285+0000 7f16a2d61700 1 -- 172.21.15.26:0/1480345469 wait complete. 2023-10-09T11:43:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.286+0000 7f16a2d61700 1 Processor -- start 2023-10-09T11:43:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.286+0000 7f16a2d61700 1 -- start start 2023-10-09T11:43:26.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c0675a0 0x7f169c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c1595d0 0x7f169c14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15ddf0 con 0x7f169c06b230 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15d530 con 0x7f169c0675a0 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a2d61700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15d7a0 con 0x7f169c1595d0 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36536/0 (socket says 172.21.15.26:36536) 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 -- 172.21.15.26:0/1663151606 learned_addr learned my addr 172.21.15.26:0/1663151606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a0afd700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c0675a0 0x7f169c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f16a12fe700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c1595d0 0x7f169c14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 -- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c1595d0 msgr2=0x7f169c14a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c1595d0 0x7f169c14a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 -- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c0675a0 msgr2=0x7f169c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c0675a0 0x7f169c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.287+0000 7f169bfff700 1 -- 172.21.15.26:0/1663151606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840094f0 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f169bfff700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f168c00e1c0 tx=0x7f168c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00ee60 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c014420 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c15da80 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0147e0 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.288+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c0b1780 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.289+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c15dfa0 con 0x7f169c06b230 2023-10-09T11:43:26.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.289+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f168c014b90 con 0x7f169c06b230 2023-10-09T11:43:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.290+0000 7f1698ff9700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 0x7f167c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.290+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f168c085490 con 0x7f169c06b230 2023-10-09T11:43:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.290+0000 7f16a0afd700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 0x7f167c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.290+0000 7f16a0afd700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 0x7f167c0697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f16840099b0 tx=0x7f1684017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.294+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f169c15dfa0 con 0x7f169c06b230 2023-10-09T11:43:26.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:26.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.536+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f169c15dfa0 con 0x7f169c06b230 2023-10-09T11:43:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.537+0000 7f1698ff9700 1 -- 172.21.15.26:0/1663151606 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7f169c15dfa0 con 0x7f169c06b230 2023-10-09T11:43:26.538 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:26.538 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:26.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 msgr2=0x7f167c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 0x7f167c0697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f16840099b0 tx=0x7f1684017000 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 msgr2=0x7f169c0b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f168c00e1c0 tx=0x7f168c009920 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 shutdown_connections 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f167c067320 0x7f167c0697d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f169c1595d0 0x7f169c14a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f169c0675a0 0x7f169c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 --2- 172.21.15.26:0/1663151606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f169c06b230 0x7f169c0b1240 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 >> 172.21.15.26:0/1663151606 conn(0x7f169c0cd400 msgr2=0x7f169c1588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 shutdown_connections 2023-10-09T11:43:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.539+0000 7f16a2d61700 1 -- 172.21.15.26:0/1663151606 wait complete. 2023-10-09T11:43:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 102 2023-10-09T11:43:26.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:26.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.670+0000 7effb7d62700 1 Processor -- start 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.670+0000 7effb7d62700 1 -- start start 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb7d62700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb7d62700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 0x7effb0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb7d62700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb015ae40 con 0x7effb00cb5a0 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb7d62700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00ce0f0 con 0x7effb015a400 2023-10-09T11:43:26.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb7d62700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00cbde0 con 0x7effb00cb970 2023-10-09T11:43:26.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb52fd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb62ff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 0x7effb0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb52fd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:39148/0 (socket says 172.21.15.26:39148) 2023-10-09T11:43:26.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.671+0000 7effb52fd700 1 -- 172.21.15.26:0/3361909176 learned_addr learned my addr 172.21.15.26:0/3361909176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb52fd700 1 -- 172.21.15.26:0/3361909176 >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 msgr2=0x7effb0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb52fd700 1 --2- 172.21.15.26:0/3361909176 >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 0x7effb0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb52fd700 1 -- 172.21.15.26:0/3361909176 >> v1:172.21.15.67:6789/0 conn(0x7effb00cb5a0 legacy=0x7effb00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb52fd700 1 -- 172.21.15.26:0/3361909176 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb015ab60 con 0x7effb00cb970 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb62ff700 1 --2- 172.21.15.26:0/3361909176 >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 0x7effb0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb52fd700 1 --2- 172.21.15.26:0/3361909176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effa40099b0 tx=0x7effa4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1f710f55f26107 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb4afc700 1 -- 172.21.15.26:0/3361909176 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4009ea0 con 0x7effb00cb970 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb4afc700 1 -- 172.21.15.26:0/3361909176 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400b860 con 0x7effb00cb970 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.672+0000 7effb4afc700 1 -- 172.21.15.26:0/3361909176 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400bc00 con 0x7effb00cb970 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 -- 172.21.15.26:0/3361909176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 msgr2=0x7effb0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 --2- 172.21.15.26:0/3361909176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effa40099b0 tx=0x7effa4009250 comp rx=0 tx=0).stop 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 -- 172.21.15.26:0/3361909176 shutdown_connections 2023-10-09T11:43:26.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 --2- 172.21.15.26:0/3361909176 >> v2:172.21.15.67:3300/0 conn(0x7effb015a400 0x7effb0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 --2- 172.21.15.26:0/3361909176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb00cb970 0x7effb0159ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 -- 172.21.15.26:0/3361909176 >> 172.21.15.26:0/3361909176 conn(0x7effb0070e30 msgr2=0x7effb00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 -- 172.21.15.26:0/3361909176 shutdown_connections 2023-10-09T11:43:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.673+0000 7effb7d62700 1 -- 172.21.15.26:0/3361909176 wait complete. 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.674+0000 7effb7d62700 1 Processor -- start 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.674+0000 7effb7d62700 1 -- start start 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb00cb970 0x7effb01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb015a400 0x7effb0157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0152470 con 0x7effb00cb5a0 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01517f0 con 0x7effb00cb970 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb7d62700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb0151ad0 con 0x7effb015a400 2023-10-09T11:43:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36550/0 (socket says 172.21.15.26:36550) 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 -- 172.21.15.26:0/2361152657 learned_addr learned my addr 172.21.15.26:0/2361152657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb62ff700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb015a400 0x7effb0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb52fd700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb00cb970 0x7effb01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 -- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb015a400 msgr2=0x7effb0157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb015a400 0x7effb0157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 -- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb00cb970 msgr2=0x7effb01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb00cb970 0x7effb01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 -- 172.21.15.26:0/2361152657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009420 con 0x7effb00cb5a0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effb5afe700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7effa000c910 tx=0x7effa00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012630 con 0x7effb00cb5a0 2023-10-09T11:43:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.675+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0012790 con 0x7effb00cb5a0 2023-10-09T11:43:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.676+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa40094f0 con 0x7effb00cb5a0 2023-10-09T11:43:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.676+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012b50 con 0x7effb00cb5a0 2023-10-09T11:43:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.676+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb0152090 con 0x7effb00cb5a0 2023-10-09T11:43:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.677+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb01525b0 con 0x7effb00cb5a0 2023-10-09T11:43:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.677+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7effa0003030 con 0x7effb00cb5a0 2023-10-09T11:43:26.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.677+0000 7effadffb700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 0x7eff9c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:26.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.677+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effa0084b50 con 0x7effb00cb5a0 2023-10-09T11:43:26.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.678+0000 7effb52fd700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 0x7eff9c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:26.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.678+0000 7effb52fd700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 0x7eff9c0697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7effa4009290 tx=0x7effa4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:26.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.682+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effb01525b0 con 0x7effb00cb5a0 2023-10-09T11:43:26.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.918+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effb01525b0 con 0x7effb00cb5a0 2023-10-09T11:43:26.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.918+0000 7effadffb700 1 -- 172.21.15.26:0/2361152657 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4600 (secure 0 0 0) 0x7effb01525b0 con 0x7effb00cb5a0 2023-10-09T11:43:26.920 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:26.920 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":102,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:12.664683+0000","modified":"2023-10-09T11:43:16.278142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"d","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/3007773785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3007773785},{"type":"v1","addr":"172.21.15.67:6836","nonce":3007773785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 msgr2=0x7eff9c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 0x7eff9c0697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7effa4009290 tx=0x7effa4017000 comp rx=0 tx=0).stop 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 msgr2=0x7effb0150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7effa000c910 tx=0x7effa00016b0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 shutdown_connections 2023-10-09T11:43:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff9c067320 0x7eff9c0697d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7effb015a400 0x7effb0157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb00cb5a0 0x7effb0150560 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 --2- 172.21.15.26:0/2361152657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb00cb970 0x7effb01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 >> 172.21.15.26:0/2361152657 conn(0x7effb0070e30 msgr2=0x7effb00c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.920+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 shutdown_connections 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:26.921+0000 7effb7d62700 1 -- 172.21.15.26:0/2361152657 wait complete. 2023-10-09T11:43:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 102 2023-10-09T11:43:26.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:27.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.051+0000 7f2b0ef09700 1 Processor -- start 2023-10-09T11:43:27.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.051+0000 7f2b0ef09700 1 -- start start 2023-10-09T11:43:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0ef09700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b080cb5a0 0x7f2b080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0ef09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b080cd9e0 0x7f2b08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0ef09700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0815ae40 con 0x7f2b0815a400 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0ef09700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080d13f0 con 0x7f2b080cd9e0 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0ef09700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0815ab60 con 0x7f2b080cb5a0 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b080cd9e0 0x7f2b08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b080cd9e0 0x7f2b08159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36560/0 (socket says 172.21.15.26:36560) 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 -- 172.21.15.26:0/3847375657 learned_addr learned my addr 172.21.15.26:0/3847375657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b0cca5700 1 --2- 172.21.15.26:0/3847375657 >> v2:172.21.15.67:3300/0 conn(0x7f2b080cb5a0 0x7f2b080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 -- 172.21.15.26:0/3847375657 >> v2:172.21.15.67:3300/0 conn(0x7f2b080cb5a0 msgr2=0x7f2b080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 --2- 172.21.15.26:0/3847375657 >> v2:172.21.15.67:3300/0 conn(0x7f2b080cb5a0 0x7f2b080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 -- 172.21.15.26:0/3847375657 >> v1:172.21.15.67:6789/0 conn(0x7f2b0815a400 legacy=0x7f2b08156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 -- 172.21.15.26:0/3847375657 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080ccf00 con 0x7f2b080cd9e0 2023-10-09T11:43:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b07fff700 1 --2- 172.21.15.26:0/3847375657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cd9e0 0x7f2b08159ec0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0099b0 tx=0x7f2afc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994f01263e6f716e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b077fe700 1 -- 172.21.15.26:0/3847375657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00b820 con 0x7f2b080cd9e0 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.052+0000 7f2b077fe700 1 -- 172.21.15.26:0/3847375657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc00b980 con 0x7f2b080cd9e0 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b077fe700 1 -- 172.21.15.26:0/3847375657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00bd20 con 0x7f2b080cd9e0 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 -- 172.21.15.26:0/3847375657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cd9e0 msgr2=0x7f2b08159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/3847375657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cd9e0 0x7f2b08159ec0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0099b0 tx=0x7f2afc009250 comp rx=0 tx=0).stop 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 -- 172.21.15.26:0/3847375657 shutdown_connections 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/3847375657 >> v2:172.21.15.67:3300/0 conn(0x7f2b080cb5a0 0x7f2b080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/3847375657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cd9e0 0x7f2b08159ec0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 -- 172.21.15.26:0/3847375657 >> 172.21.15.26:0/3847375657 conn(0x7f2b08070e30 msgr2=0x7f2b080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 -- 172.21.15.26:0/3847375657 shutdown_connections 2023-10-09T11:43:27.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.053+0000 7f2b0ef09700 1 -- 172.21.15.26:0/3847375657 wait complete. 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.054+0000 7f2b0ef09700 1 Processor -- start 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.054+0000 7f2b0ef09700 1 -- start start 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b080cd9e0 0x7f2b08153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0815a400 0x7f2b08156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08169e50 con 0x7f2b080cb5a0 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0816a0e0 con 0x7f2b080cd9e0 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0ef09700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0815a090 con 0x7f2b0815a400 2023-10-09T11:43:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0cca5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0cca5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36562/0 (socket says 172.21.15.26:36562) 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0cca5700 1 -- 172.21.15.26:0/1815802184 learned_addr learned my addr 172.21.15.26:0/1815802184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b07fff700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b080cd9e0 0x7f2b08153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0d4a6700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0815a400 0x7f2b08156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.055+0000 7f2b0cca5700 1 -- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0815a400 msgr2=0x7f2b08156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0cca5700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0815a400 0x7f2b08156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0cca5700 1 -- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b080cd9e0 msgr2=0x7f2b08153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0cca5700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b080cd9e0 0x7f2b08153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0cca5700 1 -- 172.21.15.26:0/1815802184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0094f0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0cca5700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f2af800e190 tx=0x7f2af8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800ecd0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800ee30 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0816e3e0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8014650 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.056+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0816de20 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.057+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0816a3c0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.057+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2af80149c0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.058+0000 7f2b04ff9700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 0x7f2af40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.058+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2af8085320 con 0x7f2b080cb5a0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.058+0000 7f2b07fff700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 0x7f2af40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.058+0000 7f2b07fff700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 0x7f2af40697d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0099b0 tx=0x7f2afc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.062+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2af8051fb0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.253+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0804c3c0 con 0x7f2b080cb5a0 2023-10-09T11:43:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.254+0000 7f2b04ff9700 1 -- 172.21.15.26:0/1815802184 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f2af8009a60 con 0x7f2b080cb5a0 2023-10-09T11:43:27.255 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:27.256 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":153,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:14.265321+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:11.074096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:11.630780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 msgr2=0x7f2af40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 0x7f2af40697d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0099b0 tx=0x7f2afc017000 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 msgr2=0x7f2b0816d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f2af800e190 tx=0x7f2af8009920 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 shutdown_connections 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2af4067320 0x7f2af40697d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0815a400 0x7f2b08156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b080cb5a0 0x7f2b0816d4b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 --2- 172.21.15.26:0/1815802184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b080cd9e0 0x7f2b08153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 >> 172.21.15.26:0/1815802184 conn(0x7f2b08070e30 msgr2=0x7f2b080cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 shutdown_connections 2023-10-09T11:43:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.256+0000 7f2b0ef09700 1 -- 172.21.15.26:0/1815802184 wait complete. 2023-10-09T11:43:27.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:43:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.387+0000 7f33278f3700 1 Processor -- start 2023-10-09T11:43:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f33278f3700 1 -- start start 2023-10-09T11:43:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f33278f3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33200a90d0 0x7f332006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f33278f3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33200aeee0 con 0x7f33200a8d00 2023-10-09T11:43:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f33278f3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33200cf490 con 0x7f332006e380 2023-10-09T11:43:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f33278f3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332006e820 con 0x7f33200a90d0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f3324e8e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33200a90d0 0x7f332006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f332568f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33200a8d00 0x7f33200cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35348/0 (socket says 172.21.15.26:35348) 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.388+0000 7f332568f700 1 -- 172.21.15.26:0/3707858664 learned_addr learned my addr 172.21.15.26:0/3707858664 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f3324e8e700 1 -- 172.21.15.26:0/3707858664 >> v1:172.21.15.67:6789/0 conn(0x7f332006e380 legacy=0x7f33200af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f3324e8e700 1 -- 172.21.15.26:0/3707858664 >> v1:172.21.15.26:6789/0 conn(0x7f33200a8d00 legacy=0x7f33200cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f3324e8e700 1 -- 172.21.15.26:0/3707858664 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33200cf1b0 con 0x7f33200a90d0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f3324e8e700 1 --2- 172.21.15.26:0/3707858664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f332006de40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3314009900 tx=0x7f3314009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade6ef9e71621ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f331ffff700 1 -- 172.21.15.26:0/3707858664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314009ea0 con 0x7f33200a90d0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f331ffff700 1 -- 172.21.15.26:0/3707858664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314005c10 con 0x7f33200a90d0 2023-10-09T11:43:27.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.389+0000 7f331ffff700 1 -- 172.21.15.26:0/3707858664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400b610 con 0x7f33200a90d0 2023-10-09T11:43:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 -- 172.21.15.26:0/3707858664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 msgr2=0x7f332006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 --2- 172.21.15.26:0/3707858664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f332006de40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3314009900 tx=0x7f3314009120 comp rx=0 tx=0).stop 2023-10-09T11:43:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 -- 172.21.15.26:0/3707858664 shutdown_connections 2023-10-09T11:43:27.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 --2- 172.21.15.26:0/3707858664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f332006de40 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 -- 172.21.15.26:0/3707858664 >> 172.21.15.26:0/3707858664 conn(0x7f332006ce80 msgr2=0x7f33200ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 -- 172.21.15.26:0/3707858664 shutdown_connections 2023-10-09T11:43:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.390+0000 7f33278f3700 1 -- 172.21.15.26:0/3707858664 wait complete. 2023-10-09T11:43:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.391+0000 7f33278f3700 1 Processor -- start 2023-10-09T11:43:27.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.391+0000 7f33278f3700 1 -- start start 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f332006e380 0x7f332009a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33200a8d00 0x7f332009b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332009b5d0 con 0x7f33200a90d0 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332009b7e0 con 0x7f33200a8d00 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f33278f3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332009bac0 con 0x7f332006e380 2023-10-09T11:43:27.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36592/0 (socket says 172.21.15.26:36592) 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 -- 172.21.15.26:0/378232426 learned_addr learned my addr 172.21.15.26:0/378232426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f332568f700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f332006e380 0x7f332009a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 -- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f332006e380 msgr2=0x7f332009a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f332006e380 0x7f332009a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 -- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33200a8d00 msgr2=0x7f332009b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33200a8d00 0x7f332009b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 -- 172.21.15.26:0/378232426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140093c0 con 0x7f33200a90d0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.392+0000 7f3325e90700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f331800c840 tx=0x7f3318001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318012630 con 0x7f33200a90d0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33180127b0 con 0x7f33200a90d0 2023-10-09T11:43:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318012b70 con 0x7f33200a90d0 2023-10-09T11:43:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332009bda0 con 0x7f33200a90d0 2023-10-09T11:43:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332015b230 con 0x7f33200a90d0 2023-10-09T11:43:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.393+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332015b090 con 0x7f33200a90d0 2023-10-09T11:43:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.394+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3318003030 con 0x7f33200a90d0 2023-10-09T11:43:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.394+0000 7f331d7fa700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 0x7f330c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.394+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3318084c30 con 0x7f33200a90d0 2023-10-09T11:43:27.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.395+0000 7f332568f700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 0x7f330c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.395+0000 7f332568f700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 0x7f330c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f33100010e0 tx=0x7f3310009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.399+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f332015b090 con 0x7f33200a90d0 2023-10-09T11:43:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.634+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f332015b090 con 0x7f33200a90d0 2023-10-09T11:43:27.635 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:43:27.634+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:43:27.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.638+0000 7f331d7fa700 1 -- 172.21.15.26:0/378232426 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v103) v1 ==== 161+0+0 (secure 0 0 0) 0x7f332015b090 con 0x7f33200a90d0 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 msgr2=0x7f330c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 0x7f330c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f33100010e0 tx=0x7f3310009040 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 msgr2=0x7f3320157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f331800c840 tx=0x7f3318001670 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 shutdown_connections 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33200a90d0 0x7f3320157890 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f330c067320 0x7f330c0697d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f332006e380 0x7f332009a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 --2- 172.21.15.26:0/378232426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33200a8d00 0x7f332009b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 >> 172.21.15.26:0/378232426 conn(0x7f332006ce80 msgr2=0x7f3320158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 shutdown_connections 2023-10-09T11:43:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.640+0000 7f33278f3700 1 -- 172.21.15.26:0/378232426 wait complete. 2023-10-09T11:43:27.643 INFO:tasks.ceph.mds.d.smithi067.stderr: -627> 2023-10-09T11:43:18.581+0000 7fe0c193a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:27.643 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:43:27.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:43:27.673 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:43:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.775+0000 7f0df7498700 1 Processor -- start 2023-10-09T11:43:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.775+0000 7f0df7498700 1 -- start start 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0df0159550 0x7f0df00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0df015dfd0 0x7f0df00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00acc00 con 0x7f0df0159550 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00abff0 con 0x7f0df015dfd0 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df7498700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00ac2d0 con 0x7f0df0159920 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0df0159550 0x7f0df00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0df0159550 0x7f0df00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36594/0 (socket says 172.21.15.26:36594) 2023-10-09T11:43:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 -- 172.21.15.26:0/2852483295 learned_addr learned my addr 172.21.15.26:0/2852483295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6c97700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df5c95700 1 --2- 172.21.15.26:0/2852483295 >> v2:172.21.15.67:3300/0 conn(0x7f0df015dfd0 0x7f0df00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 -- 172.21.15.26:0/2852483295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 msgr2=0x7f0df00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 -- 172.21.15.26:0/2852483295 >> v2:172.21.15.67:3300/0 conn(0x7f0df015dfd0 msgr2=0x7f0df00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 --2- 172.21.15.26:0/2852483295 >> v2:172.21.15.67:3300/0 conn(0x7f0df015dfd0 0x7f0df00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.776+0000 7f0df6496700 1 -- 172.21.15.26:0/2852483295 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00ac5b0 con 0x7f0df0159550 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df6496700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00ceac0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0df006c180 tx=0x7f0de0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b761244237a54c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df5494700 1 -- 172.21.15.26:0/2852483295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000e070 con 0x7f0df0159550 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df5494700 1 -- 172.21.15.26:0/2852483295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000b970 con 0x7f0df0159550 2023-10-09T11:43:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df5494700 1 -- 172.21.15.26:0/2852483295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00092e0 con 0x7f0df0159550 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 -- 172.21.15.26:0/2852483295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 msgr2=0x7f0df00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00ceac0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0df006c180 tx=0x7f0de0009840 comp rx=0 tx=0).stop 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 -- 172.21.15.26:0/2852483295 shutdown_connections 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 --2- 172.21.15.26:0/2852483295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00ceac0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 --2- 172.21.15.26:0/2852483295 >> v2:172.21.15.67:3300/0 conn(0x7f0df015dfd0 0x7f0df00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 -- 172.21.15.26:0/2852483295 >> 172.21.15.26:0/2852483295 conn(0x7f0df006ce80 msgr2=0x7f0df00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 -- 172.21.15.26:0/2852483295 shutdown_connections 2023-10-09T11:43:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.777+0000 7f0df7498700 1 -- 172.21.15.26:0/2852483295 wait complete. 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.778+0000 7f0df7498700 1 Processor -- start 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 -- start start 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 0x7f0df00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c8780 con 0x7f0df0159550 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01587d0 con 0x7f0df015dfd0 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df7498700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c7b90 con 0x7f0df0159920 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df6496700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df6496700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36610/0 (socket says 172.21.15.26:36610) 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df6496700 1 -- 172.21.15.26:0/1327943322 learned_addr learned my addr 172.21.15.26:0/1327943322 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df5c95700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.779+0000 7f0df6c97700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 0x7f0df00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 -- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 msgr2=0x7f0df0158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df0158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 -- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 msgr2=0x7f0df00b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 0x7f0df00b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 -- 172.21.15.26:0/1327943322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0009ae0 con 0x7f0df0159550 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6c97700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 0x7f0df00b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df6496700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f0df006ad70 tx=0x7f0de0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00088a0 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0008a00 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df00c7e50 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0008dc0 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.780+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00c8410 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.781+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df004c3c0 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.781+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0de0003040 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.782+0000 7f0dee7fc700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 0x7f0ddc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.782+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0de0086340 con 0x7f0df0159550 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.782+0000 7f0df5c95700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 0x7f0ddc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:27.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.782+0000 7f0df5c95700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 0x7f0ddc0697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0df0157c20 tx=0x7f0de40091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:27.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:27.786+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0de0052e30 con 0x7f0df0159550 2023-10-09T11:43:28.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.025+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0df00ceab0 con 0x7f0df0159550 2023-10-09T11:43:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.644+0000 7f0dee7fc700 1 -- 172.21.15.26:0/1327943322 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v104) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0de0056450 con 0x7f0df0159550 2023-10-09T11:43:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.646+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 msgr2=0x7f0ddc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.646+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 0x7f0ddc0697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0df0157c20 tx=0x7f0de40091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.646+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 msgr2=0x7f0df00c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.646+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f0df006ad70 tx=0x7f0de0018000 comp rx=0 tx=0).stop 2023-10-09T11:43:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 shutdown_connections 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0df015dfd0 0x7f0df00b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0df0159550 0x7f0df00c7560 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ddc067320 0x7f0ddc0697d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 --2- 172.21.15.26:0/1327943322 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0df0159920 0x7f0df0158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 >> 172.21.15.26:0/1327943322 conn(0x7f0df006ce80 msgr2=0x7f0df0152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 shutdown_connections 2023-10-09T11:43:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.647+0000 7f0df7498700 1 -- 172.21.15.26:0/1327943322 wait complete. 2023-10-09T11:43:28.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:43:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.792+0000 7f96aef5b700 1 Processor -- start 2023-10-09T11:43:28.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.792+0000 7f96aef5b700 1 -- start start 2023-10-09T11:43:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96aef5b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f96a80cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96aef5b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80cc090 con 0x7f96a8159530 2023-10-09T11:43:28.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96aef5b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80ccfd0 con 0x7f96a806dcf0 2023-10-09T11:43:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96aef5b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815a410 con 0x7f96a80cb6f0 2023-10-09T11:43:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96accf7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96a8159530 0x7f96a80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35358/0 (socket says 172.21.15.26:35358) 2023-10-09T11:43:28.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96accf7700 1 -- 172.21.15.26:0/1112312935 learned_addr learned my addr 172.21.15.26:0/1112312935 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f96a80cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.793+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163845347 0 0) 0x7f9698001110 con 0x7f96a8159530 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9690003570 con 0x7f96a8159530 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805553105 0 0) 0x7f96a80ccfd0 con 0x7f96a806dcf0 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9698001110 con 0x7f96a806dcf0 2023-10-09T11:43:28.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3179743156 0 0) 0x7f9690003570 con 0x7f96a8159530 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 msgr2=0x7f96a80cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f96a80cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 >> v1:172.21.15.67:6789/0 conn(0x7f96a806dcf0 legacy=0x7f96a8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a815a6f0 con 0x7f96a8159530 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f9698001600 con 0x7f96a8159530 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 >> v1:172.21.15.26:6789/0 conn(0x7f96a8159530 legacy=0x7f96a80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9690003c20 0x7f9690004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f9690004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9690004d50 0x7f96900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815a410 con 0x7f9690004d50 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969000bbf0 con 0x7f9690003c20 2023-10-09T11:43:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969000bd60 con 0x7f96a80cb6f0 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9690004d50 0x7f96900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96accf7700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9690003c20 0x7f9690004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96a7fff700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f9690004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 -- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 msgr2=0x7f9690004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80cb6f0 0x7f9690004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 -- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9690003c20 msgr2=0x7f9690004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9690003c20 0x7f9690004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 -- 172.21.15.26:0/1112312935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690003570 con 0x7f9690004d50 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.794+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9690004d50 0x7f96900051c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f96a00094d0 tx=0x7f96a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec429c34e1340acd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000ea90 con 0x7f9690004d50 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000f040 con 0x7f9690004d50 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96a77fe700 1 -- 172.21.15.26:0/1112312935 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000ee20 con 0x7f9690004d50 2023-10-09T11:43:28.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 -- 172.21.15.26:0/1112312935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9690004d50 msgr2=0x7f96900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 --2- 172.21.15.26:0/1112312935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9690004d50 0x7f96900051c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f96a00094d0 tx=0x7f96a000b040 comp rx=0 tx=0).stop 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96ad4f8700 1 -- 172.21.15.26:0/1112312935 reap_dead start 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 -- 172.21.15.26:0/1112312935 shutdown_connections 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 -- 172.21.15.26:0/1112312935 >> 172.21.15.26:0/1112312935 conn(0x7f96a80703a0 msgr2=0x7f96a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 -- 172.21.15.26:0/1112312935 shutdown_connections 2023-10-09T11:43:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.795+0000 7f96aef5b700 1 -- 172.21.15.26:0/1112312935 wait complete. 2023-10-09T11:43:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.796+0000 7f96aef5b700 1 Processor -- start 2023-10-09T11:43:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 -- start start 2023-10-09T11:43:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 0x7f96a815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 0x7f96a815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80c9170 con 0x7f96a80b35a0 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815b1c0 con 0x7f96a80b3f50 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96aef5b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80c9cb0 con 0x7f96a80b6130 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36638/0 (socket says 172.21.15.26:36638) 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.797+0000 7f96a7fff700 1 -- 172.21.15.26:0/212055688 learned_addr learned my addr 172.21.15.26:0/212055688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96accf7700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 0x7f96a815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 0x7f96a815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 -- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 msgr2=0x7f96a815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 0x7f96a815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 -- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 msgr2=0x7f96a815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 0x7f96a815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:28.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 -- 172.21.15.26:0/212055688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80ca140 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96ad4f8700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 0x7f96a815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96accf7700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 0x7f96a815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a7fff700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f969c0010e0 tx=0x7f969c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c013600 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c013780 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a80c9380 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c013b40 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.798+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a80c9940 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.799+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a80c9e20 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.799+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f969c01c400 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.800+0000 7f96a4ff9700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 0x7f96940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.800+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f969c085040 con 0x7f96a80b35a0 2023-10-09T11:43:28.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.800+0000 7f96accf7700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 0x7f96940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:28.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.801+0000 7f96accf7700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 0x7f96940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9698000e10 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:28.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.804+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f969c0b65a0 con 0x7f96a80b35a0 2023-10-09T11:43:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:28.997+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96a804c3c0 con 0x7f96a80b35a0 2023-10-09T11:43:29.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.645+0000 7f96a4ff9700 1 -- 172.21.15.26:0/212055688 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7f969c0170d0 con 0x7f96a80b35a0 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 msgr2=0x7f96940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 0x7f96940697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9698000e10 tx=0x7f9698009040 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 msgr2=0x7f96a80b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f969c0010e0 tx=0x7f969c007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 shutdown_connections 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a80b3f50 0x7f96a815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9694067320 0x7f96940697d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96a80b6130 0x7f96a815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 --2- 172.21.15.26:0/212055688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a80b35a0 0x7f96a80b3a10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 >> 172.21.15.26:0/212055688 conn(0x7f96a80703a0 msgr2=0x7f96a81585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:29.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 shutdown_connections 2023-10-09T11:43:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.647+0000 7f96aef5b700 1 -- 172.21.15.26:0/212055688 wait complete. 2023-10-09T11:43:29.650 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:43:29.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:43:29.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.789+0000 7fb88f59e700 1 Processor -- start 2023-10-09T11:43:29.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.789+0000 7fb88f59e700 1 -- start start 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.790+0000 7fb88f59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb890142ca0 0x7fb89015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.790+0000 7fb88f59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 0x7fb8900cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.790+0000 7fb88f59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89015d8d0 con 0x7fb89015a6f0 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.790+0000 7fb88f59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89015d2f0 con 0x7fb890142ca0 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.790+0000 7fb88f59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cc630 con 0x7fb890143070 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 0x7fb8900cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb890142ca0 0x7fb89015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88ed9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb89015a6f0 0x7fb8900cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:51962/0 (socket says 172.21.15.26:51962) 2023-10-09T11:43:29.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88ed9d700 1 -- 172.21.15.26:0/3532029695 learned_addr learned my addr 172.21.15.26:0/3532029695 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:29.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 0x7fb8900cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:35512/0 (socket says 172.21.15.26:35512) 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 -- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 msgr2=0x7fb8900cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 --2- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 0x7fb8900cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 -- 172.21.15.26:0/3532029695 >> v1:172.21.15.67:6789/0 conn(0x7fb89015a6f0 legacy=0x7fb8900cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 -- 172.21.15.26:0/3532029695 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89015d560 con 0x7fb890142ca0 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.791+0000 7fb88e59c700 1 --2- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89015dd60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e60 tx=0x7fb880009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4fcbe6826820f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88d59a700 1 -- 172.21.15.26:0/3532029695 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000e070 con 0x7fb890142ca0 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88d59a700 1 -- 172.21.15.26:0/3532029695 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88000ba60 con 0x7fb890142ca0 2023-10-09T11:43:29.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88d59a700 1 -- 172.21.15.26:0/3532029695 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000be20 con 0x7fb890142ca0 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 -- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 msgr2=0x7fb89015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 --2- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89015dd60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e60 tx=0x7fb880009780 comp rx=0 tx=0).stop 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 -- 172.21.15.26:0/3532029695 shutdown_connections 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 --2- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89015dd60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 --2- 172.21.15.26:0/3532029695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb890143070 0x7fb8900cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 -- 172.21.15.26:0/3532029695 >> 172.21.15.26:0/3532029695 conn(0x7fb890067c80 msgr2=0x7fb890068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 -- 172.21.15.26:0/3532029695 shutdown_connections 2023-10-09T11:43:29.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.792+0000 7fb88f59e700 1 -- 172.21.15.26:0/3532029695 wait complete. 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.793+0000 7fb88f59e700 1 Processor -- start 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.793+0000 7fb88f59e700 1 -- start start 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89016c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb89015a6f0 0x7fb89015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900ad7b0 con 0x7fb890143070 2023-10-09T11:43:29.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890140930 con 0x7fb890142ca0 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88f59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900aa3b0 con 0x7fb89015a6f0 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47728/0 (socket says 172.21.15.26:47728) 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88dd9b700 1 -- 172.21.15.26:0/770560315 learned_addr learned my addr 172.21.15.26:0/770560315 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88e59c700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89016c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.794+0000 7fb88ed9d700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb89015a6f0 0x7fb89015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 -- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb89015a6f0 msgr2=0x7fb89015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb89015a6f0 0x7fb89015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 -- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 msgr2=0x7fb89016c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89016c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 -- 172.21.15.26:0/770560315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009a20 con 0x7fb890143070 2023-10-09T11:43:29.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88e59c700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89016c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88dd9b700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ec80 tx=0x7fb8780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800c850 con 0x7fb890143070 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800c9d0 con 0x7fb890143070 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8900a9a80 con 0x7fb890143070 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800cd90 con 0x7fb890143070 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.795+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8900aa040 con 0x7fb890143070 2023-10-09T11:43:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.796+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89004c3c0 con 0x7fb890143070 2023-10-09T11:43:29.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.796+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb878013680 con 0x7fb890143070 2023-10-09T11:43:29.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.797+0000 7fb8867fc700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 0x7fb8700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:29.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.797+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fb878084de0 con 0x7fb890143070 2023-10-09T11:43:29.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.797+0000 7fb88e59c700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 0x7fb8700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:29.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.798+0000 7fb88e59c700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 0x7fb8700697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb8800097c0 tx=0x7fb880018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:29.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.801+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb878051bd0 con 0x7fb890143070 2023-10-09T11:43:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:29.993+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb8900aa4f0 con 0x7fb890143070 2023-10-09T11:43:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.646+0000 7fb8867fc700 1 -- 172.21.15.26:0/770560315 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v156) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb8780551f0 con 0x7fb890143070 2023-10-09T11:43:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.650+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 msgr2=0x7fb8700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.650+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 0x7fb8700697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb8800097c0 tx=0x7fb880018000 comp rx=0 tx=0).stop 2023-10-09T11:43:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.650+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 msgr2=0x7fb8901698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.650+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ec80 tx=0x7fb8780091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 shutdown_connections 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb870067320 0x7fb8700697d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb89015a6f0 0x7fb89015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb890142ca0 0x7fb89016c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 --2- 172.21.15.26:0/770560315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb890143070 0x7fb8901698c0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 >> 172.21.15.26:0/770560315 conn(0x7fb890067c80 msgr2=0x7fb8900694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 shutdown_connections 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.651+0000 7fb88f59e700 1 -- 172.21.15.26:0/770560315 wait complete. 2023-10-09T11:43:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:43:30.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:43:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.805+0000 7ff0ee896700 1 Processor -- start 2023-10-09T11:43:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.805+0000 7ff0ee896700 1 -- start start 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0ee896700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0ee896700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80ccfd0 con 0x7ff0e8159530 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0ee896700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e815a3d0 con 0x7ff0e806dc70 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0ee896700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815a6b0 con 0x7ff0e806e0e0 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0e7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0e8159530 0x7ff0e80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49578/0 (socket says 172.21.15.26:49578) 2023-10-09T11:43:30.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.806+0000 7ff0e7fff700 1 -- 172.21.15.26:0/3016761723 learned_addr learned my addr 172.21.15.26:0/3016761723 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0ece33700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543464869 0 0) 0x7ff0e80ccfd0 con 0x7ff0e8159530 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d4003570 con 0x7ff0e8159530 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431620766 0 0) 0x7ff0d4003570 con 0x7ff0e8159530 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 msgr2=0x7ff0e80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0e80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 >> v1:172.21.15.67:6789/0 conn(0x7ff0e806dc70 legacy=0x7ff0e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e815a990 con 0x7ff0e8159530 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7ff0d8001470 con 0x7ff0e8159530 2023-10-09T11:43:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 >> v1:172.21.15.26:6789/0 conn(0x7ff0e8159530 legacy=0x7ff0e80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d4003a90 0x7ff0d4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d4004810 0x7ff0d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0d4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815a6b0 con 0x7ff0d4003a90 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400bc20 con 0x7ff0d4004810 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400bde0 con 0x7ff0e806e0e0 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d4003a90 0x7ff0d4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e77fe700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d4004810 0x7ff0d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0ece33700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0d4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 -- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 msgr2=0x7ff0d4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806e0e0 0x7ff0d4005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 -- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d4004810 msgr2=0x7ff0d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d4004810 0x7ff0d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.807+0000 7ff0e7fff700 1 -- 172.21.15.26:0/3016761723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4003570 con 0x7ff0d4003a90 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d4003a90 0x7ff0d4003ea0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800c2d0 tx=0x7ff0d8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e497796096e93402 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800cba0 con 0x7ff0d4003a90 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800cd20 con 0x7ff0d4003a90 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0e6ffd700 1 -- 172.21.15.26:0/3016761723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8005b70 con 0x7ff0d4003a90 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 -- 172.21.15.26:0/3016761723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d4003a90 msgr2=0x7ff0d4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 --2- 172.21.15.26:0/3016761723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d4003a90 0x7ff0d4003ea0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800c2d0 tx=0x7ff0d8001d80 comp rx=0 tx=0).stop 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ece33700 1 -- 172.21.15.26:0/3016761723 reap_dead start 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 -- 172.21.15.26:0/3016761723 shutdown_connections 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 -- 172.21.15.26:0/3016761723 >> 172.21.15.26:0/3016761723 conn(0x7ff0e80703a0 msgr2=0x7ff0e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 -- 172.21.15.26:0/3016761723 shutdown_connections 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.808+0000 7ff0ee896700 1 -- 172.21.15.26:0/3016761723 wait complete. 2023-10-09T11:43:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.809+0000 7ff0ee896700 1 Processor -- start 2023-10-09T11:43:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 -- start start 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0d4003a90 0x7ff0e8151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 0x7ff0e815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80c97f0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80c7830 con 0x7ff0e80b4930 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ee896700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815df30 con 0x7ff0d4003a90 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ece33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ece33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47746/0 (socket says 172.21.15.26:47746) 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.810+0000 7ff0ece33700 1 -- 172.21.15.26:0/342366120 learned_addr learned my addr 172.21.15.26:0/342366120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0e77fe700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 0x7ff0e815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0d4003a90 0x7ff0e8151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 -- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0d4003a90 msgr2=0x7ff0e8151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0d4003a90 0x7ff0e8151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 -- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 msgr2=0x7ff0e815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 0x7ff0e815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 -- 172.21.15.26:0/342366120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e815e210 con 0x7ff0e80b4da0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0e77fe700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 0x7ff0e815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ece33700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80cf2d0 tx=0x7ff0e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000e070 con 0x7ff0e80b4da0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0011d00 con 0x7ff0e80b4da0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80c7ad0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00166c0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.811+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e81522f0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.812+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e80c7cc0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.813+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff0e0016ab0 con 0x7ff0e80b4da0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.813+0000 7ff0dffff700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 0x7ff0c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.813+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff0e0085550 con 0x7ff0e80b4da0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.813+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 0x7ff0c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.814+0000 7ff0e7fff700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 0x7ff0c80697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000ff0 tx=0x7ff0d8015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:30.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:30.817+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0e00523d0 con 0x7ff0e80b4da0 2023-10-09T11:43:31.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.012+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff0e804c3c0 con 0x7ff0e80b4da0 2023-10-09T11:43:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.015+0000 7ff0dffff700 1 -- 172.21.15.26:0/342366120 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0e00559f0 con 0x7ff0e80b4da0 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 msgr2=0x7ff0c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 0x7ff0c80697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000ff0 tx=0x7ff0d8015000 comp rx=0 tx=0).stop 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 msgr2=0x7ff0e815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80cf2d0 tx=0x7ff0e000b040 comp rx=0 tx=0).stop 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 shutdown_connections 2023-10-09T11:43:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0e80b4da0 0x7ff0e815d900 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff0c8067320 0x7ff0c80697d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0d4003a90 0x7ff0e8151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 --2- 172.21.15.26:0/342366120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e80b4930 0x7ff0e815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.017+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 >> 172.21.15.26:0/342366120 conn(0x7ff0e80703a0 msgr2=0x7ff0e80cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.018+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 shutdown_connections 2023-10-09T11:43:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.018+0000 7ff0ee896700 1 -- 172.21.15.26:0/342366120 wait complete. 2023-10-09T11:43:31.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-09T11:43:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.148+0000 7f045b7c6700 1 Processor -- start 2023-10-09T11:43:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.148+0000 7f045b7c6700 1 -- start start 2023-10-09T11:43:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04540a8d00 0x7f04540cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f04540a90d0 0x7f045406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f045406e380 0x7f04540cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540ae680 con 0x7f04540a90d0 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045406e7f0 con 0x7f04540a8d00 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f045b7c6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540aeee0 con 0x7f045406e380 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f0458d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f04540a90d0 0x7f045406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f0458d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f04540a90d0 0x7f045406de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47760/0 (socket says 172.21.15.26:47760) 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.149+0000 7f0458d61700 1 -- 172.21.15.26:0/666218807 learned_addr learned my addr 172.21.15.26:0/666218807 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0459d63700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f045406e380 0x7f04540cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0459562700 1 --2- 172.21.15.26:0/666218807 >> v2:172.21.15.67:3300/0 conn(0x7f04540a8d00 0x7f04540cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 -- 172.21.15.26:0/666218807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f045406e380 msgr2=0x7f04540cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f045406e380 0x7f04540cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 -- 172.21.15.26:0/666218807 >> v2:172.21.15.67:3300/0 conn(0x7f04540a8d00 msgr2=0x7f04540cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:31.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 --2- 172.21.15.26:0/666218807 >> v2:172.21.15.67:3300/0 conn(0x7f04540a8d00 0x7f04540cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 -- 172.21.15.26:0/666218807 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540cf490 con 0x7f04540a90d0 2023-10-09T11:43:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0458d61700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04540a90d0 0x7f045406de40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0454088a00 tx=0x7f0448009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec1ac0f3f09753f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0453fff700 1 -- 172.21.15.26:0/666218807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448005c10 con 0x7f04540a90d0 2023-10-09T11:43:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0453fff700 1 -- 172.21.15.26:0/666218807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448005d70 con 0x7f04540a90d0 2023-10-09T11:43:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.150+0000 7f0453fff700 1 -- 172.21.15.26:0/666218807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800b880 con 0x7f04540a90d0 2023-10-09T11:43:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 -- 172.21.15.26:0/666218807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04540a90d0 msgr2=0x7f045406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04540a90d0 0x7f045406de40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0454088a00 tx=0x7f0448009220 comp rx=0 tx=0).stop 2023-10-09T11:43:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 -- 172.21.15.26:0/666218807 shutdown_connections 2023-10-09T11:43:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 --2- 172.21.15.26:0/666218807 >> v2:172.21.15.67:3300/0 conn(0x7f04540a8d00 0x7f04540cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f045406e380 0x7f04540cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 --2- 172.21.15.26:0/666218807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04540a90d0 0x7f045406de40 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 -- 172.21.15.26:0/666218807 >> 172.21.15.26:0/666218807 conn(0x7f045406ce80 msgr2=0x7f04540ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 -- 172.21.15.26:0/666218807 shutdown_connections 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.151+0000 7f045b7c6700 1 -- 172.21.15.26:0/666218807 wait complete. 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.152+0000 7f045b7c6700 1 Processor -- start 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.152+0000 7f045b7c6700 1 -- start start 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04540a8d00 0x7f0454148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04540a90d0 0x7f04541485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454148b00 con 0x7f045406e380 2023-10-09T11:43:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045416aad0 con 0x7f04540a8d00 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f045b7c6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045415f8d0 con 0x7f04540a90d0 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47764/0 (socket says 172.21.15.26:47764) 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 -- 172.21.15.26:0/1154485175 learned_addr learned my addr 172.21.15.26:0/1154485175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0458d61700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04540a8d00 0x7f0454148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459d63700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04540a90d0 0x7f04541485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 -- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04540a90d0 msgr2=0x7f04541485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04540a90d0 0x7f04541485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 -- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04540a8d00 msgr2=0x7f0454148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04540a8d00 0x7f0454148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 -- 172.21.15.26:0/1154485175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448009480 con 0x7f045406e380 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f0459562700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f044c00d810 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.153+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0125f0 con 0x7f045406e380 2023-10-09T11:43:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.154+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c012750 con 0x7f045406e380 2023-10-09T11:43:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.154+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045415fbb0 con 0x7f045406e380 2023-10-09T11:43:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.154+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c012af0 con 0x7f045406e380 2023-10-09T11:43:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.154+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454160170 con 0x7f045406e380 2023-10-09T11:43:31.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.154+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045416adb0 con 0x7f045406e380 2023-10-09T11:43:31.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.155+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f044c01e460 con 0x7f045406e380 2023-10-09T11:43:31.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.155+0000 7f04517fa700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 0x7f04400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.155+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f044c085010 con 0x7f045406e380 2023-10-09T11:43:31.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.155+0000 7f0458d61700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 0x7f04400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.156+0000 7f0458d61700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 0x7f04400697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0448009260 tx=0x7f0448016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.159+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f044c051f60 con 0x7f045406e380 2023-10-09T11:43:31.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.433+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f045404c3c0 con 0x7f045406e380 2023-10-09T11:43:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.648+0000 7f04517fa700 1 -- 172.21.15.26:0/1154485175 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v413) v1 ==== 167+0+0 (secure 0 0 0) 0x7f044c055580 con 0x7f045406e380 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 msgr2=0x7f04400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 0x7f04400697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0448009260 tx=0x7f0448016000 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 msgr2=0x7f045409b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f044c00d810 tx=0x7f044c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 shutdown_connections 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0440067320 0x7f04400697d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04540a90d0 0x7f04541485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045406e380 0x7f045409b7c0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 --2- 172.21.15.26:0/1154485175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04540a8d00 0x7f0454148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 >> 172.21.15.26:0/1154485175 conn(0x7f045406ce80 msgr2=0x7f04540b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 shutdown_connections 2023-10-09T11:43:31.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.650+0000 7f045b7c6700 1 -- 172.21.15.26:0/1154485175 wait complete. 2023-10-09T11:43:31.664 INFO:tasks.cephfs_test_runner:That renaming volume fails without --yes-i-really-mean-it flag. ... ok 2023-10-09T11:43:31.664 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) That renaming a volume with more than one data pool does not change 2023-10-09T11:43:31.665 INFO:tasks.cephfs_test_runner:test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:43:31.665 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-09T11:43:31.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.783+0000 7fb4cd825700 1 Processor -- start 2023-10-09T11:43:31.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.783+0000 7fb4cd825700 1 -- start start 2023-10-09T11:43:31.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4cd825700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4c80a8be0 0x7fb4c80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4cd825700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80ce1a0 con 0x7fb4c80aee90 2023-10-09T11:43:31.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4cd825700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80cd5d0 con 0x7fb4c806d280 2023-10-09T11:43:31.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4cd825700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80cd870 con 0x7fb4c80a8be0 2023-10-09T11:43:31.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4c77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4c80aee90 0x7fb4c80b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49594/0 (socket says 172.21.15.26:49594) 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4c77fe700 1 -- 172.21.15.26:0/695512855 learned_addr learned my addr 172.21.15.26:0/695512855 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.784+0000 7fb4c6ffd700 1 --2- 172.21.15.26:0/695512855 >> v2:172.21.15.67:3300/0 conn(0x7fb4c80a8be0 0x7fb4c80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963659652 0 0) 0x7fb4c80ce1a0 con 0x7fb4c80aee90 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b4003570 con 0x7fb4c80aee90 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c6ffd700 1 -- 172.21.15.26:0/695512855 >> v1:172.21.15.67:6789/0 conn(0x7fb4c806d280 legacy=0x7fb4c80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037873809 0 0) 0x7fb4b4003570 con 0x7fb4c80aee90 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c6ffd700 1 -- 172.21.15.26:0/695512855 >> v1:172.21.15.26:6789/0 conn(0x7fb4c80aee90 legacy=0x7fb4c80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c6ffd700 1 -- 172.21.15.26:0/695512855 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80cdb50 con 0x7fb4c80a8be0 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c6ffd700 1 --2- 172.21.15.26:0/695512855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80a8be0 0x7fb4c80a8fb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80098d0 tx=0x7fb4b8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab257bb9a7286cdd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00017f0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8011420 con 0x7fb4c80a8be0 2023-10-09T11:43:31.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.785+0000 7fb4c5ffb700 1 -- 172.21.15.26:0/695512855 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80117c0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 -- 172.21.15.26:0/695512855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80a8be0 msgr2=0x7fb4c80a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 --2- 172.21.15.26:0/695512855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80a8be0 0x7fb4c80a8fb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80098d0 tx=0x7fb4b8009120 comp rx=0 tx=0).stop 2023-10-09T11:43:31.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 -- 172.21.15.26:0/695512855 shutdown_connections 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 --2- 172.21.15.26:0/695512855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80a8be0 0x7fb4c80a8fb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 -- 172.21.15.26:0/695512855 >> 172.21.15.26:0/695512855 conn(0x7fb4c806ce80 msgr2=0x7fb4c80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 -- 172.21.15.26:0/695512855 shutdown_connections 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.786+0000 7fb4cd825700 1 -- 172.21.15.26:0/695512855 wait complete. 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.787+0000 7fb4cd825700 1 Processor -- start 2023-10-09T11:43:31.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.787+0000 7fb4cd825700 1 -- start start 2023-10-09T11:43:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4c806d280 0x7fb4c809ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80aee90 0x7fb4c816bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8099f60 con 0x7fb4c80a8be0 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8098fc0 con 0x7fb4c80aee90 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4cd825700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8157170 con 0x7fb4c806d280 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47778/0 (socket says 172.21.15.26:47778) 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 -- 172.21.15.26:0/150738836 learned_addr learned my addr 172.21.15.26:0/150738836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c77fe700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80aee90 0x7fb4c816bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c6ffd700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4c806d280 0x7fb4c809ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 -- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4c806d280 msgr2=0x7fb4c809ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4c806d280 0x7fb4c809ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 -- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80aee90 msgr2=0x7fb4c816bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80aee90 0x7fb4c816bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 -- 172.21.15.26:0/150738836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80093c0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.788+0000 7fb4c67fc700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001a90 tx=0x7fb4b0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.789+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000a840 con 0x7fb4c80a8be0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.789+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000a9e0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.789+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c8099350 con 0x7fb4c80a8be0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.789+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000ada0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.789+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8099910 con 0x7fb4c80a8be0 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.790+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c804c3c0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.790+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb4b0018610 con 0x7fb4c80a8be0 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.790+0000 7fb4beffd700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 0x7fb4a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.790+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb4b00882d0 con 0x7fb4c80a8be0 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.791+0000 7fb4c6ffd700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 0x7fb4a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:31.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.791+0000 7fb4c6ffd700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 0x7fb4a80697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009160 tx=0x7fb4b8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:31.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:31.795+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4b00505a0 con 0x7fb4c80a8be0 2023-10-09T11:43:32.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.068+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7fb4c8159790 con 0x7fb4c80a8be0 2023-10-09T11:43:32.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.649+0000 7fb4beffd700 1 -- 172.21.15.26:0/150738836 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v414) v1 ==== 166+0+0 (secure 0 0 0) 0x7fb4b0055200 con 0x7fb4c80a8be0 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 msgr2=0x7fb4a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 0x7fb4a80697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009160 tx=0x7fb4b8017000 comp rx=0 tx=0).stop 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 msgr2=0x7fb4c816b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001a90 tx=0x7fb4b0007ea0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 shutdown_connections 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4c80aee90 0x7fb4c816bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb4a8067320 0x7fb4a80697d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4c806d280 0x7fb4c809ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 --2- 172.21.15.26:0/150738836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c80a8be0 0x7fb4c816b890 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 >> 172.21.15.26:0/150738836 conn(0x7fb4c806ce80 msgr2=0x7fb4c80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 shutdown_connections 2023-10-09T11:43:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.651+0000 7fb4cd825700 1 -- 172.21.15.26:0/150738836 wait complete. 2023-10-09T11:43:32.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:43:32.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.789+0000 7f006359e700 1 Processor -- start 2023-10-09T11:43:32.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.789+0000 7f006359e700 1 -- start start 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0064153a00 0x7f0064153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006359e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006415ac50 con 0x7f00640cea00 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006359e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006415d010 con 0x7f006415de50 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006359e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006415af60 con 0x7f0064153a00 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0064153a00 0x7f0064153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0064153a00 0x7f0064153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47788/0 (socket says 172.21.15.26:47788) 2023-10-09T11:43:32.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f0062d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f00640cea00 0x7f00640cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49604/0 (socket says 172.21.15.26:49604) 2023-10-09T11:43:32.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.790+0000 7f006259c700 1 -- 172.21.15.26:0/444892518 learned_addr learned my addr 172.21.15.26:0/444892518 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:32.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006259c700 1 -- 172.21.15.26:0/444892518 >> v1:172.21.15.67:6789/0 conn(0x7f006415de50 legacy=0x7f006415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006259c700 1 -- 172.21.15.26:0/444892518 >> v1:172.21.15.26:6789/0 conn(0x7f00640cea00 legacy=0x7f00640cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006259c700 1 -- 172.21.15.26:0/444892518 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006415b240 con 0x7f0064153a00 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006159a700 1 -- 172.21.15.26:0/444892518 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406696806 0 0) 0x7f006415ac50 con 0x7f00640cea00 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006259c700 1 --2- 172.21.15.26:0/444892518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064153a00 0x7f0064153dd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f0054009f20 tx=0x7f0054009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9c87440a77a513 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006159a700 1 -- 172.21.15.26:0/444892518 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400e070 con 0x7f0064153a00 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006159a700 1 -- 172.21.15.26:0/444892518 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005400ba80 con 0x7f0064153a00 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.791+0000 7f006159a700 1 -- 172.21.15.26:0/444892518 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540092e0 con 0x7f0064153a00 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 -- 172.21.15.26:0/444892518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064153a00 msgr2=0x7f0064153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 --2- 172.21.15.26:0/444892518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064153a00 0x7f0064153dd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f0054009f20 tx=0x7f0054009840 comp rx=0 tx=0).stop 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 -- 172.21.15.26:0/444892518 shutdown_connections 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 --2- 172.21.15.26:0/444892518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0064153a00 0x7f0064153dd0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 -- 172.21.15.26:0/444892518 >> 172.21.15.26:0/444892518 conn(0x7f00640703a0 msgr2=0x7f00640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 -- 172.21.15.26:0/444892518 shutdown_connections 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.792+0000 7f006359e700 1 -- 172.21.15.26:0/444892518 wait complete. 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.793+0000 7f006359e700 1 Processor -- start 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.793+0000 7f006359e700 1 -- start start 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00640cea00 0x7f00640b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0064153a00 0x7f0064152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640c9ff0 con 0x7f006415de50 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640c9d10 con 0x7f00640cea00 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b43b0 con 0x7f0064153a00 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:32.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47804/0 (socket says 172.21.15.26:47804) 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 -- 172.21.15.26:0/1872428983 learned_addr learned my addr 172.21.15.26:0/1872428983 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006259c700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00640cea00 0x7f00640b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0061d9b700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0064153a00 0x7f0064152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 -- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0064153a00 msgr2=0x7f0064152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0064153a00 0x7f0064152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 -- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00640cea00 msgr2=0x7f00640b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00640cea00 0x7f00640b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 -- 172.21.15.26:0/1872428983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054009ae0 con 0x7f006415de50 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f0062d9d700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c530 tx=0x7f005c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c005a70 con 0x7f006415de50 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005bd0 con 0x7f006415de50 2023-10-09T11:43:32.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00640b4690 con 0x7f006415de50 2023-10-09T11:43:32.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0070d0 con 0x7f006415de50 2023-10-09T11:43:32.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.794+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640b40a0 con 0x7f006415de50 2023-10-09T11:43:32.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.795+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640b4bb0 con 0x7f006415de50 2023-10-09T11:43:32.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.796+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f005c007480 con 0x7f006415de50 2023-10-09T11:43:32.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.796+0000 7f005a7fc700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:32.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.796+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f005c083d00 con 0x7f006415de50 2023-10-09T11:43:32.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.796+0000 7f006259c700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:32.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.797+0000 7f006259c700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0054009ab0 tx=0x7f0054018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:32.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.800+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f005c050c90 con 0x7f006415de50 2023-10-09T11:43:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.994+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f006404c3c0 con 0x7f006415de50 2023-10-09T11:43:32.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:32.998+0000 7f005a7fc700 1 -- 172.21.15.26:0/1872428983 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f005c017020 con 0x7f006415de50 2023-10-09T11:43:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 msgr2=0x7f00440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0054009ab0 tx=0x7f0054018000 comp rx=0 tx=0).stop 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 msgr2=0x7f00640c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c530 tx=0x7f005c007f90 comp rx=0 tx=0).stop 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 shutdown_connections 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f006415de50 0x7f00640c93c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00640cea00 0x7f00640b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 --2- 172.21.15.26:0/1872428983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0064153a00 0x7f0064152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 >> 172.21.15.26:0/1872428983 conn(0x7f00640703a0 msgr2=0x7f0064152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:33.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 shutdown_connections 2023-10-09T11:43:33.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.000+0000 7f006359e700 1 -- 172.21.15.26:0/1872428983 wait complete. 2023-10-09T11:43:33.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:43:33.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:33.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:33.103 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:43:33.104 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:43:33.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:33.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.222+0000 7fbd67570700 1 Processor -- start 2023-10-09T11:43:33.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.222+0000 7fbd67570700 1 -- start start 2023-10-09T11:43:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd67570700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd67570700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd600cde50 0x7fbd60156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd67570700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6015ae40 con 0x7fbd600cd9e0 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd67570700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600d13f0 con 0x7fbd600cde50 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd67570700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6015ab60 con 0x7fbd600cb5a0 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd600cde50 0x7fbd60156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd600cde50 0x7fbd60156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47808/0 (socket says 172.21.15.26:47808) 2023-10-09T11:43:33.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 -- 172.21.15.26:0/2714131186 learned_addr learned my addr 172.21.15.26:0/2714131186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd6530c700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 -- 172.21.15.26:0/2714131186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 msgr2=0x7fbd600cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd600cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 -- 172.21.15.26:0/2714131186 >> v1:172.21.15.67:6789/0 conn(0x7fbd600cd9e0 legacy=0x7fbd60159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 -- 172.21.15.26:0/2714131186 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600ccf00 con 0x7fbd600cde50 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd65b0d700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cde50 0x7fbd60156e90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009f20 tx=0x7fbd50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0bac4cb291df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd5ffff700 1 -- 172.21.15.26:0/2714131186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000e070 con 0x7fbd600cde50 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd5ffff700 1 -- 172.21.15.26:0/2714131186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000ba80 con 0x7fbd600cde50 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.223+0000 7fbd5ffff700 1 -- 172.21.15.26:0/2714131186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500092e0 con 0x7fbd600cde50 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 -- 172.21.15.26:0/2714131186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cde50 msgr2=0x7fbd60156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cde50 0x7fbd60156e90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009f20 tx=0x7fbd50009840 comp rx=0 tx=0).stop 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 -- 172.21.15.26:0/2714131186 shutdown_connections 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cde50 0x7fbd60156e90 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 --2- 172.21.15.26:0/2714131186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd600cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 -- 172.21.15.26:0/2714131186 >> 172.21.15.26:0/2714131186 conn(0x7fbd60070e30 msgr2=0x7fbd600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 -- 172.21.15.26:0/2714131186 shutdown_connections 2023-10-09T11:43:33.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.224+0000 7fbd67570700 1 -- 172.21.15.26:0/2714131186 wait complete. 2023-10-09T11:43:33.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.225+0000 7fbd67570700 1 Processor -- start 2023-10-09T11:43:33.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.225+0000 7fbd67570700 1 -- start start 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd60169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6016ca40 0x7fbd60158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b4a40 con 0x7fbd600cd9e0 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6016a3a0 con 0x7fbd6016ca40 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd67570700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c6740 con 0x7fbd600cb5a0 2023-10-09T11:43:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47822/0 (socket says 172.21.15.26:47822) 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 -- 172.21.15.26:0/4268940656 learned_addr learned my addr 172.21.15.26:0/4268940656 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd65b0d700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6016ca40 0x7fbd60158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd6530c700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd60169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 -- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 msgr2=0x7fbd60169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd60169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 -- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6016ca40 msgr2=0x7fbd60158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6016ca40 0x7fbd60158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd64b0b700 1 -- 172.21.15.26:0/4268940656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009ae0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.226+0000 7fbd6530c700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd60169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd64b0b700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400c5c0 tx=0x7fbd5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011590 con 0x7fbd600cd9e0 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54011710 con 0x7fbd600cd9e0 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6016cf20 con 0x7fbd600cd9e0 2023-10-09T11:43:33.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011ad0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.227+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6016d4e0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.228+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6004c3c0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.228+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbd5401b3b0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.229+0000 7fbd5d7fa700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 0x7fbd4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.229+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbd54083e40 con 0x7fbd600cd9e0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.229+0000 7fbd6530c700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 0x7fbd4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.229+0000 7fbd6530c700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 0x7fbd4c0697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbd58006fd0 tx=0x7fbd58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.233+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd54050dd0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.472+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd600cd1e0 con 0x7fbd600cd9e0 2023-10-09T11:43:33.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.473+0000 7fbd5d7fa700 1 -- 172.21.15.26:0/4268940656 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+3528 (secure 0 0 0) 0x7fbd54017070 con 0x7fbd600cd9e0 2023-10-09T11:43:33.474 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:33.474 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":104,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/212085372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":212085372},{"type":"v1","addr":"172.21.15.67:6837","nonce":212085372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2603442939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2603442939},{"type":"v1","addr":"172.21.15.67:6836","nonce":2603442939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1416958814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1416958814},{"type":"v1","addr":"172.21.15.26:6834","nonce":1416958814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1548194771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1548194771},{"type":"v1","addr":"172.21.15.26:6835","nonce":1548194771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[]} 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 msgr2=0x7fbd4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 0x7fbd4c0697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbd58006fd0 tx=0x7fbd58008040 comp rx=0 tx=0).stop 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 msgr2=0x7fbd60156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400c5c0 tx=0x7fbd5400c8d0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 shutdown_connections 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd6016ca40 0x7fbd60158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbd4c067320 0x7fbd4c0697d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd600cb5a0 0x7fbd60169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 --2- 172.21.15.26:0/4268940656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd600cd9e0 0x7fbd60156c60 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 >> 172.21.15.26:0/4268940656 conn(0x7fbd60070e30 msgr2=0x7fbd600d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 shutdown_connections 2023-10-09T11:43:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.475+0000 7fbd67570700 1 -- 172.21.15.26:0/4268940656 wait complete. 2023-10-09T11:43:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 104 2023-10-09T11:43:33.488 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:43:33.489 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:43:33.489 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:43:33.489 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:33.489 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:43:33.489 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:43:33.489 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:43:33.489 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:33.490 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:43:33.490 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:43:33.490 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:43:33.490 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:33.490 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:43:33.490 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:43:33.491 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:43:33.491 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:43:33.497 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:43:33.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:43:33.499 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:43:33.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:43:33.501 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:43:33.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:43:33.502 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:43:33.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:43:33.540 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:43:33.540 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:33.541 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:43:33.541 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:33.544 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:43:33.544 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:33.545 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:43:33.545 DEBUG:teuthology.parallel:result is None 2023-10-09T11:43:33.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:43:33.616 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:43:33.616 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:43:33.626 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:43:33.626 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:43:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.670+0000 7f1382cf6700 1 Processor -- start 2023-10-09T11:43:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.670+0000 7f1382cf6700 1 -- start start 2023-10-09T11:43:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.671+0000 7f1382cf6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.671+0000 7f1382cf6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f137c150c90 0x7f137c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.671+0000 7f1382cf6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c158c80 con 0x7f137c1508c0 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.671+0000 7f1382cf6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c15afc0 con 0x7f137c150c90 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.671+0000 7f1382cf6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0af820 con 0x7f137c15a7d0 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137bfff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f137c150c90 0x7f137c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137bfff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:35668/0 (socket says 172.21.15.26:35668) 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f137c150c90 0x7f137c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:33826/0 (socket says 172.21.15.26:33826) 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137bfff700 1 -- 172.21.15.26:0/489475697 learned_addr learned my addr 172.21.15.26:0/489475697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1380a92700 1 --1- 172.21.15.26:0/489475697 >> v1:172.21.15.67:6789/0 conn(0x7f137c1508c0 0x7f137c15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:52024/0 (socket says 172.21.15.26:52024) 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 -- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 msgr2=0x7f137c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 -- 172.21.15.26:0/489475697 >> v1:172.21.15.67:6789/0 conn(0x7f137c1508c0 legacy=0x7f137c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 -- 172.21.15.26:0/489475697 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c155710 con 0x7f137c150c90 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137bfff700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f1381293700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c0af2e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e60 tx=0x7f1374009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216b4cea9160e0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137b7fe700 1 -- 172.21.15.26:0/489475697 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400e070 con 0x7f137c150c90 2023-10-09T11:43:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137b7fe700 1 -- 172.21.15.26:0/489475697 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400bb60 con 0x7f137c150c90 2023-10-09T11:43:33.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.672+0000 7f137b7fe700 1 -- 172.21.15.26:0/489475697 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374012430 con 0x7f137c150c90 2023-10-09T11:43:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 -- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 msgr2=0x7f137c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c0af2e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e60 tx=0x7f1374009780 comp rx=0 tx=0).stop 2023-10-09T11:43:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 -- 172.21.15.26:0/489475697 shutdown_connections 2023-10-09T11:43:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c0af2e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 --2- 172.21.15.26:0/489475697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c15a7d0 0x7f137c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 -- 172.21.15.26:0/489475697 >> 172.21.15.26:0/489475697 conn(0x7f137c0cded0 msgr2=0x7f137c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 -- 172.21.15.26:0/489475697 shutdown_connections 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.673+0000 7f1382cf6700 1 -- 172.21.15.26:0/489475697 wait complete. 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.674+0000 7f1382cf6700 1 Processor -- start 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.674+0000 7f1382cf6700 1 -- start start 2023-10-09T11:43:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c1508c0 0x7f137c145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c152ac0 con 0x7f137c15a7d0 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c151290 con 0x7f137c150c90 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1382cf6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1520f0 con 0x7f137c1508c0 2023-10-09T11:43:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1381293700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1381293700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47864/0 (socket says 172.21.15.26:47864) 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1381293700 1 -- 172.21.15.26:0/4113406729 learned_addr learned my addr 172.21.15.26:0/4113406729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1380a92700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c1508c0 0x7f137c145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f137bfff700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1381293700 1 -- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c1508c0 msgr2=0x7f137c145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.675+0000 7f1381293700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c1508c0 0x7f137c145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1381293700 1 -- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 msgr2=0x7f137c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1381293700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1381293700 1 -- 172.21.15.26:0/4113406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680094f0 con 0x7f137c15a7d0 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1381293700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f137400b6c0 tx=0x7f1374019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374027470 con 0x7f137c15a7d0 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740275f0 con 0x7f137c15a7d0 2023-10-09T11:43:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374009a20 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740279b0 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.676+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c1517c0 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.677+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c04c3c0 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.677+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1374024070 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.678+0000 7f1378ff9700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 0x7f13600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.678+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f13740872e0 con 0x7f137c15a7d0 2023-10-09T11:43:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.678+0000 7f1380a92700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 0x7f13600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:33.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.678+0000 7f1380a92700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 0x7f13600697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1370004fd0 tx=0x7f1370007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:33.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.682+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1374054270 con 0x7f137c15a7d0 2023-10-09T11:43:33.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T11:43:33.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:33.888+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f137c152230 con 0x7f137c15a7d0 2023-10-09T11:43:34.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.667+0000 7f1378ff9700 1 -- 172.21.15.26:0/4113406729 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1374057890 con 0x7f137c15a7d0 2023-10-09T11:43:34.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 msgr2=0x7f13600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:34.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 0x7f13600697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1370004fd0 tx=0x7f1370007eb0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 msgr2=0x7f137c144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f137400b6c0 tx=0x7f1374019000 comp rx=0 tx=0).stop 2023-10-09T11:43:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 shutdown_connections 2023-10-09T11:43:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c15a7d0 0x7f137c144800 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1360067320 0x7f13600697d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.669+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f137c1508c0 0x7f137c145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.670+0000 7f1382cf6700 1 --2- 172.21.15.26:0/4113406729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f137c150c90 0x7f137c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.670+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 >> 172.21.15.26:0/4113406729 conn(0x7f137c0cded0 msgr2=0x7f137c0680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.670+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 shutdown_connections 2023-10-09T11:43:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.670+0000 7f1382cf6700 1 -- 172.21.15.26:0/4113406729 wait complete. 2023-10-09T11:43:34.674 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:43:34.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:43:34.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.810+0000 7f7950829700 1 Processor -- start 2023-10-09T11:43:34.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.810+0000 7f7950829700 1 -- start start 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f7950829700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f794c159550 0x7f794c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f7950829700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f794c15dfd0 0x7f794c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f7950829700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0acc00 con 0x7f794c159920 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f7950829700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0abff0 con 0x7f794c159550 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f7950829700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0ac2d0 con 0x7f794c15dfd0 2023-10-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f794c159550 0x7f794c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f794c159550 0x7f794c0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47878/0 (socket says 172.21.15.26:47878) 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 -- 172.21.15.26:0/3900983500 learned_addr learned my addr 172.21.15.26:0/3900983500 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794affd700 1 --2- 172.21.15.26:0/3900983500 >> v2:172.21.15.67:3300/0 conn(0x7f794c15dfd0 0x7f794c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 -- 172.21.15.26:0/3900983500 >> v2:172.21.15.67:3300/0 conn(0x7f794c15dfd0 msgr2=0x7f794c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3900983500 >> v2:172.21.15.67:3300/0 conn(0x7f794c15dfd0 0x7f794c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.811+0000 7f794b7fe700 1 -- 172.21.15.26:0/3900983500 >> v1:172.21.15.67:6789/0 conn(0x7f794c159920 legacy=0x7f794c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f794b7fe700 1 -- 172.21.15.26:0/3900983500 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0ac5b0 con 0x7f794c159550 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3900983500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159550 0x7f794c0ceac0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f794c06c180 tx=0x7f793c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efea72ee52b1aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f794a7fc700 1 -- 172.21.15.26:0/3900983500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c00b820 con 0x7f794c159550 2023-10-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f794a7fc700 1 -- 172.21.15.26:0/3900983500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c00b980 con 0x7f794c159550 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f794a7fc700 1 -- 172.21.15.26:0/3900983500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c00bd20 con 0x7f794c159550 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 -- 172.21.15.26:0/3900983500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159550 msgr2=0x7f794c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 --2- 172.21.15.26:0/3900983500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159550 0x7f794c0ceac0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f794c06c180 tx=0x7f793c009250 comp rx=0 tx=0).stop 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 -- 172.21.15.26:0/3900983500 shutdown_connections 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 --2- 172.21.15.26:0/3900983500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159550 0x7f794c0ceac0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 --2- 172.21.15.26:0/3900983500 >> v2:172.21.15.67:3300/0 conn(0x7f794c15dfd0 0x7f794c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 -- 172.21.15.26:0/3900983500 >> 172.21.15.26:0/3900983500 conn(0x7f794c06ce80 msgr2=0x7f794c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 -- 172.21.15.26:0/3900983500 shutdown_connections 2023-10-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.812+0000 7f7950829700 1 -- 172.21.15.26:0/3900983500 wait complete. 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.814+0000 7f7950829700 1 Processor -- start 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.814+0000 7f7950829700 1 -- start start 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.814+0000 7f7950829700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 0x7f794c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.814+0000 7f7950829700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c15dfd0 0x7f794c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c152670 con 0x7f794c159920 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0cd0a0 con 0x7f794c159550 2023-10-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0cd380 con 0x7f794c15dfd0 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47884/0 (socket says 172.21.15.26:47884) 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 -- 172.21.15.26:0/3997275537 learned_addr learned my addr 172.21.15.26:0/3997275537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 0x7f794c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794bfff700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c15dfd0 0x7f794c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 -- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c15dfd0 msgr2=0x7f794c0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c15dfd0 0x7f794c0cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 -- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 msgr2=0x7f794c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 0x7f794c0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 -- 172.21.15.26:0/3997275537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0094f0 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 0x7f794c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f794affd700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f794000d860 tx=0x7f7940008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940009610 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940009770 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0cd660 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940009b30 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.815+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0cdc20 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.816+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c04c3c0 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.817+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f794001e460 con 0x7f794c159920 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.818+0000 7f79337fe700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 0x7f79380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.818+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7940085a00 con 0x7f794c159920 2023-10-09T11:43:34.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.818+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 0x7f79380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:34.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.819+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 0x7f79380697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f794c06c180 tx=0x7f793c016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:34.821+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7940052a20 con 0x7f794c159920 2023-10-09T11:43:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.093+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f794c06e7c0 con 0x7f794c159920 2023-10-09T11:43:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.094+0000 7f79337fe700 1 -- 172.21.15.26:0/3997275537 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7940056040 con 0x7f794c159920 2023-10-09T11:43:35.095 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:35.096 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.097 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:35.098 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:35.099 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.100 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.101 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.102 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.102 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.102 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.102 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:43:35.105 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.106 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.107 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:43:35.108 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:43:35.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:43:35.111 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:43:35.112 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:43:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 msgr2=0x7f79380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 0x7f79380697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f794c06c180 tx=0x7f793c016000 comp rx=0 tx=0).stop 2023-10-09T11:43:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 msgr2=0x7f794c152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f794000d860 tx=0x7f7940008040 comp rx=0 tx=0).stop 2023-10-09T11:43:35.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 shutdown_connections 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7938067320 0x7f79380697d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c15dfd0 0x7f794c0cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c159550 0x7f794c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 --2- 172.21.15.26:0/3997275537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c159920 0x7f794c152130 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 >> 172.21.15.26:0/3997275537 conn(0x7f794c06ce80 msgr2=0x7f794c0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 shutdown_connections 2023-10-09T11:43:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.096+0000 7f7950829700 1 -- 172.21.15.26:0/3997275537 wait complete. 2023-10-09T11:43:35.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.232+0000 7f7343afa700 1 Processor -- start 2023-10-09T11:43:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.232+0000 7f7343afa700 1 -- start start 2023-10-09T11:43:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7343afa700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f733c0cb5a0 0x7f733c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7343afa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f733c15a5d0 0x7f733c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7343afa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c15ae40 con 0x7f733c0cd9e0 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7343afa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c0d13f0 con 0x7f733c15a5d0 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7343afa700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c15ab60 con 0x7f733c0cb5a0 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f733c15a5d0 0x7f733c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f733c15a5d0 0x7f733c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47890/0 (socket says 172.21.15.26:47890) 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 -- 172.21.15.26:0/3632170270 learned_addr learned my addr 172.21.15.26:0/3632170270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7341896700 1 --2- 172.21.15.26:0/3632170270 >> v2:172.21.15.67:3300/0 conn(0x7f733c0cb5a0 0x7f733c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 -- 172.21.15.26:0/3632170270 >> v2:172.21.15.67:3300/0 conn(0x7f733c0cb5a0 msgr2=0x7f733c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 --2- 172.21.15.26:0/3632170270 >> v2:172.21.15.67:3300/0 conn(0x7f733c0cb5a0 0x7f733c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 -- 172.21.15.26:0/3632170270 >> v1:172.21.15.67:6789/0 conn(0x7f733c0cd9e0 legacy=0x7f733c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 -- 172.21.15.26:0/3632170270 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0ccf00 con 0x7f733c15a5d0 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7342097700 1 --2- 172.21.15.26:0/3632170270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c15a5d0 0x7f733c156e90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f73340099b0 tx=0x7f7334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb885a027b7d205e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.233+0000 7f7340894700 1 -- 172.21.15.26:0/3632170270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400b7e0 con 0x7f733c15a5d0 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7340894700 1 -- 172.21.15.26:0/3632170270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733400b940 con 0x7f733c15a5d0 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7340894700 1 -- 172.21.15.26:0/3632170270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400bce0 con 0x7f733c15a5d0 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 -- 172.21.15.26:0/3632170270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c15a5d0 msgr2=0x7f733c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 --2- 172.21.15.26:0/3632170270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c15a5d0 0x7f733c156e90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f73340099b0 tx=0x7f7334009250 comp rx=0 tx=0).stop 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 -- 172.21.15.26:0/3632170270 shutdown_connections 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 --2- 172.21.15.26:0/3632170270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c15a5d0 0x7f733c156e90 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 --2- 172.21.15.26:0/3632170270 >> v2:172.21.15.67:3300/0 conn(0x7f733c0cb5a0 0x7f733c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 -- 172.21.15.26:0/3632170270 >> 172.21.15.26:0/3632170270 conn(0x7f733c070e30 msgr2=0x7f733c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 -- 172.21.15.26:0/3632170270 shutdown_connections 2023-10-09T11:43:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.234+0000 7f7343afa700 1 -- 172.21.15.26:0/3632170270 wait complete. 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.235+0000 7f7343afa700 1 Processor -- start 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.235+0000 7f7343afa700 1 -- start start 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733c0cd9e0 0x7f733c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f733c15a5d0 0x7f733c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0ca750 con 0x7f733c0cb5a0 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c79f0 con 0x7f733c0cd9e0 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7343afa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c1520e0 con 0x7f733c15a5d0 2023-10-09T11:43:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7341896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7341896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47896/0 (socket says 172.21.15.26:47896) 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7341896700 1 -- 172.21.15.26:0/4002383102 learned_addr learned my addr 172.21.15.26:0/4002383102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7342097700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f733c15a5d0 0x7f733c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.236+0000 7f7341095700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733c0cd9e0 0x7f733c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 -- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f733c15a5d0 msgr2=0x7f733c0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f733c15a5d0 0x7f733c0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 -- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733c0cd9e0 msgr2=0x7f733c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733c0cd9e0 0x7f733c0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 -- 172.21.15.26:0/4002383102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340094f0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7341896700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f732c00e190 tx=0x7f732c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00ecd0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c00ee30 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c0c9bd0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c014670 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.237+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c0ca190 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.238+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c0cbcf0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.239+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f732c014a20 con 0x7f733c0cb5a0 2023-10-09T11:43:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.239+0000 7f7339ffb700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 0x7f73280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.239+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f732c084fe0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.239+0000 7f7341095700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 0x7f73280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.240+0000 7f7341095700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 0x7f73280697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f733c0afbb0 tx=0x7f7330007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.243+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f732c051fc0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.436+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f733c04c3c0 con 0x7f733c0cb5a0 2023-10-09T11:43:35.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.437+0000 7f7339ffb700 1 -- 172.21.15.26:0/4002383102 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f732c009a60 con 0x7f733c0cb5a0 2023-10-09T11:43:35.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:35.438 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":161,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:34.665186+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 msgr2=0x7f73280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 0x7f73280697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f733c0afbb0 tx=0x7f7330007ea0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 msgr2=0x7f733c151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f732c00e190 tx=0x7f732c009920 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 shutdown_connections 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7328067320 0x7f73280697d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f733c15a5d0 0x7f733c0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733c0cb5a0 0x7f733c151ba0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 --2- 172.21.15.26:0/4002383102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733c0cd9e0 0x7f733c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 >> 172.21.15.26:0/4002383102 conn(0x7f733c070e30 msgr2=0x7f733c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 shutdown_connections 2023-10-09T11:43:35.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.439+0000 7f7343afa700 1 -- 172.21.15.26:0/4002383102 wait complete. 2023-10-09T11:43:35.452 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:43:35.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:43:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.574+0000 7fc7bf89c700 1 Processor -- start 2023-10-09T11:43:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.574+0000 7fc7bf89c700 1 -- start start 2023-10-09T11:43:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bf89c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bf89c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bf89c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80ccfd0 con 0x7fc7b8159530 2023-10-09T11:43:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bf89c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b815a3d0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bf89c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b815a6b0 con 0x7fc7b806dc70 2023-10-09T11:43:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bde39700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bce37700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bce37700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:35726/0 (socket says 172.21.15.26:35726) 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bde39700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:33882/0 (socket says 172.21.15.26:33882) 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.575+0000 7fc7bce37700 1 -- 172.21.15.26:0/3758393669 learned_addr learned my addr 172.21.15.26:0/3758393669 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bce37700 1 -- 172.21.15.26:0/3758393669 >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 msgr2=0x7fc7b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bce37700 1 --2- 172.21.15.26:0/3758393669 >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bce37700 1 -- 172.21.15.26:0/3758393669 >> v1:172.21.15.67:6789/0 conn(0x7fc7b8159530 legacy=0x7fc7b80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bce37700 1 -- 172.21.15.26:0/3758393669 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b815a990 con 0x7fc7b806dc70 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bde39700 1 --2- 172.21.15.26:0/3758393669 >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7bce37700 1 --2- 172.21.15.26:0/3758393669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80099b0 tx=0x7fc7a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db26e1b23ebf0662 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7affff700 1 -- 172.21.15.26:0/3758393669 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8009ea0 con 0x7fc7b806dc70 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7affff700 1 -- 172.21.15.26:0/3758393669 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800b860 con 0x7fc7b806dc70 2023-10-09T11:43:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.576+0000 7fc7affff700 1 -- 172.21.15.26:0/3758393669 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800bc00 con 0x7fc7b806dc70 2023-10-09T11:43:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 -- 172.21.15.26:0/3758393669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 msgr2=0x7fc7b8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/3758393669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80099b0 tx=0x7fc7a8009250 comp rx=0 tx=0).stop 2023-10-09T11:43:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 -- 172.21.15.26:0/3758393669 shutdown_connections 2023-10-09T11:43:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/3758393669 >> v2:172.21.15.67:3300/0 conn(0x7fc7b806e0e0 0x7fc7b80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/3758393669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b806dc70 0x7fc7b8159900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 -- 172.21.15.26:0/3758393669 >> 172.21.15.26:0/3758393669 conn(0x7fc7b80703a0 msgr2=0x7fc7b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 -- 172.21.15.26:0/3758393669 shutdown_connections 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.577+0000 7fc7bf89c700 1 -- 172.21.15.26:0/3758393669 wait complete. 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.578+0000 7fc7bf89c700 1 Processor -- start 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.578+0000 7fc7bf89c700 1 -- start start 2023-10-09T11:43:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b806dc70 0x7fc7b815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b8159530 0x7fc7b80b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b815d460 con 0x7fc7b806e0e0 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80b5a10 con 0x7fc7b806dc70 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bf89c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80b5cf0 con 0x7fc7b8159530 2023-10-09T11:43:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47900/0 (socket says 172.21.15.26:47900) 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 -- 172.21.15.26:0/4056294935 learned_addr learned my addr 172.21.15.26:0/4056294935 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bde39700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b8159530 0x7fc7b80b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bd638700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b806dc70 0x7fc7b815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 -- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b8159530 msgr2=0x7fc7b80b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b8159530 0x7fc7b80b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.579+0000 7fc7bce37700 1 -- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b806dc70 msgr2=0x7fc7b815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7bce37700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b806dc70 0x7fc7b815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7bce37700 1 -- 172.21.15.26:0/4056294935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009a20 con 0x7fc7b806e0e0 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7bce37700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc7b815a7f0 tx=0x7fc7a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800bbe0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8011420 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80117c0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a80094f0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.580+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b80b36b0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.581+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b815d5d0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.581+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc7a8011bf0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.582+0000 7fc7ad7fa700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 0x7fc79c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.582+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc7a80862b0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.582+0000 7fc7bd638700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 0x7fc79c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.582+0000 7fc7bd638700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 0x7fc79c0697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40037c0 tx=0x7fc7b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.586+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a8053290 con 0x7fc7b806e0e0 2023-10-09T11:43:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.780+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7b804c3c0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.781+0000 7fc7ad7fa700 1 -- 172.21.15.26:0/4056294935 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7a80568b0 con 0x7fc7b806e0e0 2023-10-09T11:43:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:43:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 msgr2=0x7fc79c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 0x7fc79c0697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40037c0 tx=0x7fc7b4009040 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 msgr2=0x7fc7b80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc7b815a7f0 tx=0x7fc7a8017000 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 shutdown_connections 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc79c067320 0x7fc79c0697d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc7b8159530 0x7fc7b80b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7b806dc70 0x7fc7b815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 --2- 172.21.15.26:0/4056294935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7b806e0e0 0x7fc7b80b4e50 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 >> 172.21.15.26:0/4056294935 conn(0x7fc7b80703a0 msgr2=0x7fc7b80d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 shutdown_connections 2023-10-09T11:43:35.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.783+0000 7fc7bf89c700 1 -- 172.21.15.26:0/4056294935 wait complete. 2023-10-09T11:43:35.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:43:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 Processor -- start 2023-10-09T11:43:35.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 -- start start 2023-10-09T11:43:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc15a280 con 0x7f3ccc0cf200 2023-10-09T11:43:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc06e180 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.914+0000 7f3cd1546700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc06d850 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cca7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3ccc0cf200 0x7f3ccc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49624/0 (socket says 172.21.15.26:49624) 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47914/0 (socket says 172.21.15.26:47914) 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cca7fc700 1 -- 172.21.15.26:0/1664348746 learned_addr learned my addr 172.21.15.26:0/1664348746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 -- 172.21.15.26:0/1664348746 >> v1:172.21.15.67:6789/0 conn(0x7f3ccc0b0ba0 legacy=0x7f3ccc06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 -- 172.21.15.26:0/1664348746 >> v1:172.21.15.26:6789/0 conn(0x7f3ccc0cf200 legacy=0x7f3ccc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 -- 172.21.15.26:0/1664348746 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc06db30 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cc9ffb700 1 -- 172.21.15.26:0/1664348746 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690086016 0 0) 0x7f3ccc15a280 con 0x7f3ccc0cf200 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3ccaffd700 1 --2- 172.21.15.26:0/1664348746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009eb0 tx=0x7f3cc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20878e16c4e57c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cc9ffb700 1 -- 172.21.15.26:0/1664348746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400e070 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cc9ffb700 1 -- 172.21.15.26:0/1664348746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc400bcc0 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.915+0000 7f3cc9ffb700 1 -- 172.21.15.26:0/1664348746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4012680 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 -- 172.21.15.26:0/1664348746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b07d0 msgr2=0x7f3ccc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 --2- 172.21.15.26:0/1664348746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009eb0 tx=0x7f3cc4009780 comp rx=0 tx=0).stop 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 -- 172.21.15.26:0/1664348746 shutdown_connections 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 --2- 172.21.15.26:0/1664348746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0ccac0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 -- 172.21.15.26:0/1664348746 >> 172.21.15.26:0/1664348746 conn(0x7f3ccc06ce80 msgr2=0x7f3ccc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 -- 172.21.15.26:0/1664348746 shutdown_connections 2023-10-09T11:43:35.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.916+0000 7f3cd1546700 1 -- 172.21.15.26:0/1664348746 wait complete. 2023-10-09T11:43:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.917+0000 7f3cd1546700 1 Processor -- start 2023-10-09T11:43:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.917+0000 7f3cd1546700 1 -- start start 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ccc0cf200 0x7f3ccc158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c70d0 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c67a0 con 0x7f3ccc0b07d0 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cd1546700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c6a80 con 0x7f3ccc0cf200 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47922/0 (socket says 172.21.15.26:47922) 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 -- 172.21.15.26:0/2229274438 learned_addr learned my addr 172.21.15.26:0/2229274438 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3ccaffd700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3ccb7fe700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ccc0cf200 0x7f3ccc158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 -- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ccc0cf200 msgr2=0x7f3ccc158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ccc0cf200 0x7f3ccc158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 -- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0b07d0 msgr2=0x7f3ccc0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.918+0000 7f3cca7fc700 1 -- 172.21.15.26:0/2229274438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009a20 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cca7fc700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c560 tx=0x7f3cb4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4005b30 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb4005c90 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc0c6d60 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4007320 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.919+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0b2680 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.920+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc0c7280 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.920+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3cb401b3b0 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.921+0000 7f3cc2ffd700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 0x7f3cac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.921+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3cb4083cf0 con 0x7f3ccc0b0ba0 2023-10-09T11:43:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.921+0000 7f3ccaffd700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 0x7f3cac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.921+0000 7f3ccaffd700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 0x7f3cac0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097c0 tx=0x7f3cc4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:35.925+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ccc0c7280 con 0x7f3ccc0b0ba0 2023-10-09T11:43:36.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.120+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3ccc04c3c0 con 0x7f3ccc0b0ba0 2023-10-09T11:43:36.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.120+0000 7f3cc2ffd700 1 -- 172.21.15.26:0/2229274438 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3cb4017090 con 0x7f3ccc0b0ba0 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:36.122 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 msgr2=0x7f3cac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 0x7f3cac0697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097c0 tx=0x7f3cc4017000 comp rx=0 tx=0).stop 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 msgr2=0x7f3ccc0b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c560 tx=0x7f3cb4000fe0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 shutdown_connections 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3cac067320 0x7f3cac0697d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ccc0cf200 0x7f3ccc158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0b07d0 0x7f3ccc0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 --2- 172.21.15.26:0/2229274438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ccc0b0ba0 0x7f3ccc0b2140 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 >> 172.21.15.26:0/2229274438 conn(0x7f3ccc06ce80 msgr2=0x7f3ccc1556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 shutdown_connections 2023-10-09T11:43:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.122+0000 7f3cd1546700 1 -- 172.21.15.26:0/2229274438 wait complete. 2023-10-09T11:43:36.135 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:43:36.136 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:43:36.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.258+0000 7f4efb06e700 1 Processor -- start 2023-10-09T11:43:36.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.258+0000 7f4efb06e700 1 -- start start 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 0x7f4ef415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef415a8c0 0x7f4ef40cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef406d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef415e180 con 0x7f4ef415a8c0 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40cd810 con 0x7f4ef4159fb0 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efb06e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef415d570 con 0x7f4ef40cd3d0 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef415a8c0 0x7f4ef40cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ef415a8c0 0x7f4ef40cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47930/0 (socket says 172.21.15.26:47930) 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 -- 172.21.15.26:0/3367642337 learned_addr learned my addr 172.21.15.26:0/3367642337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efa86d700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efa06c700 1 --2- 172.21.15.26:0/3367642337 >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 0x7f4ef415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 -- 172.21.15.26:0/3367642337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 msgr2=0x7f4ef406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef406d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 -- 172.21.15.26:0/3367642337 >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 msgr2=0x7f4ef415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 --2- 172.21.15.26:0/3367642337 >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 0x7f4ef415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4ef986b700 1 -- 172.21.15.26:0/3367642337 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef415d850 con 0x7f4ef415a8c0 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.259+0000 7f4efa06c700 1 --2- 172.21.15.26:0/3367642337 >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 0x7f4ef415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4ef986b700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40cce90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4ef406e8d0 tx=0x7f4ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bac00540401733 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4ef906a700 1 -- 172.21.15.26:0/3367642337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800b860 con 0x7f4ef415a8c0 2023-10-09T11:43:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4ef906a700 1 -- 172.21.15.26:0/3367642337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800b9c0 con 0x7f4ef415a8c0 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4ef906a700 1 -- 172.21.15.26:0/3367642337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800bd60 con 0x7f4ef415a8c0 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 -- 172.21.15.26:0/3367642337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef415a8c0 msgr2=0x7f4ef40cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40cce90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4ef406e8d0 tx=0x7f4ee8009250 comp rx=0 tx=0).stop 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 -- 172.21.15.26:0/3367642337 shutdown_connections 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 --2- 172.21.15.26:0/3367642337 >> v2:172.21.15.67:3300/0 conn(0x7f4ef4159fb0 0x7f4ef415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef406d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 --2- 172.21.15.26:0/3367642337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40cce90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 -- 172.21.15.26:0/3367642337 >> 172.21.15.26:0/3367642337 conn(0x7f4ef40703a0 msgr2=0x7f4ef40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 -- 172.21.15.26:0/3367642337 shutdown_connections 2023-10-09T11:43:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.260+0000 7f4efb06e700 1 -- 172.21.15.26:0/3367642337 wait complete. 2023-10-09T11:43:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.261+0000 7f4efb06e700 1 Processor -- start 2023-10-09T11:43:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 -- start start 2023-10-09T11:43:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef41482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4159290 con 0x7f4ef4159fb0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4158680 con 0x7f4ef415a8c0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efb06e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4158960 con 0x7f4ef40cd3d0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4ef986b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4ef986b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47938/0 (socket says 172.21.15.26:47938) 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4ef986b700 1 -- 172.21.15.26:0/2140685820 learned_addr learned my addr 172.21.15.26:0/2140685820 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efa06c700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef41482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.262+0000 7f4efa86d700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 -- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 msgr2=0x7f4ef41482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef41482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 -- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef415a8c0 msgr2=0x7f4ef40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 -- 172.21.15.26:0/2140685820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80094f0 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef986b700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4ef406d1f0 tx=0x7f4ee8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011dc0 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8024440 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef4158c40 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8024800 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.263+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef41581e0 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.264+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef41590e0 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.264+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4ee801a420 con 0x7f4ef4159fb0 2023-10-09T11:43:36.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.265+0000 7f4ef27fc700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 0x7f4ee00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.265+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4ee8086790 con 0x7f4ef4159fb0 2023-10-09T11:43:36.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.265+0000 7f4efa06c700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 0x7f4ee00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.266+0000 7f4efa06c700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 0x7f4ee00697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400d6e0 tx=0x7f4ee4007850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.269+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ee8053770 con 0x7f4ef4159fb0 2023-10-09T11:43:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.466+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4ef41583d0 con 0x7f4ef4159fb0 2023-10-09T11:43:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.679+0000 7f4ef27fc700 1 -- 172.21.15.26:0/2140685820 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4ee8056d90 con 0x7f4ef4159fb0 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 msgr2=0x7f4ee00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 0x7f4ee00697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400d6e0 tx=0x7f4ee4007850 comp rx=0 tx=0).stop 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 msgr2=0x7f4ef40ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4ef406d1f0 tx=0x7f4ee8017000 comp rx=0 tx=0).stop 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 shutdown_connections 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef415a8c0 0x7f4ef40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ee0067320 0x7f4ee00697d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ef40cd3d0 0x7f4ef41482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 --2- 172.21.15.26:0/2140685820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ef4159fb0 0x7f4ef40ce380 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 >> 172.21.15.26:0/2140685820 conn(0x7f4ef40703a0 msgr2=0x7f4ef40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 shutdown_connections 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.681+0000 7f4efb06e700 1 -- 172.21.15.26:0/2140685820 wait complete. 2023-10-09T11:43:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:43:36.698 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:43:36.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.822+0000 7efc8e49b700 1 Processor -- start 2023-10-09T11:43:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.822+0000 7efc8e49b700 1 -- start start 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8e49b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc88159380 0x7efc88159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8e49b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880ccfa0 con 0x7efc880cb3f0 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8e49b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880cb880 con 0x7efc880cea00 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8e49b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc880cbb60 con 0x7efc88159380 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8d499700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc88159380 0x7efc88159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8d499700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc88159380 0x7efc88159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47946/0 (socket says 172.21.15.26:47946) 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8d499700 1 -- 172.21.15.26:0/228083900 learned_addr learned my addr 172.21.15.26:0/228083900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.823+0000 7efc8cc98700 1 --1- 172.21.15.26:0/228083900 >> v1:172.21.15.26:6789/0 conn(0x7efc880cb3f0 0x7efc8815dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49626/0 (socket says 172.21.15.26:49626) 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8d499700 1 -- 172.21.15.26:0/228083900 >> v1:172.21.15.67:6789/0 conn(0x7efc880cea00 legacy=0x7efc880b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8d499700 1 -- 172.21.15.26:0/228083900 >> v1:172.21.15.26:6789/0 conn(0x7efc880cb3f0 legacy=0x7efc8815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8d499700 1 -- 172.21.15.26:0/228083900 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880cbe40 con 0x7efc88159380 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc87fff700 1 -- 172.21.15.26:0/228083900 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814413330 0 0) 0x7efc880ccfa0 con 0x7efc880cb3f0 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8d499700 1 --2- 172.21.15.26:0/228083900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc88159380 0x7efc88159750 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efc780099b0 tx=0x7efc78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49068c6f75ed484 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc87fff700 1 -- 172.21.15.26:0/228083900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800b820 con 0x7efc88159380 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc87fff700 1 -- 172.21.15.26:0/228083900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800b980 con 0x7efc88159380 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc87fff700 1 -- 172.21.15.26:0/228083900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800bd20 con 0x7efc88159380 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 -- 172.21.15.26:0/228083900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc88159380 msgr2=0x7efc88159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 --2- 172.21.15.26:0/228083900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc88159380 0x7efc88159750 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efc780099b0 tx=0x7efc78009250 comp rx=0 tx=0).stop 2023-10-09T11:43:36.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 -- 172.21.15.26:0/228083900 shutdown_connections 2023-10-09T11:43:36.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 --2- 172.21.15.26:0/228083900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc88159380 0x7efc88159750 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 -- 172.21.15.26:0/228083900 >> 172.21.15.26:0/228083900 conn(0x7efc880703a0 msgr2=0x7efc880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:36.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.824+0000 7efc8e49b700 1 -- 172.21.15.26:0/228083900 shutdown_connections 2023-10-09T11:43:36.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.825+0000 7efc8e49b700 1 -- 172.21.15.26:0/228083900 wait complete. 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 Processor -- start 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 -- start start 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 0x7efc8815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efc88159380 0x7efc88159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c9e90 con 0x7efc880cb3f0 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c9280 con 0x7efc880cea00 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.826+0000 7efc8e49b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c9560 con 0x7efc88159380 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47954/0 (socket says 172.21.15.26:47954) 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 -- 172.21.15.26:0/1984555255 learned_addr learned my addr 172.21.15.26:0/1984555255 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8cc98700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 0x7efc8815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8dc9a700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efc88159380 0x7efc88159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 -- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efc88159380 msgr2=0x7efc88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efc88159380 0x7efc88159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 -- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 msgr2=0x7efc8815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 0x7efc8815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 -- 172.21.15.26:0/1984555255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780094f0 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8cc98700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 0x7efc8815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8d499700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efc78009290 tx=0x7efc78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800bc40 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78020070 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc880c9840 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7801b6a0 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.827+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc880ca320 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.828+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8804c3c0 con 0x7efc880cb3f0 2023-10-09T11:43:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.829+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efc78022030 con 0x7efc880cb3f0 2023-10-09T11:43:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.829+0000 7efc857fa700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 0x7efc740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.829+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5223+0+0 (secure 0 0 0) 0x7efc78086930 con 0x7efc880cb3f0 2023-10-09T11:43:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.830+0000 7efc8cc98700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 0x7efc740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.830+0000 7efc8cc98700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 0x7efc740697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efc880b1460 tx=0x7efc7c007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:36.834+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc78053870 con 0x7efc880cb3f0 2023-10-09T11:43:37.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.027+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc8804c3c0 con 0x7efc880cb3f0 2023-10-09T11:43:37.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.688+0000 7efc857fa700 1 -- 172.21.15.26:0/1984555255 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) v1 ==== 170+0+0 (secure 0 0 0) 0x7efc78056e90 con 0x7efc880cb3f0 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.693+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 msgr2=0x7efc740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.693+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 0x7efc740697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efc880b1460 tx=0x7efc7c007c90 comp rx=0 tx=0).stop 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.693+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 msgr2=0x7efc88149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.693+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efc78009290 tx=0x7efc78016000 comp rx=0 tx=0).stop 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 shutdown_connections 2023-10-09T11:43:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efc74067320 0x7efc740697d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efc88159380 0x7efc88159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc880cb3f0 0x7efc88149280 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 --2- 172.21.15.26:0/1984555255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc880cea00 0x7efc8815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.694+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 >> 172.21.15.26:0/1984555255 conn(0x7efc880703a0 msgr2=0x7efc88153350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.696+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 shutdown_connections 2023-10-09T11:43:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.696+0000 7efc8e49b700 1 -- 172.21.15.26:0/1984555255 wait complete. 2023-10-09T11:43:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:43:37.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:43:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 Processor -- start 2023-10-09T11:43:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 -- start start 2023-10-09T11:43:37.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf8159530 0x7f7bf80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bf806dc70 0x7f7bf8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7bf806e0e0 0x7f7bf80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80ccfd0 con 0x7f7bf806dc70 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80cf0e0 con 0x7f7bf806e0e0 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.848+0000 7f7bfec06700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf815a3d0 con 0x7f7bf8159530 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bf806dc70 0x7f7bf8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bf806dc70 0x7f7bf8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47968/0 (socket says 172.21.15.26:47968) 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 -- 172.21.15.26:0/3856454967 learned_addr learned my addr 172.21.15.26:0/3856454967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bfd1a3700 1 --2- 172.21.15.26:0/3856454967 >> v2:172.21.15.67:3300/0 conn(0x7f7bf806e0e0 0x7f7bf80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bfc9a2700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf8159530 0x7f7bf80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 -- 172.21.15.26:0/3856454967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf8159530 msgr2=0x7f7bf80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf8159530 0x7f7bf80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 -- 172.21.15.26:0/3856454967 >> v2:172.21.15.67:3300/0 conn(0x7f7bf806e0e0 msgr2=0x7f7bf80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/3856454967 >> v2:172.21.15.67:3300/0 conn(0x7f7bf806e0e0 0x7f7bf80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 -- 172.21.15.26:0/3856454967 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf815a6b0 con 0x7f7bf806dc70 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806dc70 0x7f7bf8159900 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8089880 tx=0x7f7be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0921f7dd05e5d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf77fe700 1 -- 172.21.15.26:0/3856454967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800b860 con 0x7f7bf806dc70 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf77fe700 1 -- 172.21.15.26:0/3856454967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800b9c0 con 0x7f7bf806dc70 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.849+0000 7f7bf77fe700 1 -- 172.21.15.26:0/3856454967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800bd60 con 0x7f7bf806dc70 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 -- 172.21.15.26:0/3856454967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806dc70 msgr2=0x7f7bf8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806dc70 0x7f7bf8159900 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8089880 tx=0x7f7be8009250 comp rx=0 tx=0).stop 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 -- 172.21.15.26:0/3856454967 shutdown_connections 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 --2- 172.21.15.26:0/3856454967 >> v2:172.21.15.67:3300/0 conn(0x7f7bf806e0e0 0x7f7bf80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf8159530 0x7f7bf80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 --2- 172.21.15.26:0/3856454967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806dc70 0x7f7bf8159900 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 -- 172.21.15.26:0/3856454967 >> 172.21.15.26:0/3856454967 conn(0x7f7bf80703a0 msgr2=0x7f7bf80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 -- 172.21.15.26:0/3856454967 shutdown_connections 2023-10-09T11:43:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.850+0000 7f7bfec06700 1 -- 172.21.15.26:0/3856454967 wait complete. 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.851+0000 7f7bfec06700 1 Processor -- start 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.851+0000 7f7bfec06700 1 -- start start 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf806dc70 0x7f7bf8154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf8159530 0x7f7bf80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf816b300 con 0x7f7bf806e0e0 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8155120 con 0x7f7bf8159530 2023-10-09T11:43:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfec06700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf816a710 con 0x7f7bf806dc70 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47976/0 (socket says 172.21.15.26:47976) 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 -- 172.21.15.26:0/1200470606 learned_addr learned my addr 172.21.15.26:0/1200470606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfc9a2700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf806dc70 0x7f7bf8154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bfd1a3700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf8159530 0x7f7bf80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 -- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf806dc70 msgr2=0x7f7bf8154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf806dc70 0x7f7bf8154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 -- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf8159530 msgr2=0x7f7bf80b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf8159530 0x7f7bf80b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.852+0000 7f7bf7fff700 1 -- 172.21.15.26:0/1200470606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80094f0 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bf7fff700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8089650 tx=0x7f7be8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8011dc0 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8024440 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf816a9d0 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8024800 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.853+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf816af90 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.854+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf816b470 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.854+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7be801a420 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.855+0000 7f7bf4ff9700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 0x7f7bd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.855+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7be8087110 con 0x7f7bf806e0e0 2023-10-09T11:43:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.855+0000 7f7bfc9a2700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 0x7f7bd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.855+0000 7f7bfc9a2700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 0x7f7bd80697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8156ba0 tx=0x7f7bf0007750 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:37.859+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be8053e80 con 0x7f7bf806e0e0 2023-10-09T11:43:38.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.094+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7bf804c3c0 con 0x7f7bf806e0e0 2023-10-09T11:43:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.692+0000 7f7bf4ff9700 1 -- 172.21.15.26:0/1200470606 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v106) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7be80574a0 con 0x7f7bf806e0e0 2023-10-09T11:43:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 msgr2=0x7f7bd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 0x7f7bd80697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8156ba0 tx=0x7f7bf0007750 comp rx=0 tx=0).stop 2023-10-09T11:43:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 msgr2=0x7f7bf80b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8089650 tx=0x7f7be8017000 comp rx=0 tx=0).stop 2023-10-09T11:43:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 shutdown_connections 2023-10-09T11:43:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf8159530 0x7f7bf80b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7bd8067320 0x7f7bd80697d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7bf806dc70 0x7f7bf8154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 --2- 172.21.15.26:0/1200470606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf806e0e0 0x7f7bf80b19f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.698+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 >> 172.21.15.26:0/1200470606 conn(0x7f7bf80703a0 msgr2=0x7f7bf80c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.700+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 shutdown_connections 2023-10-09T11:43:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.701+0000 7f7bfec06700 1 -- 172.21.15.26:0/1200470606 wait complete. 2023-10-09T11:43:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 28 and data pool 29 2023-10-09T11:43:38.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.851+0000 7f8f94b5f700 1 Processor -- start 2023-10-09T11:43:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.851+0000 7f8f94b5f700 1 -- start start 2023-10-09T11:43:38.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f94b5f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f900aee90 0x7f8f900a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f94b5f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f9006d280 0x7f8f900b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f94b5f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f900ce1a0 con 0x7f8f900a8be0 2023-10-09T11:43:38.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f94b5f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900cd5d0 con 0x7f8f900aee90 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f94b5f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900cd870 con 0x7f8f9006d280 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f8e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f900a8be0 0x7f8f900ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49642/0 (socket says 172.21.15.26:49642) 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f8e59c700 1 -- 172.21.15.26:0/2007856433 learned_addr learned my addr 172.21.15.26:0/2007856433 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.852+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/2007856433 >> v2:172.21.15.26:3300/0 conn(0x7f8f900aee90 0x7f8f900a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8ed9d700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f9006d280 0x7f8f900b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8d59a700 1 -- 172.21.15.26:0/2007856433 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645727784 0 0) 0x7f8f900ce1a0 con 0x7f8f900a8be0 2023-10-09T11:43:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8d59a700 1 -- 172.21.15.26:0/2007856433 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003570 con 0x7f8f900a8be0 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2007856433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f9006d280 msgr2=0x7f8f900b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f9006d280 0x7f8f900b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2007856433 >> v1:172.21.15.26:6789/0 conn(0x7f8f900a8be0 legacy=0x7f8f900ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2007856433 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900cdb50 con 0x7f8f900aee90 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900aee90 0x7f8f900a8fb0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8f780098d0 tx=0x7f8f78009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f524b63325dc9155 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8d59a700 1 -- 172.21.15.26:0/2007856433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78005c10 con 0x7f8f900aee90 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8d59a700 1 -- 172.21.15.26:0/2007856433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78005d70 con 0x7f8f900aee90 2023-10-09T11:43:38.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f8d59a700 1 -- 172.21.15.26:0/2007856433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78006280 con 0x7f8f900aee90 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f94b5f700 1 -- 172.21.15.26:0/2007856433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900aee90 msgr2=0x7f8f900a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.853+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900aee90 0x7f8f900a8fb0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8f780098d0 tx=0x7f8f78009120 comp rx=0 tx=0).stop 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 -- 172.21.15.26:0/2007856433 shutdown_connections 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f9006d280 0x7f8f900b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/2007856433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900aee90 0x7f8f900a8fb0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 -- 172.21.15.26:0/2007856433 >> 172.21.15.26:0/2007856433 conn(0x7f8f9006ce80 msgr2=0x7f8f900ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:38.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 -- 172.21.15.26:0/2007856433 shutdown_connections 2023-10-09T11:43:38.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.854+0000 7f8f94b5f700 1 -- 172.21.15.26:0/2007856433 wait complete. 2023-10-09T11:43:38.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.855+0000 7f8f94b5f700 1 Processor -- start 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.855+0000 7f8f94b5f700 1 -- start start 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.855+0000 7f8f94b5f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 0x7f8f90169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.855+0000 7f8f94b5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 0x7f8f900c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9006e1f0 con 0x7f8f900a8be0 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9009b3a0 con 0x7f8f9006d280 2023-10-09T11:43:38.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c4840 con 0x7f8f900aee90 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47996/0 (socket says 172.21.15.26:47996) 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/954992886 learned_addr learned my addr 172.21.15.26:0/954992886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8ed9d700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 0x7f8f900c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 0x7f8f90169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 msgr2=0x7f8f900c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 0x7f8f900c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 msgr2=0x7f8f90169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 0x7f8f90169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/954992886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780093c0 con 0x7f8f900a8be0 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 0x7f8f90169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8ed9d700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 0x7f8f900c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009f70 tx=0x7f8f78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800b9a0 con 0x7f8f900a8be0 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800bb00 con 0x7f8f900a8be0 2023-10-09T11:43:38.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9006d8c0 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800bec0 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.856+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9006de80 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.857+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9006e3a0 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.858+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f7801b690 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.858+0000 7f8f867fc700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 0x7f8f700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.858+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f78086af0 con 0x7f8f900a8be0 2023-10-09T11:43:38.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.858+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 0x7f8f700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.859+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 0x7f8f700697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001360 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:38.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:38.862+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f9006e3a0 con 0x7f8f900a8be0 2023-10-09T11:43:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.055+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f9006e3a0 con 0x7f8f900a8be0 2023-10-09T11:43:39.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.056+0000 7f8f867fc700 1 -- 172.21.15.26:0/954992886 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f8f9006e3a0 con 0x7f8f900a8be0 2023-10-09T11:43:39.058 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:39.058 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":164,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:38.095684+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 msgr2=0x7f8f700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 0x7f8f700697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001360 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2023-10-09T11:43:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 msgr2=0x7f8f9016c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009f70 tx=0x7f8f78016000 comp rx=0 tx=0).stop 2023-10-09T11:43:39.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 shutdown_connections 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.058+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f70067320 0x7f8f700697d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f900aee90 0x7f8f900c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f9006d280 0x7f8f90169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 --2- 172.21.15.26:0/954992886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900a8be0 0x7f8f9016c9a0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 >> 172.21.15.26:0/954992886 conn(0x7f8f9006ce80 msgr2=0x7f8f90159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 shutdown_connections 2023-10-09T11:43:39.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.059+0000 7f8f94b5f700 1 -- 172.21.15.26:0/954992886 wait complete. 2023-10-09T11:43:39.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:39.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.189+0000 7f2c5d0c5700 1 Processor -- start 2023-10-09T11:43:39.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.189+0000 7f2c5d0c5700 1 -- start start 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5d0c5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2c580cb5a0 0x7f2c580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5d0c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c580cd9e0 0x7f2c58159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5d0c5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5815ae40 con 0x7f2c5815a400 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5d0c5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c580d13f0 con 0x7f2c580cd9e0 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5d0c5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5815ab60 con 0x7f2c580cb5a0 2023-10-09T11:43:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c580cd9e0 0x7f2c58159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c580cd9e0 0x7f2c58159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47998/0 (socket says 172.21.15.26:47998) 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5759e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2c5815a400 0x7f2c58156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49656/0 (socket says 172.21.15.26:49656) 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.190+0000 7f2c5659c700 1 -- 172.21.15.26:0/2751722498 learned_addr learned my addr 172.21.15.26:0/2751722498 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c56d9d700 1 --2- 172.21.15.26:0/2751722498 >> v2:172.21.15.67:3300/0 conn(0x7f2c580cb5a0 0x7f2c580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5659c700 1 -- 172.21.15.26:0/2751722498 >> v2:172.21.15.67:3300/0 conn(0x7f2c580cb5a0 msgr2=0x7f2c580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5659c700 1 --2- 172.21.15.26:0/2751722498 >> v2:172.21.15.67:3300/0 conn(0x7f2c580cb5a0 0x7f2c580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5659c700 1 -- 172.21.15.26:0/2751722498 >> v1:172.21.15.26:6789/0 conn(0x7f2c5815a400 legacy=0x7f2c58156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5659c700 1 -- 172.21.15.26:0/2751722498 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580ccf00 con 0x7f2c580cd9e0 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c55d9b700 1 -- 172.21.15.26:0/2751722498 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888780691 0 0) 0x7f2c5815ae40 con 0x7f2c5815a400 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5659c700 1 --2- 172.21.15.26:0/2751722498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c580cd9e0 0x7f2c58159ec0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2c480099b0 tx=0x7f2c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945ea37751065b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c55d9b700 1 -- 172.21.15.26:0/2751722498 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800b820 con 0x7f2c580cd9e0 2023-10-09T11:43:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c55d9b700 1 -- 172.21.15.26:0/2751722498 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4800b980 con 0x7f2c580cd9e0 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c55d9b700 1 -- 172.21.15.26:0/2751722498 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800bd20 con 0x7f2c580cd9e0 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.191+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/2751722498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c580cd9e0 msgr2=0x7f2c58159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/2751722498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c580cd9e0 0x7f2c58159ec0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2c480099b0 tx=0x7f2c48009250 comp rx=0 tx=0).stop 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/2751722498 shutdown_connections 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/2751722498 >> v2:172.21.15.67:3300/0 conn(0x7f2c580cb5a0 0x7f2c580cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/2751722498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c580cd9e0 0x7f2c58159ec0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/2751722498 >> 172.21.15.26:0/2751722498 conn(0x7f2c58070e30 msgr2=0x7f2c580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/2751722498 shutdown_connections 2023-10-09T11:43:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.192+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/2751722498 wait complete. 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.193+0000 7f2c5d0c5700 1 Processor -- start 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.193+0000 7f2c5d0c5700 1 -- start start 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 0x7f2c581524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c580cd9e0 0x7f2c580b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c58152a30 con 0x7f2c5815a400 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580b4510 con 0x7f2c580cd9e0 2023-10-09T11:43:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5d0c5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580b3660 con 0x7f2c580cb5a0 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48006/0 (socket says 172.21.15.26:48006) 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 -- 172.21.15.26:0/769941274 learned_addr learned my addr 172.21.15.26:0/769941274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5659c700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c580cd9e0 0x7f2c580b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c56d9d700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 0x7f2c581524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 -- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 msgr2=0x7f2c581524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 0x7f2c581524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 -- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c580cd9e0 msgr2=0x7f2c580b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c580cd9e0 0x7f2c580b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 -- 172.21.15.26:0/769941274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480094f0 con 0x7f2c5815a400 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c56d9d700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 0x7f2c581524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c5759e700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000ccc0 tx=0x7f2c50001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50005df0 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.194+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5000a6b0 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.195+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c580b3900 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.195+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000aa70 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.195+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c580b3f40 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.196+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c580b4680 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.196+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2c500070f0 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.197+0000 7f2c4effd700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 0x7f2c380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.197+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c50084de0 con 0x7f2c5815a400 2023-10-09T11:43:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.197+0000 7f2c56d9d700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 0x7f2c380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.197+0000 7f2c56d9d700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 0x7f2c380697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006fd0 tx=0x7f2c40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.201+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c50051ba0 con 0x7f2c5815a400 2023-10-09T11:43:39.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.396+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c5804c3c0 con 0x7f2c5815a400 2023-10-09T11:43:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.397+0000 7f2c4effd700 1 -- 172.21.15.26:0/769941274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f2c500551c0 con 0x7f2c5815a400 2023-10-09T11:43:39.398 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:39.398 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":164,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:38.095684+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 msgr2=0x7f2c380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 0x7f2c380697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006fd0 tx=0x7f2c40008040 comp rx=0 tx=0).stop 2023-10-09T11:43:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 msgr2=0x7f2c580c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000ccc0 tx=0x7f2c50001a70 comp rx=0 tx=0).stop 2023-10-09T11:43:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 shutdown_connections 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5815a400 0x7f2c580c9ee0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2c38067320 0x7f2c380697d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c580cb5a0 0x7f2c581524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 --2- 172.21.15.26:0/769941274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c580cd9e0 0x7f2c580b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 >> 172.21.15.26:0/769941274 conn(0x7f2c58070e30 msgr2=0x7f2c580cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 shutdown_connections 2023-10-09T11:43:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.399+0000 7f2c5d0c5700 1 -- 172.21.15.26:0/769941274 wait complete. 2023-10-09T11:43:39.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:43:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.533+0000 7ff47ecaf700 1 Processor -- start 2023-10-09T11:43:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.533+0000 7ff47ecaf700 1 -- start start 2023-10-09T11:43:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47ecaf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff478159530 0x7ff4780ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47ecaf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780ccfd0 con 0x7ff47806e0e0 2023-10-09T11:43:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47ecaf700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780cf0e0 con 0x7ff47806dc70 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47ecaf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47815a3d0 con 0x7ff478159530 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47ca4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff478159530 0x7ff4780ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47d24c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff47806e0e0 0x7ff4780cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49666/0 (socket says 172.21.15.26:49666) 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.534+0000 7ff47d24c700 1 -- 172.21.15.26:0/1784777575 learned_addr learned my addr 172.21.15.26:0/1784777575 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff47ca4b700 1 -- 172.21.15.26:0/1784777575 >> v1:172.21.15.67:6789/0 conn(0x7ff47806dc70 legacy=0x7ff478159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff47ca4b700 1 -- 172.21.15.26:0/1784777575 >> v1:172.21.15.26:6789/0 conn(0x7ff47806e0e0 legacy=0x7ff4780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff4777fe700 1 -- 172.21.15.26:0/1784777575 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305223785 0 0) 0x7ff4780ccfd0 con 0x7ff47806e0e0 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff47ca4b700 1 -- 172.21.15.26:0/1784777575 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47815a6b0 con 0x7ff478159530 2023-10-09T11:43:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff47ca4b700 1 --2- 172.21.15.26:0/1784777575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff478159530 0x7ff4780ceba0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0b589be7a024a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff4777fe700 1 -- 172.21.15.26:0/1784777575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468009e80 con 0x7ff478159530 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff4777fe700 1 -- 172.21.15.26:0/1784777575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800b820 con 0x7ff478159530 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.535+0000 7ff4777fe700 1 -- 172.21.15.26:0/1784777575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bba0 con 0x7ff478159530 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 -- 172.21.15.26:0/1784777575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff478159530 msgr2=0x7ff4780ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/1784777575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff478159530 0x7ff4780ceba0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 -- 172.21.15.26:0/1784777575 shutdown_connections 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/1784777575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff478159530 0x7ff4780ceba0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 -- 172.21.15.26:0/1784777575 >> 172.21.15.26:0/1784777575 conn(0x7ff4780703a0 msgr2=0x7ff4780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 -- 172.21.15.26:0/1784777575 shutdown_connections 2023-10-09T11:43:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.536+0000 7ff47ecaf700 1 -- 172.21.15.26:0/1784777575 wait complete. 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.537+0000 7ff47ecaf700 1 Processor -- start 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.537+0000 7ff47ecaf700 1 -- start start 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 0x7ff4780c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 0x7ff4780b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781522f0 con 0x7ff47806dc70 2023-10-09T11:43:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780c80e0 con 0x7ff47806e0e0 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff478152590 con 0x7ff478159530 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48014/0 (socket says 172.21.15.26:48014) 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 -- 172.21.15.26:0/724838254 learned_addr learned my addr 172.21.15.26:0/724838254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47d24c700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 0x7ff4780b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff477fff700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 0x7ff4780c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 -- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 msgr2=0x7ff4780b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 0x7ff4780b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 -- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 msgr2=0x7ff4780c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:39.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 0x7ff4780c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 -- 172.21.15.26:0/724838254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009420 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff477fff700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 0x7ff4780c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47d24c700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 0x7ff4780b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ca4b700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff4680030c0 tx=0x7ff468016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bae0 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468020070 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478152870 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.538+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46801b6a0 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.539+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4780c7cd0 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.539+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff478070770 con 0x7ff47806dc70 2023-10-09T11:43:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.540+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff468022030 con 0x7ff47806dc70 2023-10-09T11:43:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.540+0000 7ff474ff9700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 0x7ff4640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.541+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff468086b20 con 0x7ff47806dc70 2023-10-09T11:43:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.541+0000 7ff477fff700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 0x7ff4640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.541+0000 7ff477fff700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 0x7ff4640697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff478158fe0 tx=0x7ff46c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.545+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4680538c0 con 0x7ff47806dc70 2023-10-09T11:43:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:39.783+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff478070770 con 0x7ff47806dc70 2023-10-09T11:43:40.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T11:43:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.709+0000 7ff474ff9700 1 -- 172.21.15.26:0/724838254 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v108) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff468056ee0 con 0x7ff47806dc70 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 msgr2=0x7ff4640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 0x7ff4640697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff478158fe0 tx=0x7ff46c009040 comp rx=0 tx=0).stop 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 msgr2=0x7ff4780ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff4680030c0 tx=0x7ff468016000 comp rx=0 tx=0).stop 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 shutdown_connections 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff464067320 0x7ff4640697d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff478159530 0x7ff4780b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff47806dc70 0x7ff4780ca260 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 --2- 172.21.15.26:0/724838254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47806e0e0 0x7ff4780c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 >> 172.21.15.26:0/724838254 conn(0x7ff4780703a0 msgr2=0x7ff47815b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.712+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 shutdown_connections 2023-10-09T11:43:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.713+0000 7ff47ecaf700 1 -- 172.21.15.26:0/724838254 wait complete. 2023-10-09T11:43:40.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:43:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.860+0000 7f2a5d621700 1 Processor -- start 2023-10-09T11:43:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.860+0000 7f2a5d621700 1 -- start start 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a5d621700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a58159530 0x7f2a580ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a5d621700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a5806e0e0 0x7f2a580cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a5d621700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580ccfd0 con 0x7f2a5806dc70 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a5d621700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a580cf0e0 con 0x7f2a5806e0e0 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a5d621700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5815a3d0 con 0x7f2a58159530 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a5806e0e0 0x7f2a580cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a567fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a5806dc70 0x7f2a58159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34584/0 (socket says 172.21.15.26:34584) 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a567fc700 1 -- 172.21.15.26:0/2448292205 learned_addr learned my addr 172.21.15.26:0/2448292205 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a56ffd700 1 --2- 172.21.15.26:0/2448292205 >> v2:172.21.15.67:3300/0 conn(0x7f2a58159530 0x7f2a580ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 -- 172.21.15.26:0/2448292205 >> v2:172.21.15.67:3300/0 conn(0x7f2a58159530 msgr2=0x7f2a580ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 --2- 172.21.15.26:0/2448292205 >> v2:172.21.15.67:3300/0 conn(0x7f2a58159530 0x7f2a580ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 -- 172.21.15.26:0/2448292205 >> v1:172.21.15.26:6789/0 conn(0x7f2a5806dc70 legacy=0x7f2a58159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a55ffb700 1 -- 172.21.15.26:0/2448292205 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195371282 0 0) 0x7f2a580ccfd0 con 0x7f2a5806dc70 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 -- 172.21.15.26:0/2448292205 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5815a6b0 con 0x7f2a5806e0e0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.861+0000 7f2a577fe700 1 --2- 172.21.15.26:0/2448292205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806e0e0 0x7f2a580cb6f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f2a5806d630 tx=0x7f2a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ec8d6ab8bf0975 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a55ffb700 1 -- 172.21.15.26:0/2448292205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011630 con 0x7f2a5806e0e0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a55ffb700 1 -- 172.21.15.26:0/2448292205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50011790 con 0x7f2a5806e0e0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a55ffb700 1 -- 172.21.15.26:0/2448292205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011b30 con 0x7f2a5806e0e0 2023-10-09T11:43:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 -- 172.21.15.26:0/2448292205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806e0e0 msgr2=0x7f2a580cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 --2- 172.21.15.26:0/2448292205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806e0e0 0x7f2a580cb6f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f2a5806d630 tx=0x7f2a500091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 -- 172.21.15.26:0/2448292205 shutdown_connections 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 --2- 172.21.15.26:0/2448292205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806e0e0 0x7f2a580cb6f0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 --2- 172.21.15.26:0/2448292205 >> v2:172.21.15.67:3300/0 conn(0x7f2a58159530 0x7f2a580ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 -- 172.21.15.26:0/2448292205 >> 172.21.15.26:0/2448292205 conn(0x7f2a580703a0 msgr2=0x7f2a580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 -- 172.21.15.26:0/2448292205 shutdown_connections 2023-10-09T11:43:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.862+0000 7f2a5d621700 1 -- 172.21.15.26:0/2448292205 wait complete. 2023-10-09T11:43:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.863+0000 7f2a5d621700 1 Processor -- start 2023-10-09T11:43:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.863+0000 7f2a5d621700 1 -- start start 2023-10-09T11:43:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a5806e0e0 0x7f2a580c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a58159530 0x7f2a580d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a581548a0 con 0x7f2a5806dc70 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58155fc0 con 0x7f2a58159530 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a5d621700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580c79e0 con 0x7f2a5806e0e0 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49044/0 (socket says 172.21.15.26:49044) 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a56ffd700 1 -- 172.21.15.26:0/209113551 learned_addr learned my addr 172.21.15.26:0/209113551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a577fe700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a58159530 0x7f2a580d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.864+0000 7f2a567fc700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a5806e0e0 0x7f2a580c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 -- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a5806e0e0 msgr2=0x7f2a580c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a5806e0e0 0x7f2a580c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 -- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a58159530 msgr2=0x7f2a580d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a58159530 0x7f2a580d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 -- 172.21.15.26:0/209113551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009420 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a56ffd700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009e50 tx=0x7f2a4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800caa0 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800f040 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a58156260 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800ce30 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.865+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58156820 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.866+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5804c3c0 con 0x7f2a5806dc70 2023-10-09T11:43:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.866+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2a48014690 con 0x7f2a5806dc70 2023-10-09T11:43:40.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.867+0000 7f2a4effd700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 0x7f2a380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:40.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.867+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a48085890 con 0x7f2a5806dc70 2023-10-09T11:43:40.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.867+0000 7f2a567fc700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 0x7f2a380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:40.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.868+0000 7f2a567fc700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 0x7f2a380697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a581588e0 tx=0x7f2a40007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:40.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:40.871+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a48052410 con 0x7f2a5806dc70 2023-10-09T11:43:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.108+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2a5815a990 con 0x7f2a5806dc70 2023-10-09T11:43:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.714+0000 7f2a4effd700 1 -- 172.21.15.26:0/209113551 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v109) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a48055a30 con 0x7f2a5806dc70 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 msgr2=0x7f2a380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 0x7f2a380697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a581588e0 tx=0x7f2a40007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 msgr2=0x7f2a58143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009e50 tx=0x7f2a4800b040 comp rx=0 tx=0).stop 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 shutdown_connections 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a58159530 0x7f2a580d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a5806dc70 0x7f2a58143ce0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a38067320 0x7f2a380697d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 --2- 172.21.15.26:0/209113551 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a5806e0e0 0x7f2a580c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 >> 172.21.15.26:0/209113551 conn(0x7f2a580703a0 msgr2=0x7f2a580d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 shutdown_connections 2023-10-09T11:43:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.717+0000 7f2a5d621700 1 -- 172.21.15.26:0/209113551 wait complete. 2023-10-09T11:43:41.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.858+0000 7f0778971700 1 Processor -- start 2023-10-09T11:43:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.858+0000 7f0778971700 1 -- start start 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0778971700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07740cb5a0 0x7f07740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0778971700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f077415a5d0 0x7f0774156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0778971700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077415ae40 con 0x7f07740cd9e0 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0778971700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07740d13f0 con 0x7f07740cb5a0 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0778971700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077415ab60 con 0x7f077415a5d0 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0771d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f07740cd9e0 0x7f0774159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34600/0 (socket says 172.21.15.26:34600) 2023-10-09T11:43:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0771d9b700 1 -- 172.21.15.26:0/3302693983 learned_addr learned my addr 172.21.15.26:0/3302693983 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f077259c700 1 --2- 172.21.15.26:0/3302693983 >> v2:172.21.15.67:3300/0 conn(0x7f07740cb5a0 0x7f07740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f0772d9d700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f077415a5d0 0x7f0774156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015327546 0 0) 0x7f077415ae40 con 0x7f07740cd9e0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c003570 con 0x7f07740cd9e0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342786432 0 0) 0x7f075c003570 con 0x7f07740cd9e0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.859+0000 7f077259c700 1 -- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f077415a5d0 msgr2=0x7f0774156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077259c700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f077415a5d0 0x7f0774156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077259c700 1 -- 172.21.15.26:0/3302693983 >> v1:172.21.15.26:6789/0 conn(0x7f07740cd9e0 legacy=0x7f0774159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077259c700 1 -- 172.21.15.26:0/3302693983 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740ccf00 con 0x7f07740cb5a0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077259c700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07740cb5a0 0x7f07740cb970 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0764009910 tx=0x7f07640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b0bf230ee657fbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768001470 con 0x7f07740cb5a0 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764011420 con 0x7f07740cb5a0 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f077159a700 1 -- 172.21.15.26:0/3302693983 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640117c0 con 0x7f07740cb5a0 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f0778971700 1 -- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07740cb5a0 msgr2=0x7f07740cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.860+0000 7f0778971700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07740cb5a0 0x7f07740cb970 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0764009910 tx=0x7f07640091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 -- 172.21.15.26:0/3302693983 shutdown_connections 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f077415a5d0 0x7f0774156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 --2- 172.21.15.26:0/3302693983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07740cb5a0 0x7f07740cb970 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 -- 172.21.15.26:0/3302693983 >> 172.21.15.26:0/3302693983 conn(0x7f0774070e30 msgr2=0x7f07740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 -- 172.21.15.26:0/3302693983 shutdown_connections 2023-10-09T11:43:41.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.861+0000 7f0778971700 1 -- 172.21.15.26:0/3302693983 wait complete. 2023-10-09T11:43:41.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.862+0000 7f0778971700 1 Processor -- start 2023-10-09T11:43:41.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.862+0000 7f0778971700 1 -- start start 2023-10-09T11:43:41.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.862+0000 7f0778971700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07740cd9e0 0x7f07740c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 0x7f07741501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740c7070 con 0x7f07740cb5a0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740c7500 con 0x7f077415a5d0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07740c61e0 con 0x7f07740cd9e0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49060/0 (socket says 172.21.15.26:49060) 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 -- 172.21.15.26:0/3918414744 learned_addr learned my addr 172.21.15.26:0/3918414744 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0771d9b700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07740cd9e0 0x7f07740c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0772d9d700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 0x7f07741501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 -- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07740cd9e0 msgr2=0x7f07740c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07740cd9e0 0x7f07740c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 -- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 msgr2=0x7f07741501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 0x7f07741501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 -- 172.21.15.26:0/3918414744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0772d9d700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 0x7f07741501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f077259c700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f07640093f0 tx=0x7f0764016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076401bb90 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076401bcf0 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07740c6460 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076401c680 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.863+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07740c6a20 con 0x7f07740cb5a0 2023-10-09T11:43:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.864+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077404c3c0 con 0x7f07740cb5a0 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.865+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f076401ca70 con 0x7f07740cb5a0 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.865+0000 7f07627fc700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 0x7f07540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.865+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0764085f50 con 0x7f07740cb5a0 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.865+0000 7f0771d9b700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 0x7f07540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.866+0000 7f0771d9b700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 0x7f07540697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07740b0a10 tx=0x7f0768001aa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:41.869+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0764052be0 con 0x7f07740cb5a0 2023-10-09T11:43:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.103+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07740c7350 con 0x7f07740cb5a0 2023-10-09T11:43:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.104+0000 7f07627fc700 1 -- 172.21.15.26:0/3918414744 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f076401be60 con 0x7f07740cb5a0 2023-10-09T11:43:42.105 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:42.105 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":109,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:41.709676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.105+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 msgr2=0x7f07540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.105+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 0x7f07540697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07740b0a10 tx=0x7f0768001aa0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.105+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 msgr2=0x7f077416d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.105+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f07640093f0 tx=0x7f0764016000 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 shutdown_connections 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f077415a5d0 0x7f07741501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07740cb5a0 0x7f077416d9b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0754067320 0x7f07540697d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 --2- 172.21.15.26:0/3918414744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07740cd9e0 0x7f07740c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 >> 172.21.15.26:0/3918414744 conn(0x7f0774070e30 msgr2=0x7f0774159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 shutdown_connections 2023-10-09T11:43:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.106+0000 7f0778971700 1 -- 172.21.15.26:0/3918414744 wait complete. 2023-10-09T11:43:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 109 2023-10-09T11:43:42.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:42.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.237+0000 7f4aebaa1700 1 Processor -- start 2023-10-09T11:43:42.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.237+0000 7f4aebaa1700 1 -- start start 2023-10-09T11:43:42.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4aebaa1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4ae4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4aebaa1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae415ae40 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4aebaa1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae415ab60 con 0x7f4ae415a400 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4aebaa1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ce0f0 con 0x7f4ae40cb970 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4ae983d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4ae40cb5a0 0x7f4ae40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34608/0 (socket says 172.21.15.26:34608) 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4ae983d700 1 -- 172.21.15.26:0/2109024737 learned_addr learned my addr 172.21.15.26:0/2109024737 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4ae4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696603870 0 0) 0x7f4ae415ae40 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.238+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc003570 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863259841 0 0) 0x7f4ae415ab60 con 0x7f4ae415a400 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae415ae40 con 0x7f4ae415a400 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719293787 0 0) 0x7f4acc003570 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 msgr2=0x7f4ae4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4ae4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 >> v1:172.21.15.67:6789/0 conn(0x7f4ae415a400 legacy=0x7f4ae4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40ccf00 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4ad40017f0 con 0x7f4ae40cb5a0 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 >> v1:172.21.15.26:6789/0 conn(0x7f4ae40cb5a0 legacy=0x7f4ae40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4acc003c20 0x7f4acc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4acc004810 0x7f4acc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4acc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ce0f0 con 0x7f4acc004810 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc00bb70 con 0x7f4acc003c20 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc00bd30 con 0x7f4ae40cb970 2023-10-09T11:43:42.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4acc004810 0x7f4acc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae983d700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4acc003c20 0x7f4acc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4aea03e700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4acc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 -- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 msgr2=0x7f4acc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4acc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 -- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4acc003c20 msgr2=0x7f4acc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4acc003c20 0x7f4acc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 -- 172.21.15.26:0/2109024737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc003570 con 0x7f4acc004810 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4aea03e700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ae40cb970 0x7f4acc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.239+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4acc004810 0x7f4acc004c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009c00 tx=0x7f4ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dadf93a1ad4611a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800e710 con 0x7f4acc004810 2023-10-09T11:43:42.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800e870 con 0x7f4acc004810 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4ae883b700 1 -- 172.21.15.26:0/2109024737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800ec30 con 0x7f4acc004810 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2109024737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4acc004810 msgr2=0x7f4acc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2109024737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4acc004810 0x7f4acc004c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009c00 tx=0x7f4ad80091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aea03e700 1 -- 172.21.15.26:0/2109024737 reap_dead start 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2109024737 shutdown_connections 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2109024737 >> 172.21.15.26:0/2109024737 conn(0x7f4ae4070e30 msgr2=0x7f4ae40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2109024737 shutdown_connections 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.240+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2109024737 wait complete. 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.241+0000 7f4aebaa1700 1 Processor -- start 2023-10-09T11:43:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.241+0000 7f4aebaa1700 1 -- start start 2023-10-09T11:43:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4acc004810 0x7f4ae415bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae4155e90 0x7f4ae4156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40cbde0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae415d370 con 0x7f4ae4155e90 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aebaa1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41583b0 con 0x7f4acc004810 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49072/0 (socket says 172.21.15.26:49072) 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 -- 172.21.15.26:0/2876996106 learned_addr learned my addr 172.21.15.26:0/2876996106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae983d700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4acc004810 0x7f4ae415bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4aea03e700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae4155e90 0x7f4ae4156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 -- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4acc004810 msgr2=0x7f4ae415bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4acc004810 0x7f4ae415bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 -- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae4155e90 msgr2=0x7f4ae4156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae4155e90 0x7f4ae4156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.242+0000 7f4ae903c700 1 -- 172.21.15.26:0/2876996106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40c7ff0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4ae903c700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e4b0 tx=0x7f4ad801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8022070 con 0x7f4ae415c8b0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800e9e0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae415d090 con 0x7f4ae415c8b0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad801c680 con 0x7f4ae415c8b0 2023-10-09T11:43:42.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.243+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae4158040 con 0x7f4ae415c8b0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.244+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae4158540 con 0x7f4ae415c8b0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.244+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4ad801cab0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.245+0000 7f4ae1ffb700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 0x7f4ad00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.245+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ad8086270 con 0x7f4ae415c8b0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.245+0000 7f4ae983d700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 0x7f4ad00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.246+0000 7f4ae983d700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 0x7f4ad00697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4004e00 tx=0x7f4ad4006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.249+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad80530b0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.442+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae404c3c0 con 0x7f4ae415c8b0 2023-10-09T11:43:42.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.443+0000 7f4ae1ffb700 1 -- 172.21.15.26:0/2876996106 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f4ad8056650 con 0x7f4ae415c8b0 2023-10-09T11:43:42.444 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:42.445 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":165,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:39.689173+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 msgr2=0x7f4ad00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 0x7f4ad00697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4004e00 tx=0x7f4ad4006040 comp rx=0 tx=0).stop 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 msgr2=0x7f4ae40b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e4b0 tx=0x7f4ad801a000 comp rx=0 tx=0).stop 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 shutdown_connections 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae4155e90 0x7f4ae4156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4ad0067320 0x7f4ad00697d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4acc004810 0x7f4ae415bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 --2- 172.21.15.26:0/2876996106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ae415c8b0 0x7f4ae40b1f30 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 >> 172.21.15.26:0/2876996106 conn(0x7f4ae4070e30 msgr2=0x7f4ae40b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 shutdown_connections 2023-10-09T11:43:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.445+0000 7f4aebaa1700 1 -- 172.21.15.26:0/2876996106 wait complete. 2023-10-09T11:43:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:43:42.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:42.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 Processor -- start 2023-10-09T11:43:42.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 -- start start 2023-10-09T11:43:42.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f815a5d0 0x7fa7f8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f815ae40 con 0x7fa7f80cd9e0 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80d13f0 con 0x7fa7f815a5d0 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.578+0000 7fa7fd39a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f815ab60 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f815a5d0 0x7fa7f8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa7f80cd9e0 0x7fa7f8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34612/0 (socket says 172.21.15.26:34612) 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f67fc700 1 -- 172.21.15.26:0/1819938930 learned_addr learned my addr 172.21.15.26:0/1819938930 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/1819938930 >> v2:172.21.15.67:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 -- 172.21.15.26:0/1819938930 >> v2:172.21.15.67:3300/0 conn(0x7fa7f80cb5a0 msgr2=0x7fa7f80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 --2- 172.21.15.26:0/1819938930 >> v2:172.21.15.67:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 -- 172.21.15.26:0/1819938930 >> v1:172.21.15.26:6789/0 conn(0x7fa7f80cd9e0 legacy=0x7fa7f8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 -- 172.21.15.26:0/1819938930 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80ccf00 con 0x7fa7f815a5d0 2023-10-09T11:43:42.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/1819938930 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627984613 0 0) 0x7fa7f815ae40 con 0x7fa7f80cd9e0 2023-10-09T11:43:42.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f77fe700 1 --2- 172.21.15.26:0/1819938930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8156e90 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80098e0 tx=0x7fa7e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289fa4866f570f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/1819938930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8009e80 con 0x7fa7f815a5d0 2023-10-09T11:43:42.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/1819938930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e800b820 con 0x7fa7f815a5d0 2023-10-09T11:43:42.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.579+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/1819938930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800bba0 con 0x7fa7f815a5d0 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 -- 172.21.15.26:0/1819938930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f815a5d0 msgr2=0x7fa7f8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/1819938930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8156e90 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80098e0 tx=0x7fa7e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 -- 172.21.15.26:0/1819938930 shutdown_connections 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/1819938930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8156e90 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/1819938930 >> v2:172.21.15.67:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 -- 172.21.15.26:0/1819938930 >> 172.21.15.26:0/1819938930 conn(0x7fa7f8070e30 msgr2=0x7fa7f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 -- 172.21.15.26:0/1819938930 shutdown_connections 2023-10-09T11:43:42.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.580+0000 7fa7fd39a700 1 -- 172.21.15.26:0/1819938930 wait complete. 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.581+0000 7fa7fd39a700 1 Processor -- start 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.581+0000 7fa7fd39a700 1 -- start start 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7f80cd9e0 0x7fa7f8159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80b6500 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c9140 con 0x7fa7f815a5d0 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c9990 con 0x7fa7f80cd9e0 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49086/0 (socket says 172.21.15.26:49086) 2023-10-09T11:43:42.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2242621674 learned_addr learned my addr 172.21.15.26:0/2242621674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f77fe700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7f80cd9e0 0x7fa7f8159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7f80cd9e0 msgr2=0x7fa7f8159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7f80cd9e0 0x7fa7f8159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 msgr2=0x7fa7f8169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2242621674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8009420 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f77fe700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000e190 tx=0x7fa7f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000ee30 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0014420 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00147e0 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.582+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f80b6220 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.583+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f80c96a0 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.584+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f80c9c70 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.584+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7f0014b90 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.584+0000 7fa7eeffd700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.584+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7f00854a0 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.585+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.585+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 0x7fa7d80697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80cf120 tx=0x7fa7e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.589+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f0052130 con 0x7fa7f80cb5a0 2023-10-09T11:43:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.776+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7f80c9ad0 con 0x7fa7d8067320 2023-10-09T11:43:42.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.786+0000 7fa7eeffd700 1 -- 172.21.15.26:0/2242621674 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289838 (secure 0 0 0) 0x7fa7e00014f0 con 0x7fa7d8067320 2023-10-09T11:43:42.790 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 msgr2=0x7fa7d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 0x7fa7d80697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80cf120 tx=0x7fa7e0009040 comp rx=0 tx=0).stop 2023-10-09T11:43:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 msgr2=0x7fa7f8156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000e190 tx=0x7fa7f0009920 comp rx=0 tx=0).stop 2023-10-09T11:43:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 shutdown_connections 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f815a5d0 0x7fa7f8169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f8156c60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7d8067320 0x7fa7d80697d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 --2- 172.21.15.26:0/2242621674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7f80cd9e0 0x7fa7f8159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 >> 172.21.15.26:0/2242621674 conn(0x7fa7f8070e30 msgr2=0x7fa7f80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 shutdown_connections 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.788+0000 7fa7fd39a700 1 -- 172.21.15.26:0/2242621674 wait complete. 2023-10-09T11:43:42.793 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:43:42.802 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2023-10-09T11:43:41.226660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428556,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546164,"statfs":{"total":773094113280,"available":770607271936,"internally_reserved":0,"allocated":17903616,"data_stored":8634028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.543974"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723741+0000","last_change":"2023-10-09T11:43:38.717256+0000","last_active":"2023-10-09T11:43:38.723741+0000","last_peered":"2023-10-09T11:43:38.723741+0000","last_clean":"2023-10-09T11:43:38.723741+0000","last_became_active":"2023-10-09T11:43:38.716595+0000","last_became_peered":"2023-10-09T11:43:38.716595+0000","last_unstale":"2023-10-09T11:43:38.723741+0000","last_undegraded":"2023-10-09T11:43:38.723741+0000","last_fullsized":"2023-10-09T11:43:38.723741+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:51.582237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727798+0000","last_change":"2023-10-09T11:43:38.725816+0000","last_active":"2023-10-09T11:43:38.727798+0000","last_peered":"2023-10-09T11:43:38.727798+0000","last_clean":"2023-10-09T11:43:38.727798+0000","last_became_active":"2023-10-09T11:43:38.725484+0000","last_became_peered":"2023-10-09T11:43:38.725484+0000","last_unstale":"2023-10-09T11:43:38.727798+0000","last_undegraded":"2023-10-09T11:43:38.727798+0000","last_fullsized":"2023-10-09T11:43:38.727798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:21.308066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722046+0000","last_change":"2023-10-09T11:43:38.714076+0000","last_active":"2023-10-09T11:43:38.722046+0000","last_peered":"2023-10-09T11:43:38.722046+0000","last_clean":"2023-10-09T11:43:38.722046+0000","last_became_active":"2023-10-09T11:43:38.713790+0000","last_became_peered":"2023-10-09T11:43:38.713790+0000","last_unstale":"2023-10-09T11:43:38.722046+0000","last_undegraded":"2023-10-09T11:43:38.722046+0000","last_fullsized":"2023-10-09T11:43:38.722046+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:04.771537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715684+0000","last_change":"2023-10-09T11:43:38.715684+0000","last_active":"2023-10-09T11:43:38.715684+0000","last_peered":"2023-10-09T11:43:38.715684+0000","last_clean":"2023-10-09T11:43:38.715684+0000","last_became_active":"2023-10-09T11:43:38.713214+0000","last_became_peered":"2023-10-09T11:43:38.713214+0000","last_unstale":"2023-10-09T11:43:38.715684+0000","last_undegraded":"2023-10-09T11:43:38.715684+0000","last_fullsized":"2023-10-09T11:43:38.715684+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:58.459671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720949+0000","last_change":"2023-10-09T11:43:38.720949+0000","last_active":"2023-10-09T11:43:38.720949+0000","last_peered":"2023-10-09T11:43:38.720949+0000","last_clean":"2023-10-09T11:43:38.720949+0000","last_became_active":"2023-10-09T11:43:38.720673+0000","last_became_peered":"2023-10-09T11:43:38.720673+0000","last_unstale":"2023-10-09T11:43:38.720949+0000","last_undegraded":"2023-10-09T11:43:38.720949+0000","last_fullsized":"2023-10-09T11:43:38.720949+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:17.771576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714418+0000","last_change":"2023-10-09T11:43:38.714418+0000","last_active":"2023-10-09T11:43:38.714418+0000","last_peered":"2023-10-09T11:43:38.714418+0000","last_clean":"2023-10-09T11:43:38.714418+0000","last_became_active":"2023-10-09T11:43:38.714158+0000","last_became_peered":"2023-10-09T11:43:38.714158+0000","last_unstale":"2023-10-09T11:43:38.714418+0000","last_undegraded":"2023-10-09T11:43:38.714418+0000","last_fullsized":"2023-10-09T11:43:38.714418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:38.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722016+0000","last_change":"2023-10-09T11:43:38.713539+0000","last_active":"2023-10-09T11:43:38.722016+0000","last_peered":"2023-10-09T11:43:38.722016+0000","last_clean":"2023-10-09T11:43:38.722016+0000","last_became_active":"2023-10-09T11:43:38.708253+0000","last_became_peered":"2023-10-09T11:43:38.708253+0000","last_unstale":"2023-10-09T11:43:38.722016+0000","last_undegraded":"2023-10-09T11:43:38.722016+0000","last_fullsized":"2023-10-09T11:43:38.722016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:16.791051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720840+0000","last_change":"2023-10-09T11:43:38.720840+0000","last_active":"2023-10-09T11:43:38.720840+0000","last_peered":"2023-10-09T11:43:38.720840+0000","last_clean":"2023-10-09T11:43:38.720840+0000","last_became_active":"2023-10-09T11:43:38.720578+0000","last_became_peered":"2023-10-09T11:43:38.720578+0000","last_unstale":"2023-10-09T11:43:38.720840+0000","last_undegraded":"2023-10-09T11:43:38.720840+0000","last_fullsized":"2023-10-09T11:43:38.720840+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:10.746031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726103+0000","last_change":"2023-10-09T11:43:38.721424+0000","last_active":"2023-10-09T11:43:38.726103+0000","last_peered":"2023-10-09T11:43:38.726103+0000","last_clean":"2023-10-09T11:43:38.726103+0000","last_became_active":"2023-10-09T11:43:38.721087+0000","last_became_peered":"2023-10-09T11:43:38.721087+0000","last_unstale":"2023-10-09T11:43:38.726103+0000","last_undegraded":"2023-10-09T11:43:38.726103+0000","last_fullsized":"2023-10-09T11:43:38.726103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:54.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714329+0000","last_change":"2023-10-09T11:43:38.714329+0000","last_active":"2023-10-09T11:43:38.714329+0000","last_peered":"2023-10-09T11:43:38.714329+0000","last_clean":"2023-10-09T11:43:38.714329+0000","last_became_active":"2023-10-09T11:43:38.714067+0000","last_became_peered":"2023-10-09T11:43:38.714067+0000","last_unstale":"2023-10-09T11:43:38.714329+0000","last_undegraded":"2023-10-09T11:43:38.714329+0000","last_fullsized":"2023-10-09T11:43:38.714329+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:14.431778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722692+0000","last_change":"2023-10-09T11:43:38.718248+0000","last_active":"2023-10-09T11:43:38.722692+0000","last_peered":"2023-10-09T11:43:38.722692+0000","last_clean":"2023-10-09T11:43:38.722692+0000","last_became_active":"2023-10-09T11:43:38.717856+0000","last_became_peered":"2023-10-09T11:43:38.717856+0000","last_unstale":"2023-10-09T11:43:38.722692+0000","last_undegraded":"2023-10-09T11:43:38.722692+0000","last_fullsized":"2023-10-09T11:43:38.722692+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.823189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722750+0000","last_change":"2023-10-09T11:43:38.718451+0000","last_active":"2023-10-09T11:43:38.722750+0000","last_peered":"2023-10-09T11:43:38.722750+0000","last_clean":"2023-10-09T11:43:38.722750+0000","last_became_active":"2023-10-09T11:43:38.717454+0000","last_became_peered":"2023-10-09T11:43:38.717454+0000","last_unstale":"2023-10-09T11:43:38.722750+0000","last_undegraded":"2023-10-09T11:43:38.722750+0000","last_fullsized":"2023-10-09T11:43:38.722750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:51.673315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717739+0000","last_change":"2023-10-09T11:43:38.714767+0000","last_active":"2023-10-09T11:43:38.717739+0000","last_peered":"2023-10-09T11:43:38.717739+0000","last_clean":"2023-10-09T11:43:38.717739+0000","last_became_active":"2023-10-09T11:43:38.714505+0000","last_became_peered":"2023-10-09T11:43:38.714505+0000","last_unstale":"2023-10-09T11:43:38.717739+0000","last_undegraded":"2023-10-09T11:43:38.717739+0000","last_fullsized":"2023-10-09T11:43:38.717739+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:52.932030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710883+0000","last_change":"2023-10-09T11:43:38.708799+0000","last_active":"2023-10-09T11:43:38.710883+0000","last_peered":"2023-10-09T11:43:38.710883+0000","last_clean":"2023-10-09T11:43:38.710883+0000","last_became_active":"2023-10-09T11:43:38.705405+0000","last_became_peered":"2023-10-09T11:43:38.705405+0000","last_unstale":"2023-10-09T11:43:38.710883+0000","last_undegraded":"2023-10-09T11:43:38.710883+0000","last_fullsized":"2023-10-09T11:43:38.710883+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:51.673315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.707000+0000","last_change":"2023-10-09T11:43:38.707000+0000","last_active":"2023-10-09T11:43:38.707000+0000","last_peered":"2023-10-09T11:43:38.707000+0000","last_clean":"2023-10-09T11:43:38.707000+0000","last_became_active":"2023-10-09T11:43:38.706688+0000","last_became_peered":"2023-10-09T11:43:38.706688+0000","last_unstale":"2023-10-09T11:43:38.707000+0000","last_undegraded":"2023-10-09T11:43:38.707000+0000","last_fullsized":"2023-10-09T11:43:38.707000+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:11.768342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722664+0000","last_change":"2023-10-09T11:43:38.720058+0000","last_active":"2023-10-09T11:43:38.722664+0000","last_peered":"2023-10-09T11:43:38.722664+0000","last_clean":"2023-10-09T11:43:38.722664+0000","last_became_active":"2023-10-09T11:43:38.719535+0000","last_became_peered":"2023-10-09T11:43:38.719535+0000","last_unstale":"2023-10-09T11:43:38.722664+0000","last_undegraded":"2023-10-09T11:43:38.722664+0000","last_fullsized":"2023-10-09T11:43:38.722664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:04.621228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711083+0000","last_change":"2023-10-09T11:43:38.705132+0000","last_active":"2023-10-09T11:43:38.711083+0000","last_peered":"2023-10-09T11:43:38.711083+0000","last_clean":"2023-10-09T11:43:38.711083+0000","last_became_active":"2023-10-09T11:43:38.704861+0000","last_became_peered":"2023-10-09T11:43:38.704861+0000","last_unstale":"2023-10-09T11:43:38.711083+0000","last_undegraded":"2023-10-09T11:43:38.711083+0000","last_fullsized":"2023-10-09T11:43:38.711083+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:13.061510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720798+0000","last_change":"2023-10-09T11:43:38.720798+0000","last_active":"2023-10-09T11:43:38.720798+0000","last_peered":"2023-10-09T11:43:38.720798+0000","last_clean":"2023-10-09T11:43:38.720798+0000","last_became_active":"2023-10-09T11:43:38.720522+0000","last_became_peered":"2023-10-09T11:43:38.720522+0000","last_unstale":"2023-10-09T11:43:38.720798+0000","last_undegraded":"2023-10-09T11:43:38.720798+0000","last_fullsized":"2023-10-09T11:43:38.720798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:39.490545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.713597+0000","last_change":"2023-10-09T11:43:38.713597+0000","last_active":"2023-10-09T11:43:38.713597+0000","last_peered":"2023-10-09T11:43:38.713597+0000","last_clean":"2023-10-09T11:43:38.713597+0000","last_became_active":"2023-10-09T11:43:38.713198+0000","last_became_peered":"2023-10-09T11:43:38.713198+0000","last_unstale":"2023-10-09T11:43:38.713597+0000","last_undegraded":"2023-10-09T11:43:38.713597+0000","last_fullsized":"2023-10-09T11:43:38.713597+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:31.526613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.716958+0000","last_change":"2023-10-09T11:43:38.716958+0000","last_active":"2023-10-09T11:43:38.716958+0000","last_peered":"2023-10-09T11:43:38.716958+0000","last_clean":"2023-10-09T11:43:38.716958+0000","last_became_active":"2023-10-09T11:43:38.716043+0000","last_became_peered":"2023-10-09T11:43:38.716043+0000","last_unstale":"2023-10-09T11:43:38.716958+0000","last_undegraded":"2023-10-09T11:43:38.716958+0000","last_fullsized":"2023-10-09T11:43:38.716958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:07.570645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.708772+0000","last_change":"2023-10-09T11:43:38.708772+0000","last_active":"2023-10-09T11:43:38.708772+0000","last_peered":"2023-10-09T11:43:38.708772+0000","last_clean":"2023-10-09T11:43:38.708772+0000","last_became_active":"2023-10-09T11:43:38.707904+0000","last_became_peered":"2023-10-09T11:43:38.707904+0000","last_unstale":"2023-10-09T11:43:38.708772+0000","last_undegraded":"2023-10-09T11:43:38.708772+0000","last_fullsized":"2023-10-09T11:43:38.708772+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.976125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.719415+0000","last_change":"2023-10-09T11:43:38.719415+0000","last_active":"2023-10-09T11:43:38.719415+0000","last_peered":"2023-10-09T11:43:38.719415+0000","last_clean":"2023-10-09T11:43:38.719415+0000","last_became_active":"2023-10-09T11:43:38.719093+0000","last_became_peered":"2023-10-09T11:43:38.719093+0000","last_unstale":"2023-10-09T11:43:38.719415+0000","last_undegraded":"2023-10-09T11:43:38.719415+0000","last_fullsized":"2023-10-09T11:43:38.719415+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:48.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714564+0000","last_change":"2023-10-09T11:43:38.713678+0000","last_active":"2023-10-09T11:43:38.714564+0000","last_peered":"2023-10-09T11:43:38.714564+0000","last_clean":"2023-10-09T11:43:38.714564+0000","last_became_active":"2023-10-09T11:43:38.713395+0000","last_became_peered":"2023-10-09T11:43:38.713395+0000","last_unstale":"2023-10-09T11:43:38.714564+0000","last_undegraded":"2023-10-09T11:43:38.714564+0000","last_fullsized":"2023-10-09T11:43:38.714564+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:35.775931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.712284+0000","last_change":"2023-10-09T11:43:38.712284+0000","last_active":"2023-10-09T11:43:38.712284+0000","last_peered":"2023-10-09T11:43:38.712284+0000","last_clean":"2023-10-09T11:43:38.712284+0000","last_became_active":"2023-10-09T11:43:38.711932+0000","last_became_peered":"2023-10-09T11:43:38.711932+0000","last_unstale":"2023-10-09T11:43:38.712284+0000","last_undegraded":"2023-10-09T11:43:38.712284+0000","last_fullsized":"2023-10-09T11:43:38.712284+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:29.203153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723761+0000","last_change":"2023-10-09T11:43:38.717439+0000","last_active":"2023-10-09T11:43:38.723761+0000","last_peered":"2023-10-09T11:43:38.723761+0000","last_clean":"2023-10-09T11:43:38.723761+0000","last_became_active":"2023-10-09T11:43:38.716983+0000","last_became_peered":"2023-10-09T11:43:38.716983+0000","last_unstale":"2023-10-09T11:43:38.723761+0000","last_undegraded":"2023-10-09T11:43:38.723761+0000","last_fullsized":"2023-10-09T11:43:38.723761+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:05.843802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.707723+0000","last_change":"2023-10-09T11:43:38.707723+0000","last_active":"2023-10-09T11:43:38.707723+0000","last_peered":"2023-10-09T11:43:38.707723+0000","last_clean":"2023-10-09T11:43:38.707723+0000","last_became_active":"2023-10-09T11:43:38.707464+0000","last_became_peered":"2023-10-09T11:43:38.707464+0000","last_unstale":"2023-10-09T11:43:38.707723+0000","last_undegraded":"2023-10-09T11:43:38.707723+0000","last_fullsized":"2023-10-09T11:43:38.707723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.837243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724939+0000","last_change":"2023-10-09T11:43:38.720308+0000","last_active":"2023-10-09T11:43:38.724939+0000","last_peered":"2023-10-09T11:43:38.724939+0000","last_clean":"2023-10-09T11:43:38.724939+0000","last_became_active":"2023-10-09T11:43:38.719978+0000","last_became_peered":"2023-10-09T11:43:38.719978+0000","last_unstale":"2023-10-09T11:43:38.724939+0000","last_undegraded":"2023-10-09T11:43:38.724939+0000","last_fullsized":"2023-10-09T11:43:38.724939+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.197296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717126+0000","last_change":"2023-10-09T11:43:38.717126+0000","last_active":"2023-10-09T11:43:38.717126+0000","last_peered":"2023-10-09T11:43:38.717126+0000","last_clean":"2023-10-09T11:43:38.717126+0000","last_became_active":"2023-10-09T11:43:38.716686+0000","last_became_peered":"2023-10-09T11:43:38.716686+0000","last_unstale":"2023-10-09T11:43:38.717126+0000","last_undegraded":"2023-10-09T11:43:38.717126+0000","last_fullsized":"2023-10-09T11:43:38.717126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:50.132394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711181+0000","last_change":"2023-10-09T11:43:38.710522+0000","last_active":"2023-10-09T11:43:38.711181+0000","last_peered":"2023-10-09T11:43:38.711181+0000","last_clean":"2023-10-09T11:43:38.711181+0000","last_became_active":"2023-10-09T11:43:38.710242+0000","last_became_peered":"2023-10-09T11:43:38.710242+0000","last_unstale":"2023-10-09T11:43:38.711181+0000","last_undegraded":"2023-10-09T11:43:38.711181+0000","last_fullsized":"2023-10-09T11:43:38.711181+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:21.308066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714369+0000","last_change":"2023-10-09T11:43:38.712560+0000","last_active":"2023-10-09T11:43:38.714369+0000","last_peered":"2023-10-09T11:43:38.714369+0000","last_clean":"2023-10-09T11:43:38.714369+0000","last_became_active":"2023-10-09T11:43:38.712013+0000","last_became_peered":"2023-10-09T11:43:38.712013+0000","last_unstale":"2023-10-09T11:43:38.714369+0000","last_undegraded":"2023-10-09T11:43:38.714369+0000","last_fullsized":"2023-10-09T11:43:38.714369+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:39.490545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.712886+0000","last_change":"2023-10-09T11:43:38.712886+0000","last_active":"2023-10-09T11:43:38.712886+0000","last_peered":"2023-10-09T11:43:38.712886+0000","last_clean":"2023-10-09T11:43:38.712886+0000","last_became_active":"2023-10-09T11:43:38.712433+0000","last_became_peered":"2023-10-09T11:43:38.712433+0000","last_unstale":"2023-10-09T11:43:38.712886+0000","last_undegraded":"2023-10-09T11:43:38.712886+0000","last_fullsized":"2023-10-09T11:43:38.712886+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.412850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.706827+0000","last_change":"2023-10-09T11:43:38.706827+0000","last_active":"2023-10-09T11:43:38.706827+0000","last_peered":"2023-10-09T11:43:38.706827+0000","last_clean":"2023-10-09T11:43:38.706827+0000","last_became_active":"2023-10-09T11:43:38.706523+0000","last_became_peered":"2023-10-09T11:43:38.706523+0000","last_unstale":"2023-10-09T11:43:38.706827+0000","last_undegraded":"2023-10-09T11:43:38.706827+0000","last_fullsized":"2023-10-09T11:43:38.706827+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:02.256054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725246+0000","last_change":"2023-10-09T11:43:38.717609+0000","last_active":"2023-10-09T11:43:38.725246+0000","last_peered":"2023-10-09T11:43:38.725246+0000","last_clean":"2023-10-09T11:43:38.725246+0000","last_became_active":"2023-10-09T11:43:38.717275+0000","last_became_peered":"2023-10-09T11:43:38.717275+0000","last_unstale":"2023-10-09T11:43:38.725246+0000","last_undegraded":"2023-10-09T11:43:38.725246+0000","last_fullsized":"2023-10-09T11:43:38.725246+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:16.105561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"164'4","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714387+0000","last_change":"2023-10-09T11:43:37.705861+0000","last_active":"2023-10-09T11:43:38.714387+0000","last_peered":"2023-10-09T11:43:38.714387+0000","last_clean":"2023-10-09T11:43:38.714387+0000","last_became_active":"2023-10-09T11:43:37.705574+0000","last_became_peered":"2023-10-09T11:43:37.705574+0000","last_unstale":"2023-10-09T11:43:38.714387+0000","last_undegraded":"2023-10-09T11:43:38.714387+0000","last_fullsized":"2023-10-09T11:43:38.714387+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:53.536233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710801+0000","last_change":"2023-10-09T11:43:38.710801+0000","last_active":"2023-10-09T11:43:38.710801+0000","last_peered":"2023-10-09T11:43:38.710801+0000","last_clean":"2023-10-09T11:43:38.710801+0000","last_became_active":"2023-10-09T11:43:38.710510+0000","last_became_peered":"2023-10-09T11:43:38.710510+0000","last_unstale":"2023-10-09T11:43:38.710801+0000","last_undegraded":"2023-10-09T11:43:38.710801+0000","last_fullsized":"2023-10-09T11:43:38.710801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:07.350977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717962+0000","last_change":"2023-10-09T11:43:37.704593+0000","last_active":"2023-10-09T11:43:38.717962+0000","last_peered":"2023-10-09T11:43:38.717962+0000","last_clean":"2023-10-09T11:43:38.717962+0000","last_became_active":"2023-10-09T11:43:37.704274+0000","last_became_peered":"2023-10-09T11:43:37.704274+0000","last_unstale":"2023-10-09T11:43:38.717962+0000","last_undegraded":"2023-10-09T11:43:38.717962+0000","last_fullsized":"2023-10-09T11:43:38.717962+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720286+0000","last_change":"2023-10-09T11:43:38.716496+0000","last_active":"2023-10-09T11:43:38.720286+0000","last_peered":"2023-10-09T11:43:38.720286+0000","last_clean":"2023-10-09T11:43:38.720286+0000","last_became_active":"2023-10-09T11:43:38.716183+0000","last_became_peered":"2023-10-09T11:43:38.716183+0000","last_unstale":"2023-10-09T11:43:38.720286+0000","last_undegraded":"2023-10-09T11:43:38.720286+0000","last_fullsized":"2023-10-09T11:43:38.720286+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:56.991564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723510+0000","last_change":"2023-10-09T11:43:37.710210+0000","last_active":"2023-10-09T11:43:38.723510+0000","last_peered":"2023-10-09T11:43:38.723510+0000","last_clean":"2023-10-09T11:43:38.723510+0000","last_became_active":"2023-10-09T11:43:37.709909+0000","last_became_peered":"2023-10-09T11:43:37.709909+0000","last_unstale":"2023-10-09T11:43:38.723510+0000","last_undegraded":"2023-10-09T11:43:38.723510+0000","last_fullsized":"2023-10-09T11:43:38.723510+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714388+0000","last_change":"2023-10-09T11:43:38.712595+0000","last_active":"2023-10-09T11:43:38.714388+0000","last_peered":"2023-10-09T11:43:38.714388+0000","last_clean":"2023-10-09T11:43:38.714388+0000","last_became_active":"2023-10-09T11:43:38.712319+0000","last_became_peered":"2023-10-09T11:43:38.712319+0000","last_unstale":"2023-10-09T11:43:38.714388+0000","last_undegraded":"2023-10-09T11:43:38.714388+0000","last_fullsized":"2023-10-09T11:43:38.714388+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:38.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.696573+0000","last_change":"2023-10-09T11:43:37.703358+0000","last_active":"2023-10-09T11:43:38.696573+0000","last_peered":"2023-10-09T11:43:38.696573+0000","last_clean":"2023-10-09T11:43:38.696573+0000","last_became_active":"2023-10-09T11:43:37.702687+0000","last_became_peered":"2023-10-09T11:43:37.702687+0000","last_unstale":"2023-10-09T11:43:38.696573+0000","last_undegraded":"2023-10-09T11:43:38.696573+0000","last_fullsized":"2023-10-09T11:43:38.696573+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:27.020092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.709733+0000","last_change":"2023-10-09T11:43:38.709733+0000","last_active":"2023-10-09T11:43:38.709733+0000","last_peered":"2023-10-09T11:43:38.709733+0000","last_clean":"2023-10-09T11:43:38.709733+0000","last_became_active":"2023-10-09T11:43:38.709440+0000","last_became_peered":"2023-10-09T11:43:38.709440+0000","last_unstale":"2023-10-09T11:43:38.709733+0000","last_undegraded":"2023-10-09T11:43:38.709733+0000","last_fullsized":"2023-10-09T11:43:38.709733+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:33.918946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722119+0000","last_change":"2023-10-09T11:43:37.708114+0000","last_active":"2023-10-09T11:43:38.722119+0000","last_peered":"2023-10-09T11:43:38.722119+0000","last_clean":"2023-10-09T11:43:38.722119+0000","last_became_active":"2023-10-09T11:43:37.707619+0000","last_became_peered":"2023-10-09T11:43:37.707619+0000","last_unstale":"2023-10-09T11:43:38.722119+0000","last_undegraded":"2023-10-09T11:43:38.722119+0000","last_fullsized":"2023-10-09T11:43:38.722119+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.716819+0000","last_change":"2023-10-09T11:43:38.716819+0000","last_active":"2023-10-09T11:43:38.716819+0000","last_peered":"2023-10-09T11:43:38.716819+0000","last_clean":"2023-10-09T11:43:38.716819+0000","last_became_active":"2023-10-09T11:43:38.716540+0000","last_became_peered":"2023-10-09T11:43:38.716540+0000","last_unstale":"2023-10-09T11:43:38.716819+0000","last_undegraded":"2023-10-09T11:43:38.716819+0000","last_fullsized":"2023-10-09T11:43:38.716819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:24.770877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699173+0000","last_change":"2023-10-09T11:43:37.703140+0000","last_active":"2023-10-09T11:43:38.699173+0000","last_peered":"2023-10-09T11:43:38.699173+0000","last_clean":"2023-10-09T11:43:38.699173+0000","last_became_active":"2023-10-09T11:43:37.702805+0000","last_became_peered":"2023-10-09T11:43:37.702805+0000","last_unstale":"2023-10-09T11:43:38.699173+0000","last_undegraded":"2023-10-09T11:43:38.699173+0000","last_fullsized":"2023-10-09T11:43:38.699173+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:14.761390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717775+0000","last_change":"2023-10-09T11:43:38.716003+0000","last_active":"2023-10-09T11:43:38.717775+0000","last_peered":"2023-10-09T11:43:38.717775+0000","last_clean":"2023-10-09T11:43:38.717775+0000","last_became_active":"2023-10-09T11:43:38.715033+0000","last_became_peered":"2023-10-09T11:43:38.715033+0000","last_unstale":"2023-10-09T11:43:38.717775+0000","last_undegraded":"2023-10-09T11:43:38.717775+0000","last_fullsized":"2023-10-09T11:43:38.717775+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:40.071972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.706320+0000","last_change":"2023-10-09T11:43:37.704472+0000","last_active":"2023-10-09T11:43:37.706320+0000","last_peered":"2023-10-09T11:43:37.706320+0000","last_clean":"2023-10-09T11:43:37.706320+0000","last_became_active":"2023-10-09T11:43:37.703508+0000","last_became_peered":"2023-10-09T11:43:37.703508+0000","last_unstale":"2023-10-09T11:43:37.706320+0000","last_undegraded":"2023-10-09T11:43:37.706320+0000","last_fullsized":"2023-10-09T11:43:37.706320+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:16.764486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727719+0000","last_change":"2023-10-09T11:43:38.723719+0000","last_active":"2023-10-09T11:43:38.727719+0000","last_peered":"2023-10-09T11:43:38.727719+0000","last_clean":"2023-10-09T11:43:38.727719+0000","last_became_active":"2023-10-09T11:43:38.723430+0000","last_became_peered":"2023-10-09T11:43:38.723430+0000","last_unstale":"2023-10-09T11:43:38.727719+0000","last_undegraded":"2023-10-09T11:43:38.727719+0000","last_fullsized":"2023-10-09T11:43:38.727719+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:56.991564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.709145+0000","last_change":"2023-10-09T11:43:37.710024+0000","last_active":"2023-10-09T11:43:38.709145+0000","last_peered":"2023-10-09T11:43:38.709145+0000","last_clean":"2023-10-09T11:43:38.709145+0000","last_became_active":"2023-10-09T11:43:37.708586+0000","last_became_peered":"2023-10-09T11:43:37.708586+0000","last_unstale":"2023-10-09T11:43:38.709145+0000","last_undegraded":"2023-10-09T11:43:38.709145+0000","last_fullsized":"2023-10-09T11:43:38.709145+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:03.405760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727336+0000","last_change":"2023-10-09T11:43:38.722335+0000","last_active":"2023-10-09T11:43:38.727336+0000","last_peered":"2023-10-09T11:43:38.727336+0000","last_clean":"2023-10-09T11:43:38.727336+0000","last_became_active":"2023-10-09T11:43:38.722006+0000","last_became_peered":"2023-10-09T11:43:38.722006+0000","last_unstale":"2023-10-09T11:43:38.727336+0000","last_undegraded":"2023-10-09T11:43:38.727336+0000","last_fullsized":"2023-10-09T11:43:38.727336+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:37.545194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705026+0000","last_change":"2023-10-09T11:43:37.699340+0000","last_active":"2023-10-09T11:43:37.705026+0000","last_peered":"2023-10-09T11:43:37.705026+0000","last_clean":"2023-10-09T11:43:37.705026+0000","last_became_active":"2023-10-09T11:43:37.699041+0000","last_became_peered":"2023-10-09T11:43:37.699041+0000","last_unstale":"2023-10-09T11:43:37.705026+0000","last_undegraded":"2023-10-09T11:43:37.705026+0000","last_fullsized":"2023-10-09T11:43:37.705026+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:56.273587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711183+0000","last_change":"2023-10-09T11:43:38.709698+0000","last_active":"2023-10-09T11:43:38.711183+0000","last_peered":"2023-10-09T11:43:38.711183+0000","last_clean":"2023-10-09T11:43:38.711183+0000","last_became_active":"2023-10-09T11:43:38.709366+0000","last_became_peered":"2023-10-09T11:43:38.709366+0000","last_unstale":"2023-10-09T11:43:38.711183+0000","last_undegraded":"2023-10-09T11:43:38.711183+0000","last_fullsized":"2023-10-09T11:43:38.711183+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:04.621228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"164'3","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715571+0000","last_change":"2023-10-09T11:43:37.705229+0000","last_active":"2023-10-09T11:43:38.715571+0000","last_peered":"2023-10-09T11:43:38.715571+0000","last_clean":"2023-10-09T11:43:38.715571+0000","last_became_active":"2023-10-09T11:43:37.704950+0000","last_became_peered":"2023-10-09T11:43:37.704950+0000","last_unstale":"2023-10-09T11:43:38.715571+0000","last_undegraded":"2023-10-09T11:43:38.715571+0000","last_fullsized":"2023-10-09T11:43:38.715571+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:08.373941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724994+0000","last_change":"2023-10-09T11:43:38.721285+0000","last_active":"2023-10-09T11:43:38.724994+0000","last_peered":"2023-10-09T11:43:38.724994+0000","last_clean":"2023-10-09T11:43:38.724994+0000","last_became_active":"2023-10-09T11:43:38.721000+0000","last_became_peered":"2023-10-09T11:43:38.721000+0000","last_unstale":"2023-10-09T11:43:38.724994+0000","last_undegraded":"2023-10-09T11:43:38.724994+0000","last_fullsized":"2023-10-09T11:43:38.724994+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:01.915087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"164'6","reported_seq":15,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720585+0000","last_change":"2023-10-09T11:43:37.696512+0000","last_active":"2023-10-09T11:43:38.720585+0000","last_peered":"2023-10-09T11:43:38.720585+0000","last_clean":"2023-10-09T11:43:38.720585+0000","last_became_active":"2023-10-09T11:43:37.696224+0000","last_became_peered":"2023-10-09T11:43:37.696224+0000","last_unstale":"2023-10-09T11:43:38.720585+0000","last_undegraded":"2023-10-09T11:43:38.720585+0000","last_fullsized":"2023-10-09T11:43:38.720585+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:32.911856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.698165+0000","last_change":"2023-10-09T11:43:38.698165+0000","last_active":"2023-10-09T11:43:38.698165+0000","last_peered":"2023-10-09T11:43:38.698165+0000","last_clean":"2023-10-09T11:43:38.698165+0000","last_became_active":"2023-10-09T11:43:38.697855+0000","last_became_peered":"2023-10-09T11:43:38.697855+0000","last_unstale":"2023-10-09T11:43:38.698165+0000","last_undegraded":"2023-10-09T11:43:38.698165+0000","last_fullsized":"2023-10-09T11:43:38.698165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:43.604179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725417+0000","last_change":"2023-10-09T11:43:37.712981+0000","last_active":"2023-10-09T11:43:38.725417+0000","last_peered":"2023-10-09T11:43:38.725417+0000","last_clean":"2023-10-09T11:43:38.725417+0000","last_became_active":"2023-10-09T11:43:37.712716+0000","last_became_peered":"2023-10-09T11:43:37.712716+0000","last_unstale":"2023-10-09T11:43:38.725417+0000","last_undegraded":"2023-10-09T11:43:38.725417+0000","last_fullsized":"2023-10-09T11:43:38.725417+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:18.164806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725520+0000","last_change":"2023-10-09T11:43:38.719494+0000","last_active":"2023-10-09T11:43:38.725520+0000","last_peered":"2023-10-09T11:43:38.725520+0000","last_clean":"2023-10-09T11:43:38.725520+0000","last_became_active":"2023-10-09T11:43:38.718273+0000","last_became_peered":"2023-10-09T11:43:38.718273+0000","last_unstale":"2023-10-09T11:43:38.725520+0000","last_undegraded":"2023-10-09T11:43:38.725520+0000","last_fullsized":"2023-10-09T11:43:38.725520+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:48.321489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.704950+0000","last_change":"2023-10-09T11:43:37.699988+0000","last_active":"2023-10-09T11:43:37.704950+0000","last_peered":"2023-10-09T11:43:37.704950+0000","last_clean":"2023-10-09T11:43:37.704950+0000","last_became_active":"2023-10-09T11:43:37.699723+0000","last_became_peered":"2023-10-09T11:43:37.699723+0000","last_unstale":"2023-10-09T11:43:37.704950+0000","last_undegraded":"2023-10-09T11:43:37.704950+0000","last_fullsized":"2023-10-09T11:43:37.704950+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.956517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726070+0000","last_change":"2023-10-09T11:43:38.721161+0000","last_active":"2023-10-09T11:43:38.726070+0000","last_peered":"2023-10-09T11:43:38.726070+0000","last_clean":"2023-10-09T11:43:38.726070+0000","last_became_active":"2023-10-09T11:43:38.720874+0000","last_became_peered":"2023-10-09T11:43:38.720874+0000","last_unstale":"2023-10-09T11:43:38.726070+0000","last_undegraded":"2023-10-09T11:43:38.726070+0000","last_fullsized":"2023-10-09T11:43:38.726070+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:33.305532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705173+0000","last_change":"2023-10-09T11:43:37.703049+0000","last_active":"2023-10-09T11:43:37.705173+0000","last_peered":"2023-10-09T11:43:37.705173+0000","last_clean":"2023-10-09T11:43:37.705173+0000","last_became_active":"2023-10-09T11:43:37.702781+0000","last_became_peered":"2023-10-09T11:43:37.702781+0000","last_unstale":"2023-10-09T11:43:37.705173+0000","last_undegraded":"2023-10-09T11:43:37.705173+0000","last_fullsized":"2023-10-09T11:43:37.705173+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:06.740440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.713109+0000","last_change":"2023-10-09T11:43:38.711899+0000","last_active":"2023-10-09T11:43:38.713109+0000","last_peered":"2023-10-09T11:43:38.713109+0000","last_clean":"2023-10-09T11:43:38.713109+0000","last_became_active":"2023-10-09T11:43:38.711622+0000","last_became_peered":"2023-10-09T11:43:38.711622+0000","last_unstale":"2023-10-09T11:43:38.713109+0000","last_undegraded":"2023-10-09T11:43:38.713109+0000","last_fullsized":"2023-10-09T11:43:38.713109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:52.932030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722611+0000","last_change":"2023-10-09T11:43:37.706299+0000","last_active":"2023-10-09T11:43:38.722611+0000","last_peered":"2023-10-09T11:43:38.722611+0000","last_clean":"2023-10-09T11:43:38.722611+0000","last_became_active":"2023-10-09T11:43:37.705909+0000","last_became_peered":"2023-10-09T11:43:37.705909+0000","last_unstale":"2023-10-09T11:43:38.722611+0000","last_undegraded":"2023-10-09T11:43:38.722611+0000","last_fullsized":"2023-10-09T11:43:38.722611+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710943+0000","last_change":"2023-10-09T11:43:38.710943+0000","last_active":"2023-10-09T11:43:38.710943+0000","last_peered":"2023-10-09T11:43:38.710943+0000","last_clean":"2023-10-09T11:43:38.710943+0000","last_became_active":"2023-10-09T11:43:38.710663+0000","last_became_peered":"2023-10-09T11:43:38.710663+0000","last_unstale":"2023-10-09T11:43:38.710943+0000","last_undegraded":"2023-10-09T11:43:38.710943+0000","last_fullsized":"2023-10-09T11:43:38.710943+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:10.140288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722355+0000","last_change":"2023-10-09T11:43:37.714046+0000","last_active":"2023-10-09T11:43:38.722355+0000","last_peered":"2023-10-09T11:43:38.722355+0000","last_clean":"2023-10-09T11:43:38.722355+0000","last_became_active":"2023-10-09T11:43:37.713753+0000","last_became_peered":"2023-10-09T11:43:37.713753+0000","last_unstale":"2023-10-09T11:43:38.722355+0000","last_undegraded":"2023-10-09T11:43:38.722355+0000","last_fullsized":"2023-10-09T11:43:38.722355+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:44.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722661+0000","last_change":"2023-10-09T11:43:38.722661+0000","last_active":"2023-10-09T11:43:38.722661+0000","last_peered":"2023-10-09T11:43:38.722661+0000","last_clean":"2023-10-09T11:43:38.722661+0000","last_became_active":"2023-10-09T11:43:38.722338+0000","last_became_peered":"2023-10-09T11:43:38.722338+0000","last_unstale":"2023-10-09T11:43:38.722661+0000","last_undegraded":"2023-10-09T11:43:38.722661+0000","last_fullsized":"2023-10-09T11:43:38.722661+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:32.816842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.703597+0000","last_change":"2023-10-09T11:43:37.703810+0000","last_active":"2023-10-09T11:43:38.703597+0000","last_peered":"2023-10-09T11:43:38.703597+0000","last_clean":"2023-10-09T11:43:38.703597+0000","last_became_active":"2023-10-09T11:43:37.703493+0000","last_became_peered":"2023-10-09T11:43:37.703493+0000","last_unstale":"2023-10-09T11:43:38.703597+0000","last_undegraded":"2023-10-09T11:43:38.703597+0000","last_fullsized":"2023-10-09T11:43:38.703597+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:27.204312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717325+0000","last_change":"2023-10-09T11:43:38.706850+0000","last_active":"2023-10-09T11:43:38.717325+0000","last_peered":"2023-10-09T11:43:38.717325+0000","last_clean":"2023-10-09T11:43:38.717325+0000","last_became_active":"2023-10-09T11:43:38.706274+0000","last_became_peered":"2023-10-09T11:43:38.706274+0000","last_unstale":"2023-10-09T11:43:38.717325+0000","last_undegraded":"2023-10-09T11:43:38.717325+0000","last_fullsized":"2023-10-09T11:43:38.717325+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.556615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723659+0000","last_change":"2023-10-09T11:43:37.711291+0000","last_active":"2023-10-09T11:43:38.723659+0000","last_peered":"2023-10-09T11:43:38.723659+0000","last_clean":"2023-10-09T11:43:38.723659+0000","last_became_active":"2023-10-09T11:43:37.710470+0000","last_became_peered":"2023-10-09T11:43:37.710470+0000","last_unstale":"2023-10-09T11:43:38.723659+0000","last_undegraded":"2023-10-09T11:43:38.723659+0000","last_fullsized":"2023-10-09T11:43:38.723659+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:01.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.721715+0000","last_change":"2023-10-09T11:43:38.707671+0000","last_active":"2023-10-09T11:43:38.721715+0000","last_peered":"2023-10-09T11:43:38.721715+0000","last_clean":"2023-10-09T11:43:38.721715+0000","last_became_active":"2023-10-09T11:43:38.707374+0000","last_became_peered":"2023-10-09T11:43:38.707374+0000","last_unstale":"2023-10-09T11:43:38.721715+0000","last_undegraded":"2023-10-09T11:43:38.721715+0000","last_fullsized":"2023-10-09T11:43:38.721715+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:09.381031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705284+0000","last_change":"2023-10-09T11:43:37.703146+0000","last_active":"2023-10-09T11:43:37.705284+0000","last_peered":"2023-10-09T11:43:37.705284+0000","last_clean":"2023-10-09T11:43:37.705284+0000","last_became_active":"2023-10-09T11:43:37.702871+0000","last_became_peered":"2023-10-09T11:43:37.702871+0000","last_unstale":"2023-10-09T11:43:37.705284+0000","last_undegraded":"2023-10-09T11:43:37.705284+0000","last_fullsized":"2023-10-09T11:43:37.705284+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:55.190428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711841+0000","last_change":"2023-10-09T11:43:38.711841+0000","last_active":"2023-10-09T11:43:38.711841+0000","last_peered":"2023-10-09T11:43:38.711841+0000","last_clean":"2023-10-09T11:43:38.711841+0000","last_became_active":"2023-10-09T11:43:38.711553+0000","last_became_peered":"2023-10-09T11:43:38.711553+0000","last_unstale":"2023-10-09T11:43:38.711841+0000","last_undegraded":"2023-10-09T11:43:38.711841+0000","last_fullsized":"2023-10-09T11:43:38.711841+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:57.354042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723753+0000","last_change":"2023-10-09T11:43:37.707575+0000","last_active":"2023-10-09T11:43:38.723753+0000","last_peered":"2023-10-09T11:43:38.723753+0000","last_clean":"2023-10-09T11:43:38.723753+0000","last_became_active":"2023-10-09T11:43:37.707257+0000","last_became_peered":"2023-10-09T11:43:37.707257+0000","last_unstale":"2023-10-09T11:43:38.723753+0000","last_undegraded":"2023-10-09T11:43:38.723753+0000","last_fullsized":"2023-10-09T11:43:38.723753+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:11.431667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725548+0000","last_change":"2023-10-09T11:43:38.719664+0000","last_active":"2023-10-09T11:43:38.725548+0000","last_peered":"2023-10-09T11:43:38.725548+0000","last_clean":"2023-10-09T11:43:38.725548+0000","last_became_active":"2023-10-09T11:43:38.718966+0000","last_became_peered":"2023-10-09T11:43:38.718966+0000","last_unstale":"2023-10-09T11:43:38.725548+0000","last_undegraded":"2023-10-09T11:43:38.725548+0000","last_fullsized":"2023-10-09T11:43:38.725548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:38.736671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699475+0000","last_change":"2023-10-09T11:43:37.704134+0000","last_active":"2023-10-09T11:43:38.699475+0000","last_peered":"2023-10-09T11:43:38.699475+0000","last_clean":"2023-10-09T11:43:38.699475+0000","last_became_active":"2023-10-09T11:43:37.703873+0000","last_became_peered":"2023-10-09T11:43:37.703873+0000","last_unstale":"2023-10-09T11:43:38.699475+0000","last_undegraded":"2023-10-09T11:43:38.699475+0000","last_fullsized":"2023-10-09T11:43:38.699475+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710838+0000","last_change":"2023-10-09T11:43:38.710838+0000","last_active":"2023-10-09T11:43:38.710838+0000","last_peered":"2023-10-09T11:43:38.710838+0000","last_clean":"2023-10-09T11:43:38.710838+0000","last_became_active":"2023-10-09T11:43:38.710578+0000","last_became_peered":"2023-10-09T11:43:38.710578+0000","last_unstale":"2023-10-09T11:43:38.710838+0000","last_undegraded":"2023-10-09T11:43:38.710838+0000","last_fullsized":"2023-10-09T11:43:38.710838+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:45.044498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699275+0000","last_change":"2023-10-09T11:43:37.709800+0000","last_active":"2023-10-09T11:43:38.699275+0000","last_peered":"2023-10-09T11:43:38.699275+0000","last_clean":"2023-10-09T11:43:38.699275+0000","last_became_active":"2023-10-09T11:43:37.709534+0000","last_became_peered":"2023-10-09T11:43:37.709534+0000","last_unstale":"2023-10-09T11:43:38.699275+0000","last_undegraded":"2023-10-09T11:43:38.699275+0000","last_fullsized":"2023-10-09T11:43:38.699275+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717819+0000","last_change":"2023-10-09T11:43:38.717819+0000","last_active":"2023-10-09T11:43:38.717819+0000","last_peered":"2023-10-09T11:43:38.717819+0000","last_clean":"2023-10-09T11:43:38.717819+0000","last_became_active":"2023-10-09T11:43:38.714563+0000","last_became_peered":"2023-10-09T11:43:38.714563+0000","last_unstale":"2023-10-09T11:43:38.717819+0000","last_undegraded":"2023-10-09T11:43:38.717819+0000","last_fullsized":"2023-10-09T11:43:38.717819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:11.347718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.700471+0000","last_change":"2023-10-09T11:43:37.707190+0000","last_active":"2023-10-09T11:43:38.700471+0000","last_peered":"2023-10-09T11:43:38.700471+0000","last_clean":"2023-10-09T11:43:38.700471+0000","last_became_active":"2023-10-09T11:43:37.706885+0000","last_became_peered":"2023-10-09T11:43:37.706885+0000","last_unstale":"2023-10-09T11:43:38.700471+0000","last_undegraded":"2023-10-09T11:43:38.700471+0000","last_fullsized":"2023-10-09T11:43:38.700471+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:06.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715134+0000","last_change":"2023-10-09T11:43:38.715134+0000","last_active":"2023-10-09T11:43:38.715134+0000","last_peered":"2023-10-09T11:43:38.715134+0000","last_clean":"2023-10-09T11:43:38.715134+0000","last_became_active":"2023-10-09T11:43:38.714775+0000","last_became_peered":"2023-10-09T11:43:38.714775+0000","last_unstale":"2023-10-09T11:43:38.715134+0000","last_undegraded":"2023-10-09T11:43:38.715134+0000","last_fullsized":"2023-10-09T11:43:38.715134+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:04.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726152+0000","last_change":"2023-10-09T11:43:37.711289+0000","last_active":"2023-10-09T11:43:38.726152+0000","last_peered":"2023-10-09T11:43:38.726152+0000","last_clean":"2023-10-09T11:43:38.726152+0000","last_became_active":"2023-10-09T11:43:37.710997+0000","last_became_peered":"2023-10-09T11:43:37.710997+0000","last_unstale":"2023-10-09T11:43:38.726152+0000","last_undegraded":"2023-10-09T11:43:38.726152+0000","last_fullsized":"2023-10-09T11:43:38.726152+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:32.298442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725159+0000","last_change":"2023-10-09T11:43:38.716799+0000","last_active":"2023-10-09T11:43:38.725159+0000","last_peered":"2023-10-09T11:43:38.725159+0000","last_clean":"2023-10-09T11:43:38.725159+0000","last_became_active":"2023-10-09T11:43:38.715414+0000","last_became_peered":"2023-10-09T11:43:38.715414+0000","last_unstale":"2023-10-09T11:43:38.725159+0000","last_undegraded":"2023-10-09T11:43:38.725159+0000","last_fullsized":"2023-10-09T11:43:38.725159+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:33.064378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.705152+0000","last_change":"2023-10-09T11:43:37.709714+0000","last_active":"2023-10-09T11:43:38.705152+0000","last_peered":"2023-10-09T11:43:38.705152+0000","last_clean":"2023-10-09T11:43:38.705152+0000","last_became_active":"2023-10-09T11:43:37.708570+0000","last_became_peered":"2023-10-09T11:43:37.708570+0000","last_unstale":"2023-10-09T11:43:38.705152+0000","last_undegraded":"2023-10-09T11:43:38.705152+0000","last_fullsized":"2023-10-09T11:43:38.705152+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:54.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725126+0000","last_change":"2023-10-09T11:43:38.716507+0000","last_active":"2023-10-09T11:43:38.725126+0000","last_peered":"2023-10-09T11:43:38.725126+0000","last_clean":"2023-10-09T11:43:38.725126+0000","last_became_active":"2023-10-09T11:43:38.716231+0000","last_became_peered":"2023-10-09T11:43:38.716231+0000","last_unstale":"2023-10-09T11:43:38.725126+0000","last_undegraded":"2023-10-09T11:43:38.725126+0000","last_fullsized":"2023-10-09T11:43:38.725126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:15.255097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.706909+0000","last_change":"2023-10-09T11:43:37.709439+0000","last_active":"2023-10-09T11:43:38.706909+0000","last_peered":"2023-10-09T11:43:38.706909+0000","last_clean":"2023-10-09T11:43:38.706909+0000","last_became_active":"2023-10-09T11:43:37.709185+0000","last_became_peered":"2023-10-09T11:43:37.709185+0000","last_unstale":"2023-10-09T11:43:38.706909+0000","last_undegraded":"2023-10-09T11:43:38.706909+0000","last_fullsized":"2023-10-09T11:43:38.706909+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:00.558503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.705921+0000","last_change":"2023-10-09T11:43:38.705921+0000","last_active":"2023-10-09T11:43:38.705921+0000","last_peered":"2023-10-09T11:43:38.705921+0000","last_clean":"2023-10-09T11:43:38.705921+0000","last_became_active":"2023-10-09T11:43:38.705526+0000","last_became_peered":"2023-10-09T11:43:38.705526+0000","last_unstale":"2023-10-09T11:43:38.705921+0000","last_undegraded":"2023-10-09T11:43:38.705921+0000","last_fullsized":"2023-10-09T11:43:38.705921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:02.099658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.702740+0000","last_change":"2023-10-09T11:43:37.707237+0000","last_active":"2023-10-09T11:43:38.702740+0000","last_peered":"2023-10-09T11:43:38.702740+0000","last_clean":"2023-10-09T11:43:38.702740+0000","last_became_active":"2023-10-09T11:43:37.706939+0000","last_became_peered":"2023-10-09T11:43:37.706939+0000","last_unstale":"2023-10-09T11:43:38.702740+0000","last_undegraded":"2023-10-09T11:43:38.702740+0000","last_fullsized":"2023-10-09T11:43:38.702740+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717677+0000","last_change":"2023-10-09T11:43:38.713890+0000","last_active":"2023-10-09T11:43:38.717677+0000","last_peered":"2023-10-09T11:43:38.717677+0000","last_clean":"2023-10-09T11:43:38.717677+0000","last_became_active":"2023-10-09T11:43:38.713598+0000","last_became_peered":"2023-10-09T11:43:38.713598+0000","last_unstale":"2023-10-09T11:43:38.717677+0000","last_undegraded":"2023-10-09T11:43:38.717677+0000","last_fullsized":"2023-10-09T11:43:38.717677+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:13.061510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699060+0000","last_change":"2023-10-09T11:43:37.705573+0000","last_active":"2023-10-09T11:43:38.699060+0000","last_peered":"2023-10-09T11:43:38.699060+0000","last_clean":"2023-10-09T11:43:38.699060+0000","last_became_active":"2023-10-09T11:43:37.705275+0000","last_became_peered":"2023-10-09T11:43:37.705275+0000","last_unstale":"2023-10-09T11:43:38.699060+0000","last_undegraded":"2023-10-09T11:43:38.699060+0000","last_fullsized":"2023-10-09T11:43:38.699060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:06.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725494+0000","last_change":"2023-10-09T11:43:38.719275+0000","last_active":"2023-10-09T11:43:38.725494+0000","last_peered":"2023-10-09T11:43:38.725494+0000","last_clean":"2023-10-09T11:43:38.725494+0000","last_became_active":"2023-10-09T11:43:38.718202+0000","last_became_peered":"2023-10-09T11:43:38.718202+0000","last_unstale":"2023-10-09T11:43:38.725494+0000","last_undegraded":"2023-10-09T11:43:38.725494+0000","last_fullsized":"2023-10-09T11:43:38.725494+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.894255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.704931+0000","last_change":"2023-10-09T11:43:37.699442+0000","last_active":"2023-10-09T11:43:37.704931+0000","last_peered":"2023-10-09T11:43:37.704931+0000","last_clean":"2023-10-09T11:43:37.704931+0000","last_became_active":"2023-10-09T11:43:37.699129+0000","last_became_peered":"2023-10-09T11:43:37.699129+0000","last_unstale":"2023-10-09T11:43:37.704931+0000","last_undegraded":"2023-10-09T11:43:37.704931+0000","last_fullsized":"2023-10-09T11:43:37.704931+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:48.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724386+0000","last_change":"2023-10-09T11:43:38.715219+0000","last_active":"2023-10-09T11:43:38.724386+0000","last_peered":"2023-10-09T11:43:38.724386+0000","last_clean":"2023-10-09T11:43:38.724386+0000","last_became_active":"2023-10-09T11:43:38.714802+0000","last_became_peered":"2023-10-09T11:43:38.714802+0000","last_unstale":"2023-10-09T11:43:38.724386+0000","last_undegraded":"2023-10-09T11:43:38.724386+0000","last_fullsized":"2023-10-09T11:43:38.724386+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:07.747530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.710212+0000","last_change":"2023-10-09T11:43:37.709757+0000","last_active":"2023-10-09T11:43:37.710212+0000","last_peered":"2023-10-09T11:43:37.710212+0000","last_clean":"2023-10-09T11:43:37.710212+0000","last_became_active":"2023-10-09T11:43:37.709454+0000","last_became_peered":"2023-10-09T11:43:37.709454+0000","last_unstale":"2023-10-09T11:43:37.710212+0000","last_undegraded":"2023-10-09T11:43:37.710212+0000","last_fullsized":"2023-10-09T11:43:37.710212+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:13.549525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725012+0000","last_change":"2023-10-09T11:43:38.721375+0000","last_active":"2023-10-09T11:43:38.725012+0000","last_peered":"2023-10-09T11:43:38.725012+0000","last_clean":"2023-10-09T11:43:38.725012+0000","last_became_active":"2023-10-09T11:43:38.721079+0000","last_became_peered":"2023-10-09T11:43:38.721079+0000","last_unstale":"2023-10-09T11:43:38.725012+0000","last_undegraded":"2023-10-09T11:43:38.725012+0000","last_fullsized":"2023-10-09T11:43:38.725012+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:28.459233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.700610+0000","last_change":"2023-10-09T11:43:37.702815+0000","last_active":"2023-10-09T11:43:38.700610+0000","last_peered":"2023-10-09T11:43:38.700610+0000","last_clean":"2023-10-09T11:43:38.700610+0000","last_became_active":"2023-10-09T11:43:37.702515+0000","last_became_peered":"2023-10-09T11:43:37.702515+0000","last_unstale":"2023-10-09T11:43:38.700610+0000","last_undegraded":"2023-10-09T11:43:38.700610+0000","last_fullsized":"2023-10-09T11:43:38.700610+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727398+0000","last_change":"2023-10-09T11:43:38.723998+0000","last_active":"2023-10-09T11:43:38.727398+0000","last_peered":"2023-10-09T11:43:38.727398+0000","last_clean":"2023-10-09T11:43:38.727398+0000","last_became_active":"2023-10-09T11:43:38.723733+0000","last_became_peered":"2023-10-09T11:43:38.723733+0000","last_unstale":"2023-10-09T11:43:38.727398+0000","last_undegraded":"2023-10-09T11:43:38.727398+0000","last_fullsized":"2023-10-09T11:43:38.727398+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:07.570645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722042+0000","last_change":"2023-10-09T11:43:37.707750+0000","last_active":"2023-10-09T11:43:38.722042+0000","last_peered":"2023-10-09T11:43:38.722042+0000","last_clean":"2023-10-09T11:43:38.722042+0000","last_became_active":"2023-10-09T11:43:37.707480+0000","last_became_peered":"2023-10-09T11:43:37.707480+0000","last_unstale":"2023-10-09T11:43:38.722042+0000","last_undegraded":"2023-10-09T11:43:38.722042+0000","last_fullsized":"2023-10-09T11:43:38.722042+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":280,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.704425+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:43:38.704425+0000","last_peered":"2023-10-09T11:43:38.704425+0000","last_clean":"2023-10-09T11:43:38.704425+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:43:38.704425+0000","last_undegraded":"2023-10-09T11:43:38.704425+0000","last_fullsized":"2023-10-09T11:43:38.704425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.623},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.64200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":935071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.752}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":928817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.34899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.498},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304000,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067840,"statfs":{"total":96636764160,"available":96325468160,"internally_reserved":0,"allocated":2678784,"data_stored":1519739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.752},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.83099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":930319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.318}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574953,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":930333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.371},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.41799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.499},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.47299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542252,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":935569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.503}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.69199999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303424,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068416,"statfs":{"total":96636764160,"available":96326057984,"internally_reserved":0,"allocated":2088960,"data_stored":935015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.66800000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.627}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:43:42.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:42.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.960+0000 7f389ad5d700 1 Processor -- start 2023-10-09T11:43:42.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.960+0000 7f389ad5d700 1 -- start start 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38940b07d0 0x7f38940ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38940cf200 0x7f38940cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389415a280 con 0x7f38940b07d0 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389406e180 con 0x7f38940cf200 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f389ad5d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cd540 con 0x7f38940b0ba0 2023-10-09T11:43:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38940b07d0 0x7f38940ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38940b07d0 0x7f38940ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49088/0 (socket says 172.21.15.26:49088) 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 -- 172.21.15.26:0/4213844079 learned_addr learned my addr 172.21.15.26:0/4213844079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3893fff700 1 --2- 172.21.15.26:0/4213844079 >> v2:172.21.15.67:3300/0 conn(0x7f38940cf200 0x7f38940cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f38992fa700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 -- 172.21.15.26:0/4213844079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 msgr2=0x7f389406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 -- 172.21.15.26:0/4213844079 >> v2:172.21.15.67:3300/0 conn(0x7f38940cf200 msgr2=0x7f38940cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 --2- 172.21.15.26:0/4213844079 >> v2:172.21.15.67:3300/0 conn(0x7f38940cf200 0x7f38940cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.961+0000 7f3898af9700 1 -- 172.21.15.26:0/4213844079 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389406d850 con 0x7f38940b07d0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f3898af9700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940ccac0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f38940cab40 tx=0x7f388c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632acf859292fb0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f38937fe700 1 -- 172.21.15.26:0/4213844079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c005c10 con 0x7f38940b07d0 2023-10-09T11:43:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f38937fe700 1 -- 172.21.15.26:0/4213844079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c005d70 con 0x7f38940b07d0 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f38937fe700 1 -- 172.21.15.26:0/4213844079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00b910 con 0x7f38940b07d0 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 -- 172.21.15.26:0/4213844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 msgr2=0x7f38940ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940ccac0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f38940cab40 tx=0x7f388c009220 comp rx=0 tx=0).stop 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 -- 172.21.15.26:0/4213844079 shutdown_connections 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 --2- 172.21.15.26:0/4213844079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940ccac0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 --2- 172.21.15.26:0/4213844079 >> v2:172.21.15.67:3300/0 conn(0x7f38940cf200 0x7f38940cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 -- 172.21.15.26:0/4213844079 >> 172.21.15.26:0/4213844079 conn(0x7f389406ce80 msgr2=0x7f38940ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 -- 172.21.15.26:0/4213844079 shutdown_connections 2023-10-09T11:43:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.962+0000 7f389ad5d700 1 -- 172.21.15.26:0/4213844079 wait complete. 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.963+0000 7f389ad5d700 1 Processor -- start 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 -- start start 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38940cf200 0x7f3894068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389409c100 con 0x7f38940b07d0 2023-10-09T11:43:42.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894068b40 con 0x7f38940cf200 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f389ad5d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894068530 con 0x7f38940b0ba0 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f3898af9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f3898af9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49096/0 (socket says 172.21.15.26:49096) 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f3898af9700 1 -- 172.21.15.26:0/2083073667 learned_addr learned my addr 172.21.15.26:0/2083073667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f38992fa700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38940cf200 0x7f3894068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.964+0000 7f3893fff700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389409b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 -- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 msgr2=0x7f389409b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389409b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 -- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38940cf200 msgr2=0x7f3894068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38940cf200 0x7f3894068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 -- 172.21.15.26:0/2083073667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009480 con 0x7f38940b07d0 2023-10-09T11:43:42.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3898af9700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b3c0 tx=0x7f388c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c011740 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c020070 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389409be20 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c011af0 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.965+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941575a0 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.966+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894068390 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.966+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f388c022030 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.967+0000 7f3890ff9700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 0x7f38740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.967+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f388c086640 con 0x7f38940b07d0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.967+0000 7f3893fff700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 0x7f38740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.967+0000 7f3893fff700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 0x7f38740697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f38940c86d0 tx=0x7f38840097e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:42.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:42.971+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3894068390 con 0x7f38940b07d0 2023-10-09T11:43:43.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.159+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3894068c80 con 0x7f3874067320 2023-10-09T11:43:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.169+0000 7f3890ff9700 1 -- 172.21.15.26:0/2083073667 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289838 (secure 0 0 0) 0x7f3884007e10 con 0x7f3874067320 2023-10-09T11:43:43.173 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.171+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 msgr2=0x7f38740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.171+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 0x7f38740697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f38940c86d0 tx=0x7f38840097e0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.171+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 msgr2=0x7f38940c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.171+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b3c0 tx=0x7f388c016000 comp rx=0 tx=0).stop 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 shutdown_connections 2023-10-09T11:43:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38940cf200 0x7f3894068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38940b07d0 0x7f38940c6470 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3874067320 0x7f38740697d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 --2- 172.21.15.26:0/2083073667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38940b0ba0 0x7f389409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 >> 172.21.15.26:0/2083073667 conn(0x7f389406ce80 msgr2=0x7f38941590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 shutdown_connections 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.172+0000 7f389ad5d700 1 -- 172.21.15.26:0/2083073667 wait complete. 2023-10-09T11:43:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:43:43.185 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2023-10-09T11:43:41.226660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428556,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546164,"statfs":{"total":773094113280,"available":770607271936,"internally_reserved":0,"allocated":17903616,"data_stored":8634028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.543974"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723741+0000","last_change":"2023-10-09T11:43:38.717256+0000","last_active":"2023-10-09T11:43:38.723741+0000","last_peered":"2023-10-09T11:43:38.723741+0000","last_clean":"2023-10-09T11:43:38.723741+0000","last_became_active":"2023-10-09T11:43:38.716595+0000","last_became_peered":"2023-10-09T11:43:38.716595+0000","last_unstale":"2023-10-09T11:43:38.723741+0000","last_undegraded":"2023-10-09T11:43:38.723741+0000","last_fullsized":"2023-10-09T11:43:38.723741+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:51.582237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727798+0000","last_change":"2023-10-09T11:43:38.725816+0000","last_active":"2023-10-09T11:43:38.727798+0000","last_peered":"2023-10-09T11:43:38.727798+0000","last_clean":"2023-10-09T11:43:38.727798+0000","last_became_active":"2023-10-09T11:43:38.725484+0000","last_became_peered":"2023-10-09T11:43:38.725484+0000","last_unstale":"2023-10-09T11:43:38.727798+0000","last_undegraded":"2023-10-09T11:43:38.727798+0000","last_fullsized":"2023-10-09T11:43:38.727798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:21.308066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722046+0000","last_change":"2023-10-09T11:43:38.714076+0000","last_active":"2023-10-09T11:43:38.722046+0000","last_peered":"2023-10-09T11:43:38.722046+0000","last_clean":"2023-10-09T11:43:38.722046+0000","last_became_active":"2023-10-09T11:43:38.713790+0000","last_became_peered":"2023-10-09T11:43:38.713790+0000","last_unstale":"2023-10-09T11:43:38.722046+0000","last_undegraded":"2023-10-09T11:43:38.722046+0000","last_fullsized":"2023-10-09T11:43:38.722046+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:04.771537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715684+0000","last_change":"2023-10-09T11:43:38.715684+0000","last_active":"2023-10-09T11:43:38.715684+0000","last_peered":"2023-10-09T11:43:38.715684+0000","last_clean":"2023-10-09T11:43:38.715684+0000","last_became_active":"2023-10-09T11:43:38.713214+0000","last_became_peered":"2023-10-09T11:43:38.713214+0000","last_unstale":"2023-10-09T11:43:38.715684+0000","last_undegraded":"2023-10-09T11:43:38.715684+0000","last_fullsized":"2023-10-09T11:43:38.715684+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:58.459671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720949+0000","last_change":"2023-10-09T11:43:38.720949+0000","last_active":"2023-10-09T11:43:38.720949+0000","last_peered":"2023-10-09T11:43:38.720949+0000","last_clean":"2023-10-09T11:43:38.720949+0000","last_became_active":"2023-10-09T11:43:38.720673+0000","last_became_peered":"2023-10-09T11:43:38.720673+0000","last_unstale":"2023-10-09T11:43:38.720949+0000","last_undegraded":"2023-10-09T11:43:38.720949+0000","last_fullsized":"2023-10-09T11:43:38.720949+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:17.771576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714418+0000","last_change":"2023-10-09T11:43:38.714418+0000","last_active":"2023-10-09T11:43:38.714418+0000","last_peered":"2023-10-09T11:43:38.714418+0000","last_clean":"2023-10-09T11:43:38.714418+0000","last_became_active":"2023-10-09T11:43:38.714158+0000","last_became_peered":"2023-10-09T11:43:38.714158+0000","last_unstale":"2023-10-09T11:43:38.714418+0000","last_undegraded":"2023-10-09T11:43:38.714418+0000","last_fullsized":"2023-10-09T11:43:38.714418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:38.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722016+0000","last_change":"2023-10-09T11:43:38.713539+0000","last_active":"2023-10-09T11:43:38.722016+0000","last_peered":"2023-10-09T11:43:38.722016+0000","last_clean":"2023-10-09T11:43:38.722016+0000","last_became_active":"2023-10-09T11:43:38.708253+0000","last_became_peered":"2023-10-09T11:43:38.708253+0000","last_unstale":"2023-10-09T11:43:38.722016+0000","last_undegraded":"2023-10-09T11:43:38.722016+0000","last_fullsized":"2023-10-09T11:43:38.722016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:16.791051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720840+0000","last_change":"2023-10-09T11:43:38.720840+0000","last_active":"2023-10-09T11:43:38.720840+0000","last_peered":"2023-10-09T11:43:38.720840+0000","last_clean":"2023-10-09T11:43:38.720840+0000","last_became_active":"2023-10-09T11:43:38.720578+0000","last_became_peered":"2023-10-09T11:43:38.720578+0000","last_unstale":"2023-10-09T11:43:38.720840+0000","last_undegraded":"2023-10-09T11:43:38.720840+0000","last_fullsized":"2023-10-09T11:43:38.720840+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:10.746031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726103+0000","last_change":"2023-10-09T11:43:38.721424+0000","last_active":"2023-10-09T11:43:38.726103+0000","last_peered":"2023-10-09T11:43:38.726103+0000","last_clean":"2023-10-09T11:43:38.726103+0000","last_became_active":"2023-10-09T11:43:38.721087+0000","last_became_peered":"2023-10-09T11:43:38.721087+0000","last_unstale":"2023-10-09T11:43:38.726103+0000","last_undegraded":"2023-10-09T11:43:38.726103+0000","last_fullsized":"2023-10-09T11:43:38.726103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:54.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714329+0000","last_change":"2023-10-09T11:43:38.714329+0000","last_active":"2023-10-09T11:43:38.714329+0000","last_peered":"2023-10-09T11:43:38.714329+0000","last_clean":"2023-10-09T11:43:38.714329+0000","last_became_active":"2023-10-09T11:43:38.714067+0000","last_became_peered":"2023-10-09T11:43:38.714067+0000","last_unstale":"2023-10-09T11:43:38.714329+0000","last_undegraded":"2023-10-09T11:43:38.714329+0000","last_fullsized":"2023-10-09T11:43:38.714329+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:14.431778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722692+0000","last_change":"2023-10-09T11:43:38.718248+0000","last_active":"2023-10-09T11:43:38.722692+0000","last_peered":"2023-10-09T11:43:38.722692+0000","last_clean":"2023-10-09T11:43:38.722692+0000","last_became_active":"2023-10-09T11:43:38.717856+0000","last_became_peered":"2023-10-09T11:43:38.717856+0000","last_unstale":"2023-10-09T11:43:38.722692+0000","last_undegraded":"2023-10-09T11:43:38.722692+0000","last_fullsized":"2023-10-09T11:43:38.722692+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:34.823189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722750+0000","last_change":"2023-10-09T11:43:38.718451+0000","last_active":"2023-10-09T11:43:38.722750+0000","last_peered":"2023-10-09T11:43:38.722750+0000","last_clean":"2023-10-09T11:43:38.722750+0000","last_became_active":"2023-10-09T11:43:38.717454+0000","last_became_peered":"2023-10-09T11:43:38.717454+0000","last_unstale":"2023-10-09T11:43:38.722750+0000","last_undegraded":"2023-10-09T11:43:38.722750+0000","last_fullsized":"2023-10-09T11:43:38.722750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:51.673315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717739+0000","last_change":"2023-10-09T11:43:38.714767+0000","last_active":"2023-10-09T11:43:38.717739+0000","last_peered":"2023-10-09T11:43:38.717739+0000","last_clean":"2023-10-09T11:43:38.717739+0000","last_became_active":"2023-10-09T11:43:38.714505+0000","last_became_peered":"2023-10-09T11:43:38.714505+0000","last_unstale":"2023-10-09T11:43:38.717739+0000","last_undegraded":"2023-10-09T11:43:38.717739+0000","last_fullsized":"2023-10-09T11:43:38.717739+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:52.932030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710883+0000","last_change":"2023-10-09T11:43:38.708799+0000","last_active":"2023-10-09T11:43:38.710883+0000","last_peered":"2023-10-09T11:43:38.710883+0000","last_clean":"2023-10-09T11:43:38.710883+0000","last_became_active":"2023-10-09T11:43:38.705405+0000","last_became_peered":"2023-10-09T11:43:38.705405+0000","last_unstale":"2023-10-09T11:43:38.710883+0000","last_undegraded":"2023-10-09T11:43:38.710883+0000","last_fullsized":"2023-10-09T11:43:38.710883+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:51.673315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.707000+0000","last_change":"2023-10-09T11:43:38.707000+0000","last_active":"2023-10-09T11:43:38.707000+0000","last_peered":"2023-10-09T11:43:38.707000+0000","last_clean":"2023-10-09T11:43:38.707000+0000","last_became_active":"2023-10-09T11:43:38.706688+0000","last_became_peered":"2023-10-09T11:43:38.706688+0000","last_unstale":"2023-10-09T11:43:38.707000+0000","last_undegraded":"2023-10-09T11:43:38.707000+0000","last_fullsized":"2023-10-09T11:43:38.707000+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:11.768342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722664+0000","last_change":"2023-10-09T11:43:38.720058+0000","last_active":"2023-10-09T11:43:38.722664+0000","last_peered":"2023-10-09T11:43:38.722664+0000","last_clean":"2023-10-09T11:43:38.722664+0000","last_became_active":"2023-10-09T11:43:38.719535+0000","last_became_peered":"2023-10-09T11:43:38.719535+0000","last_unstale":"2023-10-09T11:43:38.722664+0000","last_undegraded":"2023-10-09T11:43:38.722664+0000","last_fullsized":"2023-10-09T11:43:38.722664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:04.621228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711083+0000","last_change":"2023-10-09T11:43:38.705132+0000","last_active":"2023-10-09T11:43:38.711083+0000","last_peered":"2023-10-09T11:43:38.711083+0000","last_clean":"2023-10-09T11:43:38.711083+0000","last_became_active":"2023-10-09T11:43:38.704861+0000","last_became_peered":"2023-10-09T11:43:38.704861+0000","last_unstale":"2023-10-09T11:43:38.711083+0000","last_undegraded":"2023-10-09T11:43:38.711083+0000","last_fullsized":"2023-10-09T11:43:38.711083+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:13.061510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720798+0000","last_change":"2023-10-09T11:43:38.720798+0000","last_active":"2023-10-09T11:43:38.720798+0000","last_peered":"2023-10-09T11:43:38.720798+0000","last_clean":"2023-10-09T11:43:38.720798+0000","last_became_active":"2023-10-09T11:43:38.720522+0000","last_became_peered":"2023-10-09T11:43:38.720522+0000","last_unstale":"2023-10-09T11:43:38.720798+0000","last_undegraded":"2023-10-09T11:43:38.720798+0000","last_fullsized":"2023-10-09T11:43:38.720798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:39.490545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.713597+0000","last_change":"2023-10-09T11:43:38.713597+0000","last_active":"2023-10-09T11:43:38.713597+0000","last_peered":"2023-10-09T11:43:38.713597+0000","last_clean":"2023-10-09T11:43:38.713597+0000","last_became_active":"2023-10-09T11:43:38.713198+0000","last_became_peered":"2023-10-09T11:43:38.713198+0000","last_unstale":"2023-10-09T11:43:38.713597+0000","last_undegraded":"2023-10-09T11:43:38.713597+0000","last_fullsized":"2023-10-09T11:43:38.713597+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:31.526613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.716958+0000","last_change":"2023-10-09T11:43:38.716958+0000","last_active":"2023-10-09T11:43:38.716958+0000","last_peered":"2023-10-09T11:43:38.716958+0000","last_clean":"2023-10-09T11:43:38.716958+0000","last_became_active":"2023-10-09T11:43:38.716043+0000","last_became_peered":"2023-10-09T11:43:38.716043+0000","last_unstale":"2023-10-09T11:43:38.716958+0000","last_undegraded":"2023-10-09T11:43:38.716958+0000","last_fullsized":"2023-10-09T11:43:38.716958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:07.570645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.708772+0000","last_change":"2023-10-09T11:43:38.708772+0000","last_active":"2023-10-09T11:43:38.708772+0000","last_peered":"2023-10-09T11:43:38.708772+0000","last_clean":"2023-10-09T11:43:38.708772+0000","last_became_active":"2023-10-09T11:43:38.707904+0000","last_became_peered":"2023-10-09T11:43:38.707904+0000","last_unstale":"2023-10-09T11:43:38.708772+0000","last_undegraded":"2023-10-09T11:43:38.708772+0000","last_fullsized":"2023-10-09T11:43:38.708772+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.976125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.719415+0000","last_change":"2023-10-09T11:43:38.719415+0000","last_active":"2023-10-09T11:43:38.719415+0000","last_peered":"2023-10-09T11:43:38.719415+0000","last_clean":"2023-10-09T11:43:38.719415+0000","last_became_active":"2023-10-09T11:43:38.719093+0000","last_became_peered":"2023-10-09T11:43:38.719093+0000","last_unstale":"2023-10-09T11:43:38.719415+0000","last_undegraded":"2023-10-09T11:43:38.719415+0000","last_fullsized":"2023-10-09T11:43:38.719415+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:48.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714564+0000","last_change":"2023-10-09T11:43:38.713678+0000","last_active":"2023-10-09T11:43:38.714564+0000","last_peered":"2023-10-09T11:43:38.714564+0000","last_clean":"2023-10-09T11:43:38.714564+0000","last_became_active":"2023-10-09T11:43:38.713395+0000","last_became_peered":"2023-10-09T11:43:38.713395+0000","last_unstale":"2023-10-09T11:43:38.714564+0000","last_undegraded":"2023-10-09T11:43:38.714564+0000","last_fullsized":"2023-10-09T11:43:38.714564+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:35.775931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.712284+0000","last_change":"2023-10-09T11:43:38.712284+0000","last_active":"2023-10-09T11:43:38.712284+0000","last_peered":"2023-10-09T11:43:38.712284+0000","last_clean":"2023-10-09T11:43:38.712284+0000","last_became_active":"2023-10-09T11:43:38.711932+0000","last_became_peered":"2023-10-09T11:43:38.711932+0000","last_unstale":"2023-10-09T11:43:38.712284+0000","last_undegraded":"2023-10-09T11:43:38.712284+0000","last_fullsized":"2023-10-09T11:43:38.712284+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:29.203153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723761+0000","last_change":"2023-10-09T11:43:38.717439+0000","last_active":"2023-10-09T11:43:38.723761+0000","last_peered":"2023-10-09T11:43:38.723761+0000","last_clean":"2023-10-09T11:43:38.723761+0000","last_became_active":"2023-10-09T11:43:38.716983+0000","last_became_peered":"2023-10-09T11:43:38.716983+0000","last_unstale":"2023-10-09T11:43:38.723761+0000","last_undegraded":"2023-10-09T11:43:38.723761+0000","last_fullsized":"2023-10-09T11:43:38.723761+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:05.843802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.707723+0000","last_change":"2023-10-09T11:43:38.707723+0000","last_active":"2023-10-09T11:43:38.707723+0000","last_peered":"2023-10-09T11:43:38.707723+0000","last_clean":"2023-10-09T11:43:38.707723+0000","last_became_active":"2023-10-09T11:43:38.707464+0000","last_became_peered":"2023-10-09T11:43:38.707464+0000","last_unstale":"2023-10-09T11:43:38.707723+0000","last_undegraded":"2023-10-09T11:43:38.707723+0000","last_fullsized":"2023-10-09T11:43:38.707723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.837243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724939+0000","last_change":"2023-10-09T11:43:38.720308+0000","last_active":"2023-10-09T11:43:38.724939+0000","last_peered":"2023-10-09T11:43:38.724939+0000","last_clean":"2023-10-09T11:43:38.724939+0000","last_became_active":"2023-10-09T11:43:38.719978+0000","last_became_peered":"2023-10-09T11:43:38.719978+0000","last_unstale":"2023-10-09T11:43:38.724939+0000","last_undegraded":"2023-10-09T11:43:38.724939+0000","last_fullsized":"2023-10-09T11:43:38.724939+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.197296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717126+0000","last_change":"2023-10-09T11:43:38.717126+0000","last_active":"2023-10-09T11:43:38.717126+0000","last_peered":"2023-10-09T11:43:38.717126+0000","last_clean":"2023-10-09T11:43:38.717126+0000","last_became_active":"2023-10-09T11:43:38.716686+0000","last_became_peered":"2023-10-09T11:43:38.716686+0000","last_unstale":"2023-10-09T11:43:38.717126+0000","last_undegraded":"2023-10-09T11:43:38.717126+0000","last_fullsized":"2023-10-09T11:43:38.717126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:50.132394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711181+0000","last_change":"2023-10-09T11:43:38.710522+0000","last_active":"2023-10-09T11:43:38.711181+0000","last_peered":"2023-10-09T11:43:38.711181+0000","last_clean":"2023-10-09T11:43:38.711181+0000","last_became_active":"2023-10-09T11:43:38.710242+0000","last_became_peered":"2023-10-09T11:43:38.710242+0000","last_unstale":"2023-10-09T11:43:38.711181+0000","last_undegraded":"2023-10-09T11:43:38.711181+0000","last_fullsized":"2023-10-09T11:43:38.711181+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:21.308066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714369+0000","last_change":"2023-10-09T11:43:38.712560+0000","last_active":"2023-10-09T11:43:38.714369+0000","last_peered":"2023-10-09T11:43:38.714369+0000","last_clean":"2023-10-09T11:43:38.714369+0000","last_became_active":"2023-10-09T11:43:38.712013+0000","last_became_peered":"2023-10-09T11:43:38.712013+0000","last_unstale":"2023-10-09T11:43:38.714369+0000","last_undegraded":"2023-10-09T11:43:38.714369+0000","last_fullsized":"2023-10-09T11:43:38.714369+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:39.490545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.712886+0000","last_change":"2023-10-09T11:43:38.712886+0000","last_active":"2023-10-09T11:43:38.712886+0000","last_peered":"2023-10-09T11:43:38.712886+0000","last_clean":"2023-10-09T11:43:38.712886+0000","last_became_active":"2023-10-09T11:43:38.712433+0000","last_became_peered":"2023-10-09T11:43:38.712433+0000","last_unstale":"2023-10-09T11:43:38.712886+0000","last_undegraded":"2023-10-09T11:43:38.712886+0000","last_fullsized":"2023-10-09T11:43:38.712886+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:04.412850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.706827+0000","last_change":"2023-10-09T11:43:38.706827+0000","last_active":"2023-10-09T11:43:38.706827+0000","last_peered":"2023-10-09T11:43:38.706827+0000","last_clean":"2023-10-09T11:43:38.706827+0000","last_became_active":"2023-10-09T11:43:38.706523+0000","last_became_peered":"2023-10-09T11:43:38.706523+0000","last_unstale":"2023-10-09T11:43:38.706827+0000","last_undegraded":"2023-10-09T11:43:38.706827+0000","last_fullsized":"2023-10-09T11:43:38.706827+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:02.256054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725246+0000","last_change":"2023-10-09T11:43:38.717609+0000","last_active":"2023-10-09T11:43:38.725246+0000","last_peered":"2023-10-09T11:43:38.725246+0000","last_clean":"2023-10-09T11:43:38.725246+0000","last_became_active":"2023-10-09T11:43:38.717275+0000","last_became_peered":"2023-10-09T11:43:38.717275+0000","last_unstale":"2023-10-09T11:43:38.725246+0000","last_undegraded":"2023-10-09T11:43:38.725246+0000","last_fullsized":"2023-10-09T11:43:38.725246+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:16.105561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"164'4","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714387+0000","last_change":"2023-10-09T11:43:37.705861+0000","last_active":"2023-10-09T11:43:38.714387+0000","last_peered":"2023-10-09T11:43:38.714387+0000","last_clean":"2023-10-09T11:43:38.714387+0000","last_became_active":"2023-10-09T11:43:37.705574+0000","last_became_peered":"2023-10-09T11:43:37.705574+0000","last_unstale":"2023-10-09T11:43:38.714387+0000","last_undegraded":"2023-10-09T11:43:38.714387+0000","last_fullsized":"2023-10-09T11:43:38.714387+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:53.536233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710801+0000","last_change":"2023-10-09T11:43:38.710801+0000","last_active":"2023-10-09T11:43:38.710801+0000","last_peered":"2023-10-09T11:43:38.710801+0000","last_clean":"2023-10-09T11:43:38.710801+0000","last_became_active":"2023-10-09T11:43:38.710510+0000","last_became_peered":"2023-10-09T11:43:38.710510+0000","last_unstale":"2023-10-09T11:43:38.710801+0000","last_undegraded":"2023-10-09T11:43:38.710801+0000","last_fullsized":"2023-10-09T11:43:38.710801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:07.350977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717962+0000","last_change":"2023-10-09T11:43:37.704593+0000","last_active":"2023-10-09T11:43:38.717962+0000","last_peered":"2023-10-09T11:43:38.717962+0000","last_clean":"2023-10-09T11:43:38.717962+0000","last_became_active":"2023-10-09T11:43:37.704274+0000","last_became_peered":"2023-10-09T11:43:37.704274+0000","last_unstale":"2023-10-09T11:43:38.717962+0000","last_undegraded":"2023-10-09T11:43:38.717962+0000","last_fullsized":"2023-10-09T11:43:38.717962+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720286+0000","last_change":"2023-10-09T11:43:38.716496+0000","last_active":"2023-10-09T11:43:38.720286+0000","last_peered":"2023-10-09T11:43:38.720286+0000","last_clean":"2023-10-09T11:43:38.720286+0000","last_became_active":"2023-10-09T11:43:38.716183+0000","last_became_peered":"2023-10-09T11:43:38.716183+0000","last_unstale":"2023-10-09T11:43:38.720286+0000","last_undegraded":"2023-10-09T11:43:38.720286+0000","last_fullsized":"2023-10-09T11:43:38.720286+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:56.991564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723510+0000","last_change":"2023-10-09T11:43:37.710210+0000","last_active":"2023-10-09T11:43:38.723510+0000","last_peered":"2023-10-09T11:43:38.723510+0000","last_clean":"2023-10-09T11:43:38.723510+0000","last_became_active":"2023-10-09T11:43:37.709909+0000","last_became_peered":"2023-10-09T11:43:37.709909+0000","last_unstale":"2023-10-09T11:43:38.723510+0000","last_undegraded":"2023-10-09T11:43:38.723510+0000","last_fullsized":"2023-10-09T11:43:38.723510+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.714388+0000","last_change":"2023-10-09T11:43:38.712595+0000","last_active":"2023-10-09T11:43:38.714388+0000","last_peered":"2023-10-09T11:43:38.714388+0000","last_clean":"2023-10-09T11:43:38.714388+0000","last_became_active":"2023-10-09T11:43:38.712319+0000","last_became_peered":"2023-10-09T11:43:38.712319+0000","last_unstale":"2023-10-09T11:43:38.714388+0000","last_undegraded":"2023-10-09T11:43:38.714388+0000","last_fullsized":"2023-10-09T11:43:38.714388+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:38.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"164'1","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.696573+0000","last_change":"2023-10-09T11:43:37.703358+0000","last_active":"2023-10-09T11:43:38.696573+0000","last_peered":"2023-10-09T11:43:38.696573+0000","last_clean":"2023-10-09T11:43:38.696573+0000","last_became_active":"2023-10-09T11:43:37.702687+0000","last_became_peered":"2023-10-09T11:43:37.702687+0000","last_unstale":"2023-10-09T11:43:38.696573+0000","last_undegraded":"2023-10-09T11:43:38.696573+0000","last_fullsized":"2023-10-09T11:43:38.696573+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:27.020092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.709733+0000","last_change":"2023-10-09T11:43:38.709733+0000","last_active":"2023-10-09T11:43:38.709733+0000","last_peered":"2023-10-09T11:43:38.709733+0000","last_clean":"2023-10-09T11:43:38.709733+0000","last_became_active":"2023-10-09T11:43:38.709440+0000","last_became_peered":"2023-10-09T11:43:38.709440+0000","last_unstale":"2023-10-09T11:43:38.709733+0000","last_undegraded":"2023-10-09T11:43:38.709733+0000","last_fullsized":"2023-10-09T11:43:38.709733+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:33.918946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722119+0000","last_change":"2023-10-09T11:43:37.708114+0000","last_active":"2023-10-09T11:43:38.722119+0000","last_peered":"2023-10-09T11:43:38.722119+0000","last_clean":"2023-10-09T11:43:38.722119+0000","last_became_active":"2023-10-09T11:43:37.707619+0000","last_became_peered":"2023-10-09T11:43:37.707619+0000","last_unstale":"2023-10-09T11:43:38.722119+0000","last_undegraded":"2023-10-09T11:43:38.722119+0000","last_fullsized":"2023-10-09T11:43:38.722119+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.716819+0000","last_change":"2023-10-09T11:43:38.716819+0000","last_active":"2023-10-09T11:43:38.716819+0000","last_peered":"2023-10-09T11:43:38.716819+0000","last_clean":"2023-10-09T11:43:38.716819+0000","last_became_active":"2023-10-09T11:43:38.716540+0000","last_became_peered":"2023-10-09T11:43:38.716540+0000","last_unstale":"2023-10-09T11:43:38.716819+0000","last_undegraded":"2023-10-09T11:43:38.716819+0000","last_fullsized":"2023-10-09T11:43:38.716819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:24.770877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699173+0000","last_change":"2023-10-09T11:43:37.703140+0000","last_active":"2023-10-09T11:43:38.699173+0000","last_peered":"2023-10-09T11:43:38.699173+0000","last_clean":"2023-10-09T11:43:38.699173+0000","last_became_active":"2023-10-09T11:43:37.702805+0000","last_became_peered":"2023-10-09T11:43:37.702805+0000","last_unstale":"2023-10-09T11:43:38.699173+0000","last_undegraded":"2023-10-09T11:43:38.699173+0000","last_fullsized":"2023-10-09T11:43:38.699173+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:14.761390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717775+0000","last_change":"2023-10-09T11:43:38.716003+0000","last_active":"2023-10-09T11:43:38.717775+0000","last_peered":"2023-10-09T11:43:38.717775+0000","last_clean":"2023-10-09T11:43:38.717775+0000","last_became_active":"2023-10-09T11:43:38.715033+0000","last_became_peered":"2023-10-09T11:43:38.715033+0000","last_unstale":"2023-10-09T11:43:38.717775+0000","last_undegraded":"2023-10-09T11:43:38.717775+0000","last_fullsized":"2023-10-09T11:43:38.717775+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:40.071972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.706320+0000","last_change":"2023-10-09T11:43:37.704472+0000","last_active":"2023-10-09T11:43:37.706320+0000","last_peered":"2023-10-09T11:43:37.706320+0000","last_clean":"2023-10-09T11:43:37.706320+0000","last_became_active":"2023-10-09T11:43:37.703508+0000","last_became_peered":"2023-10-09T11:43:37.703508+0000","last_unstale":"2023-10-09T11:43:37.706320+0000","last_undegraded":"2023-10-09T11:43:37.706320+0000","last_fullsized":"2023-10-09T11:43:37.706320+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:16.764486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727719+0000","last_change":"2023-10-09T11:43:38.723719+0000","last_active":"2023-10-09T11:43:38.727719+0000","last_peered":"2023-10-09T11:43:38.727719+0000","last_clean":"2023-10-09T11:43:38.727719+0000","last_became_active":"2023-10-09T11:43:38.723430+0000","last_became_peered":"2023-10-09T11:43:38.723430+0000","last_unstale":"2023-10-09T11:43:38.727719+0000","last_undegraded":"2023-10-09T11:43:38.727719+0000","last_fullsized":"2023-10-09T11:43:38.727719+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:56.991564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.709145+0000","last_change":"2023-10-09T11:43:37.710024+0000","last_active":"2023-10-09T11:43:38.709145+0000","last_peered":"2023-10-09T11:43:38.709145+0000","last_clean":"2023-10-09T11:43:38.709145+0000","last_became_active":"2023-10-09T11:43:37.708586+0000","last_became_peered":"2023-10-09T11:43:37.708586+0000","last_unstale":"2023-10-09T11:43:38.709145+0000","last_undegraded":"2023-10-09T11:43:38.709145+0000","last_fullsized":"2023-10-09T11:43:38.709145+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:03.405760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727336+0000","last_change":"2023-10-09T11:43:38.722335+0000","last_active":"2023-10-09T11:43:38.727336+0000","last_peered":"2023-10-09T11:43:38.727336+0000","last_clean":"2023-10-09T11:43:38.727336+0000","last_became_active":"2023-10-09T11:43:38.722006+0000","last_became_peered":"2023-10-09T11:43:38.722006+0000","last_unstale":"2023-10-09T11:43:38.727336+0000","last_undegraded":"2023-10-09T11:43:38.727336+0000","last_fullsized":"2023-10-09T11:43:38.727336+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:37.545194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705026+0000","last_change":"2023-10-09T11:43:37.699340+0000","last_active":"2023-10-09T11:43:37.705026+0000","last_peered":"2023-10-09T11:43:37.705026+0000","last_clean":"2023-10-09T11:43:37.705026+0000","last_became_active":"2023-10-09T11:43:37.699041+0000","last_became_peered":"2023-10-09T11:43:37.699041+0000","last_unstale":"2023-10-09T11:43:37.705026+0000","last_undegraded":"2023-10-09T11:43:37.705026+0000","last_fullsized":"2023-10-09T11:43:37.705026+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:56.273587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711183+0000","last_change":"2023-10-09T11:43:38.709698+0000","last_active":"2023-10-09T11:43:38.711183+0000","last_peered":"2023-10-09T11:43:38.711183+0000","last_clean":"2023-10-09T11:43:38.711183+0000","last_became_active":"2023-10-09T11:43:38.709366+0000","last_became_peered":"2023-10-09T11:43:38.709366+0000","last_unstale":"2023-10-09T11:43:38.711183+0000","last_undegraded":"2023-10-09T11:43:38.711183+0000","last_fullsized":"2023-10-09T11:43:38.711183+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:04.621228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"164'3","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715571+0000","last_change":"2023-10-09T11:43:37.705229+0000","last_active":"2023-10-09T11:43:38.715571+0000","last_peered":"2023-10-09T11:43:38.715571+0000","last_clean":"2023-10-09T11:43:38.715571+0000","last_became_active":"2023-10-09T11:43:37.704950+0000","last_became_peered":"2023-10-09T11:43:37.704950+0000","last_unstale":"2023-10-09T11:43:38.715571+0000","last_undegraded":"2023-10-09T11:43:38.715571+0000","last_fullsized":"2023-10-09T11:43:38.715571+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:08.373941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724994+0000","last_change":"2023-10-09T11:43:38.721285+0000","last_active":"2023-10-09T11:43:38.724994+0000","last_peered":"2023-10-09T11:43:38.724994+0000","last_clean":"2023-10-09T11:43:38.724994+0000","last_became_active":"2023-10-09T11:43:38.721000+0000","last_became_peered":"2023-10-09T11:43:38.721000+0000","last_unstale":"2023-10-09T11:43:38.724994+0000","last_undegraded":"2023-10-09T11:43:38.724994+0000","last_fullsized":"2023-10-09T11:43:38.724994+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:01.915087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"164'6","reported_seq":15,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.720585+0000","last_change":"2023-10-09T11:43:37.696512+0000","last_active":"2023-10-09T11:43:38.720585+0000","last_peered":"2023-10-09T11:43:38.720585+0000","last_clean":"2023-10-09T11:43:38.720585+0000","last_became_active":"2023-10-09T11:43:37.696224+0000","last_became_peered":"2023-10-09T11:43:37.696224+0000","last_unstale":"2023-10-09T11:43:38.720585+0000","last_undegraded":"2023-10-09T11:43:38.720585+0000","last_fullsized":"2023-10-09T11:43:38.720585+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:32.911856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.698165+0000","last_change":"2023-10-09T11:43:38.698165+0000","last_active":"2023-10-09T11:43:38.698165+0000","last_peered":"2023-10-09T11:43:38.698165+0000","last_clean":"2023-10-09T11:43:38.698165+0000","last_became_active":"2023-10-09T11:43:38.697855+0000","last_became_peered":"2023-10-09T11:43:38.697855+0000","last_unstale":"2023-10-09T11:43:38.698165+0000","last_undegraded":"2023-10-09T11:43:38.698165+0000","last_fullsized":"2023-10-09T11:43:38.698165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:43.604179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725417+0000","last_change":"2023-10-09T11:43:37.712981+0000","last_active":"2023-10-09T11:43:38.725417+0000","last_peered":"2023-10-09T11:43:38.725417+0000","last_clean":"2023-10-09T11:43:38.725417+0000","last_became_active":"2023-10-09T11:43:37.712716+0000","last_became_peered":"2023-10-09T11:43:37.712716+0000","last_unstale":"2023-10-09T11:43:38.725417+0000","last_undegraded":"2023-10-09T11:43:38.725417+0000","last_fullsized":"2023-10-09T11:43:38.725417+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:18.164806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725520+0000","last_change":"2023-10-09T11:43:38.719494+0000","last_active":"2023-10-09T11:43:38.725520+0000","last_peered":"2023-10-09T11:43:38.725520+0000","last_clean":"2023-10-09T11:43:38.725520+0000","last_became_active":"2023-10-09T11:43:38.718273+0000","last_became_peered":"2023-10-09T11:43:38.718273+0000","last_unstale":"2023-10-09T11:43:38.725520+0000","last_undegraded":"2023-10-09T11:43:38.725520+0000","last_fullsized":"2023-10-09T11:43:38.725520+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:48.321489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.704950+0000","last_change":"2023-10-09T11:43:37.699988+0000","last_active":"2023-10-09T11:43:37.704950+0000","last_peered":"2023-10-09T11:43:37.704950+0000","last_clean":"2023-10-09T11:43:37.704950+0000","last_became_active":"2023-10-09T11:43:37.699723+0000","last_became_peered":"2023-10-09T11:43:37.699723+0000","last_unstale":"2023-10-09T11:43:37.704950+0000","last_undegraded":"2023-10-09T11:43:37.704950+0000","last_fullsized":"2023-10-09T11:43:37.704950+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.956517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726070+0000","last_change":"2023-10-09T11:43:38.721161+0000","last_active":"2023-10-09T11:43:38.726070+0000","last_peered":"2023-10-09T11:43:38.726070+0000","last_clean":"2023-10-09T11:43:38.726070+0000","last_became_active":"2023-10-09T11:43:38.720874+0000","last_became_peered":"2023-10-09T11:43:38.720874+0000","last_unstale":"2023-10-09T11:43:38.726070+0000","last_undegraded":"2023-10-09T11:43:38.726070+0000","last_fullsized":"2023-10-09T11:43:38.726070+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:33.305532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705173+0000","last_change":"2023-10-09T11:43:37.703049+0000","last_active":"2023-10-09T11:43:37.705173+0000","last_peered":"2023-10-09T11:43:37.705173+0000","last_clean":"2023-10-09T11:43:37.705173+0000","last_became_active":"2023-10-09T11:43:37.702781+0000","last_became_peered":"2023-10-09T11:43:37.702781+0000","last_unstale":"2023-10-09T11:43:37.705173+0000","last_undegraded":"2023-10-09T11:43:37.705173+0000","last_fullsized":"2023-10-09T11:43:37.705173+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:06.740440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.713109+0000","last_change":"2023-10-09T11:43:38.711899+0000","last_active":"2023-10-09T11:43:38.713109+0000","last_peered":"2023-10-09T11:43:38.713109+0000","last_clean":"2023-10-09T11:43:38.713109+0000","last_became_active":"2023-10-09T11:43:38.711622+0000","last_became_peered":"2023-10-09T11:43:38.711622+0000","last_unstale":"2023-10-09T11:43:38.713109+0000","last_undegraded":"2023-10-09T11:43:38.713109+0000","last_fullsized":"2023-10-09T11:43:38.713109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:52.932030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722611+0000","last_change":"2023-10-09T11:43:37.706299+0000","last_active":"2023-10-09T11:43:38.722611+0000","last_peered":"2023-10-09T11:43:38.722611+0000","last_clean":"2023-10-09T11:43:38.722611+0000","last_became_active":"2023-10-09T11:43:37.705909+0000","last_became_peered":"2023-10-09T11:43:37.705909+0000","last_unstale":"2023-10-09T11:43:38.722611+0000","last_undegraded":"2023-10-09T11:43:38.722611+0000","last_fullsized":"2023-10-09T11:43:38.722611+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710943+0000","last_change":"2023-10-09T11:43:38.710943+0000","last_active":"2023-10-09T11:43:38.710943+0000","last_peered":"2023-10-09T11:43:38.710943+0000","last_clean":"2023-10-09T11:43:38.710943+0000","last_became_active":"2023-10-09T11:43:38.710663+0000","last_became_peered":"2023-10-09T11:43:38.710663+0000","last_unstale":"2023-10-09T11:43:38.710943+0000","last_undegraded":"2023-10-09T11:43:38.710943+0000","last_fullsized":"2023-10-09T11:43:38.710943+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:10.140288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722355+0000","last_change":"2023-10-09T11:43:37.714046+0000","last_active":"2023-10-09T11:43:38.722355+0000","last_peered":"2023-10-09T11:43:38.722355+0000","last_clean":"2023-10-09T11:43:38.722355+0000","last_became_active":"2023-10-09T11:43:37.713753+0000","last_became_peered":"2023-10-09T11:43:37.713753+0000","last_unstale":"2023-10-09T11:43:38.722355+0000","last_undegraded":"2023-10-09T11:43:38.722355+0000","last_fullsized":"2023-10-09T11:43:38.722355+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:44.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722661+0000","last_change":"2023-10-09T11:43:38.722661+0000","last_active":"2023-10-09T11:43:38.722661+0000","last_peered":"2023-10-09T11:43:38.722661+0000","last_clean":"2023-10-09T11:43:38.722661+0000","last_became_active":"2023-10-09T11:43:38.722338+0000","last_became_peered":"2023-10-09T11:43:38.722338+0000","last_unstale":"2023-10-09T11:43:38.722661+0000","last_undegraded":"2023-10-09T11:43:38.722661+0000","last_fullsized":"2023-10-09T11:43:38.722661+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:32.816842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.703597+0000","last_change":"2023-10-09T11:43:37.703810+0000","last_active":"2023-10-09T11:43:38.703597+0000","last_peered":"2023-10-09T11:43:38.703597+0000","last_clean":"2023-10-09T11:43:38.703597+0000","last_became_active":"2023-10-09T11:43:37.703493+0000","last_became_peered":"2023-10-09T11:43:37.703493+0000","last_unstale":"2023-10-09T11:43:38.703597+0000","last_undegraded":"2023-10-09T11:43:38.703597+0000","last_fullsized":"2023-10-09T11:43:38.703597+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:27.204312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717325+0000","last_change":"2023-10-09T11:43:38.706850+0000","last_active":"2023-10-09T11:43:38.717325+0000","last_peered":"2023-10-09T11:43:38.717325+0000","last_clean":"2023-10-09T11:43:38.717325+0000","last_became_active":"2023-10-09T11:43:38.706274+0000","last_became_peered":"2023-10-09T11:43:38.706274+0000","last_unstale":"2023-10-09T11:43:38.717325+0000","last_undegraded":"2023-10-09T11:43:38.717325+0000","last_fullsized":"2023-10-09T11:43:38.717325+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.556615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723659+0000","last_change":"2023-10-09T11:43:37.711291+0000","last_active":"2023-10-09T11:43:38.723659+0000","last_peered":"2023-10-09T11:43:38.723659+0000","last_clean":"2023-10-09T11:43:38.723659+0000","last_became_active":"2023-10-09T11:43:37.710470+0000","last_became_peered":"2023-10-09T11:43:37.710470+0000","last_unstale":"2023-10-09T11:43:38.723659+0000","last_undegraded":"2023-10-09T11:43:38.723659+0000","last_fullsized":"2023-10-09T11:43:38.723659+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:01.092568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.721715+0000","last_change":"2023-10-09T11:43:38.707671+0000","last_active":"2023-10-09T11:43:38.721715+0000","last_peered":"2023-10-09T11:43:38.721715+0000","last_clean":"2023-10-09T11:43:38.721715+0000","last_became_active":"2023-10-09T11:43:38.707374+0000","last_became_peered":"2023-10-09T11:43:38.707374+0000","last_unstale":"2023-10-09T11:43:38.721715+0000","last_undegraded":"2023-10-09T11:43:38.721715+0000","last_fullsized":"2023-10-09T11:43:38.721715+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:09.381031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.705284+0000","last_change":"2023-10-09T11:43:37.703146+0000","last_active":"2023-10-09T11:43:37.705284+0000","last_peered":"2023-10-09T11:43:37.705284+0000","last_clean":"2023-10-09T11:43:37.705284+0000","last_became_active":"2023-10-09T11:43:37.702871+0000","last_became_peered":"2023-10-09T11:43:37.702871+0000","last_unstale":"2023-10-09T11:43:37.705284+0000","last_undegraded":"2023-10-09T11:43:37.705284+0000","last_fullsized":"2023-10-09T11:43:37.705284+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:55.190428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.711841+0000","last_change":"2023-10-09T11:43:38.711841+0000","last_active":"2023-10-09T11:43:38.711841+0000","last_peered":"2023-10-09T11:43:38.711841+0000","last_clean":"2023-10-09T11:43:38.711841+0000","last_became_active":"2023-10-09T11:43:38.711553+0000","last_became_peered":"2023-10-09T11:43:38.711553+0000","last_unstale":"2023-10-09T11:43:38.711841+0000","last_undegraded":"2023-10-09T11:43:38.711841+0000","last_fullsized":"2023-10-09T11:43:38.711841+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:57.354042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.723753+0000","last_change":"2023-10-09T11:43:37.707575+0000","last_active":"2023-10-09T11:43:38.723753+0000","last_peered":"2023-10-09T11:43:38.723753+0000","last_clean":"2023-10-09T11:43:38.723753+0000","last_became_active":"2023-10-09T11:43:37.707257+0000","last_became_peered":"2023-10-09T11:43:37.707257+0000","last_unstale":"2023-10-09T11:43:38.723753+0000","last_undegraded":"2023-10-09T11:43:38.723753+0000","last_fullsized":"2023-10-09T11:43:38.723753+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:11.431667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725548+0000","last_change":"2023-10-09T11:43:38.719664+0000","last_active":"2023-10-09T11:43:38.725548+0000","last_peered":"2023-10-09T11:43:38.725548+0000","last_clean":"2023-10-09T11:43:38.725548+0000","last_became_active":"2023-10-09T11:43:38.718966+0000","last_became_peered":"2023-10-09T11:43:38.718966+0000","last_unstale":"2023-10-09T11:43:38.725548+0000","last_undegraded":"2023-10-09T11:43:38.725548+0000","last_fullsized":"2023-10-09T11:43:38.725548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:38.736671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699475+0000","last_change":"2023-10-09T11:43:37.704134+0000","last_active":"2023-10-09T11:43:38.699475+0000","last_peered":"2023-10-09T11:43:38.699475+0000","last_clean":"2023-10-09T11:43:38.699475+0000","last_became_active":"2023-10-09T11:43:37.703873+0000","last_became_peered":"2023-10-09T11:43:37.703873+0000","last_unstale":"2023-10-09T11:43:38.699475+0000","last_undegraded":"2023-10-09T11:43:38.699475+0000","last_fullsized":"2023-10-09T11:43:38.699475+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.710838+0000","last_change":"2023-10-09T11:43:38.710838+0000","last_active":"2023-10-09T11:43:38.710838+0000","last_peered":"2023-10-09T11:43:38.710838+0000","last_clean":"2023-10-09T11:43:38.710838+0000","last_became_active":"2023-10-09T11:43:38.710578+0000","last_became_peered":"2023-10-09T11:43:38.710578+0000","last_unstale":"2023-10-09T11:43:38.710838+0000","last_undegraded":"2023-10-09T11:43:38.710838+0000","last_fullsized":"2023-10-09T11:43:38.710838+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:45.044498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699275+0000","last_change":"2023-10-09T11:43:37.709800+0000","last_active":"2023-10-09T11:43:38.699275+0000","last_peered":"2023-10-09T11:43:38.699275+0000","last_clean":"2023-10-09T11:43:38.699275+0000","last_became_active":"2023-10-09T11:43:37.709534+0000","last_became_peered":"2023-10-09T11:43:37.709534+0000","last_unstale":"2023-10-09T11:43:38.699275+0000","last_undegraded":"2023-10-09T11:43:38.699275+0000","last_fullsized":"2023-10-09T11:43:38.699275+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717819+0000","last_change":"2023-10-09T11:43:38.717819+0000","last_active":"2023-10-09T11:43:38.717819+0000","last_peered":"2023-10-09T11:43:38.717819+0000","last_clean":"2023-10-09T11:43:38.717819+0000","last_became_active":"2023-10-09T11:43:38.714563+0000","last_became_peered":"2023-10-09T11:43:38.714563+0000","last_unstale":"2023-10-09T11:43:38.717819+0000","last_undegraded":"2023-10-09T11:43:38.717819+0000","last_fullsized":"2023-10-09T11:43:38.717819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:11.347718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.700471+0000","last_change":"2023-10-09T11:43:37.707190+0000","last_active":"2023-10-09T11:43:38.700471+0000","last_peered":"2023-10-09T11:43:38.700471+0000","last_clean":"2023-10-09T11:43:38.700471+0000","last_became_active":"2023-10-09T11:43:37.706885+0000","last_became_peered":"2023-10-09T11:43:37.706885+0000","last_unstale":"2023-10-09T11:43:38.700471+0000","last_undegraded":"2023-10-09T11:43:38.700471+0000","last_fullsized":"2023-10-09T11:43:38.700471+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:06.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.715134+0000","last_change":"2023-10-09T11:43:38.715134+0000","last_active":"2023-10-09T11:43:38.715134+0000","last_peered":"2023-10-09T11:43:38.715134+0000","last_clean":"2023-10-09T11:43:38.715134+0000","last_became_active":"2023-10-09T11:43:38.714775+0000","last_became_peered":"2023-10-09T11:43:38.714775+0000","last_unstale":"2023-10-09T11:43:38.715134+0000","last_undegraded":"2023-10-09T11:43:38.715134+0000","last_fullsized":"2023-10-09T11:43:38.715134+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:04.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"164'2","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.726152+0000","last_change":"2023-10-09T11:43:37.711289+0000","last_active":"2023-10-09T11:43:38.726152+0000","last_peered":"2023-10-09T11:43:38.726152+0000","last_clean":"2023-10-09T11:43:38.726152+0000","last_became_active":"2023-10-09T11:43:37.710997+0000","last_became_peered":"2023-10-09T11:43:37.710997+0000","last_unstale":"2023-10-09T11:43:38.726152+0000","last_undegraded":"2023-10-09T11:43:38.726152+0000","last_fullsized":"2023-10-09T11:43:38.726152+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:32.298442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725159+0000","last_change":"2023-10-09T11:43:38.716799+0000","last_active":"2023-10-09T11:43:38.725159+0000","last_peered":"2023-10-09T11:43:38.725159+0000","last_clean":"2023-10-09T11:43:38.725159+0000","last_became_active":"2023-10-09T11:43:38.715414+0000","last_became_peered":"2023-10-09T11:43:38.715414+0000","last_unstale":"2023-10-09T11:43:38.725159+0000","last_undegraded":"2023-10-09T11:43:38.725159+0000","last_fullsized":"2023-10-09T11:43:38.725159+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:33.064378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.705152+0000","last_change":"2023-10-09T11:43:37.709714+0000","last_active":"2023-10-09T11:43:38.705152+0000","last_peered":"2023-10-09T11:43:38.705152+0000","last_clean":"2023-10-09T11:43:38.705152+0000","last_became_active":"2023-10-09T11:43:37.708570+0000","last_became_peered":"2023-10-09T11:43:37.708570+0000","last_unstale":"2023-10-09T11:43:38.705152+0000","last_undegraded":"2023-10-09T11:43:38.705152+0000","last_fullsized":"2023-10-09T11:43:38.705152+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:54.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725126+0000","last_change":"2023-10-09T11:43:38.716507+0000","last_active":"2023-10-09T11:43:38.725126+0000","last_peered":"2023-10-09T11:43:38.725126+0000","last_clean":"2023-10-09T11:43:38.725126+0000","last_became_active":"2023-10-09T11:43:38.716231+0000","last_became_peered":"2023-10-09T11:43:38.716231+0000","last_unstale":"2023-10-09T11:43:38.725126+0000","last_undegraded":"2023-10-09T11:43:38.725126+0000","last_fullsized":"2023-10-09T11:43:38.725126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:15.255097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.706909+0000","last_change":"2023-10-09T11:43:37.709439+0000","last_active":"2023-10-09T11:43:38.706909+0000","last_peered":"2023-10-09T11:43:38.706909+0000","last_clean":"2023-10-09T11:43:38.706909+0000","last_became_active":"2023-10-09T11:43:37.709185+0000","last_became_peered":"2023-10-09T11:43:37.709185+0000","last_unstale":"2023-10-09T11:43:38.706909+0000","last_undegraded":"2023-10-09T11:43:38.706909+0000","last_fullsized":"2023-10-09T11:43:38.706909+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:00.558503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.705921+0000","last_change":"2023-10-09T11:43:38.705921+0000","last_active":"2023-10-09T11:43:38.705921+0000","last_peered":"2023-10-09T11:43:38.705921+0000","last_clean":"2023-10-09T11:43:38.705921+0000","last_became_active":"2023-10-09T11:43:38.705526+0000","last_became_peered":"2023-10-09T11:43:38.705526+0000","last_unstale":"2023-10-09T11:43:38.705921+0000","last_undegraded":"2023-10-09T11:43:38.705921+0000","last_fullsized":"2023-10-09T11:43:38.705921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:02.099658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.702740+0000","last_change":"2023-10-09T11:43:37.707237+0000","last_active":"2023-10-09T11:43:38.702740+0000","last_peered":"2023-10-09T11:43:38.702740+0000","last_clean":"2023-10-09T11:43:38.702740+0000","last_became_active":"2023-10-09T11:43:37.706939+0000","last_became_peered":"2023-10-09T11:43:37.706939+0000","last_unstale":"2023-10-09T11:43:38.702740+0000","last_undegraded":"2023-10-09T11:43:38.702740+0000","last_fullsized":"2023-10-09T11:43:38.702740+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:29.830153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.717677+0000","last_change":"2023-10-09T11:43:38.713890+0000","last_active":"2023-10-09T11:43:38.717677+0000","last_peered":"2023-10-09T11:43:38.717677+0000","last_clean":"2023-10-09T11:43:38.717677+0000","last_became_active":"2023-10-09T11:43:38.713598+0000","last_became_peered":"2023-10-09T11:43:38.713598+0000","last_unstale":"2023-10-09T11:43:38.717677+0000","last_undegraded":"2023-10-09T11:43:38.717677+0000","last_fullsized":"2023-10-09T11:43:38.717677+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:13.061510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.699060+0000","last_change":"2023-10-09T11:43:37.705573+0000","last_active":"2023-10-09T11:43:38.699060+0000","last_peered":"2023-10-09T11:43:38.699060+0000","last_clean":"2023-10-09T11:43:38.699060+0000","last_became_active":"2023-10-09T11:43:37.705275+0000","last_became_peered":"2023-10-09T11:43:37.705275+0000","last_unstale":"2023-10-09T11:43:38.699060+0000","last_undegraded":"2023-10-09T11:43:38.699060+0000","last_fullsized":"2023-10-09T11:43:38.699060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:06.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725494+0000","last_change":"2023-10-09T11:43:38.719275+0000","last_active":"2023-10-09T11:43:38.725494+0000","last_peered":"2023-10-09T11:43:38.725494+0000","last_clean":"2023-10-09T11:43:38.725494+0000","last_became_active":"2023-10-09T11:43:38.718202+0000","last_became_peered":"2023-10-09T11:43:38.718202+0000","last_unstale":"2023-10-09T11:43:38.725494+0000","last_undegraded":"2023-10-09T11:43:38.725494+0000","last_fullsized":"2023-10-09T11:43:38.725494+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.894255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.704931+0000","last_change":"2023-10-09T11:43:37.699442+0000","last_active":"2023-10-09T11:43:37.704931+0000","last_peered":"2023-10-09T11:43:37.704931+0000","last_clean":"2023-10-09T11:43:37.704931+0000","last_became_active":"2023-10-09T11:43:37.699129+0000","last_became_peered":"2023-10-09T11:43:37.699129+0000","last_unstale":"2023-10-09T11:43:37.704931+0000","last_undegraded":"2023-10-09T11:43:37.704931+0000","last_fullsized":"2023-10-09T11:43:37.704931+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:48.736549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.724386+0000","last_change":"2023-10-09T11:43:38.715219+0000","last_active":"2023-10-09T11:43:38.724386+0000","last_peered":"2023-10-09T11:43:38.724386+0000","last_clean":"2023-10-09T11:43:38.724386+0000","last_became_active":"2023-10-09T11:43:38.714802+0000","last_became_peered":"2023-10-09T11:43:38.714802+0000","last_unstale":"2023-10-09T11:43:38.724386+0000","last_undegraded":"2023-10-09T11:43:38.724386+0000","last_fullsized":"2023-10-09T11:43:38.724386+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:07.747530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T11:43:37.710212+0000","last_change":"2023-10-09T11:43:37.709757+0000","last_active":"2023-10-09T11:43:37.710212+0000","last_peered":"2023-10-09T11:43:37.710212+0000","last_clean":"2023-10-09T11:43:37.710212+0000","last_became_active":"2023-10-09T11:43:37.709454+0000","last_became_peered":"2023-10-09T11:43:37.709454+0000","last_unstale":"2023-10-09T11:43:37.710212+0000","last_undegraded":"2023-10-09T11:43:37.710212+0000","last_fullsized":"2023-10-09T11:43:37.710212+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:13.549525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.725012+0000","last_change":"2023-10-09T11:43:38.721375+0000","last_active":"2023-10-09T11:43:38.725012+0000","last_peered":"2023-10-09T11:43:38.725012+0000","last_clean":"2023-10-09T11:43:38.725012+0000","last_became_active":"2023-10-09T11:43:38.721079+0000","last_became_peered":"2023-10-09T11:43:38.721079+0000","last_unstale":"2023-10-09T11:43:38.725012+0000","last_undegraded":"2023-10-09T11:43:38.725012+0000","last_fullsized":"2023-10-09T11:43:38.725012+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:28.459233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.700610+0000","last_change":"2023-10-09T11:43:37.702815+0000","last_active":"2023-10-09T11:43:38.700610+0000","last_peered":"2023-10-09T11:43:38.700610+0000","last_clean":"2023-10-09T11:43:38.700610+0000","last_became_active":"2023-10-09T11:43:37.702515+0000","last_became_peered":"2023-10-09T11:43:37.702515+0000","last_unstale":"2023-10-09T11:43:38.700610+0000","last_undegraded":"2023-10-09T11:43:38.700610+0000","last_fullsized":"2023-10-09T11:43:38.700610+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:09.133198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.727398+0000","last_change":"2023-10-09T11:43:38.723998+0000","last_active":"2023-10-09T11:43:38.727398+0000","last_peered":"2023-10-09T11:43:38.727398+0000","last_clean":"2023-10-09T11:43:38.727398+0000","last_became_active":"2023-10-09T11:43:38.723733+0000","last_became_peered":"2023-10-09T11:43:38.723733+0000","last_unstale":"2023-10-09T11:43:38.727398+0000","last_undegraded":"2023-10-09T11:43:38.727398+0000","last_fullsized":"2023-10-09T11:43:38.727398+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:37.679639+0000","last_clean_scrub_stamp":"2023-10-09T11:43:37.679639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:07.570645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.722042+0000","last_change":"2023-10-09T11:43:37.707750+0000","last_active":"2023-10-09T11:43:38.722042+0000","last_peered":"2023-10-09T11:43:38.722042+0000","last_clean":"2023-10-09T11:43:38.722042+0000","last_became_active":"2023-10-09T11:43:37.707480+0000","last_became_peered":"2023-10-09T11:43:37.707480+0000","last_unstale":"2023-10-09T11:43:38.722042+0000","last_undegraded":"2023-10-09T11:43:38.722042+0000","last_fullsized":"2023-10-09T11:43:38.722042+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:43:36.672549+0000","last_clean_scrub_stamp":"2023-10-09T11:43:36.672549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.738941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":280,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T11:43:38.704425+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:43:38.704425+0000","last_peered":"2023-10-09T11:43:38.704425+0000","last_clean":"2023-10-09T11:43:38.704425+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:43:38.704425+0000","last_undegraded":"2023-10-09T11:43:38.704425+0000","last_fullsized":"2023-10-09T11:43:38.704425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.623},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.64200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":935071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.752}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":928817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.34899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.498},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304000,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067840,"statfs":{"total":96636764160,"available":96325468160,"internally_reserved":0,"allocated":2678784,"data_stored":1519739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.752},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.83099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303432,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068408,"statfs":{"total":96636764160,"available":96326049792,"internally_reserved":0,"allocated":2097152,"data_stored":930319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.318}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574953,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":930333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.371},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.41799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.499},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.47299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542252,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":935569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.503}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.69199999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303424,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068416,"statfs":{"total":96636764160,"available":96326057984,"internally_reserved":0,"allocated":2088960,"data_stored":935015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.66800000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.627}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:43:43.191 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:43:43.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:43:43.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.350+0000 7fe3ea962700 1 Processor -- start 2023-10-09T11:43:43.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.350+0000 7fe3ea962700 1 -- start start 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3ea962700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3ea962700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e40ccfd0 con 0x7fe3e406dc70 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3ea962700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e415a3d0 con 0x7fe3e4159530 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3ea962700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e415a6b0 con 0x7fe3e406e0e0 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3e406dc70 0x7fe3e4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34626/0 (socket says 172.21.15.26:34626) 2023-10-09T11:43:43.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49102/0 (socket says 172.21.15.26:49102) 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e37fe700 1 -- 172.21.15.26:0/300702587 learned_addr learned my addr 172.21.15.26:0/300702587 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 -- 172.21.15.26:0/300702587 >> v1:172.21.15.67:6789/0 conn(0x7fe3e4159530 legacy=0x7fe3e40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 -- 172.21.15.26:0/300702587 >> v1:172.21.15.26:6789/0 conn(0x7fe3e406dc70 legacy=0x7fe3e4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 -- 172.21.15.26:0/300702587 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e415a990 con 0x7fe3e406e0e0 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e2ffd700 1 -- 172.21.15.26:0/300702587 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725915450 0 0) 0x7fe3e40ccfd0 con 0x7fe3e406dc70 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e8eff700 1 --2- 172.21.15.26:0/300702587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e60 tx=0x7fe3dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199ceba8b3f3f5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e2ffd700 1 -- 172.21.15.26:0/300702587 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc00e070 con 0x7fe3e406e0e0 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e2ffd700 1 -- 172.21.15.26:0/300702587 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc00bc30 con 0x7fe3e406e0e0 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.351+0000 7fe3e2ffd700 1 -- 172.21.15.26:0/300702587 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc012430 con 0x7fe3e406e0e0 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 -- 172.21.15.26:0/300702587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406e0e0 msgr2=0x7fe3e40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 --2- 172.21.15.26:0/300702587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e60 tx=0x7fe3dc009780 comp rx=0 tx=0).stop 2023-10-09T11:43:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 -- 172.21.15.26:0/300702587 shutdown_connections 2023-10-09T11:43:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 --2- 172.21.15.26:0/300702587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406e0e0 0x7fe3e40cb6f0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 -- 172.21.15.26:0/300702587 >> 172.21.15.26:0/300702587 conn(0x7fe3e40703a0 msgr2=0x7fe3e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 -- 172.21.15.26:0/300702587 shutdown_connections 2023-10-09T11:43:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.352+0000 7fe3ea962700 1 -- 172.21.15.26:0/300702587 wait complete. 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.353+0000 7fe3ea962700 1 Processor -- start 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.353+0000 7fe3ea962700 1 -- start start 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 0x7fe3e40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e4159530 0x7fe3e40b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e40b3e30 con 0x7fe3e406dc70 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e40b4010 con 0x7fe3e4159530 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3ea962700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e40b42f0 con 0x7fe3e406e0e0 2023-10-09T11:43:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49110/0 (socket says 172.21.15.26:49110) 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 -- 172.21.15.26:0/814776101 learned_addr learned my addr 172.21.15.26:0/814776101 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e8eff700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e4159530 0x7fe3e40b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e37fe700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 0x7fe3e40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 -- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 msgr2=0x7fe3e40c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 0x7fe3e40c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 -- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e4159530 msgr2=0x7fe3e40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e4159530 0x7fe3e40b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 -- 172.21.15.26:0/814776101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc009a20 con 0x7fe3e406dc70 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e37fe700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 0x7fe3e40c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.354+0000 7fe3e3fff700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c590 tx=0x7fe3cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.355+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011590 con 0x7fe3e406dc70 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.355+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc011710 con 0x7fe3e406dc70 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.355+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011ad0 con 0x7fe3e406dc70 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.355+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e40b45d0 con 0x7fe3e406dc70 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.355+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e41541a0 con 0x7fe3e406dc70 2023-10-09T11:43:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.356+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e404c3c0 con 0x7fe3e406dc70 2023-10-09T11:43:43.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.356+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe3cc01b3b0 con 0x7fe3e406dc70 2023-10-09T11:43:43.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.356+0000 7fe3dbfff700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 0x7fe3c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.357+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3cc0841e0 con 0x7fe3e406dc70 2023-10-09T11:43:43.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.357+0000 7fe3e37fe700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 0x7fe3c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.357+0000 7fe3e37fe700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 0x7fe3c40697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe3e416ceb0 tx=0x7fe3d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.361+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3cc050e30 con 0x7fe3e406dc70 2023-10-09T11:43:43.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.633+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe3e415ac70 con 0x7fe3e406dc70 2023-10-09T11:43:43.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.636+0000 7fe3dbfff700 1 -- 172.21.15.26:0/814776101 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe3cc0170e0 con 0x7fe3e406dc70 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 msgr2=0x7fe3c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 0x7fe3c40697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe3e416ceb0 tx=0x7fe3d4009040 comp rx=0 tx=0).stop 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 msgr2=0x7fe3e4153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c590 tx=0x7fe3cc00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 shutdown_connections 2023-10-09T11:43:43.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e4159530 0x7fe3e40b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e406dc70 0x7fe3e4153c60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3c4067320 0x7fe3c40697d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 --2- 172.21.15.26:0/814776101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e406e0e0 0x7fe3e40c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.638+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 >> 172.21.15.26:0/814776101 conn(0x7fe3e40703a0 msgr2=0x7fe3e415d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.639+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 shutdown_connections 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.639+0000 7fe3ea962700 1 -- 172.21.15.26:0/814776101 wait complete. 2023-10-09T11:43:43.641 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:43:43.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.770+0000 7fb925ea5700 1 Processor -- start 2023-10-09T11:43:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 -- start start 2023-10-09T11:43:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9201598b0 0x7fb9200af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb9200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9200af790 0x7fb9200cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9200ce9d0 con 0x7fb9200af790 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9200afc30 con 0x7fb9201598b0 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb925ea5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200aff10 con 0x7fb920159c80 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.771+0000 7fb91ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9200af790 0x7fb9200cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9200af790 0x7fb9200cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49128/0 (socket says 172.21.15.26:49128) 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 -- 172.21.15.26:0/3625805099 learned_addr learned my addr 172.21.15.26:0/3625805099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91f7fe700 1 --2- 172.21.15.26:0/3625805099 >> v2:172.21.15.67:3300/0 conn(0x7fb9201598b0 0x7fb9200af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91effd700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb9200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 -- 172.21.15.26:0/3625805099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 msgr2=0x7fb9200cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb9200cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 -- 172.21.15.26:0/3625805099 >> v2:172.21.15.67:3300/0 conn(0x7fb9201598b0 msgr2=0x7fb9200af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 --2- 172.21.15.26:0/3625805099 >> v2:172.21.15.67:3300/0 conn(0x7fb9201598b0 0x7fb9200af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 -- 172.21.15.26:0/3625805099 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200ce380 con 0x7fb9200af790 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91effd700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb9200cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91ffff700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9200cbc30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb920065860 tx=0x7fb918009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b21404abb850f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91e7fc700 1 -- 172.21.15.26:0/3625805099 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800e070 con 0x7fb9200af790 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91e7fc700 1 -- 172.21.15.26:0/3625805099 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800ba20 con 0x7fb9200af790 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.772+0000 7fb91e7fc700 1 -- 172.21.15.26:0/3625805099 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180092e0 con 0x7fb9200af790 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 -- 172.21.15.26:0/3625805099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 msgr2=0x7fb9200cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9200cbc30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb920065860 tx=0x7fb918009840 comp rx=0 tx=0).stop 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 -- 172.21.15.26:0/3625805099 shutdown_connections 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 --2- 172.21.15.26:0/3625805099 >> v2:172.21.15.67:3300/0 conn(0x7fb9201598b0 0x7fb9200af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9200cbc30 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 --2- 172.21.15.26:0/3625805099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb9200cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 -- 172.21.15.26:0/3625805099 >> 172.21.15.26:0/3625805099 conn(0x7fb920070e30 msgr2=0x7fb9200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 -- 172.21.15.26:0/3625805099 shutdown_connections 2023-10-09T11:43:43.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.773+0000 7fb925ea5700 1 -- 172.21.15.26:0/3625805099 wait complete. 2023-10-09T11:43:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.774+0000 7fb925ea5700 1 Processor -- start 2023-10-09T11:43:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.774+0000 7fb925ea5700 1 -- start start 2023-10-09T11:43:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 0x7fb92015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb92015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200b3e70 con 0x7fb9200af790 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92015ffe0 con 0x7fb9201598b0 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200b4060 con 0x7fb920159c80 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49134/0 (socket says 172.21.15.26:49134) 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 -- 172.21.15.26:0/1149072778 learned_addr learned my addr 172.21.15.26:0/1149072778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91ffff700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb92015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91effd700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 0x7fb92015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 -- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 msgr2=0x7fb92015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb92015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 -- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 msgr2=0x7fb92015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 0x7fb92015ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 -- 172.21.15.26:0/1149072778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009ae0 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91ffff700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb92015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91effd700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 0x7fb92015ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb91f7fe700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb91000ecb0 tx=0x7fb9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000c9d0 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000cb30 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200b4340 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.775+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000ced0 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.776+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9200b4900 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.776+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9200b4f50 con 0x7fb9200af790 2023-10-09T11:43:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.777+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb910013680 con 0x7fb9200af790 2023-10-09T11:43:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.777+0000 7fb9077fe700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 0x7fb90c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.778+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb910085030 con 0x7fb9200af790 2023-10-09T11:43:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.778+0000 7fb91effd700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 0x7fb90c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.778+0000 7fb91effd700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 0x7fb90c0697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb914006f00 tx=0x7fb914008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:43.782+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb910051cc0 con 0x7fb9200af790 2023-10-09T11:43:44.009 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-10-09T11:43:44.008+0000 7f5dee850700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:44.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.020+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9200ce660 con 0x7fb9200af790 2023-10-09T11:43:44.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.020+0000 7fb9077fe700 1 -- 172.21.15.26:0/1149072778 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fb9100552e0 con 0x7fb9200af790 2023-10-09T11:43:44.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:44.022 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":109,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:41.709676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 msgr2=0x7fb90c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 0x7fb90c0697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb914006f00 tx=0x7fb914008040 comp rx=0 tx=0).stop 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 msgr2=0x7fb9201511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb91000ecb0 tx=0x7fb9100091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 shutdown_connections 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb90c067320 0x7fb90c0697d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb920159c80 0x7fb92015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200af790 0x7fb9201511d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 --2- 172.21.15.26:0/1149072778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9201598b0 0x7fb92015ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 >> 172.21.15.26:0/1149072778 conn(0x7fb920070e30 msgr2=0x7fb9200b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 shutdown_connections 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.022+0000 7fb925ea5700 1 -- 172.21.15.26:0/1149072778 wait complete. 2023-10-09T11:43:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 109 2023-10-09T11:43:44.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:43:38.096004+0000', 'modified': '2023-10-09T11:43:41.709676+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8307': {'gid': 8307, 'name': 'a', 'rank': 0, 'incarnation': 106, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/4207168086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 4207168086}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 4207168086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:43:44.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:43:44.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:43:44.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.560+0000 7fd680aab700 1 Processor -- start 2023-10-09T11:43:44.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.560+0000 7fd680aab700 1 -- start start 2023-10-09T11:43:44.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd680aab700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd67c157600 0x7fd67c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd680aab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd67c1579d0 0x7fd67c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd680aab700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c158210 con 0x7fd67c0ccba0 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd680aab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0cb850 con 0x7fd67c1579d0 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd680aab700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0cb290 con 0x7fd67c157600 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd67c1579d0 0x7fd67c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd67c1579d0 0x7fd67c0b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49150/0 (socket says 172.21.15.26:49150) 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 -- 172.21.15.26:0/808321039 learned_addr learned my addr 172.21.15.26:0/808321039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd67a59c700 1 --2- 172.21.15.26:0/808321039 >> v2:172.21.15.67:3300/0 conn(0x7fd67c157600 0x7fd67c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 -- 172.21.15.26:0/808321039 >> v2:172.21.15.67:3300/0 conn(0x7fd67c157600 msgr2=0x7fd67c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 --2- 172.21.15.26:0/808321039 >> v2:172.21.15.67:3300/0 conn(0x7fd67c157600 0x7fd67c0b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 -- 172.21.15.26:0/808321039 >> v1:172.21.15.67:6789/0 conn(0x7fd67c0ccba0 legacy=0x7fd67c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 -- 172.21.15.26:0/808321039 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0cb570 con 0x7fd67c1579d0 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd679d9b700 1 --2- 172.21.15.26:0/808321039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c1579d0 0x7fd67c0b1950 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0650d0 tx=0x7fd664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc5f742dec39131 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd67959a700 1 -- 172.21.15.26:0/808321039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400b820 con 0x7fd67c1579d0 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd67959a700 1 -- 172.21.15.26:0/808321039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400b980 con 0x7fd67c1579d0 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.561+0000 7fd67959a700 1 -- 172.21.15.26:0/808321039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400bd20 con 0x7fd67c1579d0 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 -- 172.21.15.26:0/808321039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c1579d0 msgr2=0x7fd67c0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 --2- 172.21.15.26:0/808321039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c1579d0 0x7fd67c0b1950 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0650d0 tx=0x7fd664009250 comp rx=0 tx=0).stop 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 -- 172.21.15.26:0/808321039 shutdown_connections 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 --2- 172.21.15.26:0/808321039 >> v2:172.21.15.67:3300/0 conn(0x7fd67c157600 0x7fd67c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 --2- 172.21.15.26:0/808321039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c1579d0 0x7fd67c0b1950 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 -- 172.21.15.26:0/808321039 >> 172.21.15.26:0/808321039 conn(0x7fd67c06d170 msgr2=0x7fd67c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 -- 172.21.15.26:0/808321039 shutdown_connections 2023-10-09T11:43:44.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.562+0000 7fd680aab700 1 -- 172.21.15.26:0/808321039 wait complete. 2023-10-09T11:43:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.563+0000 7fd680aab700 1 Processor -- start 2023-10-09T11:43:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.563+0000 7fd680aab700 1 -- start start 2023-10-09T11:43:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd67c0ccba0 0x7fd67c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 0x7fd67c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c15b3f0 con 0x7fd67c157600 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c15c6a0 con 0x7fd67c1579d0 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd680aab700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c15c210 con 0x7fd67c0ccba0 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49160/0 (socket says 172.21.15.26:49160) 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 -- 172.21.15.26:0/666087412 learned_addr learned my addr 172.21.15.26:0/666087412 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd67a59c700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd67c0ccba0 0x7fd67c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 0x7fd67c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 -- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd67c0ccba0 msgr2=0x7fd67c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd67c0ccba0 0x7fd67c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 -- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 msgr2=0x7fd67c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 0x7fd67c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 -- 172.21.15.26:0/666087412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640094f0 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 0x7fd67c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.564+0000 7fd679d9b700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd67c06d610 tx=0x7fd664016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.565+0000 7fd6727fc700 1 -- 172.21.15.26:0/666087412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664011d70 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.565+0000 7fd6727fc700 1 -- 172.21.15.26:0/666087412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664020070 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.565+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c15b600 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.565+0000 7fd6727fc700 1 -- 172.21.15.26:0/666087412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66401b6a0 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.565+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c15bbc0 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.566+0000 7fd6727fc700 1 -- 172.21.15.26:0/666087412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd664022030 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.567+0000 7fd6727fc700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 0x7fd65c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.567+0000 7fd6727fc700 1 -- 172.21.15.26:0/666087412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd664086ab0 con 0x7fd67c157600 2023-10-09T11:43:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.567+0000 7fd67a59c700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 0x7fd65c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.567+0000 7fd67a59c700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 0x7fd65c0697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00f570 tx=0x7fd66c007750 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.568+0000 7fd689da3b80 1 Processor -- start 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 -- start start 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a2dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a308f60 0x56078a2dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a236a70 con 0x56078a329d00 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a234270 con 0x56078a2dfa50 2023-10-09T11:43:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56078a230060 con 0x56078a308f60 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49168/0 (socket says 172.21.15.26:49168) 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd679d9b700 1 -- 172.21.15.26:0/1398000506 learned_addr learned my addr 172.21.15.26:0/1398000506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.569+0000 7fd67a59c700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a2dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a308f60 0x56078a2dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 -- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a308f60 msgr2=0x56078a2dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a308f60 0x56078a2dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 -- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 msgr2=0x56078a2dfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a2dfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 -- 172.21.15.26:0/1398000506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56078a0ca270 con 0x56078a329d00 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd67a59c700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a2dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd679d9b700 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fd664057460 tx=0x7fd66401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4e6cca6e57d645 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd65b7fe700 1 -- 172.21.15.26:0/1398000506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664057bd0 con 0x56078a329d00 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd65b7fe700 1 -- 172.21.15.26:0/1398000506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640574d0 con 0x56078a329d00 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.570+0000 7fd65b7fe700 1 -- 172.21.15.26:0/1398000506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66405a720 con 0x56078a329d00 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- 172.21.15.26:0/1398000506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 msgr2=0x56078a308a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fd664057460 tx=0x7fd66401e040 comp rx=0 tx=0).stop 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- 172.21.15.26:0/1398000506 shutdown_connections 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a308f60 0x56078a2dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a2dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 --2- 172.21.15.26:0/1398000506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a308a20 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- 172.21.15.26:0/1398000506 >> 172.21.15.26:0/1398000506 conn(0x56078a2e1370 msgr2=0x56078a2e1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- 172.21.15.26:0/1398000506 shutdown_connections 2023-10-09T11:43:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- 172.21.15.26:0/1398000506 wait complete. 2023-10-09T11:43:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 -- start start 2023-10-09T11:43:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.571+0000 7fd689da3b80 1 Processor -- start 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a31fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a1db890 con 0x56078a2dfa50 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a1f6ea0 con 0x56078a308f60 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56078a0b2e30 con 0x56078a329d00 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd689da3b80 10 client.0 _ll_register_callbacks cb 0x56078a2a3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49180/0 (socket says 172.21.15.26:49180) 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.572+0000 7fd67a59c700 1 -- 172.21.15.26:0/3869725266 learned_addr learned my addr 172.21.15.26:0/3869725266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd679d9b700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a31fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 -- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 msgr2=0x56078a3203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 -- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 msgr2=0x56078a31fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a31fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 -- 172.21.15.26:0/3869725266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c15bbc0 con 0x56078a2dfa50 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd67a59c700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00ffa0 tx=0x7fd66c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d871e548d95580c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd658ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c010e30 con 0x56078a2dfa50 2023-10-09T11:43:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56078a2d4b70 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd66c01f430 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd66c01f800 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd689da3b80 10 client.8460 fetch_fsmap learned FSMap version 109 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x56078a06cfe0 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.573+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56078a2d4b70 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd66c025020 con 0x56078a2dfa50 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 10 client.8460 fetch_fsmap finished waiting for FSMap version 109 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 10 client.8460 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 20 client.8460 populate_metadata read hostname 'smithi026' 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a3367d0 0x56078a336ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 4 client.8460 mds_command: new command op to 8307 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 --> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56078a2b1aa0 con 0x56078a3367d0 2023-10-09T11:43:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd679d9b700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a3367d0 0x56078a336ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd658ff9700 10 client.8460 ms_handle_connect on v2:172.21.15.26:6833/4207168086 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.574+0000 7fd679d9b700 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a3367d0 0x56078a336ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba691be5abc533c server_cookie=d5f1152e358a56e2 in_seq=0 out_seq=0 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd658ff9700 1 -- 172.21.15.26:0/3869725266 <== mds.0 v2:172.21.15.26:6833/4207168086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56078a2b1aa0 con 0x56078a3367d0 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd658ff9700 10 client.8460 handle_command_reply: tid=0 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 client.8460 shutdown 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 msgr2=0x56078a328440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00ffa0 tx=0x7fd66c016000 comp rx=0 tx=0).stop 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 shutdown_connections 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a3367d0 0x56078a336ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a2dfa50 0x56078a328440 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3869725266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a31fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd658ff9700 0 client.8460 ms_handle_reset on v2:172.21.15.26:6833/4207168086 2023-10-09T11:43:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 >> 172.21.15.26:0/3869725266 conn(0x56078a2e1370 msgr2=0x56078a325550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 shutdown_connections 2023-10-09T11:43:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 1 -- 172.21.15.26:0/3869725266 wait complete. 2023-10-09T11:43:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.575+0000 7fd689da3b80 20 client.8460 trim_cache size 0 max 16384 2023-10-09T11:43:44.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.592+0000 7fd689da3b80 1 Processor -- start 2023-10-09T11:43:44.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.592+0000 7fd689da3b80 1 -- start start 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a2dfa50 0x56078a30f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a30f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a2b84b0 con 0x56078a329d00 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a33f010 con 0x56078a308f60 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56078a2da5a0 con 0x56078a2dfa50 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49190/0 (socket says 172.21.15.26:49190) 2023-10-09T11:43:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 -- 172.21.15.26:0/3825787276 learned_addr learned my addr 172.21.15.26:0/3825787276 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd679d9b700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a30f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67a59c700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a2dfa50 0x56078a30f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 -- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a2dfa50 msgr2=0x56078a30f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a2dfa50 0x56078a30f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 -- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 msgr2=0x56078a30f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a30f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 -- 172.21.15.26:0/3825787276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56078a2db990 con 0x56078a329d00 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd679d9b700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a30f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd67400b860 tx=0x7fd674008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4263e703d018dc35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd65bfff700 1 -- 172.21.15.26:0/3825787276 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740126b0 con 0x56078a329d00 2023-10-09T11:43:44.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd65bfff700 1 -- 172.21.15.26:0/3825787276 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674012810 con 0x56078a329d00 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.593+0000 7fd65bfff700 1 -- 172.21.15.26:0/3825787276 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674012bd0 con 0x56078a329d00 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 -- 172.21.15.26:0/3825787276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 msgr2=0x56078a31c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd67400b860 tx=0x7fd674008040 comp rx=0 tx=0).stop 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 -- 172.21.15.26:0/3825787276 shutdown_connections 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a329d00 0x56078a31c560 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a2dfa50 0x56078a30f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 --2- 172.21.15.26:0/3825787276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a308f60 0x56078a30f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 -- 172.21.15.26:0/3825787276 >> 172.21.15.26:0/3825787276 conn(0x56078a2e1370 msgr2=0x56078a3255c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 -- 172.21.15.26:0/3825787276 shutdown_connections 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.594+0000 7fd689da3b80 1 -- 172.21.15.26:0/3825787276 wait complete. 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.595+0000 7fd689da3b80 1 -- start start 2023-10-09T11:43:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.595+0000 7fd689da3b80 1 Processor -- start 2023-10-09T11:43:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a379bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a343b00 con 0x56078a308f60 2023-10-09T11:43:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078a308c10 con 0x56078a2dfa50 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56078a391aa0 con 0x56078a329d00 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 10 client.0 _ll_register_callbacks cb 0x56078a2a3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49210/0 (socket says 172.21.15.26:49210) 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 -- 172.21.15.26:0/664038934 learned_addr learned my addr 172.21.15.26:0/664038934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd67a59c700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a379bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd67ad9d700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 -- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 msgr2=0x56078a3082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 -- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 msgr2=0x56078a379bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a379bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 -- 172.21.15.26:0/664038934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67400e040 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd67a59c700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a379bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd679d9b700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd6640571d0 tx=0x7fd66401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90586c74791156c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd658ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66405e470 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd66405a720 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6640574d0 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd664057940 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 10 client.8466 fetch_fsmap learned FSMap version 109 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.596+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x56078a1fe780 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664067020 con 0x56078a308f60 2023-10-09T11:43:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd664069d20 con 0x56078a308f60 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 10 client.8466 fetch_fsmap finished waiting for FSMap version 109 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 10 client.8466 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 20 client.8466 populate_metadata read hostname 'smithi026' 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a31c560 0x56078a31c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 4 client.8466 mds_command: new command op to 8307 tid=0[{"prefix": "status"}] 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 --> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56078a1d2e00 con 0x56078a31c560 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd67a59c700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a31c560 0x56078a31c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 10 client.8466 ms_handle_connect on v2:172.21.15.26:6833/4207168086 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd67a59c700 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a31c560 0x56078a31c930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da54ebeb91492504 server_cookie=6d11e21f2de2f215 in_seq=0 out_seq=0 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 1 -- 172.21.15.26:0/664038934 <== mds.0 v2:172.21.15.26:6833/4207168086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x56078a1d2e00 con 0x56078a31c560 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 10 client.8466 handle_command_reply: tid=0 2023-10-09T11:43:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 client.8466 shutdown 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 msgr2=0x56078a307da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd6640571d0 tx=0x7fd66401e040 comp rx=0 tx=0).stop 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 shutdown_connections 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:6833/4207168086,v1:172.21.15.26:6835/4207168086] conn(0x56078a31c560 0x56078a31c930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56078a329d00 0x56078a3082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56078a2dfa50 0x56078a379bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 --2- 172.21.15.26:0/664038934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56078a308f60 0x56078a307da0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd658ff9700 0 client.8466 ms_handle_reset on v2:172.21.15.26:6833/4207168086 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.597+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 >> 172.21.15.26:0/664038934 conn(0x56078a2e1370 msgr2=0x56078a325550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 shutdown_connections 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd689da3b80 1 -- 172.21.15.26:0/664038934 wait complete. 2023-10-09T11:43:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd689da3b80 20 client.8466 trim_cache size 0 max 16384 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 8307, 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9092390349999997, 2023-10-09T11:43:44.607 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 109, 2023-10-09T11:43:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 165, 2023-10-09T11:43:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 165, 2023-10-09T11:43:44.608 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 10.981211329000001 2023-10-09T11:43:44.608 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:43:44.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 msgr2=0x7fd65c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 0x7fd65c0697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00f570 tx=0x7fd66c007750 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 msgr2=0x7fd67c167960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd67c06d610 tx=0x7fd664016000 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 shutdown_connections 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67c1579d0 0x7fd67c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd65c067320 0x7fd65c0697d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd67c0ccba0 0x7fd67c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 --2- 172.21.15.26:0/666087412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67c157600 0x7fd67c167960 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 >> 172.21.15.26:0/666087412 conn(0x7fd67c06d170 msgr2=0x7fd67c0c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 shutdown_connections 2023-10-09T11:43:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.598+0000 7fd680aab700 1 -- 172.21.15.26:0/666087412 wait complete. 2023-10-09T11:43:44.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:44.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.729+0000 7f948f012700 1 Processor -- start 2023-10-09T11:43:44.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.729+0000 7f948f012700 1 -- start start 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948f012700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94880ccac0 0x7f94880cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948f012700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880cb460 con 0x7f94880cbe30 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948f012700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880cb180 con 0x7f948806c8f0 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948f012700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948815db00 con 0x7f94880ccac0 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948d80f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94880ccac0 0x7f94880cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948d80f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94880ccac0 0x7f94880cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49216/0 (socket says 172.21.15.26:49216) 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948e811700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f94880cbe30 0x7f94880a98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34642/0 (socket says 172.21.15.26:34642) 2023-10-09T11:43:44.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.730+0000 7f948d80f700 1 -- 172.21.15.26:0/2309079497 learned_addr learned my addr 172.21.15.26:0/2309079497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d80f700 1 -- 172.21.15.26:0/2309079497 >> v1:172.21.15.67:6789/0 conn(0x7f948806c8f0 legacy=0x7f948815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d80f700 1 -- 172.21.15.26:0/2309079497 >> v1:172.21.15.26:6789/0 conn(0x7f94880cbe30 legacy=0x7f94880a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d80f700 1 -- 172.21.15.26:0/2309079497 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948815dde0 con 0x7f94880ccac0 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d00e700 1 -- 172.21.15.26:0/2309079497 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148946849 0 0) 0x7f94880cb460 con 0x7f94880cbe30 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d80f700 1 --2- 172.21.15.26:0/2309079497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880cb8f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f947c0099b0 tx=0x7f947c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16eac582c3240c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d00e700 1 -- 172.21.15.26:0/2309079497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00b820 con 0x7f94880ccac0 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d00e700 1 -- 172.21.15.26:0/2309079497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00b980 con 0x7f94880ccac0 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948d00e700 1 -- 172.21.15.26:0/2309079497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00bd20 con 0x7f94880ccac0 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948f012700 1 -- 172.21.15.26:0/2309079497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 msgr2=0x7f94880cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948f012700 1 --2- 172.21.15.26:0/2309079497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880cb8f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f947c0099b0 tx=0x7f947c009250 comp rx=0 tx=0).stop 2023-10-09T11:43:44.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.731+0000 7f948f012700 1 -- 172.21.15.26:0/2309079497 shutdown_connections 2023-10-09T11:43:44.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.732+0000 7f948f012700 1 --2- 172.21.15.26:0/2309079497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880cb8f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.732+0000 7f948f012700 1 -- 172.21.15.26:0/2309079497 >> 172.21.15.26:0/2309079497 conn(0x7f948806e280 msgr2=0x7f94880cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.732+0000 7f948f012700 1 -- 172.21.15.26:0/2309079497 shutdown_connections 2023-10-09T11:43:44.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.732+0000 7f948f012700 1 -- 172.21.15.26:0/2309079497 wait complete. 2023-10-09T11:43:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 Processor -- start 2023-10-09T11:43:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 -- start start 2023-10-09T11:43:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f948806c8f0 0x7f94881547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94880cbe30 0x7f94880b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9488154d20 con 0x7f94880ccac0 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880b19e0 con 0x7f94880cbe30 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948f012700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880b1c30 con 0x7f948806c8f0 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.733+0000 7f948e811700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49224/0 (socket says 172.21.15.26:49224) 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 -- 172.21.15.26:0/3706891251 learned_addr learned my addr 172.21.15.26:0/3706891251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948d80f700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94880cbe30 0x7f94880b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e010700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f948806c8f0 0x7f94881547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 -- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f948806c8f0 msgr2=0x7f94881547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f948806c8f0 0x7f94881547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 -- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94880cbe30 msgr2=0x7f94880b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94880cbe30 0x7f94880b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 -- 172.21.15.26:0/3706891251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0094f0 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948e811700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f948000cd50 tx=0x7f9480001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480005df0 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000a940 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880b1f10 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000ad00 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.734+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880b24d0 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.735+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948804c3c0 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.735+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9480007300 con 0x7f94880ccac0 2023-10-09T11:43:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.736+0000 7f94867fc700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 0x7f94740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.736+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9480084db0 con 0x7f94880ccac0 2023-10-09T11:43:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.736+0000 7f948e010700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 0x7f94740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.737+0000 7f948e010700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 0x7f94740697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9478003a30 tx=0x7f9478007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.740+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9480089070 con 0x7f94880ccac0 2023-10-09T11:43:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.980+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94880cdf80 con 0x7f94880ccac0 2023-10-09T11:43:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.980+0000 7f94867fc700 1 -- 172.21.15.26:0/3706891251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9480051ac0 con 0x7f94880ccac0 2023-10-09T11:43:44.982 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:44.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 msgr2=0x7f94740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 0x7f94740697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9478003a30 tx=0x7f9478007ea0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 msgr2=0x7f94880ab1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:44.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f948000cd50 tx=0x7f9480001b10 comp rx=0 tx=0).stop 2023-10-09T11:43:44.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 shutdown_connections 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94880ccac0 0x7f94880ab1d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9474067320 0x7f94740697d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f948806c8f0 0x7f94881547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.982+0000 7f948f012700 1 --2- 172.21.15.26:0/3706891251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94880cbe30 0x7f94880b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.983+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 >> 172.21.15.26:0/3706891251 conn(0x7f948806e280 msgr2=0x7f948815b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.983+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 shutdown_connections 2023-10-09T11:43:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:44.983+0000 7f948f012700 1 -- 172.21.15.26:0/3706891251 wait complete. 2023-10-09T11:43:44.996 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:44.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:44.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:43:44.996 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:43:44.996 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:44.997 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:44.997 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:44.997 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:44.997 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:44.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:44.997 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:43:45.012 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:45.012 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:43:45.013 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41967sec preferred_lft 41967sec 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:45.014 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:43:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:45.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.016 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:45.076 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:43:45.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.078 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:43:45.134 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:43:45.134 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:45.134 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:43:45.135 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:43:45.135 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:45.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:43:45.135 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:43:45.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.237 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:43:45.252 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:43:45.252 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:43:45.252 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:45.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:43:45.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:45.317 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:45.372 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:45.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:45.372 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:45.426 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:43:45.427 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:45.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:45.507 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:45.507 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:45.526 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:45.527 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:45.527 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:45.527 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:45.548 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:45.548 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:45.548 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:45.548 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:45.548 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:43:45.549 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:43:45.551 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:45.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:45.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:45.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.777+0000 7f1064f5d700 1 Processor -- start 2023-10-09T11:43:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.777+0000 7f1064f5d700 1 -- start start 2023-10-09T11:43:45.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f1064f5d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f106015a5d0 0x7f1060156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:45.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f1064f5d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015ae40 con 0x7f10600cb5a0 2023-10-09T11:43:45.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f1064f5d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015ab60 con 0x7f10600cb970 2023-10-09T11:43:45.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f1064f5d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600ce0f0 con 0x7f106015a5d0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f105e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10600cb5a0 0x7f10600cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34658/0 (socket says 172.21.15.26:34658) 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f105e59c700 1 -- 172.21.15.26:0/130339159 learned_addr learned my addr 172.21.15.26:0/130339159 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.778+0000 7f105ed9d700 1 --2- 172.21.15.26:0/130339159 >> v2:172.21.15.67:3300/0 conn(0x7f106015a5d0 0x7f1060156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105d59a700 1 -- 172.21.15.26:0/130339159 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940157125 0 0) 0x7f106015ae40 con 0x7f10600cb5a0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105d59a700 1 -- 172.21.15.26:0/130339159 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003570 con 0x7f10600cb5a0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105ed9d700 1 -- 172.21.15.26:0/130339159 >> v1:172.21.15.67:6789/0 conn(0x7f10600cb970 legacy=0x7f1060159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105ed9d700 1 -- 172.21.15.26:0/130339159 >> v1:172.21.15.26:6789/0 conn(0x7f10600cb5a0 legacy=0x7f10600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105ed9d700 1 -- 172.21.15.26:0/130339159 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600ccf00 con 0x7f106015a5d0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105ed9d700 1 --2- 172.21.15.26:0/130339159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106015a5d0 0x7f1060156e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e14a5a242bc762b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105d59a700 1 -- 172.21.15.26:0/130339159 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800b640 con 0x7f106015a5d0 2023-10-09T11:43:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105d59a700 1 -- 172.21.15.26:0/130339159 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800b7a0 con 0x7f106015a5d0 2023-10-09T11:43:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.779+0000 7f105d59a700 1 -- 172.21.15.26:0/130339159 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800bb40 con 0x7f106015a5d0 2023-10-09T11:43:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 -- 172.21.15.26:0/130339159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106015a5d0 msgr2=0x7f1060156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 --2- 172.21.15.26:0/130339159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106015a5d0 0x7f1060156e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 -- 172.21.15.26:0/130339159 shutdown_connections 2023-10-09T11:43:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 --2- 172.21.15.26:0/130339159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106015a5d0 0x7f1060156e90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 -- 172.21.15.26:0/130339159 >> 172.21.15.26:0/130339159 conn(0x7f1060070e30 msgr2=0x7f10600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 -- 172.21.15.26:0/130339159 shutdown_connections 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.780+0000 7f1064f5d700 1 -- 172.21.15.26:0/130339159 wait complete. 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.781+0000 7f1064f5d700 1 Processor -- start 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.781+0000 7f1064f5d700 1 -- start start 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 0x7f1060155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106015a5d0 0x7f1060154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600ca710 con 0x7f10600cb5a0 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b4780 con 0x7f10600cb970 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f1064f5d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c9ed0 con 0x7f106015a5d0 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:45.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49236/0 (socket says 172.21.15.26:49236) 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 -- 172.21.15.26:0/3692842991 learned_addr learned my addr 172.21.15.26:0/3692842991 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105ed9d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106015a5d0 0x7f1060154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105dd9b700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 0x7f1060155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 -- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106015a5d0 msgr2=0x7f1060154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106015a5d0 0x7f1060154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 -- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 msgr2=0x7f1060155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 0x7f1060155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 -- 172.21.15.26:0/3692842991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009420 con 0x7f10600cb5a0 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105dd9b700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 0x7f1060155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f105e59c700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f105000cd90 tx=0x7f1050001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.782+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000aaf0 con 0x7f10600cb5a0 2023-10-09T11:43:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.783+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000ac50 con 0x7f10600cb5a0 2023-10-09T11:43:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.783+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600ca150 con 0x7f10600cb5a0 2023-10-09T11:43:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.783+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500070f0 con 0x7f10600cb5a0 2023-10-09T11:43:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.783+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600b4410 con 0x7f10600cb5a0 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.783+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106004c3c0 con 0x7f10600cb5a0 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.784+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1050007520 con 0x7f10600cb5a0 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.784+0000 7f10567fc700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 0x7f10400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.785+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1050085100 con 0x7f10600cb5a0 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.785+0000 7f105dd9b700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 0x7f10400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.785+0000 7f105dd9b700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 0x7f10400697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1048007fd0 tx=0x7f1048009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:45.789+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1050051d90 con 0x7f10600cb5a0 2023-10-09T11:43:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.030+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f106015a3b0 con 0x7f10600cb5a0 2023-10-09T11:43:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.030+0000 7f10567fc700 1 -- 172.21.15.26:0/3692842991 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10500553b0 con 0x7f10600cb5a0 2023-10-09T11:43:46.031 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 msgr2=0x7f10400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 0x7f10400697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1048007fd0 tx=0x7f1048009040 comp rx=0 tx=0).stop 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 msgr2=0x7f1060151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f105000cd90 tx=0x7f1050001b10 comp rx=0 tx=0).stop 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 shutdown_connections 2023-10-09T11:43:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1040067320 0x7f10400697d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106015a5d0 0x7f1060154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10600cb5a0 0x7f1060151ba0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 --2- 172.21.15.26:0/3692842991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10600cb970 0x7f1060155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 >> 172.21.15.26:0/3692842991 conn(0x7f1060070e30 msgr2=0x7f10600b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 shutdown_connections 2023-10-09T11:43:46.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.032+0000 7f1064f5d700 1 -- 172.21.15.26:0/3692842991 wait complete. 2023-10-09T11:43:46.045 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:46.046 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:46.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.046 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:43:46.066 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:46.066 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:46.066 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:46.067 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41981sec preferred_lft 41981sec 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:43:46.068 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:46.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.069 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:46.135 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:43:46.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.137 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:43:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:43:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:43:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:43:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:46.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:43:46.196 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:43:46.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.303 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:43:46.318 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:43:46.318 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:43:46.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:46.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:43:46.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:46.385 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:46.440 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:46.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:46.441 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:46.495 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:43:46.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:46.496 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:46.577 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:46.577 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:46.596 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:46.618 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:46.618 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:46.618 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:43:46.618 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:43:46.618 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:43:46.619 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:43:46.621 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:46.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:46.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:46.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:43:46.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.823+0000 7f1bdaad3700 1 Processor -- start 2023-10-09T11:43:46.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.823+0000 7f1bdaad3700 1 -- start start 2023-10-09T11:43:46.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd4155c80 0x7f1bd40abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1bd40ac200 0x7f1bd406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bd406b210 0x7f1bd40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406a560 con 0x7f1bd406b210 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406a840 con 0x7f1bd40ac200 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bdaad3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40ac700 con 0x7f1bd4155c80 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.824+0000 7f1bd9070700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bd406b210 0x7f1bd40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bd406b210 0x7f1bd40703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49250/0 (socket says 172.21.15.26:49250) 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 -- 172.21.15.26:0/2650064712 learned_addr learned my addr 172.21.15.26:0/2650064712 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd886f700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd4155c80 0x7f1bd40abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd3fff700 1 --2- 172.21.15.26:0/2650064712 >> v2:172.21.15.67:3300/0 conn(0x7f1bd40ac200 0x7f1bd406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 -- 172.21.15.26:0/2650064712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd4155c80 msgr2=0x7f1bd40abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd4155c80 0x7f1bd40abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 -- 172.21.15.26:0/2650064712 >> v2:172.21.15.67:3300/0 conn(0x7f1bd40ac200 msgr2=0x7f1bd406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 --2- 172.21.15.26:0/2650064712 >> v2:172.21.15.67:3300/0 conn(0x7f1bd40ac200 0x7f1bd406acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 -- 172.21.15.26:0/2650064712 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40ac9e0 con 0x7f1bd406b210 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd9070700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd406b210 0x7f1bd40703a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cdc60 tx=0x7f1bcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52027252f536dfb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd37fe700 1 -- 172.21.15.26:0/2650064712 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00e070 con 0x7f1bd406b210 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd37fe700 1 -- 172.21.15.26:0/2650064712 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00ba50 con 0x7f1bd406b210 2023-10-09T11:43:46.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.825+0000 7f1bd37fe700 1 -- 172.21.15.26:0/2650064712 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0092e0 con 0x7f1bd406b210 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 -- 172.21.15.26:0/2650064712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd406b210 msgr2=0x7f1bd40703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd406b210 0x7f1bd40703a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cdc60 tx=0x7f1bcc009840 comp rx=0 tx=0).stop 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 -- 172.21.15.26:0/2650064712 shutdown_connections 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd406b210 0x7f1bd40703a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/2650064712 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd4155c80 0x7f1bd40abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/2650064712 >> v2:172.21.15.67:3300/0 conn(0x7f1bd40ac200 0x7f1bd406acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 -- 172.21.15.26:0/2650064712 >> 172.21.15.26:0/2650064712 conn(0x7f1bd40675a0 msgr2=0x7f1bd40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 -- 172.21.15.26:0/2650064712 shutdown_connections 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.826+0000 7f1bdaad3700 1 -- 172.21.15.26:0/2650064712 wait complete. 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.827+0000 7f1bdaad3700 1 Processor -- start 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.827+0000 7f1bdaad3700 1 -- start start 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 0x7f1bd4156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bd4155c80 0x7f1bd414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40aa2a0 con 0x7f1bd40ac200 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd414f250 con 0x7f1bd4155c80 2023-10-09T11:43:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bdaad3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4156a60 con 0x7f1bd406b210 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49252/0 (socket says 172.21.15.26:49252) 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 -- 172.21.15.26:0/3132669233 learned_addr learned my addr 172.21.15.26:0/3132669233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd886f700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 0x7f1bd4156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd9070700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bd4155c80 0x7f1bd414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 -- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 msgr2=0x7f1bd4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 0x7f1bd4156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 -- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bd4155c80 msgr2=0x7f1bd414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bd4155c80 0x7f1bd414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 -- 172.21.15.26:0/3132669233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc009ae0 con 0x7f1bd40ac200 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd886f700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 0x7f1bd4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.828+0000 7f1bd3fff700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800d860 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.829+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80125f0 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.829+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8012750 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.829+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4157270 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.829+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8012b10 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.829+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd4156cb0 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.830+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd404c3c0 con 0x7f1bd40ac200 2023-10-09T11:43:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.830+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1bc801e460 con 0x7f1bd40ac200 2023-10-09T11:43:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.830+0000 7f1bd0ff9700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 0x7f1bc00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.831+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bc8085280 con 0x7f1bd40ac200 2023-10-09T11:43:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.831+0000 7f1bd886f700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 0x7f1bc00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.831+0000 7f1bd886f700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 0x7f1bc00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009990 tx=0x7f1bc4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:46.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:46.835+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bc8051f10 con 0x7f1bd40ac200 2023-10-09T11:43:47.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.077+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1bd414d620 con 0x7f1bd40ac200 2023-10-09T11:43:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.734+0000 7f1bd0ff9700 1 -- 172.21.15.26:0/3132669233 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v110) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1bc8055530 con 0x7f1bd40ac200 2023-10-09T11:43:47.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 msgr2=0x7f1bc00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 0x7f1bc00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009990 tx=0x7f1bc4008040 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 msgr2=0x7f1bd414d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800d860 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 shutdown_connections 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bd4155c80 0x7f1bd414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1bc0067320 0x7f1bc00697d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1bd406b210 0x7f1bd4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 --2- 172.21.15.26:0/3132669233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd40ac200 0x7f1bd414d0e0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 >> 172.21.15.26:0/3132669233 conn(0x7f1bd40675a0 msgr2=0x7f1bd4154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 shutdown_connections 2023-10-09T11:43:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.737+0000 7f1bdaad3700 1 -- 172.21.15.26:0/3132669233 wait complete. 2023-10-09T11:43:47.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:43:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.878+0000 7fb78d8ad700 1 Processor -- start 2023-10-09T11:43:47.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.878+0000 7fb78d8ad700 1 -- start start 2023-10-09T11:43:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d8ad700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d8ad700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb78815de50 0x7fb7880cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d8ad700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78815afd0 con 0x7fb7880cef40 2023-10-09T11:43:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d8ad700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78815b2b0 con 0x7fb78815de50 2023-10-09T11:43:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d8ad700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78815b590 con 0x7fb788153c30 2023-10-09T11:43:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb787fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb78815de50 0x7fb7880cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78c8ab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78c8ab700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:36668/0 (socket says 172.21.15.26:36668) 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb787fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb78815de50 0x7fb7880cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:57336/0 (socket says 172.21.15.26:57336) 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78c8ab700 1 -- 172.21.15.26:0/3585079259 learned_addr learned my addr 172.21.15.26:0/3585079259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.879+0000 7fb78d0ac700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb7880cef40 0x7fb78806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:38898/0 (socket says 172.21.15.26:38898) 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb787fff700 1 -- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 msgr2=0x7fb78815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb787fff700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb787fff700 1 -- 172.21.15.26:0/3585079259 >> v1:172.21.15.67:6789/0 conn(0x7fb7880cef40 legacy=0x7fb78806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb787fff700 1 -- 172.21.15.26:0/3585079259 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78815b870 con 0x7fb78815de50 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb78c8ab700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb787fff700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb78815de50 0x7fb7880cea00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0098e0 tx=0x7fb77c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7984f5802a3c0f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb7877fe700 1 -- 172.21.15.26:0/3585079259 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00b640 con 0x7fb78815de50 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb7877fe700 1 -- 172.21.15.26:0/3585079259 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c00b7a0 con 0x7fb78815de50 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.880+0000 7fb7877fe700 1 -- 172.21.15.26:0/3585079259 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00bb40 con 0x7fb78815de50 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 -- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb78815de50 msgr2=0x7fb7880cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb78815de50 0x7fb7880cea00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0098e0 tx=0x7fb77c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 -- 172.21.15.26:0/3585079259 shutdown_connections 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb78815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/3585079259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb78815de50 0x7fb7880cea00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 -- 172.21.15.26:0/3585079259 >> 172.21.15.26:0/3585079259 conn(0x7fb7880703a0 msgr2=0x7fb7880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 -- 172.21.15.26:0/3585079259 shutdown_connections 2023-10-09T11:43:47.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.881+0000 7fb78d8ad700 1 -- 172.21.15.26:0/3585079259 wait complete. 2023-10-09T11:43:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.882+0000 7fb78d8ad700 1 Processor -- start 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.882+0000 7fb78d8ad700 1 -- start start 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7880cef40 0x7fb788159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb7880b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c7d20 con 0x7fb78815de50 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb788159a80 con 0x7fb7880cef40 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d8ad700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c8120 con 0x7fb788153c30 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49266/0 (socket says 172.21.15.26:49266) 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 -- 172.21.15.26:0/2319744773 learned_addr learned my addr 172.21.15.26:0/2319744773 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb787fff700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb7880b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78c8ab700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7880cef40 0x7fb788159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 -- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 msgr2=0x7fb7880b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb7880b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 -- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7880cef40 msgr2=0x7fb788159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7880cef40 0x7fb788159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 -- 172.21.15.26:0/2319744773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009ae0 con 0x7fb78815de50 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.883+0000 7fb78d0ac700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c4e0 tx=0x7fb778007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.884+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778005b40 con 0x7fb78815de50 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.884+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778005ca0 con 0x7fb78815de50 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.884+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c009420 con 0x7fb78815de50 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.884+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778007300 con 0x7fb78815de50 2023-10-09T11:43:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.884+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880b5bb0 con 0x7fb78815de50 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.885+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880c82e0 con 0x7fb78815de50 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.885+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb77801b3b0 con 0x7fb78815de50 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.885+0000 7fb784ff9700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 0x7fb7740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.885+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7780841b0 con 0x7fb78815de50 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.886+0000 7fb78c8ab700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 0x7fb7740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:47.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.886+0000 7fb78c8ab700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 0x7fb7740697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb780009ab0 tx=0x7fb78000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:47.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:47.890+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb778050e40 con 0x7fb78815de50 2023-10-09T11:43:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.118+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb78804c3c0 con 0x7fb774067320 2023-10-09T11:43:48.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.120+0000 7fb784ff9700 1 -- 172.21.15.26:0/2319744773 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb78804c3c0 con 0x7fb774067320 2023-10-09T11:43:48.121 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:43:48.121 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:48.121 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:43:48.121 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:48.121 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:43:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 msgr2=0x7fb7740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 0x7fb7740697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb780009ab0 tx=0x7fb78000b040 comp rx=0 tx=0).stop 2023-10-09T11:43:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 msgr2=0x7fb7880b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c4e0 tx=0x7fb778007f50 comp rx=0 tx=0).stop 2023-10-09T11:43:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 shutdown_connections 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb78815de50 0x7fb7880b0380 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7880cef40 0x7fb788159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb774067320 0x7fb7740697d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 --2- 172.21.15.26:0/2319744773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb788153c30 0x7fb7880b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 >> 172.21.15.26:0/2319744773 conn(0x7fb7880703a0 msgr2=0x7fb7880c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 shutdown_connections 2023-10-09T11:43:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.122+0000 7fb78d8ad700 1 -- 172.21.15.26:0/2319744773 wait complete. 2023-10-09T11:43:48.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:43:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.256+0000 7fbe4c1ce700 1 Processor -- start 2023-10-09T11:43:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.256+0000 7fbe4c1ce700 1 -- start start 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe4c1ce700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe4406dc70 0x7fbe44159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe4c1ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe440ccfd0 con 0x7fbe44159530 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe4c1ce700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4415a3d0 con 0x7fbe4406e0e0 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe4c1ce700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4415a6b0 con 0x7fbe4406dc70 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49f6a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbe44159530 0x7fbe440ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34664/0 (socket says 172.21.15.26:34664) 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49f6a700 1 -- 172.21.15.26:0/2562487704 learned_addr learned my addr 172.21.15.26:0/2562487704 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49769700 1 --2- 172.21.15.26:0/2562487704 >> v2:172.21.15.67:3300/0 conn(0x7fbe4406dc70 0x7fbe44159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456153181 0 0) 0x7fbe440ccfd0 con 0x7fbe44159530 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe30003570 con 0x7fbe44159530 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906947009 0 0) 0x7fbe4415a3d0 con 0x7fbe4406e0e0 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe440ccfd0 con 0x7fbe4406e0e0 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49769700 1 -- 172.21.15.26:0/2562487704 >> v1:172.21.15.67:6789/0 conn(0x7fbe4406e0e0 legacy=0x7fbe440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792160440 0 0) 0x7fbe30003570 con 0x7fbe44159530 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49769700 1 -- 172.21.15.26:0/2562487704 >> v1:172.21.15.26:6789/0 conn(0x7fbe44159530 legacy=0x7fbe440ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49769700 1 -- 172.21.15.26:0/2562487704 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4415a990 con 0x7fbe4406dc70 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.257+0000 7fbe49769700 1 --2- 172.21.15.26:0/2562487704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406dc70 0x7fbe44159900 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbe340098e0 tx=0x7fbe340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17540d3ac1115da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400017f0 con 0x7fbe4406dc70 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe34011420 con 0x7fbe4406dc70 2023-10-09T11:43:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe48f68700 1 -- 172.21.15.26:0/2562487704 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340117c0 con 0x7fbe4406dc70 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/2562487704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406dc70 msgr2=0x7fbe44159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/2562487704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406dc70 0x7fbe44159900 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbe340098e0 tx=0x7fbe340091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/2562487704 shutdown_connections 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/2562487704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406dc70 0x7fbe44159900 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/2562487704 >> 172.21.15.26:0/2562487704 conn(0x7fbe440703a0 msgr2=0x7fbe440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/2562487704 shutdown_connections 2023-10-09T11:43:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.258+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/2562487704 wait complete. 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.259+0000 7fbe4c1ce700 1 Processor -- start 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.259+0000 7fbe4c1ce700 1 -- start start 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe4406dc70 0x7fbe441472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406e0e0 0x7fbe440b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440c9090 con 0x7fbe44159530 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe441477f0 con 0x7fbe4406e0e0 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4c1ce700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440c8480 con 0x7fbe4406dc70 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49272/0 (socket says 172.21.15.26:49272) 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 -- 172.21.15.26:0/3630364686 learned_addr learned my addr 172.21.15.26:0/3630364686 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe49f6a700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe4406dc70 0x7fbe441472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe49769700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406e0e0 0x7fbe440b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 -- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe4406dc70 msgr2=0x7fbe441472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe4406dc70 0x7fbe441472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 -- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406e0e0 msgr2=0x7fbe440b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406e0e0 0x7fbe440b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.260+0000 7fbe4a76b700 1 -- 172.21.15.26:0/3630364686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009420 con 0x7fbe44159530 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe4a76b700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c4e0 tx=0x7fbe3c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011590 con 0x7fbe44159530 2023-10-09T11:43:48.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c011710 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe440c8760 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011ad0 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.261+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe440c8d20 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.262+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe440c9200 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.262+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbe3c012420 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.263+0000 7fbe39ffb700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 0x7fbe280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.263+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe3c002030 con 0x7fbe44159530 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.263+0000 7fbe49f6a700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 0x7fbe280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.264+0000 7fbe49f6a700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 0x7fbe280697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbe40007fd0 tx=0x7fbe40000f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.267+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe3c0513a0 con 0x7fbe44159530 2023-10-09T11:43:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.459+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbe4404c3c0 con 0x7fbe44159530 2023-10-09T11:43:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.459+0000 7fbe39ffb700 1 -- 172.21.15.26:0/3630364686 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe3c0549c0 con 0x7fbe44159530 2023-10-09T11:43:48.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 msgr2=0x7fbe280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 0x7fbe280697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbe40007fd0 tx=0x7fbe40000f40 comp rx=0 tx=0).stop 2023-10-09T11:43:48.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 msgr2=0x7fbe440b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c4e0 tx=0x7fbe3c007d80 comp rx=0 tx=0).stop 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 shutdown_connections 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe44159530 0x7fbe440b2050 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbe28067320 0x7fbe280697d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe4406dc70 0x7fbe441472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 --2- 172.21.15.26:0/3630364686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4406e0e0 0x7fbe440b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 >> 172.21.15.26:0/3630364686 conn(0x7fbe440703a0 msgr2=0x7fbe4415ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 shutdown_connections 2023-10-09T11:43:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.461+0000 7fbe4c1ce700 1 -- 172.21.15.26:0/3630364686 wait complete. 2023-10-09T11:43:48.475 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:43:48.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:43:48.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:48.529 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:43:48.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:48.529 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:43:48.544 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:43:48.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:43:48.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:48.586 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:43:48.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:48.587 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:43:48.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:43:48.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:48.644 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:43:48.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:43:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T11:43:48.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:43:48.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:48.660 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:43:48.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:43:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T11:43:48.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create another-data-pool --pg_num_min 64 2023-10-09T11:43:48.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.824+0000 7fcc25017700 1 Processor -- start 2023-10-09T11:43:48.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.824+0000 7fcc25017700 1 -- start start 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.824+0000 7fcc25017700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc2015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.824+0000 7fcc25017700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc200c8c70 0x7fcc200c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc25017700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2015d9f0 con 0x7fcc20068220 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc25017700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2015d3c0 con 0x7fcc200c8c70 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc25017700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200c9630 con 0x7fcc20067e50 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc20068220 0x7fcc20159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34668/0 (socket says 172.21.15.26:34668) 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1e59c700 1 -- 172.21.15.26:0/2274168921 learned_addr learned my addr 172.21.15.26:0/2274168921 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1f59e700 1 --2- 172.21.15.26:0/2274168921 >> v2:172.21.15.67:3300/0 conn(0x7fcc200c8c70 0x7fcc200c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc2015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090163877 0 0) 0x7fcc2015d9f0 con 0x7fcc20068220 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc0c003570 con 0x7fcc20068220 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440833491 0 0) 0x7fcc0c003570 con 0x7fcc20068220 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 msgr2=0x7fcc2015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc2015de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 >> v2:172.21.15.67:3300/0 conn(0x7fcc200c8c70 msgr2=0x7fcc200c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 --2- 172.21.15.26:0/2274168921 >> v2:172.21.15.67:3300/0 conn(0x7fcc200c8c70 0x7fcc200c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2015a8f0 con 0x7fcc20068220 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fcc08001470 con 0x7fcc20068220 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 >> v1:172.21.15.26:6789/0 conn(0x7fcc20068220 legacy=0x7fcc20159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc0c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc0c003fe0 0x7fcc0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c004d50 0x7fcc0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2015d3c0 con 0x7fcc0c003fe0 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200c9630 con 0x7fcc0c004d50 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c00ba90 con 0x7fcc20067e50 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.825+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc0c003fe0 0x7fcc0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc0c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1f59e700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c004d50 0x7fcc0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 -- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 msgr2=0x7fcc0c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc20067e50 0x7fcc0c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 -- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c004d50 msgr2=0x7fcc0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c004d50 0x7fcc0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 -- 172.21.15.26:0/2274168921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c003570 con 0x7fcc0c003fe0 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc0c003fe0 0x7fcc0c004810 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c3c0 tx=0x7fcc08001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e327b0eef929cbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800cc30 con 0x7fcc0c003fe0 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0800cdb0 con 0x7fcc0c003fe0 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.826+0000 7fcc1dd9b700 1 -- 172.21.15.26:0/2274168921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08005b70 con 0x7fcc0c003fe0 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 -- 172.21.15.26:0/2274168921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc0c003fe0 msgr2=0x7fcc0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 --2- 172.21.15.26:0/2274168921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc0c003fe0 0x7fcc0c004810 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c3c0 tx=0x7fcc08001e90 comp rx=0 tx=0).stop 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc1f59e700 1 -- 172.21.15.26:0/2274168921 reap_dead start 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 -- 172.21.15.26:0/2274168921 shutdown_connections 2023-10-09T11:43:48.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 -- 172.21.15.26:0/2274168921 >> 172.21.15.26:0/2274168921 conn(0x7fcc200ce4a0 msgr2=0x7fcc200ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:48.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 -- 172.21.15.26:0/2274168921 shutdown_connections 2023-10-09T11:43:48.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.827+0000 7fcc25017700 1 -- 172.21.15.26:0/2274168921 wait complete. 2023-10-09T11:43:48.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.828+0000 7fcc25017700 1 Processor -- start 2023-10-09T11:43:48.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.828+0000 7fcc25017700 1 -- start start 2023-10-09T11:43:48.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 0x7fcc201488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc200c3e50 0x7fcc200c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200c4800 con 0x7fcc200b1c10 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200c1ee0 con 0x7fcc0c003fe0 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20148e00 con 0x7fcc200c3e50 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49286/0 (socket says 172.21.15.26:49286) 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 -- 172.21.15.26:0/4174828981 learned_addr learned my addr 172.21.15.26:0/4174828981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1f59e700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc200c3e50 0x7fcc200c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 0x7fcc201488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 -- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc200c3e50 msgr2=0x7fcc200c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc200c3e50 0x7fcc200c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 -- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 msgr2=0x7fcc201488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 0x7fcc201488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 -- 172.21.15.26:0/4174828981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200b21d0 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 0x7fcc201488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc1e59c700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fcc08001ed0 tx=0x7fcc08015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08001430 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080072e0 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc200b24b0 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080076a0 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.829+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc200b2a70 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.830+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc200c4800 con 0x7fcc200b1c10 2023-10-09T11:43:48.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.831+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcc08019030 con 0x7fcc200b1c10 2023-10-09T11:43:48.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.831+0000 7fcc16ffd700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 0x7fcc000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:48.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.831+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc08085f70 con 0x7fcc200b1c10 2023-10-09T11:43:48.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.831+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 0x7fcc000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:48.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.832+0000 7fcc1ed9d700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 0x7fcc000697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009390 tx=0x7fcc1000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:48.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:48.836+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc08052c00 con 0x7fcc200b1c10 2023-10-09T11:43:49.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.029+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64} v 0) v1 -- 0x7fcc2004c3c0 con 0x7fcc200b1c10 2023-10-09T11:43:49.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.740+0000 7fcc16ffd700 1 -- 172.21.15.26:0/4174828981 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64}]=0 pool 'another-data-pool' created v166) v1 ==== 142+0+0 (secure 0 0 0) 0x7fcc080170b0 con 0x7fcc200b1c10 2023-10-09T11:43:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 msgr2=0x7fcc000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 0x7fcc000697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009390 tx=0x7fcc1000b040 comp rx=0 tx=0).stop 2023-10-09T11:43:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 msgr2=0x7fcc200b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fcc08001ed0 tx=0x7fcc08015000 comp rx=0 tx=0).stop 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 shutdown_connections 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc00067320 0x7fcc000697d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc200c3e50 0x7fcc200c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c003fe0 0x7fcc201488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 --2- 172.21.15.26:0/4174828981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200b1c10 0x7fcc200b3bc0 secure :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fcc08001ed0 tx=0x7fcc08015000 comp rx=0 tx=0).stop 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.745+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 >> 172.21.15.26:0/4174828981 conn(0x7fcc200ce4a0 msgr2=0x7fcc200ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.747+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 shutdown_connections 2023-10-09T11:43:49.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.748+0000 7fcc25017700 1 -- 172.21.15.26:0/4174828981 wait complete. 2023-10-09T11:43:49.752 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'another-data-pool' created 2023-10-09T11:43:49.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs another-data-pool 2023-10-09T11:43:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.892+0000 7faba2215700 1 Processor -- start 2023-10-09T11:43:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.892+0000 7faba2215700 1 -- start start 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7faba2215700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab9c159530 0x7fab9c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7faba2215700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab9c06e0e0 0x7fab9c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7faba2215700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c0ccfd0 con 0x7fab9c06dc70 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7faba2215700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c0cf0e0 con 0x7fab9c159530 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7faba2215700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c15a3d0 con 0x7fab9c06e0e0 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab9c159530 0x7fab9c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab9c159530 0x7fab9c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57790/0 (socket says 172.21.15.26:57790) 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 -- 172.21.15.26:0/2879867437 learned_addr learned my addr 172.21.15.26:0/2879867437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9bfff700 1 --2- 172.21.15.26:0/2879867437 >> v2:172.21.15.67:3300/0 conn(0x7fab9c06e0e0 0x7fab9c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 -- 172.21.15.26:0/2879867437 >> v2:172.21.15.67:3300/0 conn(0x7fab9c06e0e0 msgr2=0x7fab9c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/2879867437 >> v2:172.21.15.67:3300/0 conn(0x7fab9c06e0e0 0x7fab9c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 -- 172.21.15.26:0/2879867437 >> v1:172.21.15.67:6789/0 conn(0x7fab9c06dc70 legacy=0x7fab9c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.893+0000 7fab9b7fe700 1 -- 172.21.15.26:0/2879867437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c15a6b0 con 0x7fab9c159530 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/2879867437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c159530 0x7fab9c0ceba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0caef0 tx=0x7fab8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1a4c5cc0b075f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7fab9a7fc700 1 -- 172.21.15.26:0/2879867437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00b820 con 0x7fab9c159530 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7fab9a7fc700 1 -- 172.21.15.26:0/2879867437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c00b980 con 0x7fab9c159530 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7fab9a7fc700 1 -- 172.21.15.26:0/2879867437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00bd20 con 0x7fab9c159530 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 -- 172.21.15.26:0/2879867437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c159530 msgr2=0x7fab9c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 --2- 172.21.15.26:0/2879867437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c159530 0x7fab9c0ceba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0caef0 tx=0x7fab8c009250 comp rx=0 tx=0).stop 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 -- 172.21.15.26:0/2879867437 shutdown_connections 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 --2- 172.21.15.26:0/2879867437 >> v2:172.21.15.67:3300/0 conn(0x7fab9c06e0e0 0x7fab9c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 --2- 172.21.15.26:0/2879867437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c159530 0x7fab9c0ceba0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 -- 172.21.15.26:0/2879867437 >> 172.21.15.26:0/2879867437 conn(0x7fab9c0703a0 msgr2=0x7fab9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:49.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 -- 172.21.15.26:0/2879867437 shutdown_connections 2023-10-09T11:43:49.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.894+0000 7faba2215700 1 -- 172.21.15.26:0/2879867437 wait complete. 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 Processor -- start 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 -- start start 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab9c06dc70 0x7fab9c149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab9c159530 0x7fab9c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c157b90 con 0x7fab9c06e0e0 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1572c0 con 0x7fab9c159530 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.896+0000 7faba2215700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c16abd0 con 0x7fab9c06dc70 2023-10-09T11:43:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57802/0 (socket says 172.21.15.26:57802) 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 -- 172.21.15.26:0/3853409503 learned_addr learned my addr 172.21.15.26:0/3853409503 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9bfff700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab9c159530 0x7fab9c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab9c06dc70 0x7fab9c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 -- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab9c06dc70 msgr2=0x7fab9c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab9c06dc70 0x7fab9c149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 -- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab9c159530 msgr2=0x7fab9c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab9c159530 0x7fab9c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 -- 172.21.15.26:0/3853409503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0094f0 con 0x7fab9c06e0e0 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab9affd700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c5d0 tx=0x7fab90007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90011590 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900116f0 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c157540 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90011ab0 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.897+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c1495b0 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.898+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c157d00 con 0x7fab9c06e0e0 2023-10-09T11:43:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.899+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fab9001c460 con 0x7fab9c06e0e0 2023-10-09T11:43:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.899+0000 7fab837fe700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 0x7fab880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.899+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6077+0+0 (secure 0 0 0) 0x7fab90084b40 con 0x7fab9c06e0e0 2023-10-09T11:43:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.899+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 0x7fab880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.900+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 0x7fab880697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0caef0 tx=0x7fab8c016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:49.904+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab90051620 con 0x7fab9c06e0e0 2023-10-09T11:43:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.146+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"} v 0) v1 -- 0x7fab9c04c3c0 con 0x7fab9c06e0e0 2023-10-09T11:43:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.741+0000 7fab837fe700 1 -- 172.21.15.26:0/3853409503 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"}]=0 added data pool 30 to fsmap v111) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab90054c40 con 0x7fab9c06e0e0 2023-10-09T11:43:50.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 msgr2=0x7fab880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 0x7fab880697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0caef0 tx=0x7fab8c016000 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 msgr2=0x7fab9c16b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c5d0 tx=0x7fab90007f60 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 shutdown_connections 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab9c159530 0x7fab9c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab88067320 0x7fab880697d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab9c06dc70 0x7fab9c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 --2- 172.21.15.26:0/3853409503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab9c06e0e0 0x7fab9c16b000 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 >> 172.21.15.26:0/3853409503 conn(0x7fab9c0703a0 msgr2=0x7fab9c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 shutdown_connections 2023-10-09T11:43:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.744+0000 7faba2215700 1 -- 172.21.15.26:0/3853409503 wait complete. 2023-10-09T11:43:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:added data pool 30 to fsmap 2023-10-09T11:43:50.759 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:50.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.879+0000 7f7c46451700 1 Processor -- start 2023-10-09T11:43:50.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.879+0000 7f7c46451700 1 -- start start 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c46451700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c400cb5a0 0x7f7c400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c46451700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7c4015a5d0 0x7f7c40156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c46451700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4015ae40 con 0x7f7c400cd9e0 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c46451700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400d13f0 con 0x7f7c400cb5a0 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c46451700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4015ab60 con 0x7f7c4015a5d0 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c3ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c400cb5a0 0x7f7c400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c3f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7c400cd9e0 0x7f7c40159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57226/0 (socket says 172.21.15.26:57226) 2023-10-09T11:43:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c3ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c400cb5a0 0x7f7c400cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57810/0 (socket says 172.21.15.26:57810) 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.880+0000 7f7c3f7fe700 1 -- 172.21.15.26:0/3260096361 learned_addr learned my addr 172.21.15.26:0/3260096361 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c449ee700 1 --2- 172.21.15.26:0/3260096361 >> v2:172.21.15.67:3300/0 conn(0x7f7c4015a5d0 0x7f7c40156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3ffff700 1 -- 172.21.15.26:0/3260096361 >> v2:172.21.15.67:3300/0 conn(0x7f7c4015a5d0 msgr2=0x7f7c40156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3ffff700 1 --2- 172.21.15.26:0/3260096361 >> v2:172.21.15.67:3300/0 conn(0x7f7c4015a5d0 0x7f7c40156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3ffff700 1 -- 172.21.15.26:0/3260096361 >> v1:172.21.15.26:6789/0 conn(0x7f7c400cd9e0 legacy=0x7f7c40159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3ffff700 1 -- 172.21.15.26:0/3260096361 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400ccf00 con 0x7f7c400cb5a0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3effd700 1 -- 172.21.15.26:0/3260096361 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765878900 0 0) 0x7f7c4015ae40 con 0x7f7c400cd9e0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3ffff700 1 --2- 172.21.15.26:0/3260096361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c400cb5a0 0x7f7c400cb970 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7c300098e0 tx=0x7f7c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d8ddbc402eb0c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3effd700 1 -- 172.21.15.26:0/3260096361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30009e80 con 0x7f7c400cb5a0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3effd700 1 -- 172.21.15.26:0/3260096361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000b820 con 0x7f7c400cb5a0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.881+0000 7f7c3effd700 1 -- 172.21.15.26:0/3260096361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000bba0 con 0x7f7c400cb5a0 2023-10-09T11:43:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 -- 172.21.15.26:0/3260096361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c400cb5a0 msgr2=0x7f7c400cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 --2- 172.21.15.26:0/3260096361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c400cb5a0 0x7f7c400cb970 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7c300098e0 tx=0x7f7c300091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 -- 172.21.15.26:0/3260096361 shutdown_connections 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 --2- 172.21.15.26:0/3260096361 >> v2:172.21.15.67:3300/0 conn(0x7f7c4015a5d0 0x7f7c40156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 --2- 172.21.15.26:0/3260096361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c400cb5a0 0x7f7c400cb970 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 -- 172.21.15.26:0/3260096361 >> 172.21.15.26:0/3260096361 conn(0x7f7c40070e30 msgr2=0x7f7c400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 -- 172.21.15.26:0/3260096361 shutdown_connections 2023-10-09T11:43:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.882+0000 7f7c46451700 1 -- 172.21.15.26:0/3260096361 wait complete. 2023-10-09T11:43:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.883+0000 7f7c46451700 1 Processor -- start 2023-10-09T11:43:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.883+0000 7f7c46451700 1 -- start start 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c400cb5a0 0x7f7c4015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c400cd9e0 0x7f7c400c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015c420 con 0x7f7c4015a5d0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b4d00 con 0x7f7c400cd9e0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015bf70 con 0x7f7c400cb5a0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57816/0 (socket says 172.21.15.26:57816) 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 -- 172.21.15.26:0/3207538900 learned_addr learned my addr 172.21.15.26:0/3207538900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c3f7fe700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c400cd9e0 0x7f7c400c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c3ffff700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c400cb5a0 0x7f7c4015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 -- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c400cb5a0 msgr2=0x7f7c4015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c400cb5a0 0x7f7c4015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 -- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c400cd9e0 msgr2=0x7f7c400c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c400cd9e0 0x7f7c400c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 -- 172.21.15.26:0/3207538900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30009420 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c449ee700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800cdb0 tx=0x7f7c380077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800aa80 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800abe0 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4016a4a0 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38017430 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.884+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4016aa60 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.885+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400b4eb0 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.886+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7c38003020 con 0x7f7c4015a5d0 2023-10-09T11:43:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.886+0000 7f7c27fff700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 0x7f7c2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.886+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f7c38013070 con 0x7f7c4015a5d0 2023-10-09T11:43:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.886+0000 7f7c3ffff700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 0x7f7c2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:50.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.887+0000 7f7c3ffff700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 0x7f7c2c0697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7c300093f0 tx=0x7f7c30017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:50.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:50.891+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c400b4eb0 con 0x7f7c4015a5d0 2023-10-09T11:43:51.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.125+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c400b4eb0 con 0x7f7c4015a5d0 2023-10-09T11:43:51.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.126+0000 7f7c27fff700 1 -- 172.21.15.26:0/3207538900 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f7c400b4eb0 con 0x7f7c4015a5d0 2023-10-09T11:43:51.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:51.127 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:50.740156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.127+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 msgr2=0x7f7c2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.127+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 0x7f7c2c0697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7c300093f0 tx=0x7f7c30017000 comp rx=0 tx=0).stop 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.127+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 msgr2=0x7f7c400c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.127+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800cdb0 tx=0x7f7c380077d0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 shutdown_connections 2023-10-09T11:43:51.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c4015a5d0 0x7f7c400c9e50 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7c2c067320 0x7f7c2c0697d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c400cb5a0 0x7f7c4015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 --2- 172.21.15.26:0/3207538900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c400cd9e0 0x7f7c400c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 >> 172.21.15.26:0/3207538900 conn(0x7f7c40070e30 msgr2=0x7f7c400b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 shutdown_connections 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.128+0000 7f7c46451700 1 -- 172.21.15.26:0/3207538900 wait complete. 2023-10-09T11:43:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 111 2023-10-09T11:43:51.141 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:51.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.260+0000 7fb5af59e700 1 Processor -- start 2023-10-09T11:43:51.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.260+0000 7fb5af59e700 1 -- start start 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5af59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5b015de50 0x7fb5b00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5af59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5b00cef40 0x7fb5b015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5af59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00cf3c0 con 0x7fb5b0153c30 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5af59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b015afd0 con 0x7fb5b015de50 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5af59e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b015b2b0 con 0x7fb5b00cef40 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5b015de50 0x7fb5b00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5b015de50 0x7fb5b00cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57820/0 (socket says 172.21.15.26:57820) 2023-10-09T11:43:51.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 -- 172.21.15.26:0/5573391 learned_addr learned my addr 172.21.15.26:0/5573391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5aed9d700 1 --2- 172.21.15.26:0/5573391 >> v2:172.21.15.67:3300/0 conn(0x7fb5b00cef40 0x7fb5b015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 -- 172.21.15.26:0/5573391 >> v2:172.21.15.67:3300/0 conn(0x7fb5b00cef40 msgr2=0x7fb5b015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 --2- 172.21.15.26:0/5573391 >> v2:172.21.15.67:3300/0 conn(0x7fb5b00cef40 0x7fb5b015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.261+0000 7fb5add9b700 1 -- 172.21.15.26:0/5573391 >> v1:172.21.15.67:6789/0 conn(0x7fb5b0153c30 legacy=0x7fb5b015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5add9b700 1 -- 172.21.15.26:0/5573391 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b015b590 con 0x7fb5b015de50 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5add9b700 1 --2- 172.21.15.26:0/5573391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b015de50 0x7fb5b00cea00 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cdab0 tx=0x7fb598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd436973747ae8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5ad59a700 1 -- 172.21.15.26:0/5573391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800b820 con 0x7fb5b015de50 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5ad59a700 1 -- 172.21.15.26:0/5573391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59800b980 con 0x7fb5b015de50 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5ad59a700 1 -- 172.21.15.26:0/5573391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800bd20 con 0x7fb5b015de50 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 -- 172.21.15.26:0/5573391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b015de50 msgr2=0x7fb5b00cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 --2- 172.21.15.26:0/5573391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b015de50 0x7fb5b00cea00 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cdab0 tx=0x7fb598009250 comp rx=0 tx=0).stop 2023-10-09T11:43:51.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 -- 172.21.15.26:0/5573391 shutdown_connections 2023-10-09T11:43:51.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 --2- 172.21.15.26:0/5573391 >> v2:172.21.15.67:3300/0 conn(0x7fb5b00cef40 0x7fb5b015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 --2- 172.21.15.26:0/5573391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b015de50 0x7fb5b00cea00 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 -- 172.21.15.26:0/5573391 >> 172.21.15.26:0/5573391 conn(0x7fb5b00703a0 msgr2=0x7fb5b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 -- 172.21.15.26:0/5573391 shutdown_connections 2023-10-09T11:43:51.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.262+0000 7fb5af59e700 1 -- 172.21.15.26:0/5573391 wait complete. 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.263+0000 7fb5af59e700 1 Processor -- start 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 -- start start 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0153c30 0x7fb5b00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b015de50 0x7fb5b00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b013ea50 con 0x7fb5b00cef40 2023-10-09T11:43:51.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c87b0 con 0x7fb5b0153c30 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5af59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00cd850 con 0x7fb5b015de50 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5ae59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5ae59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57832/0 (socket says 172.21.15.26:57832) 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5ae59c700 1 -- 172.21.15.26:0/2462452019 learned_addr learned my addr 172.21.15.26:0/2462452019 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5aed9d700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b015de50 0x7fb5b00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.264+0000 7fb5add9b700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0153c30 0x7fb5b00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 -- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b015de50 msgr2=0x7fb5b00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b015de50 0x7fb5b00b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 -- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0153c30 msgr2=0x7fb5b00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0153c30 0x7fb5b00cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 -- 172.21.15.26:0/2462452019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980094f0 con 0x7fb5b00cef40 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5ae59c700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bc30 tx=0x7fb5a0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000c840 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000c9e0 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00c7ba0 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000cda0 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.265+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00c8160 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.266+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b004c3c0 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.267+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb5a0014620 con 0x7fb5b00cef40 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.267+0000 7fb5a67fc700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 0x7fb5900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.267+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fb5a0084d70 con 0x7fb5b00cef40 2023-10-09T11:43:51.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.267+0000 7fb5add9b700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 0x7fb5900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.268+0000 7fb5add9b700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 0x7fb5900697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cdab0 tx=0x7fb598016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.271+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5a004c5a0 con 0x7fb5b00cef40 2023-10-09T11:43:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.465+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b00caef0 con 0x7fb5b00cef40 2023-10-09T11:43:51.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.466+0000 7fb5a67fc700 1 -- 172.21.15.26:0/2462452019 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16886 (secure 0 0 0) 0x7fb5a0051870 con 0x7fb5b00cef40 2023-10-09T11:43:51.468 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:51.468 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":168,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:51.222167+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.468+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 msgr2=0x7fb5900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.468+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 0x7fb5900697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00cdab0 tx=0x7fb598016000 comp rx=0 tx=0).stop 2023-10-09T11:43:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 msgr2=0x7fb5b00cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bc30 tx=0x7fb5a0009820 comp rx=0 tx=0).stop 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 shutdown_connections 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb590067320 0x7fb5900697d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b015de50 0x7fb5b00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b00cef40 0x7fb5b00cd310 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 --2- 172.21.15.26:0/2462452019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0153c30 0x7fb5b00cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 >> 172.21.15.26:0/2462452019 conn(0x7fb5b00703a0 msgr2=0x7fb5b0150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 shutdown_connections 2023-10-09T11:43:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.469+0000 7fb5af59e700 1 -- 172.21.15.26:0/2462452019 wait complete. 2023-10-09T11:43:51.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:51.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.600+0000 7fca86e0f700 1 Processor -- start 2023-10-09T11:43:51.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.600+0000 7fca86e0f700 1 -- start start 2023-10-09T11:43:51.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca86e0f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fca800cb5a0 0x7fca800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca86e0f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8015ae40 con 0x7fca800cd9e0 2023-10-09T11:43:51.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca86e0f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8015ab60 con 0x7fca8015a5d0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca86e0f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800d13f0 con 0x7fca800cb5a0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca7ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fca800cd9e0 0x7fca80159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57236/0 (socket says 172.21.15.26:57236) 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca7ffff700 1 -- 172.21.15.26:0/2369977318 learned_addr learned my addr 172.21.15.26:0/2369977318 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca84bab700 1 --2- 172.21.15.26:0/2369977318 >> v2:172.21.15.67:3300/0 conn(0x7fca800cb5a0 0x7fca800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883486976 0 0) 0x7fca8015ae40 con 0x7fca800cd9e0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6c003570 con 0x7fca800cd9e0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958219961 0 0) 0x7fca6c003570 con 0x7fca800cd9e0 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca84bab700 1 -- 172.21.15.26:0/2369977318 >> v1:172.21.15.67:6789/0 conn(0x7fca8015a5d0 legacy=0x7fca80156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca84bab700 1 -- 172.21.15.26:0/2369977318 >> v1:172.21.15.26:6789/0 conn(0x7fca800cd9e0 legacy=0x7fca80159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.601+0000 7fca84bab700 1 -- 172.21.15.26:0/2369977318 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800ccf00 con 0x7fca800cb5a0 2023-10-09T11:43:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca84bab700 1 --2- 172.21.15.26:0/2369977318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cb5a0 0x7fca800cb970 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fca68009910 tx=0x7fca680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b2d7d7de285396 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70001470 con 0x7fca800cb5a0 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68011420 con 0x7fca800cb5a0 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca7f7fe700 1 -- 172.21.15.26:0/2369977318 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680117a0 con 0x7fca800cb5a0 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 -- 172.21.15.26:0/2369977318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cb5a0 msgr2=0x7fca800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 --2- 172.21.15.26:0/2369977318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cb5a0 0x7fca800cb970 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fca68009910 tx=0x7fca680091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 -- 172.21.15.26:0/2369977318 shutdown_connections 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 --2- 172.21.15.26:0/2369977318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cb5a0 0x7fca800cb970 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 -- 172.21.15.26:0/2369977318 >> 172.21.15.26:0/2369977318 conn(0x7fca80070e30 msgr2=0x7fca800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 -- 172.21.15.26:0/2369977318 shutdown_connections 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.602+0000 7fca86e0f700 1 -- 172.21.15.26:0/2369977318 wait complete. 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.603+0000 7fca86e0f700 1 Processor -- start 2023-10-09T11:43:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 -- start start 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cd9e0 0x7fca800b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca8015a5d0 0x7fca800c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800c9090 con 0x7fca800cb5a0 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80158b80 con 0x7fca800cd9e0 2023-10-09T11:43:51.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca86e0f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca80157f70 con 0x7fca8015a5d0 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca84bab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca84bab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57836/0 (socket says 172.21.15.26:57836) 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca84bab700 1 -- 172.21.15.26:0/3116213699 learned_addr learned my addr 172.21.15.26:0/3116213699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca7ffff700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cd9e0 0x7fca800b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.604+0000 7fca853ac700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca8015a5d0 0x7fca800c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 -- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca8015a5d0 msgr2=0x7fca800c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca8015a5d0 0x7fca800c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 -- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cd9e0 msgr2=0x7fca800b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cd9e0 0x7fca800b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 -- 172.21.15.26:0/3116213699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009420 con 0x7fca800cb5a0 2023-10-09T11:43:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca84bab700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fca680093f0 tx=0x7fca68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6801b960 con 0x7fca800cb5a0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68020070 con 0x7fca800cb5a0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca80158250 con 0x7fca800cb5a0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6801bd10 con 0x7fca800cb5a0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.605+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca80158810 con 0x7fca800cb5a0 2023-10-09T11:43:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.606+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8004c3c0 con 0x7fca800cb5a0 2023-10-09T11:43:51.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.607+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fca68022030 con 0x7fca800cb5a0 2023-10-09T11:43:51.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.607+0000 7fca7cff9700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 0x7fca600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.607+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fca680864a0 con 0x7fca800cb5a0 2023-10-09T11:43:51.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.607+0000 7fca7ffff700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 0x7fca600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.608+0000 7fca7ffff700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 0x7fca600697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fca8015e4e0 tx=0x7fca70000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.611+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca680530b0 con 0x7fca800cb5a0 2023-10-09T11:43:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.849+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca800cd1e0 con 0x7fca800cb5a0 2023-10-09T11:43:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.850+0000 7fca7cff9700 1 -- 172.21.15.26:0/3116213699 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fca680566d0 con 0x7fca800cb5a0 2023-10-09T11:43:51.852 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:51.852 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":111,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:50.740156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 msgr2=0x7fca600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 0x7fca600697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fca8015e4e0 tx=0x7fca70000bc0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 msgr2=0x7fca80151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fca680093f0 tx=0x7fca68016000 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 shutdown_connections 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fca60067320 0x7fca600697d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fca8015a5d0 0x7fca800c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca800cb5a0 0x7fca80151010 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 --2- 172.21.15.26:0/3116213699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca800cd9e0 0x7fca800b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 >> 172.21.15.26:0/3116213699 conn(0x7fca80070e30 msgr2=0x7fca800af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 shutdown_connections 2023-10-09T11:43:51.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.852+0000 7fca86e0f700 1 -- 172.21.15.26:0/3116213699 wait complete. 2023-10-09T11:43:51.855 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 111 2023-10-09T11:43:51.866 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.983+0000 7feb88fcf700 1 Processor -- start 2023-10-09T11:43:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.983+0000 7feb88fcf700 1 -- start start 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.984+0000 7feb88fcf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb84159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.984+0000 7feb88fcf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb8415a400 0x7feb84156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.984+0000 7feb88fcf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415ae40 con 0x7feb840cb5a0 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.984+0000 7feb88fcf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840ce0f0 con 0x7feb8415a400 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.984+0000 7feb88fcf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840cbde0 con 0x7feb840cb970 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb8259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feb840cb5a0 0x7feb840cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57252/0 (socket says 172.21.15.26:57252) 2023-10-09T11:43:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb8415a400 0x7feb84156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb8259c700 1 -- 172.21.15.26:0/3525656932 learned_addr learned my addr 172.21.15.26:0/3525656932 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb81d9b700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb84159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 -- 172.21.15.26:0/3525656932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 msgr2=0x7feb84159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb84159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 -- 172.21.15.26:0/3525656932 >> v1:172.21.15.26:6789/0 conn(0x7feb840cb5a0 legacy=0x7feb840cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 -- 172.21.15.26:0/3525656932 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8415ab60 con 0x7feb8415a400 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb82d9d700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb84156e90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009e90 tx=0x7feb7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15f76e85f76084 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb8159a700 1 -- 172.21.15.26:0/3525656932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00e070 con 0x7feb8415a400 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb8159a700 1 -- 172.21.15.26:0/3525656932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00bbf0 con 0x7feb8415a400 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.985+0000 7feb8159a700 1 -- 172.21.15.26:0/3525656932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c012430 con 0x7feb8415a400 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 -- 172.21.15.26:0/3525656932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 msgr2=0x7feb84156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb84156e90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009e90 tx=0x7feb7c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 -- 172.21.15.26:0/3525656932 shutdown_connections 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb84156e90 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 --2- 172.21.15.26:0/3525656932 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb84159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 -- 172.21.15.26:0/3525656932 >> 172.21.15.26:0/3525656932 conn(0x7feb84070e30 msgr2=0x7feb840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 -- 172.21.15.26:0/3525656932 shutdown_connections 2023-10-09T11:43:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.986+0000 7feb88fcf700 1 -- 172.21.15.26:0/3525656932 wait complete. 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.987+0000 7feb88fcf700 1 Processor -- start 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.987+0000 7feb88fcf700 1 -- start start 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb840cb5a0 0x7feb840b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb8416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b5950 con 0x7feb8415a400 2023-10-09T11:43:51.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8416a890 con 0x7feb840cb5a0 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb88fcf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b4d40 con 0x7feb840cb970 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57850/0 (socket says 172.21.15.26:57850) 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 -- 172.21.15.26:0/65693821 learned_addr learned my addr 172.21.15.26:0/65693821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb81d9b700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb8416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb8259c700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb840cb5a0 0x7feb840b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 -- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 msgr2=0x7feb8416a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb8416a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 -- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb840cb5a0 msgr2=0x7feb840b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb840cb5a0 0x7feb840b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 -- 172.21.15.26:0/65693821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009a20 con 0x7feb8415a400 2023-10-09T11:43:51.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb82d9d700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00b6c0 tx=0x7feb7c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.988+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c012ea0 con 0x7feb8415a400 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.989+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c01e630 con 0x7feb8415a400 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.989+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c01e9f0 con 0x7feb8415a400 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.989+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840b5020 con 0x7feb8415a400 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.989+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840b55e0 con 0x7feb8415a400 2023-10-09T11:43:51.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.989+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8404c3c0 con 0x7feb8415a400 2023-10-09T11:43:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.991+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb7c024070 con 0x7feb8415a400 2023-10-09T11:43:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.991+0000 7feb7a7fc700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 0x7feb640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.992+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7feb7c087840 con 0x7feb8415a400 2023-10-09T11:43:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.992+0000 7feb8259c700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 0x7feb640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:51.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.992+0000 7feb8259c700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 0x7feb640697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7feb74001950 tx=0x7feb74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:51.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:51.995+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb7c054380 con 0x7feb8415a400 2023-10-09T11:43:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.188+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb840b0600 con 0x7feb8415a400 2023-10-09T11:43:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.189+0000 7feb7a7fc700 1 -- 172.21.15.26:0/65693821 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16886 (secure 0 0 0) 0x7feb7c0579a0 con 0x7feb8415a400 2023-10-09T11:43:52.191 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:52.191 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":168,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:51.222167+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 msgr2=0x7feb640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 0x7feb640697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7feb74001950 tx=0x7feb74009040 comp rx=0 tx=0).stop 2023-10-09T11:43:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 msgr2=0x7feb840c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00b6c0 tx=0x7feb7c019000 comp rx=0 tx=0).stop 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 shutdown_connections 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8415a400 0x7feb840c9b30 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb840cb5a0 0x7feb840b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feb64067320 0x7feb640697d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 --2- 172.21.15.26:0/65693821 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb840cb970 0x7feb8416a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 >> 172.21.15.26:0/65693821 conn(0x7feb84070e30 msgr2=0x7feb840ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 shutdown_connections 2023-10-09T11:43:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.192+0000 7feb88fcf700 1 -- 172.21.15.26:0/65693821 wait complete. 2023-10-09T11:43:52.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000272394 --yes-i-really-mean-it 2023-10-09T11:43:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.327+0000 7f6a32ff7700 1 Processor -- start 2023-10-09T11:43:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.327+0000 7f6a32ff7700 1 -- start start 2023-10-09T11:43:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a32ff7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c159530 0x7f6a2c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a32ff7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c06dcf0 0x7f6a2c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a32ff7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c0ccfd0 con 0x7f6a2c159e40 2023-10-09T11:43:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a32ff7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c15a410 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a32ff7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15a6f0 con 0x7f6a2c159530 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a2bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c06dcf0 0x7f6a2c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a2bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c06dcf0 0x7f6a2c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57854/0 (socket says 172.21.15.26:57854) 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.328+0000 7f6a2bfff700 1 -- 172.21.15.26:0/1419228032 learned_addr learned my addr 172.21.15.26:0/1419228032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a30d93700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c159530 0x7f6a2c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2bfff700 1 -- 172.21.15.26:0/1419228032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c159530 msgr2=0x7f6a2c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2bfff700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c159530 0x7f6a2c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2bfff700 1 -- 172.21.15.26:0/1419228032 >> v1:172.21.15.67:6789/0 conn(0x7f6a2c159e40 legacy=0x7f6a2c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2bfff700 1 -- 172.21.15.26:0/1419228032 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c15a9d0 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2bfff700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c06dcf0 0x7f6a2c159900 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6a200099b0 tx=0x7f6a20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa51c25f1256838 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2b7fe700 1 -- 172.21.15.26:0/1419228032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000b820 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2b7fe700 1 -- 172.21.15.26:0/1419228032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000b980 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a2b7fe700 1 -- 172.21.15.26:0/1419228032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000bd20 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.329+0000 7f6a32ff7700 1 -- 172.21.15.26:0/1419228032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c06dcf0 msgr2=0x7f6a2c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c06dcf0 0x7f6a2c159900 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6a200099b0 tx=0x7f6a20009250 comp rx=0 tx=0).stop 2023-10-09T11:43:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 -- 172.21.15.26:0/1419228032 shutdown_connections 2023-10-09T11:43:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c159530 0x7f6a2c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/1419228032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c06dcf0 0x7f6a2c159900 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 -- 172.21.15.26:0/1419228032 >> 172.21.15.26:0/1419228032 conn(0x7f6a2c0703a0 msgr2=0x7f6a2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 -- 172.21.15.26:0/1419228032 shutdown_connections 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.330+0000 7f6a32ff7700 1 -- 172.21.15.26:0/1419228032 wait complete. 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.331+0000 7f6a32ff7700 1 Processor -- start 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.331+0000 7f6a32ff7700 1 -- start start 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 0x7f6a2c148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c159e40 0x7f6a2c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15b000 con 0x7f6a2c159530 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0b4790 con 0x7f6a2c159e40 2023-10-09T11:43:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15b2a0 con 0x7f6a2c06dcf0 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57868/0 (socket says 172.21.15.26:57868) 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 -- 172.21.15.26:0/2310530024 learned_addr learned my addr 172.21.15.26:0/2310530024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a30d93700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 0x7f6a2c148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a31594700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c159e40 0x7f6a2c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 -- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 msgr2=0x7f6a2c148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 0x7f6a2c148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 -- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c159e40 msgr2=0x7f6a2c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c159e40 0x7f6a2c15d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 -- 172.21.15.26:0/2310530024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200094f0 con 0x7f6a2c159530 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a30d93700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 0x7f6a2c148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a2bfff700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f6a200030c0 tx=0x7f6a20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20011ea0 con 0x7f6a2c159530 2023-10-09T11:43:52.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20020070 con 0x7f6a2c159530 2023-10-09T11:43:52.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c15b580 con 0x7f6a2c159530 2023-10-09T11:43:52.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2001b6a0 con 0x7f6a2c159530 2023-10-09T11:43:52.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.332+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c1488c0 con 0x7f6a2c159530 2023-10-09T11:43:52.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.333+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c04c3c0 con 0x7f6a2c159530 2023-10-09T11:43:52.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.334+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a20022030 con 0x7f6a2c159530 2023-10-09T11:43:52.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.334+0000 7f6a28ff9700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 0x7f6a180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:52.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.334+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f6a20086ca0 con 0x7f6a2c159530 2023-10-09T11:43:52.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.334+0000 7f6a30d93700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 0x7f6a180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:52.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.335+0000 7f6a30d93700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 0x7f6a180697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c008a80 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:52.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.338+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a200538b0 con 0x7f6a2c159530 2023-10-09T11:43:52.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:52.560+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000272394", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2c04c3c0 con 0x7f6a18067320 2023-10-09T11:43:54.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.235+0000 7f6a28ff9700 1 -- 172.21.15.26:0/2310530024 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+127 (secure 0 0 0) 0x7f6a2c04c3c0 con 0x7f6a18067320 2023-10-09T11:43:54.237 INFO:teuthology.orchestra.run.smithi026.stdout:FS volume 'cephfs' renamed to 'volume_0000000000272394'. But failed to rename data pools as more than one data pool was found. 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 msgr2=0x7f6a180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 0x7f6a180697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c008a80 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 msgr2=0x7f6a2c0b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f6a200030c0 tx=0x7f6a20016000 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 shutdown_connections 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c159e40 0x7f6a2c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6a18067320 0x7f6a180697d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6a2c06dcf0 0x7f6a2c148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 --2- 172.21.15.26:0/2310530024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c159530 0x7f6a2c0b3e40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 >> 172.21.15.26:0/2310530024 conn(0x7f6a2c0703a0 msgr2=0x7f6a2c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 shutdown_connections 2023-10-09T11:43:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.238+0000 7f6a32ff7700 1 -- 172.21.15.26:0/2310530024 wait complete. 2023-10-09T11:43:54.254 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:43:54.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.379+0000 7f78d494e700 1 Processor -- start 2023-10-09T11:43:54.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.379+0000 7f78d494e700 1 -- start start 2023-10-09T11:43:54.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78d494e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78d00b0ba0 0x7f78d00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78d494e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d015a280 con 0x7f78d00cf200 2023-10-09T11:43:54.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78d494e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d006e180 con 0x7f78d00b07d0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78d494e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d006d850 con 0x7f78d00b0ba0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78ced9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78d00b0ba0 0x7f78d00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78cdd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f78d00cf200 0x7f78d006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57266/0 (socket says 172.21.15.26:57266) 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78ced9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78d00b0ba0 0x7f78d00c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57874/0 (socket says 172.21.15.26:57874) 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.380+0000 7f78cdd9b700 1 -- 172.21.15.26:0/3068640823 learned_addr learned my addr 172.21.15.26:0/3068640823 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78ced9d700 1 -- 172.21.15.26:0/3068640823 >> v1:172.21.15.67:6789/0 conn(0x7f78d00b07d0 legacy=0x7f78d00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78ced9d700 1 -- 172.21.15.26:0/3068640823 >> v1:172.21.15.26:6789/0 conn(0x7f78d00cf200 legacy=0x7f78d006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78ced9d700 1 -- 172.21.15.26:0/3068640823 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d006db30 con 0x7f78d00b0ba0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78cd59a700 1 -- 172.21.15.26:0/3068640823 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185611582 0 0) 0x7f78d015a280 con 0x7f78d00cf200 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78ced9d700 1 --2- 172.21.15.26:0/3068640823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c42c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009e60 tx=0x7f78c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a0f2c39ac3f7c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78cd59a700 1 -- 172.21.15.26:0/3068640823 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800e070 con 0x7f78d00b0ba0 2023-10-09T11:43:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78cd59a700 1 -- 172.21.15.26:0/3068640823 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c800bc30 con 0x7f78d00b0ba0 2023-10-09T11:43:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.381+0000 7f78cd59a700 1 -- 172.21.15.26:0/3068640823 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012430 con 0x7f78d00b0ba0 2023-10-09T11:43:54.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 -- 172.21.15.26:0/3068640823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 msgr2=0x7f78d00c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 --2- 172.21.15.26:0/3068640823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c42c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009e60 tx=0x7f78c8009780 comp rx=0 tx=0).stop 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 -- 172.21.15.26:0/3068640823 shutdown_connections 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 --2- 172.21.15.26:0/3068640823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c42c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 -- 172.21.15.26:0/3068640823 >> 172.21.15.26:0/3068640823 conn(0x7f78d006ce80 msgr2=0x7f78d00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 -- 172.21.15.26:0/3068640823 shutdown_connections 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.382+0000 7f78d494e700 1 -- 172.21.15.26:0/3068640823 wait complete. 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.383+0000 7f78d494e700 1 Processor -- start 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.383+0000 7f78d494e700 1 -- start start 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 0x7f78d01472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 0x7f78d00981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c7300 con 0x7f78d00b0ba0 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c6710 con 0x7f78d00b07d0 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c69d0 con 0x7f78d00cf200 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57888/0 (socket says 172.21.15.26:57888) 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 -- 172.21.15.26:0/3214634770 learned_addr learned my addr 172.21.15.26:0/3214634770 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78ce59c700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 0x7f78d01472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78ced9d700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 0x7f78d00981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 -- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 msgr2=0x7f78d00981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 0x7f78d00981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 -- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 msgr2=0x7f78d01472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 0x7f78d01472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 -- 172.21.15.26:0/3214634770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8009a20 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78ced9d700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 0x7f78d00981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78ce59c700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 0x7f78d01472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78cdd9b700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7e0 tx=0x7f78b8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8005b30 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8005c90 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d00c6cb0 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007300 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.384+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d0147830 con 0x7f78d00b0ba0 2023-10-09T11:43:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.385+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d00c7470 con 0x7f78d00b0ba0 2023-10-09T11:43:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.386+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f78b801b400 con 0x7f78d00b0ba0 2023-10-09T11:43:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.386+0000 7f78c67fc700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 0x7f78b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.386+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f78b8084930 con 0x7f78d00b0ba0 2023-10-09T11:43:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.387+0000 7f78ce59c700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 0x7f78b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.387+0000 7f78ce59c700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 0x7f78b00697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f78c0001850 tx=0x7f78c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.391+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78b8051480 con 0x7f78d00b0ba0 2023-10-09T11:43:54.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.611+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f78d004c3c0 con 0x7f78b0067320 2023-10-09T11:43:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.614+0000 7f78c67fc700 1 -- 172.21.15.26:0/3214634770 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f78d004c3c0 con 0x7f78b0067320 2023-10-09T11:43:54.614 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:43:54.614 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:43:54.614 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000000272394" 2023-10-09T11:43:54.615 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:43:54.615 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 msgr2=0x7f78b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 0x7f78b00697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f78c0001850 tx=0x7f78c0009040 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 msgr2=0x7f78d00c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7e0 tx=0x7f78b8007df0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 shutdown_connections 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f78b0067320 0x7f78b00697d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f78d00cf200 0x7f78d00981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d00b07d0 0x7f78d01472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 --2- 172.21.15.26:0/3214634770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78d00b0ba0 0x7f78d00c7790 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 >> 172.21.15.26:0/3214634770 conn(0x7f78d006ce80 msgr2=0x7f78d00ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 shutdown_connections 2023-10-09T11:43:54.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.615+0000 7f78d494e700 1 -- 172.21.15.26:0/3214634770 wait complete. 2023-10-09T11:43:54.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.749+0000 7f1b14802700 1 Processor -- start 2023-10-09T11:43:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.749+0000 7f1b14802700 1 -- start start 2023-10-09T11:43:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.750+0000 7f1b14802700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b1006a410 0x7f1b1006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.750+0000 7f1b14802700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.750+0000 7f1b14802700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b100af550 con 0x7f1b10159890 2023-10-09T11:43:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.750+0000 7f1b14802700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b100ace30 con 0x7f1b1006a410 2023-10-09T11:43:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.750+0000 7f1b14802700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100ad330 con 0x7f1b100ad810 2023-10-09T11:43:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b1006a410 0x7f1b1006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b1006a410 0x7f1b1006a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:35040/0 (socket says 172.21.15.26:35040) 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0ffff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:44166/0 (socket says 172.21.15.26:44166) 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 -- 172.21.15.26:0/2680642980 learned_addr learned my addr 172.21.15.26:0/2680642980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 -- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 msgr2=0x7f1b100adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 -- 172.21.15.26:0/2680642980 >> v1:172.21.15.67:6789/0 conn(0x7f1b10159890 legacy=0x7f1b100aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 -- 172.21.15.26:0/2680642980 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1006adc0 con 0x7f1b1006a410 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0effd700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1006a410 0x7f1b1006a880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400bc50 tx=0x7f1b0400b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b69d55df4c921b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/2680642980 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400dbf0 con 0x7f1b1006a410 2023-10-09T11:43:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/2680642980 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400dd50 con 0x7f1b1006a410 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.751+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/2680642980 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040196b0 con 0x7f1b1006a410 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 -- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1006a410 msgr2=0x7f1b1006a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1006a410 0x7f1b1006a880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400bc50 tx=0x7f1b0400b4f0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 -- 172.21.15.26:0/2680642980 shutdown_connections 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b100ad810 0x7f1b100adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 --2- 172.21.15.26:0/2680642980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1006a410 0x7f1b1006a880 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 -- 172.21.15.26:0/2680642980 >> 172.21.15.26:0/2680642980 conn(0x7f1b100cca00 msgr2=0x7f1b100cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 -- 172.21.15.26:0/2680642980 shutdown_connections 2023-10-09T11:43:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.752+0000 7f1b14802700 1 -- 172.21.15.26:0/2680642980 wait complete. 2023-10-09T11:43:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.753+0000 7f1b14802700 1 Processor -- start 2023-10-09T11:43:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.753+0000 7f1b14802700 1 -- start start 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b100ad810 0x7f1b101588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 0x7f1b1014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100afa10 con 0x7f1b1006a410 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10150740 con 0x7f1b100ad810 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b14802700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10150a20 con 0x7f1b10159890 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57904/0 (socket says 172.21.15.26:57904) 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b0f7fe700 1 -- 172.21.15.26:0/175113056 learned_addr learned my addr 172.21.15.26:0/175113056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b0effd700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b100ad810 0x7f1b101588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.754+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 0x7f1b1014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 -- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 msgr2=0x7f1b1014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 0x7f1b1014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 -- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b100ad810 msgr2=0x7f1b101588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b100ad810 0x7f1b101588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 -- 172.21.15.26:0/175113056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009a20 con 0x7f1b1006a410 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 0x7f1b1014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b0f7fe700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c4e0 tx=0x7f1b0000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00011590 con 0x7f1b1006a410 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00011710 con 0x7f1b1006a410 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0400b790 con 0x7f1b1006a410 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00011ad0 con 0x7f1b1006a410 2023-10-09T11:43:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.755+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b10150fe0 con 0x7f1b1006a410 2023-10-09T11:43:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.756+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1004c3c0 con 0x7f1b1006a410 2023-10-09T11:43:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.756+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b0001b3b0 con 0x7f1b1006a410 2023-10-09T11:43:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.757+0000 7f1af77fe700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.757+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f1b00084380 con 0x7f1b1006a410 2023-10-09T11:43:54.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.757+0000 7f1b0effd700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:54.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.758+0000 7f1b0effd700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400bc50 tx=0x7f1b0401b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:54.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.761+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b00050e30 con 0x7f1b1006a410 2023-10-09T11:43:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.999+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b100c8ed0 con 0x7f1b1006a410 2023-10-09T11:43:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:54.999+0000 7f1af77fe700 1 -- 172.21.15.26:0/175113056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4627 (secure 0 0 0) 0x7f1b00017090 con 0x7f1b1006a410 2023-10-09T11:43:55.001 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:55.001 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:53.225580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000272394","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 msgr2=0x7f1afc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400bc50 tx=0x7f1b0401b000 comp rx=0 tx=0).stop 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 msgr2=0x7f1b1014ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c4e0 tx=0x7f1b0000c7f0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 shutdown_connections 2023-10-09T11:43:55.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b10159890 0x7f1b1014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b1006a410 0x7f1b1014ec30 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 --2- 172.21.15.26:0/175113056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b100ad810 0x7f1b101588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 >> 172.21.15.26:0/175113056 conn(0x7f1b100cca00 msgr2=0x7f1b100ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 shutdown_connections 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.001+0000 7f1b14802700 1 -- 172.21.15.26:0/175113056 wait complete. 2023-10-09T11:43:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 112 2023-10-09T11:43:55.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.132+0000 7f4a19bdc700 1 Processor -- start 2023-10-09T11:43:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.132+0000 7f4a19bdc700 1 -- start start 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a19bdc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a19bdc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1415a400 0x7f4a14156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a19bdc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1415ae40 con 0x7f4a140cb5a0 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a19bdc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140ce0f0 con 0x7f4a1415a400 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a19bdc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140cbde0 con 0x7f4a140cb970 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a13fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1415a400 0x7f4a14156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a13fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a1415a400 0x7f4a14156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57920/0 (socket says 172.21.15.26:57920) 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a13fff700 1 -- 172.21.15.26:0/1404394317 learned_addr learned my addr 172.21.15.26:0/1404394317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.133+0000 7f4a12ffd700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a13fff700 1 -- 172.21.15.26:0/1404394317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 msgr2=0x7f4a14159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a13fff700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a14159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a13fff700 1 -- 172.21.15.26:0/1404394317 >> v1:172.21.15.67:6789/0 conn(0x7f4a140cb5a0 legacy=0x7f4a140cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a13fff700 1 -- 172.21.15.26:0/1404394317 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1415ab60 con 0x7f4a1415a400 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a13fff700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1415a400 0x7f4a14156e90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f50 tx=0x7f4a0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75873979ab81cc11 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a127fc700 1 -- 172.21.15.26:0/1404394317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00e070 con 0x7f4a1415a400 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a127fc700 1 -- 172.21.15.26:0/1404394317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00b9c0 con 0x7f4a1415a400 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a127fc700 1 -- 172.21.15.26:0/1404394317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0092e0 con 0x7f4a1415a400 2023-10-09T11:43:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 -- 172.21.15.26:0/1404394317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1415a400 msgr2=0x7f4a14156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1415a400 0x7f4a14156e90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f50 tx=0x7f4a0c009840 comp rx=0 tx=0).stop 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 -- 172.21.15.26:0/1404394317 shutdown_connections 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a1415a400 0x7f4a14156e90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/1404394317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a14159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 -- 172.21.15.26:0/1404394317 >> 172.21.15.26:0/1404394317 conn(0x7f4a14070e30 msgr2=0x7f4a140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 -- 172.21.15.26:0/1404394317 shutdown_connections 2023-10-09T11:43:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.134+0000 7f4a19bdc700 1 -- 172.21.15.26:0/1404394317 wait complete. 2023-10-09T11:43:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 Processor -- start 2023-10-09T11:43:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 -- start start 2023-10-09T11:43:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a1416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1415a400 0x7f4a140c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140b5950 con 0x7f4a140cb5a0 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1416a890 con 0x7f4a1415a400 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a19bdc700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140b4d40 con 0x7f4a140cb970 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.136+0000 7f4a137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57932/0 (socket says 172.21.15.26:57932) 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 -- 172.21.15.26:0/3452363477 learned_addr learned my addr 172.21.15.26:0/3452363477 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a13fff700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1415a400 0x7f4a140c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a12ffd700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a1416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 -- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 msgr2=0x7f4a1416a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a1416a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 -- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1415a400 msgr2=0x7f4a140c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1415a400 0x7f4a140c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 -- 172.21.15.26:0/3452363477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c009ae0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a12ffd700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a1416a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a137fe700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c510 tx=0x7f4a0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011590 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04011710 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a140b5020 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011ad0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.137+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a140b55e0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.138+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1404c3c0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.139+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a0401b3b0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.139+0000 7f49fb7fe700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 0x7f4a000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.139+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f4a04084410 con 0x7f4a140cb5a0 2023-10-09T11:43:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.139+0000 7f4a12ffd700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 0x7f4a000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.140+0000 7f4a12ffd700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 0x7f4a000697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006f00 tx=0x7f4a08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.143+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a04050ec0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.338+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a140b5c30 con 0x7f4a140cb5a0 2023-10-09T11:43:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.339+0000 7f49fb7fe700 1 -- 172.21.15.26:0/3452363477 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f4a040544e0 con 0x7f4a140cb5a0 2023-10-09T11:43:55.340 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:55.341 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":170,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:54.227452+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000272394.meta","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000272394"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 msgr2=0x7f4a000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 0x7f4a000697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006f00 tx=0x7f4a08008040 comp rx=0 tx=0).stop 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 msgr2=0x7f4a140b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c510 tx=0x7f4a0400c8d0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 shutdown_connections 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a1415a400 0x7f4a140c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140cb5a0 0x7f4a140b46a0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a00067320 0x7f4a000697d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 --2- 172.21.15.26:0/3452363477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a140cb970 0x7f4a1416a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 >> 172.21.15.26:0/3452363477 conn(0x7f4a14070e30 msgr2=0x7f4a140ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 shutdown_connections 2023-10-09T11:43:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.341+0000 7f4a19bdc700 1 -- 172.21.15.26:0/3452363477 wait complete. 2023-10-09T11:43:55.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:43:55.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:55.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:43:55.435 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:43:55.436 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:55.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.553+0000 7f1051584700 1 Processor -- start 2023-10-09T11:43:55.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.553+0000 7f1051584700 1 -- start start 2023-10-09T11:43:55.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f1051584700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f104c0cb5a0 0x7f104c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f1051584700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f104c15a5d0 0x7f104c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f1051584700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104c15ae40 con 0x7f104c0cd9e0 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f1051584700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104c0d13f0 con 0x7f104c15a5d0 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f1051584700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104c15ab60 con 0x7f104c0cb5a0 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f104b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f104c15a5d0 0x7f104c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.554+0000 7f104b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f104c15a5d0 0x7f104c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57940/0 (socket says 172.21.15.26:57940) 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 -- 172.21.15.26:0/1584378056 learned_addr learned my addr 172.21.15.26:0/1584378056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104affd700 1 --2- 172.21.15.26:0/1584378056 >> v2:172.21.15.67:3300/0 conn(0x7f104c0cb5a0 0x7f104c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 -- 172.21.15.26:0/1584378056 >> v2:172.21.15.67:3300/0 conn(0x7f104c0cb5a0 msgr2=0x7f104c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 --2- 172.21.15.26:0/1584378056 >> v2:172.21.15.67:3300/0 conn(0x7f104c0cb5a0 0x7f104c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 -- 172.21.15.26:0/1584378056 >> v1:172.21.15.67:6789/0 conn(0x7f104c0cd9e0 legacy=0x7f104c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 -- 172.21.15.26:0/1584378056 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0ccf00 con 0x7f104c15a5d0 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f104b7fe700 1 --2- 172.21.15.26:0/1584378056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c15a5d0 0x7f104c156e90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1044009f20 tx=0x7f1044009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee98260ad3816df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f1049ffb700 1 -- 172.21.15.26:0/1584378056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104400e070 con 0x7f104c15a5d0 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f1049ffb700 1 -- 172.21.15.26:0/1584378056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104400ba00 con 0x7f104c15a5d0 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.555+0000 7f1049ffb700 1 -- 172.21.15.26:0/1584378056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10440092e0 con 0x7f104c15a5d0 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 -- 172.21.15.26:0/1584378056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c15a5d0 msgr2=0x7f104c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 --2- 172.21.15.26:0/1584378056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c15a5d0 0x7f104c156e90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1044009f20 tx=0x7f1044009840 comp rx=0 tx=0).stop 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 -- 172.21.15.26:0/1584378056 shutdown_connections 2023-10-09T11:43:55.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 --2- 172.21.15.26:0/1584378056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c15a5d0 0x7f104c156e90 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 --2- 172.21.15.26:0/1584378056 >> v2:172.21.15.67:3300/0 conn(0x7f104c0cb5a0 0x7f104c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 -- 172.21.15.26:0/1584378056 >> 172.21.15.26:0/1584378056 conn(0x7f104c070e30 msgr2=0x7f104c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 -- 172.21.15.26:0/1584378056 shutdown_connections 2023-10-09T11:43:55.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.556+0000 7f1051584700 1 -- 172.21.15.26:0/1584378056 wait complete. 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.557+0000 7f1051584700 1 Processor -- start 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.557+0000 7f1051584700 1 -- start start 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f104c0cb5a0 0x7f104c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f104c15a5d0 0x7f104c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c16dda0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c0b5b20 con 0x7f104c0cb5a0 2023-10-09T11:43:55.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c0b5e00 con 0x7f104c15a5d0 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57954/0 (socket says 172.21.15.26:57954) 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 -- 172.21.15.26:0/4137271519 learned_addr learned my addr 172.21.15.26:0/4137271519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104affd700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f104c0cb5a0 0x7f104c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 -- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f104c15a5d0 msgr2=0x7f104c16cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f104c15a5d0 0x7f104c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 -- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f104c0cb5a0 msgr2=0x7f104c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f104c0cb5a0 0x7f104c1521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 -- 172.21.15.26:0/4137271519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1044009ae0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f104a7fc700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f103400b600 tx=0x7f10340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400f510 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400f670 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c0b60e0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400fa30 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.558+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c1545a0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.559+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c1547c0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.560+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f103401a400 con 0x7f104c0cd9e0 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.560+0000 7f1042ffd700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 0x7f102c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.560+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f1034084810 con 0x7f104c0cd9e0 2023-10-09T11:43:55.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.561+0000 7f104affd700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 0x7f102c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.561+0000 7f104affd700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 0x7f102c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f103c006fd0 tx=0x7f103c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.565+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1034051440 con 0x7f104c0cd9e0 2023-10-09T11:43:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.800+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f104c04c3f0 con 0x7f104c0cd9e0 2023-10-09T11:43:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.800+0000 7f1042ffd700 1 -- 172.21.15.26:0/4137271519 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4627 (secure 0 0 0) 0x7f1034054a60 con 0x7f104c0cd9e0 2023-10-09T11:43:55.801 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:55.802 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:53.225580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000272394","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 msgr2=0x7f102c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 0x7f102c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f103c006fd0 tx=0x7f103c008040 comp rx=0 tx=0).stop 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 msgr2=0x7f104c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f103400b600 tx=0x7f10340091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 shutdown_connections 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f102c067320 0x7f102c0697d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f104c15a5d0 0x7f104c16cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f104c0cb5a0 0x7f104c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 --2- 172.21.15.26:0/4137271519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c0cd9e0 0x7f104c15d950 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 >> 172.21.15.26:0/4137271519 conn(0x7f104c070e30 msgr2=0x7f104c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 shutdown_connections 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.803+0000 7f1051584700 1 -- 172.21.15.26:0/4137271519 wait complete. 2023-10-09T11:43:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 112 2023-10-09T11:43:55.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 Processor -- start 2023-10-09T11:43:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 -- start start 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f531c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c15ae40 con 0x7f531c0cb5a0 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c15ab60 con 0x7f531c0cb970 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.933+0000 7f53245b4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0ce0f0 con 0x7f531c15a5d0 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5322350700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f531c0cb5a0 0x7f531c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57276/0 (socket says 172.21.15.26:57276) 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5322350700 1 -- 172.21.15.26:0/331756691 learned_addr learned my addr 172.21.15.26:0/331756691 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848799944 0 0) 0x7f531c15ae40 con 0x7f531c0cb5a0 2023-10-09T11:43:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5322b51700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f531c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5304003570 con 0x7f531c0cb5a0 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461465836 0 0) 0x7f5304003570 con 0x7f531c0cb5a0 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 msgr2=0x7f531c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f531c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 >> v1:172.21.15.67:6789/0 conn(0x7f531c0cb970 legacy=0x7f531c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0ccf00 con 0x7f531c0cb5a0 2023-10-09T11:43:55.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f530c0017f0 con 0x7f531c0cb5a0 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 >> v1:172.21.15.26:6789/0 conn(0x7f531c0cb5a0 legacy=0x7f531c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304003a90 0x7f5304003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f5304004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5304004d50 0x7f53040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0ce0f0 con 0x7f5304004d50 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530400bb70 con 0x7f5304003a90 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530400bd30 con 0x7f531c15a5d0 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5322b51700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5304004d50 0x7f53040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5322350700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304003a90 0x7f5304003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.934+0000 7f5321b4f700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f5304004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 -- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 msgr2=0x7f5304004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f531c15a5d0 0x7f5304004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 -- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304003a90 msgr2=0x7f5304003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304003a90 0x7f5304003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 -- 172.21.15.26:0/331756691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304003570 con 0x7f5304004d50 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f5322b51700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5304004d50 0x7f53040051c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5314009c00 tx=0x7f53140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d023bbdef37ad173 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400e710 con 0x7f5304004d50 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400e870 con 0x7f5304004d50 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.935+0000 7f532134e700 1 -- 172.21.15.26:0/331756691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400ec30 con 0x7f5304004d50 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 -- 172.21.15.26:0/331756691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5304004d50 msgr2=0x7f53040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 --2- 172.21.15.26:0/331756691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5304004d50 0x7f53040051c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5314009c00 tx=0x7f53140091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f5322b51700 1 -- 172.21.15.26:0/331756691 reap_dead start 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 -- 172.21.15.26:0/331756691 shutdown_connections 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 -- 172.21.15.26:0/331756691 >> 172.21.15.26:0/331756691 conn(0x7f531c070e30 msgr2=0x7f531c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 -- 172.21.15.26:0/331756691 shutdown_connections 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.936+0000 7f53245b4700 1 -- 172.21.15.26:0/331756691 wait complete. 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 Processor -- start 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 -- start start 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5304004d50 0x7f531c168f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531c155360 0x7f531c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c169490 con 0x7f531c158d30 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c155d40 con 0x7f531c155360 2023-10-09T11:43:55.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.937+0000 7f53245b4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c15b0b0 con 0x7f5304004d50 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57964/0 (socket says 172.21.15.26:57964) 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 -- 172.21.15.26:0/1321532394 learned_addr learned my addr 172.21.15.26:0/1321532394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5322350700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5304004d50 0x7f531c168f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5322b51700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531c155360 0x7f531c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 -- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5304004d50 msgr2=0x7f531c168f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5304004d50 0x7f531c168f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 -- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531c155360 msgr2=0x7f531c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531c155360 0x7f531c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 -- 172.21.15.26:0/1321532394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0b47c0 con 0x7f531c158d30 2023-10-09T11:43:55.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f5321b4f700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5310002950 tx=0x7f5310007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310013600 con 0x7f531c158d30 2023-10-09T11:43:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310013760 con 0x7f531c158d30 2023-10-09T11:43:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c0b4aa0 con 0x7f531c158d30 2023-10-09T11:43:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310013b20 con 0x7f531c158d30 2023-10-09T11:43:55.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.938+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c0b5060 con 0x7f531c158d30 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.939+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c0b5250 con 0x7f531c158d30 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.940+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f531001b3b0 con 0x7f531c158d30 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.940+0000 7f531a7fc700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 0x7f53080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.940+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f5310084b00 con 0x7f531c158d30 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.940+0000 7f5322350700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 0x7f53080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:55.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.941+0000 7f5322350700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 0x7f53080697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f530c001a20 tx=0x7f530c0021d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:55.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:55.944+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5310086e60 con 0x7f531c158d30 2023-10-09T11:43:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.138+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f531c04c3c0 con 0x7f531c158d30 2023-10-09T11:43:56.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.139+0000 7f531a7fc700 1 -- 172.21.15.26:0/1321532394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f53100515b0 con 0x7f531c158d30 2023-10-09T11:43:56.141 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:56.141 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":170,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:54.227452+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000272394.meta","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000272394"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 msgr2=0x7f53080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 0x7f53080697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f530c001a20 tx=0x7f530c0021d0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 msgr2=0x7f531c0b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5310002950 tx=0x7f5310007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 shutdown_connections 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531c155360 0x7f531c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5308067320 0x7f53080697d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5304004d50 0x7f531c168f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 --2- 172.21.15.26:0/1321532394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f531c158d30 0x7f531c0b3e70 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 >> 172.21.15.26:0/1321532394 conn(0x7f531c070e30 msgr2=0x7f531c154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.141+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 shutdown_connections 2023-10-09T11:43:56.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.142+0000 7f53245b4700 1 -- 172.21.15.26:0/1321532394 wait complete. 2023-10-09T11:43:56.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 28, 'pool_name': 'cephfs.volume_0000000000272394.meta', 'create_time': '2023-10-09T11:43:36.497513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000272394'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:43:37.058665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000272394'}}}, {'pool': 30, 'pool_name': 'another-data-pool', 'create_time': '2023-10-09T11:43:49.060468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000272394'}}}] 2023-10-09T11:43:56.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.277+0000 7fa3e5b25700 1 Processor -- start 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.277+0000 7fa3e5b25700 1 -- start start 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3e5b25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e0159860 0x7fa3e00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3e5b25700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e00ccfa0 0x7fa3e00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3e5b25700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e00cf510 con 0x7fa3e00cbd90 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3e5b25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e00d00b0 con 0x7fa3e0159860 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3e5b25700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00cc210 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3df7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e0159860 0x7fa3e00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3df7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e0159860 0x7fa3e00ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57980/0 (socket says 172.21.15.26:57980) 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3df7fe700 1 -- 172.21.15.26:0/1726214531 learned_addr learned my addr 172.21.15.26:0/1726214531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.278+0000 7fa3deffd700 1 --1- 172.21.15.26:0/1726214531 >> v1:172.21.15.26:6789/0 conn(0x7fa3e00cbd90 0x7fa3e00cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57278/0 (socket says 172.21.15.26:57278) 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3dffff700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e00ccfa0 0x7fa3e00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3df7fe700 1 -- 172.21.15.26:0/1726214531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e00ccfa0 msgr2=0x7fa3e00cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3df7fe700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e00ccfa0 0x7fa3e00cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3df7fe700 1 -- 172.21.15.26:0/1726214531 >> v1:172.21.15.26:6789/0 conn(0x7fa3e00cbd90 legacy=0x7fa3e00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3df7fe700 1 -- 172.21.15.26:0/1726214531 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00cd960 con 0x7fa3e0159860 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3de7fc700 1 -- 172.21.15.26:0/1726214531 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485313336 0 0) 0x7fa3e00cf510 con 0x7fa3e00cbd90 2023-10-09T11:43:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3df7fe700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e0159860 0x7fa3e00ce220 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009990 tx=0x7fa3d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c878211f900fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3de7fc700 1 -- 172.21.15.26:0/1726214531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0005c10 con 0x7fa3e0159860 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3de7fc700 1 -- 172.21.15.26:0/1726214531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0005d70 con 0x7fa3e0159860 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3de7fc700 1 -- 172.21.15.26:0/1726214531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000b880 con 0x7fa3e0159860 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3e5b25700 1 -- 172.21.15.26:0/1726214531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e0159860 msgr2=0x7fa3e00ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.279+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e0159860 0x7fa3e00ce220 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009990 tx=0x7fa3d0009220 comp rx=0 tx=0).stop 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 -- 172.21.15.26:0/1726214531 shutdown_connections 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e00ccfa0 0x7fa3e00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/1726214531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e0159860 0x7fa3e00ce220 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 -- 172.21.15.26:0/1726214531 >> 172.21.15.26:0/1726214531 conn(0x7fa3e00999b0 msgr2=0x7fa3e0070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 -- 172.21.15.26:0/1726214531 shutdown_connections 2023-10-09T11:43:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.280+0000 7fa3e5b25700 1 -- 172.21.15.26:0/1726214531 wait complete. 2023-10-09T11:43:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.281+0000 7fa3e5b25700 1 Processor -- start 2023-10-09T11:43:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.281+0000 7fa3e5b25700 1 -- start start 2023-10-09T11:43:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00cbd90 0x7fa3e00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e0159860 0x7fa3e0169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00cacf0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00c8160 con 0x7fa3e00cbd90 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009a500 con 0x7fa3e0159860 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57992/0 (socket says 172.21.15.26:57992) 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 -- 172.21.15.26:0/2782126631 learned_addr learned my addr 172.21.15.26:0/2782126631 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3df7fe700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00cbd90 0x7fa3e00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3dffff700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e0159860 0x7fa3e0169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 -- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e0159860 msgr2=0x7fa3e0169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e0159860 0x7fa3e0169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 -- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00cbd90 msgr2=0x7fa3e00ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00cbd90 0x7fa3e00ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 -- 172.21.15.26:0/2782126631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009480 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3deffd700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c5e0 tx=0x7fa3d4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40072e0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4007440 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40057f0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.282+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e00c7830 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.283+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e00c7df0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.283+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e00c82f0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.284+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa3d4005ba0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.284+0000 7fa3c77fe700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 0x7fa3cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.284+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fa3d40843e0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.285+0000 7fa3df7fe700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 0x7fa3cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.285+0000 7fa3df7fe700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 0x7fa3cc0697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009860 tx=0x7fa3d0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.289+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3d4050e50 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:56.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.483+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3e004c3c0 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.483+0000 7fa3c77fe700 1 -- 172.21.15.26:0/2782126631 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3d4017020 con 0x7fa3e00ccfa0 2023-10-09T11:43:56.485 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 msgr2=0x7fa3cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 0x7fa3cc0697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009860 tx=0x7fa3d0016000 comp rx=0 tx=0).stop 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 msgr2=0x7fa3e0158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c5e0 tx=0x7fa3d4007f40 comp rx=0 tx=0).stop 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 shutdown_connections 2023-10-09T11:43:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa3cc067320 0x7fa3cc0697d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3e0159860 0x7fa3e0169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00cbd90 0x7fa3e00ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 --2- 172.21.15.26:0/2782126631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e00ccfa0 0x7fa3e0158bf0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 >> 172.21.15.26:0/2782126631 conn(0x7fa3e00999b0 msgr2=0x7fa3e00b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 shutdown_connections 2023-10-09T11:43:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.486+0000 7fa3e5b25700 1 -- 172.21.15.26:0/2782126631 wait complete. 2023-10-09T11:43:56.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000272394.meta pg_num 2023-10-09T11:43:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.619+0000 7ffa79456700 1 Processor -- start 2023-10-09T11:43:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.619+0000 7ffa79456700 1 -- start start 2023-10-09T11:43:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa79456700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa79456700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa740cea00 0x7ffa740cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa79456700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415ac50 con 0x7ffa7415de50 2023-10-09T11:43:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa79456700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7415d010 con 0x7ffa740cea00 2023-10-09T11:43:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa79456700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7415af60 con 0x7ffa74153a00 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa78c55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa740cea00 0x7ffa740cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa78c55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa740cea00 0x7ffa740cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58004/0 (socket says 172.21.15.26:58004) 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa78c55700 1 -- 172.21.15.26:0/2841001995 learned_addr learned my addr 172.21.15.26:0/2841001995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.620+0000 7ffa73fff700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa78c55700 1 -- 172.21.15.26:0/2841001995 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 msgr2=0x7ffa74153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa78c55700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa78c55700 1 -- 172.21.15.26:0/2841001995 >> v1:172.21.15.67:6789/0 conn(0x7ffa7415de50 legacy=0x7ffa7415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa78c55700 1 -- 172.21.15.26:0/2841001995 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7415b240 con 0x7ffa740cea00 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa73fff700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa78c55700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa740cea00 0x7ffa740cee40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f20 tx=0x7ffa6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e86a0b8375519b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa72ffd700 1 -- 172.21.15.26:0/2841001995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00e070 con 0x7ffa740cea00 2023-10-09T11:43:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa72ffd700 1 -- 172.21.15.26:0/2841001995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00ba40 con 0x7ffa740cea00 2023-10-09T11:43:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa72ffd700 1 -- 172.21.15.26:0/2841001995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0092e0 con 0x7ffa740cea00 2023-10-09T11:43:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 -- 172.21.15.26:0/2841001995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa740cea00 msgr2=0x7ffa740cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa740cea00 0x7ffa740cee40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f20 tx=0x7ffa6c009840 comp rx=0 tx=0).stop 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 -- 172.21.15.26:0/2841001995 shutdown_connections 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa740cea00 0x7ffa740cee40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 --2- 172.21.15.26:0/2841001995 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.621+0000 7ffa79456700 1 -- 172.21.15.26:0/2841001995 >> 172.21.15.26:0/2841001995 conn(0x7ffa740703a0 msgr2=0x7ffa740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.622+0000 7ffa79456700 1 -- 172.21.15.26:0/2841001995 shutdown_connections 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.622+0000 7ffa79456700 1 -- 172.21.15.26:0/2841001995 wait complete. 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.623+0000 7ffa79456700 1 Processor -- start 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.623+0000 7ffa79456700 1 -- start start 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.623+0000 7ffa79456700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740cea00 0x7ffa7414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740cc100 con 0x7ffa7415de50 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740cb4f0 con 0x7ffa740cea00 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740cb7d0 con 0x7ffa74153a00 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58012/0 (socket says 172.21.15.26:58012) 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 -- 172.21.15.26:0/1024454153 learned_addr learned my addr 172.21.15.26:0/1024454153 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa737fe700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa73fff700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740cea00 0x7ffa7414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 -- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 msgr2=0x7ffa74159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 -- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740cea00 msgr2=0x7ffa7414ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740cea00 0x7ffa7414ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 -- 172.21.15.26:0/1024454153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009ae0 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa78c55700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ffa7406eb00 tx=0x7ffa6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0032f0 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c012e60 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c01d670 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740cbab0 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.624+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7414d4e0 con 0x7ffa7415de50 2023-10-09T11:43:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.625+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7404c3c0 con 0x7ffa7415de50 2023-10-09T11:43:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.626+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa6c01da60 con 0x7ffa7415de50 2023-10-09T11:43:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.626+0000 7ffa5bfff700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 0x7ffa600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.626+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ffa6c086880 con 0x7ffa7415de50 2023-10-09T11:43:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.626+0000 7ffa73fff700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 0x7ffa600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.627+0000 7ffa73fff700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 0x7ffa600697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b0a40 tx=0x7ffa64006f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.631+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa6c053220 con 0x7ffa7415de50 2023-10-09T11:43:56.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.822+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000272394.meta", "var": "pg_num"} v 0) v1 -- 0x7ffa740cc240 con 0x7ffa7415de50 2023-10-09T11:43:56.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.823+0000 7ffa5bfff700 1 -- 172.21.15.26:0/1024454153 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000272394.meta", "var": "pg_num"}]=0 v170) v1 ==== 124+0+11 (secure 0 0 0) 0x7ffa6c009420 con 0x7ffa7415de50 2023-10-09T11:43:56.823 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:43:56.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 msgr2=0x7ffa600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 0x7ffa600697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b0a40 tx=0x7ffa64006f90 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 msgr2=0x7ffa741526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ffa7406eb00 tx=0x7ffa6c017000 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 shutdown_connections 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa7415de50 0x7ffa741526a0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740cea00 0x7ffa7414ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ffa60067320 0x7ffa600697d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 --2- 172.21.15.26:0/1024454153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa74153a00 0x7ffa74159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 >> 172.21.15.26:0/1024454153 conn(0x7ffa740703a0 msgr2=0x7ffa7414e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 shutdown_connections 2023-10-09T11:43:56.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.825+0000 7ffa79456700 1 -- 172.21.15.26:0/1024454153 wait complete. 2023-10-09T11:43:56.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:43:56.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 Processor -- start 2023-10-09T11:43:56.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 -- start start 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 0x7ff9840cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9840cf510 con 0x7ff9840cbd90 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840d00b0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.960+0000 7ff989961700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840cc1e0 con 0x7ff984159860 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff9837fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 0x7ff9840cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:44248/0 (socket says 172.21.15.26:44248) 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff9837fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 0x7ff9840cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:35122/0 (socket says 172.21.15.26:35122) 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 -- 172.21.15.26:0/2529256880 learned_addr learned my addr 172.21.15.26:0/2529256880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 -- 172.21.15.26:0/2529256880 >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 msgr2=0x7ff9840cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 --2- 172.21.15.26:0/2529256880 >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 0x7ff9840cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 -- 172.21.15.26:0/2529256880 >> v1:172.21.15.67:6789/0 conn(0x7ff9840cbd90 legacy=0x7ff9840cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 -- 172.21.15.26:0/2529256880 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840cd960 con 0x7ff984159860 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.961+0000 7ff982ffd700 1 --2- 172.21.15.26:0/2529256880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff974009990 tx=0x7ff974009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15dabbdc3f5c7b4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff981ffb700 1 -- 172.21.15.26:0/2529256880 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974009e80 con 0x7ff984159860 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff981ffb700 1 -- 172.21.15.26:0/2529256880 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974005c10 con 0x7ff984159860 2023-10-09T11:43:56.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff981ffb700 1 -- 172.21.15.26:0/2529256880 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400b650 con 0x7ff984159860 2023-10-09T11:43:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 -- 172.21.15.26:0/2529256880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 msgr2=0x7ff9840ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 --2- 172.21.15.26:0/2529256880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff974009990 tx=0x7ff974009220 comp rx=0 tx=0).stop 2023-10-09T11:43:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 -- 172.21.15.26:0/2529256880 shutdown_connections 2023-10-09T11:43:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 --2- 172.21.15.26:0/2529256880 >> v2:172.21.15.67:3300/0 conn(0x7ff9840ccfa0 0x7ff9840cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 --2- 172.21.15.26:0/2529256880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff984159860 0x7ff9840ce220 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 -- 172.21.15.26:0/2529256880 >> 172.21.15.26:0/2529256880 conn(0x7ff9840999b0 msgr2=0x7ff984070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 -- 172.21.15.26:0/2529256880 shutdown_connections 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.962+0000 7ff989961700 1 -- 172.21.15.26:0/2529256880 wait complete. 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.963+0000 7ff989961700 1 Processor -- start 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.963+0000 7ff989961700 1 -- start start 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 0x7ff98406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 0x7ff98409a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98416a530 con 0x7ff9840ccfa0 2023-10-09T11:43:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98409cc00 con 0x7ff984159860 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff989961700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98409c310 con 0x7ff9840cbd90 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff9827fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff9827fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58026/0 (socket says 172.21.15.26:58026) 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff9827fc700 1 -- 172.21.15.26:0/1827705436 learned_addr learned my addr 172.21.15.26:0/1827705436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff9837fe700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 0x7ff98409a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.964+0000 7ff982ffd700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 0x7ff98406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 -- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 msgr2=0x7ff98406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 0x7ff98406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 -- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 msgr2=0x7ff98409a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 0x7ff98409a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 -- 172.21.15.26:0/1827705436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009480 con 0x7ff9840ccfa0 2023-10-09T11:43:56.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff982ffd700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 0x7ff98406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9837fe700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 0x7ff98409a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff9827fc700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c7c0 tx=0x7ff96c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011590 con 0x7ff9840ccfa0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c011710 con 0x7ff9840ccfa0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98416a2b0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011ad0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.965+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98406f5b0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.966+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98409cdb0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.966+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff96c01b3b0 con 0x7ff9840ccfa0 2023-10-09T11:43:56.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.967+0000 7ff97affd700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 0x7ff9640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:56.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.967+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ff96c084360 con 0x7ff9840ccfa0 2023-10-09T11:43:56.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.967+0000 7ff982ffd700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 0x7ff9640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:56.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.967+0000 7ff982ffd700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 0x7ff9640697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff974007fd0 tx=0x7ff974016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:56.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:56.971+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff98409cdb0 con 0x7ff9840ccfa0 2023-10-09T11:43:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.161+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff98409cdb0 con 0x7ff9840ccfa0 2023-10-09T11:43:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.162+0000 7ff97affd700 1 -- 172.21.15.26:0/1827705436 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff98409cdb0 con 0x7ff9840ccfa0 2023-10-09T11:43:57.162 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:43:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 msgr2=0x7ff9640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 0x7ff9640697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff974007fd0 tx=0x7ff974016000 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 msgr2=0x7ff98409d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c7c0 tx=0x7ff96c007f70 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 shutdown_connections 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff984159860 0x7ff98409a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff964067320 0x7ff9640697d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff9840cbd90 0x7ff98406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 --2- 172.21.15.26:0/1827705436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840ccfa0 0x7ff98409d090 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 >> 172.21.15.26:0/1827705436 conn(0x7ff9840999b0 msgr2=0x7ff98415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 shutdown_connections 2023-10-09T11:43:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.164+0000 7ff989961700 1 -- 172.21.15.26:0/1827705436 wait complete. 2023-10-09T11:43:57.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get another-data-pool pg_num 2023-10-09T11:43:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.299+0000 7ff16c0ee700 1 Processor -- start 2023-10-09T11:43:57.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.299+0000 7ff16c0ee700 1 -- start start 2023-10-09T11:43:57.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16c0ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff164159530 0x7ff1640ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16c0ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16c0ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1640ccfd0 con 0x7ff16406dc70 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16c0ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1640cf0e0 con 0x7ff164159530 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16c0ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16415a3d0 con 0x7ff16406e0e0 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff164159530 0x7ff1640ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169689700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff16406dc70 0x7ff164159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57288/0 (socket says 172.21.15.26:57288) 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169689700 1 -- 172.21.15.26:0/1449240443 learned_addr learned my addr 172.21.15.26:0/1449240443 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff16a68b700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 -- 172.21.15.26:0/1449240443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 msgr2=0x7ff1640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 -- 172.21.15.26:0/1449240443 >> v1:172.21.15.26:6789/0 conn(0x7ff16406dc70 legacy=0x7ff164159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 -- 172.21.15.26:0/1449240443 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16415a6b0 con 0x7ff164159530 2023-10-09T11:43:57.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff168e88700 1 -- 172.21.15.26:0/1449240443 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311005266 0 0) 0x7ff1640ccfd0 con 0x7ff16406dc70 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff169e8a700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff164159530 0x7ff1640ceba0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ff154009e60 tx=0x7ff154009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da93b462c4095f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff168e88700 1 -- 172.21.15.26:0/1449240443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400e070 con 0x7ff164159530 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff168e88700 1 -- 172.21.15.26:0/1449240443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400bc30 con 0x7ff164159530 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.300+0000 7ff168e88700 1 -- 172.21.15.26:0/1449240443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154012430 con 0x7ff164159530 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 -- 172.21.15.26:0/1449240443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff164159530 msgr2=0x7ff1640ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff164159530 0x7ff1640ceba0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ff154009e60 tx=0x7ff154009780 comp rx=0 tx=0).stop 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 -- 172.21.15.26:0/1449240443 shutdown_connections 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/1449240443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff164159530 0x7ff1640ceba0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 -- 172.21.15.26:0/1449240443 >> 172.21.15.26:0/1449240443 conn(0x7ff1640703a0 msgr2=0x7ff1640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 -- 172.21.15.26:0/1449240443 shutdown_connections 2023-10-09T11:43:57.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.301+0000 7ff16c0ee700 1 -- 172.21.15.26:0/1449240443 wait complete. 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.302+0000 7ff16c0ee700 1 Processor -- start 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.302+0000 7ff16c0ee700 1 -- start start 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff164159530 0x7ff1640cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640b5980 con 0x7ff16406dc70 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640b4db0 con 0x7ff164159530 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16c0ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640b5050 con 0x7ff16406e0e0 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58044/0 (socket says 172.21.15.26:58044) 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 -- 172.21.15.26:0/2824015023 learned_addr learned my addr 172.21.15.26:0/2824015023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff16a68b700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff164159530 0x7ff1640cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169689700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 -- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 msgr2=0x7ff1640cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 -- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff164159530 msgr2=0x7ff1640cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff164159530 0x7ff1640cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.303+0000 7ff169e8a700 1 -- 172.21.15.26:0/2824015023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154009a20 con 0x7ff16406dc70 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff169e8a700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7ff164089650 tx=0x7ff154019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154012d20 con 0x7ff16406dc70 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154027470 con 0x7ff16406dc70 2023-10-09T11:43:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1640b5330 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154027830 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.304+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1641485b0 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.305+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16404c3c0 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.305+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff154024070 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.306+0000 7ff161ffb700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 0x7ff1500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.306+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ff154087410 con 0x7ff16406dc70 2023-10-09T11:43:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.306+0000 7ff169689700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 0x7ff1500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.306+0000 7ff169689700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 0x7ff1500697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff1640b65f0 tx=0x7ff158007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.310+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff154053e80 con 0x7ff16406dc70 2023-10-09T11:43:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.501+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"} v 0) v1 -- 0x7ff16415a990 con 0x7ff16406dc70 2023-10-09T11:43:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.501+0000 7ff161ffb700 1 -- 172.21.15.26:0/2824015023 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"}]=0 v170) v1 ==== 106+0+11 (secure 0 0 0) 0x7ff1540574a0 con 0x7ff16406dc70 2023-10-09T11:43:57.502 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 msgr2=0x7ff1500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 0x7ff1500697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff1640b65f0 tx=0x7ff158007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 msgr2=0x7ff164148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7ff164089650 tx=0x7ff154019000 comp rx=0 tx=0).stop 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 shutdown_connections 2023-10-09T11:43:57.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff164159530 0x7ff1640cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff16406dc70 0x7ff164148070 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff150067320 0x7ff1500697d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 --2- 172.21.15.26:0/2824015023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff16406e0e0 0x7ff1640cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 >> 172.21.15.26:0/2824015023 conn(0x7ff1640703a0 msgr2=0x7ff1640d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.503+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 shutdown_connections 2023-10-09T11:43:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.504+0000 7ff16c0ee700 1 -- 172.21.15.26:0/2824015023 wait complete. 2023-10-09T11:43:57.516 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:57.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.634+0000 7fb2d359e700 1 Processor -- start 2023-10-09T11:43:57.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.634+0000 7fb2d359e700 1 -- start start 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2d415dfd0 0x7fb2d40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d359e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2d4159920 0x7fb2d40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d359e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40acc00 con 0x7fb2d4159550 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d359e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40abff0 con 0x7fb2d415dfd0 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d359e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40ac2d0 con 0x7fb2d4159920 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2d415dfd0 0x7fb2d40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2d415dfd0 0x7fb2d40aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58048/0 (socket says 172.21.15.26:58048) 2023-10-09T11:43:57.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3864641289 learned_addr learned my addr 172.21.15.26:0/3864641289 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d2d9d700 1 --2- 172.21.15.26:0/3864641289 >> v2:172.21.15.67:3300/0 conn(0x7fb2d4159920 0x7fb2d40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3864641289 >> v2:172.21.15.67:3300/0 conn(0x7fb2d4159920 msgr2=0x7fb2d40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 --2- 172.21.15.26:0/3864641289 >> v2:172.21.15.67:3300/0 conn(0x7fb2d4159920 0x7fb2d40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.635+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3864641289 >> v1:172.21.15.67:6789/0 conn(0x7fb2d4159550 legacy=0x7fb2d40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3864641289 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40ac5b0 con 0x7fb2d415dfd0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d1d9b700 1 --2- 172.21.15.26:0/3864641289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d415dfd0 0x7fb2d40aedb0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fb2d406b0f0 tx=0x7fb2c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddd966fa60a43ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d159a700 1 -- 172.21.15.26:0/3864641289 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800b820 con 0x7fb2d415dfd0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d159a700 1 -- 172.21.15.26:0/3864641289 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800b980 con 0x7fb2d415dfd0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d159a700 1 -- 172.21.15.26:0/3864641289 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800bd20 con 0x7fb2d415dfd0 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 -- 172.21.15.26:0/3864641289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d415dfd0 msgr2=0x7fb2d40aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3864641289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d415dfd0 0x7fb2d40aedb0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fb2d406b0f0 tx=0x7fb2c8009250 comp rx=0 tx=0).stop 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 -- 172.21.15.26:0/3864641289 shutdown_connections 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3864641289 >> v2:172.21.15.67:3300/0 conn(0x7fb2d4159920 0x7fb2d40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3864641289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d415dfd0 0x7fb2d40aedb0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 -- 172.21.15.26:0/3864641289 >> 172.21.15.26:0/3864641289 conn(0x7fb2d406ce80 msgr2=0x7fb2d40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.636+0000 7fb2d359e700 1 -- 172.21.15.26:0/3864641289 shutdown_connections 2023-10-09T11:43:57.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.637+0000 7fb2d359e700 1 -- 172.21.15.26:0/3864641289 wait complete. 2023-10-09T11:43:57.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 Processor -- start 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 -- start start 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2d4159550 0x7fb2d40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 0x7fb2d416a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40ca6a0 con 0x7fb2d4159920 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d414f470 con 0x7fb2d415dfd0 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d359e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d414ee60 con 0x7fb2d4159550 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58064/0 (socket says 172.21.15.26:58064) 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.638+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3885746222 learned_addr learned my addr 172.21.15.26:0/3885746222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d2d9d700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 0x7fb2d416a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d259c700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2d4159550 0x7fb2d40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2d4159550 msgr2=0x7fb2d40c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2d4159550 0x7fb2d40c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 msgr2=0x7fb2d416a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 0x7fb2d416a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 -- 172.21.15.26:0/3885746222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c80094f0 con 0x7fb2d4159920 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d2d9d700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 0x7fb2d416a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d1d9b700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80030c0 tx=0x7fb2c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8011e60 con 0x7fb2d4159920 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8020070 con 0x7fb2d4159920 2023-10-09T11:43:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d414d4d0 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c801b6a0 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.639+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40ca0e0 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.641+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d404c3c0 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.641+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb2c8022030 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.641+0000 7fb2c27fc700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 0x7fb2b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.641+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb2c8086ce0 con 0x7fb2d4159920 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.641+0000 7fb2d259c700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 0x7fb2b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.642+0000 7fb2d259c700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 0x7fb2b40697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:57.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.645+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2c80538a0 con 0x7fb2d4159920 2023-10-09T11:43:57.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.882+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d404c3c0 con 0x7fb2d4159920 2023-10-09T11:43:57.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.883+0000 7fb2c27fc700 1 -- 172.21.15.26:0/3885746222 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fb2c8056ec0 con 0x7fb2d4159920 2023-10-09T11:43:57.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:57.884 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:53.225580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000272394","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:57.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 msgr2=0x7fb2b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 0x7fb2b40697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4009040 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 msgr2=0x7fb2d414cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80030c0 tx=0x7fb2c8016000 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 shutdown_connections 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d415dfd0 0x7fb2d416a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb2b4067320 0x7fb2b40697d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb2d4159550 0x7fb2d40c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 --2- 172.21.15.26:0/3885746222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2d4159920 0x7fb2d414cf90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 >> 172.21.15.26:0/3885746222 conn(0x7fb2d406ce80 msgr2=0x7fb2d415eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 shutdown_connections 2023-10-09T11:43:57.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:57.885+0000 7fb2d359e700 1 -- 172.21.15.26:0/3885746222 wait complete. 2023-10-09T11:43:57.887 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 112 2023-10-09T11:43:57.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.017+0000 7f8025925700 1 Processor -- start 2023-10-09T11:43:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.017+0000 7f8025925700 1 -- start start 2023-10-09T11:43:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.017+0000 7f8025925700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f8025925700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 0x7f80200c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f8025925700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200c4c70 0x7f80200b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f8025925700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200c3690 con 0x7f80200c4c70 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f8025925700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200c3970 con 0x7f80200cc690 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f8025925700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c3c50 con 0x7f80200cce90 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200c4c70 0x7f80200b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80200c4c70 0x7f80200b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58068/0 (socket says 172.21.15.26:58068) 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 -- 172.21.15.26:0/2601318450 learned_addr learned my addr 172.21.15.26:0/2601318450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801e7fc700 1 --2- 172.21.15.26:0/2601318450 >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 0x7f80200c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801effd700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 -- 172.21.15.26:0/2601318450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 msgr2=0x7f80200cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 -- 172.21.15.26:0/2601318450 >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 msgr2=0x7f80200c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2601318450 >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 0x7f80200c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 -- 172.21.15.26:0/2601318450 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200c3f30 con 0x7f80200c4c70 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801e7fc700 1 --2- 172.21.15.26:0/2601318450 >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 0x7f80200c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200c4c70 0x7f80200b12d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f802006b550 tx=0x7f8018009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84737d8662a02e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801dffb700 1 -- 172.21.15.26:0/2601318450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800e070 con 0x7f80200c4c70 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801dffb700 1 -- 172.21.15.26:0/2601318450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800ba50 con 0x7f80200c4c70 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.018+0000 7f801dffb700 1 -- 172.21.15.26:0/2601318450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180092e0 con 0x7f80200c4c70 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 -- 172.21.15.26:0/2601318450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200c4c70 msgr2=0x7f80200b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200c4c70 0x7f80200b12d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f802006b550 tx=0x7f8018009840 comp rx=0 tx=0).stop 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 -- 172.21.15.26:0/2601318450 shutdown_connections 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200c4c70 0x7f80200b12d0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 --2- 172.21.15.26:0/2601318450 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 --2- 172.21.15.26:0/2601318450 >> v2:172.21.15.67:3300/0 conn(0x7f80200cc690 0x7f80200c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 -- 172.21.15.26:0/2601318450 >> 172.21.15.26:0/2601318450 conn(0x7f802006ce80 msgr2=0x7f80200ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 -- 172.21.15.26:0/2601318450 shutdown_connections 2023-10-09T11:43:58.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.019+0000 7f8025925700 1 -- 172.21.15.26:0/2601318450 wait complete. 2023-10-09T11:43:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.020+0000 7f8025925700 1 Processor -- start 2023-10-09T11:43:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.020+0000 7f8025925700 1 -- start start 2023-10-09T11:43:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200c4c70 0x7f80200b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802009bba0 con 0x7f80200cc690 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802009af90 con 0x7f80200c4c70 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f8025925700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802009b270 con 0x7f80200cce90 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f801e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f801e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58070/0 (socket says 172.21.15.26:58070) 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f801e7fc700 1 -- 172.21.15.26:0/2073738900 learned_addr learned my addr 172.21.15.26:0/2073738900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.021+0000 7f801effd700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200c4c70 0x7f80200b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 -- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 msgr2=0x7f80200c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 -- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200c4c70 msgr2=0x7f80200b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200c4c70 0x7f80200b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 -- 172.21.15.26:0/2073738900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009ae0 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f801e7fc700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f801400e8d0 tx=0x7f8014008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014013410 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014013570 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802009b550 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014013910 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.022+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802015c4d0 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.023+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802009bd10 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.023+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8014013d40 con 0x7f80200cc690 2023-10-09T11:43:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.024+0000 7f8006ffd700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 0x7f800c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.024+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f8014084c40 con 0x7f80200cc690 2023-10-09T11:43:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.024+0000 7f801effd700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 0x7f800c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.024+0000 7f801effd700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 0x7f800c0697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f80100061f0 tx=0x7f8010008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.028+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80140515e0 con 0x7f80200cc690 2023-10-09T11:43:58.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.222+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f802004c3c0 con 0x7f80200cc690 2023-10-09T11:43:58.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.223+0000 7f8006ffd700 1 -- 172.21.15.26:0/2073738900 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f8014054c00 con 0x7f80200cc690 2023-10-09T11:43:58.223 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:58.223 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":170,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:54.227452+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000272394.meta","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000272394"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:58.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.224+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 msgr2=0x7f800c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.224+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 0x7f800c0697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f80100061f0 tx=0x7f8010008040 comp rx=0 tx=0).stop 2023-10-09T11:43:58.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.224+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 msgr2=0x7f80200c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.224+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f801400e8d0 tx=0x7f8014008040 comp rx=0 tx=0).stop 2023-10-09T11:43:58.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 shutdown_connections 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f800c067320 0x7f800c0697d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80200cce90 0x7f80200c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80200c4c70 0x7f80200b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 --2- 172.21.15.26:0/2073738900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80200cc690 0x7f80200c7710 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 >> 172.21.15.26:0/2073738900 conn(0x7f802006ce80 msgr2=0x7f80200b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 shutdown_connections 2023-10-09T11:43:58.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.225+0000 7f8025925700 1 -- 172.21.15.26:0/2073738900 wait complete. 2023-10-09T11:43:58.238 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000272394 and related pools 2023-10-09T11:43:58.238 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:58.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 Processor -- start 2023-10-09T11:43:58.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 -- start start 2023-10-09T11:43:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 0x7fd6b40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6b415a5d0 0x7fd6b4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b415ae40 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b40d13f0 con 0x7fd6b415a5d0 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.358+0000 7fd6b9df6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b415ab60 con 0x7fd6b40cb5a0 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6b415a5d0 0x7fd6b4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6b415a5d0 0x7fd6b4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58080/0 (socket says 172.21.15.26:58080) 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 -- 172.21.15.26:0/2014998699 learned_addr learned my addr 172.21.15.26:0/2014998699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6aaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6b40cd9e0 0x7fd6b4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57300/0 (socket says 172.21.15.26:57300) 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b37fe700 1 --2- 172.21.15.26:0/2014998699 >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 0x7fd6b40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 -- 172.21.15.26:0/2014998699 >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 msgr2=0x7fd6b40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 --2- 172.21.15.26:0/2014998699 >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 0x7fd6b40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 -- 172.21.15.26:0/2014998699 >> v1:172.21.15.26:6789/0 conn(0x7fd6b40cd9e0 legacy=0x7fd6b4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 -- 172.21.15.26:0/2014998699 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40ccf00 con 0x7fd6b415a5d0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b2ffd700 1 -- 172.21.15.26:0/2014998699 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919053602 0 0) 0x7fd6b415ae40 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b37fe700 1 --2- 172.21.15.26:0/2014998699 >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 0x7fd6b40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b3fff700 1 --2- 172.21.15.26:0/2014998699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4156e90 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009f20 tx=0x7fd6ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5797d16f020fb788 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b2ffd700 1 -- 172.21.15.26:0/2014998699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00e070 con 0x7fd6b415a5d0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b2ffd700 1 -- 172.21.15.26:0/2014998699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00ba40 con 0x7fd6b415a5d0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.359+0000 7fd6b2ffd700 1 -- 172.21.15.26:0/2014998699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0092e0 con 0x7fd6b415a5d0 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 -- 172.21.15.26:0/2014998699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b415a5d0 msgr2=0x7fd6b4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/2014998699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4156e90 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009f20 tx=0x7fd6ac009840 comp rx=0 tx=0).stop 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 -- 172.21.15.26:0/2014998699 shutdown_connections 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/2014998699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4156e90 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/2014998699 >> v2:172.21.15.67:3300/0 conn(0x7fd6b40cb5a0 0x7fd6b40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 -- 172.21.15.26:0/2014998699 >> 172.21.15.26:0/2014998699 conn(0x7fd6b4070e30 msgr2=0x7fd6b40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 -- 172.21.15.26:0/2014998699 shutdown_connections 2023-10-09T11:43:58.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.360+0000 7fd6b9df6700 1 -- 172.21.15.26:0/2014998699 wait complete. 2023-10-09T11:43:58.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.361+0000 7fd6b9df6700 1 Processor -- start 2023-10-09T11:43:58.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.361+0000 7fd6b9df6700 1 -- start start 2023-10-09T11:43:58.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6b40cb5a0 0x7fd6b4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40c77c0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40c8620 con 0x7fd6b415a5d0 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6b9df6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40c7a10 con 0x7fd6b40cb5a0 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58092/0 (socket says 172.21.15.26:58092) 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 -- 172.21.15.26:0/1913902982 learned_addr learned my addr 172.21.15.26:0/1913902982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 -- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6b40cb5a0 msgr2=0x7fd6b4152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6b40cb5a0 0x7fd6b4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 -- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b415a5d0 msgr2=0x7fd6b4161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 -- 172.21.15.26:0/1913902982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac009ae0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6aaffd700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0011e0 tx=0x7fd69c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.362+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c007300 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.363+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c007460 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.363+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b40c7cf0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.363+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c004830 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.363+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40c82b0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.364+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b40afee0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.364+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd69c004be0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.364+0000 7fd6abfff700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 0x7fd6940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.364+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fd69c084360 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.365+0000 7fd6b37fe700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 0x7fd6940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.365+0000 7fd6b37fe700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 0x7fd6940697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007aa0 tx=0x7fd6a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.369+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd69c050e90 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.606+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6b404c3c0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.607+0000 7fd6abfff700 1 -- 172.21.15.26:0/1913902982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fd69c0544b0 con 0x7fd6b40cd9e0 2023-10-09T11:43:58.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:58.607 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:53.225580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000272394","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:58.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 msgr2=0x7fd6940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 0x7fd6940697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007aa0 tx=0x7fd6a4008040 comp rx=0 tx=0).stop 2023-10-09T11:43:58.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 msgr2=0x7fd6b4160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0011e0 tx=0x7fd69c007e10 comp rx=0 tx=0).stop 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 shutdown_connections 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b415a5d0 0x7fd6b4161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd694067320 0x7fd6940697d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6b40cb5a0 0x7fd6b4152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 --2- 172.21.15.26:0/1913902982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b40cd9e0 0x7fd6b4160ce0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 >> 172.21.15.26:0/1913902982 conn(0x7fd6b4070e30 msgr2=0x7fd6b40cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 shutdown_connections 2023-10-09T11:43:58.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.609+0000 7fd6b9df6700 1 -- 172.21.15.26:0/1913902982 wait complete. 2023-10-09T11:43:58.611 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 112 2023-10-09T11:43:58.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.740+0000 7f3c39b3d700 1 Processor -- start 2023-10-09T11:43:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.740+0000 7f3c39b3d700 1 -- start start 2023-10-09T11:43:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c39b3d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c39b3d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c340cde50 0x7f3c34156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c39b3d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3415ae40 con 0x7f3c340cd9e0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c39b3d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c340d13f0 con 0x7f3c340cde50 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c39b3d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3415ab60 con 0x7f3c340cb5a0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c32ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c340cd9e0 0x7f3c34159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57314/0 (socket says 172.21.15.26:57314) 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.741+0000 7f3c32ffd700 1 -- 172.21.15.26:0/2074693007 learned_addr learned my addr 172.21.15.26:0/2074693007 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 --2- 172.21.15.26:0/2074693007 >> v2:172.21.15.67:3300/0 conn(0x7f3c340cde50 0x7f3c34156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c337fe700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990279057 0 0) 0x7f3c3415ae40 con 0x7f3c340cd9e0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c003570 con 0x7f3c340cd9e0 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 -- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 msgr2=0x7f3c340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 -- 172.21.15.26:0/2074693007 >> v1:172.21.15.26:6789/0 conn(0x7f3c340cd9e0 legacy=0x7f3c34159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294273456 0 0) 0x7f3c1c003570 con 0x7f3c340cd9e0 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 -- 172.21.15.26:0/2074693007 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340ccf00 con 0x7f3c340cde50 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c337fe700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c33fff700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cde50 0x7f3c34156e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009e60 tx=0x7f3c2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4aa038f191e963 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00e070 con 0x7f3c340cde50 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00b7a0 con 0x7f3c340cde50 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.742+0000 7f3c327fc700 1 -- 172.21.15.26:0/2074693007 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28001470 con 0x7f3c340cde50 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 -- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cde50 msgr2=0x7f3c34156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cde50 0x7f3c34156e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009e60 tx=0x7f3c2c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 -- 172.21.15.26:0/2074693007 shutdown_connections 2023-10-09T11:43:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cde50 0x7f3c34156e90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/2074693007 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 -- 172.21.15.26:0/2074693007 >> 172.21.15.26:0/2074693007 conn(0x7f3c34070e30 msgr2=0x7f3c340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 -- 172.21.15.26:0/2074693007 shutdown_connections 2023-10-09T11:43:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.743+0000 7f3c39b3d700 1 -- 172.21.15.26:0/2074693007 wait complete. 2023-10-09T11:43:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.744+0000 7f3c39b3d700 1 Processor -- start 2023-10-09T11:43:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.744+0000 7f3c39b3d700 1 -- start start 2023-10-09T11:43:58.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 0x7f3c340b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34157800 con 0x7f3c34159850 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34147df0 con 0x7f3c340cd9e0 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c39b3d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c341564b0 con 0x7f3c340cb5a0 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58106/0 (socket says 172.21.15.26:58106) 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 -- 172.21.15.26:0/1333872619 learned_addr learned my addr 172.21.15.26:0/1333872619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c32ffd700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 0x7f3c340b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c337fe700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 -- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 msgr2=0x7f3c340b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 -- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 msgr2=0x7f3c340b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 0x7f3c340b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c33fff700 1 -- 172.21.15.26:0/1333872619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009420 con 0x7f3c34159850 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.745+0000 7f3c32ffd700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 0x7f3c340b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c33fff700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b610 tx=0x7f3c2c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c012d50 con 0x7f3c34159850 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c01e430 con 0x7f3c34159850 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c009a20 con 0x7f3c34159850 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c01e7f0 con 0x7f3c34159850 2023-10-09T11:43:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.746+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c34156ed0 con 0x7f3c34159850 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.747+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3404c3c0 con 0x7f3c34159850 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.747+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c2c01ebe0 con 0x7f3c34159850 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.748+0000 7f3c1b7fe700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 0x7f3c20069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.748+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f3c2c087440 con 0x7f3c34159850 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.748+0000 7f3c337fe700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 0x7f3c20069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:58.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.748+0000 7f3c337fe700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 0x7f3c20069800 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3c240093f0 tx=0x7f3c24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:58.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.752+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c2c053de0 con 0x7f3c34159850 2023-10-09T11:43:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.986+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c340cd1e0 con 0x7f3c34159850 2023-10-09T11:43:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.986+0000 7f3c1b7fe700 1 -- 172.21.15.26:0/1333872619 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4627 (secure 0 0 0) 0x7f3c2c057400 con 0x7f3c34159850 2023-10-09T11:43:58.987 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:43:38.096004+0000","modified":"2023-10-09T11:43:53.225580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8307":{"gid":8307,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4207168086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4207168086},{"type":"v1","addr":"172.21.15.26:6835","nonce":4207168086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000272394","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 msgr2=0x7f3c20069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 0x7f3c20069800 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3c240093f0 tx=0x7f3c24008040 comp rx=0 tx=0).stop 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 msgr2=0x7f3c340b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b610 tx=0x7f3c2c018000 comp rx=0 tx=0).stop 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 shutdown_connections 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c34159850 0x7f3c340b5450 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c20067350 0x7f3c20069800 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c340cb5a0 0x7f3c340b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 --2- 172.21.15.26:0/1333872619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c340cd9e0 0x7f3c340b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:58.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 >> 172.21.15.26:0/1333872619 conn(0x7f3c34070e30 msgr2=0x7f3c340c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:58.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 shutdown_connections 2023-10-09T11:43:58.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:58.988+0000 7f3c39b3d700 1 -- 172.21.15.26:0/1333872619 wait complete. 2023-10-09T11:43:58.990 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 112 2023-10-09T11:43:59.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:59.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.119+0000 7f9135862700 1 Processor -- start 2023-10-09T11:43:59.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.119+0000 7f9135862700 1 -- start start 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f9135862700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91300b07d0 0x7f91300ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f9135862700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f91300c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f9135862700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913015a280 con 0x7f91300cf200 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f9135862700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913006e180 con 0x7f91300b07d0 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f9135862700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913006d850 con 0x7f91300b0ba0 2023-10-09T11:43:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f912effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91300b07d0 0x7f91300ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f912e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f91300cf200 0x7f913006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57320/0 (socket says 172.21.15.26:57320) 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f912e7fc700 1 -- 172.21.15.26:0/201658307 learned_addr learned my addr 172.21.15.26:0/201658307 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.120+0000 7f912f7fe700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f91300c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912effd700 1 -- 172.21.15.26:0/201658307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 msgr2=0x7f91300c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912effd700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f91300c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912effd700 1 -- 172.21.15.26:0/201658307 >> v1:172.21.15.26:6789/0 conn(0x7f91300cf200 legacy=0x7f913006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912dffb700 1 -- 172.21.15.26:0/201658307 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650690556 0 0) 0x7f913015a280 con 0x7f91300cf200 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912effd700 1 -- 172.21.15.26:0/201658307 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913006db30 con 0x7f91300b07d0 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912f7fe700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f91300c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912effd700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300b07d0 0x7f91300ccac0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f9120009eb0 tx=0x7f9120009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bd7e254e53fa2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912dffb700 1 -- 172.21.15.26:0/201658307 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000e070 con 0x7f91300b07d0 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912dffb700 1 -- 172.21.15.26:0/201658307 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000bc30 con 0x7f91300b07d0 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f912dffb700 1 -- 172.21.15.26:0/201658307 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120012430 con 0x7f91300b07d0 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 -- 172.21.15.26:0/201658307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300b07d0 msgr2=0x7f91300ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300b07d0 0x7f91300ccac0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f9120009eb0 tx=0x7f9120009780 comp rx=0 tx=0).stop 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 -- 172.21.15.26:0/201658307 shutdown_connections 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f91300c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 --2- 172.21.15.26:0/201658307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300b07d0 0x7f91300ccac0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 -- 172.21.15.26:0/201658307 >> 172.21.15.26:0/201658307 conn(0x7f913006ce80 msgr2=0x7f91300ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.121+0000 7f9135862700 1 -- 172.21.15.26:0/201658307 shutdown_connections 2023-10-09T11:43:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.122+0000 7f9135862700 1 -- 172.21.15.26:0/201658307 wait complete. 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.123+0000 7f9135862700 1 Processor -- start 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.123+0000 7f9135862700 1 -- start start 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.123+0000 7f9135862700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91300b07d0 0x7f91300c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.123+0000 7f9135862700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f9130150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300c5b00 con 0x7f91300cf200 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300c5da0 con 0x7f91300b07d0 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300c6080 con 0x7f91300b0ba0 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58118/0 (socket says 172.21.15.26:58118) 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 -- 172.21.15.26:0/3173952277 learned_addr learned my addr 172.21.15.26:0/3173952277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912e7fc700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f9130150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912effd700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91300b07d0 0x7f91300c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 -- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 msgr2=0x7f9130150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f9130150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 -- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91300b07d0 msgr2=0x7f91300c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91300b07d0 0x7f91300c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 -- 172.21.15.26:0/3173952277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120009a20 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f912f7fe700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f912800c880 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128011600 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9128011760 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91300c6360 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128011b20 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.124+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9130152a00 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.125+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913004c3c0 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.126+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f91280193b0 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.126+0000 7f9126ffd700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 0x7f9110069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.126+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f9128085020 con 0x7f91300cf200 2023-10-09T11:43:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.126+0000 7f912effd700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 0x7f9110069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.127+0000 7f912effd700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 0x7f9110069850 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9120009eb0 tx=0x7f9120017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.130+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9128055410 con 0x7f91300cf200 2023-10-09T11:43:59.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.325+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913006de10 con 0x7f91300cf200 2023-10-09T11:43:59.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.325+0000 7f9126ffd700 1 -- 172.21.15.26:0/3173952277 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f9128015090 con 0x7f91300cf200 2023-10-09T11:43:59.326 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:43:59.326 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":170,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:43:54.227452+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000272394.meta","create_time":"2023-10-09T11:43:36.497513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000272394"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T11:43:37.058665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T11:43:49.060468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000272394"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 msgr2=0x7f9110069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 0x7f9110069850 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9120009eb0 tx=0x7f9120017000 comp rx=0 tx=0).stop 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 msgr2=0x7f9130068d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f912800c880 tx=0x7f9128008040 comp rx=0 tx=0).stop 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 shutdown_connections 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91300cf200 0x7f9130068d70 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91300b07d0 0x7f91300c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f91100673a0 0x7f9110069850 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 --2- 172.21.15.26:0/3173952277 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91300b0ba0 0x7f9130150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 >> 172.21.15.26:0/3173952277 conn(0x7f913006ce80 msgr2=0x7f91300c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 shutdown_connections 2023-10-09T11:43:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.327+0000 7f9135862700 1 -- 172.21.15.26:0/3173952277 wait complete. 2023-10-09T11:43:59.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000272394 2023-10-09T11:43:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.460+0000 7f96135a3700 1 Processor -- start 2023-10-09T11:43:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.460+0000 7f96135a3700 1 -- start start 2023-10-09T11:43:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f96135a3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 0x7f960c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f96135a3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c15a280 con 0x7f960c0cf200 2023-10-09T11:43:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f96135a3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c06e180 con 0x7f960c0b0ba0 2023-10-09T11:43:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f96135a3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c06d850 con 0x7f960c0b07d0 2023-10-09T11:43:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9610b3e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f960c0cf200 0x7f960c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57322/0 (socket says 172.21.15.26:57322) 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9610b3e700 1 -- 172.21.15.26:0/1394629262 learned_addr learned my addr 172.21.15.26:0/1394629262 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f961133f700 1 --2- 172.21.15.26:0/1394629262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 0x7f960c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210272325 0 0) 0x7f960c15a280 con 0x7f960c0cf200 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f8003570 con 0x7f960c0cf200 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148778431 0 0) 0x7f960c06e180 con 0x7f960c0b0ba0 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c15a280 con 0x7f960c0b0ba0 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.461+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463040766 0 0) 0x7f95f8003570 con 0x7f960c0cf200 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f961133f700 1 -- 172.21.15.26:0/1394629262 >> v1:172.21.15.67:6789/0 conn(0x7f960c0b0ba0 legacy=0x7f960c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f961133f700 1 -- 172.21.15.26:0/1394629262 >> v1:172.21.15.26:6789/0 conn(0x7f960c0cf200 legacy=0x7f960c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f961133f700 1 -- 172.21.15.26:0/1394629262 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c06db30 con 0x7f960c0b07d0 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f961133f700 1 --2- 172.21.15.26:0/1394629262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 0x7f960c0ccac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9608009900 tx=0x7f9608009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b46245286f5927 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc001470 con 0x7f960c0b07d0 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608011420 con 0x7f960c0b07d0 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f9603fff700 1 -- 172.21.15.26:0/1394629262 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080117a0 con 0x7f960c0b07d0 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f96135a3700 1 -- 172.21.15.26:0/1394629262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 msgr2=0x7f960c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.462+0000 7f96135a3700 1 --2- 172.21.15.26:0/1394629262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 0x7f960c0ccac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9608009900 tx=0x7f9608009120 comp rx=0 tx=0).stop 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.463+0000 7f96135a3700 1 -- 172.21.15.26:0/1394629262 shutdown_connections 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.463+0000 7f96135a3700 1 --2- 172.21.15.26:0/1394629262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0b07d0 0x7f960c0ccac0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.463+0000 7f96135a3700 1 -- 172.21.15.26:0/1394629262 >> 172.21.15.26:0/1394629262 conn(0x7f960c06ce80 msgr2=0x7f960c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.463+0000 7f96135a3700 1 -- 172.21.15.26:0/1394629262 shutdown_connections 2023-10-09T11:43:59.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.463+0000 7f96135a3700 1 -- 172.21.15.26:0/1394629262 wait complete. 2023-10-09T11:43:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.464+0000 7f96135a3700 1 Processor -- start 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.464+0000 7f96135a3700 1 -- start start 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f960c0b0ba0 0x7f960c09b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0cf200 0x7f960c09ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0995b0 con 0x7f960c0b07d0 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c15ee70 con 0x7f960c0b0ba0 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c15f150 con 0x7f960c0cf200 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58134/0 (socket says 172.21.15.26:58134) 2023-10-09T11:43:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 -- 172.21.15.26:0/2888195358 learned_addr learned my addr 172.21.15.26:0/2888195358 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f9610b3e700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f960c0b0ba0 0x7f960c09b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f9611b40700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0cf200 0x7f960c09ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 -- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0cf200 msgr2=0x7f960c09ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0cf200 0x7f960c09ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 -- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f960c0b0ba0 msgr2=0x7f960c09b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f960c0b0ba0 0x7f960c09b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 -- 172.21.15.26:0/2888195358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080093c0 con 0x7f960c0b07d0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f961133f700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9608009160 tx=0x7f9608016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801cc40 con 0x7f960c0b07d0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960801cdc0 con 0x7f960c0b07d0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c15f430 con 0x7f960c0b07d0 2023-10-09T11:43:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801a6a0 con 0x7f960c0b07d0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.465+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c169ab0 con 0x7f960c0b07d0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.466+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c04c3c0 con 0x7f960c0b07d0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.467+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f960801aa50 con 0x7f960c0b07d0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.467+0000 7f96017fa700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 0x7f95f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.467+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f96080867a0 con 0x7f960c0b07d0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.467+0000 7f9610b3e700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 0x7f95f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.468+0000 7f9610b3e700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 0x7f95f00697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f960c0b03e0 tx=0x7f95fc001620 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.472+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9608053290 con 0x7f960c0b07d0 2023-10-09T11:43:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.708+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000272394"} v 0) v1 -- 0x7f960c06de10 con 0x7f960c0b07d0 2023-10-09T11:43:59.709 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:43:59.709+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:43:59.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.712+0000 7f96017fa700 1 -- 172.21.15.26:0/2888195358 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000272394"}]=0 volume_0000000000272394 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) v1 ==== 195+0+0 (secure 0 0 0) 0x7f9608056870 con 0x7f960c0b07d0 2023-10-09T11:43:59.713 INFO:tasks.ceph.mds.a.smithi026.stderr: -850> 2023-10-09T11:43:44.008+0000 7f5dee850700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:59.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.714+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 msgr2=0x7f95f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.714+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 0x7f95f00697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f960c0b03e0 tx=0x7f95fc001620 comp rx=0 tx=0).stop 2023-10-09T11:43:59.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.714+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 msgr2=0x7f960c157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.714+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9608009160 tx=0x7f9608016000 comp rx=0 tx=0).stop 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 shutdown_connections 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f95f0067320 0x7f95f00697d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f960c0cf200 0x7f960c09ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960c0b07d0 0x7f960c157030 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 --2- 172.21.15.26:0/2888195358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f960c0b0ba0 0x7f960c09b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 >> 172.21.15.26:0/2888195358 conn(0x7f960c06ce80 msgr2=0x7f960c0b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 shutdown_connections 2023-10-09T11:43:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.715+0000 7f96135a3700 1 -- 172.21.15.26:0/2888195358 wait complete. 2023-10-09T11:43:59.717 INFO:teuthology.orchestra.run.smithi026.stderr:volume_0000000000272394 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:43:59.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000272394 --yes-i-really-mean-it 2023-10-09T11:43:59.735 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:43:59.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.849+0000 7fe942103700 1 Processor -- start 2023-10-09T11:43:59.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.849+0000 7fe942103700 1 -- start start 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe942103700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe93c06dc70 0x7fe93c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe942103700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c0ccfd0 con 0x7fe93c159530 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe942103700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c15a3d0 con 0x7fe93c06e0e0 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe942103700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c15a6b0 con 0x7fe93c06dc70 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe93c06dc70 0x7fe93c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe93c159530 0x7fe93c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56630/0 (socket says 172.21.15.26:56630) 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93b7fe700 1 -- 172.21.15.26:0/1501752061 learned_addr learned my addr 172.21.15.26:0/1501752061 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:43:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93affd700 1 -- 172.21.15.26:0/1501752061 >> v1:172.21.15.67:6789/0 conn(0x7fe93c06e0e0 legacy=0x7fe93c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93affd700 1 -- 172.21.15.26:0/1501752061 >> v1:172.21.15.26:6789/0 conn(0x7fe93c159530 legacy=0x7fe93c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93affd700 1 -- 172.21.15.26:0/1501752061 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c15a990 con 0x7fe93c06dc70 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.850+0000 7fe93affd700 1 --2- 172.21.15.26:0/1501752061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c06dc70 0x7fe93c159900 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe9300098e0 tx=0x7fe9300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a8579b2f7f586d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe93a7fc700 1 -- 172.21.15.26:0/1501752061 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930009e80 con 0x7fe93c06dc70 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe93a7fc700 1 -- 172.21.15.26:0/1501752061 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000b820 con 0x7fe93c06dc70 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe93a7fc700 1 -- 172.21.15.26:0/1501752061 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000bba0 con 0x7fe93c06dc70 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 -- 172.21.15.26:0/1501752061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c06dc70 msgr2=0x7fe93c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 --2- 172.21.15.26:0/1501752061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c06dc70 0x7fe93c159900 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe9300098e0 tx=0x7fe9300091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 -- 172.21.15.26:0/1501752061 shutdown_connections 2023-10-09T11:43:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 --2- 172.21.15.26:0/1501752061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c06dc70 0x7fe93c159900 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 -- 172.21.15.26:0/1501752061 >> 172.21.15.26:0/1501752061 conn(0x7fe93c0703a0 msgr2=0x7fe93c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:59.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 -- 172.21.15.26:0/1501752061 shutdown_connections 2023-10-09T11:43:59.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.851+0000 7fe942103700 1 -- 172.21.15.26:0/1501752061 wait complete. 2023-10-09T11:43:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.852+0000 7fe942103700 1 Processor -- start 2023-10-09T11:43:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 -- start start 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe93c06dc70 0x7fe93c0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe93c06e0e0 0x7fe93c16def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0b65e0 con 0x7fe93c159530 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c13fc90 con 0x7fe93c06e0e0 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe942103700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0c8fa0 con 0x7fe93c06dc70 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe93bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe93bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52246/0 (socket says 172.21.15.26:52246) 2023-10-09T11:43:59.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe93bfff700 1 -- 172.21.15.26:0/3526477880 learned_addr learned my addr 172.21.15.26:0/3526477880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe93affd700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe93c06e0e0 0x7fe93c16def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.853+0000 7fe93b7fe700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe93c06dc70 0x7fe93c0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 -- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe93c06dc70 msgr2=0x7fe93c0b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe93c06dc70 0x7fe93c0b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 -- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe93c06e0e0 msgr2=0x7fe93c16def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe93c06e0e0 0x7fe93c16def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 -- 172.21.15.26:0/3526477880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930009420 con 0x7fe93c159530 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe93bfff700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c930 tx=0x7fe9340026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012630 con 0x7fe93c159530 2023-10-09T11:43:59.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9340127d0 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012b90 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0c9200 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.854+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c0b39b0 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.855+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c04c3c0 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.855+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe93401b400 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.856+0000 7fe9237fe700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 0x7fe9280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.856+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fe9340850e0 con 0x7fe93c159530 2023-10-09T11:43:59.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.856+0000 7fe93b7fe700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 0x7fe9280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:59.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.857+0000 7fe93b7fe700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 0x7fe9280697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe92c001950 tx=0x7fe92c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:59.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:43:59.860+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9340555d0 con 0x7fe93c159530 2023-10-09T11:44:00.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.098+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000272394", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe93c15ac70 con 0x7fe93c159530 2023-10-09T11:44:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.714+0000 7fe9237fe700 1 -- 172.21.15.26:0/3526477880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000272394", "yes_i_really_mean_it": true}]=0 v114) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe934055160 con 0x7fe93c159530 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 msgr2=0x7fe9280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 0x7fe9280697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe92c001950 tx=0x7fe92c009040 comp rx=0 tx=0).stop 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 msgr2=0x7fe93c13f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c930 tx=0x7fe9340026e0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 shutdown_connections 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe93c159530 0x7fe93c13f750 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe928067320 0x7fe9280697d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe93c06dc70 0x7fe93c0b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 --2- 172.21.15.26:0/3526477880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe93c06e0e0 0x7fe93c16def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 >> 172.21.15.26:0/3526477880 conn(0x7fe93c0703a0 msgr2=0x7fe93c153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 shutdown_connections 2023-10-09T11:44:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.717+0000 7fe942103700 1 -- 172.21.15.26:0/3526477880 wait complete. 2023-10-09T11:44:00.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000272394.meta cephfs.volume_0000000000272394.meta --yes-i-really-really-mean-it 2023-10-09T11:44:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.904+0000 7f4a64e1b700 1 Processor -- start 2023-10-09T11:44:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.904+0000 7f4a64e1b700 1 -- start start 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a64e1b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a60156480 0x7f4a60157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a64e1b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a600c7b30 0x7f4a6006b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a64e1b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6006b2f0 con 0x7f4a6006bcc0 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a64e1b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6006ace0 con 0x7f4a60156480 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a64e1b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a600c8310 con 0x7f4a600c7b30 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a60156480 0x7f4a60157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a60156480 0x7f4a60157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52262/0 (socket says 172.21.15.26:52262) 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5e59c700 1 -- 172.21.15.26:0/2801981398 learned_addr learned my addr 172.21.15.26:0/2801981398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5dd9b700 1 --2- 172.21.15.26:0/2801981398 >> v2:172.21.15.67:3300/0 conn(0x7f4a600c7b30 0x7f4a6006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5e59c700 1 -- 172.21.15.26:0/2801981398 >> v2:172.21.15.67:3300/0 conn(0x7f4a600c7b30 msgr2=0x7f4a6006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.905+0000 7f4a5e59c700 1 --2- 172.21.15.26:0/2801981398 >> v2:172.21.15.67:3300/0 conn(0x7f4a600c7b30 0x7f4a6006b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5e59c700 1 -- 172.21.15.26:0/2801981398 >> v1:172.21.15.67:6789/0 conn(0x7f4a6006bcc0 legacy=0x7f4a600ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5e59c700 1 -- 172.21.15.26:0/2801981398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600c85f0 con 0x7f4a60156480 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5e59c700 1 --2- 172.21.15.26:0/2801981398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60157710 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006dfb0 tx=0x7f4a50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7e9a26a57fd2f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5d59a700 1 -- 172.21.15.26:0/2801981398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000e070 con 0x7f4a60156480 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5d59a700 1 -- 172.21.15.26:0/2801981398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000ba20 con 0x7f4a60156480 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a5d59a700 1 -- 172.21.15.26:0/2801981398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500092e0 con 0x7f4a60156480 2023-10-09T11:44:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 -- 172.21.15.26:0/2801981398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 msgr2=0x7f4a60157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/2801981398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60157710 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006dfb0 tx=0x7f4a50009840 comp rx=0 tx=0).stop 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 -- 172.21.15.26:0/2801981398 shutdown_connections 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/2801981398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60157710 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/2801981398 >> v2:172.21.15.67:3300/0 conn(0x7f4a600c7b30 0x7f4a6006b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 -- 172.21.15.26:0/2801981398 >> 172.21.15.26:0/2801981398 conn(0x7f4a6006d170 msgr2=0x7f4a600cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.906+0000 7f4a64e1b700 1 -- 172.21.15.26:0/2801981398 shutdown_connections 2023-10-09T11:44:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.907+0000 7f4a64e1b700 1 -- 172.21.15.26:0/2801981398 wait complete. 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 Processor -- start 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 -- start start 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6006bcc0 0x7f4a600b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a600c7b30 0x7f4a600c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600c5350 con 0x7f4a60156480 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60158970 con 0x7f4a6006bcc0 2023-10-09T11:44:00.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.908+0000 7f4a64e1b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600b1000 con 0x7f4a600c7b30 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52268/0 (socket says 172.21.15.26:52268) 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 -- 172.21.15.26:0/1065461979 learned_addr learned my addr 172.21.15.26:0/1065461979 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5e59c700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6006bcc0 0x7f4a600b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5dd9b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a600c7b30 0x7f4a600c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 -- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a600c7b30 msgr2=0x7f4a600c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a600c7b30 0x7f4a600c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 -- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6006bcc0 msgr2=0x7f4a600b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6006bcc0 0x7f4a600b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 -- 172.21.15.26:0/1065461979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50009ae0 con 0x7f4a60156480 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a5ed9d700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c590 tx=0x7f4a58007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011590 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a580116f0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a600b12e0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011ab0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.909+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a600b18a0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.910+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6004c3c0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.911+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a5801b3b0 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.911+0000 7f4a567fc700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 0x7f4a400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.911+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f4a58084200 con 0x7f4a60156480 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.911+0000 7f4a5e59c700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 0x7f4a400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.912+0000 7f4a5e59c700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 0x7f4a400697d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009880 tx=0x7f4a50018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:00.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:00.916+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a58050c60 con 0x7f4a60156480 2023-10-09T11:44:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.108+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000272394.meta", "pool2": "cephfs.volume_0000000000272394.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a6006af80 con 0x7f4a60156480 2023-10-09T11:44:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.718+0000 7f4a567fc700 1 -- 172.21.15.26:0/1065461979 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000272394.meta", "pool2": "cephfs.volume_0000000000272394.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000272394.meta' removed v172) v1 ==== 241+0+0 (secure 0 0 0) 0x7f4a58017100 con 0x7f4a60156480 2023-10-09T11:44:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.720+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 msgr2=0x7f4a400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.720+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 0x7f4a400697d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009880 tx=0x7f4a50018000 comp rx=0 tx=0).stop 2023-10-09T11:44:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.720+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 msgr2=0x7f4a60152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.720+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c590 tx=0x7f4a58007ec0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 shutdown_connections 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a60156480 0x7f4a60152210 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6006bcc0 0x7f4a600b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a40067320 0x7f4a400697d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 --2- 172.21.15.26:0/1065461979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a600c7b30 0x7f4a600c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 >> 172.21.15.26:0/1065461979 conn(0x7f4a6006d170 msgr2=0x7f4a60152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 shutdown_connections 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.721+0000 7f4a64e1b700 1 -- 172.21.15.26:0/1065461979 wait complete. 2023-10-09T11:44:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs.volume_0000000000272394.meta' removed 2023-10-09T11:44:01.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:44:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.862+0000 7f659d9fe700 1 Processor -- start 2023-10-09T11:44:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.862+0000 7f659d9fe700 1 -- start start 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6598159fb0 0x7f659815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f659815a8c0 0x7f65980cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65980cd3d0 0x7f659806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659815e180 con 0x7f65980cd3d0 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65980cd830 con 0x7f659815a8c0 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d9fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659815d570 con 0x7f6598159fb0 2023-10-09T11:44:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65980cd3d0 0x7f659806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65980cd3d0 0x7f659806d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52276/0 (socket says 172.21.15.26:52276) 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 -- 172.21.15.26:0/2490687917 learned_addr learned my addr 172.21.15.26:0/2490687917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 -- 172.21.15.26:0/2490687917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6598159fb0 msgr2=0x7f659815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 --2- 172.21.15.26:0/2490687917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6598159fb0 0x7f659815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 -- 172.21.15.26:0/2490687917 >> v2:172.21.15.67:3300/0 conn(0x7f659815a8c0 msgr2=0x7f65980cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 --2- 172.21.15.26:0/2490687917 >> v2:172.21.15.67:3300/0 conn(0x7f659815a8c0 0x7f65980cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.863+0000 7f659d1fd700 1 -- 172.21.15.26:0/2490687917 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659815d850 con 0x7f65980cd3d0 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d1fd700 1 --2- 172.21.15.26:0/2490687917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980cd3d0 0x7f659806d830 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f659806e900 tx=0x7f6588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed0ac1c10656b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f65977fe700 1 -- 172.21.15.26:0/2490687917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800b860 con 0x7f65980cd3d0 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f65977fe700 1 -- 172.21.15.26:0/2490687917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800b9c0 con 0x7f65980cd3d0 2023-10-09T11:44:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f65977fe700 1 -- 172.21.15.26:0/2490687917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800bd60 con 0x7f65980cd3d0 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 -- 172.21.15.26:0/2490687917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980cd3d0 msgr2=0x7f659806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 --2- 172.21.15.26:0/2490687917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980cd3d0 0x7f659806d830 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f659806e900 tx=0x7f6588009250 comp rx=0 tx=0).stop 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 -- 172.21.15.26:0/2490687917 shutdown_connections 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 --2- 172.21.15.26:0/2490687917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980cd3d0 0x7f659806d830 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 --2- 172.21.15.26:0/2490687917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6598159fb0 0x7f659815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 --2- 172.21.15.26:0/2490687917 >> v2:172.21.15.67:3300/0 conn(0x7f659815a8c0 0x7f65980cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 -- 172.21.15.26:0/2490687917 >> 172.21.15.26:0/2490687917 conn(0x7f65980703a0 msgr2=0x7f65980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 -- 172.21.15.26:0/2490687917 shutdown_connections 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.864+0000 7f659d9fe700 1 -- 172.21.15.26:0/2490687917 wait complete. 2023-10-09T11:44:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.866+0000 7f659d9fe700 1 Processor -- start 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.866+0000 7f659d9fe700 1 -- start start 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.866+0000 7f659d9fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65980cd3d0 0x7f65980b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.866+0000 7f659d9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6598159fb0 0x7f659813fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.866+0000 7f659d9fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d9fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65980ca100 con 0x7f659815a8c0 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d9fe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65980b18e0 con 0x7f6598159fb0 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d9fe700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65980b1bc0 con 0x7f65980cd3d0 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52290/0 (socket says 172.21.15.26:52290) 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 -- 172.21.15.26:0/4176420427 learned_addr learned my addr 172.21.15.26:0/4176420427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f6597fff700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6598159fb0 0x7f659813fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659c9fc700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65980cd3d0 0x7f65980b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 -- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65980cd3d0 msgr2=0x7f65980b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65980cd3d0 0x7f65980b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 -- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6598159fb0 msgr2=0x7f659813fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6598159fb0 0x7f659813fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 -- 172.21.15.26:0/4176420427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880094f0 con 0x7f659815a8c0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d1fd700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f65880090b0 tx=0x7f6588017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658801a660 con 0x7f659815a8c0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658801a7c0 con 0x7f659815a8c0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658801ab80 con 0x7f659815a8c0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65980b1ea0 con 0x7f659815a8c0 2023-10-09T11:44:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.867+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65980b09e0 con 0x7f659815a8c0 2023-10-09T11:44:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.868+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659804c3c0 con 0x7f659815a8c0 2023-10-09T11:44:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.869+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f658801b430 con 0x7f659815a8c0 2023-10-09T11:44:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.869+0000 7f6594ff9700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.869+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6588086640 con 0x7f659815a8c0 2023-10-09T11:44:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.869+0000 7f659c9fc700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.870+0000 7f659c9fc700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 0x7f65840697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6590001250 tx=0x7f6590009620 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:01.873+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6588053280 con 0x7f659815a8c0 2023-10-09T11:44:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.067+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65980caef0 con 0x7f659815a8c0 2023-10-09T11:44:02.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.720+0000 7f6594ff9700 1 -- 172.21.15.26:0/4176420427 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) v1 ==== 169+0+0 (secure 0 0 0) 0x7f65880568a0 con 0x7f659815a8c0 2023-10-09T11:44:02.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 msgr2=0x7f65840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 0x7f65840697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6590001250 tx=0x7f6590009620 comp rx=0 tx=0).stop 2023-10-09T11:44:02.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 msgr2=0x7f659815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f65880090b0 tx=0x7f6588017000 comp rx=0 tx=0).stop 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 shutdown_connections 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f659815a8c0 0x7f659815ad10 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6584067320 0x7f65840697d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65980cd3d0 0x7f65980b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 --2- 172.21.15.26:0/4176420427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6598159fb0 0x7f659813fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 >> 172.21.15.26:0/4176420427 conn(0x7f65980703a0 msgr2=0x7f659815c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 shutdown_connections 2023-10-09T11:44:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.723+0000 7f659d9fe700 1 -- 172.21.15.26:0/4176420427 wait complete. 2023-10-09T11:44:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:44:02.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm another-data-pool another-data-pool --yes-i-really-really-mean-it 2023-10-09T11:44:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.863+0000 7f961a947700 1 Processor -- start 2023-10-09T11:44:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.863+0000 7f961a947700 1 -- start start 2023-10-09T11:44:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.864+0000 7f961a947700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 0x7f9614159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.864+0000 7f961a947700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.864+0000 7f961a947700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140ccfd0 con 0x7f9614159530 2023-10-09T11:44:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.864+0000 7f961a947700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961415a410 con 0x7f9614159e40 2023-10-09T11:44:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.864+0000 7f961a947700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961415a6f0 con 0x7f961406dcf0 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 0x7f9614159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f9618ee4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f9618ee4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:47830/0 (socket says 172.21.15.26:47830) 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f9618ee4700 1 -- 172.21.15.26:0/1399148461 learned_addr learned my addr 172.21.15.26:0/1399148461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 -- 172.21.15.26:0/1399148461 >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 msgr2=0x7f96140cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 --2- 172.21.15.26:0/1399148461 >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 -- 172.21.15.26:0/1399148461 >> v1:172.21.15.67:6789/0 conn(0x7f9614159530 legacy=0x7f96140ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 -- 172.21.15.26:0/1399148461 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961415a9d0 con 0x7f961406dcf0 2023-10-09T11:44:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f9618ee4700 1 --2- 172.21.15.26:0/1399148461 >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f96137fe700 1 --2- 172.21.15.26:0/1399148461 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 0x7f9614159900 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96080098e0 tx=0x7f96080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf7e95e3218a569 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.865+0000 7f9612ffd700 1 -- 172.21.15.26:0/1399148461 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800b640 con 0x7f961406dcf0 2023-10-09T11:44:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f9612ffd700 1 -- 172.21.15.26:0/1399148461 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800b7a0 con 0x7f961406dcf0 2023-10-09T11:44:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f9612ffd700 1 -- 172.21.15.26:0/1399148461 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800bb40 con 0x7f961406dcf0 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 -- 172.21.15.26:0/1399148461 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 msgr2=0x7f9614159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 --2- 172.21.15.26:0/1399148461 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 0x7f9614159900 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96080098e0 tx=0x7f96080091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 -- 172.21.15.26:0/1399148461 shutdown_connections 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 --2- 172.21.15.26:0/1399148461 >> v2:172.21.15.67:3300/0 conn(0x7f9614159e40 0x7f96140cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 --2- 172.21.15.26:0/1399148461 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f961406dcf0 0x7f9614159900 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 -- 172.21.15.26:0/1399148461 >> 172.21.15.26:0/1399148461 conn(0x7f96140703a0 msgr2=0x7f96140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 -- 172.21.15.26:0/1399148461 shutdown_connections 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.866+0000 7f961a947700 1 -- 172.21.15.26:0/1399148461 wait complete. 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.867+0000 7f961a947700 1 Processor -- start 2023-10-09T11:44:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.867+0000 7f961a947700 1 -- start start 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f961406dcf0 0x7f9614169c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9614159e40 0x7f9614155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961416a170 con 0x7f9614159530 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614153ea0 con 0x7f961406dcf0 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f961a947700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961416ac30 con 0x7f9614159e40 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f96137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f96137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52306/0 (socket says 172.21.15.26:52306) 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f96137fe700 1 -- 172.21.15.26:0/871392854 learned_addr learned my addr 172.21.15.26:0/871392854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f9618ee4700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9614159e40 0x7f9614155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f9613fff700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f961406dcf0 0x7f9614169c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f96137fe700 1 -- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9614159e40 msgr2=0x7f9614155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.868+0000 7f96137fe700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9614159e40 0x7f9614155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f96137fe700 1 -- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f961406dcf0 msgr2=0x7f9614169c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f96137fe700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f961406dcf0 0x7f9614169c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f96137fe700 1 -- 172.21.15.26:0/871392854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009ae0 con 0x7f9614159530 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f96137fe700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f961415a830 tx=0x7f9608017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801bb70 con 0x7f9614159530 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960801bcd0 con 0x7f9614159530 2023-10-09T11:44:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011670 con 0x7f9614159530 2023-10-09T11:44:02.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9608009420 con 0x7f9614159530 2023-10-09T11:44:02.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.869+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961416a390 con 0x7f9614159530 2023-10-09T11:44:02.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.870+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961404c3c0 con 0x7f9614159530 2023-10-09T11:44:02.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.870+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f96080119e0 con 0x7f9614159530 2023-10-09T11:44:02.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.871+0000 7f95fbfff700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 0x7f96000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.871+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5360+0+0 (secure 0 0 0) 0x7f9608085f70 con 0x7f9614159530 2023-10-09T11:44:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.871+0000 7f9613fff700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 0x7f96000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.871+0000 7f9613fff700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 0x7f96000697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9604003a60 tx=0x7f9604007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:02.875+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9608052d60 con 0x7f9614159530 2023-10-09T11:44:03.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.066+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96140640f0 con 0x7f9614159530 2023-10-09T11:44:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.728+0000 7f95fbfff700 1 -- 172.21.15.26:0/871392854 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true}]=0 pool 'another-data-pool' removed v174) v1 ==== 187+0+0 (secure 0 0 0) 0x7f9608056380 con 0x7f9614159530 2023-10-09T11:44:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 msgr2=0x7f96000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 0x7f96000697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9604003a60 tx=0x7f9604007ec0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 msgr2=0x7f9614153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f961415a830 tx=0x7f9608017000 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 shutdown_connections 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9600067320 0x7f96000697d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9614159e40 0x7f9614155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f961406dcf0 0x7f9614169c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 --2- 172.21.15.26:0/871392854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9614159530 0x7f9614153960 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.733+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 >> 172.21.15.26:0/871392854 conn(0x7f96140703a0 msgr2=0x7f96140cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.734+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 shutdown_connections 2023-10-09T11:44:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.734+0000 7f961a947700 1 -- 172.21.15.26:0/871392854 wait complete. 2023-10-09T11:44:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'another-data-pool' removed 2023-10-09T11:44:03.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:44:03.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.873+0000 7fbc317e3700 1 Processor -- start 2023-10-09T11:44:03.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.873+0000 7fbc317e3700 1 -- start start 2023-10-09T11:44:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc317e3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c13c9b0 0x7fbc2c069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc317e3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc317e3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c06d7b0 con 0x7fbc2c0cc320 2023-10-09T11:44:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc317e3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c06f7d0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc317e3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c06e330 con 0x7fbc2c13c9b0 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc2a7fc700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c13c9b0 0x7fbc2c069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc2b7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc2b7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:47844/0 (socket says 172.21.15.26:47844) 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.874+0000 7fbc2b7fe700 1 -- 172.21.15.26:0/2854567332 learned_addr learned my addr 172.21.15.26:0/2854567332 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc2b7fe700 1 -- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c13c9b0 msgr2=0x7fbc2c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc2b7fe700 1 --2- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c13c9b0 0x7fbc2c069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc2b7fe700 1 -- 172.21.15.26:0/2854567332 >> v1:172.21.15.67:6789/0 conn(0x7fbc2c0cc320 legacy=0x7fbc2c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc2b7fe700 1 -- 172.21.15.26:0/2854567332 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c06da00 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc29ffb700 1 -- 172.21.15.26:0/2854567332 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866051546 0 0) 0x7fbc2c06d7b0 con 0x7fbc2c0cc320 2023-10-09T11:44:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc2b7fe700 1 --2- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009f20 tx=0x7fbc1c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c71b79bc1d3fc111 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc29ffb700 1 -- 172.21.15.26:0/2854567332 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00e070 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc29ffb700 1 -- 172.21.15.26:0/2854567332 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00b9d0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.875+0000 7fbc29ffb700 1 -- 172.21.15.26:0/2854567332 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0092e0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 -- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c0cc6f0 msgr2=0x7fbc2c069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 --2- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009f20 tx=0x7fbc1c009840 comp rx=0 tx=0).stop 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 -- 172.21.15.26:0/2854567332 shutdown_connections 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 --2- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c069f40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 --2- 172.21.15.26:0/2854567332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c13c9b0 0x7fbc2c069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 -- 172.21.15.26:0/2854567332 >> 172.21.15.26:0/2854567332 conn(0x7fbc2c067f00 msgr2=0x7fbc2c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 -- 172.21.15.26:0/2854567332 shutdown_connections 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.876+0000 7fbc317e3700 1 -- 172.21.15.26:0/2854567332 wait complete. 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.877+0000 7fbc317e3700 1 Processor -- start 2023-10-09T11:44:03.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.877+0000 7fbc317e3700 1 -- start start 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c0cc320 0x7fbc2c16adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c13c9b0 0x7fbc2c16d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0af5d0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0aeca0 con 0x7fbc2c13c9b0 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc317e3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0aef80 con 0x7fbc2c0cc320 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52314/0 (socket says 172.21.15.26:52314) 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 -- 172.21.15.26:0/765492925 learned_addr learned my addr 172.21.15.26:0/765492925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2affd700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c0cc320 0x7fbc2c16adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2b7fe700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c13c9b0 0x7fbc2c16d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 -- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c0cc320 msgr2=0x7fbc2c16adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c0cc320 0x7fbc2c16adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 -- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c13c9b0 msgr2=0x7fbc2c16d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c13c9b0 0x7fbc2c16d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 -- 172.21.15.26:0/765492925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009ae0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.878+0000 7fbc2a7fc700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400e900 tx=0x7fbc140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14013680 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140137e0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c0af260 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14013ba0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c0afa60 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.879+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c04c3c0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.880+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbc140123d0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.880+0000 7fbc22ffd700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 0x7fbc0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.880+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbc140849f0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.881+0000 7fbc2affd700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 0x7fbc0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:03.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.881+0000 7fbc2affd700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 0x7fbc0c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0c3990 tx=0x7fbc24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:03.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:03.885+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc14051980 con 0x7fbc2c0cc6f0 2023-10-09T11:44:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.083+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc2c0af710 con 0x7fbc2c0cc6f0 2023-10-09T11:44:04.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.086+0000 7fbc22ffd700 1 -- 172.21.15.26:0/765492925 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc14054fa0 con 0x7fbc2c0cc6f0 2023-10-09T11:44:04.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 msgr2=0x7fbc0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 0x7fbc0c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0c3990 tx=0x7fbc24009040 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 msgr2=0x7fbc2c16d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400e900 tx=0x7fbc140091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 shutdown_connections 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc2c13c9b0 0x7fbc2c16d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbc0c067320 0x7fbc0c0697d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbc2c0cc320 0x7fbc2c16adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 --2- 172.21.15.26:0/765492925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c0cc6f0 0x7fbc2c16d1e0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 >> 172.21.15.26:0/765492925 conn(0x7fbc2c067f00 msgr2=0x7fbc2c0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:04.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 shutdown_connections 2023-10-09T11:44:04.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.089+0000 7fbc317e3700 1 -- 172.21.15.26:0/765492925 wait complete. 2023-10-09T11:44:04.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-09T11:44:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.220+0000 7f3a30cbf700 1 Processor -- start 2023-10-09T11:44:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.220+0000 7f3a30cbf700 1 -- start start 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a30cbf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 0x7f3a2c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a30cbf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 0x7f3a2c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a30cbf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c15a280 con 0x7f3a2c0b07d0 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a30cbf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c06e180 con 0x7f3a2c0cf200 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a30cbf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c06d850 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a2a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a2c0b07d0 0x7f3a2c0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56642/0 (socket says 172.21.15.26:56642) 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a2a59c700 1 -- 172.21.15.26:0/475313258 learned_addr learned my addr 172.21.15.26:0/475313258 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a29d9b700 1 --2- 172.21.15.26:0/475313258 >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 0x7f3a2c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.221+0000 7f3a2ad9d700 1 --2- 172.21.15.26:0/475313258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 0x7f3a2c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2ad9d700 1 -- 172.21.15.26:0/475313258 >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 msgr2=0x7f3a2c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2ad9d700 1 --2- 172.21.15.26:0/475313258 >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 0x7f3a2c0c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2ad9d700 1 -- 172.21.15.26:0/475313258 >> v1:172.21.15.26:6789/0 conn(0x7f3a2c0b07d0 legacy=0x7f3a2c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2ad9d700 1 -- 172.21.15.26:0/475313258 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c06db30 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a29d9b700 1 --2- 172.21.15.26:0/475313258 >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 0x7f3a2c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2ad9d700 1 --2- 172.21.15.26:0/475313258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 0x7f3a2c06e610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009e60 tx=0x7f3a24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753ba2a5677974d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2959a700 1 -- 172.21.15.26:0/475313258 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400e070 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2959a700 1 -- 172.21.15.26:0/475313258 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400bb60 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.222+0000 7f3a2959a700 1 -- 172.21.15.26:0/475313258 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24012430 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 -- 172.21.15.26:0/475313258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 msgr2=0x7f3a2c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/475313258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 0x7f3a2c06e610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009e60 tx=0x7f3a24009780 comp rx=0 tx=0).stop 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 -- 172.21.15.26:0/475313258 shutdown_connections 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/475313258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0b0ba0 0x7f3a2c06e610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/475313258 >> v2:172.21.15.67:3300/0 conn(0x7f3a2c0cf200 0x7f3a2c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 -- 172.21.15.26:0/475313258 >> 172.21.15.26:0/475313258 conn(0x7f3a2c06ce80 msgr2=0x7f3a2c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 -- 172.21.15.26:0/475313258 shutdown_connections 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.223+0000 7f3a30cbf700 1 -- 172.21.15.26:0/475313258 wait complete. 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.224+0000 7f3a30cbf700 1 Processor -- start 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.224+0000 7f3a30cbf700 1 -- start start 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2c0b07d0 0x7f3a2c1443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0cf200 0x7f3a2c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c8870 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c153670 con 0x7f3a2c0b07d0 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a30cbf700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c152da0 con 0x7f3a2c0cf200 2023-10-09T11:44:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52324/0 (socket says 172.21.15.26:52324) 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 -- 172.21.15.26:0/4173527771 learned_addr learned my addr 172.21.15.26:0/4173527771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a2a59c700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2c0b07d0 0x7f3a2c1443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a2ad9d700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0cf200 0x7f3a2c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 -- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0cf200 msgr2=0x7f3a2c0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0cf200 0x7f3a2c0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 -- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2c0b07d0 msgr2=0x7f3a2c1443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2c0b07d0 0x7f3a2c1443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 -- 172.21.15.26:0/4173527771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009420 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.225+0000 7f3a29d9b700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000ecb0 tx=0x7f3a200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.226+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000c920 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.226+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000ca80 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.226+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a24009a20 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.226+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000ce00 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.226+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0c7d80 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.227+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c153820 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.227+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3a20013680 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.227+0000 7f3a1a7fc700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 0x7f3a0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.227+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3a20084c10 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.227+0000 7f3a2a59c700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 0x7f3a0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.228+0000 7f3a2a59c700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 0x7f3a0c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c002950 tx=0x7f3a1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.232+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a2c153820 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.506+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7f3a2c153820 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.730+0000 7f3a1a7fc700 1 -- 172.21.15.26:0/4173527771 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v445) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3a2c153820 con 0x7f3a2c0b0ba0 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 msgr2=0x7f3a0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 0x7f3a0c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c002950 tx=0x7f3a1c009040 comp rx=0 tx=0).stop 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 msgr2=0x7f3a2c0c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000ecb0 tx=0x7f3a200091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 shutdown_connections 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3a0c067320 0x7f3a0c0697d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a2c0cf200 0x7f3a2c0c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2c0b07d0 0x7f3a2c1443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 --2- 172.21.15.26:0/4173527771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a2c0b0ba0 0x7f3a2c0c55c0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 >> 172.21.15.26:0/4173527771 conn(0x7f3a2c06ce80 msgr2=0x7f3a2c068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 shutdown_connections 2023-10-09T11:44:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.732+0000 7f3a30cbf700 1 -- 172.21.15.26:0/4173527771 wait complete. 2023-10-09T11:44:04.745 INFO:tasks.cephfs_test_runner:That renaming a volume with more than one data pool does not change ... ok 2023-10-09T11:44:04.745 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) That volume rename is idempotent. 2023-10-09T11:44:04.745 INFO:tasks.cephfs_test_runner:test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:44:04.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-09T11:44:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.865+0000 7f30da01d700 1 Processor -- start 2023-10-09T11:44:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.865+0000 7f30da01d700 1 -- start start 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30da01d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 0x7f30d40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30da01d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30d415a5d0 0x7f30d4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30da01d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d415ae40 con 0x7f30d40cd9e0 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30da01d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40d13f0 con 0x7f30d415a5d0 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30da01d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d415ab60 con 0x7f30d40cb5a0 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30d415a5d0 0x7f30d4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30d415a5d0 0x7f30d4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52338/0 (socket says 172.21.15.26:52338) 2023-10-09T11:44:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 -- 172.21.15.26:0/2377367230 learned_addr learned my addr 172.21.15.26:0/2377367230 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d37fe700 1 --2- 172.21.15.26:0/2377367230 >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 0x7f30d40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 -- 172.21.15.26:0/2377367230 >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 msgr2=0x7f30d40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 --2- 172.21.15.26:0/2377367230 >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 0x7f30d40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 -- 172.21.15.26:0/2377367230 >> v1:172.21.15.67:6789/0 conn(0x7f30d40cd9e0 legacy=0x7f30d4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 -- 172.21.15.26:0/2377367230 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40ccf00 con 0x7f30d415a5d0 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d37fe700 1 --2- 172.21.15.26:0/2377367230 >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 0x7f30d40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.866+0000 7f30d3fff700 1 --2- 172.21.15.26:0/2377367230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d415a5d0 0x7f30d4156e90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009f20 tx=0x7f30cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bf0277a77c943f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30d27fc700 1 -- 172.21.15.26:0/2377367230 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00e070 con 0x7f30d415a5d0 2023-10-09T11:44:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30d27fc700 1 -- 172.21.15.26:0/2377367230 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc00ba40 con 0x7f30d415a5d0 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30d27fc700 1 -- 172.21.15.26:0/2377367230 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0092e0 con 0x7f30d415a5d0 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 -- 172.21.15.26:0/2377367230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d415a5d0 msgr2=0x7f30d4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 --2- 172.21.15.26:0/2377367230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d415a5d0 0x7f30d4156e90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009f20 tx=0x7f30cc009840 comp rx=0 tx=0).stop 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 -- 172.21.15.26:0/2377367230 shutdown_connections 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 --2- 172.21.15.26:0/2377367230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d415a5d0 0x7f30d4156e90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 --2- 172.21.15.26:0/2377367230 >> v2:172.21.15.67:3300/0 conn(0x7f30d40cb5a0 0x7f30d40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 -- 172.21.15.26:0/2377367230 >> 172.21.15.26:0/2377367230 conn(0x7f30d4070e30 msgr2=0x7f30d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 -- 172.21.15.26:0/2377367230 shutdown_connections 2023-10-09T11:44:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.867+0000 7f30da01d700 1 -- 172.21.15.26:0/2377367230 wait complete. 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.868+0000 7f30da01d700 1 Processor -- start 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.868+0000 7f30da01d700 1 -- start start 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30d40cb5a0 0x7f30d40b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 0x7f30d4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d41521e0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d415c5e0 con 0x7f30d40cb5a0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30da01d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d41523f0 con 0x7f30d415a5d0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52346/0 (socket says 172.21.15.26:52346) 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30d2ffd700 1 -- 172.21.15.26:0/4257557669 learned_addr learned my addr 172.21.15.26:0/4257557669 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30d37fe700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30d40cb5a0 0x7f30d40b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.869+0000 7f30d3fff700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 0x7f30d4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 -- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 msgr2=0x7f30d4151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 0x7f30d4151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 -- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30d40cb5a0 msgr2=0x7f30d40b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30d40cb5a0 0x7f30d40b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 -- 172.21.15.26:0/4257557669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc009ae0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d3fff700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 0x7f30d4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30d2ffd700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c590 tx=0x7f30c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8011590 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c8011710 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8011ad0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d41526d0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.870+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d4152c90 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.871+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d404c3c0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.871+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30c801b3b0 con 0x7f30d40cd9e0 2023-10-09T11:44:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.872+0000 7f30bb7fe700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.872+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f30c8083f70 con 0x7f30d40cd9e0 2023-10-09T11:44:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.872+0000 7f30d37fe700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.872+0000 7f30d37fe700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 0x7f30c00697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f30c4006f00 tx=0x7f30c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:04.876+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30c8050ec0 con 0x7f30d40cd9e0 2023-10-09T11:44:05.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.146+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f30d40cd1e0 con 0x7f30d40cd9e0 2023-10-09T11:44:05.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.736+0000 7f30bb7fe700 1 -- 172.21.15.26:0/4257557669 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v446) v1 ==== 150+0+0 (secure 0 0 0) 0x7f30c8017070 con 0x7f30d40cd9e0 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 msgr2=0x7f30c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 0x7f30c00697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f30c4006f00 tx=0x7f30c4008040 comp rx=0 tx=0).stop 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 msgr2=0x7f30d416d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c590 tx=0x7f30c800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 shutdown_connections 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30d415a5d0 0x7f30d4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30d40cb5a0 0x7f30d40b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 --2- 172.21.15.26:0/4257557669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d40cd9e0 0x7f30d416d420 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 >> 172.21.15.26:0/4257557669 conn(0x7f30d4070e30 msgr2=0x7f30d4155230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:05.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 shutdown_connections 2023-10-09T11:44:05.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.739+0000 7f30da01d700 1 -- 172.21.15.26:0/4257557669 wait complete. 2023-10-09T11:44:05.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:44:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.881+0000 7f8645995700 1 Processor -- start 2023-10-09T11:44:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.881+0000 7f8645995700 1 -- start start 2023-10-09T11:44:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f8645995700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86400cf110 0x7f864015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f8645995700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864015ac50 con 0x7f8640153dd0 2023-10-09T11:44:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f8645995700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864015d010 con 0x7f8640153a00 2023-10-09T11:44:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f8645995700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864015af60 con 0x7f86400cf110 2023-10-09T11:44:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f863ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8640153dd0 0x7f86400cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56644/0 (socket says 172.21.15.26:56644) 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f863ffff700 1 -- 172.21.15.26:0/1027547617 learned_addr learned my addr 172.21.15.26:0/1027547617 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.882+0000 7f8645194700 1 --2- 172.21.15.26:0/1027547617 >> v2:172.21.15.67:3300/0 conn(0x7f86400cf110 0x7f864015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f863f7fe700 1 -- 172.21.15.26:0/1027547617 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659465691 0 0) 0x7f864015ac50 con 0x7f8640153dd0 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f863f7fe700 1 -- 172.21.15.26:0/1027547617 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c003570 con 0x7f8640153dd0 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f8645194700 1 -- 172.21.15.26:0/1027547617 >> v1:172.21.15.67:6789/0 conn(0x7f8640153a00 legacy=0x7f864015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f8645194700 1 -- 172.21.15.26:0/1027547617 >> v1:172.21.15.26:6789/0 conn(0x7f8640153dd0 legacy=0x7f86400cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f8645194700 1 -- 172.21.15.26:0/1027547617 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864015b240 con 0x7f86400cf110 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f8645194700 1 --2- 172.21.15.26:0/1027547617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f864015de50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f86280098e0 tx=0x7f86280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1ce0f0d7747580a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f863f7fe700 1 -- 172.21.15.26:0/1027547617 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800b640 con 0x7f86400cf110 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f863f7fe700 1 -- 172.21.15.26:0/1027547617 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800b7a0 con 0x7f86400cf110 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.883+0000 7f863f7fe700 1 -- 172.21.15.26:0/1027547617 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800bb20 con 0x7f86400cf110 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 -- 172.21.15.26:0/1027547617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 msgr2=0x7f864015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 --2- 172.21.15.26:0/1027547617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f864015de50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f86280098e0 tx=0x7f86280091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 -- 172.21.15.26:0/1027547617 shutdown_connections 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 --2- 172.21.15.26:0/1027547617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f864015de50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 -- 172.21.15.26:0/1027547617 >> 172.21.15.26:0/1027547617 conn(0x7f86400703a0 msgr2=0x7f86400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 -- 172.21.15.26:0/1027547617 shutdown_connections 2023-10-09T11:44:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.884+0000 7f8645995700 1 -- 172.21.15.26:0/1027547617 wait complete. 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.885+0000 7f8645995700 1 Processor -- start 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.885+0000 7f8645995700 1 -- start start 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f8640151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 0x7f86400c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cc900 con 0x7f8640153a00 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cbcf0 con 0x7f86400cf110 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645995700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cbfd0 con 0x7f8640153dd0 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52352/0 (socket says 172.21.15.26:52352) 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 -- 172.21.15.26:0/1412980636 learned_addr learned my addr 172.21.15.26:0/1412980636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8644993700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f8640151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 -- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 msgr2=0x7f86400c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645194700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 0x7f86400c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 0x7f86400c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 -- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 msgr2=0x7f8640151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f8640151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 -- 172.21.15.26:0/1412980636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009420 con 0x7f8640153a00 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8644993700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f8640151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f8645194700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 0x7f86400c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863ffff700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f863000c590 tx=0x7f8630007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.886+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630005b30 con 0x7f8640153a00 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.887+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630005cb0 con 0x7f8640153a00 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.887+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86400cc2b0 con 0x7f8640153a00 2023-10-09T11:44:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.887+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630007320 con 0x7f8640153a00 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.887+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86400cb910 con 0x7f8640153a00 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.887+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86400b10b0 con 0x7f8640153a00 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.888+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f863001b3b0 con 0x7f8640153a00 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.888+0000 7f863cff9700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 0x7f86200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.889+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8630083f60 con 0x7f8640153a00 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.889+0000 7f8644993700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 0x7f86200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:05.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.889+0000 7f8644993700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 0x7f86200697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8638007fd0 tx=0x7f8638009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:05.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:05.893+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8630050ef0 con 0x7f8640153a00 2023-10-09T11:44:06.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.086+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f86400ccc90 con 0x7f8640153a00 2023-10-09T11:44:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.089+0000 7f863cff9700 1 -- 172.21.15.26:0/1412980636 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8630017070 con 0x7f8640153a00 2023-10-09T11:44:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 msgr2=0x7f86200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 0x7f86200697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8638007fd0 tx=0x7f8638009040 comp rx=0 tx=0).stop 2023-10-09T11:44:06.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 msgr2=0x7f86400c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f863000c590 tx=0x7f8630007e00 comp rx=0 tx=0).stop 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 shutdown_connections 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8620067320 0x7f86200697d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8640153dd0 0x7f86400c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86400cf110 0x7f8640151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 --2- 172.21.15.26:0/1412980636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8640153a00 0x7f86400c7ed0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 >> 172.21.15.26:0/1412980636 conn(0x7f86400703a0 msgr2=0x7f864015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 shutdown_connections 2023-10-09T11:44:06.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.092+0000 7f8645995700 1 -- 172.21.15.26:0/1412980636 wait complete. 2023-10-09T11:44:06.104 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:44:06.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:06.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:06.200 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:44:06.200 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:44:06.201 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:06.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.319+0000 7fc4560f9700 1 Processor -- start 2023-10-09T11:44:06.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.319+0000 7fc4560f9700 1 -- start start 2023-10-09T11:44:06.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc4560f9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 0x7fc4501645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc4560f9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500ce9d0 con 0x7fc4501598b0 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc4560f9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500af960 con 0x7fc450159c80 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc4560f9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500afc30 con 0x7fc4500cbe00 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc44f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4501598b0 0x7fc4500af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56648/0 (socket says 172.21.15.26:56648) 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.320+0000 7fc44f7fe700 1 -- 172.21.15.26:0/2285615694 learned_addr learned my addr 172.21.15.26:0/2285615694 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44ffff700 1 --2- 172.21.15.26:0/2285615694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 0x7fc4501645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887311891 0 0) 0x7fc4500ce9d0 con 0x7fc4501598b0 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc438003570 con 0x7fc4501598b0 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712561510 0 0) 0x7fc4500af960 con 0x7fc450159c80 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4500ce9d0 con 0x7fc450159c80 2023-10-09T11:44:06.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44ffff700 1 -- 172.21.15.26:0/2285615694 >> v1:172.21.15.67:6789/0 conn(0x7fc450159c80 legacy=0x7fc4500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44ffff700 1 -- 172.21.15.26:0/2285615694 >> v1:172.21.15.26:6789/0 conn(0x7fc4501598b0 legacy=0x7fc4500af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457413134 0 0) 0x7fc438003570 con 0x7fc4501598b0 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44ffff700 1 -- 172.21.15.26:0/2285615694 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500aff10 con 0x7fc4500cbe00 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44ffff700 1 --2- 172.21.15.26:0/2285615694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 0x7fc4501645a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc448009e90 tx=0x7fc448009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7496bba0d5d634 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.321+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44800e070 con 0x7fc4500cbe00 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44800b870 con 0x7fc4500cbe00 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc44e7fc700 1 -- 172.21.15.26:0/2285615694 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440001470 con 0x7fc4500cbe00 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 -- 172.21.15.26:0/2285615694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 msgr2=0x7fc4501645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 --2- 172.21.15.26:0/2285615694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 0x7fc4501645a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc448009e90 tx=0x7fc448009780 comp rx=0 tx=0).stop 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 -- 172.21.15.26:0/2285615694 shutdown_connections 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 --2- 172.21.15.26:0/2285615694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc4500cbe00 0x7fc4501645a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 -- 172.21.15.26:0/2285615694 >> 172.21.15.26:0/2285615694 conn(0x7fc450070e30 msgr2=0x7fc4500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:06.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 -- 172.21.15.26:0/2285615694 shutdown_connections 2023-10-09T11:44:06.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.322+0000 7fc4560f9700 1 -- 172.21.15.26:0/2285615694 wait complete. 2023-10-09T11:44:06.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.323+0000 7fc4560f9700 1 Processor -- start 2023-10-09T11:44:06.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.323+0000 7fc4560f9700 1 -- start start 2023-10-09T11:44:06.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4500cbe00 0x7fc4500b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc450159c80 0x7fc4500c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b34b0 con 0x7fc4501598b0 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b3a70 con 0x7fc4500cbe00 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc4560f9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45016d570 con 0x7fc450159c80 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc44effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc44effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52366/0 (socket says 172.21.15.26:52366) 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc44effd700 1 -- 172.21.15.26:0/741445667 learned_addr learned my addr 172.21.15.26:0/741445667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc44ffff700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc450159c80 0x7fc4500c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.324+0000 7fc44f7fe700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4500cbe00 0x7fc4500b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 -- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc450159c80 msgr2=0x7fc4500c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc450159c80 0x7fc4500c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 -- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4500cbe00 msgr2=0x7fc4500b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4500cbe00 0x7fc4500b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 -- 172.21.15.26:0/741445667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448009a20 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc44effd700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c5b0 tx=0x7fc444007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444010510 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444010670 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45016d850 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444010a30 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.325+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500b52c0 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.326+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4500b3c00 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.326+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc44401b400 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.327+0000 7fc4377fe700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 0x7fc43c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.327+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc444084420 con 0x7fc4501598b0 2023-10-09T11:44:06.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.327+0000 7fc44f7fe700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 0x7fc43c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.327+0000 7fc44f7fe700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 0x7fc43c0697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc440004de0 tx=0x7fc440000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.331+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc444051430 con 0x7fc4501598b0 2023-10-09T11:44:06.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.569+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc45004c3c0 con 0x7fc4501598b0 2023-10-09T11:44:06.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.569+0000 7fc4377fe700 1 -- 172.21.15.26:0/741445667 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+3534 (secure 0 0 0) 0x7fc444054a50 con 0x7fc4501598b0 2023-10-09T11:44:06.570 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:06.570 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":114,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1874639706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1874639706},{"type":"v1","addr":"172.21.15.67:6836","nonce":1874639706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3896436630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3896436630},{"type":"v1","addr":"172.21.15.67:6837","nonce":3896436630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/4038566749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4038566749},{"type":"v1","addr":"172.21.15.26:6834","nonce":4038566749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":105},{"gid":8649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/1881452974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":1881452974},{"type":"v1","addr":"172.21.15.26:6835","nonce":1881452974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":114}],"filesystems":[]} 2023-10-09T11:44:06.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 msgr2=0x7fc43c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 0x7fc43c0697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc440004de0 tx=0x7fc440000bc0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 msgr2=0x7fc45016cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c5b0 tx=0x7fc444007e10 comp rx=0 tx=0).stop 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 shutdown_connections 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc43c067320 0x7fc43c0697d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc450159c80 0x7fc4500c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4500cbe00 0x7fc4500b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 --2- 172.21.15.26:0/741445667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4501598b0 0x7fc45016cb20 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 >> 172.21.15.26:0/741445667 conn(0x7fc450070e30 msgr2=0x7fc4500b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 shutdown_connections 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.571+0000 7fc4560f9700 1 -- 172.21.15.26:0/741445667 wait complete. 2023-10-09T11:44:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 114 2023-10-09T11:44:06.584 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:44:06.584 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:44:06.585 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:44:06.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:06.585 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:44:06.585 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:44:06.585 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:44:06.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:06.585 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:44:06.586 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:44:06.586 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:44:06.586 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:06.586 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:44:06.586 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:44:06.589 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:44:06.589 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:06.593 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:44:06.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:44:06.594 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:44:06.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:44:06.597 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:44:06.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:44:06.598 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:44:06.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:44:06.635 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:44:06.635 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:06.636 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:44:06.636 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:06.640 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:44:06.640 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:06.641 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:44:06.641 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:06.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:44:06.711 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:44:06.711 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:44:06.727 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:44:06.727 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:44:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.769+0000 7fd575e46700 1 Processor -- start 2023-10-09T11:44:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.769+0000 7fd575e46700 1 -- start start 2023-10-09T11:44:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd575e46700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5700cb5a0 0x7fd5700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd575e46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5700cd9e0 0x7fd570159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd575e46700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57015ae40 con 0x7fd57015a400 2023-10-09T11:44:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd575e46700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5700d13f0 con 0x7fd5700cd9e0 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd575e46700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57015ab60 con 0x7fd5700cb5a0 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd57015a400 0x7fd570156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56654/0 (socket says 172.21.15.26:56654) 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5700cd9e0 0x7fd570159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56ffff700 1 -- 172.21.15.26:0/735581129 learned_addr learned my addr 172.21.15.26:0/735581129 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56f7fe700 1 --2- 172.21.15.26:0/735581129 >> v2:172.21.15.67:3300/0 conn(0x7fd5700cb5a0 0x7fd5700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56e7fc700 1 -- 172.21.15.26:0/735581129 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780253804 0 0) 0x7fd57015ae40 con 0x7fd57015a400 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.770+0000 7fd56e7fc700 1 -- 172.21.15.26:0/735581129 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd558003570 con 0x7fd57015a400 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56effd700 1 -- 172.21.15.26:0/735581129 >> v2:172.21.15.67:3300/0 conn(0x7fd5700cb5a0 msgr2=0x7fd5700cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56effd700 1 --2- 172.21.15.26:0/735581129 >> v2:172.21.15.67:3300/0 conn(0x7fd5700cb5a0 0x7fd5700cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56effd700 1 -- 172.21.15.26:0/735581129 >> v1:172.21.15.26:6789/0 conn(0x7fd57015a400 legacy=0x7fd570156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56effd700 1 -- 172.21.15.26:0/735581129 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700ccf00 con 0x7fd5700cd9e0 2023-10-09T11:44:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56effd700 1 --2- 172.21.15.26:0/735581129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cd9e0 0x7fd570159ec0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd5640098e0 tx=0x7fd5640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a335bae3b00a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56e7fc700 1 -- 172.21.15.26:0/735581129 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564011630 con 0x7fd5700cd9e0 2023-10-09T11:44:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56e7fc700 1 -- 172.21.15.26:0/735581129 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564011790 con 0x7fd5700cd9e0 2023-10-09T11:44:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd56e7fc700 1 -- 172.21.15.26:0/735581129 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564011b30 con 0x7fd5700cd9e0 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 -- 172.21.15.26:0/735581129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cd9e0 msgr2=0x7fd570159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 --2- 172.21.15.26:0/735581129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cd9e0 0x7fd570159ec0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd5640098e0 tx=0x7fd5640091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 -- 172.21.15.26:0/735581129 shutdown_connections 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 --2- 172.21.15.26:0/735581129 >> v2:172.21.15.67:3300/0 conn(0x7fd5700cb5a0 0x7fd5700cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 --2- 172.21.15.26:0/735581129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cd9e0 0x7fd570159ec0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 -- 172.21.15.26:0/735581129 >> 172.21.15.26:0/735581129 conn(0x7fd570070e30 msgr2=0x7fd5700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.771+0000 7fd575e46700 1 -- 172.21.15.26:0/735581129 shutdown_connections 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.772+0000 7fd575e46700 1 -- 172.21.15.26:0/735581129 wait complete. 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.773+0000 7fd575e46700 1 Processor -- start 2023-10-09T11:44:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.773+0000 7fd575e46700 1 -- start start 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.773+0000 7fd575e46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5700cd9e0 0x7fd570154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57015a400 0x7fd570154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57016a6c0 con 0x7fd5700cb5a0 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd570169af0 con 0x7fd57015a400 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd570169d90 con 0x7fd5700cd9e0 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52408/0 (socket says 172.21.15.26:52408) 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 -- 172.21.15.26:0/478944654 learned_addr learned my addr 172.21.15.26:0/478944654 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56effd700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5700cd9e0 0x7fd570154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56ffff700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57015a400 0x7fd570154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 -- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5700cd9e0 msgr2=0x7fd570154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5700cd9e0 0x7fd570154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 -- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57015a400 msgr2=0x7fd570154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57015a400 0x7fd570154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 -- 172.21.15.26:0/478944654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564009420 con 0x7fd5700cb5a0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd56f7fe700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ec80 tx=0x7fd5600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000c850 con 0x7fd5700cb5a0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000c9b0 con 0x7fd5700cb5a0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57016a070 con 0x7fd5700cb5a0 2023-10-09T11:44:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000cd50 con 0x7fd5700cb5a0 2023-10-09T11:44:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.774+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700b4920 con 0x7fd5700cb5a0 2023-10-09T11:44:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.775+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57016a9a0 con 0x7fd5700cb5a0 2023-10-09T11:44:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.776+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd560013680 con 0x7fd5700cb5a0 2023-10-09T11:44:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.776+0000 7fd5577fe700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 0x7fd55c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.776+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd560084ba0 con 0x7fd5700cb5a0 2023-10-09T11:44:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.776+0000 7fd56effd700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 0x7fd55c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.777+0000 7fd56effd700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 0x7fd55c0697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd57016cf40 tx=0x7fd564017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.781+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd560051b30 con 0x7fd5700cb5a0 2023-10-09T11:44:06.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:06.989+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd57004c3c0 con 0x7fd5700cb5a0 2023-10-09T11:44:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.761+0000 7fd5577fe700 1 -- 172.21.15.26:0/478944654 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v179) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd560055150 con 0x7fd5700cb5a0 2023-10-09T11:44:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.763+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 msgr2=0x7fd55c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 0x7fd55c0697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd57016cf40 tx=0x7fd564017000 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 msgr2=0x7fd5700af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ec80 tx=0x7fd5600091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 shutdown_connections 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57015a400 0x7fd570154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5700cb5a0 0x7fd5700af5f0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd55c067320 0x7fd55c0697d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 --2- 172.21.15.26:0/478944654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5700cd9e0 0x7fd570154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 >> 172.21.15.26:0/478944654 conn(0x7fd570070e30 msgr2=0x7fd5700cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 shutdown_connections 2023-10-09T11:44:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.764+0000 7fd575e46700 1 -- 172.21.15.26:0/478944654 wait complete. 2023-10-09T11:44:07.766 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:44:07.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:44:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.906+0000 7f84f702a700 1 Processor -- start 2023-10-09T11:44:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.906+0000 7f84f702a700 1 -- start start 2023-10-09T11:44:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f702a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84f00cb5a0 0x7f84f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f702a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f00cd9e0 0x7f84f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f702a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f015ae40 con 0x7f84f015a400 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f702a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f00d13f0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f702a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f015ab60 con 0x7f84f00cb5a0 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f00cd9e0 0x7f84f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f55c7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84f015a400 0x7f84f0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56666/0 (socket says 172.21.15.26:56666) 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84f00cd9e0 0x7f84f0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52418/0 (socket says 172.21.15.26:52418) 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f55c7700 1 -- 172.21.15.26:0/3426700020 learned_addr learned my addr 172.21.15.26:0/3426700020 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84f4dc6700 1 --2- 172.21.15.26:0/3426700020 >> v2:172.21.15.67:3300/0 conn(0x7f84f00cb5a0 0x7f84f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 -- 172.21.15.26:0/3426700020 >> v2:172.21.15.67:3300/0 conn(0x7f84f00cb5a0 msgr2=0x7f84f00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 --2- 172.21.15.26:0/3426700020 >> v2:172.21.15.67:3300/0 conn(0x7f84f00cb5a0 0x7f84f00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 -- 172.21.15.26:0/3426700020 >> v1:172.21.15.26:6789/0 conn(0x7f84f015a400 legacy=0x7f84f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 -- 172.21.15.26:0/3426700020 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00ccf00 con 0x7f84f00cd9e0 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84effff700 1 --2- 172.21.15.26:0/3426700020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f0159ec0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098e0 tx=0x7f84d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f239ee5fab2b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.907+0000 7f84ef7fe700 1 -- 172.21.15.26:0/3426700020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8009e80 con 0x7f84f00cd9e0 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84ef7fe700 1 -- 172.21.15.26:0/3426700020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d800b820 con 0x7f84f00cd9e0 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84ef7fe700 1 -- 172.21.15.26:0/3426700020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d800bba0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 -- 172.21.15.26:0/3426700020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 msgr2=0x7f84f0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 --2- 172.21.15.26:0/3426700020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f0159ec0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098e0 tx=0x7f84d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 -- 172.21.15.26:0/3426700020 shutdown_connections 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 --2- 172.21.15.26:0/3426700020 >> v2:172.21.15.67:3300/0 conn(0x7f84f00cb5a0 0x7f84f00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 --2- 172.21.15.26:0/3426700020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f0159ec0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 -- 172.21.15.26:0/3426700020 >> 172.21.15.26:0/3426700020 conn(0x7f84f0070e30 msgr2=0x7f84f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 -- 172.21.15.26:0/3426700020 shutdown_connections 2023-10-09T11:44:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.908+0000 7f84f702a700 1 -- 172.21.15.26:0/3426700020 wait complete. 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.909+0000 7f84f702a700 1 Processor -- start 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.909+0000 7f84f702a700 1 -- start start 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 0x7f84f0150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f015a400 0x7f84f015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0151ae0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f015fdd0 con 0x7f84f015a400 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f702a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0150aa0 con 0x7f84f00cb5a0 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52422/0 (socket says 172.21.15.26:52422) 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84effff700 1 -- 172.21.15.26:0/223588395 learned_addr learned my addr 172.21.15.26:0/223588395 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.910+0000 7f84f55c7700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f015a400 0x7f84f015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84f4dc6700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 0x7f84f0150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 -- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 msgr2=0x7f84f0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 0x7f84f0150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 -- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f015a400 msgr2=0x7f84f015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f015a400 0x7f84f015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 -- 172.21.15.26:0/223588395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8009420 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84f4dc6700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 0x7f84f0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84effff700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f84f006ea60 tx=0x7f84d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d800ba60 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8025420 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f015f1c0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80257e0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.911+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f015f780 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.912+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f004c3c0 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.913+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f84d8023070 con 0x7f84f00cd9e0 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.913+0000 7f84ecff9700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 0x7f84d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:07.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.913+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f84d8086080 con 0x7f84f00cd9e0 2023-10-09T11:44:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.913+0000 7f84f4dc6700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 0x7f84d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.914+0000 7f84f4dc6700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 0x7f84d00697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f84e000ab70 tx=0x7f84e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:07.918+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84d80b75a0 con 0x7f84f00cd9e0 2023-10-09T11:44:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.192+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f84f00cd1e0 con 0x7f84f00cd9e0 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.192+0000 7f84ecff9700 1 -- 172.21.15.26:0/223588395 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f84d8053060 con 0x7f84f00cd9e0 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:44:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:08.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.195 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:44:08.196 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.197 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:44:08.198 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.199 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:44:08.200 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:08.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.202 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.203 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:08.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.205 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:44:08.206 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:44:08.207 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.194+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 msgr2=0x7f84d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.194+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 0x7f84d00697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f84e000ab70 tx=0x7f84e0008040 comp rx=0 tx=0).stop 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.194+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 msgr2=0x7f84f015e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f84f006ea60 tx=0x7f84d8017000 comp rx=0 tx=0).stop 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 shutdown_connections 2023-10-09T11:44:08.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84f015a400 0x7f84f015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f84d0067320 0x7f84d00697d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84f00cb5a0 0x7f84f0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 --2- 172.21.15.26:0/223588395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84f00cd9e0 0x7f84f015e600 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 >> 172.21.15.26:0/223588395 conn(0x7f84f0070e30 msgr2=0x7f84f00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 shutdown_connections 2023-10-09T11:44:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.195+0000 7f84f702a700 1 -- 172.21.15.26:0/223588395 wait complete. 2023-10-09T11:44:08.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:08.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.327+0000 7f2b07571700 1 Processor -- start 2023-10-09T11:44:08.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.328+0000 7f2b07571700 1 -- start start 2023-10-09T11:44:08.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.328+0000 7f2b07571700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b000cb5a0 0x7f2b000cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.328+0000 7f2b07571700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0015a5d0 0x7f2b00156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b07571700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0015ae40 con 0x7f2b000cd9e0 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b07571700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000d13f0 con 0x7f2b000cb5a0 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b07571700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0015ab60 con 0x7f2b0015a5d0 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b000cb5a0 0x7f2b000cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b04b0c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2b000cd9e0 0x7f2b00159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56680/0 (socket says 172.21.15.26:56680) 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b04b0c700 1 -- 172.21.15.26:0/3928912365 learned_addr learned my addr 172.21.15.26:0/3928912365 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b05b0e700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0015a5d0 0x7f2b00156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 -- 172.21.15.26:0/3928912365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0015a5d0 msgr2=0x7f2b00156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0015a5d0 0x7f2b00156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 -- 172.21.15.26:0/3928912365 >> v1:172.21.15.26:6789/0 conn(0x7f2b000cd9e0 legacy=0x7f2b00159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2afffff700 1 -- 172.21.15.26:0/3928912365 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557578175 0 0) 0x7f2b0015ae40 con 0x7f2b000cd9e0 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 -- 172.21.15.26:0/3928912365 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000ccf00 con 0x7f2b000cb5a0 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2b0530d700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b000cb5a0 0x7f2b000cb970 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e90 tx=0x7f2af8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2ee1872efa925 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2afffff700 1 -- 172.21.15.26:0/3928912365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800e070 con 0x7f2b000cb5a0 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2afffff700 1 -- 172.21.15.26:0/3928912365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800bbf0 con 0x7f2b000cb5a0 2023-10-09T11:44:08.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.329+0000 7f2afffff700 1 -- 172.21.15.26:0/3928912365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8012430 con 0x7f2b000cb5a0 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 -- 172.21.15.26:0/3928912365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b000cb5a0 msgr2=0x7f2b000cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b000cb5a0 0x7f2b000cb970 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e90 tx=0x7f2af8009780 comp rx=0 tx=0).stop 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 -- 172.21.15.26:0/3928912365 shutdown_connections 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b0015a5d0 0x7f2b00156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 --2- 172.21.15.26:0/3928912365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b000cb5a0 0x7f2b000cb970 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 -- 172.21.15.26:0/3928912365 >> 172.21.15.26:0/3928912365 conn(0x7f2b00070e30 msgr2=0x7f2b000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:08.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 -- 172.21.15.26:0/3928912365 shutdown_connections 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.330+0000 7f2b07571700 1 -- 172.21.15.26:0/3928912365 wait complete. 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.331+0000 7f2b07571700 1 Processor -- start 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.331+0000 7f2b07571700 1 -- start start 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b000cb5a0 0x7f2b001512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b000cd9e0 0x7f2b000c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00152100 con 0x7f2b0015a5d0 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00151820 con 0x7f2b000cb5a0 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b07571700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000c8640 con 0x7f2b000cd9e0 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52432/0 (socket says 172.21.15.26:52432) 2023-10-09T11:44:08.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 -- 172.21.15.26:0/1016671057 learned_addr learned my addr 172.21.15.26:0/1016671057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b0530d700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b000cb5a0 0x7f2b001512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b04b0c700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b000cd9e0 0x7f2b000c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 -- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b000cd9e0 msgr2=0x7f2b000c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b000cd9e0 0x7f2b000c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 -- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b000cb5a0 msgr2=0x7f2b001512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b000cb5a0 0x7f2b001512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.332+0000 7f2b05b0e700 1 -- 172.21.15.26:0/1016671057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009a20 con 0x7f2b0015a5d0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2b05b0e700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e8d0 tx=0x7f2af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0013680 con 0x7f2b0015a5d0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af00137e0 con 0x7f2b0015a5d0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b000c8920 con 0x7f2b0015a5d0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0013ba0 con 0x7f2b0015a5d0 2023-10-09T11:44:08.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.333+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b001532a0 con 0x7f2b0015a5d0 2023-10-09T11:44:08.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.334+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0004c3c0 con 0x7f2b0015a5d0 2023-10-09T11:44:08.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.334+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2af00123d0 con 0x7f2b0015a5d0 2023-10-09T11:44:08.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.334+0000 7f2afd7fa700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 0x7f2aec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.335+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2af0084a30 con 0x7f2b0015a5d0 2023-10-09T11:44:08.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.335+0000 7f2b0530d700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 0x7f2aec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.335+0000 7f2b0530d700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 0x7f2aec0697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097c0 tx=0x7f2af8019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.339+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2af0051a10 con 0x7f2b0015a5d0 2023-10-09T11:44:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.535+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0015e140 con 0x7f2b0015a5d0 2023-10-09T11:44:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.536+0000 7f2afd7fa700 1 -- 172.21.15.26:0/1016671057 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f2af0055030 con 0x7f2b0015a5d0 2023-10-09T11:44:08.537 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:08.537 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":179,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:07.758014+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 msgr2=0x7f2aec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 0x7f2aec0697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097c0 tx=0x7f2af8019000 comp rx=0 tx=0).stop 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 msgr2=0x7f2b001523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e8d0 tx=0x7f2af00091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 shutdown_connections 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b0015a5d0 0x7f2b001523e0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b000cb5a0 0x7f2b001512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2aec067320 0x7f2aec0697d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 --2- 172.21.15.26:0/1016671057 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b000cd9e0 0x7f2b000c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 >> 172.21.15.26:0/1016671057 conn(0x7f2b00070e30 msgr2=0x7f2b000b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 shutdown_connections 2023-10-09T11:44:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.538+0000 7f2b07571700 1 -- 172.21.15.26:0/1016671057 wait complete. 2023-10-09T11:44:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:44:08.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:44:08.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.672+0000 7feb12e7b700 1 Processor -- start 2023-10-09T11:44:08.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 -- start start 2023-10-09T11:44:08.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb0c157a40 0x7feb0c0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feb0c0afa30 0x7feb0c06c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c0afea0 con 0x7feb0c06cc50 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c06bbe0 con 0x7feb0c157a40 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb12e7b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c06afd0 con 0x7feb0c0afa30 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.673+0000 7feb10c17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb0c157a40 0x7feb0c0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb0c157a40 0x7feb0c0af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52434/0 (socket says 172.21.15.26:52434) 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 -- 172.21.15.26:0/930443831 learned_addr learned my addr 172.21.15.26:0/930443831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb0bfff700 1 --2- 172.21.15.26:0/930443831 >> v2:172.21.15.67:3300/0 conn(0x7feb0c0afa30 0x7feb0c06c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 -- 172.21.15.26:0/930443831 >> v2:172.21.15.67:3300/0 conn(0x7feb0c0afa30 msgr2=0x7feb0c06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 --2- 172.21.15.26:0/930443831 >> v2:172.21.15.67:3300/0 conn(0x7feb0c0afa30 0x7feb0c06c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 -- 172.21.15.26:0/930443831 >> v1:172.21.15.67:6789/0 conn(0x7feb0c06cc50 legacy=0x7feb0c0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 -- 172.21.15.26:0/930443831 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c06b2b0 con 0x7feb0c157a40 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb10c17700 1 --2- 172.21.15.26:0/930443831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c157a40 0x7feb0c0af4f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7feb0c06c340 tx=0x7feb04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656c37e331e300e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb0b7fe700 1 -- 172.21.15.26:0/930443831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400b820 con 0x7feb0c157a40 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb0b7fe700 1 -- 172.21.15.26:0/930443831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400b980 con 0x7feb0c157a40 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.674+0000 7feb0b7fe700 1 -- 172.21.15.26:0/930443831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400bd20 con 0x7feb0c157a40 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 -- 172.21.15.26:0/930443831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c157a40 msgr2=0x7feb0c0af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 --2- 172.21.15.26:0/930443831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c157a40 0x7feb0c0af4f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7feb0c06c340 tx=0x7feb04009250 comp rx=0 tx=0).stop 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 -- 172.21.15.26:0/930443831 shutdown_connections 2023-10-09T11:44:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 --2- 172.21.15.26:0/930443831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c157a40 0x7feb0c0af4f0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 --2- 172.21.15.26:0/930443831 >> v2:172.21.15.67:3300/0 conn(0x7feb0c0afa30 0x7feb0c06c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 -- 172.21.15.26:0/930443831 >> 172.21.15.26:0/930443831 conn(0x7feb0c06e250 msgr2=0x7feb0c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 -- 172.21.15.26:0/930443831 shutdown_connections 2023-10-09T11:44:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.675+0000 7feb12e7b700 1 -- 172.21.15.26:0/930443831 wait complete. 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.676+0000 7feb12e7b700 1 Processor -- start 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.676+0000 7feb12e7b700 1 -- start start 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 0x7feb0c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb0c157a40 0x7feb0c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c14a6d0 con 0x7feb0c06cc50 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0b15c0 con 0x7feb0c0afa30 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb12e7b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0b09e0 con 0x7feb0c157a40 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52438/0 (socket says 172.21.15.26:52438) 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 -- 172.21.15.26:0/1947097967 learned_addr learned my addr 172.21.15.26:0/1947097967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb0bfff700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 0x7feb0c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 -- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb0c157a40 msgr2=0x7feb0c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb11418700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb0c157a40 0x7feb0c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb0c157a40 0x7feb0c14a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 -- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 msgr2=0x7feb0c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 0x7feb0c0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 -- 172.21.15.26:0/1947097967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040094f0 con 0x7feb0c06cc50 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb0bfff700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 0x7feb0c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb10c17700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7feb04009290 tx=0x7feb04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.677+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04011e20 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.678+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04020070 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.678+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0401b6a0 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.678+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c0b0cc0 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.678+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c0b1280 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.678+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c04c3c0 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.679+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb04022030 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.679+0000 7feb08ff9700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 0x7feaec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.679+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feb04086760 con 0x7feb0c06cc50 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.680+0000 7feb0bfff700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 0x7feaec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.680+0000 7feb0bfff700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 0x7feaec0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0b3320 tx=0x7feafc0075e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.684+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb04053810 con 0x7feb0c06cc50 2023-10-09T11:44:08.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.876+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb0c04c3c0 con 0x7feb0c06cc50 2023-10-09T11:44:08.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.876+0000 7feb08ff9700 1 -- 172.21.15.26:0/1947097967 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb04056e30 con 0x7feb0c06cc50 2023-10-09T11:44:08.876 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 msgr2=0x7feaec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 0x7feaec0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0b3320 tx=0x7feafc0075e0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 msgr2=0x7feb0c0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7feb04009290 tx=0x7feb04016000 comp rx=0 tx=0).stop 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 shutdown_connections 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7feaec067320 0x7feaec0697d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb0c157a40 0x7feb0c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb0c06cc50 0x7feb0c0b0320 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 --2- 172.21.15.26:0/1947097967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb0c0afa30 0x7feb0c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:08.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 >> 172.21.15.26:0/1947097967 conn(0x7feb0c06e250 msgr2=0x7feb0c0c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:08.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 shutdown_connections 2023-10-09T11:44:08.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:08.878+0000 7feb12e7b700 1 -- 172.21.15.26:0/1947097967 wait complete. 2023-10-09T11:44:08.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:44:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.010+0000 7fd9a9fee700 1 Processor -- start 2023-10-09T11:44:09.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.010+0000 7fd9a9fee700 1 -- start start 2023-10-09T11:44:09.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a9fee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd9a40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a9fee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40adb20 con 0x7fd9a40b1040 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a9fee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40acf10 con 0x7fd9a4159c20 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a9fee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ccdc0 con 0x7fd9a4159850 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd9a40b1040 0x7fd9a40c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56692/0 (socket says 172.21.15.26:56692) 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a3fff700 1 -- 172.21.15.26:0/2825694859 learned_addr learned my addr 172.21.15.26:0/2825694859 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380110743 0 0) 0x7fd9a40adb20 con 0x7fd9a40b1040 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd990003570 con 0x7fd9a40b1040 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd9a40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836757832 0 0) 0x7fd990003570 con 0x7fd9a40b1040 2023-10-09T11:44:09.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 msgr2=0x7fd9a40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd9a40adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 >> v1:172.21.15.67:6789/0 conn(0x7fd9a4159c20 legacy=0x7fd9a40b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40ad1f0 con 0x7fd9a40b1040 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd99c0017f0 con 0x7fd9a40b1040 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 >> v1:172.21.15.26:6789/0 conn(0x7fd9a40b1040 legacy=0x7fd9a40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd990003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd990004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd990004d50 0x7fd9900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ccdc0 con 0x7fd990004010 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990010070 con 0x7fd990004d50 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900101b0 con 0x7fd9a4159850 2023-10-09T11:44:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.011+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd990004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a3fff700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd990004d50 0x7fd9900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd990003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 -- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 msgr2=0x7fd990003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd990003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 -- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd990004d50 msgr2=0x7fd9900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd990004d50 0x7fd9900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 -- 172.21.15.26:0/2825694859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990003570 con 0x7fd990004010 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4159850 0x7fd990003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a3fff700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd990004d50 0x7fd9900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd990004810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd9940018b0 tx=0x7fd994007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dd9dcba1d2d368 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994012420 con 0x7fd990004010 2023-10-09T11:44:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994012580 con 0x7fd990004010 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.012+0000 7fd9a27fc700 1 -- 172.21.15.26:0/2825694859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994012920 con 0x7fd990004010 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2825694859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 msgr2=0x7fd990004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2825694859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd990004810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd9940018b0 tx=0x7fd994007d30 comp rx=0 tx=0).stop 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a3fff700 1 -- 172.21.15.26:0/2825694859 reap_dead start 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2825694859 shutdown_connections 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2825694859 >> 172.21.15.26:0/2825694859 conn(0x7fd9a406d170 msgr2=0x7fd9a40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2825694859 shutdown_connections 2023-10-09T11:44:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.013+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2825694859 wait complete. 2023-10-09T11:44:09.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.014+0000 7fd9a9fee700 1 Processor -- start 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.014+0000 7fd9a9fee700 1 -- start start 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a4150430 0x7fd9a414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a414f5d0 0x7fd9a414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41527c0 con 0x7fd990004010 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4152aa0 con 0x7fd9a4150430 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4152d80 con 0x7fd9a414f5d0 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52444/0 (socket says 172.21.15.26:52444) 2023-10-09T11:44:09.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 -- 172.21.15.26:0/2015970512 learned_addr learned my addr 172.21.15.26:0/2015970512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 -- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a414f5d0 msgr2=0x7fd9a414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a414f5d0 0x7fd9a414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 -- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a4150430 msgr2=0x7fd9a414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a4150430 0x7fd9a414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a4150430 0x7fd9a414f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 -- 172.21.15.26:0/2015970512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4153060 con 0x7fd990004010 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a37fe700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0118e0 tx=0x7fd98c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c011e80 con 0x7fd990004010 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c00f970 con 0x7fd990004010 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c00fd10 con 0x7fd990004010 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a414d260 con 0x7fd990004010 2023-10-09T11:44:09.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.015+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a414ccb0 con 0x7fd990004010 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.016+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a404c3c0 con 0x7fd990004010 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.017+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd98c015670 con 0x7fd990004010 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.017+0000 7fd99b7fe700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 0x7fd984069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.017+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd98c085260 con 0x7fd990004010 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.017+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 0x7fd984069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.018+0000 7fd9a2ffd700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 0x7fd984069800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4150880 tx=0x7fd994015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.022+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd98c055cd0 con 0x7fd990004010 2023-10-09T11:44:09.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.215+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd9a41531f0 con 0x7fd990004010 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.215+0000 7fd99b7fe700 1 -- 172.21.15.26:0/2015970512 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v179) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd98c055860 con 0x7fd990004010 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:09.216 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 msgr2=0x7fd984069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 0x7fd984069800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4150880 tx=0x7fd994015000 comp rx=0 tx=0).stop 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 msgr2=0x7fd9a414c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0118e0 tx=0x7fd98c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 shutdown_connections 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd984067350 0x7fd984069800 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a414f5d0 0x7fd9a414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd990004010 0x7fd9a414c5b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 --2- 172.21.15.26:0/2015970512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a4150430 0x7fd9a414f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 >> 172.21.15.26:0/2015970512 conn(0x7fd9a406d170 msgr2=0x7fd9a40afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 shutdown_connections 2023-10-09T11:44:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.217+0000 7fd9a9fee700 1 -- 172.21.15.26:0/2015970512 wait complete. 2023-10-09T11:44:09.230 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:44:09.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:44:09.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.353+0000 7f1ecb952700 1 Processor -- start 2023-10-09T11:44:09.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 -- start start 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ec415de80 0x7f1ec4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec40c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec415d9f0 con 0x7f1ec4067e50 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec415d3c0 con 0x7f1ec415de80 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.354+0000 7f1ecb952700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec415a8f0 con 0x7f1ec415a300 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec96ee700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1ec4067e50 0x7f1ec4068220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56708/0 (socket says 172.21.15.26:56708) 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec96ee700 1 -- 172.21.15.26:0/1022912891 learned_addr learned my addr 172.21.15.26:0/1022912891 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 --2- 172.21.15.26:0/1022912891 >> v2:172.21.15.67:3300/0 conn(0x7f1ec415de80 0x7f1ec4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec9eef700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec40c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec3fff700 1 -- 172.21.15.26:0/1022912891 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896078086 0 0) 0x7f1ec415d9f0 con 0x7f1ec4067e50 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec3fff700 1 -- 172.21.15.26:0/1022912891 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eac003570 con 0x7f1ec4067e50 2023-10-09T11:44:09.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 -- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 msgr2=0x7f1ec40c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec40c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 -- 172.21.15.26:0/1022912891 >> v1:172.21.15.26:6789/0 conn(0x7f1ec4067e50 legacy=0x7f1ec4068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 -- 172.21.15.26:0/1022912891 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec415abd0 con 0x7f1ec415de80 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.355+0000 7f1ec8eed700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec415de80 0x7f1ec4159dc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80098e0 tx=0x7f1eb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adfc86be83fe27f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ec3fff700 1 -- 172.21.15.26:0/1022912891 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8011630 con 0x7f1ec415de80 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ec3fff700 1 -- 172.21.15.26:0/1022912891 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8011790 con 0x7f1ec415de80 2023-10-09T11:44:09.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ec3fff700 1 -- 172.21.15.26:0/1022912891 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8011b30 con 0x7f1ec415de80 2023-10-09T11:44:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 -- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec415de80 msgr2=0x7f1ec4159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec415de80 0x7f1ec4159dc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80098e0 tx=0x7f1eb80091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 -- 172.21.15.26:0/1022912891 shutdown_connections 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec40c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 --2- 172.21.15.26:0/1022912891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec415de80 0x7f1ec4159dc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 -- 172.21.15.26:0/1022912891 >> 172.21.15.26:0/1022912891 conn(0x7f1ec40ce4a0 msgr2=0x7f1ec40ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 -- 172.21.15.26:0/1022912891 shutdown_connections 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.356+0000 7f1ecb952700 1 -- 172.21.15.26:0/1022912891 wait complete. 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.357+0000 7f1ecb952700 1 Processor -- start 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.357+0000 7f1ecb952700 1 -- start start 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec4067e50 0x7f1ec40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec406da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40c2370 con 0x7f1ec415de80 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40c2650 con 0x7f1ec4067e50 2023-10-09T11:44:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ecb952700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40c2930 con 0x7f1ec415a300 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec9eef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec9eef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52450/0 (socket says 172.21.15.26:52450) 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec9eef700 1 -- 172.21.15.26:0/2775130088 learned_addr learned my addr 172.21.15.26:0/2775130088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec96ee700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec4067e50 0x7f1ec40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec8eed700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec9eef700 1 -- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 msgr2=0x7f1ec406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.358+0000 7f1ec9eef700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec406da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec9eef700 1 -- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec4067e50 msgr2=0x7f1ec40c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec9eef700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec4067e50 0x7f1ec40c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec9eef700 1 -- 172.21.15.26:0/2775130088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8009420 con 0x7f1ec415de80 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec9eef700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e8d0 tx=0x7f1eb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400ee70 con 0x7f1ec415de80 2023-10-09T11:44:09.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb400c850 con 0x7f1ec415de80 2023-10-09T11:44:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec40c2c10 con 0x7f1ec415de80 2023-10-09T11:44:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400cc50 con 0x7f1ec415de80 2023-10-09T11:44:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.359+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec406df40 con 0x7f1ec415de80 2023-10-09T11:44:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.360+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec406e160 con 0x7f1ec415de80 2023-10-09T11:44:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.360+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1eb4013680 con 0x7f1ec415de80 2023-10-09T11:44:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.361+0000 7f1ec17fa700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 0x7f1eb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.361+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1eb4084ae0 con 0x7f1ec415de80 2023-10-09T11:44:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.361+0000 7f1ec96ee700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 0x7f1eb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.361+0000 7f1ec96ee700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 0x7f1eb00697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005c50 tx=0x7f1ebc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:09.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.365+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb4051ac0 con 0x7f1ec415de80 2023-10-09T11:44:09.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:09.557+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1ec41543f0 con 0x7f1ec415de80 2023-10-09T11:44:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.235+0000 7f1ec17fa700 1 -- 172.21.15.26:0/2775130088 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v180) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ec41543f0 con 0x7f1ec415de80 2023-10-09T11:44:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 msgr2=0x7f1eb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 0x7f1eb00697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005c50 tx=0x7f1ebc009040 comp rx=0 tx=0).stop 2023-10-09T11:44:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 msgr2=0x7f1ec41516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e8d0 tx=0x7f1eb40091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 shutdown_connections 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ec415de80 0x7f1ec41516b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ec4067e50 0x7f1ec40c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1eb0067320 0x7f1eb00697d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 --2- 172.21.15.26:0/2775130088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ec415a300 0x7f1ec406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 >> 172.21.15.26:0/2775130088 conn(0x7f1ec40ce4a0 msgr2=0x7f1ec41598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 shutdown_connections 2023-10-09T11:44:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.239+0000 7f1ecb952700 1 -- 172.21.15.26:0/2775130088 wait complete. 2023-10-09T11:44:10.243 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:44:10.256 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:44:10.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.387+0000 7fc11cfa9700 1 Processor -- start 2023-10-09T11:44:10.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.387+0000 7fc11cfa9700 1 -- start start 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11cfa9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11cfa9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1180ccfd0 con 0x7fc11806dc70 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11cfa9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1180cf0e0 con 0x7fc11806e0e0 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11cfa9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815a3d0 con 0x7fc118159530 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc115d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc11806dc70 0x7fc118159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56978/0 (socket says 172.21.15.26:56978) 2023-10-09T11:44:10.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc115d9b700 1 -- 172.21.15.26:0/2896443603 learned_addr learned my addr 172.21.15.26:0/2896443603 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956154753 0 0) 0x7fc1180ccfd0 con 0x7fc11806dc70 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc104003570 con 0x7fc11806dc70 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.388+0000 7fc11659c700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2501180079 0 0) 0x7fc104003570 con 0x7fc11806dc70 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 msgr2=0x7fc1180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1180ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 >> v1:172.21.15.67:6789/0 conn(0x7fc11806e0e0 legacy=0x7fc1180cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11815a6b0 con 0x7fc11806dc70 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fc100001470 con 0x7fc11806dc70 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 >> v1:172.21.15.26:6789/0 conn(0x7fc11806dc70 legacy=0x7fc118159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104003a90 0x7fc104003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc104004810 0x7fc104004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1040051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815a3d0 con 0x7fc104004810 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10400bb60 con 0x7fc104003a90 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10400bd20 con 0x7fc118159530 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc104004810 0x7fc104004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc116d9d700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1040051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc11659c700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104003a90 0x7fc104003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 -- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 msgr2=0x7fc1040051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118159530 0x7fc1040051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 -- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104003a90 msgr2=0x7fc104003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:10.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104003a90 0x7fc104003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 -- 172.21.15.26:0/2896443603 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104003570 con 0x7fc104004810 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.389+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc104004810 0x7fc104004c80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c3c0 tx=0x7fc100001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d98876b1b638796 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000cc90 con 0x7fc104004810 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000cdf0 con 0x7fc104004810 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11559a700 1 -- 172.21.15.26:0/2896443603 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100005b50 con 0x7fc104004810 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2896443603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc104004810 msgr2=0x7fc104004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2896443603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc104004810 0x7fc104004c80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c3c0 tx=0x7fc100001e50 comp rx=0 tx=0).stop 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc116d9d700 1 -- 172.21.15.26:0/2896443603 reap_dead start 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2896443603 shutdown_connections 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2896443603 >> 172.21.15.26:0/2896443603 conn(0x7fc1180703a0 msgr2=0x7fc1180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2896443603 shutdown_connections 2023-10-09T11:44:10.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.390+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2896443603 wait complete. 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.391+0000 7fc11cfa9700 1 Processor -- start 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.391+0000 7fc11cfa9700 1 -- start start 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104004810 0x7fc1180b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118147d00 0x7fc118148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180d0550 con 0x7fc1181551a0 2023-10-09T11:44:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180d1310 con 0x7fc104004810 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11cfa9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180d0740 con 0x7fc118147d00 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40146/0 (socket says 172.21.15.26:40146) 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 -- 172.21.15.26:0/2761843075 learned_addr learned my addr 172.21.15.26:0/2761843075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc11659c700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104004810 0x7fc1180b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc116d9d700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118147d00 0x7fc118148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 -- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118147d00 msgr2=0x7fc118148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118147d00 0x7fc118148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 -- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104004810 msgr2=0x7fc1180b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104004810 0x7fc1180b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.392+0000 7fc115d9b700 1 -- 172.21.15.26:0/2761843075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180b6510 con 0x7fc1181551a0 2023-10-09T11:44:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc115d9b700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc10400bb30 tx=0x7fc100015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000070d0 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100007250 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100007610 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1180d09e0 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.393+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1180d0fa0 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.394+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1180d16a0 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.394+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc100019030 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.395+0000 7fc10e7fc700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 0x7fc0f8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.395+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fc100085e00 con 0x7fc1181551a0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.395+0000 7fc11659c700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 0x7fc0f8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.396+0000 7fc11659c700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 0x7fc0f8069800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc110006f00 tx=0x7fc1100091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.399+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1180d16a0 con 0x7fc1181551a0 2023-10-09T11:44:10.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:10.592+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc1180d16a0 con 0x7fc1181551a0 2023-10-09T11:44:11.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.238+0000 7fc10e7fc700 1 -- 172.21.15.26:0/2761843075 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v181) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc1180d16a0 con 0x7fc1181551a0 2023-10-09T11:44:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.246+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 msgr2=0x7fc0f8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.246+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 0x7fc0f8069800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc110006f00 tx=0x7fc1100091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.246+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 msgr2=0x7fc1180b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.246+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc10400bb30 tx=0x7fc100015000 comp rx=0 tx=0).stop 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 shutdown_connections 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc0f8067350 0x7fc0f8069800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc118147d00 0x7fc118148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc104004810 0x7fc1180b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 --2- 172.21.15.26:0/2761843075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1181551a0 0x7fc1180b40e0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.248+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 >> 172.21.15.26:0/2761843075 conn(0x7fc1180703a0 msgr2=0x7fc1180cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.251+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 shutdown_connections 2023-10-09T11:44:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.251+0000 7fc11cfa9700 1 -- 172.21.15.26:0/2761843075 wait complete. 2023-10-09T11:44:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:44:11.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:44:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.394+0000 7f9ba69d9700 1 Processor -- start 2023-10-09T11:44:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.394+0000 7f9ba69d9700 1 -- start start 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba69d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ba0159530 0x7f9ba00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba69d9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9ba006e0e0 0x7f9ba00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba69d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba00ccfd0 con 0x7f9ba006dc70 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba69d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba00cf0e0 con 0x7f9ba0159530 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba69d9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba015a3d0 con 0x7f9ba006e0e0 2023-10-09T11:44:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ba0159530 0x7f9ba00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9ba006dc70 0x7f9ba0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56986/0 (socket says 172.21.15.26:56986) 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ba0159530 0x7f9ba00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40162/0 (socket says 172.21.15.26:40162) 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9f7fe700 1 -- 172.21.15.26:0/2776808610 learned_addr learned my addr 172.21.15.26:0/2776808610 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9ba4f76700 1 --2- 172.21.15.26:0/2776808610 >> v2:172.21.15.67:3300/0 conn(0x7f9ba006e0e0 0x7f9ba00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9ffff700 1 -- 172.21.15.26:0/2776808610 >> v2:172.21.15.67:3300/0 conn(0x7f9ba006e0e0 msgr2=0x7f9ba00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/2776808610 >> v2:172.21.15.67:3300/0 conn(0x7f9ba006e0e0 0x7f9ba00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9ffff700 1 -- 172.21.15.26:0/2776808610 >> v1:172.21.15.26:6789/0 conn(0x7f9ba006dc70 legacy=0x7f9ba0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9b9ffff700 1 -- 172.21.15.26:0/2776808610 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba015a6b0 con 0x7f9ba0159530 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.395+0000 7f9b9effd700 1 -- 172.21.15.26:0/2776808610 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201454684 0 0) 0x7f9ba00ccfd0 con 0x7f9ba006dc70 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/2776808610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00ceba0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00caef0 tx=0x7f9b900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79662339db8ea189 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9b9effd700 1 -- 172.21.15.26:0/2776808610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90011630 con 0x7f9ba0159530 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9b9effd700 1 -- 172.21.15.26:0/2776808610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90011790 con 0x7f9ba0159530 2023-10-09T11:44:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9b9effd700 1 -- 172.21.15.26:0/2776808610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90011b30 con 0x7f9ba0159530 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 -- 172.21.15.26:0/2776808610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 msgr2=0x7f9ba00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/2776808610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00ceba0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00caef0 tx=0x7f9b900091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 -- 172.21.15.26:0/2776808610 shutdown_connections 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/2776808610 >> v2:172.21.15.67:3300/0 conn(0x7f9ba006e0e0 0x7f9ba00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/2776808610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00ceba0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 -- 172.21.15.26:0/2776808610 >> 172.21.15.26:0/2776808610 conn(0x7f9ba00703a0 msgr2=0x7f9ba00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 -- 172.21.15.26:0/2776808610 shutdown_connections 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.396+0000 7f9ba69d9700 1 -- 172.21.15.26:0/2776808610 wait complete. 2023-10-09T11:44:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 Processor -- start 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 -- start start 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 0x7f9ba0153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ba006e0e0 0x7f9ba014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00b39f0 con 0x7f9ba0159530 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00b3cd0 con 0x7f9ba006dc70 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.398+0000 7f9ba69d9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00b3fb0 con 0x7f9ba006e0e0 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40176/0 (socket says 172.21.15.26:40176) 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 -- 172.21.15.26:0/212413054 learned_addr learned my addr 172.21.15.26:0/212413054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 0x7f9ba0153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b9f7fe700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ba006e0e0 0x7f9ba014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 -- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ba006e0e0 msgr2=0x7f9ba014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ba006e0e0 0x7f9ba014e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 -- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 msgr2=0x7f9ba0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 0x7f9ba0153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 -- 172.21.15.26:0/212413054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009420 con 0x7f9ba0159530 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 0x7f9ba0153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba4f76700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009e90 tx=0x7f9b9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800cb70 con 0x7f9ba0159530 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9800f040 con 0x7f9ba0159530 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98014480 con 0x7f9ba0159530 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba00b4290 con 0x7f9ba0159530 2023-10-09T11:44:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.399+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba01539d0 con 0x7f9ba0159530 2023-10-09T11:44:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.400+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba00b47b0 con 0x7f9ba0159530 2023-10-09T11:44:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.401+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9b98014830 con 0x7f9ba0159530 2023-10-09T11:44:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.401+0000 7f9b97fff700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 0x7f9b800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.401+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9b980855f0 con 0x7f9ba0159530 2023-10-09T11:44:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.401+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 0x7f9b800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.402+0000 7f9b9ffff700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 0x7f9b800697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097b0 tx=0x7f9b90017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.406+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b980522d0 con 0x7f9ba0159530 2023-10-09T11:44:11.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:11.645+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9ba004c3c0 con 0x7f9ba0159530 2023-10-09T11:44:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.289+0000 7f9b97fff700 1 -- 172.21.15.26:0/212413054 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v116) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9b980558f0 con 0x7f9ba0159530 2023-10-09T11:44:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 msgr2=0x7f9b800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 0x7f9b800697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097b0 tx=0x7f9b90017000 comp rx=0 tx=0).stop 2023-10-09T11:44:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 msgr2=0x7f9ba00cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009e90 tx=0x7f9b9800b040 comp rx=0 tx=0).stop 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 shutdown_connections 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba0159530 0x7f9ba00cd460 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba006dc70 0x7f9ba0153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9b80067320 0x7f9b800697d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 --2- 172.21.15.26:0/212413054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9ba006e0e0 0x7f9ba014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.293+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 >> 172.21.15.26:0/212413054 conn(0x7f9ba00703a0 msgr2=0x7f9ba015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:12.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.294+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 shutdown_connections 2023-10-09T11:44:12.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.295+0000 7f9ba69d9700 1 -- 172.21.15.26:0/212413054 wait complete. 2023-10-09T11:44:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 31 and data pool 32 2023-10-09T11:44:12.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:12.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.431+0000 7f4943fef700 1 Processor -- start 2023-10-09T11:44:12.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.431+0000 7f4943fef700 1 -- start start 2023-10-09T11:44:12.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4943fef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f493c0cb5a0 0x7f493c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4943fef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4943fef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c15ae40 con 0x7f493c0cd9e0 2023-10-09T11:44:12.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4943fef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0d13f0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4943fef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15ab60 con 0x7f493c15a5d0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4941d8b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f493c0cb5a0 0x7f493c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4941d8b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f493c0cb5a0 0x7f493c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40180/0 (socket says 172.21.15.26:40180) 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f4941d8b700 1 -- 172.21.15.26:0/2344863914 learned_addr learned my addr 172.21.15.26:0/2344863914 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.432+0000 7f494258c700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4941d8b700 1 -- 172.21.15.26:0/2344863914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 msgr2=0x7f493c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4941d8b700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4941d8b700 1 -- 172.21.15.26:0/2344863914 >> v1:172.21.15.67:6789/0 conn(0x7f493c0cd9e0 legacy=0x7f493c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4941d8b700 1 -- 172.21.15.26:0/2344863914 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0ccf00 con 0x7f493c0cb5a0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4941d8b700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c0cb970 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f49340099e0 tx=0x7f4934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bf593469f5fd9c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4940d89700 1 -- 172.21.15.26:0/2344863914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400b820 con 0x7f493c0cb5a0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4940d89700 1 -- 172.21.15.26:0/2344863914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b980 con 0x7f493c0cb5a0 2023-10-09T11:44:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4940d89700 1 -- 172.21.15.26:0/2344863914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bd20 con 0x7f493c0cb5a0 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 -- 172.21.15.26:0/2344863914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 msgr2=0x7f493c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c0cb970 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f49340099e0 tx=0x7f4934009250 comp rx=0 tx=0).stop 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 -- 172.21.15.26:0/2344863914 shutdown_connections 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 --2- 172.21.15.26:0/2344863914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c0cb970 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.433+0000 7f4943fef700 1 -- 172.21.15.26:0/2344863914 >> 172.21.15.26:0/2344863914 conn(0x7f493c070e30 msgr2=0x7f493c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.434+0000 7f4943fef700 1 -- 172.21.15.26:0/2344863914 shutdown_connections 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.434+0000 7f4943fef700 1 -- 172.21.15.26:0/2344863914 wait complete. 2023-10-09T11:44:12.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 Processor -- start 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 -- start start 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 0x7f493c16a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c16c100 con 0x7f493c0cb5a0 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c16aed0 con 0x7f493c0cd9e0 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.435+0000 7f4943fef700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c158ff0 con 0x7f493c15a5d0 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40188/0 (socket says 172.21.15.26:40188) 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 -- 172.21.15.26:0/2044918616 learned_addr learned my addr 172.21.15.26:0/2044918616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f494158a700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 0x7f493c16a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 -- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 msgr2=0x7f493c158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f494258c700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 -- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 msgr2=0x7f493c16a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 0x7f493c16a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 -- 172.21.15.26:0/2044918616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340094f0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f494158a700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 0x7f493c16a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4941d8b700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f493c06ea60 tx=0x7f4934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934011e70 con 0x7f493c0cb5a0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934026450 con 0x7f493c0cb5a0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c16b4f0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934026830 con 0x7f493c0cb5a0 2023-10-09T11:44:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.436+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c16bab0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.437+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c04c3c0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.438+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f493401a420 con 0x7f493c0cb5a0 2023-10-09T11:44:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.438+0000 7f4939ffb700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 0x7f49280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.438+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4934086a00 con 0x7f493c0cb5a0 2023-10-09T11:44:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.438+0000 7f494158a700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 0x7f49280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.439+0000 7f494158a700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 0x7f49280697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f493c0cab90 tx=0x7f4930009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.443+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49340536d0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.637+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f493c0cd1e0 con 0x7f493c0cb5a0 2023-10-09T11:44:12.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.638+0000 7f4939ffb700 1 -- 172.21.15.26:0/2044918616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f4934015090 con 0x7f493c0cb5a0 2023-10-09T11:44:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:12.639 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":182,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:11.646245+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:10.623231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.640+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 msgr2=0x7f49280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.640+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 0x7f49280697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f493c0cab90 tx=0x7f4930009040 comp rx=0 tx=0).stop 2023-10-09T11:44:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 msgr2=0x7f493c156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f493c06ea60 tx=0x7f4934017000 comp rx=0 tx=0).stop 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 shutdown_connections 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4928067320 0x7f49280697d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f493c15a5d0 0x7f493c158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493c0cb5a0 0x7f493c156c60 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 --2- 172.21.15.26:0/2044918616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f493c0cd9e0 0x7f493c16a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 >> 172.21.15.26:0/2044918616 conn(0x7f493c070e30 msgr2=0x7f493c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 shutdown_connections 2023-10-09T11:44:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.641+0000 7f4943fef700 1 -- 172.21.15.26:0/2044918616 wait complete. 2023-10-09T11:44:12.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:12.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.771+0000 7f4650809700 1 Processor -- start 2023-10-09T11:44:12.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.771+0000 7f4650809700 1 -- start start 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f4650809700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f464c0cb970 0x7f464c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f4650809700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c15ae40 con 0x7f464c0cb5a0 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f4650809700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c15ab60 con 0x7f464c15a400 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f4650809700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0ce0f0 con 0x7f464c0cb970 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f4649d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f464c0cb970 0x7f464c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.772+0000 7f464a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f464c0cb5a0 0x7f464c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56988/0 (socket says 172.21.15.26:56988) 2023-10-09T11:44:12.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f464a59c700 1 -- 172.21.15.26:0/1184282901 learned_addr learned my addr 172.21.15.26:0/1184282901 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:12.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f4649d9b700 1 -- 172.21.15.26:0/1184282901 >> v1:172.21.15.67:6789/0 conn(0x7f464c15a400 legacy=0x7f464c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:12.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f4649d9b700 1 -- 172.21.15.26:0/1184282901 >> v1:172.21.15.26:6789/0 conn(0x7f464c0cb5a0 legacy=0x7f464c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f4649d9b700 1 -- 172.21.15.26:0/1184282901 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0ccf00 con 0x7f464c0cb970 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f464959a700 1 -- 172.21.15.26:0/1184282901 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810313368 0 0) 0x7f464c15ae40 con 0x7f464c0cb5a0 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f4649d9b700 1 --2- 172.21.15.26:0/1184282901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb970 0x7f464c159ec0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f46340098e0 tx=0x7f46340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edf2823de0dd0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f464959a700 1 -- 172.21.15.26:0/1184282901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634009e80 con 0x7f464c0cb970 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f464959a700 1 -- 172.21.15.26:0/1184282901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400b820 con 0x7f464c0cb970 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.773+0000 7f464959a700 1 -- 172.21.15.26:0/1184282901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400bba0 con 0x7f464c0cb970 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 -- 172.21.15.26:0/1184282901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb970 msgr2=0x7f464c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 --2- 172.21.15.26:0/1184282901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb970 0x7f464c159ec0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f46340098e0 tx=0x7f46340091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 -- 172.21.15.26:0/1184282901 shutdown_connections 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 --2- 172.21.15.26:0/1184282901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb970 0x7f464c159ec0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 -- 172.21.15.26:0/1184282901 >> 172.21.15.26:0/1184282901 conn(0x7f464c070e30 msgr2=0x7f464c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:12.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 -- 172.21.15.26:0/1184282901 shutdown_connections 2023-10-09T11:44:12.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.774+0000 7f4650809700 1 -- 172.21.15.26:0/1184282901 wait complete. 2023-10-09T11:44:12.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.775+0000 7f4650809700 1 Processor -- start 2023-10-09T11:44:12.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.775+0000 7f4650809700 1 -- start start 2023-10-09T11:44:12.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.775+0000 7f4650809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.775+0000 7f4650809700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f464c0cb970 0x7f464c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464c15a400 0x7f464c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c152ec0 con 0x7f464c0cb5a0 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c158790 con 0x7f464c0cb970 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c159760 con 0x7f464c15a400 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40210/0 (socket says 172.21.15.26:40210) 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 -- 172.21.15.26:0/3631258241 learned_addr learned my addr 172.21.15.26:0/3631258241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 -- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464c15a400 msgr2=0x7f464c152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464c15a400 0x7f464c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 -- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f464c0cb970 msgr2=0x7f464c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f464c0cb970 0x7f464c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 -- 172.21.15.26:0/3631258241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634009420 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f464a59c700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f464400cca0 tx=0x7f4644001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400ab30 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400ac90 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c157b80 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644007300 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.776+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c158140 con 0x7f464c0cb5a0 2023-10-09T11:44:12.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.777+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c04c3c0 con 0x7f464c0cb5a0 2023-10-09T11:44:12.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.778+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f46440076f0 con 0x7f464c0cb5a0 2023-10-09T11:44:12.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.778+0000 7f46427fc700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 0x7f462c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:12.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.778+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4644085160 con 0x7f464c0cb5a0 2023-10-09T11:44:12.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.778+0000 7f4649d9b700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 0x7f462c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:12.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.779+0000 7f4649d9b700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 0x7f462c0697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f464c156040 tx=0x7f4634016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:12.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.783+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4644051e70 con 0x7f464c0cb5a0 2023-10-09T11:44:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.976+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f464c0cb1c0 con 0x7f464c0cb5a0 2023-10-09T11:44:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.977+0000 7f46427fc700 1 -- 172.21.15.26:0/3631258241 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f4644055490 con 0x7f464c0cb5a0 2023-10-09T11:44:12.977 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:12.977 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":182,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:11.646245+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:10.623231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 msgr2=0x7f462c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 0x7f462c0697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f464c156040 tx=0x7f4634016000 comp rx=0 tx=0).stop 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 msgr2=0x7f464c1575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f464400cca0 tx=0x7f4644001a30 comp rx=0 tx=0).stop 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 shutdown_connections 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f462c067320 0x7f462c0697d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464c15a400 0x7f464c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0cb5a0 0x7f464c1575a0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 --2- 172.21.15.26:0/3631258241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f464c0cb970 0x7f464c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 >> 172.21.15.26:0/3631258241 conn(0x7f464c070e30 msgr2=0x7f464c0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 shutdown_connections 2023-10-09T11:44:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:12.979+0000 7f4650809700 1 -- 172.21.15.26:0/3631258241 wait complete. 2023-10-09T11:44:12.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:44:13.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.113+0000 7fe3fe9e0700 1 Processor -- start 2023-10-09T11:44:13.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.113+0000 7fe3fe9e0700 1 -- start start 2023-10-09T11:44:13.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fe9e0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fe9e0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3f806e0e0 0x7fe3f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fe9e0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80ccfd0 con 0x7fe3f8159530 2023-10-09T11:44:13.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fe9e0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f815a3d0 con 0x7fe3f806e0e0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fe9e0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f815a6b0 con 0x7fe3f806dc70 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3fcf7d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3f806e0e0 0x7fe3f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3f7fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe3f8159530 0x7fe3f80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:45432/0 (socket says 172.21.15.26:45432) 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3f7fff700 1 -- 172.21.15.26:0/2439173692 learned_addr learned my addr 172.21.15.26:0/2439173692 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.114+0000 7fe3f77fe700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 msgr2=0x7fe3f8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3fcf7d700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/2439173692 >> v1:172.21.15.67:6789/0 conn(0x7fe3f8159530 legacy=0x7fe3f80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/2439173692 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f815a990 con 0x7fe3f806e0e0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3fcf7d700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f80cb6f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e60 tx=0x7fe3f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658fd7d5f7089648 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2439173692 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e070 con 0x7fe3f806e0e0 2023-10-09T11:44:13.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2439173692 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000bb60 con 0x7fe3f806e0e0 2023-10-09T11:44:13.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.115+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2439173692 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0012430 con 0x7fe3f806e0e0 2023-10-09T11:44:13.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 msgr2=0x7fe3f80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:13.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f80cb6f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e60 tx=0x7fe3f0009780 comp rx=0 tx=0).stop 2023-10-09T11:44:13.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/2439173692 shutdown_connections 2023-10-09T11:44:13.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f80cb6f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:13.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/2439173692 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/2439173692 >> 172.21.15.26:0/2439173692 conn(0x7fe3f80703a0 msgr2=0x7fe3f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/2439173692 shutdown_connections 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.116+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/2439173692 wait complete. 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.117+0000 7fe3fe9e0700 1 Processor -- start 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.117+0000 7fe3fe9e0700 1 -- start start 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f8155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8169380 con 0x7fe3f8159530 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8169ea0 con 0x7fe3f806e0e0 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fe9e0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f816a330 con 0x7fe3f806dc70 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40216/0 (socket says 172.21.15.26:40216) 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/213092471 learned_addr learned my addr 172.21.15.26:0/213092471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3f77fe700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f8155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 msgr2=0x7fe3f8140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 msgr2=0x7fe3f8155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f8155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 -- 172.21.15.26:0/213092471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0009a20 con 0x7fe3f8159530 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.118+0000 7fe3fcf7d700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0013000 tx=0x7fe3f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0027470 con 0x7fe3f8159530 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f00275f0 con 0x7fe3f8159530 2023-10-09T11:44:13.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00279b0 con 0x7fe3f8159530 2023-10-09T11:44:13.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f816a540 con 0x7fe3f8159530 2023-10-09T11:44:13.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f8169850 con 0x7fe3f8159530 2023-10-09T11:44:13.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.119+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f804c3c0 con 0x7fe3f8159530 2023-10-09T11:44:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.120+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe3f0024070 con 0x7fe3f8159530 2023-10-09T11:44:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.120+0000 7fe3effff700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 0x7fe3d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.120+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3f0087640 con 0x7fe3f8159530 2023-10-09T11:44:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.121+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 0x7fe3d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.121+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 0x7fe3d80697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007130 tx=0x7fe3e8000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:13.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.125+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f00542d0 con 0x7fe3f8159530 2023-10-09T11:44:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:13.366+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe3f8169fe0 con 0x7fe3f8159530 2023-10-09T11:44:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.297+0000 7fe3effff700 1 -- 172.21.15.26:0/213092471 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v119) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe3f00578f0 con 0x7fe3f8159530 2023-10-09T11:44:14.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 msgr2=0x7fe3d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 0x7fe3d80697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007130 tx=0x7fe3e8000bc0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 msgr2=0x7fe3f815bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0013000 tx=0x7fe3f0019000 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 shutdown_connections 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f8159530 0x7fe3f815bd70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3d8067320 0x7fe3d80697d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3f806dc70 0x7fe3f8140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 --2- 172.21.15.26:0/213092471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f806e0e0 0x7fe3f8155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 >> 172.21.15.26:0/213092471 conn(0x7fe3f80703a0 msgr2=0x7fe3f80cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:14.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 shutdown_connections 2023-10-09T11:44:14.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.300+0000 7fe3fe9e0700 1 -- 172.21.15.26:0/213092471 wait complete. 2023-10-09T11:44:14.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:44:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.439+0000 7f3c2555a700 1 Processor -- start 2023-10-09T11:44:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.439+0000 7f3c2555a700 1 -- start start 2023-10-09T11:44:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c2555a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c2006d490 0x7f3c2006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c2555a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2006ddf0 con 0x7f3c200703a0 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c2555a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2006c740 con 0x7f3c20159790 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c2555a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2006c9b0 con 0x7f3c2006d490 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c1e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c200703a0 0x7f3c200c7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56992/0 (socket says 172.21.15.26:56992) 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c1e7fc700 1 -- 172.21.15.26:0/3807474343 learned_addr learned my addr 172.21.15.26:0/3807474343 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c1f7fe700 1 --2- 172.21.15.26:0/3807474343 >> v2:172.21.15.67:3300/0 conn(0x7f3c2006d490 0x7f3c2006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575003583 0 0) 0x7f3c2006ddf0 con 0x7f3c200703a0 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.440+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c003570 con 0x7f3c200703a0 2023-10-09T11:44:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 353768698 0 0) 0x7f3c0c003570 con 0x7f3c200703a0 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 >> v2:172.21.15.67:3300/0 conn(0x7f3c2006d490 msgr2=0x7f3c2006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 --2- 172.21.15.26:0/3807474343 >> v2:172.21.15.67:3300/0 conn(0x7f3c2006d490 0x7f3c2006d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 >> v1:172.21.15.67:6789/0 conn(0x7f3c20159790 legacy=0x7f3c2006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2006cc90 con 0x7f3c200703a0 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3c08001470 con 0x7f3c200703a0 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 >> v1:172.21.15.26:6789/0 conn(0x7f3c200703a0 legacy=0x7f3c200c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c0c004810 0x7f3c0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c0c0051c0 0x7f3c0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2006c9b0 con 0x7f3c0c003a60 2023-10-09T11:44:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00c160 con 0x7f3c0c004810 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00c320 con 0x7f3c0c0051c0 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1e7fc700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c0c004810 0x7f3c0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1f7fe700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c0c0051c0 0x7f3c0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 -- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c0c0051c0 msgr2=0x7f3c0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c0c0051c0 0x7f3c0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 -- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c0c004810 msgr2=0x7f3c0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c0c004810 0x7f3c0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 -- 172.21.15.26:0/3807474343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c003570 con 0x7f3c0c003a60 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1f7fe700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c0c0051c0 0x7f3c0c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1e7fc700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c0c004810 0x7f3c0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1f7fe700 1 -- 172.21.15.26:0/3807474343 reap_dead start 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1effd700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c0c003e70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f3c180018b0 tx=0x7f3c18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f2c09208b80ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18012420 con 0x7f3c0c003a60 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c180125a0 con 0x7f3c0c003a60 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.441+0000 7f3c1dffb700 1 -- 172.21.15.26:0/3807474343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18012960 con 0x7f3c0c003a60 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 -- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 msgr2=0x7f3c0c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c0c003e70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f3c180018b0 tx=0x7f3c18007d30 comp rx=0 tx=0).stop 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 -- 172.21.15.26:0/3807474343 shutdown_connections 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 --2- 172.21.15.26:0/3807474343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c0c003e70 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 -- 172.21.15.26:0/3807474343 >> 172.21.15.26:0/3807474343 conn(0x7f3c2006ecd0 msgr2=0x7f3c2006f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:14.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 -- 172.21.15.26:0/3807474343 shutdown_connections 2023-10-09T11:44:14.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.442+0000 7f3c2555a700 1 -- 172.21.15.26:0/3807474343 wait complete. 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.443+0000 7f3c2555a700 1 Processor -- start 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.443+0000 7f3c2555a700 1 -- start start 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c200c44b0 0x7f3c2014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c200af7f0 0x7f3c20150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2014fcb0 con 0x7f3c0c003a60 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2014ef30 con 0x7f3c200c44b0 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c2555a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2014f380 con 0x7f3c200af7f0 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40234/0 (socket says 172.21.15.26:40234) 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 -- 172.21.15.26:0/912726709 learned_addr learned my addr 172.21.15.26:0/912726709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1f7fe700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c200af7f0 0x7f3c20150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 -- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c200af7f0 msgr2=0x7f3c20150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1e7fc700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c200c44b0 0x7f3c2014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c200af7f0 0x7f3c20150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 -- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c200c44b0 msgr2=0x7f3c2014e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c200c44b0 0x7f3c2014e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.444+0000 7f3c1effd700 1 -- 172.21.15.26:0/912726709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2014f660 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c1effd700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001010 tx=0x7f3c18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800c780 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800c900 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2014f940 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800ccc0 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.445+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c200c4c20 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.446+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2014ff90 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.446+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c1801f410 con 0x7f3c0c003a60 2023-10-09T11:44:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.446+0000 7f3c16ffd700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 0x7f3c000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.446+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c18086670 con 0x7f3c0c003a60 2023-10-09T11:44:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.447+0000 7f3c1e7fc700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 0x7f3c000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.447+0000 7f3c1e7fc700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 0x7f3c000697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3c08000e10 tx=0x7f3c08001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.451+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c180530f0 con 0x7f3c0c003a60 2023-10-09T11:44:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:14.689+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c2004c3c0 con 0x7f3c0c003a60 2023-10-09T11:44:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.303+0000 7f3c16ffd700 1 -- 172.21.15.26:0/912726709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v120) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c18056710 con 0x7f3c0c003a60 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 msgr2=0x7f3c000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 0x7f3c000697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3c08000e10 tx=0x7f3c08001110 comp rx=0 tx=0).stop 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 msgr2=0x7f3c200c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001010 tx=0x7f3c18015000 comp rx=0 tx=0).stop 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 shutdown_connections 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3c00067320 0x7f3c000697d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c200af7f0 0x7f3c20150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c0c003a60 0x7f3c200c6650 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 --2- 172.21.15.26:0/912726709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c200c44b0 0x7f3c2014e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 >> 172.21.15.26:0/912726709 conn(0x7f3c2006ecd0 msgr2=0x7f3c2006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:15.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 shutdown_connections 2023-10-09T11:44:15.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.306+0000 7f3c2555a700 1 -- 172.21.15.26:0/912726709 wait complete. 2023-10-09T11:44:15.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.447+0000 7fa88f99f700 1 Processor -- start 2023-10-09T11:44:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.447+0000 7fa88f99f700 1 -- start start 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88f99f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8880aee90 0x7fa8880a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88f99f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa8880b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88f99f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880ce1a0 con 0x7fa8880a8be0 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88f99f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880cd5d0 con 0x7fa8880aee90 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88f99f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880cd870 con 0x7fa88806d280 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88cf3a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8880aee90 0x7fa8880a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88d73b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa8880a8be0 0x7fa8880ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56994/0 (socket says 172.21.15.26:56994) 2023-10-09T11:44:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.448+0000 7fa88d73b700 1 -- 172.21.15.26:0/2716977380 learned_addr learned my addr 172.21.15.26:0/2716977380 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88df3c700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa8880b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88cf3a700 1 -- 172.21.15.26:0/2716977380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 msgr2=0x7fa8880b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88cf3a700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa8880b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88cf3a700 1 -- 172.21.15.26:0/2716977380 >> v1:172.21.15.26:6789/0 conn(0x7fa8880a8be0 legacy=0x7fa8880ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa887fff700 1 -- 172.21.15.26:0/2716977380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015967934 0 0) 0x7fa8880ce1a0 con 0x7fa8880a8be0 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88cf3a700 1 -- 172.21.15.26:0/2716977380 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880cdb50 con 0x7fa8880aee90 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88cf3a700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa8880a8fb0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0098d0 tx=0x7fa87c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a735f2caf0de6cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa887fff700 1 -- 172.21.15.26:0/2716977380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c009e70 con 0x7fa8880aee90 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa887fff700 1 -- 172.21.15.26:0/2716977380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c005c10 con 0x7fa8880aee90 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa887fff700 1 -- 172.21.15.26:0/2716977380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00b6e0 con 0x7fa8880aee90 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 -- 172.21.15.26:0/2716977380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 msgr2=0x7fa8880a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa8880a8fb0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0098d0 tx=0x7fa87c009120 comp rx=0 tx=0).stop 2023-10-09T11:44:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 -- 172.21.15.26:0/2716977380 shutdown_connections 2023-10-09T11:44:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa8880b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 --2- 172.21.15.26:0/2716977380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa8880a8fb0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.449+0000 7fa88f99f700 1 -- 172.21.15.26:0/2716977380 >> 172.21.15.26:0/2716977380 conn(0x7fa88806ce80 msgr2=0x7fa8880ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.450+0000 7fa88f99f700 1 -- 172.21.15.26:0/2716977380 shutdown_connections 2023-10-09T11:44:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.450+0000 7fa88f99f700 1 -- 172.21.15.26:0/2716977380 wait complete. 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.451+0000 7fa88f99f700 1 Processor -- start 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.451+0000 7fa88f99f700 1 -- start start 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa888156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8880a8be0 0x7fa88815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881675c0 con 0x7fa8880aee90 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815cf60 con 0x7fa8880a8be0 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa888167b30 con 0x7fa88806d280 2023-10-09T11:44:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40246/0 (socket says 172.21.15.26:40246) 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 -- 172.21.15.26:0/267539632 learned_addr learned my addr 172.21.15.26:0/267539632 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88d73b700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa888156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88cf3a700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8880a8be0 0x7fa88815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 -- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 msgr2=0x7fa888156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa888156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 -- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8880a8be0 msgr2=0x7fa88815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8880a8be0 0x7fa88815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 -- 172.21.15.26:0/267539632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0093c0 con 0x7fa8880aee90 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88df3c700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d8c0 tx=0x7fa878008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780095b0 con 0x7fa8880aee90 2023-10-09T11:44:15.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878009750 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88815c9a0 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878009b10 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.452+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8881677c0 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.453+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888167cc0 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.454+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa878014410 con 0x7fa8880aee90 2023-10-09T11:44:15.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.454+0000 7fa8857fa700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 0x7fa8740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.454+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8780850c0 con 0x7fa8880aee90 2023-10-09T11:44:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.455+0000 7fa88d73b700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 0x7fa8740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.455+0000 7fa88d73b700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 0x7fa8740697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa880007fd0 tx=0x7fa880009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.459+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa878051d50 con 0x7fa8880aee90 2023-10-09T11:44:15.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.704+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa88804c3c0 con 0x7fa8880aee90 2023-10-09T11:44:15.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.705+0000 7fa8857fa700 1 -- 172.21.15.26:0/267539632 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4601 (secure 0 0 0) 0x7fa878055370 con 0x7fa8880aee90 2023-10-09T11:44:15.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:15.705 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":120,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:15.297277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 msgr2=0x7fa8740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 0x7fa8740697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa880007fd0 tx=0x7fa880009040 comp rx=0 tx=0).stop 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 msgr2=0x7fa888099bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d8c0 tx=0x7fa878008040 comp rx=0 tx=0).stop 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 shutdown_connections 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8880aee90 0x7fa888099bf0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa874067320 0x7fa8740697d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa88806d280 0x7fa888156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 --2- 172.21.15.26:0/267539632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8880a8be0 0x7fa88815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.706+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 >> 172.21.15.26:0/267539632 conn(0x7fa88806ce80 msgr2=0x7fa8880b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:15.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.707+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 shutdown_connections 2023-10-09T11:44:15.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.707+0000 7fa88f99f700 1 -- 172.21.15.26:0/267539632 wait complete. 2023-10-09T11:44:15.708 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 120 2023-10-09T11:44:15.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.837+0000 7fc0b5182700 1 Processor -- start 2023-10-09T11:44:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.837+0000 7fc0b5182700 1 -- start start 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 0x7fc0b00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0b00b0ba0 0x7fc0b006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b015a280 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b006e180 con 0x7fc0b00b07d0 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0b5182700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00cd540 con 0x7fc0b00cf200 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0b00b0ba0 0x7fc0b006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0b00b0ba0 0x7fc0b006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40260/0 (socket says 172.21.15.26:40260) 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 -- 172.21.15.26:0/3637148655 learned_addr learned my addr 172.21.15.26:0/3637148655 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0aed9d700 1 --2- 172.21.15.26:0/3637148655 >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 0x7fc0b00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 -- 172.21.15.26:0/3637148655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 msgr2=0x7fc0b00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b00cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 -- 172.21.15.26:0/3637148655 >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 msgr2=0x7fc0b00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 --2- 172.21.15.26:0/3637148655 >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 0x7fc0b00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0af59e700 1 -- 172.21.15.26:0/3637148655 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b006d850 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.838+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0aed9d700 1 --2- 172.21.15.26:0/3637148655 >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 0x7fc0b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0af59e700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b006e610 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0064720 tx=0x7fc0a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6100eadd0274a6a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0add9b700 1 -- 172.21.15.26:0/3637148655 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000e070 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0add9b700 1 -- 172.21.15.26:0/3637148655 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000bae0 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0add9b700 1 -- 172.21.15.26:0/3637148655 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00092e0 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 -- 172.21.15.26:0/3637148655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b0ba0 msgr2=0x7fc0b006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b006e610 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0064720 tx=0x7fc0a0009840 comp rx=0 tx=0).stop 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 -- 172.21.15.26:0/3637148655 shutdown_connections 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 --2- 172.21.15.26:0/3637148655 >> v2:172.21.15.67:3300/0 conn(0x7fc0b00b07d0 0x7fc0b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b006e610 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 --2- 172.21.15.26:0/3637148655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 -- 172.21.15.26:0/3637148655 >> 172.21.15.26:0/3637148655 conn(0x7fc0b006ce80 msgr2=0x7fc0b00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 -- 172.21.15.26:0/3637148655 shutdown_connections 2023-10-09T11:44:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.839+0000 7fc0b5182700 1 -- 172.21.15.26:0/3637148655 wait complete. 2023-10-09T11:44:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 Processor -- start 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 -- start start 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b0068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b014b990 con 0x7fc0b00b07d0 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b016a0f0 con 0x7fc0b00b0ba0 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0b5182700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0169520 con 0x7fc0b00cf200 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.841+0000 7fc0aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40264/0 (socket says 172.21.15.26:40264) 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 -- 172.21.15.26:0/521455410 learned_addr learned my addr 172.21.15.26:0/521455410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0af59e700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b0068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 -- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 msgr2=0x7fc0b0068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b0068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 -- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 msgr2=0x7fc0b00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b00c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 -- 172.21.15.26:0/521455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009ae0 con 0x7fc0b00b07d0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0aed9d700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800c850 tx=0x7fc0a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8005a00 con 0x7fc0b00b07d0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8005b60 con 0x7fc0b00b07d0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b01697c0 con 0x7fc0b00b07d0 2023-10-09T11:44:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8011600 con 0x7fc0b00b07d0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.842+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b0169d80 con 0x7fc0b00b07d0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.843+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b004c3c0 con 0x7fc0b00b07d0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.844+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc0a80119b0 con 0x7fc0b00b07d0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.844+0000 7fc0a6ffd700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 0x7fc0900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.844+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0a80850b0 con 0x7fc0b00b07d0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.844+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 0x7fc0900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:15.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.845+0000 7fc0ae59c700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 0x7fc0900697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc098006fd0 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:15.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:15.849+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0a8051c30 con 0x7fc0b00b07d0 2023-10-09T11:44:16.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.041+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0b006db30 con 0x7fc0b00b07d0 2023-10-09T11:44:16.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.041+0000 7fc0a6ffd700 1 -- 172.21.15.26:0/521455410 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fc0a8055250 con 0x7fc0b00b07d0 2023-10-09T11:44:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:16.042 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":183,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:13.254389+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:10.623231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 msgr2=0x7fc0900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 0x7fc0900697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc098006fd0 tx=0x7fc098008040 comp rx=0 tx=0).stop 2023-10-09T11:44:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 msgr2=0x7fc0b014b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800c850 tx=0x7fc0a8008040 comp rx=0 tx=0).stop 2023-10-09T11:44:16.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 shutdown_connections 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc090067320 0x7fc0900697d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc0b00cf200 0x7fc0b0068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b00b07d0 0x7fc0b014b450 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 --2- 172.21.15.26:0/521455410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0b00b0ba0 0x7fc0b00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 >> 172.21.15.26:0/521455410 conn(0x7fc0b006ce80 msgr2=0x7fc0b00c40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 shutdown_connections 2023-10-09T11:44:16.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.044+0000 7fc0b5182700 1 -- 172.21.15.26:0/521455410 wait complete. 2023-10-09T11:44:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:44:16.056 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 Processor -- start 2023-10-09T11:44:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 -- start start 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48880cb5a0 0x7f48880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488815ae40 con 0x7f48880cd9e0 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488815ab60 con 0x7f488815a5d0 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.175+0000 7f488ea27700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48880d13f0 con 0x7f48880cb5a0 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4887fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48880cb5a0 0x7f48880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f48877fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f48880cd9e0 0x7f4888159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56996/0 (socket says 172.21.15.26:56996) 2023-10-09T11:44:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f48877fe700 1 -- 172.21.15.26:0/67448674 learned_addr learned my addr 172.21.15.26:0/67448674 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:16.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4887fff700 1 -- 172.21.15.26:0/67448674 >> v1:172.21.15.67:6789/0 conn(0x7f488815a5d0 legacy=0x7f4888156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4887fff700 1 -- 172.21.15.26:0/67448674 >> v1:172.21.15.26:6789/0 conn(0x7f48880cd9e0 legacy=0x7f4888159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4886ffd700 1 -- 172.21.15.26:0/67448674 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714415542 0 0) 0x7f488815ae40 con 0x7f48880cd9e0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4887fff700 1 -- 172.21.15.26:0/67448674 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880ccf00 con 0x7f48880cb5a0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4887fff700 1 --2- 172.21.15.26:0/67448674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f48880cb970 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4878009910 tx=0x7f48780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897a25ad3e98c391 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4886ffd700 1 -- 172.21.15.26:0/67448674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487800b820 con 0x7f48880cb5a0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4886ffd700 1 -- 172.21.15.26:0/67448674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800b980 con 0x7f48880cb5a0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.176+0000 7f4886ffd700 1 -- 172.21.15.26:0/67448674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487800bd20 con 0x7f48880cb5a0 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 -- 172.21.15.26:0/67448674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 msgr2=0x7f48880cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 --2- 172.21.15.26:0/67448674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f48880cb970 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4878009910 tx=0x7f48780091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 -- 172.21.15.26:0/67448674 shutdown_connections 2023-10-09T11:44:16.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 --2- 172.21.15.26:0/67448674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f48880cb970 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 -- 172.21.15.26:0/67448674 >> 172.21.15.26:0/67448674 conn(0x7f4888070e30 msgr2=0x7f48880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 -- 172.21.15.26:0/67448674 shutdown_connections 2023-10-09T11:44:16.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.177+0000 7f488ea27700 1 -- 172.21.15.26:0/67448674 wait complete. 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.178+0000 7f488ea27700 1 Processor -- start 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.178+0000 7f488ea27700 1 -- start start 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 0x7f48880c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 0x7f48880c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881513c0 con 0x7f48880cb5a0 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881521c0 con 0x7f48880cd9e0 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488ea27700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48881515b0 con 0x7f488815a5d0 2023-10-09T11:44:16.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40274/0 (socket says 172.21.15.26:40274) 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 -- 172.21.15.26:0/630914463 learned_addr learned my addr 172.21.15.26:0/630914463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 -- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 msgr2=0x7f48880c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f48877fe700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 0x7f48880c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488cfc4700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 0x7f48880c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 0x7f48880c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 -- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 msgr2=0x7f48880c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 0x7f48880c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 -- 172.21.15.26:0/630914463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009420 con 0x7f48880cb5a0 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f488cfc4700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 0x7f48880c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f48877fe700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 0x7f48880c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:16.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f4887fff700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f48780093f0 tx=0x7f4878017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.179+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487801f070 con 0x7f48880cb5a0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.180+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800baf0 con 0x7f48880cb5a0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.180+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4888151890 con 0x7f48880cb5a0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.180+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878025420 con 0x7f48880cb5a0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.180+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4888151e50 con 0x7f48880cb5a0 2023-10-09T11:44:16.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.181+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48881500b0 con 0x7f48880cb5a0 2023-10-09T11:44:16.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.181+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4878023070 con 0x7f48880cb5a0 2023-10-09T11:44:16.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.181+0000 7f486ffff700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 0x7f48740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.182+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48780862f0 con 0x7f48880cb5a0 2023-10-09T11:44:16.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.182+0000 7f48877fe700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 0x7f48740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.182+0000 7f48877fe700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 0x7f48740697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.186+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4878052f80 con 0x7f48880cb5a0 2023-10-09T11:44:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.376+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4888152300 con 0x7f4874067320 2023-10-09T11:44:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.384+0000 7f486ffff700 1 -- 172.21.15.26:0/630914463 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284571 (secure 0 0 0) 0x7f487c001d70 con 0x7f4874067320 2023-10-09T11:44:16.388 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 msgr2=0x7f48740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 0x7f48740697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c009040 comp rx=0 tx=0).stop 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 msgr2=0x7f488814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f48780093f0 tx=0x7f4878017000 comp rx=0 tx=0).stop 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 shutdown_connections 2023-10-09T11:44:16.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4874067320 0x7f48740697d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f488815a5d0 0x7f48880c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48880cb5a0 0x7f488814fab0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 --2- 172.21.15.26:0/630914463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880cd9e0 0x7f48880c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 >> 172.21.15.26:0/630914463 conn(0x7f4888070e30 msgr2=0x7f48880b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 shutdown_connections 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.388+0000 7f488ea27700 1 -- 172.21.15.26:0/630914463 wait complete. 2023-10-09T11:44:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:16.400 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-09T11:44:15.234451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434372,"kb_used_data":19204,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540348,"statfs":{"total":773094113280,"available":770601316352,"internally_reserved":0,"allocated":19664896,"data_stored":9463066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996492"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268780+0000","last_change":"2023-10-09T11:44:12.265095+0000","last_active":"2023-10-09T11:44:12.268780+0000","last_peered":"2023-10-09T11:44:12.268780+0000","last_clean":"2023-10-09T11:44:12.268780+0000","last_became_active":"2023-10-09T11:44:12.264811+0000","last_became_peered":"2023-10-09T11:44:12.264811+0000","last_unstale":"2023-10-09T11:44:12.268780+0000","last_undegraded":"2023-10-09T11:44:12.268780+0000","last_fullsized":"2023-10-09T11:44:12.268780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:50.460620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271517+0000","last_change":"2023-10-09T11:44:12.268131+0000","last_active":"2023-10-09T11:44:12.271517+0000","last_peered":"2023-10-09T11:44:12.271517+0000","last_clean":"2023-10-09T11:44:12.271517+0000","last_became_active":"2023-10-09T11:44:12.267795+0000","last_became_peered":"2023-10-09T11:44:12.267795+0000","last_unstale":"2023-10-09T11:44:12.271517+0000","last_undegraded":"2023-10-09T11:44:12.271517+0000","last_fullsized":"2023-10-09T11:44:12.271517+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:08.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273286+0000","last_change":"2023-10-09T11:44:12.271095+0000","last_active":"2023-10-09T11:44:12.273286+0000","last_peered":"2023-10-09T11:44:12.273286+0000","last_clean":"2023-10-09T11:44:12.273286+0000","last_became_active":"2023-10-09T11:44:12.270824+0000","last_became_peered":"2023-10-09T11:44:12.270824+0000","last_unstale":"2023-10-09T11:44:12.273286+0000","last_undegraded":"2023-10-09T11:44:12.273286+0000","last_fullsized":"2023-10-09T11:44:12.273286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278326+0000","last_change":"2023-10-09T11:44:12.277359+0000","last_active":"2023-10-09T11:44:12.278326+0000","last_peered":"2023-10-09T11:44:12.278326+0000","last_clean":"2023-10-09T11:44:12.278326+0000","last_became_active":"2023-10-09T11:44:12.277030+0000","last_became_peered":"2023-10-09T11:44:12.277030+0000","last_unstale":"2023-10-09T11:44:12.278326+0000","last_undegraded":"2023-10-09T11:44:12.278326+0000","last_fullsized":"2023-10-09T11:44:12.278326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:32.137710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281252+0000","last_change":"2023-10-09T11:44:12.280836+0000","last_active":"2023-10-09T11:44:12.281252+0000","last_peered":"2023-10-09T11:44:12.281252+0000","last_clean":"2023-10-09T11:44:12.281252+0000","last_became_active":"2023-10-09T11:44:12.280543+0000","last_became_peered":"2023-10-09T11:44:12.280543+0000","last_unstale":"2023-10-09T11:44:12.281252+0000","last_undegraded":"2023-10-09T11:44:12.281252+0000","last_fullsized":"2023-10-09T11:44:12.281252+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283142+0000","last_change":"2023-10-09T11:44:12.282782+0000","last_active":"2023-10-09T11:44:12.283142+0000","last_peered":"2023-10-09T11:44:12.283142+0000","last_clean":"2023-10-09T11:44:12.283142+0000","last_became_active":"2023-10-09T11:44:12.282522+0000","last_became_peered":"2023-10-09T11:44:12.282522+0000","last_unstale":"2023-10-09T11:44:12.283142+0000","last_undegraded":"2023-10-09T11:44:12.283142+0000","last_fullsized":"2023-10-09T11:44:12.283142+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:05.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270666+0000","last_change":"2023-10-09T11:44:12.269473+0000","last_active":"2023-10-09T11:44:12.270666+0000","last_peered":"2023-10-09T11:44:12.270666+0000","last_clean":"2023-10-09T11:44:12.270666+0000","last_became_active":"2023-10-09T11:44:12.269237+0000","last_became_peered":"2023-10-09T11:44:12.269237+0000","last_unstale":"2023-10-09T11:44:12.270666+0000","last_undegraded":"2023-10-09T11:44:12.270666+0000","last_fullsized":"2023-10-09T11:44:12.270666+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273839+0000","last_change":"2023-10-09T11:44:12.272512+0000","last_active":"2023-10-09T11:44:12.273839+0000","last_peered":"2023-10-09T11:44:12.273839+0000","last_clean":"2023-10-09T11:44:12.273839+0000","last_became_active":"2023-10-09T11:44:12.272231+0000","last_became_peered":"2023-10-09T11:44:12.272231+0000","last_unstale":"2023-10-09T11:44:12.273839+0000","last_undegraded":"2023-10-09T11:44:12.273839+0000","last_fullsized":"2023-10-09T11:44:12.273839+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278371+0000","last_change":"2023-10-09T11:44:12.277523+0000","last_active":"2023-10-09T11:44:12.278371+0000","last_peered":"2023-10-09T11:44:12.278371+0000","last_clean":"2023-10-09T11:44:12.278371+0000","last_became_active":"2023-10-09T11:44:12.277208+0000","last_became_peered":"2023-10-09T11:44:12.277208+0000","last_unstale":"2023-10-09T11:44:12.278371+0000","last_undegraded":"2023-10-09T11:44:12.278371+0000","last_fullsized":"2023-10-09T11:44:12.278371+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.272691+0000","last_change":"2023-10-09T11:44:12.271664+0000","last_active":"2023-10-09T11:44:12.272691+0000","last_peered":"2023-10-09T11:44:12.272691+0000","last_clean":"2023-10-09T11:44:12.272691+0000","last_became_active":"2023-10-09T11:44:12.271378+0000","last_became_peered":"2023-10-09T11:44:12.271378+0000","last_unstale":"2023-10-09T11:44:12.272691+0000","last_undegraded":"2023-10-09T11:44:12.272691+0000","last_fullsized":"2023-10-09T11:44:12.272691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269835+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.269835+0000","last_peered":"2023-10-09T11:44:12.269835+0000","last_clean":"2023-10-09T11:44:12.269835+0000","last_became_active":"2023-10-09T11:44:12.266282+0000","last_became_peered":"2023-10-09T11:44:12.266282+0000","last_unstale":"2023-10-09T11:44:12.269835+0000","last_undegraded":"2023-10-09T11:44:12.269835+0000","last_fullsized":"2023-10-09T11:44:12.269835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:49.065836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.263811+0000","last_change":"2023-10-09T11:44:12.262564+0000","last_active":"2023-10-09T11:44:12.263811+0000","last_peered":"2023-10-09T11:44:12.263811+0000","last_clean":"2023-10-09T11:44:12.263811+0000","last_became_active":"2023-10-09T11:44:12.262269+0000","last_became_peered":"2023-10-09T11:44:12.262269+0000","last_unstale":"2023-10-09T11:44:12.263811+0000","last_undegraded":"2023-10-09T11:44:12.263811+0000","last_fullsized":"2023-10-09T11:44:12.263811+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:17.384685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274003+0000","last_change":"2023-10-09T11:44:12.273270+0000","last_active":"2023-10-09T11:44:12.274003+0000","last_peered":"2023-10-09T11:44:12.274003+0000","last_clean":"2023-10-09T11:44:12.274003+0000","last_became_active":"2023-10-09T11:44:12.272950+0000","last_became_peered":"2023-10-09T11:44:12.272950+0000","last_unstale":"2023-10-09T11:44:12.274003+0000","last_undegraded":"2023-10-09T11:44:12.274003+0000","last_fullsized":"2023-10-09T11:44:12.274003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.518058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267250+0000","last_change":"2023-10-09T11:44:12.264884+0000","last_active":"2023-10-09T11:44:12.267250+0000","last_peered":"2023-10-09T11:44:12.267250+0000","last_clean":"2023-10-09T11:44:12.267250+0000","last_became_active":"2023-10-09T11:44:12.264602+0000","last_became_peered":"2023-10-09T11:44:12.264602+0000","last_unstale":"2023-10-09T11:44:12.267250+0000","last_undegraded":"2023-10-09T11:44:12.267250+0000","last_fullsized":"2023-10-09T11:44:12.267250+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:03.929742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273284+0000","last_change":"2023-10-09T11:44:12.271739+0000","last_active":"2023-10-09T11:44:12.273284+0000","last_peered":"2023-10-09T11:44:12.273284+0000","last_clean":"2023-10-09T11:44:12.273284+0000","last_became_active":"2023-10-09T11:44:12.271461+0000","last_became_peered":"2023-10-09T11:44:12.271461+0000","last_unstale":"2023-10-09T11:44:12.273284+0000","last_undegraded":"2023-10-09T11:44:12.273284+0000","last_fullsized":"2023-10-09T11:44:12.273284+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:36.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274785+0000","last_change":"2023-10-09T11:44:12.273174+0000","last_active":"2023-10-09T11:44:12.274785+0000","last_peered":"2023-10-09T11:44:12.274785+0000","last_clean":"2023-10-09T11:44:12.274785+0000","last_became_active":"2023-10-09T11:44:12.272914+0000","last_became_peered":"2023-10-09T11:44:12.272914+0000","last_unstale":"2023-10-09T11:44:12.274785+0000","last_undegraded":"2023-10-09T11:44:12.274785+0000","last_fullsized":"2023-10-09T11:44:12.274785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270511+0000","last_change":"2023-10-09T11:44:12.269715+0000","last_active":"2023-10-09T11:44:12.270511+0000","last_peered":"2023-10-09T11:44:12.270511+0000","last_clean":"2023-10-09T11:44:12.270511+0000","last_became_active":"2023-10-09T11:44:12.269364+0000","last_became_peered":"2023-10-09T11:44:12.269364+0000","last_unstale":"2023-10-09T11:44:12.270511+0000","last_undegraded":"2023-10-09T11:44:12.270511+0000","last_fullsized":"2023-10-09T11:44:12.270511+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282933+0000","last_change":"2023-10-09T11:44:12.282608+0000","last_active":"2023-10-09T11:44:12.282933+0000","last_peered":"2023-10-09T11:44:12.282933+0000","last_clean":"2023-10-09T11:44:12.282933+0000","last_became_active":"2023-10-09T11:44:12.282260+0000","last_became_peered":"2023-10-09T11:44:12.282260+0000","last_unstale":"2023-10-09T11:44:12.282933+0000","last_undegraded":"2023-10-09T11:44:12.282933+0000","last_fullsized":"2023-10-09T11:44:12.282933+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278541+0000","last_change":"2023-10-09T11:44:12.276888+0000","last_active":"2023-10-09T11:44:12.278541+0000","last_peered":"2023-10-09T11:44:12.278541+0000","last_clean":"2023-10-09T11:44:12.278541+0000","last_became_active":"2023-10-09T11:44:12.276610+0000","last_became_peered":"2023-10-09T11:44:12.276610+0000","last_unstale":"2023-10-09T11:44:12.278541+0000","last_undegraded":"2023-10-09T11:44:12.278541+0000","last_fullsized":"2023-10-09T11:44:12.278541+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271095+0000","last_change":"2023-10-09T11:44:12.267810+0000","last_active":"2023-10-09T11:44:12.271095+0000","last_peered":"2023-10-09T11:44:12.271095+0000","last_clean":"2023-10-09T11:44:12.271095+0000","last_became_active":"2023-10-09T11:44:12.266902+0000","last_became_peered":"2023-10-09T11:44:12.266902+0000","last_unstale":"2023-10-09T11:44:12.271095+0000","last_undegraded":"2023-10-09T11:44:12.271095+0000","last_fullsized":"2023-10-09T11:44:12.271095+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298440+0000","last_change":"2023-10-09T11:44:11.254907+0000","last_active":"2023-10-09T11:44:12.298440+0000","last_peered":"2023-10-09T11:44:12.298440+0000","last_clean":"2023-10-09T11:44:12.298440+0000","last_became_active":"2023-10-09T11:44:11.254645+0000","last_became_peered":"2023-10-09T11:44:11.254645+0000","last_unstale":"2023-10-09T11:44:12.298440+0000","last_undegraded":"2023-10-09T11:44:12.298440+0000","last_fullsized":"2023-10-09T11:44:12.298440+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:12.461779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240217+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:40.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281715+0000","last_change":"2023-10-09T11:44:12.281389+0000","last_active":"2023-10-09T11:44:12.281715+0000","last_peered":"2023-10-09T11:44:12.281715+0000","last_clean":"2023-10-09T11:44:12.281715+0000","last_became_active":"2023-10-09T11:44:12.281155+0000","last_became_peered":"2023-10-09T11:44:12.281155+0000","last_unstale":"2023-10-09T11:44:12.281715+0000","last_undegraded":"2023-10-09T11:44:12.281715+0000","last_fullsized":"2023-10-09T11:44:12.281715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:34.148015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298886+0000","last_change":"2023-10-09T11:44:11.255393+0000","last_active":"2023-10-09T11:44:12.298886+0000","last_peered":"2023-10-09T11:44:12.298886+0000","last_clean":"2023-10-09T11:44:12.298886+0000","last_became_active":"2023-10-09T11:44:11.255123+0000","last_became_peered":"2023-10-09T11:44:11.255123+0000","last_unstale":"2023-10-09T11:44:12.298886+0000","last_undegraded":"2023-10-09T11:44:12.298886+0000","last_fullsized":"2023-10-09T11:44:12.298886+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.717853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267036+0000","last_change":"2023-10-09T11:44:12.266273+0000","last_active":"2023-10-09T11:44:12.267036+0000","last_peered":"2023-10-09T11:44:12.267036+0000","last_clean":"2023-10-09T11:44:12.267036+0000","last_became_active":"2023-10-09T11:44:12.266008+0000","last_became_peered":"2023-10-09T11:44:12.266008+0000","last_unstale":"2023-10-09T11:44:12.267036+0000","last_undegraded":"2023-10-09T11:44:12.267036+0000","last_fullsized":"2023-10-09T11:44:12.267036+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:50.221128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.243484+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295663+0000","last_change":"2023-10-09T11:44:11.248115+0000","last_active":"2023-10-09T11:44:12.295663+0000","last_peered":"2023-10-09T11:44:12.295663+0000","last_clean":"2023-10-09T11:44:12.295663+0000","last_became_active":"2023-10-09T11:44:11.247830+0000","last_became_peered":"2023-10-09T11:44:11.247830+0000","last_unstale":"2023-10-09T11:44:12.295663+0000","last_undegraded":"2023-10-09T11:44:12.295663+0000","last_fullsized":"2023-10-09T11:44:12.295663+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:34.353464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278563+0000","last_change":"2023-10-09T11:44:12.277707+0000","last_active":"2023-10-09T11:44:12.278563+0000","last_peered":"2023-10-09T11:44:12.278563+0000","last_clean":"2023-10-09T11:44:12.278563+0000","last_became_active":"2023-10-09T11:44:12.277006+0000","last_became_peered":"2023-10-09T11:44:12.277006+0000","last_unstale":"2023-10-09T11:44:12.278563+0000","last_undegraded":"2023-10-09T11:44:12.278563+0000","last_fullsized":"2023-10-09T11:44:12.278563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259291+0000","last_change":"2023-10-09T11:44:11.252418+0000","last_active":"2023-10-09T11:44:12.259291+0000","last_peered":"2023-10-09T11:44:12.259291+0000","last_clean":"2023-10-09T11:44:12.259291+0000","last_became_active":"2023-10-09T11:44:11.252160+0000","last_became_peered":"2023-10-09T11:44:11.252160+0000","last_unstale":"2023-10-09T11:44:12.259291+0000","last_undegraded":"2023-10-09T11:44:12.259291+0000","last_fullsized":"2023-10-09T11:44:12.259291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:48.365961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259179+0000","last_change":"2023-10-09T11:44:11.252816+0000","last_active":"2023-10-09T11:44:12.259179+0000","last_peered":"2023-10-09T11:44:12.259179+0000","last_clean":"2023-10-09T11:44:12.259179+0000","last_became_active":"2023-10-09T11:44:11.252549+0000","last_became_peered":"2023-10-09T11:44:11.252549+0000","last_unstale":"2023-10-09T11:44:12.259179+0000","last_undegraded":"2023-10-09T11:44:12.259179+0000","last_fullsized":"2023-10-09T11:44:12.259179+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:48.710847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255963+0000","last_change":"2023-10-09T11:44:11.252364+0000","last_active":"2023-10-09T11:44:12.255963+0000","last_peered":"2023-10-09T11:44:12.255963+0000","last_clean":"2023-10-09T11:44:12.255963+0000","last_became_active":"2023-10-09T11:44:11.252051+0000","last_became_peered":"2023-10-09T11:44:11.252051+0000","last_unstale":"2023-10-09T11:44:12.255963+0000","last_undegraded":"2023-10-09T11:44:12.255963+0000","last_fullsized":"2023-10-09T11:44:12.255963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:57.149728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.260595+0000","last_change":"2023-10-09T11:44:11.253569+0000","last_active":"2023-10-09T11:44:12.260595+0000","last_peered":"2023-10-09T11:44:12.260595+0000","last_clean":"2023-10-09T11:44:12.260595+0000","last_became_active":"2023-10-09T11:44:11.253257+0000","last_became_peered":"2023-10-09T11:44:11.253257+0000","last_unstale":"2023-10-09T11:44:12.260595+0000","last_undegraded":"2023-10-09T11:44:12.260595+0000","last_fullsized":"2023-10-09T11:44:12.260595+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:36.301961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273860+0000","last_change":"2023-10-09T11:44:12.272569+0000","last_active":"2023-10-09T11:44:12.273860+0000","last_peered":"2023-10-09T11:44:12.273860+0000","last_clean":"2023-10-09T11:44:12.273860+0000","last_became_active":"2023-10-09T11:44:12.272276+0000","last_became_peered":"2023-10-09T11:44:12.272276+0000","last_unstale":"2023-10-09T11:44:12.273860+0000","last_undegraded":"2023-10-09T11:44:12.273860+0000","last_fullsized":"2023-10-09T11:44:12.273860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240987+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:44.619299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.299977+0000","last_change":"2023-10-09T11:44:11.250362+0000","last_active":"2023-10-09T11:44:12.299977+0000","last_peered":"2023-10-09T11:44:12.299977+0000","last_clean":"2023-10-09T11:44:12.299977+0000","last_became_active":"2023-10-09T11:44:11.249947+0000","last_became_peered":"2023-10-09T11:44:11.249947+0000","last_unstale":"2023-10-09T11:44:12.299977+0000","last_undegraded":"2023-10-09T11:44:12.299977+0000","last_fullsized":"2023-10-09T11:44:12.299977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.024197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267426+0000","last_change":"2023-10-09T11:44:12.266628+0000","last_active":"2023-10-09T11:44:12.267426+0000","last_peered":"2023-10-09T11:44:12.267426+0000","last_clean":"2023-10-09T11:44:12.267426+0000","last_became_active":"2023-10-09T11:44:12.266365+0000","last_became_peered":"2023-10-09T11:44:12.266365+0000","last_unstale":"2023-10-09T11:44:12.267426+0000","last_undegraded":"2023-10-09T11:44:12.267426+0000","last_fullsized":"2023-10-09T11:44:12.267426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:41.693514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242467+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:39.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241499+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:57.072034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241253+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:42.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.309647+0000","last_change":"2023-10-09T11:44:11.252250+0000","last_active":"2023-10-09T11:44:12.309647+0000","last_peered":"2023-10-09T11:44:12.309647+0000","last_clean":"2023-10-09T11:44:12.309647+0000","last_became_active":"2023-10-09T11:44:11.251901+0000","last_became_peered":"2023-10-09T11:44:11.251901+0000","last_unstale":"2023-10-09T11:44:12.309647+0000","last_undegraded":"2023-10-09T11:44:12.309647+0000","last_fullsized":"2023-10-09T11:44:12.309647+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:10.090035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298209+0000","last_change":"2023-10-09T11:44:11.258244+0000","last_active":"2023-10-09T11:44:12.298209+0000","last_peered":"2023-10-09T11:44:12.298209+0000","last_clean":"2023-10-09T11:44:12.298209+0000","last_became_active":"2023-10-09T11:44:11.257906+0000","last_became_peered":"2023-10-09T11:44:11.257906+0000","last_unstale":"2023-10-09T11:44:12.298209+0000","last_undegraded":"2023-10-09T11:44:12.298209+0000","last_fullsized":"2023-10-09T11:44:12.298209+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:05:41.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296867+0000","last_change":"2023-10-09T11:44:11.248480+0000","last_active":"2023-10-09T11:44:12.296867+0000","last_peered":"2023-10-09T11:44:12.296867+0000","last_clean":"2023-10-09T11:44:12.296867+0000","last_became_active":"2023-10-09T11:44:11.248222+0000","last_became_peered":"2023-10-09T11:44:11.248222+0000","last_unstale":"2023-10-09T11:44:12.296867+0000","last_undegraded":"2023-10-09T11:44:12.296867+0000","last_fullsized":"2023-10-09T11:44:12.296867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.459928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271463+0000","last_change":"2023-10-09T11:44:12.269495+0000","last_active":"2023-10-09T11:44:12.271463+0000","last_peered":"2023-10-09T11:44:12.271463+0000","last_clean":"2023-10-09T11:44:12.271463+0000","last_became_active":"2023-10-09T11:44:12.269229+0000","last_became_peered":"2023-10-09T11:44:12.269229+0000","last_unstale":"2023-10-09T11:44:12.271463+0000","last_undegraded":"2023-10-09T11:44:12.271463+0000","last_fullsized":"2023-10-09T11:44:12.271463+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239659+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284050+0000","last_change":"2023-10-09T11:44:12.283601+0000","last_active":"2023-10-09T11:44:12.284050+0000","last_peered":"2023-10-09T11:44:12.284050+0000","last_clean":"2023-10-09T11:44:12.284050+0000","last_became_active":"2023-10-09T11:44:12.283374+0000","last_became_peered":"2023-10-09T11:44:12.283374+0000","last_unstale":"2023-10-09T11:44:12.284050+0000","last_undegraded":"2023-10-09T11:44:12.284050+0000","last_fullsized":"2023-10-09T11:44:12.284050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:09.075683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242501+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:55.918892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269913+0000","last_change":"2023-10-09T11:44:12.266466+0000","last_active":"2023-10-09T11:44:12.269913+0000","last_peered":"2023-10-09T11:44:12.269913+0000","last_clean":"2023-10-09T11:44:12.269913+0000","last_became_active":"2023-10-09T11:44:12.266180+0000","last_became_peered":"2023-10-09T11:44:12.266180+0000","last_unstale":"2023-10-09T11:44:12.269913+0000","last_undegraded":"2023-10-09T11:44:12.269913+0000","last_fullsized":"2023-10-09T11:44:12.269913+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.294921+0000","last_change":"2023-10-09T11:44:11.258567+0000","last_active":"2023-10-09T11:44:12.294921+0000","last_peered":"2023-10-09T11:44:12.294921+0000","last_clean":"2023-10-09T11:44:12.294921+0000","last_became_active":"2023-10-09T11:44:11.258262+0000","last_became_peered":"2023-10-09T11:44:11.258262+0000","last_unstale":"2023-10-09T11:44:12.294921+0000","last_undegraded":"2023-10-09T11:44:12.294921+0000","last_fullsized":"2023-10-09T11:44:12.294921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:41.584422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271493+0000","last_change":"2023-10-09T11:44:12.270382+0000","last_active":"2023-10-09T11:44:12.271493+0000","last_peered":"2023-10-09T11:44:12.271493+0000","last_clean":"2023-10-09T11:44:12.271493+0000","last_became_active":"2023-10-09T11:44:12.270128+0000","last_became_peered":"2023-10-09T11:44:12.270128+0000","last_unstale":"2023-10-09T11:44:12.271493+0000","last_undegraded":"2023-10-09T11:44:12.271493+0000","last_fullsized":"2023-10-09T11:44:12.271493+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:28.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239119+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:05.361683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239679+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:29.247637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255762+0000","last_change":"2023-10-09T11:44:11.256911+0000","last_active":"2023-10-09T11:44:12.255762+0000","last_peered":"2023-10-09T11:44:12.255762+0000","last_clean":"2023-10-09T11:44:12.255762+0000","last_became_active":"2023-10-09T11:44:11.256623+0000","last_became_peered":"2023-10-09T11:44:11.256623+0000","last_unstale":"2023-10-09T11:44:12.255762+0000","last_undegraded":"2023-10-09T11:44:12.255762+0000","last_fullsized":"2023-10-09T11:44:12.255762+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:55.284864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296150+0000","last_change":"2023-10-09T11:44:11.250873+0000","last_active":"2023-10-09T11:44:12.296150+0000","last_peered":"2023-10-09T11:44:12.296150+0000","last_clean":"2023-10-09T11:44:12.296150+0000","last_became_active":"2023-10-09T11:44:11.250597+0000","last_became_peered":"2023-10-09T11:44:11.250597+0000","last_unstale":"2023-10-09T11:44:12.296150+0000","last_undegraded":"2023-10-09T11:44:12.296150+0000","last_fullsized":"2023-10-09T11:44:12.296150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:32.783621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:40.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278495+0000","last_change":"2023-10-09T11:44:12.277527+0000","last_active":"2023-10-09T11:44:12.278495+0000","last_peered":"2023-10-09T11:44:12.278495+0000","last_clean":"2023-10-09T11:44:12.278495+0000","last_became_active":"2023-10-09T11:44:12.277236+0000","last_became_peered":"2023-10-09T11:44:12.277236+0000","last_unstale":"2023-10-09T11:44:12.278495+0000","last_undegraded":"2023-10-09T11:44:12.278495+0000","last_fullsized":"2023-10-09T11:44:12.278495+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:49.722879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255955+0000","last_change":"2023-10-09T11:44:11.252839+0000","last_active":"2023-10-09T11:44:12.255955+0000","last_peered":"2023-10-09T11:44:12.255955+0000","last_clean":"2023-10-09T11:44:12.255955+0000","last_became_active":"2023-10-09T11:44:11.252571+0000","last_became_peered":"2023-10-09T11:44:11.252571+0000","last_unstale":"2023-10-09T11:44:12.255955+0000","last_undegraded":"2023-10-09T11:44:12.255955+0000","last_fullsized":"2023-10-09T11:44:12.255955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:04.073378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.256442+0000","last_change":"2023-10-09T11:44:11.257159+0000","last_active":"2023-10-09T11:44:12.256442+0000","last_peered":"2023-10-09T11:44:12.256442+0000","last_clean":"2023-10-09T11:44:12.256442+0000","last_became_active":"2023-10-09T11:44:11.256893+0000","last_became_peered":"2023-10-09T11:44:11.256893+0000","last_unstale":"2023-10-09T11:44:12.256442+0000","last_undegraded":"2023-10-09T11:44:12.256442+0000","last_fullsized":"2023-10-09T11:44:12.256442+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:38.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271958+0000","last_change":"2023-10-09T11:44:12.270119+0000","last_active":"2023-10-09T11:44:12.271958+0000","last_peered":"2023-10-09T11:44:12.271958+0000","last_clean":"2023-10-09T11:44:12.271958+0000","last_became_active":"2023-10-09T11:44:12.269860+0000","last_became_peered":"2023-10-09T11:44:12.269860+0000","last_unstale":"2023-10-09T11:44:12.271958+0000","last_undegraded":"2023-10-09T11:44:12.271958+0000","last_fullsized":"2023-10-09T11:44:12.271958+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268711+0000","last_change":"2023-10-09T11:44:12.265836+0000","last_active":"2023-10-09T11:44:12.268711+0000","last_peered":"2023-10-09T11:44:12.268711+0000","last_clean":"2023-10-09T11:44:12.268711+0000","last_became_active":"2023-10-09T11:44:12.265556+0000","last_became_peered":"2023-10-09T11:44:12.265556+0000","last_unstale":"2023-10-09T11:44:12.268711+0000","last_undegraded":"2023-10-09T11:44:12.268711+0000","last_fullsized":"2023-10-09T11:44:12.268711+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:44.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240889+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:45.101304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271533+0000","last_change":"2023-10-09T11:44:12.270361+0000","last_active":"2023-10-09T11:44:12.271533+0000","last_peered":"2023-10-09T11:44:12.271533+0000","last_clean":"2023-10-09T11:44:12.271533+0000","last_became_active":"2023-10-09T11:44:12.270098+0000","last_became_peered":"2023-10-09T11:44:12.270098+0000","last_unstale":"2023-10-09T11:44:12.271533+0000","last_undegraded":"2023-10-09T11:44:12.271533+0000","last_fullsized":"2023-10-09T11:44:12.271533+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:30.835127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259407+0000","last_change":"2023-10-09T11:44:11.251683+0000","last_active":"2023-10-09T11:44:12.259407+0000","last_peered":"2023-10-09T11:44:12.259407+0000","last_clean":"2023-10-09T11:44:12.259407+0000","last_became_active":"2023-10-09T11:44:11.251366+0000","last_became_peered":"2023-10-09T11:44:11.251366+0000","last_unstale":"2023-10-09T11:44:12.259407+0000","last_undegraded":"2023-10-09T11:44:12.259407+0000","last_fullsized":"2023-10-09T11:44:12.259407+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:32.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239082+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:57.315718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268852+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.268852+0000","last_peered":"2023-10-09T11:44:12.268852+0000","last_clean":"2023-10-09T11:44:12.268852+0000","last_became_active":"2023-10-09T11:44:12.266287+0000","last_became_peered":"2023-10-09T11:44:12.266287+0000","last_unstale":"2023-10-09T11:44:12.268852+0000","last_undegraded":"2023-10-09T11:44:12.268852+0000","last_fullsized":"2023-10-09T11:44:12.268852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:58.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239077+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":293,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-09T11:44:07.948923+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:07.948923+0000","last_peered":"2023-10-09T11:44:07.948923+0000","last_clean":"2023-10-09T11:44:07.948923+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:07.948923+0000","last_undegraded":"2023-10-09T11:44:07.948923+0000","last_fullsized":"2023-10-09T11:44:07.948923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542257,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304196,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067644,"statfs":{"total":96636764160,"available":96325267456,"internally_reserved":0,"allocated":2879488,"data_stored":1615464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.624},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.36599999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.59399999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.442}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.219},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.309}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308340,"kb_used_data":2860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063500,"statfs":{"total":96636764160,"available":96321024000,"internally_reserved":0,"allocated":2928640,"data_stored":1636314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1045034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1046556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.751}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.78200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:16.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:16.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 Processor -- start 2023-10-09T11:44:16.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 -- start start 2023-10-09T11:44:16.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 0x7f445c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f445c0cd9e0 0x7f445c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c15ae40 con 0x7f445c15a400 2023-10-09T11:44:16.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0d13f0 con 0x7f445c0cd9e0 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.559+0000 7f4461933700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c15ab60 con 0x7f445c0cb5a0 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f445c0cd9e0 0x7f445c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f445c15a400 0x7f445c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57012/0 (socket says 172.21.15.26:57012) 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445b7fe700 1 -- 172.21.15.26:0/2908710040 learned_addr learned my addr 172.21.15.26:0/2908710040 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445affd700 1 --2- 172.21.15.26:0/2908710040 >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 0x7f445c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 -- 172.21.15.26:0/2908710040 >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 msgr2=0x7f445c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 --2- 172.21.15.26:0/2908710040 >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 0x7f445c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 -- 172.21.15.26:0/2908710040 >> v1:172.21.15.26:6789/0 conn(0x7f445c15a400 legacy=0x7f445c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f4459ffb700 1 -- 172.21.15.26:0/2908710040 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367458394 0 0) 0x7f445c15ae40 con 0x7f445c15a400 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 -- 172.21.15.26:0/2908710040 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0ccf00 con 0x7f445c0cd9e0 2023-10-09T11:44:16.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445affd700 1 --2- 172.21.15.26:0/2908710040 >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 0x7f445c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f445a7fc700 1 --2- 172.21.15.26:0/2908710040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cd9e0 0x7f445c159ec0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f44440098e0 tx=0x7f44440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee81034575fb495f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f4459ffb700 1 -- 172.21.15.26:0/2908710040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444009e80 con 0x7f445c0cd9e0 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f4459ffb700 1 -- 172.21.15.26:0/2908710040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444400b820 con 0x7f445c0cd9e0 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.560+0000 7f4459ffb700 1 -- 172.21.15.26:0/2908710040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444400bba0 con 0x7f445c0cd9e0 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 -- 172.21.15.26:0/2908710040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cd9e0 msgr2=0x7f445c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 --2- 172.21.15.26:0/2908710040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cd9e0 0x7f445c159ec0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f44440098e0 tx=0x7f44440091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 -- 172.21.15.26:0/2908710040 shutdown_connections 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 --2- 172.21.15.26:0/2908710040 >> v2:172.21.15.67:3300/0 conn(0x7f445c0cb5a0 0x7f445c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 --2- 172.21.15.26:0/2908710040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cd9e0 0x7f445c159ec0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 -- 172.21.15.26:0/2908710040 >> 172.21.15.26:0/2908710040 conn(0x7f445c070e30 msgr2=0x7f445c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 -- 172.21.15.26:0/2908710040 shutdown_connections 2023-10-09T11:44:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.561+0000 7f4461933700 1 -- 172.21.15.26:0/2908710040 wait complete. 2023-10-09T11:44:16.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.562+0000 7f4461933700 1 Processor -- start 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.562+0000 7f4461933700 1 -- start start 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f445c0cd9e0 0x7f445c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f445c15a400 0x7f445c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c9810 con 0x7f445c0cb5a0 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c9af0 con 0x7f445c15a400 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f4461933700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c9dd0 con 0x7f445c0cd9e0 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40302/0 (socket says 172.21.15.26:40302) 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 -- 172.21.15.26:0/933977890 learned_addr learned my addr 172.21.15.26:0/933977890 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:16.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445b7fe700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f445c15a400 0x7f445c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445a7fc700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f445c0cd9e0 0x7f445c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 -- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f445c0cd9e0 msgr2=0x7f445c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f445c0cd9e0 0x7f445c0c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 -- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f445c15a400 msgr2=0x7f445c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f445c15a400 0x7f445c15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 -- 172.21.15.26:0/933977890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009420 con 0x7f445c0cb5a0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.563+0000 7f445affd700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f445400e8d0 tx=0x7f4454008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.564+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400ee70 con 0x7f445c0cb5a0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.564+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400c5e0 con 0x7f445c0cb5a0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.564+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400c980 con 0x7f445c0cb5a0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.564+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c0ca0b0 con 0x7f445c0cb5a0 2023-10-09T11:44:16.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.564+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c152820 con 0x7f445c0cb5a0 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.565+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c0b3680 con 0x7f445c0cb5a0 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.565+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4454013410 con 0x7f445c0cb5a0 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.565+0000 7f4452ffd700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 0x7f443c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.566+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4454084e10 con 0x7f445c0cb5a0 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.566+0000 7f445a7fc700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 0x7f443c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.566+0000 7f445a7fc700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 0x7f443c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f445c0cbc50 tx=0x7f4444017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.570+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4454088030 con 0x7f445c0cb5a0 2023-10-09T11:44:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.758+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f445c04c3c0 con 0x7f443c067320 2023-10-09T11:44:16.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.766+0000 7f4452ffd700 1 -- 172.21.15.26:0/933977890 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284571 (secure 0 0 0) 0x7f445c04c3c0 con 0x7f443c067320 2023-10-09T11:44:16.770 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 msgr2=0x7f443c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 0x7f443c0697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f445c0cbc50 tx=0x7f4444017000 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 msgr2=0x7f445c0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f445400e8d0 tx=0x7f4454008040 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 shutdown_connections 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.769+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f445c15a400 0x7f445c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c0cb5a0 0x7f445c0c8a40 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f443c067320 0x7f443c0697d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 --2- 172.21.15.26:0/933977890 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f445c0cd9e0 0x7f445c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 >> 172.21.15.26:0/933977890 conn(0x7f445c070e30 msgr2=0x7f445c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 shutdown_connections 2023-10-09T11:44:16.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.770+0000 7f4461933700 1 -- 172.21.15.26:0/933977890 wait complete. 2023-10-09T11:44:16.773 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:16.782 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-09T11:44:15.234451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434372,"kb_used_data":19204,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540348,"statfs":{"total":773094113280,"available":770601316352,"internally_reserved":0,"allocated":19664896,"data_stored":9463066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996492"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268780+0000","last_change":"2023-10-09T11:44:12.265095+0000","last_active":"2023-10-09T11:44:12.268780+0000","last_peered":"2023-10-09T11:44:12.268780+0000","last_clean":"2023-10-09T11:44:12.268780+0000","last_became_active":"2023-10-09T11:44:12.264811+0000","last_became_peered":"2023-10-09T11:44:12.264811+0000","last_unstale":"2023-10-09T11:44:12.268780+0000","last_undegraded":"2023-10-09T11:44:12.268780+0000","last_fullsized":"2023-10-09T11:44:12.268780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:50.460620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271517+0000","last_change":"2023-10-09T11:44:12.268131+0000","last_active":"2023-10-09T11:44:12.271517+0000","last_peered":"2023-10-09T11:44:12.271517+0000","last_clean":"2023-10-09T11:44:12.271517+0000","last_became_active":"2023-10-09T11:44:12.267795+0000","last_became_peered":"2023-10-09T11:44:12.267795+0000","last_unstale":"2023-10-09T11:44:12.271517+0000","last_undegraded":"2023-10-09T11:44:12.271517+0000","last_fullsized":"2023-10-09T11:44:12.271517+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:08.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273286+0000","last_change":"2023-10-09T11:44:12.271095+0000","last_active":"2023-10-09T11:44:12.273286+0000","last_peered":"2023-10-09T11:44:12.273286+0000","last_clean":"2023-10-09T11:44:12.273286+0000","last_became_active":"2023-10-09T11:44:12.270824+0000","last_became_peered":"2023-10-09T11:44:12.270824+0000","last_unstale":"2023-10-09T11:44:12.273286+0000","last_undegraded":"2023-10-09T11:44:12.273286+0000","last_fullsized":"2023-10-09T11:44:12.273286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278326+0000","last_change":"2023-10-09T11:44:12.277359+0000","last_active":"2023-10-09T11:44:12.278326+0000","last_peered":"2023-10-09T11:44:12.278326+0000","last_clean":"2023-10-09T11:44:12.278326+0000","last_became_active":"2023-10-09T11:44:12.277030+0000","last_became_peered":"2023-10-09T11:44:12.277030+0000","last_unstale":"2023-10-09T11:44:12.278326+0000","last_undegraded":"2023-10-09T11:44:12.278326+0000","last_fullsized":"2023-10-09T11:44:12.278326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:32.137710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281252+0000","last_change":"2023-10-09T11:44:12.280836+0000","last_active":"2023-10-09T11:44:12.281252+0000","last_peered":"2023-10-09T11:44:12.281252+0000","last_clean":"2023-10-09T11:44:12.281252+0000","last_became_active":"2023-10-09T11:44:12.280543+0000","last_became_peered":"2023-10-09T11:44:12.280543+0000","last_unstale":"2023-10-09T11:44:12.281252+0000","last_undegraded":"2023-10-09T11:44:12.281252+0000","last_fullsized":"2023-10-09T11:44:12.281252+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283142+0000","last_change":"2023-10-09T11:44:12.282782+0000","last_active":"2023-10-09T11:44:12.283142+0000","last_peered":"2023-10-09T11:44:12.283142+0000","last_clean":"2023-10-09T11:44:12.283142+0000","last_became_active":"2023-10-09T11:44:12.282522+0000","last_became_peered":"2023-10-09T11:44:12.282522+0000","last_unstale":"2023-10-09T11:44:12.283142+0000","last_undegraded":"2023-10-09T11:44:12.283142+0000","last_fullsized":"2023-10-09T11:44:12.283142+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:05.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270666+0000","last_change":"2023-10-09T11:44:12.269473+0000","last_active":"2023-10-09T11:44:12.270666+0000","last_peered":"2023-10-09T11:44:12.270666+0000","last_clean":"2023-10-09T11:44:12.270666+0000","last_became_active":"2023-10-09T11:44:12.269237+0000","last_became_peered":"2023-10-09T11:44:12.269237+0000","last_unstale":"2023-10-09T11:44:12.270666+0000","last_undegraded":"2023-10-09T11:44:12.270666+0000","last_fullsized":"2023-10-09T11:44:12.270666+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273839+0000","last_change":"2023-10-09T11:44:12.272512+0000","last_active":"2023-10-09T11:44:12.273839+0000","last_peered":"2023-10-09T11:44:12.273839+0000","last_clean":"2023-10-09T11:44:12.273839+0000","last_became_active":"2023-10-09T11:44:12.272231+0000","last_became_peered":"2023-10-09T11:44:12.272231+0000","last_unstale":"2023-10-09T11:44:12.273839+0000","last_undegraded":"2023-10-09T11:44:12.273839+0000","last_fullsized":"2023-10-09T11:44:12.273839+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278371+0000","last_change":"2023-10-09T11:44:12.277523+0000","last_active":"2023-10-09T11:44:12.278371+0000","last_peered":"2023-10-09T11:44:12.278371+0000","last_clean":"2023-10-09T11:44:12.278371+0000","last_became_active":"2023-10-09T11:44:12.277208+0000","last_became_peered":"2023-10-09T11:44:12.277208+0000","last_unstale":"2023-10-09T11:44:12.278371+0000","last_undegraded":"2023-10-09T11:44:12.278371+0000","last_fullsized":"2023-10-09T11:44:12.278371+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.272691+0000","last_change":"2023-10-09T11:44:12.271664+0000","last_active":"2023-10-09T11:44:12.272691+0000","last_peered":"2023-10-09T11:44:12.272691+0000","last_clean":"2023-10-09T11:44:12.272691+0000","last_became_active":"2023-10-09T11:44:12.271378+0000","last_became_peered":"2023-10-09T11:44:12.271378+0000","last_unstale":"2023-10-09T11:44:12.272691+0000","last_undegraded":"2023-10-09T11:44:12.272691+0000","last_fullsized":"2023-10-09T11:44:12.272691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269835+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.269835+0000","last_peered":"2023-10-09T11:44:12.269835+0000","last_clean":"2023-10-09T11:44:12.269835+0000","last_became_active":"2023-10-09T11:44:12.266282+0000","last_became_peered":"2023-10-09T11:44:12.266282+0000","last_unstale":"2023-10-09T11:44:12.269835+0000","last_undegraded":"2023-10-09T11:44:12.269835+0000","last_fullsized":"2023-10-09T11:44:12.269835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:49.065836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.263811+0000","last_change":"2023-10-09T11:44:12.262564+0000","last_active":"2023-10-09T11:44:12.263811+0000","last_peered":"2023-10-09T11:44:12.263811+0000","last_clean":"2023-10-09T11:44:12.263811+0000","last_became_active":"2023-10-09T11:44:12.262269+0000","last_became_peered":"2023-10-09T11:44:12.262269+0000","last_unstale":"2023-10-09T11:44:12.263811+0000","last_undegraded":"2023-10-09T11:44:12.263811+0000","last_fullsized":"2023-10-09T11:44:12.263811+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:17.384685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274003+0000","last_change":"2023-10-09T11:44:12.273270+0000","last_active":"2023-10-09T11:44:12.274003+0000","last_peered":"2023-10-09T11:44:12.274003+0000","last_clean":"2023-10-09T11:44:12.274003+0000","last_became_active":"2023-10-09T11:44:12.272950+0000","last_became_peered":"2023-10-09T11:44:12.272950+0000","last_unstale":"2023-10-09T11:44:12.274003+0000","last_undegraded":"2023-10-09T11:44:12.274003+0000","last_fullsized":"2023-10-09T11:44:12.274003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.518058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267250+0000","last_change":"2023-10-09T11:44:12.264884+0000","last_active":"2023-10-09T11:44:12.267250+0000","last_peered":"2023-10-09T11:44:12.267250+0000","last_clean":"2023-10-09T11:44:12.267250+0000","last_became_active":"2023-10-09T11:44:12.264602+0000","last_became_peered":"2023-10-09T11:44:12.264602+0000","last_unstale":"2023-10-09T11:44:12.267250+0000","last_undegraded":"2023-10-09T11:44:12.267250+0000","last_fullsized":"2023-10-09T11:44:12.267250+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:03.929742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273284+0000","last_change":"2023-10-09T11:44:12.271739+0000","last_active":"2023-10-09T11:44:12.273284+0000","last_peered":"2023-10-09T11:44:12.273284+0000","last_clean":"2023-10-09T11:44:12.273284+0000","last_became_active":"2023-10-09T11:44:12.271461+0000","last_became_peered":"2023-10-09T11:44:12.271461+0000","last_unstale":"2023-10-09T11:44:12.273284+0000","last_undegraded":"2023-10-09T11:44:12.273284+0000","last_fullsized":"2023-10-09T11:44:12.273284+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:36.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274785+0000","last_change":"2023-10-09T11:44:12.273174+0000","last_active":"2023-10-09T11:44:12.274785+0000","last_peered":"2023-10-09T11:44:12.274785+0000","last_clean":"2023-10-09T11:44:12.274785+0000","last_became_active":"2023-10-09T11:44:12.272914+0000","last_became_peered":"2023-10-09T11:44:12.272914+0000","last_unstale":"2023-10-09T11:44:12.274785+0000","last_undegraded":"2023-10-09T11:44:12.274785+0000","last_fullsized":"2023-10-09T11:44:12.274785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270511+0000","last_change":"2023-10-09T11:44:12.269715+0000","last_active":"2023-10-09T11:44:12.270511+0000","last_peered":"2023-10-09T11:44:12.270511+0000","last_clean":"2023-10-09T11:44:12.270511+0000","last_became_active":"2023-10-09T11:44:12.269364+0000","last_became_peered":"2023-10-09T11:44:12.269364+0000","last_unstale":"2023-10-09T11:44:12.270511+0000","last_undegraded":"2023-10-09T11:44:12.270511+0000","last_fullsized":"2023-10-09T11:44:12.270511+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282933+0000","last_change":"2023-10-09T11:44:12.282608+0000","last_active":"2023-10-09T11:44:12.282933+0000","last_peered":"2023-10-09T11:44:12.282933+0000","last_clean":"2023-10-09T11:44:12.282933+0000","last_became_active":"2023-10-09T11:44:12.282260+0000","last_became_peered":"2023-10-09T11:44:12.282260+0000","last_unstale":"2023-10-09T11:44:12.282933+0000","last_undegraded":"2023-10-09T11:44:12.282933+0000","last_fullsized":"2023-10-09T11:44:12.282933+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278541+0000","last_change":"2023-10-09T11:44:12.276888+0000","last_active":"2023-10-09T11:44:12.278541+0000","last_peered":"2023-10-09T11:44:12.278541+0000","last_clean":"2023-10-09T11:44:12.278541+0000","last_became_active":"2023-10-09T11:44:12.276610+0000","last_became_peered":"2023-10-09T11:44:12.276610+0000","last_unstale":"2023-10-09T11:44:12.278541+0000","last_undegraded":"2023-10-09T11:44:12.278541+0000","last_fullsized":"2023-10-09T11:44:12.278541+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271095+0000","last_change":"2023-10-09T11:44:12.267810+0000","last_active":"2023-10-09T11:44:12.271095+0000","last_peered":"2023-10-09T11:44:12.271095+0000","last_clean":"2023-10-09T11:44:12.271095+0000","last_became_active":"2023-10-09T11:44:12.266902+0000","last_became_peered":"2023-10-09T11:44:12.266902+0000","last_unstale":"2023-10-09T11:44:12.271095+0000","last_undegraded":"2023-10-09T11:44:12.271095+0000","last_fullsized":"2023-10-09T11:44:12.271095+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298440+0000","last_change":"2023-10-09T11:44:11.254907+0000","last_active":"2023-10-09T11:44:12.298440+0000","last_peered":"2023-10-09T11:44:12.298440+0000","last_clean":"2023-10-09T11:44:12.298440+0000","last_became_active":"2023-10-09T11:44:11.254645+0000","last_became_peered":"2023-10-09T11:44:11.254645+0000","last_unstale":"2023-10-09T11:44:12.298440+0000","last_undegraded":"2023-10-09T11:44:12.298440+0000","last_fullsized":"2023-10-09T11:44:12.298440+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:12.461779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240217+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:40.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281715+0000","last_change":"2023-10-09T11:44:12.281389+0000","last_active":"2023-10-09T11:44:12.281715+0000","last_peered":"2023-10-09T11:44:12.281715+0000","last_clean":"2023-10-09T11:44:12.281715+0000","last_became_active":"2023-10-09T11:44:12.281155+0000","last_became_peered":"2023-10-09T11:44:12.281155+0000","last_unstale":"2023-10-09T11:44:12.281715+0000","last_undegraded":"2023-10-09T11:44:12.281715+0000","last_fullsized":"2023-10-09T11:44:12.281715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:34.148015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298886+0000","last_change":"2023-10-09T11:44:11.255393+0000","last_active":"2023-10-09T11:44:12.298886+0000","last_peered":"2023-10-09T11:44:12.298886+0000","last_clean":"2023-10-09T11:44:12.298886+0000","last_became_active":"2023-10-09T11:44:11.255123+0000","last_became_peered":"2023-10-09T11:44:11.255123+0000","last_unstale":"2023-10-09T11:44:12.298886+0000","last_undegraded":"2023-10-09T11:44:12.298886+0000","last_fullsized":"2023-10-09T11:44:12.298886+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.717853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267036+0000","last_change":"2023-10-09T11:44:12.266273+0000","last_active":"2023-10-09T11:44:12.267036+0000","last_peered":"2023-10-09T11:44:12.267036+0000","last_clean":"2023-10-09T11:44:12.267036+0000","last_became_active":"2023-10-09T11:44:12.266008+0000","last_became_peered":"2023-10-09T11:44:12.266008+0000","last_unstale":"2023-10-09T11:44:12.267036+0000","last_undegraded":"2023-10-09T11:44:12.267036+0000","last_fullsized":"2023-10-09T11:44:12.267036+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:50.221128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.243484+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295663+0000","last_change":"2023-10-09T11:44:11.248115+0000","last_active":"2023-10-09T11:44:12.295663+0000","last_peered":"2023-10-09T11:44:12.295663+0000","last_clean":"2023-10-09T11:44:12.295663+0000","last_became_active":"2023-10-09T11:44:11.247830+0000","last_became_peered":"2023-10-09T11:44:11.247830+0000","last_unstale":"2023-10-09T11:44:12.295663+0000","last_undegraded":"2023-10-09T11:44:12.295663+0000","last_fullsized":"2023-10-09T11:44:12.295663+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:34.353464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278563+0000","last_change":"2023-10-09T11:44:12.277707+0000","last_active":"2023-10-09T11:44:12.278563+0000","last_peered":"2023-10-09T11:44:12.278563+0000","last_clean":"2023-10-09T11:44:12.278563+0000","last_became_active":"2023-10-09T11:44:12.277006+0000","last_became_peered":"2023-10-09T11:44:12.277006+0000","last_unstale":"2023-10-09T11:44:12.278563+0000","last_undegraded":"2023-10-09T11:44:12.278563+0000","last_fullsized":"2023-10-09T11:44:12.278563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259291+0000","last_change":"2023-10-09T11:44:11.252418+0000","last_active":"2023-10-09T11:44:12.259291+0000","last_peered":"2023-10-09T11:44:12.259291+0000","last_clean":"2023-10-09T11:44:12.259291+0000","last_became_active":"2023-10-09T11:44:11.252160+0000","last_became_peered":"2023-10-09T11:44:11.252160+0000","last_unstale":"2023-10-09T11:44:12.259291+0000","last_undegraded":"2023-10-09T11:44:12.259291+0000","last_fullsized":"2023-10-09T11:44:12.259291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:48.365961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259179+0000","last_change":"2023-10-09T11:44:11.252816+0000","last_active":"2023-10-09T11:44:12.259179+0000","last_peered":"2023-10-09T11:44:12.259179+0000","last_clean":"2023-10-09T11:44:12.259179+0000","last_became_active":"2023-10-09T11:44:11.252549+0000","last_became_peered":"2023-10-09T11:44:11.252549+0000","last_unstale":"2023-10-09T11:44:12.259179+0000","last_undegraded":"2023-10-09T11:44:12.259179+0000","last_fullsized":"2023-10-09T11:44:12.259179+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:48.710847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255963+0000","last_change":"2023-10-09T11:44:11.252364+0000","last_active":"2023-10-09T11:44:12.255963+0000","last_peered":"2023-10-09T11:44:12.255963+0000","last_clean":"2023-10-09T11:44:12.255963+0000","last_became_active":"2023-10-09T11:44:11.252051+0000","last_became_peered":"2023-10-09T11:44:11.252051+0000","last_unstale":"2023-10-09T11:44:12.255963+0000","last_undegraded":"2023-10-09T11:44:12.255963+0000","last_fullsized":"2023-10-09T11:44:12.255963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:57.149728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.260595+0000","last_change":"2023-10-09T11:44:11.253569+0000","last_active":"2023-10-09T11:44:12.260595+0000","last_peered":"2023-10-09T11:44:12.260595+0000","last_clean":"2023-10-09T11:44:12.260595+0000","last_became_active":"2023-10-09T11:44:11.253257+0000","last_became_peered":"2023-10-09T11:44:11.253257+0000","last_unstale":"2023-10-09T11:44:12.260595+0000","last_undegraded":"2023-10-09T11:44:12.260595+0000","last_fullsized":"2023-10-09T11:44:12.260595+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:36.301961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273860+0000","last_change":"2023-10-09T11:44:12.272569+0000","last_active":"2023-10-09T11:44:12.273860+0000","last_peered":"2023-10-09T11:44:12.273860+0000","last_clean":"2023-10-09T11:44:12.273860+0000","last_became_active":"2023-10-09T11:44:12.272276+0000","last_became_peered":"2023-10-09T11:44:12.272276+0000","last_unstale":"2023-10-09T11:44:12.273860+0000","last_undegraded":"2023-10-09T11:44:12.273860+0000","last_fullsized":"2023-10-09T11:44:12.273860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240987+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:44.619299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.299977+0000","last_change":"2023-10-09T11:44:11.250362+0000","last_active":"2023-10-09T11:44:12.299977+0000","last_peered":"2023-10-09T11:44:12.299977+0000","last_clean":"2023-10-09T11:44:12.299977+0000","last_became_active":"2023-10-09T11:44:11.249947+0000","last_became_peered":"2023-10-09T11:44:11.249947+0000","last_unstale":"2023-10-09T11:44:12.299977+0000","last_undegraded":"2023-10-09T11:44:12.299977+0000","last_fullsized":"2023-10-09T11:44:12.299977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.024197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267426+0000","last_change":"2023-10-09T11:44:12.266628+0000","last_active":"2023-10-09T11:44:12.267426+0000","last_peered":"2023-10-09T11:44:12.267426+0000","last_clean":"2023-10-09T11:44:12.267426+0000","last_became_active":"2023-10-09T11:44:12.266365+0000","last_became_peered":"2023-10-09T11:44:12.266365+0000","last_unstale":"2023-10-09T11:44:12.267426+0000","last_undegraded":"2023-10-09T11:44:12.267426+0000","last_fullsized":"2023-10-09T11:44:12.267426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:41.693514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242467+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:39.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241499+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:57.072034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241253+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:42.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.309647+0000","last_change":"2023-10-09T11:44:11.252250+0000","last_active":"2023-10-09T11:44:12.309647+0000","last_peered":"2023-10-09T11:44:12.309647+0000","last_clean":"2023-10-09T11:44:12.309647+0000","last_became_active":"2023-10-09T11:44:11.251901+0000","last_became_peered":"2023-10-09T11:44:11.251901+0000","last_unstale":"2023-10-09T11:44:12.309647+0000","last_undegraded":"2023-10-09T11:44:12.309647+0000","last_fullsized":"2023-10-09T11:44:12.309647+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:10.090035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298209+0000","last_change":"2023-10-09T11:44:11.258244+0000","last_active":"2023-10-09T11:44:12.298209+0000","last_peered":"2023-10-09T11:44:12.298209+0000","last_clean":"2023-10-09T11:44:12.298209+0000","last_became_active":"2023-10-09T11:44:11.257906+0000","last_became_peered":"2023-10-09T11:44:11.257906+0000","last_unstale":"2023-10-09T11:44:12.298209+0000","last_undegraded":"2023-10-09T11:44:12.298209+0000","last_fullsized":"2023-10-09T11:44:12.298209+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:05:41.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296867+0000","last_change":"2023-10-09T11:44:11.248480+0000","last_active":"2023-10-09T11:44:12.296867+0000","last_peered":"2023-10-09T11:44:12.296867+0000","last_clean":"2023-10-09T11:44:12.296867+0000","last_became_active":"2023-10-09T11:44:11.248222+0000","last_became_peered":"2023-10-09T11:44:11.248222+0000","last_unstale":"2023-10-09T11:44:12.296867+0000","last_undegraded":"2023-10-09T11:44:12.296867+0000","last_fullsized":"2023-10-09T11:44:12.296867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.459928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271463+0000","last_change":"2023-10-09T11:44:12.269495+0000","last_active":"2023-10-09T11:44:12.271463+0000","last_peered":"2023-10-09T11:44:12.271463+0000","last_clean":"2023-10-09T11:44:12.271463+0000","last_became_active":"2023-10-09T11:44:12.269229+0000","last_became_peered":"2023-10-09T11:44:12.269229+0000","last_unstale":"2023-10-09T11:44:12.271463+0000","last_undegraded":"2023-10-09T11:44:12.271463+0000","last_fullsized":"2023-10-09T11:44:12.271463+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239659+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284050+0000","last_change":"2023-10-09T11:44:12.283601+0000","last_active":"2023-10-09T11:44:12.284050+0000","last_peered":"2023-10-09T11:44:12.284050+0000","last_clean":"2023-10-09T11:44:12.284050+0000","last_became_active":"2023-10-09T11:44:12.283374+0000","last_became_peered":"2023-10-09T11:44:12.283374+0000","last_unstale":"2023-10-09T11:44:12.284050+0000","last_undegraded":"2023-10-09T11:44:12.284050+0000","last_fullsized":"2023-10-09T11:44:12.284050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:09.075683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242501+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:55.918892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269913+0000","last_change":"2023-10-09T11:44:12.266466+0000","last_active":"2023-10-09T11:44:12.269913+0000","last_peered":"2023-10-09T11:44:12.269913+0000","last_clean":"2023-10-09T11:44:12.269913+0000","last_became_active":"2023-10-09T11:44:12.266180+0000","last_became_peered":"2023-10-09T11:44:12.266180+0000","last_unstale":"2023-10-09T11:44:12.269913+0000","last_undegraded":"2023-10-09T11:44:12.269913+0000","last_fullsized":"2023-10-09T11:44:12.269913+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.294921+0000","last_change":"2023-10-09T11:44:11.258567+0000","last_active":"2023-10-09T11:44:12.294921+0000","last_peered":"2023-10-09T11:44:12.294921+0000","last_clean":"2023-10-09T11:44:12.294921+0000","last_became_active":"2023-10-09T11:44:11.258262+0000","last_became_peered":"2023-10-09T11:44:11.258262+0000","last_unstale":"2023-10-09T11:44:12.294921+0000","last_undegraded":"2023-10-09T11:44:12.294921+0000","last_fullsized":"2023-10-09T11:44:12.294921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:41.584422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271493+0000","last_change":"2023-10-09T11:44:12.270382+0000","last_active":"2023-10-09T11:44:12.271493+0000","last_peered":"2023-10-09T11:44:12.271493+0000","last_clean":"2023-10-09T11:44:12.271493+0000","last_became_active":"2023-10-09T11:44:12.270128+0000","last_became_peered":"2023-10-09T11:44:12.270128+0000","last_unstale":"2023-10-09T11:44:12.271493+0000","last_undegraded":"2023-10-09T11:44:12.271493+0000","last_fullsized":"2023-10-09T11:44:12.271493+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:28.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239119+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:05.361683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239679+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:29.247637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255762+0000","last_change":"2023-10-09T11:44:11.256911+0000","last_active":"2023-10-09T11:44:12.255762+0000","last_peered":"2023-10-09T11:44:12.255762+0000","last_clean":"2023-10-09T11:44:12.255762+0000","last_became_active":"2023-10-09T11:44:11.256623+0000","last_became_peered":"2023-10-09T11:44:11.256623+0000","last_unstale":"2023-10-09T11:44:12.255762+0000","last_undegraded":"2023-10-09T11:44:12.255762+0000","last_fullsized":"2023-10-09T11:44:12.255762+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:55.284864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296150+0000","last_change":"2023-10-09T11:44:11.250873+0000","last_active":"2023-10-09T11:44:12.296150+0000","last_peered":"2023-10-09T11:44:12.296150+0000","last_clean":"2023-10-09T11:44:12.296150+0000","last_became_active":"2023-10-09T11:44:11.250597+0000","last_became_peered":"2023-10-09T11:44:11.250597+0000","last_unstale":"2023-10-09T11:44:12.296150+0000","last_undegraded":"2023-10-09T11:44:12.296150+0000","last_fullsized":"2023-10-09T11:44:12.296150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:32.783621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:40.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278495+0000","last_change":"2023-10-09T11:44:12.277527+0000","last_active":"2023-10-09T11:44:12.278495+0000","last_peered":"2023-10-09T11:44:12.278495+0000","last_clean":"2023-10-09T11:44:12.278495+0000","last_became_active":"2023-10-09T11:44:12.277236+0000","last_became_peered":"2023-10-09T11:44:12.277236+0000","last_unstale":"2023-10-09T11:44:12.278495+0000","last_undegraded":"2023-10-09T11:44:12.278495+0000","last_fullsized":"2023-10-09T11:44:12.278495+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:49.722879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255955+0000","last_change":"2023-10-09T11:44:11.252839+0000","last_active":"2023-10-09T11:44:12.255955+0000","last_peered":"2023-10-09T11:44:12.255955+0000","last_clean":"2023-10-09T11:44:12.255955+0000","last_became_active":"2023-10-09T11:44:11.252571+0000","last_became_peered":"2023-10-09T11:44:11.252571+0000","last_unstale":"2023-10-09T11:44:12.255955+0000","last_undegraded":"2023-10-09T11:44:12.255955+0000","last_fullsized":"2023-10-09T11:44:12.255955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:04.073378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.256442+0000","last_change":"2023-10-09T11:44:11.257159+0000","last_active":"2023-10-09T11:44:12.256442+0000","last_peered":"2023-10-09T11:44:12.256442+0000","last_clean":"2023-10-09T11:44:12.256442+0000","last_became_active":"2023-10-09T11:44:11.256893+0000","last_became_peered":"2023-10-09T11:44:11.256893+0000","last_unstale":"2023-10-09T11:44:12.256442+0000","last_undegraded":"2023-10-09T11:44:12.256442+0000","last_fullsized":"2023-10-09T11:44:12.256442+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:38.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271958+0000","last_change":"2023-10-09T11:44:12.270119+0000","last_active":"2023-10-09T11:44:12.271958+0000","last_peered":"2023-10-09T11:44:12.271958+0000","last_clean":"2023-10-09T11:44:12.271958+0000","last_became_active":"2023-10-09T11:44:12.269860+0000","last_became_peered":"2023-10-09T11:44:12.269860+0000","last_unstale":"2023-10-09T11:44:12.271958+0000","last_undegraded":"2023-10-09T11:44:12.271958+0000","last_fullsized":"2023-10-09T11:44:12.271958+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268711+0000","last_change":"2023-10-09T11:44:12.265836+0000","last_active":"2023-10-09T11:44:12.268711+0000","last_peered":"2023-10-09T11:44:12.268711+0000","last_clean":"2023-10-09T11:44:12.268711+0000","last_became_active":"2023-10-09T11:44:12.265556+0000","last_became_peered":"2023-10-09T11:44:12.265556+0000","last_unstale":"2023-10-09T11:44:12.268711+0000","last_undegraded":"2023-10-09T11:44:12.268711+0000","last_fullsized":"2023-10-09T11:44:12.268711+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:44.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240889+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:45.101304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271533+0000","last_change":"2023-10-09T11:44:12.270361+0000","last_active":"2023-10-09T11:44:12.271533+0000","last_peered":"2023-10-09T11:44:12.271533+0000","last_clean":"2023-10-09T11:44:12.271533+0000","last_became_active":"2023-10-09T11:44:12.270098+0000","last_became_peered":"2023-10-09T11:44:12.270098+0000","last_unstale":"2023-10-09T11:44:12.271533+0000","last_undegraded":"2023-10-09T11:44:12.271533+0000","last_fullsized":"2023-10-09T11:44:12.271533+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:30.835127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259407+0000","last_change":"2023-10-09T11:44:11.251683+0000","last_active":"2023-10-09T11:44:12.259407+0000","last_peered":"2023-10-09T11:44:12.259407+0000","last_clean":"2023-10-09T11:44:12.259407+0000","last_became_active":"2023-10-09T11:44:11.251366+0000","last_became_peered":"2023-10-09T11:44:11.251366+0000","last_unstale":"2023-10-09T11:44:12.259407+0000","last_undegraded":"2023-10-09T11:44:12.259407+0000","last_fullsized":"2023-10-09T11:44:12.259407+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:32.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239082+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:57.315718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268852+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.268852+0000","last_peered":"2023-10-09T11:44:12.268852+0000","last_clean":"2023-10-09T11:44:12.268852+0000","last_became_active":"2023-10-09T11:44:12.266287+0000","last_became_peered":"2023-10-09T11:44:12.266287+0000","last_unstale":"2023-10-09T11:44:12.268852+0000","last_undegraded":"2023-10-09T11:44:12.268852+0000","last_fullsized":"2023-10-09T11:44:12.268852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:58.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239077+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":293,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-09T11:44:07.948923+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:07.948923+0000","last_peered":"2023-10-09T11:44:07.948923+0000","last_clean":"2023-10-09T11:44:07.948923+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:07.948923+0000","last_undegraded":"2023-10-09T11:44:07.948923+0000","last_fullsized":"2023-10-09T11:44:07.948923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542257,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304196,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067644,"statfs":{"total":96636764160,"available":96325267456,"internally_reserved":0,"allocated":2879488,"data_stored":1615464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.624},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.36599999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.59399999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.442}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.219},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.309}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308340,"kb_used_data":2860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063500,"statfs":{"total":96636764160,"available":96321024000,"internally_reserved":0,"allocated":2928640,"data_stored":1636314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1045034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1046556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.751}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.78200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:16.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.941+0000 7f475f6ee700 1 Processor -- start 2023-10-09T11:44:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.942+0000 7f475f6ee700 1 -- start start 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.942+0000 7f475f6ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f47580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.942+0000 7f475f6ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475815ae40 con 0x7f47580cd9e0 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.942+0000 7f475f6ee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475815ab60 con 0x7f47580cde50 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.942+0000 7f475f6ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580d13f0 con 0x7f47580cb5a0 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475cc89700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f47580cd9e0 0x7f4758159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57016/0 (socket says 172.21.15.26:57016) 2023-10-09T11:44:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475cc89700 1 -- 172.21.15.26:0/3168122159 learned_addr learned my addr 172.21.15.26:0/3168122159 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374360841 0 0) 0x7f475815ae40 con 0x7f47580cd9e0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740003570 con 0x7f47580cd9e0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475d48a700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f47580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1896293654 0 0) 0x7f4740003570 con 0x7f47580cd9e0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 msgr2=0x7f47580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f47580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 >> v1:172.21.15.67:6789/0 conn(0x7f47580cde50 legacy=0x7f4758156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580ccf00 con 0x7f47580cd9e0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f474c001470 con 0x7f47580cd9e0 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 >> v1:172.21.15.26:6789/0 conn(0x7f47580cd9e0 legacy=0x7f4758159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4740003a90 0x7f4740003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f4740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f474000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400054f0 con 0x7f4740004810 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740005660 con 0x7f4740003a90 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474000bfa0 con 0x7f47580cb5a0 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475cc89700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f4740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475d48a700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4740003a90 0x7f4740003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.943+0000 7f475dc8b700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f474000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 -- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 msgr2=0x7f474000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f474000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 -- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4740003a90 msgr2=0x7f4740003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4740003a90 0x7f4740003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 -- 172.21.15.26:0/3168122159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740003570 con 0x7f4740004810 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475dc8b700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580cb5a0 0x7f474000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475cc89700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f4740004c80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c300 tx=0x7f474c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11fe6f206695ad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00cb90 con 0x7f4740004810 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00cd10 con 0x7f4740004810 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f4757fff700 1 -- 172.21.15.26:0/3168122159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c005b70 con 0x7f4740004810 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475f6ee700 1 -- 172.21.15.26:0/3168122159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 msgr2=0x7f4740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3168122159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f4740004c80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c300 tx=0x7f474c001d80 comp rx=0 tx=0).stop 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475dc8b700 1 -- 172.21.15.26:0/3168122159 reap_dead start 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475f6ee700 1 -- 172.21.15.26:0/3168122159 shutdown_connections 2023-10-09T11:44:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.944+0000 7f475f6ee700 1 -- 172.21.15.26:0/3168122159 >> 172.21.15.26:0/3168122159 conn(0x7f4758070e30 msgr2=0x7f47580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.945+0000 7f475f6ee700 1 -- 172.21.15.26:0/3168122159 shutdown_connections 2023-10-09T11:44:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.945+0000 7f475f6ee700 1 -- 172.21.15.26:0/3168122159 wait complete. 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.946+0000 7f475f6ee700 1 Processor -- start 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.946+0000 7f475f6ee700 1 -- start start 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.946+0000 7f475f6ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.946+0000 7f475f6ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4758156ac0 0x7f47580c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.946+0000 7f475f6ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580c7db0 0x7f4758156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475f6ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815d390 con 0x7f4740004810 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475f6ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758157bd0 con 0x7f4758156ac0 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475f6ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475816e0e0 con 0x7f47580c7db0 2023-10-09T11:44:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40328/0 (socket says 172.21.15.26:40328) 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 -- 172.21.15.26:0/3087229628 learned_addr learned my addr 172.21.15.26:0/3087229628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475dc8b700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580c7db0 0x7f4758156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475cc89700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4758156ac0 0x7f47580c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 -- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580c7db0 msgr2=0x7f4758156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580c7db0 0x7f4758156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 -- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4758156ac0 msgr2=0x7f47580c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4758156ac0 0x7f47580c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 -- 172.21.15.26:0/3087229628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758156fc0 con 0x7f4740004810 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475d48a700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4750010d00 tx=0x7f4750008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000eae0 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475000ec40 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47581572a0 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750014430 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.947+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4758157860 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.948+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475815a7a0 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.949+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4750014820 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.949+0000 7f47557fa700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 0x7f47440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.949+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47500855c0 con 0x7f4740004810 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.949+0000 7f475cc89700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 0x7f47440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.950+0000 7f475cc89700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 0x7f47440697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c220 tx=0x7f474c015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:16.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:16.953+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4750052250 con 0x7f4740004810 2023-10-09T11:44:17.099 INFO:tasks.ceph.mds.d.smithi067.stderr:2023-10-09T11:44:17.098+0000 7ff37a0a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:44:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.144+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f475804c3c0 con 0x7f4744067320 2023-10-09T11:44:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.152+0000 7f47557fa700 1 -- 172.21.15.26:0/3087229628 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284571 (secure 0 0 0) 0x7f475804c3c0 con 0x7f4744067320 2023-10-09T11:44:17.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 msgr2=0x7f47440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 0x7f47440697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c220 tx=0x7f474c015000 comp rx=0 tx=0).stop 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 msgr2=0x7f475816dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4750010d00 tx=0x7f4750008040 comp rx=0 tx=0).stop 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 shutdown_connections 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4744067320 0x7f47440697d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f47580c7db0 0x7f4758156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4740004810 0x7f475816dba0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 --2- 172.21.15.26:0/3087229628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4758156ac0 0x7f47580c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 >> 172.21.15.26:0/3087229628 conn(0x7f4758070e30 msgr2=0x7f47580b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 shutdown_connections 2023-10-09T11:44:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.156+0000 7f475f6ee700 1 -- 172.21.15.26:0/3087229628 wait complete. 2023-10-09T11:44:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:17.168 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-09T11:44:15.234451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434372,"kb_used_data":19204,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540348,"statfs":{"total":773094113280,"available":770601316352,"internally_reserved":0,"allocated":19664896,"data_stored":9463066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996492"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268780+0000","last_change":"2023-10-09T11:44:12.265095+0000","last_active":"2023-10-09T11:44:12.268780+0000","last_peered":"2023-10-09T11:44:12.268780+0000","last_clean":"2023-10-09T11:44:12.268780+0000","last_became_active":"2023-10-09T11:44:12.264811+0000","last_became_peered":"2023-10-09T11:44:12.264811+0000","last_unstale":"2023-10-09T11:44:12.268780+0000","last_undegraded":"2023-10-09T11:44:12.268780+0000","last_fullsized":"2023-10-09T11:44:12.268780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:50.460620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271517+0000","last_change":"2023-10-09T11:44:12.268131+0000","last_active":"2023-10-09T11:44:12.271517+0000","last_peered":"2023-10-09T11:44:12.271517+0000","last_clean":"2023-10-09T11:44:12.271517+0000","last_became_active":"2023-10-09T11:44:12.267795+0000","last_became_peered":"2023-10-09T11:44:12.267795+0000","last_unstale":"2023-10-09T11:44:12.271517+0000","last_undegraded":"2023-10-09T11:44:12.271517+0000","last_fullsized":"2023-10-09T11:44:12.271517+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:08.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273286+0000","last_change":"2023-10-09T11:44:12.271095+0000","last_active":"2023-10-09T11:44:12.273286+0000","last_peered":"2023-10-09T11:44:12.273286+0000","last_clean":"2023-10-09T11:44:12.273286+0000","last_became_active":"2023-10-09T11:44:12.270824+0000","last_became_peered":"2023-10-09T11:44:12.270824+0000","last_unstale":"2023-10-09T11:44:12.273286+0000","last_undegraded":"2023-10-09T11:44:12.273286+0000","last_fullsized":"2023-10-09T11:44:12.273286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278326+0000","last_change":"2023-10-09T11:44:12.277359+0000","last_active":"2023-10-09T11:44:12.278326+0000","last_peered":"2023-10-09T11:44:12.278326+0000","last_clean":"2023-10-09T11:44:12.278326+0000","last_became_active":"2023-10-09T11:44:12.277030+0000","last_became_peered":"2023-10-09T11:44:12.277030+0000","last_unstale":"2023-10-09T11:44:12.278326+0000","last_undegraded":"2023-10-09T11:44:12.278326+0000","last_fullsized":"2023-10-09T11:44:12.278326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:32.137710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281252+0000","last_change":"2023-10-09T11:44:12.280836+0000","last_active":"2023-10-09T11:44:12.281252+0000","last_peered":"2023-10-09T11:44:12.281252+0000","last_clean":"2023-10-09T11:44:12.281252+0000","last_became_active":"2023-10-09T11:44:12.280543+0000","last_became_peered":"2023-10-09T11:44:12.280543+0000","last_unstale":"2023-10-09T11:44:12.281252+0000","last_undegraded":"2023-10-09T11:44:12.281252+0000","last_fullsized":"2023-10-09T11:44:12.281252+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283142+0000","last_change":"2023-10-09T11:44:12.282782+0000","last_active":"2023-10-09T11:44:12.283142+0000","last_peered":"2023-10-09T11:44:12.283142+0000","last_clean":"2023-10-09T11:44:12.283142+0000","last_became_active":"2023-10-09T11:44:12.282522+0000","last_became_peered":"2023-10-09T11:44:12.282522+0000","last_unstale":"2023-10-09T11:44:12.283142+0000","last_undegraded":"2023-10-09T11:44:12.283142+0000","last_fullsized":"2023-10-09T11:44:12.283142+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:05.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270666+0000","last_change":"2023-10-09T11:44:12.269473+0000","last_active":"2023-10-09T11:44:12.270666+0000","last_peered":"2023-10-09T11:44:12.270666+0000","last_clean":"2023-10-09T11:44:12.270666+0000","last_became_active":"2023-10-09T11:44:12.269237+0000","last_became_peered":"2023-10-09T11:44:12.269237+0000","last_unstale":"2023-10-09T11:44:12.270666+0000","last_undegraded":"2023-10-09T11:44:12.270666+0000","last_fullsized":"2023-10-09T11:44:12.270666+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273839+0000","last_change":"2023-10-09T11:44:12.272512+0000","last_active":"2023-10-09T11:44:12.273839+0000","last_peered":"2023-10-09T11:44:12.273839+0000","last_clean":"2023-10-09T11:44:12.273839+0000","last_became_active":"2023-10-09T11:44:12.272231+0000","last_became_peered":"2023-10-09T11:44:12.272231+0000","last_unstale":"2023-10-09T11:44:12.273839+0000","last_undegraded":"2023-10-09T11:44:12.273839+0000","last_fullsized":"2023-10-09T11:44:12.273839+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278371+0000","last_change":"2023-10-09T11:44:12.277523+0000","last_active":"2023-10-09T11:44:12.278371+0000","last_peered":"2023-10-09T11:44:12.278371+0000","last_clean":"2023-10-09T11:44:12.278371+0000","last_became_active":"2023-10-09T11:44:12.277208+0000","last_became_peered":"2023-10-09T11:44:12.277208+0000","last_unstale":"2023-10-09T11:44:12.278371+0000","last_undegraded":"2023-10-09T11:44:12.278371+0000","last_fullsized":"2023-10-09T11:44:12.278371+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.272691+0000","last_change":"2023-10-09T11:44:12.271664+0000","last_active":"2023-10-09T11:44:12.272691+0000","last_peered":"2023-10-09T11:44:12.272691+0000","last_clean":"2023-10-09T11:44:12.272691+0000","last_became_active":"2023-10-09T11:44:12.271378+0000","last_became_peered":"2023-10-09T11:44:12.271378+0000","last_unstale":"2023-10-09T11:44:12.272691+0000","last_undegraded":"2023-10-09T11:44:12.272691+0000","last_fullsized":"2023-10-09T11:44:12.272691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269835+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.269835+0000","last_peered":"2023-10-09T11:44:12.269835+0000","last_clean":"2023-10-09T11:44:12.269835+0000","last_became_active":"2023-10-09T11:44:12.266282+0000","last_became_peered":"2023-10-09T11:44:12.266282+0000","last_unstale":"2023-10-09T11:44:12.269835+0000","last_undegraded":"2023-10-09T11:44:12.269835+0000","last_fullsized":"2023-10-09T11:44:12.269835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:49.065836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.263811+0000","last_change":"2023-10-09T11:44:12.262564+0000","last_active":"2023-10-09T11:44:12.263811+0000","last_peered":"2023-10-09T11:44:12.263811+0000","last_clean":"2023-10-09T11:44:12.263811+0000","last_became_active":"2023-10-09T11:44:12.262269+0000","last_became_peered":"2023-10-09T11:44:12.262269+0000","last_unstale":"2023-10-09T11:44:12.263811+0000","last_undegraded":"2023-10-09T11:44:12.263811+0000","last_fullsized":"2023-10-09T11:44:12.263811+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:17.384685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274003+0000","last_change":"2023-10-09T11:44:12.273270+0000","last_active":"2023-10-09T11:44:12.274003+0000","last_peered":"2023-10-09T11:44:12.274003+0000","last_clean":"2023-10-09T11:44:12.274003+0000","last_became_active":"2023-10-09T11:44:12.272950+0000","last_became_peered":"2023-10-09T11:44:12.272950+0000","last_unstale":"2023-10-09T11:44:12.274003+0000","last_undegraded":"2023-10-09T11:44:12.274003+0000","last_fullsized":"2023-10-09T11:44:12.274003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.518058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267250+0000","last_change":"2023-10-09T11:44:12.264884+0000","last_active":"2023-10-09T11:44:12.267250+0000","last_peered":"2023-10-09T11:44:12.267250+0000","last_clean":"2023-10-09T11:44:12.267250+0000","last_became_active":"2023-10-09T11:44:12.264602+0000","last_became_peered":"2023-10-09T11:44:12.264602+0000","last_unstale":"2023-10-09T11:44:12.267250+0000","last_undegraded":"2023-10-09T11:44:12.267250+0000","last_fullsized":"2023-10-09T11:44:12.267250+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:03.929742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273284+0000","last_change":"2023-10-09T11:44:12.271739+0000","last_active":"2023-10-09T11:44:12.273284+0000","last_peered":"2023-10-09T11:44:12.273284+0000","last_clean":"2023-10-09T11:44:12.273284+0000","last_became_active":"2023-10-09T11:44:12.271461+0000","last_became_peered":"2023-10-09T11:44:12.271461+0000","last_unstale":"2023-10-09T11:44:12.273284+0000","last_undegraded":"2023-10-09T11:44:12.273284+0000","last_fullsized":"2023-10-09T11:44:12.273284+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:36.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274785+0000","last_change":"2023-10-09T11:44:12.273174+0000","last_active":"2023-10-09T11:44:12.274785+0000","last_peered":"2023-10-09T11:44:12.274785+0000","last_clean":"2023-10-09T11:44:12.274785+0000","last_became_active":"2023-10-09T11:44:12.272914+0000","last_became_peered":"2023-10-09T11:44:12.272914+0000","last_unstale":"2023-10-09T11:44:12.274785+0000","last_undegraded":"2023-10-09T11:44:12.274785+0000","last_fullsized":"2023-10-09T11:44:12.274785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270511+0000","last_change":"2023-10-09T11:44:12.269715+0000","last_active":"2023-10-09T11:44:12.270511+0000","last_peered":"2023-10-09T11:44:12.270511+0000","last_clean":"2023-10-09T11:44:12.270511+0000","last_became_active":"2023-10-09T11:44:12.269364+0000","last_became_peered":"2023-10-09T11:44:12.269364+0000","last_unstale":"2023-10-09T11:44:12.270511+0000","last_undegraded":"2023-10-09T11:44:12.270511+0000","last_fullsized":"2023-10-09T11:44:12.270511+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282933+0000","last_change":"2023-10-09T11:44:12.282608+0000","last_active":"2023-10-09T11:44:12.282933+0000","last_peered":"2023-10-09T11:44:12.282933+0000","last_clean":"2023-10-09T11:44:12.282933+0000","last_became_active":"2023-10-09T11:44:12.282260+0000","last_became_peered":"2023-10-09T11:44:12.282260+0000","last_unstale":"2023-10-09T11:44:12.282933+0000","last_undegraded":"2023-10-09T11:44:12.282933+0000","last_fullsized":"2023-10-09T11:44:12.282933+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278541+0000","last_change":"2023-10-09T11:44:12.276888+0000","last_active":"2023-10-09T11:44:12.278541+0000","last_peered":"2023-10-09T11:44:12.278541+0000","last_clean":"2023-10-09T11:44:12.278541+0000","last_became_active":"2023-10-09T11:44:12.276610+0000","last_became_peered":"2023-10-09T11:44:12.276610+0000","last_unstale":"2023-10-09T11:44:12.278541+0000","last_undegraded":"2023-10-09T11:44:12.278541+0000","last_fullsized":"2023-10-09T11:44:12.278541+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271095+0000","last_change":"2023-10-09T11:44:12.267810+0000","last_active":"2023-10-09T11:44:12.271095+0000","last_peered":"2023-10-09T11:44:12.271095+0000","last_clean":"2023-10-09T11:44:12.271095+0000","last_became_active":"2023-10-09T11:44:12.266902+0000","last_became_peered":"2023-10-09T11:44:12.266902+0000","last_unstale":"2023-10-09T11:44:12.271095+0000","last_undegraded":"2023-10-09T11:44:12.271095+0000","last_fullsized":"2023-10-09T11:44:12.271095+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298440+0000","last_change":"2023-10-09T11:44:11.254907+0000","last_active":"2023-10-09T11:44:12.298440+0000","last_peered":"2023-10-09T11:44:12.298440+0000","last_clean":"2023-10-09T11:44:12.298440+0000","last_became_active":"2023-10-09T11:44:11.254645+0000","last_became_peered":"2023-10-09T11:44:11.254645+0000","last_unstale":"2023-10-09T11:44:12.298440+0000","last_undegraded":"2023-10-09T11:44:12.298440+0000","last_fullsized":"2023-10-09T11:44:12.298440+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:12.461779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240217+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:40.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281715+0000","last_change":"2023-10-09T11:44:12.281389+0000","last_active":"2023-10-09T11:44:12.281715+0000","last_peered":"2023-10-09T11:44:12.281715+0000","last_clean":"2023-10-09T11:44:12.281715+0000","last_became_active":"2023-10-09T11:44:12.281155+0000","last_became_peered":"2023-10-09T11:44:12.281155+0000","last_unstale":"2023-10-09T11:44:12.281715+0000","last_undegraded":"2023-10-09T11:44:12.281715+0000","last_fullsized":"2023-10-09T11:44:12.281715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:34.148015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298886+0000","last_change":"2023-10-09T11:44:11.255393+0000","last_active":"2023-10-09T11:44:12.298886+0000","last_peered":"2023-10-09T11:44:12.298886+0000","last_clean":"2023-10-09T11:44:12.298886+0000","last_became_active":"2023-10-09T11:44:11.255123+0000","last_became_peered":"2023-10-09T11:44:11.255123+0000","last_unstale":"2023-10-09T11:44:12.298886+0000","last_undegraded":"2023-10-09T11:44:12.298886+0000","last_fullsized":"2023-10-09T11:44:12.298886+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.717853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267036+0000","last_change":"2023-10-09T11:44:12.266273+0000","last_active":"2023-10-09T11:44:12.267036+0000","last_peered":"2023-10-09T11:44:12.267036+0000","last_clean":"2023-10-09T11:44:12.267036+0000","last_became_active":"2023-10-09T11:44:12.266008+0000","last_became_peered":"2023-10-09T11:44:12.266008+0000","last_unstale":"2023-10-09T11:44:12.267036+0000","last_undegraded":"2023-10-09T11:44:12.267036+0000","last_fullsized":"2023-10-09T11:44:12.267036+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:50.221128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.243484+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295663+0000","last_change":"2023-10-09T11:44:11.248115+0000","last_active":"2023-10-09T11:44:12.295663+0000","last_peered":"2023-10-09T11:44:12.295663+0000","last_clean":"2023-10-09T11:44:12.295663+0000","last_became_active":"2023-10-09T11:44:11.247830+0000","last_became_peered":"2023-10-09T11:44:11.247830+0000","last_unstale":"2023-10-09T11:44:12.295663+0000","last_undegraded":"2023-10-09T11:44:12.295663+0000","last_fullsized":"2023-10-09T11:44:12.295663+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:34.353464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278563+0000","last_change":"2023-10-09T11:44:12.277707+0000","last_active":"2023-10-09T11:44:12.278563+0000","last_peered":"2023-10-09T11:44:12.278563+0000","last_clean":"2023-10-09T11:44:12.278563+0000","last_became_active":"2023-10-09T11:44:12.277006+0000","last_became_peered":"2023-10-09T11:44:12.277006+0000","last_unstale":"2023-10-09T11:44:12.278563+0000","last_undegraded":"2023-10-09T11:44:12.278563+0000","last_fullsized":"2023-10-09T11:44:12.278563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259291+0000","last_change":"2023-10-09T11:44:11.252418+0000","last_active":"2023-10-09T11:44:12.259291+0000","last_peered":"2023-10-09T11:44:12.259291+0000","last_clean":"2023-10-09T11:44:12.259291+0000","last_became_active":"2023-10-09T11:44:11.252160+0000","last_became_peered":"2023-10-09T11:44:11.252160+0000","last_unstale":"2023-10-09T11:44:12.259291+0000","last_undegraded":"2023-10-09T11:44:12.259291+0000","last_fullsized":"2023-10-09T11:44:12.259291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:48.365961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259179+0000","last_change":"2023-10-09T11:44:11.252816+0000","last_active":"2023-10-09T11:44:12.259179+0000","last_peered":"2023-10-09T11:44:12.259179+0000","last_clean":"2023-10-09T11:44:12.259179+0000","last_became_active":"2023-10-09T11:44:11.252549+0000","last_became_peered":"2023-10-09T11:44:11.252549+0000","last_unstale":"2023-10-09T11:44:12.259179+0000","last_undegraded":"2023-10-09T11:44:12.259179+0000","last_fullsized":"2023-10-09T11:44:12.259179+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:48.710847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255963+0000","last_change":"2023-10-09T11:44:11.252364+0000","last_active":"2023-10-09T11:44:12.255963+0000","last_peered":"2023-10-09T11:44:12.255963+0000","last_clean":"2023-10-09T11:44:12.255963+0000","last_became_active":"2023-10-09T11:44:11.252051+0000","last_became_peered":"2023-10-09T11:44:11.252051+0000","last_unstale":"2023-10-09T11:44:12.255963+0000","last_undegraded":"2023-10-09T11:44:12.255963+0000","last_fullsized":"2023-10-09T11:44:12.255963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:57.149728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.260595+0000","last_change":"2023-10-09T11:44:11.253569+0000","last_active":"2023-10-09T11:44:12.260595+0000","last_peered":"2023-10-09T11:44:12.260595+0000","last_clean":"2023-10-09T11:44:12.260595+0000","last_became_active":"2023-10-09T11:44:11.253257+0000","last_became_peered":"2023-10-09T11:44:11.253257+0000","last_unstale":"2023-10-09T11:44:12.260595+0000","last_undegraded":"2023-10-09T11:44:12.260595+0000","last_fullsized":"2023-10-09T11:44:12.260595+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:36.301961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273860+0000","last_change":"2023-10-09T11:44:12.272569+0000","last_active":"2023-10-09T11:44:12.273860+0000","last_peered":"2023-10-09T11:44:12.273860+0000","last_clean":"2023-10-09T11:44:12.273860+0000","last_became_active":"2023-10-09T11:44:12.272276+0000","last_became_peered":"2023-10-09T11:44:12.272276+0000","last_unstale":"2023-10-09T11:44:12.273860+0000","last_undegraded":"2023-10-09T11:44:12.273860+0000","last_fullsized":"2023-10-09T11:44:12.273860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240987+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:44.619299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.299977+0000","last_change":"2023-10-09T11:44:11.250362+0000","last_active":"2023-10-09T11:44:12.299977+0000","last_peered":"2023-10-09T11:44:12.299977+0000","last_clean":"2023-10-09T11:44:12.299977+0000","last_became_active":"2023-10-09T11:44:11.249947+0000","last_became_peered":"2023-10-09T11:44:11.249947+0000","last_unstale":"2023-10-09T11:44:12.299977+0000","last_undegraded":"2023-10-09T11:44:12.299977+0000","last_fullsized":"2023-10-09T11:44:12.299977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.024197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267426+0000","last_change":"2023-10-09T11:44:12.266628+0000","last_active":"2023-10-09T11:44:12.267426+0000","last_peered":"2023-10-09T11:44:12.267426+0000","last_clean":"2023-10-09T11:44:12.267426+0000","last_became_active":"2023-10-09T11:44:12.266365+0000","last_became_peered":"2023-10-09T11:44:12.266365+0000","last_unstale":"2023-10-09T11:44:12.267426+0000","last_undegraded":"2023-10-09T11:44:12.267426+0000","last_fullsized":"2023-10-09T11:44:12.267426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:41.693514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242467+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:39.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241499+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:57.072034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241253+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:42.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.309647+0000","last_change":"2023-10-09T11:44:11.252250+0000","last_active":"2023-10-09T11:44:12.309647+0000","last_peered":"2023-10-09T11:44:12.309647+0000","last_clean":"2023-10-09T11:44:12.309647+0000","last_became_active":"2023-10-09T11:44:11.251901+0000","last_became_peered":"2023-10-09T11:44:11.251901+0000","last_unstale":"2023-10-09T11:44:12.309647+0000","last_undegraded":"2023-10-09T11:44:12.309647+0000","last_fullsized":"2023-10-09T11:44:12.309647+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:10.090035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298209+0000","last_change":"2023-10-09T11:44:11.258244+0000","last_active":"2023-10-09T11:44:12.298209+0000","last_peered":"2023-10-09T11:44:12.298209+0000","last_clean":"2023-10-09T11:44:12.298209+0000","last_became_active":"2023-10-09T11:44:11.257906+0000","last_became_peered":"2023-10-09T11:44:11.257906+0000","last_unstale":"2023-10-09T11:44:12.298209+0000","last_undegraded":"2023-10-09T11:44:12.298209+0000","last_fullsized":"2023-10-09T11:44:12.298209+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:05:41.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296867+0000","last_change":"2023-10-09T11:44:11.248480+0000","last_active":"2023-10-09T11:44:12.296867+0000","last_peered":"2023-10-09T11:44:12.296867+0000","last_clean":"2023-10-09T11:44:12.296867+0000","last_became_active":"2023-10-09T11:44:11.248222+0000","last_became_peered":"2023-10-09T11:44:11.248222+0000","last_unstale":"2023-10-09T11:44:12.296867+0000","last_undegraded":"2023-10-09T11:44:12.296867+0000","last_fullsized":"2023-10-09T11:44:12.296867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.459928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271463+0000","last_change":"2023-10-09T11:44:12.269495+0000","last_active":"2023-10-09T11:44:12.271463+0000","last_peered":"2023-10-09T11:44:12.271463+0000","last_clean":"2023-10-09T11:44:12.271463+0000","last_became_active":"2023-10-09T11:44:12.269229+0000","last_became_peered":"2023-10-09T11:44:12.269229+0000","last_unstale":"2023-10-09T11:44:12.271463+0000","last_undegraded":"2023-10-09T11:44:12.271463+0000","last_fullsized":"2023-10-09T11:44:12.271463+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239659+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284050+0000","last_change":"2023-10-09T11:44:12.283601+0000","last_active":"2023-10-09T11:44:12.284050+0000","last_peered":"2023-10-09T11:44:12.284050+0000","last_clean":"2023-10-09T11:44:12.284050+0000","last_became_active":"2023-10-09T11:44:12.283374+0000","last_became_peered":"2023-10-09T11:44:12.283374+0000","last_unstale":"2023-10-09T11:44:12.284050+0000","last_undegraded":"2023-10-09T11:44:12.284050+0000","last_fullsized":"2023-10-09T11:44:12.284050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:09.075683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.242501+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:55.918892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269913+0000","last_change":"2023-10-09T11:44:12.266466+0000","last_active":"2023-10-09T11:44:12.269913+0000","last_peered":"2023-10-09T11:44:12.269913+0000","last_clean":"2023-10-09T11:44:12.269913+0000","last_became_active":"2023-10-09T11:44:12.266180+0000","last_became_peered":"2023-10-09T11:44:12.266180+0000","last_unstale":"2023-10-09T11:44:12.269913+0000","last_undegraded":"2023-10-09T11:44:12.269913+0000","last_fullsized":"2023-10-09T11:44:12.269913+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.294921+0000","last_change":"2023-10-09T11:44:11.258567+0000","last_active":"2023-10-09T11:44:12.294921+0000","last_peered":"2023-10-09T11:44:12.294921+0000","last_clean":"2023-10-09T11:44:12.294921+0000","last_became_active":"2023-10-09T11:44:11.258262+0000","last_became_peered":"2023-10-09T11:44:11.258262+0000","last_unstale":"2023-10-09T11:44:12.294921+0000","last_undegraded":"2023-10-09T11:44:12.294921+0000","last_fullsized":"2023-10-09T11:44:12.294921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:41.584422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271493+0000","last_change":"2023-10-09T11:44:12.270382+0000","last_active":"2023-10-09T11:44:12.271493+0000","last_peered":"2023-10-09T11:44:12.271493+0000","last_clean":"2023-10-09T11:44:12.271493+0000","last_became_active":"2023-10-09T11:44:12.270128+0000","last_became_peered":"2023-10-09T11:44:12.270128+0000","last_unstale":"2023-10-09T11:44:12.271493+0000","last_undegraded":"2023-10-09T11:44:12.271493+0000","last_fullsized":"2023-10-09T11:44:12.271493+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:28.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239119+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:05.361683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239679+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:29.247637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255762+0000","last_change":"2023-10-09T11:44:11.256911+0000","last_active":"2023-10-09T11:44:12.255762+0000","last_peered":"2023-10-09T11:44:12.255762+0000","last_clean":"2023-10-09T11:44:12.255762+0000","last_became_active":"2023-10-09T11:44:11.256623+0000","last_became_peered":"2023-10-09T11:44:11.256623+0000","last_unstale":"2023-10-09T11:44:12.255762+0000","last_undegraded":"2023-10-09T11:44:12.255762+0000","last_fullsized":"2023-10-09T11:44:12.255762+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:55.284864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296150+0000","last_change":"2023-10-09T11:44:11.250873+0000","last_active":"2023-10-09T11:44:12.296150+0000","last_peered":"2023-10-09T11:44:12.296150+0000","last_clean":"2023-10-09T11:44:12.296150+0000","last_became_active":"2023-10-09T11:44:11.250597+0000","last_became_peered":"2023-10-09T11:44:11.250597+0000","last_unstale":"2023-10-09T11:44:12.296150+0000","last_undegraded":"2023-10-09T11:44:12.296150+0000","last_fullsized":"2023-10-09T11:44:12.296150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:32.783621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.241489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:40.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278495+0000","last_change":"2023-10-09T11:44:12.277527+0000","last_active":"2023-10-09T11:44:12.278495+0000","last_peered":"2023-10-09T11:44:12.278495+0000","last_clean":"2023-10-09T11:44:12.278495+0000","last_became_active":"2023-10-09T11:44:12.277236+0000","last_became_peered":"2023-10-09T11:44:12.277236+0000","last_unstale":"2023-10-09T11:44:12.278495+0000","last_undegraded":"2023-10-09T11:44:12.278495+0000","last_fullsized":"2023-10-09T11:44:12.278495+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:49.722879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255955+0000","last_change":"2023-10-09T11:44:11.252839+0000","last_active":"2023-10-09T11:44:12.255955+0000","last_peered":"2023-10-09T11:44:12.255955+0000","last_clean":"2023-10-09T11:44:12.255955+0000","last_became_active":"2023-10-09T11:44:11.252571+0000","last_became_peered":"2023-10-09T11:44:11.252571+0000","last_unstale":"2023-10-09T11:44:12.255955+0000","last_undegraded":"2023-10-09T11:44:12.255955+0000","last_fullsized":"2023-10-09T11:44:12.255955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:04.073378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.256442+0000","last_change":"2023-10-09T11:44:11.257159+0000","last_active":"2023-10-09T11:44:12.256442+0000","last_peered":"2023-10-09T11:44:12.256442+0000","last_clean":"2023-10-09T11:44:12.256442+0000","last_became_active":"2023-10-09T11:44:11.256893+0000","last_became_peered":"2023-10-09T11:44:11.256893+0000","last_unstale":"2023-10-09T11:44:12.256442+0000","last_undegraded":"2023-10-09T11:44:12.256442+0000","last_fullsized":"2023-10-09T11:44:12.256442+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:38.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271958+0000","last_change":"2023-10-09T11:44:12.270119+0000","last_active":"2023-10-09T11:44:12.271958+0000","last_peered":"2023-10-09T11:44:12.271958+0000","last_clean":"2023-10-09T11:44:12.271958+0000","last_became_active":"2023-10-09T11:44:12.269860+0000","last_became_peered":"2023-10-09T11:44:12.269860+0000","last_unstale":"2023-10-09T11:44:12.271958+0000","last_undegraded":"2023-10-09T11:44:12.271958+0000","last_fullsized":"2023-10-09T11:44:12.271958+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239489+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268711+0000","last_change":"2023-10-09T11:44:12.265836+0000","last_active":"2023-10-09T11:44:12.268711+0000","last_peered":"2023-10-09T11:44:12.268711+0000","last_clean":"2023-10-09T11:44:12.268711+0000","last_became_active":"2023-10-09T11:44:12.265556+0000","last_became_peered":"2023-10-09T11:44:12.265556+0000","last_unstale":"2023-10-09T11:44:12.268711+0000","last_undegraded":"2023-10-09T11:44:12.268711+0000","last_fullsized":"2023-10-09T11:44:12.268711+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:44.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.240889+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:45.101304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271533+0000","last_change":"2023-10-09T11:44:12.270361+0000","last_active":"2023-10-09T11:44:12.271533+0000","last_peered":"2023-10-09T11:44:12.271533+0000","last_clean":"2023-10-09T11:44:12.271533+0000","last_became_active":"2023-10-09T11:44:12.270098+0000","last_became_peered":"2023-10-09T11:44:12.270098+0000","last_unstale":"2023-10-09T11:44:12.271533+0000","last_undegraded":"2023-10-09T11:44:12.271533+0000","last_fullsized":"2023-10-09T11:44:12.271533+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:30.835127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259407+0000","last_change":"2023-10-09T11:44:11.251683+0000","last_active":"2023-10-09T11:44:12.259407+0000","last_peered":"2023-10-09T11:44:12.259407+0000","last_clean":"2023-10-09T11:44:12.259407+0000","last_became_active":"2023-10-09T11:44:11.251366+0000","last_became_peered":"2023-10-09T11:44:11.251366+0000","last_unstale":"2023-10-09T11:44:12.259407+0000","last_undegraded":"2023-10-09T11:44:12.259407+0000","last_fullsized":"2023-10-09T11:44:12.259407+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:32.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:44:11.234090+0000","last_change":"2023-10-09T11:44:11.234090+0000","last_active":"2023-10-09T11:44:11.234090+0000","last_peered":"2023-10-09T11:44:11.234090+0000","last_clean":"2023-10-09T11:44:11.234090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:11.234090+0000","last_undegraded":"2023-10-09T11:44:11.234090+0000","last_fullsized":"2023-10-09T11:44:11.234090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239082+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:57.315718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268852+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.268852+0000","last_peered":"2023-10-09T11:44:12.268852+0000","last_clean":"2023-10-09T11:44:12.268852+0000","last_became_active":"2023-10-09T11:44:12.266287+0000","last_became_peered":"2023-10-09T11:44:12.266287+0000","last_unstale":"2023-10-09T11:44:12.268852+0000","last_undegraded":"2023-10-09T11:44:12.268852+0000","last_fullsized":"2023-10-09T11:44:12.268852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:58.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:44:10.224480+0000","last_change":"2023-10-09T11:44:10.239077+0000","last_active":"2023-10-09T11:44:10.224480+0000","last_peered":"2023-10-09T11:44:10.224480+0000","last_clean":"2023-10-09T11:44:10.224480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:44:10.224480+0000","last_undegraded":"2023-10-09T11:44:10.224480+0000","last_fullsized":"2023-10-09T11:44:10.224480+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":293,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-09T11:44:07.948923+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:07.948923+0000","last_peered":"2023-10-09T11:44:07.948923+0000","last_clean":"2023-10-09T11:44:07.948923+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:07.948923+0000","last_undegraded":"2023-10-09T11:44:07.948923+0000","last_fullsized":"2023-10-09T11:44:07.948923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542257,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304196,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067644,"statfs":{"total":96636764160,"available":96325267456,"internally_reserved":0,"allocated":2879488,"data_stored":1615464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.624},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.36599999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.59399999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.442}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.219},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.309}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308340,"kb_used_data":2860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063500,"statfs":{"total":96636764160,"available":96321024000,"internally_reserved":0,"allocated":2928640,"data_stored":1636314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1045034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1046556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.751}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.78200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2285568,"data_stored":1025096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:17.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.1b is not active+clean 2023-10-09T11:44:17.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.19 is not active+clean 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.18 is not active+clean 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.13 is not active+clean 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.11 is not active+clean 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.f is not active+clean 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.d is not active+clean 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.b is not active+clean 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.a is not active+clean 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.9 is not active+clean 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.8 is not active+clean 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.6 is not active+clean 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.5 is not active+clean 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.22 is not active+clean 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.1d is not active+clean 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.240217+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:00:40.683904+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.1b is not active+clean 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.243484+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:08:51.195695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.25 is not active+clean 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.27 is not active+clean 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.28 is not active+clean 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.29 is not active+clean 2023-10-09T11:44:17.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.15 is not active+clean 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.240987+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:38:44.619299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.2b is not active+clean 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.13 is not active+clean 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.242467+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:16:39.944414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.2d is not active+clean 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.12 is not active+clean 2023-10-09T11:44:17.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.241499+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:05:57.072034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.2e is not active+clean 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.11 is not active+clean 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.241253+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:11:42.562693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.2f is not active+clean 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.30 is not active+clean 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.31 is not active+clean 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.d is not active+clean 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239659+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.c is not active+clean 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.242501+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:22:55.918892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.a is not active+clean 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239119+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:30:05.361683+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.36 is not active+clean 2023-10-09T11:44:17.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.9 is not active+clean 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239679+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:23:29.247637+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.37 is not active+clean 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.38 is not active+clean 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.39 is not active+clean 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.6 is not active+clean 2023-10-09T11:44:17.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.241489+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:53:40.238487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.3b is not active+clean 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.3 is not active+clean 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239489+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.2 is not active+clean 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.240889+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:07:45.101304+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 32.3f is not active+clean 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '32.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:44:11.234090+0000', 'last_change': '2023-10-09T11:44:11.234090+0000', 'last_active': '2023-10-09T11:44:11.234090+0000', 'last_peered': '2023-10-09T11:44:11.234090+0000', 'last_clean': '2023-10-09T11:44:11.234090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:11.234090+0000', 'last_undegraded': '2023-10-09T11:44:11.234090+0000', 'last_fullsized': '2023-10-09T11:44:11.234090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:11.234090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:44:17.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.0 is not active+clean 2023-10-09T11:44:17.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239082+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:28:57.315718+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:44:17.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 31.1e is not active+clean 2023-10-09T11:44:17.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '31.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:44:10.224480+0000', 'last_change': '2023-10-09T11:44:10.239077+0000', 'last_active': '2023-10-09T11:44:10.224480+0000', 'last_peered': '2023-10-09T11:44:10.224480+0000', 'last_clean': '2023-10-09T11:44:10.224480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:44:10.224480+0000', 'last_undegraded': '2023-10-09T11:44:10.224480+0000', 'last_fullsized': '2023-10-09T11:44:10.224480+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'last_clean_scrub_stamp': '2023-10-09T11:44:10.224480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:11:22.677235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:44:17.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:44:17.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.326+0000 7f57bf530700 1 Processor -- start 2023-10-09T11:44:17.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 -- start start 2023-10-09T11:44:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cb50 0x7f57b80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57b815cf20 0x7f57b80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b815ad50 con 0x7f57b80b0710 2023-10-09T11:44:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b815a140 con 0x7f57b815cf20 2023-10-09T11:44:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.327+0000 7f57bf530700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815a420 con 0x7f57b815cb50 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57b815cf20 0x7f57b80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bdacd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f57b80b0710 0x7f57b81536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57024/0 (socket says 172.21.15.26:57024) 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bdacd700 1 -- 172.21.15.26:0/83480185 learned_addr learned my addr 172.21.15.26:0/83480185 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bd2cc700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cb50 0x7f57b80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 -- 172.21.15.26:0/83480185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cb50 msgr2=0x7f57b80b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cb50 0x7f57b80b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 -- 172.21.15.26:0/83480185 >> v1:172.21.15.26:6789/0 conn(0x7f57b80b0710 legacy=0x7f57b81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57b7fff700 1 -- 172.21.15.26:0/83480185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385725189 0 0) 0x7f57b815ad50 con 0x7f57b80b0710 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 -- 172.21.15.26:0/83480185 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b815a700 con 0x7f57b815cf20 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57bcacb700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b815cf20 0x7f57b80b27d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098e0 tx=0x7f57ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532e2d5aac8fc794 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57b7fff700 1 -- 172.21.15.26:0/83480185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac009e80 con 0x7f57b815cf20 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57b7fff700 1 -- 172.21.15.26:0/83480185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00b860 con 0x7f57b815cf20 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.328+0000 7f57b7fff700 1 -- 172.21.15.26:0/83480185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bbe0 con 0x7f57b815cf20 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 -- 172.21.15.26:0/83480185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b815cf20 msgr2=0x7f57b80b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b815cf20 0x7f57b80b27d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098e0 tx=0x7f57ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 -- 172.21.15.26:0/83480185 shutdown_connections 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cb50 0x7f57b80b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 --2- 172.21.15.26:0/83480185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b815cf20 0x7f57b80b27d0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 -- 172.21.15.26:0/83480185 >> 172.21.15.26:0/83480185 conn(0x7f57b80cded0 msgr2=0x7f57b806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 -- 172.21.15.26:0/83480185 shutdown_connections 2023-10-09T11:44:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.329+0000 7f57bf530700 1 -- 172.21.15.26:0/83480185 wait complete. 2023-10-09T11:44:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.330+0000 7f57bf530700 1 Processor -- start 2023-10-09T11:44:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.330+0000 7f57bf530700 1 -- start start 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57b815cb50 0x7f57b80c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cf20 0x7f57b816cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815e590 con 0x7f57b80b0710 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815d980 con 0x7f57b815cb50 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bf530700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815dc60 con 0x7f57b815cf20 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40346/0 (socket says 172.21.15.26:40346) 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 -- 172.21.15.26:0/1133383378 learned_addr learned my addr 172.21.15.26:0/1133383378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bcacb700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57b815cb50 0x7f57b80c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bdacd700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cf20 0x7f57b816cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 -- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cf20 msgr2=0x7f57b816cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cf20 0x7f57b816cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 -- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57b815cb50 msgr2=0x7f57b80c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57b815cb50 0x7f57b80c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 -- 172.21.15.26:0/1133383378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009420 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57bd2cc700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e190 tx=0x7f57a8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.331+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800ee30 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.332+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8014420 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.332+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b815df40 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.332+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80147e0 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.332+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b80c36c0 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.332+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b804c3c0 con 0x7f57b80b0710 2023-10-09T11:44:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.333+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f57a8014b90 con 0x7f57b80b0710 2023-10-09T11:44:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.333+0000 7f57b57fa700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 0x7f57a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.333+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57a8085480 con 0x7f57b80b0710 2023-10-09T11:44:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.334+0000 7f57bcacb700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 0x7f57a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.334+0000 7f57bcacb700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 0x7f57a40697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f57b815d350 tx=0x7f57ac017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.338+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57a8052110 con 0x7f57b80b0710 2023-10-09T11:44:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.613+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f57b815e3e0 con 0x7f57b80b0710 2023-10-09T11:44:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.613+0000 7f57b57fa700 1 -- 172.21.15.26:0/1133383378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7f57a8009a60 con 0x7f57b80b0710 2023-10-09T11:44:17.614 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:17.614 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":558,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":183,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851310,"num_in_osds":8,"osd_in_since":1696851301,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2492964864,"bytes_avail":770601148416,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":120,"id":15,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":15,"rank":0,"name":"d","status":"up:active","gid":8724}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-09T11:42:33.211051+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:44:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 msgr2=0x7f57a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 0x7f57a40697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f57b815d350 tx=0x7f57ac017000 comp rx=0 tx=0).stop 2023-10-09T11:44:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 msgr2=0x7f57b815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e190 tx=0x7f57a8009920 comp rx=0 tx=0).stop 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 shutdown_connections 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f57a4067320 0x7f57a40697d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57b815cf20 0x7f57b816cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57b80b0710 0x7f57b815ea20 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 --2- 172.21.15.26:0/1133383378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57b815cb50 0x7f57b80c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 >> 172.21.15.26:0/1133383378 conn(0x7f57b80cded0 msgr2=0x7f57b8069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 shutdown_connections 2023-10-09T11:44:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.615+0000 7f57bf530700 1 -- 172.21.15.26:0/1133383378 wait complete. 2023-10-09T11:44:17.628 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:44:17.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.745+0000 7f8124fda700 1 Processor -- start 2023-10-09T11:44:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.745+0000 7f8124fda700 1 -- start start 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.746+0000 7f8124fda700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81200cf200 0x7f81200c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.746+0000 7f8124fda700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812015a280 con 0x7f81200b0ba0 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.746+0000 7f8124fda700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812006e180 con 0x7f81200b07d0 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.746+0000 7f8124fda700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812006d850 con 0x7f81200cf200 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f81200b0ba0 0x7f812006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57036/0 (socket says 172.21.15.26:57036) 2023-10-09T11:44:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811ed9d700 1 -- 172.21.15.26:0/627023697 learned_addr learned my addr 172.21.15.26:0/627023697 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811dd9b700 1 --2- 172.21.15.26:0/627023697 >> v2:172.21.15.67:3300/0 conn(0x7f81200cf200 0x7f81200c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827743898 0 0) 0x7f812015a280 con 0x7f81200b0ba0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f810c003570 con 0x7f81200b0ba0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627256533 0 0) 0x7f812006e180 con 0x7f81200b07d0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f812015a280 con 0x7f81200b07d0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279764902 0 0) 0x7f810c003570 con 0x7f81200b0ba0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 >> v2:172.21.15.67:3300/0 conn(0x7f81200cf200 msgr2=0x7f81200c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 --2- 172.21.15.26:0/627023697 >> v2:172.21.15.67:3300/0 conn(0x7f81200cf200 0x7f81200c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 >> v1:172.21.15.67:6789/0 conn(0x7f81200b07d0 legacy=0x7f81200ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812006db30 con 0x7f81200b0ba0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f81100017f0 con 0x7f81200b0ba0 2023-10-09T11:44:17.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 >> v1:172.21.15.26:6789/0 conn(0x7f81200b0ba0 legacy=0x7f812006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 0x7f810c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f810c004810 0x7f810c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c0051c0 0x7f810c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812006d850 con 0x7f810c003bf0 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c00c0b0 con 0x7f810c0051c0 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c00c270 con 0x7f810c004810 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811e59c700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 0x7f810c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811ed9d700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c0051c0 0x7f810c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.747+0000 7f811dd9b700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f810c004810 0x7f810c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 -- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f810c004810 msgr2=0x7f810c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:17.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f810c004810 0x7f810c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 -- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c0051c0 msgr2=0x7f810c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c0051c0 0x7f810c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 -- 172.21.15.26:0/627023697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c003570 con 0x7f810c003bf0 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811ed9d700 1 -- 172.21.15.26:0/627023697 reap_dead start 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811e59c700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 0x7f810c003fe0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8118001a30 tx=0x7f8118007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eae50ebd1ccebd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180013f0 con 0x7f810c003bf0 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800c5d0 con 0x7f810c003bf0 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f811d59a700 1 -- 172.21.15.26:0/627023697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800c990 con 0x7f810c003bf0 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f8124fda700 1 -- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 msgr2=0x7f810c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f8124fda700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 0x7f810c003fe0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8118001a30 tx=0x7f8118007d80 comp rx=0 tx=0).stop 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f8124fda700 1 -- 172.21.15.26:0/627023697 shutdown_connections 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f8124fda700 1 --2- 172.21.15.26:0/627023697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f810c003bf0 0x7f810c003fe0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.748+0000 7f8124fda700 1 -- 172.21.15.26:0/627023697 >> 172.21.15.26:0/627023697 conn(0x7f812006ce80 msgr2=0x7f81200ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.749+0000 7f8124fda700 1 -- 172.21.15.26:0/627023697 shutdown_connections 2023-10-09T11:44:17.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.749+0000 7f8124fda700 1 -- 172.21.15.26:0/627023697 wait complete. 2023-10-09T11:44:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 Processor -- start 2023-10-09T11:44:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 -- start start 2023-10-09T11:44:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 0x7f812016a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 0x7f812016c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015d6e0 con 0x7f812015aaf0 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015d400 con 0x7f810c003bf0 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f8124fda700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b28e0 con 0x7f812015a680 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f811ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f811ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40370/0 (socket says 172.21.15.26:40370) 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.750+0000 7f811ed9d700 1 -- 172.21.15.26:0/3806923086 learned_addr learned my addr 172.21.15.26:0/3806923086 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811dd9b700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 0x7f812016c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811e59c700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 0x7f812016a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 -- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 msgr2=0x7f812016c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 0x7f812016c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 -- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 msgr2=0x7f812016a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 0x7f812016a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 -- 172.21.15.26:0/3806923086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200b2bc0 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811dd9b700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 0x7f812016c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811e59c700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 0x7f812016a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f811ed9d700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f8110001580 tx=0x7f81100017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000eb60 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000ece0 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200b2ea0 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110013670 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.751+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812015c8d0 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.752+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812004c3c0 con 0x7f812015aaf0 2023-10-09T11:44:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.752+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f81100139e0 con 0x7f812015aaf0 2023-10-09T11:44:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.753+0000 7f81167fc700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 0x7f81000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.753+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81100850f0 con 0x7f812015aaf0 2023-10-09T11:44:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.753+0000 7f811e59c700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 0x7f81000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.754+0000 7f811e59c700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 0x7f81000697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8118000c00 tx=0x7f8118015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.757+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8110051d40 con 0x7f812015aaf0 2023-10-09T11:44:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.944+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8120071230 con 0x7f8100067320 2023-10-09T11:44:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.953+0000 7f81167fc700 1 -- 172.21.15.26:0/3806923086 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289777 (secure 0 0 0) 0x7f8120071230 con 0x7f8100067320 2023-10-09T11:44:17.958 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 msgr2=0x7f81000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 0x7f81000697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8118000c00 tx=0x7f8118015000 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 msgr2=0x7f812016c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f8110001580 tx=0x7f81100017f0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 shutdown_connections 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812015aaf0 0x7f812016c560 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810c003bf0 0x7f812016a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8100067320 0x7f81000697d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 --2- 172.21.15.26:0/3806923086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f812015a680 0x7f812016c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 >> 172.21.15.26:0/3806923086 conn(0x7f812006ce80 msgr2=0x7f81200c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:17.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 shutdown_connections 2023-10-09T11:44:17.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:17.957+0000 7f8124fda700 1 -- 172.21.15.26:0/3806923086 wait complete. 2023-10-09T11:44:17.961 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:17.970 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-09T11:44:17.234928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434536,"kb_used_data":19368,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540184,"statfs":{"total":773094113280,"available":770601148416,"internally_reserved":0,"allocated":19832832,"data_stored":9540628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001331"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268780+0000","last_change":"2023-10-09T11:44:12.265095+0000","last_active":"2023-10-09T11:44:12.268780+0000","last_peered":"2023-10-09T11:44:12.268780+0000","last_clean":"2023-10-09T11:44:12.268780+0000","last_became_active":"2023-10-09T11:44:12.264811+0000","last_became_peered":"2023-10-09T11:44:12.264811+0000","last_unstale":"2023-10-09T11:44:12.268780+0000","last_undegraded":"2023-10-09T11:44:12.268780+0000","last_fullsized":"2023-10-09T11:44:12.268780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:50.460620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271517+0000","last_change":"2023-10-09T11:44:12.268131+0000","last_active":"2023-10-09T11:44:12.271517+0000","last_peered":"2023-10-09T11:44:12.271517+0000","last_clean":"2023-10-09T11:44:12.271517+0000","last_became_active":"2023-10-09T11:44:12.267795+0000","last_became_peered":"2023-10-09T11:44:12.267795+0000","last_unstale":"2023-10-09T11:44:12.271517+0000","last_undegraded":"2023-10-09T11:44:12.271517+0000","last_fullsized":"2023-10-09T11:44:12.271517+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:08.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273286+0000","last_change":"2023-10-09T11:44:12.271095+0000","last_active":"2023-10-09T11:44:12.273286+0000","last_peered":"2023-10-09T11:44:12.273286+0000","last_clean":"2023-10-09T11:44:12.273286+0000","last_became_active":"2023-10-09T11:44:12.270824+0000","last_became_peered":"2023-10-09T11:44:12.270824+0000","last_unstale":"2023-10-09T11:44:12.273286+0000","last_undegraded":"2023-10-09T11:44:12.273286+0000","last_fullsized":"2023-10-09T11:44:12.273286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278326+0000","last_change":"2023-10-09T11:44:12.277359+0000","last_active":"2023-10-09T11:44:12.278326+0000","last_peered":"2023-10-09T11:44:12.278326+0000","last_clean":"2023-10-09T11:44:12.278326+0000","last_became_active":"2023-10-09T11:44:12.277030+0000","last_became_peered":"2023-10-09T11:44:12.277030+0000","last_unstale":"2023-10-09T11:44:12.278326+0000","last_undegraded":"2023-10-09T11:44:12.278326+0000","last_fullsized":"2023-10-09T11:44:12.278326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:32.137710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284684+0000","last_change":"2023-10-09T11:44:12.282862+0000","last_active":"2023-10-09T11:44:12.284684+0000","last_peered":"2023-10-09T11:44:12.284684+0000","last_clean":"2023-10-09T11:44:12.284684+0000","last_became_active":"2023-10-09T11:44:12.282550+0000","last_became_peered":"2023-10-09T11:44:12.282550+0000","last_unstale":"2023-10-09T11:44:12.284684+0000","last_undegraded":"2023-10-09T11:44:12.284684+0000","last_fullsized":"2023-10-09T11:44:12.284684+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:20.967247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281252+0000","last_change":"2023-10-09T11:44:12.280836+0000","last_active":"2023-10-09T11:44:12.281252+0000","last_peered":"2023-10-09T11:44:12.281252+0000","last_clean":"2023-10-09T11:44:12.281252+0000","last_became_active":"2023-10-09T11:44:12.280543+0000","last_became_peered":"2023-10-09T11:44:12.280543+0000","last_unstale":"2023-10-09T11:44:12.281252+0000","last_undegraded":"2023-10-09T11:44:12.281252+0000","last_fullsized":"2023-10-09T11:44:12.281252+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276535+0000","last_change":"2023-10-09T11:44:12.270583+0000","last_active":"2023-10-09T11:44:12.276535+0000","last_peered":"2023-10-09T11:44:12.276535+0000","last_clean":"2023-10-09T11:44:12.276535+0000","last_became_active":"2023-10-09T11:44:12.270266+0000","last_became_peered":"2023-10-09T11:44:12.270266+0000","last_unstale":"2023-10-09T11:44:12.276535+0000","last_undegraded":"2023-10-09T11:44:12.276535+0000","last_fullsized":"2023-10-09T11:44:12.276535+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:20.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278942+0000","last_change":"2023-10-09T11:44:12.271500+0000","last_active":"2023-10-09T11:44:12.278942+0000","last_peered":"2023-10-09T11:44:12.278942+0000","last_clean":"2023-10-09T11:44:12.278942+0000","last_became_active":"2023-10-09T11:44:12.271208+0000","last_became_peered":"2023-10-09T11:44:12.271208+0000","last_unstale":"2023-10-09T11:44:12.278942+0000","last_undegraded":"2023-10-09T11:44:12.278942+0000","last_fullsized":"2023-10-09T11:44:12.278942+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:47.241223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283142+0000","last_change":"2023-10-09T11:44:12.282782+0000","last_active":"2023-10-09T11:44:12.283142+0000","last_peered":"2023-10-09T11:44:12.283142+0000","last_clean":"2023-10-09T11:44:12.283142+0000","last_became_active":"2023-10-09T11:44:12.282522+0000","last_became_peered":"2023-10-09T11:44:12.282522+0000","last_unstale":"2023-10-09T11:44:12.283142+0000","last_undegraded":"2023-10-09T11:44:12.283142+0000","last_fullsized":"2023-10-09T11:44:12.283142+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:05.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270666+0000","last_change":"2023-10-09T11:44:12.269473+0000","last_active":"2023-10-09T11:44:12.270666+0000","last_peered":"2023-10-09T11:44:12.270666+0000","last_clean":"2023-10-09T11:44:12.270666+0000","last_became_active":"2023-10-09T11:44:12.269237+0000","last_became_peered":"2023-10-09T11:44:12.269237+0000","last_unstale":"2023-10-09T11:44:12.270666+0000","last_undegraded":"2023-10-09T11:44:12.270666+0000","last_fullsized":"2023-10-09T11:44:12.270666+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273839+0000","last_change":"2023-10-09T11:44:12.272512+0000","last_active":"2023-10-09T11:44:12.273839+0000","last_peered":"2023-10-09T11:44:12.273839+0000","last_clean":"2023-10-09T11:44:12.273839+0000","last_became_active":"2023-10-09T11:44:12.272231+0000","last_became_peered":"2023-10-09T11:44:12.272231+0000","last_unstale":"2023-10-09T11:44:12.273839+0000","last_undegraded":"2023-10-09T11:44:12.273839+0000","last_fullsized":"2023-10-09T11:44:12.273839+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278371+0000","last_change":"2023-10-09T11:44:12.277523+0000","last_active":"2023-10-09T11:44:12.278371+0000","last_peered":"2023-10-09T11:44:12.278371+0000","last_clean":"2023-10-09T11:44:12.278371+0000","last_became_active":"2023-10-09T11:44:12.277208+0000","last_became_peered":"2023-10-09T11:44:12.277208+0000","last_unstale":"2023-10-09T11:44:12.278371+0000","last_undegraded":"2023-10-09T11:44:12.278371+0000","last_fullsized":"2023-10-09T11:44:12.278371+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278733+0000","last_change":"2023-10-09T11:44:12.272912+0000","last_active":"2023-10-09T11:44:12.278733+0000","last_peered":"2023-10-09T11:44:12.278733+0000","last_clean":"2023-10-09T11:44:12.278733+0000","last_became_active":"2023-10-09T11:44:12.272474+0000","last_became_peered":"2023-10-09T11:44:12.272474+0000","last_unstale":"2023-10-09T11:44:12.278733+0000","last_undegraded":"2023-10-09T11:44:12.278733+0000","last_fullsized":"2023-10-09T11:44:12.278733+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:20.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.272691+0000","last_change":"2023-10-09T11:44:12.271664+0000","last_active":"2023-10-09T11:44:12.272691+0000","last_peered":"2023-10-09T11:44:12.272691+0000","last_clean":"2023-10-09T11:44:12.272691+0000","last_became_active":"2023-10-09T11:44:12.271378+0000","last_became_peered":"2023-10-09T11:44:12.271378+0000","last_unstale":"2023-10-09T11:44:12.272691+0000","last_undegraded":"2023-10-09T11:44:12.272691+0000","last_fullsized":"2023-10-09T11:44:12.272691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284710+0000","last_change":"2023-10-09T11:44:12.281135+0000","last_active":"2023-10-09T11:44:12.284710+0000","last_peered":"2023-10-09T11:44:12.284710+0000","last_clean":"2023-10-09T11:44:12.284710+0000","last_became_active":"2023-10-09T11:44:12.280644+0000","last_became_peered":"2023-10-09T11:44:12.280644+0000","last_unstale":"2023-10-09T11:44:12.284710+0000","last_undegraded":"2023-10-09T11:44:12.284710+0000","last_fullsized":"2023-10-09T11:44:12.284710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269835+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.269835+0000","last_peered":"2023-10-09T11:44:12.269835+0000","last_clean":"2023-10-09T11:44:12.269835+0000","last_became_active":"2023-10-09T11:44:12.266282+0000","last_became_peered":"2023-10-09T11:44:12.266282+0000","last_unstale":"2023-10-09T11:44:12.269835+0000","last_undegraded":"2023-10-09T11:44:12.269835+0000","last_fullsized":"2023-10-09T11:44:12.269835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:49.065836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283352+0000","last_change":"2023-10-09T11:44:12.282872+0000","last_active":"2023-10-09T11:44:12.283352+0000","last_peered":"2023-10-09T11:44:12.283352+0000","last_clean":"2023-10-09T11:44:12.283352+0000","last_became_active":"2023-10-09T11:44:12.282563+0000","last_became_peered":"2023-10-09T11:44:12.282563+0000","last_unstale":"2023-10-09T11:44:12.283352+0000","last_undegraded":"2023-10-09T11:44:12.283352+0000","last_fullsized":"2023-10-09T11:44:12.283352+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:35.810505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.263811+0000","last_change":"2023-10-09T11:44:12.262564+0000","last_active":"2023-10-09T11:44:12.263811+0000","last_peered":"2023-10-09T11:44:12.263811+0000","last_clean":"2023-10-09T11:44:12.263811+0000","last_became_active":"2023-10-09T11:44:12.262269+0000","last_became_peered":"2023-10-09T11:44:12.262269+0000","last_unstale":"2023-10-09T11:44:12.263811+0000","last_undegraded":"2023-10-09T11:44:12.263811+0000","last_fullsized":"2023-10-09T11:44:12.263811+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:17.384685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284690+0000","last_change":"2023-10-09T11:44:12.275185+0000","last_active":"2023-10-09T11:44:12.284690+0000","last_peered":"2023-10-09T11:44:12.284690+0000","last_clean":"2023-10-09T11:44:12.284690+0000","last_became_active":"2023-10-09T11:44:12.274595+0000","last_became_peered":"2023-10-09T11:44:12.274595+0000","last_unstale":"2023-10-09T11:44:12.284690+0000","last_undegraded":"2023-10-09T11:44:12.284690+0000","last_fullsized":"2023-10-09T11:44:12.284690+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274003+0000","last_change":"2023-10-09T11:44:12.273270+0000","last_active":"2023-10-09T11:44:12.274003+0000","last_peered":"2023-10-09T11:44:12.274003+0000","last_clean":"2023-10-09T11:44:12.274003+0000","last_became_active":"2023-10-09T11:44:12.272950+0000","last_became_peered":"2023-10-09T11:44:12.272950+0000","last_unstale":"2023-10-09T11:44:12.274003+0000","last_undegraded":"2023-10-09T11:44:12.274003+0000","last_fullsized":"2023-10-09T11:44:12.274003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.518058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282188+0000","last_change":"2023-10-09T11:44:12.280897+0000","last_active":"2023-10-09T11:44:12.282188+0000","last_peered":"2023-10-09T11:44:12.282188+0000","last_clean":"2023-10-09T11:44:12.282188+0000","last_became_active":"2023-10-09T11:44:12.280658+0000","last_became_peered":"2023-10-09T11:44:12.280658+0000","last_unstale":"2023-10-09T11:44:12.282188+0000","last_undegraded":"2023-10-09T11:44:12.282188+0000","last_fullsized":"2023-10-09T11:44:12.282188+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279280+0000","last_change":"2023-10-09T11:44:12.277123+0000","last_active":"2023-10-09T11:44:12.279280+0000","last_peered":"2023-10-09T11:44:12.279280+0000","last_clean":"2023-10-09T11:44:12.279280+0000","last_became_active":"2023-10-09T11:44:12.276788+0000","last_became_peered":"2023-10-09T11:44:12.276788+0000","last_unstale":"2023-10-09T11:44:12.279280+0000","last_undegraded":"2023-10-09T11:44:12.279280+0000","last_fullsized":"2023-10-09T11:44:12.279280+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:43.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.285206+0000","last_change":"2023-10-09T11:44:12.284385+0000","last_active":"2023-10-09T11:44:12.285206+0000","last_peered":"2023-10-09T11:44:12.285206+0000","last_clean":"2023-10-09T11:44:12.285206+0000","last_became_active":"2023-10-09T11:44:12.281892+0000","last_became_peered":"2023-10-09T11:44:12.281892+0000","last_unstale":"2023-10-09T11:44:12.285206+0000","last_undegraded":"2023-10-09T11:44:12.285206+0000","last_fullsized":"2023-10-09T11:44:12.285206+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278785+0000","last_change":"2023-10-09T11:44:12.275473+0000","last_active":"2023-10-09T11:44:12.278785+0000","last_peered":"2023-10-09T11:44:12.278785+0000","last_clean":"2023-10-09T11:44:12.278785+0000","last_became_active":"2023-10-09T11:44:12.274981+0000","last_became_peered":"2023-10-09T11:44:12.274981+0000","last_unstale":"2023-10-09T11:44:12.278785+0000","last_undegraded":"2023-10-09T11:44:12.278785+0000","last_fullsized":"2023-10-09T11:44:12.278785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:56.481085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267250+0000","last_change":"2023-10-09T11:44:12.264884+0000","last_active":"2023-10-09T11:44:12.267250+0000","last_peered":"2023-10-09T11:44:12.267250+0000","last_clean":"2023-10-09T11:44:12.267250+0000","last_became_active":"2023-10-09T11:44:12.264602+0000","last_became_peered":"2023-10-09T11:44:12.264602+0000","last_unstale":"2023-10-09T11:44:12.267250+0000","last_undegraded":"2023-10-09T11:44:12.267250+0000","last_fullsized":"2023-10-09T11:44:12.267250+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:03.929742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276502+0000","last_change":"2023-10-09T11:44:12.270350+0000","last_active":"2023-10-09T11:44:12.276502+0000","last_peered":"2023-10-09T11:44:12.276502+0000","last_clean":"2023-10-09T11:44:12.276502+0000","last_became_active":"2023-10-09T11:44:12.270044+0000","last_became_peered":"2023-10-09T11:44:12.270044+0000","last_unstale":"2023-10-09T11:44:12.276502+0000","last_undegraded":"2023-10-09T11:44:12.276502+0000","last_fullsized":"2023-10-09T11:44:12.276502+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:03.390027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282047+0000","last_change":"2023-10-09T11:44:12.275497+0000","last_active":"2023-10-09T11:44:12.282047+0000","last_peered":"2023-10-09T11:44:12.282047+0000","last_clean":"2023-10-09T11:44:12.282047+0000","last_became_active":"2023-10-09T11:44:12.275218+0000","last_became_peered":"2023-10-09T11:44:12.275218+0000","last_unstale":"2023-10-09T11:44:12.282047+0000","last_undegraded":"2023-10-09T11:44:12.282047+0000","last_fullsized":"2023-10-09T11:44:12.282047+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:08.133438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273284+0000","last_change":"2023-10-09T11:44:12.271739+0000","last_active":"2023-10-09T11:44:12.273284+0000","last_peered":"2023-10-09T11:44:12.273284+0000","last_clean":"2023-10-09T11:44:12.273284+0000","last_became_active":"2023-10-09T11:44:12.271461+0000","last_became_peered":"2023-10-09T11:44:12.271461+0000","last_unstale":"2023-10-09T11:44:12.273284+0000","last_undegraded":"2023-10-09T11:44:12.273284+0000","last_fullsized":"2023-10-09T11:44:12.273284+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:36.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274785+0000","last_change":"2023-10-09T11:44:12.273174+0000","last_active":"2023-10-09T11:44:12.274785+0000","last_peered":"2023-10-09T11:44:12.274785+0000","last_clean":"2023-10-09T11:44:12.274785+0000","last_became_active":"2023-10-09T11:44:12.272914+0000","last_became_peered":"2023-10-09T11:44:12.272914+0000","last_unstale":"2023-10-09T11:44:12.274785+0000","last_undegraded":"2023-10-09T11:44:12.274785+0000","last_fullsized":"2023-10-09T11:44:12.274785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270511+0000","last_change":"2023-10-09T11:44:12.269715+0000","last_active":"2023-10-09T11:44:12.270511+0000","last_peered":"2023-10-09T11:44:12.270511+0000","last_clean":"2023-10-09T11:44:12.270511+0000","last_became_active":"2023-10-09T11:44:12.269364+0000","last_became_peered":"2023-10-09T11:44:12.269364+0000","last_unstale":"2023-10-09T11:44:12.270511+0000","last_undegraded":"2023-10-09T11:44:12.270511+0000","last_fullsized":"2023-10-09T11:44:12.270511+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282933+0000","last_change":"2023-10-09T11:44:12.282608+0000","last_active":"2023-10-09T11:44:12.282933+0000","last_peered":"2023-10-09T11:44:12.282933+0000","last_clean":"2023-10-09T11:44:12.282933+0000","last_became_active":"2023-10-09T11:44:12.282260+0000","last_became_peered":"2023-10-09T11:44:12.282260+0000","last_unstale":"2023-10-09T11:44:12.282933+0000","last_undegraded":"2023-10-09T11:44:12.282933+0000","last_fullsized":"2023-10-09T11:44:12.282933+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278541+0000","last_change":"2023-10-09T11:44:12.276888+0000","last_active":"2023-10-09T11:44:12.278541+0000","last_peered":"2023-10-09T11:44:12.278541+0000","last_clean":"2023-10-09T11:44:12.278541+0000","last_became_active":"2023-10-09T11:44:12.276610+0000","last_became_peered":"2023-10-09T11:44:12.276610+0000","last_unstale":"2023-10-09T11:44:12.278541+0000","last_undegraded":"2023-10-09T11:44:12.278541+0000","last_fullsized":"2023-10-09T11:44:12.278541+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271095+0000","last_change":"2023-10-09T11:44:12.267810+0000","last_active":"2023-10-09T11:44:12.271095+0000","last_peered":"2023-10-09T11:44:12.271095+0000","last_clean":"2023-10-09T11:44:12.271095+0000","last_became_active":"2023-10-09T11:44:12.266902+0000","last_became_peered":"2023-10-09T11:44:12.266902+0000","last_unstale":"2023-10-09T11:44:12.271095+0000","last_undegraded":"2023-10-09T11:44:12.271095+0000","last_fullsized":"2023-10-09T11:44:12.271095+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298440+0000","last_change":"2023-10-09T11:44:11.254907+0000","last_active":"2023-10-09T11:44:12.298440+0000","last_peered":"2023-10-09T11:44:12.298440+0000","last_clean":"2023-10-09T11:44:12.298440+0000","last_became_active":"2023-10-09T11:44:11.254645+0000","last_became_peered":"2023-10-09T11:44:11.254645+0000","last_unstale":"2023-10-09T11:44:12.298440+0000","last_undegraded":"2023-10-09T11:44:12.298440+0000","last_fullsized":"2023-10-09T11:44:12.298440+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:12.461779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.285169+0000","last_change":"2023-10-09T11:44:12.283478+0000","last_active":"2023-10-09T11:44:12.285169+0000","last_peered":"2023-10-09T11:44:12.285169+0000","last_clean":"2023-10-09T11:44:12.285169+0000","last_became_active":"2023-10-09T11:44:12.283197+0000","last_became_peered":"2023-10-09T11:44:12.283197+0000","last_unstale":"2023-10-09T11:44:12.285169+0000","last_undegraded":"2023-10-09T11:44:12.285169+0000","last_fullsized":"2023-10-09T11:44:12.285169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298373+0000","last_change":"2023-10-09T11:44:11.256232+0000","last_active":"2023-10-09T11:44:12.298373+0000","last_peered":"2023-10-09T11:44:12.298373+0000","last_clean":"2023-10-09T11:44:12.298373+0000","last_became_active":"2023-10-09T11:44:11.255527+0000","last_became_peered":"2023-10-09T11:44:11.255527+0000","last_unstale":"2023-10-09T11:44:12.298373+0000","last_undegraded":"2023-10-09T11:44:12.298373+0000","last_fullsized":"2023-10-09T11:44:12.298373+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:02.920132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281715+0000","last_change":"2023-10-09T11:44:12.281389+0000","last_active":"2023-10-09T11:44:12.281715+0000","last_peered":"2023-10-09T11:44:12.281715+0000","last_clean":"2023-10-09T11:44:12.281715+0000","last_became_active":"2023-10-09T11:44:12.281155+0000","last_became_peered":"2023-10-09T11:44:12.281155+0000","last_unstale":"2023-10-09T11:44:12.281715+0000","last_undegraded":"2023-10-09T11:44:12.281715+0000","last_fullsized":"2023-10-09T11:44:12.281715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:34.148015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298886+0000","last_change":"2023-10-09T11:44:11.255393+0000","last_active":"2023-10-09T11:44:12.298886+0000","last_peered":"2023-10-09T11:44:12.298886+0000","last_clean":"2023-10-09T11:44:12.298886+0000","last_became_active":"2023-10-09T11:44:11.255123+0000","last_became_peered":"2023-10-09T11:44:11.255123+0000","last_unstale":"2023-10-09T11:44:12.298886+0000","last_undegraded":"2023-10-09T11:44:12.298886+0000","last_fullsized":"2023-10-09T11:44:12.298886+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.717853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267036+0000","last_change":"2023-10-09T11:44:12.266273+0000","last_active":"2023-10-09T11:44:12.267036+0000","last_peered":"2023-10-09T11:44:12.267036+0000","last_clean":"2023-10-09T11:44:12.267036+0000","last_became_active":"2023-10-09T11:44:12.266008+0000","last_became_peered":"2023-10-09T11:44:12.266008+0000","last_unstale":"2023-10-09T11:44:12.267036+0000","last_undegraded":"2023-10-09T11:44:12.267036+0000","last_fullsized":"2023-10-09T11:44:12.267036+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:50.221128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295865+0000","last_change":"2023-10-09T11:44:11.253368+0000","last_active":"2023-10-09T11:44:12.295865+0000","last_peered":"2023-10-09T11:44:12.295865+0000","last_clean":"2023-10-09T11:44:12.295865+0000","last_became_active":"2023-10-09T11:44:11.252492+0000","last_became_peered":"2023-10-09T11:44:11.252492+0000","last_unstale":"2023-10-09T11:44:12.295865+0000","last_undegraded":"2023-10-09T11:44:12.295865+0000","last_fullsized":"2023-10-09T11:44:12.295865+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:15.772110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279461+0000","last_change":"2023-10-09T11:44:12.275082+0000","last_active":"2023-10-09T11:44:12.279461+0000","last_peered":"2023-10-09T11:44:12.279461+0000","last_clean":"2023-10-09T11:44:12.279461+0000","last_became_active":"2023-10-09T11:44:12.274586+0000","last_became_peered":"2023-10-09T11:44:12.274586+0000","last_unstale":"2023-10-09T11:44:12.279461+0000","last_undegraded":"2023-10-09T11:44:12.279461+0000","last_fullsized":"2023-10-09T11:44:12.279461+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:17.158630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295663+0000","last_change":"2023-10-09T11:44:11.248115+0000","last_active":"2023-10-09T11:44:12.295663+0000","last_peered":"2023-10-09T11:44:12.295663+0000","last_clean":"2023-10-09T11:44:12.295663+0000","last_became_active":"2023-10-09T11:44:11.247830+0000","last_became_peered":"2023-10-09T11:44:11.247830+0000","last_unstale":"2023-10-09T11:44:12.295663+0000","last_undegraded":"2023-10-09T11:44:12.295663+0000","last_fullsized":"2023-10-09T11:44:12.295663+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:34.353464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278563+0000","last_change":"2023-10-09T11:44:12.277707+0000","last_active":"2023-10-09T11:44:12.278563+0000","last_peered":"2023-10-09T11:44:12.278563+0000","last_clean":"2023-10-09T11:44:12.278563+0000","last_became_active":"2023-10-09T11:44:12.277006+0000","last_became_peered":"2023-10-09T11:44:12.277006+0000","last_unstale":"2023-10-09T11:44:12.278563+0000","last_undegraded":"2023-10-09T11:44:12.278563+0000","last_fullsized":"2023-10-09T11:44:12.278563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259291+0000","last_change":"2023-10-09T11:44:11.252418+0000","last_active":"2023-10-09T11:44:12.259291+0000","last_peered":"2023-10-09T11:44:12.259291+0000","last_clean":"2023-10-09T11:44:12.259291+0000","last_became_active":"2023-10-09T11:44:11.252160+0000","last_became_peered":"2023-10-09T11:44:11.252160+0000","last_unstale":"2023-10-09T11:44:12.259291+0000","last_undegraded":"2023-10-09T11:44:12.259291+0000","last_fullsized":"2023-10-09T11:44:12.259291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:48.365961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284678+0000","last_change":"2023-10-09T11:44:12.281776+0000","last_active":"2023-10-09T11:44:12.284678+0000","last_peered":"2023-10-09T11:44:12.284678+0000","last_clean":"2023-10-09T11:44:12.284678+0000","last_became_active":"2023-10-09T11:44:12.278827+0000","last_became_peered":"2023-10-09T11:44:12.278827+0000","last_unstale":"2023-10-09T11:44:12.284678+0000","last_undegraded":"2023-10-09T11:44:12.284678+0000","last_fullsized":"2023-10-09T11:44:12.284678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:16.781720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259179+0000","last_change":"2023-10-09T11:44:11.252816+0000","last_active":"2023-10-09T11:44:12.259179+0000","last_peered":"2023-10-09T11:44:12.259179+0000","last_clean":"2023-10-09T11:44:12.259179+0000","last_became_active":"2023-10-09T11:44:11.252549+0000","last_became_peered":"2023-10-09T11:44:11.252549+0000","last_unstale":"2023-10-09T11:44:12.259179+0000","last_undegraded":"2023-10-09T11:44:12.259179+0000","last_fullsized":"2023-10-09T11:44:12.259179+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:48.710847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284055+0000","last_change":"2023-10-09T11:44:12.281487+0000","last_active":"2023-10-09T11:44:12.284055+0000","last_peered":"2023-10-09T11:44:12.284055+0000","last_clean":"2023-10-09T11:44:12.284055+0000","last_became_active":"2023-10-09T11:44:12.281244+0000","last_became_peered":"2023-10-09T11:44:12.281244+0000","last_unstale":"2023-10-09T11:44:12.284055+0000","last_undegraded":"2023-10-09T11:44:12.284055+0000","last_fullsized":"2023-10-09T11:44:12.284055+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255963+0000","last_change":"2023-10-09T11:44:11.252364+0000","last_active":"2023-10-09T11:44:12.255963+0000","last_peered":"2023-10-09T11:44:12.255963+0000","last_clean":"2023-10-09T11:44:12.255963+0000","last_became_active":"2023-10-09T11:44:11.252051+0000","last_became_peered":"2023-10-09T11:44:11.252051+0000","last_unstale":"2023-10-09T11:44:12.255963+0000","last_undegraded":"2023-10-09T11:44:12.255963+0000","last_fullsized":"2023-10-09T11:44:12.255963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:57.149728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.280204+0000","last_change":"2023-10-09T11:44:12.277671+0000","last_active":"2023-10-09T11:44:12.280204+0000","last_peered":"2023-10-09T11:44:12.280204+0000","last_clean":"2023-10-09T11:44:12.280204+0000","last_became_active":"2023-10-09T11:44:12.277369+0000","last_became_peered":"2023-10-09T11:44:12.277369+0000","last_unstale":"2023-10-09T11:44:12.280204+0000","last_undegraded":"2023-10-09T11:44:12.280204+0000","last_fullsized":"2023-10-09T11:44:12.280204+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:26.590079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.260595+0000","last_change":"2023-10-09T11:44:11.253569+0000","last_active":"2023-10-09T11:44:12.260595+0000","last_peered":"2023-10-09T11:44:12.260595+0000","last_clean":"2023-10-09T11:44:12.260595+0000","last_became_active":"2023-10-09T11:44:11.253257+0000","last_became_peered":"2023-10-09T11:44:11.253257+0000","last_unstale":"2023-10-09T11:44:12.260595+0000","last_undegraded":"2023-10-09T11:44:12.260595+0000","last_fullsized":"2023-10-09T11:44:12.260595+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:36.301961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273860+0000","last_change":"2023-10-09T11:44:12.272569+0000","last_active":"2023-10-09T11:44:12.273860+0000","last_peered":"2023-10-09T11:44:12.273860+0000","last_clean":"2023-10-09T11:44:12.273860+0000","last_became_active":"2023-10-09T11:44:12.272276+0000","last_became_peered":"2023-10-09T11:44:12.272276+0000","last_unstale":"2023-10-09T11:44:12.273860+0000","last_undegraded":"2023-10-09T11:44:12.273860+0000","last_fullsized":"2023-10-09T11:44:12.273860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"182'3","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295108+0000","last_change":"2023-10-09T11:44:11.253845+0000","last_active":"2023-10-09T11:44:12.295108+0000","last_peered":"2023-10-09T11:44:12.295108+0000","last_clean":"2023-10-09T11:44:12.295108+0000","last_became_active":"2023-10-09T11:44:11.253276+0000","last_became_peered":"2023-10-09T11:44:11.253276+0000","last_unstale":"2023-10-09T11:44:12.295108+0000","last_undegraded":"2023-10-09T11:44:12.295108+0000","last_fullsized":"2023-10-09T11:44:12.295108+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:19.314813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276565+0000","last_change":"2023-10-09T11:44:12.273142+0000","last_active":"2023-10-09T11:44:12.276565+0000","last_peered":"2023-10-09T11:44:12.276565+0000","last_clean":"2023-10-09T11:44:12.276565+0000","last_became_active":"2023-10-09T11:44:12.271202+0000","last_became_peered":"2023-10-09T11:44:12.271202+0000","last_unstale":"2023-10-09T11:44:12.276565+0000","last_undegraded":"2023-10-09T11:44:12.276565+0000","last_fullsized":"2023-10-09T11:44:12.276565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:21.907886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.299977+0000","last_change":"2023-10-09T11:44:11.250362+0000","last_active":"2023-10-09T11:44:12.299977+0000","last_peered":"2023-10-09T11:44:12.299977+0000","last_clean":"2023-10-09T11:44:12.299977+0000","last_became_active":"2023-10-09T11:44:11.249947+0000","last_became_peered":"2023-10-09T11:44:11.249947+0000","last_unstale":"2023-10-09T11:44:12.299977+0000","last_undegraded":"2023-10-09T11:44:12.299977+0000","last_fullsized":"2023-10-09T11:44:12.299977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.024197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267426+0000","last_change":"2023-10-09T11:44:12.266628+0000","last_active":"2023-10-09T11:44:12.267426+0000","last_peered":"2023-10-09T11:44:12.267426+0000","last_clean":"2023-10-09T11:44:12.267426+0000","last_became_active":"2023-10-09T11:44:12.266365+0000","last_became_peered":"2023-10-09T11:44:12.266365+0000","last_unstale":"2023-10-09T11:44:12.267426+0000","last_undegraded":"2023-10-09T11:44:12.267426+0000","last_fullsized":"2023-10-09T11:44:12.267426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:41.693514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298913+0000","last_change":"2023-10-09T11:44:11.254801+0000","last_active":"2023-10-09T11:44:12.298913+0000","last_peered":"2023-10-09T11:44:12.298913+0000","last_clean":"2023-10-09T11:44:12.298913+0000","last_became_active":"2023-10-09T11:44:11.254506+0000","last_became_peered":"2023-10-09T11:44:11.254506+0000","last_unstale":"2023-10-09T11:44:12.298913+0000","last_undegraded":"2023-10-09T11:44:12.298913+0000","last_fullsized":"2023-10-09T11:44:12.298913+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:45.868934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278538+0000","last_change":"2023-10-09T11:44:12.273403+0000","last_active":"2023-10-09T11:44:12.278538+0000","last_peered":"2023-10-09T11:44:12.278538+0000","last_clean":"2023-10-09T11:44:12.278538+0000","last_became_active":"2023-10-09T11:44:12.272892+0000","last_became_peered":"2023-10-09T11:44:12.272892+0000","last_unstale":"2023-10-09T11:44:12.278538+0000","last_undegraded":"2023-10-09T11:44:12.278538+0000","last_fullsized":"2023-10-09T11:44:12.278538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.266988+0000","last_change":"2023-10-09T11:44:11.254967+0000","last_active":"2023-10-09T11:44:12.266988+0000","last_peered":"2023-10-09T11:44:12.266988+0000","last_clean":"2023-10-09T11:44:12.266988+0000","last_became_active":"2023-10-09T11:44:11.254636+0000","last_became_peered":"2023-10-09T11:44:11.254636+0000","last_unstale":"2023-10-09T11:44:12.266988+0000","last_undegraded":"2023-10-09T11:44:12.266988+0000","last_fullsized":"2023-10-09T11:44:12.266988+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:20.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284611+0000","last_change":"2023-10-09T11:44:12.279589+0000","last_active":"2023-10-09T11:44:12.284611+0000","last_peered":"2023-10-09T11:44:12.284611+0000","last_clean":"2023-10-09T11:44:12.284611+0000","last_became_active":"2023-10-09T11:44:12.279319+0000","last_became_peered":"2023-10-09T11:44:12.279319+0000","last_unstale":"2023-10-09T11:44:12.284611+0000","last_undegraded":"2023-10-09T11:44:12.284611+0000","last_fullsized":"2023-10-09T11:44:12.284611+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267492+0000","last_change":"2023-10-09T11:44:11.255215+0000","last_active":"2023-10-09T11:44:12.267492+0000","last_peered":"2023-10-09T11:44:12.267492+0000","last_clean":"2023-10-09T11:44:12.267492+0000","last_became_active":"2023-10-09T11:44:11.254929+0000","last_became_peered":"2023-10-09T11:44:11.254929+0000","last_unstale":"2023-10-09T11:44:12.267492+0000","last_undegraded":"2023-10-09T11:44:12.267492+0000","last_fullsized":"2023-10-09T11:44:12.267492+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:45.017973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284654+0000","last_change":"2023-10-09T11:44:12.278621+0000","last_active":"2023-10-09T11:44:12.284654+0000","last_peered":"2023-10-09T11:44:12.284654+0000","last_clean":"2023-10-09T11:44:12.284654+0000","last_became_active":"2023-10-09T11:44:12.278278+0000","last_became_peered":"2023-10-09T11:44:12.278278+0000","last_unstale":"2023-10-09T11:44:12.284654+0000","last_undegraded":"2023-10-09T11:44:12.284654+0000","last_fullsized":"2023-10-09T11:44:12.284654+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:46.878544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.309647+0000","last_change":"2023-10-09T11:44:11.252250+0000","last_active":"2023-10-09T11:44:12.309647+0000","last_peered":"2023-10-09T11:44:12.309647+0000","last_clean":"2023-10-09T11:44:12.309647+0000","last_became_active":"2023-10-09T11:44:11.251901+0000","last_became_peered":"2023-10-09T11:44:11.251901+0000","last_unstale":"2023-10-09T11:44:12.309647+0000","last_undegraded":"2023-10-09T11:44:12.309647+0000","last_fullsized":"2023-10-09T11:44:12.309647+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:10.090035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278927+0000","last_change":"2023-10-09T11:44:12.270789+0000","last_active":"2023-10-09T11:44:12.278927+0000","last_peered":"2023-10-09T11:44:12.278927+0000","last_clean":"2023-10-09T11:44:12.278927+0000","last_became_active":"2023-10-09T11:44:12.269949+0000","last_became_peered":"2023-10-09T11:44:12.269949+0000","last_unstale":"2023-10-09T11:44:12.278927+0000","last_undegraded":"2023-10-09T11:44:12.278927+0000","last_fullsized":"2023-10-09T11:44:12.278927+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:41.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298209+0000","last_change":"2023-10-09T11:44:11.258244+0000","last_active":"2023-10-09T11:44:12.298209+0000","last_peered":"2023-10-09T11:44:12.298209+0000","last_clean":"2023-10-09T11:44:12.298209+0000","last_became_active":"2023-10-09T11:44:11.257906+0000","last_became_peered":"2023-10-09T11:44:11.257906+0000","last_unstale":"2023-10-09T11:44:12.298209+0000","last_undegraded":"2023-10-09T11:44:12.298209+0000","last_fullsized":"2023-10-09T11:44:12.298209+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:05:41.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284513+0000","last_change":"2023-10-09T11:44:12.278154+0000","last_active":"2023-10-09T11:44:12.284513+0000","last_peered":"2023-10-09T11:44:12.284513+0000","last_clean":"2023-10-09T11:44:12.284513+0000","last_became_active":"2023-10-09T11:44:12.277570+0000","last_became_peered":"2023-10-09T11:44:12.277570+0000","last_unstale":"2023-10-09T11:44:12.284513+0000","last_undegraded":"2023-10-09T11:44:12.284513+0000","last_fullsized":"2023-10-09T11:44:12.284513+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:56.928502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296867+0000","last_change":"2023-10-09T11:44:11.248480+0000","last_active":"2023-10-09T11:44:12.296867+0000","last_peered":"2023-10-09T11:44:12.296867+0000","last_clean":"2023-10-09T11:44:12.296867+0000","last_became_active":"2023-10-09T11:44:11.248222+0000","last_became_peered":"2023-10-09T11:44:11.248222+0000","last_unstale":"2023-10-09T11:44:12.296867+0000","last_undegraded":"2023-10-09T11:44:12.296867+0000","last_fullsized":"2023-10-09T11:44:12.296867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.459928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271463+0000","last_change":"2023-10-09T11:44:12.269495+0000","last_active":"2023-10-09T11:44:12.271463+0000","last_peered":"2023-10-09T11:44:12.271463+0000","last_clean":"2023-10-09T11:44:12.271463+0000","last_became_active":"2023-10-09T11:44:12.269229+0000","last_became_peered":"2023-10-09T11:44:12.269229+0000","last_unstale":"2023-10-09T11:44:12.271463+0000","last_undegraded":"2023-10-09T11:44:12.271463+0000","last_fullsized":"2023-10-09T11:44:12.271463+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298304+0000","last_change":"2023-10-09T11:44:11.255801+0000","last_active":"2023-10-09T11:44:12.298304+0000","last_peered":"2023-10-09T11:44:12.298304+0000","last_clean":"2023-10-09T11:44:12.298304+0000","last_became_active":"2023-10-09T11:44:11.255146+0000","last_became_peered":"2023-10-09T11:44:11.255146+0000","last_unstale":"2023-10-09T11:44:12.298304+0000","last_undegraded":"2023-10-09T11:44:12.298304+0000","last_fullsized":"2023-10-09T11:44:12.298304+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:07.413760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284050+0000","last_change":"2023-10-09T11:44:12.283601+0000","last_active":"2023-10-09T11:44:12.284050+0000","last_peered":"2023-10-09T11:44:12.284050+0000","last_clean":"2023-10-09T11:44:12.284050+0000","last_became_active":"2023-10-09T11:44:12.283374+0000","last_became_peered":"2023-10-09T11:44:12.283374+0000","last_unstale":"2023-10-09T11:44:12.284050+0000","last_undegraded":"2023-10-09T11:44:12.284050+0000","last_fullsized":"2023-10-09T11:44:12.284050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:09.075683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271567+0000","last_change":"2023-10-09T11:44:11.252588+0000","last_active":"2023-10-09T11:44:12.271567+0000","last_peered":"2023-10-09T11:44:12.271567+0000","last_clean":"2023-10-09T11:44:12.271567+0000","last_became_active":"2023-10-09T11:44:11.252379+0000","last_became_peered":"2023-10-09T11:44:11.252379+0000","last_unstale":"2023-10-09T11:44:12.271567+0000","last_undegraded":"2023-10-09T11:44:12.271567+0000","last_fullsized":"2023-10-09T11:44:12.271567+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:07.123828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269913+0000","last_change":"2023-10-09T11:44:12.266466+0000","last_active":"2023-10-09T11:44:12.269913+0000","last_peered":"2023-10-09T11:44:12.269913+0000","last_clean":"2023-10-09T11:44:12.269913+0000","last_became_active":"2023-10-09T11:44:12.266180+0000","last_became_peered":"2023-10-09T11:44:12.266180+0000","last_unstale":"2023-10-09T11:44:12.269913+0000","last_undegraded":"2023-10-09T11:44:12.269913+0000","last_fullsized":"2023-10-09T11:44:12.269913+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.294921+0000","last_change":"2023-10-09T11:44:11.258567+0000","last_active":"2023-10-09T11:44:12.294921+0000","last_peered":"2023-10-09T11:44:12.294921+0000","last_clean":"2023-10-09T11:44:12.294921+0000","last_became_active":"2023-10-09T11:44:11.258262+0000","last_became_peered":"2023-10-09T11:44:11.258262+0000","last_unstale":"2023-10-09T11:44:12.294921+0000","last_undegraded":"2023-10-09T11:44:12.294921+0000","last_fullsized":"2023-10-09T11:44:12.294921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:41.584422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271493+0000","last_change":"2023-10-09T11:44:12.270382+0000","last_active":"2023-10-09T11:44:12.271493+0000","last_peered":"2023-10-09T11:44:12.271493+0000","last_clean":"2023-10-09T11:44:12.271493+0000","last_became_active":"2023-10-09T11:44:12.270128+0000","last_became_peered":"2023-10-09T11:44:12.270128+0000","last_unstale":"2023-10-09T11:44:12.271493+0000","last_undegraded":"2023-10-09T11:44:12.271493+0000","last_fullsized":"2023-10-09T11:44:12.271493+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:28.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269467+0000","last_change":"2023-10-09T11:44:11.252219+0000","last_active":"2023-10-09T11:44:12.269467+0000","last_peered":"2023-10-09T11:44:12.269467+0000","last_clean":"2023-10-09T11:44:12.269467+0000","last_became_active":"2023-10-09T11:44:11.251916+0000","last_became_peered":"2023-10-09T11:44:11.251916+0000","last_unstale":"2023-10-09T11:44:12.269467+0000","last_undegraded":"2023-10-09T11:44:12.269467+0000","last_fullsized":"2023-10-09T11:44:12.269467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:27.088164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279338+0000","last_change":"2023-10-09T11:44:12.277200+0000","last_active":"2023-10-09T11:44:12.279338+0000","last_peered":"2023-10-09T11:44:12.279338+0000","last_clean":"2023-10-09T11:44:12.279338+0000","last_became_active":"2023-10-09T11:44:12.276892+0000","last_became_peered":"2023-10-09T11:44:12.276892+0000","last_unstale":"2023-10-09T11:44:12.279338+0000","last_undegraded":"2023-10-09T11:44:12.279338+0000","last_fullsized":"2023-10-09T11:44:12.279338+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:45.322793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269978+0000","last_change":"2023-10-09T11:44:11.255197+0000","last_active":"2023-10-09T11:44:12.269978+0000","last_peered":"2023-10-09T11:44:12.269978+0000","last_clean":"2023-10-09T11:44:12.269978+0000","last_became_active":"2023-10-09T11:44:11.254510+0000","last_became_peered":"2023-10-09T11:44:11.254510+0000","last_unstale":"2023-10-09T11:44:12.269978+0000","last_undegraded":"2023-10-09T11:44:12.269978+0000","last_fullsized":"2023-10-09T11:44:12.269978+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:11.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282290+0000","last_change":"2023-10-09T11:44:12.280500+0000","last_active":"2023-10-09T11:44:12.282290+0000","last_peered":"2023-10-09T11:44:12.282290+0000","last_clean":"2023-10-09T11:44:12.282290+0000","last_became_active":"2023-10-09T11:44:12.280076+0000","last_became_peered":"2023-10-09T11:44:12.280076+0000","last_unstale":"2023-10-09T11:44:12.282290+0000","last_undegraded":"2023-10-09T11:44:12.282290+0000","last_fullsized":"2023-10-09T11:44:12.282290+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:45.188348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255762+0000","last_change":"2023-10-09T11:44:11.256911+0000","last_active":"2023-10-09T11:44:12.255762+0000","last_peered":"2023-10-09T11:44:12.255762+0000","last_clean":"2023-10-09T11:44:12.255762+0000","last_became_active":"2023-10-09T11:44:11.256623+0000","last_became_peered":"2023-10-09T11:44:11.256623+0000","last_unstale":"2023-10-09T11:44:12.255762+0000","last_undegraded":"2023-10-09T11:44:12.255762+0000","last_fullsized":"2023-10-09T11:44:12.255762+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:55.284864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276489+0000","last_change":"2023-10-09T11:44:12.269431+0000","last_active":"2023-10-09T11:44:12.276489+0000","last_peered":"2023-10-09T11:44:12.276489+0000","last_clean":"2023-10-09T11:44:12.276489+0000","last_became_active":"2023-10-09T11:44:12.269120+0000","last_became_peered":"2023-10-09T11:44:12.269120+0000","last_unstale":"2023-10-09T11:44:12.276489+0000","last_undegraded":"2023-10-09T11:44:12.276489+0000","last_fullsized":"2023-10-09T11:44:12.276489+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:19.062318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296150+0000","last_change":"2023-10-09T11:44:11.250873+0000","last_active":"2023-10-09T11:44:12.296150+0000","last_peered":"2023-10-09T11:44:12.296150+0000","last_clean":"2023-10-09T11:44:12.296150+0000","last_became_active":"2023-10-09T11:44:11.250597+0000","last_became_peered":"2023-10-09T11:44:11.250597+0000","last_unstale":"2023-10-09T11:44:12.296150+0000","last_undegraded":"2023-10-09T11:44:12.296150+0000","last_fullsized":"2023-10-09T11:44:12.296150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:32.783621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284665+0000","last_change":"2023-10-09T11:44:12.280919+0000","last_active":"2023-10-09T11:44:12.284665+0000","last_peered":"2023-10-09T11:44:12.284665+0000","last_clean":"2023-10-09T11:44:12.284665+0000","last_became_active":"2023-10-09T11:44:12.280369+0000","last_became_peered":"2023-10-09T11:44:12.280369+0000","last_unstale":"2023-10-09T11:44:12.284665+0000","last_undegraded":"2023-10-09T11:44:12.284665+0000","last_fullsized":"2023-10-09T11:44:12.284665+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.266395+0000","last_change":"2023-10-09T11:44:11.252539+0000","last_active":"2023-10-09T11:44:12.266395+0000","last_peered":"2023-10-09T11:44:12.266395+0000","last_clean":"2023-10-09T11:44:12.266395+0000","last_became_active":"2023-10-09T11:44:11.252251+0000","last_became_peered":"2023-10-09T11:44:11.252251+0000","last_unstale":"2023-10-09T11:44:12.266395+0000","last_undegraded":"2023-10-09T11:44:12.266395+0000","last_fullsized":"2023-10-09T11:44:12.266395+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:27.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278495+0000","last_change":"2023-10-09T11:44:12.277527+0000","last_active":"2023-10-09T11:44:12.278495+0000","last_peered":"2023-10-09T11:44:12.278495+0000","last_clean":"2023-10-09T11:44:12.278495+0000","last_became_active":"2023-10-09T11:44:12.277236+0000","last_became_peered":"2023-10-09T11:44:12.277236+0000","last_unstale":"2023-10-09T11:44:12.278495+0000","last_undegraded":"2023-10-09T11:44:12.278495+0000","last_fullsized":"2023-10-09T11:44:12.278495+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:49.722879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255955+0000","last_change":"2023-10-09T11:44:11.252839+0000","last_active":"2023-10-09T11:44:12.255955+0000","last_peered":"2023-10-09T11:44:12.255955+0000","last_clean":"2023-10-09T11:44:12.255955+0000","last_became_active":"2023-10-09T11:44:11.252571+0000","last_became_peered":"2023-10-09T11:44:11.252571+0000","last_unstale":"2023-10-09T11:44:12.255955+0000","last_undegraded":"2023-10-09T11:44:12.255955+0000","last_fullsized":"2023-10-09T11:44:12.255955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:04.073378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284661+0000","last_change":"2023-10-09T11:44:12.278997+0000","last_active":"2023-10-09T11:44:12.284661+0000","last_peered":"2023-10-09T11:44:12.284661+0000","last_clean":"2023-10-09T11:44:12.284661+0000","last_became_active":"2023-10-09T11:44:12.278530+0000","last_became_peered":"2023-10-09T11:44:12.278530+0000","last_unstale":"2023-10-09T11:44:12.284661+0000","last_undegraded":"2023-10-09T11:44:12.284661+0000","last_fullsized":"2023-10-09T11:44:12.284661+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:16.481903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.256442+0000","last_change":"2023-10-09T11:44:11.257159+0000","last_active":"2023-10-09T11:44:12.256442+0000","last_peered":"2023-10-09T11:44:12.256442+0000","last_clean":"2023-10-09T11:44:12.256442+0000","last_became_active":"2023-10-09T11:44:11.256893+0000","last_became_peered":"2023-10-09T11:44:11.256893+0000","last_unstale":"2023-10-09T11:44:12.256442+0000","last_undegraded":"2023-10-09T11:44:12.256442+0000","last_fullsized":"2023-10-09T11:44:12.256442+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:38.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271958+0000","last_change":"2023-10-09T11:44:12.270119+0000","last_active":"2023-10-09T11:44:12.271958+0000","last_peered":"2023-10-09T11:44:12.271958+0000","last_clean":"2023-10-09T11:44:12.271958+0000","last_became_active":"2023-10-09T11:44:12.269860+0000","last_became_peered":"2023-10-09T11:44:12.269860+0000","last_unstale":"2023-10-09T11:44:12.271958+0000","last_undegraded":"2023-10-09T11:44:12.271958+0000","last_fullsized":"2023-10-09T11:44:12.271958+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269242+0000","last_change":"2023-10-09T11:44:11.254560+0000","last_active":"2023-10-09T11:44:12.269242+0000","last_peered":"2023-10-09T11:44:12.269242+0000","last_clean":"2023-10-09T11:44:12.269242+0000","last_became_active":"2023-10-09T11:44:11.254255+0000","last_became_peered":"2023-10-09T11:44:11.254255+0000","last_unstale":"2023-10-09T11:44:12.269242+0000","last_undegraded":"2023-10-09T11:44:12.269242+0000","last_fullsized":"2023-10-09T11:44:12.269242+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:01.508448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268711+0000","last_change":"2023-10-09T11:44:12.265836+0000","last_active":"2023-10-09T11:44:12.268711+0000","last_peered":"2023-10-09T11:44:12.268711+0000","last_clean":"2023-10-09T11:44:12.268711+0000","last_became_active":"2023-10-09T11:44:12.265556+0000","last_became_peered":"2023-10-09T11:44:12.265556+0000","last_unstale":"2023-10-09T11:44:12.268711+0000","last_undegraded":"2023-10-09T11:44:12.268711+0000","last_fullsized":"2023-10-09T11:44:12.268711+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:44.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267118+0000","last_change":"2023-10-09T11:44:11.253601+0000","last_active":"2023-10-09T11:44:12.267118+0000","last_peered":"2023-10-09T11:44:12.267118+0000","last_clean":"2023-10-09T11:44:12.267118+0000","last_became_active":"2023-10-09T11:44:11.252839+0000","last_became_peered":"2023-10-09T11:44:11.252839+0000","last_unstale":"2023-10-09T11:44:12.267118+0000","last_undegraded":"2023-10-09T11:44:12.267118+0000","last_fullsized":"2023-10-09T11:44:12.267118+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:59.261645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271533+0000","last_change":"2023-10-09T11:44:12.270361+0000","last_active":"2023-10-09T11:44:12.271533+0000","last_peered":"2023-10-09T11:44:12.271533+0000","last_clean":"2023-10-09T11:44:12.271533+0000","last_became_active":"2023-10-09T11:44:12.270098+0000","last_became_peered":"2023-10-09T11:44:12.270098+0000","last_unstale":"2023-10-09T11:44:12.271533+0000","last_undegraded":"2023-10-09T11:44:12.271533+0000","last_fullsized":"2023-10-09T11:44:12.271533+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:30.835127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259407+0000","last_change":"2023-10-09T11:44:11.251683+0000","last_active":"2023-10-09T11:44:12.259407+0000","last_peered":"2023-10-09T11:44:12.259407+0000","last_clean":"2023-10-09T11:44:12.259407+0000","last_became_active":"2023-10-09T11:44:11.251366+0000","last_became_peered":"2023-10-09T11:44:11.251366+0000","last_unstale":"2023-10-09T11:44:12.259407+0000","last_undegraded":"2023-10-09T11:44:12.259407+0000","last_fullsized":"2023-10-09T11:44:12.259407+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:32.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279313+0000","last_change":"2023-10-09T11:44:12.277051+0000","last_active":"2023-10-09T11:44:12.279313+0000","last_peered":"2023-10-09T11:44:12.279313+0000","last_clean":"2023-10-09T11:44:12.279313+0000","last_became_active":"2023-10-09T11:44:12.276725+0000","last_became_peered":"2023-10-09T11:44:12.276725+0000","last_unstale":"2023-10-09T11:44:12.279313+0000","last_undegraded":"2023-10-09T11:44:12.279313+0000","last_fullsized":"2023-10-09T11:44:12.279313+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:19.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269113+0000","last_change":"2023-10-09T11:44:11.251728+0000","last_active":"2023-10-09T11:44:12.269113+0000","last_peered":"2023-10-09T11:44:12.269113+0000","last_clean":"2023-10-09T11:44:12.269113+0000","last_became_active":"2023-10-09T11:44:11.251072+0000","last_became_peered":"2023-10-09T11:44:11.251072+0000","last_unstale":"2023-10-09T11:44:12.269113+0000","last_undegraded":"2023-10-09T11:44:12.269113+0000","last_fullsized":"2023-10-09T11:44:12.269113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:55.980828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268852+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.268852+0000","last_peered":"2023-10-09T11:44:12.268852+0000","last_clean":"2023-10-09T11:44:12.268852+0000","last_became_active":"2023-10-09T11:44:12.266287+0000","last_became_peered":"2023-10-09T11:44:12.266287+0000","last_unstale":"2023-10-09T11:44:12.268852+0000","last_undegraded":"2023-10-09T11:44:12.268852+0000","last_fullsized":"2023-10-09T11:44:12.268852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:58.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295747+0000","last_change":"2023-10-09T11:44:11.247562+0000","last_active":"2023-10-09T11:44:12.295747+0000","last_peered":"2023-10-09T11:44:12.295747+0000","last_clean":"2023-10-09T11:44:12.295747+0000","last_became_active":"2023-10-09T11:44:11.247261+0000","last_became_peered":"2023-10-09T11:44:11.247261+0000","last_unstale":"2023-10-09T11:44:12.295747+0000","last_undegraded":"2023-10-09T11:44:12.295747+0000","last_fullsized":"2023-10-09T11:44:12.295747+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":296,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274036+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:12.274036+0000","last_peered":"2023-10-09T11:44:12.274036+0000","last_clean":"2023-10-09T11:44:12.274036+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:12.274036+0000","last_undegraded":"2023-10-09T11:44:12.274036+0000","last_fullsized":"2023-10-09T11:44:12.274036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304240,"kb_used_data":2856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067600,"statfs":{"total":96636764160,"available":96325222400,"internally_reserved":0,"allocated":2924544,"data_stored":1634902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.58599999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.498},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.71699999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542258,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1044522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.219},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.309}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308340,"kb_used_data":2860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063500,"statfs":{"total":96636764160,"available":96321024000,"internally_reserved":0,"allocated":2928640,"data_stored":1636314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1045034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.25},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1046556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542259,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1044480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.056},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.373}]},{"osd":1,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.66600000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":3.7400000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.433},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.234},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.85799999999999998,"15min":0.91800000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.58799999999999997},"min":{"1min":0.5,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.282},"last":0.57899999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79900000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89500000000000002,"5min":0.92500000000000004,"15min":1.2509999999999999},"last":0.59199999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542259,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.377},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.65200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:20.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 Processor -- start 2023-10-09T11:44:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 -- start start 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24fc067e00 0x7f24fc068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc15d290 0x7f24fc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc0687b0 con 0x7f24fc153d20 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc15e280 con 0x7f24fc15d290 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.109+0000 7f2500925700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc06b7a0 con 0x7f24fc067e00 2023-10-09T11:44:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc15d290 0x7f24fc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24fc15d290 0x7f24fc15d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51496/0 (socket says 172.21.15.26:51496) 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 -- 172.21.15.26:0/3678599314 learned_addr learned my addr 172.21.15.26:0/3678599314 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24faffd700 1 --2- 172.21.15.26:0/3678599314 >> v2:172.21.15.67:3300/0 conn(0x7f24fc067e00 0x7f24fc068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 -- 172.21.15.26:0/3678599314 >> v2:172.21.15.67:3300/0 conn(0x7f24fc067e00 msgr2=0x7f24fc068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 --2- 172.21.15.26:0/3678599314 >> v2:172.21.15.67:3300/0 conn(0x7f24fc067e00 0x7f24fc068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 -- 172.21.15.26:0/3678599314 >> v1:172.21.15.67:6789/0 conn(0x7f24fc153d20 legacy=0x7f24fc06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 -- 172.21.15.26:0/3678599314 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc15dfa0 con 0x7f24fc15d290 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fbfff700 1 --2- 172.21.15.26:0/3678599314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc15d290 0x7f24fc15d6d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f24fc06fa90 tx=0x7f24f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b29d199a06bed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fa7fc700 1 -- 172.21.15.26:0/3678599314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400b820 con 0x7f24fc15d290 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fa7fc700 1 -- 172.21.15.26:0/3678599314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400b980 con 0x7f24fc15d290 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.110+0000 7f24fa7fc700 1 -- 172.21.15.26:0/3678599314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400bd20 con 0x7f24fc15d290 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 -- 172.21.15.26:0/3678599314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc15d290 msgr2=0x7f24fc15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 --2- 172.21.15.26:0/3678599314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc15d290 0x7f24fc15d6d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f24fc06fa90 tx=0x7f24f4009250 comp rx=0 tx=0).stop 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 -- 172.21.15.26:0/3678599314 shutdown_connections 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 --2- 172.21.15.26:0/3678599314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc15d290 0x7f24fc15d6d0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 --2- 172.21.15.26:0/3678599314 >> v2:172.21.15.67:3300/0 conn(0x7f24fc067e00 0x7f24fc068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 -- 172.21.15.26:0/3678599314 >> 172.21.15.26:0/3678599314 conn(0x7f24fc0cca00 msgr2=0x7f24fc0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:21.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 -- 172.21.15.26:0/3678599314 shutdown_connections 2023-10-09T11:44:21.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.111+0000 7f2500925700 1 -- 172.21.15.26:0/3678599314 wait complete. 2023-10-09T11:44:21.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.112+0000 7f2500925700 1 Processor -- start 2023-10-09T11:44:21.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.112+0000 7f2500925700 1 -- start start 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc067e00 0x7f24fc0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc15d290 0x7f24fc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b0a40 con 0x7f24fc153d20 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0afe30 con 0x7f24fc15d290 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f2500925700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b0110 con 0x7f24fc067e00 2023-10-09T11:44:21.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51498/0 (socket says 172.21.15.26:51498) 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 -- 172.21.15.26:0/3992122532 learned_addr learned my addr 172.21.15.26:0/3992122532 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24fbfff700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc15d290 0x7f24fc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc067e00 0x7f24fc0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 -- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc067e00 msgr2=0x7f24fc0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc067e00 0x7f24fc0c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 -- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc15d290 msgr2=0x7f24fc0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.113+0000 7f24faffd700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc15d290 0x7f24fc0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f24faffd700 1 -- 172.21.15.26:0/3992122532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40094f0 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f24faffd700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d860 tx=0x7f24f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00125f0 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0012750 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0b03f0 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0012b10 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.114+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc0c9f70 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.115+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc0b0bb0 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.115+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24f001e460 con 0x7f24fc153d20 2023-10-09T11:44:21.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.116+0000 7f24e37fe700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 0x7f24e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.116+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f24f00851a0 con 0x7f24fc153d20 2023-10-09T11:44:21.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.116+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 0x7f24e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.116+0000 7f24fb7fe700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 0x7f24e80697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007fd0 tx=0x7f24ec0026a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.120+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f00558c0 con 0x7f24fc153d20 2023-10-09T11:44:21.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.311+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24fc04c3c0 con 0x7f24e8067320 2023-10-09T11:44:21.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.320+0000 7f24e37fe700 1 -- 172.21.15.26:0/3992122532 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289740 (secure 0 0 0) 0x7f24fc04c3c0 con 0x7f24e8067320 2023-10-09T11:44:21.325 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 msgr2=0x7f24e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 0x7f24e80697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007fd0 tx=0x7f24ec0026a0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 msgr2=0x7f24fc0c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d860 tx=0x7f24f0008040 comp rx=0 tx=0).stop 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 shutdown_connections 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24fc15d290 0x7f24fc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f24e8067320 0x7f24e80697d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24fc067e00 0x7f24fc0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 --2- 172.21.15.26:0/3992122532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24fc153d20 0x7f24fc0c8800 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 >> 172.21.15.26:0/3992122532 conn(0x7f24fc0cca00 msgr2=0x7f24fc15a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 shutdown_connections 2023-10-09T11:44:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.324+0000 7f2500925700 1 -- 172.21.15.26:0/3992122532 wait complete. 2023-10-09T11:44:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:21.337 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2023-10-09T11:44:21.235815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434536,"kb_used_data":19368,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752540184,"statfs":{"total":773094113280,"available":770601148416,"internally_reserved":0,"allocated":19832832,"data_stored":9540628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.978086"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268780+0000","last_change":"2023-10-09T11:44:12.265095+0000","last_active":"2023-10-09T11:44:12.268780+0000","last_peered":"2023-10-09T11:44:12.268780+0000","last_clean":"2023-10-09T11:44:12.268780+0000","last_became_active":"2023-10-09T11:44:12.264811+0000","last_became_peered":"2023-10-09T11:44:12.264811+0000","last_unstale":"2023-10-09T11:44:12.268780+0000","last_undegraded":"2023-10-09T11:44:12.268780+0000","last_fullsized":"2023-10-09T11:44:12.268780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:50.460620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271517+0000","last_change":"2023-10-09T11:44:12.268131+0000","last_active":"2023-10-09T11:44:12.271517+0000","last_peered":"2023-10-09T11:44:12.271517+0000","last_clean":"2023-10-09T11:44:12.271517+0000","last_became_active":"2023-10-09T11:44:12.267795+0000","last_became_peered":"2023-10-09T11:44:12.267795+0000","last_unstale":"2023-10-09T11:44:12.271517+0000","last_undegraded":"2023-10-09T11:44:12.271517+0000","last_fullsized":"2023-10-09T11:44:12.271517+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:08.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273286+0000","last_change":"2023-10-09T11:44:12.271095+0000","last_active":"2023-10-09T11:44:12.273286+0000","last_peered":"2023-10-09T11:44:12.273286+0000","last_clean":"2023-10-09T11:44:12.273286+0000","last_became_active":"2023-10-09T11:44:12.270824+0000","last_became_peered":"2023-10-09T11:44:12.270824+0000","last_unstale":"2023-10-09T11:44:12.273286+0000","last_undegraded":"2023-10-09T11:44:12.273286+0000","last_fullsized":"2023-10-09T11:44:12.273286+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278326+0000","last_change":"2023-10-09T11:44:12.277359+0000","last_active":"2023-10-09T11:44:12.278326+0000","last_peered":"2023-10-09T11:44:12.278326+0000","last_clean":"2023-10-09T11:44:12.278326+0000","last_became_active":"2023-10-09T11:44:12.277030+0000","last_became_peered":"2023-10-09T11:44:12.277030+0000","last_unstale":"2023-10-09T11:44:12.278326+0000","last_undegraded":"2023-10-09T11:44:12.278326+0000","last_fullsized":"2023-10-09T11:44:12.278326+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:32.137710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284684+0000","last_change":"2023-10-09T11:44:12.282862+0000","last_active":"2023-10-09T11:44:12.284684+0000","last_peered":"2023-10-09T11:44:12.284684+0000","last_clean":"2023-10-09T11:44:12.284684+0000","last_became_active":"2023-10-09T11:44:12.282550+0000","last_became_peered":"2023-10-09T11:44:12.282550+0000","last_unstale":"2023-10-09T11:44:12.284684+0000","last_undegraded":"2023-10-09T11:44:12.284684+0000","last_fullsized":"2023-10-09T11:44:12.284684+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:20.967247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281252+0000","last_change":"2023-10-09T11:44:12.280836+0000","last_active":"2023-10-09T11:44:12.281252+0000","last_peered":"2023-10-09T11:44:12.281252+0000","last_clean":"2023-10-09T11:44:12.281252+0000","last_became_active":"2023-10-09T11:44:12.280543+0000","last_became_peered":"2023-10-09T11:44:12.280543+0000","last_unstale":"2023-10-09T11:44:12.281252+0000","last_undegraded":"2023-10-09T11:44:12.281252+0000","last_fullsized":"2023-10-09T11:44:12.281252+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276535+0000","last_change":"2023-10-09T11:44:12.270583+0000","last_active":"2023-10-09T11:44:12.276535+0000","last_peered":"2023-10-09T11:44:12.276535+0000","last_clean":"2023-10-09T11:44:12.276535+0000","last_became_active":"2023-10-09T11:44:12.270266+0000","last_became_peered":"2023-10-09T11:44:12.270266+0000","last_unstale":"2023-10-09T11:44:12.276535+0000","last_undegraded":"2023-10-09T11:44:12.276535+0000","last_fullsized":"2023-10-09T11:44:12.276535+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:20.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278942+0000","last_change":"2023-10-09T11:44:12.271500+0000","last_active":"2023-10-09T11:44:12.278942+0000","last_peered":"2023-10-09T11:44:12.278942+0000","last_clean":"2023-10-09T11:44:12.278942+0000","last_became_active":"2023-10-09T11:44:12.271208+0000","last_became_peered":"2023-10-09T11:44:12.271208+0000","last_unstale":"2023-10-09T11:44:12.278942+0000","last_undegraded":"2023-10-09T11:44:12.278942+0000","last_fullsized":"2023-10-09T11:44:12.278942+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:21:47.241223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283142+0000","last_change":"2023-10-09T11:44:12.282782+0000","last_active":"2023-10-09T11:44:12.283142+0000","last_peered":"2023-10-09T11:44:12.283142+0000","last_clean":"2023-10-09T11:44:12.283142+0000","last_became_active":"2023-10-09T11:44:12.282522+0000","last_became_peered":"2023-10-09T11:44:12.282522+0000","last_unstale":"2023-10-09T11:44:12.283142+0000","last_undegraded":"2023-10-09T11:44:12.283142+0000","last_fullsized":"2023-10-09T11:44:12.283142+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:05.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270666+0000","last_change":"2023-10-09T11:44:12.269473+0000","last_active":"2023-10-09T11:44:12.270666+0000","last_peered":"2023-10-09T11:44:12.270666+0000","last_clean":"2023-10-09T11:44:12.270666+0000","last_became_active":"2023-10-09T11:44:12.269237+0000","last_became_peered":"2023-10-09T11:44:12.269237+0000","last_unstale":"2023-10-09T11:44:12.270666+0000","last_undegraded":"2023-10-09T11:44:12.270666+0000","last_fullsized":"2023-10-09T11:44:12.270666+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273839+0000","last_change":"2023-10-09T11:44:12.272512+0000","last_active":"2023-10-09T11:44:12.273839+0000","last_peered":"2023-10-09T11:44:12.273839+0000","last_clean":"2023-10-09T11:44:12.273839+0000","last_became_active":"2023-10-09T11:44:12.272231+0000","last_became_peered":"2023-10-09T11:44:12.272231+0000","last_unstale":"2023-10-09T11:44:12.273839+0000","last_undegraded":"2023-10-09T11:44:12.273839+0000","last_fullsized":"2023-10-09T11:44:12.273839+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278371+0000","last_change":"2023-10-09T11:44:12.277523+0000","last_active":"2023-10-09T11:44:12.278371+0000","last_peered":"2023-10-09T11:44:12.278371+0000","last_clean":"2023-10-09T11:44:12.278371+0000","last_became_active":"2023-10-09T11:44:12.277208+0000","last_became_peered":"2023-10-09T11:44:12.277208+0000","last_unstale":"2023-10-09T11:44:12.278371+0000","last_undegraded":"2023-10-09T11:44:12.278371+0000","last_fullsized":"2023-10-09T11:44:12.278371+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278733+0000","last_change":"2023-10-09T11:44:12.272912+0000","last_active":"2023-10-09T11:44:12.278733+0000","last_peered":"2023-10-09T11:44:12.278733+0000","last_clean":"2023-10-09T11:44:12.278733+0000","last_became_active":"2023-10-09T11:44:12.272474+0000","last_became_peered":"2023-10-09T11:44:12.272474+0000","last_unstale":"2023-10-09T11:44:12.278733+0000","last_undegraded":"2023-10-09T11:44:12.278733+0000","last_fullsized":"2023-10-09T11:44:12.278733+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:20.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.272691+0000","last_change":"2023-10-09T11:44:12.271664+0000","last_active":"2023-10-09T11:44:12.272691+0000","last_peered":"2023-10-09T11:44:12.272691+0000","last_clean":"2023-10-09T11:44:12.272691+0000","last_became_active":"2023-10-09T11:44:12.271378+0000","last_became_peered":"2023-10-09T11:44:12.271378+0000","last_unstale":"2023-10-09T11:44:12.272691+0000","last_undegraded":"2023-10-09T11:44:12.272691+0000","last_fullsized":"2023-10-09T11:44:12.272691+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:52.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284710+0000","last_change":"2023-10-09T11:44:12.281135+0000","last_active":"2023-10-09T11:44:12.284710+0000","last_peered":"2023-10-09T11:44:12.284710+0000","last_clean":"2023-10-09T11:44:12.284710+0000","last_became_active":"2023-10-09T11:44:12.280644+0000","last_became_peered":"2023-10-09T11:44:12.280644+0000","last_unstale":"2023-10-09T11:44:12.284710+0000","last_undegraded":"2023-10-09T11:44:12.284710+0000","last_fullsized":"2023-10-09T11:44:12.284710+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:10.308209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269835+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.269835+0000","last_peered":"2023-10-09T11:44:12.269835+0000","last_clean":"2023-10-09T11:44:12.269835+0000","last_became_active":"2023-10-09T11:44:12.266282+0000","last_became_peered":"2023-10-09T11:44:12.266282+0000","last_unstale":"2023-10-09T11:44:12.269835+0000","last_undegraded":"2023-10-09T11:44:12.269835+0000","last_fullsized":"2023-10-09T11:44:12.269835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:49.065836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.283352+0000","last_change":"2023-10-09T11:44:12.282872+0000","last_active":"2023-10-09T11:44:12.283352+0000","last_peered":"2023-10-09T11:44:12.283352+0000","last_clean":"2023-10-09T11:44:12.283352+0000","last_became_active":"2023-10-09T11:44:12.282563+0000","last_became_peered":"2023-10-09T11:44:12.282563+0000","last_unstale":"2023-10-09T11:44:12.283352+0000","last_undegraded":"2023-10-09T11:44:12.283352+0000","last_fullsized":"2023-10-09T11:44:12.283352+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:35.810505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.263811+0000","last_change":"2023-10-09T11:44:12.262564+0000","last_active":"2023-10-09T11:44:12.263811+0000","last_peered":"2023-10-09T11:44:12.263811+0000","last_clean":"2023-10-09T11:44:12.263811+0000","last_became_active":"2023-10-09T11:44:12.262269+0000","last_became_peered":"2023-10-09T11:44:12.262269+0000","last_unstale":"2023-10-09T11:44:12.263811+0000","last_undegraded":"2023-10-09T11:44:12.263811+0000","last_fullsized":"2023-10-09T11:44:12.263811+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:17.384685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284690+0000","last_change":"2023-10-09T11:44:12.275185+0000","last_active":"2023-10-09T11:44:12.284690+0000","last_peered":"2023-10-09T11:44:12.284690+0000","last_clean":"2023-10-09T11:44:12.284690+0000","last_became_active":"2023-10-09T11:44:12.274595+0000","last_became_peered":"2023-10-09T11:44:12.274595+0000","last_unstale":"2023-10-09T11:44:12.284690+0000","last_undegraded":"2023-10-09T11:44:12.284690+0000","last_fullsized":"2023-10-09T11:44:12.284690+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274003+0000","last_change":"2023-10-09T11:44:12.273270+0000","last_active":"2023-10-09T11:44:12.274003+0000","last_peered":"2023-10-09T11:44:12.274003+0000","last_clean":"2023-10-09T11:44:12.274003+0000","last_became_active":"2023-10-09T11:44:12.272950+0000","last_became_peered":"2023-10-09T11:44:12.272950+0000","last_unstale":"2023-10-09T11:44:12.274003+0000","last_undegraded":"2023-10-09T11:44:12.274003+0000","last_fullsized":"2023-10-09T11:44:12.274003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:02.518058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282188+0000","last_change":"2023-10-09T11:44:12.280897+0000","last_active":"2023-10-09T11:44:12.282188+0000","last_peered":"2023-10-09T11:44:12.282188+0000","last_clean":"2023-10-09T11:44:12.282188+0000","last_became_active":"2023-10-09T11:44:12.280658+0000","last_became_peered":"2023-10-09T11:44:12.280658+0000","last_unstale":"2023-10-09T11:44:12.282188+0000","last_undegraded":"2023-10-09T11:44:12.282188+0000","last_fullsized":"2023-10-09T11:44:12.282188+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279280+0000","last_change":"2023-10-09T11:44:12.277123+0000","last_active":"2023-10-09T11:44:12.279280+0000","last_peered":"2023-10-09T11:44:12.279280+0000","last_clean":"2023-10-09T11:44:12.279280+0000","last_became_active":"2023-10-09T11:44:12.276788+0000","last_became_peered":"2023-10-09T11:44:12.276788+0000","last_unstale":"2023-10-09T11:44:12.279280+0000","last_undegraded":"2023-10-09T11:44:12.279280+0000","last_fullsized":"2023-10-09T11:44:12.279280+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:43.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.285206+0000","last_change":"2023-10-09T11:44:12.284385+0000","last_active":"2023-10-09T11:44:12.285206+0000","last_peered":"2023-10-09T11:44:12.285206+0000","last_clean":"2023-10-09T11:44:12.285206+0000","last_became_active":"2023-10-09T11:44:12.281892+0000","last_became_peered":"2023-10-09T11:44:12.281892+0000","last_unstale":"2023-10-09T11:44:12.285206+0000","last_undegraded":"2023-10-09T11:44:12.285206+0000","last_fullsized":"2023-10-09T11:44:12.285206+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:58.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278785+0000","last_change":"2023-10-09T11:44:12.275473+0000","last_active":"2023-10-09T11:44:12.278785+0000","last_peered":"2023-10-09T11:44:12.278785+0000","last_clean":"2023-10-09T11:44:12.278785+0000","last_became_active":"2023-10-09T11:44:12.274981+0000","last_became_peered":"2023-10-09T11:44:12.274981+0000","last_unstale":"2023-10-09T11:44:12.278785+0000","last_undegraded":"2023-10-09T11:44:12.278785+0000","last_fullsized":"2023-10-09T11:44:12.278785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:56.481085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267250+0000","last_change":"2023-10-09T11:44:12.264884+0000","last_active":"2023-10-09T11:44:12.267250+0000","last_peered":"2023-10-09T11:44:12.267250+0000","last_clean":"2023-10-09T11:44:12.267250+0000","last_became_active":"2023-10-09T11:44:12.264602+0000","last_became_peered":"2023-10-09T11:44:12.264602+0000","last_unstale":"2023-10-09T11:44:12.267250+0000","last_undegraded":"2023-10-09T11:44:12.267250+0000","last_fullsized":"2023-10-09T11:44:12.267250+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:03.929742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276502+0000","last_change":"2023-10-09T11:44:12.270350+0000","last_active":"2023-10-09T11:44:12.276502+0000","last_peered":"2023-10-09T11:44:12.276502+0000","last_clean":"2023-10-09T11:44:12.276502+0000","last_became_active":"2023-10-09T11:44:12.270044+0000","last_became_peered":"2023-10-09T11:44:12.270044+0000","last_unstale":"2023-10-09T11:44:12.276502+0000","last_undegraded":"2023-10-09T11:44:12.276502+0000","last_fullsized":"2023-10-09T11:44:12.276502+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:03.390027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282047+0000","last_change":"2023-10-09T11:44:12.275497+0000","last_active":"2023-10-09T11:44:12.282047+0000","last_peered":"2023-10-09T11:44:12.282047+0000","last_clean":"2023-10-09T11:44:12.282047+0000","last_became_active":"2023-10-09T11:44:12.275218+0000","last_became_peered":"2023-10-09T11:44:12.275218+0000","last_unstale":"2023-10-09T11:44:12.282047+0000","last_undegraded":"2023-10-09T11:44:12.282047+0000","last_fullsized":"2023-10-09T11:44:12.282047+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:08.133438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273284+0000","last_change":"2023-10-09T11:44:12.271739+0000","last_active":"2023-10-09T11:44:12.273284+0000","last_peered":"2023-10-09T11:44:12.273284+0000","last_clean":"2023-10-09T11:44:12.273284+0000","last_became_active":"2023-10-09T11:44:12.271461+0000","last_became_peered":"2023-10-09T11:44:12.271461+0000","last_unstale":"2023-10-09T11:44:12.273284+0000","last_undegraded":"2023-10-09T11:44:12.273284+0000","last_fullsized":"2023-10-09T11:44:12.273284+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:36.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274785+0000","last_change":"2023-10-09T11:44:12.273174+0000","last_active":"2023-10-09T11:44:12.274785+0000","last_peered":"2023-10-09T11:44:12.274785+0000","last_clean":"2023-10-09T11:44:12.274785+0000","last_became_active":"2023-10-09T11:44:12.272914+0000","last_became_peered":"2023-10-09T11:44:12.272914+0000","last_unstale":"2023-10-09T11:44:12.274785+0000","last_undegraded":"2023-10-09T11:44:12.274785+0000","last_fullsized":"2023-10-09T11:44:12.274785+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:11.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.270511+0000","last_change":"2023-10-09T11:44:12.269715+0000","last_active":"2023-10-09T11:44:12.270511+0000","last_peered":"2023-10-09T11:44:12.270511+0000","last_clean":"2023-10-09T11:44:12.270511+0000","last_became_active":"2023-10-09T11:44:12.269364+0000","last_became_peered":"2023-10-09T11:44:12.269364+0000","last_unstale":"2023-10-09T11:44:12.270511+0000","last_undegraded":"2023-10-09T11:44:12.270511+0000","last_fullsized":"2023-10-09T11:44:12.270511+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:41.290483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282933+0000","last_change":"2023-10-09T11:44:12.282608+0000","last_active":"2023-10-09T11:44:12.282933+0000","last_peered":"2023-10-09T11:44:12.282933+0000","last_clean":"2023-10-09T11:44:12.282933+0000","last_became_active":"2023-10-09T11:44:12.282260+0000","last_became_peered":"2023-10-09T11:44:12.282260+0000","last_unstale":"2023-10-09T11:44:12.282933+0000","last_undegraded":"2023-10-09T11:44:12.282933+0000","last_fullsized":"2023-10-09T11:44:12.282933+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:01.765853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278541+0000","last_change":"2023-10-09T11:44:12.276888+0000","last_active":"2023-10-09T11:44:12.278541+0000","last_peered":"2023-10-09T11:44:12.278541+0000","last_clean":"2023-10-09T11:44:12.278541+0000","last_became_active":"2023-10-09T11:44:12.276610+0000","last_became_peered":"2023-10-09T11:44:12.276610+0000","last_unstale":"2023-10-09T11:44:12.278541+0000","last_undegraded":"2023-10-09T11:44:12.278541+0000","last_fullsized":"2023-10-09T11:44:12.278541+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271095+0000","last_change":"2023-10-09T11:44:12.267810+0000","last_active":"2023-10-09T11:44:12.271095+0000","last_peered":"2023-10-09T11:44:12.271095+0000","last_clean":"2023-10-09T11:44:12.271095+0000","last_became_active":"2023-10-09T11:44:12.266902+0000","last_became_peered":"2023-10-09T11:44:12.266902+0000","last_unstale":"2023-10-09T11:44:12.271095+0000","last_undegraded":"2023-10-09T11:44:12.271095+0000","last_fullsized":"2023-10-09T11:44:12.271095+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"182'4","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298440+0000","last_change":"2023-10-09T11:44:11.254907+0000","last_active":"2023-10-09T11:44:12.298440+0000","last_peered":"2023-10-09T11:44:12.298440+0000","last_clean":"2023-10-09T11:44:12.298440+0000","last_became_active":"2023-10-09T11:44:11.254645+0000","last_became_peered":"2023-10-09T11:44:11.254645+0000","last_unstale":"2023-10-09T11:44:12.298440+0000","last_undegraded":"2023-10-09T11:44:12.298440+0000","last_fullsized":"2023-10-09T11:44:12.298440+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:12.461779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.285169+0000","last_change":"2023-10-09T11:44:12.283478+0000","last_active":"2023-10-09T11:44:12.285169+0000","last_peered":"2023-10-09T11:44:12.285169+0000","last_clean":"2023-10-09T11:44:12.285169+0000","last_became_active":"2023-10-09T11:44:12.283197+0000","last_became_peered":"2023-10-09T11:44:12.283197+0000","last_unstale":"2023-10-09T11:44:12.285169+0000","last_undegraded":"2023-10-09T11:44:12.285169+0000","last_fullsized":"2023-10-09T11:44:12.285169+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298373+0000","last_change":"2023-10-09T11:44:11.256232+0000","last_active":"2023-10-09T11:44:12.298373+0000","last_peered":"2023-10-09T11:44:12.298373+0000","last_clean":"2023-10-09T11:44:12.298373+0000","last_became_active":"2023-10-09T11:44:11.255527+0000","last_became_peered":"2023-10-09T11:44:11.255527+0000","last_unstale":"2023-10-09T11:44:12.298373+0000","last_undegraded":"2023-10-09T11:44:12.298373+0000","last_fullsized":"2023-10-09T11:44:12.298373+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:02.920132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.281715+0000","last_change":"2023-10-09T11:44:12.281389+0000","last_active":"2023-10-09T11:44:12.281715+0000","last_peered":"2023-10-09T11:44:12.281715+0000","last_clean":"2023-10-09T11:44:12.281715+0000","last_became_active":"2023-10-09T11:44:12.281155+0000","last_became_peered":"2023-10-09T11:44:12.281155+0000","last_unstale":"2023-10-09T11:44:12.281715+0000","last_undegraded":"2023-10-09T11:44:12.281715+0000","last_fullsized":"2023-10-09T11:44:12.281715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:34.148015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298886+0000","last_change":"2023-10-09T11:44:11.255393+0000","last_active":"2023-10-09T11:44:12.298886+0000","last_peered":"2023-10-09T11:44:12.298886+0000","last_clean":"2023-10-09T11:44:12.298886+0000","last_became_active":"2023-10-09T11:44:11.255123+0000","last_became_peered":"2023-10-09T11:44:11.255123+0000","last_unstale":"2023-10-09T11:44:12.298886+0000","last_undegraded":"2023-10-09T11:44:12.298886+0000","last_fullsized":"2023-10-09T11:44:12.298886+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.717853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267036+0000","last_change":"2023-10-09T11:44:12.266273+0000","last_active":"2023-10-09T11:44:12.267036+0000","last_peered":"2023-10-09T11:44:12.267036+0000","last_clean":"2023-10-09T11:44:12.267036+0000","last_became_active":"2023-10-09T11:44:12.266008+0000","last_became_peered":"2023-10-09T11:44:12.266008+0000","last_unstale":"2023-10-09T11:44:12.267036+0000","last_undegraded":"2023-10-09T11:44:12.267036+0000","last_fullsized":"2023-10-09T11:44:12.267036+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:50.221128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295865+0000","last_change":"2023-10-09T11:44:11.253368+0000","last_active":"2023-10-09T11:44:12.295865+0000","last_peered":"2023-10-09T11:44:12.295865+0000","last_clean":"2023-10-09T11:44:12.295865+0000","last_became_active":"2023-10-09T11:44:11.252492+0000","last_became_peered":"2023-10-09T11:44:11.252492+0000","last_unstale":"2023-10-09T11:44:12.295865+0000","last_undegraded":"2023-10-09T11:44:12.295865+0000","last_fullsized":"2023-10-09T11:44:12.295865+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:15.772110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279461+0000","last_change":"2023-10-09T11:44:12.275082+0000","last_active":"2023-10-09T11:44:12.279461+0000","last_peered":"2023-10-09T11:44:12.279461+0000","last_clean":"2023-10-09T11:44:12.279461+0000","last_became_active":"2023-10-09T11:44:12.274586+0000","last_became_peered":"2023-10-09T11:44:12.274586+0000","last_unstale":"2023-10-09T11:44:12.279461+0000","last_undegraded":"2023-10-09T11:44:12.279461+0000","last_fullsized":"2023-10-09T11:44:12.279461+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:17.158630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295663+0000","last_change":"2023-10-09T11:44:11.248115+0000","last_active":"2023-10-09T11:44:12.295663+0000","last_peered":"2023-10-09T11:44:12.295663+0000","last_clean":"2023-10-09T11:44:12.295663+0000","last_became_active":"2023-10-09T11:44:11.247830+0000","last_became_peered":"2023-10-09T11:44:11.247830+0000","last_unstale":"2023-10-09T11:44:12.295663+0000","last_undegraded":"2023-10-09T11:44:12.295663+0000","last_fullsized":"2023-10-09T11:44:12.295663+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:34.353464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278563+0000","last_change":"2023-10-09T11:44:12.277707+0000","last_active":"2023-10-09T11:44:12.278563+0000","last_peered":"2023-10-09T11:44:12.278563+0000","last_clean":"2023-10-09T11:44:12.278563+0000","last_became_active":"2023-10-09T11:44:12.277006+0000","last_became_peered":"2023-10-09T11:44:12.277006+0000","last_unstale":"2023-10-09T11:44:12.278563+0000","last_undegraded":"2023-10-09T11:44:12.278563+0000","last_fullsized":"2023-10-09T11:44:12.278563+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:59.812338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259291+0000","last_change":"2023-10-09T11:44:11.252418+0000","last_active":"2023-10-09T11:44:12.259291+0000","last_peered":"2023-10-09T11:44:12.259291+0000","last_clean":"2023-10-09T11:44:12.259291+0000","last_became_active":"2023-10-09T11:44:11.252160+0000","last_became_peered":"2023-10-09T11:44:11.252160+0000","last_unstale":"2023-10-09T11:44:12.259291+0000","last_undegraded":"2023-10-09T11:44:12.259291+0000","last_fullsized":"2023-10-09T11:44:12.259291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:48.365961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284678+0000","last_change":"2023-10-09T11:44:12.281776+0000","last_active":"2023-10-09T11:44:12.284678+0000","last_peered":"2023-10-09T11:44:12.284678+0000","last_clean":"2023-10-09T11:44:12.284678+0000","last_became_active":"2023-10-09T11:44:12.278827+0000","last_became_peered":"2023-10-09T11:44:12.278827+0000","last_unstale":"2023-10-09T11:44:12.284678+0000","last_undegraded":"2023-10-09T11:44:12.284678+0000","last_fullsized":"2023-10-09T11:44:12.284678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:16.781720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259179+0000","last_change":"2023-10-09T11:44:11.252816+0000","last_active":"2023-10-09T11:44:12.259179+0000","last_peered":"2023-10-09T11:44:12.259179+0000","last_clean":"2023-10-09T11:44:12.259179+0000","last_became_active":"2023-10-09T11:44:11.252549+0000","last_became_peered":"2023-10-09T11:44:11.252549+0000","last_unstale":"2023-10-09T11:44:12.259179+0000","last_undegraded":"2023-10-09T11:44:12.259179+0000","last_fullsized":"2023-10-09T11:44:12.259179+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:48.710847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284055+0000","last_change":"2023-10-09T11:44:12.281487+0000","last_active":"2023-10-09T11:44:12.284055+0000","last_peered":"2023-10-09T11:44:12.284055+0000","last_clean":"2023-10-09T11:44:12.284055+0000","last_became_active":"2023-10-09T11:44:12.281244+0000","last_became_peered":"2023-10-09T11:44:12.281244+0000","last_unstale":"2023-10-09T11:44:12.284055+0000","last_undegraded":"2023-10-09T11:44:12.284055+0000","last_fullsized":"2023-10-09T11:44:12.284055+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255963+0000","last_change":"2023-10-09T11:44:11.252364+0000","last_active":"2023-10-09T11:44:12.255963+0000","last_peered":"2023-10-09T11:44:12.255963+0000","last_clean":"2023-10-09T11:44:12.255963+0000","last_became_active":"2023-10-09T11:44:11.252051+0000","last_became_peered":"2023-10-09T11:44:11.252051+0000","last_unstale":"2023-10-09T11:44:12.255963+0000","last_undegraded":"2023-10-09T11:44:12.255963+0000","last_fullsized":"2023-10-09T11:44:12.255963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:57.149728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.280204+0000","last_change":"2023-10-09T11:44:12.277671+0000","last_active":"2023-10-09T11:44:12.280204+0000","last_peered":"2023-10-09T11:44:12.280204+0000","last_clean":"2023-10-09T11:44:12.280204+0000","last_became_active":"2023-10-09T11:44:12.277369+0000","last_became_peered":"2023-10-09T11:44:12.277369+0000","last_unstale":"2023-10-09T11:44:12.280204+0000","last_undegraded":"2023-10-09T11:44:12.280204+0000","last_fullsized":"2023-10-09T11:44:12.280204+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:26.590079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.260595+0000","last_change":"2023-10-09T11:44:11.253569+0000","last_active":"2023-10-09T11:44:12.260595+0000","last_peered":"2023-10-09T11:44:12.260595+0000","last_clean":"2023-10-09T11:44:12.260595+0000","last_became_active":"2023-10-09T11:44:11.253257+0000","last_became_peered":"2023-10-09T11:44:11.253257+0000","last_unstale":"2023-10-09T11:44:12.260595+0000","last_undegraded":"2023-10-09T11:44:12.260595+0000","last_fullsized":"2023-10-09T11:44:12.260595+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:36.301961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.273860+0000","last_change":"2023-10-09T11:44:12.272569+0000","last_active":"2023-10-09T11:44:12.273860+0000","last_peered":"2023-10-09T11:44:12.273860+0000","last_clean":"2023-10-09T11:44:12.273860+0000","last_became_active":"2023-10-09T11:44:12.272276+0000","last_became_peered":"2023-10-09T11:44:12.272276+0000","last_unstale":"2023-10-09T11:44:12.273860+0000","last_undegraded":"2023-10-09T11:44:12.273860+0000","last_fullsized":"2023-10-09T11:44:12.273860+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:48.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"182'3","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295108+0000","last_change":"2023-10-09T11:44:11.253845+0000","last_active":"2023-10-09T11:44:12.295108+0000","last_peered":"2023-10-09T11:44:12.295108+0000","last_clean":"2023-10-09T11:44:12.295108+0000","last_became_active":"2023-10-09T11:44:11.253276+0000","last_became_peered":"2023-10-09T11:44:11.253276+0000","last_unstale":"2023-10-09T11:44:12.295108+0000","last_undegraded":"2023-10-09T11:44:12.295108+0000","last_fullsized":"2023-10-09T11:44:12.295108+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:19.314813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276565+0000","last_change":"2023-10-09T11:44:12.273142+0000","last_active":"2023-10-09T11:44:12.276565+0000","last_peered":"2023-10-09T11:44:12.276565+0000","last_clean":"2023-10-09T11:44:12.276565+0000","last_became_active":"2023-10-09T11:44:12.271202+0000","last_became_peered":"2023-10-09T11:44:12.271202+0000","last_unstale":"2023-10-09T11:44:12.276565+0000","last_undegraded":"2023-10-09T11:44:12.276565+0000","last_fullsized":"2023-10-09T11:44:12.276565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:21.907886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"182'6","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.299977+0000","last_change":"2023-10-09T11:44:11.250362+0000","last_active":"2023-10-09T11:44:12.299977+0000","last_peered":"2023-10-09T11:44:12.299977+0000","last_clean":"2023-10-09T11:44:12.299977+0000","last_became_active":"2023-10-09T11:44:11.249947+0000","last_became_peered":"2023-10-09T11:44:11.249947+0000","last_unstale":"2023-10-09T11:44:12.299977+0000","last_undegraded":"2023-10-09T11:44:12.299977+0000","last_fullsized":"2023-10-09T11:44:12.299977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.024197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267426+0000","last_change":"2023-10-09T11:44:12.266628+0000","last_active":"2023-10-09T11:44:12.267426+0000","last_peered":"2023-10-09T11:44:12.267426+0000","last_clean":"2023-10-09T11:44:12.267426+0000","last_became_active":"2023-10-09T11:44:12.266365+0000","last_became_peered":"2023-10-09T11:44:12.266365+0000","last_unstale":"2023-10-09T11:44:12.267426+0000","last_undegraded":"2023-10-09T11:44:12.267426+0000","last_fullsized":"2023-10-09T11:44:12.267426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:41.693514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298913+0000","last_change":"2023-10-09T11:44:11.254801+0000","last_active":"2023-10-09T11:44:12.298913+0000","last_peered":"2023-10-09T11:44:12.298913+0000","last_clean":"2023-10-09T11:44:12.298913+0000","last_became_active":"2023-10-09T11:44:11.254506+0000","last_became_peered":"2023-10-09T11:44:11.254506+0000","last_unstale":"2023-10-09T11:44:12.298913+0000","last_undegraded":"2023-10-09T11:44:12.298913+0000","last_fullsized":"2023-10-09T11:44:12.298913+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:45.868934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278538+0000","last_change":"2023-10-09T11:44:12.273403+0000","last_active":"2023-10-09T11:44:12.278538+0000","last_peered":"2023-10-09T11:44:12.278538+0000","last_clean":"2023-10-09T11:44:12.278538+0000","last_became_active":"2023-10-09T11:44:12.272892+0000","last_became_peered":"2023-10-09T11:44:12.272892+0000","last_unstale":"2023-10-09T11:44:12.278538+0000","last_undegraded":"2023-10-09T11:44:12.278538+0000","last_fullsized":"2023-10-09T11:44:12.278538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:57:23.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.266988+0000","last_change":"2023-10-09T11:44:11.254967+0000","last_active":"2023-10-09T11:44:12.266988+0000","last_peered":"2023-10-09T11:44:12.266988+0000","last_clean":"2023-10-09T11:44:12.266988+0000","last_became_active":"2023-10-09T11:44:11.254636+0000","last_became_peered":"2023-10-09T11:44:11.254636+0000","last_unstale":"2023-10-09T11:44:12.266988+0000","last_undegraded":"2023-10-09T11:44:12.266988+0000","last_fullsized":"2023-10-09T11:44:12.266988+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:20.486951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284611+0000","last_change":"2023-10-09T11:44:12.279589+0000","last_active":"2023-10-09T11:44:12.284611+0000","last_peered":"2023-10-09T11:44:12.284611+0000","last_clean":"2023-10-09T11:44:12.284611+0000","last_became_active":"2023-10-09T11:44:12.279319+0000","last_became_peered":"2023-10-09T11:44:12.279319+0000","last_unstale":"2023-10-09T11:44:12.284611+0000","last_undegraded":"2023-10-09T11:44:12.284611+0000","last_fullsized":"2023-10-09T11:44:12.284611+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267492+0000","last_change":"2023-10-09T11:44:11.255215+0000","last_active":"2023-10-09T11:44:12.267492+0000","last_peered":"2023-10-09T11:44:12.267492+0000","last_clean":"2023-10-09T11:44:12.267492+0000","last_became_active":"2023-10-09T11:44:11.254929+0000","last_became_peered":"2023-10-09T11:44:11.254929+0000","last_unstale":"2023-10-09T11:44:12.267492+0000","last_undegraded":"2023-10-09T11:44:12.267492+0000","last_fullsized":"2023-10-09T11:44:12.267492+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:45.017973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284654+0000","last_change":"2023-10-09T11:44:12.278621+0000","last_active":"2023-10-09T11:44:12.284654+0000","last_peered":"2023-10-09T11:44:12.284654+0000","last_clean":"2023-10-09T11:44:12.284654+0000","last_became_active":"2023-10-09T11:44:12.278278+0000","last_became_peered":"2023-10-09T11:44:12.278278+0000","last_unstale":"2023-10-09T11:44:12.284654+0000","last_undegraded":"2023-10-09T11:44:12.284654+0000","last_fullsized":"2023-10-09T11:44:12.284654+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:46.878544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"182'8","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.309647+0000","last_change":"2023-10-09T11:44:11.252250+0000","last_active":"2023-10-09T11:44:12.309647+0000","last_peered":"2023-10-09T11:44:12.309647+0000","last_clean":"2023-10-09T11:44:12.309647+0000","last_became_active":"2023-10-09T11:44:11.251901+0000","last_became_peered":"2023-10-09T11:44:11.251901+0000","last_unstale":"2023-10-09T11:44:12.309647+0000","last_undegraded":"2023-10-09T11:44:12.309647+0000","last_fullsized":"2023-10-09T11:44:12.309647+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:10.090035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278927+0000","last_change":"2023-10-09T11:44:12.270789+0000","last_active":"2023-10-09T11:44:12.278927+0000","last_peered":"2023-10-09T11:44:12.278927+0000","last_clean":"2023-10-09T11:44:12.278927+0000","last_became_active":"2023-10-09T11:44:12.269949+0000","last_became_peered":"2023-10-09T11:44:12.269949+0000","last_unstale":"2023-10-09T11:44:12.278927+0000","last_undegraded":"2023-10-09T11:44:12.278927+0000","last_fullsized":"2023-10-09T11:44:12.278927+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:41.531509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298209+0000","last_change":"2023-10-09T11:44:11.258244+0000","last_active":"2023-10-09T11:44:12.298209+0000","last_peered":"2023-10-09T11:44:12.298209+0000","last_clean":"2023-10-09T11:44:12.298209+0000","last_became_active":"2023-10-09T11:44:11.257906+0000","last_became_peered":"2023-10-09T11:44:11.257906+0000","last_unstale":"2023-10-09T11:44:12.298209+0000","last_undegraded":"2023-10-09T11:44:12.298209+0000","last_fullsized":"2023-10-09T11:44:12.298209+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:05:41.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284513+0000","last_change":"2023-10-09T11:44:12.278154+0000","last_active":"2023-10-09T11:44:12.284513+0000","last_peered":"2023-10-09T11:44:12.284513+0000","last_clean":"2023-10-09T11:44:12.284513+0000","last_became_active":"2023-10-09T11:44:12.277570+0000","last_became_peered":"2023-10-09T11:44:12.277570+0000","last_unstale":"2023-10-09T11:44:12.284513+0000","last_undegraded":"2023-10-09T11:44:12.284513+0000","last_fullsized":"2023-10-09T11:44:12.284513+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:56.928502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296867+0000","last_change":"2023-10-09T11:44:11.248480+0000","last_active":"2023-10-09T11:44:12.296867+0000","last_peered":"2023-10-09T11:44:12.296867+0000","last_clean":"2023-10-09T11:44:12.296867+0000","last_became_active":"2023-10-09T11:44:11.248222+0000","last_became_peered":"2023-10-09T11:44:11.248222+0000","last_unstale":"2023-10-09T11:44:12.296867+0000","last_undegraded":"2023-10-09T11:44:12.296867+0000","last_fullsized":"2023-10-09T11:44:12.296867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:34.459928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271463+0000","last_change":"2023-10-09T11:44:12.269495+0000","last_active":"2023-10-09T11:44:12.271463+0000","last_peered":"2023-10-09T11:44:12.271463+0000","last_clean":"2023-10-09T11:44:12.271463+0000","last_became_active":"2023-10-09T11:44:12.269229+0000","last_became_peered":"2023-10-09T11:44:12.269229+0000","last_unstale":"2023-10-09T11:44:12.271463+0000","last_undegraded":"2023-10-09T11:44:12.271463+0000","last_fullsized":"2023-10-09T11:44:12.271463+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:24.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.298304+0000","last_change":"2023-10-09T11:44:11.255801+0000","last_active":"2023-10-09T11:44:12.298304+0000","last_peered":"2023-10-09T11:44:12.298304+0000","last_clean":"2023-10-09T11:44:12.298304+0000","last_became_active":"2023-10-09T11:44:11.255146+0000","last_became_peered":"2023-10-09T11:44:11.255146+0000","last_unstale":"2023-10-09T11:44:12.298304+0000","last_undegraded":"2023-10-09T11:44:12.298304+0000","last_fullsized":"2023-10-09T11:44:12.298304+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:07.413760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284050+0000","last_change":"2023-10-09T11:44:12.283601+0000","last_active":"2023-10-09T11:44:12.284050+0000","last_peered":"2023-10-09T11:44:12.284050+0000","last_clean":"2023-10-09T11:44:12.284050+0000","last_became_active":"2023-10-09T11:44:12.283374+0000","last_became_peered":"2023-10-09T11:44:12.283374+0000","last_unstale":"2023-10-09T11:44:12.284050+0000","last_undegraded":"2023-10-09T11:44:12.284050+0000","last_fullsized":"2023-10-09T11:44:12.284050+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:09.075683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271567+0000","last_change":"2023-10-09T11:44:11.252588+0000","last_active":"2023-10-09T11:44:12.271567+0000","last_peered":"2023-10-09T11:44:12.271567+0000","last_clean":"2023-10-09T11:44:12.271567+0000","last_became_active":"2023-10-09T11:44:11.252379+0000","last_became_peered":"2023-10-09T11:44:11.252379+0000","last_unstale":"2023-10-09T11:44:12.271567+0000","last_undegraded":"2023-10-09T11:44:12.271567+0000","last_fullsized":"2023-10-09T11:44:12.271567+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:07.123828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269913+0000","last_change":"2023-10-09T11:44:12.266466+0000","last_active":"2023-10-09T11:44:12.269913+0000","last_peered":"2023-10-09T11:44:12.269913+0000","last_clean":"2023-10-09T11:44:12.269913+0000","last_became_active":"2023-10-09T11:44:12.266180+0000","last_became_peered":"2023-10-09T11:44:12.266180+0000","last_unstale":"2023-10-09T11:44:12.269913+0000","last_undegraded":"2023-10-09T11:44:12.269913+0000","last_fullsized":"2023-10-09T11:44:12.269913+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:29.798330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.294921+0000","last_change":"2023-10-09T11:44:11.258567+0000","last_active":"2023-10-09T11:44:12.294921+0000","last_peered":"2023-10-09T11:44:12.294921+0000","last_clean":"2023-10-09T11:44:12.294921+0000","last_became_active":"2023-10-09T11:44:11.258262+0000","last_became_peered":"2023-10-09T11:44:11.258262+0000","last_unstale":"2023-10-09T11:44:12.294921+0000","last_undegraded":"2023-10-09T11:44:12.294921+0000","last_fullsized":"2023-10-09T11:44:12.294921+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:41.584422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271493+0000","last_change":"2023-10-09T11:44:12.270382+0000","last_active":"2023-10-09T11:44:12.271493+0000","last_peered":"2023-10-09T11:44:12.271493+0000","last_clean":"2023-10-09T11:44:12.271493+0000","last_became_active":"2023-10-09T11:44:12.270128+0000","last_became_peered":"2023-10-09T11:44:12.270128+0000","last_unstale":"2023-10-09T11:44:12.271493+0000","last_undegraded":"2023-10-09T11:44:12.271493+0000","last_fullsized":"2023-10-09T11:44:12.271493+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:28.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269467+0000","last_change":"2023-10-09T11:44:11.252219+0000","last_active":"2023-10-09T11:44:12.269467+0000","last_peered":"2023-10-09T11:44:12.269467+0000","last_clean":"2023-10-09T11:44:12.269467+0000","last_became_active":"2023-10-09T11:44:11.251916+0000","last_became_peered":"2023-10-09T11:44:11.251916+0000","last_unstale":"2023-10-09T11:44:12.269467+0000","last_undegraded":"2023-10-09T11:44:12.269467+0000","last_fullsized":"2023-10-09T11:44:12.269467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:27.088164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279338+0000","last_change":"2023-10-09T11:44:12.277200+0000","last_active":"2023-10-09T11:44:12.279338+0000","last_peered":"2023-10-09T11:44:12.279338+0000","last_clean":"2023-10-09T11:44:12.279338+0000","last_became_active":"2023-10-09T11:44:12.276892+0000","last_became_peered":"2023-10-09T11:44:12.276892+0000","last_unstale":"2023-10-09T11:44:12.279338+0000","last_undegraded":"2023-10-09T11:44:12.279338+0000","last_fullsized":"2023-10-09T11:44:12.279338+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:45.322793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269978+0000","last_change":"2023-10-09T11:44:11.255197+0000","last_active":"2023-10-09T11:44:12.269978+0000","last_peered":"2023-10-09T11:44:12.269978+0000","last_clean":"2023-10-09T11:44:12.269978+0000","last_became_active":"2023-10-09T11:44:11.254510+0000","last_became_peered":"2023-10-09T11:44:11.254510+0000","last_unstale":"2023-10-09T11:44:12.269978+0000","last_undegraded":"2023-10-09T11:44:12.269978+0000","last_fullsized":"2023-10-09T11:44:12.269978+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:11.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.282290+0000","last_change":"2023-10-09T11:44:12.280500+0000","last_active":"2023-10-09T11:44:12.282290+0000","last_peered":"2023-10-09T11:44:12.282290+0000","last_clean":"2023-10-09T11:44:12.282290+0000","last_became_active":"2023-10-09T11:44:12.280076+0000","last_became_peered":"2023-10-09T11:44:12.280076+0000","last_unstale":"2023-10-09T11:44:12.282290+0000","last_undegraded":"2023-10-09T11:44:12.282290+0000","last_fullsized":"2023-10-09T11:44:12.282290+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:45.188348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255762+0000","last_change":"2023-10-09T11:44:11.256911+0000","last_active":"2023-10-09T11:44:12.255762+0000","last_peered":"2023-10-09T11:44:12.255762+0000","last_clean":"2023-10-09T11:44:12.255762+0000","last_became_active":"2023-10-09T11:44:11.256623+0000","last_became_peered":"2023-10-09T11:44:11.256623+0000","last_unstale":"2023-10-09T11:44:12.255762+0000","last_undegraded":"2023-10-09T11:44:12.255762+0000","last_fullsized":"2023-10-09T11:44:12.255762+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:55.284864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.276489+0000","last_change":"2023-10-09T11:44:12.269431+0000","last_active":"2023-10-09T11:44:12.276489+0000","last_peered":"2023-10-09T11:44:12.276489+0000","last_clean":"2023-10-09T11:44:12.276489+0000","last_became_active":"2023-10-09T11:44:12.269120+0000","last_became_peered":"2023-10-09T11:44:12.269120+0000","last_unstale":"2023-10-09T11:44:12.276489+0000","last_undegraded":"2023-10-09T11:44:12.276489+0000","last_fullsized":"2023-10-09T11:44:12.276489+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:19.062318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"182'2","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.296150+0000","last_change":"2023-10-09T11:44:11.250873+0000","last_active":"2023-10-09T11:44:12.296150+0000","last_peered":"2023-10-09T11:44:12.296150+0000","last_clean":"2023-10-09T11:44:12.296150+0000","last_became_active":"2023-10-09T11:44:11.250597+0000","last_became_peered":"2023-10-09T11:44:11.250597+0000","last_unstale":"2023-10-09T11:44:12.296150+0000","last_undegraded":"2023-10-09T11:44:12.296150+0000","last_fullsized":"2023-10-09T11:44:12.296150+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:32.783621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284665+0000","last_change":"2023-10-09T11:44:12.280919+0000","last_active":"2023-10-09T11:44:12.284665+0000","last_peered":"2023-10-09T11:44:12.284665+0000","last_clean":"2023-10-09T11:44:12.284665+0000","last_became_active":"2023-10-09T11:44:12.280369+0000","last_became_peered":"2023-10-09T11:44:12.280369+0000","last_unstale":"2023-10-09T11:44:12.284665+0000","last_undegraded":"2023-10-09T11:44:12.284665+0000","last_fullsized":"2023-10-09T11:44:12.284665+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:27.615187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"183'1","reported_seq":11,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-09T11:44:13.263968+0000","last_change":"2023-10-09T11:44:11.252539+0000","last_active":"2023-10-09T11:44:13.263968+0000","last_peered":"2023-10-09T11:44:13.263968+0000","last_clean":"2023-10-09T11:44:13.263968+0000","last_became_active":"2023-10-09T11:44:11.252251+0000","last_became_peered":"2023-10-09T11:44:11.252251+0000","last_unstale":"2023-10-09T11:44:13.263968+0000","last_undegraded":"2023-10-09T11:44:13.263968+0000","last_fullsized":"2023-10-09T11:44:13.263968+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:27.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.278495+0000","last_change":"2023-10-09T11:44:12.277527+0000","last_active":"2023-10-09T11:44:12.278495+0000","last_peered":"2023-10-09T11:44:12.278495+0000","last_clean":"2023-10-09T11:44:12.278495+0000","last_became_active":"2023-10-09T11:44:12.277236+0000","last_became_peered":"2023-10-09T11:44:12.277236+0000","last_unstale":"2023-10-09T11:44:12.278495+0000","last_undegraded":"2023-10-09T11:44:12.278495+0000","last_fullsized":"2023-10-09T11:44:12.278495+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:49.722879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.255955+0000","last_change":"2023-10-09T11:44:11.252839+0000","last_active":"2023-10-09T11:44:12.255955+0000","last_peered":"2023-10-09T11:44:12.255955+0000","last_clean":"2023-10-09T11:44:12.255955+0000","last_became_active":"2023-10-09T11:44:11.252571+0000","last_became_peered":"2023-10-09T11:44:11.252571+0000","last_unstale":"2023-10-09T11:44:12.255955+0000","last_undegraded":"2023-10-09T11:44:12.255955+0000","last_fullsized":"2023-10-09T11:44:12.255955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:04.073378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.284661+0000","last_change":"2023-10-09T11:44:12.278997+0000","last_active":"2023-10-09T11:44:12.284661+0000","last_peered":"2023-10-09T11:44:12.284661+0000","last_clean":"2023-10-09T11:44:12.284661+0000","last_became_active":"2023-10-09T11:44:12.278530+0000","last_became_peered":"2023-10-09T11:44:12.278530+0000","last_unstale":"2023-10-09T11:44:12.284661+0000","last_undegraded":"2023-10-09T11:44:12.284661+0000","last_fullsized":"2023-10-09T11:44:12.284661+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:16.481903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.256442+0000","last_change":"2023-10-09T11:44:11.257159+0000","last_active":"2023-10-09T11:44:12.256442+0000","last_peered":"2023-10-09T11:44:12.256442+0000","last_clean":"2023-10-09T11:44:12.256442+0000","last_became_active":"2023-10-09T11:44:11.256893+0000","last_became_peered":"2023-10-09T11:44:11.256893+0000","last_unstale":"2023-10-09T11:44:12.256442+0000","last_undegraded":"2023-10-09T11:44:12.256442+0000","last_fullsized":"2023-10-09T11:44:12.256442+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:38.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271958+0000","last_change":"2023-10-09T11:44:12.270119+0000","last_active":"2023-10-09T11:44:12.271958+0000","last_peered":"2023-10-09T11:44:12.271958+0000","last_clean":"2023-10-09T11:44:12.271958+0000","last_became_active":"2023-10-09T11:44:12.269860+0000","last_became_peered":"2023-10-09T11:44:12.269860+0000","last_unstale":"2023-10-09T11:44:12.271958+0000","last_undegraded":"2023-10-09T11:44:12.271958+0000","last_fullsized":"2023-10-09T11:44:12.271958+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:48.499907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269242+0000","last_change":"2023-10-09T11:44:11.254560+0000","last_active":"2023-10-09T11:44:12.269242+0000","last_peered":"2023-10-09T11:44:12.269242+0000","last_clean":"2023-10-09T11:44:12.269242+0000","last_became_active":"2023-10-09T11:44:11.254255+0000","last_became_peered":"2023-10-09T11:44:11.254255+0000","last_unstale":"2023-10-09T11:44:12.269242+0000","last_undegraded":"2023-10-09T11:44:12.269242+0000","last_fullsized":"2023-10-09T11:44:12.269242+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:01.508448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268711+0000","last_change":"2023-10-09T11:44:12.265836+0000","last_active":"2023-10-09T11:44:12.268711+0000","last_peered":"2023-10-09T11:44:12.268711+0000","last_clean":"2023-10-09T11:44:12.268711+0000","last_became_active":"2023-10-09T11:44:12.265556+0000","last_became_peered":"2023-10-09T11:44:12.265556+0000","last_unstale":"2023-10-09T11:44:12.268711+0000","last_undegraded":"2023-10-09T11:44:12.268711+0000","last_fullsized":"2023-10-09T11:44:12.268711+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:44.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.267118+0000","last_change":"2023-10-09T11:44:11.253601+0000","last_active":"2023-10-09T11:44:12.267118+0000","last_peered":"2023-10-09T11:44:12.267118+0000","last_clean":"2023-10-09T11:44:12.267118+0000","last_became_active":"2023-10-09T11:44:11.252839+0000","last_became_peered":"2023-10-09T11:44:11.252839+0000","last_unstale":"2023-10-09T11:44:12.267118+0000","last_undegraded":"2023-10-09T11:44:12.267118+0000","last_fullsized":"2023-10-09T11:44:12.267118+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:59.261645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.271533+0000","last_change":"2023-10-09T11:44:12.270361+0000","last_active":"2023-10-09T11:44:12.271533+0000","last_peered":"2023-10-09T11:44:12.271533+0000","last_clean":"2023-10-09T11:44:12.271533+0000","last_became_active":"2023-10-09T11:44:12.270098+0000","last_became_peered":"2023-10-09T11:44:12.270098+0000","last_unstale":"2023-10-09T11:44:12.271533+0000","last_undegraded":"2023-10-09T11:44:12.271533+0000","last_fullsized":"2023-10-09T11:44:12.271533+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:30.835127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.259407+0000","last_change":"2023-10-09T11:44:11.251683+0000","last_active":"2023-10-09T11:44:12.259407+0000","last_peered":"2023-10-09T11:44:12.259407+0000","last_clean":"2023-10-09T11:44:12.259407+0000","last_became_active":"2023-10-09T11:44:11.251366+0000","last_became_peered":"2023-10-09T11:44:11.251366+0000","last_unstale":"2023-10-09T11:44:12.259407+0000","last_undegraded":"2023-10-09T11:44:12.259407+0000","last_fullsized":"2023-10-09T11:44:12.259407+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:32.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.279313+0000","last_change":"2023-10-09T11:44:12.277051+0000","last_active":"2023-10-09T11:44:12.279313+0000","last_peered":"2023-10-09T11:44:12.279313+0000","last_clean":"2023-10-09T11:44:12.279313+0000","last_became_active":"2023-10-09T11:44:12.276725+0000","last_became_peered":"2023-10-09T11:44:12.276725+0000","last_unstale":"2023-10-09T11:44:12.279313+0000","last_undegraded":"2023-10-09T11:44:12.279313+0000","last_fullsized":"2023-10-09T11:44:12.279313+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:19.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.269113+0000","last_change":"2023-10-09T11:44:11.251728+0000","last_active":"2023-10-09T11:44:12.269113+0000","last_peered":"2023-10-09T11:44:12.269113+0000","last_clean":"2023-10-09T11:44:12.269113+0000","last_became_active":"2023-10-09T11:44:11.251072+0000","last_became_peered":"2023-10-09T11:44:11.251072+0000","last_unstale":"2023-10-09T11:44:12.269113+0000","last_undegraded":"2023-10-09T11:44:12.269113+0000","last_fullsized":"2023-10-09T11:44:12.269113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:55.980828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.268852+0000","last_change":"2023-10-09T11:44:12.266545+0000","last_active":"2023-10-09T11:44:12.268852+0000","last_peered":"2023-10-09T11:44:12.268852+0000","last_clean":"2023-10-09T11:44:12.268852+0000","last_became_active":"2023-10-09T11:44:12.266287+0000","last_became_peered":"2023-10-09T11:44:12.266287+0000","last_unstale":"2023-10-09T11:44:12.268852+0000","last_undegraded":"2023-10-09T11:44:12.268852+0000","last_fullsized":"2023-10-09T11:44:12.268852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:11.234090+0000","last_clean_scrub_stamp":"2023-10-09T11:44:11.234090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:58.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"182'1","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.295747+0000","last_change":"2023-10-09T11:44:11.247562+0000","last_active":"2023-10-09T11:44:12.295747+0000","last_peered":"2023-10-09T11:44:12.295747+0000","last_clean":"2023-10-09T11:44:12.295747+0000","last_became_active":"2023-10-09T11:44:11.247261+0000","last_became_peered":"2023-10-09T11:44:11.247261+0000","last_unstale":"2023-10-09T11:44:12.295747+0000","last_undegraded":"2023-10-09T11:44:12.295747+0000","last_fullsized":"2023-10-09T11:44:12.295747+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:10.224480+0000","last_clean_scrub_stamp":"2023-10-09T11:44:10.224480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:46.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":296,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:44:12.274036+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:12.274036+0000","last_peered":"2023-10-09T11:44:12.274036+0000","last_clean":"2023-10-09T11:44:12.274036+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:12.274036+0000","last_undegraded":"2023-10-09T11:44:12.274036+0000","last_fullsized":"2023-10-09T11:44:12.274036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304240,"kb_used_data":2856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067600,"statfs":{"total":96636764160,"available":96325222400,"internally_reserved":0,"allocated":2924544,"data_stored":1634902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.66500000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.67700000000000005,"5min":0.81399999999999995,"15min":5.8700000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.57399999999999995},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.751,"15min":2.6160000000000001},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.68600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.256},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.80200000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68899999999999995,"5min":0.86699999999999999,"15min":8.8940000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.62,"15min":0.86899999999999999},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":8.9309999999999992},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":2.7629999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.55900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":1.3},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.163},"last":0.77700000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.61099999999999999},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":1.369},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":1.1279999999999999},"last":0.81499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1044522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.77900000000000003,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.748,"5min":0.85199999999999998,"15min":1.153},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.92800000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.81299999999999994},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.86399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":1.1060000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77300000000000002,"5min":0.871,"15min":0.871},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0069999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.503},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.624}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.48999999999999999},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.65600000000000003,"15min":11.06},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.379,"15min":0.84199999999999997},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.372,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":11.935},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.69399999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":11.087},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39800000000000002,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.74399999999999999},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.65700000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.90900000000000003},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88400000000000001,"15min":10.939},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85699999999999998,"5min":0.85799999999999998,"15min":4.9370000000000003},"last":0.627}]},{"osd":6,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.94099999999999995},"min":{"1min":0.443,"5min":0.38,"15min":0.376},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":10.975},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.96899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":0.96999999999999997,"15min":11.031000000000001},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.96999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.93000000000000005,"15min":11.000999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308340,"kb_used_data":2860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063500,"statfs":{"total":96636764160,"available":96321024000,"internally_reserved":0,"allocated":2928640,"data_stored":1636314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.496},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":3.8650000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38,"15min":0.52900000000000003},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.72899999999999998},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.60499999999999998,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.375,"15min":0.76600000000000001},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":12.589},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.435},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36099999999999999,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":1.502},"last":0.42699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.63},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74399999999999999,"5min":1.095,"15min":1.446},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82299999999999995,"5min":1.1970000000000001,"15min":1.278},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84099999999999997,"5min":2.286,"15min":2.286},"last":0.76200000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.66300000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.95799999999999996,"15min":1.639},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":1.288,"15min":1.3149999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.5629999999999999},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303660,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068180,"statfs":{"total":96636764160,"available":96325816320,"internally_reserved":0,"allocated":2330624,"data_stored":1045034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32500000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":1.272},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35799999999999998,"15min":0.36899999999999999},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":0.624,"5min":0.66400000000000003,"15min":0.68400000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.39000000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.75,"15min":0.75},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.57099999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90800000000000003},"last":0.435}]},{"osd":5,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56799999999999995,"15min":0.58899999999999997},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":1.286},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":3.843},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.3149999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2347008,"data_stored":1046556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.375,"5min":0.35199999999999998,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":1,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58099999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.73099999999999998,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.45700000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.77500000000000002,"5min":0.871,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1044480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":1.056},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.75}]},{"osd":1,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.65500000000000003},"min":{"1min":0.47799999999999998,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.7400000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.69999999999999996},"min":{"1min":0.438,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.84499999999999997,"15min":1.234},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":0.81999999999999995,"15min":0.91800000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.0229999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.878,"15min":1.282},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.78100000000000003,"5min":0.79900000000000004,"15min":0.95499999999999996},"last":0.621},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.73499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542260,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1044410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.307},"max":{"1min":0.69699999999999995,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.89600000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":0.752,"5min":0.90600000000000003,"15min":1.0189999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.95999999999999996},"last":0.75800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.86799999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65600000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.89200000000000002},"last":0.873},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:21.343 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:44:21.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:44:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.502+0000 7fa7b549c700 1 Processor -- start 2023-10-09T11:44:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.502+0000 7fa7b549c700 1 -- start start 2023-10-09T11:44:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7b549c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7b0159530 0x7fa7b00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7b549c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7b549c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b00ccfd0 con 0x7fa7b006dc70 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7b549c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b00cf0e0 con 0x7fa7b0159530 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7b549c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b015a3d0 con 0x7fa7b006e0e0 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7aeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7b0159530 0x7fa7b00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7ae7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa7b006dc70 0x7fa7b0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52016/0 (socket says 172.21.15.26:52016) 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.503+0000 7fa7ae7fc700 1 -- 172.21.15.26:0/3911586495 learned_addr learned my addr 172.21.15.26:0/3911586495 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7af7fe700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7adffb700 1 -- 172.21.15.26:0/3911586495 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773479982 0 0) 0x7fa7b00ccfd0 con 0x7fa7b006dc70 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7adffb700 1 -- 172.21.15.26:0/3911586495 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa798003570 con 0x7fa7b006dc70 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3911586495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 msgr2=0x7fa7b00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7aeffd700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3911586495 >> v1:172.21.15.26:6789/0 conn(0x7fa7b006dc70 legacy=0x7fa7b0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3911586495 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b015a6b0 con 0x7fa7b0159530 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7af7fe700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7aeffd700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b0159530 0x7fa7b00ceba0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00098e0 tx=0x7fa7a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7777d25cd94a28ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7adffb700 1 -- 172.21.15.26:0/3911586495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000b640 con 0x7fa7b0159530 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7adffb700 1 -- 172.21.15.26:0/3911586495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000b7a0 con 0x7fa7b0159530 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.504+0000 7fa7adffb700 1 -- 172.21.15.26:0/3911586495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000bb40 con 0x7fa7b0159530 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 -- 172.21.15.26:0/3911586495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b0159530 msgr2=0x7fa7b00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b0159530 0x7fa7b00ceba0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00098e0 tx=0x7fa7a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 -- 172.21.15.26:0/3911586495 shutdown_connections 2023-10-09T11:44:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3911586495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b0159530 0x7fa7b00ceba0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 -- 172.21.15.26:0/3911586495 >> 172.21.15.26:0/3911586495 conn(0x7fa7b00703a0 msgr2=0x7fa7b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 -- 172.21.15.26:0/3911586495 shutdown_connections 2023-10-09T11:44:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.505+0000 7fa7b549c700 1 -- 172.21.15.26:0/3911586495 wait complete. 2023-10-09T11:44:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.506+0000 7fa7b549c700 1 Processor -- start 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.506+0000 7fa7b549c700 1 -- start start 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b0159530 0x7fa7b00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0155660 con 0x7fa7b006dc70 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0155940 con 0x7fa7b0159530 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0153b30 con 0x7fa7b006e0e0 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51510/0 (socket says 172.21.15.26:51510) 2023-10-09T11:44:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3251582079 learned_addr learned my addr 172.21.15.26:0/3251582079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7af7fe700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b0159530 0x7fa7b00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7ae7fc700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 msgr2=0x7fa7b00b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b0159530 msgr2=0x7fa7b00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b0159530 0x7fa7b00b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 -- 172.21.15.26:0/3251582079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009420 con 0x7fa7b006dc70 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7aeffd700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f80 tx=0x7fa7a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a001bd90 con 0x7fa7b006dc70 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0011420 con 0x7fa7b006dc70 2023-10-09T11:44:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00117e0 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0153e10 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.507+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0152e00 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.509+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b004c3c0 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.509+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7a0011b90 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.509+0000 7fa796ffd700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.509+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7a0086210 con 0x7fa7b006dc70 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.509+0000 7fa7ae7fc700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.510+0000 7fa7ae7fc700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 0x7fa79c0697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40058d0 tx=0x7fa7a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.514+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a0052ea0 con 0x7fa7b006dc70 2023-10-09T11:44:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.785+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa7b015a990 con 0x7fa7b006dc70 2023-10-09T11:44:21.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.788+0000 7fa796ffd700 1 -- 172.21.15.26:0/3251582079 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa7a00564c0 con 0x7fa7b006dc70 2023-10-09T11:44:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.790+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 msgr2=0x7fa79c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.790+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 0x7fa79c0697d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40058d0 tx=0x7fa7a4009040 comp rx=0 tx=0).stop 2023-10-09T11:44:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.790+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 msgr2=0x7fa7b014e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.790+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f80 tx=0x7fa7a0017000 comp rx=0 tx=0).stop 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 shutdown_connections 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7b0159530 0x7fa7b00b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b006dc70 0x7fa7b014e150 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 --2- 172.21.15.26:0/3251582079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7b006e0e0 0x7fa7b00b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 >> 172.21.15.26:0/3251582079 conn(0x7fa7b00703a0 msgr2=0x7fa7b00cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:21.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 shutdown_connections 2023-10-09T11:44:21.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.791+0000 7fa7b549c700 1 -- 172.21.15.26:0/3251582079 wait complete. 2023-10-09T11:44:21.794 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:44:21.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:21.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.921+0000 7f06b1268700 1 Processor -- start 2023-10-09T11:44:21.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.921+0000 7f06b1268700 1 -- start start 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06b1268700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06ac1594d0 0x7f06ac0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06b1268700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f06ac0cb1a0 0x7f06ac0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06b1268700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15e010 con 0x7f06ac1598a0 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06b1268700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac15d420 con 0x7f06ac1594d0 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06b1268700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac15d6e0 con 0x7f06ac0cb1a0 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06ac1594d0 0x7f06ac0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06ac1594d0 0x7f06ac0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51516/0 (socket says 172.21.15.26:51516) 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 -- 172.21.15.26:0/1778746073 learned_addr learned my addr 172.21.15.26:0/1778746073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aa7fc700 1 --2- 172.21.15.26:0/1778746073 >> v2:172.21.15.67:3300/0 conn(0x7f06ac0cb1a0 0x7f06ac0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 -- 172.21.15.26:0/1778746073 >> v2:172.21.15.67:3300/0 conn(0x7f06ac0cb1a0 msgr2=0x7f06ac0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:21.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 --2- 172.21.15.26:0/1778746073 >> v2:172.21.15.67:3300/0 conn(0x7f06ac0cb1a0 0x7f06ac0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 -- 172.21.15.26:0/1778746073 >> v1:172.21.15.67:6789/0 conn(0x7f06ac1598a0 legacy=0x7f06ac0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.922+0000 7f06aaffd700 1 -- 172.21.15.26:0/1778746073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac15d9c0 con 0x7f06ac1594d0 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06aaffd700 1 --2- 172.21.15.26:0/1778746073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1594d0 0x7f06ac0cea70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0633c0 tx=0x7f06a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483693f5cd7eb622 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06a9ffb700 1 -- 172.21.15.26:0/1778746073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400e070 con 0x7f06ac1594d0 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06a9ffb700 1 -- 172.21.15.26:0/1778746073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400ba50 con 0x7f06ac1594d0 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06a9ffb700 1 -- 172.21.15.26:0/1778746073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40092e0 con 0x7f06ac1594d0 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 -- 172.21.15.26:0/1778746073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1594d0 msgr2=0x7f06ac0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 --2- 172.21.15.26:0/1778746073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1594d0 0x7f06ac0cea70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0633c0 tx=0x7f06a4009840 comp rx=0 tx=0).stop 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 -- 172.21.15.26:0/1778746073 shutdown_connections 2023-10-09T11:44:21.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 --2- 172.21.15.26:0/1778746073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1594d0 0x7f06ac0cea70 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 --2- 172.21.15.26:0/1778746073 >> v2:172.21.15.67:3300/0 conn(0x7f06ac0cb1a0 0x7f06ac0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 -- 172.21.15.26:0/1778746073 >> 172.21.15.26:0/1778746073 conn(0x7f06ac0703a0 msgr2=0x7f06ac070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:21.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 -- 172.21.15.26:0/1778746073 shutdown_connections 2023-10-09T11:44:21.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.923+0000 7f06b1268700 1 -- 172.21.15.26:0/1778746073 wait complete. 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.924+0000 7f06b1268700 1 Processor -- start 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 -- start start 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06ac0cb1a0 0x7f06ac0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06ac1594d0 0x7f06ac14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0ca4e0 con 0x7f06ac1598a0 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b0800 con 0x7f06ac0cb1a0 2023-10-09T11:44:21.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06b1268700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0c9f20 con 0x7f06ac1594d0 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51528/0 (socket says 172.21.15.26:51528) 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.925+0000 7f06ab7fe700 1 -- 172.21.15.26:0/2225355428 learned_addr learned my addr 172.21.15.26:0/2225355428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06aaffd700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06ac0cb1a0 0x7f06ac0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06aa7fc700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06ac1594d0 0x7f06ac14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 -- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06ac1594d0 msgr2=0x7f06ac14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06ac1594d0 0x7f06ac14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 -- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06ac0cb1a0 msgr2=0x7f06ac0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06ac0cb1a0 0x7f06ac0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:21.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 -- 172.21.15.26:0/2225355428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009ae0 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c4c0 tx=0x7f069c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ce70 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c011590 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c011970 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0ca200 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.926+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0c9ba0 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.927+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac0b02f0 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.928+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f069c011ce0 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.928+0000 7f06a2ffd700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 0x7f068c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.928+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f069c083f90 con 0x7f06ac1598a0 2023-10-09T11:44:21.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.928+0000 7f06aaffd700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 0x7f068c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:21.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.929+0000 7f06aaffd700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 0x7f068c0697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009880 tx=0x7f06a4018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:21.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:21.932+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06ac0b02f0 con 0x7f06ac1598a0 2023-10-09T11:44:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.169+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06ac0b02f0 con 0x7f06ac1598a0 2023-10-09T11:44:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.169+0000 7f06a2ffd700 1 -- 172.21.15.26:0/2225355428 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4601 (secure 0 0 0) 0x7f06ac0b02f0 con 0x7f06ac1598a0 2023-10-09T11:44:22.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:22.171 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":120,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:15.297277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.171+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 msgr2=0x7f068c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.171+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 0x7f068c0697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009880 tx=0x7f06a4018000 comp rx=0 tx=0).stop 2023-10-09T11:44:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.171+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 msgr2=0x7f06ac0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.171+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c4c0 tx=0x7f069c007f50 comp rx=0 tx=0).stop 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 shutdown_connections 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac1598a0 0x7f06ac0cb6e0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06ac0cb1a0 0x7f06ac0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f068c067320 0x7f068c0697d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 --2- 172.21.15.26:0/2225355428 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06ac1594d0 0x7f06ac14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 >> 172.21.15.26:0/2225355428 conn(0x7f06ac0703a0 msgr2=0x7f06ac0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 shutdown_connections 2023-10-09T11:44:22.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.172+0000 7f06b1268700 1 -- 172.21.15.26:0/2225355428 wait complete. 2023-10-09T11:44:22.175 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 120 2023-10-09T11:44:22.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 120, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:44:11.646554+0000', 'modified': '2023-10-09T11:44:15.297277+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8724}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8724': {'gid': 8724, 'name': 'd', 'rank': 0, 'incarnation': 116, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6836/136982227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 136982227}, {'type': 'v1', 'addr': '172.21.15.67:6836', 'nonce': 136982227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:44:22.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:44:22.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:44:22.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.709+0000 7fb4c1739700 1 Processor -- start 2023-10-09T11:44:22.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 -- start start 2023-10-09T11:44:22.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4bc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4bc0cf200 0x7fb4bc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc15a280 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc06e180 con 0x7fb4bc0cf200 2023-10-09T11:44:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4c1739700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cd540 con 0x7fb4bc0b07d0 2023-10-09T11:44:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4bb7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4bc0b0ba0 0x7fb4bc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52032/0 (socket says 172.21.15.26:52032) 2023-10-09T11:44:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.710+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3472118520 learned_addr learned my addr 172.21.15.26:0/3472118520 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4baffd700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4bc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/3472118520 >> v2:172.21.15.67:3300/0 conn(0x7fb4bc0cf200 0x7fb4bc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188907086 0 0) 0x7fb4bc15a280 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a8003570 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 109420815 0 0) 0x7fb4a8003570 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 msgr2=0x7fb4bc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4bc0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 >> v2:172.21.15.67:3300/0 conn(0x7fb4bc0cf200 msgr2=0x7fb4bc0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 --2- 172.21.15.26:0/3472118520 >> v2:172.21.15.67:3300/0 conn(0x7fb4bc0cf200 0x7fb4bc0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc06d850 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb4ac001470 con 0x7fb4bc0b0ba0 2023-10-09T11:44:22.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 >> v1:172.21.15.26:6789/0 conn(0x7fb4bc0b0ba0 legacy=0x7fb4bc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4a8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a8003fe0 0x7fb4a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc06e180 con 0x7fb4a8004d50 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cd540 con 0x7fb4a8003fe0 2023-10-09T11:44:22.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a800ba90 con 0x7fb4bc0b07d0 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4baffd700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4a8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.711+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a8003fe0 0x7fb4a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 msgr2=0x7fb4a8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0b07d0 0x7fb4a8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a8003fe0 msgr2=0x7fb4a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a8003fe0 0x7fb4a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3472118520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8003570 con 0x7fb4a8004d50 2023-10-09T11:44:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4a80051c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c3c0 tx=0x7fb4ac001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7b3b8d0118bb99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00cc30 con 0x7fb4a8004d50 2023-10-09T11:44:22.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac00cdb0 con 0x7fb4a8004d50 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4b9ffb700 1 -- 172.21.15.26:0/3472118520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac005b70 con 0x7fb4a8004d50 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4c1739700 1 -- 172.21.15.26:0/3472118520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 msgr2=0x7fb4a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4c1739700 1 --2- 172.21.15.26:0/3472118520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4a80051c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c3c0 tx=0x7fb4ac001e90 comp rx=0 tx=0).stop 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3472118520 reap_dead start 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4c1739700 1 -- 172.21.15.26:0/3472118520 shutdown_connections 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4c1739700 1 -- 172.21.15.26:0/3472118520 >> 172.21.15.26:0/3472118520 conn(0x7fb4bc06ce80 msgr2=0x7fb4bc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.712+0000 7fb4c1739700 1 -- 172.21.15.26:0/3472118520 shutdown_connections 2023-10-09T11:44:22.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.713+0000 7fb4c1739700 1 -- 172.21.15.26:0/3472118520 wait complete. 2023-10-09T11:44:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 Processor -- start 2023-10-09T11:44:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 -- start start 2023-10-09T11:44:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0990c0 0x7fb4bc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4bc099f70 0x7fb4bc0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b12d0 con 0x7fb4a8004d50 2023-10-09T11:44:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b1b70 con 0x7fb4bc099f70 2023-10-09T11:44:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.714+0000 7fb4c1739700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc169fe0 con 0x7fb4bc0990c0 2023-10-09T11:44:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51532/0 (socket says 172.21.15.26:51532) 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 -- 172.21.15.26:0/4207133817 learned_addr learned my addr 172.21.15.26:0/4207133817 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 -- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0990c0 msgr2=0x7fb4bc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0990c0 0x7fb4bc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 -- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4bc099f70 msgr2=0x7fb4bc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4bc099f70 0x7fb4bc0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 -- 172.21.15.26:0/4207133817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc09a870 con 0x7fb4a8004d50 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4baffd700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4011f80 tx=0x7fb4b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4b2ffd700 1 -- 172.21.15.26:0/4207133817 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400e040 con 0x7fb4a8004d50 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4b2ffd700 1 -- 172.21.15.26:0/4207133817 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400f040 con 0x7fb4a8004d50 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0b1520 con 0x7fb4a8004d50 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4b2ffd700 1 -- 172.21.15.26:0/4207133817 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4015430 con 0x7fb4a8004d50 2023-10-09T11:44:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.715+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc158b50 con 0x7fb4a8004d50 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.717+0000 7fb4b2ffd700 1 -- 172.21.15.26:0/4207133817 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb4b4015860 con 0x7fb4a8004d50 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.717+0000 7fb4b2ffd700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 0x7fb49c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.717+0000 7fb4b2ffd700 1 -- 172.21.15.26:0/4207133817 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4b4085b00 con 0x7fb4a8004d50 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.717+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 0x7fb49c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.718+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 0x7fb49c0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009170 tx=0x7fb4a40091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.719+0000 7fb4caa31b80 1 Processor -- start 2023-10-09T11:44:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.719+0000 7fb4caa31b80 1 -- start start 2023-10-09T11:44:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf209dd00 0x559cf207ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf204fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf1faaa70 con 0x559cf2053a50 2023-10-09T11:44:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf1fa8270 con 0x559cf207cf60 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cf1fa4060 con 0x559cf209dd00 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51540/0 (socket says 172.21.15.26:51540) 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 -- 172.21.15.26:0/1037675558 learned_addr learned my addr 172.21.15.26:0/1037675558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf204fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf209dd00 0x559cf207ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 -- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf209dd00 msgr2=0x559cf207ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf209dd00 0x559cf207ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 -- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 msgr2=0x559cf204fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf204fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 -- 172.21.15.26:0/1037675558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cf1e3e270 con 0x559cf2053a50 2023-10-09T11:44:22.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf204fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.720+0000 7fb4baffd700 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40839d0 tx=0x7fb4b4056110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84613838041aee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb49bfff700 1 -- 172.21.15.26:0/1037675558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4059590 con 0x559cf2053a50 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb49bfff700 1 -- 172.21.15.26:0/1037675558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b405d2e0 con 0x559cf2053a50 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb49bfff700 1 -- 172.21.15.26:0/1037675558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4015b10 con 0x559cf2053a50 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 -- 172.21.15.26:0/1037675558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 msgr2=0x559cf2053e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40839d0 tx=0x7fb4b4056110 comp rx=0 tx=0).stop 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 -- 172.21.15.26:0/1037675558 shutdown_connections 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf204fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf2053a50 0x559cf2053e20 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/1037675558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf209dd00 0x559cf207ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 -- 172.21.15.26:0/1037675558 >> 172.21.15.26:0/1037675558 conn(0x559cf2055370 msgr2=0x559cf2055740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 -- 172.21.15.26:0/1037675558 shutdown_connections 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.721+0000 7fb4caa31b80 1 -- 172.21.15.26:0/1037675558 wait complete. 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.722+0000 7fb4caa31b80 1 -- start start 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.722+0000 7fb4caa31b80 1 Processor -- start 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2079420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf207d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf1f4f890 con 0x559cf209dd00 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf1f6aea0 con 0x559cf207cf60 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cf1e26e30 con 0x559cf2053a50 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4caa31b80 10 client.0 _ll_register_callbacks cb 0x559cf2017110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51544/0 (socket says 172.21.15.26:51544) 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3775332913 learned_addr learned my addr 172.21.15.26:0/3775332913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4baffd700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2079420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf207d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 msgr2=0x559cf2079420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2079420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 msgr2=0x559cf207d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf207d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/3775332913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc158b50 con 0x559cf209dd00 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.723+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf207d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac011000 tx=0x7fb4ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e52734fd4d89c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:44:22.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00cc30 con 0x559cf209dd00 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4ac0070d0 con 0x559cf209dd00 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cf2048b70 con 0x559cf209dd00 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4ac005b90 con 0x559cf209dd00 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 10 client.8895 fetch_fsmap learned FSMap version 120 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) v3 -- 0x559cf1de0fe0 con 0x559cf209dd00 2023-10-09T11:44:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cf2048b70 con 0x559cf209dd00 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 120) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb4ac0074a0 con 0x559cf209dd00 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 10 client.8895 fetch_fsmap finished waiting for FSMap version 120 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 10 client.8895 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 20 client.8895 populate_metadata read hostname 'smithi026' 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf2094600 0x559cf20949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 4 client.8895 mds_command: new command op to 8724 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:44:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 --> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cf2025aa0 con 0x559cf2094600 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.724+0000 7fb4baffd700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf2094600 0x559cf20949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.725+0000 7fb4997fa700 10 client.8895 ms_handle_connect on v2:172.21.15.67:6834/136982227 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.725+0000 7fb4baffd700 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf2094600 0x559cf20949d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c773b1935b52ea91 server_cookie=b73ce1ae9f185116 in_seq=0 out_seq=0 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.725+0000 7fb4997fa700 1 -- 172.21.15.26:0/3775332913 <== mds.0 v2:172.21.15.67:6834/136982227 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559cf2025aa0 con 0x559cf2094600 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4997fa700 10 client.8895 handle_command_reply: tid=0 2023-10-09T11:44:22.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 client.8895 shutdown 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 msgr2=0x559cf204ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac011000 tx=0x7fb4ac015000 comp rx=0 tx=0).stop 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 shutdown_connections 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf204ec20 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf2094600 0x559cf20949d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2079420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4997fa700 0 client.8895 ms_handle_reset on v2:172.21.15.67:6834/136982227 2023-10-09T11:44:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/3775332913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf207d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 >> 172.21.15.26:0/3775332913 conn(0x559cf2055370 msgr2=0x559cf2099520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 shutdown_connections 2023-10-09T11:44:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 1 -- 172.21.15.26:0/3775332913 wait complete. 2023-10-09T11:44:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.726+0000 7fb4caa31b80 20 client.8895 trim_cache size 0 max 16384 2023-10-09T11:44:22.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 Processor -- start 2023-10-09T11:44:22.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 -- start start 2023-10-09T11:44:22.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2053ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf209dd00 0x559cf20fa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf207c410 con 0x559cf207cf60 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf2050f90 con 0x559cf209dd00 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.743+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cf2098a90 con 0x559cf2053a50 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51560/0 (socket says 172.21.15.26:51560) 2023-10-09T11:44:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 -- 172.21.15.26:0/813335477 learned_addr learned my addr 172.21.15.26:0/813335477 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4baffd700 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2053ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf209dd00 0x559cf20fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 -- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 msgr2=0x559cf2053ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2053ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 -- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf209dd00 msgr2=0x559cf20fa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf209dd00 0x559cf20fa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 -- 172.21.15.26:0/813335477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cf1f72780 con 0x559cf207cf60 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006f00 tx=0x7fb4a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4145246dbfa1d9b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4b0ff9700 1 -- 172.21.15.26:0/813335477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4011e60 con 0x559cf207cf60 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4b0ff9700 1 -- 172.21.15.26:0/813335477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4014ae0 con 0x559cf207cf60 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.744+0000 7fb4b0ff9700 1 -- 172.21.15.26:0/813335477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4014e60 con 0x559cf207cf60 2023-10-09T11:44:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- 172.21.15.26:0/813335477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 msgr2=0x559cf20fa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006f00 tx=0x7fb4a4019000 comp rx=0 tx=0).stop 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- 172.21.15.26:0/813335477 shutdown_connections 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf209dd00 0x559cf20fa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf2053ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/813335477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf207cf60 0x559cf20fa330 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- 172.21.15.26:0/813335477 >> 172.21.15.26:0/813335477 conn(0x559cf2055370 msgr2=0x559cf2056bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- 172.21.15.26:0/813335477 shutdown_connections 2023-10-09T11:44:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- 172.21.15.26:0/813335477 wait complete. 2023-10-09T11:44:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 -- start start 2023-10-09T11:44:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.745+0000 7fb4caa31b80 1 Processor -- start 2023-10-09T11:44:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf20ac290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf20f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf2092f20 con 0x559cf209dd00 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cf2101230 con 0x559cf207cf60 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cf20ac7d0 con 0x559cf2053a50 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4caa31b80 10 client.0 _ll_register_callbacks cb 0x559cf2017110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51562/0 (socket says 172.21.15.26:51562) 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.746+0000 7fb4baffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf20ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/4046761301 learned_addr learned my addr 172.21.15.26:0/4046761301 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4ba7fc700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf20f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 msgr2=0x559cf20ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf20ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 msgr2=0x559cf20f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf20f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 -- 172.21.15.26:0/4046761301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4011a60 con 0x559cf209dd00 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4bb7fe700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000c00 tx=0x7fb4ac021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a056fb215ba92c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac001bf0 con 0x559cf209dd00 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4ac0070d0 con 0x559cf209dd00 2023-10-09T11:44:22.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4b405d2e0 con 0x559cf209dd00 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4ac00cc30 con 0x559cf209dd00 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4caa31b80 10 client.8901 fetch_fsmap learned FSMap version 120 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) v3 -- 0x559cf1f59470 con 0x559cf209dd00 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b405d2e0 con 0x559cf209dd00 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 120) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb4ac027410 con 0x559cf209dd00 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.747+0000 7fb4caa31b80 10 client.8901 fetch_fsmap finished waiting for FSMap version 120 2023-10-09T11:44:22.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 10 client.8901 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 20 client.8901 populate_metadata read hostname 'smithi026' 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf20b3430 0x559cf20b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 4 client.8901 mds_command: new command op to 8724 tid=0[{"prefix": "status"}] 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 --> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559cf1f46e00 con 0x559cf20b3430 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4baffd700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf20b3430 0x559cf20b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4997fa700 10 client.8901 ms_handle_connect on v2:172.21.15.67:6834/136982227 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4baffd700 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf20b3430 0x559cf20b3800 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda2beddb8bcba2 server_cookie=110b3a0dabf40389 in_seq=0 out_seq=0 2023-10-09T11:44:22.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4997fa700 1 -- 172.21.15.26:0/4046761301 <== mds.0 v2:172.21.15.67:6834/136982227 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x559cf1f46e00 con 0x559cf20b3430 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4997fa700 10 client.8901 handle_command_reply: tid=0 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 1 client.8901 shutdown 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 msgr2=0x559cf20f7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.748+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000c00 tx=0x7fb4ac021070 comp rx=0 tx=0).stop 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 shutdown_connections 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559cf209dd00 0x559cf20f7850 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:6834/136982227,v1:172.21.15.67:6836/136982227] conn(0x559cf20b3430 0x559cf20b3800 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x559cf2053a50 0x559cf20ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 --2- 172.21.15.26:0/4046761301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559cf207cf60 0x559cf20f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4997fa700 0 client.8901 ms_handle_reset on v2:172.21.15.67:6834/136982227 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 >> 172.21.15.26:0/4046761301 conn(0x559cf2055370 msgr2=0x559cf2056950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 shutdown_connections 2023-10-09T11:44:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 1 -- 172.21.15.26:0/4046761301 wait complete. 2023-10-09T11:44:22.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4caa31b80 20 client.8901 trim_cache size 0 max 16384 2023-10-09T11:44:22.770 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:44:22.770 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:44:22.770 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:44:22.770 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 8724, 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 10.461975342000001, 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 120, 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 183, 2023-10-09T11:44:22.771 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 183, 2023-10-09T11:44:22.772 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 16.021127285999999 2023-10-09T11:44:22.772 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 msgr2=0x7fb49c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 0x7fb49c0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009170 tx=0x7fb4a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 msgr2=0x7fb4bc169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4011f80 tx=0x7fb4b400b040 comp rx=0 tx=0).stop 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 shutdown_connections 2023-10-09T11:44:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4bc099f70 0x7fb4bc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a8004d50 0x7fb4bc169aa0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb49c067320 0x7fb49c0697d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 --2- 172.21.15.26:0/4207133817 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4bc0990c0 0x7fb4bc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 >> 172.21.15.26:0/4207133817 conn(0x7fb4bc06ce80 msgr2=0x7fb4bc0c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 shutdown_connections 2023-10-09T11:44:22.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.749+0000 7fb4c1739700 1 -- 172.21.15.26:0/4207133817 wait complete. 2023-10-09T11:44:22.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:44:22.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.893+0000 7efec1f70700 1 Processor -- start 2023-10-09T11:44:22.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.893+0000 7efec1f70700 1 -- start start 2023-10-09T11:44:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efec1f70700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efebc0cb5a0 0x7efebc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efec1f70700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc15ae40 con 0x7efebc0cd9e0 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efec1f70700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc15ab60 con 0x7efebc15a5d0 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efec1f70700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc0d13f0 con 0x7efebc0cb5a0 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efebaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efebc0cd9e0 0x7efebc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52046/0 (socket says 172.21.15.26:52046) 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.894+0000 7efebaffd700 1 -- 172.21.15.26:0/1026592414 learned_addr learned my addr 172.21.15.26:0/1026592414 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebb7fe700 1 --2- 172.21.15.26:0/1026592414 >> v2:172.21.15.67:3300/0 conn(0x7efebc0cb5a0 0x7efebc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110653206 0 0) 0x7efebc15ae40 con 0x7efebc0cd9e0 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea4003570 con 0x7efebc0cd9e0 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 37988181 0 0) 0x7efea4003570 con 0x7efebc0cd9e0 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 >> v2:172.21.15.67:3300/0 conn(0x7efebc0cb5a0 msgr2=0x7efebc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 --2- 172.21.15.26:0/1026592414 >> v2:172.21.15.67:3300/0 conn(0x7efebc0cb5a0 0x7efebc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 >> v1:172.21.15.67:6789/0 conn(0x7efebc15a5d0 legacy=0x7efebc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0ccf00 con 0x7efebc0cd9e0 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7efeb0001470 con 0x7efebc0cd9e0 2023-10-09T11:44:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 >> v1:172.21.15.26:6789/0 conn(0x7efebc0cd9e0 legacy=0x7efebc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea4003a60 0x7efea4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 0x7efea4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea40051c0 0x7efea400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea400c0a0 con 0x7efea4004810 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea400c210 con 0x7efea4003a60 2023-10-09T11:44:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea400c3d0 con 0x7efea40051c0 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 0x7efea4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebb7fe700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea4003a60 0x7efea4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebbfff700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea40051c0 0x7efea400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 -- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea40051c0 msgr2=0x7efea400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea40051c0 0x7efea400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 -- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea4003a60 msgr2=0x7efea4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea4003a60 0x7efea4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebaffd700 1 -- 172.21.15.26:0/1026592414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4003570 con 0x7efea4004810 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.895+0000 7efebb7fe700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea4003a60 0x7efea4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efebbfff700 1 -- 172.21.15.26:0/1026592414 reap_dead start 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efebaffd700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 0x7efea4004c80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c3c0 tx=0x7efeb0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86112275059829e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000cc90 con 0x7efea4004810 2023-10-09T11:44:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000cdf0 con 0x7efea4004810 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efeba7fc700 1 -- 172.21.15.26:0/1026592414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0005b50 con 0x7efea4004810 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 -- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 msgr2=0x7efea4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 0x7efea4004c80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c3c0 tx=0x7efeb0001e50 comp rx=0 tx=0).stop 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 -- 172.21.15.26:0/1026592414 shutdown_connections 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 --2- 172.21.15.26:0/1026592414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efea4004810 0x7efea4004c80 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 -- 172.21.15.26:0/1026592414 >> 172.21.15.26:0/1026592414 conn(0x7efebc070e30 msgr2=0x7efebc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 -- 172.21.15.26:0/1026592414 shutdown_connections 2023-10-09T11:44:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.896+0000 7efec1f70700 1 -- 172.21.15.26:0/1026592414 wait complete. 2023-10-09T11:44:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 Processor -- start 2023-10-09T11:44:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 -- start start 2023-10-09T11:44:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea4004810 0x7efebc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efebc0c8c20 0x7efebc156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc15c980 con 0x7efebc15ebb0 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc15f560 con 0x7efebc0c8c20 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efec1f70700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0c9fd0 con 0x7efea4004810 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efebbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.898+0000 7efebbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51578/0 (socket says 172.21.15.26:51578) 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 -- 172.21.15.26:0/975407879 learned_addr learned my addr 172.21.15.26:0/975407879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebaffd700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efebc0c8c20 0x7efebc156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebb7fe700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea4004810 0x7efebc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 -- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea4004810 msgr2=0x7efebc15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea4004810 0x7efebc15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 -- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efebc0c8c20 msgr2=0x7efebc156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efebc0c8c20 0x7efebc156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 -- 172.21.15.26:0/975407879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0c96a0 con 0x7efebc15ebb0 2023-10-09T11:44:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efebbfff700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7efebc064ad0 tx=0x7efeb4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40032e0 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4003440 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0c9980 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40017d0 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.899+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0c9090 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.900+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0ca160 con 0x7efebc15ebb0 2023-10-09T11:44:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.901+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efeb4001c00 con 0x7efebc15ebb0 2023-10-09T11:44:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.901+0000 7efea37fe700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 0x7efea80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.901+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efeb4084b30 con 0x7efebc15ebb0 2023-10-09T11:44:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.901+0000 7efebb7fe700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 0x7efea80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.902+0000 7efebb7fe700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 0x7efea80697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efeac0093f0 tx=0x7efeac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:22.905+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeb40517c0 con 0x7efebc15ebb0 2023-10-09T11:44:23.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.144+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efebc04c3c0 con 0x7efebc15ebb0 2023-10-09T11:44:23.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.144+0000 7efea37fe700 1 -- 172.21.15.26:0/975407879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) v1 ==== 53+0+73 (secure 0 0 0) 0x7efeb4054de0 con 0x7efebc15ebb0 2023-10-09T11:44:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:44:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 msgr2=0x7efea80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 0x7efea80697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efeac0093f0 tx=0x7efeac008040 comp rx=0 tx=0).stop 2023-10-09T11:44:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 msgr2=0x7efebc15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7efebc064ad0 tx=0x7efeb4009040 comp rx=0 tx=0).stop 2023-10-09T11:44:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 shutdown_connections 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efebc15ebb0 0x7efebc15f020 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efea8067320 0x7efea80697d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efea4004810 0x7efebc15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 --2- 172.21.15.26:0/975407879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efebc0c8c20 0x7efebc156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 >> 172.21.15.26:0/975407879 conn(0x7efebc070e30 msgr2=0x7efebc0c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 shutdown_connections 2023-10-09T11:44:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.146+0000 7efec1f70700 1 -- 172.21.15.26:0/975407879 wait complete. 2023-10-09T11:44:23.160 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:44:23.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:44:23.160 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:44:23.160 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:44:23.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:23.161 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:44:23.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:44:23.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:44:23.161 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:23.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.161 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:44:23.177 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:44:23.177 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:44:23.177 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:44:23.177 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.177 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:23.178 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41929sec preferred_lft 41929sec 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.179 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.180 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:44:23.181 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:23.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.182 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:44:23.241 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:44:23.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.243 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:44:23.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:44:23.301 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:44:23.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.403 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:44:23.417 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:44:23.417 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:44:23.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:23.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:44:23.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:23.483 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:23.538 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:23.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:23.538 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:23.593 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:44:23.593 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:44:23.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:23.675 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:23.675 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:23.716 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:44:23.717 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:44:23.718 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:44:23.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:23.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:23.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:44:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.942+0000 7fa5bf59e700 1 Processor -- start 2023-10-09T11:44:23.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.942+0000 7fa5bf59e700 1 -- start start 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bf59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5c0159550 0x7fa5c00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bf59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bf59e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00acc00 con 0x7fa5c015dfd0 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bf59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00abff0 con 0x7fa5c0159550 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bf59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00ac2d0 con 0x7fa5c0159920 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5c0159550 0x7fa5c00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5c0159550 0x7fa5c00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51582/0 (socket says 172.21.15.26:51582) 2023-10-09T11:44:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 -- 172.21.15.26:0/4005845524 learned_addr learned my addr 172.21.15.26:0/4005845524 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5bed9d700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 -- 172.21.15.26:0/4005845524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 msgr2=0x7fa5c00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 -- 172.21.15.26:0/4005845524 >> v1:172.21.15.67:6789/0 conn(0x7fa5c015dfd0 legacy=0x7fa5c00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.943+0000 7fa5be59c700 1 -- 172.21.15.26:0/4005845524 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00ac5b0 con 0x7fa5c0159550 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5be59c700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ceac0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009f20 tx=0x7fa5b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdee6d9fe9096d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bd59a700 1 -- 172.21.15.26:0/4005845524 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000e070 con 0x7fa5c0159550 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bd59a700 1 -- 172.21.15.26:0/4005845524 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000b9d0 con 0x7fa5c0159550 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bd59a700 1 -- 172.21.15.26:0/4005845524 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00092e0 con 0x7fa5c0159550 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 -- 172.21.15.26:0/4005845524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 msgr2=0x7fa5c00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ceac0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009f20 tx=0x7fa5b0009840 comp rx=0 tx=0).stop 2023-10-09T11:44:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 -- 172.21.15.26:0/4005845524 shutdown_connections 2023-10-09T11:44:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/4005845524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ceac0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 -- 172.21.15.26:0/4005845524 >> 172.21.15.26:0/4005845524 conn(0x7fa5c006ce80 msgr2=0x7fa5c00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 -- 172.21.15.26:0/4005845524 shutdown_connections 2023-10-09T11:44:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.944+0000 7fa5bf59e700 1 -- 172.21.15.26:0/4005845524 wait complete. 2023-10-09T11:44:23.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 Processor -- start 2023-10-09T11:44:23.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 -- start start 2023-10-09T11:44:23.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c015dfd0 0x7fa5c00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00cbdc0 con 0x7fa5c0159550 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c009a180 con 0x7fa5c015dfd0 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bf59e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00cb2f0 con 0x7fa5c0159920 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5be59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5be59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51592/0 (socket says 172.21.15.26:51592) 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5be59c700 1 -- 172.21.15.26:0/1580261392 learned_addr learned my addr 172.21.15.26:0/1580261392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bed9d700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c015dfd0 0x7fa5c00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.946+0000 7fa5bdd9b700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 -- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 msgr2=0x7fa5c00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 -- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c015dfd0 msgr2=0x7fa5c00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c015dfd0 0x7fa5c00b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 -- 172.21.15.26:0/1580261392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009ae0 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5be59c700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b610 tx=0x7fa5b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00088f0 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0008a50 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c009a440 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0008e10 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.947+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00cb800 con 0x7fa5c0159550 2023-10-09T11:44:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.948+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c004c3c0 con 0x7fa5c0159550 2023-10-09T11:44:23.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.949+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa5b0003040 con 0x7fa5c0159550 2023-10-09T11:44:23.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.949+0000 7fa5b67fc700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 0x7fa5a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:23.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.949+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5b0086490 con 0x7fa5c0159550 2023-10-09T11:44:23.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.949+0000 7fa5bdd9b700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 0x7fa5a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:23.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.950+0000 7fa5bdd9b700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 0x7fa5a00697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00cc6c0 tx=0x7fa5a8007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:23.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:23.953+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5b0053010 con 0x7fa5c0159550 2023-10-09T11:44:24.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.191+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5c006e7c0 con 0x7fa5c0159550 2023-10-09T11:44:24.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.192+0000 7fa5b67fc700 1 -- 172.21.15.26:0/1580261392 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5b0056630 con 0x7fa5c0159550 2023-10-09T11:44:24.193 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:44:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 msgr2=0x7fa5a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 0x7fa5a00697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00cc6c0 tx=0x7fa5a8007ec0 comp rx=0 tx=0).stop 2023-10-09T11:44:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 msgr2=0x7fa5c00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:24.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b610 tx=0x7fa5b0018000 comp rx=0 tx=0).stop 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 shutdown_connections 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c015dfd0 0x7fa5c00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5c0159550 0x7fa5c00ce600 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa5a0067320 0x7fa5a00697d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 --2- 172.21.15.26:0/1580261392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5c0159920 0x7fa5c00cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 >> 172.21.15.26:0/1580261392 conn(0x7fa5c006ce80 msgr2=0x7fa5c01542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 shutdown_connections 2023-10-09T11:44:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:24.194+0000 7fa5bf59e700 1 -- 172.21.15.26:0/1580261392 wait complete. 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:44:24.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:44:24.208 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:44:24.208 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.208 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:44:24.227 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:44:24.227 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:44:24.227 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:44:24.227 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:24.228 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:44:24.229 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:24.229 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41943sec preferred_lft 41943sec 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:24.230 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:24.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.231 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:44:24.297 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:44:24.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.299 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:44:24.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:44:24.359 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:44:24.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.504 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:44:24.520 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:44:24.520 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:44:24.520 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:24.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:44:24.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:24.587 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:24.643 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:24.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:24.644 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:24.699 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:44:24.699 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:44:24.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:24.780 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:24.780 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:24.799 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:24.799 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:24.799 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:24.799 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:24.799 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:24.800 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:24.800 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:24.800 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:24.821 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:44:24.822 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:44:24.822 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:44:24.823 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:44:24.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:24.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:24.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:44:25.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.023+0000 7fac0d5c8700 1 Processor -- start 2023-10-09T11:44:25.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.023+0000 7fac0d5c8700 1 -- start start 2023-10-09T11:44:25.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac0d5c8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fac08159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac0d5c8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080ccfd0 con 0x7fac08159530 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac0d5c8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0815a410 con 0x7fac08159e40 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac0d5c8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815a6f0 con 0x7fac0806dcf0 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac06ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fac08159530 0x7fac080ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52048/0 (socket says 172.21.15.26:52048) 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac06ffd700 1 -- 172.21.15.26:0/2779191558 learned_addr learned my addr 172.21.15.26:0/2779191558 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357787372 0 0) 0x7fac080ccfd0 con 0x7fac08159530 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4003570 con 0x7fac08159530 2023-10-09T11:44:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.024+0000 7fac067fc700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fac08159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787585227 0 0) 0x7fabf4003570 con 0x7fac08159530 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 msgr2=0x7fac08159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fac08159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 >> v1:172.21.15.67:6789/0 conn(0x7fac08159e40 legacy=0x7fac080cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0815a9d0 con 0x7fac08159530 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fac000017f0 con 0x7fac08159530 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 >> v1:172.21.15.26:6789/0 conn(0x7fac08159530 legacy=0x7fac080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fabf4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf4003fd0 0x7fabf4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf4004d50 0x7fabf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815a6f0 con 0x7fabf4004d50 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400bba0 con 0x7fabf4003fd0 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400bd60 con 0x7fac0806dcf0 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac06ffd700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fabf4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf4004d50 0x7fabf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac067fc700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf4003fd0 0x7fabf4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 -- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 msgr2=0x7fabf4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac0806dcf0 0x7fabf4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 -- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf4003fd0 msgr2=0x7fabf4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf4003fd0 0x7fabf4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 -- 172.21.15.26:0/2779191558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4003570 con 0x7fabf4004d50 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.025+0000 7fac077fe700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf4004d50 0x7fabf40051c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fabf80019a0 tx=0x7fabf8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3d7f580df23a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf800c5d0 con 0x7fabf4004d50 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf800c750 con 0x7fabf4004d50 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac05ffb700 1 -- 172.21.15.26:0/2779191558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf800cb10 con 0x7fabf4004d50 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 -- 172.21.15.26:0/2779191558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf4004d50 msgr2=0x7fabf40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/2779191558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf4004d50 0x7fabf40051c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fabf80019a0 tx=0x7fabf8007d10 comp rx=0 tx=0).stop 2023-10-09T11:44:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac077fe700 1 -- 172.21.15.26:0/2779191558 reap_dead start 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 -- 172.21.15.26:0/2779191558 shutdown_connections 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 -- 172.21.15.26:0/2779191558 >> 172.21.15.26:0/2779191558 conn(0x7fac080703a0 msgr2=0x7fac080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 -- 172.21.15.26:0/2779191558 shutdown_connections 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.026+0000 7fac0d5c8700 1 -- 172.21.15.26:0/2779191558 wait complete. 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.027+0000 7fac0d5c8700 1 Processor -- start 2023-10-09T11:44:25.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.027+0000 7fac0d5c8700 1 -- start start 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 0x7fac08156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 0x7fac080b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08157500 con 0x7fac0815bf60 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815c940 con 0x7fac080b5f60 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac0d5c8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac080b4ff0 con 0x7fabf4004d50 2023-10-09T11:44:25.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51600/0 (socket says 172.21.15.26:51600) 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac077fe700 1 -- 172.21.15.26:0/146572540 learned_addr learned my addr 172.21.15.26:0/146572540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac06ffd700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 0x7fac08156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.028+0000 7fac067fc700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 0x7fac080b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 -- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 msgr2=0x7fac08156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 0x7fac08156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 -- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 msgr2=0x7fac080b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 0x7fac080b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 -- 172.21.15.26:0/146572540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080b4140 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac067fc700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 0x7fac080b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac06ffd700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 0x7fac08156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac077fe700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fabf8008fd0 tx=0x7fabf8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8007af0 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf800c5d0 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac080b5480 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8006a50 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.029+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac080b46c0 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.030+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac080b5180 con 0x7fac0815bf60 2023-10-09T11:44:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.030+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fabf8019070 con 0x7fac0815bf60 2023-10-09T11:44:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.031+0000 7fabfeffd700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 0x7fabe80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.031+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabf80861b0 con 0x7fac0815bf60 2023-10-09T11:44:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.031+0000 7fac06ffd700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 0x7fabe80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.031+0000 7fac06ffd700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 0x7fabe80697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fac00001fb0 tx=0x7fac00006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.035+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabf8052f00 con 0x7fac0815bf60 2023-10-09T11:44:25.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.273+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fac0804c3c0 con 0x7fac0815bf60 2023-10-09T11:44:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.330+0000 7fabfeffd700 1 -- 172.21.15.26:0/146572540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v121) v1 ==== 136+0+0 (secure 0 0 0) 0x7fabf80170c0 con 0x7fac0815bf60 2023-10-09T11:44:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 msgr2=0x7fabe80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 0x7fabe80697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fac00001fb0 tx=0x7fac00006040 comp rx=0 tx=0).stop 2023-10-09T11:44:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 msgr2=0x7fac0815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fabf8008fd0 tx=0x7fabf8015000 comp rx=0 tx=0).stop 2023-10-09T11:44:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 shutdown_connections 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0815bf60 0x7fac0815c400 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabe8067320 0x7fabe80697d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf4004d50 0x7fac08156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 --2- 172.21.15.26:0/146572540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac080b5f60 0x7fac080b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 >> 172.21.15.26:0/146572540 conn(0x7fac080703a0 msgr2=0x7fac080c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 shutdown_connections 2023-10-09T11:44:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.332+0000 7fac0d5c8700 1 -- 172.21.15.26:0/146572540 wait complete. 2023-10-09T11:44:25.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:44:25.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.465+0000 7eff45989700 1 Processor -- start 2023-10-09T11:44:25.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.465+0000 7eff45989700 1 -- start start 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45989700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff40153c30 0x7eff4015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45989700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 0x7eff4015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45989700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4015afd0 con 0x7eff4015de50 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45989700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4015b2b0 con 0x7eff40153c30 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45989700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4015b590 con 0x7eff400cf110 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff40153c30 0x7eff4015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff40153c30 0x7eff4015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51616/0 (socket says 172.21.15.26:51616) 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff3ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7eff4015de50 0x7eff400cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52060/0 (socket says 172.21.15.26:52060) 2023-10-09T11:44:25.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 -- 172.21.15.26:0/3380549 learned_addr learned my addr 172.21.15.26:0/3380549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45188700 1 --2- 172.21.15.26:0/3380549 >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 0x7eff4015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 -- 172.21.15.26:0/3380549 >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 msgr2=0x7eff4015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 --2- 172.21.15.26:0/3380549 >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 0x7eff4015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 -- 172.21.15.26:0/3380549 >> v1:172.21.15.26:6789/0 conn(0x7eff4015de50 legacy=0x7eff400cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff3f7fe700 1 -- 172.21.15.26:0/3380549 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596910980 0 0) 0x7eff4015afd0 con 0x7eff4015de50 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff44987700 1 -- 172.21.15.26:0/3380549 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4015b870 con 0x7eff40153c30 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.466+0000 7eff45188700 1 --2- 172.21.15.26:0/3380549 >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 0x7eff4015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff44987700 1 --2- 172.21.15.26:0/3380549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff40153c30 0x7eff4015a5e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7eff400cdab0 tx=0x7eff30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200cd31053b6d6cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff3f7fe700 1 -- 172.21.15.26:0/3380549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b860 con 0x7eff40153c30 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff3f7fe700 1 -- 172.21.15.26:0/3380549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000b9c0 con 0x7eff40153c30 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff3f7fe700 1 -- 172.21.15.26:0/3380549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000bd60 con 0x7eff40153c30 2023-10-09T11:44:25.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 -- 172.21.15.26:0/3380549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff40153c30 msgr2=0x7eff4015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 --2- 172.21.15.26:0/3380549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff40153c30 0x7eff4015a5e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7eff400cdab0 tx=0x7eff30009250 comp rx=0 tx=0).stop 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 -- 172.21.15.26:0/3380549 shutdown_connections 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 --2- 172.21.15.26:0/3380549 >> v2:172.21.15.67:3300/0 conn(0x7eff400cf110 0x7eff4015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 --2- 172.21.15.26:0/3380549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff40153c30 0x7eff4015a5e0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 -- 172.21.15.26:0/3380549 >> 172.21.15.26:0/3380549 conn(0x7eff400703a0 msgr2=0x7eff400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 -- 172.21.15.26:0/3380549 shutdown_connections 2023-10-09T11:44:25.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.467+0000 7eff45989700 1 -- 172.21.15.26:0/3380549 wait complete. 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.468+0000 7eff45989700 1 Processor -- start 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 -- start start 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff400cf110 0x7eff40146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff40153c30 0x7eff400b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40169730 con 0x7eff4015de50 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff400c8580 con 0x7eff400cf110 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45989700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400c8860 con 0x7eff40153c30 2023-10-09T11:44:25.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45188700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45188700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51630/0 (socket says 172.21.15.26:51630) 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff45188700 1 -- 172.21.15.26:0/607113309 learned_addr learned my addr 172.21.15.26:0/607113309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.469+0000 7eff44987700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff400cf110 0x7eff40146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff3ffff700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff40153c30 0x7eff400b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 -- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff40153c30 msgr2=0x7eff400b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff40153c30 0x7eff400b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 -- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff400cf110 msgr2=0x7eff40146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff400cf110 0x7eff40146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 -- 172.21.15.26:0/607113309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094f0 con 0x7eff4015de50 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45188700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7eff3800a380 tx=0x7eff38007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38015440 con 0x7eff4015de50 2023-10-09T11:44:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380155a0 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38015960 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400c8b40 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.470+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff40147470 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.471+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff401698a0 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.472+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff3800d440 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.472+0000 7eff3cff9700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 0x7eff2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.472+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff38085670 con 0x7eff4015de50 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.472+0000 7eff44987700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 0x7eff2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.473+0000 7eff44987700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 0x7eff2c0697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff400cdab0 tx=0x7eff30017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.476+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff38052400 con 0x7eff4015de50 2023-10-09T11:44:25.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.701+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7eff400c89d0 con 0x7eff2c067320 2023-10-09T11:44:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.702+0000 7eff3cff9700 1 -- 172.21.15.26:0/607113309 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7eff400c89d0 con 0x7eff2c067320 2023-10-09T11:44:25.704 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:44:25.704 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:25.704 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:44:25.704 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:25.704 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:44:25.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 msgr2=0x7eff2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 0x7eff2c0697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff400cdab0 tx=0x7eff30017000 comp rx=0 tx=0).stop 2023-10-09T11:44:25.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 msgr2=0x7eff400b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7eff3800a380 tx=0x7eff38007900 comp rx=0 tx=0).stop 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 shutdown_connections 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4015de50 0x7eff400b4f40 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff400cf110 0x7eff40146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7eff2c067320 0x7eff2c0697d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 --2- 172.21.15.26:0/607113309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff40153c30 0x7eff400b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 >> 172.21.15.26:0/607113309 conn(0x7eff400703a0 msgr2=0x7eff400c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 shutdown_connections 2023-10-09T11:44:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.705+0000 7eff45989700 1 -- 172.21.15.26:0/607113309 wait complete. 2023-10-09T11:44:25.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:44:25.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.839+0000 7f6d6e447700 1 Processor -- start 2023-10-09T11:44:25.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 -- start start 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6d68159550 0x7f6d680ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d6815dfd0 0x7f6d680aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680acc00 con 0x7f6d68159920 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680abff0 con 0x7f6d6815dfd0 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.840+0000 7f6d6e447700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680ac2d0 con 0x7f6d68159550 2023-10-09T11:44:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d6815dfd0 0x7f6d680aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d6815dfd0 0x7f6d680aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51640/0 (socket says 172.21.15.26:51640) 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2528920649 learned_addr learned my addr 172.21.15.26:0/2528920649 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2528920649 >> v2:172.21.15.67:3300/0 conn(0x7f6d68159550 msgr2=0x7f6d680ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6d445700 1 --2- 172.21.15.26:0/2528920649 >> v2:172.21.15.67:3300/0 conn(0x7f6d68159550 0x7f6d680ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 --2- 172.21.15.26:0/2528920649 >> v2:172.21.15.67:3300/0 conn(0x7f6d68159550 0x7f6d680ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2528920649 >> v1:172.21.15.67:6789/0 conn(0x7f6d68159920 legacy=0x7f6d680ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2528920649 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680ac5b0 con 0x7f6d6815dfd0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d6cc44700 1 --2- 172.21.15.26:0/2528920649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d6815dfd0 0x7f6d680aedb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f6d68064270 tx=0x7f6d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db6ce0b62493b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d67fff700 1 -- 172.21.15.26:0/2528920649 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00b820 con 0x7f6d6815dfd0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d67fff700 1 -- 172.21.15.26:0/2528920649 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00b980 con 0x7f6d6815dfd0 2023-10-09T11:44:25.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.841+0000 7f6d67fff700 1 -- 172.21.15.26:0/2528920649 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00bd20 con 0x7f6d6815dfd0 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 -- 172.21.15.26:0/2528920649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d6815dfd0 msgr2=0x7f6d680aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2528920649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d6815dfd0 0x7f6d680aedb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f6d68064270 tx=0x7f6d5c009250 comp rx=0 tx=0).stop 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 -- 172.21.15.26:0/2528920649 shutdown_connections 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2528920649 >> v2:172.21.15.67:3300/0 conn(0x7f6d68159550 0x7f6d680ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2528920649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d6815dfd0 0x7f6d680aedb0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 -- 172.21.15.26:0/2528920649 >> 172.21.15.26:0/2528920649 conn(0x7f6d6806ce80 msgr2=0x7f6d680ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 -- 172.21.15.26:0/2528920649 shutdown_connections 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.842+0000 7f6d6e447700 1 -- 172.21.15.26:0/2528920649 wait complete. 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.843+0000 7f6d6e447700 1 Processor -- start 2023-10-09T11:44:25.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.843+0000 7f6d6e447700 1 -- start start 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d68159550 0x7f6d6816dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d6815dfd0 0x7f6d68169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6816adb0 con 0x7f6d68159920 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6816d900 con 0x7f6d6815dfd0 2023-10-09T11:44:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6e447700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6816e2d0 con 0x7f6d68159550 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51654/0 (socket says 172.21.15.26:51654) 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2885313388 learned_addr learned my addr 172.21.15.26:0/2885313388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6dc46700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d6815dfd0 0x7f6d68169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6d445700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d68159550 0x7f6d6816dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d68159550 msgr2=0x7f6d6816dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d68159550 0x7f6d6816dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d6815dfd0 msgr2=0x7f6d68169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d6815dfd0 0x7f6d68169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.844+0000 7f6d6cc44700 1 -- 172.21.15.26:0/2885313388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0094f0 con 0x7f6d68159920 2023-10-09T11:44:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d6cc44700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009290 tx=0x7f6d5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011cc0 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c020070 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6816a7f0 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c01b6a0 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.845+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6816d590 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.846+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6816da90 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.846+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6d5c022030 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.847+0000 7f6d657fa700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 0x7f6d540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.847+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d5c0868e0 con 0x7f6d68159920 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.847+0000 7f6d6d445700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 0x7f6d540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.847+0000 7f6d6d445700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 0x7f6d540697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800f610 tx=0x7f6d580077d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:25.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:25.851+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d5c053680 con 0x7f6d68159920 2023-10-09T11:44:26.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.043+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6d6816da40 con 0x7f6d68159920 2023-10-09T11:44:26.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.043+0000 7f6d657fa700 1 -- 172.21.15.26:0/2885313388 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d5c056ca0 con 0x7f6d68159920 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 msgr2=0x7f6d540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 0x7f6d540697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800f610 tx=0x7f6d580077d0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 msgr2=0x7f6d68144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009290 tx=0x7f6d5c016000 comp rx=0 tx=0).stop 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 shutdown_connections 2023-10-09T11:44:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d6815dfd0 0x7f6d68169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6d54067320 0x7f6d540697d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d68159550 0x7f6d6816dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 --2- 172.21.15.26:0/2885313388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d68159920 0x7f6d68144d30 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.045+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 >> 172.21.15.26:0/2885313388 conn(0x7f6d6806ce80 msgr2=0x7f6d680b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.046+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 shutdown_connections 2023-10-09T11:44:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.046+0000 7f6d6e447700 1 -- 172.21.15.26:0/2885313388 wait complete. 2023-10-09T11:44:26.059 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:44:26.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:44:26.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:26.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:44:26.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:26.110 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:44:26.124 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:44:26.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:44:26.125 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:26.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:44:26.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:26.184 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:44:26.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:44:26.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:26.201 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:44:26.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:44:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T11:44:26.216 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:44:26.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:26.216 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:44:26.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T11:44:26.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000887794 --yes-i-really-mean-it 2023-10-09T11:44:26.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.379+0000 7f4e1d0d3700 1 Processor -- start 2023-10-09T11:44:26.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.379+0000 7f4e1d0d3700 1 -- start start 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1d0d3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e18159940 0x7f4e180b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1d0d3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180af670 con 0x7f4e1806cdb0 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1d0d3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180aa2b0 con 0x7f4e180b0e00 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1d0d3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180b12a0 con 0x7f4e18159940 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e16d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e18159940 0x7f4e180b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1759e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e1806cdb0 0x7f4e180aa740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52076/0 (socket says 172.21.15.26:52076) 2023-10-09T11:44:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.380+0000 7f4e1759e700 1 -- 172.21.15.26:0/3986808869 learned_addr learned my addr 172.21.15.26:0/3986808869 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e16d9d700 1 -- 172.21.15.26:0/3986808869 >> v1:172.21.15.67:6789/0 conn(0x7f4e180b0e00 legacy=0x7f4e1806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e16d9d700 1 -- 172.21.15.26:0/3986808869 >> v1:172.21.15.26:6789/0 conn(0x7f4e1806cdb0 legacy=0x7f4e180aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e16d9d700 1 -- 172.21.15.26:0/3986808869 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18159d10 con 0x7f4e18159940 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e15d9b700 1 -- 172.21.15.26:0/3986808869 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110865423 0 0) 0x7f4e10001110 con 0x7f4e1806cdb0 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e16d9d700 1 --2- 172.21.15.26:0/3986808869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18159940 0x7f4e180b08c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009eb0 tx=0x7f4e08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead2965523d0b693 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e15d9b700 1 -- 172.21.15.26:0/3986808869 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800e070 con 0x7f4e18159940 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e15d9b700 1 -- 172.21.15.26:0/3986808869 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800bc30 con 0x7f4e18159940 2023-10-09T11:44:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e15d9b700 1 -- 172.21.15.26:0/3986808869 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012430 con 0x7f4e18159940 2023-10-09T11:44:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3986808869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18159940 msgr2=0x7f4e180b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3986808869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18159940 0x7f4e180b08c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009eb0 tx=0x7f4e08009780 comp rx=0 tx=0).stop 2023-10-09T11:44:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3986808869 shutdown_connections 2023-10-09T11:44:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3986808869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18159940 0x7f4e180b08c0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3986808869 >> 172.21.15.26:0/3986808869 conn(0x7f4e180cd3e0 msgr2=0x7f4e180cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3986808869 shutdown_connections 2023-10-09T11:44:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.381+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3986808869 wait complete. 2023-10-09T11:44:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 Processor -- start 2023-10-09T11:44:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 -- start start 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 0x7f4e18155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e18159940 0x7f4e18068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815ab10 con 0x7f4e180b0e00 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18159f00 con 0x7f4e1806cdb0 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.383+0000 7f4e1d0d3700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815a1e0 con 0x7f4e18159940 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51660/0 (socket says 172.21.15.26:51660) 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 -- 172.21.15.26:0/3081011532 learned_addr learned my addr 172.21.15.26:0/3081011532 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1759e700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e18159940 0x7f4e18068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e16d9d700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 0x7f4e18155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 -- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e18159940 msgr2=0x7f4e18068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e18159940 0x7f4e18068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 -- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 msgr2=0x7f4e18155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 0x7f4e18155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 -- 172.21.15.26:0/3081011532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009a20 con 0x7f4e180b0e00 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e16d9d700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 0x7f4e18155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1659c700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c590 tx=0x7f4e0000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011590 con 0x7f4e180b0e00 2023-10-09T11:44:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e000116f0 con 0x7f4e180b0e00 2023-10-09T11:44:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1815a4c0 con 0x7f4e180b0e00 2023-10-09T11:44:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011ab0 con 0x7f4e180b0e00 2023-10-09T11:44:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.384+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e181562b0 con 0x7f4e180b0e00 2023-10-09T11:44:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.385+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1815acc0 con 0x7f4e180b0e00 2023-10-09T11:44:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.386+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e0001b3b0 con 0x7f4e180b0e00 2023-10-09T11:44:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.386+0000 7f4e0effd700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 0x7f4df80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.386+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e00084230 con 0x7f4e180b0e00 2023-10-09T11:44:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.386+0000 7f4e16d9d700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 0x7f4df80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.387+0000 7f4e16d9d700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 0x7f4df80697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009eb0 tx=0x7f4e08017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.391+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e1815acc0 con 0x7f4e180b0e00 2023-10-09T11:44:26.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:26.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:26.615+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000887794", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4e1804c3c0 con 0x7f4df8067320 2023-10-09T11:44:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.359+0000 7f4e0effd700 1 -- 172.21.15.26:0/3081011532 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f4e1804c3c0 con 0x7f4df8067320 2023-10-09T11:44:29.360 INFO:teuthology.orchestra.run.smithi026.stdout:FS volume 'cephfs' renamed to 'volume_0000000000887794' 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 msgr2=0x7f4df80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 0x7f4df80697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009eb0 tx=0x7f4e08017000 comp rx=0 tx=0).stop 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 msgr2=0x7f4e1815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c590 tx=0x7f4e0000c950 comp rx=0 tx=0).stop 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 shutdown_connections 2023-10-09T11:44:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4df8067320 0x7f4df80697d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e18159940 0x7f4e18068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e1806cdb0 0x7f4e18155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 --2- 172.21.15.26:0/3081011532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e180b0e00 0x7f4e1815afa0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 >> 172.21.15.26:0/3081011532 conn(0x7f4e180cd3e0 msgr2=0x7f4e180cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 shutdown_connections 2023-10-09T11:44:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.362+0000 7f4e1d0d3700 1 -- 172.21.15.26:0/3081011532 wait complete. 2023-10-09T11:44:29.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000887794 --yes-i-really-mean-it 2023-10-09T11:44:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.507+0000 7ff00425c700 1 Processor -- start 2023-10-09T11:44:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.507+0000 7ff00425c700 1 -- start start 2023-10-09T11:44:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff00425c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feffc06dcf0 0x7feffc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff00425c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 0x7feffc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff00425c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0ccfd0 con 0x7feffc159530 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff00425c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc15a410 con 0x7feffc06dcf0 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff00425c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc15a6f0 con 0x7feffc159e40 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feffc06dcf0 0x7feffc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feffc06dcf0 0x7feffc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51662/0 (socket says 172.21.15.26:51662) 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 -- 172.21.15.26:0/2714252513 learned_addr learned my addr 172.21.15.26:0/2714252513 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0027f9700 1 --2- 172.21.15.26:0/2714252513 >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 0x7feffc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 -- 172.21.15.26:0/2714252513 >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 msgr2=0x7feffc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 --2- 172.21.15.26:0/2714252513 >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 0x7feffc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 -- 172.21.15.26:0/2714252513 >> v1:172.21.15.67:6789/0 conn(0x7feffc159530 legacy=0x7feffc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 -- 172.21.15.26:0/2714252513 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc15a9d0 con 0x7feffc06dcf0 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0027f9700 1 --2- 172.21.15.26:0/2714252513 >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 0x7feffc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:29.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff0017f7700 1 --2- 172.21.15.26:0/2714252513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc06dcf0 0x7feffc159900 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7feffc0caef0 tx=0x7fefec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74efa4abee8b5de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff000ff6700 1 -- 172.21.15.26:0/2714252513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00b820 con 0x7feffc06dcf0 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff000ff6700 1 -- 172.21.15.26:0/2714252513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec00b980 con 0x7feffc06dcf0 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.508+0000 7ff000ff6700 1 -- 172.21.15.26:0/2714252513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00bd20 con 0x7feffc06dcf0 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 -- 172.21.15.26:0/2714252513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc06dcf0 msgr2=0x7feffc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 --2- 172.21.15.26:0/2714252513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc06dcf0 0x7feffc159900 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7feffc0caef0 tx=0x7fefec009250 comp rx=0 tx=0).stop 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 -- 172.21.15.26:0/2714252513 shutdown_connections 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 --2- 172.21.15.26:0/2714252513 >> v2:172.21.15.67:3300/0 conn(0x7feffc159e40 0x7feffc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 --2- 172.21.15.26:0/2714252513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc06dcf0 0x7feffc159900 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 -- 172.21.15.26:0/2714252513 >> 172.21.15.26:0/2714252513 conn(0x7feffc0703a0 msgr2=0x7feffc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 -- 172.21.15.26:0/2714252513 shutdown_connections 2023-10-09T11:44:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.509+0000 7ff00425c700 1 -- 172.21.15.26:0/2714252513 wait complete. 2023-10-09T11:44:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.510+0000 7ff00425c700 1 Processor -- start 2023-10-09T11:44:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.510+0000 7ff00425c700 1 -- start start 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feffc06dcf0 0x7feffc0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feffc159530 0x7feffc15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c95b0 con 0x7feffc159e40 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c89a0 con 0x7feffc159530 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff00425c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c8c80 con 0x7feffc06dcf0 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff0027f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff0027f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51664/0 (socket says 172.21.15.26:51664) 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff0027f9700 1 -- 172.21.15.26:0/2346840943 learned_addr learned my addr 172.21.15.26:0/2346840943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff001ff8700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feffc06dcf0 0x7feffc0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.511+0000 7ff0017f7700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feffc159530 0x7feffc15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 -- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feffc06dcf0 msgr2=0x7feffc0c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feffc06dcf0 0x7feffc0c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 -- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feffc159530 msgr2=0x7feffc15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feffc159530 0x7feffc15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 -- 172.21.15.26:0/2346840943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0094f0 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff0027f9700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7feff400a380 tx=0x7feff4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4015440 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff40155a0 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4015960 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc0c8f60 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.512+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc15bdd0 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.513+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc0c9720 con 0x7feffc159e40 2023-10-09T11:44:29.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.513+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feff400d440 con 0x7feffc159e40 2023-10-09T11:44:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.514+0000 7feff1ffb700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 0x7fefe00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.514+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7feff40856c0 con 0x7feffc159e40 2023-10-09T11:44:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.514+0000 7ff001ff8700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 0x7fefe00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.515+0000 7ff001ff8700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 0x7fefe00697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feff8003a30 tx=0x7feff8007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.518+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feff4052400 con 0x7feffc159e40 2023-10-09T11:44:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:29.742+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000887794", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7feffc04c3c0 con 0x7fefe0067320 2023-10-09T11:44:30.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.368+0000 7feff1ffb700 1 -- 172.21.15.26:0/2346840943 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7feffc04c3c0 con 0x7fefe0067320 2023-10-09T11:44:30.369 INFO:teuthology.orchestra.run.smithi026.stdout:FS volume 'cephfs' renamed to 'volume_0000000000887794' 2023-10-09T11:44:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.370+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 msgr2=0x7fefe00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.370+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 0x7fefe00697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feff8003a30 tx=0x7feff8007ea0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.370+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 msgr2=0x7feffc0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.370+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7feff400a380 tx=0x7feff4007900 comp rx=0 tx=0).stop 2023-10-09T11:44:30.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 shutdown_connections 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feffc159e40 0x7feffc0c9a40 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fefe0067320 0x7fefe00697d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feffc06dcf0 0x7feffc0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 --2- 172.21.15.26:0/2346840943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feffc159530 0x7feffc15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 >> 172.21.15.26:0/2346840943 conn(0x7feffc0703a0 msgr2=0x7feffc0b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 shutdown_connections 2023-10-09T11:44:30.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.371+0000 7ff00425c700 1 -- 172.21.15.26:0/2346840943 wait complete. 2023-10-09T11:44:30.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:44:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.511+0000 7fe0b3f59700 1 Processor -- start 2023-10-09T11:44:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.511+0000 7fe0b3f59700 1 -- start start 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0ac1595d0 0x7fe0ac1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac0675a0 0x7fe0ac06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0ac06b230 0x7fe0ac0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac06bd00 con 0x7fe0ac1595d0 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c7f50 con 0x7fe0ac06b230 2023-10-09T11:44:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b3f59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac06b740 con 0x7fe0ac0675a0 2023-10-09T11:44:30.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0ac1595d0 0x7fe0ac1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0ac1595d0 0x7fe0ac1599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34162/0 (socket says 172.21.15.26:34162) 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1100390031 learned_addr learned my addr 172.21.15.26:0/1100390031 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b14f4700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac0675a0 0x7fe0ac06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1100390031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac0675a0 msgr2=0x7fe0ac06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac0675a0 0x7fe0ac06acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1100390031 >> v2:172.21.15.67:3300/0 conn(0x7fe0ac06b230 msgr2=0x7fe0ac0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1100390031 >> v2:172.21.15.67:3300/0 conn(0x7fe0ac06b230 0x7fe0ac0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1100390031 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac06ba20 con 0x7fe0ac1595d0 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.512+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac1599a0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac064a20 tx=0x7fe0a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58baac3a2c191a06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b0cf3700 1 -- 172.21.15.26:0/1100390031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800b860 con 0x7fe0ac1595d0 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b0cf3700 1 -- 172.21.15.26:0/1100390031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b9c0 con 0x7fe0ac1595d0 2023-10-09T11:44:30.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b0cf3700 1 -- 172.21.15.26:0/1100390031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800bd60 con 0x7fe0ac1595d0 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1100390031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac1595d0 msgr2=0x7fe0ac1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac1599a0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac064a20 tx=0x7fe0a8009250 comp rx=0 tx=0).stop 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1100390031 shutdown_connections 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1100390031 >> v2:172.21.15.67:3300/0 conn(0x7fe0ac06b230 0x7fe0ac0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac1599a0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1100390031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac0675a0 0x7fe0ac06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1100390031 >> 172.21.15.26:0/1100390031 conn(0x7fe0ac0cd400 msgr2=0x7fe0ac0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1100390031 shutdown_connections 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.513+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1100390031 wait complete. 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.514+0000 7fe0b3f59700 1 Processor -- start 2023-10-09T11:44:30.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.514+0000 7fe0b3f59700 1 -- start start 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac06b230 0x7fe0ac0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c6020 con 0x7fe0ac0675a0 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b1bc0 con 0x7fe0ac1595d0 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b3f59700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac169d20 con 0x7fe0ac06b230 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b1cf5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b1cf5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34168/0 (socket says 172.21.15.26:34168) 2023-10-09T11:44:30.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1293427385 learned_addr learned my addr 172.21.15.26:0/1293427385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b14f4700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac06b230 0x7fe0ac0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.515+0000 7fe0b24f6700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac06b230 msgr2=0x7fe0ac0b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac06b230 0x7fe0ac0b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0ac1595d0 msgr2=0x7fe0ac155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 -- 172.21.15.26:0/1293427385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80094f0 con 0x7fe0ac0675a0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b1cf5700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009290 tx=0x7fe0a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8011e40 con 0x7fe0ac0675a0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a801f070 con 0x7fe0ac0675a0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac1555c0 con 0x7fe0ac0675a0 2023-10-09T11:44:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80266d0 con 0x7fe0ac0675a0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.516+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac0c5780 con 0x7fe0ac0675a0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.517+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac169e90 con 0x7fe0ac0675a0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.518+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe0a801a430 con 0x7fe0ac0675a0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.518+0000 7fe0a1ffb700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 0x7fe090069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.518+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe0a8021070 con 0x7fe0ac0675a0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.518+0000 7fe0b14f4700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 0x7fe090069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.519+0000 7fe0b14f4700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 0x7fe090069800 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac15c2d0 tx=0x7fe09c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.522+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0a8052fc0 con 0x7fe0ac0675a0 2023-10-09T11:44:30.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.744+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0ac04c3c0 con 0x7fe090067350 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.746+0000 7fe0a1ffb700 1 -- 172.21.15.26:0/1293427385 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fe0ac04c3c0 con 0x7fe090067350 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volume_0000000000887794" 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:30.747 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:44:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 msgr2=0x7fe090069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 0x7fe090069800 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac15c2d0 tx=0x7fe09c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 msgr2=0x7fe0ac0c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009290 tx=0x7fe0a8017000 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 shutdown_connections 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0ac1595d0 0x7fe0ac155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0ac0675a0 0x7fe0ac0c4ec0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe090067350 0x7fe090069800 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 --2- 172.21.15.26:0/1293427385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0ac06b230 0x7fe0ac0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 >> 172.21.15.26:0/1293427385 conn(0x7fe0ac0cd400 msgr2=0x7fe0ac15c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:30.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 shutdown_connections 2023-10-09T11:44:30.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.748+0000 7fe0b3f59700 1 -- 172.21.15.26:0/1293427385 wait complete. 2023-10-09T11:44:30.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.881+0000 7f005ecec700 1 Processor -- start 2023-10-09T11:44:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.881+0000 7f005ecec700 1 -- start start 2023-10-09T11:44:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005ecec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 0x7f00580ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005ecec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f005815dfd0 0x7f00580aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005ecec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580acc00 con 0x7f0058159920 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005ecec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580abff0 con 0x7f005815dfd0 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005ecec700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580ac2d0 con 0x7f0058159550 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005e4eb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0058159920 0x7f00580ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45246/0 (socket says 172.21.15.26:45246) 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005e4eb700 1 -- 172.21.15.26:0/301027265 learned_addr learned my addr 172.21.15.26:0/301027265 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005d4e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f005815dfd0 0x7f00580aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005dcea700 1 --2- 172.21.15.26:0/301027265 >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 0x7f00580ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005cce8700 1 -- 172.21.15.26:0/301027265 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263598160 0 0) 0x7f00580acc00 con 0x7f0058159920 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005cce8700 1 -- 172.21.15.26:0/301027265 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040003570 con 0x7f0058159920 2023-10-09T11:44:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005d4e9700 1 -- 172.21.15.26:0/301027265 >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 msgr2=0x7f00580ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005d4e9700 1 --2- 172.21.15.26:0/301027265 >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 0x7f00580ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005d4e9700 1 -- 172.21.15.26:0/301027265 >> v1:172.21.15.26:6789/0 conn(0x7f0058159920 legacy=0x7f00580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005d4e9700 1 -- 172.21.15.26:0/301027265 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580ac5b0 con 0x7f005815dfd0 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.882+0000 7f005dcea700 1 --2- 172.21.15.26:0/301027265 >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 0x7f00580ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005d4e9700 1 --2- 172.21.15.26:0/301027265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005815dfd0 0x7f00580aedb0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0058064270 tx=0x7f004c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce18fb205bd67cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005cce8700 1 -- 172.21.15.26:0/301027265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011630 con 0x7f005815dfd0 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005cce8700 1 -- 172.21.15.26:0/301027265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c011790 con 0x7f005815dfd0 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005cce8700 1 -- 172.21.15.26:0/301027265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011b30 con 0x7f005815dfd0 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 -- 172.21.15.26:0/301027265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005815dfd0 msgr2=0x7f00580aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 --2- 172.21.15.26:0/301027265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005815dfd0 0x7f00580aedb0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0058064270 tx=0x7f004c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 -- 172.21.15.26:0/301027265 shutdown_connections 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 --2- 172.21.15.26:0/301027265 >> v2:172.21.15.67:3300/0 conn(0x7f0058159550 0x7f00580ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 --2- 172.21.15.26:0/301027265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005815dfd0 0x7f00580aedb0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 -- 172.21.15.26:0/301027265 >> 172.21.15.26:0/301027265 conn(0x7f005806ce80 msgr2=0x7f00580ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 -- 172.21.15.26:0/301027265 shutdown_connections 2023-10-09T11:44:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.883+0000 7f005ecec700 1 -- 172.21.15.26:0/301027265 wait complete. 2023-10-09T11:44:30.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.884+0000 7f005ecec700 1 Processor -- start 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.884+0000 7f005ecec700 1 -- start start 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0058159920 0x7f00580cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f005815dfd0 0x7f00580ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580cccb0 con 0x7f0058159550 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580cc0a0 con 0x7f005815dfd0 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005ecec700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580cc380 con 0x7f0058159920 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34174/0 (socket says 172.21.15.26:34174) 2023-10-09T11:44:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 -- 172.21.15.26:0/3730061979 learned_addr learned my addr 172.21.15.26:0/3730061979 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005e4eb700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f005815dfd0 0x7f00580ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005d4e9700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0058159920 0x7f00580cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 -- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0058159920 msgr2=0x7f00580cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0058159920 0x7f00580cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 -- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f005815dfd0 msgr2=0x7f00580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f005815dfd0 0x7f00580ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.885+0000 7f005dcea700 1 -- 172.21.15.26:0/3730061979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c009420 con 0x7f0058159550 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f005dcea700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f005000c830 tx=0x7f0050008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011600 con 0x7f0058159550 2023-10-09T11:44:30.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050011760 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580cc660 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011b20 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.886+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005816cdd0 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.887+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005804c3c0 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.887+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f005000a3e0 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.888+0000 7f0055ffb700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.888+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f0050085290 con 0x7f0058159550 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.888+0000 7f005d4e9700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:30.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.888+0000 7f005d4e9700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f004c0093f0 tx=0x7f004c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:30.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:30.892+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0050051dc0 con 0x7f0058159550 2023-10-09T11:44:31.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.129+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f005806ef90 con 0x7f0058159550 2023-10-09T11:44:31.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.129+0000 7f0055ffb700 1 -- 172.21.15.26:0/3730061979 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4618 (secure 0 0 0) 0x7f00500553e0 con 0x7f0058159550 2023-10-09T11:44:31.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:31.131 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:27.331784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000887794","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.131+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 msgr2=0x7f00440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.131+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f004c0093f0 tx=0x7f004c017000 comp rx=0 tx=0).stop 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 msgr2=0x7f005816c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f005000c830 tx=0x7f0050008040 comp rx=0 tx=0).stop 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 shutdown_connections 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f005815dfd0 0x7f00580ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058159550 0x7f005816c890 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0044067320 0x7f00440697d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 --2- 172.21.15.26:0/3730061979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0058159920 0x7f00580cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 >> 172.21.15.26:0/3730061979 conn(0x7f005806ce80 msgr2=0x7f00580aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 shutdown_connections 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.132+0000 7f005ecec700 1 -- 172.21.15.26:0/3730061979 wait complete. 2023-10-09T11:44:31.134 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 123 2023-10-09T11:44:31.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.263+0000 7f621f4e4700 1 Processor -- start 2023-10-09T11:44:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.263+0000 7f621f4e4700 1 -- start start 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 0x7f62180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 0x7f6218159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62180cde50 0x7f621815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62180d13f0 con 0x7f62180cde50 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621815a940 con 0x7f62180cb5a0 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621f4e4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621815ae40 con 0x7f62180cd9e0 2023-10-09T11:44:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62180cde50 0x7f621815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62180cde50 0x7f621815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34180/0 (socket says 172.21.15.26:34180) 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 -- 172.21.15.26:0/154457881 learned_addr learned my addr 172.21.15.26:0/154457881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621d280700 1 --2- 172.21.15.26:0/154457881 >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 0x7f62180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621ca7f700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 0x7f6218159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 -- 172.21.15.26:0/154457881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 msgr2=0x7f6218159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 0x7f6218159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 -- 172.21.15.26:0/154457881 >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 msgr2=0x7f62180cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 --2- 172.21.15.26:0/154457881 >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 0x7f62180cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621da81700 1 -- 172.21.15.26:0/154457881 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621815ab60 con 0x7f62180cde50 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621ca7f700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 0x7f6218159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:31.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.264+0000 7f621d280700 1 --2- 172.21.15.26:0/154457881 >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 0x7f62180cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621da81700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180cde50 0x7f621815a400 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6218065120 tx=0x7f6208009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed07dbdd89f63d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f6217fff700 1 -- 172.21.15.26:0/154457881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800b820 con 0x7f62180cde50 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f6217fff700 1 -- 172.21.15.26:0/154457881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800b980 con 0x7f62180cde50 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f6217fff700 1 -- 172.21.15.26:0/154457881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800bd20 con 0x7f62180cde50 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 -- 172.21.15.26:0/154457881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180cde50 msgr2=0x7f621815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180cde50 0x7f621815a400 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6218065120 tx=0x7f6208009250 comp rx=0 tx=0).stop 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 -- 172.21.15.26:0/154457881 shutdown_connections 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 --2- 172.21.15.26:0/154457881 >> v2:172.21.15.67:3300/0 conn(0x7f62180cb5a0 0x7f62180cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180cde50 0x7f621815a400 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 --2- 172.21.15.26:0/154457881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cd9e0 0x7f6218159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 -- 172.21.15.26:0/154457881 >> 172.21.15.26:0/154457881 conn(0x7f6218070e30 msgr2=0x7f62180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:31.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 -- 172.21.15.26:0/154457881 shutdown_connections 2023-10-09T11:44:31.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.265+0000 7f621f4e4700 1 -- 172.21.15.26:0/154457881 wait complete. 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.266+0000 7f621f4e4700 1 Processor -- start 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 -- start start 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cb5a0 0x7f6218159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62180cd9e0 0x7f6218156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180c91a0 con 0x7f62180c9ed0 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218157500 con 0x7f62180cd9e0 2023-10-09T11:44:31.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621f4e4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6218159d10 con 0x7f62180cb5a0 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621da81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.267+0000 7f621da81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34188/0 (socket says 172.21.15.26:34188) 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 -- 172.21.15.26:0/492278860 learned_addr learned my addr 172.21.15.26:0/492278860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621d280700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cb5a0 0x7f6218159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621ca7f700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62180cd9e0 0x7f6218156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 -- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cb5a0 msgr2=0x7f6218159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cb5a0 0x7f6218159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 -- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62180cd9e0 msgr2=0x7f6218156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62180cd9e0 0x7f6218156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 -- 172.21.15.26:0/492278860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080094f0 con 0x7f62180c9ed0 2023-10-09T11:44:31.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621da81700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6208009290 tx=0x7f6208017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208011ea0 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620801a630 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620801aa30 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62180c93f0 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.268+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180c99b0 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.269+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62180c9ba0 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.269+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f620802e450 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.270+0000 7f62157fa700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 0x7f62040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.270+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6208086620 con 0x7f62180c9ed0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.270+0000 7f621d280700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 0x7f62040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.271+0000 7f621d280700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 0x7f62040697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6210007fd0 tx=0x7f62100077c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.274+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6208053360 con 0x7f62180c9ed0 2023-10-09T11:44:31.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.468+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f621804c3c0 con 0x7f62180c9ed0 2023-10-09T11:44:31.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.469+0000 7f62157fa700 1 -- 172.21.15.26:0/492278860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f620801ae60 con 0x7f62180c9ed0 2023-10-09T11:44:31.470 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:31.470 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":186,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:29.345949+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000887794.meta","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000887794"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000887794.data","create_time":"2023-10-09T11:44:10.623231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000887794"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:31.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 msgr2=0x7f62040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 0x7f62040697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6210007fd0 tx=0x7f62100077c0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 msgr2=0x7f62181578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6208009290 tx=0x7f6208017000 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 shutdown_connections 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62180c9ed0 0x7f62181578e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6204067320 0x7f62040697d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f62180cb5a0 0x7f6218159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 --2- 172.21.15.26:0/492278860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62180cd9e0 0x7f6218156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 >> 172.21.15.26:0/492278860 conn(0x7f6218070e30 msgr2=0x7f62180d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 shutdown_connections 2023-10-09T11:44:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.471+0000 7f621f4e4700 1 -- 172.21.15.26:0/492278860 wait complete. 2023-10-09T11:44:31.484 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:44:31.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:31.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:31.567 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:44:31.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.685+0000 7f1214dba700 1 Processor -- start 2023-10-09T11:44:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.685+0000 7f1214dba700 1 -- start start 2023-10-09T11:44:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.686+0000 7f1214dba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12100b07d0 0x7f12100ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.686+0000 7f1214dba700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 0x7f12100c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.686+0000 7f1214dba700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121015a280 con 0x7f12100cf200 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.686+0000 7f1214dba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006e180 con 0x7f12100b07d0 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.686+0000 7f1214dba700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006d850 con 0x7f12100b0ba0 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12100b07d0 0x7f12100ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f12100cf200 0x7f121006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45252/0 (socket says 172.21.15.26:45252) 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120dd9b700 1 -- 172.21.15.26:0/2530675378 learned_addr learned my addr 172.21.15.26:0/2530675378 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120ed9d700 1 --2- 172.21.15.26:0/2530675378 >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 0x7f12100c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 -- 172.21.15.26:0/2530675378 >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 msgr2=0x7f12100c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 --2- 172.21.15.26:0/2530675378 >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 0x7f12100c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 -- 172.21.15.26:0/2530675378 >> v1:172.21.15.26:6789/0 conn(0x7f12100cf200 legacy=0x7f121006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 -- 172.21.15.26:0/2530675378 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121006db30 con 0x7f12100b07d0 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120d59a700 1 -- 172.21.15.26:0/2530675378 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850443817 0 0) 0x7f121015a280 con 0x7f12100cf200 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120ed9d700 1 --2- 172.21.15.26:0/2530675378 >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 0x7f12100c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120e59c700 1 --2- 172.21.15.26:0/2530675378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b07d0 0x7f12100ccac0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f12100637a0 tx=0x7f1208009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf6d380b997a7cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120d59a700 1 -- 172.21.15.26:0/2530675378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208005c10 con 0x7f12100b07d0 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120d59a700 1 -- 172.21.15.26:0/2530675378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208005d70 con 0x7f12100b07d0 2023-10-09T11:44:31.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.687+0000 7f120d59a700 1 -- 172.21.15.26:0/2530675378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208006260 con 0x7f12100b07d0 2023-10-09T11:44:31.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 -- 172.21.15.26:0/2530675378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b07d0 msgr2=0x7f12100ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 --2- 172.21.15.26:0/2530675378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b07d0 0x7f12100ccac0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f12100637a0 tx=0x7f1208009120 comp rx=0 tx=0).stop 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 -- 172.21.15.26:0/2530675378 shutdown_connections 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 --2- 172.21.15.26:0/2530675378 >> v2:172.21.15.67:3300/0 conn(0x7f12100b0ba0 0x7f12100c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 --2- 172.21.15.26:0/2530675378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b07d0 0x7f12100ccac0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 -- 172.21.15.26:0/2530675378 >> 172.21.15.26:0/2530675378 conn(0x7f121006ce80 msgr2=0x7f12100ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 -- 172.21.15.26:0/2530675378 shutdown_connections 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.688+0000 7f1214dba700 1 -- 172.21.15.26:0/2530675378 wait complete. 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.689+0000 7f1214dba700 1 Processor -- start 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.689+0000 7f1214dba700 1 -- start start 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12100b07d0 0x7f1210141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12100cf200 0x7f1210144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210158700 con 0x7f12100b0ba0 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101589e0 con 0x7f12100cf200 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f1214dba700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1210158cc0 con 0x7f12100b07d0 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34200/0 (socket says 172.21.15.26:34200) 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 -- 172.21.15.26:0/3428210062 learned_addr learned my addr 172.21.15.26:0/3428210062 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120ed9d700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12100cf200 0x7f1210144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 -- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12100b07d0 msgr2=0x7f1210141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120e59c700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12100b07d0 0x7f1210141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12100b07d0 0x7f1210141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 -- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12100cf200 msgr2=0x7f1210144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12100cf200 0x7f1210144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 -- 172.21.15.26:0/3428210062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080093c0 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.690+0000 7f120dd9b700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c810 tx=0x7f11f8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.691+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8005c00 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.691+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8005d60 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.691+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1210158fa0 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.691+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8007340 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.691+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1210158320 con 0x7f12100b0ba0 2023-10-09T11:44:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.692+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121004c3c0 con 0x7f12100b0ba0 2023-10-09T11:44:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.692+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11f801b400 con 0x7f12100b0ba0 2023-10-09T11:44:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.692+0000 7f12067fc700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.693+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f11f80846a0 con 0x7f12100b0ba0 2023-10-09T11:44:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.693+0000 7f120e59c700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.693+0000 7f120e59c700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 0x7f11f00697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12100637a0 tx=0x7f1208016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:31.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.697+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11f8051460 con 0x7f12100b0ba0 2023-10-09T11:44:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.934+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f121006de10 con 0x7f12100b0ba0 2023-10-09T11:44:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.934+0000 7f12067fc700 1 -- 172.21.15.26:0/3428210062 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4618 (secure 0 0 0) 0x7f11f8054a80 con 0x7f12100b0ba0 2023-10-09T11:44:31.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:31.936 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:27.331784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000887794","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 msgr2=0x7f11f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 0x7f11f00697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12100637a0 tx=0x7f1208016000 comp rx=0 tx=0).stop 2023-10-09T11:44:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 msgr2=0x7f121016a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c810 tx=0x7f11f8007d90 comp rx=0 tx=0).stop 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 shutdown_connections 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12100cf200 0x7f1210144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12100b07d0 0x7f1210141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 --2- 172.21.15.26:0/3428210062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12100b0ba0 0x7f121016a8b0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 >> 172.21.15.26:0/3428210062 conn(0x7f121006ce80 msgr2=0x7f12100cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 shutdown_connections 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:31.936+0000 7f1214dba700 1 -- 172.21.15.26:0/3428210062 wait complete. 2023-10-09T11:44:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 123 2023-10-09T11:44:31.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.068+0000 7f5d61bbb700 1 Processor -- start 2023-10-09T11:44:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.068+0000 7f5d61bbb700 1 -- start start 2023-10-09T11:44:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d61bbb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c1598b0 0x7f5d5c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d61bbb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0ce9d0 con 0x7f5d5c159c80 2023-10-09T11:44:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d61bbb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0afc30 con 0x7f5d5c0af790 2023-10-09T11:44:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d61bbb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c0aff10 con 0x7f5d5c1598b0 2023-10-09T11:44:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d5b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c1598b0 0x7f5d5c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d5affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5d5c159c80 0x7f5d5c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45260/0 (socket says 172.21.15.26:45260) 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d5affd700 1 -- 172.21.15.26:0/1684812338 learned_addr learned my addr 172.21.15.26:0/1684812338 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.069+0000 7f5d5b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c1598b0 0x7f5d5c0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34208/0 (socket says 172.21.15.26:34208) 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5b7fe700 1 -- 172.21.15.26:0/1684812338 >> v1:172.21.15.67:6789/0 conn(0x7f5d5c0af790 legacy=0x7f5d5c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5b7fe700 1 -- 172.21.15.26:0/1684812338 >> v1:172.21.15.26:6789/0 conn(0x7f5d5c159c80 legacy=0x7f5d5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5b7fe700 1 -- 172.21.15.26:0/1684812338 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0ce380 con 0x7f5d5c1598b0 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5a7fc700 1 -- 172.21.15.26:0/1684812338 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254942789 0 0) 0x7f5d5c0ce9d0 con 0x7f5d5c159c80 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5b7fe700 1 --2- 172.21.15.26:0/1684812338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c0af250 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098e0 tx=0x7f5d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff93568445e4c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5a7fc700 1 -- 172.21.15.26:0/1684812338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c009e80 con 0x7f5d5c1598b0 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5a7fc700 1 -- 172.21.15.26:0/1684812338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c00b860 con 0x7f5d5c1598b0 2023-10-09T11:44:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.070+0000 7f5d5a7fc700 1 -- 172.21.15.26:0/1684812338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00bbe0 con 0x7f5d5c1598b0 2023-10-09T11:44:32.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 -- 172.21.15.26:0/1684812338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c1598b0 msgr2=0x7f5d5c0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/1684812338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c0af250 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098e0 tx=0x7f5d4c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 -- 172.21.15.26:0/1684812338 shutdown_connections 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/1684812338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c0af250 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 -- 172.21.15.26:0/1684812338 >> 172.21.15.26:0/1684812338 conn(0x7f5d5c070e30 msgr2=0x7f5d5c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 -- 172.21.15.26:0/1684812338 shutdown_connections 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.071+0000 7f5d61bbb700 1 -- 172.21.15.26:0/1684812338 wait complete. 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.072+0000 7f5d61bbb700 1 Processor -- start 2023-10-09T11:44:32.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.072+0000 7f5d61bbb700 1 -- start start 2023-10-09T11:44:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d5c0af790 0x7f5d5c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c16d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b4430 con 0x7f5d5c159c80 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b3820 con 0x7f5d5c1598b0 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b3b00 con 0x7f5d5c0af790 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34224/0 (socket says 172.21.15.26:34224) 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 -- 172.21.15.26:0/2036295128 learned_addr learned my addr 172.21.15.26:0/2036295128 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5affd700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c16d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5b7fe700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d5c0af790 0x7f5d5c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 -- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d5c0af790 msgr2=0x7f5d5c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d5c0af790 0x7f5d5c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 -- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 msgr2=0x7f5d5c16d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c16d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 -- 172.21.15.26:0/2036295128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c009420 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5affd700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c16d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d5bfff700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400c900 tx=0x7f5d54001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400cea0 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400a7e0 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c0b3de0 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.073+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400aba0 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.074+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c0b34b0 con 0x7f5d5c159c80 2023-10-09T11:44:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.074+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c0d11f0 con 0x7f5d5c159c80 2023-10-09T11:44:32.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.075+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5d54003030 con 0x7f5d5c159c80 2023-10-09T11:44:32.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.075+0000 7f5d437fe700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 0x7f5d480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.075+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f5d54084d30 con 0x7f5d5c159c80 2023-10-09T11:44:32.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.075+0000 7f5d5b7fe700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 0x7f5d480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.076+0000 7f5d5b7fe700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 0x7f5d480697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0093f0 tx=0x7f5d4c017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.080+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d54051970 con 0x7f5d5c159c80 2023-10-09T11:44:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.273+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d5c04c3c0 con 0x7f5d5c159c80 2023-10-09T11:44:32.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.274+0000 7f5d437fe700 1 -- 172.21.15.26:0/2036295128 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f5d54054f90 con 0x7f5d5c159c80 2023-10-09T11:44:32.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:32.275 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":186,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:29.345949+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000887794.meta","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000887794"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000887794.data","create_time":"2023-10-09T11:44:10.623231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000887794"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.275+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 msgr2=0x7f5d480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.275+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 0x7f5d480697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0093f0 tx=0x7f5d4c017000 comp rx=0 tx=0).stop 2023-10-09T11:44:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.275+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 msgr2=0x7f5d5c16d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.275+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400c900 tx=0x7f5d54001730 comp rx=0 tx=0).stop 2023-10-09T11:44:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 shutdown_connections 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c159c80 0x7f5d5c16d940 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5d48067320 0x7f5d480697d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d5c0af790 0x7f5d5c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 --2- 172.21.15.26:0/2036295128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d5c1598b0 0x7f5d5c16d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 >> 172.21.15.26:0/2036295128 conn(0x7f5d5c070e30 msgr2=0x7f5d5c1551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 shutdown_connections 2023-10-09T11:44:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.276+0000 7f5d61bbb700 1 -- 172.21.15.26:0/2036295128 wait complete. 2023-10-09T11:44:32.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 31, 'pool_name': 'cephfs.volume_0000000000887794.meta', 'create_time': '2023-10-09T11:44:09.587778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000887794'}}}, {'pool': 32, 'pool_name': 'cephfs.volume_0000000000887794.data', 'create_time': '2023-10-09T11:44:10.623231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000887794'}}}] 2023-10-09T11:44:32.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:44:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 Processor -- start 2023-10-09T11:44:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 -- start start 2023-10-09T11:44:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd2000ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2000cbd90 0x7fd2000cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000cf510 con 0x7fd2000ccfa0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000cc1e0 con 0x7fd2000cbd90 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.411+0000 7fd205bb2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000ce900 con 0x7fd200159860 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2000ccfa0 0x7fd2000cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45274/0 (socket says 172.21.15.26:45274) 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fffff700 1 -- 172.21.15.26:0/2633313354 learned_addr learned my addr 172.21.15.26:0/2633313354 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1feffd700 1 --2- 172.21.15.26:0/2633313354 >> v2:172.21.15.67:3300/0 conn(0x7fd2000cbd90 0x7fd2000cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd2000ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296592227 0 0) 0x7fd2000cf510 con 0x7fd2000ccfa0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e8003570 con 0x7fd2000ccfa0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054935915 0 0) 0x7fd1e8003570 con 0x7fd2000ccfa0 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 msgr2=0x7fd2000ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd2000ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 >> v2:172.21.15.67:3300/0 conn(0x7fd2000cbd90 msgr2=0x7fd2000cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 --2- 172.21.15.26:0/2633313354 >> v2:172.21.15.67:3300/0 conn(0x7fd2000cbd90 0x7fd2000cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000cebe0 con 0x7fd2000ccfa0 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd1f80017f0 con 0x7fd2000ccfa0 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 >> v1:172.21.15.26:6789/0 conn(0x7fd2000ccfa0 legacy=0x7fd2000cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1e8003a60 0x7fd1e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd1e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1e8004d50 0x7fd1e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000cc1e0 con 0x7fd1e8004d50 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000ce900 con 0x7fd1e8003a60 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e800ba60 con 0x7fd200159860 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1fffff700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1e8004d50 0x7fd1e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1feffd700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd1e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.412+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1e8003a60 0x7fd1e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 -- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 msgr2=0x7fd1e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd1e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 -- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1e8003a60 msgr2=0x7fd1e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1e8003a60 0x7fd1e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 -- 172.21.15.26:0/2633313354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8003570 con 0x7fd1e8004d50 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1feffd700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd200159860 0x7fd1e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fffff700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1e8004d50 0x7fd1e80051c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800a970 tx=0x7fd1f8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b100a80c803cc2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8012440 con 0x7fd1e8004d50 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80125c0 con 0x7fd1e8004d50 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.413+0000 7fd1fe7fc700 1 -- 172.21.15.26:0/2633313354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8012980 con 0x7fd1e8004d50 2023-10-09T11:44:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 -- 172.21.15.26:0/2633313354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1e8004d50 msgr2=0x7fd1e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 --2- 172.21.15.26:0/2633313354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1e8004d50 0x7fd1e80051c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800a970 tx=0x7fd1f8002210 comp rx=0 tx=0).stop 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd1fffff700 1 -- 172.21.15.26:0/2633313354 reap_dead start 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 -- 172.21.15.26:0/2633313354 shutdown_connections 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 -- 172.21.15.26:0/2633313354 >> 172.21.15.26:0/2633313354 conn(0x7fd2000999b0 msgr2=0x7fd200070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 -- 172.21.15.26:0/2633313354 shutdown_connections 2023-10-09T11:44:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.414+0000 7fd205bb2700 1 -- 172.21.15.26:0/2633313354 wait complete. 2023-10-09T11:44:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.415+0000 7fd205bb2700 1 Processor -- start 2023-10-09T11:44:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.415+0000 7fd205bb2700 1 -- start start 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd20015a9d0 0x7fd20015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2000ca8f0 0x7fd20016d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20015e870 con 0x7fd2000ca480 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20015b710 con 0x7fd20015a9d0 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20015b9f0 con 0x7fd2000ca8f0 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34246/0 (socket says 172.21.15.26:34246) 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 -- 172.21.15.26:0/573877006 learned_addr learned my addr 172.21.15.26:0/573877006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1fffff700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2000ca8f0 0x7fd20016d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd20015a9d0 0x7fd20015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 -- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2000ca8f0 msgr2=0x7fd20016d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2000ca8f0 0x7fd20016d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 -- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd20015a9d0 msgr2=0x7fd20015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd20015a9d0 0x7fd20015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 -- 172.21.15.26:0/573877006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20015bcd0 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1feffd700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4006e50 tx=0x7fd1f4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400fcd0 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f400fe30 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20015eac0 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4005c50 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.416+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20016d840 con 0x7fd2000ca480 2023-10-09T11:44:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.417+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20004c3c0 con 0x7fd2000ca480 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.418+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1f4006230 con 0x7fd2000ca480 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.418+0000 7fd1e77fe700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 0x7fd1ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.418+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd1f4018070 con 0x7fd2000ca480 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.418+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 0x7fd1ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.419+0000 7fd1ff7fe700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 0x7fd1ec0697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0006ea0 tx=0x7fd1f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.422+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1f4055d70 con 0x7fd2000ca480 2023-10-09T11:44:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.614+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2000ceec0 con 0x7fd2000ca480 2023-10-09T11:44:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.614+0000 7fd1e77fe700 1 -- 172.21.15.26:0/573877006 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1f4055900 con 0x7fd2000ca480 2023-10-09T11:44:32.615 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:44:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 msgr2=0x7fd1ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 0x7fd1ec0697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0006ea0 tx=0x7fd1f0008040 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 msgr2=0x7fd20016cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4006e50 tx=0x7fd1f4009120 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 shutdown_connections 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd1ec067320 0x7fd1ec0697d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2000ca8f0 0x7fd20016d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd20015a9d0 0x7fd20015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 --2- 172.21.15.26:0/573877006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2000ca480 0x7fd20016cdc0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 >> 172.21.15.26:0/573877006 conn(0x7fd2000999b0 msgr2=0x7fd2000b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 shutdown_connections 2023-10-09T11:44:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.616+0000 7fd205bb2700 1 -- 172.21.15.26:0/573877006 wait complete. 2023-10-09T11:44:32.629 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000887794.meta pg_num 2023-10-09T11:44:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.751+0000 7fc1f9d9a700 1 Processor -- start 2023-10-09T11:44:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.751+0000 7fc1f9d9a700 1 -- start start 2023-10-09T11:44:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f9d9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1f4159530 0x7fc1f40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f9d9a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40ccfd0 con 0x7fc1f406dc70 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f9d9a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40cf0e0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f9d9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f415a3d0 con 0x7fc1f4159530 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1f4159530 0x7fc1f40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc1f406dc70 0x7fc1f4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45286/0 (socket says 172.21.15.26:45286) 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1f4159530 0x7fc1f40ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34262/0 (socket says 172.21.15.26:34262) 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/4047015933 learned_addr learned my addr 172.21.15.26:0/4047015933 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f37fe700 1 -- 172.21.15.26:0/4047015933 >> v1:172.21.15.67:6789/0 conn(0x7fc1f406e0e0 legacy=0x7fc1f40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f37fe700 1 -- 172.21.15.26:0/4047015933 >> v1:172.21.15.26:6789/0 conn(0x7fc1f406dc70 legacy=0x7fc1f4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.752+0000 7fc1f37fe700 1 -- 172.21.15.26:0/4047015933 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f415a6b0 con 0x7fc1f4159530 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f37fe700 1 --2- 172.21.15.26:0/4047015933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f4159530 0x7fc1f40ceba0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40098e0 tx=0x7fc1e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f95f98d426779 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f27fc700 1 -- 172.21.15.26:0/4047015933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4009e80 con 0x7fc1f4159530 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f27fc700 1 -- 172.21.15.26:0/4047015933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e400b860 con 0x7fc1f4159530 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f27fc700 1 -- 172.21.15.26:0/4047015933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400bbe0 con 0x7fc1f4159530 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/4047015933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f4159530 msgr2=0x7fc1f40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/4047015933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f4159530 0x7fc1f40ceba0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40098e0 tx=0x7fc1e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/4047015933 shutdown_connections 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/4047015933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f4159530 0x7fc1f40ceba0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/4047015933 >> 172.21.15.26:0/4047015933 conn(0x7fc1f40703a0 msgr2=0x7fc1f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/4047015933 shutdown_connections 2023-10-09T11:44:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.753+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/4047015933 wait complete. 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 Processor -- start 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 -- start start 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 0x7fc1f40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1f4159530 0x7fc1f4147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c7790 con 0x7fc1f406e0e0 2023-10-09T11:44:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b6580 con 0x7fc1f406dc70 2023-10-09T11:44:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f9d9a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f416d960 con 0x7fc1f4159530 2023-10-09T11:44:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34276/0 (socket says 172.21.15.26:34276) 2023-10-09T11:44:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.755+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3637108773 learned_addr learned my addr 172.21.15.26:0/3637108773 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f37fe700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 0x7fc1f40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f3fff700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1f4159530 0x7fc1f4147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1f4159530 msgr2=0x7fc1f4147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1f4159530 0x7fc1f4147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 msgr2=0x7fc1f40b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 0x7fc1f40b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3637108773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009420 con 0x7fc1f406e0e0 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f37fe700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 0x7fc1f40b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f2ffd700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c7c0 tx=0x7fc1e8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8005b30 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8005c90 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f416dc40 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004a80 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.756+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40c90d0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.757+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f416de30 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.758+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc1e80070d0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.758+0000 7fc1db7fe700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 0x7fc1e0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.758+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fc1e8084090 con 0x7fc1f406e0e0 2023-10-09T11:44:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.758+0000 7fc1f37fe700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 0x7fc1e0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:32.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.759+0000 7fc1f37fe700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 0x7fc1e0069800 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40093f0 tx=0x7fc1e4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:32.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.762+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1e804b5a0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.952+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000887794.meta", "var": "pg_num"} v 0) v1 -- 0x7fc1f404c3c0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.953+0000 7fc1db7fe700 1 -- 172.21.15.26:0/3637108773 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000887794.meta", "var": "pg_num"}]=0 v186) v1 ==== 124+0+11 (secure 0 0 0) 0x7fc1e8050cd0 con 0x7fc1f406e0e0 2023-10-09T11:44:32.954 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:44:32.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 msgr2=0x7fc1e0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 0x7fc1e0069800 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40093f0 tx=0x7fc1e4017000 comp rx=0 tx=0).stop 2023-10-09T11:44:32.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 msgr2=0x7fc1f40c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:32.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c7c0 tx=0x7fc1e8007f70 comp rx=0 tx=0).stop 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 shutdown_connections 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc1e0067350 0x7fc1e0069800 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1f4159530 0x7fc1f4147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1f406dc70 0x7fc1f40b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 --2- 172.21.15.26:0/3637108773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f406e0e0 0x7fc1f40c8b90 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 >> 172.21.15.26:0/3637108773 conn(0x7fc1f40703a0 msgr2=0x7fc1f40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 shutdown_connections 2023-10-09T11:44:32.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:32.955+0000 7fc1f9d9a700 1 -- 172.21.15.26:0/3637108773 wait complete. 2023-10-09T11:44:32.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000887794.data pg_num 2023-10-09T11:44:33.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.090+0000 7f8894f48700 1 Processor -- start 2023-10-09T11:44:33.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.091+0000 7f8894f48700 1 -- start start 2023-10-09T11:44:33.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.091+0000 7f8894f48700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8890159530 0x7f88900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.091+0000 7f8894f48700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88900ccfd0 con 0x7f889006e0e0 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f8894f48700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88900cf0e0 con 0x7f889006dc70 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f8894f48700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889015a3d0 con 0x7f8890159530 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8890159530 0x7f88900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f889006e0e0 0x7f88900cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45294/0 (socket says 172.21.15.26:45294) 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888ed9d700 1 -- 172.21.15.26:0/3184824206 learned_addr learned my addr 172.21.15.26:0/3184824206 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888e59c700 1 -- 172.21.15.26:0/3184824206 >> v1:172.21.15.67:6789/0 conn(0x7f889006dc70 legacy=0x7f8890159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888e59c700 1 -- 172.21.15.26:0/3184824206 >> v1:172.21.15.26:6789/0 conn(0x7f889006e0e0 legacy=0x7f88900cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888e59c700 1 -- 172.21.15.26:0/3184824206 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889015a6b0 con 0x7f8890159530 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888d59a700 1 -- 172.21.15.26:0/3184824206 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424281049 0 0) 0x7f88900ccfd0 con 0x7f889006e0e0 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888e59c700 1 --2- 172.21.15.26:0/3184824206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900ceba0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f88880098e0 tx=0x7f88880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c2f49d2dbed8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888d59a700 1 -- 172.21.15.26:0/3184824206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888009e80 con 0x7f8890159530 2023-10-09T11:44:33.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888d59a700 1 -- 172.21.15.26:0/3184824206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800b820 con 0x7f8890159530 2023-10-09T11:44:33.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.092+0000 7f888d59a700 1 -- 172.21.15.26:0/3184824206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800bba0 con 0x7f8890159530 2023-10-09T11:44:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 -- 172.21.15.26:0/3184824206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 msgr2=0x7f88900ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 --2- 172.21.15.26:0/3184824206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900ceba0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f88880098e0 tx=0x7f88880091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 -- 172.21.15.26:0/3184824206 shutdown_connections 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 --2- 172.21.15.26:0/3184824206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900ceba0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 -- 172.21.15.26:0/3184824206 >> 172.21.15.26:0/3184824206 conn(0x7f88900703a0 msgr2=0x7f88900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 -- 172.21.15.26:0/3184824206 shutdown_connections 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.093+0000 7f8894f48700 1 -- 172.21.15.26:0/3184824206 wait complete. 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.094+0000 7f8894f48700 1 Processor -- start 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.094+0000 7f8894f48700 1 -- start start 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 0x7f88900ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f889006e0e0 0x7f88900c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88901522f0 con 0x7f8890159530 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900c80e0 con 0x7f889006dc70 2023-10-09T11:44:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f8894f48700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890152590 con 0x7f889006e0e0 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34294/0 (socket says 172.21.15.26:34294) 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 -- 172.21.15.26:0/4241475721 learned_addr learned my addr 172.21.15.26:0/4241475721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888e59c700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 0x7f88900ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888dd9b700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f889006e0e0 0x7f88900c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 -- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f889006e0e0 msgr2=0x7f88900c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f889006e0e0 0x7f88900c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 -- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 msgr2=0x7f88900ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 0x7f88900ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 -- 172.21.15.26:0/4241475721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888009420 con 0x7f8890159530 2023-10-09T11:44:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888e59c700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 0x7f88900ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.095+0000 7f888ed9d700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f888000cc90 tx=0x7f8880001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.096+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000a960 con 0x7f8890159530 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.096+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000aac0 con 0x7f8890159530 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.096+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8890152870 con 0x7f8890159530 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.096+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000ae80 con 0x7f8890159530 2023-10-09T11:44:33.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.096+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88900c7cd0 con 0x7f8890159530 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.097+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890070770 con 0x7f8890159530 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.097+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8880007300 con 0x7f8890159530 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.097+0000 7f88867fc700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 0x7f88700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.098+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f88800850a0 con 0x7f8890159530 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.098+0000 7f888e59c700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 0x7f88700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.098+0000 7f888e59c700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 0x7f88700697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f88880030c0 tx=0x7f8888016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.102+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8880051d60 con 0x7f8890159530 2023-10-09T11:44:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.293+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000887794.data", "var": "pg_num"} v 0) v1 -- 0x7f889004c3c0 con 0x7f8890159530 2023-10-09T11:44:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.294+0000 7f88867fc700 1 -- 172.21.15.26:0/4241475721 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000887794.data", "var": "pg_num"}]=0 v186) v1 ==== 124+0+11 (secure 0 0 0) 0x7f8880055380 con 0x7f8890159530 2023-10-09T11:44:33.295 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 msgr2=0x7f88700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 0x7f88700697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f88880030c0 tx=0x7f8888016000 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 msgr2=0x7f88900b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f888000cc90 tx=0x7f8880001a80 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 shutdown_connections 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8890159530 0x7f88900b2390 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f889006dc70 0x7f88900ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8870067320 0x7f88700697d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 --2- 172.21.15.26:0/4241475721 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f889006e0e0 0x7f88900c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 >> 172.21.15.26:0/4241475721 conn(0x7f88900703a0 msgr2=0x7f889015b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 shutdown_connections 2023-10-09T11:44:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.296+0000 7f8894f48700 1 -- 172.21.15.26:0/4241475721 wait complete. 2023-10-09T11:44:33.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.428+0000 7fe3e6c86700 1 Processor -- start 2023-10-09T11:44:33.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.428+0000 7fe3e6c86700 1 -- start start 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6c86700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e0153c30 0x7fe3e015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6c86700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3e015de50 0x7fe3e00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6c86700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e00cf3c0 con 0x7fe3e00cef40 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6c86700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e015afd0 con 0x7fe3e0153c30 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6c86700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e015b2b0 con 0x7fe3e015de50 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e5c84700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e0153c30 0x7fe3e015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6485700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3e00cef40 0x7fe3e006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45306/0 (socket says 172.21.15.26:45306) 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e6485700 1 -- 172.21.15.26:0/2637931961 learned_addr learned my addr 172.21.15.26:0/2637931961 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.429+0000 7fe3e5483700 1 --2- 172.21.15.26:0/2637931961 >> v2:172.21.15.67:3300/0 conn(0x7fe3e015de50 0x7fe3e00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e5c84700 1 -- 172.21.15.26:0/2637931961 >> v2:172.21.15.67:3300/0 conn(0x7fe3e015de50 msgr2=0x7fe3e00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e5c84700 1 --2- 172.21.15.26:0/2637931961 >> v2:172.21.15.67:3300/0 conn(0x7fe3e015de50 0x7fe3e00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e5c84700 1 -- 172.21.15.26:0/2637931961 >> v1:172.21.15.26:6789/0 conn(0x7fe3e00cef40 legacy=0x7fe3e006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e5c84700 1 -- 172.21.15.26:0/2637931961 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e015b590 con 0x7fe3e0153c30 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e5c84700 1 --2- 172.21.15.26:0/2637931961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e015a5e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00713a0 tx=0x7fe3d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780cc0e0ba64a76d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e4c82700 1 -- 172.21.15.26:0/2637931961 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000e070 con 0x7fe3e0153c30 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e4c82700 1 -- 172.21.15.26:0/2637931961 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000bc30 con 0x7fe3e0153c30 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e4c82700 1 -- 172.21.15.26:0/2637931961 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0012430 con 0x7fe3e0153c30 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 -- 172.21.15.26:0/2637931961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 msgr2=0x7fe3e015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/2637931961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e015a5e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00713a0 tx=0x7fe3d0009780 comp rx=0 tx=0).stop 2023-10-09T11:44:33.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 -- 172.21.15.26:0/2637931961 shutdown_connections 2023-10-09T11:44:33.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/2637931961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e015a5e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/2637931961 >> v2:172.21.15.67:3300/0 conn(0x7fe3e015de50 0x7fe3e00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 -- 172.21.15.26:0/2637931961 >> 172.21.15.26:0/2637931961 conn(0x7fe3e00703a0 msgr2=0x7fe3e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:33.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 -- 172.21.15.26:0/2637931961 shutdown_connections 2023-10-09T11:44:33.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.430+0000 7fe3e6c86700 1 -- 172.21.15.26:0/2637931961 wait complete. 2023-10-09T11:44:33.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 Processor -- start 2023-10-09T11:44:33.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 -- start start 2023-10-09T11:44:33.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e00cef40 0x7fe3e0158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e015de50 0x7fe3e00b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c95a0 con 0x7fe3e0153c30 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c8990 con 0x7fe3e015de50 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6c86700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c8c70 con 0x7fe3e00cef40 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e5483700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e5483700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34304/0 (socket says 172.21.15.26:34304) 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e5483700 1 -- 172.21.15.26:0/3465749688 learned_addr learned my addr 172.21.15.26:0/3465749688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.432+0000 7fe3e6485700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e015de50 0x7fe3e00b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5c84700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e00cef40 0x7fe3e0158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 -- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e00cef40 msgr2=0x7fe3e0158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e00cef40 0x7fe3e0158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 -- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e015de50 msgr2=0x7fe3e00b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e015de50 0x7fe3e00b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 -- 172.21.15.26:0/3465749688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009a20 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e5483700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400d890 tx=0x7fe3d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40125f0 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4012750 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4012af0 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e00c8f50 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.433+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e00c85b0 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.434+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e004c3c0 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.435+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe3d401e460 con 0x7fe3e0153c30 2023-10-09T11:44:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.435+0000 7fe3ddffb700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 0x7fe3cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.435+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe3d40851f0 con 0x7fe3e0153c30 2023-10-09T11:44:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.435+0000 7fe3e5c84700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 0x7fe3cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.436+0000 7fe3e5c84700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 0x7fe3cc0697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00713a0 tx=0x7fe3d0019000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.439+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3d4051e30 con 0x7fe3e0153c30 2023-10-09T11:44:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.679+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3e015bab0 con 0x7fe3e0153c30 2023-10-09T11:44:33.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.679+0000 7fe3ddffb700 1 -- 172.21.15.26:0/3465749688 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4618 (secure 0 0 0) 0x7fe3d4055450 con 0x7fe3e0153c30 2023-10-09T11:44:33.681 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:33.681 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:27.331784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000887794","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 msgr2=0x7fe3cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 0x7fe3cc0697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00713a0 tx=0x7fe3d0019000 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 msgr2=0x7fe3e00c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400d890 tx=0x7fe3d4008040 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 shutdown_connections 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3e015de50 0x7fe3e00b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe3cc067320 0x7fe3cc0697d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe3e00cef40 0x7fe3e0158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 --2- 172.21.15.26:0/3465749688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e0153c30 0x7fe3e00c9a30 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 >> 172.21.15.26:0/3465749688 conn(0x7fe3e00703a0 msgr2=0x7fe3e00cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 shutdown_connections 2023-10-09T11:44:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.682+0000 7fe3e6c86700 1 -- 172.21.15.26:0/3465749688 wait complete. 2023-10-09T11:44:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 123 2023-10-09T11:44:33.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:33.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.813+0000 7f140e8f6700 1 Processor -- start 2023-10-09T11:44:33.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.813+0000 7f140e8f6700 1 -- start start 2023-10-09T11:44:33.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e8f6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1408153c30 0x7f140815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e8f6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f140815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e8f6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140815afd0 con 0x7f140815de50 2023-10-09T11:44:33.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e8f6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140815b2b0 con 0x7f1408153c30 2023-10-09T11:44:33.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e8f6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140815b590 con 0x7f14080cf110 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140d0f3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f140815de50 0x7f14080cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45322/0 (socket says 172.21.15.26:45322) 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140d0f3700 1 -- 172.21.15.26:0/4149543921 learned_addr learned my addr 172.21.15.26:0/4149543921 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> v2:172.21.15.67:3300/0 conn(0x7f1408153c30 0x7f140815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.814+0000 7f140e0f5700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f140815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547864207 0 0) 0x7f140815afd0 con 0x7f140815de50 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f0003570 con 0x7f140815de50 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 518961229 0 0) 0x7f13f0003570 con 0x7f140815de50 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 msgr2=0x7f140815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f140815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 >> v2:172.21.15.67:3300/0 conn(0x7f1408153c30 msgr2=0x7f140815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 --2- 172.21.15.26:0/4149543921 >> v2:172.21.15.67:3300/0 conn(0x7f1408153c30 0x7f140815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140815b870 con 0x7f140815de50 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f13fc001470 con 0x7f140815de50 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> v2:172.21.15.67:3300/0 conn(0x7f1408153c30 0x7f140815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140e0f5700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f140815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 >> v1:172.21.15.26:6789/0 conn(0x7f140815de50 legacy=0x7f14080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f0003a60 0x7f13f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f13f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0004d50 0x7f13f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140815b2b0 con 0x7f13f0003a60 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140815b590 con 0x7f13f0004d50 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f000ba60 con 0x7f14080cf110 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f0003a60 0x7f13f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d0f3700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f13f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140e0f5700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0004d50 0x7f13f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 -- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 msgr2=0x7f13f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f13f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 -- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0004d50 msgr2=0x7f13f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0004d50 0x7f13f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d8f4700 1 -- 172.21.15.26:0/4149543921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8009a20 con 0x7f13f0003a60 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.815+0000 7f140d0f3700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080cf110 0x7f13f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140d8f4700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f0003a60 0x7f13f0003e70 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e20 tx=0x7f14000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad1ce2a7d28b851 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000e8c0 con 0x7f13f0003a60 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000ea20 con 0x7f13f0003a60 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140c8f2700 1 -- 172.21.15.26:0/4149543921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000edc0 con 0x7f13f0003a60 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 -- 172.21.15.26:0/4149543921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f0003a60 msgr2=0x7f13f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 --2- 172.21.15.26:0/4149543921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f0003a60 0x7f13f0003e70 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e20 tx=0x7f14000091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e0f5700 1 -- 172.21.15.26:0/4149543921 reap_dead start 2023-10-09T11:44:33.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 -- 172.21.15.26:0/4149543921 shutdown_connections 2023-10-09T11:44:33.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 -- 172.21.15.26:0/4149543921 >> 172.21.15.26:0/4149543921 conn(0x7f14080703a0 msgr2=0x7f14080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:33.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 -- 172.21.15.26:0/4149543921 shutdown_connections 2023-10-09T11:44:33.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.816+0000 7f140e8f6700 1 -- 172.21.15.26:0/4149543921 wait complete. 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.817+0000 7f140e8f6700 1 Processor -- start 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.817+0000 7f140e8f6700 1 -- start start 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 0x7f14080b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 0x7f1408169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140816a9d0 con 0x7f140816a010 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14081524a0 con 0x7f13f0003a60 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e8f6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080c9330 con 0x7f14080c82b0 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e0f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e0f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34326/0 (socket says 172.21.15.26:34326) 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140e0f5700 1 -- 172.21.15.26:0/788610151 learned_addr learned my addr 172.21.15.26:0/788610151 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140d8f4700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 0x7f14080b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.818+0000 7f140d0f3700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 0x7f1408169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 -- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 msgr2=0x7f1408169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 0x7f1408169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 -- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 msgr2=0x7f14080b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 0x7f14080b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 -- 172.21.15.26:0/788610151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080c8a90 con 0x7f140816a010 2023-10-09T11:44:33.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140d0f3700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 0x7f1408169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140d8f4700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 0x7f14080b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e0f5700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f140815e220 tx=0x7f13f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800e070 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8011db0 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80166c0 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080c8d70 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.819+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080b3370 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.820+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14080b3590 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.820+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f13f8016ab0 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.821+0000 7f1405ffb700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 0x7f13f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.821+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f13f8085a80 con 0x7f140816a010 2023-10-09T11:44:33.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.821+0000 7f140d8f4700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 0x7f13f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:33.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.822+0000 7f140d8f4700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 0x7f13f40697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f14000091e0 tx=0x7f140001a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:33.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:33.825+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f80525b0 con 0x7f140816a010 2023-10-09T11:44:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.019+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f140804c3c0 con 0x7f140816a010 2023-10-09T11:44:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.019+0000 7f1405ffb700 1 -- 172.21.15.26:0/788610151 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f13f8055bd0 con 0x7f140816a010 2023-10-09T11:44:34.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:34.021 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":186,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:29.345949+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000887794.meta","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000887794"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000887794.data","create_time":"2023-10-09T11:44:10.623231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000887794"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 msgr2=0x7f13f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 0x7f13f40697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f14000091e0 tx=0x7f140001a000 comp rx=0 tx=0).stop 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 msgr2=0x7f140816a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f140815e220 tx=0x7f13f800b040 comp rx=0 tx=0).stop 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 shutdown_connections 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f140816a010 0x7f140816a490 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f0003a60 0x7f14080b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f13f4067320 0x7f13f40697d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 --2- 172.21.15.26:0/788610151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14080c82b0 0x7f1408169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.021+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 >> 172.21.15.26:0/788610151 conn(0x7f14080703a0 msgr2=0x7f1408152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.022+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 shutdown_connections 2023-10-09T11:44:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.022+0000 7f140e8f6700 1 -- 172.21.15.26:0/788610151 wait complete. 2023-10-09T11:44:34.035 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000887794 and related pools 2023-10-09T11:44:34.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.153+0000 7f6ffc6a9700 1 Processor -- start 2023-10-09T11:44:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.153+0000 7f6ffc6a9700 1 -- start start 2023-10-09T11:44:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffc6a9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff41599a0 0x7f6ff406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffc6a9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40c7f50 con 0x7f6ff41595d0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffc6a9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff406b740 con 0x7f6ff406b230 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffc6a9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff406bd00 con 0x7f6ff41599a0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9c44700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff41599a0 0x7f6ff406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffa445700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6ff41595d0 0x7f6ff40675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45324/0 (socket says 172.21.15.26:45324) 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ffa445700 1 -- 172.21.15.26:0/2198879418 learned_addr learned my addr 172.21.15.26:0/2198879418 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9c44700 1 -- 172.21.15.26:0/2198879418 >> v1:172.21.15.67:6789/0 conn(0x7f6ff406b230 legacy=0x7f6ff40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9c44700 1 -- 172.21.15.26:0/2198879418 >> v1:172.21.15.26:6789/0 conn(0x7f6ff41595d0 legacy=0x7f6ff40675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9c44700 1 -- 172.21.15.26:0/2198879418 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff406ba20 con 0x7f6ff41599a0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9443700 1 -- 172.21.15.26:0/2198879418 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734057775 0 0) 0x7f6ff40c7f50 con 0x7f6ff41595d0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9c44700 1 --2- 172.21.15.26:0/2198879418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff41599a0 0x7f6ff406acf0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80098e0 tx=0x7f6fe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0a2cd183e2e8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9443700 1 -- 172.21.15.26:0/2198879418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8009e80 con 0x7f6ff41599a0 2023-10-09T11:44:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9443700 1 -- 172.21.15.26:0/2198879418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe800b860 con 0x7f6ff41599a0 2023-10-09T11:44:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.154+0000 7f6ff9443700 1 -- 172.21.15.26:0/2198879418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800bbe0 con 0x7f6ff41599a0 2023-10-09T11:44:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/2198879418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff41599a0 msgr2=0x7f6ff406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/2198879418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff41599a0 0x7f6ff406acf0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80098e0 tx=0x7f6fe80091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/2198879418 shutdown_connections 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/2198879418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff41599a0 0x7f6ff406acf0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/2198879418 >> 172.21.15.26:0/2198879418 conn(0x7f6ff40cd400 msgr2=0x7f6ff40cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/2198879418 shutdown_connections 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.155+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/2198879418 wait complete. 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.156+0000 7f6ffc6a9700 1 Processor -- start 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.156+0000 7f6ffc6a9700 1 -- start start 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ff41595d0 0x7f6ff415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ff41599a0 0x7f6ff41699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b1550 con 0x7f6ff406b230 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b1830 con 0x7f6ff41595d0 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffc6a9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b1b10 con 0x7f6ff41599a0 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34342/0 (socket says 172.21.15.26:34342) 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 -- 172.21.15.26:0/3424606146 learned_addr learned my addr 172.21.15.26:0/3424606146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffac46700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ff41599a0 0x7f6ff41699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ff9c44700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ff41595d0 0x7f6ff415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 -- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ff41599a0 msgr2=0x7f6ff41699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ff41599a0 0x7f6ff41699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 -- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ff41595d0 msgr2=0x7f6ff415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ff41595d0 0x7f6ff415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 -- 172.21.15.26:0/3424606146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8009420 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.157+0000 7f6ffa445700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400ccc0 tx=0x7f6fe4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.158+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400ab70 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.158+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400acd0 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.158+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff40b1df0 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.158+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4007340 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.158+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40b1170 con 0x7f6ff406b230 2023-10-09T11:44:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.159+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40b2b30 con 0x7f6ff406b230 2023-10-09T11:44:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.159+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6fe4007770 con 0x7f6ff406b230 2023-10-09T11:44:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.159+0000 7f6ff27fc700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 0x7f6fe00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.159+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6fe4085170 con 0x7f6ff406b230 2023-10-09T11:44:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.160+0000 7f6ff9c44700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 0x7f6fe00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.160+0000 7f6ff9c44700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 0x7f6fe00697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80091e0 tx=0x7f6fe8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.164+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fe4051e30 con 0x7f6ff406b230 2023-10-09T11:44:34.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.406+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ff404c3c0 con 0x7f6ff406b230 2023-10-09T11:44:34.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.406+0000 7f6ff27fc700 1 -- 172.21.15.26:0/3424606146 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4618 (secure 0 0 0) 0x7f6fe4055450 con 0x7f6ff406b230 2023-10-09T11:44:34.408 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:34.408 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:27.331784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000887794","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.408+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 msgr2=0x7f6fe00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.408+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 0x7f6fe00697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80091e0 tx=0x7f6fe8017000 comp rx=0 tx=0).stop 2023-10-09T11:44:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.408+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 msgr2=0x7f6ff40b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.408+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400ccc0 tx=0x7f6fe4001a80 comp rx=0 tx=0).stop 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 shutdown_connections 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6fe0067320 0x7f6fe00697d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ff41599a0 0x7f6ff41699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff406b230 0x7f6ff40b25f0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 --2- 172.21.15.26:0/3424606146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ff41595d0 0x7f6ff415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 >> 172.21.15.26:0/3424606146 conn(0x7f6ff40cd400 msgr2=0x7f6ff41587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 shutdown_connections 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.409+0000 7f6ffc6a9700 1 -- 172.21.15.26:0/3424606146 wait complete. 2023-10-09T11:44:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 123 2023-10-09T11:44:34.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:34.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.540+0000 7f5d01496700 1 Processor -- start 2023-10-09T11:44:34.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.540+0000 7f5d01496700 1 -- start start 2023-10-09T11:44:34.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5d01496700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5cfc0b07d0 0x7f5cfc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5d01496700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cfc0b0ba0 0x7f5cfc0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5d01496700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc15a280 con 0x7f5cfc0cf200 2023-10-09T11:44:34.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5d01496700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc06e180 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5d01496700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc06d850 con 0x7f5cfc0b0ba0 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5cfaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5cfc0b07d0 0x7f5cfc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5cfa7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5cfc0cf200 0x7f5cfc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45332/0 (socket says 172.21.15.26:45332) 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.541+0000 7f5cfa7fc700 1 -- 172.21.15.26:0/4133722315 learned_addr learned my addr 172.21.15.26:0/4133722315 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfb7fe700 1 --2- 172.21.15.26:0/4133722315 >> v2:172.21.15.67:3300/0 conn(0x7f5cfc0b0ba0 0x7f5cfc0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfaffd700 1 -- 172.21.15.26:0/4133722315 >> v2:172.21.15.67:3300/0 conn(0x7f5cfc0b0ba0 msgr2=0x7f5cfc0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/4133722315 >> v2:172.21.15.67:3300/0 conn(0x7f5cfc0b0ba0 0x7f5cfc0c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfaffd700 1 -- 172.21.15.26:0/4133722315 >> v1:172.21.15.26:6789/0 conn(0x7f5cfc0cf200 legacy=0x7f5cfc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfaffd700 1 -- 172.21.15.26:0/4133722315 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc06db30 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cf9ffb700 1 -- 172.21.15.26:0/4133722315 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232633813 0 0) 0x7f5cfc15a280 con 0x7f5cfc0cf200 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/4133722315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc0ccac0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0637a0 tx=0x7f5cf4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88c1cf88b575a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cf9ffb700 1 -- 172.21.15.26:0/4133722315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4005c10 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cf9ffb700 1 -- 172.21.15.26:0/4133722315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf4005d70 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5cf9ffb700 1 -- 172.21.15.26:0/4133722315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4006260 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5d01496700 1 -- 172.21.15.26:0/4133722315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0b07d0 msgr2=0x7f5cfc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.542+0000 7f5d01496700 1 --2- 172.21.15.26:0/4133722315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc0ccac0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0637a0 tx=0x7f5cf4009120 comp rx=0 tx=0).stop 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 -- 172.21.15.26:0/4133722315 shutdown_connections 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 --2- 172.21.15.26:0/4133722315 >> v2:172.21.15.67:3300/0 conn(0x7f5cfc0b0ba0 0x7f5cfc0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 --2- 172.21.15.26:0/4133722315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc0ccac0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 -- 172.21.15.26:0/4133722315 >> 172.21.15.26:0/4133722315 conn(0x7f5cfc06ce80 msgr2=0x7f5cfc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 -- 172.21.15.26:0/4133722315 shutdown_connections 2023-10-09T11:44:34.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.543+0000 7f5d01496700 1 -- 172.21.15.26:0/4133722315 wait complete. 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.544+0000 7f5d01496700 1 Processor -- start 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.544+0000 7f5d01496700 1 -- start start 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 0x7f5cfc142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc144df0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc155890 con 0x7f5cfc0b07d0 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc154c90 con 0x7f5cfc0b0ba0 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34368/0 (socket says 172.21.15.26:34368) 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 -- 172.21.15.26:0/2912618765 learned_addr learned my addr 172.21.15.26:0/2912618765 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfa7fc700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 0x7f5cfc142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 -- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 msgr2=0x7f5cfc142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 0x7f5cfc142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 -- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 msgr2=0x7f5cfc1448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc1448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 -- 172.21.15.26:0/2912618765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf40093c0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfa7fc700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 0x7f5cfc142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cfb7fe700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009fa0 tx=0x7f5cec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00ed20 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00ee80 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec014670 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc154f60 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.545+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc155520 con 0x7f5cfc0cf200 2023-10-09T11:44:34.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.546+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc141db0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.547+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5cec0149e0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.547+0000 7f5cf2ffd700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 0x7f5cdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.547+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f5cec085460 con 0x7f5cfc0cf200 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.547+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 0x7f5cdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.548+0000 7f5cfaffd700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 0x7f5cdc0697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40030c0 tx=0x7f5cf4016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.551+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cfc141db0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.788+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cfc141db0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.788+0000 7f5cf2ffd700 1 -- 172.21.15.26:0/2912618765 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+4618 (secure 0 0 0) 0x7f5cfc141db0 con 0x7f5cfc0cf200 2023-10-09T11:44:34.790 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:34.790 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":123,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:11.646554+0000","modified":"2023-10-09T11:44:27.331784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8724":{"gid":8724,"name":"d","rank":0,"incarnation":116,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6836/136982227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":136982227},{"type":"v1","addr":"172.21.15.67:6836","nonce":136982227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000887794","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 msgr2=0x7f5cdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 0x7f5cdc0697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40030c0 tx=0x7f5cf4016000 comp rx=0 tx=0).stop 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 msgr2=0x7f5cfc1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009fa0 tx=0x7f5cec009900 comp rx=0 tx=0).stop 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 shutdown_connections 2023-10-09T11:44:34.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cfc0cf200 0x7f5cfc1425d0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc0b07d0 0x7f5cfc1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5cdc067320 0x7f5cdc0697d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 --2- 172.21.15.26:0/2912618765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cfc0b0ba0 0x7f5cfc142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.790+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 >> 172.21.15.26:0/2912618765 conn(0x7f5cfc06ce80 msgr2=0x7f5cfc140fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.791+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 shutdown_connections 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.791+0000 7f5d01496700 1 -- 172.21.15.26:0/2912618765 wait complete. 2023-10-09T11:44:34.793 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 123 2023-10-09T11:44:34.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:34.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.922+0000 7fb749576700 1 Processor -- start 2023-10-09T11:44:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.922+0000 7fb749576700 1 -- start start 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb749576700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb7440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb749576700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74415ae40 con 0x7fb7440cd9e0 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb749576700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74415ab60 con 0x7fb7440cde50 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb749576700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440d13f0 con 0x7fb7440cb5a0 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb7427fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb7440cd9e0 0x7fb744159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45340/0 (socket says 172.21.15.26:45340) 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb7427fc700 1 -- 172.21.15.26:0/2758978559 learned_addr learned my addr 172.21.15.26:0/2758978559 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.923+0000 7fb742ffd700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb7440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015758466 0 0) 0x7fb74415ae40 con 0x7fb7440cd9e0 2023-10-09T11:44:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb730003570 con 0x7fb7440cd9e0 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3650495912 0 0) 0x7fb730003570 con 0x7fb7440cd9e0 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 msgr2=0x7fb7440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb7440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 >> v1:172.21.15.67:6789/0 conn(0x7fb7440cde50 legacy=0x7fb744156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440ccf00 con 0x7fb7440cd9e0 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb72c001470 con 0x7fb7440cd9e0 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 >> v1:172.21.15.26:6789/0 conn(0x7fb7440cd9e0 legacy=0x7fb744159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb730003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb730004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb730004d50 0x7fb7300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73000bbf0 con 0x7fb730004010 2023-10-09T11:44:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73000bd30 con 0x7fb730004d50 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73000bef0 con 0x7fb7440cb5a0 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb730004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb742ffd700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb730003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7437fe700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb730004d50 0x7fb7300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 -- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 msgr2=0x7fb730003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440cb5a0 0x7fb730003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 -- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb730004d50 msgr2=0x7fb7300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb730004d50 0x7fb7300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 -- 172.21.15.26:0/2758978559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730003570 con 0x7fb730004010 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.924+0000 7fb7427fc700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb730004810 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c390 tx=0x7fb72c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c939593e0341e4d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00cc60 con 0x7fb730004010 2023-10-09T11:44:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00cde0 con 0x7fb730004010 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb741ffb700 1 -- 172.21.15.26:0/2758978559 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c005b70 con 0x7fb730004010 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 -- 172.21.15.26:0/2758978559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 msgr2=0x7fb730004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 --2- 172.21.15.26:0/2758978559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb730004810 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c390 tx=0x7fb72c001e50 comp rx=0 tx=0).stop 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb7437fe700 1 -- 172.21.15.26:0/2758978559 reap_dead start 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 -- 172.21.15.26:0/2758978559 shutdown_connections 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 -- 172.21.15.26:0/2758978559 >> 172.21.15.26:0/2758978559 conn(0x7fb744070e30 msgr2=0x7fb7440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 -- 172.21.15.26:0/2758978559 shutdown_connections 2023-10-09T11:44:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.925+0000 7fb749576700 1 -- 172.21.15.26:0/2758978559 wait complete. 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.926+0000 7fb749576700 1 Processor -- start 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 -- start start 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 0x7fb7441560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440b4990 0x7fb7440b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440b5370 con 0x7fb730004010 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440c93c0 con 0x7fb74415ccf0 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb749576700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440c87b0 con 0x7fb7440b4990 2023-10-09T11:44:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb742ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb742ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34386/0 (socket says 172.21.15.26:34386) 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb742ffd700 1 -- 172.21.15.26:0/772097284 learned_addr learned my addr 172.21.15.26:0/772097284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb7437fe700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440b4990 0x7fb7440b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.927+0000 7fb7427fc700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 0x7fb7441560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 -- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440b4990 msgr2=0x7fb7440b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440b4990 0x7fb7440b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 -- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 msgr2=0x7fb7441560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 0x7fb7441560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 -- 172.21.15.26:0/772097284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440c8a90 con 0x7fb730004010 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb7427fc700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 0x7fb7441560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb742ffd700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb73c011f80 tx=0x7fb73c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00e040 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f040 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c015430 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440c8d70 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.928+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74415d160 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.929+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74404c3c0 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.929+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb73c015820 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.930+0000 7fb73affd700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 0x7fb7240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.930+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb73c085a90 con 0x7fb730004010 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.930+0000 7fb7427fc700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 0x7fb7240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.930+0000 7fb7427fc700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 0x7fb7240697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb72c001e90 tx=0x7fb72c015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:34.934+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb73c0525c0 con 0x7fb730004010 2023-10-09T11:44:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.128+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7440cd1e0 con 0x7fb730004010 2023-10-09T11:44:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.129+0000 7fb73affd700 1 -- 172.21.15.26:0/772097284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fb73c055be0 con 0x7fb730004010 2023-10-09T11:44:35.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:35.131 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":186,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:29.345949+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000887794.meta","create_time":"2023-10-09T11:44:09.587778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000887794"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000887794.data","create_time":"2023-10-09T11:44:10.623231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000887794"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 msgr2=0x7fb7240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 0x7fb7240697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb72c001e90 tx=0x7fb72c015000 comp rx=0 tx=0).stop 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 msgr2=0x7fb7440c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb73c011f80 tx=0x7fb73c00b040 comp rx=0 tx=0).stop 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 shutdown_connections 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb724067320 0x7fb7240697d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7440b4990 0x7fb7440b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb730004010 0x7fb7440c8180 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 --2- 172.21.15.26:0/772097284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb74415ccf0 0x7fb7441560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 >> 172.21.15.26:0/772097284 conn(0x7fb744070e30 msgr2=0x7fb7440c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 shutdown_connections 2023-10-09T11:44:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.131+0000 7fb749576700 1 -- 172.21.15.26:0/772097284 wait complete. 2023-10-09T11:44:35.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000887794 2023-10-09T11:44:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.265+0000 7fa129445700 1 Processor -- start 2023-10-09T11:44:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 -- start start 2023-10-09T11:44:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 0x7fa1240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1240cde50 0x7fa124156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12415ae40 con 0x7fa1240cd9e0 2023-10-09T11:44:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1240d13f0 con 0x7fa1240cde50 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.266+0000 7fa129445700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12415ab60 con 0x7fa1240cb5a0 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa122ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 0x7fa1240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1240cde50 0x7fa124156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa122ffd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 0x7fa1240cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:41214/0 (socket says 172.21.15.26:41214) 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa122ffd700 1 -- 172.21.15.26:0/1517858568 learned_addr learned my addr 172.21.15.26:0/1517858568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1227fc700 1 --1- 172.21.15.26:0/1517858568 >> v1:172.21.15.67:6789/0 conn(0x7fa1240cd9e0 0x7fa124159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:58080/0 (socket says 172.21.15.26:58080) 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 -- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 msgr2=0x7fa1240cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 --2- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 0x7fa1240cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 -- 172.21.15.26:0/1517858568 >> v1:172.21.15.67:6789/0 conn(0x7fa1240cd9e0 legacy=0x7fa124159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 -- 172.21.15.26:0/1517858568 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240ccf00 con 0x7fa1240cde50 2023-10-09T11:44:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa1237fe700 1 --2- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cde50 0x7fa124156e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa114009e60 tx=0x7fa114009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bde57a6f5207b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa121ffb700 1 -- 172.21.15.26:0/1517858568 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400e070 con 0x7fa1240cde50 2023-10-09T11:44:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa121ffb700 1 -- 172.21.15.26:0/1517858568 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400bb60 con 0x7fa1240cde50 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.267+0000 7fa121ffb700 1 -- 172.21.15.26:0/1517858568 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114012430 con 0x7fa1240cde50 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 -- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cde50 msgr2=0x7fa124156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 --2- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cde50 0x7fa124156e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa114009e60 tx=0x7fa114009780 comp rx=0 tx=0).stop 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 -- 172.21.15.26:0/1517858568 shutdown_connections 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 --2- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cde50 0x7fa124156e90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 --2- 172.21.15.26:0/1517858568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cb5a0 0x7fa1240cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 -- 172.21.15.26:0/1517858568 >> 172.21.15.26:0/1517858568 conn(0x7fa124070e30 msgr2=0x7fa1240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 -- 172.21.15.26:0/1517858568 shutdown_connections 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.268+0000 7fa129445700 1 -- 172.21.15.26:0/1517858568 wait complete. 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.269+0000 7fa129445700 1 Processor -- start 2023-10-09T11:44:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.269+0000 7fa129445700 1 -- start start 2023-10-09T11:44:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cb5a0 0x7fa1240c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cd9e0 0x7fa124156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12415e490 con 0x7fa12415df90 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240c8370 con 0x7fa1240cb5a0 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa129445700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa124157da0 con 0x7fa1240cd9e0 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa1237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa1237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34390/0 (socket says 172.21.15.26:34390) 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa1237fe700 1 -- 172.21.15.26:0/3788329796 learned_addr learned my addr 172.21.15.26:0/3788329796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa122ffd700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cb5a0 0x7fa1240c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa1227fc700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cd9e0 0x7fa124156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.270+0000 7fa1237fe700 1 -- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cd9e0 msgr2=0x7fa124156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa1237fe700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cd9e0 0x7fa124156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa1237fe700 1 -- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cb5a0 msgr2=0x7fa1240c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa1237fe700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cb5a0 0x7fa1240c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa1237fe700 1 -- 172.21.15.26:0/3788329796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009a20 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa1237fe700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fa12406ea60 tx=0x7fa114019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114027470 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1140275f0 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa124158080 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1140279b0 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.271+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa124159890 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.272+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa124158270 con 0x7fa12415df90 2023-10-09T11:44:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.272+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa114024070 con 0x7fa12415df90 2023-10-09T11:44:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.273+0000 7fa11affd700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 0x7fa1040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.273+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fa1140876f0 con 0x7fa12415df90 2023-10-09T11:44:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.273+0000 7fa122ffd700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 0x7fa1040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.273+0000 7fa122ffd700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 0x7fa1040697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa11c006fd0 tx=0x7fa11c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.277+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa114054330 con 0x7fa12415df90 2023-10-09T11:44:35.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.518+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000887794"} v 0) v1 -- 0x7fa12404c3c0 con 0x7fa12415df90 2023-10-09T11:44:35.519 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:44:35.518+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:44:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.523+0000 7fa11affd700 1 -- 172.21.15.26:0/3788329796 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000887794"}]=0 volume_0000000000887794 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v124) v1 ==== 195+0+0 (secure 0 0 0) 0x7fa114057950 con 0x7fa12415df90 2023-10-09T11:44:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 msgr2=0x7fa1040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 0x7fa1040697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa11c006fd0 tx=0x7fa11c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 msgr2=0x7fa1240c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fa12406ea60 tx=0x7fa114019000 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 shutdown_connections 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa12415df90 0x7fa1240c9c10 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240cb5a0 0x7fa1240c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa104067320 0x7fa1040697d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 --2- 172.21.15.26:0/3788329796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa1240cd9e0 0x7fa124156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 >> 172.21.15.26:0/3788329796 conn(0x7fa124070e30 msgr2=0x7fa1240c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 shutdown_connections 2023-10-09T11:44:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.525+0000 7fa129445700 1 -- 172.21.15.26:0/3788329796 wait complete. 2023-10-09T11:44:35.528 INFO:tasks.ceph.mds.d.smithi067.stderr: -856> 2023-10-09T11:44:17.098+0000 7ff37a0a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:44:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:volume_0000000000887794 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:44:35.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000887794 --yes-i-really-mean-it 2023-10-09T11:44:35.549 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:44:35.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.658+0000 7f2a55975700 1 Processor -- start 2023-10-09T11:44:35.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.658+0000 7f2a55975700 1 -- start start 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a55975700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a50159860 0x7f2a500ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a55975700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500cbd90 0x7f2a500cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a55975700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500cf510 con 0x7f2a500ccfa0 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a55975700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500cc1e0 con 0x7f2a50159860 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a55975700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500ce900 con 0x7f2a500cbd90 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a4effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a50159860 0x7f2a500ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a4f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a500ccfa0 0x7f2a500cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45344/0 (socket says 172.21.15.26:45344) 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a4effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a50159860 0x7f2a500ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34396/0 (socket says 172.21.15.26:34396) 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.659+0000 7f2a4f7fe700 1 -- 172.21.15.26:0/1413117451 learned_addr learned my addr 172.21.15.26:0/1413117451 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4e7fc700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500cbd90 0x7f2a500cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4effd700 1 -- 172.21.15.26:0/1413117451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500cbd90 msgr2=0x7f2a500cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4effd700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500cbd90 0x7f2a500cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4effd700 1 -- 172.21.15.26:0/1413117451 >> v1:172.21.15.26:6789/0 conn(0x7f2a500ccfa0 legacy=0x7f2a500cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4dffb700 1 -- 172.21.15.26:0/1413117451 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596904981 0 0) 0x7f2a500cf510 con 0x7f2a500ccfa0 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4effd700 1 -- 172.21.15.26:0/1413117451 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500cebe0 con 0x7f2a50159860 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4effd700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a500ce220 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009eb0 tx=0x7f2a40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c110cfd56b0d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4dffb700 1 -- 172.21.15.26:0/1413117451 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000e070 con 0x7f2a50159860 2023-10-09T11:44:35.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4dffb700 1 -- 172.21.15.26:0/1413117451 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000bc30 con 0x7f2a50159860 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.660+0000 7f2a4dffb700 1 -- 172.21.15.26:0/1413117451 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40012430 con 0x7f2a50159860 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 -- 172.21.15.26:0/1413117451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 msgr2=0x7f2a500ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a500ce220 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009eb0 tx=0x7f2a40009780 comp rx=0 tx=0).stop 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 -- 172.21.15.26:0/1413117451 shutdown_connections 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a500ce220 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 --2- 172.21.15.26:0/1413117451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500cbd90 0x7f2a500cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 -- 172.21.15.26:0/1413117451 >> 172.21.15.26:0/1413117451 conn(0x7f2a500999b0 msgr2=0x7f2a50070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 -- 172.21.15.26:0/1413117451 shutdown_connections 2023-10-09T11:44:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.661+0000 7f2a55975700 1 -- 172.21.15.26:0/1413117451 wait complete. 2023-10-09T11:44:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.662+0000 7f2a55975700 1 Processor -- start 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.662+0000 7f2a55975700 1 -- start start 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a500cbd90 0x7f2a5016ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500ccfa0 0x7f2a5016e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5016fd70 con 0x7f2a50159860 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5016f160 con 0x7f2a500cbd90 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a55975700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5016f440 con 0x7f2a500ccfa0 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34404/0 (socket says 172.21.15.26:34404) 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 -- 172.21.15.26:0/3329932256 learned_addr learned my addr 172.21.15.26:0/3329932256 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4effd700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a500cbd90 0x7f2a5016ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4e7fc700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500ccfa0 0x7f2a5016e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 -- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500ccfa0 msgr2=0x7f2a5016e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500ccfa0 0x7f2a5016e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 -- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a500cbd90 msgr2=0x7f2a5016ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a500cbd90 0x7f2a5016ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 -- 172.21.15.26:0/3329932256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40009a20 con 0x7f2a50159860 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a4f7fe700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c7e0 tx=0x7f2a48007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.663+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48005c00 con 0x7f2a50159860 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.664+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48005d80 con 0x7f2a50159860 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.664+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5016f720 con 0x7f2a50159860 2023-10-09T11:44:35.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.664+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48007320 con 0x7f2a50159860 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.664+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5016d550 con 0x7f2a50159860 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.665+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5004c3c0 con 0x7f2a50159860 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.665+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2a4801b3b0 con 0x7f2a50159860 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.665+0000 7f2a46ffd700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 0x7f2a300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.665+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f2a48084150 con 0x7f2a50159860 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.666+0000 7f2a4effd700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 0x7f2a300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:35.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.666+0000 7f2a4effd700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 0x7f2a300697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009eb0 tx=0x7f2a40017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:35.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.670+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a48050d40 con 0x7f2a50159860 2023-10-09T11:44:35.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:35.909+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000887794", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a500ceec0 con 0x7f2a50159860 2023-10-09T11:44:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.524+0000 7f2a46ffd700 1 -- 172.21.15.26:0/3329932256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000887794", "yes_i_really_mean_it": true}]=0 v125) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2a480170c0 con 0x7f2a50159860 2023-10-09T11:44:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 msgr2=0x7f2a300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 0x7f2a300697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009eb0 tx=0x7f2a40017000 comp rx=0 tx=0).stop 2023-10-09T11:44:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 msgr2=0x7f2a5016d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c7e0 tx=0x7f2a48007d90 comp rx=0 tx=0).stop 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 shutdown_connections 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a50159860 0x7f2a5016d010 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a500cbd90 0x7f2a5016ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2a30067320 0x7f2a300697d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 --2- 172.21.15.26:0/3329932256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a500ccfa0 0x7f2a5016e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 >> 172.21.15.26:0/3329932256 conn(0x7f2a500999b0 msgr2=0x7f2a5006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 shutdown_connections 2023-10-09T11:44:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.526+0000 7f2a55975700 1 -- 172.21.15.26:0/3329932256 wait complete. 2023-10-09T11:44:36.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000887794.meta cephfs.volume_0000000000887794.meta --yes-i-really-really-mean-it 2023-10-09T11:44:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.664+0000 7f1719ae6700 1 Processor -- start 2023-10-09T11:44:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.664+0000 7f1719ae6700 1 -- start start 2023-10-09T11:44:36.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f1719ae6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f1719ae6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17140cd770 0x7f17141591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f1719ae6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17140cf330 con 0x7f17140b04f0 2023-10-09T11:44:36.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f1719ae6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140cdbd0 con 0x7f17140cd770 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f1719ae6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140cead0 con 0x7f17140cb880 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.665+0000 7f17137fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17140cd770 0x7f17141591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1712ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17140b04f0 0x7f17140cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:58092/0 (socket says 172.21.15.26:58092) 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1712ffd700 1 -- 172.21.15.26:0/3113319289 learned_addr learned my addr 172.21.15.26:0/3113319289 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f17137fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:41258/0 (socket says 172.21.15.26:41258) 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17140cd770 0x7f17141591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:50690/0 (socket says 172.21.15.26:50690) 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 -- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 msgr2=0x7f17140cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 -- 172.21.15.26:0/3113319289 >> v1:172.21.15.67:6789/0 conn(0x7f17140b04f0 legacy=0x7f17140cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 -- 172.21.15.26:0/3113319289 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140cddd0 con 0x7f17140cd770 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f17137fe700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:36.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f1713fff700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140cd770 0x7f17141591e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f170c009e60 tx=0x7f170c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4462f9e06dfbab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f17127fc700 1 -- 172.21.15.26:0/3113319289 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00e070 con 0x7f17140cd770 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f17127fc700 1 -- 172.21.15.26:0/3113319289 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00bb60 con 0x7f17140cd770 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.666+0000 7f17127fc700 1 -- 172.21.15.26:0/3113319289 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c012430 con 0x7f17140cd770 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 -- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140cd770 msgr2=0x7f17141591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140cd770 0x7f17141591e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f170c009e60 tx=0x7f170c009780 comp rx=0 tx=0).stop 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 -- 172.21.15.26:0/3113319289 shutdown_connections 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140cd770 0x7f17141591e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 --2- 172.21.15.26:0/3113319289 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cb880 0x7f17140cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 -- 172.21.15.26:0/3113319289 >> 172.21.15.26:0/3113319289 conn(0x7f17140703a0 msgr2=0x7f17140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 -- 172.21.15.26:0/3113319289 shutdown_connections 2023-10-09T11:44:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.667+0000 7f1719ae6700 1 -- 172.21.15.26:0/3113319289 wait complete. 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.668+0000 7f1719ae6700 1 Processor -- start 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.668+0000 7f1719ae6700 1 -- start start 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140b04f0 0x7f1714142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cd770 0x7f1714156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714142fe0 con 0x7f17140cb880 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171416a810 con 0x7f17140b04f0 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1719ae6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140c85c0 con 0x7f17140cd770 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34412/0 (socket says 172.21.15.26:34412) 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 -- 172.21.15.26:0/2944568627 learned_addr learned my addr 172.21.15.26:0/2944568627 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f17137fe700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140b04f0 0x7f1714142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1713fff700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cd770 0x7f1714156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 -- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cd770 msgr2=0x7f1714156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cd770 0x7f1714156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 -- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140b04f0 msgr2=0x7f1714142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140b04f0 0x7f1714142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 -- 172.21.15.26:0/2944568627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704009420 con 0x7f17140cb880 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.669+0000 7f1712ffd700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f170800c590 tx=0x7f1708007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.670+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708005b30 con 0x7f17140cb880 2023-10-09T11:44:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.670+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1708005cb0 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.670+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708007320 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.670+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c009a20 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.670+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171416a1c0 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.671+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171404c3c0 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.671+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f170801b3b0 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.671+0000 7f16fb7fe700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 0x7f17000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.672+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f1708083fb0 con 0x7f17140cb880 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.672+0000 7f17137fe700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 0x7f17000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.672+0000 7f17137fe700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 0x7f17000697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f17140c8810 tx=0x7f17040091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:36.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.676+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1708050ba0 con 0x7f17140cb880 2023-10-09T11:44:36.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:36.869+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000887794.meta", "pool2": "cephfs.volume_0000000000887794.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17140c7530 con 0x7f17140cb880 2023-10-09T11:44:37.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.533+0000 7f16fb7fe700 1 -- 172.21.15.26:0/2944568627 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000887794.meta", "pool2": "cephfs.volume_0000000000887794.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000887794.meta' removed v188) v1 ==== 241+0+0 (secure 0 0 0) 0x7f1708017020 con 0x7f17140cb880 2023-10-09T11:44:37.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 msgr2=0x7f17000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 0x7f17000697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f17140c8810 tx=0x7f17040091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 msgr2=0x7f1714155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f170800c590 tx=0x7f1708007f90 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 shutdown_connections 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1700067320 0x7f17000697d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17140cd770 0x7f1714156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140b04f0 0x7f1714142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 --2- 172.21.15.26:0/2944568627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17140cb880 0x7f1714155d20 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 >> 172.21.15.26:0/2944568627 conn(0x7f17140703a0 msgr2=0x7f17140b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 shutdown_connections 2023-10-09T11:44:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.535+0000 7f1719ae6700 1 -- 172.21.15.26:0/2944568627 wait complete. 2023-10-09T11:44:37.538 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs.volume_0000000000887794.meta' removed 2023-10-09T11:44:37.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000887794.data cephfs.volume_0000000000887794.data --yes-i-really-really-mean-it 2023-10-09T11:44:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.674+0000 7f088530b700 1 Processor -- start 2023-10-09T11:44:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.674+0000 7f088530b700 1 -- start start 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f088530b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0880067e50 0x7f088015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f088530b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0880068220 0x7f0880159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f088530b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088015d9f0 con 0x7f088015a300 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f088530b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088015d3c0 con 0x7f0880068220 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f088530b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088015a8f0 con 0x7f0880067e50 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0880068220 0x7f0880159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0880068220 0x7f0880159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34424/0 (socket says 172.21.15.26:34424) 2023-10-09T11:44:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 -- 172.21.15.26:0/4058498185 learned_addr learned my addr 172.21.15.26:0/4058498185 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087effd700 1 --2- 172.21.15.26:0/4058498185 >> v2:172.21.15.67:3300/0 conn(0x7f0880067e50 0x7f088015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 -- 172.21.15.26:0/4058498185 >> v2:172.21.15.67:3300/0 conn(0x7f0880067e50 msgr2=0x7f088015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 --2- 172.21.15.26:0/4058498185 >> v2:172.21.15.67:3300/0 conn(0x7f0880067e50 0x7f088015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 -- 172.21.15.26:0/4058498185 >> v1:172.21.15.67:6789/0 conn(0x7f088015a300 legacy=0x7f08800c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 -- 172.21.15.26:0/4058498185 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088015abd0 con 0x7f0880068220 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.675+0000 7f087e7fc700 1 --2- 172.21.15.26:0/4058498185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f0880159dc0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f0880067b60 tx=0x7f0868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef0fadd8209a6fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f087dffb700 1 -- 172.21.15.26:0/4058498185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800b820 con 0x7f0880068220 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f087dffb700 1 -- 172.21.15.26:0/4058498185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800b980 con 0x7f0880068220 2023-10-09T11:44:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f087dffb700 1 -- 172.21.15.26:0/4058498185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800bd20 con 0x7f0880068220 2023-10-09T11:44:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 -- 172.21.15.26:0/4058498185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 msgr2=0x7f0880159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 --2- 172.21.15.26:0/4058498185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f0880159dc0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f0880067b60 tx=0x7f0868009250 comp rx=0 tx=0).stop 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 -- 172.21.15.26:0/4058498185 shutdown_connections 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 --2- 172.21.15.26:0/4058498185 >> v2:172.21.15.67:3300/0 conn(0x7f0880067e50 0x7f088015de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 --2- 172.21.15.26:0/4058498185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f0880159dc0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 -- 172.21.15.26:0/4058498185 >> 172.21.15.26:0/4058498185 conn(0x7f08800ce4a0 msgr2=0x7f08800ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 -- 172.21.15.26:0/4058498185 shutdown_connections 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.676+0000 7f088530b700 1 -- 172.21.15.26:0/4058498185 wait complete. 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.677+0000 7f088530b700 1 Processor -- start 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.677+0000 7f088530b700 1 -- start start 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0880067e50 0x7f0880152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f088015a300 0x7f08800c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880154fa0 con 0x7f0880068220 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880154400 con 0x7f088015a300 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f088530b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0880154670 con 0x7f0880067e50 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f087e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f087e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34428/0 (socket says 172.21.15.26:34428) 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f087e7fc700 1 -- 172.21.15.26:0/3613058088 learned_addr learned my addr 172.21.15.26:0/3613058088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f087f7fe700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f088015a300 0x7f08800c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.678+0000 7f087effd700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0880067e50 0x7f0880152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 -- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0880067e50 msgr2=0x7f0880152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0880067e50 0x7f0880152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 -- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f088015a300 msgr2=0x7f08800c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f088015a300 0x7f08800c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 -- 172.21.15.26:0/3613058088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680094f0 con 0x7f0880068220 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f087e7fc700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f0868009290 tx=0x7f0868016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011cc0 con 0x7f0880068220 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868020070 con 0x7f0880068220 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086801b6a0 con 0x7f0880068220 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0880154950 con 0x7f0880068220 2023-10-09T11:44:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.679+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0880152850 con 0x7f0880068220 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.680+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088004c3c0 con 0x7f0880068220 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.680+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0868022030 con 0x7f0880068220 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.681+0000 7f0876ffd700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 0x7f08600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.681+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5394+0+0 (secure 0 0 0) 0x7f0868086750 con 0x7f0880068220 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.681+0000 7f087effd700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 0x7f08600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.682+0000 7f087effd700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 0x7f08600697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f087000f570 tx=0x7f0870007730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:37.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.685+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0868053620 con 0x7f0880068220 2023-10-09T11:44:37.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:37.879+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000887794.data", "pool2": "cephfs.volume_0000000000887794.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f088004c3c0 con 0x7f0880068220 2023-10-09T11:44:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.535+0000 7f0876ffd700 1 -- 172.21.15.26:0/3613058088 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000887794.data", "pool2": "cephfs.volume_0000000000887794.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000887794.data' removed v189) v1 ==== 241+0+0 (secure 0 0 0) 0x7f0868056c40 con 0x7f0880068220 2023-10-09T11:44:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 msgr2=0x7f08600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 0x7f08600697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f087000f570 tx=0x7f0870007730 comp rx=0 tx=0).stop 2023-10-09T11:44:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 msgr2=0x7f08800c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f0868009290 tx=0x7f0868016000 comp rx=0 tx=0).stop 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 shutdown_connections 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f088015a300 0x7f08800c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0860067320 0x7f08600697d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0880067e50 0x7f0880152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 --2- 172.21.15.26:0/3613058088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0880068220 0x7f08800c4510 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 >> 172.21.15.26:0/3613058088 conn(0x7f08800ce4a0 msgr2=0x7f08801598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 shutdown_connections 2023-10-09T11:44:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.540+0000 7f088530b700 1 -- 172.21.15.26:0/3613058088 wait complete. 2023-10-09T11:44:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs.volume_0000000000887794.data' removed 2023-10-09T11:44:38.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:44:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.683+0000 7f44bd66e700 1 Processor -- start 2023-10-09T11:44:38.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.683+0000 7f44bd66e700 1 -- start start 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44bd66e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44b8159970 0x7f44b80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44bd66e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b80c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44bd66e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b8068350 con 0x7f44b80cbbc0 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44bd66e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b8067740 con 0x7f44b8159970 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44bd66e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8067a20 con 0x7f44b80c9ab0 2023-10-09T11:44:38.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44b8159970 0x7f44b80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44b8159970 0x7f44b80686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34440/0 (socket says 172.21.15.26:34440) 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44b6ffd700 1 -- 172.21.15.26:0/824645348 learned_addr learned my addr 172.21.15.26:0/824645348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.684+0000 7f44b77fe700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b80c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b6ffd700 1 -- 172.21.15.26:0/824645348 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 msgr2=0x7f44b80c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b6ffd700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b80c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b6ffd700 1 -- 172.21.15.26:0/824645348 >> v1:172.21.15.67:6789/0 conn(0x7f44b80cbbc0 legacy=0x7f44b80c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b6ffd700 1 -- 172.21.15.26:0/824645348 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8067d00 con 0x7f44b8159970 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b6ffd700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b8159970 0x7f44b80686a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f44b00099b0 tx=0x7f44b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c835a9f5557eddac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b5ffb700 1 -- 172.21.15.26:0/824645348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000b860 con 0x7f44b8159970 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b5ffb700 1 -- 172.21.15.26:0/824645348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000b9c0 con 0x7f44b8159970 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44b5ffb700 1 -- 172.21.15.26:0/824645348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000bd60 con 0x7f44b8159970 2023-10-09T11:44:38.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 -- 172.21.15.26:0/824645348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b8159970 msgr2=0x7f44b80686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b8159970 0x7f44b80686a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f44b00099b0 tx=0x7f44b0009250 comp rx=0 tx=0).stop 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 -- 172.21.15.26:0/824645348 shutdown_connections 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b80c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 --2- 172.21.15.26:0/824645348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b8159970 0x7f44b80686a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 -- 172.21.15.26:0/824645348 >> 172.21.15.26:0/824645348 conn(0x7f44b806e250 msgr2=0x7f44b80cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.685+0000 7f44bd66e700 1 -- 172.21.15.26:0/824645348 shutdown_connections 2023-10-09T11:44:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.686+0000 7f44bd66e700 1 -- 172.21.15.26:0/824645348 wait complete. 2023-10-09T11:44:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.687+0000 7f44bd66e700 1 Processor -- start 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.687+0000 7f44bd66e700 1 -- start start 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.687+0000 7f44bd66e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.687+0000 7f44bd66e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 0x7f44b80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b3370 con 0x7f44b80cbbc0 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8169c30 con 0x7f44b8159970 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b816a490 con 0x7f44b80c9ab0 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34444/0 (socket says 172.21.15.26:34444) 2023-10-09T11:44:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 -- 172.21.15.26:0/2874499998 learned_addr learned my addr 172.21.15.26:0/2874499998 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b6ffd700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b77fe700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 0x7f44b80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 -- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 msgr2=0x7f44b8152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b8152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 -- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 msgr2=0x7f44b80b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 0x7f44b80b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 -- 172.21.15.26:0/2874499998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00094f0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b77fe700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 0x7f44b80b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44b67fc700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c7c0 tx=0x7f44a0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011590 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0011710 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80b3090 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011ad0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.688+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b8153160 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.689+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b804c3c0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.690+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f44a001b3b0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.690+0000 7f44aeffd700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 0x7f44980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.690+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f44a0083da0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.691+0000 7f44b6ffd700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 0x7f44980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.691+0000 7f44b6ffd700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 0x7f44980697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44b00099b0 tx=0x7f44b0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.695+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44a0050d30 con 0x7f44b80cbbc0 2023-10-09T11:44:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.891+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f44b816a5d0 con 0x7f44b80cbbc0 2023-10-09T11:44:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.894+0000 7f44aeffd700 1 -- 172.21.15.26:0/2874499998 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44a0017020 con 0x7f44b80cbbc0 2023-10-09T11:44:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 msgr2=0x7f44980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 0x7f44980697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44b00099b0 tx=0x7f44b0017000 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 msgr2=0x7f44b80b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c7c0 tx=0x7f44a0007f50 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 shutdown_connections 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44b8159970 0x7f44b80b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4498067320 0x7f44980697d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44b80c9ab0 0x7f44b8152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 --2- 172.21.15.26:0/2874499998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44b80cbbc0 0x7f44b80b2540 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 >> 172.21.15.26:0/2874499998 conn(0x7f44b806e250 msgr2=0x7f44b80cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 shutdown_connections 2023-10-09T11:44:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:38.897+0000 7f44bd66e700 1 -- 172.21.15.26:0/2874499998 wait complete. 2023-10-09T11:44:38.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-09T11:44:39.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.028+0000 7f509a1ee700 1 Processor -- start 2023-10-09T11:44:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 -- start start 2023-10-09T11:44:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50940ccac0 0x7f50940cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50940cbe30 0x7f50940a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940cb460 con 0x7f509406c8f0 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940cb180 con 0x7f50940cbe30 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f509a1ee700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509415db00 con 0x7f50940ccac0 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.029+0000 7f50999ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50940cbe30 0x7f50940a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50940cbe30 0x7f50940a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34454/0 (socket says 172.21.15.26:34454) 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 -- 172.21.15.26:0/2760711619 learned_addr learned my addr 172.21.15.26:0/2760711619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50989eb700 1 --2- 172.21.15.26:0/2760711619 >> v2:172.21.15.67:3300/0 conn(0x7f50940ccac0 0x7f50940cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 -- 172.21.15.26:0/2760711619 >> v2:172.21.15.67:3300/0 conn(0x7f50940ccac0 msgr2=0x7f50940cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 --2- 172.21.15.26:0/2760711619 >> v2:172.21.15.67:3300/0 conn(0x7f50940ccac0 0x7f50940cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 -- 172.21.15.26:0/2760711619 >> v1:172.21.15.67:6789/0 conn(0x7f509406c8f0 legacy=0x7f509415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 -- 172.21.15.26:0/2760711619 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509415dde0 con 0x7f50940cbe30 2023-10-09T11:44:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f50999ed700 1 --2- 172.21.15.26:0/2760711619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940cbe30 0x7f50940a98f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f50940cdc80 tx=0x7f5084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7dd0885217e7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f5093fff700 1 -- 172.21.15.26:0/2760711619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400e070 con 0x7f50940cbe30 2023-10-09T11:44:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f5093fff700 1 -- 172.21.15.26:0/2760711619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400ba50 con 0x7f50940cbe30 2023-10-09T11:44:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.030+0000 7f5093fff700 1 -- 172.21.15.26:0/2760711619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840092e0 con 0x7f50940cbe30 2023-10-09T11:44:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 -- 172.21.15.26:0/2760711619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940cbe30 msgr2=0x7f50940a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 --2- 172.21.15.26:0/2760711619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940cbe30 0x7f50940a98f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f50940cdc80 tx=0x7f5084009840 comp rx=0 tx=0).stop 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 -- 172.21.15.26:0/2760711619 shutdown_connections 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 --2- 172.21.15.26:0/2760711619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940cbe30 0x7f50940a98f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 --2- 172.21.15.26:0/2760711619 >> v2:172.21.15.67:3300/0 conn(0x7f50940ccac0 0x7f50940cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 -- 172.21.15.26:0/2760711619 >> 172.21.15.26:0/2760711619 conn(0x7f509406e280 msgr2=0x7f50940cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 -- 172.21.15.26:0/2760711619 shutdown_connections 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.031+0000 7f509a1ee700 1 -- 172.21.15.26:0/2760711619 wait complete. 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.032+0000 7f509a1ee700 1 Processor -- start 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.032+0000 7f509a1ee700 1 -- start start 2023-10-09T11:44:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 0x7f509416a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 0x7f50940ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509416abd0 con 0x7f50940ccac0 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940b1750 con 0x7f509406c8f0 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f509a1ee700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940b25b0 con 0x7f50940cbe30 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34456/0 (socket says 172.21.15.26:34456) 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 -- 172.21.15.26:0/204549652 learned_addr learned my addr 172.21.15.26:0/204549652 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 -- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 msgr2=0x7f50940ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50989eb700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 0x7f50940ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50991ec700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 0x7f509416a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 0x7f50940ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 -- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 msgr2=0x7f509416a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 0x7f509416a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 -- 172.21.15.26:0/204549652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009ae0 con 0x7f50940ccac0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50989eb700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 0x7f50940ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50991ec700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 0x7f509416a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.033+0000 7f50999ed700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f509406a6e0 tx=0x7f5084018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.034+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084008e80 con 0x7f50940ccac0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.034+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400be60 con 0x7f50940ccac0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.034+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50940b19a0 con 0x7f50940ccac0 2023-10-09T11:44:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.034+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084026690 con 0x7f50940ccac0 2023-10-09T11:44:39.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.034+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50940b1f60 con 0x7f50940ccac0 2023-10-09T11:44:39.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.035+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50940b2760 con 0x7f50940ccac0 2023-10-09T11:44:39.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.035+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5084003040 con 0x7f50940ccac0 2023-10-09T11:44:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.035+0000 7f50917fa700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 0x7f50800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.036+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5084086550 con 0x7f50940ccac0 2023-10-09T11:44:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.036+0000 7f50991ec700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 0x7f50800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.036+0000 7f50991ec700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 0x7f50800697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f508c001840 tx=0x7f508c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.040+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50840533d0 con 0x7f50940ccac0 2023-10-09T11:44:39.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.312+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f509404c3c0 con 0x7f50940ccac0 2023-10-09T11:44:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.536+0000 7f50917fa700 1 -- 172.21.15.26:0/204549652 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v478) v1 ==== 147+0+0 (secure 0 0 0) 0x7f5084009940 con 0x7f50940ccac0 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 msgr2=0x7f50800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 0x7f50800697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f508c001840 tx=0x7f508c009040 comp rx=0 tx=0).stop 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 msgr2=0x7f509414c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f509406a6e0 tx=0x7f5084018000 comp rx=0 tx=0).stop 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 shutdown_connections 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50940ccac0 0x7f509414c270 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509406c8f0 0x7f509416a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5080067320 0x7f50800697d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 --2- 172.21.15.26:0/204549652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50940cbe30 0x7f50940ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 >> 172.21.15.26:0/204549652 conn(0x7f509406e280 msgr2=0x7f509406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 shutdown_connections 2023-10-09T11:44:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.538+0000 7f509a1ee700 1 -- 172.21.15.26:0/204549652 wait complete. 2023-10-09T11:44:39.552 INFO:tasks.cephfs_test_runner:That volume rename is idempotent. ... ok 2023-10-09T11:44:39.552 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T11:44:39.552 INFO:tasks.cephfs_test_runner:test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:44:39.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-09T11:44:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.671+0000 7f8f0d893700 1 Processor -- start 2023-10-09T11:44:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.671+0000 7f8f0d893700 1 -- start start 2023-10-09T11:44:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f0d893700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f080cb970 0x7f8f08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f0d893700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f0815a400 0x7f8f08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f0d893700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0815ae40 con 0x7f8f080cb5a0 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f0d893700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080ce0f0 con 0x7f8f080cb970 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f0d893700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080d13f0 con 0x7f8f0815a400 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f080cb970 0x7f8f08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f080cb970 0x7f8f08159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55496/0 (socket says 172.21.15.26:55496) 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 -- 172.21.15.26:0/2457539957 learned_addr learned my addr 172.21.15.26:0/2457539957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f077fe700 1 --2- 172.21.15.26:0/2457539957 >> v2:172.21.15.67:3300/0 conn(0x7f8f0815a400 0x7f8f08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 -- 172.21.15.26:0/2457539957 >> v2:172.21.15.67:3300/0 conn(0x7f8f0815a400 msgr2=0x7f8f08156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 --2- 172.21.15.26:0/2457539957 >> v2:172.21.15.67:3300/0 conn(0x7f8f0815a400 0x7f8f08156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 -- 172.21.15.26:0/2457539957 >> v1:172.21.15.67:6789/0 conn(0x7f8f080cb5a0 legacy=0x7f8f080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 -- 172.21.15.26:0/2457539957 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0815ab60 con 0x7f8f080cb970 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f067fc700 1 --2- 172.21.15.26:0/2457539957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb970 0x7f8f08159ec0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ccdf0 tx=0x7f8ef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffff72a4b7856b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.672+0000 7f8f05ffb700 1 -- 172.21.15.26:0/2457539957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000b860 con 0x7f8f080cb970 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f05ffb700 1 -- 172.21.15.26:0/2457539957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000b9c0 con 0x7f8f080cb970 2023-10-09T11:44:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f05ffb700 1 -- 172.21.15.26:0/2457539957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000bd60 con 0x7f8f080cb970 2023-10-09T11:44:39.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 -- 172.21.15.26:0/2457539957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb970 msgr2=0x7f8f08159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 --2- 172.21.15.26:0/2457539957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb970 0x7f8f08159ec0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ccdf0 tx=0x7f8ef0009250 comp rx=0 tx=0).stop 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 -- 172.21.15.26:0/2457539957 shutdown_connections 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 --2- 172.21.15.26:0/2457539957 >> v2:172.21.15.67:3300/0 conn(0x7f8f0815a400 0x7f8f08156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 --2- 172.21.15.26:0/2457539957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb970 0x7f8f08159ec0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 -- 172.21.15.26:0/2457539957 >> 172.21.15.26:0/2457539957 conn(0x7f8f08070e30 msgr2=0x7f8f080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 -- 172.21.15.26:0/2457539957 shutdown_connections 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.673+0000 7f8f0d893700 1 -- 172.21.15.26:0/2457539957 wait complete. 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.674+0000 7f8f0d893700 1 Processor -- start 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.674+0000 7f8f0d893700 1 -- start start 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 0x7f8f080b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 0x7f8f080b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b3ba0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ca7e0 con 0x7f8f080cb970 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f0d893700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ca500 con 0x7f8f0815a400 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55502/0 (socket says 172.21.15.26:55502) 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 -- 172.21.15.26:0/1084355683 learned_addr learned my addr 172.21.15.26:0/1084355683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f077fe700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 0x7f8f080b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f067fc700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 0x7f8f080b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 -- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 msgr2=0x7f8f080b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 0x7f8f080b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 -- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 msgr2=0x7f8f080b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 0x7f8f080b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f06ffd700 1 -- 172.21.15.26:0/1084355683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00094f0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.675+0000 7f8f067fc700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 0x7f8f080b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8f077fe700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 0x7f8f080b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8f06ffd700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c590 tx=0x7f8ef800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011590 con 0x7f8f080cb5a0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef80116f0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f080b3550 con 0x7f8f080cb5a0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011ab0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.676+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08151660 con 0x7f8f080cb5a0 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.677+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08151850 con 0x7f8f080cb5a0 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.677+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8ef801b3b0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.678+0000 7f8efeffd700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 0x7f8ee80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.678+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8ef8083fb0 con 0x7f8f080cb5a0 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.678+0000 7f8f067fc700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 0x7f8ee80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.679+0000 7f8f067fc700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 0x7f8ee80697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ccdf0 tx=0x7f8ef0017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:39.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.682+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef8050f40 con 0x7f8f080cb5a0 2023-10-09T11:44:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:39.959+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f8f0804c3c0 con 0x7f8f080cb5a0 2023-10-09T11:44:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.538+0000 7f8efeffd700 1 -- 172.21.15.26:0/1084355683 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v479) v1 ==== 134+0+0 (secure 0 0 0) 0x7f8ef8017020 con 0x7f8f080cb5a0 2023-10-09T11:44:40.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 msgr2=0x7f8ee80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 0x7f8ee80697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ccdf0 tx=0x7f8ef0017000 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 msgr2=0x7f8f08151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c590 tx=0x7f8ef800c950 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 shutdown_connections 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8ee8067320 0x7f8ee80697d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f0815a400 0x7f8f080b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f080cb5a0 0x7f8f08151120 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 --2- 172.21.15.26:0/1084355683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f080cb970 0x7f8f080b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 >> 172.21.15.26:0/1084355683 conn(0x7f8f08070e30 msgr2=0x7f8f080cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:40.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 shutdown_connections 2023-10-09T11:44:40.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.540+0000 7f8f0d893700 1 -- 172.21.15.26:0/1084355683 wait complete. 2023-10-09T11:44:40.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:44:40.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.683+0000 7efe26592700 1 Processor -- start 2023-10-09T11:44:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.683+0000 7efe26592700 1 -- start start 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe26592700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe20159860 0x7efe200ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe26592700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe200cbd90 0x7efe200cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe26592700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe200cf510 con 0x7efe200ccfa0 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe26592700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200cc1e0 con 0x7efe200cbd90 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe26592700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200ce900 con 0x7efe20159860 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe1f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe200cbd90 0x7efe200cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe24b2f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe200ccfa0 0x7efe200cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39746/0 (socket says 172.21.15.26:39746) 2023-10-09T11:44:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe24b2f700 1 -- 172.21.15.26:0/1496088544 learned_addr learned my addr 172.21.15.26:0/1496088544 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.684+0000 7efe1ffff700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe20159860 0x7efe200ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1f7fe700 1 -- 172.21.15.26:0/1496088544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe20159860 msgr2=0x7efe200ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1f7fe700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe20159860 0x7efe200ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1f7fe700 1 -- 172.21.15.26:0/1496088544 >> v1:172.21.15.26:6789/0 conn(0x7efe200ccfa0 legacy=0x7efe200cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1f7fe700 1 -- 172.21.15.26:0/1496088544 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200cebe0 con 0x7efe200cbd90 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1effd700 1 -- 172.21.15.26:0/1496088544 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154242960 0 0) 0x7efe200cf510 con 0x7efe200ccfa0 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1f7fe700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe200cbd90 0x7efe200cf9a0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7efe140098d0 tx=0x7efe14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d829fb09f79c1d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1effd700 1 -- 172.21.15.26:0/1496088544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14009e70 con 0x7efe200cbd90 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1effd700 1 -- 172.21.15.26:0/1496088544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14005c10 con 0x7efe200cbd90 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe1effd700 1 -- 172.21.15.26:0/1496088544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400b650 con 0x7efe200cbd90 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe26592700 1 -- 172.21.15.26:0/1496088544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe200cbd90 msgr2=0x7efe200cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.685+0000 7efe26592700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe200cbd90 0x7efe200cf9a0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7efe140098d0 tx=0x7efe14009120 comp rx=0 tx=0).stop 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 -- 172.21.15.26:0/1496088544 shutdown_connections 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe20159860 0x7efe200ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 --2- 172.21.15.26:0/1496088544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe200cbd90 0x7efe200cf9a0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 -- 172.21.15.26:0/1496088544 >> 172.21.15.26:0/1496088544 conn(0x7efe200999b0 msgr2=0x7efe20070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 -- 172.21.15.26:0/1496088544 shutdown_connections 2023-10-09T11:44:40.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.686+0000 7efe26592700 1 -- 172.21.15.26:0/1496088544 wait complete. 2023-10-09T11:44:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.687+0000 7efe26592700 1 Processor -- start 2023-10-09T11:44:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.687+0000 7efe26592700 1 -- start start 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 0x7efe2009c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 0x7efe201579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2009be40 con 0x7efe20159860 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2009b230 con 0x7efe200ccfa0 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2009b510 con 0x7efe200cbd90 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55518/0 (socket says 172.21.15.26:55518) 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 -- 172.21.15.26:0/2120292889 learned_addr learned my addr 172.21.15.26:0/2120292889 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe1ffff700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 0x7efe2009c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe1f7fe700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 0x7efe201579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 -- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 msgr2=0x7efe2009c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 0x7efe2009c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 -- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 msgr2=0x7efe201579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 0x7efe201579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 -- 172.21.15.26:0/2120292889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140093c0 con 0x7efe20159860 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe1f7fe700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 0x7efe201579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe1ffff700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 0x7efe2009c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe24b2f700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7efe1800cc90 tx=0x7efe18001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800cea0 con 0x7efe20159860 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800ab70 con 0x7efe20159860 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2009b7f0 con 0x7efe20159860 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180070f0 con 0x7efe20159860 2023-10-09T11:44:40.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.688+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe20157f00 con 0x7efe20159860 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.689+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2004c3c0 con 0x7efe20159860 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.690+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efe180074a0 con 0x7efe20159860 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.690+0000 7efe07fff700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 0x7efe0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.690+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efe18084e90 con 0x7efe20159860 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.690+0000 7efe1ffff700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 0x7efe0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:40.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.691+0000 7efe1ffff700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 0x7efe0c0697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efe10005fd0 tx=0x7efe10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:40.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.695+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe18051e60 con 0x7efe20159860 2023-10-09T11:44:40.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.886+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe200ceec0 con 0x7efe20159860 2023-10-09T11:44:40.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.890+0000 7efe07fff700 1 -- 172.21.15.26:0/2120292889 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe18055480 con 0x7efe20159860 2023-10-09T11:44:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 msgr2=0x7efe0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 0x7efe0c0697d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efe10005fd0 tx=0x7efe10008040 comp rx=0 tx=0).stop 2023-10-09T11:44:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 msgr2=0x7efe2009ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7efe1800cc90 tx=0x7efe18001a80 comp rx=0 tx=0).stop 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 shutdown_connections 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe20159860 0x7efe2009ccc0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe0c067320 0x7efe0c0697d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe200cbd90 0x7efe2009c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 --2- 172.21.15.26:0/2120292889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe200ccfa0 0x7efe201579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 >> 172.21.15.26:0/2120292889 conn(0x7efe200999b0 msgr2=0x7efe2015bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 shutdown_connections 2023-10-09T11:44:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:40.892+0000 7efe26592700 1 -- 172.21.15.26:0/2120292889 wait complete. 2023-10-09T11:44:40.905 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:44:40.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:40.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:44:40.989 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:44:40.990 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:44:40.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.108+0000 7f653f9bb700 1 Processor -- start 2023-10-09T11:44:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.108+0000 7f653f9bb700 1 -- start start 2023-10-09T11:44:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653f9bb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 0x7f65380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653f9bb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65380cd9e0 0x7f6538159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653f9bb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653815ae40 con 0x7f65380cde50 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653f9bb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380d13f0 con 0x7f65380cd9e0 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653f9bb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653815ab60 con 0x7f65380cb5a0 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65380cd9e0 0x7f6538159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653df58700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f65380cde50 0x7f6538156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39750/0 (socket says 172.21.15.26:39750) 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653df58700 1 -- 172.21.15.26:0/2437950229 learned_addr learned my addr 172.21.15.26:0/2437950229 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653d757700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 0x7f65380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 -- 172.21.15.26:0/2437950229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 msgr2=0x7f65380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 0x7f65380cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 -- 172.21.15.26:0/2437950229 >> v1:172.21.15.26:6789/0 conn(0x7f65380cde50 legacy=0x7f6538156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 -- 172.21.15.26:0/2437950229 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380ccf00 con 0x7f65380cd9e0 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653d757700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 0x7f65380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f653cf56700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65380cd9e0 0x7f6538159ec0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f652c0098e0 tx=0x7f652c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de7c2d69db36c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.109+0000 7f6537fff700 1 -- 172.21.15.26:0/2437950229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c009e80 con 0x7f65380cd9e0 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f6537fff700 1 -- 172.21.15.26:0/2437950229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00b860 con 0x7f65380cd9e0 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f6537fff700 1 -- 172.21.15.26:0/2437950229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00bbe0 con 0x7f65380cd9e0 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 -- 172.21.15.26:0/2437950229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65380cd9e0 msgr2=0x7f6538159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65380cd9e0 0x7f6538159ec0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f652c0098e0 tx=0x7f652c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 -- 172.21.15.26:0/2437950229 shutdown_connections 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cb5a0 0x7f65380cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 --2- 172.21.15.26:0/2437950229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65380cd9e0 0x7f6538159ec0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 -- 172.21.15.26:0/2437950229 >> 172.21.15.26:0/2437950229 conn(0x7f6538070e30 msgr2=0x7f65380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 -- 172.21.15.26:0/2437950229 shutdown_connections 2023-10-09T11:44:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.110+0000 7f653f9bb700 1 -- 172.21.15.26:0/2437950229 wait complete. 2023-10-09T11:44:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.111+0000 7f653f9bb700 1 Processor -- start 2023-10-09T11:44:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.111+0000 7f653f9bb700 1 -- start start 2023-10-09T11:44:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 0x7f65380c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cd9e0 0x7f6538156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c8c60 con 0x7f653816a3f0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653816aa90 con 0x7f65380cb5a0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653f9bb700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c83c0 con 0x7f65380cd9e0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653df58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653df58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55536/0 (socket says 172.21.15.26:55536) 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653df58700 1 -- 172.21.15.26:0/1648815179 learned_addr learned my addr 172.21.15.26:0/1648815179 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653cf56700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cd9e0 0x7f6538156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.112+0000 7f653d757700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 0x7f65380c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 -- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cd9e0 msgr2=0x7f6538156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cd9e0 0x7f6538156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 -- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 msgr2=0x7f65380c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 0x7f65380c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 -- 172.21.15.26:0/1648815179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c009420 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653d757700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 0x7f65380c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653df58700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f653000c560 tx=0x7f6530007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530005b30 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530005c90 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65380c86a0 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300072e0 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.113+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65380c80d0 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.114+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653804c3c0 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.114+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6530007690 con 0x7f653816a3f0 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.115+0000 7f65357fa700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 0x7f65240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.115+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6530083cd0 con 0x7f653816a3f0 2023-10-09T11:44:41.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.115+0000 7f653d757700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 0x7f65240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.116+0000 7f653d757700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 0x7f65240697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f65380cf5b0 tx=0x7f6528007690 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.119+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f653004b5a0 con 0x7f653816a3f0 2023-10-09T11:44:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.356+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65380cd1e0 con 0x7f653816a3f0 2023-10-09T11:44:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.357+0000 7f65357fa700 1 -- 172.21.15.26:0/1648815179 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+3525 (secure 0 0 0) 0x7f6530017020 con 0x7f653816a3f0 2023-10-09T11:44:41.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:41.358 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":125,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/87137832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":87137832},{"type":"v1","addr":"172.21.15.67:6836","nonce":87137832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/481363397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":481363397},{"type":"v1","addr":"172.21.15.26:6834","nonce":481363397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3927256686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3927256686},{"type":"v1","addr":"172.21.15.26:6835","nonce":3927256686}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":8721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3730234717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3730234717},{"type":"v1","addr":"172.21.15.67:6837","nonce":3730234717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[]} 2023-10-09T11:44:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 msgr2=0x7f65240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 0x7f65240697d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f65380cf5b0 tx=0x7f6528007690 comp rx=0 tx=0).stop 2023-10-09T11:44:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 msgr2=0x7f65380b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f653000c560 tx=0x7f6530007f60 comp rx=0 tx=0).stop 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 shutdown_connections 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f653816a3f0 0x7f65380b4480 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65380cb5a0 0x7f65380c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6524067320 0x7f65240697d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 --2- 172.21.15.26:0/1648815179 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65380cd9e0 0x7f6538156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 >> 172.21.15.26:0/1648815179 conn(0x7f6538070e30 msgr2=0x7f65380c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 shutdown_connections 2023-10-09T11:44:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.359+0000 7f653f9bb700 1 -- 172.21.15.26:0/1648815179 wait complete. 2023-10-09T11:44:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 125 2023-10-09T11:44:41.372 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:44:41.372 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:44:41.373 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:44:41.373 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:41.373 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:44:41.373 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:44:41.373 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:44:41.373 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:41.374 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:44:41.374 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:44:41.374 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:44:41.374 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:41.374 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:44:41.374 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:44:41.374 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:44:41.375 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:44:41.381 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:44:41.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:44:41.382 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:44:41.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:44:41.385 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:44:41.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:44:41.386 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:44:41.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:44:41.424 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:44:41.424 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:41.425 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:44:41.425 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:41.428 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:44:41.428 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:41.429 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:44:41.429 DEBUG:teuthology.parallel:result is None 2023-10-09T11:44:41.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:44:41.499 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-10-09T11:44:41.500 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-09T11:44:41.514 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2023-10-09T11:44:41.514 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:44:41.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.555+0000 7f02c4296700 1 Processor -- start 2023-10-09T11:44:41.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.555+0000 7f02c4296700 1 -- start start 2023-10-09T11:44:41.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c4296700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 0x7f02bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c4296700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c4296700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc15ae40 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c4296700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0ce0f0 con 0x7f02bc0cb970 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c4296700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d13f0 con 0x7f02bc15a400 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c2833700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c1831700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 0x7f02bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c2032700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f02bc0cb5a0 0x7f02bc0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:34100/0 (socket says 172.21.15.26:34100) 2023-10-09T11:44:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.556+0000 7f02c2032700 1 -- 172.21.15.26:0/3503532037 learned_addr learned my addr 172.21.15.26:0/3503532037 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c2833700 1 -- 172.21.15.26:0/3503532037 >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 msgr2=0x7f02bc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c2833700 1 --2- 172.21.15.26:0/3503532037 >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 0x7f02bc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c2833700 1 -- 172.21.15.26:0/3503532037 >> v1:172.21.15.67:6789/0 conn(0x7f02bc0cb5a0 legacy=0x7f02bc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c1030700 1 -- 172.21.15.26:0/3503532037 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488250526 0 0) 0x7f02bc15ae40 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c2833700 1 -- 172.21.15.26:0/3503532037 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc15ab60 con 0x7f02bc15a400 2023-10-09T11:44:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c1831700 1 --2- 172.21.15.26:0/3503532037 >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 0x7f02bc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c2833700 1 --2- 172.21.15.26:0/3503532037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc156e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009e60 tx=0x7f02ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a2cf20e10dd8bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c1030700 1 -- 172.21.15.26:0/3503532037 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00e070 con 0x7f02bc15a400 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c1030700 1 -- 172.21.15.26:0/3503532037 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac00bb60 con 0x7f02bc15a400 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.557+0000 7f02c1030700 1 -- 172.21.15.26:0/3503532037 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac012430 con 0x7f02bc15a400 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 -- 172.21.15.26:0/3503532037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 msgr2=0x7f02bc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 --2- 172.21.15.26:0/3503532037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc156e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009e60 tx=0x7f02ac009780 comp rx=0 tx=0).stop 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 -- 172.21.15.26:0/3503532037 shutdown_connections 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 --2- 172.21.15.26:0/3503532037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc156e90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 --2- 172.21.15.26:0/3503532037 >> v2:172.21.15.67:3300/0 conn(0x7f02bc0cb970 0x7f02bc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 -- 172.21.15.26:0/3503532037 >> 172.21.15.26:0/3503532037 conn(0x7f02bc070e30 msgr2=0x7f02bc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 -- 172.21.15.26:0/3503532037 shutdown_connections 2023-10-09T11:44:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.558+0000 7f02c4296700 1 -- 172.21.15.26:0/3503532037 wait complete. 2023-10-09T11:44:41.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.559+0000 7f02c4296700 1 Processor -- start 2023-10-09T11:44:41.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.559+0000 7f02c4296700 1 -- start start 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 0x7f02bc150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc151840 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0c8f40 con 0x7f02bc0cb970 2023-10-09T11:44:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c4296700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0c7a80 con 0x7f02bc15a400 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55574/0 (socket says 172.21.15.26:55574) 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 -- 172.21.15.26:0/2738861860 learned_addr learned my addr 172.21.15.26:0/2738861860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c1831700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 0x7f02bc150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2833700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 -- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 msgr2=0x7f02bc150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 -- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 msgr2=0x7f02bc150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 0x7f02bc150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 -- 172.21.15.26:0/2738861860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0009420 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c1831700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 0x7f02bc150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.560+0000 7f02c2032700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c840 tx=0x7f02b4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4005b30 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4005c90 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac009a20 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4007300 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc151560 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.561+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc04c3c0 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.562+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02b40076b0 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.562+0000 7f02ba7fc700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 0x7f02a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.562+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f02b4084510 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.562+0000 7f02c1831700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 0x7f02a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:41.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.563+0000 7f02c1831700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 0x7f02a80697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f02b00093f0 tx=0x7f02b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.567+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02b40514a0 con 0x7f02bc0cb5a0 2023-10-09T11:44:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:41.775+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02bc088310 con 0x7f02bc0cb5a0 2023-10-09T11:44:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.552+0000 7f02ba7fc700 1 -- 172.21.15.26:0/2738861860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v194) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02b4054ac0 con 0x7f02bc0cb5a0 2023-10-09T11:44:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 msgr2=0x7f02a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 0x7f02a80697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f02b00093f0 tx=0x7f02b0008040 comp rx=0 tx=0).stop 2023-10-09T11:44:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 msgr2=0x7f02bc14fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c840 tx=0x7f02b4007df0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 shutdown_connections 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f02a8067320 0x7f02a80697d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02bc15a400 0x7f02bc150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02bc0cb5a0 0x7f02bc14fe80 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 --2- 172.21.15.26:0/2738861860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02bc0cb970 0x7f02bc150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 >> 172.21.15.26:0/2738861860 conn(0x7f02bc070e30 msgr2=0x7f02bc0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 shutdown_connections 2023-10-09T11:44:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.555+0000 7f02c4296700 1 -- 172.21.15.26:0/2738861860 wait complete. 2023-10-09T11:44:42.558 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-10-09T11:44:42.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:44:42.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.693+0000 7f508448d700 1 Processor -- start 2023-10-09T11:44:42.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.693+0000 7f508448d700 1 -- start start 2023-10-09T11:44:42.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f508448d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f507c0cbe00 0x7f507c1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:42.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f508448d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0ce9d0 con 0x7f507c159c80 2023-10-09T11:44:42.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f508448d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0af960 con 0x7f507c1598b0 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f508448d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c0afc30 con 0x7f507c0cbe00 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f5082a2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f507c0cbe00 0x7f507c1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f5081a28700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f507c159c80 0x7f507c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39772/0 (socket says 172.21.15.26:39772) 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.694+0000 7f5081a28700 1 -- 172.21.15.26:0/3567347982 learned_addr learned my addr 172.21.15.26:0/3567347982 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5082a2a700 1 -- 172.21.15.26:0/3567347982 >> v1:172.21.15.67:6789/0 conn(0x7f507c1598b0 legacy=0x7f507c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5082a2a700 1 -- 172.21.15.26:0/3567347982 >> v1:172.21.15.26:6789/0 conn(0x7f507c159c80 legacy=0x7f507c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5082a2a700 1 -- 172.21.15.26:0/3567347982 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0aff10 con 0x7f507c0cbe00 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5082a2a700 1 --2- 172.21.15.26:0/3567347982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c0cbe00 0x7f507c1645a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f506c009e60 tx=0x7f506c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfdf88e2d9e4740 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5081227700 1 -- 172.21.15.26:0/3567347982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00e070 con 0x7f507c0cbe00 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5081227700 1 -- 172.21.15.26:0/3567347982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c00bbf0 con 0x7f507c0cbe00 2023-10-09T11:44:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.695+0000 7f5081227700 1 -- 172.21.15.26:0/3567347982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c012430 con 0x7f507c0cbe00 2023-10-09T11:44:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 -- 172.21.15.26:0/3567347982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c0cbe00 msgr2=0x7f507c1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 --2- 172.21.15.26:0/3567347982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c0cbe00 0x7f507c1645a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f506c009e60 tx=0x7f506c009780 comp rx=0 tx=0).stop 2023-10-09T11:44:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 -- 172.21.15.26:0/3567347982 shutdown_connections 2023-10-09T11:44:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 --2- 172.21.15.26:0/3567347982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c0cbe00 0x7f507c1645a0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 -- 172.21.15.26:0/3567347982 >> 172.21.15.26:0/3567347982 conn(0x7f507c070e30 msgr2=0x7f507c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 -- 172.21.15.26:0/3567347982 shutdown_connections 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.696+0000 7f508448d700 1 -- 172.21.15.26:0/3567347982 wait complete. 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.697+0000 7f508448d700 1 Processor -- start 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.697+0000 7f508448d700 1 -- start start 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f507c0cbe00 0x7f507c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 0x7f507c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c157990 con 0x7f507c159c80 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c15ca50 con 0x7f507c0cbe00 2023-10-09T11:44:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c15cd30 con 0x7f507c1598b0 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55586/0 (socket says 172.21.15.26:55586) 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 -- 172.21.15.26:0/641003053 learned_addr learned my addr 172.21.15.26:0/641003053 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082229700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f507c0cbe00 0x7f507c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5081a28700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 0x7f507c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 -- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 msgr2=0x7f507c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 0x7f507c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 -- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f507c0cbe00 msgr2=0x7f507c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f507c0cbe00 0x7f507c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 -- 172.21.15.26:0/641003053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009a20 con 0x7f507c159c80 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5081a28700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 0x7f507c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f5082a2a700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f507c06cd60 tx=0x7f506c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c01e640 con 0x7f507c159c80 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c01e7a0 con 0x7f507c159c80 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c157620 con 0x7f507c159c80 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c01eb60 con 0x7f507c159c80 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.698+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c1572d0 con 0x7f507c159c80 2023-10-09T11:44:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.699+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c157460 con 0x7f507c159c80 2023-10-09T11:44:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.700+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f506c024070 con 0x7f507c159c80 2023-10-09T11:44:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.700+0000 7f507a7fc700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 0x7f50680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.700+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f506c0872d0 con 0x7f507c159c80 2023-10-09T11:44:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.700+0000 7f5082229700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 0x7f50680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.701+0000 7f5082229700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 0x7f50680697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f507c0b5b20 tx=0x7f5074007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.705+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f506c0543b0 con 0x7f507c159c80 2023-10-09T11:44:42.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.976+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f507c04c3c0 con 0x7f507c159c80 2023-10-09T11:44:42.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.976+0000 7f507a7fc700 1 -- 172.21.15.26:0/641003053 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f506c0579d0 con 0x7f507c159c80 2023-10-09T11:44:42.977 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:42.977 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:44:42.977 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlweORKhAADf9wBWthJ6lwPgN7Yu+wXg==", 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.978 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlFu1oNhAAQgAmZ2rulzZz/ZXcX6g2iQ==", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-10-09T11:44:42.979 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlh/6NMRAA6m6qCFSzRU2E9g44ajeQrQ==", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlEPXvARAAbpt6Qn3mMxDrQjLr18Sx0g==", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.980 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBF5SNl6Y5EJBAAWDDRGXDkas6pmItDNXtm1g==", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.981 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBI5SNlhI7kIRAAede4U8HMP9avzyT5n1fxEw==", 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.982 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBL5SNlkQYfIBAAbR5O9Ge0xrQZeBIt5G4pWw==", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBO5SNlZkMQHhAAFmqzEU2CnMVtuXUduHLMWQ==", 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.983 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBU5SNlKeqRJhAAuixWUyJJoQrczp8EtMwSww==", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.984 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBX5SNlyHnxJBAAasU0SWAbOiJ8dC+L5ArsVg==", 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-10-09T11:44:42.985 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBa5SNlLMybIhAAOzsBGNoDOWpWjpzH+urDsg==", 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBd5SNlOEuaIBAAqj21Z7/i7S6YDUgmROf6lg==", 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.986 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlE57dBRAAnGFFZBz94UUb2PIyA9EGow==", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow r", 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlia9sDhAAhvboHPyik2tQNwBK81gB2A==", 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.988 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlPoJTCxAA8GfedXZsHmhHI72KHclZoA==", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBE5SNlI1DoExAAx5jTC6XQBFA+y9vZTFfXmQ==", 2023-10-09T11:44:42.989 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBC5SNlFGL5NhAAJhufFD30pNt/qmmPCjdImA==", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:42.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNlG1pVJxAAB3ei2y4HVIAHDIjEgOLEjw==", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.991 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQBD5SNl09QKIxAA8QoJBnc5hFOSpXREJJFVUQ==", 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-09T11:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 msgr2=0x7f50680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 0x7f50680697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f507c0b5b20 tx=0x7f5074007ea0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 msgr2=0x7f507c157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f507c06cd60 tx=0x7f506c018000 comp rx=0 tx=0).stop 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 shutdown_connections 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f507c159c80 0x7f507c157e20 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f507c0cbe00 0x7f507c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5068067320 0x7f50680697d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 --2- 172.21.15.26:0/641003053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f507c1598b0 0x7f507c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 >> 172.21.15.26:0/641003053 conn(0x7f507c070e30 msgr2=0x7f507c0d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 shutdown_connections 2023-10-09T11:44:42.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:42.978+0000 7f508448d700 1 -- 172.21.15.26:0/641003053 wait complete. 2023-10-09T11:44:42.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:43.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.113+0000 7f4625b5b700 1 Processor -- start 2023-10-09T11:44:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.113+0000 7f4625b5b700 1 -- start start 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f4625b5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462015de50 0x7f46200cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f4625b5b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46200cef40 0x7f462015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f4625b5b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46200cf3c0 con 0x7f4620153c30 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f4625b5b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462015afd0 con 0x7f462015de50 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f4625b5b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462015b2b0 con 0x7f46200cef40 2023-10-09T11:44:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462015de50 0x7f46200cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f462015de50 0x7f46200cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55598/0 (socket says 172.21.15.26:55598) 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 -- 172.21.15.26:0/495552255 learned_addr learned my addr 172.21.15.26:0/495552255 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f462535a700 1 --2- 172.21.15.26:0/495552255 >> v2:172.21.15.67:3300/0 conn(0x7f46200cef40 0x7f462015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 -- 172.21.15.26:0/495552255 >> v2:172.21.15.67:3300/0 conn(0x7f46200cef40 msgr2=0x7f462015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 --2- 172.21.15.26:0/495552255 >> v2:172.21.15.67:3300/0 conn(0x7f46200cef40 0x7f462015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 -- 172.21.15.26:0/495552255 >> v1:172.21.15.67:6789/0 conn(0x7f4620153c30 legacy=0x7f462015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.114+0000 7f461ffff700 1 -- 172.21.15.26:0/495552255 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462015b590 con 0x7f462015de50 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f461ffff700 1 --2- 172.21.15.26:0/495552255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462015de50 0x7f46200cea00 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f46200cdab0 tx=0x7f460c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd80150fd1fa663 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f461f7fe700 1 -- 172.21.15.26:0/495552255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00b860 con 0x7f462015de50 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f461f7fe700 1 -- 172.21.15.26:0/495552255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c00b9c0 con 0x7f462015de50 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f461f7fe700 1 -- 172.21.15.26:0/495552255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00bd60 con 0x7f462015de50 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 -- 172.21.15.26:0/495552255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462015de50 msgr2=0x7f46200cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 --2- 172.21.15.26:0/495552255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462015de50 0x7f46200cea00 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f46200cdab0 tx=0x7f460c009250 comp rx=0 tx=0).stop 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 -- 172.21.15.26:0/495552255 shutdown_connections 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 --2- 172.21.15.26:0/495552255 >> v2:172.21.15.67:3300/0 conn(0x7f46200cef40 0x7f462015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 --2- 172.21.15.26:0/495552255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f462015de50 0x7f46200cea00 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 -- 172.21.15.26:0/495552255 >> 172.21.15.26:0/495552255 conn(0x7f46200703a0 msgr2=0x7f46200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 -- 172.21.15.26:0/495552255 shutdown_connections 2023-10-09T11:44:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.115+0000 7f4625b5b700 1 -- 172.21.15.26:0/495552255 wait complete. 2023-10-09T11:44:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.116+0000 7f4625b5b700 1 Processor -- start 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 -- start start 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46200cef40 0x7f46200cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f462015de50 0x7f462014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46200ca4d0 con 0x7f4620153c30 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46200ccc20 con 0x7f462015de50 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f4625b5b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46200cc010 con 0x7f46200cef40 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f461ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f461ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55604/0 (socket says 172.21.15.26:55604) 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.117+0000 7f461ffff700 1 -- 172.21.15.26:0/1032684252 learned_addr learned my addr 172.21.15.26:0/1032684252 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f462535a700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f462015de50 0x7f462014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f4624b59700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46200cef40 0x7f46200cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 -- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46200cef40 msgr2=0x7f46200cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46200cef40 0x7f46200cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 -- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f462015de50 msgr2=0x7f462014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f462015de50 0x7f462014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 -- 172.21.15.26:0/1032684252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0094f0 con 0x7f4620153c30 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461ffff700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f462006eb00 tx=0x7f460c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c011e40 con 0x7f4620153c30 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c01a450 con 0x7f4620153c30 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46200cc2f0 con 0x7f4620153c30 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c01a810 con 0x7f4620153c30 2023-10-09T11:44:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.118+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46200cc8b0 con 0x7f4620153c30 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.119+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462004c3c0 con 0x7f4620153c30 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.120+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f460c01ac00 con 0x7f4620153c30 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.120+0000 7f461cff9700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 0x7f46040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.120+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f460c0862a0 con 0x7f4620153c30 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.120+0000 7f4624b59700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 0x7f46040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.121+0000 7f4624b59700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 0x7f46040697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f46140039e0 tx=0x7f4614007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.124+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f460c053380 con 0x7f4620153c30 2023-10-09T11:44:43.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.317+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46200ccd60 con 0x7f4620153c30 2023-10-09T11:44:43.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.318+0000 7f461cff9700 1 -- 172.21.15.26:0/1032684252 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f460c0569a0 con 0x7f4620153c30 2023-10-09T11:44:43.319 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:43.319 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":194,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:42.551179+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:43.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 msgr2=0x7f46040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 0x7f46040697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f46140039e0 tx=0x7f4614007ec0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 msgr2=0x7f46200c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f462006eb00 tx=0x7f460c017000 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 shutdown_connections 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f462015de50 0x7f462014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4604067320 0x7f46040697d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46200cef40 0x7f46200cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 --2- 172.21.15.26:0/1032684252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4620153c30 0x7f46200c75e0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 >> 172.21.15.26:0/1032684252 conn(0x7f46200703a0 msgr2=0x7f46200c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 shutdown_connections 2023-10-09T11:44:43.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.320+0000 7f4625b5b700 1 -- 172.21.15.26:0/1032684252 wait complete. 2023-10-09T11:44:43.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:44:43.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:44:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.454+0000 7fcccc768700 1 Processor -- start 2023-10-09T11:44:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.454+0000 7fcccc768700 1 -- start start 2023-10-09T11:44:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccc768700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 0x7fccc4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccc768700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40ccfd0 con 0x7fccc406e0e0 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccc768700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc415a3d0 con 0x7fccc4159530 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccc768700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415a6b0 con 0x7fccc406dc70 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccad05700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fccc406e0e0 0x7fccc40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39788/0 (socket says 172.21.15.26:39788) 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.455+0000 7fcccad05700 1 -- 172.21.15.26:0/3359744852 learned_addr learned my addr 172.21.15.26:0/3359744852 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9d03700 1 --2- 172.21.15.26:0/3359744852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 0x7fccc4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462746195 0 0) 0x7fccc40ccfd0 con 0x7fccc406e0e0 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac003570 con 0x7fccc406e0e0 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507403438 0 0) 0x7fccc415a3d0 con 0x7fccc4159530 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc40ccfd0 con 0x7fccc4159530 2023-10-09T11:44:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9d03700 1 -- 172.21.15.26:0/3359744852 >> v1:172.21.15.67:6789/0 conn(0x7fccc4159530 legacy=0x7fccc40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9d03700 1 -- 172.21.15.26:0/3359744852 >> v1:172.21.15.26:6789/0 conn(0x7fccc406e0e0 legacy=0x7fccc40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9d03700 1 -- 172.21.15.26:0/3359744852 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc415a990 con 0x7fccc406dc70 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9d03700 1 --2- 172.21.15.26:0/3359744852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 0x7fccc4159900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009910 tx=0x7fccb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac2e05fcd260eff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8011630 con 0x7fccc406dc70 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8011790 con 0x7fccc406dc70 2023-10-09T11:44:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.456+0000 7fccc9502700 1 -- 172.21.15.26:0/3359744852 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8011b10 con 0x7fccc406dc70 2023-10-09T11:44:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 -- 172.21.15.26:0/3359744852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 msgr2=0x7fccc4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 --2- 172.21.15.26:0/3359744852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 0x7fccc4159900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009910 tx=0x7fccb80091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 -- 172.21.15.26:0/3359744852 shutdown_connections 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 --2- 172.21.15.26:0/3359744852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc406dc70 0x7fccc4159900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 -- 172.21.15.26:0/3359744852 >> 172.21.15.26:0/3359744852 conn(0x7fccc40703a0 msgr2=0x7fccc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 -- 172.21.15.26:0/3359744852 shutdown_connections 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.457+0000 7fcccc768700 1 -- 172.21.15.26:0/3359744852 wait complete. 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.458+0000 7fcccc768700 1 Processor -- start 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.458+0000 7fcccc768700 1 -- start start 2023-10-09T11:44:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc406e0e0 0x7fccc40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 0x7fccc40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40ca4c0 con 0x7fccc406dc70 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b2040 con 0x7fccc406e0e0 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccc768700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4152830 con 0x7fccc4159530 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55606/0 (socket says 172.21.15.26:55606) 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 -- 172.21.15.26:0/2933769623 learned_addr learned my addr 172.21.15.26:0/2933769623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccc9d03700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc406e0e0 0x7fccc40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccad05700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 0x7fccc40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 -- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 msgr2=0x7fccc40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 0x7fccc40b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 -- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc406e0e0 msgr2=0x7fccc40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc406e0e0 0x7fccc40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 -- 172.21.15.26:0/2933769623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009420 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fcccad05700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 0x7fccc40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccca504700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c8e0 tx=0x7fccb4002740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.459+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400ce80 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.460+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400a7a0 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.460+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40b1d60 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.460+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400ab60 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.460+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc41524c0 con 0x7fccc406dc70 2023-10-09T11:44:43.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.460+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc404c3c0 con 0x7fccc406dc70 2023-10-09T11:44:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.461+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fccb4012420 con 0x7fccc406dc70 2023-10-09T11:44:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.461+0000 7fccc27fc700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 0x7fccb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.461+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fccb4084780 con 0x7fccc406dc70 2023-10-09T11:44:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.461+0000 7fccc9d03700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 0x7fccb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.462+0000 7fccc9d03700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 0x7fccb00697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009860 tx=0x7fccb8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.466+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccb4051760 con 0x7fccc406dc70 2023-10-09T11:44:43.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.661+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccc415ac70 con 0x7fccc406dc70 2023-10-09T11:44:43.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.661+0000 7fccc27fc700 1 -- 172.21.15.26:0/2933769623 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccb4016020 con 0x7fccc406dc70 2023-10-09T11:44:43.662 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 msgr2=0x7fccb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 0x7fccb00697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009860 tx=0x7fccb8017000 comp rx=0 tx=0).stop 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 msgr2=0x7fccc40b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c8e0 tx=0x7fccb4002740 comp rx=0 tx=0).stop 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 shutdown_connections 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fccb0067320 0x7fccb00697d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fccc4159530 0x7fccc40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc406dc70 0x7fccc40b1250 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 --2- 172.21.15.26:0/2933769623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc406e0e0 0x7fccc40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 >> 172.21.15.26:0/2933769623 conn(0x7fccc40703a0 msgr2=0x7fccc40cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 shutdown_connections 2023-10-09T11:44:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.663+0000 7fcccc768700 1 -- 172.21.15.26:0/2933769623 wait complete. 2023-10-09T11:44:43.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:44:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.794+0000 7f00cba3b700 1 Processor -- start 2023-10-09T11:44:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.794+0000 7f00cba3b700 1 -- start start 2023-10-09T11:44:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00cba3b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00c4159c80 0x7f00c40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00cba3b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40ce9d0 con 0x7f00c40cfe70 2023-10-09T11:44:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00cba3b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40af960 con 0x7f00c41598b0 2023-10-09T11:44:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00cba3b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40afc30 con 0x7f00c4159c80 2023-10-09T11:44:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00c9fd8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f00c40cfe70 0x7f00c4163590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39796/0 (socket says 172.21.15.26:39796) 2023-10-09T11:44:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.795+0000 7f00c9fd8700 1 -- 172.21.15.26:0/1662187915 learned_addr learned my addr 172.21.15.26:0/1662187915 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c8fd6700 1 --2- 172.21.15.26:0/1662187915 >> v2:172.21.15.67:3300/0 conn(0x7f00c4159c80 0x7f00c40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026092606 0 0) 0x7f00c40ce9d0 con 0x7f00c40cfe70 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac003570 con 0x7f00c40cfe70 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248930732 0 0) 0x7f00ac003570 con 0x7f00c40cfe70 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 >> v2:172.21.15.67:3300/0 conn(0x7f00c4159c80 msgr2=0x7f00c40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 --2- 172.21.15.26:0/1662187915 >> v2:172.21.15.67:3300/0 conn(0x7f00c4159c80 0x7f00c40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 >> v1:172.21.15.67:6789/0 conn(0x7f00c41598b0 legacy=0x7f00c40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40aff10 con 0x7f00c40cfe70 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f00b4001470 con 0x7f00c40cfe70 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 >> v1:172.21.15.26:6789/0 conn(0x7f00c40cfe70 legacy=0x7f00c4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00ac003a60 0x7f00ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ac004810 0x7f00ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40afc30 con 0x7f00ac0051c0 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac00c0d0 con 0x7f00ac004810 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac00c290 con 0x7f00ac003a60 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c8fd6700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ac004810 0x7f00ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c97d7700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00ac003a60 0x7f00ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 -- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00ac003a60 msgr2=0x7f00ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00ac003a60 0x7f00ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 -- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ac004810 msgr2=0x7f00ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ac004810 0x7f00ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 -- 172.21.15.26:0/1662187915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac003570 con 0x7f00ac0051c0 2023-10-09T11:44:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c97d7700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00ac003a60 0x7f00ac003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.796+0000 7f00c9fd8700 1 -- 172.21.15.26:0/1662187915 reap_dead start 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00c9fd8700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00ac00ba60 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f00b400c3e0 tx=0x7f00b4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231b5eefa77ea70a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400cc30 con 0x7f00ac0051c0 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400cd90 con 0x7f00ac0051c0 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00c3fff700 1 -- 172.21.15.26:0/1662187915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4015b70 con 0x7f00ac0051c0 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 -- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 msgr2=0x7f00ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00ac00ba60 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f00b400c3e0 tx=0x7f00b4001e50 comp rx=0 tx=0).stop 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 -- 172.21.15.26:0/1662187915 shutdown_connections 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 --2- 172.21.15.26:0/1662187915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00ac00ba60 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 -- 172.21.15.26:0/1662187915 >> 172.21.15.26:0/1662187915 conn(0x7f00c4070e30 msgr2=0x7f00c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 -- 172.21.15.26:0/1662187915 shutdown_connections 2023-10-09T11:44:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.797+0000 7f00cba3b700 1 -- 172.21.15.26:0/1662187915 wait complete. 2023-10-09T11:44:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.798+0000 7f00cba3b700 1 Processor -- start 2023-10-09T11:44:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 -- start start 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00c41566f0 0x7f00c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00c41587b0 0x7f00c4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4159190 con 0x7f00ac0051c0 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4165650 con 0x7f00c41587b0 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00cba3b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4156b80 con 0x7f00c41566f0 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00c97d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00c97d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55624/0 (socket says 172.21.15.26:55624) 2023-10-09T11:44:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.799+0000 7f00c97d7700 1 -- 172.21.15.26:0/3855698522 learned_addr learned my addr 172.21.15.26:0/3855698522 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c8fd6700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00c41566f0 0x7f00c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c9fd8700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00c41587b0 0x7f00c4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 -- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00c41566f0 msgr2=0x7f00c40697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00c41566f0 0x7f00c40697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 -- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00c41587b0 msgr2=0x7f00c4158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00c41587b0 0x7f00c4158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 -- 172.21.15.26:0/3855698522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4156e60 con 0x7f00ac0051c0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c97d7700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000f80 tx=0x7f00bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc018070 con 0x7f00ac0051c0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc010040 con 0x7f00ac0051c0 2023-10-09T11:44:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c4157140 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc006dd0 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.800+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c41485c0 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.801+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c404c3c0 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.802+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00bc003030 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.802+0000 7f00c17fa700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 0x7f00b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.802+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f00bc0845c0 con 0x7f00ac0051c0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.802+0000 7f00c8fd6700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 0x7f00b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.803+0000 7f00c8fd6700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 0x7f00b00697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b6440 tx=0x7f00b80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:43.806+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00bc051490 con 0x7f00ac0051c0 2023-10-09T11:44:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.000+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f00c40ce380 con 0x7f00ac0051c0 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.001+0000 7f00c17fa700 1 -- 172.21.15.26:0/3855698522 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v194) v1 ==== 84+0+65 (secure 0 0 0) 0x7f00bc054ab0 con 0x7f00ac0051c0 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:44.003 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:44:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 msgr2=0x7f00b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 0x7f00b00697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b6440 tx=0x7f00b80091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 msgr2=0x7f00c4148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000f80 tx=0x7f00bc009040 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 shutdown_connections 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00c41587b0 0x7f00c4158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0051c0 0x7f00c4148080 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00b0067320 0x7f00b00697d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 --2- 172.21.15.26:0/3855698522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00c41566f0 0x7f00c40697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 >> 172.21.15.26:0/3855698522 conn(0x7f00c4070e30 msgr2=0x7f00c40b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 shutdown_connections 2023-10-09T11:44:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.003+0000 7f00cba3b700 1 -- 172.21.15.26:0/3855698522 wait complete. 2023-10-09T11:44:44.016 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:44:44.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:44:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.138+0000 7fcca8598700 1 Processor -- start 2023-10-09T11:44:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.139+0000 7fcca8598700 1 -- start start 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.139+0000 7fcca8598700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcca00cd770 0x7fcca00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca8598700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00b04f0 0x7fcca01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca8598700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00cf330 con 0x7fcca00cb880 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca8598700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00cead0 con 0x7fcca00cd770 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca8598700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00cdbc0 con 0x7fcca00b04f0 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcca00cd770 0x7fcca00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcca00cd770 0x7fcca00cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55640/0 (socket says 172.21.15.26:55640) 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 -- 172.21.15.26:0/930720869 learned_addr learned my addr 172.21.15.26:0/930720869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca6b35700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00b04f0 0x7fcca01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 -- 172.21.15.26:0/930720869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00b04f0 msgr2=0x7fcca01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:44.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00b04f0 0x7fcca01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5332700 1 -- 172.21.15.26:0/930720869 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745797460 0 0) 0x7fcca00cf330 con 0x7fcca00cb880 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 -- 172.21.15.26:0/930720869 >> v1:172.21.15.67:6789/0 conn(0x7fcca00cb880 legacy=0x7fcca00cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 -- 172.21.15.26:0/930720869 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00cddd0 con 0x7fcca00cd770 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5b33700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00cd770 0x7fcca00cbc50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fcc940099b0 tx=0x7fcc94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7e6c3721ec1fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5332700 1 -- 172.21.15.26:0/930720869 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94009ea0 con 0x7fcca00cd770 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5332700 1 -- 172.21.15.26:0/930720869 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400b860 con 0x7fcca00cd770 2023-10-09T11:44:44.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.140+0000 7fcca5332700 1 -- 172.21.15.26:0/930720869 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400bc00 con 0x7fcca00cd770 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 -- 172.21.15.26:0/930720869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00cd770 msgr2=0x7fcca00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00cd770 0x7fcca00cbc50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fcc940099b0 tx=0x7fcc94009250 comp rx=0 tx=0).stop 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 -- 172.21.15.26:0/930720869 shutdown_connections 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00b04f0 0x7fcca01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 --2- 172.21.15.26:0/930720869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00cd770 0x7fcca00cbc50 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 -- 172.21.15.26:0/930720869 >> 172.21.15.26:0/930720869 conn(0x7fcca00703a0 msgr2=0x7fcca00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 -- 172.21.15.26:0/930720869 shutdown_connections 2023-10-09T11:44:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.141+0000 7fcca8598700 1 -- 172.21.15.26:0/930720869 wait complete. 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.142+0000 7fcca8598700 1 Processor -- start 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.142+0000 7fcca8598700 1 -- start start 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00cb880 0x7fcca0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcca00cd770 0x7fcca00b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0155880 con 0x7fcca00b04f0 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0155d10 con 0x7fcca00cd770 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca8598700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0154c70 con 0x7fcca00cb880 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55650/0 (socket says 172.21.15.26:55650) 2023-10-09T11:44:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 -- 172.21.15.26:0/2730562245 learned_addr learned my addr 172.21.15.26:0/2730562245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6b35700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcca00cd770 0x7fcca00b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca5b33700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00cb880 0x7fcca0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 -- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00cb880 msgr2=0x7fcca0156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00cb880 0x7fcca0156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 -- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcca00cd770 msgr2=0x7fcca00b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcca00cd770 0x7fcca00b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.143+0000 7fcca6334700 1 -- 172.21.15.26:0/2730562245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940094f0 con 0x7fcca00b04f0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcca6334700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7e0 tx=0x7fcc98007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98012700 con 0x7fcca00b04f0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98012880 con 0x7fcca00b04f0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca0154f50 con 0x7fcca00b04f0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98012c40 con 0x7fcca00b04f0 2023-10-09T11:44:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.144+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca0155510 con 0x7fcca00b04f0 2023-10-09T11:44:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.145+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00af980 con 0x7fcca00b04f0 2023-10-09T11:44:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.145+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcc9801b400 con 0x7fcca00b04f0 2023-10-09T11:44:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.146+0000 7fcc9e7fc700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 0x7fcc8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.146+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcc980844f0 con 0x7fcca00b04f0 2023-10-09T11:44:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.146+0000 7fcca5b33700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 0x7fcc8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.146+0000 7fcca5b33700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 0x7fcc8c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcc940099b0 tx=0x7fcc94017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.150+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc980514d0 con 0x7fcca00b04f0 2023-10-09T11:44:44.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:44.344+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcca004c3c0 con 0x7fcca00b04f0 2023-10-09T11:44:45.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.234+0000 7fcc9e7fc700 1 -- 172.21.15.26:0/2730562245 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v195) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc98054af0 con 0x7fcca00b04f0 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 msgr2=0x7fcc8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 0x7fcc8c0697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcc940099b0 tx=0x7fcc94017000 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 msgr2=0x7fcca0147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7e0 tx=0x7fcc98007df0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 shutdown_connections 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcca00cd770 0x7fcca00b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcca00b04f0 0x7fcca0147070 secure :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7e0 tx=0x7fcc98007df0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fcc8c067320 0x7fcc8c0697d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 --2- 172.21.15.26:0/2730562245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcca00cb880 0x7fcca0156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.238+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 >> 172.21.15.26:0/2730562245 conn(0x7fcca00703a0 msgr2=0x7fcca0157470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.242+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 shutdown_connections 2023-10-09T11:44:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.242+0000 7fcca8598700 1 -- 172.21.15.26:0/2730562245 wait complete. 2023-10-09T11:44:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-09T11:44:45.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:44:45.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.390+0000 7fd24c7c9700 1 Processor -- start 2023-10-09T11:44:45.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.390+0000 7fd24c7c9700 1 -- start start 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd24c7c9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd244159530 0x7fd2440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd24c7c9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd24406e0e0 0x7fd2440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd24c7c9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440ccfd0 con 0x7fd24406dc70 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd24c7c9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440cf0e0 con 0x7fd244159530 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd24c7c9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24415a3d0 con 0x7fd24406e0e0 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd249d64700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd24406dc70 0x7fd244159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39806/0 (socket says 172.21.15.26:39806) 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.391+0000 7fd249d64700 1 -- 172.21.15.26:0/2568603680 learned_addr learned my addr 172.21.15.26:0/2568603680 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24ad66700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd24406e0e0 0x7fd2440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24a565700 1 --2- 172.21.15.26:0/2568603680 >> v2:172.21.15.67:3300/0 conn(0x7fd244159530 0x7fd2440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792171897 0 0) 0x7fd2440ccfd0 con 0x7fd24406dc70 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003570 con 0x7fd24406dc70 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174114920 0 0) 0x7fd22c003570 con 0x7fd24406dc70 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd24406e0e0 msgr2=0x7fd2440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd24406e0e0 0x7fd2440cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 >> v2:172.21.15.67:3300/0 conn(0x7fd244159530 msgr2=0x7fd2440ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 --2- 172.21.15.26:0/2568603680 >> v2:172.21.15.67:3300/0 conn(0x7fd244159530 0x7fd2440ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24415a6b0 con 0x7fd24406dc70 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fd238001470 con 0x7fd24406dc70 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 >> v1:172.21.15.26:6789/0 conn(0x7fd24406dc70 legacy=0x7fd244159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c003a60 0x7fd22c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd22c004810 0x7fd22c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22c0051c0 0x7fd22c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440cf0e0 con 0x7fd22c004810 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24415a3d0 con 0x7fd22c003a60 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00bfa0 con 0x7fd22c0051c0 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24ad66700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd24406e0e0 0x7fd2440cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24a565700 1 --2- 172.21.15.26:0/2568603680 >> v2:172.21.15.67:3300/0 conn(0x7fd244159530 0x7fd2440ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249d64700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd22c004810 0x7fd22c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24ad66700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22c0051c0 0x7fd22c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd24a565700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c003a60 0x7fd22c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.392+0000 7fd249d64700 1 -- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22c0051c0 msgr2=0x7fd22c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249d64700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22c0051c0 0x7fd22c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249d64700 1 -- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c003a60 msgr2=0x7fd22c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249d64700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c003a60 0x7fd22c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249d64700 1 -- 172.21.15.26:0/2568603680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c003570 con 0x7fd22c004810 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24a565700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c003a60 0x7fd22c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24ad66700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22c0051c0 0x7fd22c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249d64700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd22c004810 0x7fd22c004c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c3c0 tx=0x7fd238001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcaa92cf129ad77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800cc90 con 0x7fd22c004810 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800ce30 con 0x7fd22c004810 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd249563700 1 -- 172.21.15.26:0/2568603680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238005b70 con 0x7fd22c004810 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24c7c9700 1 -- 172.21.15.26:0/2568603680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd22c004810 msgr2=0x7fd22c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/2568603680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd22c004810 0x7fd22c004c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c3c0 tx=0x7fd238001e90 comp rx=0 tx=0).stop 2023-10-09T11:44:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24ad66700 1 -- 172.21.15.26:0/2568603680 reap_dead start 2023-10-09T11:44:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24c7c9700 1 -- 172.21.15.26:0/2568603680 shutdown_connections 2023-10-09T11:44:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24c7c9700 1 -- 172.21.15.26:0/2568603680 >> 172.21.15.26:0/2568603680 conn(0x7fd2440703a0 msgr2=0x7fd2440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.393+0000 7fd24c7c9700 1 -- 172.21.15.26:0/2568603680 shutdown_connections 2023-10-09T11:44:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.394+0000 7fd24c7c9700 1 -- 172.21.15.26:0/2568603680 wait complete. 2023-10-09T11:44:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 Processor -- start 2023-10-09T11:44:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 -- start start 2023-10-09T11:44:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c004810 0x7fd2440b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2440d0860 0x7fd2440d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440d1240 con 0x7fd2440b3680 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244152050 con 0x7fd22c004810 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd24c7c9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b3af0 con 0x7fd2440d0860 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd249d64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd249d64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55662/0 (socket says 172.21.15.26:55662) 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.395+0000 7fd249d64700 1 -- 172.21.15.26:0/323162271 learned_addr learned my addr 172.21.15.26:0/323162271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd24a565700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c004810 0x7fd2440b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd24ad66700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2440d0860 0x7fd2440d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 -- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2440d0860 msgr2=0x7fd2440d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2440d0860 0x7fd2440d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 -- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c004810 msgr2=0x7fd2440b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c004810 0x7fd2440b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 -- 172.21.15.26:0/323162271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440b4420 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd249d64700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd238011000 tx=0x7fd238015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238001c70 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800cc90 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2440b4700 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238007510 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.396+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440b4cc0 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.397+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2440c9480 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.398+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd238019070 con 0x7fd2440b3680 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.398+0000 7fd2427fc700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 0x7fd2300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.398+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd238085830 con 0x7fd2440b3680 2023-10-09T11:44:45.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.398+0000 7fd24a565700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 0x7fd2300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:45.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.399+0000 7fd24a565700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 0x7fd2300697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd23c014350 tx=0x7fd23c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:45.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.403+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2440c9480 con 0x7fd2440b3680 2023-10-09T11:44:45.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:45.598+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2440c9480 con 0x7fd2440b3680 2023-10-09T11:44:46.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.242+0000 7fd2427fc700 1 -- 172.21.15.26:0/323162271 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v196) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd2440c9480 con 0x7fd2440b3680 2023-10-09T11:44:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.247+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 msgr2=0x7fd2300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.247+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 0x7fd2300697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd23c014350 tx=0x7fd23c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:46.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.247+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 msgr2=0x7fd244151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.247+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd238011000 tx=0x7fd238015000 comp rx=0 tx=0).stop 2023-10-09T11:44:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 shutdown_connections 2023-10-09T11:44:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd230067320 0x7fd2300697d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2440d0860 0x7fd2440d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd22c004810 0x7fd2440b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 --2- 172.21.15.26:0/323162271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2440b3680 0x7fd244151b10 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.249+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 >> 172.21.15.26:0/323162271 conn(0x7fd2440703a0 msgr2=0x7fd2440cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.250+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 shutdown_connections 2023-10-09T11:44:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.250+0000 7fd24c7c9700 1 -- 172.21.15.26:0/323162271 wait complete. 2023-10-09T11:44:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-09T11:44:46.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:44:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.401+0000 7fb7fe83b700 1 Processor -- start 2023-10-09T11:44:46.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.401+0000 7fb7fe83b700 1 -- start start 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fe83b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7f815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fe83b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f815ac50 con 0x7fb7f8153a00 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fe83b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f815d010 con 0x7fb7f8153dd0 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fe83b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f815af60 con 0x7fb7f80cf110 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fd839700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb7f8153a00 0x7fb7f815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39810/0 (socket says 172.21.15.26:39810) 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fd839700 1 -- 172.21.15.26:0/850916210 learned_addr learned my addr 172.21.15.26:0/850916210 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7f815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.402+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492548350 0 0) 0x7fb7f815ac50 con 0x7fb7f8153a00 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e0003570 con 0x7fb7f8153a00 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1761966273 0 0) 0x7fb7e0003570 con 0x7fb7f8153a00 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 msgr2=0x7fb7f815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7f815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 >> v1:172.21.15.67:6789/0 conn(0x7fb7f8153dd0 legacy=0x7fb7f80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f815b240 con 0x7fb7f8153a00 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb7e80017f0 con 0x7fb7f8153a00 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 >> v1:172.21.15.26:6789/0 conn(0x7fb7f8153a00 legacy=0x7fb7f815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7e0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7e0003fd0 0x7fb7e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f815af60 con 0x7fb7e0004d50 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e000bb40 con 0x7fb7e0003fd0 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e000bd00 con 0x7fb7f80cf110 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fd839700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7e0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fd038700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7e0003fd0 0x7fb7e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 -- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 msgr2=0x7fb7e0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cf110 0x7fb7e0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 -- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7e0003fd0 msgr2=0x7fb7e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7e0003fd0 0x7fb7e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 -- 172.21.15.26:0/850916210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0003570 con 0x7fb7e0004d50 2023-10-09T11:44:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.403+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7e00051c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fb7f815e390 tx=0x7fb7f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702e2da88eb82785 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000e710 con 0x7fb7e0004d50 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000e870 con 0x7fb7e0004d50 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fc837700 1 -- 172.21.15.26:0/850916210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000ec30 con 0x7fb7e0004d50 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 -- 172.21.15.26:0/850916210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 msgr2=0x7fb7e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/850916210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7e00051c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fb7f815e390 tx=0x7fb7f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe03a700 1 -- 172.21.15.26:0/850916210 reap_dead start 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 -- 172.21.15.26:0/850916210 shutdown_connections 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 -- 172.21.15.26:0/850916210 >> 172.21.15.26:0/850916210 conn(0x7fb7f80703a0 msgr2=0x7fb7f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 -- 172.21.15.26:0/850916210 shutdown_connections 2023-10-09T11:44:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.404+0000 7fb7fe83b700 1 -- 172.21.15.26:0/850916210 wait complete. 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.405+0000 7fb7fe83b700 1 Processor -- start 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.405+0000 7fb7fe83b700 1 -- start start 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7f814f200 0x7fb7f814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cb880 0x7fb7f80cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80cc260 con 0x7fb7e0004d50 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80b0c70 con 0x7fb7f814f200 2023-10-09T11:44:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe83b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f814e720 con 0x7fb7f80cb880 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55678/0 (socket says 172.21.15.26:55678) 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 -- 172.21.15.26:0/3187713178 learned_addr learned my addr 172.21.15.26:0/3187713178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd038700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7f814f200 0x7fb7f814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fe03a700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cb880 0x7fb7f80cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 -- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cb880 msgr2=0x7fb7f80cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cb880 0x7fb7f80cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 -- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7f814f200 msgr2=0x7fb7f814e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7f814f200 0x7fb7f814e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.406+0000 7fb7fd839700 1 -- 172.21.15.26:0/3187713178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f81585d0 con 0x7fb7e0004d50 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7fd839700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800a0e0 tx=0x7fb7e8002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800ad70 con 0x7fb7e0004d50 2023-10-09T11:44:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80133f0 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f81588b0 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80137b0 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.407+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f814f670 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.408+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f80b0a40 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.408+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb7e8013b20 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.409+0000 7fb7f5ffb700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 0x7fb7e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.409+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb7e8085980 con 0x7fb7e0004d50 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.409+0000 7fb7fd038700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 0x7fb7e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.409+0000 7fb7fd038700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 0x7fb7e40697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0010e0 tx=0x7fb7ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.413+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f80b0a40 con 0x7fb7e0004d50 2023-10-09T11:44:46.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:46.650+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7f80b0a40 con 0x7fb7e0004d50 2023-10-09T11:44:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.244+0000 7fb7f5ffb700 1 -- 172.21.15.26:0/3187713178 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v127) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb7f80b0a40 con 0x7fb7e0004d50 2023-10-09T11:44:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.257+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 msgr2=0x7fb7e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.257+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 0x7fb7e40697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0010e0 tx=0x7fb7ec009040 comp rx=0 tx=0).stop 2023-10-09T11:44:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.257+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 msgr2=0x7fb7f8157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.257+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800a0e0 tx=0x7fb7e8002170 comp rx=0 tx=0).stop 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 shutdown_connections 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb7e4067320 0x7fb7e40697d0 secure :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0010e0 tx=0x7fb7ec009040 comp rx=0 tx=0).stop 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb7f80cb880 0x7fb7f80cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7e0004d50 0x7fb7f8157f00 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 --2- 172.21.15.26:0/3187713178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7f814f200 0x7fb7f814e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.258+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 >> 172.21.15.26:0/3187713178 conn(0x7fb7f80703a0 msgr2=0x7fb7f80c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.262+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 shutdown_connections 2023-10-09T11:44:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.262+0000 7fb7fe83b700 1 -- 172.21.15.26:0/3187713178 wait complete. 2023-10-09T11:44:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 33 and data pool 34 2023-10-09T11:44:47.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.402+0000 7f40aae60700 1 Processor -- start 2023-10-09T11:44:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.402+0000 7f40aae60700 1 -- start start 2023-10-09T11:44:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40a4159c80 0x7f40a40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a40af790 0x7f40a40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40ce9d0 con 0x7f40a40af790 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40afc30 con 0x7f40a4159c80 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40aae60700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40aff10 con 0x7f40a41598b0 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40a93fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a40af790 0x7f40a40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40a93fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a40af790 0x7f40a40cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55688/0 (socket says 172.21.15.26:55688) 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.403+0000 7f40a93fd700 1 -- 172.21.15.26:0/985697010 learned_addr learned my addr 172.21.15.26:0/985697010 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a3fff700 1 --2- 172.21.15.26:0/985697010 >> v2:172.21.15.67:3300/0 conn(0x7f40a4159c80 0x7f40a40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a8bfc700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 -- 172.21.15.26:0/985697010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 msgr2=0x7f40a40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 -- 172.21.15.26:0/985697010 >> v2:172.21.15.67:3300/0 conn(0x7f40a4159c80 msgr2=0x7f40a40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 --2- 172.21.15.26:0/985697010 >> v2:172.21.15.67:3300/0 conn(0x7f40a4159c80 0x7f40a40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 -- 172.21.15.26:0/985697010 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40ce380 con 0x7f40a40af790 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a93fd700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40cbc30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f40a40897e0 tx=0x7f4094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1163882cf5ac5e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a37fe700 1 -- 172.21.15.26:0/985697010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400b860 con 0x7f40a40af790 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a37fe700 1 -- 172.21.15.26:0/985697010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409400b9c0 con 0x7f40a40af790 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.404+0000 7f40a37fe700 1 -- 172.21.15.26:0/985697010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400bd60 con 0x7f40a40af790 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 -- 172.21.15.26:0/985697010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 msgr2=0x7f40a40cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40cbc30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f40a40897e0 tx=0x7f4094009250 comp rx=0 tx=0).stop 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 -- 172.21.15.26:0/985697010 shutdown_connections 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40cbc30 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 --2- 172.21.15.26:0/985697010 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 --2- 172.21.15.26:0/985697010 >> v2:172.21.15.67:3300/0 conn(0x7f40a4159c80 0x7f40a40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 -- 172.21.15.26:0/985697010 >> 172.21.15.26:0/985697010 conn(0x7f40a4070e30 msgr2=0x7f40a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 -- 172.21.15.26:0/985697010 shutdown_connections 2023-10-09T11:44:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.405+0000 7f40aae60700 1 -- 172.21.15.26:0/985697010 wait complete. 2023-10-09T11:44:47.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.406+0000 7f40aae60700 1 Processor -- start 2023-10-09T11:44:47.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.406+0000 7f40aae60700 1 -- start start 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 0x7f40a40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a414faf0 con 0x7f40a40af790 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a415b020 con 0x7f40a4159c80 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a415b8c0 con 0x7f40a41598b0 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55704/0 (socket says 172.21.15.26:55704) 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 -- 172.21.15.26:0/3207591220 learned_addr learned my addr 172.21.15.26:0/3207591220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a93fd700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 0x7f40a40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a3fff700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 -- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 msgr2=0x7f40a40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 -- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 msgr2=0x7f40a40c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 0x7f40a40c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 -- 172.21.15.26:0/3207591220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940094f0 con 0x7f40a40af790 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a93fd700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 0x7f40a40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a8bfc700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e190 tx=0x7f409c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00ee30 con 0x7f40a40af790 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c014420 con 0x7f40a40af790 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a40b3ca0 con 0x7f40a40af790 2023-10-09T11:44:47.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0147e0 con 0x7f40a40af790 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.407+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a415b270 con 0x7f40a40af790 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.408+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a415bba0 con 0x7f40a40af790 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.409+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f409c014bd0 con 0x7f40a40af790 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.409+0000 7f40a0ff9700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 0x7f40900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.409+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f409c085470 con 0x7f40a40af790 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.409+0000 7f40a3fff700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 0x7f40900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.410+0000 7f40a3fff700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 0x7f40900697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d02d0 tx=0x7f4098008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.414+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f409c052100 con 0x7f40a40af790 2023-10-09T11:44:47.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.607+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a404c3c0 con 0x7f40a40af790 2023-10-09T11:44:47.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.608+0000 7f40a0ff9700 1 -- 172.21.15.26:0/3207591220 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f409c009a60 con 0x7f40a40af790 2023-10-09T11:44:47.610 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:47.610 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":197,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:46.651842+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 msgr2=0x7f40900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 0x7f40900697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d02d0 tx=0x7f4098008040 comp rx=0 tx=0).stop 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 msgr2=0x7f40a40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e190 tx=0x7f409c009920 comp rx=0 tx=0).stop 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 shutdown_connections 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a4159c80 0x7f40a40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a40af790 0x7f40a40c9e80 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4090067320 0x7f40900697d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 --2- 172.21.15.26:0/3207591220 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40a41598b0 0x7f40a40b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.610+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 >> 172.21.15.26:0/3207591220 conn(0x7f40a4070e30 msgr2=0x7f40a40ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.611+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 shutdown_connections 2023-10-09T11:44:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.611+0000 7f40aae60700 1 -- 172.21.15.26:0/3207591220 wait complete. 2023-10-09T11:44:47.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.741+0000 7fac0309a700 1 Processor -- start 2023-10-09T11:44:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.741+0000 7fac0309a700 1 -- start start 2023-10-09T11:44:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac0309a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cb5a0 0x7fabfc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac0309a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabfc0cde50 0x7fabfc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac0309a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc15ae40 con 0x7fabfc0cd9e0 2023-10-09T11:44:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac0309a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0d13f0 con 0x7fabfc0cde50 2023-10-09T11:44:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac0309a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc15ab60 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fac01637700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabfc0cde50 0x7fabfc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fabfbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fabfc0cd9e0 0x7fabfc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39814/0 (socket says 172.21.15.26:39814) 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.742+0000 7fabfbfff700 1 -- 172.21.15.26:0/2822545752 learned_addr learned my addr 172.21.15.26:0/2822545752 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac01637700 1 -- 172.21.15.26:0/2822545752 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cb5a0 msgr2=0x7fabfc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac01637700 1 --2- 172.21.15.26:0/2822545752 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cb5a0 0x7fabfc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac01637700 1 -- 172.21.15.26:0/2822545752 >> v1:172.21.15.26:6789/0 conn(0x7fabfc0cd9e0 legacy=0x7fabfc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac01637700 1 -- 172.21.15.26:0/2822545752 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0ccf00 con 0x7fabfc0cde50 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fabfb7fe700 1 -- 172.21.15.26:0/2822545752 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758232886 0 0) 0x7fabfc15ae40 con 0x7fabfc0cd9e0 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac01637700 1 --2- 172.21.15.26:0/2822545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cde50 0x7fabfc156e90 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fabe40098e0 tx=0x7fabe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87894b166f59067 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fabfb7fe700 1 -- 172.21.15.26:0/2822545752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4009e80 con 0x7fabfc0cde50 2023-10-09T11:44:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fabfb7fe700 1 -- 172.21.15.26:0/2822545752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400b860 con 0x7fabfc0cde50 2023-10-09T11:44:47.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fabfb7fe700 1 -- 172.21.15.26:0/2822545752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400bbe0 con 0x7fabfc0cde50 2023-10-09T11:44:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 -- 172.21.15.26:0/2822545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cde50 msgr2=0x7fabfc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 --2- 172.21.15.26:0/2822545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cde50 0x7fabfc156e90 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fabe40098e0 tx=0x7fabe40091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 -- 172.21.15.26:0/2822545752 shutdown_connections 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 --2- 172.21.15.26:0/2822545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cde50 0x7fabfc156e90 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 --2- 172.21.15.26:0/2822545752 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cb5a0 0x7fabfc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.743+0000 7fac0309a700 1 -- 172.21.15.26:0/2822545752 >> 172.21.15.26:0/2822545752 conn(0x7fabfc070e30 msgr2=0x7fabfc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.744+0000 7fac0309a700 1 -- 172.21.15.26:0/2822545752 shutdown_connections 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.744+0000 7fac0309a700 1 -- 172.21.15.26:0/2822545752 wait complete. 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.745+0000 7fac0309a700 1 Processor -- start 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.745+0000 7fac0309a700 1 -- start start 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.745+0000 7fac0309a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.745+0000 7fac0309a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 0x7fabfc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 0x7fabfc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b3e70 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc169e40 con 0x7fabfc0b34b0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc169550 con 0x7fabfc0cd9e0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55722/0 (socket says 172.21.15.26:55722) 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 -- 172.21.15.26:0/3081255355 learned_addr learned my addr 172.21.15.26:0/3081255355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fabfbfff700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 0x7fabfc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac01637700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 0x7fabfc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 -- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 msgr2=0x7fabfc1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 0x7fabfc1590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 -- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 msgr2=0x7fabfc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 0x7fabfc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 -- 172.21.15.26:0/3081255355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4009420 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fabfbfff700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 0x7fabfc1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac01637700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 0x7fabfc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac00e36700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fabf400b810 tx=0x7fabf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400f510 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400f670 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400fa30 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc159610 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.746+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc169ad0 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.747+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc04c3c0 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.748+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fabf401a400 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.748+0000 7fabf8ff9700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 0x7fabdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.748+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabf40847c0 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.748+0000 7fabfbfff700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 0x7fabdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.749+0000 7fabfbfff700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 0x7fabdc0697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e2a0 tx=0x7fabec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.752+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabf40514d0 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.944+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabfc0afa90 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.945+0000 7fabf8ff9700 1 -- 172.21.15.26:0/3081255355 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fabf4054af0 con 0x7fabfc0cb5a0 2023-10-09T11:44:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:47.947 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":197,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:46.651842+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:47.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 msgr2=0x7fabdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 0x7fabdc0697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e2a0 tx=0x7fabec009040 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 msgr2=0x7fabfc16a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fabf400b810 tx=0x7fabf40091d0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 shutdown_connections 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabfc0b34b0 0x7fabfc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabfc0cb5a0 0x7fabfc16a2d0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fabdc067320 0x7fabdc0697d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 --2- 172.21.15.26:0/3081255355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabfc0cd9e0 0x7fabfc1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 >> 172.21.15.26:0/3081255355 conn(0x7fabfc070e30 msgr2=0x7fabfc159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 shutdown_connections 2023-10-09T11:44:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:47.947+0000 7fac0309a700 1 -- 172.21.15.26:0/3081255355 wait complete. 2023-10-09T11:44:47.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 Processor -- start 2023-10-09T11:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 -- start start 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 0x7f2ddc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc0ccfd0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0cf0e0 con 0x7f2ddc159530 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.082+0000 7f2de2348700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc15a3d0 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2ddbfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 0x7f2ddc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2ddb7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2ddc06dc70 0x7f2ddc159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:34162/0 (socket says 172.21.15.26:34162) 2023-10-09T11:44:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:56556/0 (socket says 172.21.15.26:56556) 2023-10-09T11:44:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2ddb7fe700 1 -- 172.21.15.26:0/3435097290 learned_addr learned my addr 172.21.15.26:0/3435097290 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 -- 172.21.15.26:0/3435097290 >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 msgr2=0x7f2ddc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 --2- 172.21.15.26:0/3435097290 >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 0x7f2ddc0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 -- 172.21.15.26:0/3435097290 >> v1:172.21.15.67:6789/0 conn(0x7f2ddc06dc70 legacy=0x7f2ddc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2de08e5700 1 -- 172.21.15.26:0/3435097290 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc15a6b0 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.083+0000 7f2ddbfff700 1 --2- 172.21.15.26:0/3435097290 >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 0x7f2ddc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de08e5700 1 --2- 172.21.15.26:0/3435097290 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009e60 tx=0x7f2dd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d28ae5a3f36106 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2ddaffd700 1 -- 172.21.15.26:0/3435097290 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400e070 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2ddaffd700 1 -- 172.21.15.26:0/3435097290 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400bb60 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2ddaffd700 1 -- 172.21.15.26:0/3435097290 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4012430 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 -- 172.21.15.26:0/3435097290 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 msgr2=0x7f2ddc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 --2- 172.21.15.26:0/3435097290 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009e60 tx=0x7f2dd4009780 comp rx=0 tx=0).stop 2023-10-09T11:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 -- 172.21.15.26:0/3435097290 shutdown_connections 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 --2- 172.21.15.26:0/3435097290 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0cb6f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 --2- 172.21.15.26:0/3435097290 >> v2:172.21.15.67:3300/0 conn(0x7f2ddc159530 0x7f2ddc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 -- 172.21.15.26:0/3435097290 >> 172.21.15.26:0/3435097290 conn(0x7f2ddc0703a0 msgr2=0x7f2ddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 -- 172.21.15.26:0/3435097290 shutdown_connections 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.084+0000 7f2de2348700 1 -- 172.21.15.26:0/3435097290 wait complete. 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.085+0000 7f2de2348700 1 Processor -- start 2023-10-09T11:44:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 -- start start 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc159530 0x7f2ddc0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc155bc0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0b1530 con 0x7f2ddc159530 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de2348700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0b1810 con 0x7f2ddc06e0e0 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55732/0 (socket says 172.21.15.26:55732) 2023-10-09T11:44:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2ddbfff700 1 -- 172.21.15.26:0/531836479 learned_addr learned my addr 172.21.15.26:0/531836479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2de08e5700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc159530 0x7f2ddc0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.086+0000 7f2ddb7fe700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 -- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 msgr2=0x7f2ddc0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 -- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc159530 msgr2=0x7f2ddc0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc159530 0x7f2ddc0b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 -- 172.21.15.26:0/531836479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc009420 con 0x7f2ddc06dc70 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2ddbfff700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00ec80 tx=0x7f2dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00c850 con 0x7f2ddc06dc70 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc00c9b0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd4009a20 con 0x7f2ddc06dc70 2023-10-09T11:44:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00cd30 con 0x7f2ddc06dc70 2023-10-09T11:44:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.087+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0b1dd0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.088+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc155ea0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.089+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2dcc013680 con 0x7f2ddc06dc70 2023-10-09T11:44:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.089+0000 7f2dc3fff700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 0x7f2dc80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.089+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2dcc0851b0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.089+0000 7f2ddb7fe700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 0x7f2dc80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.090+0000 7f2ddb7fe700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 0x7f2dc80697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0007130 tx=0x7f2dd0007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.093+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dcc0558d0 con 0x7f2ddc06dc70 2023-10-09T11:44:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:48.334+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2ddc04c3c0 con 0x7f2ddc06dc70 2023-10-09T11:44:49.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.262+0000 7f2dc3fff700 1 -- 172.21.15.26:0/531836479 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v130) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2dcc055460 con 0x7f2ddc06dc70 2023-10-09T11:44:49.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 msgr2=0x7f2dc80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 0x7f2dc80697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0007130 tx=0x7f2dd0007eb0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 msgr2=0x7f2ddc0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00ec80 tx=0x7f2dcc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 shutdown_connections 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc159530 0x7f2ddc0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ddc06dc70 0x7f2ddc0b3480 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2dc8067320 0x7f2dc80697d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 --2- 172.21.15.26:0/531836479 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ddc06e0e0 0x7f2ddc0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 >> 172.21.15.26:0/531836479 conn(0x7f2ddc0703a0 msgr2=0x7f2ddc15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 shutdown_connections 2023-10-09T11:44:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.265+0000 7f2de2348700 1 -- 172.21.15.26:0/531836479 wait complete. 2023-10-09T11:44:49.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:44:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.409+0000 7f27cda52700 1 Processor -- start 2023-10-09T11:44:49.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.409+0000 7f27cda52700 1 -- start start 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.409+0000 7f27cda52700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 0x7f27c813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27cda52700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 0x7f27c813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27cda52700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c806d7b0 con 0x7f27c80cc6f0 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27cda52700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c806a570 con 0x7f27c80cc320 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27cda52700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c806f7d0 con 0x7f27c806a110 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c6ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 0x7f27c813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 0x7f27c813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c67fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f27c80cc6f0 0x7f27c8069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:34172/0 (socket says 172.21.15.26:34172) 2023-10-09T11:44:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c67fc700 1 -- 172.21.15.26:0/409831462 learned_addr learned my addr 172.21.15.26:0/409831462 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 -- 172.21.15.26:0/409831462 >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 msgr2=0x7f27c813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 --2- 172.21.15.26:0/409831462 >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 0x7f27c813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 -- 172.21.15.26:0/409831462 >> v1:172.21.15.67:6789/0 conn(0x7f27c80cc6f0 legacy=0x7f27c8069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 -- 172.21.15.26:0/409831462 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c806e330 con 0x7f27c806a110 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c6ffd700 1 --2- 172.21.15.26:0/409831462 >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 0x7f27c813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.410+0000 7f27c77fe700 1 --2- 172.21.15.26:0/409831462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 0x7f27c813c7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c00098e0 tx=0x7f27c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3f17667d37ffd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27c5ffb700 1 -- 172.21.15.26:0/409831462 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000b640 con 0x7f27c806a110 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27c5ffb700 1 -- 172.21.15.26:0/409831462 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000b7a0 con 0x7f27c806a110 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27c5ffb700 1 -- 172.21.15.26:0/409831462 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000bb40 con 0x7f27c806a110 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 -- 172.21.15.26:0/409831462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 msgr2=0x7f27c813c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 --2- 172.21.15.26:0/409831462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 0x7f27c813c7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c00098e0 tx=0x7f27c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 -- 172.21.15.26:0/409831462 shutdown_connections 2023-10-09T11:44:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 --2- 172.21.15.26:0/409831462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c806a110 0x7f27c813c7e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 --2- 172.21.15.26:0/409831462 >> v2:172.21.15.67:3300/0 conn(0x7f27c80cc320 0x7f27c813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 -- 172.21.15.26:0/409831462 >> 172.21.15.26:0/409831462 conn(0x7f27c8067f00 msgr2=0x7f27c8068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 -- 172.21.15.26:0/409831462 shutdown_connections 2023-10-09T11:44:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.411+0000 7f27cda52700 1 -- 172.21.15.26:0/409831462 wait complete. 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 Processor -- start 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 -- start start 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 0x7f27c80ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c80cc320 0x7f27c80ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80af560 con 0x7f27c80cc6f0 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80c7300 con 0x7f27c806a110 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27cda52700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80aec30 con 0x7f27c80cc320 2023-10-09T11:44:49.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.413+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 0x7f27c80ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55738/0 (socket says 172.21.15.26:55738) 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 -- 172.21.15.26:0/813812286 learned_addr learned my addr 172.21.15.26:0/813812286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c67fc700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c80cc320 0x7f27c80ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 -- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c80cc320 msgr2=0x7f27c80ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c80cc320 0x7f27c80ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 -- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 msgr2=0x7f27c80ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 0x7f27c80ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 -- 172.21.15.26:0/813812286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8009a20 con 0x7f27c80cc6f0 2023-10-09T11:44:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c6ffd700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 0x7f27c80ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:49.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27c77fe700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009f80 tx=0x7f27c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000bb20 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c0011420 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c0009420 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c00117a0 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.414+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c80af1f0 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.415+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c80af710 con 0x7f27c80cc6f0 2023-10-09T11:44:49.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.416+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f27c0011b10 con 0x7f27c80cc6f0 2023-10-09T11:44:49.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.416+0000 7f27beffd700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 0x7f27a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:49.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.416+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27c0086240 con 0x7f27c80cc6f0 2023-10-09T11:44:49.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.416+0000 7f27c6ffd700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 0x7f27a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:49.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.417+0000 7f27c6ffd700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 0x7f27a80697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b30d0 tx=0x7f27b800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:49.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.421+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27c80af710 con 0x7f27c80cc6f0 2023-10-09T11:44:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:49.660+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27c80af710 con 0x7f27c80cc6f0 2023-10-09T11:44:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.263+0000 7f27beffd700 1 -- 172.21.15.26:0/813812286 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v131) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27c80af710 con 0x7f27c80cc6f0 2023-10-09T11:44:50.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 msgr2=0x7f27a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 0x7f27a80697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b30d0 tx=0x7f27b800b040 comp rx=0 tx=0).stop 2023-10-09T11:44:50.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 msgr2=0x7f27c80c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009f80 tx=0x7f27c0017000 comp rx=0 tx=0).stop 2023-10-09T11:44:50.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 shutdown_connections 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27c80cc6f0 0x7f27c80c6960 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c806a110 0x7f27c80ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f27a8067320 0x7f27a80697d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 --2- 172.21.15.26:0/813812286 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27c80cc320 0x7f27c80ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 >> 172.21.15.26:0/813812286 conn(0x7f27c8067f00 msgr2=0x7f27c80682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 shutdown_connections 2023-10-09T11:44:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.266+0000 7f27cda52700 1 -- 172.21.15.26:0/813812286 wait complete. 2023-10-09T11:44:50.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:50.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.408+0000 7f3e8e131700 1 Processor -- start 2023-10-09T11:44:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.408+0000 7f3e8e131700 1 -- start start 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e8e131700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cb5a0 0x7f3e880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e8e131700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e880cde50 0x7f3e88156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e8e131700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8815ae40 con 0x7f3e880cd9e0 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e8e131700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e880d13f0 con 0x7f3e880cde50 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e8e131700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8815ab60 con 0x7f3e880cb5a0 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e87fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e880cde50 0x7f3e88156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e86ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e880cd9e0 0x7f3e88159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44554/0 (socket says 172.21.15.26:44554) 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e86ffd700 1 -- 172.21.15.26:0/2592967343 learned_addr learned my addr 172.21.15.26:0/2592967343 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e87fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e880cde50 0x7f3e88156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58510/0 (socket says 172.21.15.26:58510) 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e877fe700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cb5a0 0x7f3e880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e87fff700 1 -- 172.21.15.26:0/2592967343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cb5a0 msgr2=0x7f3e880cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e87fff700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cb5a0 0x7f3e880cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.409+0000 7f3e87fff700 1 -- 172.21.15.26:0/2592967343 >> v1:172.21.15.26:6789/0 conn(0x7f3e880cd9e0 legacy=0x7f3e88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e867fc700 1 -- 172.21.15.26:0/2592967343 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301760769 0 0) 0x7f3e8815ae40 con 0x7f3e880cd9e0 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e87fff700 1 -- 172.21.15.26:0/2592967343 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e880ccf00 con 0x7f3e880cde50 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e87fff700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e880cde50 0x7f3e88156e90 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009e60 tx=0x7f3e80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8975657ccf1ce91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e867fc700 1 -- 172.21.15.26:0/2592967343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000e070 con 0x7f3e880cde50 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e867fc700 1 -- 172.21.15.26:0/2592967343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000bc30 con 0x7f3e880cde50 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e867fc700 1 -- 172.21.15.26:0/2592967343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80012430 con 0x7f3e880cde50 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 -- 172.21.15.26:0/2592967343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e880cde50 msgr2=0x7f3e88156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e880cde50 0x7f3e88156e90 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009e60 tx=0x7f3e80009780 comp rx=0 tx=0).stop 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 -- 172.21.15.26:0/2592967343 shutdown_connections 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e880cde50 0x7f3e88156e90 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 --2- 172.21.15.26:0/2592967343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cb5a0 0x7f3e880cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 -- 172.21.15.26:0/2592967343 >> 172.21.15.26:0/2592967343 conn(0x7f3e88070e30 msgr2=0x7f3e880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 -- 172.21.15.26:0/2592967343 shutdown_connections 2023-10-09T11:44:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.410+0000 7f3e8e131700 1 -- 172.21.15.26:0/2592967343 wait complete. 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 Processor -- start 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 -- start start 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e880cb5a0 0x7f3e8815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cd9e0 0x7f3e8815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880c7cc0 con 0x7f3e881589f0 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8815cdd0 con 0x7f3e880cb5a0 2023-10-09T11:44:50.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.412+0000 7f3e8e131700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e881691b0 con 0x7f3e880cd9e0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58514/0 (socket says 172.21.15.26:58514) 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 -- 172.21.15.26:0/771970941 learned_addr learned my addr 172.21.15.26:0/771970941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e86ffd700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cd9e0 0x7f3e8815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e877fe700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e880cb5a0 0x7f3e8815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 -- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cd9e0 msgr2=0x7f3e8815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cd9e0 0x7f3e8815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 -- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e880cb5a0 msgr2=0x7f3e8815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e880cb5a0 0x7f3e8815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 -- 172.21.15.26:0/771970941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009a20 con 0x7f3e881589f0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e87fff700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3e80013000 tx=0x7f3e80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80027470 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e800275f0 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8815d080 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e800279b0 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.413+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8815d640 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.414+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e880c7e30 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.415+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3e80024070 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.415+0000 7f3e7f7fe700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 0x7f3e680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.415+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e80087480 con 0x7f3e881589f0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.415+0000 7f3e877fe700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 0x7f3e680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.416+0000 7f3e877fe700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 0x7f3e680697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3e78006fd0 tx=0x7f3e78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.419+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e80054110 con 0x7f3e881589f0 2023-10-09T11:44:50.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.654+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e8804c3c0 con 0x7f3e881589f0 2023-10-09T11:44:50.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.654+0000 7f3e7f7fe700 1 -- 172.21.15.26:0/771970941 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) v1 ==== 95+0+4598 (secure 0 0 0) 0x7f3e80057730 con 0x7f3e881589f0 2023-10-09T11:44:50.656 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:50.656 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":131,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:44:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 msgr2=0x7f3e680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 0x7f3e680697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3e78006fd0 tx=0x7f3e78008040 comp rx=0 tx=0).stop 2023-10-09T11:44:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 msgr2=0x7f3e88158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3e80013000 tx=0x7f3e80019000 comp rx=0 tx=0).stop 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 shutdown_connections 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e881589f0 0x7f3e88158e90 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e880cb5a0 0x7f3e8815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3e68067320 0x7f3e680697d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 --2- 172.21.15.26:0/771970941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e880cd9e0 0x7f3e8815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 >> 172.21.15.26:0/771970941 conn(0x7f3e88070e30 msgr2=0x7f3e880b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 shutdown_connections 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.656+0000 7f3e8e131700 1 -- 172.21.15.26:0/771970941 wait complete. 2023-10-09T11:44:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 131 2023-10-09T11:44:50.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:44:50.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.788+0000 7f95572bd700 1 Processor -- start 2023-10-09T11:44:50.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.788+0000 7f95572bd700 1 -- start start 2023-10-09T11:44:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f95572bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95500cf110 0x7f9550164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f95572bd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955015afd0 con 0x7f955015de50 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f95572bd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955015b2b0 con 0x7f9550153c30 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f95572bd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955015b590 con 0x7f95500cf110 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9556abc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95500cf110 0x7f9550164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9555aba700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f955015de50 0x7f95500cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44568/0 (socket says 172.21.15.26:44568) 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9555aba700 1 -- 172.21.15.26:0/4000775641 learned_addr learned my addr 172.21.15.26:0/4000775641 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9556abc700 1 -- 172.21.15.26:0/4000775641 >> v1:172.21.15.67:6789/0 conn(0x7f9550153c30 legacy=0x7f955015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9556abc700 1 -- 172.21.15.26:0/4000775641 >> v1:172.21.15.26:6789/0 conn(0x7f955015de50 legacy=0x7f95500cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f9556abc700 1 -- 172.21.15.26:0/4000775641 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955015b870 con 0x7f95500cf110 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.789+0000 7f95552b9700 1 -- 172.21.15.26:0/4000775641 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469932029 0 0) 0x7f955015afd0 con 0x7f955015de50 2023-10-09T11:44:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f9556abc700 1 --2- 172.21.15.26:0/4000775641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95500cf110 0x7f9550164600 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9548009e60 tx=0x7f9548009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b67c2c767425c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95552b9700 1 -- 172.21.15.26:0/4000775641 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954800e070 con 0x7f95500cf110 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95552b9700 1 -- 172.21.15.26:0/4000775641 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954800bc30 con 0x7f95500cf110 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95552b9700 1 -- 172.21.15.26:0/4000775641 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548012430 con 0x7f95500cf110 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 -- 172.21.15.26:0/4000775641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95500cf110 msgr2=0x7f9550164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 --2- 172.21.15.26:0/4000775641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95500cf110 0x7f9550164600 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9548009e60 tx=0x7f9548009780 comp rx=0 tx=0).stop 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 -- 172.21.15.26:0/4000775641 shutdown_connections 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 --2- 172.21.15.26:0/4000775641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95500cf110 0x7f9550164600 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 -- 172.21.15.26:0/4000775641 >> 172.21.15.26:0/4000775641 conn(0x7f95500703a0 msgr2=0x7f95500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 -- 172.21.15.26:0/4000775641 shutdown_connections 2023-10-09T11:44:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.790+0000 7f95572bd700 1 -- 172.21.15.26:0/4000775641 wait complete. 2023-10-09T11:44:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.791+0000 7f95572bd700 1 Processor -- start 2023-10-09T11:44:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.791+0000 7f95572bd700 1 -- start start 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 0x7f95501693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9550153c30 0x7f9550158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500b4480 con 0x7f955015de50 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500b3870 con 0x7f9550153c30 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95572bd700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95500b3b50 con 0x7f95500cf110 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f9556abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f9556abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58524/0 (socket says 172.21.15.26:58524) 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f9556abc700 1 -- 172.21.15.26:0/2487130590 learned_addr learned my addr 172.21.15.26:0/2487130590 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f9555aba700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9550153c30 0x7f9550158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f95562bb700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 0x7f95501693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.792+0000 7f9556abc700 1 -- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 msgr2=0x7f95501693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f9556abc700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 0x7f95501693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f9556abc700 1 -- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9550153c30 msgr2=0x7f9550158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f9556abc700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9550153c30 0x7f9550158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f9556abc700 1 -- 172.21.15.26:0/2487130590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548009a20 con 0x7f955015de50 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f95562bb700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 0x7f95501693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f9556abc700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9548013000 tx=0x7f9548019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954801b630 con 0x7f955015de50 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954801b7b0 con 0x7f955015de50 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500b3e30 con 0x7f955015de50 2023-10-09T11:44:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954801bb70 con 0x7f955015de50 2023-10-09T11:44:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.793+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95500c7310 con 0x7f955015de50 2023-10-09T11:44:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.794+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95500b4630 con 0x7f955015de50 2023-10-09T11:44:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.794+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9548003020 con 0x7f955015de50 2023-10-09T11:44:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.795+0000 7f954e7fc700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 0x7f953c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.795+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9548086910 con 0x7f955015de50 2023-10-09T11:44:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.795+0000 7f95562bb700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 0x7f953c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.795+0000 7f95562bb700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 0x7f953c069800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9540007fd0 tx=0x7f9540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.799+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95500b4630 con 0x7f955015de50 2023-10-09T11:44:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.992+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955004c3c0 con 0x7f955015de50 2023-10-09T11:44:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.993+0000 7f954e7fc700 1 -- 172.21.15.26:0/2487130590 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f954802a020 con 0x7f955015de50 2023-10-09T11:44:50.995 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:50.995 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":198,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:44:48.251491+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:44:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 msgr2=0x7f953c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 0x7f953c069800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9540007fd0 tx=0x7f9540009040 comp rx=0 tx=0).stop 2023-10-09T11:44:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 msgr2=0x7f95500b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9548013000 tx=0x7f9548019000 comp rx=0 tx=0).stop 2023-10-09T11:44:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 shutdown_connections 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955015de50 0x7f95500b5500 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f953c067350 0x7f953c069800 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f95500cf110 0x7f95501693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 --2- 172.21.15.26:0/2487130590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9550153c30 0x7f9550158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 >> 172.21.15.26:0/2487130590 conn(0x7f95500703a0 msgr2=0x7f95500cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 shutdown_connections 2023-10-09T11:44:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:50.995+0000 7f95572bd700 1 -- 172.21.15.26:0/2487130590 wait complete. 2023-10-09T11:44:51.009 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:44:51.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.126+0000 7fbf7d1c5700 1 Processor -- start 2023-10-09T11:44:51.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.126+0000 7fbf7d1c5700 1 -- start start 2023-10-09T11:44:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7d1c5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf780a8be0 0x7fbf780a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7d1c5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf7806d280 0x7fbf780b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7d1c5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780ce1a0 con 0x7fbf780ae780 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7d1c5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780cd5d0 con 0x7fbf780a8be0 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7d1c5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780cd870 con 0x7fbf7806d280 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7759e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf780ae780 0x7fbf780cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44572/0 (socket says 172.21.15.26:44572) 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.127+0000 7fbf7759e700 1 -- 172.21.15.26:0/4138587115 learned_addr learned my addr 172.21.15.26:0/4138587115 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/4138587115 >> v2:172.21.15.67:3300/0 conn(0x7fbf780a8be0 0x7fbf780a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf7659c700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf7806d280 0x7fbf780b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639606410 0 0) 0x7fbf780ce1a0 con 0x7fbf780ae780 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf64003570 con 0x7fbf780ae780 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567672500 0 0) 0x7fbf64003570 con 0x7fbf780ae780 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 -- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf7806d280 msgr2=0x7fbf780b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf7806d280 0x7fbf780b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 -- 172.21.15.26:0/4138587115 >> v1:172.21.15.26:6789/0 conn(0x7fbf780ae780 legacy=0x7fbf780cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 -- 172.21.15.26:0/4138587115 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780cdb50 con 0x7fbf780a8be0 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780a8be0 0x7fbf780a8fb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbf700098d0 tx=0x7fbf70009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389547bbbedcadaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680017f0 con 0x7fbf780a8be0 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70011420 con 0x7fbf780a8be0 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.128+0000 7fbf75d9b700 1 -- 172.21.15.26:0/4138587115 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700117a0 con 0x7fbf780a8be0 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780a8be0 msgr2=0x7fbf780a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780a8be0 0x7fbf780a8fb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbf700098d0 tx=0x7fbf70009120 comp rx=0 tx=0).stop 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/4138587115 shutdown_connections 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780a8be0 0x7fbf780a8fb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/4138587115 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf7806d280 0x7fbf780b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/4138587115 >> 172.21.15.26:0/4138587115 conn(0x7fbf7806ce80 msgr2=0x7fbf780ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/4138587115 shutdown_connections 2023-10-09T11:44:51.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.129+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/4138587115 wait complete. 2023-10-09T11:44:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.130+0000 7fbf7d1c5700 1 Processor -- start 2023-10-09T11:44:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.130+0000 7fbf7d1c5700 1 -- start start 2023-10-09T11:44:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 0x7fbf78159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780ae780 0x7fbf7815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780acc70 con 0x7fbf7806d280 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7814ff80 con 0x7fbf780ae780 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7d1c5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780abbd0 con 0x7fbf780a8be0 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf76d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf76d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58540/0 (socket says 172.21.15.26:58540) 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf76d9d700 1 -- 172.21.15.26:0/255626648 learned_addr learned my addr 172.21.15.26:0/255626648 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7759e700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780ae780 0x7fbf7815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf7659c700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 0x7fbf78159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf76d9d700 1 -- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 msgr2=0x7fbf78159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.131+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 0x7fbf78159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf76d9d700 1 -- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780ae780 msgr2=0x7fbf7815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780ae780 0x7fbf7815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf76d9d700 1 -- 172.21.15.26:0/255626648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf700093c0 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf7659c700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 0x7fbf78159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf76d9d700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbf7806aa60 tx=0x7fbf70016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7001cc60 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780abeb0 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7001cdc0 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7001a680 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.132+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf780ac470 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.133+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7804c3c0 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.133+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbf7001a9f0 con 0x7fbf7806d280 2023-10-09T11:44:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.134+0000 7fbf6effd700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 0x7fbf580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.134+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf700865f0 con 0x7fbf7806d280 2023-10-09T11:44:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.134+0000 7fbf7659c700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 0x7fbf580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.134+0000 7fbf7659c700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 0x7fbf580697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbf780a9060 tx=0x7fbf60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.138+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf70053380 con 0x7fbf7806d280 2023-10-09T11:44:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.327+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf780acff0 con 0x7fbf58067320 2023-10-09T11:44:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.337+0000 7fbf6effd700 1 -- 172.21.15.26:0/255626648 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289731 (secure 0 0 0) 0x7fbf780acff0 con 0x7fbf58067320 2023-10-09T11:44:51.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 msgr2=0x7fbf580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 0x7fbf580697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbf780a9060 tx=0x7fbf60008040 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 msgr2=0x7fbf7814fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbf7806aa60 tx=0x7fbf70016000 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 shutdown_connections 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf780ae780 0x7fbf7815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf7806d280 0x7fbf7814fa40 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fbf58067320 0x7fbf580697d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 --2- 172.21.15.26:0/255626648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbf780a8be0 0x7fbf78159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 >> 172.21.15.26:0/255626648 conn(0x7fbf7806ce80 msgr2=0x7fbf780aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 shutdown_connections 2023-10-09T11:44:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.339+0000 7fbf7d1c5700 1 -- 172.21.15.26:0/255626648 wait complete. 2023-10-09T11:44:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:51.353 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2023-10-09T11:44:51.242947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444232,"kb_used_data":20872,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530488,"statfs":{"total":773094113280,"available":770591219712,"internally_reserved":0,"allocated":21372928,"data_stored":10239468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001208"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275621+0000","last_change":"2023-10-09T11:44:47.274128+0000","last_active":"2023-10-09T11:44:47.275621+0000","last_peered":"2023-10-09T11:44:47.275621+0000","last_clean":"2023-10-09T11:44:47.275621+0000","last_became_active":"2023-10-09T11:44:47.273421+0000","last_became_peered":"2023-10-09T11:44:47.273421+0000","last_unstale":"2023-10-09T11:44:47.275621+0000","last_undegraded":"2023-10-09T11:44:47.275621+0000","last_fullsized":"2023-10-09T11:44:47.275621+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:38.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264670+0000","last_change":"2023-10-09T11:44:47.261314+0000","last_active":"2023-10-09T11:44:47.264670+0000","last_peered":"2023-10-09T11:44:47.264670+0000","last_clean":"2023-10-09T11:44:47.264670+0000","last_became_active":"2023-10-09T11:44:47.261060+0000","last_became_peered":"2023-10-09T11:44:47.261060+0000","last_unstale":"2023-10-09T11:44:47.264670+0000","last_undegraded":"2023-10-09T11:44:47.264670+0000","last_fullsized":"2023-10-09T11:44:47.264670+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:09.969313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264274+0000","last_change":"2023-10-09T11:44:47.261666+0000","last_active":"2023-10-09T11:44:47.264274+0000","last_peered":"2023-10-09T11:44:47.264274+0000","last_clean":"2023-10-09T11:44:47.264274+0000","last_became_active":"2023-10-09T11:44:47.261419+0000","last_became_peered":"2023-10-09T11:44:47.261419+0000","last_unstale":"2023-10-09T11:44:47.264274+0000","last_undegraded":"2023-10-09T11:44:47.264274+0000","last_fullsized":"2023-10-09T11:44:47.264274+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:15.726932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263403+0000","last_change":"2023-10-09T11:44:47.259680+0000","last_active":"2023-10-09T11:44:47.263403+0000","last_peered":"2023-10-09T11:44:47.263403+0000","last_clean":"2023-10-09T11:44:47.263403+0000","last_became_active":"2023-10-09T11:44:47.259401+0000","last_became_peered":"2023-10-09T11:44:47.259401+0000","last_unstale":"2023-10-09T11:44:47.263403+0000","last_undegraded":"2023-10-09T11:44:47.263403+0000","last_fullsized":"2023-10-09T11:44:47.263403+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:11.379202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269406+0000","last_change":"2023-10-09T11:44:47.263631+0000","last_active":"2023-10-09T11:44:47.269406+0000","last_peered":"2023-10-09T11:44:47.269406+0000","last_clean":"2023-10-09T11:44:47.269406+0000","last_became_active":"2023-10-09T11:44:47.262814+0000","last_became_peered":"2023-10-09T11:44:47.262814+0000","last_unstale":"2023-10-09T11:44:47.269406+0000","last_undegraded":"2023-10-09T11:44:47.269406+0000","last_fullsized":"2023-10-09T11:44:47.269406+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:54.729889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.261401+0000","last_change":"2023-10-09T11:44:47.258045+0000","last_active":"2023-10-09T11:44:47.261401+0000","last_peered":"2023-10-09T11:44:47.261401+0000","last_clean":"2023-10-09T11:44:47.261401+0000","last_became_active":"2023-10-09T11:44:47.255306+0000","last_became_peered":"2023-10-09T11:44:47.255306+0000","last_unstale":"2023-10-09T11:44:47.261401+0000","last_undegraded":"2023-10-09T11:44:47.261401+0000","last_fullsized":"2023-10-09T11:44:47.261401+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:14.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265512+0000","last_change":"2023-10-09T11:44:47.264842+0000","last_active":"2023-10-09T11:44:47.265512+0000","last_peered":"2023-10-09T11:44:47.265512+0000","last_clean":"2023-10-09T11:44:47.265512+0000","last_became_active":"2023-10-09T11:44:47.264537+0000","last_became_peered":"2023-10-09T11:44:47.264537+0000","last_unstale":"2023-10-09T11:44:47.265512+0000","last_undegraded":"2023-10-09T11:44:47.265512+0000","last_fullsized":"2023-10-09T11:44:47.265512+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:14.130024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263278+0000","last_change":"2023-10-09T11:44:47.258489+0000","last_active":"2023-10-09T11:44:47.263278+0000","last_peered":"2023-10-09T11:44:47.263278+0000","last_clean":"2023-10-09T11:44:47.263278+0000","last_became_active":"2023-10-09T11:44:47.258225+0000","last_became_peered":"2023-10-09T11:44:47.258225+0000","last_unstale":"2023-10-09T11:44:47.263278+0000","last_undegraded":"2023-10-09T11:44:47.263278+0000","last_fullsized":"2023-10-09T11:44:47.263278+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:09.969313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265675+0000","last_change":"2023-10-09T11:44:47.263887+0000","last_active":"2023-10-09T11:44:47.265675+0000","last_peered":"2023-10-09T11:44:47.265675+0000","last_clean":"2023-10-09T11:44:47.265675+0000","last_became_active":"2023-10-09T11:44:47.263625+0000","last_became_peered":"2023-10-09T11:44:47.263625+0000","last_unstale":"2023-10-09T11:44:47.265675+0000","last_undegraded":"2023-10-09T11:44:47.265675+0000","last_fullsized":"2023-10-09T11:44:47.265675+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:13.215461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272575+0000","last_change":"2023-10-09T11:44:47.265079+0000","last_active":"2023-10-09T11:44:47.272575+0000","last_peered":"2023-10-09T11:44:47.272575+0000","last_clean":"2023-10-09T11:44:47.272575+0000","last_became_active":"2023-10-09T11:44:47.264820+0000","last_became_peered":"2023-10-09T11:44:47.264820+0000","last_unstale":"2023-10-09T11:44:47.272575+0000","last_undegraded":"2023-10-09T11:44:47.272575+0000","last_fullsized":"2023-10-09T11:44:47.272575+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:13.432756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275527+0000","last_change":"2023-10-09T11:44:47.272686+0000","last_active":"2023-10-09T11:44:47.275527+0000","last_peered":"2023-10-09T11:44:47.275527+0000","last_clean":"2023-10-09T11:44:47.275527+0000","last_became_active":"2023-10-09T11:44:47.272450+0000","last_became_peered":"2023-10-09T11:44:47.272450+0000","last_unstale":"2023-10-09T11:44:47.275527+0000","last_undegraded":"2023-10-09T11:44:47.275527+0000","last_fullsized":"2023-10-09T11:44:47.275527+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:27.711726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269454+0000","last_change":"2023-10-09T11:44:47.267327+0000","last_active":"2023-10-09T11:44:47.269454+0000","last_peered":"2023-10-09T11:44:47.269454+0000","last_clean":"2023-10-09T11:44:47.269454+0000","last_became_active":"2023-10-09T11:44:47.266553+0000","last_became_peered":"2023-10-09T11:44:47.266553+0000","last_unstale":"2023-10-09T11:44:47.269454+0000","last_undegraded":"2023-10-09T11:44:47.269454+0000","last_fullsized":"2023-10-09T11:44:47.269454+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:40.967960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271384+0000","last_change":"2023-10-09T11:44:47.268750+0000","last_active":"2023-10-09T11:44:47.271384+0000","last_peered":"2023-10-09T11:44:47.271384+0000","last_clean":"2023-10-09T11:44:47.271384+0000","last_became_active":"2023-10-09T11:44:47.268496+0000","last_became_peered":"2023-10-09T11:44:47.268496+0000","last_unstale":"2023-10-09T11:44:47.271384+0000","last_undegraded":"2023-10-09T11:44:47.271384+0000","last_fullsized":"2023-10-09T11:44:47.271384+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:41.352820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272043+0000","last_change":"2023-10-09T11:44:47.270068+0000","last_active":"2023-10-09T11:44:47.272043+0000","last_peered":"2023-10-09T11:44:47.272043+0000","last_clean":"2023-10-09T11:44:47.272043+0000","last_became_active":"2023-10-09T11:44:47.266120+0000","last_became_peered":"2023-10-09T11:44:47.266120+0000","last_unstale":"2023-10-09T11:44:47.272043+0000","last_undegraded":"2023-10-09T11:44:47.272043+0000","last_fullsized":"2023-10-09T11:44:47.272043+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:29.337907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273579+0000","last_change":"2023-10-09T11:44:47.267279+0000","last_active":"2023-10-09T11:44:47.273579+0000","last_peered":"2023-10-09T11:44:47.273579+0000","last_clean":"2023-10-09T11:44:47.273579+0000","last_became_active":"2023-10-09T11:44:47.266772+0000","last_became_peered":"2023-10-09T11:44:47.266772+0000","last_unstale":"2023-10-09T11:44:47.273579+0000","last_undegraded":"2023-10-09T11:44:47.273579+0000","last_fullsized":"2023-10-09T11:44:47.273579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.054918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268832+0000","last_change":"2023-10-09T11:44:47.258634+0000","last_active":"2023-10-09T11:44:47.268832+0000","last_peered":"2023-10-09T11:44:47.268832+0000","last_clean":"2023-10-09T11:44:47.268832+0000","last_became_active":"2023-10-09T11:44:47.258351+0000","last_became_peered":"2023-10-09T11:44:47.258351+0000","last_unstale":"2023-10-09T11:44:47.268832+0000","last_undegraded":"2023-10-09T11:44:47.268832+0000","last_fullsized":"2023-10-09T11:44:47.268832+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:44.540119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272695+0000","last_change":"2023-10-09T11:44:47.268611+0000","last_active":"2023-10-09T11:44:47.272695+0000","last_peered":"2023-10-09T11:44:47.272695+0000","last_clean":"2023-10-09T11:44:47.272695+0000","last_became_active":"2023-10-09T11:44:47.268002+0000","last_became_peered":"2023-10-09T11:44:47.268002+0000","last_unstale":"2023-10-09T11:44:47.272695+0000","last_undegraded":"2023-10-09T11:44:47.272695+0000","last_fullsized":"2023-10-09T11:44:47.272695+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:48.393484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.267614+0000","last_change":"2023-10-09T11:44:47.265412+0000","last_active":"2023-10-09T11:44:47.267614+0000","last_peered":"2023-10-09T11:44:47.267614+0000","last_clean":"2023-10-09T11:44:47.267614+0000","last_became_active":"2023-10-09T11:44:47.264027+0000","last_became_peered":"2023-10-09T11:44:47.264027+0000","last_unstale":"2023-10-09T11:44:47.267614+0000","last_undegraded":"2023-10-09T11:44:47.267614+0000","last_fullsized":"2023-10-09T11:44:47.267614+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:14.130024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275042+0000","last_change":"2023-10-09T11:44:47.273501+0000","last_active":"2023-10-09T11:44:47.275042+0000","last_peered":"2023-10-09T11:44:47.275042+0000","last_clean":"2023-10-09T11:44:47.275042+0000","last_became_active":"2023-10-09T11:44:47.273199+0000","last_became_peered":"2023-10-09T11:44:47.273199+0000","last_unstale":"2023-10-09T11:44:47.275042+0000","last_undegraded":"2023-10-09T11:44:47.275042+0000","last_fullsized":"2023-10-09T11:44:47.275042+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:01.680921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269417+0000","last_change":"2023-10-09T11:44:47.266832+0000","last_active":"2023-10-09T11:44:47.269417+0000","last_peered":"2023-10-09T11:44:47.269417+0000","last_clean":"2023-10-09T11:44:47.269417+0000","last_became_active":"2023-10-09T11:44:47.265832+0000","last_became_peered":"2023-10-09T11:44:47.265832+0000","last_unstale":"2023-10-09T11:44:47.269417+0000","last_undegraded":"2023-10-09T11:44:47.269417+0000","last_fullsized":"2023-10-09T11:44:47.269417+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:23.527138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271170+0000","last_change":"2023-10-09T11:44:47.266578+0000","last_active":"2023-10-09T11:44:47.271170+0000","last_peered":"2023-10-09T11:44:47.271170+0000","last_clean":"2023-10-09T11:44:47.271170+0000","last_became_active":"2023-10-09T11:44:47.266272+0000","last_became_peered":"2023-10-09T11:44:47.266272+0000","last_unstale":"2023-10-09T11:44:47.271170+0000","last_undegraded":"2023-10-09T11:44:47.271170+0000","last_fullsized":"2023-10-09T11:44:47.271170+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.193647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271881+0000","last_change":"2023-10-09T11:44:47.268325+0000","last_active":"2023-10-09T11:44:47.271881+0000","last_peered":"2023-10-09T11:44:47.271881+0000","last_clean":"2023-10-09T11:44:47.271881+0000","last_became_active":"2023-10-09T11:44:47.267536+0000","last_became_peered":"2023-10-09T11:44:47.267536+0000","last_unstale":"2023-10-09T11:44:47.271881+0000","last_undegraded":"2023-10-09T11:44:47.271881+0000","last_fullsized":"2023-10-09T11:44:47.271881+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:22.573497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273556+0000","last_change":"2023-10-09T11:44:47.267061+0000","last_active":"2023-10-09T11:44:47.273556+0000","last_peered":"2023-10-09T11:44:47.273556+0000","last_clean":"2023-10-09T11:44:47.273556+0000","last_became_active":"2023-10-09T11:44:47.266430+0000","last_became_peered":"2023-10-09T11:44:47.266430+0000","last_unstale":"2023-10-09T11:44:47.273556+0000","last_undegraded":"2023-10-09T11:44:47.273556+0000","last_fullsized":"2023-10-09T11:44:47.273556+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:59.352866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271910+0000","last_change":"2023-10-09T11:44:47.267780+0000","last_active":"2023-10-09T11:44:47.271910+0000","last_peered":"2023-10-09T11:44:47.271910+0000","last_clean":"2023-10-09T11:44:47.271910+0000","last_became_active":"2023-10-09T11:44:47.267442+0000","last_became_peered":"2023-10-09T11:44:47.267442+0000","last_unstale":"2023-10-09T11:44:47.271910+0000","last_undegraded":"2023-10-09T11:44:47.271910+0000","last_fullsized":"2023-10-09T11:44:47.271910+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:10.641334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263409+0000","last_change":"2023-10-09T11:44:47.256071+0000","last_active":"2023-10-09T11:44:47.263409+0000","last_peered":"2023-10-09T11:44:47.263409+0000","last_clean":"2023-10-09T11:44:47.263409+0000","last_became_active":"2023-10-09T11:44:47.255780+0000","last_became_peered":"2023-10-09T11:44:47.255780+0000","last_unstale":"2023-10-09T11:44:47.263409+0000","last_undegraded":"2023-10-09T11:44:47.263409+0000","last_fullsized":"2023-10-09T11:44:47.263409+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:40.082458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269548+0000","last_change":"2023-10-09T11:44:47.263896+0000","last_active":"2023-10-09T11:44:47.269548+0000","last_peered":"2023-10-09T11:44:47.269548+0000","last_clean":"2023-10-09T11:44:47.269548+0000","last_became_active":"2023-10-09T11:44:47.263648+0000","last_became_peered":"2023-10-09T11:44:47.263648+0000","last_unstale":"2023-10-09T11:44:47.269548+0000","last_undegraded":"2023-10-09T11:44:47.269548+0000","last_fullsized":"2023-10-09T11:44:47.269548+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.431753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275413+0000","last_change":"2023-10-09T11:44:47.272049+0000","last_active":"2023-10-09T11:44:47.275413+0000","last_peered":"2023-10-09T11:44:47.275413+0000","last_clean":"2023-10-09T11:44:47.275413+0000","last_became_active":"2023-10-09T11:44:47.271393+0000","last_became_peered":"2023-10-09T11:44:47.271393+0000","last_unstale":"2023-10-09T11:44:47.275413+0000","last_undegraded":"2023-10-09T11:44:47.275413+0000","last_fullsized":"2023-10-09T11:44:47.275413+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:53.905366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275542+0000","last_change":"2023-10-09T11:44:47.272749+0000","last_active":"2023-10-09T11:44:47.275542+0000","last_peered":"2023-10-09T11:44:47.275542+0000","last_clean":"2023-10-09T11:44:47.275542+0000","last_became_active":"2023-10-09T11:44:47.272421+0000","last_became_peered":"2023-10-09T11:44:47.272421+0000","last_unstale":"2023-10-09T11:44:47.275542+0000","last_undegraded":"2023-10-09T11:44:47.275542+0000","last_fullsized":"2023-10-09T11:44:47.275542+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:12.799720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266167+0000","last_change":"2023-10-09T11:44:47.265158+0000","last_active":"2023-10-09T11:44:47.266167+0000","last_peered":"2023-10-09T11:44:47.266167+0000","last_clean":"2023-10-09T11:44:47.266167+0000","last_became_active":"2023-10-09T11:44:47.264912+0000","last_became_peered":"2023-10-09T11:44:47.264912+0000","last_unstale":"2023-10-09T11:44:47.266167+0000","last_undegraded":"2023-10-09T11:44:47.266167+0000","last_fullsized":"2023-10-09T11:44:47.266167+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:27.038531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269179+0000","last_change":"2023-10-09T11:44:47.262533+0000","last_active":"2023-10-09T11:44:47.269179+0000","last_peered":"2023-10-09T11:44:47.269179+0000","last_clean":"2023-10-09T11:44:47.269179+0000","last_became_active":"2023-10-09T11:44:47.262266+0000","last_became_peered":"2023-10-09T11:44:47.262266+0000","last_unstale":"2023-10-09T11:44:47.269179+0000","last_undegraded":"2023-10-09T11:44:47.269179+0000","last_fullsized":"2023-10-09T11:44:47.269179+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:12.391841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269974+0000","last_change":"2023-10-09T11:44:47.265221+0000","last_active":"2023-10-09T11:44:47.269974+0000","last_peered":"2023-10-09T11:44:47.269974+0000","last_clean":"2023-10-09T11:44:47.269974+0000","last_became_active":"2023-10-09T11:44:47.264962+0000","last_became_peered":"2023-10-09T11:44:47.264962+0000","last_unstale":"2023-10-09T11:44:47.269974+0000","last_undegraded":"2023-10-09T11:44:47.269974+0000","last_fullsized":"2023-10-09T11:44:47.269974+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:44.319105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272414+0000","last_change":"2023-10-09T11:44:47.260042+0000","last_active":"2023-10-09T11:44:47.272414+0000","last_peered":"2023-10-09T11:44:47.272414+0000","last_clean":"2023-10-09T11:44:47.272414+0000","last_became_active":"2023-10-09T11:44:47.259780+0000","last_became_peered":"2023-10-09T11:44:47.259780+0000","last_unstale":"2023-10-09T11:44:47.272414+0000","last_undegraded":"2023-10-09T11:44:47.272414+0000","last_fullsized":"2023-10-09T11:44:47.272414+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:38.766995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"197'4","reported_seq":14,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268723+0000","last_change":"2023-10-09T11:44:46.262156+0000","last_active":"2023-10-09T11:44:47.268723+0000","last_peered":"2023-10-09T11:44:47.268723+0000","last_clean":"2023-10-09T11:44:47.268723+0000","last_became_active":"2023-10-09T11:44:46.261796+0000","last_became_peered":"2023-10-09T11:44:46.261796+0000","last_unstale":"2023-10-09T11:44:47.268723+0000","last_undegraded":"2023-10-09T11:44:47.268723+0000","last_fullsized":"2023-10-09T11:44:47.268723+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:16.108432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273276+0000","last_change":"2023-10-09T11:44:47.272792+0000","last_active":"2023-10-09T11:44:47.273276+0000","last_peered":"2023-10-09T11:44:47.273276+0000","last_clean":"2023-10-09T11:44:47.273276+0000","last_became_active":"2023-10-09T11:44:47.272519+0000","last_became_peered":"2023-10-09T11:44:47.272519+0000","last_unstale":"2023-10-09T11:44:47.273276+0000","last_undegraded":"2023-10-09T11:44:47.273276+0000","last_fullsized":"2023-10-09T11:44:47.273276+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264185+0000","last_change":"2023-10-09T11:44:46.263402+0000","last_active":"2023-10-09T11:44:47.264185+0000","last_peered":"2023-10-09T11:44:47.264185+0000","last_clean":"2023-10-09T11:44:47.264185+0000","last_became_active":"2023-10-09T11:44:46.263102+0000","last_became_peered":"2023-10-09T11:44:46.263102+0000","last_unstale":"2023-10-09T11:44:47.264185+0000","last_undegraded":"2023-10-09T11:44:47.264185+0000","last_fullsized":"2023-10-09T11:44:47.264185+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:11.066766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.267594+0000","last_change":"2023-10-09T11:44:47.262874+0000","last_active":"2023-10-09T11:44:47.267594+0000","last_peered":"2023-10-09T11:44:47.267594+0000","last_clean":"2023-10-09T11:44:47.267594+0000","last_became_active":"2023-10-09T11:44:47.262599+0000","last_became_peered":"2023-10-09T11:44:47.262599+0000","last_unstale":"2023-10-09T11:44:47.267594+0000","last_undegraded":"2023-10-09T11:44:47.267594+0000","last_fullsized":"2023-10-09T11:44:47.267594+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:15.726932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275269+0000","last_change":"2023-10-09T11:44:46.269396+0000","last_active":"2023-10-09T11:44:47.275269+0000","last_peered":"2023-10-09T11:44:47.275269+0000","last_clean":"2023-10-09T11:44:47.275269+0000","last_became_active":"2023-10-09T11:44:46.269140+0000","last_became_peered":"2023-10-09T11:44:46.269140+0000","last_unstale":"2023-10-09T11:44:47.275269+0000","last_undegraded":"2023-10-09T11:44:47.275269+0000","last_fullsized":"2023-10-09T11:44:47.275269+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:09.360060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272063+0000","last_change":"2023-10-09T11:44:47.270062+0000","last_active":"2023-10-09T11:44:47.272063+0000","last_peered":"2023-10-09T11:44:47.272063+0000","last_clean":"2023-10-09T11:44:47.272063+0000","last_became_active":"2023-10-09T11:44:47.267995+0000","last_became_peered":"2023-10-09T11:44:47.267995+0000","last_unstale":"2023-10-09T11:44:47.272063+0000","last_undegraded":"2023-10-09T11:44:47.272063+0000","last_fullsized":"2023-10-09T11:44:47.272063+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:25.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265381+0000","last_change":"2023-10-09T11:44:46.262769+0000","last_active":"2023-10-09T11:44:47.265381+0000","last_peered":"2023-10-09T11:44:47.265381+0000","last_clean":"2023-10-09T11:44:47.265381+0000","last_became_active":"2023-10-09T11:44:46.262471+0000","last_became_peered":"2023-10-09T11:44:46.262471+0000","last_unstale":"2023-10-09T11:44:47.265381+0000","last_undegraded":"2023-10-09T11:44:47.265381+0000","last_fullsized":"2023-10-09T11:44:47.265381+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:35.195750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269999+0000","last_change":"2023-10-09T11:44:47.266570+0000","last_active":"2023-10-09T11:44:47.269999+0000","last_peered":"2023-10-09T11:44:47.269999+0000","last_clean":"2023-10-09T11:44:47.269999+0000","last_became_active":"2023-10-09T11:44:47.266185+0000","last_became_peered":"2023-10-09T11:44:47.266185+0000","last_unstale":"2023-10-09T11:44:47.269999+0000","last_undegraded":"2023-10-09T11:44:47.269999+0000","last_fullsized":"2023-10-09T11:44:47.269999+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:26.442052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263454+0000","last_change":"2023-10-09T11:44:46.256943+0000","last_active":"2023-10-09T11:44:47.263454+0000","last_peered":"2023-10-09T11:44:47.263454+0000","last_clean":"2023-10-09T11:44:47.263454+0000","last_became_active":"2023-10-09T11:44:46.256668+0000","last_became_peered":"2023-10-09T11:44:46.256668+0000","last_unstale":"2023-10-09T11:44:47.263454+0000","last_undegraded":"2023-10-09T11:44:47.263454+0000","last_fullsized":"2023-10-09T11:44:47.263454+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269528+0000","last_change":"2023-10-09T11:44:47.264295+0000","last_active":"2023-10-09T11:44:47.269528+0000","last_peered":"2023-10-09T11:44:47.269528+0000","last_clean":"2023-10-09T11:44:47.269528+0000","last_became_active":"2023-10-09T11:44:47.261582+0000","last_became_peered":"2023-10-09T11:44:47.261582+0000","last_unstale":"2023-10-09T11:44:47.269528+0000","last_undegraded":"2023-10-09T11:44:47.269528+0000","last_fullsized":"2023-10-09T11:44:47.269528+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:41.352820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272107+0000","last_change":"2023-10-09T11:44:46.256622+0000","last_active":"2023-10-09T11:44:47.272107+0000","last_peered":"2023-10-09T11:44:47.272107+0000","last_clean":"2023-10-09T11:44:47.272107+0000","last_became_active":"2023-10-09T11:44:46.255103+0000","last_became_peered":"2023-10-09T11:44:46.255103+0000","last_unstale":"2023-10-09T11:44:47.272107+0000","last_undegraded":"2023-10-09T11:44:47.272107+0000","last_fullsized":"2023-10-09T11:44:47.272107+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:55.276316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264172+0000","last_change":"2023-10-09T11:44:47.262285+0000","last_active":"2023-10-09T11:44:47.264172+0000","last_peered":"2023-10-09T11:44:47.264172+0000","last_clean":"2023-10-09T11:44:47.264172+0000","last_became_active":"2023-10-09T11:44:47.261995+0000","last_became_peered":"2023-10-09T11:44:47.261995+0000","last_unstale":"2023-10-09T11:44:47.264172+0000","last_undegraded":"2023-10-09T11:44:47.264172+0000","last_fullsized":"2023-10-09T11:44:47.264172+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248797+0000","last_change":"2023-10-09T11:44:46.264339+0000","last_active":"2023-10-09T11:44:47.248797+0000","last_peered":"2023-10-09T11:44:47.248797+0000","last_clean":"2023-10-09T11:44:47.248797+0000","last_became_active":"2023-10-09T11:44:46.264066+0000","last_became_peered":"2023-10-09T11:44:46.264066+0000","last_unstale":"2023-10-09T11:44:47.248797+0000","last_undegraded":"2023-10-09T11:44:47.248797+0000","last_fullsized":"2023-10-09T11:44:47.248797+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:00.425964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264922+0000","last_change":"2023-10-09T11:44:47.260753+0000","last_active":"2023-10-09T11:44:47.264922+0000","last_peered":"2023-10-09T11:44:47.264922+0000","last_clean":"2023-10-09T11:44:47.264922+0000","last_became_active":"2023-10-09T11:44:47.260455+0000","last_became_peered":"2023-10-09T11:44:47.260455+0000","last_unstale":"2023-10-09T11:44:47.264922+0000","last_undegraded":"2023-10-09T11:44:47.264922+0000","last_fullsized":"2023-10-09T11:44:47.264922+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:59.352866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246324+0000","last_change":"2023-10-09T11:44:46.261022+0000","last_active":"2023-10-09T11:44:47.246324+0000","last_peered":"2023-10-09T11:44:47.246324+0000","last_clean":"2023-10-09T11:44:47.246324+0000","last_became_active":"2023-10-09T11:44:46.260688+0000","last_became_peered":"2023-10-09T11:44:46.260688+0000","last_unstale":"2023-10-09T11:44:47.246324+0000","last_undegraded":"2023-10-09T11:44:47.246324+0000","last_fullsized":"2023-10-09T11:44:47.246324+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:22.524654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263384+0000","last_change":"2023-10-09T11:44:47.258787+0000","last_active":"2023-10-09T11:44:47.263384+0000","last_peered":"2023-10-09T11:44:47.263384+0000","last_clean":"2023-10-09T11:44:47.263384+0000","last_became_active":"2023-10-09T11:44:47.257995+0000","last_became_peered":"2023-10-09T11:44:47.257995+0000","last_unstale":"2023-10-09T11:44:47.263384+0000","last_undegraded":"2023-10-09T11:44:47.263384+0000","last_fullsized":"2023-10-09T11:44:47.263384+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:02.820695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247293+0000","last_change":"2023-10-09T11:44:46.258790+0000","last_active":"2023-10-09T11:44:47.247293+0000","last_peered":"2023-10-09T11:44:47.247293+0000","last_clean":"2023-10-09T11:44:47.247293+0000","last_became_active":"2023-10-09T11:44:46.257801+0000","last_became_peered":"2023-10-09T11:44:46.257801+0000","last_unstale":"2023-10-09T11:44:47.247293+0000","last_undegraded":"2023-10-09T11:44:47.247293+0000","last_fullsized":"2023-10-09T11:44:47.247293+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:25.439568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264650+0000","last_change":"2023-10-09T11:44:47.259916+0000","last_active":"2023-10-09T11:44:47.264650+0000","last_peered":"2023-10-09T11:44:47.264650+0000","last_clean":"2023-10-09T11:44:47.264650+0000","last_became_active":"2023-10-09T11:44:47.259644+0000","last_became_peered":"2023-10-09T11:44:47.259644+0000","last_unstale":"2023-10-09T11:44:47.264650+0000","last_undegraded":"2023-10-09T11:44:47.264650+0000","last_fullsized":"2023-10-09T11:44:47.264650+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:19.677634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.249613+0000","last_change":"2023-10-09T11:44:46.261860+0000","last_active":"2023-10-09T11:44:47.249613+0000","last_peered":"2023-10-09T11:44:47.249613+0000","last_clean":"2023-10-09T11:44:47.249613+0000","last_became_active":"2023-10-09T11:44:46.261582+0000","last_became_peered":"2023-10-09T11:44:46.261582+0000","last_unstale":"2023-10-09T11:44:47.249613+0000","last_undegraded":"2023-10-09T11:44:47.249613+0000","last_fullsized":"2023-10-09T11:44:47.249613+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:33.797406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268297+0000","last_change":"2023-10-09T11:44:47.265310+0000","last_active":"2023-10-09T11:44:47.268297+0000","last_peered":"2023-10-09T11:44:47.268297+0000","last_clean":"2023-10-09T11:44:47.268297+0000","last_became_active":"2023-10-09T11:44:47.264977+0000","last_became_peered":"2023-10-09T11:44:47.264977+0000","last_unstale":"2023-10-09T11:44:47.268297+0000","last_undegraded":"2023-10-09T11:44:47.268297+0000","last_fullsized":"2023-10-09T11:44:47.268297+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.887268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"197'3","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265593+0000","last_change":"2023-10-09T11:44:46.258002+0000","last_active":"2023-10-09T11:44:47.265593+0000","last_peered":"2023-10-09T11:44:47.265593+0000","last_clean":"2023-10-09T11:44:47.265593+0000","last_became_active":"2023-10-09T11:44:46.257671+0000","last_became_peered":"2023-10-09T11:44:46.257671+0000","last_unstale":"2023-10-09T11:44:47.265593+0000","last_undegraded":"2023-10-09T11:44:47.265593+0000","last_fullsized":"2023-10-09T11:44:47.265593+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:47.809752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275477+0000","last_change":"2023-10-09T11:44:47.272418+0000","last_active":"2023-10-09T11:44:47.275477+0000","last_peered":"2023-10-09T11:44:47.275477+0000","last_clean":"2023-10-09T11:44:47.275477+0000","last_became_active":"2023-10-09T11:44:47.272057+0000","last_became_peered":"2023-10-09T11:44:47.272057+0000","last_unstale":"2023-10-09T11:44:47.275477+0000","last_undegraded":"2023-10-09T11:44:47.275477+0000","last_fullsized":"2023-10-09T11:44:47.275477+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:06.314252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"197'6","reported_seq":16,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275837+0000","last_change":"2023-10-09T11:44:46.263987+0000","last_active":"2023-10-09T11:44:47.275837+0000","last_peered":"2023-10-09T11:44:47.275837+0000","last_clean":"2023-10-09T11:44:47.275837+0000","last_became_active":"2023-10-09T11:44:46.263719+0000","last_became_peered":"2023-10-09T11:44:46.263719+0000","last_unstale":"2023-10-09T11:44:47.275837+0000","last_undegraded":"2023-10-09T11:44:47.275837+0000","last_fullsized":"2023-10-09T11:44:47.275837+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:47.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269658+0000","last_change":"2023-10-09T11:44:47.264295+0000","last_active":"2023-10-09T11:44:47.269658+0000","last_peered":"2023-10-09T11:44:47.269658+0000","last_clean":"2023-10-09T11:44:47.269658+0000","last_became_active":"2023-10-09T11:44:47.263984+0000","last_became_peered":"2023-10-09T11:44:47.263984+0000","last_unstale":"2023-10-09T11:44:47.269658+0000","last_undegraded":"2023-10-09T11:44:47.269658+0000","last_fullsized":"2023-10-09T11:44:47.269658+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:59.158302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275467+0000","last_change":"2023-10-09T11:44:46.264516+0000","last_active":"2023-10-09T11:44:47.275467+0000","last_peered":"2023-10-09T11:44:47.275467+0000","last_clean":"2023-10-09T11:44:47.275467+0000","last_became_active":"2023-10-09T11:44:46.264199+0000","last_became_peered":"2023-10-09T11:44:46.264199+0000","last_unstale":"2023-10-09T11:44:47.275467+0000","last_undegraded":"2023-10-09T11:44:47.275467+0000","last_fullsized":"2023-10-09T11:44:47.275467+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:26.036047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272310+0000","last_change":"2023-10-09T11:44:47.269021+0000","last_active":"2023-10-09T11:44:47.272310+0000","last_peered":"2023-10-09T11:44:47.272310+0000","last_clean":"2023-10-09T11:44:47.272310+0000","last_became_active":"2023-10-09T11:44:47.267496+0000","last_became_peered":"2023-10-09T11:44:47.267496+0000","last_unstale":"2023-10-09T11:44:47.272310+0000","last_undegraded":"2023-10-09T11:44:47.272310+0000","last_fullsized":"2023-10-09T11:44:47.272310+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:16.289953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248095+0000","last_change":"2023-10-09T11:44:46.263598+0000","last_active":"2023-10-09T11:44:47.248095+0000","last_peered":"2023-10-09T11:44:47.248095+0000","last_clean":"2023-10-09T11:44:47.248095+0000","last_became_active":"2023-10-09T11:44:46.263323+0000","last_became_peered":"2023-10-09T11:44:46.263323+0000","last_unstale":"2023-10-09T11:44:47.248095+0000","last_undegraded":"2023-10-09T11:44:47.248095+0000","last_fullsized":"2023-10-09T11:44:47.248095+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:03.149760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.270783+0000","last_change":"2023-10-09T11:44:47.267744+0000","last_active":"2023-10-09T11:44:47.270783+0000","last_peered":"2023-10-09T11:44:47.270783+0000","last_clean":"2023-10-09T11:44:47.270783+0000","last_became_active":"2023-10-09T11:44:47.267490+0000","last_became_peered":"2023-10-09T11:44:47.267490+0000","last_unstale":"2023-10-09T11:44:47.270783+0000","last_undegraded":"2023-10-09T11:44:47.270783+0000","last_fullsized":"2023-10-09T11:44:47.270783+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:28.274874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247064+0000","last_change":"2023-10-09T11:44:46.257020+0000","last_active":"2023-10-09T11:44:47.247064+0000","last_peered":"2023-10-09T11:44:47.247064+0000","last_clean":"2023-10-09T11:44:47.247064+0000","last_became_active":"2023-10-09T11:44:46.256729+0000","last_became_peered":"2023-10-09T11:44:46.256729+0000","last_unstale":"2023-10-09T11:44:47.247064+0000","last_undegraded":"2023-10-09T11:44:47.247064+0000","last_fullsized":"2023-10-09T11:44:47.247064+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:06:05.309704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269436+0000","last_change":"2023-10-09T11:44:47.263837+0000","last_active":"2023-10-09T11:44:47.269436+0000","last_peered":"2023-10-09T11:44:47.269436+0000","last_clean":"2023-10-09T11:44:47.269436+0000","last_became_active":"2023-10-09T11:44:47.263216+0000","last_became_peered":"2023-10-09T11:44:47.263216+0000","last_unstale":"2023-10-09T11:44:47.269436+0000","last_undegraded":"2023-10-09T11:44:47.269436+0000","last_fullsized":"2023-10-09T11:44:47.269436+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:39.535020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"197'8","reported_seq":18,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266225+0000","last_change":"2023-10-09T11:44:46.253206+0000","last_active":"2023-10-09T11:44:47.266225+0000","last_peered":"2023-10-09T11:44:47.266225+0000","last_clean":"2023-10-09T11:44:47.266225+0000","last_became_active":"2023-10-09T11:44:46.252862+0000","last_became_peered":"2023-10-09T11:44:46.252862+0000","last_unstale":"2023-10-09T11:44:47.266225+0000","last_undegraded":"2023-10-09T11:44:47.266225+0000","last_fullsized":"2023-10-09T11:44:47.266225+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:32.508881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275442+0000","last_change":"2023-10-09T11:44:47.272093+0000","last_active":"2023-10-09T11:44:47.275442+0000","last_peered":"2023-10-09T11:44:47.275442+0000","last_clean":"2023-10-09T11:44:47.275442+0000","last_became_active":"2023-10-09T11:44:47.271330+0000","last_became_peered":"2023-10-09T11:44:47.271330+0000","last_unstale":"2023-10-09T11:44:47.275442+0000","last_undegraded":"2023-10-09T11:44:47.275442+0000","last_fullsized":"2023-10-09T11:44:47.275442+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:11.272831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266673+0000","last_change":"2023-10-09T11:44:46.262262+0000","last_active":"2023-10-09T11:44:47.266673+0000","last_peered":"2023-10-09T11:44:47.266673+0000","last_clean":"2023-10-09T11:44:47.266673+0000","last_became_active":"2023-10-09T11:44:46.261967+0000","last_became_peered":"2023-10-09T11:44:46.261967+0000","last_unstale":"2023-10-09T11:44:47.266673+0000","last_undegraded":"2023-10-09T11:44:47.266673+0000","last_fullsized":"2023-10-09T11:44:47.266673+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:15.247657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275435+0000","last_change":"2023-10-09T11:44:47.272085+0000","last_active":"2023-10-09T11:44:47.275435+0000","last_peered":"2023-10-09T11:44:47.275435+0000","last_clean":"2023-10-09T11:44:47.275435+0000","last_became_active":"2023-10-09T11:44:47.271786+0000","last_became_peered":"2023-10-09T11:44:47.271786+0000","last_unstale":"2023-10-09T11:44:47.275435+0000","last_undegraded":"2023-10-09T11:44:47.275435+0000","last_fullsized":"2023-10-09T11:44:47.275435+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:25.220598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265575+0000","last_change":"2023-10-09T11:44:46.262491+0000","last_active":"2023-10-09T11:44:47.265575+0000","last_peered":"2023-10-09T11:44:47.265575+0000","last_clean":"2023-10-09T11:44:47.265575+0000","last_became_active":"2023-10-09T11:44:46.261689+0000","last_became_peered":"2023-10-09T11:44:46.261689+0000","last_unstale":"2023-10-09T11:44:47.265575+0000","last_undegraded":"2023-10-09T11:44:47.265575+0000","last_fullsized":"2023-10-09T11:44:47.265575+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:01.858904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271725+0000","last_change":"2023-10-09T11:44:47.270067+0000","last_active":"2023-10-09T11:44:47.271725+0000","last_peered":"2023-10-09T11:44:47.271725+0000","last_clean":"2023-10-09T11:44:47.271725+0000","last_became_active":"2023-10-09T11:44:47.269804+0000","last_became_peered":"2023-10-09T11:44:47.269804+0000","last_unstale":"2023-10-09T11:44:47.271725+0000","last_undegraded":"2023-10-09T11:44:47.271725+0000","last_fullsized":"2023-10-09T11:44:47.271725+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:12.391841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.261403+0000","last_change":"2023-10-09T11:44:46.257653+0000","last_active":"2023-10-09T11:44:47.261403+0000","last_peered":"2023-10-09T11:44:47.261403+0000","last_clean":"2023-10-09T11:44:47.261403+0000","last_became_active":"2023-10-09T11:44:46.257242+0000","last_became_peered":"2023-10-09T11:44:46.257242+0000","last_unstale":"2023-10-09T11:44:47.261403+0000","last_undegraded":"2023-10-09T11:44:47.261403+0000","last_fullsized":"2023-10-09T11:44:47.261403+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:16.108432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275671+0000","last_change":"2023-10-09T11:44:47.274334+0000","last_active":"2023-10-09T11:44:47.275671+0000","last_peered":"2023-10-09T11:44:47.275671+0000","last_clean":"2023-10-09T11:44:47.275671+0000","last_became_active":"2023-10-09T11:44:47.273759+0000","last_became_peered":"2023-10-09T11:44:47.273759+0000","last_unstale":"2023-10-09T11:44:47.275671+0000","last_undegraded":"2023-10-09T11:44:47.275671+0000","last_fullsized":"2023-10-09T11:44:47.275671+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:09.831971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247465+0000","last_change":"2023-10-09T11:44:46.258580+0000","last_active":"2023-10-09T11:44:47.247465+0000","last_peered":"2023-10-09T11:44:47.247465+0000","last_clean":"2023-10-09T11:44:47.247465+0000","last_became_active":"2023-10-09T11:44:46.257372+0000","last_became_peered":"2023-10-09T11:44:46.257372+0000","last_unstale":"2023-10-09T11:44:47.247465+0000","last_undegraded":"2023-10-09T11:44:47.247465+0000","last_fullsized":"2023-10-09T11:44:47.247465+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:46.030793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271754+0000","last_change":"2023-10-09T11:44:47.267886+0000","last_active":"2023-10-09T11:44:47.271754+0000","last_peered":"2023-10-09T11:44:47.271754+0000","last_clean":"2023-10-09T11:44:47.271754+0000","last_became_active":"2023-10-09T11:44:47.267620+0000","last_became_peered":"2023-10-09T11:44:47.267620+0000","last_unstale":"2023-10-09T11:44:47.271754+0000","last_undegraded":"2023-10-09T11:44:47.271754+0000","last_fullsized":"2023-10-09T11:44:47.271754+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:50.602320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266023+0000","last_change":"2023-10-09T11:44:46.256243+0000","last_active":"2023-10-09T11:44:47.266023+0000","last_peered":"2023-10-09T11:44:47.266023+0000","last_clean":"2023-10-09T11:44:47.266023+0000","last_became_active":"2023-10-09T11:44:46.255919+0000","last_became_peered":"2023-10-09T11:44:46.255919+0000","last_unstale":"2023-10-09T11:44:47.266023+0000","last_undegraded":"2023-10-09T11:44:47.266023+0000","last_fullsized":"2023-10-09T11:44:47.266023+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:49.090835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272291+0000","last_change":"2023-10-09T11:44:47.268829+0000","last_active":"2023-10-09T11:44:47.272291+0000","last_peered":"2023-10-09T11:44:47.272291+0000","last_clean":"2023-10-09T11:44:47.272291+0000","last_became_active":"2023-10-09T11:44:47.267073+0000","last_became_peered":"2023-10-09T11:44:47.267073+0000","last_unstale":"2023-10-09T11:44:47.272291+0000","last_undegraded":"2023-10-09T11:44:47.272291+0000","last_fullsized":"2023-10-09T11:44:47.272291+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:23.499377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247096+0000","last_change":"2023-10-09T11:44:46.258481+0000","last_active":"2023-10-09T11:44:47.247096+0000","last_peered":"2023-10-09T11:44:47.247096+0000","last_clean":"2023-10-09T11:44:47.247096+0000","last_became_active":"2023-10-09T11:44:46.258198+0000","last_became_peered":"2023-10-09T11:44:46.258198+0000","last_unstale":"2023-10-09T11:44:47.247096+0000","last_undegraded":"2023-10-09T11:44:47.247096+0000","last_fullsized":"2023-10-09T11:44:47.247096+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:12.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263466+0000","last_change":"2023-10-09T11:44:47.259313+0000","last_active":"2023-10-09T11:44:47.263466+0000","last_peered":"2023-10-09T11:44:47.263466+0000","last_clean":"2023-10-09T11:44:47.263466+0000","last_became_active":"2023-10-09T11:44:47.259009+0000","last_became_peered":"2023-10-09T11:44:47.259009+0000","last_unstale":"2023-10-09T11:44:47.263466+0000","last_undegraded":"2023-10-09T11:44:47.263466+0000","last_fullsized":"2023-10-09T11:44:47.263466+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:52.307356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.254914+0000","last_change":"2023-10-09T11:44:46.260913+0000","last_active":"2023-10-09T11:44:47.254914+0000","last_peered":"2023-10-09T11:44:47.254914+0000","last_clean":"2023-10-09T11:44:47.254914+0000","last_became_active":"2023-10-09T11:44:46.260389+0000","last_became_peered":"2023-10-09T11:44:46.260389+0000","last_unstale":"2023-10-09T11:44:47.254914+0000","last_undegraded":"2023-10-09T11:44:47.254914+0000","last_fullsized":"2023-10-09T11:44:47.254914+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:25.864103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.270010+0000","last_change":"2023-10-09T11:44:47.266956+0000","last_active":"2023-10-09T11:44:47.270010+0000","last_peered":"2023-10-09T11:44:47.270010+0000","last_clean":"2023-10-09T11:44:47.270010+0000","last_became_active":"2023-10-09T11:44:47.266691+0000","last_became_peered":"2023-10-09T11:44:47.266691+0000","last_unstale":"2023-10-09T11:44:47.270010+0000","last_undegraded":"2023-10-09T11:44:47.270010+0000","last_fullsized":"2023-10-09T11:44:47.270010+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:11.379202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248977+0000","last_change":"2023-10-09T11:44:46.262182+0000","last_active":"2023-10-09T11:44:47.248977+0000","last_peered":"2023-10-09T11:44:47.248977+0000","last_clean":"2023-10-09T11:44:47.248977+0000","last_became_active":"2023-10-09T11:44:46.261917+0000","last_became_peered":"2023-10-09T11:44:46.261917+0000","last_unstale":"2023-10-09T11:44:47.248977+0000","last_undegraded":"2023-10-09T11:44:47.248977+0000","last_fullsized":"2023-10-09T11:44:47.248977+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:27.133028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269437+0000","last_change":"2023-10-09T11:44:47.267072+0000","last_active":"2023-10-09T11:44:47.269437+0000","last_peered":"2023-10-09T11:44:47.269437+0000","last_clean":"2023-10-09T11:44:47.269437+0000","last_became_active":"2023-10-09T11:44:47.266204+0000","last_became_peered":"2023-10-09T11:44:47.266204+0000","last_unstale":"2023-10-09T11:44:47.269437+0000","last_undegraded":"2023-10-09T11:44:47.269437+0000","last_fullsized":"2023-10-09T11:44:47.269437+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:50.698594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269644+0000","last_change":"2023-10-09T11:44:46.261506+0000","last_active":"2023-10-09T11:44:47.269644+0000","last_peered":"2023-10-09T11:44:47.269644+0000","last_clean":"2023-10-09T11:44:47.269644+0000","last_became_active":"2023-10-09T11:44:46.261234+0000","last_became_peered":"2023-10-09T11:44:46.261234+0000","last_unstale":"2023-10-09T11:44:47.269644+0000","last_undegraded":"2023-10-09T11:44:47.269644+0000","last_fullsized":"2023-10-09T11:44:47.269644+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265222+0000","last_change":"2023-10-09T11:44:47.260264+0000","last_active":"2023-10-09T11:44:47.265222+0000","last_peered":"2023-10-09T11:44:47.265222+0000","last_clean":"2023-10-09T11:44:47.265222+0000","last_became_active":"2023-10-09T11:44:47.259966+0000","last_became_peered":"2023-10-09T11:44:47.259966+0000","last_unstale":"2023-10-09T11:44:47.265222+0000","last_undegraded":"2023-10-09T11:44:47.265222+0000","last_fullsized":"2023-10-09T11:44:47.265222+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:50.093319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248460+0000","last_change":"2023-10-09T11:44:46.262739+0000","last_active":"2023-10-09T11:44:47.248460+0000","last_peered":"2023-10-09T11:44:47.248460+0000","last_clean":"2023-10-09T11:44:47.248460+0000","last_became_active":"2023-10-09T11:44:46.262141+0000","last_became_peered":"2023-10-09T11:44:46.262141+0000","last_unstale":"2023-10-09T11:44:47.248460+0000","last_undegraded":"2023-10-09T11:44:47.248460+0000","last_fullsized":"2023-10-09T11:44:47.248460+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:23.717443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264169+0000","last_change":"2023-10-09T11:44:47.260893+0000","last_active":"2023-10-09T11:44:47.264169+0000","last_peered":"2023-10-09T11:44:47.264169+0000","last_clean":"2023-10-09T11:44:47.264169+0000","last_became_active":"2023-10-09T11:44:47.260627+0000","last_became_peered":"2023-10-09T11:44:47.260627+0000","last_unstale":"2023-10-09T11:44:47.264169+0000","last_undegraded":"2023-10-09T11:44:47.264169+0000","last_fullsized":"2023-10-09T11:44:47.264169+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:31.293944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247053+0000","last_change":"2023-10-09T11:44:46.257462+0000","last_active":"2023-10-09T11:44:47.247053+0000","last_peered":"2023-10-09T11:44:47.247053+0000","last_clean":"2023-10-09T11:44:47.247053+0000","last_became_active":"2023-10-09T11:44:46.256591+0000","last_became_peered":"2023-10-09T11:44:46.256591+0000","last_unstale":"2023-10-09T11:44:47.247053+0000","last_undegraded":"2023-10-09T11:44:47.247053+0000","last_fullsized":"2023-10-09T11:44:47.247053+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275086+0000","last_change":"2023-10-09T11:44:47.272772+0000","last_active":"2023-10-09T11:44:47.275086+0000","last_peered":"2023-10-09T11:44:47.275086+0000","last_clean":"2023-10-09T11:44:47.275086+0000","last_became_active":"2023-10-09T11:44:47.272481+0000","last_became_peered":"2023-10-09T11:44:47.272481+0000","last_unstale":"2023-10-09T11:44:47.275086+0000","last_undegraded":"2023-10-09T11:44:47.275086+0000","last_fullsized":"2023-10-09T11:44:47.275086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:19.759566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247224+0000","last_change":"2023-10-09T11:44:46.257155+0000","last_active":"2023-10-09T11:44:47.247224+0000","last_peered":"2023-10-09T11:44:47.247224+0000","last_clean":"2023-10-09T11:44:47.247224+0000","last_became_active":"2023-10-09T11:44:46.256871+0000","last_became_peered":"2023-10-09T11:44:46.256871+0000","last_unstale":"2023-10-09T11:44:47.247224+0000","last_undegraded":"2023-10-09T11:44:47.247224+0000","last_fullsized":"2023-10-09T11:44:47.247224+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:57.639961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263309+0000","last_change":"2023-10-09T11:44:47.260780+0000","last_active":"2023-10-09T11:44:47.263309+0000","last_peered":"2023-10-09T11:44:47.263309+0000","last_clean":"2023-10-09T11:44:47.263309+0000","last_became_active":"2023-10-09T11:44:47.260509+0000","last_became_peered":"2023-10-09T11:44:47.260509+0000","last_unstale":"2023-10-09T11:44:47.263309+0000","last_undegraded":"2023-10-09T11:44:47.263309+0000","last_fullsized":"2023-10-09T11:44:47.263309+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:50.856537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246964+0000","last_change":"2023-10-09T11:44:46.257529+0000","last_active":"2023-10-09T11:44:47.246964+0000","last_peered":"2023-10-09T11:44:47.246964+0000","last_clean":"2023-10-09T11:44:47.246964+0000","last_became_active":"2023-10-09T11:44:46.257232+0000","last_became_peered":"2023-10-09T11:44:46.257232+0000","last_unstale":"2023-10-09T11:44:47.246964+0000","last_undegraded":"2023-10-09T11:44:47.246964+0000","last_fullsized":"2023-10-09T11:44:47.246964+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:57.639961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273597+0000","last_change":"2023-10-09T11:44:47.267362+0000","last_active":"2023-10-09T11:44:47.273597+0000","last_peered":"2023-10-09T11:44:47.273597+0000","last_clean":"2023-10-09T11:44:47.273597+0000","last_became_active":"2023-10-09T11:44:47.267091+0000","last_became_peered":"2023-10-09T11:44:47.267091+0000","last_unstale":"2023-10-09T11:44:47.273597+0000","last_undegraded":"2023-10-09T11:44:47.273597+0000","last_fullsized":"2023-10-09T11:44:47.273597+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:50.856537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246800+0000","last_change":"2023-10-09T11:44:46.255826+0000","last_active":"2023-10-09T11:44:47.246800+0000","last_peered":"2023-10-09T11:44:47.246800+0000","last_clean":"2023-10-09T11:44:47.246800+0000","last_became_active":"2023-10-09T11:44:46.255552+0000","last_became_peered":"2023-10-09T11:44:46.255552+0000","last_unstale":"2023-10-09T11:44:47.246800+0000","last_undegraded":"2023-10-09T11:44:47.246800+0000","last_fullsized":"2023-10-09T11:44:47.246800+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:08.589914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268905+0000","last_change":"2023-10-09T11:44:47.262590+0000","last_active":"2023-10-09T11:44:47.268905+0000","last_peered":"2023-10-09T11:44:47.268905+0000","last_clean":"2023-10-09T11:44:47.268905+0000","last_became_active":"2023-10-09T11:44:47.262325+0000","last_became_peered":"2023-10-09T11:44:47.262325+0000","last_unstale":"2023-10-09T11:44:47.268905+0000","last_undegraded":"2023-10-09T11:44:47.268905+0000","last_fullsized":"2023-10-09T11:44:47.268905+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:35.862903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246889+0000","last_change":"2023-10-09T11:44:46.254722+0000","last_active":"2023-10-09T11:44:47.246889+0000","last_peered":"2023-10-09T11:44:47.246889+0000","last_clean":"2023-10-09T11:44:47.246889+0000","last_became_active":"2023-10-09T11:44:46.254419+0000","last_became_peered":"2023-10-09T11:44:46.254419+0000","last_unstale":"2023-10-09T11:44:47.246889+0000","last_undegraded":"2023-10-09T11:44:47.246889+0000","last_fullsized":"2023-10-09T11:44:47.246889+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:43.072669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272457+0000","last_change":"2023-10-09T11:44:47.258796+0000","last_active":"2023-10-09T11:44:47.272457+0000","last_peered":"2023-10-09T11:44:47.272457+0000","last_clean":"2023-10-09T11:44:47.272457+0000","last_became_active":"2023-10-09T11:44:47.258372+0000","last_became_peered":"2023-10-09T11:44:47.258372+0000","last_unstale":"2023-10-09T11:44:47.272457+0000","last_undegraded":"2023-10-09T11:44:47.272457+0000","last_fullsized":"2023-10-09T11:44:47.272457+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:44.041870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247243+0000","last_change":"2023-10-09T11:44:46.264611+0000","last_active":"2023-10-09T11:44:47.247243+0000","last_peered":"2023-10-09T11:44:47.247243+0000","last_clean":"2023-10-09T11:44:47.247243+0000","last_became_active":"2023-10-09T11:44:46.264322+0000","last_became_peered":"2023-10-09T11:44:46.264322+0000","last_unstale":"2023-10-09T11:44:47.247243+0000","last_undegraded":"2023-10-09T11:44:47.247243+0000","last_fullsized":"2023-10-09T11:44:47.247243+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264902+0000","last_change":"2023-10-09T11:44:47.260674+0000","last_active":"2023-10-09T11:44:47.264902+0000","last_peered":"2023-10-09T11:44:47.264902+0000","last_clean":"2023-10-09T11:44:47.264902+0000","last_became_active":"2023-10-09T11:44:47.260409+0000","last_became_peered":"2023-10-09T11:44:47.260409+0000","last_unstale":"2023-10-09T11:44:47.264902+0000","last_undegraded":"2023-10-09T11:44:47.264902+0000","last_fullsized":"2023-10-09T11:44:47.264902+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:25.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.251288+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:47.251288+0000","last_peered":"2023-10-09T11:44:47.251288+0000","last_clean":"2023-10-09T11:44:47.251288+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:47.251288+0000","last_undegraded":"2023-10-09T11:44:47.251288+0000","last_fullsized":"2023-10-09T11:44:47.251288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542265,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304428,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067412,"statfs":{"total":96636764160,"available":96325029888,"internally_reserved":0,"allocated":3117056,"data_stored":1722709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.64900000000000002},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.503,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.751,"15min":2.6160000000000001},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":1.256},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.77200000000000002},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.872,"5min":0.872,"15min":8.8940000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68100000000000005,"5min":0.79700000000000004,"15min":0.82499999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.66300000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67000000000000004,"5min":0.79200000000000004,"15min":1.3},"last":0.317},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.48299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":1.163},"last":0.46500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.82399999999999995,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.57099999999999995,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":1.369},"last":0.49299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.999},"last":0.443},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58799999999999997,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.52100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542265,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1131799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.79400000000000004,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.59899999999999998},"min":{"1min":0.435,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80500000000000005,"5min":0.85199999999999998,"15min":1.153},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.92800000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.81299999999999994},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57499999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":1.1060000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84499999999999997,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76200000000000001,"5min":2.895,"15min":2.895},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.871,"15min":0.871},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0069999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.61599999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.746},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2523136,"data_stored":1131889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.47099999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.54500000000000004,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.64700000000000002},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.215},"max":{"1min":0.58899999999999997,"5min":0.65600000000000003,"15min":11.06},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.78500000000000003},"min":{"1min":0.26700000000000002,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.495,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.67900000000000005},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54000000000000004,"5min":2.1960000000000002,"15min":11.935},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.65300000000000002},"min":{"1min":0.28799999999999998,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.51800000000000002,"5min":0.76400000000000001,"15min":11.087},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.57899999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.317}]},{"osd":4,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.96399999999999997,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.434},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.373},"max":{"1min":0.97899999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":10.939},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":4.9370000000000003},"last":0.41499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.622,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":1.0089999999999999,"15min":10.975},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63800000000000001,"15min":0.93100000000000005},"min":{"1min":0.46999999999999997,"5min":0.39800000000000002,"15min":0.38100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.436,"5min":0.39700000000000002,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":1.72,"15min":1.72},"last":0.498},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63700000000000001,"15min":0.93100000000000005},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":11.000999999999999},"last":0.44400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308520,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063320,"statfs":{"total":96636764160,"available":96320839680,"internally_reserved":0,"allocated":3112960,"data_stored":1722203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.47699999999999998},"min":{"1min":0.22600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.248},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.51200000000000001},"min":{"1min":0.318,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63400000000000001,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.68700000000000006},"min":{"1min":0.313,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.371,"15min":0.71699999999999997},"min":{"1min":0.245,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.67400000000000004,"5min":0.71499999999999997,"15min":12.589},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.42899999999999999},"min":{"1min":0.317,"5min":0.25,"15min":0.25},"max":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":1.502},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.625},"min":{"1min":0.41799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78700000000000003,"5min":1.095,"15min":1.446},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":1.1970000000000001,"15min":1.278},"last":0.81499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.65000000000000002},"min":{"1min":0.44800000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85999999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.62,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":2.286,"15min":2.286},"last":0.76900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.91900000000000004,"5min":0.95799999999999996,"15min":1.639},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.68000000000000005},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.88700000000000001,"5min":1.288,"15min":1.3149999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":0.85499999999999998,"5min":1.038,"15min":1.5629999999999999},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1133877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32500000000000001},"min":{"1min":0.25,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.501,"5min":0.60999999999999999,"15min":1.272},"last":0.311},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35699999999999998,"15min":0.36699999999999999},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.52500000000000002,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.249}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.41099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.376},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60199999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.54200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.181,"5min":1.181,"15min":1.286},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.47499999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.65100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.018,"5min":1.018,"15min":1.3149999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64100000000000001,"15min":0.624},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":2519040,"data_stored":1131855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.33300000000000002,"15min":0.33800000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34999999999999998,"15min":0.33500000000000002},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.41499999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.48999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.38900000000000001,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.49399999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41699999999999998,"15min":0.40899999999999997},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.502,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.45800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":4,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.61799999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.68999999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.747,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70899999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83599999999999997,"5min":0.871,"15min":0.873},"last":0.56599999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542266,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303852,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067988,"statfs":{"total":96636764160,"available":96325619712,"internally_reserved":0,"allocated":2527232,"data_stored":1133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":1.056},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.65500000000000003},"min":{"1min":0.47799999999999998,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.7400000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.69999999999999996},"min":{"1min":0.438,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.84499999999999997,"15min":1.234},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":0.81999999999999995,"15min":0.91800000000000004},"last":0.496}]},{"osd":6,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.0229999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.878,"15min":1.282},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.78100000000000003,"5min":0.79900000000000004,"15min":0.95499999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.58799999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542266,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1131835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.63,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.314,"15min":0.307},"max":{"1min":5.5229999999999997,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.67300000000000004,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":5.0970000000000004,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.54800000000000004},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.498}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.41499999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55000000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.47899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.873,"15min":0.89200000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:51.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:44:51.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.511+0000 7f3b63055700 1 Processor -- start 2023-10-09T11:44:51.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.511+0000 7f3b63055700 1 -- start start 2023-10-09T11:44:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b63055700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b5c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b63055700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b5c159c80 0x7f3b5c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b63055700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0ce9d0 con 0x7f3b5c0af790 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b63055700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0afc30 con 0x7f3b5c159c80 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b63055700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aff10 con 0x7f3b5c1598b0 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b615f2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b5c0af790 0x7f3b5c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44588/0 (socket says 172.21.15.26:44588) 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b615f2700 1 -- 172.21.15.26:0/1952002117 learned_addr learned my addr 172.21.15.26:0/1952002117 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393126103 0 0) 0x7f3b5c0ce9d0 con 0x7f3b5c0af790 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b60df1700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b5c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b5bfff700 1 --2- 172.21.15.26:0/1952002117 >> v2:172.21.15.67:3300/0 conn(0x7f3b5c159c80 0x7f3b5c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.512+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b44003570 con 0x7f3b5c0af790 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402243747 0 0) 0x7f3b44003570 con 0x7f3b5c0af790 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 msgr2=0x7f3b5c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b5c0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 >> v2:172.21.15.67:3300/0 conn(0x7f3b5c159c80 msgr2=0x7f3b5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 --2- 172.21.15.26:0/1952002117 >> v2:172.21.15.67:3300/0 conn(0x7f3b5c159c80 0x7f3b5c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0ce380 con 0x7f3b5c0af790 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f3b4c001470 con 0x7f3b5c0af790 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 >> v1:172.21.15.26:6789/0 conn(0x7f3b5c0af790 legacy=0x7f3b5c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44003a60 0x7f3b44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b44004d50 0x7f3b440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0afc30 con 0x7f3b44004d50 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aff10 con 0x7f3b44003a60 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4400ba60 con 0x7f3b5c1598b0 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b44004d50 0x7f3b440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b60df1700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44003a60 0x7f3b44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b5bfff700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 -- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 msgr2=0x7f3b44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1598b0 0x7f3b44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 -- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44003a60 msgr2=0x7f3b44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44003a60 0x7f3b44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 -- 172.21.15.26:0/1952002117 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44003570 con 0x7f3b44004d50 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.513+0000 7f3b615f2700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b44004d50 0x7f3b440051c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0cad00 tx=0x7f3b4c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6095009e2c0e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00cbd0 con 0x7f3b44004d50 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c00cd70 con 0x7f3b44004d50 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b5b7fe700 1 -- 172.21.15.26:0/1952002117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c005b70 con 0x7f3b44004d50 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 -- 172.21.15.26:0/1952002117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b44004d50 msgr2=0x7f3b440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 --2- 172.21.15.26:0/1952002117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b44004d50 0x7f3b440051c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0cad00 tx=0x7f3b4c001e90 comp rx=0 tx=0).stop 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b615f2700 1 -- 172.21.15.26:0/1952002117 reap_dead start 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 -- 172.21.15.26:0/1952002117 shutdown_connections 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 -- 172.21.15.26:0/1952002117 >> 172.21.15.26:0/1952002117 conn(0x7f3b5c070e30 msgr2=0x7f3b5c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:51.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 -- 172.21.15.26:0/1952002117 shutdown_connections 2023-10-09T11:44:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.514+0000 7f3b63055700 1 -- 172.21.15.26:0/1952002117 wait complete. 2023-10-09T11:44:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.515+0000 7f3b63055700 1 Processor -- start 2023-10-09T11:44:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.515+0000 7f3b63055700 1 -- start start 2023-10-09T11:44:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 0x7f3b5c1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1543d0 0x7f3b5c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0ca200 con 0x7f3b5c14f400 2023-10-09T11:44:51.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c9d70 con 0x7f3b44004d50 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b63055700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c9440 con 0x7f3b5c1543d0 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58560/0 (socket says 172.21.15.26:58560) 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b5bfff700 1 -- 172.21.15.26:0/2211825059 learned_addr learned my addr 172.21.15.26:0/2211825059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b60df1700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 0x7f3b5c1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.516+0000 7f3b615f2700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1543d0 0x7f3b5c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 -- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1543d0 msgr2=0x7f3b5c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1543d0 0x7f3b5c154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 -- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 msgr2=0x7f3b5c1431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 0x7f3b5c1431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 -- 172.21.15.26:0/2211825059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0c9720 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b60df1700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 0x7f3b5c1431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b5bfff700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006ac0 tx=0x7f3b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000f9b0 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000fb10 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c0c9a00 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000fe90 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.517+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c143710 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.518+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c04c3c0 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.519+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b50014650 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.519+0000 7f3b58ff9700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 0x7f3b480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.519+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b50018030 con 0x7f3b5c14f400 2023-10-09T11:44:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.519+0000 7f3b60df1700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 0x7f3b480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.520+0000 7f3b60df1700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 0x7f3b480697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009fd0 tx=0x7f3b5400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.523+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b500522d0 con 0x7f3b5c14f400 2023-10-09T11:44:51.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.711+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b5c0c9eb0 con 0x7f3b48067320 2023-10-09T11:44:51.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.720+0000 7f3b58ff9700 1 -- 172.21.15.26:0/2211825059 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289731 (secure 0 0 0) 0x7f3b5c0c9eb0 con 0x7f3b48067320 2023-10-09T11:44:51.725 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.723+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 msgr2=0x7f3b480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.723+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 0x7f3b480697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009fd0 tx=0x7f3b5400b040 comp rx=0 tx=0).stop 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.723+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 msgr2=0x7f3b5c152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.723+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006ac0 tx=0x7f3b500091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 shutdown_connections 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3b48067320 0x7f3b480697d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b5c1543d0 0x7f3b5c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b44004d50 0x7f3b5c1431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 --2- 172.21.15.26:0/2211825059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b5c14f400 0x7f3b5c152820 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 >> 172.21.15.26:0/2211825059 conn(0x7f3b5c070e30 msgr2=0x7f3b5c0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:51.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 shutdown_connections 2023-10-09T11:44:51.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.724+0000 7f3b63055700 1 -- 172.21.15.26:0/2211825059 wait complete. 2023-10-09T11:44:51.728 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:44:51.737 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2023-10-09T11:44:51.242947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444232,"kb_used_data":20872,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530488,"statfs":{"total":773094113280,"available":770591219712,"internally_reserved":0,"allocated":21372928,"data_stored":10239468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001208"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275621+0000","last_change":"2023-10-09T11:44:47.274128+0000","last_active":"2023-10-09T11:44:47.275621+0000","last_peered":"2023-10-09T11:44:47.275621+0000","last_clean":"2023-10-09T11:44:47.275621+0000","last_became_active":"2023-10-09T11:44:47.273421+0000","last_became_peered":"2023-10-09T11:44:47.273421+0000","last_unstale":"2023-10-09T11:44:47.275621+0000","last_undegraded":"2023-10-09T11:44:47.275621+0000","last_fullsized":"2023-10-09T11:44:47.275621+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:38.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264670+0000","last_change":"2023-10-09T11:44:47.261314+0000","last_active":"2023-10-09T11:44:47.264670+0000","last_peered":"2023-10-09T11:44:47.264670+0000","last_clean":"2023-10-09T11:44:47.264670+0000","last_became_active":"2023-10-09T11:44:47.261060+0000","last_became_peered":"2023-10-09T11:44:47.261060+0000","last_unstale":"2023-10-09T11:44:47.264670+0000","last_undegraded":"2023-10-09T11:44:47.264670+0000","last_fullsized":"2023-10-09T11:44:47.264670+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:09.969313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264274+0000","last_change":"2023-10-09T11:44:47.261666+0000","last_active":"2023-10-09T11:44:47.264274+0000","last_peered":"2023-10-09T11:44:47.264274+0000","last_clean":"2023-10-09T11:44:47.264274+0000","last_became_active":"2023-10-09T11:44:47.261419+0000","last_became_peered":"2023-10-09T11:44:47.261419+0000","last_unstale":"2023-10-09T11:44:47.264274+0000","last_undegraded":"2023-10-09T11:44:47.264274+0000","last_fullsized":"2023-10-09T11:44:47.264274+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:15.726932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263403+0000","last_change":"2023-10-09T11:44:47.259680+0000","last_active":"2023-10-09T11:44:47.263403+0000","last_peered":"2023-10-09T11:44:47.263403+0000","last_clean":"2023-10-09T11:44:47.263403+0000","last_became_active":"2023-10-09T11:44:47.259401+0000","last_became_peered":"2023-10-09T11:44:47.259401+0000","last_unstale":"2023-10-09T11:44:47.263403+0000","last_undegraded":"2023-10-09T11:44:47.263403+0000","last_fullsized":"2023-10-09T11:44:47.263403+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:11.379202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269406+0000","last_change":"2023-10-09T11:44:47.263631+0000","last_active":"2023-10-09T11:44:47.269406+0000","last_peered":"2023-10-09T11:44:47.269406+0000","last_clean":"2023-10-09T11:44:47.269406+0000","last_became_active":"2023-10-09T11:44:47.262814+0000","last_became_peered":"2023-10-09T11:44:47.262814+0000","last_unstale":"2023-10-09T11:44:47.269406+0000","last_undegraded":"2023-10-09T11:44:47.269406+0000","last_fullsized":"2023-10-09T11:44:47.269406+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:54.729889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.261401+0000","last_change":"2023-10-09T11:44:47.258045+0000","last_active":"2023-10-09T11:44:47.261401+0000","last_peered":"2023-10-09T11:44:47.261401+0000","last_clean":"2023-10-09T11:44:47.261401+0000","last_became_active":"2023-10-09T11:44:47.255306+0000","last_became_peered":"2023-10-09T11:44:47.255306+0000","last_unstale":"2023-10-09T11:44:47.261401+0000","last_undegraded":"2023-10-09T11:44:47.261401+0000","last_fullsized":"2023-10-09T11:44:47.261401+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:14.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265512+0000","last_change":"2023-10-09T11:44:47.264842+0000","last_active":"2023-10-09T11:44:47.265512+0000","last_peered":"2023-10-09T11:44:47.265512+0000","last_clean":"2023-10-09T11:44:47.265512+0000","last_became_active":"2023-10-09T11:44:47.264537+0000","last_became_peered":"2023-10-09T11:44:47.264537+0000","last_unstale":"2023-10-09T11:44:47.265512+0000","last_undegraded":"2023-10-09T11:44:47.265512+0000","last_fullsized":"2023-10-09T11:44:47.265512+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:14.130024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263278+0000","last_change":"2023-10-09T11:44:47.258489+0000","last_active":"2023-10-09T11:44:47.263278+0000","last_peered":"2023-10-09T11:44:47.263278+0000","last_clean":"2023-10-09T11:44:47.263278+0000","last_became_active":"2023-10-09T11:44:47.258225+0000","last_became_peered":"2023-10-09T11:44:47.258225+0000","last_unstale":"2023-10-09T11:44:47.263278+0000","last_undegraded":"2023-10-09T11:44:47.263278+0000","last_fullsized":"2023-10-09T11:44:47.263278+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:09.969313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265675+0000","last_change":"2023-10-09T11:44:47.263887+0000","last_active":"2023-10-09T11:44:47.265675+0000","last_peered":"2023-10-09T11:44:47.265675+0000","last_clean":"2023-10-09T11:44:47.265675+0000","last_became_active":"2023-10-09T11:44:47.263625+0000","last_became_peered":"2023-10-09T11:44:47.263625+0000","last_unstale":"2023-10-09T11:44:47.265675+0000","last_undegraded":"2023-10-09T11:44:47.265675+0000","last_fullsized":"2023-10-09T11:44:47.265675+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:13.215461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272575+0000","last_change":"2023-10-09T11:44:47.265079+0000","last_active":"2023-10-09T11:44:47.272575+0000","last_peered":"2023-10-09T11:44:47.272575+0000","last_clean":"2023-10-09T11:44:47.272575+0000","last_became_active":"2023-10-09T11:44:47.264820+0000","last_became_peered":"2023-10-09T11:44:47.264820+0000","last_unstale":"2023-10-09T11:44:47.272575+0000","last_undegraded":"2023-10-09T11:44:47.272575+0000","last_fullsized":"2023-10-09T11:44:47.272575+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:13.432756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275527+0000","last_change":"2023-10-09T11:44:47.272686+0000","last_active":"2023-10-09T11:44:47.275527+0000","last_peered":"2023-10-09T11:44:47.275527+0000","last_clean":"2023-10-09T11:44:47.275527+0000","last_became_active":"2023-10-09T11:44:47.272450+0000","last_became_peered":"2023-10-09T11:44:47.272450+0000","last_unstale":"2023-10-09T11:44:47.275527+0000","last_undegraded":"2023-10-09T11:44:47.275527+0000","last_fullsized":"2023-10-09T11:44:47.275527+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:27.711726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269454+0000","last_change":"2023-10-09T11:44:47.267327+0000","last_active":"2023-10-09T11:44:47.269454+0000","last_peered":"2023-10-09T11:44:47.269454+0000","last_clean":"2023-10-09T11:44:47.269454+0000","last_became_active":"2023-10-09T11:44:47.266553+0000","last_became_peered":"2023-10-09T11:44:47.266553+0000","last_unstale":"2023-10-09T11:44:47.269454+0000","last_undegraded":"2023-10-09T11:44:47.269454+0000","last_fullsized":"2023-10-09T11:44:47.269454+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:40.967960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271384+0000","last_change":"2023-10-09T11:44:47.268750+0000","last_active":"2023-10-09T11:44:47.271384+0000","last_peered":"2023-10-09T11:44:47.271384+0000","last_clean":"2023-10-09T11:44:47.271384+0000","last_became_active":"2023-10-09T11:44:47.268496+0000","last_became_peered":"2023-10-09T11:44:47.268496+0000","last_unstale":"2023-10-09T11:44:47.271384+0000","last_undegraded":"2023-10-09T11:44:47.271384+0000","last_fullsized":"2023-10-09T11:44:47.271384+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:41.352820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272043+0000","last_change":"2023-10-09T11:44:47.270068+0000","last_active":"2023-10-09T11:44:47.272043+0000","last_peered":"2023-10-09T11:44:47.272043+0000","last_clean":"2023-10-09T11:44:47.272043+0000","last_became_active":"2023-10-09T11:44:47.266120+0000","last_became_peered":"2023-10-09T11:44:47.266120+0000","last_unstale":"2023-10-09T11:44:47.272043+0000","last_undegraded":"2023-10-09T11:44:47.272043+0000","last_fullsized":"2023-10-09T11:44:47.272043+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:29.337907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273579+0000","last_change":"2023-10-09T11:44:47.267279+0000","last_active":"2023-10-09T11:44:47.273579+0000","last_peered":"2023-10-09T11:44:47.273579+0000","last_clean":"2023-10-09T11:44:47.273579+0000","last_became_active":"2023-10-09T11:44:47.266772+0000","last_became_peered":"2023-10-09T11:44:47.266772+0000","last_unstale":"2023-10-09T11:44:47.273579+0000","last_undegraded":"2023-10-09T11:44:47.273579+0000","last_fullsized":"2023-10-09T11:44:47.273579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.054918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268832+0000","last_change":"2023-10-09T11:44:47.258634+0000","last_active":"2023-10-09T11:44:47.268832+0000","last_peered":"2023-10-09T11:44:47.268832+0000","last_clean":"2023-10-09T11:44:47.268832+0000","last_became_active":"2023-10-09T11:44:47.258351+0000","last_became_peered":"2023-10-09T11:44:47.258351+0000","last_unstale":"2023-10-09T11:44:47.268832+0000","last_undegraded":"2023-10-09T11:44:47.268832+0000","last_fullsized":"2023-10-09T11:44:47.268832+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:44.540119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272695+0000","last_change":"2023-10-09T11:44:47.268611+0000","last_active":"2023-10-09T11:44:47.272695+0000","last_peered":"2023-10-09T11:44:47.272695+0000","last_clean":"2023-10-09T11:44:47.272695+0000","last_became_active":"2023-10-09T11:44:47.268002+0000","last_became_peered":"2023-10-09T11:44:47.268002+0000","last_unstale":"2023-10-09T11:44:47.272695+0000","last_undegraded":"2023-10-09T11:44:47.272695+0000","last_fullsized":"2023-10-09T11:44:47.272695+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:48.393484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.267614+0000","last_change":"2023-10-09T11:44:47.265412+0000","last_active":"2023-10-09T11:44:47.267614+0000","last_peered":"2023-10-09T11:44:47.267614+0000","last_clean":"2023-10-09T11:44:47.267614+0000","last_became_active":"2023-10-09T11:44:47.264027+0000","last_became_peered":"2023-10-09T11:44:47.264027+0000","last_unstale":"2023-10-09T11:44:47.267614+0000","last_undegraded":"2023-10-09T11:44:47.267614+0000","last_fullsized":"2023-10-09T11:44:47.267614+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:14.130024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275042+0000","last_change":"2023-10-09T11:44:47.273501+0000","last_active":"2023-10-09T11:44:47.275042+0000","last_peered":"2023-10-09T11:44:47.275042+0000","last_clean":"2023-10-09T11:44:47.275042+0000","last_became_active":"2023-10-09T11:44:47.273199+0000","last_became_peered":"2023-10-09T11:44:47.273199+0000","last_unstale":"2023-10-09T11:44:47.275042+0000","last_undegraded":"2023-10-09T11:44:47.275042+0000","last_fullsized":"2023-10-09T11:44:47.275042+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:01.680921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269417+0000","last_change":"2023-10-09T11:44:47.266832+0000","last_active":"2023-10-09T11:44:47.269417+0000","last_peered":"2023-10-09T11:44:47.269417+0000","last_clean":"2023-10-09T11:44:47.269417+0000","last_became_active":"2023-10-09T11:44:47.265832+0000","last_became_peered":"2023-10-09T11:44:47.265832+0000","last_unstale":"2023-10-09T11:44:47.269417+0000","last_undegraded":"2023-10-09T11:44:47.269417+0000","last_fullsized":"2023-10-09T11:44:47.269417+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:23.527138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271170+0000","last_change":"2023-10-09T11:44:47.266578+0000","last_active":"2023-10-09T11:44:47.271170+0000","last_peered":"2023-10-09T11:44:47.271170+0000","last_clean":"2023-10-09T11:44:47.271170+0000","last_became_active":"2023-10-09T11:44:47.266272+0000","last_became_peered":"2023-10-09T11:44:47.266272+0000","last_unstale":"2023-10-09T11:44:47.271170+0000","last_undegraded":"2023-10-09T11:44:47.271170+0000","last_fullsized":"2023-10-09T11:44:47.271170+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:09.193647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271881+0000","last_change":"2023-10-09T11:44:47.268325+0000","last_active":"2023-10-09T11:44:47.271881+0000","last_peered":"2023-10-09T11:44:47.271881+0000","last_clean":"2023-10-09T11:44:47.271881+0000","last_became_active":"2023-10-09T11:44:47.267536+0000","last_became_peered":"2023-10-09T11:44:47.267536+0000","last_unstale":"2023-10-09T11:44:47.271881+0000","last_undegraded":"2023-10-09T11:44:47.271881+0000","last_fullsized":"2023-10-09T11:44:47.271881+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:22.573497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273556+0000","last_change":"2023-10-09T11:44:47.267061+0000","last_active":"2023-10-09T11:44:47.273556+0000","last_peered":"2023-10-09T11:44:47.273556+0000","last_clean":"2023-10-09T11:44:47.273556+0000","last_became_active":"2023-10-09T11:44:47.266430+0000","last_became_peered":"2023-10-09T11:44:47.266430+0000","last_unstale":"2023-10-09T11:44:47.273556+0000","last_undegraded":"2023-10-09T11:44:47.273556+0000","last_fullsized":"2023-10-09T11:44:47.273556+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:59.352866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271910+0000","last_change":"2023-10-09T11:44:47.267780+0000","last_active":"2023-10-09T11:44:47.271910+0000","last_peered":"2023-10-09T11:44:47.271910+0000","last_clean":"2023-10-09T11:44:47.271910+0000","last_became_active":"2023-10-09T11:44:47.267442+0000","last_became_peered":"2023-10-09T11:44:47.267442+0000","last_unstale":"2023-10-09T11:44:47.271910+0000","last_undegraded":"2023-10-09T11:44:47.271910+0000","last_fullsized":"2023-10-09T11:44:47.271910+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:10.641334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263409+0000","last_change":"2023-10-09T11:44:47.256071+0000","last_active":"2023-10-09T11:44:47.263409+0000","last_peered":"2023-10-09T11:44:47.263409+0000","last_clean":"2023-10-09T11:44:47.263409+0000","last_became_active":"2023-10-09T11:44:47.255780+0000","last_became_peered":"2023-10-09T11:44:47.255780+0000","last_unstale":"2023-10-09T11:44:47.263409+0000","last_undegraded":"2023-10-09T11:44:47.263409+0000","last_fullsized":"2023-10-09T11:44:47.263409+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:40.082458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269548+0000","last_change":"2023-10-09T11:44:47.263896+0000","last_active":"2023-10-09T11:44:47.269548+0000","last_peered":"2023-10-09T11:44:47.269548+0000","last_clean":"2023-10-09T11:44:47.269548+0000","last_became_active":"2023-10-09T11:44:47.263648+0000","last_became_peered":"2023-10-09T11:44:47.263648+0000","last_unstale":"2023-10-09T11:44:47.269548+0000","last_undegraded":"2023-10-09T11:44:47.269548+0000","last_fullsized":"2023-10-09T11:44:47.269548+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.431753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275413+0000","last_change":"2023-10-09T11:44:47.272049+0000","last_active":"2023-10-09T11:44:47.275413+0000","last_peered":"2023-10-09T11:44:47.275413+0000","last_clean":"2023-10-09T11:44:47.275413+0000","last_became_active":"2023-10-09T11:44:47.271393+0000","last_became_peered":"2023-10-09T11:44:47.271393+0000","last_unstale":"2023-10-09T11:44:47.275413+0000","last_undegraded":"2023-10-09T11:44:47.275413+0000","last_fullsized":"2023-10-09T11:44:47.275413+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:53.905366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275542+0000","last_change":"2023-10-09T11:44:47.272749+0000","last_active":"2023-10-09T11:44:47.275542+0000","last_peered":"2023-10-09T11:44:47.275542+0000","last_clean":"2023-10-09T11:44:47.275542+0000","last_became_active":"2023-10-09T11:44:47.272421+0000","last_became_peered":"2023-10-09T11:44:47.272421+0000","last_unstale":"2023-10-09T11:44:47.275542+0000","last_undegraded":"2023-10-09T11:44:47.275542+0000","last_fullsized":"2023-10-09T11:44:47.275542+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:12.799720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266167+0000","last_change":"2023-10-09T11:44:47.265158+0000","last_active":"2023-10-09T11:44:47.266167+0000","last_peered":"2023-10-09T11:44:47.266167+0000","last_clean":"2023-10-09T11:44:47.266167+0000","last_became_active":"2023-10-09T11:44:47.264912+0000","last_became_peered":"2023-10-09T11:44:47.264912+0000","last_unstale":"2023-10-09T11:44:47.266167+0000","last_undegraded":"2023-10-09T11:44:47.266167+0000","last_fullsized":"2023-10-09T11:44:47.266167+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:27.038531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269179+0000","last_change":"2023-10-09T11:44:47.262533+0000","last_active":"2023-10-09T11:44:47.269179+0000","last_peered":"2023-10-09T11:44:47.269179+0000","last_clean":"2023-10-09T11:44:47.269179+0000","last_became_active":"2023-10-09T11:44:47.262266+0000","last_became_peered":"2023-10-09T11:44:47.262266+0000","last_unstale":"2023-10-09T11:44:47.269179+0000","last_undegraded":"2023-10-09T11:44:47.269179+0000","last_fullsized":"2023-10-09T11:44:47.269179+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:12.391841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269974+0000","last_change":"2023-10-09T11:44:47.265221+0000","last_active":"2023-10-09T11:44:47.269974+0000","last_peered":"2023-10-09T11:44:47.269974+0000","last_clean":"2023-10-09T11:44:47.269974+0000","last_became_active":"2023-10-09T11:44:47.264962+0000","last_became_peered":"2023-10-09T11:44:47.264962+0000","last_unstale":"2023-10-09T11:44:47.269974+0000","last_undegraded":"2023-10-09T11:44:47.269974+0000","last_fullsized":"2023-10-09T11:44:47.269974+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:44.319105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272414+0000","last_change":"2023-10-09T11:44:47.260042+0000","last_active":"2023-10-09T11:44:47.272414+0000","last_peered":"2023-10-09T11:44:47.272414+0000","last_clean":"2023-10-09T11:44:47.272414+0000","last_became_active":"2023-10-09T11:44:47.259780+0000","last_became_peered":"2023-10-09T11:44:47.259780+0000","last_unstale":"2023-10-09T11:44:47.272414+0000","last_undegraded":"2023-10-09T11:44:47.272414+0000","last_fullsized":"2023-10-09T11:44:47.272414+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:38.766995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"197'4","reported_seq":14,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268723+0000","last_change":"2023-10-09T11:44:46.262156+0000","last_active":"2023-10-09T11:44:47.268723+0000","last_peered":"2023-10-09T11:44:47.268723+0000","last_clean":"2023-10-09T11:44:47.268723+0000","last_became_active":"2023-10-09T11:44:46.261796+0000","last_became_peered":"2023-10-09T11:44:46.261796+0000","last_unstale":"2023-10-09T11:44:47.268723+0000","last_undegraded":"2023-10-09T11:44:47.268723+0000","last_fullsized":"2023-10-09T11:44:47.268723+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:16.108432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273276+0000","last_change":"2023-10-09T11:44:47.272792+0000","last_active":"2023-10-09T11:44:47.273276+0000","last_peered":"2023-10-09T11:44:47.273276+0000","last_clean":"2023-10-09T11:44:47.273276+0000","last_became_active":"2023-10-09T11:44:47.272519+0000","last_became_peered":"2023-10-09T11:44:47.272519+0000","last_unstale":"2023-10-09T11:44:47.273276+0000","last_undegraded":"2023-10-09T11:44:47.273276+0000","last_fullsized":"2023-10-09T11:44:47.273276+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264185+0000","last_change":"2023-10-09T11:44:46.263402+0000","last_active":"2023-10-09T11:44:47.264185+0000","last_peered":"2023-10-09T11:44:47.264185+0000","last_clean":"2023-10-09T11:44:47.264185+0000","last_became_active":"2023-10-09T11:44:46.263102+0000","last_became_peered":"2023-10-09T11:44:46.263102+0000","last_unstale":"2023-10-09T11:44:47.264185+0000","last_undegraded":"2023-10-09T11:44:47.264185+0000","last_fullsized":"2023-10-09T11:44:47.264185+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:11.066766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.267594+0000","last_change":"2023-10-09T11:44:47.262874+0000","last_active":"2023-10-09T11:44:47.267594+0000","last_peered":"2023-10-09T11:44:47.267594+0000","last_clean":"2023-10-09T11:44:47.267594+0000","last_became_active":"2023-10-09T11:44:47.262599+0000","last_became_peered":"2023-10-09T11:44:47.262599+0000","last_unstale":"2023-10-09T11:44:47.267594+0000","last_undegraded":"2023-10-09T11:44:47.267594+0000","last_fullsized":"2023-10-09T11:44:47.267594+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:15.726932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275269+0000","last_change":"2023-10-09T11:44:46.269396+0000","last_active":"2023-10-09T11:44:47.275269+0000","last_peered":"2023-10-09T11:44:47.275269+0000","last_clean":"2023-10-09T11:44:47.275269+0000","last_became_active":"2023-10-09T11:44:46.269140+0000","last_became_peered":"2023-10-09T11:44:46.269140+0000","last_unstale":"2023-10-09T11:44:47.275269+0000","last_undegraded":"2023-10-09T11:44:47.275269+0000","last_fullsized":"2023-10-09T11:44:47.275269+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:09.360060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272063+0000","last_change":"2023-10-09T11:44:47.270062+0000","last_active":"2023-10-09T11:44:47.272063+0000","last_peered":"2023-10-09T11:44:47.272063+0000","last_clean":"2023-10-09T11:44:47.272063+0000","last_became_active":"2023-10-09T11:44:47.267995+0000","last_became_peered":"2023-10-09T11:44:47.267995+0000","last_unstale":"2023-10-09T11:44:47.272063+0000","last_undegraded":"2023-10-09T11:44:47.272063+0000","last_fullsized":"2023-10-09T11:44:47.272063+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:25.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265381+0000","last_change":"2023-10-09T11:44:46.262769+0000","last_active":"2023-10-09T11:44:47.265381+0000","last_peered":"2023-10-09T11:44:47.265381+0000","last_clean":"2023-10-09T11:44:47.265381+0000","last_became_active":"2023-10-09T11:44:46.262471+0000","last_became_peered":"2023-10-09T11:44:46.262471+0000","last_unstale":"2023-10-09T11:44:47.265381+0000","last_undegraded":"2023-10-09T11:44:47.265381+0000","last_fullsized":"2023-10-09T11:44:47.265381+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:35.195750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269999+0000","last_change":"2023-10-09T11:44:47.266570+0000","last_active":"2023-10-09T11:44:47.269999+0000","last_peered":"2023-10-09T11:44:47.269999+0000","last_clean":"2023-10-09T11:44:47.269999+0000","last_became_active":"2023-10-09T11:44:47.266185+0000","last_became_peered":"2023-10-09T11:44:47.266185+0000","last_unstale":"2023-10-09T11:44:47.269999+0000","last_undegraded":"2023-10-09T11:44:47.269999+0000","last_fullsized":"2023-10-09T11:44:47.269999+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:26.442052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263454+0000","last_change":"2023-10-09T11:44:46.256943+0000","last_active":"2023-10-09T11:44:47.263454+0000","last_peered":"2023-10-09T11:44:47.263454+0000","last_clean":"2023-10-09T11:44:47.263454+0000","last_became_active":"2023-10-09T11:44:46.256668+0000","last_became_peered":"2023-10-09T11:44:46.256668+0000","last_unstale":"2023-10-09T11:44:47.263454+0000","last_undegraded":"2023-10-09T11:44:47.263454+0000","last_fullsized":"2023-10-09T11:44:47.263454+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269528+0000","last_change":"2023-10-09T11:44:47.264295+0000","last_active":"2023-10-09T11:44:47.269528+0000","last_peered":"2023-10-09T11:44:47.269528+0000","last_clean":"2023-10-09T11:44:47.269528+0000","last_became_active":"2023-10-09T11:44:47.261582+0000","last_became_peered":"2023-10-09T11:44:47.261582+0000","last_unstale":"2023-10-09T11:44:47.269528+0000","last_undegraded":"2023-10-09T11:44:47.269528+0000","last_fullsized":"2023-10-09T11:44:47.269528+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:41.352820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272107+0000","last_change":"2023-10-09T11:44:46.256622+0000","last_active":"2023-10-09T11:44:47.272107+0000","last_peered":"2023-10-09T11:44:47.272107+0000","last_clean":"2023-10-09T11:44:47.272107+0000","last_became_active":"2023-10-09T11:44:46.255103+0000","last_became_peered":"2023-10-09T11:44:46.255103+0000","last_unstale":"2023-10-09T11:44:47.272107+0000","last_undegraded":"2023-10-09T11:44:47.272107+0000","last_fullsized":"2023-10-09T11:44:47.272107+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:55.276316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264172+0000","last_change":"2023-10-09T11:44:47.262285+0000","last_active":"2023-10-09T11:44:47.264172+0000","last_peered":"2023-10-09T11:44:47.264172+0000","last_clean":"2023-10-09T11:44:47.264172+0000","last_became_active":"2023-10-09T11:44:47.261995+0000","last_became_peered":"2023-10-09T11:44:47.261995+0000","last_unstale":"2023-10-09T11:44:47.264172+0000","last_undegraded":"2023-10-09T11:44:47.264172+0000","last_fullsized":"2023-10-09T11:44:47.264172+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:28.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248797+0000","last_change":"2023-10-09T11:44:46.264339+0000","last_active":"2023-10-09T11:44:47.248797+0000","last_peered":"2023-10-09T11:44:47.248797+0000","last_clean":"2023-10-09T11:44:47.248797+0000","last_became_active":"2023-10-09T11:44:46.264066+0000","last_became_peered":"2023-10-09T11:44:46.264066+0000","last_unstale":"2023-10-09T11:44:47.248797+0000","last_undegraded":"2023-10-09T11:44:47.248797+0000","last_fullsized":"2023-10-09T11:44:47.248797+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:00.425964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264922+0000","last_change":"2023-10-09T11:44:47.260753+0000","last_active":"2023-10-09T11:44:47.264922+0000","last_peered":"2023-10-09T11:44:47.264922+0000","last_clean":"2023-10-09T11:44:47.264922+0000","last_became_active":"2023-10-09T11:44:47.260455+0000","last_became_peered":"2023-10-09T11:44:47.260455+0000","last_unstale":"2023-10-09T11:44:47.264922+0000","last_undegraded":"2023-10-09T11:44:47.264922+0000","last_fullsized":"2023-10-09T11:44:47.264922+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:59.352866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246324+0000","last_change":"2023-10-09T11:44:46.261022+0000","last_active":"2023-10-09T11:44:47.246324+0000","last_peered":"2023-10-09T11:44:47.246324+0000","last_clean":"2023-10-09T11:44:47.246324+0000","last_became_active":"2023-10-09T11:44:46.260688+0000","last_became_peered":"2023-10-09T11:44:46.260688+0000","last_unstale":"2023-10-09T11:44:47.246324+0000","last_undegraded":"2023-10-09T11:44:47.246324+0000","last_fullsized":"2023-10-09T11:44:47.246324+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:22.524654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263384+0000","last_change":"2023-10-09T11:44:47.258787+0000","last_active":"2023-10-09T11:44:47.263384+0000","last_peered":"2023-10-09T11:44:47.263384+0000","last_clean":"2023-10-09T11:44:47.263384+0000","last_became_active":"2023-10-09T11:44:47.257995+0000","last_became_peered":"2023-10-09T11:44:47.257995+0000","last_unstale":"2023-10-09T11:44:47.263384+0000","last_undegraded":"2023-10-09T11:44:47.263384+0000","last_fullsized":"2023-10-09T11:44:47.263384+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:02.820695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247293+0000","last_change":"2023-10-09T11:44:46.258790+0000","last_active":"2023-10-09T11:44:47.247293+0000","last_peered":"2023-10-09T11:44:47.247293+0000","last_clean":"2023-10-09T11:44:47.247293+0000","last_became_active":"2023-10-09T11:44:46.257801+0000","last_became_peered":"2023-10-09T11:44:46.257801+0000","last_unstale":"2023-10-09T11:44:47.247293+0000","last_undegraded":"2023-10-09T11:44:47.247293+0000","last_fullsized":"2023-10-09T11:44:47.247293+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:25.439568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264650+0000","last_change":"2023-10-09T11:44:47.259916+0000","last_active":"2023-10-09T11:44:47.264650+0000","last_peered":"2023-10-09T11:44:47.264650+0000","last_clean":"2023-10-09T11:44:47.264650+0000","last_became_active":"2023-10-09T11:44:47.259644+0000","last_became_peered":"2023-10-09T11:44:47.259644+0000","last_unstale":"2023-10-09T11:44:47.264650+0000","last_undegraded":"2023-10-09T11:44:47.264650+0000","last_fullsized":"2023-10-09T11:44:47.264650+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:19.677634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.249613+0000","last_change":"2023-10-09T11:44:46.261860+0000","last_active":"2023-10-09T11:44:47.249613+0000","last_peered":"2023-10-09T11:44:47.249613+0000","last_clean":"2023-10-09T11:44:47.249613+0000","last_became_active":"2023-10-09T11:44:46.261582+0000","last_became_peered":"2023-10-09T11:44:46.261582+0000","last_unstale":"2023-10-09T11:44:47.249613+0000","last_undegraded":"2023-10-09T11:44:47.249613+0000","last_fullsized":"2023-10-09T11:44:47.249613+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:33.797406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268297+0000","last_change":"2023-10-09T11:44:47.265310+0000","last_active":"2023-10-09T11:44:47.268297+0000","last_peered":"2023-10-09T11:44:47.268297+0000","last_clean":"2023-10-09T11:44:47.268297+0000","last_became_active":"2023-10-09T11:44:47.264977+0000","last_became_peered":"2023-10-09T11:44:47.264977+0000","last_unstale":"2023-10-09T11:44:47.268297+0000","last_undegraded":"2023-10-09T11:44:47.268297+0000","last_fullsized":"2023-10-09T11:44:47.268297+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.887268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"197'3","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265593+0000","last_change":"2023-10-09T11:44:46.258002+0000","last_active":"2023-10-09T11:44:47.265593+0000","last_peered":"2023-10-09T11:44:47.265593+0000","last_clean":"2023-10-09T11:44:47.265593+0000","last_became_active":"2023-10-09T11:44:46.257671+0000","last_became_peered":"2023-10-09T11:44:46.257671+0000","last_unstale":"2023-10-09T11:44:47.265593+0000","last_undegraded":"2023-10-09T11:44:47.265593+0000","last_fullsized":"2023-10-09T11:44:47.265593+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:47.809752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275477+0000","last_change":"2023-10-09T11:44:47.272418+0000","last_active":"2023-10-09T11:44:47.275477+0000","last_peered":"2023-10-09T11:44:47.275477+0000","last_clean":"2023-10-09T11:44:47.275477+0000","last_became_active":"2023-10-09T11:44:47.272057+0000","last_became_peered":"2023-10-09T11:44:47.272057+0000","last_unstale":"2023-10-09T11:44:47.275477+0000","last_undegraded":"2023-10-09T11:44:47.275477+0000","last_fullsized":"2023-10-09T11:44:47.275477+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:06.314252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"197'6","reported_seq":16,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275837+0000","last_change":"2023-10-09T11:44:46.263987+0000","last_active":"2023-10-09T11:44:47.275837+0000","last_peered":"2023-10-09T11:44:47.275837+0000","last_clean":"2023-10-09T11:44:47.275837+0000","last_became_active":"2023-10-09T11:44:46.263719+0000","last_became_peered":"2023-10-09T11:44:46.263719+0000","last_unstale":"2023-10-09T11:44:47.275837+0000","last_undegraded":"2023-10-09T11:44:47.275837+0000","last_fullsized":"2023-10-09T11:44:47.275837+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:47.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269658+0000","last_change":"2023-10-09T11:44:47.264295+0000","last_active":"2023-10-09T11:44:47.269658+0000","last_peered":"2023-10-09T11:44:47.269658+0000","last_clean":"2023-10-09T11:44:47.269658+0000","last_became_active":"2023-10-09T11:44:47.263984+0000","last_became_peered":"2023-10-09T11:44:47.263984+0000","last_unstale":"2023-10-09T11:44:47.269658+0000","last_undegraded":"2023-10-09T11:44:47.269658+0000","last_fullsized":"2023-10-09T11:44:47.269658+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:59.158302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275467+0000","last_change":"2023-10-09T11:44:46.264516+0000","last_active":"2023-10-09T11:44:47.275467+0000","last_peered":"2023-10-09T11:44:47.275467+0000","last_clean":"2023-10-09T11:44:47.275467+0000","last_became_active":"2023-10-09T11:44:46.264199+0000","last_became_peered":"2023-10-09T11:44:46.264199+0000","last_unstale":"2023-10-09T11:44:47.275467+0000","last_undegraded":"2023-10-09T11:44:47.275467+0000","last_fullsized":"2023-10-09T11:44:47.275467+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:26.036047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272310+0000","last_change":"2023-10-09T11:44:47.269021+0000","last_active":"2023-10-09T11:44:47.272310+0000","last_peered":"2023-10-09T11:44:47.272310+0000","last_clean":"2023-10-09T11:44:47.272310+0000","last_became_active":"2023-10-09T11:44:47.267496+0000","last_became_peered":"2023-10-09T11:44:47.267496+0000","last_unstale":"2023-10-09T11:44:47.272310+0000","last_undegraded":"2023-10-09T11:44:47.272310+0000","last_fullsized":"2023-10-09T11:44:47.272310+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:16.289953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248095+0000","last_change":"2023-10-09T11:44:46.263598+0000","last_active":"2023-10-09T11:44:47.248095+0000","last_peered":"2023-10-09T11:44:47.248095+0000","last_clean":"2023-10-09T11:44:47.248095+0000","last_became_active":"2023-10-09T11:44:46.263323+0000","last_became_peered":"2023-10-09T11:44:46.263323+0000","last_unstale":"2023-10-09T11:44:47.248095+0000","last_undegraded":"2023-10-09T11:44:47.248095+0000","last_fullsized":"2023-10-09T11:44:47.248095+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:03.149760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.270783+0000","last_change":"2023-10-09T11:44:47.267744+0000","last_active":"2023-10-09T11:44:47.270783+0000","last_peered":"2023-10-09T11:44:47.270783+0000","last_clean":"2023-10-09T11:44:47.270783+0000","last_became_active":"2023-10-09T11:44:47.267490+0000","last_became_peered":"2023-10-09T11:44:47.267490+0000","last_unstale":"2023-10-09T11:44:47.270783+0000","last_undegraded":"2023-10-09T11:44:47.270783+0000","last_fullsized":"2023-10-09T11:44:47.270783+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:26:28.274874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247064+0000","last_change":"2023-10-09T11:44:46.257020+0000","last_active":"2023-10-09T11:44:47.247064+0000","last_peered":"2023-10-09T11:44:47.247064+0000","last_clean":"2023-10-09T11:44:47.247064+0000","last_became_active":"2023-10-09T11:44:46.256729+0000","last_became_peered":"2023-10-09T11:44:46.256729+0000","last_unstale":"2023-10-09T11:44:47.247064+0000","last_undegraded":"2023-10-09T11:44:47.247064+0000","last_fullsized":"2023-10-09T11:44:47.247064+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:06:05.309704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269436+0000","last_change":"2023-10-09T11:44:47.263837+0000","last_active":"2023-10-09T11:44:47.269436+0000","last_peered":"2023-10-09T11:44:47.269436+0000","last_clean":"2023-10-09T11:44:47.269436+0000","last_became_active":"2023-10-09T11:44:47.263216+0000","last_became_peered":"2023-10-09T11:44:47.263216+0000","last_unstale":"2023-10-09T11:44:47.269436+0000","last_undegraded":"2023-10-09T11:44:47.269436+0000","last_fullsized":"2023-10-09T11:44:47.269436+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:39.535020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"197'8","reported_seq":18,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266225+0000","last_change":"2023-10-09T11:44:46.253206+0000","last_active":"2023-10-09T11:44:47.266225+0000","last_peered":"2023-10-09T11:44:47.266225+0000","last_clean":"2023-10-09T11:44:47.266225+0000","last_became_active":"2023-10-09T11:44:46.252862+0000","last_became_peered":"2023-10-09T11:44:46.252862+0000","last_unstale":"2023-10-09T11:44:47.266225+0000","last_undegraded":"2023-10-09T11:44:47.266225+0000","last_fullsized":"2023-10-09T11:44:47.266225+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:32.508881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275442+0000","last_change":"2023-10-09T11:44:47.272093+0000","last_active":"2023-10-09T11:44:47.275442+0000","last_peered":"2023-10-09T11:44:47.275442+0000","last_clean":"2023-10-09T11:44:47.275442+0000","last_became_active":"2023-10-09T11:44:47.271330+0000","last_became_peered":"2023-10-09T11:44:47.271330+0000","last_unstale":"2023-10-09T11:44:47.275442+0000","last_undegraded":"2023-10-09T11:44:47.275442+0000","last_fullsized":"2023-10-09T11:44:47.275442+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:11.272831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266673+0000","last_change":"2023-10-09T11:44:46.262262+0000","last_active":"2023-10-09T11:44:47.266673+0000","last_peered":"2023-10-09T11:44:47.266673+0000","last_clean":"2023-10-09T11:44:47.266673+0000","last_became_active":"2023-10-09T11:44:46.261967+0000","last_became_peered":"2023-10-09T11:44:46.261967+0000","last_unstale":"2023-10-09T11:44:47.266673+0000","last_undegraded":"2023-10-09T11:44:47.266673+0000","last_fullsized":"2023-10-09T11:44:47.266673+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:15.247657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275435+0000","last_change":"2023-10-09T11:44:47.272085+0000","last_active":"2023-10-09T11:44:47.275435+0000","last_peered":"2023-10-09T11:44:47.275435+0000","last_clean":"2023-10-09T11:44:47.275435+0000","last_became_active":"2023-10-09T11:44:47.271786+0000","last_became_peered":"2023-10-09T11:44:47.271786+0000","last_unstale":"2023-10-09T11:44:47.275435+0000","last_undegraded":"2023-10-09T11:44:47.275435+0000","last_fullsized":"2023-10-09T11:44:47.275435+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:25.220598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265575+0000","last_change":"2023-10-09T11:44:46.262491+0000","last_active":"2023-10-09T11:44:47.265575+0000","last_peered":"2023-10-09T11:44:47.265575+0000","last_clean":"2023-10-09T11:44:47.265575+0000","last_became_active":"2023-10-09T11:44:46.261689+0000","last_became_peered":"2023-10-09T11:44:46.261689+0000","last_unstale":"2023-10-09T11:44:47.265575+0000","last_undegraded":"2023-10-09T11:44:47.265575+0000","last_fullsized":"2023-10-09T11:44:47.265575+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:01.858904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271725+0000","last_change":"2023-10-09T11:44:47.270067+0000","last_active":"2023-10-09T11:44:47.271725+0000","last_peered":"2023-10-09T11:44:47.271725+0000","last_clean":"2023-10-09T11:44:47.271725+0000","last_became_active":"2023-10-09T11:44:47.269804+0000","last_became_peered":"2023-10-09T11:44:47.269804+0000","last_unstale":"2023-10-09T11:44:47.271725+0000","last_undegraded":"2023-10-09T11:44:47.271725+0000","last_fullsized":"2023-10-09T11:44:47.271725+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:12.391841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.261403+0000","last_change":"2023-10-09T11:44:46.257653+0000","last_active":"2023-10-09T11:44:47.261403+0000","last_peered":"2023-10-09T11:44:47.261403+0000","last_clean":"2023-10-09T11:44:47.261403+0000","last_became_active":"2023-10-09T11:44:46.257242+0000","last_became_peered":"2023-10-09T11:44:46.257242+0000","last_unstale":"2023-10-09T11:44:47.261403+0000","last_undegraded":"2023-10-09T11:44:47.261403+0000","last_fullsized":"2023-10-09T11:44:47.261403+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:16.108432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275671+0000","last_change":"2023-10-09T11:44:47.274334+0000","last_active":"2023-10-09T11:44:47.275671+0000","last_peered":"2023-10-09T11:44:47.275671+0000","last_clean":"2023-10-09T11:44:47.275671+0000","last_became_active":"2023-10-09T11:44:47.273759+0000","last_became_peered":"2023-10-09T11:44:47.273759+0000","last_unstale":"2023-10-09T11:44:47.275671+0000","last_undegraded":"2023-10-09T11:44:47.275671+0000","last_fullsized":"2023-10-09T11:44:47.275671+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:09.831971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247465+0000","last_change":"2023-10-09T11:44:46.258580+0000","last_active":"2023-10-09T11:44:47.247465+0000","last_peered":"2023-10-09T11:44:47.247465+0000","last_clean":"2023-10-09T11:44:47.247465+0000","last_became_active":"2023-10-09T11:44:46.257372+0000","last_became_peered":"2023-10-09T11:44:46.257372+0000","last_unstale":"2023-10-09T11:44:47.247465+0000","last_undegraded":"2023-10-09T11:44:47.247465+0000","last_fullsized":"2023-10-09T11:44:47.247465+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:46.030793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.271754+0000","last_change":"2023-10-09T11:44:47.267886+0000","last_active":"2023-10-09T11:44:47.271754+0000","last_peered":"2023-10-09T11:44:47.271754+0000","last_clean":"2023-10-09T11:44:47.271754+0000","last_became_active":"2023-10-09T11:44:47.267620+0000","last_became_peered":"2023-10-09T11:44:47.267620+0000","last_unstale":"2023-10-09T11:44:47.271754+0000","last_undegraded":"2023-10-09T11:44:47.271754+0000","last_fullsized":"2023-10-09T11:44:47.271754+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:50.602320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.266023+0000","last_change":"2023-10-09T11:44:46.256243+0000","last_active":"2023-10-09T11:44:47.266023+0000","last_peered":"2023-10-09T11:44:47.266023+0000","last_clean":"2023-10-09T11:44:47.266023+0000","last_became_active":"2023-10-09T11:44:46.255919+0000","last_became_peered":"2023-10-09T11:44:46.255919+0000","last_unstale":"2023-10-09T11:44:47.266023+0000","last_undegraded":"2023-10-09T11:44:47.266023+0000","last_fullsized":"2023-10-09T11:44:47.266023+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:49.090835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272291+0000","last_change":"2023-10-09T11:44:47.268829+0000","last_active":"2023-10-09T11:44:47.272291+0000","last_peered":"2023-10-09T11:44:47.272291+0000","last_clean":"2023-10-09T11:44:47.272291+0000","last_became_active":"2023-10-09T11:44:47.267073+0000","last_became_peered":"2023-10-09T11:44:47.267073+0000","last_unstale":"2023-10-09T11:44:47.272291+0000","last_undegraded":"2023-10-09T11:44:47.272291+0000","last_fullsized":"2023-10-09T11:44:47.272291+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:23.499377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247096+0000","last_change":"2023-10-09T11:44:46.258481+0000","last_active":"2023-10-09T11:44:47.247096+0000","last_peered":"2023-10-09T11:44:47.247096+0000","last_clean":"2023-10-09T11:44:47.247096+0000","last_became_active":"2023-10-09T11:44:46.258198+0000","last_became_peered":"2023-10-09T11:44:46.258198+0000","last_unstale":"2023-10-09T11:44:47.247096+0000","last_undegraded":"2023-10-09T11:44:47.247096+0000","last_fullsized":"2023-10-09T11:44:47.247096+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:12.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263466+0000","last_change":"2023-10-09T11:44:47.259313+0000","last_active":"2023-10-09T11:44:47.263466+0000","last_peered":"2023-10-09T11:44:47.263466+0000","last_clean":"2023-10-09T11:44:47.263466+0000","last_became_active":"2023-10-09T11:44:47.259009+0000","last_became_peered":"2023-10-09T11:44:47.259009+0000","last_unstale":"2023-10-09T11:44:47.263466+0000","last_undegraded":"2023-10-09T11:44:47.263466+0000","last_fullsized":"2023-10-09T11:44:47.263466+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:52.307356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.254914+0000","last_change":"2023-10-09T11:44:46.260913+0000","last_active":"2023-10-09T11:44:47.254914+0000","last_peered":"2023-10-09T11:44:47.254914+0000","last_clean":"2023-10-09T11:44:47.254914+0000","last_became_active":"2023-10-09T11:44:46.260389+0000","last_became_peered":"2023-10-09T11:44:46.260389+0000","last_unstale":"2023-10-09T11:44:47.254914+0000","last_undegraded":"2023-10-09T11:44:47.254914+0000","last_fullsized":"2023-10-09T11:44:47.254914+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:25.864103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.270010+0000","last_change":"2023-10-09T11:44:47.266956+0000","last_active":"2023-10-09T11:44:47.270010+0000","last_peered":"2023-10-09T11:44:47.270010+0000","last_clean":"2023-10-09T11:44:47.270010+0000","last_became_active":"2023-10-09T11:44:47.266691+0000","last_became_peered":"2023-10-09T11:44:47.266691+0000","last_unstale":"2023-10-09T11:44:47.270010+0000","last_undegraded":"2023-10-09T11:44:47.270010+0000","last_fullsized":"2023-10-09T11:44:47.270010+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:11.379202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248977+0000","last_change":"2023-10-09T11:44:46.262182+0000","last_active":"2023-10-09T11:44:47.248977+0000","last_peered":"2023-10-09T11:44:47.248977+0000","last_clean":"2023-10-09T11:44:47.248977+0000","last_became_active":"2023-10-09T11:44:46.261917+0000","last_became_peered":"2023-10-09T11:44:46.261917+0000","last_unstale":"2023-10-09T11:44:47.248977+0000","last_undegraded":"2023-10-09T11:44:47.248977+0000","last_fullsized":"2023-10-09T11:44:47.248977+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:27.133028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269437+0000","last_change":"2023-10-09T11:44:47.267072+0000","last_active":"2023-10-09T11:44:47.269437+0000","last_peered":"2023-10-09T11:44:47.269437+0000","last_clean":"2023-10-09T11:44:47.269437+0000","last_became_active":"2023-10-09T11:44:47.266204+0000","last_became_peered":"2023-10-09T11:44:47.266204+0000","last_unstale":"2023-10-09T11:44:47.269437+0000","last_undegraded":"2023-10-09T11:44:47.269437+0000","last_fullsized":"2023-10-09T11:44:47.269437+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:50.698594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.269644+0000","last_change":"2023-10-09T11:44:46.261506+0000","last_active":"2023-10-09T11:44:47.269644+0000","last_peered":"2023-10-09T11:44:47.269644+0000","last_clean":"2023-10-09T11:44:47.269644+0000","last_became_active":"2023-10-09T11:44:46.261234+0000","last_became_peered":"2023-10-09T11:44:46.261234+0000","last_unstale":"2023-10-09T11:44:47.269644+0000","last_undegraded":"2023-10-09T11:44:47.269644+0000","last_fullsized":"2023-10-09T11:44:47.269644+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:03.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.265222+0000","last_change":"2023-10-09T11:44:47.260264+0000","last_active":"2023-10-09T11:44:47.265222+0000","last_peered":"2023-10-09T11:44:47.265222+0000","last_clean":"2023-10-09T11:44:47.265222+0000","last_became_active":"2023-10-09T11:44:47.259966+0000","last_became_peered":"2023-10-09T11:44:47.259966+0000","last_unstale":"2023-10-09T11:44:47.265222+0000","last_undegraded":"2023-10-09T11:44:47.265222+0000","last_fullsized":"2023-10-09T11:44:47.265222+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:50.093319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.248460+0000","last_change":"2023-10-09T11:44:46.262739+0000","last_active":"2023-10-09T11:44:47.248460+0000","last_peered":"2023-10-09T11:44:47.248460+0000","last_clean":"2023-10-09T11:44:47.248460+0000","last_became_active":"2023-10-09T11:44:46.262141+0000","last_became_peered":"2023-10-09T11:44:46.262141+0000","last_unstale":"2023-10-09T11:44:47.248460+0000","last_undegraded":"2023-10-09T11:44:47.248460+0000","last_fullsized":"2023-10-09T11:44:47.248460+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:23.717443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264169+0000","last_change":"2023-10-09T11:44:47.260893+0000","last_active":"2023-10-09T11:44:47.264169+0000","last_peered":"2023-10-09T11:44:47.264169+0000","last_clean":"2023-10-09T11:44:47.264169+0000","last_became_active":"2023-10-09T11:44:47.260627+0000","last_became_peered":"2023-10-09T11:44:47.260627+0000","last_unstale":"2023-10-09T11:44:47.264169+0000","last_undegraded":"2023-10-09T11:44:47.264169+0000","last_fullsized":"2023-10-09T11:44:47.264169+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:31.293944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247053+0000","last_change":"2023-10-09T11:44:46.257462+0000","last_active":"2023-10-09T11:44:47.247053+0000","last_peered":"2023-10-09T11:44:47.247053+0000","last_clean":"2023-10-09T11:44:47.247053+0000","last_became_active":"2023-10-09T11:44:46.256591+0000","last_became_peered":"2023-10-09T11:44:46.256591+0000","last_unstale":"2023-10-09T11:44:47.247053+0000","last_undegraded":"2023-10-09T11:44:47.247053+0000","last_fullsized":"2023-10-09T11:44:47.247053+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.275086+0000","last_change":"2023-10-09T11:44:47.272772+0000","last_active":"2023-10-09T11:44:47.275086+0000","last_peered":"2023-10-09T11:44:47.275086+0000","last_clean":"2023-10-09T11:44:47.275086+0000","last_became_active":"2023-10-09T11:44:47.272481+0000","last_became_peered":"2023-10-09T11:44:47.272481+0000","last_unstale":"2023-10-09T11:44:47.275086+0000","last_undegraded":"2023-10-09T11:44:47.275086+0000","last_fullsized":"2023-10-09T11:44:47.275086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:19.759566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247224+0000","last_change":"2023-10-09T11:44:46.257155+0000","last_active":"2023-10-09T11:44:47.247224+0000","last_peered":"2023-10-09T11:44:47.247224+0000","last_clean":"2023-10-09T11:44:47.247224+0000","last_became_active":"2023-10-09T11:44:46.256871+0000","last_became_peered":"2023-10-09T11:44:46.256871+0000","last_unstale":"2023-10-09T11:44:47.247224+0000","last_undegraded":"2023-10-09T11:44:47.247224+0000","last_fullsized":"2023-10-09T11:44:47.247224+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:57.639961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.263309+0000","last_change":"2023-10-09T11:44:47.260780+0000","last_active":"2023-10-09T11:44:47.263309+0000","last_peered":"2023-10-09T11:44:47.263309+0000","last_clean":"2023-10-09T11:44:47.263309+0000","last_became_active":"2023-10-09T11:44:47.260509+0000","last_became_peered":"2023-10-09T11:44:47.260509+0000","last_unstale":"2023-10-09T11:44:47.263309+0000","last_undegraded":"2023-10-09T11:44:47.263309+0000","last_fullsized":"2023-10-09T11:44:47.263309+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:50.856537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246964+0000","last_change":"2023-10-09T11:44:46.257529+0000","last_active":"2023-10-09T11:44:47.246964+0000","last_peered":"2023-10-09T11:44:47.246964+0000","last_clean":"2023-10-09T11:44:47.246964+0000","last_became_active":"2023-10-09T11:44:46.257232+0000","last_became_peered":"2023-10-09T11:44:46.257232+0000","last_unstale":"2023-10-09T11:44:47.246964+0000","last_undegraded":"2023-10-09T11:44:47.246964+0000","last_fullsized":"2023-10-09T11:44:47.246964+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:57.639961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.273597+0000","last_change":"2023-10-09T11:44:47.267362+0000","last_active":"2023-10-09T11:44:47.273597+0000","last_peered":"2023-10-09T11:44:47.273597+0000","last_clean":"2023-10-09T11:44:47.273597+0000","last_became_active":"2023-10-09T11:44:47.267091+0000","last_became_peered":"2023-10-09T11:44:47.267091+0000","last_unstale":"2023-10-09T11:44:47.273597+0000","last_undegraded":"2023-10-09T11:44:47.273597+0000","last_fullsized":"2023-10-09T11:44:47.273597+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:50.856537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246800+0000","last_change":"2023-10-09T11:44:46.255826+0000","last_active":"2023-10-09T11:44:47.246800+0000","last_peered":"2023-10-09T11:44:47.246800+0000","last_clean":"2023-10-09T11:44:47.246800+0000","last_became_active":"2023-10-09T11:44:46.255552+0000","last_became_peered":"2023-10-09T11:44:46.255552+0000","last_unstale":"2023-10-09T11:44:47.246800+0000","last_undegraded":"2023-10-09T11:44:47.246800+0000","last_fullsized":"2023-10-09T11:44:47.246800+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:08.589914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.268905+0000","last_change":"2023-10-09T11:44:47.262590+0000","last_active":"2023-10-09T11:44:47.268905+0000","last_peered":"2023-10-09T11:44:47.268905+0000","last_clean":"2023-10-09T11:44:47.268905+0000","last_became_active":"2023-10-09T11:44:47.262325+0000","last_became_peered":"2023-10-09T11:44:47.262325+0000","last_unstale":"2023-10-09T11:44:47.268905+0000","last_undegraded":"2023-10-09T11:44:47.268905+0000","last_fullsized":"2023-10-09T11:44:47.268905+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:35.862903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.246889+0000","last_change":"2023-10-09T11:44:46.254722+0000","last_active":"2023-10-09T11:44:47.246889+0000","last_peered":"2023-10-09T11:44:47.246889+0000","last_clean":"2023-10-09T11:44:47.246889+0000","last_became_active":"2023-10-09T11:44:46.254419+0000","last_became_peered":"2023-10-09T11:44:46.254419+0000","last_unstale":"2023-10-09T11:44:47.246889+0000","last_undegraded":"2023-10-09T11:44:47.246889+0000","last_fullsized":"2023-10-09T11:44:47.246889+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:43.072669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.272457+0000","last_change":"2023-10-09T11:44:47.258796+0000","last_active":"2023-10-09T11:44:47.272457+0000","last_peered":"2023-10-09T11:44:47.272457+0000","last_clean":"2023-10-09T11:44:47.272457+0000","last_became_active":"2023-10-09T11:44:47.258372+0000","last_became_peered":"2023-10-09T11:44:47.258372+0000","last_unstale":"2023-10-09T11:44:47.272457+0000","last_undegraded":"2023-10-09T11:44:47.272457+0000","last_fullsized":"2023-10-09T11:44:47.272457+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:44.041870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.247243+0000","last_change":"2023-10-09T11:44:46.264611+0000","last_active":"2023-10-09T11:44:47.247243+0000","last_peered":"2023-10-09T11:44:47.247243+0000","last_clean":"2023-10-09T11:44:47.247243+0000","last_became_active":"2023-10-09T11:44:46.264322+0000","last_became_peered":"2023-10-09T11:44:46.264322+0000","last_unstale":"2023-10-09T11:44:47.247243+0000","last_undegraded":"2023-10-09T11:44:47.247243+0000","last_fullsized":"2023-10-09T11:44:47.247243+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:45.231076+0000","last_clean_scrub_stamp":"2023-10-09T11:44:45.231076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.264902+0000","last_change":"2023-10-09T11:44:47.260674+0000","last_active":"2023-10-09T11:44:47.264902+0000","last_peered":"2023-10-09T11:44:47.264902+0000","last_clean":"2023-10-09T11:44:47.264902+0000","last_became_active":"2023-10-09T11:44:47.260409+0000","last_became_peered":"2023-10-09T11:44:47.260409+0000","last_unstale":"2023-10-09T11:44:47.264902+0000","last_undegraded":"2023-10-09T11:44:47.264902+0000","last_fullsized":"2023-10-09T11:44:47.264902+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:44:46.233560+0000","last_clean_scrub_stamp":"2023-10-09T11:44:46.233560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:25.316603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-09T11:44:47.251288+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:44:47.251288+0000","last_peered":"2023-10-09T11:44:47.251288+0000","last_clean":"2023-10-09T11:44:47.251288+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:44:47.251288+0000","last_undegraded":"2023-10-09T11:44:47.251288+0000","last_fullsized":"2023-10-09T11:44:47.251288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542265,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304428,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067412,"statfs":{"total":96636764160,"available":96325029888,"internally_reserved":0,"allocated":3117056,"data_stored":1722709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.64900000000000002},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.503,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64600000000000002,"5min":0.751,"15min":2.6160000000000001},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":5.9450000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.75600000000000001,"15min":1.256},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.77200000000000002},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.872,"5min":0.872,"15min":8.8940000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68100000000000005,"5min":0.79700000000000004,"15min":0.82499999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.66300000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67000000000000004,"5min":0.79200000000000004,"15min":1.3},"last":0.317},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.48299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":1.163},"last":0.46500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.29299999999999998},"max":{"1min":0.82399999999999995,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.57099999999999995,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":1.369},"last":0.49299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.999},"last":0.443},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58799999999999997,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.34000000000000002,"15min":0.314},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.52100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542265,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1131799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":0.79400000000000004,"5min":0.83599999999999997,"15min":0.95599999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.59899999999999998},"min":{"1min":0.435,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80500000000000005,"5min":0.85199999999999998,"15min":1.153},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.92800000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.81299999999999994},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57499999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":1.1060000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84499999999999997,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76200000000000001,"5min":2.895,"15min":2.895},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.871,"15min":0.871},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0069999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.314},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.61599999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.746},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2523136,"data_stored":1131889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.47099999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.54500000000000004,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.64700000000000002},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.215},"max":{"1min":0.58899999999999997,"5min":0.65600000000000003,"15min":11.06},"last":0.372}]},{"osd":2,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.78500000000000003},"min":{"1min":0.26700000000000002,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.495,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.67900000000000005},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54000000000000004,"5min":2.1960000000000002,"15min":11.935},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.65300000000000002},"min":{"1min":0.28799999999999998,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.51800000000000002,"5min":0.76400000000000001,"15min":11.087},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.57899999999999996,"5min":0.70099999999999996,"15min":5.0060000000000002},"last":0.317}]},{"osd":4,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.96399999999999997,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.434},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.373},"max":{"1min":0.97899999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":10.939},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.71399999999999997},"min":{"1min":0.50900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":4.9370000000000003},"last":0.41499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.622,"15min":0.90400000000000003},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":1.0089999999999999,"15min":10.975},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63800000000000001,"15min":0.93100000000000005},"min":{"1min":0.46999999999999997,"5min":0.39800000000000002,"15min":0.38100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.436,"5min":0.39700000000000002,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":1.72,"15min":1.72},"last":0.498},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63700000000000001,"15min":0.93100000000000005},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":11.000999999999999},"last":0.44400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308520,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063320,"statfs":{"total":96636764160,"available":96320839680,"internally_reserved":0,"allocated":3112960,"data_stored":1722203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.47699999999999998},"min":{"1min":0.22600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.248},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.51200000000000001},"min":{"1min":0.318,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63400000000000001,"5min":0.73099999999999998,"15min":3.8180000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.68700000000000006},"min":{"1min":0.313,"5min":0.222,"15min":0.222},"max":{"1min":0.55400000000000005,"5min":0.81200000000000006,"15min":11.031000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.371,"15min":0.71699999999999997},"min":{"1min":0.245,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.67400000000000004,"5min":0.71499999999999997,"15min":12.589},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.42899999999999999},"min":{"1min":0.317,"5min":0.25,"15min":0.25},"max":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":1.6739999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.43099999999999999},"min":{"1min":0.29699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":1.502},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.625},"min":{"1min":0.41799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78700000000000003,"5min":1.095,"15min":1.446},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":1.1970000000000001,"15min":1.278},"last":0.81499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.65000000000000002},"min":{"1min":0.44800000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85999999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.62,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":2.286,"15min":2.286},"last":0.76900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.91900000000000004,"5min":0.95799999999999996,"15min":1.639},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.68000000000000005},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.88700000000000001,"5min":1.288,"15min":1.3149999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":0.85499999999999998,"5min":1.038,"15min":1.5629999999999999},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1133877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32500000000000001},"min":{"1min":0.25,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.501,"5min":0.60999999999999999,"15min":1.272},"last":0.311},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35699999999999998,"15min":0.36699999999999999},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.52500000000000002,"5min":0.59899999999999998,"15min":0.66000000000000003},"last":0.249}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.41099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.376},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60199999999999998,"5min":0.70299999999999996,"15min":1.246},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.54200000000000004,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80800000000000005,"5min":0.92800000000000005,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.181,"5min":1.181,"15min":1.286},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.47499999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.65100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.018,"5min":1.018,"15min":1.3149999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64100000000000001,"15min":0.624},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":2519040,"data_stored":1131855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.33300000000000002,"15min":0.33800000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34999999999999998,"15min":0.33500000000000002},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.41499999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":0.48999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.38900000000000001,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.49399999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41699999999999998,"15min":0.40899999999999997},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.502,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.45800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":4,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.373},"max":{"1min":0.61799999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.95999999999999996},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.68999999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.747,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:44:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70899999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83599999999999997,"5min":0.871,"15min":0.873},"last":0.56599999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542266,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303852,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067988,"statfs":{"total":96636764160,"available":96325619712,"internally_reserved":0,"allocated":2527232,"data_stored":1133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":1.056},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":0.82199999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.65500000000000003},"min":{"1min":0.47799999999999998,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.7400000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60199999999999998,"15min":0.69999999999999996},"min":{"1min":0.438,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.85499999999999998,"15min":3.8519999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.84499999999999997,"15min":1.234},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":0.81999999999999995,"15min":0.91800000000000004},"last":0.496}]},{"osd":6,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.0229999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.878,"15min":1.282},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.78100000000000003,"5min":0.79900000000000004,"15min":0.95499999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.58799999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542266,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1131835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.63,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.314,"15min":0.307},"max":{"1min":5.5229999999999997,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.67300000000000004,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.33200000000000002,"15min":0.314},"max":{"1min":5.0970000000000004,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.54800000000000004},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.84799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.34000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.498}]},{"osd":3,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.41499999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55000000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.47899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.873,"5min":0.873,"15min":0.89200000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:44:51.743 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:44:51.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:44:51.898 INFO:tasks.ceph.mds.b.smithi067.stderr:2023-10-09T11:44:51.897+0000 7eff5bca8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:44:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.902+0000 7fc71e4aa700 1 Processor -- start 2023-10-09T11:44:51.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.902+0000 7fc71e4aa700 1 -- start start 2023-10-09T11:44:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71e4aa700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc71813fb20 0x7fc71815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71e4aa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71e4aa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71815ae70 con 0x7fc71813fef0 2023-10-09T11:44:51.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71e4aa700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71806af60 con 0x7fc71813fb20 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71e4aa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71806b240 con 0x7fc71806aaa0 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71dca9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71d4a8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc71813fb20 0x7fc71815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71dca9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:53690/0 (socket says 172.21.15.26:53690) 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71d4a8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc71813fb20 0x7fc71815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:40600/0 (socket says 172.21.15.26:40600) 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71cca7700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc71813fef0 0x7fc7180c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:56236/0 (socket says 172.21.15.26:56236) 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.903+0000 7fc71dca9700 1 -- 172.21.15.26:0/2859363291 learned_addr learned my addr 172.21.15.26:0/2859363291 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc71d4a8700 1 -- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 msgr2=0x7fc7180c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc71d4a8700 1 --2- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc71d4a8700 1 -- 172.21.15.26:0/2859363291 >> v1:172.21.15.67:6789/0 conn(0x7fc71813fef0 legacy=0x7fc7180c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc71d4a8700 1 -- 172.21.15.26:0/2859363291 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71806b520 con 0x7fc71813fb20 2023-10-09T11:44:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc71d4a8700 1 --2- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fb20 0x7fc71815a930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc7140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57d0d2e53e816d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc70ffff700 1 -- 172.21.15.26:0/2859363291 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400b640 con 0x7fc71813fb20 2023-10-09T11:44:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc70ffff700 1 -- 172.21.15.26:0/2859363291 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400b7a0 con 0x7fc71813fb20 2023-10-09T11:44:51.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.904+0000 7fc70ffff700 1 -- 172.21.15.26:0/2859363291 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400bb40 con 0x7fc71813fb20 2023-10-09T11:44:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 -- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fb20 msgr2=0x7fc71815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fb20 0x7fc71815a930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098e0 tx=0x7fc7140091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 -- 172.21.15.26:0/2859363291 shutdown_connections 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/2859363291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fb20 0x7fc71815a930 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 -- 172.21.15.26:0/2859363291 >> 172.21.15.26:0/2859363291 conn(0x7fc71806d170 msgr2=0x7fc7180cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 -- 172.21.15.26:0/2859363291 shutdown_connections 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.905+0000 7fc71e4aa700 1 -- 172.21.15.26:0/2859363291 wait complete. 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.906+0000 7fc71e4aa700 1 Processor -- start 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.906+0000 7fc71e4aa700 1 -- start start 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 0x7fc7180c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718157800 con 0x7fc71813fb20 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718156950 con 0x7fc71813fef0 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71e4aa700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc718156bf0 con 0x7fc71806aaa0 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58576/0 (socket says 172.21.15.26:58576) 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 -- 172.21.15.26:0/456667417 learned_addr learned my addr 172.21.15.26:0/456667417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71dca9700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 0x7fc7180c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71d4a8700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 -- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 msgr2=0x7fc7180b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 -- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 msgr2=0x7fc7180c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 0x7fc7180c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 -- 172.21.15.26:0/456667417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714009420 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71dca9700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 0x7fc7180c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc71cca7700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c790 tx=0x7fc708007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708005ac0 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.907+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708005c20 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.908+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080070d0 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.908+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc718156ed0 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.908+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc718157490 con 0x7fc71813fb20 2023-10-09T11:44:51.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.908+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7181579b0 con 0x7fc71813fb20 2023-10-09T11:44:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.909+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc7080074c0 con 0x7fc71813fb20 2023-10-09T11:44:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.909+0000 7fc70d7fa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 0x7fc6fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.909+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc708083f30 con 0x7fc71813fb20 2023-10-09T11:44:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.909+0000 7fc71d4a8700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 0x7fc6fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:51.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.910+0000 7fc71d4a8700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 0x7fc6fc0697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc718159c10 tx=0x7fc714017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:51.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:51.914+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7181579b0 con 0x7fc71813fb20 2023-10-09T11:44:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.186+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc71815ae70 con 0x7fc71813fb20 2023-10-09T11:44:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.190+0000 7fc70d7fa700 1 -- 172.21.15.26:0/456667417 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc71815ae70 con 0x7fc71813fb20 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 msgr2=0x7fc6fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 0x7fc6fc0697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc718159c10 tx=0x7fc714017000 comp rx=0 tx=0).stop 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 msgr2=0x7fc7180c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c790 tx=0x7fc708007f00 comp rx=0 tx=0).stop 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 shutdown_connections 2023-10-09T11:44:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71813fef0 0x7fc7180c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc6fc067320 0x7fc6fc0697d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc71806aaa0 0x7fc7180b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 --2- 172.21.15.26:0/456667417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc71813fb20 0x7fc7180c7860 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 >> 172.21.15.26:0/456667417 conn(0x7fc71806d170 msgr2=0x7fc71813c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 shutdown_connections 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.192+0000 7fc71e4aa700 1 -- 172.21.15.26:0/456667417 wait complete. 2023-10-09T11:44:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-10-09T11:44:52.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:44:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.324+0000 7f8f46462700 1 Processor -- start 2023-10-09T11:44:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.324+0000 7f8f46462700 1 -- start start 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f40153c30 0x7f8f4015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f4015de50 0x7f8f400cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f400cef40 0x7f8f4006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4015afd0 con 0x7f8f4015de50 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4015b2b0 con 0x7f8f400cef40 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f46462700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4015b590 con 0x7f8f40153c30 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f4015de50 0x7f8f400cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f4015de50 0x7f8f400cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58580/0 (socket says 172.21.15.26:58580) 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 -- 172.21.15.26:0/866437124 learned_addr learned my addr 172.21.15.26:0/866437124 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f45c61700 1 --2- 172.21.15.26:0/866437124 >> v2:172.21.15.67:3300/0 conn(0x7f8f400cef40 0x7f8f4006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f45460700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f40153c30 0x7f8f4015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 -- 172.21.15.26:0/866437124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f40153c30 msgr2=0x7f8f4015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f40153c30 0x7f8f4015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 -- 172.21.15.26:0/866437124 >> v2:172.21.15.67:3300/0 conn(0x7f8f400cef40 msgr2=0x7f8f4006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/866437124 >> v2:172.21.15.67:3300/0 conn(0x7f8f400cef40 0x7f8f4006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.325+0000 7f8f44c5f700 1 -- 172.21.15.26:0/866437124 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4015b870 con 0x7f8f4015de50 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f4015de50 0x7f8f400cea00 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f8f40071370 tx=0x7f8f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbb48d3ee6afd36 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f37fff700 1 -- 172.21.15.26:0/866437124 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000b640 con 0x7f8f4015de50 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f37fff700 1 -- 172.21.15.26:0/866437124 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000b7a0 con 0x7f8f4015de50 2023-10-09T11:44:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f37fff700 1 -- 172.21.15.26:0/866437124 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000bb60 con 0x7f8f4015de50 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 -- 172.21.15.26:0/866437124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f4015de50 msgr2=0x7f8f400cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f4015de50 0x7f8f400cea00 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f8f40071370 tx=0x7f8f30009250 comp rx=0 tx=0).stop 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 -- 172.21.15.26:0/866437124 shutdown_connections 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 --2- 172.21.15.26:0/866437124 >> v2:172.21.15.67:3300/0 conn(0x7f8f400cef40 0x7f8f4006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f40153c30 0x7f8f4015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 --2- 172.21.15.26:0/866437124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f4015de50 0x7f8f400cea00 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 -- 172.21.15.26:0/866437124 >> 172.21.15.26:0/866437124 conn(0x7f8f400703a0 msgr2=0x7f8f400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 -- 172.21.15.26:0/866437124 shutdown_connections 2023-10-09T11:44:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.326+0000 7f8f46462700 1 -- 172.21.15.26:0/866437124 wait complete. 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.327+0000 7f8f46462700 1 Processor -- start 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.327+0000 7f8f46462700 1 -- start start 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f400cef40 0x7f8f40150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f4015de50 0x7f8f400cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40150e90 con 0x7f8f40153c30 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40151cd0 con 0x7f8f400cef40 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f46462700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f401510c0 con 0x7f8f4015de50 2023-10-09T11:44:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f44c5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f44c5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58586/0 (socket says 172.21.15.26:58586) 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f44c5f700 1 -- 172.21.15.26:0/884887527 learned_addr learned my addr 172.21.15.26:0/884887527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.328+0000 7f8f45460700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f400cef40 0x7f8f40150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f45c61700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f4015de50 0x7f8f400cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 -- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f4015de50 msgr2=0x7f8f400cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f4015de50 0x7f8f400cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 -- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f400cef40 msgr2=0x7f8f40150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f400cef40 0x7f8f40150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 -- 172.21.15.26:0/884887527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300094f0 con 0x7f8f40153c30 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f44c5f700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f8f30006fd0 tx=0x7f8f30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000bb20 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30000c90 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f401513a0 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3001a6a0 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.329+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f40151960 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.330+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f40151e60 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.330+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f3001aa50 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.331+0000 7f8f357fa700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 0x7f8f24069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.331+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f30086380 con 0x7f8f40153c30 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.331+0000 7f8f45460700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 0x7f8f24069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.332+0000 7f8f45460700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 0x7f8f24069800 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009db0 tx=0x7f8f3c0091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:52.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.335+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f30053090 con 0x7f8f40153c30 2023-10-09T11:44:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.575+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f4004c3c0 con 0x7f8f40153c30 2023-10-09T11:44:52.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.575+0000 7f8f357fa700 1 -- 172.21.15.26:0/884887527 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) v1 ==== 95+0+4598 (secure 0 0 0) 0x7f8f300566b0 con 0x7f8f40153c30 2023-10-09T11:44:52.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:44:52.577 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":131,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:44:52.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 msgr2=0x7f8f24069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 0x7f8f24069800 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009db0 tx=0x7f8f3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 msgr2=0x7f8f401490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:52.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f8f30006fd0 tx=0x7f8f30017000 comp rx=0 tx=0).stop 2023-10-09T11:44:52.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 shutdown_connections 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8f24067350 0x7f8f24069800 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8f4015de50 0x7f8f400cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f400cef40 0x7f8f40150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 --2- 172.21.15.26:0/884887527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f40153c30 0x7f8f401490f0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 >> 172.21.15.26:0/884887527 conn(0x7f8f400703a0 msgr2=0x7f8f400c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 shutdown_connections 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:52.578+0000 7f8f46462700 1 -- 172.21.15.26:0/884887527 wait complete. 2023-10-09T11:44:52.580 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 131 2023-10-09T11:44:52.994 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 131, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:44:46.652141+0000', 'modified': '2023-10-09T11:44:50.262164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9141': {'gid': 9141, 'name': 'b', 'rank': 0, 'incarnation': 127, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6837/2946278291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6835', 'nonce': 2946278291}, {'type': 'v1', 'addr': '172.21.15.67:6837', 'nonce': 2946278291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:44:52.994 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:44:52.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T11:44:53.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.117+0000 7f4a3e180700 1 Processor -- start 2023-10-09T11:44:53.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.117+0000 7f4a3e180700 1 -- start start 2023-10-09T11:44:53.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3e180700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a380cf110 0x7f4a38164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3e180700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3815afd0 con 0x7f4a38153c30 2023-10-09T11:44:53.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3e180700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3815b2b0 con 0x7f4a3815de50 2023-10-09T11:44:53.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3e180700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3815b590 con 0x7f4a380cf110 2023-10-09T11:44:53.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3d17e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a38153c30 0x7f4a3815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44598/0 (socket says 172.21.15.26:44598) 2023-10-09T11:44:53.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3d17e700 1 -- 172.21.15.26:0/691200792 learned_addr learned my addr 172.21.15.26:0/691200792 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318985092 0 0) 0x7f4a3815afd0 con 0x7f4a38153c30 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a20003570 con 0x7f4a38153c30 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.118+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/691200792 >> v2:172.21.15.67:3300/0 conn(0x7f4a380cf110 0x7f4a38164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142717681 0 0) 0x7f4a20003570 con 0x7f4a38153c30 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 >> v2:172.21.15.67:3300/0 conn(0x7f4a380cf110 msgr2=0x7f4a38164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 --2- 172.21.15.26:0/691200792 >> v2:172.21.15.67:3300/0 conn(0x7f4a380cf110 0x7f4a38164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 >> v1:172.21.15.67:6789/0 conn(0x7f4a3815de50 legacy=0x7f4a380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3815b870 con 0x7f4a38153c30 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f4a30001470 con 0x7f4a38153c30 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 >> v1:172.21.15.26:6789/0 conn(0x7f4a38153c30 legacy=0x7f4a3815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 0x7f4a20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a20004810 0x7f4a20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a200051c0 0x7f4a2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3815b590 con 0x7f4a20003a60 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2000c0d0 con 0x7f4a20004810 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2000c290 con 0x7f4a200051c0 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 0x7f4a20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a20004810 0x7f4a20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a200051c0 0x7f4a2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 -- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a200051c0 msgr2=0x7f4a2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a200051c0 0x7f4a2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 -- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a20004810 msgr2=0x7f4a20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a20004810 0x7f4a20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 -- 172.21.15.26:0/691200792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20003570 con 0x7f4a20003a60 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d97f700 1 -- 172.21.15.26:0/691200792 reap_dead start 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.119+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 0x7f4a20003e70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000c390 tx=0x7f4a3815e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7a3b54fbb2588b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000cc60 con 0x7f4a20003a60 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000cdc0 con 0x7f4a20003a60 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a37fff700 1 -- 172.21.15.26:0/691200792 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a30005b70 con 0x7f4a20003a60 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 -- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 msgr2=0x7f4a20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 0x7f4a20003e70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000c390 tx=0x7f4a3815e2d0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 -- 172.21.15.26:0/691200792 shutdown_connections 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 --2- 172.21.15.26:0/691200792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a20003a60 0x7f4a20003e70 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 -- 172.21.15.26:0/691200792 >> 172.21.15.26:0/691200792 conn(0x7f4a380703a0 msgr2=0x7f4a380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 -- 172.21.15.26:0/691200792 shutdown_connections 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.120+0000 7f4a3e180700 1 -- 172.21.15.26:0/691200792 wait complete. 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.121+0000 7f4a3e180700 1 Processor -- start 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.121+0000 7f4a3e180700 1 -- start start 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a20003a60 0x7f4a380cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a380cc9b0 0x7f4a3814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380cb800 con 0x7f4a380c8dd0 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3814b5b0 con 0x7f4a380cc9b0 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3e180700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380c9720 con 0x7f4a20003a60 2023-10-09T11:44:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3d97f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3d97f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58592/0 (socket says 172.21.15.26:58592) 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3d97f700 1 -- 172.21.15.26:0/730518630 learned_addr learned my addr 172.21.15.26:0/730518630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a380cc9b0 0x7f4a3814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.122+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a20003a60 0x7f4a380cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 -- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a20003a60 msgr2=0x7f4a380cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a20003a60 0x7f4a380cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 -- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a380cc9b0 msgr2=0x7f4a3814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a380cc9b0 0x7f4a3814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 -- 172.21.15.26:0/730518630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380cb1b0 con 0x7f4a380c8dd0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f4a38071370 tx=0x7f4a2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a357fa700 1 -- 172.21.15.26:0/730518630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800e070 con 0x7f4a380c8dd0 2023-10-09T11:44:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a357fa700 1 -- 172.21.15.26:0/730518630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28011b80 con 0x7f4a380c8dd0 2023-10-09T11:44:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a380cb490 con 0x7f4a380c8dd0 2023-10-09T11:44:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a357fa700 1 -- 172.21.15.26:0/730518630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28016470 con 0x7f4a380c8dd0 2023-10-09T11:44:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.123+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a380c9240 con 0x7f4a380c8dd0 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.124+0000 7f4a357fa700 1 -- 172.21.15.26:0/730518630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a280168a0 con 0x7f4a380c8dd0 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.125+0000 7f4a357fa700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 0x7f4a24069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.125+0000 7f4a357fa700 1 -- 172.21.15.26:0/730518630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a28085600 con 0x7f4a380c8dd0 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.125+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 0x7f4a24069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.126+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 0x7f4a24069800 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4a30007cd0 tx=0x7f4a30015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 Processor -- start 2023-10-09T11:44:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 -- start start 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c5c480 0x561f50c3b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c0f5f0 0x561f50c5c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50b68a70 con 0x561f50c11b80 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50b66270 con 0x561f50c5c480 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f50b62060 con 0x561f50c0f5f0 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a3d97f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a3d97f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58596/0 (socket says 172.21.15.26:58596) 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.127+0000 7f4a3d97f700 1 -- 172.21.15.26:0/1514909638 learned_addr learned my addr 172.21.15.26:0/1514909638 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c5c480 0x561f50c3b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c0f5f0 0x561f50c5c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 -- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c0f5f0 msgr2=0x561f50c5c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c0f5f0 0x561f50c5c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 -- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c5c480 msgr2=0x561f50c3b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c5c480 0x561f50c3b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 -- 172.21.15.26:0/1514909638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f509fc270 con 0x561f50c11b80 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4a28055c40 tx=0x7f4a28007260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882c28327557cd52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a1e7fc700 1 -- 172.21.15.26:0/1514909638 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28055f40 con 0x561f50c11b80 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a1e7fc700 1 -- 172.21.15.26:0/1514909638 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28059190 con 0x561f50c11b80 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.128+0000 7f4a1e7fc700 1 -- 172.21.15.26:0/1514909638 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2805cee0 con 0x561f50c11b80 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- 172.21.15.26:0/1514909638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 msgr2=0x561f50c11ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4a28055c40 tx=0x7f4a28007260 comp rx=0 tx=0).stop 2023-10-09T11:44:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- 172.21.15.26:0/1514909638 shutdown_connections 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c11ff0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c5c480 0x561f50c3b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1514909638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c0f5f0 0x561f50c5c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- 172.21.15.26:0/1514909638 >> 172.21.15.26:0/1514909638 conn(0x561f50c130c0 msgr2=0x561f50c138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- 172.21.15.26:0/1514909638 shutdown_connections 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- 172.21.15.26:0/1514909638 wait complete. 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 -- start start 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.129+0000 7f4a486dab80 1 Processor -- start 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c34ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50b0d890 con 0x561f50c11b80 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50b28ea0 con 0x561f50c0f5f0 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f509e4e30 con 0x561f50c5c480 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a486dab80 10 client.0 _ll_register_callbacks cb 0x561f50bd52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58606/0 (socket says 172.21.15.26:58606) 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a3c97d700 1 -- 172.21.15.26:0/3952132808 learned_addr learned my addr 172.21.15.26:0/3952132808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.130+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c34ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 -- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 msgr2=0x561f50c356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 -- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 msgr2=0x561f50c34ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c34ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 -- 172.21.15.26:0/3952132808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a380c9240 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0146e0 tx=0x7f4a2c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddd1364c2d6b7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0036d0 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a2c006a30 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f50c06cd0 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a2c006e00 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 10 client.9261 fetch_fsmap learned FSMap version 131 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=2+}) v3 -- 0x561f5099efe0 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f50c06cd0 con 0x561f50c11b80 2023-10-09T11:44:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 131) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4a2c012070 con 0x561f50c11b80 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 10 client.9261 fetch_fsmap finished waiting for FSMap version 131 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 10 client.9261 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 20 client.9261 populate_metadata read hostname 'smithi026' 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c12150 0x561f50c12520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 4 client.9261 mds_command: new command op to 9141 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.131+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 --> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f50be3aa0 con 0x561f50c12150 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.132+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c12150 0x561f50c12520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.132+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c12150 0x561f50c12520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3116be945419ca14 server_cookie=5258703b0efffd1e in_seq=0 out_seq=0 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.132+0000 7f4a177fe700 10 client.9261 ms_handle_connect on v2:172.21.15.67:6835/2946278291 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a177fe700 1 -- 172.21.15.26:0/3952132808 <== mds.0 v2:172.21.15.67:6835/2946278291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561f50be3aa0 con 0x561f50c12150 2023-10-09T11:44:53.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a177fe700 10 client.9261 handle_command_reply: tid=0 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 client.9261 shutdown 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 msgr2=0x561f50c33a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0146e0 tx=0x7f4a2c009040 comp rx=0 tx=0).stop 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 shutdown_connections 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c12150 0x561f50c12520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c34ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 --2- 172.21.15.26:0/3952132808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c33a40 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a177fe700 0 client.9261 ms_handle_reset on v2:172.21.15.67:6835/2946278291 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 >> 172.21.15.26:0/3952132808 conn(0x561f50c130c0 msgr2=0x561f50c15560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 shutdown_connections 2023-10-09T11:44:53.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.133+0000 7f4a486dab80 1 -- 172.21.15.26:0/3952132808 wait complete. 2023-10-09T11:44:53.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.134+0000 7f4a486dab80 20 client.9261 trim_cache size 0 max 16384 2023-10-09T11:44:53.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.150+0000 7f4a486dab80 1 Processor -- start 2023-10-09T11:44:53.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.150+0000 7f4a486dab80 1 -- start start 2023-10-09T11:44:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c3adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c0eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50c0df90 con 0x561f50c11b80 2023-10-09T11:44:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50c587a0 con 0x561f50c0f5f0 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f50c3bd80 con 0x561f50c5c480 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58608/0 (socket says 172.21.15.26:58608) 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 -- 172.21.15.26:0/919822073 learned_addr learned my addr 172.21.15.26:0/919822073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 -- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 msgr2=0x561f50c0eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c0eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 -- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 msgr2=0x561f50c3adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c3adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.151+0000 7f4a3c97d700 1 -- 172.21.15.26:0/919822073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f50c08a30 con 0x561f50c11b80 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c006e80 tx=0x7f4a2c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c41f7126c80417c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a1effd700 1 -- 172.21.15.26:0/919822073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c007190 con 0x561f50c11b80 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a1effd700 1 -- 172.21.15.26:0/919822073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0073a0 con 0x561f50c11b80 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a1effd700 1 -- 172.21.15.26:0/919822073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c003640 con 0x561f50c11b80 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 -- 172.21.15.26:0/919822073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 msgr2=0x561f50c0e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c006e80 tx=0x7f4a2c01d000 comp rx=0 tx=0).stop 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 -- 172.21.15.26:0/919822073 shutdown_connections 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c0eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c3adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 --2- 172.21.15.26:0/919822073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50c0e9a0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 -- 172.21.15.26:0/919822073 >> 172.21.15.26:0/919822073 conn(0x561f50c130c0 msgr2=0x561f50c0e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 -- 172.21.15.26:0/919822073 shutdown_connections 2023-10-09T11:44:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.152+0000 7f4a486dab80 1 -- 172.21.15.26:0/919822073 wait complete. 2023-10-09T11:44:53.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.153+0000 7f4a486dab80 1 -- start start 2023-10-09T11:44:53.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.153+0000 7f4a486dab80 1 Processor -- start 2023-10-09T11:44:53.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c69d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50c6a280 con 0x561f50c11b80 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f50c6a6b0 con 0x561f50c0f5f0 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f50c7a9e0 con 0x561f50c5c480 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 10 client.0 _ll_register_callbacks cb 0x561f50bd52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58614/0 (socket says 172.21.15.26:58614) 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 -- 172.21.15.26:0/1067704261 learned_addr learned my addr 172.21.15.26:0/1067704261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 -- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 msgr2=0x561f50c69d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c69d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 -- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 msgr2=0x561f50c7a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c7a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 -- 172.21.15.26:0/1067704261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f5099efe0 con 0x561f50c11b80 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3d97f700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a3c97d700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c023040 tx=0x7f4a2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4912641588c0e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a177fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0164f0 con 0x561f50c11b80 2023-10-09T11:44:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a2c016650 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.154+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a28059190 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a2c016a20 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 10 client.9267 fetch_fsmap learned FSMap version 131 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=2+}) v3 -- 0x561f50b30780 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28059190 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 131) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4a2c032070 con 0x561f50c11b80 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 10 client.9267 fetch_fsmap finished waiting for FSMap version 131 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 10 client.9267 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 20 client.9267 populate_metadata read hostname 'smithi026' 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c0e9a0 0x561f50c0ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 4 client.9267 mds_command: new command op to 9141 tid=0[{"prefix": "status"}] 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 --> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f50b04e00 con 0x561f50c0e9a0 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c0e9a0 0x561f50c0ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a3d17e700 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c0e9a0 0x561f50c0ed70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5649fe754e9b0d93 server_cookie=2bf14213288d82dd in_seq=0 out_seq=0 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.155+0000 7f4a177fe700 10 client.9267 ms_handle_connect on v2:172.21.15.67:6835/2946278291 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a177fe700 1 -- 172.21.15.26:0/1067704261 <== mds.0 v2:172.21.15.67:6835/2946278291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561f50b04e00 con 0x561f50c0e9a0 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a177fe700 10 client.9267 handle_command_reply: tid=0 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 client.9267 shutdown 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 msgr2=0x561f50cb7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c023040 tx=0x7f4a2c02c000 comp rx=0 tx=0).stop 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 shutdown_connections 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x561f50c5c480 0x561f50c69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:6835/2946278291,v1:172.21.15.67:6837/2946278291] conn(0x561f50c0e9a0 0x561f50c0ed70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f50c0f5f0 0x561f50c7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 --2- 172.21.15.26:0/1067704261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561f50c11b80 0x561f50cb7eb0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a177fe700 0 client.9267 ms_handle_reset on v2:172.21.15.67:6835/2946278291 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 >> 172.21.15.26:0/1067704261 conn(0x561f50c130c0 msgr2=0x561f50c3cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 shutdown_connections 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 1 -- 172.21.15.26:0/1067704261 wait complete. 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a486dab80 20 client.9267 trim_cache size 0 max 16384 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:44:53.165 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d2192364-4346-4c74-aa8c-103a3c519dbd", 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 9141, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9145630889999996, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 131, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 198, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 198, 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 11.64035402 2023-10-09T11:44:53.166 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:44:53.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 msgr2=0x7f4a24069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 0x7f4a24069800 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4a30007cd0 tx=0x7f4a30015000 comp rx=0 tx=0).stop 2023-10-09T11:44:53.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 msgr2=0x7f4a380b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.156+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f4a38071370 tx=0x7f4a2800b040 comp rx=0 tx=0).stop 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 shutdown_connections 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a380c8dd0 0x7f4a380b1210 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4a24067350 0x7f4a24069800 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a20003a60 0x7f4a380cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 --2- 172.21.15.26:0/730518630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a380cc9b0 0x7f4a3814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 >> 172.21.15.26:0/730518630 conn(0x7f4a380703a0 msgr2=0x7f4a3815c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 shutdown_connections 2023-10-09T11:44:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.157+0000 7f4a3e180700 1 -- 172.21.15.26:0/730518630 wait complete. 2023-10-09T11:44:53.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:44:53.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.288+0000 7fa09bc8e700 1 Processor -- start 2023-10-09T11:44:53.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.288+0000 7fa09bc8e700 1 -- start start 2023-10-09T11:44:53.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0940cb5a0 0x7fa0940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 0x7fa094159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 0x7fa094156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940d13f0 con 0x7fa0940cb5a0 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09415ae40 con 0x7fa0940cd9e0 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa09bc8e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09415ab60 con 0x7fa09415a400 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa099a2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0940cb5a0 0x7fa0940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa099a2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0940cb5a0 0x7fa0940cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58624/0 (socket says 172.21.15.26:58624) 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.289+0000 7fa099a2a700 1 -- 172.21.15.26:0/2554169833 learned_addr learned my addr 172.21.15.26:0/2554169833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099229700 1 --2- 172.21.15.26:0/2554169833 >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 0x7fa094159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 -- 172.21.15.26:0/2554169833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 msgr2=0x7fa094156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09a22b700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 0x7fa094156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 0x7fa094156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 -- 172.21.15.26:0/2554169833 >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 msgr2=0x7fa094159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 --2- 172.21.15.26:0/2554169833 >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 0x7fa094159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 -- 172.21.15.26:0/2554169833 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940ccf00 con 0x7fa0940cb5a0 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099229700 1 --2- 172.21.15.26:0/2554169833 >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 0x7fa094159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09a22b700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 0x7fa094156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa099a2a700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0940cb5a0 0x7fa0940cb970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa084009f20 tx=0x7fa084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9657324993f28b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa098a28700 1 -- 172.21.15.26:0/2554169833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400e070 con 0x7fa0940cb5a0 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa098a28700 1 -- 172.21.15.26:0/2554169833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400ba40 con 0x7fa0940cb5a0 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa098a28700 1 -- 172.21.15.26:0/2554169833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840092e0 con 0x7fa0940cb5a0 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 -- 172.21.15.26:0/2554169833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0940cb5a0 msgr2=0x7fa0940cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0940cb5a0 0x7fa0940cb970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa084009f20 tx=0x7fa084009840 comp rx=0 tx=0).stop 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 -- 172.21.15.26:0/2554169833 shutdown_connections 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa09415a400 0x7fa094156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/2554169833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0940cb5a0 0x7fa0940cb970 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/2554169833 >> v2:172.21.15.67:3300/0 conn(0x7fa0940cd9e0 0x7fa094159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.290+0000 7fa09bc8e700 1 -- 172.21.15.26:0/2554169833 >> 172.21.15.26:0/2554169833 conn(0x7fa094070e30 msgr2=0x7fa0940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.291+0000 7fa09bc8e700 1 -- 172.21.15.26:0/2554169833 shutdown_connections 2023-10-09T11:44:53.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.291+0000 7fa09bc8e700 1 -- 172.21.15.26:0/2554169833 wait complete. 2023-10-09T11:44:53.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 Processor -- start 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 -- start start 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0940cb5a0 0x7fa0940c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0940cd9e0 0x7fa094150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0941582e0 con 0x7fa09415a400 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940c8890 con 0x7fa0940cd9e0 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.292+0000 7fa09bc8e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940c7c80 con 0x7fa0940cb5a0 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58632/0 (socket says 172.21.15.26:58632) 2023-10-09T11:44:53.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 -- 172.21.15.26:0/755752453 learned_addr learned my addr 172.21.15.26:0/755752453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa099a2a700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0940cb5a0 0x7fa0940c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa099229700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0940cd9e0 0x7fa094150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 -- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0940cb5a0 msgr2=0x7fa0940c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0940cb5a0 0x7fa0940c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 -- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0940cd9e0 msgr2=0x7fa094150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0940cd9e0 0x7fa094150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 -- 172.21.15.26:0/755752453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084009ae0 con 0x7fa09415a400 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09a22b700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c850 tx=0x7fa08c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011600 con 0x7fa09415a400 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c011760 con 0x7fa09415a400 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0940c7f60 con 0x7fa09415a400 2023-10-09T11:44:53.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011b20 con 0x7fa09415a400 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.293+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0940c8520 con 0x7fa09415a400 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.294+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0940c9260 con 0x7fa09415a400 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.295+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa08c018350 con 0x7fa09415a400 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.295+0000 7fa091ffb700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 0x7fa0800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.295+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa08c084e00 con 0x7fa09415a400 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.295+0000 7fa099a2a700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 0x7fa0800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.296+0000 7fa099a2a700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 0x7fa0800697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa084009880 tx=0x7fa084018000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:53.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.300+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa08c089070 con 0x7fa09415a400 2023-10-09T11:44:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.537+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa0940c8a00 con 0x7fa09415a400 2023-10-09T11:44:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.538+0000 7fa091ffb700 1 -- 172.21.15.26:0/755752453 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v131) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa08c01e070 con 0x7fa09415a400 2023-10-09T11:44:53.539 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 msgr2=0x7fa0800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 0x7fa0800697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa084009880 tx=0x7fa084018000 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 msgr2=0x7fa094158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c850 tx=0x7fa08c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 shutdown_connections 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09415a400 0x7fa094158e90 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa080067320 0x7fa0800697d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0940cb5a0 0x7fa0940c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 --2- 172.21.15.26:0/755752453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0940cd9e0 0x7fa094150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 >> 172.21.15.26:0/755752453 conn(0x7fa094070e30 msgr2=0x7fa0940b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:53.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 shutdown_connections 2023-10-09T11:44:53.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:53.540+0000 7fa09bc8e700 1 -- 172.21.15.26:0/755752453 wait complete. 2023-10-09T11:44:53.553 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:44:53.553 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:44:53.553 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-10-09T11:44:53.553 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:44:53.554 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:53.554 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:44:53.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:44:53.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:44:53.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:53.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.554 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-10-09T11:44:53.569 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:53.570 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41899sec preferred_lft 41899sec 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:44:53.571 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::74ba:24ff:fe23:8d25/64 scope link 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether c2:79:f7:4c:e1:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::c079:f7ff:fe4c:e1cd/64 scope link 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0a:19:15:30:d8:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::819:15ff:fe30:d89a/64 scope link 2023-10-09T11:44:53.572 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:53.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.573 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:44:53.633 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-09T11:44:53.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.635 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-10-09T11:44:53.691 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-10-09T11:44:53.691 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:44:53.691 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:44:53.691 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:44:53.691 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:44:53.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.692 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-10-09T11:44:53.692 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-10-09T11:44:53.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:44:53.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:44:53.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:44:53.693 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-10-09T11:44:53.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.794 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:44:53.809 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:44:53.809 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:44:53.810 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:53.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:53.810 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-10-09T11:44:53.875 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:53.875 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:53.931 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:44:53.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:53.931 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:53.986 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:44:53.986 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:44:53.986 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:54.067 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:54.067 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:54.086 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:54.087 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:54.109 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:54.109 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:54.109 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 0@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:44:54.110 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:44:54.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:44:54.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:54.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:44:54.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.338+0000 7f026d995700 1 Processor -- start 2023-10-09T11:44:54.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.338+0000 7f026d995700 1 -- start start 2023-10-09T11:44:54.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f026d995700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02680cb5a0 0x7f02680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f026d995700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 0x7f0268159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f026d995700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026815ae40 con 0x7f026815a400 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f026d995700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680d13f0 con 0x7f02680cb5a0 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f026d995700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026815ab60 con 0x7f02680cd9e0 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02680cb5a0 0x7f02680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f02677fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f026815a400 0x7f0268156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44612/0 (socket says 172.21.15.26:44612) 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f02677fe700 1 -- 172.21.15.26:0/3591688839 learned_addr learned my addr 172.21.15.26:0/3591688839 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f02667fc700 1 --2- 172.21.15.26:0/3591688839 >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 0x7f0268159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 -- 172.21.15.26:0/3591688839 >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 msgr2=0x7f0268159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 --2- 172.21.15.26:0/3591688839 >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 0x7f0268159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 -- 172.21.15.26:0/3591688839 >> v1:172.21.15.26:6789/0 conn(0x7f026815a400 legacy=0x7f0268156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 -- 172.21.15.26:0/3591688839 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680ccf00 con 0x7f02680cb5a0 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0265ffb700 1 -- 172.21.15.26:0/3591688839 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805250464 0 0) 0x7f026815ae40 con 0x7f026815a400 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f02667fc700 1 --2- 172.21.15.26:0/3591688839 >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 0x7f0268159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0266ffd700 1 --2- 172.21.15.26:0/3591688839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680cb970 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f02580098e0 tx=0x7f02580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2062985dd3ec7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.339+0000 7f0265ffb700 1 -- 172.21.15.26:0/3591688839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258009e80 con 0x7f02680cb5a0 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f0265ffb700 1 -- 172.21.15.26:0/3591688839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800b820 con 0x7f02680cb5a0 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f0265ffb700 1 -- 172.21.15.26:0/3591688839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800bba0 con 0x7f02680cb5a0 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 -- 172.21.15.26:0/3591688839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 msgr2=0x7f02680cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 --2- 172.21.15.26:0/3591688839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680cb970 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f02580098e0 tx=0x7f02580091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 -- 172.21.15.26:0/3591688839 shutdown_connections 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 --2- 172.21.15.26:0/3591688839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680cb970 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 --2- 172.21.15.26:0/3591688839 >> v2:172.21.15.67:3300/0 conn(0x7f02680cd9e0 0x7f0268159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 -- 172.21.15.26:0/3591688839 >> 172.21.15.26:0/3591688839 conn(0x7f0268070e30 msgr2=0x7f02680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:54.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 -- 172.21.15.26:0/3591688839 shutdown_connections 2023-10-09T11:44:54.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.340+0000 7f026d995700 1 -- 172.21.15.26:0/3591688839 wait complete. 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.341+0000 7f026d995700 1 Processor -- start 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.341+0000 7f026d995700 1 -- start start 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 0x7f02680af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 0x7f02680c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268169cc0 con 0x7f02680cb5a0 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268169f60 con 0x7f026815a400 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f026d995700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026816a240 con 0x7f02680cd9e0 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58656/0 (socket says 172.21.15.26:58656) 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 -- 172.21.15.26:0/3020742570 learned_addr learned my addr 172.21.15.26:0/3020742570 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f02677fe700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 0x7f02680c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f02667fc700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 0x7f02680af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 -- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 msgr2=0x7f02680af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 0x7f02680af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 -- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 msgr2=0x7f02680c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 0x7f02680c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f0266ffd700 1 -- 172.21.15.26:0/3020742570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009420 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f02677fe700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 0x7f02680c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.342+0000 7f02667fc700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 0x7f02680af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f0266ffd700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f026806ea60 tx=0x7f0258017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025801f070 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258000bc0 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026816a520 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258025420 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.343+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680ca6a0 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.344+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026804c3c0 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.344+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0258023070 con 0x7f02680cb5a0 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.345+0000 7f024effd700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 0x7f02540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.345+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0258086180 con 0x7f02680cb5a0 2023-10-09T11:44:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.345+0000 7f02667fc700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 0x7f02540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.345+0000 7f02667fc700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 0x7f02540697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f025c006f00 tx=0x7f025c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:54.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.349+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0258052e10 con 0x7f02680cb5a0 2023-10-09T11:44:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.588+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02680cd1e0 con 0x7f02680cb5a0 2023-10-09T11:44:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.588+0000 7f024effd700 1 -- 172.21.15.26:0/3020742570 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v131) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0258056430 con 0x7f02680cb5a0 2023-10-09T11:44:54.589 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:44:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 msgr2=0x7f02540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 0x7f02540697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f025c006f00 tx=0x7f025c008040 comp rx=0 tx=0).stop 2023-10-09T11:44:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 msgr2=0x7f02680c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f026806ea60 tx=0x7f0258017000 comp rx=0 tx=0).stop 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 shutdown_connections 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026815a400 0x7f02680c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02680cb5a0 0x7f02680c8980 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0254067320 0x7f02540697d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 --2- 172.21.15.26:0/3020742570 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02680cd9e0 0x7f02680af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 >> 172.21.15.26:0/3020742570 conn(0x7f0268070e30 msgr2=0x7f02680b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 shutdown_connections 2023-10-09T11:44:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:54.590+0000 7f026d995700 1 -- 172.21.15.26:0/3020742570 wait complete. 2023-10-09T11:44:54.603 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:44:54.603 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:44:54.604 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:54.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.604 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-09T11:44:54.623 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:44:54.623 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:44:54.623 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:44:54.623 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.623 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:44:54.624 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41912sec preferred_lft 41912sec 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::e066:81ff:fecc:518d/64 scope link 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:54.625 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5a:7c:97:78:d9:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::587c:97ff:fe78:d94d/64 scope link 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4a:8b:bd:f9:e1:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::488b:bdff:fef9:e110/64 scope link 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:44:54.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.626 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:44:54.691 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-09T11:44:54.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.693 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:44:54.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:44:54.752 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-09T11:44:54.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.858 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:44:54.874 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:44:54.874 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:44:54.874 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:54.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:54.874 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-09T11:44:54.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:54.939 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:54.994 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:44:54.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:44:54.994 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:55.048 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:44:55.048 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:44:55.048 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:55.129 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:55.129 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:55.149 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:55.149 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:55.149 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:55.170 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:44:55.200 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.67:3300,172.21.15.67:3301" 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d2192364-4346-4c74-aa8c-103a3c519dbd.cephfs=/ 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.26:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:44:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790" 2023-10-09T11:44:55.202 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:6789,172.21.15.67:6789,172.21.15.67:6790:/ 2023-10-09T11:44:55.202 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=d2192364-4346-4c74-aa8c-103a3c519dbd" will pass to kernel 2023-10-09T11:44:55.202 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:44:55.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:55.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:55.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T11:44:55.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.396+0000 7f069e165700 1 Processor -- start 2023-10-09T11:44:55.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.396+0000 7f069e165700 1 -- start start 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f069e165700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 0x7f06980a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f069e165700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980cced0 con 0x7f0698088400 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f069e165700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980cd140 con 0x7f069806e2a0 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f069e165700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980cd420 con 0x7f06980cee40 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0696ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0698088400 0x7f06980ae4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44628/0 (socket says 172.21.15.26:44628) 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0696ffd700 1 -- 172.21.15.26:0/2630730248 learned_addr learned my addr 172.21.15.26:0/2630730248 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0697fff700 1 --2- 172.21.15.26:0/2630730248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 0x7f06980a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861051888 0 0) 0x7f06980cced0 con 0x7f0698088400 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684003570 con 0x7f0698088400 2023-10-09T11:44:55.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034200126 0 0) 0x7f06980cd140 con 0x7f069806e2a0 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06980cced0 con 0x7f069806e2a0 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0697fff700 1 -- 172.21.15.26:0/2630730248 >> v1:172.21.15.67:6789/0 conn(0x7f069806e2a0 legacy=0x7f06980a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0697fff700 1 -- 172.21.15.26:0/2630730248 >> v1:172.21.15.26:6789/0 conn(0x7f0698088400 legacy=0x7f06980ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.397+0000 7f0697fff700 1 -- 172.21.15.26:0/2630730248 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980cd700 con 0x7f06980cee40 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f0697fff700 1 --2- 172.21.15.26:0/2630730248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 0x7f06980a9020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0690009e90 tx=0x7f0690009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b7a4d2ce6ffdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000e070 con 0x7f06980cee40 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000bc10 con 0x7f06980cee40 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f06967fc700 1 -- 172.21.15.26:0/2630730248 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690012430 con 0x7f06980cee40 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 -- 172.21.15.26:0/2630730248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 msgr2=0x7f06980a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 --2- 172.21.15.26:0/2630730248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 0x7f06980a9020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0690009e90 tx=0x7f0690009780 comp rx=0 tx=0).stop 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 -- 172.21.15.26:0/2630730248 shutdown_connections 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 --2- 172.21.15.26:0/2630730248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f06980cee40 0x7f06980a9020 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:55.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 -- 172.21.15.26:0/2630730248 >> 172.21.15.26:0/2630730248 conn(0x7f0698088000 msgr2=0x7f06980ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:55.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 -- 172.21.15.26:0/2630730248 shutdown_connections 2023-10-09T11:44:55.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.398+0000 7f069e165700 1 -- 172.21.15.26:0/2630730248 wait complete. 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 Processor -- start 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 -- start start 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 0x7f069816d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06980cee40 0x7f06980b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:55.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069815a520 con 0x7f069806e2a0 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069815c950 con 0x7f06980cee40 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f069e165700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069815cc20 con 0x7f0698088400 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f06977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f06977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58664/0 (socket says 172.21.15.26:58664) 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.400+0000 7f06977fe700 1 -- 172.21.15.26:0/592530334 learned_addr learned my addr 172.21.15.26:0/592530334 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f0697fff700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06980cee40 0x7f06980b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f0696ffd700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 0x7f069816d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 -- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 msgr2=0x7f069816d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 0x7f069816d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 -- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06980cee40 msgr2=0x7f06980b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06980cee40 0x7f06980b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:55.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 -- 172.21.15.26:0/592530334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009a20 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f0696ffd700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 0x7f069816d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f06977fe700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f068800c7c0 tx=0x7f0688007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880115b0 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688011710 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069815cf00 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688011ad0 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.401+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069816dd90 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.402+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069815d140 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.402+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0688012440 con 0x7f069806e2a0 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.403+0000 7f068f7fe700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 0x7f06780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:55.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.403+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0688084b70 con 0x7f069806e2a0 2023-10-09T11:44:55.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.403+0000 7f0696ffd700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 0x7f06780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:55.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.403+0000 7f0696ffd700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 0x7f06780697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0680007fd0 tx=0x7f0680009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:55.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.407+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f069815d140 con 0x7f069806e2a0 2023-10-09T11:44:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:55.645+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f069815d140 con 0x7f069806e2a0 2023-10-09T11:44:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.291+0000 7f068f7fe700 1 -- 172.21.15.26:0/592530334 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v132) v1 ==== 136+0+0 (secure 0 0 0) 0x7f069815d140 con 0x7f069806e2a0 2023-10-09T11:44:56.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 msgr2=0x7f06780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 0x7f06780697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0680007fd0 tx=0x7f0680009040 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 msgr2=0x7f069816d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f068800c7c0 tx=0x7f0688007e00 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 shutdown_connections 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06980cee40 0x7f06980b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f069806e2a0 0x7f069816d310 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0678067320 0x7f06780697d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 --2- 172.21.15.26:0/592530334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0698088400 0x7f069816d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 >> 172.21.15.26:0/592530334 conn(0x7f0698088000 msgr2=0x7f06980689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:56.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 shutdown_connections 2023-10-09T11:44:56.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.294+0000 7f069e165700 1 -- 172.21.15.26:0/592530334 wait complete. 2023-10-09T11:44:56.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:44:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.436+0000 7f398b99b700 1 Processor -- start 2023-10-09T11:44:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.436+0000 7f398b99b700 1 -- start start 2023-10-09T11:44:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f398b99b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39840cb970 0x7f3984159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f398b99b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398415ae40 con 0x7f39840cb5a0 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f398b99b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398415ab60 con 0x7f398415a400 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f398b99b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840ce0f0 con 0x7f39840cb970 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3988f36700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39840cb970 0x7f3984159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3989737700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f39840cb5a0 0x7f39840cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44644/0 (socket says 172.21.15.26:44644) 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3989737700 1 -- 172.21.15.26:0/4072107929 learned_addr learned my addr 172.21.15.26:0/4072107929 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3988f36700 1 -- 172.21.15.26:0/4072107929 >> v1:172.21.15.67:6789/0 conn(0x7f398415a400 legacy=0x7f3984156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3988f36700 1 -- 172.21.15.26:0/4072107929 >> v1:172.21.15.26:6789/0 conn(0x7f39840cb5a0 legacy=0x7f39840cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3983fff700 1 -- 172.21.15.26:0/4072107929 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950732197 0 0) 0x7f398415ae40 con 0x7f39840cb5a0 2023-10-09T11:44:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3988f36700 1 -- 172.21.15.26:0/4072107929 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840ccf00 con 0x7f39840cb970 2023-10-09T11:44:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3988f36700 1 --2- 172.21.15.26:0/4072107929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39840cb970 0x7f3984159ec0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f39780098e0 tx=0x7f39780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878f4b0002cf0498 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3983fff700 1 -- 172.21.15.26:0/4072107929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978009e80 con 0x7f39840cb970 2023-10-09T11:44:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3983fff700 1 -- 172.21.15.26:0/4072107929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b820 con 0x7f39840cb970 2023-10-09T11:44:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.437+0000 7f3983fff700 1 -- 172.21.15.26:0/4072107929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800bba0 con 0x7f39840cb970 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 -- 172.21.15.26:0/4072107929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39840cb970 msgr2=0x7f3984159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 --2- 172.21.15.26:0/4072107929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39840cb970 0x7f3984159ec0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f39780098e0 tx=0x7f39780091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 -- 172.21.15.26:0/4072107929 shutdown_connections 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 --2- 172.21.15.26:0/4072107929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39840cb970 0x7f3984159ec0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 -- 172.21.15.26:0/4072107929 >> 172.21.15.26:0/4072107929 conn(0x7f3984070e30 msgr2=0x7f39840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 -- 172.21.15.26:0/4072107929 shutdown_connections 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.438+0000 7f398b99b700 1 -- 172.21.15.26:0/4072107929 wait complete. 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.439+0000 7f398b99b700 1 Processor -- start 2023-10-09T11:44:56.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.439+0000 7f398b99b700 1 -- start start 2023-10-09T11:44:56.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39840cb5a0 0x7f398415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39840cb970 0x7f398416a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398416a540 con 0x7f398415a400 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840ca160 con 0x7f39840cb5a0 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f398b99b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398415bad0 con 0x7f39840cb970 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58692/0 (socket says 172.21.15.26:58692) 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 -- 172.21.15.26:0/1369516093 learned_addr learned my addr 172.21.15.26:0/1369516093 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989737700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39840cb5a0 0x7f398415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3988f36700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39840cb970 0x7f398416a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 -- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39840cb970 msgr2=0x7f398416a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39840cb970 0x7f398416a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.440+0000 7f3989f38700 1 -- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39840cb5a0 msgr2=0x7f398415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f3989f38700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39840cb5a0 0x7f398415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f3989f38700 1 -- 172.21.15.26:0/1369516093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009420 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f3989f38700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c5b0 tx=0x7f397c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011590 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c011710 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398415bdb0 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011ad0 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.441+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840b4650 con 0x7f398415a400 2023-10-09T11:44:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.442+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398404c3c0 con 0x7f398415a400 2023-10-09T11:44:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.442+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f397c01c460 con 0x7f398415a400 2023-10-09T11:44:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.443+0000 7f39817fa700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 0x7f39700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.443+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f397c084920 con 0x7f398415a400 2023-10-09T11:44:56.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.443+0000 7f3989737700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 0x7f39700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.444+0000 7f3989737700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 0x7f39700697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f39840ca550 tx=0x7f3974009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.447+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f397c0515b0 con 0x7f398415a400 2023-10-09T11:44:56.537 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:56.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:56.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.671+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f39840d0fa0 con 0x7f3970067320 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.673+0000 7f39817fa700 1 -- 172.21.15.26:0/1369516093 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f39840d0fa0 con 0x7f3970067320 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephfs" 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-09T11:44:56.674 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-09T11:44:56.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.674+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 msgr2=0x7f39700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.674+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 0x7f39700697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f39840ca550 tx=0x7f3974009040 comp rx=0 tx=0).stop 2023-10-09T11:44:56.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.674+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 msgr2=0x7f39840c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.674+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c5b0 tx=0x7f397c007f60 comp rx=0 tx=0).stop 2023-10-09T11:44:56.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 shutdown_connections 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398415a400 0x7f39840c9c20 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39840cb5a0 0x7f398415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3970067320 0x7f39700697d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 --2- 172.21.15.26:0/1369516093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39840cb970 0x7f398416a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 >> 172.21.15.26:0/1369516093 conn(0x7f3984070e30 msgr2=0x7f39840ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 shutdown_connections 2023-10-09T11:44:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.675+0000 7f398b99b700 1 -- 172.21.15.26:0/1369516093 wait complete. 2023-10-09T11:44:56.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:44:56.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.809+0000 7fde6a575700 1 Processor -- start 2023-10-09T11:44:56.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.809+0000 7fde6a575700 1 -- start start 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde6a575700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fde64153a00 0x7fde64153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde6a575700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415ac50 con 0x7fde640cea00 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde6a575700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415d010 con 0x7fde6415de50 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde6a575700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6415af60 con 0x7fde64153a00 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde69d74700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fde640cea00 0x7fde640cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44650/0 (socket says 172.21.15.26:44650) 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde69d74700 1 -- 172.21.15.26:0/1791671933 learned_addr learned my addr 172.21.15.26:0/1791671933 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde69573700 1 --2- 172.21.15.26:0/1791671933 >> v2:172.21.15.67:3300/0 conn(0x7fde64153a00 0x7fde64153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690334986 0 0) 0x7fde6415ac50 con 0x7fde640cea00 2023-10-09T11:44:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.810+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde50003570 con 0x7fde640cea00 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255530965 0 0) 0x7fde50003570 con 0x7fde640cea00 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 >> v2:172.21.15.67:3300/0 conn(0x7fde64153a00 msgr2=0x7fde64153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 --2- 172.21.15.26:0/1791671933 >> v2:172.21.15.67:3300/0 conn(0x7fde64153a00 0x7fde64153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 >> v1:172.21.15.67:6789/0 conn(0x7fde6415de50 legacy=0x7fde6415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6415b240 con 0x7fde640cea00 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fde5c0017f0 con 0x7fde640cea00 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 >> v1:172.21.15.26:6789/0 conn(0x7fde640cea00 legacy=0x7fde640cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 0x7fde50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415af60 con 0x7fde50003a60 2023-10-09T11:44:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000c160 con 0x7fde500051c0 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000c320 con 0x7fde50004810 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 0x7fde50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69d74700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde68d72700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 -- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde50004810 msgr2=0x7fde50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 -- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500051c0 msgr2=0x7fde5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69d74700 1 -- 172.21.15.26:0/1791671933 reap_dead start 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 -- 172.21.15.26:0/1791671933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50003570 con 0x7fde50003a60 2023-10-09T11:44:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde69573700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 0x7fde50003e70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fde60009c00 tx=0x7fde600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7bfe0178d5a49c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.811+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000e710 con 0x7fde50003a60 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000e870 con 0x7fde50003a60 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde5bfff700 1 -- 172.21.15.26:0/1791671933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000ec30 con 0x7fde50003a60 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 -- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 msgr2=0x7fde50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 0x7fde50003e70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fde60009c00 tx=0x7fde600091a0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 -- 172.21.15.26:0/1791671933 shutdown_connections 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 --2- 172.21.15.26:0/1791671933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde50003a60 0x7fde50003e70 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 -- 172.21.15.26:0/1791671933 >> 172.21.15.26:0/1791671933 conn(0x7fde640703a0 msgr2=0x7fde640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 -- 172.21.15.26:0/1791671933 shutdown_connections 2023-10-09T11:44:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.812+0000 7fde6a575700 1 -- 172.21.15.26:0/1791671933 wait complete. 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.813+0000 7fde6a575700 1 Processor -- start 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.813+0000 7fde6a575700 1 -- start start 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde50003a60 0x7fde6416cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde640cc370 0x7fde640cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640ccd20 con 0x7fde64152c40 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c7910 con 0x7fde50003a60 2023-10-09T11:44:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde6a575700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c75e0 con 0x7fde640cc370 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde68d72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde68d72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58698/0 (socket says 172.21.15.26:58698) 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde68d72700 1 -- 172.21.15.26:0/2147065628 learned_addr learned my addr 172.21.15.26:0/2147065628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde69d74700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde640cc370 0x7fde640cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.814+0000 7fde69573700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde50003a60 0x7fde6416cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 -- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde640cc370 msgr2=0x7fde640cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde640cc370 0x7fde640cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 -- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde50003a60 msgr2=0x7fde6416cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde50003a60 0x7fde6416cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 -- 172.21.15.26:0/2147065628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6416d530 con 0x7fde64152c40 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde68d72700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fde5400e630 tx=0x7fde54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540115c0 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54011720 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6416d7d0 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011ac0 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.815+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6416dd90 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.816+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c7a80 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.816+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fde54014480 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.817+0000 7fde597fa700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 0x7fde480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.817+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde54084980 con 0x7fde64152c40 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.817+0000 7fde69573700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 0x7fde480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.818+0000 7fde69573700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 0x7fde480697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fde600091e0 tx=0x7fde6001a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:56.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:56.821+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde5404d5a0 con 0x7fde64152c40 2023-10-09T11:44:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.014+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde6404c3c0 con 0x7fde64152c40 2023-10-09T11:44:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.015+0000 7fde597fa700 1 -- 172.21.15.26:0/2147065628 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde54055150 con 0x7fde64152c40 2023-10-09T11:44:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 msgr2=0x7fde480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 0x7fde480697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fde600091e0 tx=0x7fde6001a000 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 msgr2=0x7fde641523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fde5400e630 tx=0x7fde54009040 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 shutdown_connections 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fde48067320 0x7fde480697d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde640cc370 0x7fde640cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde50003a60 0x7fde6416cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 --2- 172.21.15.26:0/2147065628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde64152c40 0x7fde641523b0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 >> 172.21.15.26:0/2147065628 conn(0x7fde640703a0 msgr2=0x7fde640d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 shutdown_connections 2023-10-09T11:44:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.017+0000 7fde6a575700 1 -- 172.21.15.26:0/2147065628 wait complete. 2023-10-09T11:44:57.030 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:44:57.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:44:57.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:44:57.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:44:57.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:57.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:44:57.123 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:44:57.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:44:57.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:44:57.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:44:57.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:57.169 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:44:57.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:44:57.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:57.187 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:44:57.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:44:57.202 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T11:44:57.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:44:57.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:44:57.202 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:44:57.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:44:57.243 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T11:44:57.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs 2023-10-09T11:44:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.365+0000 7fb086e0c700 1 Processor -- start 2023-10-09T11:44:57.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.365+0000 7fb086e0c700 1 -- start start 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb086e0c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb08013c9b0 0x7fb080069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb086e0c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08006f7d0 con 0x7fb0800cc6f0 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb086e0c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08006d7b0 con 0x7fb0800cc320 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb086e0c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08006e330 con 0x7fb08013c9b0 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb0853a9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb0800cc6f0 0x7fb080069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44652/0 (socket says 172.21.15.26:44652) 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb0853a9700 1 -- 172.21.15.26:0/3805418209 learned_addr learned my addr 172.21.15.26:0/3805418209 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07ffff700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb08013c9b0 0x7fb080069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599552546 0 0) 0x7fb08006f7d0 con 0x7fb0800cc6f0 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb068003570 con 0x7fb0800cc6f0 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808856283 0 0) 0x7fb08006d7b0 con 0x7fb0800cc320 2023-10-09T11:44:57.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb08006f7d0 con 0x7fb0800cc320 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411449310 0 0) 0x7fb068003570 con 0x7fb0800cc6f0 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb08013c9b0 msgr2=0x7fb080069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.366+0000 7fb07f7fe700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb08013c9b0 0x7fb080069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 >> v1:172.21.15.67:6789/0 conn(0x7fb0800cc320 legacy=0x7fb08013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08006da00 con 0x7fb0800cc6f0 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fb0780017f0 con 0x7fb0800cc6f0 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 >> v1:172.21.15.26:6789/0 conn(0x7fb0800cc6f0 legacy=0x7fb080069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068003c20 0x7fb068004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb068004810 0x7fb068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0680051c0 0x7fb06800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08006e330 con 0x7fb068003c20 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06800c0b0 con 0x7fb0680051c0 2023-10-09T11:44:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06800c270 con 0x7fb068004810 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07ffff700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb08013c9b0 0x7fb080069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068003c20 0x7fb068004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb0853a9700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0680051c0 0x7fb06800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07ffff700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb068004810 0x7fb068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 -- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb068004810 msgr2=0x7fb068004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb068004810 0x7fb068004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 -- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0680051c0 msgr2=0x7fb06800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0680051c0 0x7fb06800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 -- 172.21.15.26:0/3805418209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068003570 con 0x7fb068003c20 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb084ba8700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068003c20 0x7fb068004010 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb070001a10 tx=0x7fb070007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abad46744b2676d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000c5d0 con 0x7fb068003c20 2023-10-09T11:44:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000c730 con 0x7fb068003c20 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.367+0000 7fb07f7fe700 1 -- 172.21.15.26:0/3805418209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000caf0 con 0x7fb068003c20 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 -- 172.21.15.26:0/3805418209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068003c20 msgr2=0x7fb068004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 --2- 172.21.15.26:0/3805418209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068003c20 0x7fb068004010 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb070001a10 tx=0x7fb070007d10 comp rx=0 tx=0).stop 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb0853a9700 1 -- 172.21.15.26:0/3805418209 reap_dead start 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 -- 172.21.15.26:0/3805418209 shutdown_connections 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 -- 172.21.15.26:0/3805418209 >> 172.21.15.26:0/3805418209 conn(0x7fb080067f00 msgr2=0x7fb080068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 -- 172.21.15.26:0/3805418209 shutdown_connections 2023-10-09T11:44:57.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.368+0000 7fb086e0c700 1 -- 172.21.15.26:0/3805418209 wait complete. 2023-10-09T11:44:57.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.369+0000 7fb086e0c700 1 Processor -- start 2023-10-09T11:44:57.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.369+0000 7fb086e0c700 1 -- start start 2023-10-09T11:44:57.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb068003c20 0x7fb0800caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb080142430 0x7fb080157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0801428a0 0x7fb080158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c9ed0 con 0x7fb080142430 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800ca1b0 con 0x7fb068003c20 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb086e0c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800ca490 con 0x7fb0801428a0 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb080142430 0x7fb080157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb080142430 0x7fb080157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58728/0 (socket says 172.21.15.26:58728) 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 -- 172.21.15.26:0/29394639 learned_addr learned my addr 172.21.15.26:0/29394639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb084ba8700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb068003c20 0x7fb0800caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb0853a9700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0801428a0 0x7fb080158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 -- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0801428a0 msgr2=0x7fb080158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0801428a0 0x7fb080158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 -- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb068003c20 msgr2=0x7fb0800caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb068003c20 0x7fb0800caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.370+0000 7fb07ffff700 1 -- 172.21.15.26:0/29394639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800ca770 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb07ffff700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb080142430 0x7fb080157300 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fb074011940 tx=0x7fb074008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074015670 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740157d0 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb086e0c700 1 -- 172.21.15.26:0/29394639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800caa50 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074015b90 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.371+0000 7fb086e0c700 1 -- 172.21.15.26:0/29394639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080157840 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.372+0000 7fb086e0c700 1 -- 172.21.15.26:0/29394639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800cb4b0 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.372+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb074013410 con 0x7fb080142430 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.373+0000 7fb07cff9700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb06c067320 0x7fb06c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.373+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0740853b0 con 0x7fb080142430 2023-10-09T11:44:57.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.373+0000 7fb084ba8700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb06c067320 0x7fb06c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.373+0000 7fb084ba8700 1 --2- 172.21.15.26:0/29394639 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb06c067320 0x7fb06c0697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb070000c00 tx=0x7fb070015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.377+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb074052040 con 0x7fb080142430 2023-10-09T11:44:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.600+0000 7fb086e0c700 1 -- 172.21.15.26:0/29394639 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fb08004c3c0 con 0x7fb06c067320 2023-10-09T11:44:57.602 INFO:tasks.ceph.mgr.x.smithi067.stderr:2023-10-09T11:44:57.601+0000 7f48c13c6700 -1 mgr.server reply reply (1) Operation not permitted WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-09T11:44:57.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.602+0000 7fb07cff9700 1 -- 172.21.15.26:0/29394639 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: -1 WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it.) v1 ==== 204+0+0 (secure 0 0 0) 0x7fb08004c3c0 con 0x7fb06c067320 2023-10-09T11:44:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-09T11:44:57.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:44:57.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2023-10-09T11:44:57.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.728+0000 7f2ed4a74700 1 Processor -- start 2023-10-09T11:44:57.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.728+0000 7f2ed4a74700 1 -- start start 2023-10-09T11:44:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.729+0000 7f2ed4a74700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ed006dc70 0x7f2ed0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.729+0000 7f2ed4a74700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed006e0e0 0x7f2ed00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.729+0000 7f2ed4a74700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00ccfd0 con 0x7f2ed0159530 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.729+0000 7f2ed4a74700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed015a3d0 con 0x7f2ed006dc70 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.729+0000 7f2ed4a74700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed015a6b0 con 0x7f2ed006e0e0 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ed006dc70 0x7f2ed0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ed006dc70 0x7f2ed0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58730/0 (socket says 172.21.15.26:58730) 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 -- 172.21.15.26:0/1878166991 learned_addr learned my addr 172.21.15.26:0/1878166991 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2eced9d700 1 --2- 172.21.15.26:0/1878166991 >> v2:172.21.15.67:3300/0 conn(0x7f2ed006e0e0 0x7f2ed00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 -- 172.21.15.26:0/1878166991 >> v2:172.21.15.67:3300/0 conn(0x7f2ed006e0e0 msgr2=0x7f2ed00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/1878166991 >> v2:172.21.15.67:3300/0 conn(0x7f2ed006e0e0 0x7f2ed00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 -- 172.21.15.26:0/1878166991 >> v1:172.21.15.67:6789/0 conn(0x7f2ed0159530 legacy=0x7f2ed00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 -- 172.21.15.26:0/1878166991 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed015a990 con 0x7f2ed006dc70 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/1878166991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed0159900 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cf2b0 tx=0x7f2eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eb3e9bf90ca166 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecd59a700 1 -- 172.21.15.26:0/1878166991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8009e70 con 0x7f2ed006dc70 2023-10-09T11:44:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecd59a700 1 -- 172.21.15.26:0/1878166991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb800b860 con 0x7f2ed006dc70 2023-10-09T11:44:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.730+0000 7f2ecd59a700 1 -- 172.21.15.26:0/1878166991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800bc00 con 0x7f2ed006dc70 2023-10-09T11:44:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 -- 172.21.15.26:0/1878166991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 msgr2=0x7f2ed0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 --2- 172.21.15.26:0/1878166991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed0159900 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cf2b0 tx=0x7f2eb8009250 comp rx=0 tx=0).stop 2023-10-09T11:44:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 -- 172.21.15.26:0/1878166991 shutdown_connections 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 --2- 172.21.15.26:0/1878166991 >> v2:172.21.15.67:3300/0 conn(0x7f2ed006e0e0 0x7f2ed00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 --2- 172.21.15.26:0/1878166991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed0159900 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 -- 172.21.15.26:0/1878166991 >> 172.21.15.26:0/1878166991 conn(0x7f2ed00703a0 msgr2=0x7f2ed00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 -- 172.21.15.26:0/1878166991 shutdown_connections 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.731+0000 7f2ed4a74700 1 -- 172.21.15.26:0/1878166991 wait complete. 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.732+0000 7f2ed4a74700 1 Processor -- start 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.732+0000 7f2ed4a74700 1 -- start start 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed006e0e0 0x7f2ed00b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed0159530 0x7f2ed0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed014eb50 con 0x7f2ed006dc70 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b3480 con 0x7f2ed0159530 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b3720 con 0x7f2ed006e0e0 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed014e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58734/0 (socket says 172.21.15.26:58734) 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 -- 172.21.15.26:0/3944925617 learned_addr learned my addr 172.21.15.26:0/3944925617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2eced9d700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed0159530 0x7f2ed0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed006e0e0 0x7f2ed00b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 -- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed006e0e0 msgr2=0x7f2ed00b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed006e0e0 0x7f2ed00b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 -- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed0159530 msgr2=0x7f2ed0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed0159530 0x7f2ed0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 -- 172.21.15.26:0/3944925617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80094f0 con 0x7f2ed006dc70 2023-10-09T11:44:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2ed006e0e0 0x7f2ed00b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ece59c700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed006dc70 0x7f2ed014e610 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800c4e0 tx=0x7f2ec800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011590 con 0x7f2ed006dc70 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8011710 con 0x7f2ed006dc70 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 -- 172.21.15.26:0/3944925617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed00b3a00 con 0x7f2ed006dc70 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011ad0 con 0x7f2ed006dc70 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.733+0000 7f2ed4a74700 1 -- 172.21.15.26:0/3944925617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed00b3d90 con 0x7f2ed006dc70 2023-10-09T11:44:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.734+0000 7f2ed4a74700 1 -- 172.21.15.26:0/3944925617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed004c3c0 con 0x7f2ed006dc70 2023-10-09T11:44:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.735+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2ec801b3b0 con 0x7f2ed006dc70 2023-10-09T11:44:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.735+0000 7f2ec67fc700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb0067320 0x7f2eb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:44:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.735+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ec80840a0 con 0x7f2ed006dc70 2023-10-09T11:44:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.735+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb0067320 0x7f2eb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:44:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.736+0000 7f2ecdd9b700 1 --2- 172.21.15.26:0/3944925617 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2eb0067320 0x7f2eb00697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cf2b0 tx=0x7f2eb8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:44:57.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.740+0000 7f2ec67fc700 1 -- 172.21.15.26:0/3944925617 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec8050d30 con 0x7f2ed006dc70 2023-10-09T11:44:57.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:44:57.960+0000 7f2ed4a74700 1 -- 172.21.15.26:0/3944925617 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed015ac70 con 0x7f2eb0067320 2023-10-09T11:45:26.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:26.614 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:56.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:56.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:26.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:26.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:56.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:56.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:57.638 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-09T11:46:57.639 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:46:57.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:57.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:57.728 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:46:57.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.856+0000 7f91b0b82700 1 Processor -- start 2023-10-09T11:46:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.856+0000 7f91b0b82700 1 -- start start 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 0x7f91ac0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ac159c20 0x7f91ac0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac0b0930 0x7f91ac0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0ccdc0 con 0x7f91ac159c20 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0b12f0 con 0x7f91ac159850 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91b0b82700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0adb20 con 0x7f91ac0b0930 2023-10-09T11:46:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91a9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ac159c20 0x7f91ac0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91a9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ac159c20 0x7f91ac0ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49230/0 (socket says 172.21.15.26:49230) 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91a9d9b700 1 -- 172.21.15.26:0/817282555 learned_addr learned my addr 172.21.15.26:0/817282555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91aad9d700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac0b0930 0x7f91ac0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.857+0000 7f91aa59c700 1 --2- 172.21.15.26:0/817282555 >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 0x7f91ac0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 -- 172.21.15.26:0/817282555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac0b0930 msgr2=0x7f91ac0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac0b0930 0x7f91ac0b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 -- 172.21.15.26:0/817282555 >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 msgr2=0x7f91ac0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/817282555 >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 0x7f91ac0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 -- 172.21.15.26:0/817282555 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0acf10 con 0x7f91ac159c20 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91aa59c700 1 --2- 172.21.15.26:0/817282555 >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 0x7f91ac0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac159c20 0x7f91ac0ae4f0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f91ac069620 tx=0x7f9194009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6440f1a0366c6754 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a959a700 1 -- 172.21.15.26:0/817282555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400b820 con 0x7f91ac159c20 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a959a700 1 -- 172.21.15.26:0/817282555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919400b980 con 0x7f91ac159c20 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.858+0000 7f91a959a700 1 -- 172.21.15.26:0/817282555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400bd20 con 0x7f91ac159c20 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 -- 172.21.15.26:0/817282555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac159c20 msgr2=0x7f91ac0ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac159c20 0x7f91ac0ae4f0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f91ac069620 tx=0x7f9194009250 comp rx=0 tx=0).stop 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 -- 172.21.15.26:0/817282555 shutdown_connections 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 --2- 172.21.15.26:0/817282555 >> v2:172.21.15.67:3300/0 conn(0x7f91ac159850 0x7f91ac0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac0b0930 0x7f91ac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 --2- 172.21.15.26:0/817282555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac159c20 0x7f91ac0ae4f0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 -- 172.21.15.26:0/817282555 >> 172.21.15.26:0/817282555 conn(0x7f91ac06d170 msgr2=0x7f91ac0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 -- 172.21.15.26:0/817282555 shutdown_connections 2023-10-09T11:46:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.859+0000 7f91b0b82700 1 -- 172.21.15.26:0/817282555 wait complete. 2023-10-09T11:46:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.860+0000 7f91b0b82700 1 Processor -- start 2023-10-09T11:46:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.860+0000 7f91b0b82700 1 -- start start 2023-10-09T11:46:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac159850 0x7f91ac15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91ac159c20 0x7f91ac15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac167690 con 0x7f91ac0b0930 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac154450 con 0x7f91ac159c20 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac158580 con 0x7f91ac159850 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49246/0 (socket says 172.21.15.26:49246) 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 -- 172.21.15.26:0/1587208915 learned_addr learned my addr 172.21.15.26:0/1587208915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac159850 0x7f91ac15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aad9d700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91ac159c20 0x7f91ac15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 -- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac159850 msgr2=0x7f91ac15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac159850 0x7f91ac15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 -- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91ac159c20 msgr2=0x7f91ac15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91ac159c20 0x7f91ac15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 -- 172.21.15.26:0/1587208915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940094f0 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91aa59c700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f919c00d1d0 tx=0x7f919c009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00dd10 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00f040 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac158860 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c015670 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.861+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac158e20 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.862+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac167920 con 0x7f91ac0b0930 2023-10-09T11:46:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.863+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f919c015a60 con 0x7f91ac0b0930 2023-10-09T11:46:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.863+0000 7f91a27fc700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 0x7f918c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.863+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f919c085160 con 0x7f91ac0b0930 2023-10-09T11:46:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.863+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 0x7f918c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.864+0000 7f91a9d9b700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 0x7f918c0697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f91ac069620 tx=0x7f9194017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:57.868+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f919c04e5a0 con 0x7f91ac0b0930 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.104+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91ac04c3c0 con 0x7f91ac0b0930 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.105+0000 7f91a27fc700 1 -- 172.21.15.26:0/1587208915 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4598 (secure 0 0 0) 0x7f919c051d00 con 0x7f91ac0b0930 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:46:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 msgr2=0x7f918c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 0x7f918c0697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f91ac069620 tx=0x7f9194017000 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 msgr2=0x7f91ac153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f919c00d1d0 tx=0x7f919c009a90 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 shutdown_connections 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91ac159c20 0x7f91ac15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac0b0930 0x7f91ac153f10 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f918c067320 0x7f918c0697d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 --2- 172.21.15.26:0/1587208915 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91ac159850 0x7f91ac15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 >> 172.21.15.26:0/1587208915 conn(0x7f91ac06d170 msgr2=0x7f91ac06a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 shutdown_connections 2023-10-09T11:46:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.107+0000 7f91b0b82700 1 -- 172.21.15.26:0/1587208915 wait complete. 2023-10-09T11:46:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 132 2023-10-09T11:46:58.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:58.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.238+0000 7f42441d5700 1 Processor -- start 2023-10-09T11:46:58.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.238+0000 7f42441d5700 1 -- start start 2023-10-09T11:46:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f42441d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 0x7f423c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f42441d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c15ae40 con 0x7f423c15a400 2023-10-09T11:46:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f42441d5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c15ab60 con 0x7f423c0cb5a0 2023-10-09T11:46:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f42441d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0ce0f0 con 0x7f423c0cb970 2023-10-09T11:46:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f4242772700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f423c15a400 0x7f423c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41314/0 (socket says 172.21.15.26:41314) 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f4242772700 1 -- 172.21.15.26:0/3420371346 learned_addr learned my addr 172.21.15.26:0/3420371346 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.239+0000 7f4241770700 1 --2- 172.21.15.26:0/3420371346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 0x7f423c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929101141 0 0) 0x7f423c15ae40 con 0x7f423c15a400 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4224003570 con 0x7f423c15a400 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977617706 0 0) 0x7f423c15ab60 con 0x7f423c0cb5a0 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423c15ae40 con 0x7f423c0cb5a0 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4241770700 1 -- 172.21.15.26:0/3420371346 >> v1:172.21.15.67:6789/0 conn(0x7f423c0cb5a0 legacy=0x7f423c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4241770700 1 -- 172.21.15.26:0/3420371346 >> v1:172.21.15.26:6789/0 conn(0x7f423c15a400 legacy=0x7f423c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4241770700 1 -- 172.21.15.26:0/3420371346 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0ccf00 con 0x7f423c0cb970 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4241770700 1 --2- 172.21.15.26:0/3420371346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 0x7f423c159ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4230009910 tx=0x7f42300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab2e4d182d025c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011630 con 0x7f423c0cb970 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230011790 con 0x7f423c0cb970 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.240+0000 7f4240f6f700 1 -- 172.21.15.26:0/3420371346 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011b10 con 0x7f423c0cb970 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 -- 172.21.15.26:0/3420371346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 msgr2=0x7f423c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 --2- 172.21.15.26:0/3420371346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 0x7f423c159ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4230009910 tx=0x7f42300091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 -- 172.21.15.26:0/3420371346 shutdown_connections 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 --2- 172.21.15.26:0/3420371346 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb970 0x7f423c159ec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 -- 172.21.15.26:0/3420371346 >> 172.21.15.26:0/3420371346 conn(0x7f423c070e30 msgr2=0x7f423c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 -- 172.21.15.26:0/3420371346 shutdown_connections 2023-10-09T11:46:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.241+0000 7f42441d5700 1 -- 172.21.15.26:0/3420371346 wait complete. 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.242+0000 7f42441d5700 1 Processor -- start 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.242+0000 7f42441d5700 1 -- start start 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb5a0 0x7f423c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f423c15a400 0x7f423c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0cbde0 con 0x7f423c0cb970 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c152c20 con 0x7f423c15a400 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f42441d5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0b6490 con 0x7f423c0cb5a0 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49258/0 (socket says 172.21.15.26:49258) 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 -- 172.21.15.26:0/1833361784 learned_addr learned my addr 172.21.15.26:0/1833361784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241f71700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb5a0 0x7f423c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4242772700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f423c15a400 0x7f423c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 -- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb5a0 msgr2=0x7f423c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb5a0 0x7f423c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 -- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f423c15a400 msgr2=0x7f423c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f423c15a400 0x7f423c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 -- 172.21.15.26:0/1833361784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230009420 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4241770700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f423c06ea60 tx=0x7f4230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.243+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011900 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.244+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230011a60 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.244+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0c8c10 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.244+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230025640 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.244+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0c85c0 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.245+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0c8da0 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.245+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4230025a30 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.246+0000 7f4239ffb700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 0x7f4228069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.246+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f42300863f0 con 0x7f423c0cb970 2023-10-09T11:46:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.246+0000 7f4241f71700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 0x7f4228069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.246+0000 7f4241f71700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 0x7f4228069800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f422c004140 tx=0x7f422c007f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.250+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4230052ff0 con 0x7f423c0cb970 2023-10-09T11:46:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.446+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f423c04c3c0 con 0x7f423c0cb970 2023-10-09T11:46:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.447+0000 7f4239ffb700 1 -- 172.21.15.26:0/1833361784 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+15462 (secure 0 0 0) 0x7f4230056610 con 0x7f423c0cb970 2023-10-09T11:46:58.448 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:46:58.448 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":200,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:45:06.319246+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.11","mappings":[{"from":0,"to":2}]},{"pgid":"34.1f","mappings":[{"from":0,"to":1}]},{"pgid":"34.20","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:58.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 msgr2=0x7f4228069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 0x7f4228069800 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f422c004140 tx=0x7f422c007f90 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 msgr2=0x7f423c0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f423c06ea60 tx=0x7f4230017000 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 shutdown_connections 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f423c15a400 0x7f423c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4228067350 0x7f4228069800 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f423c0cb5a0 0x7f423c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 --2- 172.21.15.26:0/1833361784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f423c0cb970 0x7f423c0b37a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 >> 172.21.15.26:0/1833361784 conn(0x7f423c070e30 msgr2=0x7f423c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 shutdown_connections 2023-10-09T11:46:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.449+0000 7f42441d5700 1 -- 172.21.15.26:0/1833361784 wait complete. 2023-10-09T11:46:58.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:11.162437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 33, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:44:44.375626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '197', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 34, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:44:45.630210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '198', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:46:58.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:46:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.583+0000 7f1e057c4700 1 Processor -- start 2023-10-09T11:46:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.584+0000 7f1e057c4700 1 -- start start 2023-10-09T11:46:58.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.584+0000 7f1e057c4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e0013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.584+0000 7f1e057c4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0006d7b0 con 0x7f1e0006a110 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.584+0000 7f1e057c4700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0006e330 con 0x7f1e000cc6f0 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.584+0000 7f1e057c4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0006a590 con 0x7f1e000cc320 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dff7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1e0006a110 0x7f1e0006e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41316/0 (socket says 172.21.15.26:41316) 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dff7fe700 1 -- 172.21.15.26:0/1868951605 learned_addr learned my addr 172.21.15.26:0/1868951605 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfeffd700 1 --2- 172.21.15.26:0/1868951605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e0013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866771356 0 0) 0x7f1e0006d7b0 con 0x7f1e0006a110 2023-10-09T11:46:58.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003570 con 0x7f1e0006a110 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272818442 0 0) 0x7f1e0006e330 con 0x7f1e000cc6f0 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0006d7b0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfeffd700 1 -- 172.21.15.26:0/1868951605 >> v1:172.21.15.67:6789/0 conn(0x7f1e000cc6f0 legacy=0x7f1e00069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfeffd700 1 -- 172.21.15.26:0/1868951605 >> v1:172.21.15.26:6789/0 conn(0x7f1e0006a110 legacy=0x7f1e0006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfeffd700 1 -- 172.21.15.26:0/1868951605 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0006da00 con 0x7f1e000cc320 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfeffd700 1 --2- 172.21.15.26:0/1868951605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e0013c2a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009910 tx=0x7f1df80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1af9510d60bdf6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011630 con 0x7f1e000cc320 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8011790 con 0x7f1e000cc320 2023-10-09T11:46:58.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.585+0000 7f1dfdffb700 1 -- 172.21.15.26:0/1868951605 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011b30 con 0x7f1e000cc320 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 -- 172.21.15.26:0/1868951605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 msgr2=0x7f1e0013c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 --2- 172.21.15.26:0/1868951605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e0013c2a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009910 tx=0x7f1df80091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 -- 172.21.15.26:0/1868951605 shutdown_connections 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 --2- 172.21.15.26:0/1868951605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e0013c2a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 -- 172.21.15.26:0/1868951605 >> 172.21.15.26:0/1868951605 conn(0x7f1e00067f00 msgr2=0x7f1e00068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 -- 172.21.15.26:0/1868951605 shutdown_connections 2023-10-09T11:46:58.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.586+0000 7f1e057c4700 1 -- 172.21.15.26:0/1868951605 wait complete. 2023-10-09T11:46:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.587+0000 7f1e057c4700 1 Processor -- start 2023-10-09T11:46:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.587+0000 7f1e057c4700 1 -- start start 2023-10-09T11:46:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e0006a110 0x7f1e00137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e000ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000afaa0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000afd80 con 0x7f1e0006a110 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1e057c4700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000b0060 con 0x7f1e000cc320 2023-10-09T11:46:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49262/0 (socket says 172.21.15.26:49262) 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 -- 172.21.15.26:0/277707304 learned_addr learned my addr 172.21.15.26:0/277707304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dfe7fc700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e000ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 -- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 msgr2=0x7f1e000ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e000ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 -- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e0006a110 msgr2=0x7f1e00137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e0006a110 0x7f1e00137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dff7fe700 1 -- 172.21.15.26:0/277707304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009420 con 0x7f1e000cc6f0 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.588+0000 7f1dfe7fc700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e000ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1dff7fe700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1df000cc80 tx=0x7f1df0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000ce90 con 0x7f1e000cc6f0 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000ab70 con 0x7f1e000cc6f0 2023-10-09T11:46:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00070f0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e000b0340 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.589+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e00138450 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.590+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0004c3c0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.590+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1df00074a0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.590+0000 7f1df6ffd700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 0x7f1de0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.591+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1df0084f80 con 0x7f1e000cc6f0 2023-10-09T11:46:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.591+0000 7f1dfeffd700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 0x7f1de0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.591+0000 7f1dfeffd700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 0x7f1de0069800 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1df80091e0 tx=0x7f1df8017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.595+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1df0051bc0 con 0x7f1e000cc6f0 2023-10-09T11:46:58.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.785+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e00138450 con 0x7f1e000cc6f0 2023-10-09T11:46:58.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.786+0000 7f1df6ffd700 1 -- 172.21.15.26:0/277707304 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v200) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e00138450 con 0x7f1e000cc6f0 2023-10-09T11:46:58.787 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-09T11:46:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 msgr2=0x7f1de0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 0x7f1de0069800 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1df80091e0 tx=0x7f1df8017000 comp rx=0 tx=0).stop 2023-10-09T11:46:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 msgr2=0x7f1e000ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1df000cc80 tx=0x7f1df0001ae0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 shutdown_connections 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000cc6f0 0x7f1e000ac5d0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e0006a110 0x7f1e00137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1de0067350 0x7f1de0069800 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 --2- 172.21.15.26:0/277707304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e000cc320 0x7f1e000ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 >> 172.21.15.26:0/277707304 conn(0x7f1e00067f00 msgr2=0x7f1e000b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 shutdown_connections 2023-10-09T11:46:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.788+0000 7f1e057c4700 1 -- 172.21.15.26:0/277707304 wait complete. 2023-10-09T11:46:58.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:46:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.922+0000 7fc36171c700 1 Processor -- start 2023-10-09T11:46:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.922+0000 7fc36171c700 1 -- start start 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc36171c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 0x7fc35c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc36171c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc36171c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c15e010 con 0x7fc35c1598a0 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc36171c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c15d420 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc36171c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c15d6e0 con 0x7fc35c1594d0 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc35a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc35a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49264/0 (socket says 172.21.15.26:49264) 2023-10-09T11:46:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc35a7fc700 1 -- 172.21.15.26:0/1131671875 learned_addr learned my addr 172.21.15.26:0/1131671875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc35affd700 1 --2- 172.21.15.26:0/1131671875 >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 0x7fc35c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.923+0000 7fc35a7fc700 1 -- 172.21.15.26:0/1131671875 >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 msgr2=0x7fc35c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc35a7fc700 1 --2- 172.21.15.26:0/1131671875 >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 0x7fc35c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc35a7fc700 1 -- 172.21.15.26:0/1131671875 >> v1:172.21.15.67:6789/0 conn(0x7fc35c1598a0 legacy=0x7fc35c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc35a7fc700 1 -- 172.21.15.26:0/1131671875 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c15d9c0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc35affd700 1 --2- 172.21.15.26:0/1131671875 >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 0x7fc35c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc35a7fc700 1 --2- 172.21.15.26:0/1131671875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fc35c089440 tx=0x7fc344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd68bb8fd8470c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc359ffb700 1 -- 172.21.15.26:0/1131671875 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400b820 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc359ffb700 1 -- 172.21.15.26:0/1131671875 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400b980 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc359ffb700 1 -- 172.21.15.26:0/1131671875 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400bd20 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 -- 172.21.15.26:0/1131671875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 msgr2=0x7fc35c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 --2- 172.21.15.26:0/1131671875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fc35c089440 tx=0x7fc344009250 comp rx=0 tx=0).stop 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 -- 172.21.15.26:0/1131671875 shutdown_connections 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 --2- 172.21.15.26:0/1131671875 >> v2:172.21.15.67:3300/0 conn(0x7fc35c1594d0 0x7fc35c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 --2- 172.21.15.26:0/1131671875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c0cefb0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 -- 172.21.15.26:0/1131671875 >> 172.21.15.26:0/1131671875 conn(0x7fc35c0703a0 msgr2=0x7fc35c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 -- 172.21.15.26:0/1131671875 shutdown_connections 2023-10-09T11:46:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.924+0000 7fc36171c700 1 -- 172.21.15.26:0/1131671875 wait complete. 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 Processor -- start 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 -- start start 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35c1594d0 0x7fc35c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 0x7fc35c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1525b0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1509e0 con 0x7fc35c1598a0 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc36171c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1519a0 con 0x7fc35c1594d0 2023-10-09T11:46:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.926+0000 7fc35affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49278/0 (socket says 172.21.15.26:49278) 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 -- 172.21.15.26:0/2519271741 learned_addr learned my addr 172.21.15.26:0/2519271741 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35b7fe700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 0x7fc35c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35a7fc700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35c1594d0 0x7fc35c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 -- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35c1594d0 msgr2=0x7fc35c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35c1594d0 0x7fc35c0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 -- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 msgr2=0x7fc35c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 0x7fc35c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 -- 172.21.15.26:0/2519271741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440094f0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35b7fe700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 0x7fc35c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc35affd700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c830 tx=0x7fc354008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011600 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354011760 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011b20 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c151c80 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.927+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c152240 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.928+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c0ce4f0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.929+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc35400a3e0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.929+0000 7fc352ffd700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 0x7fc33c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.929+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fc3540852e0 con 0x7fc35c0cb1a0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.929+0000 7fc35a7fc700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 0x7fc33c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.930+0000 7fc35a7fc700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 0x7fc33c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc35c089440 tx=0x7fc344016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:58.933+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc354051e10 con 0x7fc35c0cb1a0 2023-10-09T11:46:59.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.125+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc35c04c3c0 con 0x7fc35c0cb1a0 2023-10-09T11:46:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.126+0000 7fc352ffd700 1 -- 172.21.15.26:0/2519271741 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v200) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc354055430 con 0x7fc35c0cb1a0 2023-10-09T11:46:59.127 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-09T11:46:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 msgr2=0x7fc33c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 0x7fc33c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc35c089440 tx=0x7fc344016000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 msgr2=0x7fc35c1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c830 tx=0x7fc354008040 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 shutdown_connections 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc35c1598a0 0x7fc35c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc35c0cb1a0 0x7fc35c1504a0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fc33c067320 0x7fc33c0697d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 --2- 172.21.15.26:0/2519271741 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc35c1594d0 0x7fc35c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 >> 172.21.15.26:0/2519271741 conn(0x7fc35c0703a0 msgr2=0x7fc35c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 shutdown_connections 2023-10-09T11:46:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.128+0000 7fc36171c700 1 -- 172.21.15.26:0/2519271741 wait complete. 2023-10-09T11:46:59.141 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:46:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.262+0000 7f9f9413b700 1 Processor -- start 2023-10-09T11:46:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.262+0000 7f9f9413b700 1 -- start start 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f9413b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 0x7f9f8c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f9413b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 0x7f9f8c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f9413b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0ccfd0 con 0x7f9f8c06e0e0 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f9413b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cf0e0 con 0x7f9f8c06dc70 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f9413b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c15a3d0 con 0x7f9f8c159530 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f916d6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 0x7f9f8c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f91ed7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 0x7f9f8c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f926d8700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9f8c06e0e0 0x7f9f8c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:36708/0 (socket says 172.21.15.26:36708) 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f916d6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 0x7f9f8c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:37726/0 (socket says 172.21.15.26:37726) 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f926d8700 1 -- 172.21.15.26:0/524816917 learned_addr learned my addr 172.21.15.26:0/524816917 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f90ed5700 1 -- 172.21.15.26:0/524816917 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148254659 0 0) 0x7f9f8c0ccfd0 con 0x7f9f8c06e0e0 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f91ed7700 1 -- 172.21.15.26:0/524816917 >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 msgr2=0x7f9f8c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f91ed7700 1 --2- 172.21.15.26:0/524816917 >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 0x7f9f8c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f91ed7700 1 -- 172.21.15.26:0/524816917 >> v1:172.21.15.67:6789/0 conn(0x7f9f8c06e0e0 legacy=0x7f9f8c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.263+0000 7f9f91ed7700 1 -- 172.21.15.26:0/524816917 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c15a6b0 con 0x7f9f8c159530 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f91ed7700 1 --2- 172.21.15.26:0/524816917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 0x7f9f8c0ceba0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f880098e0 tx=0x7f9f880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c3624cfbcb3bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f90ed5700 1 -- 172.21.15.26:0/524816917 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800b640 con 0x7f9f8c159530 2023-10-09T11:46:59.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f90ed5700 1 -- 172.21.15.26:0/524816917 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800b7a0 con 0x7f9f8c159530 2023-10-09T11:46:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f90ed5700 1 -- 172.21.15.26:0/524816917 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800bb40 con 0x7f9f8c159530 2023-10-09T11:46:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 -- 172.21.15.26:0/524816917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 msgr2=0x7f9f8c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 --2- 172.21.15.26:0/524816917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 0x7f9f8c0ceba0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f880098e0 tx=0x7f9f880091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 -- 172.21.15.26:0/524816917 shutdown_connections 2023-10-09T11:46:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 --2- 172.21.15.26:0/524816917 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c159530 0x7f9f8c0ceba0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 --2- 172.21.15.26:0/524816917 >> v2:172.21.15.67:3300/0 conn(0x7f9f8c06dc70 0x7f9f8c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 -- 172.21.15.26:0/524816917 >> 172.21.15.26:0/524816917 conn(0x7f9f8c0703a0 msgr2=0x7f9f8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 -- 172.21.15.26:0/524816917 shutdown_connections 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.264+0000 7f9f9413b700 1 -- 172.21.15.26:0/524816917 wait complete. 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.265+0000 7f9f9413b700 1 Processor -- start 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.265+0000 7f9f9413b700 1 -- start start 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c06dc70 0x7f9f8c16a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f8c06e0e0 0x7f9f8c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b6170 con 0x7f9f8c159530 2023-10-09T11:46:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c16ab80 con 0x7f9f8c06e0e0 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f9413b700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b5560 con 0x7f9f8c06dc70 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f926d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f926d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49288/0 (socket says 172.21.15.26:49288) 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f926d8700 1 -- 172.21.15.26:0/2377556004 learned_addr learned my addr 172.21.15.26:0/2377556004 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f916d6700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f8c06e0e0 0x7f9f8c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.266+0000 7f9f91ed7700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c06dc70 0x7f9f8c16a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 -- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c06dc70 msgr2=0x7f9f8c16a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c06dc70 0x7f9f8c16a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 -- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f8c06e0e0 msgr2=0x7f9f8c15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f8c06e0e0 0x7f9f8c15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 -- 172.21.15.26:0/2377556004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009420 con 0x7f9f8c159530 2023-10-09T11:46:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f926d8700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400ccc0 tx=0x7f9f84001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400a880 con 0x7f9f8c159530 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c0b5840 con 0x7f9f8c159530 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400abf0 con 0x7f9f8c159530 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400ad60 con 0x7f9f8c159530 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.267+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c0b5e00 con 0x7f9f8c159530 2023-10-09T11:46:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.268+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c04c3c0 con 0x7f9f8c159530 2023-10-09T11:46:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.269+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9f84007300 con 0x7f9f8c159530 2023-10-09T11:46:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.269+0000 7f9f81ffb700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 0x7f9f700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.269+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f9f84084fb0 con 0x7f9f8c159530 2023-10-09T11:46:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.269+0000 7f9f91ed7700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 0x7f9f700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.270+0000 7f9f91ed7700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 0x7f9f700697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f880093f0 tx=0x7f9f88017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.273+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f84051c70 con 0x7f9f8c159530 2023-10-09T11:46:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.467+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f8c0b62b0 con 0x7f9f8c159530 2023-10-09T11:46:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.467+0000 7f9f81ffb700 1 -- 172.21.15.26:0/2377556004 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v200) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f84055290 con 0x7f9f8c159530 2023-10-09T11:46:59.469 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 msgr2=0x7f9f700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 0x7f9f700697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f880093f0 tx=0x7f9f88017000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 msgr2=0x7f9f8c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400ccc0 tx=0x7f9f84001a20 comp rx=0 tx=0).stop 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 shutdown_connections 2023-10-09T11:46:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f8c159530 0x7f9f8c15e450 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9f70067320 0x7f9f700697d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f8c06dc70 0x7f9f8c16a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 --2- 172.21.15.26:0/2377556004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f8c06e0e0 0x7f9f8c15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 >> 172.21.15.26:0/2377556004 conn(0x7f9f8c0703a0 msgr2=0x7f9f8c0b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 shutdown_connections 2023-10-09T11:46:59.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.469+0000 7f9f9413b700 1 -- 172.21.15.26:0/2377556004 wait complete. 2023-10-09T11:46:59.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:59.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.601+0000 7f3268a71700 1 Processor -- start 2023-10-09T11:46:59.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.601+0000 7f3268a71700 1 -- start start 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3268a71700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32640cb5a0 0x7f32640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3268a71700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32640cd9e0 0x7f3264159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3268a71700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326415ae40 con 0x7f326415a400 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3268a71700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640d13f0 con 0x7f32640cd9e0 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3268a71700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326415ab60 con 0x7f32640cb5a0 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3261d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32640cd9e0 0x7f3264159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3262d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f326415a400 0x7f3264156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41324/0 (socket says 172.21.15.26:41324) 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3262d9d700 1 -- 172.21.15.26:0/4087520568 learned_addr learned my addr 172.21.15.26:0/4087520568 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f326259c700 1 --2- 172.21.15.26:0/4087520568 >> v2:172.21.15.67:3300/0 conn(0x7f32640cb5a0 0x7f32640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3261d9b700 1 -- 172.21.15.26:0/4087520568 >> v2:172.21.15.67:3300/0 conn(0x7f32640cb5a0 msgr2=0x7f32640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3261d9b700 1 --2- 172.21.15.26:0/4087520568 >> v2:172.21.15.67:3300/0 conn(0x7f32640cb5a0 0x7f32640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3261d9b700 1 -- 172.21.15.26:0/4087520568 >> v1:172.21.15.26:6789/0 conn(0x7f326415a400 legacy=0x7f3264156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f3261d9b700 1 -- 172.21.15.26:0/4087520568 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640ccf00 con 0x7f32640cd9e0 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.602+0000 7f326159a700 1 -- 172.21.15.26:0/4087520568 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040502294 0 0) 0x7f326415ae40 con 0x7f326415a400 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3261d9b700 1 --2- 172.21.15.26:0/4087520568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264159ec0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f324c0098e0 tx=0x7f324c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5073ba8e7da9ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f326159a700 1 -- 172.21.15.26:0/4087520568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011630 con 0x7f32640cd9e0 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f326159a700 1 -- 172.21.15.26:0/4087520568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c011790 con 0x7f32640cd9e0 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f326159a700 1 -- 172.21.15.26:0/4087520568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011b30 con 0x7f32640cd9e0 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 -- 172.21.15.26:0/4087520568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 msgr2=0x7f3264159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 --2- 172.21.15.26:0/4087520568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264159ec0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f324c0098e0 tx=0x7f324c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 -- 172.21.15.26:0/4087520568 shutdown_connections 2023-10-09T11:46:59.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 --2- 172.21.15.26:0/4087520568 >> v2:172.21.15.67:3300/0 conn(0x7f32640cb5a0 0x7f32640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 --2- 172.21.15.26:0/4087520568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264159ec0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 -- 172.21.15.26:0/4087520568 >> 172.21.15.26:0/4087520568 conn(0x7f3264070e30 msgr2=0x7f32640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 -- 172.21.15.26:0/4087520568 shutdown_connections 2023-10-09T11:46:59.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.603+0000 7f3268a71700 1 -- 172.21.15.26:0/4087520568 wait complete. 2023-10-09T11:46:59.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.604+0000 7f3268a71700 1 Processor -- start 2023-10-09T11:46:59.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.604+0000 7f3268a71700 1 -- start start 2023-10-09T11:46:59.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32640cb5a0 0x7f32640b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f326415a400 0x7f32640c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326415c7f0 con 0x7f32640cd9e0 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640b44f0 con 0x7f326415a400 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3268a71700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264169f00 con 0x7f32640cb5a0 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3261d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3261d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49306/0 (socket says 172.21.15.26:49306) 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3261d9b700 1 -- 172.21.15.26:0/1541082907 learned_addr learned my addr 172.21.15.26:0/1541082907 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f326259c700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32640cb5a0 0x7f32640b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.605+0000 7f3262d9d700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f326415a400 0x7f32640c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 -- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32640cb5a0 msgr2=0x7f32640b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32640cb5a0 0x7f32640b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 -- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f326415a400 msgr2=0x7f32640c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f326415a400 0x7f32640c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 -- 172.21.15.26:0/1541082907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c009420 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3261d9b700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f326406ea60 tx=0x7f324c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c000d10 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326416a1e0 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c011900 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c025670 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.606+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640c7950 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.607+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326416a420 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.607+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f324c023070 con 0x7f32640cd9e0 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.608+0000 7f325a7fc700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.608+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f324c0861e0 con 0x7f32640cd9e0 2023-10-09T11:46:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.608+0000 7f326259c700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.608+0000 7f326259c700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 0x7f32440697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f325c009fd0 tx=0x7f325c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.612+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f326416a420 con 0x7f32640cd9e0 2023-10-09T11:46:59.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.851+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f326416a420 con 0x7f32640cd9e0 2023-10-09T11:46:59.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.851+0000 7f325a7fc700 1 -- 172.21.15.26:0/1541082907 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4598 (secure 0 0 0) 0x7f326416a420 con 0x7f32640cd9e0 2023-10-09T11:46:59.853 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:46:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 msgr2=0x7f32440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 0x7f32440697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f325c009fd0 tx=0x7f325c00b040 comp rx=0 tx=0).stop 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 msgr2=0x7f3264169440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f326406ea60 tx=0x7f324c017000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 shutdown_connections 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f326415a400 0x7f32640c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f3244067320 0x7f32440697d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32640cb5a0 0x7f32640b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 --2- 172.21.15.26:0/1541082907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32640cd9e0 0x7f3264169440 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.853+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 >> 172.21.15.26:0/1541082907 conn(0x7f3264070e30 msgr2=0x7f32640b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.854+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 shutdown_connections 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.854+0000 7f3268a71700 1 -- 172.21.15.26:0/1541082907 wait complete. 2023-10-09T11:46:59.856 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 132 2023-10-09T11:46:59.867 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:59.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.985+0000 7ff415d94700 1 Processor -- start 2023-10-09T11:46:59.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.985+0000 7ff415d94700 1 -- start start 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff415d94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4100cb5a0 0x7ff4100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff415d94700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff4100cd9e0 0x7ff410159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff415d94700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41015ae40 con 0x7ff41015a400 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff415d94700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100d13f0 con 0x7ff4100cb5a0 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff415d94700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41015ab60 con 0x7ff4100cd9e0 2023-10-09T11:46:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4100cb5a0 0x7ff4100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff41015a400 0x7ff410156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57510/0 (socket says 172.21.15.26:57510) 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40ffff700 1 -- 172.21.15.26:0/2826187979 learned_addr learned my addr 172.21.15.26:0/2826187979 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40effd700 1 --2- 172.21.15.26:0/2826187979 >> v2:172.21.15.67:3300/0 conn(0x7ff4100cd9e0 0x7ff410159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40f7fe700 1 -- 172.21.15.26:0/2826187979 >> v2:172.21.15.67:3300/0 conn(0x7ff4100cd9e0 msgr2=0x7ff410159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2826187979 >> v2:172.21.15.67:3300/0 conn(0x7ff4100cd9e0 0x7ff410159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40f7fe700 1 -- 172.21.15.26:0/2826187979 >> v1:172.21.15.26:6789/0 conn(0x7ff41015a400 legacy=0x7ff410156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40f7fe700 1 -- 172.21.15.26:0/2826187979 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100ccf00 con 0x7ff4100cb5a0 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.986+0000 7ff40e7fc700 1 -- 172.21.15.26:0/2826187979 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058018187 0 0) 0x7ff41015ae40 con 0x7ff41015a400 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2826187979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100cb5a0 0x7ff4100cb970 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff4000098e0 tx=0x7ff4000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9317c6dfafa63d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff40e7fc700 1 -- 172.21.15.26:0/2826187979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400009e80 con 0x7ff4100cb5a0 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff40e7fc700 1 -- 172.21.15.26:0/2826187979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000b820 con 0x7ff4100cb5a0 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff40e7fc700 1 -- 172.21.15.26:0/2826187979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000bba0 con 0x7ff4100cb5a0 2023-10-09T11:46:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 -- 172.21.15.26:0/2826187979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100cb5a0 msgr2=0x7ff4100cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 --2- 172.21.15.26:0/2826187979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100cb5a0 0x7ff4100cb970 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff4000098e0 tx=0x7ff4000091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 -- 172.21.15.26:0/2826187979 shutdown_connections 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 --2- 172.21.15.26:0/2826187979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100cb5a0 0x7ff4100cb970 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 --2- 172.21.15.26:0/2826187979 >> v2:172.21.15.67:3300/0 conn(0x7ff4100cd9e0 0x7ff410159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 -- 172.21.15.26:0/2826187979 >> 172.21.15.26:0/2826187979 conn(0x7ff410070e30 msgr2=0x7ff4100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 -- 172.21.15.26:0/2826187979 shutdown_connections 2023-10-09T11:46:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.987+0000 7ff415d94700 1 -- 172.21.15.26:0/2826187979 wait complete. 2023-10-09T11:46:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 Processor -- start 2023-10-09T11:46:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 -- start start 2023-10-09T11:46:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 0x7ff4101533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 0x7ff410157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100c6e50 con 0x7ff41015a400 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101597f0 con 0x7ff4100cd9e0 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.989+0000 7ff415d94700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410152f20 con 0x7ff4100cb5a0 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34628/0 (socket says 172.21.15.26:34628) 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 -- 172.21.15.26:0/2409358473 learned_addr learned my addr 172.21.15.26:0/2409358473 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 0x7ff4101533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40effd700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 0x7ff410157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 -- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 msgr2=0x7ff4101533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 0x7ff4101533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 -- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 msgr2=0x7ff410157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 0x7ff410157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 -- 172.21.15.26:0/2409358473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009420 con 0x7ff41015a400 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 0x7ff4101533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40effd700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 0x7ff410157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff40ffff700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff40800cc20 tx=0x7ff4080019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408004bb0 con 0x7ff41015a400 2023-10-09T11:46:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff408004d10 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff410152310 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800abd0 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.990+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4101528d0 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.991+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41004c3c0 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.992+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff4080070f0 con 0x7ff41015a400 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.992+0000 7ff3f77fe700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 0x7ff3fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.992+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7ff408084b00 con 0x7ff41015a400 2023-10-09T11:47:00.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.992+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 0x7ff3fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.993+0000 7ff40f7fe700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 0x7ff3fc0697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff4000093f0 tx=0x7ff400017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:46:59.996+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff408086e60 con 0x7ff41015a400 2023-10-09T11:47:00.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.193+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4100cd1e0 con 0x7ff41015a400 2023-10-09T11:47:00.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.194+0000 7ff3f77fe700 1 -- 172.21.15.26:0/2409358473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+15462 (secure 0 0 0) 0x7ff408018070 con 0x7ff41015a400 2023-10-09T11:47:00.195 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:00.195 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":200,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:45:06.319246+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.11","mappings":[{"from":0,"to":2}]},{"pgid":"34.1f","mappings":[{"from":0,"to":1}]},{"pgid":"34.20","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:00.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 msgr2=0x7ff3fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 0x7ff3fc0697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff4000093f0 tx=0x7ff400017000 comp rx=0 tx=0).stop 2023-10-09T11:47:00.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 msgr2=0x7ff4100c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff40800cc20 tx=0x7ff4080019b0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 shutdown_connections 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff41015a400 0x7ff4100c54b0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff3fc067320 0x7ff3fc0697d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4100cb5a0 0x7ff4101533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 --2- 172.21.15.26:0/2409358473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4100cd9e0 0x7ff410157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 >> 172.21.15.26:0/2409358473 conn(0x7ff410070e30 msgr2=0x7ff410154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 shutdown_connections 2023-10-09T11:47:00.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.196+0000 7ff415d94700 1 -- 172.21.15.26:0/2409358473 wait complete. 2023-10-09T11:47:00.209 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:47:00.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.329+0000 7fa7c6844700 1 Processor -- start 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.329+0000 7fa7c6844700 1 -- start start 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7c00cb5a0 0x7fa7c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7c00cde50 0x7fa7c015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00d13f0 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c015a940 con 0x7fa7c00cde50 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c6844700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015ae40 con 0x7fa7c00cd9e0 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7c00cb5a0 0x7fa7c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7c00cb5a0 0x7fa7c00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34632/0 (socket says 172.21.15.26:34632) 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 -- 172.21.15.26:0/2645871187 learned_addr learned my addr 172.21.15.26:0/2645871187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7c4de1700 1 --2- 172.21.15.26:0/2645871187 >> v2:172.21.15.67:3300/0 conn(0x7fa7c00cde50 0x7fa7c015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bf7fe700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 -- 172.21.15.26:0/2645871187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 msgr2=0x7fa7c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 -- 172.21.15.26:0/2645871187 >> v2:172.21.15.67:3300/0 conn(0x7fa7c00cde50 msgr2=0x7fa7c015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 --2- 172.21.15.26:0/2645871187 >> v2:172.21.15.67:3300/0 conn(0x7fa7c00cde50 0x7fa7c015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 -- 172.21.15.26:0/2645871187 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c015ab60 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.330+0000 7fa7bffff700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c00cb970 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00cbeb0 tx=0x7fa7b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3769ff88c267b4be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7beffd700 1 -- 172.21.15.26:0/2645871187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400b820 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7beffd700 1 -- 172.21.15.26:0/2645871187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400b980 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7beffd700 1 -- 172.21.15.26:0/2645871187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400bd20 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 -- 172.21.15.26:0/2645871187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c00cb5a0 msgr2=0x7fa7c00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c00cb970 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00cbeb0 tx=0x7fa7b4009250 comp rx=0 tx=0).stop 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 -- 172.21.15.26:0/2645871187 shutdown_connections 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 --2- 172.21.15.26:0/2645871187 >> v2:172.21.15.67:3300/0 conn(0x7fa7c00cde50 0x7fa7c015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c00cb970 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 --2- 172.21.15.26:0/2645871187 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 -- 172.21.15.26:0/2645871187 >> 172.21.15.26:0/2645871187 conn(0x7fa7c0070e30 msgr2=0x7fa7c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 -- 172.21.15.26:0/2645871187 shutdown_connections 2023-10-09T11:47:00.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.331+0000 7fa7c6844700 1 -- 172.21.15.26:0/2645871187 wait complete. 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.332+0000 7fa7c6844700 1 Processor -- start 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 -- start start 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c0141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015a0b0 con 0x7fa7c0157330 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0159010 con 0x7fa7c00cb5a0 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c6844700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c01592f0 con 0x7fa7c00cd9e0 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c4de1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c4de1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34642/0 (socket says 172.21.15.26:34642) 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7c4de1700 1 -- 172.21.15.26:0/532887923 learned_addr learned my addr 172.21.15.26:0/532887923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7bf7fe700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.333+0000 7fa7bffff700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c0141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 -- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 msgr2=0x7fa7c0156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 -- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7c00cb5a0 msgr2=0x7fa7c0141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c0141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 -- 172.21.15.26:0/532887923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40094f0 con 0x7fa7c0157330 2023-10-09T11:47:00.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c4de1700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007f20 tx=0x7fa7b8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800eb90 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800ed10 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c01595d0 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8014670 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.334+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c0159b90 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.335+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c004c3c0 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.335+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7b80149e0 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.336+0000 7fa7a7fff700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 0x7fa7ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.336+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fa7b8085270 con 0x7fa7c0157330 2023-10-09T11:47:00.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.336+0000 7fa7bffff700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 0x7fa7ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.337+0000 7fa7bffff700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 0x7fa7ac0697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00cbeb0 tx=0x7fa7b4017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.340+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7b8051eb0 con 0x7fa7c0157330 2023-10-09T11:47:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.578+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7c00ccf00 con 0x7fa7c0157330 2023-10-09T11:47:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.578+0000 7fa7a7fff700 1 -- 172.21.15.26:0/532887923 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4598 (secure 0 0 0) 0x7fa7b80554d0 con 0x7fa7c0157330 2023-10-09T11:47:00.580 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:00.580 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 msgr2=0x7fa7ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 0x7fa7ac0697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00cbeb0 tx=0x7fa7b4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 msgr2=0x7fa7c00c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007f20 tx=0x7fa7b8009860 comp rx=0 tx=0).stop 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 shutdown_connections 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7c0157330 0x7fa7c00c6760 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7c00cb5a0 0x7fa7c0141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa7ac067320 0x7fa7ac0697d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 --2- 172.21.15.26:0/532887923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7c00cd9e0 0x7fa7c0156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 >> 172.21.15.26:0/532887923 conn(0x7fa7c0070e30 msgr2=0x7fa7c00d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.580+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 shutdown_connections 2023-10-09T11:47:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.581+0000 7fa7c6844700 1 -- 172.21.15.26:0/532887923 wait complete. 2023-10-09T11:47:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 132 2023-10-09T11:47:00.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.712+0000 7f827cc75700 1 Processor -- start 2023-10-09T11:47:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.712+0000 7f827cc75700 1 -- start start 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827cc75700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cb5a0 0x7f82780cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827cc75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82780cd9e0 0x7f8278159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827cc75700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827815ae40 con 0x7f82780cde50 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827cc75700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780d13f0 con 0x7f82780cd9e0 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827cc75700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827815ab60 con 0x7f82780cb5a0 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82780cd9e0 0x7f8278159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8276d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82780cde50 0x7f8278156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57522/0 (socket says 172.21.15.26:57522) 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8276d9d700 1 -- 172.21.15.26:0/500032022 learned_addr learned my addr 172.21.15.26:0/500032022 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827659c700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cb5a0 0x7f82780cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 -- 172.21.15.26:0/500032022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cb5a0 msgr2=0x7f82780cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cb5a0 0x7f82780cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 -- 172.21.15.26:0/500032022 >> v1:172.21.15.26:6789/0 conn(0x7f82780cde50 legacy=0x7f8278156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 -- 172.21.15.26:0/500032022 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780ccf00 con 0x7f82780cd9e0 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827559a700 1 -- 172.21.15.26:0/500032022 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126011957 0 0) 0x7f827815ae40 con 0x7f82780cde50 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f8275d9b700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780cd9e0 0x7f8278159ec0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d30adbf98fd4229 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.713+0000 7f827559a700 1 -- 172.21.15.26:0/500032022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00b640 con 0x7f82780cd9e0 2023-10-09T11:47:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827559a700 1 -- 172.21.15.26:0/500032022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00b7a0 con 0x7f82780cd9e0 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827559a700 1 -- 172.21.15.26:0/500032022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00bb40 con 0x7f82780cd9e0 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 -- 172.21.15.26:0/500032022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780cd9e0 msgr2=0x7f8278159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780cd9e0 0x7f8278159ec0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 -- 172.21.15.26:0/500032022 shutdown_connections 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cb5a0 0x7f82780cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 --2- 172.21.15.26:0/500032022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780cd9e0 0x7f8278159ec0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 -- 172.21.15.26:0/500032022 >> 172.21.15.26:0/500032022 conn(0x7f8278070e30 msgr2=0x7f82780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 -- 172.21.15.26:0/500032022 shutdown_connections 2023-10-09T11:47:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.714+0000 7f827cc75700 1 -- 172.21.15.26:0/500032022 wait complete. 2023-10-09T11:47:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.715+0000 7f827cc75700 1 Processor -- start 2023-10-09T11:47:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.715+0000 7f827cc75700 1 -- start start 2023-10-09T11:47:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82780cb5a0 0x7f827815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cd9e0 0x7f82780b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278159350 con 0x7f82780c9f50 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278159580 con 0x7f82780cb5a0 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827cc75700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278159860 con 0x7f82780cd9e0 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34662/0 (socket says 172.21.15.26:34662) 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 -- 172.21.15.26:0/3263787965 learned_addr learned my addr 172.21.15.26:0/3263787965 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8275d9b700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cd9e0 0x7f82780b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f827659c700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82780cb5a0 0x7f827815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 -- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cd9e0 msgr2=0x7f82780b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cd9e0 0x7f82780b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 -- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82780cb5a0 msgr2=0x7f827815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82780cb5a0 0x7f827815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.716+0000 7f8276d9d700 1 -- 172.21.15.26:0/3263787965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009420 con 0x7f82780c9f50 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f8276d9d700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f827000cbf0 tx=0x7f82700019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000a8b0 con 0x7f82780c9f50 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000aa10 con 0x7f82780c9f50 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278159b40 con 0x7f82780c9f50 2023-10-09T11:47:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000add0 con 0x7f82780c9f50 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.717+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827815e2c0 con 0x7f82780c9f50 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.718+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827804c3c0 con 0x7f82780c9f50 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.718+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8270007300 con 0x7f82780c9f50 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.719+0000 7f82667fc700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 0x7f82580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.719+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f8270084f50 con 0x7f82780c9f50 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.719+0000 7f827659c700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 0x7f82580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.720+0000 7f827659c700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 0x7f82580697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8268009db0 tx=0x7f82680091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.723+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8270051c10 con 0x7f82780c9f50 2023-10-09T11:47:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.962+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82780cd1e0 con 0x7f82780c9f50 2023-10-09T11:47:00.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.962+0000 7f82667fc700 1 -- 172.21.15.26:0/3263787965 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+4598 (secure 0 0 0) 0x7f8270055230 con 0x7f82780c9f50 2023-10-09T11:47:00.964 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:00.964 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":132,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:44:46.652141+0000","modified":"2023-10-09T11:44:50.262164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"b","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/2946278291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2946278291},{"type":"v1","addr":"172.21.15.67:6837","nonce":2946278291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T11:47:00.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 msgr2=0x7f82580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 0x7f82580697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8268009db0 tx=0x7f82680091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 msgr2=0x7f8278155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f827000cbf0 tx=0x7f82700019b0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 shutdown_connections 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82780c9f50 0x7f8278155e20 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82780cb5a0 0x7f827815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f8258067320 0x7f82580697d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 --2- 172.21.15.26:0/3263787965 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82780cd9e0 0x7f82780b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.964+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 >> 172.21.15.26:0/3263787965 conn(0x7f8278070e30 msgr2=0x7f82780c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.965+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 shutdown_connections 2023-10-09T11:47:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:00.965+0000 7f827cc75700 1 -- 172.21.15.26:0/3263787965 wait complete. 2023-10-09T11:47:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 132 2023-10-09T11:47:00.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.096+0000 7f00ebf7e700 1 Processor -- start 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.096+0000 7f00ebf7e700 1 -- start start 2023-10-09T11:47:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00e40cb5a0 0x7f00e40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00e40cd9e0 0x7f00e4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e40d13f0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e415ae40 con 0x7f00e40cd9e0 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ebf7e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e415ab60 con 0x7f00e415a400 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00e9d1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00e40cb5a0 0x7f00e40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00e9d1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00e40cb5a0 0x7f00e40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34664/0 (socket says 172.21.15.26:34664) 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00e9d1a700 1 -- 172.21.15.26:0/3724346989 learned_addr learned my addr 172.21.15.26:0/3724346989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00e9519700 1 --2- 172.21.15.26:0/3724346989 >> v2:172.21.15.67:3300/0 conn(0x7f00e40cd9e0 0x7f00e4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.097+0000 7f00ea51b700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 -- 172.21.15.26:0/3724346989 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 msgr2=0x7f00e4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 -- 172.21.15.26:0/3724346989 >> v2:172.21.15.67:3300/0 conn(0x7f00e40cd9e0 msgr2=0x7f00e4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/3724346989 >> v2:172.21.15.67:3300/0 conn(0x7f00e40cd9e0 0x7f00e4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 -- 172.21.15.26:0/3724346989 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40ccf00 con 0x7f00e40cb5a0 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e40cb970 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009f20 tx=0x7f00d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4838ccd3713cc051 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e8d18700 1 -- 172.21.15.26:0/3724346989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400e070 con 0x7f00e40cb5a0 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e8d18700 1 -- 172.21.15.26:0/3724346989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400b930 con 0x7f00e40cb5a0 2023-10-09T11:47:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00e8d18700 1 -- 172.21.15.26:0/3724346989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40092e0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 -- 172.21.15.26:0/3724346989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 msgr2=0x7f00e40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e40cb970 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009f20 tx=0x7f00d4009840 comp rx=0 tx=0).stop 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 -- 172.21.15.26:0/3724346989 shutdown_connections 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/3724346989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e40cb970 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/3724346989 >> v2:172.21.15.67:3300/0 conn(0x7f00e40cd9e0 0x7f00e4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.098+0000 7f00ebf7e700 1 -- 172.21.15.26:0/3724346989 >> 172.21.15.26:0/3724346989 conn(0x7f00e4070e30 msgr2=0x7f00e40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.099+0000 7f00ebf7e700 1 -- 172.21.15.26:0/3724346989 shutdown_connections 2023-10-09T11:47:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.099+0000 7f00ebf7e700 1 -- 172.21.15.26:0/3724346989 wait complete. 2023-10-09T11:47:01.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 Processor -- start 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 -- start start 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e40cd9e0 0x7f00e416d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e40b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40c8ce0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e416dbd0 con 0x7f00e40cd9e0 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00ebf7e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e416deb0 con 0x7f00e415a400 2023-10-09T11:47:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.100+0000 7f00e9d1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34678/0 (socket says 172.21.15.26:34678) 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 -- 172.21.15.26:0/2171046625 learned_addr learned my addr 172.21.15.26:0/2171046625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9519700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e40cd9e0 0x7f00e416d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00ea51b700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e40b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 -- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 msgr2=0x7f00e40b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e40b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 -- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e40cd9e0 msgr2=0x7f00e416d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e40cd9e0 0x7f00e416d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 -- 172.21.15.26:0/2171046625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009ae0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e9d1a700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f00e406ea60 tx=0x7f00d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4008870 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40089f0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40c8fa0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4008db0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.101+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e415e090 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.102+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e404c3c0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.103+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00d4003040 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.103+0000 7f00e1ffb700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 0x7f00d0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.103+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f00d4089460 con 0x7f00e40cb5a0 2023-10-09T11:47:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.103+0000 7f00e9519700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 0x7f00d0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.104+0000 7f00e9519700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 0x7f00d0069800 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f00e40b11b0 tx=0x7f00d80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.107+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00d40534f0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.300+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e40cd1e0 con 0x7f00e40cb5a0 2023-10-09T11:47:01.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.301+0000 7f00e1ffb700 1 -- 172.21.15.26:0/2171046625 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+15462 (secure 0 0 0) 0x7f00d4056b10 con 0x7f00e40cb5a0 2023-10-09T11:47:01.302 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:01.302 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":200,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:45:06.319246+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:44:44.375626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T11:44:45.630210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.11","mappings":[{"from":0,"to":2}]},{"pgid":"34.1f","mappings":[{"from":0,"to":1}]},{"pgid":"34.20","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 msgr2=0x7f00d0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 0x7f00d0069800 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f00e40b11b0 tx=0x7f00d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 msgr2=0x7f00e4153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f00e406ea60 tx=0x7f00d4018000 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 shutdown_connections 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f00d0067350 0x7f00d0069800 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00e415a400 0x7f00e40b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00e40cb5a0 0x7f00e4153130 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 --2- 172.21.15.26:0/2171046625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00e40cd9e0 0x7f00e416d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 >> 172.21.15.26:0/2171046625 conn(0x7f00e4070e30 msgr2=0x7f00e40cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 shutdown_connections 2023-10-09T11:47:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.303+0000 7f00ebf7e700 1 -- 172.21.15.26:0/2171046625 wait complete. 2023-10-09T11:47:01.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:47:01.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 Processor -- start 2023-10-09T11:47:01.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 -- start start 2023-10-09T11:47:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 0x7fa5600adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600adb20 con 0x7fa5600b1040 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600acf10 con 0x7fa560159c20 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.436+0000 7fa5669e9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600ccdc0 con 0x7fa560159850 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa564f86700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5600b1040 0x7fa5600c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57538/0 (socket says 172.21.15.26:57538) 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa564f86700 1 -- 172.21.15.26:0/191437533 learned_addr learned my addr 172.21.15.26:0/191437533 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55ffff700 1 --2- 172.21.15.26:0/191437533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 0x7fa5600adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145953392 0 0) 0x7fa5600adb20 con 0x7fa5600b1040 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa548003570 con 0x7fa5600b1040 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204076306 0 0) 0x7fa5600acf10 con 0x7fa560159c20 2023-10-09T11:47:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5600adb20 con 0x7fa560159c20 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55ffff700 1 -- 172.21.15.26:0/191437533 >> v1:172.21.15.67:6789/0 conn(0x7fa560159c20 legacy=0x7fa5600b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906085356 0 0) 0x7fa548003570 con 0x7fa5600b1040 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55ffff700 1 -- 172.21.15.26:0/191437533 >> v1:172.21.15.26:6789/0 conn(0x7fa5600b1040 legacy=0x7fa5600c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55ffff700 1 -- 172.21.15.26:0/191437533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600ad1f0 con 0x7fa560159850 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.437+0000 7fa55ffff700 1 --2- 172.21.15.26:0/191437533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 0x7fa5600adfb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa550009910 tx=0x7fa5500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3eac24fa34ea5d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580017f0 con 0x7fa560159850 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550011420 con 0x7fa560159850 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa55effd700 1 -- 172.21.15.26:0/191437533 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5500117c0 con 0x7fa560159850 2023-10-09T11:47:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 -- 172.21.15.26:0/191437533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 msgr2=0x7fa5600adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 --2- 172.21.15.26:0/191437533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 0x7fa5600adfb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa550009910 tx=0x7fa5500091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 -- 172.21.15.26:0/191437533 shutdown_connections 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 --2- 172.21.15.26:0/191437533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159850 0x7fa5600adfb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 -- 172.21.15.26:0/191437533 >> 172.21.15.26:0/191437533 conn(0x7fa56006d170 msgr2=0x7fa5600cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 -- 172.21.15.26:0/191437533 shutdown_connections 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.438+0000 7fa5669e9700 1 -- 172.21.15.26:0/191437533 wait complete. 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.439+0000 7fa5669e9700 1 Processor -- start 2023-10-09T11:47:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.439+0000 7fa5669e9700 1 -- start start 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5600b1040 0x7fa5600aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159c20 0x7fa5600a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600a8a80 con 0x7fa560159850 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560153570 con 0x7fa5600b1040 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa5669e9700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600cb0f0 con 0x7fa560159c20 2023-10-09T11:47:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34680/0 (socket says 172.21.15.26:34680) 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa55f7fe700 1 -- 172.21.15.26:0/2725275662 learned_addr learned my addr 172.21.15.26:0/2725275662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa564f86700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159c20 0x7fa5600a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.440+0000 7fa55ffff700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5600b1040 0x7fa5600aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 -- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159c20 msgr2=0x7fa5600a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159c20 0x7fa5600a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 -- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5600b1040 msgr2=0x7fa5600aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5600b1040 0x7fa5600aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 -- 172.21.15.26:0/2725275662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009420 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa55f7fe700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c580 tx=0x7fa554007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554010510 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa554010670 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600a9400 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554010a30 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.441+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5600a99c0 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.442+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56004c3c0 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.442+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa55401b400 con 0x7fa560159850 2023-10-09T11:47:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.443+0000 7fa547fff700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 0x7fa54c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.443+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fa5540848a0 con 0x7fa560159850 2023-10-09T11:47:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.443+0000 7fa55ffff700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 0x7fa54c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.443+0000 7fa55ffff700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 0x7fa54c0697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa5500030c0 tx=0x7fa550016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.447+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5540514e0 con 0x7fa560159850 2023-10-09T11:47:01.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.684+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5600ad4d0 con 0x7fa560159850 2023-10-09T11:47:01.686 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-09T11:47:01.685+0000 7f0acfe9f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:47:01.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.689+0000 7fa547fff700 1 -- 172.21.15.26:0/2725275662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v133) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa554054b00 con 0x7fa560159850 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 msgr2=0x7fa54c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 0x7fa54c0697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa5500030c0 tx=0x7fa550016000 comp rx=0 tx=0).stop 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 msgr2=0x7fa560153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c580 tx=0x7fa554007e10 comp rx=0 tx=0).stop 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 shutdown_connections 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa54c067320 0x7fa54c0697d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa560159c20 0x7fa5600a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5600b1040 0x7fa5600aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 --2- 172.21.15.26:0/2725275662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa560159850 0x7fa560153030 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 >> 172.21.15.26:0/2725275662 conn(0x7fa56006d170 msgr2=0x7fa560158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 shutdown_connections 2023-10-09T11:47:01.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.691+0000 7fa5669e9700 1 -- 172.21.15.26:0/2725275662 wait complete. 2023-10-09T11:47:01.694 INFO:tasks.ceph.mds.b.smithi067.stderr: -3287> 2023-10-09T11:44:51.897+0000 7eff5bca8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:47:01.695 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:47:01.705 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:47:01.720 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2023-10-09T11:47:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.826+0000 7fb5e8098700 1 Processor -- start 2023-10-09T11:47:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.827+0000 7fb5e8098700 1 -- start start 2023-10-09T11:47:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.827+0000 7fb5e8098700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5e00c4580 0x7fb5e00cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.827+0000 7fb5e8098700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5e0159c90 0x7fb5e00cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.827+0000 7fb5e8098700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e00c9310 con 0x7fb5e01598c0 2023-10-09T11:47:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.827+0000 7fb5e8098700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e00ad990 con 0x7fb5e00c4580 2023-10-09T11:47:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e8098700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e00ce090 con 0x7fb5e0159c90 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5e34700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb5e01598c0 0x7fb5e00c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57552/0 (socket says 172.21.15.26:57552) 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5e34700 1 -- 172.21.15.26:0/236277716 learned_addr learned my addr 172.21.15.26:0/236277716 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 --2- 172.21.15.26:0/236277716 >> v2:172.21.15.26:3300/0 conn(0x7fb5e00c4580 0x7fb5e00cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e6635700 1 --2- 172.21.15.26:0/236277716 >> v2:172.21.15.67:3300/0 conn(0x7fb5e0159c90 0x7fb5e00cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 -- 172.21.15.26:0/236277716 >> v2:172.21.15.67:3300/0 conn(0x7fb5e0159c90 msgr2=0x7fb5e00cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 --2- 172.21.15.26:0/236277716 >> v2:172.21.15.67:3300/0 conn(0x7fb5e0159c90 0x7fb5e00cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 -- 172.21.15.26:0/236277716 >> v1:172.21.15.26:6789/0 conn(0x7fb5e01598c0 legacy=0x7fb5e00c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 -- 172.21.15.26:0/236277716 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00c8cc0 con 0x7fb5e00c4580 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e4e32700 1 -- 172.21.15.26:0/236277716 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760862087 0 0) 0x7fb5e00c9310 con 0x7fb5e01598c0 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e5633700 1 --2- 172.21.15.26:0/236277716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e00c4580 0x7fb5e00cd460 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00c3450 tx=0x7fb5d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340b9a26fb3d3cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e4e32700 1 -- 172.21.15.26:0/236277716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400b6b0 con 0x7fb5e00c4580 2023-10-09T11:47:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e4e32700 1 -- 172.21.15.26:0/236277716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400b810 con 0x7fb5e00c4580 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.828+0000 7fb5e4e32700 1 -- 172.21.15.26:0/236277716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400bbb0 con 0x7fb5e00c4580 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 -- 172.21.15.26:0/236277716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e00c4580 msgr2=0x7fb5e00cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 --2- 172.21.15.26:0/236277716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e00c4580 0x7fb5e00cd460 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00c3450 tx=0x7fb5d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 -- 172.21.15.26:0/236277716 shutdown_connections 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 --2- 172.21.15.26:0/236277716 >> v2:172.21.15.67:3300/0 conn(0x7fb5e0159c90 0x7fb5e00cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 --2- 172.21.15.26:0/236277716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e00c4580 0x7fb5e00cd460 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 -- 172.21.15.26:0/236277716 >> 172.21.15.26:0/236277716 conn(0x7fb5e0088000 msgr2=0x7fb5e00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 -- 172.21.15.26:0/236277716 shutdown_connections 2023-10-09T11:47:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.829+0000 7fb5e8098700 1 -- 172.21.15.26:0/236277716 wait complete. 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.830+0000 7fb5e8098700 1 Processor -- start 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.830+0000 7fb5e8098700 1 -- start start 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5e00c4580 0x7fb5e0148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e0159c90 0x7fb5e00ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0154b00 con 0x7fb5e01598c0 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00ac8a0 con 0x7fb5e0159c90 2023-10-09T11:47:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e8098700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00ab1a0 con 0x7fb5e00c4580 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34692/0 (socket says 172.21.15.26:34692) 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 -- 172.21.15.26:0/840969044 learned_addr learned my addr 172.21.15.26:0/840969044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 -- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5e00c4580 msgr2=0x7fb5e0148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5e00c4580 0x7fb5e0148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 -- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e0159c90 msgr2=0x7fb5e00ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e6635700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e0159c90 0x7fb5e00ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e0159c90 0x7fb5e00ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 -- 172.21.15.26:0/840969044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009420 con 0x7fb5e01598c0 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5e5633700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4013000 tx=0x7fb5d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.831+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d401f070 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.832+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4000bc0 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.832+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e00abf20 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.832+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4025420 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.832+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e00ab720 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.833+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e00aca10 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.833+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb5d4023070 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.834+0000 7fb5ddffb700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 0x7fb5cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.834+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5878+0+0 (secure 0 0 0) 0x7fb5d4086250 con 0x7fb5e01598c0 2023-10-09T11:47:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.834+0000 7fb5e5e34700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 0x7fb5cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.834+0000 7fb5e5e34700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 0x7fb5cc0697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80011e0 tx=0x7fb5d80079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:01.838+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5d4052df0 con 0x7fb5e01598c0 2023-10-09T11:47:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.075+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5e004c3c0 con 0x7fb5e01598c0 2023-10-09T11:47:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.690+0000 7fb5ddffb700 1 -- 172.21.15.26:0/840969044 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v134) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5d4056410 con 0x7fb5e01598c0 2023-10-09T11:47:02.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.692+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 msgr2=0x7fb5cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.692+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 0x7fb5cc0697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80011e0 tx=0x7fb5d80079d0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.692+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 msgr2=0x7fb5e0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.692+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4013000 tx=0x7fb5d4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 shutdown_connections 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e0159c90 0x7fb5e00ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb5cc067320 0x7fb5cc0697d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5e00c4580 0x7fb5e0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 --2- 172.21.15.26:0/840969044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5e01598c0 0x7fb5e0154370 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 >> 172.21.15.26:0/840969044 conn(0x7fb5e0088000 msgr2=0x7fb5e0156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 shutdown_connections 2023-10-09T11:47:02.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.693+0000 7fb5e8098700 1 -- 172.21.15.26:0/840969044 wait complete. 2023-10-09T11:47:02.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:47:02.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.834+0000 7fe53b88a700 1 Processor -- start 2023-10-09T11:47:02.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.834+0000 7fe53b88a700 1 -- start start 2023-10-09T11:47:02.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe53b88a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 0x7fe53415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe53b88a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe534068220 0x7fe534159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe53b88a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53415d9f0 con 0x7fe53415a300 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe53b88a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53415d3c0 con 0x7fe534068220 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe53b88a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415a8f0 con 0x7fe534067e50 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe534068220 0x7fe534159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe539e27700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe53415a300 0x7fe5340c8c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57564/0 (socket says 172.21.15.26:57564) 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe539e27700 1 -- 172.21.15.26:0/2941275998 learned_addr learned my addr 172.21.15.26:0/2941275998 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe534068220 0x7fe534159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34708/0 (socket says 172.21.15.26:34708) 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe539626700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 0x7fe53415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 -- 172.21.15.26:0/2941275998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 msgr2=0x7fe53415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 0x7fe53415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 -- 172.21.15.26:0/2941275998 >> v1:172.21.15.26:6789/0 conn(0x7fe53415a300 legacy=0x7fe5340c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe538e25700 1 -- 172.21.15.26:0/2941275998 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53415abd0 con 0x7fe534068220 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe539626700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 0x7fe53415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.835+0000 7fe533fff700 1 -- 172.21.15.26:0/2941275998 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591138580 0 0) 0x7fe53415d9f0 con 0x7fe53415a300 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe538e25700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe534068220 0x7fe534159dc0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe5280098e0 tx=0x7fe5280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac71bb360e8bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe533fff700 1 -- 172.21.15.26:0/2941275998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528009e80 con 0x7fe534068220 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe533fff700 1 -- 172.21.15.26:0/2941275998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800b860 con 0x7fe534068220 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe533fff700 1 -- 172.21.15.26:0/2941275998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800bbe0 con 0x7fe534068220 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 -- 172.21.15.26:0/2941275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe534068220 msgr2=0x7fe534159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe534068220 0x7fe534159dc0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe5280098e0 tx=0x7fe5280091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 -- 172.21.15.26:0/2941275998 shutdown_connections 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534067e50 0x7fe53415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 --2- 172.21.15.26:0/2941275998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe534068220 0x7fe534159dc0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 -- 172.21.15.26:0/2941275998 >> 172.21.15.26:0/2941275998 conn(0x7fe5340ce4a0 msgr2=0x7fe5340ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 -- 172.21.15.26:0/2941275998 shutdown_connections 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.836+0000 7fe53b88a700 1 -- 172.21.15.26:0/2941275998 wait complete. 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.837+0000 7fe53b88a700 1 Processor -- start 2023-10-09T11:47:02.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 -- start start 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe534067e50 0x7fe5340c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 0x7fe5340b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340b1cd0 con 0x7fe53415a300 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53413f600 con 0x7fe534067e50 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.838+0000 7fe53b88a700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534158ac0 con 0x7fe534068220 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34714/0 (socket says 172.21.15.26:34714) 2023-10-09T11:47:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 -- 172.21.15.26:0/3435278003 learned_addr learned my addr 172.21.15.26:0/3435278003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe538e25700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 0x7fe5340b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539626700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe534067e50 0x7fe5340c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 -- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 msgr2=0x7fe5340b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 0x7fe5340b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 -- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe534067e50 msgr2=0x7fe5340c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe534067e50 0x7fe5340c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 -- 172.21.15.26:0/3435278003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528009420 con 0x7fe53415a300 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe538e25700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 0x7fe5340b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe539e27700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fe52400cc90 tx=0x7fe524001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52400cea0 con 0x7fe53415a300 2023-10-09T11:47:02.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52400ab70 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240070f0 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe534158da0 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.839+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5340c2c10 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.840+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5340c2e30 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.841+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe5240074a0 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.841+0000 7fe5317fa700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 0x7fe5200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.841+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5878+0+0 (secure 0 0 0) 0x7fe5240851a0 con 0x7fe53415a300 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.841+0000 7fe539626700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 0x7fe5200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.842+0000 7fe539626700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 0x7fe5200697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006fd0 tx=0x7fe52c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:02.845+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe524051e00 con 0x7fe53415a300 2023-10-09T11:47:03.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.042+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe53404c3c0 con 0x7fe53415a300 2023-10-09T11:47:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.698+0000 7fe5317fa700 1 -- 172.21.15.26:0/3435278003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v202) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe524055420 con 0x7fe53415a300 2023-10-09T11:47:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 msgr2=0x7fe5200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 0x7fe5200697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006fd0 tx=0x7fe52c008040 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 msgr2=0x7fe5340b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fe52400cc90 tx=0x7fe524001a80 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 shutdown_connections 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe53415a300 0x7fe5340b1790 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe534067e50 0x7fe5340c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe520067320 0x7fe5200697d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 --2- 172.21.15.26:0/3435278003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe534068220 0x7fe5340b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 >> 172.21.15.26:0/3435278003 conn(0x7fe5340ce4a0 msgr2=0x7fe53406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 shutdown_connections 2023-10-09T11:47:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.700+0000 7fe53b88a700 1 -- 172.21.15.26:0/3435278003 wait complete. 2023-10-09T11:47:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:47:03.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:47:03.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.843+0000 7f4977ad8700 1 Processor -- start 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.843+0000 7f4977ad8700 1 -- start start 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.843+0000 7f4977ad8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.843+0000 7f4977ad8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49700c7b30 0x7f497006b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4977ad8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497006b2f0 con 0x7f497006bcc0 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4977ad8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497006ace0 con 0x7f49700c7b30 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4977ad8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49700c8310 con 0x7f4970156480 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49700c7b30 0x7f497006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49700c7b30 0x7f497006b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34730/0 (socket says 172.21.15.26:34730) 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 -- 172.21.15.26:0/583422592 learned_addr learned my addr 172.21.15.26:0/583422592 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975874700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 -- 172.21.15.26:0/583422592 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 msgr2=0x7f4970157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 -- 172.21.15.26:0/583422592 >> v1:172.21.15.67:6789/0 conn(0x7f497006bcc0 legacy=0x7f49700ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 -- 172.21.15.26:0/583422592 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700c85f0 con 0x7f49700c7b30 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4975073700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f497006b780 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f49640099b0 tx=0x7f4964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d60ea33b5e9d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4974872700 1 -- 172.21.15.26:0/583422592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400b820 con 0x7f49700c7b30 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4974872700 1 -- 172.21.15.26:0/583422592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496400b980 con 0x7f49700c7b30 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.844+0000 7f4974872700 1 -- 172.21.15.26:0/583422592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400bd20 con 0x7f49700c7b30 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 -- 172.21.15.26:0/583422592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 msgr2=0x7f497006b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f497006b780 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f49640099b0 tx=0x7f4964009250 comp rx=0 tx=0).stop 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 -- 172.21.15.26:0/583422592 shutdown_connections 2023-10-09T11:47:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 --2- 172.21.15.26:0/583422592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f497006b780 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 -- 172.21.15.26:0/583422592 >> 172.21.15.26:0/583422592 conn(0x7f497006d170 msgr2=0x7f49700cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 -- 172.21.15.26:0/583422592 shutdown_connections 2023-10-09T11:47:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.845+0000 7f4977ad8700 1 -- 172.21.15.26:0/583422592 wait complete. 2023-10-09T11:47:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.846+0000 7f4977ad8700 1 Processor -- start 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.846+0000 7f4977ad8700 1 -- start start 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497006bcc0 0x7f49700af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b2000 con 0x7f49700c7b30 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700afa00 con 0x7f497006bcc0 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4977ad8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4970141c90 con 0x7f4970156480 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34744/0 (socket says 172.21.15.26:34744) 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 -- 172.21.15.26:0/2978739596 learned_addr learned my addr 172.21.15.26:0/2978739596 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975874700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497006bcc0 0x7f49700af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4976075700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 -- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 msgr2=0x7f4970142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 -- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497006bcc0 msgr2=0x7f49700af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497006bcc0 0x7f49700af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 -- 172.21.15.26:0/2978739596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640094f0 con 0x7f49700c7b30 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4976075700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.847+0000 7f4975073700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4964009290 tx=0x7f4964016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.848+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964011ca0 con 0x7f49700c7b30 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.848+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964020070 con 0x7f49700c7b30 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.848+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4970141380 con 0x7f49700c7b30 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.848+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496401b6a0 con 0x7f49700c7b30 2023-10-09T11:47:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.848+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4970141640 con 0x7f49700c7b30 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.849+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4970141e40 con 0x7f49700c7b30 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.849+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4964022030 con 0x7f49700c7b30 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.850+0000 7f496dffb700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 0x7f495c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.850+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f49640868f0 con 0x7f49700c7b30 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.850+0000 7f4975874700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 0x7f495c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.850+0000 7f4975874700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 0x7f495c0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f49700c76e0 tx=0x7f4960009720 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:03.854+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4970141e40 con 0x7f49700c7b30 2023-10-09T11:47:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.048+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4970141e00 con 0x7f49700c7b30 2023-10-09T11:47:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.699+0000 7f496dffb700 1 -- 172.21.15.26:0/2978739596 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v203) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4964053850 con 0x7f49700c7b30 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 msgr2=0x7f495c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 0x7f495c0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f49700c76e0 tx=0x7f4960009720 comp rx=0 tx=0).stop 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 msgr2=0x7f49700b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4964009290 tx=0x7f4964016000 comp rx=0 tx=0).stop 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 shutdown_connections 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f495c067320 0x7f495c0697d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4970156480 0x7f4970142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497006bcc0 0x7f49700af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 --2- 172.21.15.26:0/2978739596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49700c7b30 0x7f49700b1ac0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 >> 172.21.15.26:0/2978739596 conn(0x7f497006d170 msgr2=0x7f49700c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 shutdown_connections 2023-10-09T11:47:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.702+0000 7f4977ad8700 1 -- 172.21.15.26:0/2978739596 wait complete. 2023-10-09T11:47:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-10-09T11:47:04.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:47:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.840+0000 7f712d07d700 1 Processor -- start 2023-10-09T11:47:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.840+0000 7f712d07d700 1 -- start start 2023-10-09T11:47:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f712d07d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7128159860 0x7f71280ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f712d07d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 0x7f71280cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f712d07d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280cf510 con 0x7f71280ccfa0 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f712d07d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280cc210 con 0x7f7128159860 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f712d07d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280ce900 con 0x7f71280cbd90 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f7126d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7128159860 0x7f71280ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f7126d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7128159860 0x7f71280ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34746/0 (socket says 172.21.15.26:34746) 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.841+0000 7f7126d9d700 1 -- 172.21.15.26:0/1851687323 learned_addr learned my addr 172.21.15.26:0/1851687323 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712659c700 1 --2- 172.21.15.26:0/1851687323 >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 0x7f71280cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7126d9d700 1 -- 172.21.15.26:0/1851687323 >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 msgr2=0x7f71280cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7126d9d700 1 --2- 172.21.15.26:0/1851687323 >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 0x7f71280cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7126d9d700 1 -- 172.21.15.26:0/1851687323 >> v1:172.21.15.67:6789/0 conn(0x7f71280ccfa0 legacy=0x7f71280cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7126d9d700 1 -- 172.21.15.26:0/1851687323 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280cebe0 con 0x7f7128159860 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712659c700 1 --2- 172.21.15.26:0/1851687323 >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 0x7f71280cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7126d9d700 1 --2- 172.21.15.26:0/1851687323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7128159860 0x7f71280ce220 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f7128064890 tx=0x7f7120009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d389213a51c3e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7125d9b700 1 -- 172.21.15.26:0/1851687323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000e070 con 0x7f7128159860 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7125d9b700 1 -- 172.21.15.26:0/1851687323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000ba90 con 0x7f7128159860 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f7125d9b700 1 -- 172.21.15.26:0/1851687323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200092e0 con 0x7f7128159860 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 -- 172.21.15.26:0/1851687323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7128159860 msgr2=0x7f71280ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 --2- 172.21.15.26:0/1851687323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7128159860 0x7f71280ce220 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f7128064890 tx=0x7f7120009840 comp rx=0 tx=0).stop 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 -- 172.21.15.26:0/1851687323 shutdown_connections 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 --2- 172.21.15.26:0/1851687323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7128159860 0x7f71280ce220 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 --2- 172.21.15.26:0/1851687323 >> v2:172.21.15.67:3300/0 conn(0x7f71280cbd90 0x7f71280cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.842+0000 7f712d07d700 1 -- 172.21.15.26:0/1851687323 >> 172.21.15.26:0/1851687323 conn(0x7f71280999b0 msgr2=0x7f7128070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.843+0000 7f712d07d700 1 -- 172.21.15.26:0/1851687323 shutdown_connections 2023-10-09T11:47:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.843+0000 7f712d07d700 1 -- 172.21.15.26:0/1851687323 wait complete. 2023-10-09T11:47:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 Processor -- start 2023-10-09T11:47:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 -- start start 2023-10-09T11:47:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 0x7f712806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 0x7f71280c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712815beb0 con 0x7f71280cbd90 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712815b2a0 con 0x7f71280ccfa0 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.844+0000 7f712d07d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712815b580 con 0x7f7128159860 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34758/0 (socket says 172.21.15.26:34758) 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 -- 172.21.15.26:0/2218474291 learned_addr learned my addr 172.21.15.26:0/2218474291 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712659c700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 0x7f712806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712759e700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 0x7f71280c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 -- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 msgr2=0x7f71280c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 0x7f71280c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 -- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 msgr2=0x7f712806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 0x7f712806ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 -- 172.21.15.26:0/2218474291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120009ae0 con 0x7f71280cbd90 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712659c700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 0x7f712806ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712759e700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 0x7f71280c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f7126d9d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f7120003000 tx=0x7f7120017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120012ac0 con 0x7f71280cbd90 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120012c20 con 0x7f71280cbd90 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712815b860 con 0x7f71280cbd90 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712001e430 con 0x7f71280cbd90 2023-10-09T11:47:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.845+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71281590e0 con 0x7f71280cbd90 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.846+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712804c3c0 con 0x7f71280cbd90 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.847+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f712001e800 con 0x7f71280cbd90 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.847+0000 7f711effd700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 0x7f71080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.847+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f71200866b0 con 0x7f71280cbd90 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.847+0000 7f712659c700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 0x7f71080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.848+0000 7f712659c700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 0x7f71080697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f711000ab90 tx=0x7f7110008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:04.852+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7120053530 con 0x7f71280cbd90 2023-10-09T11:47:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.046+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f71280ceec0 con 0x7f71280cbd90 2023-10-09T11:47:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.050+0000 7f711effd700 1 -- 172.21.15.26:0/2218474291 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7120056b50 con 0x7f71280cbd90 2023-10-09T11:47:05.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 msgr2=0x7f71080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 0x7f71080697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f711000ab90 tx=0x7f7110008040 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 msgr2=0x7f7128158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f7120003000 tx=0x7f7120017000 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 shutdown_connections 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f7108067320 0x7f71080697d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7128159860 0x7f71280c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71280cbd90 0x7f7128158ba0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 --2- 172.21.15.26:0/2218474291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71280ccfa0 0x7f712806ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 >> 172.21.15.26:0/2218474291 conn(0x7f71280999b0 msgr2=0x7f71280b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 shutdown_connections 2023-10-09T11:47:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.052+0000 7f712d07d700 1 -- 172.21.15.26:0/2218474291 wait complete. 2023-10-09T11:47:05.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-09T11:47:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.183+0000 7f4ddd7d8700 1 Processor -- start 2023-10-09T11:47:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.183+0000 7f4ddd7d8700 1 -- start start 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4dd815d440 0x7f4dd80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd806c6a0 0x7f4dd806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dd815d810 0x7f4dd815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd806d050 con 0x7f4dd815d810 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd815a750 con 0x7f4dd815d440 2023-10-09T11:47:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4ddd7d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8159e40 con 0x7f4dd806c6a0 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dd815d810 0x7f4dd815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dd815d810 0x7f4dd815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34772/0 (socket says 172.21.15.26:34772) 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 -- 172.21.15.26:0/556041769 learned_addr learned my addr 172.21.15.26:0/556041769 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd6ffd700 1 --2- 172.21.15.26:0/556041769 >> v2:172.21.15.67:3300/0 conn(0x7f4dd815d440 0x7f4dd80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd67fc700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd806c6a0 0x7f4dd806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 -- 172.21.15.26:0/556041769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd806c6a0 msgr2=0x7f4dd806cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd806c6a0 0x7f4dd806cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 -- 172.21.15.26:0/556041769 >> v2:172.21.15.67:3300/0 conn(0x7f4dd815d440 msgr2=0x7f4dd80aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/556041769 >> v2:172.21.15.67:3300/0 conn(0x7f4dd815d440 0x7f4dd80aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 -- 172.21.15.26:0/556041769 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd80af300 con 0x7f4dd815d810 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.184+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd815d810 0x7f4dd815dc90 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af670 tx=0x7f4dc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709cf9a6e1225b08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4dd5ffb700 1 -- 172.21.15.26:0/556041769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800e070 con 0x7f4dd815d810 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4dd5ffb700 1 -- 172.21.15.26:0/556041769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800ba50 con 0x7f4dd815d810 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4dd5ffb700 1 -- 172.21.15.26:0/556041769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80092e0 con 0x7f4dd815d810 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/556041769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd815d810 msgr2=0x7f4dd815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd815d810 0x7f4dd815dc90 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af670 tx=0x7f4dc8009840 comp rx=0 tx=0).stop 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/556041769 shutdown_connections 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/556041769 >> v2:172.21.15.67:3300/0 conn(0x7f4dd815d440 0x7f4dd80aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd815d810 0x7f4dd815dc90 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/556041769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd806c6a0 0x7f4dd806cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/556041769 >> 172.21.15.26:0/556041769 conn(0x7f4dd806f190 msgr2=0x7f4dd80ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/556041769 shutdown_connections 2023-10-09T11:47:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.185+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/556041769 wait complete. 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.186+0000 7f4ddd7d8700 1 Processor -- start 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.186+0000 7f4ddd7d8700 1 -- start start 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd815d440 0x7f4dd8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dd815d810 0x7f4dd814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153d00 con 0x7f4dd806c6a0 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153460 con 0x7f4dd815d810 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4ddd7d8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153740 con 0x7f4dd815d440 2023-10-09T11:47:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34784/0 (socket says 172.21.15.26:34784) 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/1778617215 learned_addr learned my addr 172.21.15.26:0/1778617215 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4dd67fc700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd815d440 0x7f4dd8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.187+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dd815d810 0x7f4dd814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd815d440 msgr2=0x7f4dd8152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd815d440 0x7f4dd8152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dd815d810 msgr2=0x7f4dd814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dd815d810 0x7f4dd814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/1778617215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8009ae0 con 0x7f4dd806c6a0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dd6ffd700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000d860 tx=0x7f4dd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00125f0 con 0x7f4dd806c6a0 2023-10-09T11:47:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0012750 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd8153a20 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0012b10 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.188+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd8153160 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.189+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd8156c10 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.189+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4dd001e460 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.190+0000 7f4dceffd700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 0x7f4db80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.190+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4dd0084ea0 con 0x7f4dd806c6a0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.190+0000 7f4dd67fc700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 0x7f4db80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:05.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.191+0000 7f4dd67fc700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 0x7f4db80697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8150630 tx=0x7f4dc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:05.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.194+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dd8156c10 con 0x7f4dd806c6a0 2023-10-09T11:47:05.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.471+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f4dd8156c10 con 0x7f4dd806c6a0 2023-10-09T11:47:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.701+0000 7f4dceffd700 1 -- 172.21.15.26:0/1778617215 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v566) v1 ==== 131+0+0 (secure 0 0 0) 0x7f4dd8156c10 con 0x7f4dd806c6a0 2023-10-09T11:47:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 msgr2=0x7f4db80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 0x7f4db80697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8150630 tx=0x7f4dc0008040 comp rx=0 tx=0).stop 2023-10-09T11:47:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 msgr2=0x7f4dd8155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000d860 tx=0x7f4dd0008040 comp rx=0 tx=0).stop 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 shutdown_connections 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dd815d810 0x7f4dd814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd806c6a0 0x7f4dd8155350 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4db8067320 0x7f4db80697d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 --2- 172.21.15.26:0/1778617215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4dd815d440 0x7f4dd8152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.703+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 >> 172.21.15.26:0/1778617215 conn(0x7f4dd806f190 msgr2=0x7f4dd80ac490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.704+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 shutdown_connections 2023-10-09T11:47:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:05.704+0000 7f4ddd7d8700 1 -- 172.21.15.26:0/1778617215 wait complete. 2023-10-09T11:47:05.720 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used ... ERROR 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-09T11:47:05.721 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T11:47:05.722 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T11:47:05.723 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner:Ran 12 tests in 674.282s 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-09T11:47:05.724 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T11:47:05.725 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T11:47:05.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T11:47:05.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T11:47:05.728 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T11:47:05.728 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-09T11:47:05.728 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:05.728 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:47:05.790 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f9f741743b1e429799550345463f124c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T11:47:05.792 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T11:47:05.801 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T11:47:05.843 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T11:47:05.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:05.843 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:47:05.862 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:47:05.862 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:47:05.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:05.862 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:47:05.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:05.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:47:06.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-09T11:47:06.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.112 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-10-09T11:47:06.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-10-09T11:47:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-10-09T11:47:06.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:06.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.199 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:47:06.217 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:47:06.218 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:47:06.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:47:06.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.299 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:47:06.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-09T11:47:06.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.468 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-09T11:47:06.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:06.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-09T11:47:06.553 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-09T11:47:06.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:06.555 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T11:47:06.564 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T11:47:06.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.685+0000 7f9e71e42700 1 Processor -- start 2023-10-09T11:47:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.685+0000 7f9e71e42700 1 -- start start 2023-10-09T11:47:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e71e42700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e6c1598b0 0x7f9e6c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e71e42700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e6c163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e71e42700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0ce9d0 con 0x7f9e6c159c80 2023-10-09T11:47:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e71e42700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0afc30 con 0x7f9e6c1598b0 2023-10-09T11:47:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e71e42700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0aff10 con 0x7f9e6c0af790 2023-10-09T11:47:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e6affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e6c159c80 0x7f9e6c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57580/0 (socket says 172.21.15.26:57580) 2023-10-09T11:47:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.686+0000 7f9e6affd700 1 -- 172.21.15.26:0/2848316660 learned_addr learned my addr 172.21.15.26:0/2848316660 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6bfff700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e6c163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/2848316660 >> v2:172.21.15.67:3300/0 conn(0x7f9e6c1598b0 0x7f9e6c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739169699 0 0) 0x7f9e6c0ce9d0 con 0x7f9e6c159c80 2023-10-09T11:47:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e54003570 con 0x7f9e6c159c80 2023-10-09T11:47:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 795396192 0 0) 0x7f9e54003570 con 0x7f9e6c159c80 2023-10-09T11:47:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 msgr2=0x7f9e6c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e6c163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 >> v2:172.21.15.67:3300/0 conn(0x7f9e6c1598b0 msgr2=0x7f9e6c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 --2- 172.21.15.26:0/2848316660 >> v2:172.21.15.67:3300/0 conn(0x7f9e6c1598b0 0x7f9e6c0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0ce380 con 0x7f9e6c159c80 2023-10-09T11:47:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7f9e60001470 con 0x7f9e6c159c80 2023-10-09T11:47:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 >> v1:172.21.15.26:6789/0 conn(0x7f9e6c159c80 legacy=0x7f9e6c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e54003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e54003fe0 0x7f9e54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e54004d50 0x7f9e540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0afc30 con 0x7f9e54003fe0 2023-10-09T11:47:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0aff10 con 0x7f9e54004d50 2023-10-09T11:47:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5400ba90 con 0x7f9e6c0af790 2023-10-09T11:47:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/2848316660 >> v2:172.21.15.67:3300/0 conn(0x7f9e6c1598b0 0x7f9e6c0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6affd700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e54003fe0 0x7f9e54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6bfff700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e54004d50 0x7f9e540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e54003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6affd700 1 -- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 msgr2=0x7f9e54003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:06.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6affd700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e6c0af790 0x7f9e54003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6affd700 1 -- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e54004d50 msgr2=0x7f9e540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:06.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.687+0000 7f9e6affd700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e54004d50 0x7f9e540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6affd700 1 -- 172.21.15.26:0/2848316660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54003570 con 0x7f9e54003fe0 2023-10-09T11:47:06.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6affd700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e54003fe0 0x7f9e54004810 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000c3c0 tx=0x7f9e60001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed5119b919c69f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:06.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000cc30 con 0x7f9e54003fe0 2023-10-09T11:47:06.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000cdb0 con 0x7f9e54003fe0 2023-10-09T11:47:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6a7fc700 1 -- 172.21.15.26:0/2848316660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60005b70 con 0x7f9e54003fe0 2023-10-09T11:47:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 -- 172.21.15.26:0/2848316660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e54003fe0 msgr2=0x7f9e54004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 --2- 172.21.15.26:0/2848316660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e54003fe0 0x7f9e54004810 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000c3c0 tx=0x7f9e60001e90 comp rx=0 tx=0).stop 2023-10-09T11:47:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e6bfff700 1 -- 172.21.15.26:0/2848316660 reap_dead start 2023-10-09T11:47:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 -- 172.21.15.26:0/2848316660 shutdown_connections 2023-10-09T11:47:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 -- 172.21.15.26:0/2848316660 >> 172.21.15.26:0/2848316660 conn(0x7f9e6c070e30 msgr2=0x7f9e6c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 -- 172.21.15.26:0/2848316660 shutdown_connections 2023-10-09T11:47:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.688+0000 7f9e71e42700 1 -- 172.21.15.26:0/2848316660 wait complete. 2023-10-09T11:47:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.690+0000 7f9e71e42700 1 Processor -- start 2023-10-09T11:47:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.690+0000 7f9e71e42700 1 -- start start 2023-10-09T11:47:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.690+0000 7f9e71e42700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e54003fe0 0x7f9e6c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.690+0000 7f9e71e42700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e6c0b5500 0x7f9e6c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.690+0000 7f9e71e42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e71e42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c158e70 con 0x7f9e6c1695d0 2023-10-09T11:47:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e71e42700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c159150 con 0x7f9e6c0b5500 2023-10-09T11:47:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e71e42700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c155b60 con 0x7f9e54003fe0 2023-10-09T11:47:06.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34798/0 (socket says 172.21.15.26:34798) 2023-10-09T11:47:06.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 -- 172.21.15.26:0/127021463 learned_addr learned my addr 172.21.15.26:0/127021463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:06.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e54003fe0 0x7f9e6c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 -- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e54003fe0 msgr2=0x7f9e6c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e54003fe0 0x7f9e6c158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 -- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e6c0b5500 msgr2=0x7f9e6c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6affd700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e6c0b5500 0x7f9e6c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e6c0b5500 0x7f9e6c153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 -- 172.21.15.26:0/127021463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c155e40 con 0x7f9e6c1695d0 2023-10-09T11:47:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e6bfff700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9e640094d0 tx=0x7f9e6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400e040 con 0x7f9e6c1695d0 2023-10-09T11:47:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6400f040 con 0x7f9e6c1695d0 2023-10-09T11:47:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400fe20 con 0x7f9e6c1695d0 2023-10-09T11:47:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c156120 con 0x7f9e6c1695d0 2023-10-09T11:47:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.691+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c153670 con 0x7f9e6c1695d0 2023-10-09T11:47:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.692+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c04c3c0 con 0x7f9e6c1695d0 2023-10-09T11:47:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.693+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9e64015640 con 0x7f9e6c1695d0 2023-10-09T11:47:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.693+0000 7f9e537fe700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 0x7f9e580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.693+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9e640853b0 con 0x7f9e6c1695d0 2023-10-09T11:47:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.693+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 0x7f9e580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.694+0000 7f9e6b7fe700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 0x7f9e580697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006f00 tx=0x7f9e5c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:06.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.697+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e64052230 con 0x7f9e6c1695d0 2023-10-09T11:47:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.893+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e6c0ce660 con 0x7f9e6c1695d0 2023-10-09T11:47:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.894+0000 7f9e537fe700 1 -- 172.21.15.26:0/127021463 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+12225 (secure 0 0 0) 0x7f9e64055850 con 0x7f9e6c1695d0 2023-10-09T11:47:06.895 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:06.895 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":203,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:47:04.698051+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/2946278291":"2023-10-10T11:47:01.686404+0000","172.21.15.67:6835/2946278291":"2023-10-10T11:47:01.686404+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 msgr2=0x7f9e580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 0x7f9e580697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006f00 tx=0x7f9e5c008040 comp rx=0 tx=0).stop 2023-10-09T11:47:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 msgr2=0x7f9e6c0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9e640094d0 tx=0x7f9e6400b040 comp rx=0 tx=0).stop 2023-10-09T11:47:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 shutdown_connections 2023-10-09T11:47:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6c1695d0 0x7f9e6c0c5ce0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f9e58067320 0x7f9e580697d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9e54003fe0 0x7f9e6c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 --2- 172.21.15.26:0/127021463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e6c0b5500 0x7f9e6c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 >> 172.21.15.26:0/127021463 conn(0x7f9e6c070e30 msgr2=0x7f9e6c1550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 shutdown_connections 2023-10-09T11:47:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:06.896+0000 7f9e71e42700 1 -- 172.21.15.26:0/127021463 wait complete. 2023-10-09T11:47:06.911 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T11:47:06.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.029+0000 7fab53268700 1 Processor -- start 2023-10-09T11:47:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 -- start start 2023-10-09T11:47:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab4c0cf200 0x7fab4c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c15a280 con 0x7fab4c0b07d0 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c06e180 con 0x7fab4c0cf200 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.030+0000 7fab53268700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c06d850 con 0x7fab4c0b0ba0 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab4c0cf200 0x7fab4c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab4c0cf200 0x7fab4c0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34800/0 (socket says 172.21.15.26:34800) 2023-10-09T11:47:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 -- 172.21.15.26:0/2112203015 learned_addr learned my addr 172.21.15.26:0/2112203015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab51805700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 -- 172.21.15.26:0/2112203015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 msgr2=0x7fab4c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 -- 172.21.15.26:0/2112203015 >> v1:172.21.15.67:6789/0 conn(0x7fab4c0b07d0 legacy=0x7fab4c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 -- 172.21.15.26:0/2112203015 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c06db30 con 0x7fab4c0cf200 2023-10-09T11:47:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab50803700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0cf200 0x7fab4c0c42c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fab400099b0 tx=0x7fab40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b2211f04722cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab4bfff700 1 -- 172.21.15.26:0/2112203015 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40009ea0 con 0x7fab4c0cf200 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab4bfff700 1 -- 172.21.15.26:0/2112203015 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000b860 con 0x7fab4c0cf200 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.031+0000 7fab4bfff700 1 -- 172.21.15.26:0/2112203015 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000bc00 con 0x7fab4c0cf200 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 -- 172.21.15.26:0/2112203015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0cf200 msgr2=0x7fab4c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0cf200 0x7fab4c0c42c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fab400099b0 tx=0x7fab40009250 comp rx=0 tx=0).stop 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 -- 172.21.15.26:0/2112203015 shutdown_connections 2023-10-09T11:47:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 --2- 172.21.15.26:0/2112203015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0cf200 0x7fab4c0c42c0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 -- 172.21.15.26:0/2112203015 >> 172.21.15.26:0/2112203015 conn(0x7fab4c06ce80 msgr2=0x7fab4c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 -- 172.21.15.26:0/2112203015 shutdown_connections 2023-10-09T11:47:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.032+0000 7fab53268700 1 -- 172.21.15.26:0/2112203015 wait complete. 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.033+0000 7fab53268700 1 Processor -- start 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.033+0000 7fab53268700 1 -- start start 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab4c0cf200 0x7fab4c0ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c5ef0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c155d60 con 0x7fab4c0cf200 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab53268700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c55c0 con 0x7fab4c0b0ba0 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab51004700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab51004700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34806/0 (socket says 172.21.15.26:34806) 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab51004700 1 -- 172.21.15.26:0/384796777 learned_addr learned my addr 172.21.15.26:0/384796777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab51805700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab4c0cf200 0x7fab4c0ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.034+0000 7fab50803700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 -- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 msgr2=0x7fab4c0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c0cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 -- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab4c0cf200 msgr2=0x7fab4c0ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab4c0cf200 0x7fab4c0ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 -- 172.21.15.26:0/384796777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400094f0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab51004700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fab4400cd30 tx=0x7fab44001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400ce30 con 0x7fab4c0b07d0 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400aac0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0c58a0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400ae80 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.035+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c155030 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.036+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c04c3c0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.036+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fab44012630 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.037+0000 7fab497fa700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 0x7fab380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.037+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fab44084fe0 con 0x7fab4c0b07d0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.037+0000 7fab50803700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 0x7fab380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.037+0000 7fab50803700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 0x7fab380697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab400099b0 tx=0x7fab40017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.041+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab44051f70 con 0x7fab4c0b07d0 2023-10-09T11:47:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.229+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab4c0c5730 con 0x7fab38067320 2023-10-09T11:47:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.232+0000 7fab497fa700 1 -- 172.21.15.26:0/384796777 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50379 (secure 0 0 0) 0x7fab4c0c5730 con 0x7fab38067320 2023-10-09T11:47:07.234 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 msgr2=0x7fab380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 0x7fab380697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab400099b0 tx=0x7fab40017000 comp rx=0 tx=0).stop 2023-10-09T11:47:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 msgr2=0x7fab4c1444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fab4400cd30 tx=0x7fab44001b40 comp rx=0 tx=0).stop 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 shutdown_connections 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab4c0cf200 0x7fab4c0ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab4c0b07d0 0x7fab4c1444f0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fab38067320 0x7fab380697d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 --2- 172.21.15.26:0/384796777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab4c0b0ba0 0x7fab4c0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 >> 172.21.15.26:0/384796777 conn(0x7fab4c06ce80 msgr2=0x7fab4c0c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 shutdown_connections 2023-10-09T11:47:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.234+0000 7fab53268700 1 -- 172.21.15.26:0/384796777 wait complete. 2023-10-09T11:47:07.237 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:47:07.247 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2023-10-09T11:47:05.277394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2444476,"kb_used_data":21116,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530244,"statfs":{"total":773094113280,"available":770590969856,"internally_reserved":0,"allocated":21622784,"data_stored":10372341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001381"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T11:45:05.587146+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:45:05.587146+0000","last_peered":"2023-10-09T11:45:05.587146+0000","last_clean":"2023-10-09T11:45:05.587146+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:45:05.587146+0000","last_undegraded":"2023-10-09T11:45:05.587146+0000","last_fullsized":"2023-10-09T11:45:05.587146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304452,"kb_used_data":3068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067388,"statfs":{"total":96636764160,"available":96325005312,"internally_reserved":0,"allocated":3141632,"data_stored":1734780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":2.6160000000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":5.9450000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.256},"last":0.441}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.71999999999999997},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":8.8940000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.82499999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60299999999999998,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.67600000000000005,"5min":0.76900000000000002,"15min":1.3},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":1.163},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":1.369},"last":0.63900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71399999999999997,"5min":0.85899999999999999,"15min":0.999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542291,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1143870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.54200000000000004,"5min":0.32800000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.877,"15min":0.95599999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.32900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.153},"last":0.71199999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.92800000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.499,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.1060000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":2.3559999999999999},"last":0.753},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91600000000000004,"5min":2.895,"15min":2.895},"last":0.64800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.29199999999999998},"max":{"1min":1,"5min":1.05,"15min":1.05},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83999999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.96699999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.032,"15min":1.032},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307988,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063852,"statfs":{"total":96636764160,"available":96321384448,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.59099999999999997,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.57299999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.215},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":11.06},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.67700000000000005},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.438},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.22900000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":2.1960000000000002,"15min":11.935},"last":0.377}]},{"osd":3,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39200000000000002,"15min":0.57899999999999996},"min":{"1min":0.32400000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":11.087},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.436,"15min":0.499},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":5.0060000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.58899999999999997,"5min":0.41599999999999998,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.373},"max":{"1min":1.006,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.627,"15min":0.80300000000000005},"min":{"1min":0.51100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":10.939},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":4.9370000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.65100000000000002,"15min":0.83199999999999996},"min":{"1min":0.54600000000000004,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.871,"5min":1.0089999999999999,"15min":10.975},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.85499999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":0.98099999999999998,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":1.72,"15min":1.72},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67300000000000004,"15min":0.85699999999999998},"min":{"1min":0.61599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":11.000999999999999},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308556,"kb_used_data":3076,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063284,"statfs":{"total":96636764160,"available":96320802816,"internally_reserved":0,"allocated":3149824,"data_stored":1740430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.443},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.189},"max":{"1min":0.55600000000000005,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.25},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":3.8180000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.41899999999999998,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.625,"15min":11.031000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.38200000000000001,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":12.589},"last":0.28000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":1.6739999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.42099999999999999},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.77500000000000002,"15min":1.502},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":1.095,"15min":1.446},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":1.278},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.54200000000000004,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":0.93500000000000005,"5min":2.286,"15min":2.286},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.628,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":1.639},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.97899999999999998,"5min":1.077,"15min":1.3149999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.032,"15min":1.5629999999999999},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.82199999999999995,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.33600000000000002,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.749,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42299999999999999},"min":{"1min":0.34399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.873},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.33400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.44500000000000001,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.23799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.246},"last":0.377},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.432},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"max":{"1min":0.88600000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":1.599,"15min":1.599},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":2.1579999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66200000000000003,"15min":0.61899999999999999},"min":{"1min":0.55500000000000005,"5min":0.42899999999999999,"15min":0.379},"max":{"1min":1.008,"5min":1.181,"15min":1.286},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.51300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.56499999999999995,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.55000000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.98099999999999998,"5min":1.018,"15min":1.3149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67100000000000004,"15min":0.63500000000000001},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":1.359,"15min":1.359},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1150082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.312,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.67500000000000004},"last":0.311},{"interface":"front","average":{"1min":0.436,"5min":0.375,"15min":0.34699999999999998},"min":{"1min":0.311,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.39800000000000002,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.78100000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.441,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":0.63900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.25600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.54600000000000004,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.98299999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41799999999999998,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.95999999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.96399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.52900000000000003,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.93999999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63300000000000001,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.873},"last":0.53600000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542292,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303876,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067964,"statfs":{"total":96636764160,"available":96325595136,"internally_reserved":0,"allocated":2551808,"data_stored":1147133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.84899999999999998,"15min":1.056},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.63800000000000001},"min":{"1min":0.52500000000000002,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":3.7400000000000002},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.436,"15min":0.372},"max":{"1min":0.83299999999999996,"5min":0.84799999999999998,"15min":3.8519999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83699999999999997,"15min":1.234},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.91800000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.33300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75600000000000001,"5min":0.878,"15min":1.0229999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.878,"15min":1.282},"last":0.48399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.31},"max":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.95499999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.60199999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542292,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303868,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067972,"statfs":{"total":96636764160,"available":96325603328,"internally_reserved":0,"allocated":2543616,"data_stored":1143906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.307},"max":{"1min":0.81000000000000005,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.314},"max":{"1min":0.85099999999999998,"5min":5.0970000000000004,"15min":5.2519999999999998},"last":0.81499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":0.80600000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.48599999999999999,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.82599999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.48999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.64900000000000002,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.78500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.745}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.628},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:47:07.249 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:07.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.367+0000 7f0915ee5700 1 Processor -- start 2023-10-09T11:47:07.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.367+0000 7f0915ee5700 1 -- start start 2023-10-09T11:47:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0915ee5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f091006f3a0 0x7f091014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0915ee5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091006a490 con 0x7f091006e0a0 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0915ee5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100c7230 con 0x7f091006e470 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0915ee5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c7490 con 0x7f091006f3a0 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f091006f3a0 0x7f091014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0914ee3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f091006e0a0 0x7f09100c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57582/0 (socket says 172.21.15.26:57582) 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f0914ee3700 1 -- 172.21.15.26:0/1939601768 learned_addr learned my addr 172.21.15.26:0/1939601768 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090ffff700 1 -- 172.21.15.26:0/1939601768 >> v1:172.21.15.67:6789/0 conn(0x7f091006e470 legacy=0x7f091006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:07.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090ffff700 1 -- 172.21.15.26:0/1939601768 >> v1:172.21.15.26:6789/0 conn(0x7f091006e0a0 legacy=0x7f09100c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090ffff700 1 -- 172.21.15.26:0/1939601768 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c7770 con 0x7f091006f3a0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090f7fe700 1 -- 172.21.15.26:0/1939601768 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957717960 0 0) 0x7f091006a490 con 0x7f091006e0a0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.368+0000 7f090ffff700 1 --2- 172.21.15.26:0/1939601768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f091014fc70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f090400bb70 tx=0x7f090400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c80d9e54cf260f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f090f7fe700 1 -- 172.21.15.26:0/1939601768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904005c10 con 0x7f091006f3a0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f090f7fe700 1 -- 172.21.15.26:0/1939601768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904005d70 con 0x7f091006f3a0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f090f7fe700 1 -- 172.21.15.26:0/1939601768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400dba0 con 0x7f091006f3a0 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 -- 172.21.15.26:0/1939601768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 msgr2=0x7f091014fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1939601768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f091014fc70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f090400bb70 tx=0x7f090400b3e0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 -- 172.21.15.26:0/1939601768 shutdown_connections 2023-10-09T11:47:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1939601768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f091014fc70 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 -- 172.21.15.26:0/1939601768 >> 172.21.15.26:0/1939601768 conn(0x7f091006d170 msgr2=0x7f09100cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 -- 172.21.15.26:0/1939601768 shutdown_connections 2023-10-09T11:47:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.369+0000 7f0915ee5700 1 -- 172.21.15.26:0/1939601768 wait complete. 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.370+0000 7f0915ee5700 1 Processor -- start 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.370+0000 7f0915ee5700 1 -- start start 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f091006e0a0 0x7f0910165f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 0x7f09100c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b17e0 con 0x7f091006f3a0 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b0bd0 con 0x7f091006e470 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0915ee5700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b0eb0 con 0x7f091006e0a0 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f09156e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f09156e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34832/0 (socket says 172.21.15.26:34832) 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f09156e4700 1 -- 172.21.15.26:0/1182101357 learned_addr learned my addr 172.21.15.26:0/1182101357 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f090ffff700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 0x7f09100c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.371+0000 7f0914ee3700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f091006e0a0 0x7f0910165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 -- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f091006e0a0 msgr2=0x7f0910165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f091006e0a0 0x7f0910165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 -- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 msgr2=0x7f09100c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 0x7f09100c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 -- 172.21.15.26:0/1182101357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090400b660 con 0x7f091006f3a0 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f090ffff700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 0x7f09100c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f09156e4700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f090800bbb0 tx=0x7f0908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080092e0 con 0x7f091006f3a0 2023-10-09T11:47:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090800c6f0 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100b1190 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800ca90 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.372+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09100c59a0 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.373+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100b1990 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.373+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0908012070 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.374+0000 7f090cff9700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 0x7f08fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.374+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0908084630 con 0x7f091006f3a0 2023-10-09T11:47:07.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.374+0000 7f0914ee3700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 0x7f08fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.375+0000 7f0914ee3700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 0x7f08fc0697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0900007fd0 tx=0x7f0900007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.378+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09080515c0 con 0x7f091006f3a0 2023-10-09T11:47:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.571+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f091004c3c0 con 0x7f08fc067320 2023-10-09T11:47:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.574+0000 7f090cff9700 1 -- 172.21.15.26:0/1182101357 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50388 (secure 0 0 0) 0x7f091004c3c0 con 0x7f08fc067320 2023-10-09T11:47:07.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 msgr2=0x7f08fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 0x7f08fc0697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0900007fd0 tx=0x7f0900007d30 comp rx=0 tx=0).stop 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 msgr2=0x7f09100aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f090800bbb0 tx=0x7f0908009840 comp rx=0 tx=0).stop 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 shutdown_connections 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f091006f3a0 0x7f09100aeed0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f08fc067320 0x7f08fc0697d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f091006e0a0 0x7f0910165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 --2- 172.21.15.26:0/1182101357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f091006e470 0x7f09100c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 >> 172.21.15.26:0/1182101357 conn(0x7f091006d170 msgr2=0x7f09100c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 shutdown_connections 2023-10-09T11:47:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.575+0000 7f0915ee5700 1 -- 172.21.15.26:0/1182101357 wait complete. 2023-10-09T11:47:07.579 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:47:07.588 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2023-10-09T11:47:07.277765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2444588,"kb_used_data":21228,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530132,"statfs":{"total":773094113280,"available":770590855168,"internally_reserved":0,"allocated":21737472,"data_stored":10425727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001278"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":311,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-09T11:47:03.706314+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:47:03.706314+0000","last_peered":"2023-10-09T11:47:03.706314+0000","last_clean":"2023-10-09T11:47:03.706314+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:47:03.706314+0000","last_undegraded":"2023-10-09T11:47:03.706314+0000","last_fullsized":"2023-10-09T11:47:03.706314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542292,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304488,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067352,"statfs":{"total":96636764160,"available":96324968448,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":2.6160000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":5.9450000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.256},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.71999999999999997},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":8.8940000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.82499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60299999999999998,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.67600000000000005,"5min":0.76900000000000002,"15min":1.3},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":1.369},"last":0.53700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71399999999999997,"5min":0.85899999999999999,"15min":0.999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.495}]}]},{"osd":6,"up_from":14,"seq":60129542292,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.54200000000000004,"5min":0.32800000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.877,"15min":0.95599999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.32900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.153},"last":0.72999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.92800000000000005},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.499,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.1060000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":2.3559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91600000000000004,"5min":2.895,"15min":2.895},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.29199999999999998},"max":{"1min":1,"5min":1.05,"15min":1.05},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83999999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.96699999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.032,"15min":1.032},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.36799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307988,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063852,"statfs":{"total":96636764160,"available":96321384448,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.59099999999999997,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.57299999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.215},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":11.06},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.67700000000000005},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.438},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.22900000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":2.1960000000000002,"15min":11.935},"last":0.377}]},{"osd":3,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39200000000000002,"15min":0.57899999999999996},"min":{"1min":0.32400000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":11.087},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.436,"15min":0.499},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":5.0060000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.58899999999999997,"5min":0.41599999999999998,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.373},"max":{"1min":1.006,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.627,"15min":0.80300000000000005},"min":{"1min":0.51100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":10.939},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":4.9370000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.65100000000000002,"15min":0.83199999999999996},"min":{"1min":0.54600000000000004,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.871,"5min":1.0089999999999999,"15min":10.975},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.85499999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":0.98099999999999998,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":1.72,"15min":1.72},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67300000000000004,"15min":0.85699999999999998},"min":{"1min":0.61599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":11.000999999999999},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308556,"kb_used_data":3076,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063284,"statfs":{"total":96636764160,"available":96320802816,"internally_reserved":0,"allocated":3149824,"data_stored":1740430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.443},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.189},"max":{"1min":0.55600000000000005,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.25},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":3.8180000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.41899999999999998,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.625,"15min":11.031000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.38200000000000001,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":12.589},"last":0.28000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":1.6739999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.42099999999999999},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.77500000000000002,"15min":1.502},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":1.095,"15min":1.446},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":1.278},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.54200000000000004,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":0.93500000000000005,"5min":2.286,"15min":2.286},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.628,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":1.639},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.97899999999999998,"5min":1.077,"15min":1.3149999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.032,"15min":1.5629999999999999},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.82199999999999995,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.33600000000000002,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.749,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42299999999999999},"min":{"1min":0.34399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.873},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.33400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.44500000000000001,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.23799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.246},"last":0.377},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.432},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"max":{"1min":0.88600000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":1.599,"15min":1.599},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":2.1579999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66200000000000003,"15min":0.61899999999999999},"min":{"1min":0.55500000000000005,"5min":0.42899999999999999,"15min":0.379},"max":{"1min":1.008,"5min":1.181,"15min":1.286},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.51300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.56499999999999995,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.55000000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.98099999999999998,"5min":1.018,"15min":1.3149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67100000000000004,"15min":0.63500000000000001},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":1.359,"15min":1.359},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1150082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.312,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.67500000000000004},"last":0.311},{"interface":"front","average":{"1min":0.436,"5min":0.375,"15min":0.34699999999999998},"min":{"1min":0.311,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.39800000000000002,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.78100000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.441,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":0.63900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.25600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.54600000000000004,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.98299999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41799999999999998,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.95999999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.96399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.52900000000000003,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.93999999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63300000000000001,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.873},"last":0.53600000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542293,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303888,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067952,"statfs":{"total":96636764160,"available":96325582848,"internally_reserved":0,"allocated":2564096,"data_stored":1153289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.84899999999999998,"15min":1.056},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.63800000000000001},"min":{"1min":0.52500000000000002,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":3.7400000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.436,"15min":0.372},"max":{"1min":0.83299999999999996,"5min":0.84799999999999998,"15min":3.8519999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83699999999999997,"15min":1.234},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.91800000000000004},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.33300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75600000000000001,"5min":0.878,"15min":1.0229999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.878,"15min":1.282},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.31},"max":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.95499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.63800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542293,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.307},"max":{"1min":0.81000000000000005,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.314},"max":{"1min":0.85099999999999998,"5min":5.0970000000000004,"15min":5.2519999999999998},"last":0.621}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":0.80600000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.48599999999999999,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.82599999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.45800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.48999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.64900000000000002,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.376},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.495},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.78500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:47:07.591 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T11:47:07.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:07.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.710+0000 7fd450887700 1 Processor -- start 2023-10-09T11:47:07.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.710+0000 7fd450887700 1 -- start start 2023-10-09T11:47:07.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd450887700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0cb5a0 0x7fd44c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd450887700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd44c0cde50 0x7fd44c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd450887700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c15ae40 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd450887700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c0d13f0 con 0x7fd44c0cde50 2023-10-09T11:47:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd450887700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c15ab60 con 0x7fd44c0cb5a0 2023-10-09T11:47:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd44c0cde50 0x7fd44c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd44c0cde50 0x7fd44c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34844/0 (socket says 172.21.15.26:34844) 2023-10-09T11:47:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 -- 172.21.15.26:0/1971627028 learned_addr learned my addr 172.21.15.26:0/1971627028 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44a59c700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0cb5a0 0x7fd44c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 -- 172.21.15.26:0/1971627028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0cb5a0 msgr2=0x7fd44c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0cb5a0 0x7fd44c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 -- 172.21.15.26:0/1971627028 >> v1:172.21.15.67:6789/0 conn(0x7fd44c0cd9e0 legacy=0x7fd44c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 -- 172.21.15.26:0/1971627028 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0ccf00 con 0x7fd44c0cde50 2023-10-09T11:47:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.711+0000 7fd44ad9d700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cde50 0x7fd44c156e90 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fd444009f20 tx=0x7fd444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2d6fda59607b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd44959a700 1 -- 172.21.15.26:0/1971627028 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400e070 con 0x7fd44c0cde50 2023-10-09T11:47:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd44959a700 1 -- 172.21.15.26:0/1971627028 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400b9d0 con 0x7fd44c0cde50 2023-10-09T11:47:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd44959a700 1 -- 172.21.15.26:0/1971627028 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440092e0 con 0x7fd44c0cde50 2023-10-09T11:47:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 -- 172.21.15.26:0/1971627028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cde50 msgr2=0x7fd44c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cde50 0x7fd44c156e90 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fd444009f20 tx=0x7fd444009840 comp rx=0 tx=0).stop 2023-10-09T11:47:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 -- 172.21.15.26:0/1971627028 shutdown_connections 2023-10-09T11:47:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cde50 0x7fd44c156e90 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 --2- 172.21.15.26:0/1971627028 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0cb5a0 0x7fd44c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 -- 172.21.15.26:0/1971627028 >> 172.21.15.26:0/1971627028 conn(0x7fd44c070e30 msgr2=0x7fd44c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 -- 172.21.15.26:0/1971627028 shutdown_connections 2023-10-09T11:47:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.712+0000 7fd450887700 1 -- 172.21.15.26:0/1971627028 wait complete. 2023-10-09T11:47:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.713+0000 7fd450887700 1 Processor -- start 2023-10-09T11:47:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.713+0000 7fd450887700 1 -- start start 2023-10-09T11:47:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0cb5a0 0x7fd44c169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0ca4a0 0x7fd44c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c16a290 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0c54b0 con 0x7fd44c0cb5a0 2023-10-09T11:47:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd450887700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0c6310 con 0x7fd44c0ca4a0 2023-10-09T11:47:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34858/0 (socket says 172.21.15.26:34858) 2023-10-09T11:47:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 -- 172.21.15.26:0/2543313372 learned_addr learned my addr 172.21.15.26:0/2543313372 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd44ad9d700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0ca4a0 0x7fd44c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd44a59c700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0cb5a0 0x7fd44c169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 -- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0ca4a0 msgr2=0x7fd44c0c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0ca4a0 0x7fd44c0c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 -- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0cb5a0 msgr2=0x7fd44c169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0cb5a0 0x7fd44c169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.714+0000 7fd449d9b700 1 -- 172.21.15.26:0/2543313372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009ae0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd449d9b700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c7c0 tx=0x7fd440007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011590 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4400116f0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c149700 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011ab0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.715+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c0c59e0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.716+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c04c3c0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.716+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd44001b3b0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.717+0000 7fd43a7fc700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.717+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd440083e20 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.717+0000 7fd44a59c700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.717+0000 7fd44a59c700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 0x7fd42c0697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009db0 tx=0x7fd43c0091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.721+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd440050db0 con 0x7fd44c0cd9e0 2023-10-09T11:47:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.913+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd44c0c6450 con 0x7fd42c067320 2023-10-09T11:47:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.916+0000 7fd43a7fc700 1 -- 172.21.15.26:0/2543313372 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50388 (secure 0 0 0) 0x7fd44c0c6450 con 0x7fd42c067320 2023-10-09T11:47:07.918 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 msgr2=0x7fd42c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 0x7fd42c0697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009db0 tx=0x7fd43c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 msgr2=0x7fd44c1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c7c0 tx=0x7fd440007f40 comp rx=0 tx=0).stop 2023-10-09T11:47:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 shutdown_connections 2023-10-09T11:47:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd44c0ca4a0 0x7fd44c0c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0cb5a0 0x7fd44c169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 --2- 172.21.15.26:0/2543313372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c0cd9e0 0x7fd44c1491c0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 >> 172.21.15.26:0/2543313372 conn(0x7fd44c070e30 msgr2=0x7fd44c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 shutdown_connections 2023-10-09T11:47:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:07.918+0000 7fd450887700 1 -- 172.21.15.26:0/2543313372 wait complete. 2023-10-09T11:47:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:47:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2023-10-09T11:47:07.277765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2444588,"kb_used_data":21228,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752530132,"statfs":{"total":773094113280,"available":770590855168,"internally_reserved":0,"allocated":21737472,"data_stored":10425727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001278"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":311,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-09T11:47:03.706314+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:47:03.706314+0000","last_peered":"2023-10-09T11:47:03.706314+0000","last_clean":"2023-10-09T11:47:03.706314+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:47:03.706314+0000","last_undegraded":"2023-10-09T11:47:03.706314+0000","last_fullsized":"2023-10-09T11:47:03.706314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542292,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304488,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067352,"statfs":{"total":96636764160,"available":96324968448,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":2.6160000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":5.9450000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.256},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.71999999999999997},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":8.8940000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.82499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60299999999999998,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.67600000000000005,"5min":0.76900000000000002,"15min":1.3},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":1.369},"last":0.53700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71399999999999997,"5min":0.85899999999999999,"15min":0.999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.495}]}]},{"osd":6,"up_from":14,"seq":60129542292,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.54200000000000004,"5min":0.32800000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.877,"15min":0.95599999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.32900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.153},"last":0.72999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.92800000000000005},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.499,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.1060000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":2.3559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91600000000000004,"5min":2.895,"15min":2.895},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.29199999999999998},"max":{"1min":1,"5min":1.05,"15min":1.05},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83999999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.96699999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.032,"15min":1.032},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.36799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307988,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063852,"statfs":{"total":96636764160,"available":96321384448,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.59099999999999997,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.57299999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.215},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":11.06},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.67700000000000005},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.438},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.22900000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":2.1960000000000002,"15min":11.935},"last":0.377}]},{"osd":3,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39200000000000002,"15min":0.57899999999999996},"min":{"1min":0.32400000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":11.087},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.436,"15min":0.499},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":5.0060000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.58899999999999997,"5min":0.41599999999999998,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.373},"max":{"1min":1.006,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.627,"15min":0.80300000000000005},"min":{"1min":0.51100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":10.939},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":4.9370000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.65100000000000002,"15min":0.83199999999999996},"min":{"1min":0.54600000000000004,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.871,"5min":1.0089999999999999,"15min":10.975},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.85499999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":0.98099999999999998,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":1.72,"15min":1.72},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67300000000000004,"15min":0.85699999999999998},"min":{"1min":0.61599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":11.000999999999999},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308556,"kb_used_data":3076,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063284,"statfs":{"total":96636764160,"available":96320802816,"internally_reserved":0,"allocated":3149824,"data_stored":1740430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.443},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.189},"max":{"1min":0.55600000000000005,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.25},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":3.8180000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.41899999999999998,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.625,"15min":11.031000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.38200000000000001,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":12.589},"last":0.28000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":1.6739999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.42099999999999999},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.77500000000000002,"15min":1.502},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":1.095,"15min":1.446},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":1.278},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.54200000000000004,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":0.93500000000000005,"5min":2.286,"15min":2.286},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.628,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":1.639},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.97899999999999998,"5min":1.077,"15min":1.3149999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.032,"15min":1.5629999999999999},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.82199999999999995,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.313},{"interface":"front","average":{"1min":0.499,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.33600000000000002,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.749,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42299999999999999},"min":{"1min":0.34399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.873},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.33400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.44500000000000001,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.23799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.246},"last":0.377},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.432},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"max":{"1min":0.88600000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":1.599,"15min":1.599},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":2.1579999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66200000000000003,"15min":0.61899999999999999},"min":{"1min":0.55500000000000005,"5min":0.42899999999999999,"15min":0.379},"max":{"1min":1.008,"5min":1.181,"15min":1.286},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.51300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.56499999999999995,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.55000000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.98099999999999998,"5min":1.018,"15min":1.3149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67100000000000004,"15min":0.63500000000000001},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":1.359,"15min":1.359},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1150082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.312,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.67500000000000004},"last":0.311},{"interface":"front","average":{"1min":0.436,"5min":0.375,"15min":0.34699999999999998},"min":{"1min":0.311,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41599999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.39800000000000002,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.78100000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.441,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":0.63900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.25600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.54600000000000004,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.98299999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41799999999999998,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.95999999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.96399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.52900000000000003,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.93999999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63300000000000001,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.873},"last":0.53600000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542293,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303888,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067952,"statfs":{"total":96636764160,"available":96325582848,"internally_reserved":0,"allocated":2564096,"data_stored":1153289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.84899999999999998,"15min":1.056},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.63800000000000001},"min":{"1min":0.52500000000000002,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":3.7400000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.436,"15min":0.372},"max":{"1min":0.83299999999999996,"5min":0.84799999999999998,"15min":3.8519999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83699999999999997,"15min":1.234},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.91800000000000004},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.33300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75600000000000001,"5min":0.878,"15min":1.0229999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.878,"15min":1.282},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.31},"max":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.95499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.63800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542293,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1156070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.307},"max":{"1min":0.81000000000000005,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.314},"max":{"1min":0.85099999999999998,"5min":5.0970000000000004,"15min":5.2519999999999998},"last":0.621}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":0.80600000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.48599999999999999,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.82599999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.45800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.48999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.64900000000000002,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.376},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.495},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.78500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:47:07.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.050+0000 7f90a7719700 1 Processor -- start 2023-10-09T11:47:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.050+0000 7f90a7719700 1 -- start start 2023-10-09T11:47:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90a00a8d00 0x7f90a00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90a00a90d0 0x7f90a006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a006e380 0x7f90a00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00ae680 con 0x7f90a00a90d0 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a006e7f0 con 0x7f90a00a8d00 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a7719700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00aeee0 con 0x7f90a006e380 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a4cb4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90a00a90d0 0x7f90a006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a4cb4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90a00a90d0 0x7f90a006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34874/0 (socket says 172.21.15.26:34874) 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.051+0000 7f90a4cb4700 1 -- 172.21.15.26:0/1443403131 learned_addr learned my addr 172.21.15.26:0/1443403131 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a54b5700 1 --2- 172.21.15.26:0/1443403131 >> v2:172.21.15.67:3300/0 conn(0x7f90a00a8d00 0x7f90a00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a5cb6700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a006e380 0x7f90a00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 -- 172.21.15.26:0/1443403131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a006e380 msgr2=0x7f90a00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a006e380 0x7f90a00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 -- 172.21.15.26:0/1443403131 >> v2:172.21.15.67:3300/0 conn(0x7f90a00a8d00 msgr2=0x7f90a00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/1443403131 >> v2:172.21.15.67:3300/0 conn(0x7f90a00a8d00 0x7f90a00cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 -- 172.21.15.26:0/1443403131 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00cf490 con 0x7f90a00a90d0 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a90d0 0x7f90a006de40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f90a0088a00 tx=0x7f9094009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06e1e78796f8c8f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f909ffff700 1 -- 172.21.15.26:0/1443403131 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094005c10 con 0x7f90a00a90d0 2023-10-09T11:47:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f909ffff700 1 -- 172.21.15.26:0/1443403131 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9094005d70 con 0x7f90a00a90d0 2023-10-09T11:47:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.052+0000 7f909ffff700 1 -- 172.21.15.26:0/1443403131 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b880 con 0x7f90a00a90d0 2023-10-09T11:47:08.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 -- 172.21.15.26:0/1443403131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a90d0 msgr2=0x7f90a006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a90d0 0x7f90a006de40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f90a0088a00 tx=0x7f9094009220 comp rx=0 tx=0).stop 2023-10-09T11:47:08.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 -- 172.21.15.26:0/1443403131 shutdown_connections 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 --2- 172.21.15.26:0/1443403131 >> v2:172.21.15.67:3300/0 conn(0x7f90a00a8d00 0x7f90a00cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a006e380 0x7f90a00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 --2- 172.21.15.26:0/1443403131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a90d0 0x7f90a006de40 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 -- 172.21.15.26:0/1443403131 >> 172.21.15.26:0/1443403131 conn(0x7f90a006ce80 msgr2=0x7f90a00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 -- 172.21.15.26:0/1443403131 shutdown_connections 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.053+0000 7f90a7719700 1 -- 172.21.15.26:0/1443403131 wait complete. 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.054+0000 7f90a7719700 1 Processor -- start 2023-10-09T11:47:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.054+0000 7f90a7719700 1 -- start start 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a006e380 0x7f90a0148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a00a90d0 0x7f90a009ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00c40e0 con 0x7f90a00a8d00 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a009bf60 con 0x7f90a006e380 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a7719700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a016a8c0 con 0x7f90a00a90d0 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34888/0 (socket says 172.21.15.26:34888) 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 -- 172.21.15.26:0/2744699380 learned_addr learned my addr 172.21.15.26:0/2744699380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a54b5700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a006e380 0x7f90a0148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a5cb6700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a00a90d0 0x7f90a009ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 -- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a00a90d0 msgr2=0x7f90a009ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a00a90d0 0x7f90a009ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 -- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a006e380 msgr2=0x7f90a0148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a006e380 0x7f90a0148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 -- 172.21.15.26:0/2744699380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009480 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.055+0000 7f90a4cb4700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f909400b3c0 tx=0x7f9094016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094011920 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9094020070 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094011cb0 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a0160490 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a015fed0 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.056+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a016ab10 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.057+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9094022030 con 0x7f90a00a8d00 2023-10-09T11:47:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.057+0000 7f909d7fa700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 0x7f908c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.058+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9094086350 con 0x7f90a00a8d00 2023-10-09T11:47:08.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.058+0000 7f90a54b5700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 0x7f908c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.058+0000 7f90a54b5700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 0x7f908c0697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9098006aa0 tx=0x7f9098008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.062+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90a016ab10 con 0x7f90a00a8d00 2023-10-09T11:47:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.253+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90a016ab10 con 0x7f90a00a8d00 2023-10-09T11:47:08.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.254+0000 7f909d7fa700 1 -- 172.21.15.26:0/2744699380 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+12225 (secure 0 0 0) 0x7f90a016ab10 con 0x7f90a00a8d00 2023-10-09T11:47:08.255 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:08.256 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":203,"fsid":"d2192364-4346-4c74-aa8c-103a3c519dbd","created":"2023-10-09T11:34:59.346084+0000","modified":"2023-10-09T11:47:04.698051+0000","last_up_change":"2023-10-09T11:35:10.284260+0000","last_in_change":"2023-10-09T11:35:01.763965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:11.162437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c62846-a727-4140-9249-74d6d1fbcf4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":90836},{"type":"v1","addr":"172.21.15.26:6824","nonce":90836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90836},{"type":"v1","addr":"172.21.15.26:6827","nonce":90836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90836},{"type":"v1","addr":"172.21.15.26:6831","nonce":90836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90836},{"type":"v1","addr":"172.21.15.26:6829","nonce":90836}]},"public_addr":"172.21.15.26:6824/90836","cluster_addr":"172.21.15.26:6827/90836","heartbeat_back_addr":"172.21.15.26:6831/90836","heartbeat_front_addr":"172.21.15.26:6829/90836","state":["exists","up"]},{"osd":1,"uuid":"945aece4-746d-41e2-9a58-bb9cd9a39c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90835},{"type":"v1","addr":"172.21.15.26:6817","nonce":90835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90835},{"type":"v1","addr":"172.21.15.26:6819","nonce":90835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6823","nonce":90835},{"type":"v1","addr":"172.21.15.26:6825","nonce":90835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90835},{"type":"v1","addr":"172.21.15.26:6822","nonce":90835}]},"public_addr":"172.21.15.26:6817/90835","cluster_addr":"172.21.15.26:6819/90835","heartbeat_back_addr":"172.21.15.26:6825/90835","heartbeat_front_addr":"172.21.15.26:6822/90835","state":["exists","up"]},{"osd":2,"uuid":"42631142-8153-4679-8c4d-20c0d6370326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90837},{"type":"v1","addr":"172.21.15.26:6802","nonce":90837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90837},{"type":"v1","addr":"172.21.15.26:6806","nonce":90837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90837},{"type":"v1","addr":"172.21.15.26:6814","nonce":90837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90837},{"type":"v1","addr":"172.21.15.26:6810","nonce":90837}]},"public_addr":"172.21.15.26:6802/90837","cluster_addr":"172.21.15.26:6806/90837","heartbeat_back_addr":"172.21.15.26:6814/90837","heartbeat_front_addr":"172.21.15.26:6810/90837","state":["exists","up"]},{"osd":3,"uuid":"cceea557-fc4b-4629-982a-78161536c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":90834},{"type":"v1","addr":"172.21.15.26:6803","nonce":90834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":90834},{"type":"v1","addr":"172.21.15.26:6807","nonce":90834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6813","nonce":90834},{"type":"v1","addr":"172.21.15.26:6815","nonce":90834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6809","nonce":90834},{"type":"v1","addr":"172.21.15.26:6811","nonce":90834}]},"public_addr":"172.21.15.26:6803/90834","cluster_addr":"172.21.15.26:6807/90834","heartbeat_back_addr":"172.21.15.26:6815/90834","heartbeat_front_addr":"172.21.15.26:6811/90834","state":["exists","up"]},{"osd":4,"uuid":"6e560165-3cb4-41d7-8593-96eaee1c3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":91097},{"type":"v1","addr":"172.21.15.67:6801","nonce":91097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":91097},{"type":"v1","addr":"172.21.15.67:6803","nonce":91097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":91097},{"type":"v1","addr":"172.21.15.67:6807","nonce":91097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":91097},{"type":"v1","addr":"172.21.15.67:6805","nonce":91097}]},"public_addr":"172.21.15.67:6801/91097","cluster_addr":"172.21.15.67:6803/91097","heartbeat_back_addr":"172.21.15.67:6807/91097","heartbeat_front_addr":"172.21.15.67:6805/91097","state":["exists","up"]},{"osd":5,"uuid":"6a4e7d6c-9c69-4db3-8ed2-f4e880a1bf61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":91096},{"type":"v1","addr":"172.21.15.67:6809","nonce":91096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":91096},{"type":"v1","addr":"172.21.15.67:6811","nonce":91096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":91096},{"type":"v1","addr":"172.21.15.67:6815","nonce":91096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":91096},{"type":"v1","addr":"172.21.15.67:6813","nonce":91096}]},"public_addr":"172.21.15.67:6809/91096","cluster_addr":"172.21.15.67:6811/91096","heartbeat_back_addr":"172.21.15.67:6815/91096","heartbeat_front_addr":"172.21.15.67:6813/91096","state":["exists","up"]},{"osd":6,"uuid":"b359f877-48d3-43a3-9727-de1b4d331ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":91126},{"type":"v1","addr":"172.21.15.67:6817","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":91126},{"type":"v1","addr":"172.21.15.67:6819","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":91126},{"type":"v1","addr":"172.21.15.67:6823","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":91126},{"type":"v1","addr":"172.21.15.67:6821","nonce":91126}]},"public_addr":"172.21.15.67:6817/91126","cluster_addr":"172.21.15.67:6819/91126","heartbeat_back_addr":"172.21.15.67:6823/91126","heartbeat_front_addr":"172.21.15.67:6821/91126","state":["exists","up"]},{"osd":7,"uuid":"48641f8c-deaa-498f-8d8a-f695baf0d5f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":91127},{"type":"v1","addr":"172.21.15.67:6825","nonce":91127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":91127},{"type":"v1","addr":"172.21.15.67:6827","nonce":91127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":91127},{"type":"v1","addr":"172.21.15.67:6831","nonce":91127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":91127},{"type":"v1","addr":"172.21.15.67:6829","nonce":91127}]},"public_addr":"172.21.15.67:6825/91127","cluster_addr":"172.21.15.67:6827/91127","heartbeat_back_addr":"172.21.15.67:6831/91127","heartbeat_front_addr":"172.21.15.67:6829/91127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.428824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.926936+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.683501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.707915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.697977+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.875434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:07.001640+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:06.705368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/2946278291":"2023-10-10T11:47:01.686404+0000","172.21.15.67:6835/2946278291":"2023-10-10T11:47:01.686404+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 msgr2=0x7f908c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 0x7f908c0697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9098006aa0 tx=0x7f9098008040 comp rx=0 tx=0).stop 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 msgr2=0x7f90a009b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f909400b3c0 tx=0x7f9094016000 comp rx=0 tx=0).stop 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 shutdown_connections 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f908c067320 0x7f908c0697d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90a00a90d0 0x7f90a009ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90a006e380 0x7f90a0148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 --2- 172.21.15.26:0/2744699380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90a00a8d00 0x7f90a009b4e0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 >> 172.21.15.26:0/2744699380 conn(0x7f90a006ce80 msgr2=0x7f90a00682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 shutdown_connections 2023-10-09T11:47:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:08.256+0000 7f90a7719700 1 -- 172.21.15.26:0/2744699380 wait complete. 2023-10-09T11:47:09.270 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T11:47:09.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.403+0000 7f46b9eb7700 1 Processor -- start 2023-10-09T11:47:09.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.403+0000 7f46b9eb7700 1 -- start start 2023-10-09T11:47:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b9eb7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b406dcf0 0x7f46b4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b9eb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b4159e40 0x7f46b40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b9eb7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40ccfd0 con 0x7f46b4159530 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b9eb7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b415a410 con 0x7f46b406dcf0 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b9eb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b415a6f0 con 0x7f46b4159e40 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b406dcf0 0x7f46b4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46b406dcf0 0x7f46b4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34902/0 (socket says 172.21.15.26:34902) 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 -- 172.21.15.26:0/2370810032 learned_addr learned my addr 172.21.15.26:0/2370810032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b3fff700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b4159e40 0x7f46b40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 -- 172.21.15.26:0/2370810032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b4159e40 msgr2=0x7f46b40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:09.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b4159e40 0x7f46b40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 -- 172.21.15.26:0/2370810032 >> v1:172.21.15.67:6789/0 conn(0x7f46b4159530 legacy=0x7f46b40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.404+0000 7f46b2ffd700 1 -- 172.21.15.26:0/2370810032 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b415a9d0 con 0x7f46b406dcf0 2023-10-09T11:47:09.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b2ffd700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b406dcf0 0x7f46b4159900 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f46a80099b0 tx=0x7f46a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab28d0d8dcae267c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b27fc700 1 -- 172.21.15.26:0/2370810032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8009ea0 con 0x7f46b406dcf0 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b27fc700 1 -- 172.21.15.26:0/2370810032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800b860 con 0x7f46b406dcf0 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b27fc700 1 -- 172.21.15.26:0/2370810032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800bc00 con 0x7f46b406dcf0 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 -- 172.21.15.26:0/2370810032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b406dcf0 msgr2=0x7f46b4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b406dcf0 0x7f46b4159900 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f46a80099b0 tx=0x7f46a8009250 comp rx=0 tx=0).stop 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 -- 172.21.15.26:0/2370810032 shutdown_connections 2023-10-09T11:47:09.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b4159e40 0x7f46b40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/2370810032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b406dcf0 0x7f46b4159900 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 -- 172.21.15.26:0/2370810032 >> 172.21.15.26:0/2370810032 conn(0x7f46b40703a0 msgr2=0x7f46b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 -- 172.21.15.26:0/2370810032 shutdown_connections 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.405+0000 7f46b9eb7700 1 -- 172.21.15.26:0/2370810032 wait complete. 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.406+0000 7f46b9eb7700 1 Processor -- start 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 -- start start 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b406dcf0 0x7f46b40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 0x7f46b4155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b4159e40 0x7f46b415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c7de0 con 0x7f46b4159530 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b415c2e0 con 0x7f46b4159e40 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b9eb7700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b415c5c0 con 0x7f46b406dcf0 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 0x7f46b4155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 0x7f46b4155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34906/0 (socket says 172.21.15.26:34906) 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b2ffd700 1 -- 172.21.15.26:0/3776343993 learned_addr learned my addr 172.21.15.26:0/3776343993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b3fff700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b4159e40 0x7f46b415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.407+0000 7f46b37fe700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b406dcf0 0x7f46b40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 -- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b406dcf0 msgr2=0x7f46b40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46b406dcf0 0x7f46b40b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 -- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b4159e40 msgr2=0x7f46b415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b4159e40 0x7f46b415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80094f0 con 0x7f46b4159530 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b2ffd700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 0x7f46b4155fb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f46b4089650 tx=0x7f46a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8000d10 con 0x7f46b4159530 2023-10-09T11:47:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800bbe0 con 0x7f46b4159530 2023-10-09T11:47:09.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40c7790 con 0x7f46b4159530 2023-10-09T11:47:09.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8011670 con 0x7f46b4159530 2023-10-09T11:47:09.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.408+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b415be60 con 0x7f46b4159530 2023-10-09T11:47:09.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.409+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46b404c3c0 con 0x7f46b4159530 2023-10-09T11:47:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.409+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f46a8011aa0 con 0x7f46b4159530 2023-10-09T11:47:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f469b7fe700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46a0067320 0x7f46a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f46a8086180 con 0x7f46b4159530 2023-10-09T11:47:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f469b7fe700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f46a006d000 0x7f46a006f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46a006fae0 con 0x7f46a006d000 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46a80886e0 con 0x7f46b4159530 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f46b37fe700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46a0067320 0x7f46a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f46b3fff700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f46a006d000 0x7f46a006f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.410+0000 7f46b3fff700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f46a006d000 0x7f46a006f410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.411+0000 7f46b37fe700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46a0067320 0x7f46a00697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f46b4158de0 tx=0x7f46a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.411+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== osd.0 v2:172.21.15.26:6821/90836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f46a006fae0 con 0x7f46a006d000 2023-10-09T11:47:09.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.425+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 --> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46b415c780 con 0x7f46a006d000 2023-10-09T11:47:09.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.425+0000 7f469b7fe700 1 -- 172.21.15.26:0/3776343993 <== osd.0 v2:172.21.15.26:6821/90836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f46ac00f040 con 0x7f46a006d000 2023-10-09T11:47:09.427 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:09.427 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:09.427 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f46a006d000 msgr2=0x7f46a006f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:6821/90836,v1:172.21.15.26:6824/90836] conn(0x7f46a006d000 0x7f46a006f410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46a0067320 msgr2=0x7f46a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f46a0067320 0x7f46a00697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f46b4158de0 tx=0x7f46a4009040 comp rx=0 tx=0).stop 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 msgr2=0x7f46b4155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 --2- 172.21.15.26:0/3776343993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46b4159530 0x7f46b4155fb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f46b4089650 tx=0x7f46a8017000 comp rx=0 tx=0).stop 2023-10-09T11:47:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b3fff700 1 -- 172.21.15.26:0/3776343993 reap_dead start 2023-10-09T11:47:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 shutdown_connections 2023-10-09T11:47:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 >> 172.21.15.26:0/3776343993 conn(0x7f46b40703a0 msgr2=0x7f46b40b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 shutdown_connections 2023-10-09T11:47:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.426+0000 7f46b9eb7700 1 -- 172.21.15.26:0/3776343993 wait complete. 2023-10-09T11:47:09.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T11:47:09.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.557+0000 7f1073520700 1 Processor -- start 2023-10-09T11:47:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.557+0000 7f1073520700 1 -- start start 2023-10-09T11:47:09.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1073520700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f106c0cb5a0 0x7f106c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1073520700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f106c15a5d0 0x7f106c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1073520700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c15ae40 con 0x7f106c0cd9e0 2023-10-09T11:47:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1073520700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c0d13f0 con 0x7f106c15a5d0 2023-10-09T11:47:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1073520700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c15ab60 con 0x7f106c0cb5a0 2023-10-09T11:47:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1071abd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f106c15a5d0 0x7f106c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1071abd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f106c15a5d0 0x7f106c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34916/0 (socket says 172.21.15.26:34916) 2023-10-09T11:47:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f1071abd700 1 -- 172.21.15.26:0/3681678097 learned_addr learned my addr 172.21.15.26:0/3681678097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.558+0000 7f10712bc700 1 --2- 172.21.15.26:0/3681678097 >> v2:172.21.15.67:3300/0 conn(0x7f106c0cb5a0 0x7f106c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1071abd700 1 -- 172.21.15.26:0/3681678097 >> v2:172.21.15.67:3300/0 conn(0x7f106c0cb5a0 msgr2=0x7f106c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1071abd700 1 --2- 172.21.15.26:0/3681678097 >> v2:172.21.15.67:3300/0 conn(0x7f106c0cb5a0 0x7f106c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1071abd700 1 -- 172.21.15.26:0/3681678097 >> v1:172.21.15.67:6789/0 conn(0x7f106c0cd9e0 legacy=0x7f106c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1071abd700 1 -- 172.21.15.26:0/3681678097 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c0ccf00 con 0x7f106c15a5d0 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1071abd700 1 --2- 172.21.15.26:0/3681678097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c15a5d0 0x7f106c156e90 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f105c009f20 tx=0x7f105c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cd398b07c82df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f106bfff700 1 -- 172.21.15.26:0/3681678097 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00e070 con 0x7f106c15a5d0 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f106bfff700 1 -- 172.21.15.26:0/3681678097 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00ba00 con 0x7f106c15a5d0 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f106bfff700 1 -- 172.21.15.26:0/3681678097 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0092e0 con 0x7f106c15a5d0 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 -- 172.21.15.26:0/3681678097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c15a5d0 msgr2=0x7f106c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 --2- 172.21.15.26:0/3681678097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c15a5d0 0x7f106c156e90 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f105c009f20 tx=0x7f105c009840 comp rx=0 tx=0).stop 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 -- 172.21.15.26:0/3681678097 shutdown_connections 2023-10-09T11:47:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 --2- 172.21.15.26:0/3681678097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c15a5d0 0x7f106c156e90 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 --2- 172.21.15.26:0/3681678097 >> v2:172.21.15.67:3300/0 conn(0x7f106c0cb5a0 0x7f106c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.559+0000 7f1073520700 1 -- 172.21.15.26:0/3681678097 >> 172.21.15.26:0/3681678097 conn(0x7f106c070e30 msgr2=0x7f106c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.560+0000 7f1073520700 1 -- 172.21.15.26:0/3681678097 shutdown_connections 2023-10-09T11:47:09.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.560+0000 7f1073520700 1 -- 172.21.15.26:0/3681678097 wait complete. 2023-10-09T11:47:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.561+0000 7f1073520700 1 Processor -- start 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.561+0000 7f1073520700 1 -- start start 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.561+0000 7f1073520700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106c0cb5a0 0x7f106c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106c15a5d0 0x7f106c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c16dda0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0b5b20 con 0x7f106c15a5d0 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0b5e00 con 0x7f106c0cb5a0 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34920/0 (socket says 172.21.15.26:34920) 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 -- 172.21.15.26:0/790278205 learned_addr learned my addr 172.21.15.26:0/790278205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 -- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106c0cb5a0 msgr2=0x7f106c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106c0cb5a0 0x7f106c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1071abd700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106c15a5d0 0x7f106c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 -- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106c15a5d0 msgr2=0x7f106c16cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106c15a5d0 0x7f106c16cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 -- 172.21.15.26:0/790278205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009ae0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1070abb700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f106000c5d0 tx=0x7f1060007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011590 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060011710 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c0b60e0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011ad0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.562+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c1545a0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.563+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c04c3c0 con 0x7f106c0cd9e0 2023-10-09T11:47:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.564+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f106001c460 con 0x7f106c0cd9e0 2023-10-09T11:47:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.564+0000 7f10697fa700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 0x7f10580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.564+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1060084770 con 0x7f106c0cd9e0 2023-10-09T11:47:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.564+0000 7f10712bc700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 0x7f10580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.565+0000 7f10712bc700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 0x7f10580697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f106c0b35a0 tx=0x7f1064008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.568+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1060051700 con 0x7f106c0cd9e0 2023-10-09T11:47:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.760+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f106c0cd250 con 0x7f1058067320 2023-10-09T11:47:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.760+0000 7f10697fa700 1 -- 172.21.15.26:0/790278205 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f106c0cd250 con 0x7f1058067320 2023-10-09T11:47:09.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 msgr2=0x7f10580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 0x7f10580697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f106c0b35a0 tx=0x7f1064008040 comp rx=0 tx=0).stop 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 msgr2=0x7f106c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f106000c5d0 tx=0x7f1060007f60 comp rx=0 tx=0).stop 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 shutdown_connections 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f106c15a5d0 0x7f106c16cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1058067320 0x7f10580697d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f106c0cb5a0 0x7f106c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 --2- 172.21.15.26:0/790278205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f106c0cd9e0 0x7f106c15d950 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 >> 172.21.15.26:0/790278205 conn(0x7f106c070e30 msgr2=0x7f106c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 shutdown_connections 2023-10-09T11:47:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.762+0000 7f1073520700 1 -- 172.21.15.26:0/790278205 wait complete. 2023-10-09T11:47:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T11:47:09.775 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T11:47:09.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:09.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.898+0000 7f20e5973700 1 Processor -- start 2023-10-09T11:47:09.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.898+0000 7f20e5973700 1 -- start start 2023-10-09T11:47:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20e5973700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20e5973700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20e00cd770 0x7f20e01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20e5973700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00cf330 con 0x7f20e00b04f0 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20e5973700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00cdbd0 con 0x7f20e00cd770 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20e5973700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00cead0 con 0x7f20e00cb880 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20de7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f20e00b04f0 0x7f20e00cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47994/0 (socket says 172.21.15.26:47994) 2023-10-09T11:47:09.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20de7fc700 1 -- 172.21.15.26:0/4228680668 learned_addr learned my addr 172.21.15.26:0/4228680668 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20df7fe700 1 --2- 172.21.15.26:0/4228680668 >> v2:172.21.15.67:3300/0 conn(0x7f20e00cd770 0x7f20e01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20deffd700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688339013 0 0) 0x7f20e00cf330 con 0x7f20e00b04f0 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20cc003570 con 0x7f20e00b04f0 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20df7fe700 1 -- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 msgr2=0x7f20e00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188405068 0 0) 0x7f20cc003570 con 0x7f20e00b04f0 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20df7fe700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20df7fe700 1 -- 172.21.15.26:0/4228680668 >> v1:172.21.15.26:6789/0 conn(0x7f20e00b04f0 legacy=0x7f20e00cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.899+0000 7f20df7fe700 1 -- 172.21.15.26:0/4228680668 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00cddd0 con 0x7f20e00cd770 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20df7fe700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00cd770 0x7f20e01591e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e60 tx=0x7f20d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2c91c5f17b28ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000e070 con 0x7f20e00cd770 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000b7a0 con 0x7f20e00cd770 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20ddffb700 1 -- 172.21.15.26:0/4228680668 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8001470 con 0x7f20e00cd770 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 -- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00cd770 msgr2=0x7f20e01591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00cd770 0x7f20e01591e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e60 tx=0x7f20d0009780 comp rx=0 tx=0).stop 2023-10-09T11:47:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 -- 172.21.15.26:0/4228680668 shutdown_connections 2023-10-09T11:47:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00cd770 0x7f20e01591e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 --2- 172.21.15.26:0/4228680668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 -- 172.21.15.26:0/4228680668 >> 172.21.15.26:0/4228680668 conn(0x7f20e00703a0 msgr2=0x7f20e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 -- 172.21.15.26:0/4228680668 shutdown_connections 2023-10-09T11:47:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.900+0000 7f20e5973700 1 -- 172.21.15.26:0/4228680668 wait complete. 2023-10-09T11:47:09.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 Processor -- start 2023-10-09T11:47:09.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 -- start start 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00b04f0 0x7f20e00c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 0x7f20e0159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b44f0 con 0x7f20e00cd770 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c7e50 con 0x7f20e00b04f0 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20e5973700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c8130 con 0x7f20e00cb880 2023-10-09T11:47:09.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.902+0000 7f20df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 0x7f20e0159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 0x7f20e0159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39704/0 (socket says 172.21.15.26:39704) 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 -- 172.21.15.26:0/3348368867 learned_addr learned my addr 172.21.15.26:0/3348368867 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20deffd700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00b04f0 0x7f20e00c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20de7fc700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 -- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 msgr2=0x7f20e00b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20e00cb880 0x7f20e00b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 -- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00b04f0 msgr2=0x7f20e00c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e00b04f0 0x7f20e00c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0009a20 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20df7fe700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 0x7f20e0159750 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f20e0089650 tx=0x7f20d0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0012ad0 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0012c90 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00c8410 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00276c0 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.903+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00c8a50 con 0x7f20e00cd770 2023-10-09T11:47:09.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.904+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20e004c3c0 con 0x7f20e00cd770 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.905+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f20d0024070 con 0x7f20e00cd770 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.905+0000 7f20d6ffd700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f20c0067320 0x7f20c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.905+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f20d0087360 con 0x7f20e00cd770 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.905+0000 7f20d6ffd700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f20c006d170 0x7f20c006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.905+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20c006fc50 con 0x7f20c006d170 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.906+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20d0087670 con 0x7f20e00cd770 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.906+0000 7f20deffd700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f20c0067320 0x7f20c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.906+0000 7f20de7fc700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f20c006d170 0x7f20c006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:09.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.906+0000 7f20de7fc700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f20c006d170 0x7f20c006f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.906+0000 7f20deffd700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f20c0067320 0x7f20c00697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009db0 tx=0x7f20d80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:09.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.907+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== osd.1 v2:172.21.15.26:6816/90835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f20c006fc50 con 0x7f20c006d170 2023-10-09T11:47:09.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.920+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 --> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20e00b0c30 con 0x7f20c006d170 2023-10-09T11:47:09.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20d6ffd700 1 -- 172.21.15.26:0/3348368867 <== osd.1 v2:172.21.15.26:6816/90835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f20e00b0c30 con 0x7f20c006d170 2023-10-09T11:47:09.922 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:09.922 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:09.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f20c006d170 msgr2=0x7f20c006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:6816/90835,v1:172.21.15.26:6817/90835] conn(0x7f20c006d170 0x7f20c006f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f20c0067320 msgr2=0x7f20c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f20c0067320 0x7f20c00697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009db0 tx=0x7f20d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 msgr2=0x7f20e0159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 --2- 172.21.15.26:0/3348368867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e00cd770 0x7f20e0159750 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f20e0089650 tx=0x7f20d0018000 comp rx=0 tx=0).stop 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20df7fe700 1 -- 172.21.15.26:0/3348368867 reap_dead start 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 shutdown_connections 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 >> 172.21.15.26:0/3348368867 conn(0x7f20e00703a0 msgr2=0x7f20e00c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 shutdown_connections 2023-10-09T11:47:09.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:09.921+0000 7f20e5973700 1 -- 172.21.15.26:0/3348368867 wait complete. 2023-10-09T11:47:09.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T11:47:10.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.052+0000 7f555d247700 1 Processor -- start 2023-10-09T11:47:10.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.052+0000 7f555d247700 1 -- start start 2023-10-09T11:47:10.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555d247700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5558153c30 0x7f555815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555d247700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 0x7f555815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555d247700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555815afd0 con 0x7f555815de50 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555d247700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555815b2b0 con 0x7f5558153c30 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555d247700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555815b590 con 0x7f55580cf110 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5558153c30 0x7f555815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5558153c30 0x7f555815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39708/0 (socket says 172.21.15.26:39708) 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 -- 172.21.15.26:0/4009256391 learned_addr learned my addr 172.21.15.26:0/4009256391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555ca46700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 0x7f555815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 -- 172.21.15.26:0/4009256391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 msgr2=0x7f555815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 0x7f555815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 -- 172.21.15.26:0/4009256391 >> v1:172.21.15.67:6789/0 conn(0x7f555815de50 legacy=0x7f55580cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f5557fff700 1 -- 172.21.15.26:0/4009256391 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555815b870 con 0x7f5558153c30 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.053+0000 7f555ca46700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 0x7f555815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f5557fff700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5558153c30 0x7f555815a5e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f55480099b0 tx=0x7f5548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc2fd8f4e57cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f5556ffd700 1 -- 172.21.15.26:0/4009256391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800b820 con 0x7f5558153c30 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f5556ffd700 1 -- 172.21.15.26:0/4009256391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800b980 con 0x7f5558153c30 2023-10-09T11:47:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f5556ffd700 1 -- 172.21.15.26:0/4009256391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800bd20 con 0x7f5558153c30 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 -- 172.21.15.26:0/4009256391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5558153c30 msgr2=0x7f555815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5558153c30 0x7f555815a5e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f55480099b0 tx=0x7f5548009250 comp rx=0 tx=0).stop 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 -- 172.21.15.26:0/4009256391 shutdown_connections 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55580cf110 0x7f555815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 --2- 172.21.15.26:0/4009256391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5558153c30 0x7f555815a5e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 -- 172.21.15.26:0/4009256391 >> 172.21.15.26:0/4009256391 conn(0x7f55580703a0 msgr2=0x7f55580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 -- 172.21.15.26:0/4009256391 shutdown_connections 2023-10-09T11:47:10.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.054+0000 7f555d247700 1 -- 172.21.15.26:0/4009256391 wait complete. 2023-10-09T11:47:10.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.055+0000 7f555d247700 1 Processor -- start 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 -- start start 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 0x7f555814b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5558153c30 0x7f55580c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55580b0cb0 con 0x7f555815de50 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55580c8030 con 0x7f55580cf110 2023-10-09T11:47:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.056+0000 7f555d247700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55580c8310 con 0x7f5558153c30 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39720/0 (socket says 172.21.15.26:39720) 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 -- 172.21.15.26:0/36050342 learned_addr learned my addr 172.21.15.26:0/36050342 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f5557fff700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 0x7f555814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f55577fe700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5558153c30 0x7f55580c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 -- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5558153c30 msgr2=0x7f55580c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5558153c30 0x7f55580c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 -- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 msgr2=0x7f555814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 0x7f555814b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 -- 172.21.15.26:0/36050342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480094f0 con 0x7f555815de50 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f5557fff700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 0x7f555814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555ca46700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f555000a380 tx=0x7f5550007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000ae10 con 0x7f555815de50 2023-10-09T11:47:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555000d650 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55580b0940 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000da10 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.057+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555814b970 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.058+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55580b07a0 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.059+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f555001e3b0 con 0x7f555815de50 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.059+0000 7f553ffff700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 0x7f55440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.059+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5550085380 con 0x7f555815de50 2023-10-09T11:47:10.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.059+0000 7f5557fff700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 0x7f55440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.060+0000 7f5557fff700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 0x7f55440697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f55480099b0 tx=0x7f5548016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.063+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55580b07a0 con 0x7f555815de50 2023-10-09T11:47:10.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.257+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55580b07a0 con 0x7f5544067320 2023-10-09T11:47:10.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.257+0000 7f553ffff700 1 -- 172.21.15.26:0/36050342 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55580b07a0 con 0x7f5544067320 2023-10-09T11:47:10.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 msgr2=0x7f55440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 0x7f55440697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f55480099b0 tx=0x7f5548016000 comp rx=0 tx=0).stop 2023-10-09T11:47:10.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 msgr2=0x7f55580c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f555000a380 tx=0x7f5550007900 comp rx=0 tx=0).stop 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 shutdown_connections 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555815de50 0x7f55580c8770 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55580cf110 0x7f555814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f5544067320 0x7f55440697d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 --2- 172.21.15.26:0/36050342 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5558153c30 0x7f55580c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 >> 172.21.15.26:0/36050342 conn(0x7f55580703a0 msgr2=0x7f55580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 shutdown_connections 2023-10-09T11:47:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.260+0000 7f555d247700 1 -- 172.21.15.26:0/36050342 wait complete. 2023-10-09T11:47:10.263 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T11:47:10.274 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T11:47:10.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.396+0000 7f1b1a039700 1 Processor -- start 2023-10-09T11:47:10.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.396+0000 7f1b1a039700 1 -- start start 2023-10-09T11:47:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b1a039700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b14067e50 0x7f1b1415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b1a039700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b1a039700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1415d9f0 con 0x7f1b14068220 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b1a039700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1415d3c0 con 0x7f1b14067e50 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b1a039700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415a8f0 con 0x7f1b140c8c70 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b137fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b14067e50 0x7f1b1415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b12ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1b14068220 0x7f1b14159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.26:59036/0 (socket says 172.21.15.26:59036) 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b137fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b14067e50 0x7f1b1415de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.26:44298/0 (socket says 172.21.15.26:44298) 2023-10-09T11:47:10.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b12ffd700 1 -- 172.21.15.26:0/372984431 learned_addr learned my addr 172.21.15.26:0/372984431 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.397+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.26:53106/0 (socket says 172.21.15.26:53106) 2023-10-09T11:47:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b137fe700 1 -- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 msgr2=0x7f1b140c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b137fe700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b137fe700 1 -- 172.21.15.26:0/372984431 >> v1:172.21.15.67:6789/0 conn(0x7f1b14068220 legacy=0x7f1b14159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b127fc700 1 -- 172.21.15.26:0/372984431 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38148655 0 0) 0x7f1b1415d9f0 con 0x7f1b14068220 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b137fe700 1 -- 172.21.15.26:0/372984431 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1415abd0 con 0x7f1b14067e50 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b13fff700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b137fe700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b14067e50 0x7f1b1415de80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0adbc8979b6a542 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b127fc700 1 -- 172.21.15.26:0/372984431 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400b640 con 0x7f1b14067e50 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b127fc700 1 -- 172.21.15.26:0/372984431 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400b7a0 con 0x7f1b14067e50 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.398+0000 7f1b127fc700 1 -- 172.21.15.26:0/372984431 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400bb40 con 0x7f1b14067e50 2023-10-09T11:47:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 -- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b14067e50 msgr2=0x7f1b1415de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b14067e50 0x7f1b1415de80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 -- 172.21.15.26:0/372984431 shutdown_connections 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b140c8c70 0x7f1b140c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 --2- 172.21.15.26:0/372984431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b14067e50 0x7f1b1415de80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 -- 172.21.15.26:0/372984431 >> 172.21.15.26:0/372984431 conn(0x7f1b140ce4a0 msgr2=0x7f1b140ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 -- 172.21.15.26:0/372984431 shutdown_connections 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.399+0000 7f1b1a039700 1 -- 172.21.15.26:0/372984431 wait complete. 2023-10-09T11:47:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.400+0000 7f1b1a039700 1 Processor -- start 2023-10-09T11:47:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.400+0000 7f1b1a039700 1 -- start start 2023-10-09T11:47:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b14067e50 0x7f1b140b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 0x7f1b140b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b140c8c70 0x7f1b1414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415c2f0 con 0x7f1b14068220 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415c5d0 con 0x7f1b140c8c70 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b1a039700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415c8b0 con 0x7f1b14067e50 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 0x7f1b140b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 0x7f1b140b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39734/0 (socket says 172.21.15.26:39734) 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 -- 172.21.15.26:0/1392161037 learned_addr learned my addr 172.21.15.26:0/1392161037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b137fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b14067e50 0x7f1b140b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b13fff700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b140c8c70 0x7f1b1414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 -- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b14067e50 msgr2=0x7f1b140b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b14067e50 0x7f1b140b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 -- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b140c8c70 msgr2=0x7f1b1414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b140c8c70 0x7f1b1414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c009a20 con 0x7f1b14068220 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b137fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b14067e50 0x7f1b140b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b13fff700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b140c8c70 0x7f1b1414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.401+0000 7f1b12ffd700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 0x7f1b140b1eb0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800c7e0 tx=0x7f1b08007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08005b30 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08005c90 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04009420 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08007300 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1415ce70 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.402+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b1404c3c0 con 0x7f1b14068220 2023-10-09T11:47:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.403+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b0801b400 con 0x7f1b14068220 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.403+0000 7f1afb7fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1b00067320 0x7f1b000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.403+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1b08084350 con 0x7f1b14068220 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1afb7fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f1b0006d170 0x7f1b0006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b0006fc50 con 0x7f1b0006d170 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b080869a0 con 0x7f1b14068220 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1b137fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1b00067320 0x7f1b000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1b13fff700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f1b0006d170 0x7f1b0006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1b13fff700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f1b0006d170 0x7f1b0006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.404+0000 7f1b137fe700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1b00067320 0x7f1b000697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1b04003080 tx=0x7f1b04017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.405+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== osd.2 v2:172.21.15.26:6800/90837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1b0006fc50 con 0x7f1b0006d170 2023-10-09T11:47:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.418+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 --> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b1415d680 con 0x7f1b0006d170 2023-10-09T11:47:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1afb7fe700 1 -- 172.21.15.26:0/1392161037 <== osd.2 v2:172.21.15.26:6800/90837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1b1415d680 con 0x7f1b0006d170 2023-10-09T11:47:10.420 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:10.420 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:10.420 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f1b0006d170 msgr2=0x7f1b0006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:6800/90837,v1:172.21.15.26:6802/90837] conn(0x7f1b0006d170 0x7f1b0006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1b00067320 msgr2=0x7f1b000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f1b00067320 0x7f1b000697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1b04003080 tx=0x7f1b04017000 comp rx=0 tx=0).stop 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 msgr2=0x7f1b140b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 --2- 172.21.15.26:0/1392161037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b14068220 0x7f1b140b1eb0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800c7e0 tx=0x7f1b08007df0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b13fff700 1 -- 172.21.15.26:0/1392161037 reap_dead start 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 shutdown_connections 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 >> 172.21.15.26:0/1392161037 conn(0x7f1b140ce4a0 msgr2=0x7f1b14159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 shutdown_connections 2023-10-09T11:47:10.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.419+0000 7f1b1a039700 1 -- 172.21.15.26:0/1392161037 wait complete. 2023-10-09T11:47:10.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T11:47:10.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.550+0000 7f9695f66700 1 Processor -- start 2023-10-09T11:47:10.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.550+0000 7f9695f66700 1 -- start start 2023-10-09T11:47:10.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f9695f66700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96900cb970 0x7f9690159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f9695f66700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969015ae40 con 0x7f96900cb5a0 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f9695f66700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969015ab60 con 0x7f969015a400 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f9695f66700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900ce0f0 con 0x7f96900cb970 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f968f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96900cb5a0 0x7f96900cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48008/0 (socket says 172.21.15.26:48008) 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f968f7fe700 1 -- 172.21.15.26:0/546127125 learned_addr learned my addr 172.21.15.26:0/546127125 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.551+0000 7f968effd700 1 --2- 172.21.15.26:0/546127125 >> v2:172.21.15.67:3300/0 conn(0x7f96900cb970 0x7f9690159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836573021 0 0) 0x7f969015ae40 con 0x7f96900cb5a0 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9678003570 con 0x7f96900cb5a0 2023-10-09T11:47:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914347920 0 0) 0x7f969015ab60 con 0x7f969015a400 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969015ae40 con 0x7f969015a400 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800183365 0 0) 0x7f9678003570 con 0x7f96900cb5a0 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968effd700 1 -- 172.21.15.26:0/546127125 >> v1:172.21.15.67:6789/0 conn(0x7f969015a400 legacy=0x7f9690156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968effd700 1 -- 172.21.15.26:0/546127125 >> v1:172.21.15.26:6789/0 conn(0x7f96900cb5a0 legacy=0x7f96900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968effd700 1 -- 172.21.15.26:0/546127125 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900ccf00 con 0x7f96900cb970 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968effd700 1 --2- 172.21.15.26:0/546127125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f9690159ec0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96840098e0 tx=0x7f96840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff8d8deece902c5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680001470 con 0x7f96900cb970 2023-10-09T11:47:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684011420 con 0x7f96900cb970 2023-10-09T11:47:10.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.552+0000 7f968e7fc700 1 -- 172.21.15.26:0/546127125 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840117c0 con 0x7f96900cb970 2023-10-09T11:47:10.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 -- 172.21.15.26:0/546127125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 msgr2=0x7f9690159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 --2- 172.21.15.26:0/546127125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f9690159ec0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96840098e0 tx=0x7f96840091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 -- 172.21.15.26:0/546127125 shutdown_connections 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 --2- 172.21.15.26:0/546127125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f9690159ec0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 -- 172.21.15.26:0/546127125 >> 172.21.15.26:0/546127125 conn(0x7f9690070e30 msgr2=0x7f96900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 -- 172.21.15.26:0/546127125 shutdown_connections 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.553+0000 7f9695f66700 1 -- 172.21.15.26:0/546127125 wait complete. 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.554+0000 7f9695f66700 1 Processor -- start 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.554+0000 7f9695f66700 1 -- start start 2023-10-09T11:47:10.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96900cb5a0 0x7f9690150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f96900ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690151a70 con 0x7f969015a400 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b3b60 con 0x7f96900cb970 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f9695f66700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b3550 con 0x7f96900cb5a0 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39750/0 (socket says 172.21.15.26:39750) 2023-10-09T11:47:10.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 -- 172.21.15.26:0/2052639892 learned_addr learned my addr 172.21.15.26:0/2052639892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968effd700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f96900ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968f7fe700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96900cb5a0 0x7f9690150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 -- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96900cb5a0 msgr2=0x7f9690150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96900cb5a0 0x7f9690150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 -- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 msgr2=0x7f96900ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f96900ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 -- 172.21.15.26:0/2052639892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009420 con 0x7f969015a400 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.555+0000 7f968ffff700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f968800c890 tx=0x7f9688002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.556+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688002030 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.556+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96880021b0 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.556+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969016a580 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.556+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688012630 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.556+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969016a860 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.557+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96900b3d10 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.557+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9688012a20 con 0x7f969015a400 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.557+0000 7f96777fe700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 0x7f967c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.557+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f96880849d0 con 0x7f969015a400 2023-10-09T11:47:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.557+0000 7f968f7fe700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 0x7f967c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.558+0000 7f968f7fe700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 0x7f967c0697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f96800015a0 tx=0x7f9680000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.562+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96900b3d10 con 0x7f969015a400 2023-10-09T11:47:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.754+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f96900b3d10 con 0x7f967c067320 2023-10-09T11:47:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.756+0000 7f96777fe700 1 -- 172.21.15.26:0/2052639892 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f96900b3d10 con 0x7f967c067320 2023-10-09T11:47:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 msgr2=0x7f967c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 0x7f967c0697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f96800015a0 tx=0x7f9680000bc0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 msgr2=0x7f96900cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f968800c890 tx=0x7f9688002700 comp rx=0 tx=0).stop 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 shutdown_connections 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969015a400 0x7f96900cee90 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f967c067320 0x7f967c0697d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96900cb5a0 0x7f9690150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 --2- 172.21.15.26:0/2052639892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96900cb970 0x7f96900ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 >> 172.21.15.26:0/2052639892 conn(0x7f9690070e30 msgr2=0x7f96900b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 shutdown_connections 2023-10-09T11:47:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.757+0000 7f9695f66700 1 -- 172.21.15.26:0/2052639892 wait complete. 2023-10-09T11:47:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T11:47:10.770 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T11:47:10.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.892+0000 7f5609d3c700 1 Processor -- start 2023-10-09T11:47:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.892+0000 7f5609d3c700 1 -- start start 2023-10-09T11:47:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5604159530 0x7f56040ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560406dcf0 0x7f5604159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5604159e40 0x7f56040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56040ccfd0 con 0x7f5604159530 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560415a410 con 0x7f5604159e40 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5609d3c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560415a6f0 con 0x7f560406dcf0 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f56037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5604159530 0x7f56040ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f56037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5604159530 0x7f56040ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39752/0 (socket says 172.21.15.26:39752) 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f56037fe700 1 -- 172.21.15.26:0/346825954 learned_addr learned my addr 172.21.15.26:0/346825954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5602ffd700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560406dcf0 0x7f5604159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.893+0000 7f5603fff700 1 --2- 172.21.15.26:0/346825954 >> v2:172.21.15.67:3300/0 conn(0x7f5604159e40 0x7f56040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 -- 172.21.15.26:0/346825954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560406dcf0 msgr2=0x7f5604159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560406dcf0 0x7f5604159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 -- 172.21.15.26:0/346825954 >> v2:172.21.15.67:3300/0 conn(0x7f5604159e40 msgr2=0x7f56040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 --2- 172.21.15.26:0/346825954 >> v2:172.21.15.67:3300/0 conn(0x7f5604159e40 0x7f56040cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 -- 172.21.15.26:0/346825954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560415a9d0 con 0x7f5604159530 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56037fe700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5604159530 0x7f56040ceba0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f56040caf20 tx=0x7f55f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4040d705c0c74098 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56027fc700 1 -- 172.21.15.26:0/346825954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400b640 con 0x7f5604159530 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56027fc700 1 -- 172.21.15.26:0/346825954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400b7a0 con 0x7f5604159530 2023-10-09T11:47:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f56027fc700 1 -- 172.21.15.26:0/346825954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400bb60 con 0x7f5604159530 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f5609d3c700 1 -- 172.21.15.26:0/346825954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5604159530 msgr2=0x7f56040ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.894+0000 7f5609d3c700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5604159530 0x7f56040ceba0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f56040caf20 tx=0x7f55f4009250 comp rx=0 tx=0).stop 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 -- 172.21.15.26:0/346825954 shutdown_connections 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 --2- 172.21.15.26:0/346825954 >> v2:172.21.15.67:3300/0 conn(0x7f5604159e40 0x7f56040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5604159530 0x7f56040ceba0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 --2- 172.21.15.26:0/346825954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f560406dcf0 0x7f5604159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 -- 172.21.15.26:0/346825954 >> 172.21.15.26:0/346825954 conn(0x7f56040703a0 msgr2=0x7f56040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 -- 172.21.15.26:0/346825954 shutdown_connections 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.895+0000 7f5609d3c700 1 -- 172.21.15.26:0/346825954 wait complete. 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.896+0000 7f5609d3c700 1 Processor -- start 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.896+0000 7f5609d3c700 1 -- start start 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 0x7f560415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5604159530 0x7f56040b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5604159e40 0x7f56041543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041699e0 con 0x7f560406dcf0 2023-10-09T11:47:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040b5da0 con 0x7f5604159e40 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040b4f10 con 0x7f5604159530 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 0x7f560415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 0x7f560415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39756/0 (socket says 172.21.15.26:39756) 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 -- 172.21.15.26:0/347283659 learned_addr learned my addr 172.21.15.26:0/347283659 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5602ffd700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5604159530 0x7f56040b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5603fff700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5604159e40 0x7f56041543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 -- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5604159530 msgr2=0x7f56040b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5604159530 0x7f56040b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 -- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5604159e40 msgr2=0x7f56041543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5604159e40 0x7f56041543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40094f0 con 0x7f560406dcf0 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5603fff700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5604159e40 0x7f56041543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5602ffd700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5604159530 0x7f56040b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f56037fe700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 0x7f560415dd70 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4000d10 con 0x7f560406dcf0 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400bb20 con 0x7f560406dcf0 2023-10-09T11:47:10.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5604154920 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4011670 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.897+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56040b5470 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.898+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f560404c3c0 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.899+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55f40119e0 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.899+0000 7f55eb7fe700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067320 0x7f55f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.899+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f55f4086140 con 0x7f560406dcf0 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.899+0000 7f55eb7fe700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f55f006d000 0x7f55f006f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:10.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55f006fae0 con 0x7f55f006d000 2023-10-09T11:47:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55f40886a0 con 0x7f560406dcf0 2023-10-09T11:47:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f5602ffd700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067320 0x7f55f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f5603fff700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f55f006d000 0x7f55f006f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f5603fff700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f55f006d000 0x7f55f006f410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.900+0000 7f5602ffd700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067320 0x7f55f00697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f55f8006f00 tx=0x7f55f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.901+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== osd.3 v2:172.21.15.26:6801/90834 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f55f006fae0 con 0x7f55f006d000 2023-10-09T11:47:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.914+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 --> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f560415acb0 con 0x7f55f006d000 2023-10-09T11:47:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f55eb7fe700 1 -- 172.21.15.26:0/347283659 <== osd.3 v2:172.21.15.26:6801/90834 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f560415acb0 con 0x7f55f006d000 2023-10-09T11:47:10.916 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:10.916 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:10.916 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f55f006d000 msgr2=0x7f55f006f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:6801/90834,v1:172.21.15.26:6803/90834] conn(0x7f55f006d000 0x7f55f006f410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067320 msgr2=0x7f55f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f55f0067320 0x7f55f00697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f55f8006f00 tx=0x7f55f8008040 comp rx=0 tx=0).stop 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 msgr2=0x7f560415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 --2- 172.21.15.26:0/347283659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560406dcf0 0x7f560415dd70 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5603fff700 1 -- 172.21.15.26:0/347283659 reap_dead start 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 shutdown_connections 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 >> 172.21.15.26:0/347283659 conn(0x7f56040703a0 msgr2=0x7f56040cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 shutdown_connections 2023-10-09T11:47:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:10.915+0000 7f5609d3c700 1 -- 172.21.15.26:0/347283659 wait complete. 2023-10-09T11:47:10.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T11:47:11.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.048+0000 7fe49410c700 1 Processor -- start 2023-10-09T11:47:11.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 -- start start 2023-10-09T11:47:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe48c0cb5a0 0x7fe48c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c15ae40 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c0d13f0 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.049+0000 7fe49410c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c15ab60 con 0x7fe48c15a5d0 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe48c0cb5a0 0x7fe48c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe48c0cb5a0 0x7fe48c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39762/0 (socket says 172.21.15.26:39762) 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 -- 172.21.15.26:0/3723457748 learned_addr learned my addr 172.21.15.26:0/3723457748 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe4926a9700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 -- 172.21.15.26:0/3723457748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 msgr2=0x7fe48c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 -- 172.21.15.26:0/3723457748 >> v1:172.21.15.67:6789/0 conn(0x7fe48c0cd9e0 legacy=0x7fe48c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 -- 172.21.15.26:0/3723457748 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0ccf00 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe4926a9700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe491ea8700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c0cb970 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe484009f50 tx=0x7fe484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fee5d13749ffd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe490ea6700 1 -- 172.21.15.26:0/3723457748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48400e070 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe490ea6700 1 -- 172.21.15.26:0/3723457748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48400ba30 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.050+0000 7fe490ea6700 1 -- 172.21.15.26:0/3723457748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840092e0 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 -- 172.21.15.26:0/3723457748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cb5a0 msgr2=0x7fe48c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c0cb970 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe484009f50 tx=0x7fe484009840 comp rx=0 tx=0).stop 2023-10-09T11:47:11.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 -- 172.21.15.26:0/3723457748 shutdown_connections 2023-10-09T11:47:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 --2- 172.21.15.26:0/3723457748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c0cb970 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 -- 172.21.15.26:0/3723457748 >> 172.21.15.26:0/3723457748 conn(0x7fe48c070e30 msgr2=0x7fe48c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 -- 172.21.15.26:0/3723457748 shutdown_connections 2023-10-09T11:47:11.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.051+0000 7fe49410c700 1 -- 172.21.15.26:0/3723457748 wait complete. 2023-10-09T11:47:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.052+0000 7fe49410c700 1 Processor -- start 2023-10-09T11:47:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.052+0000 7fe49410c700 1 -- start start 2023-10-09T11:47:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c158800 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c9cc0 con 0x7fe48c0cb5a0 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe49410c700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c156840 con 0x7fe48c15a5d0 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39768/0 (socket says 172.21.15.26:39768) 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 -- 172.21.15.26:0/67406066 learned_addr learned my addr 172.21.15.26:0/67406066 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 -- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 msgr2=0x7fe48c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 -- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe48c0cb5a0 msgr2=0x7fe48c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 -- 172.21.15.26:0/67406066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009ae0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe4916a7700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe48000c600 tx=0x7fe480007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011590 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.053+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe480011710 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.054+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0c9ee0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.054+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011ad0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.054+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c0ca4a0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.055+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c04c3c0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.055+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe48001c460 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.055+0000 7fe489ffb700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 0x7fe4780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.055+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe480084720 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.056+0000 7fe491ea8700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 0x7fe4780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.056+0000 7fe491ea8700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 0x7fe4780697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe484009f50 tx=0x7fe484017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.060+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4800516b0 con 0x7fe48c0cd9e0 2023-10-09T11:47:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.253+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe48c0cd1e0 con 0x7fe478067320 2023-10-09T11:47:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.254+0000 7fe489ffb700 1 -- 172.21.15.26:0/67406066 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe48c0cd1e0 con 0x7fe478067320 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 msgr2=0x7fe4780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 0x7fe4780697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe484009f50 tx=0x7fe484017000 comp rx=0 tx=0).stop 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 msgr2=0x7fe48c0c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe48000c600 tx=0x7fe480007f60 comp rx=0 tx=0).stop 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 shutdown_connections 2023-10-09T11:47:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fe478067320 0x7fe4780697d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48c15a5d0 0x7fe48c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe48c0cb5a0 0x7fe48c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 --2- 172.21.15.26:0/67406066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0cd9e0 0x7fe48c0c9780 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.255+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 >> 172.21.15.26:0/67406066 conn(0x7fe48c070e30 msgr2=0x7fe48c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.256+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 shutdown_connections 2023-10-09T11:47:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.256+0000 7fe49410c700 1 -- 172.21.15.26:0/67406066 wait complete. 2023-10-09T11:47:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T11:47:11.269 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T11:47:11.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:11.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.391+0000 7f18e260f700 1 Processor -- start 2023-10-09T11:47:11.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.391+0000 7f18e260f700 1 -- start start 2023-10-09T11:47:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e260f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18dc0b24f0 0x7f18dc0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e260f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 0x7f18dc1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e260f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0b0c80 con 0x7f18dc0b28c0 2023-10-09T11:47:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e260f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0d10d0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e260f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0b0f60 con 0x7f18dc0b1d40 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18dc0b24f0 0x7f18dc0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18dc0b24f0 0x7f18dc0b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39782/0 (socket says 172.21.15.26:39782) 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 -- 172.21.15.26:0/3558589691 learned_addr learned my addr 172.21.15.26:0/3558589691 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e0e0c700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 0x7f18dc1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 -- 172.21.15.26:0/3558589691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 msgr2=0x7f18dc1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 0x7f18dc1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 -- 172.21.15.26:0/3558589691 >> v1:172.21.15.67:6789/0 conn(0x7f18dc0b28c0 legacy=0x7f18dc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e160d700 1 -- 172.21.15.26:0/3558589691 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc0b1240 con 0x7f18dc0b24f0 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.392+0000 7f18e0e0c700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 0x7f18dc1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e160d700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc0b0580 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009f20 tx=0x7f18cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec83d5f9d4caea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18dbfff700 1 -- 172.21.15.26:0/3558589691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00e070 con 0x7f18dc0b24f0 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18dbfff700 1 -- 172.21.15.26:0/3558589691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00ba40 con 0x7f18dc0b24f0 2023-10-09T11:47:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18dbfff700 1 -- 172.21.15.26:0/3558589691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0092e0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 -- 172.21.15.26:0/3558589691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 msgr2=0x7f18dc0b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc0b0580 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009f20 tx=0x7f18cc009840 comp rx=0 tx=0).stop 2023-10-09T11:47:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 -- 172.21.15.26:0/3558589691 shutdown_connections 2023-10-09T11:47:11.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc0b0580 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 --2- 172.21.15.26:0/3558589691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b1d40 0x7f18dc1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 -- 172.21.15.26:0/3558589691 >> 172.21.15.26:0/3558589691 conn(0x7f18dc0703a0 msgr2=0x7f18dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 -- 172.21.15.26:0/3558589691 shutdown_connections 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.393+0000 7f18e260f700 1 -- 172.21.15.26:0/3558589691 wait complete. 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.394+0000 7f18e260f700 1 Processor -- start 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 -- start start 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18dc0b1d40 0x7f18dc153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b28c0 0x7f18dc155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc169a60 con 0x7f18dc0b24f0 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc153660 con 0x7f18dc0b1d40 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.395+0000 7f18e260f700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc15c450 con 0x7f18dc0b28c0 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39790/0 (socket says 172.21.15.26:39790) 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 -- 172.21.15.26:0/3492723151 learned_addr learned my addr 172.21.15.26:0/3492723151 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e160d700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18dc0b1d40 0x7f18dc153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e1e0e700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b28c0 0x7f18dc155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 -- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b28c0 msgr2=0x7f18dc155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18dc0b28c0 0x7f18dc155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 -- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18dc0b1d40 msgr2=0x7f18dc153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18dc0b1d40 0x7f18dc153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009ae0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e0e0c700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc154ef0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c850 tx=0x7f18d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011600 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0011760 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc15c730 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011b00 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.396+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc15ccf0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.397+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18dc04c3c0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.397+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f18d00073b0 con 0x7f18dc0b24f0 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18d97fa700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f18c8067320 0x7f18c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f18d0084a00 con 0x7f18dc0b24f0 2023-10-09T11:47:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18d97fa700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7f18c806d170 0x7f18c806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18c806fc50 con 0x7f18c806d170 2023-10-09T11:47:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18d0089220 con 0x7f18dc0b24f0 2023-10-09T11:47:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18e160d700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f18c8067320 0x7f18c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.398+0000 7f18e1e0e700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7f18c806d170 0x7f18c806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.399+0000 7f18e160d700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f18c8067320 0x7f18c80697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009880 tx=0x7f18cc017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.399+0000 7f18e1e0e700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7f18c806d170 0x7f18c806f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.400+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== osd.4 v2:172.21.15.67:6800/91097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f18c806fc50 con 0x7f18c806d170 2023-10-09T11:47:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.413+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 --> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f18dc0aff80 con 0x7f18c806d170 2023-10-09T11:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18d97fa700 1 -- 172.21.15.26:0/3492723151 <== osd.4 v2:172.21.15.67:6800/91097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f18dc0aff80 con 0x7f18c806d170 2023-10-09T11:47:11.415 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:11.415 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:11.415 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7f18c806d170 msgr2=0x7f18c806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6800/91097,v1:172.21.15.67:6801/91097] conn(0x7f18c806d170 0x7f18c806f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f18c8067320 msgr2=0x7f18c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f18c8067320 0x7f18c80697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009880 tx=0x7f18cc017000 comp rx=0 tx=0).stop 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 msgr2=0x7f18dc154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 --2- 172.21.15.26:0/3492723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18dc0b24f0 0x7f18dc154ef0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c850 tx=0x7f18d0008040 comp rx=0 tx=0).stop 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e1e0e700 1 -- 172.21.15.26:0/3492723151 reap_dead start 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 shutdown_connections 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 >> 172.21.15.26:0/3492723151 conn(0x7f18dc0703a0 msgr2=0x7f18dc0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 shutdown_connections 2023-10-09T11:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.414+0000 7f18e260f700 1 -- 172.21.15.26:0/3492723151 wait complete. 2023-10-09T11:47:11.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T11:47:11.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.547+0000 7fa2fd355700 1 Processor -- start 2023-10-09T11:47:11.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.547+0000 7fa2fd355700 1 -- start start 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.547+0000 7fa2fd355700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f80cb5a0 0x7fa2f80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.547+0000 7fa2fd355700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2f80cd9e0 0x7fa2f8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2fd355700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f815ae40 con 0x7fa2f80cde50 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2fd355700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f80d13f0 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2fd355700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815ab60 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa2f80cde50 0x7fa2f8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48014/0 (socket says 172.21.15.26:48014) 2023-10-09T11:47:11.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f77fe700 1 -- 172.21.15.26:0/913558940 learned_addr learned my addr 172.21.15.26:0/913558940 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/913558940 >> v2:172.21.15.67:3300/0 conn(0x7fa2f80cd9e0 0x7fa2f8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f6ffd700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f80cb5a0 0x7fa2f80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336327930 0 0) 0x7fa2f815ae40 con 0x7fa2f80cde50 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e4003570 con 0x7fa2f80cde50 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647180874 0 0) 0x7fa2e4003570 con 0x7fa2f80cde50 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 -- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f80cb5a0 msgr2=0x7fa2f80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f80cb5a0 0x7fa2f80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 -- 172.21.15.26:0/913558940 >> v1:172.21.15.26:6789/0 conn(0x7fa2f80cde50 legacy=0x7fa2f8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 -- 172.21.15.26:0/913558940 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80ccf00 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.548+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f8159ec0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00098e0 tx=0x7fa2e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735b5ac617dd4dce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0001470 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0011420 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2f5ffb700 1 -- 172.21.15.26:0/913558940 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00117c0 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 -- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 msgr2=0x7fa2f8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f8159ec0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00098e0 tx=0x7fa2e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 -- 172.21.15.26:0/913558940 shutdown_connections 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f80cb5a0 0x7fa2f80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 --2- 172.21.15.26:0/913558940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f8159ec0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 -- 172.21.15.26:0/913558940 >> 172.21.15.26:0/913558940 conn(0x7fa2f8070e30 msgr2=0x7fa2f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 -- 172.21.15.26:0/913558940 shutdown_connections 2023-10-09T11:47:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.549+0000 7fa2fd355700 1 -- 172.21.15.26:0/913558940 wait complete. 2023-10-09T11:47:11.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.550+0000 7fa2fd355700 1 Processor -- start 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.550+0000 7fa2fd355700 1 -- start start 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 0x7fa2f8155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815c520 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815c800 con 0x7fa2f80cd9e0 2023-10-09T11:47:11.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2fd355700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815cae0 con 0x7fa2f815bfc0 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39806/0 (socket says 172.21.15.26:39806) 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2f6ffd700 1 -- 172.21.15.26:0/4061309240 learned_addr learned my addr 172.21.15.26:0/4061309240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2f77fe700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 0x7fa2f8155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.551+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 -- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 msgr2=0x7fa2f8155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 0x7fa2f8155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 -- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 msgr2=0x7fa2f815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 -- 172.21.15.26:0/4061309240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0009420 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f77fe700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 0x7fa2f8155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2f6ffd700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009ef0 tx=0x7fa2e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800cc50 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f815cdc0 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8014480 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.552+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f80c9960 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.553+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f804c3c0 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.553+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa2e80147f0 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.554+0000 7fa2eeffd700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 0x7fa2d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.554+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa2e8085530 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.554+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 0x7fa2d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.555+0000 7fa2f67fc700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 0x7fa2d80697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00093f0 tx=0x7fa2e0016000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.558+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2e80523b0 con 0x7fa2f80cb5a0 2023-10-09T11:47:11.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.751+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f815c970 con 0x7fa2d8067320 2023-10-09T11:47:11.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.753+0000 7fa2eeffd700 1 -- 172.21.15.26:0/4061309240 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2f815c970 con 0x7fa2d8067320 2023-10-09T11:47:11.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 msgr2=0x7fa2d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 0x7fa2d80697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00093f0 tx=0x7fa2e0016000 comp rx=0 tx=0).stop 2023-10-09T11:47:11.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 msgr2=0x7fa2f80c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009ef0 tx=0x7fa2e800b040 comp rx=0 tx=0).stop 2023-10-09T11:47:11.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 shutdown_connections 2023-10-09T11:47:11.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fa2d8067320 0x7fa2d80697d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2f815bfc0 0x7fa2f8155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f80cb5a0 0x7fa2f80c6cc0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 --2- 172.21.15.26:0/4061309240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2f80cd9e0 0x7fa2f815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 >> 172.21.15.26:0/4061309240 conn(0x7fa2f8070e30 msgr2=0x7fa2f80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 shutdown_connections 2023-10-09T11:47:11.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.754+0000 7fa2fd355700 1 -- 172.21.15.26:0/4061309240 wait complete. 2023-10-09T11:47:11.758 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T11:47:11.767 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T11:47:11.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:11.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.890+0000 7fd972581700 1 Processor -- start 2023-10-09T11:47:11.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.890+0000 7fd972581700 1 -- start start 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd972581700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd96c0caa00 0x7fd96c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd972581700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd96c0aaec0 0x7fd96c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd972581700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0c3d00 con 0x7fd96c0c95c0 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd972581700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0c3110 con 0x7fd96c0caa00 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd972581700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0c33d0 con 0x7fd96c0aaec0 2023-10-09T11:47:11.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd970d7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd96c0caa00 0x7fd96c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd970d7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd96c0caa00 0x7fd96c1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39810/0 (socket says 172.21.15.26:39810) 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd97157f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd96c0c95c0 0x7fd96c157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48028/0 (socket says 172.21.15.26:48028) 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.891+0000 7fd970d7e700 1 -- 172.21.15.26:0/2524040746 learned_addr learned my addr 172.21.15.26:0/2524040746 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd971d80700 1 --2- 172.21.15.26:0/2524040746 >> v2:172.21.15.67:3300/0 conn(0x7fd96c0aaec0 0x7fd96c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd970d7e700 1 -- 172.21.15.26:0/2524040746 >> v2:172.21.15.67:3300/0 conn(0x7fd96c0aaec0 msgr2=0x7fd96c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd970d7e700 1 --2- 172.21.15.26:0/2524040746 >> v2:172.21.15.67:3300/0 conn(0x7fd96c0aaec0 0x7fd96c0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd970d7e700 1 -- 172.21.15.26:0/2524040746 >> v1:172.21.15.26:6789/0 conn(0x7fd96c0c95c0 legacy=0x7fd96c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd96bfff700 1 -- 172.21.15.26:0/2524040746 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092600640 0 0) 0x7fd96c0c3d00 con 0x7fd96c0c95c0 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd970d7e700 1 -- 172.21.15.26:0/2524040746 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0c36b0 con 0x7fd96c0caa00 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd970d7e700 1 --2- 172.21.15.26:0/2524040746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c0caa00 0x7fd96c1579a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0c8940 tx=0x7fd960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d2ada13dc03da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd96bfff700 1 -- 172.21.15.26:0/2524040746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000b860 con 0x7fd96c0caa00 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd96bfff700 1 -- 172.21.15.26:0/2524040746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000b9c0 con 0x7fd96c0caa00 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd96bfff700 1 -- 172.21.15.26:0/2524040746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000bd60 con 0x7fd96c0caa00 2023-10-09T11:47:11.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 -- 172.21.15.26:0/2524040746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c0caa00 msgr2=0x7fd96c1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 --2- 172.21.15.26:0/2524040746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c0caa00 0x7fd96c1579a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0c8940 tx=0x7fd960009250 comp rx=0 tx=0).stop 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 -- 172.21.15.26:0/2524040746 shutdown_connections 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 --2- 172.21.15.26:0/2524040746 >> v2:172.21.15.67:3300/0 conn(0x7fd96c0aaec0 0x7fd96c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 --2- 172.21.15.26:0/2524040746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c0caa00 0x7fd96c1579a0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.892+0000 7fd972581700 1 -- 172.21.15.26:0/2524040746 >> 172.21.15.26:0/2524040746 conn(0x7fd96c088000 msgr2=0x7fd96c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.893+0000 7fd972581700 1 -- 172.21.15.26:0/2524040746 shutdown_connections 2023-10-09T11:47:11.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.893+0000 7fd972581700 1 -- 172.21.15.26:0/2524040746 wait complete. 2023-10-09T11:47:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.894+0000 7fd972581700 1 Processor -- start 2023-10-09T11:47:11.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.894+0000 7fd972581700 1 -- start start 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd96c0aaec0 0x7fd96c147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd96c0c95c0 0x7fd96c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 0x7fd96c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c15c3a0 con 0x7fd96c15d430 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c15b790 con 0x7fd96c0c95c0 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c15ba70 con 0x7fd96c0aaec0 2023-10-09T11:47:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 0x7fd96c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 0x7fd96c155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39816/0 (socket says 172.21.15.26:39816) 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 -- 172.21.15.26:0/3299066416 learned_addr learned my addr 172.21.15.26:0/3299066416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd970d7e700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd96c0c95c0 0x7fd96c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd97157f700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd96c0aaec0 0x7fd96c147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 -- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd96c0aaec0 msgr2=0x7fd96c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd96c0aaec0 0x7fd96c147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 -- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd96c0c95c0 msgr2=0x7fd96c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd96c0c95c0 0x7fd96c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600094f0 con 0x7fd96c15d430 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd971d80700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 0x7fd96c155690 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009fa0 tx=0x7fd95c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00ebc0 con 0x7fd96c15d430 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00ed20 con 0x7fd96c15d430 2023-10-09T11:47:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c014670 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c15bd50 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.895+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c147690 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.896+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd96c04c3c0 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd95c0149e0 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd958067320 0x7fd9580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd95c085010 con 0x7fd96c15d430 2023-10-09T11:47:11.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7fd95806d170 0x7fd95806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd95806fc50 con 0x7fd95806d170 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c087510 con 0x7fd96c15d430 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.897+0000 7fd97157f700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd958067320 0x7fd9580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.898+0000 7fd970d7e700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7fd95806d170 0x7fd95806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.898+0000 7fd97157f700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd958067320 0x7fd9580697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd9640012a0 tx=0x7fd964009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.898+0000 7fd970d7e700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7fd95806d170 0x7fd95806f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:11.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.899+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== osd.5 v2:172.21.15.67:6808/91096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd95806fc50 con 0x7fd95806d170 2023-10-09T11:47:11.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.913+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 --> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd96c0c3990 con 0x7fd95806d170 2023-10-09T11:47:11.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.913+0000 7fd9697fa700 1 -- 172.21.15.26:0/3299066416 <== osd.5 v2:172.21.15.67:6808/91096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd96c0c3990 con 0x7fd95806d170 2023-10-09T11:47:11.915 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:11.915 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:11.915 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:11.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7fd95806d170 msgr2=0x7fd95806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6808/91096,v1:172.21.15.67:6809/91096] conn(0x7fd95806d170 0x7fd95806f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:11.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd958067320 msgr2=0x7fd9580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fd958067320 0x7fd9580697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd9640012a0 tx=0x7fd964009040 comp rx=0 tx=0).stop 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 msgr2=0x7fd96c155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 --2- 172.21.15.26:0/3299066416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96c15d430 0x7fd96c155690 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009fa0 tx=0x7fd95c009900 comp rx=0 tx=0).stop 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd971d80700 1 -- 172.21.15.26:0/3299066416 reap_dead start 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 shutdown_connections 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 >> 172.21.15.26:0/3299066416 conn(0x7fd96c088000 msgr2=0x7fd96c0690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 shutdown_connections 2023-10-09T11:47:11.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:11.914+0000 7fd972581700 1 -- 172.21.15.26:0/3299066416 wait complete. 2023-10-09T11:47:11.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T11:47:12.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.045+0000 7fb9af7b8700 1 Processor -- start 2023-10-09T11:47:12.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.045+0000 7fb9af7b8700 1 -- start start 2023-10-09T11:47:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9af7b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9a815a5d0 0x7fb9a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9af7b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a815ae40 con 0x7fb9a80cb970 2023-10-09T11:47:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9af7b8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a815ab60 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9af7b8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a80ce0f0 con 0x7fb9a815a5d0 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9add55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9a815a5d0 0x7fb9a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9acd53700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb9a80cb970 0x7fb9a8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48038/0 (socket says 172.21.15.26:48038) 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.046+0000 7fb9acd53700 1 -- 172.21.15.26:0/2016479392 learned_addr learned my addr 172.21.15.26:0/2016479392 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9add55700 1 -- 172.21.15.26:0/2016479392 >> v1:172.21.15.67:6789/0 conn(0x7fb9a80cb5a0 legacy=0x7fb9a80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9add55700 1 -- 172.21.15.26:0/2016479392 >> v1:172.21.15.26:6789/0 conn(0x7fb9a80cb970 legacy=0x7fb9a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9a7fff700 1 -- 172.21.15.26:0/2016479392 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994448150 0 0) 0x7fb9a815ab60 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9add55700 1 -- 172.21.15.26:0/2016479392 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80ccf00 con 0x7fb9a815a5d0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9add55700 1 --2- 172.21.15.26:0/2016479392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a815a5d0 0x7fb9a8156e90 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098e0 tx=0x7fb9a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e9a377c23317ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9a7fff700 1 -- 172.21.15.26:0/2016479392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0009e80 con 0x7fb9a815a5d0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9a7fff700 1 -- 172.21.15.26:0/2016479392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a000b760 con 0x7fb9a815a5d0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.047+0000 7fb9a7fff700 1 -- 172.21.15.26:0/2016479392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000bae0 con 0x7fb9a815a5d0 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 -- 172.21.15.26:0/2016479392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a815a5d0 msgr2=0x7fb9a8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/2016479392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a815a5d0 0x7fb9a8156e90 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098e0 tx=0x7fb9a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 -- 172.21.15.26:0/2016479392 shutdown_connections 2023-10-09T11:47:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/2016479392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a815a5d0 0x7fb9a8156e90 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 -- 172.21.15.26:0/2016479392 >> 172.21.15.26:0/2016479392 conn(0x7fb9a8070e30 msgr2=0x7fb9a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 -- 172.21.15.26:0/2016479392 shutdown_connections 2023-10-09T11:47:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.048+0000 7fb9af7b8700 1 -- 172.21.15.26:0/2016479392 wait complete. 2023-10-09T11:47:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.049+0000 7fb9af7b8700 1 Processor -- start 2023-10-09T11:47:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.049+0000 7fb9af7b8700 1 -- start start 2023-10-09T11:47:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a80cb970 0x7fb9a8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9a815a5d0 0x7fb9a81571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815cc00 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a8151730 con 0x7fb9a80cb970 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815bff0 con 0x7fb9a815a5d0 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39842/0 (socket says 172.21.15.26:39842) 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 -- 172.21.15.26:0/387822798 learned_addr learned my addr 172.21.15.26:0/387822798 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9acd53700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a80cb970 0x7fb9a8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9add55700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9a815a5d0 0x7fb9a81571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 -- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9a815a5d0 msgr2=0x7fb9a81571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9a815a5d0 0x7fb9a81571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 -- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a80cb970 msgr2=0x7fb9a8156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a80cb970 0x7fb9a8156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 -- 172.21.15.26:0/387822798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009420 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9ad554700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb99800cb60 tx=0x7fb9980017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800a7b0 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99800a930 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a815c2d0 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.050+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800acf0 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.051+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a815c890 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.052+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a804c3c0 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.052+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb998003030 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.052+0000 7fb9a57fa700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 0x7fb9940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.052+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb998084aa0 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.052+0000 7fb9acd53700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 0x7fb9940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.053+0000 7fb9acd53700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 0x7fb9940697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cdc90 tx=0x7fb99c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.056+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb998051a30 con 0x7fb9a80cb5a0 2023-10-09T11:47:12.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.250+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9a815cd40 con 0x7fb994067320 2023-10-09T11:47:12.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.251+0000 7fb9a57fa700 1 -- 172.21.15.26:0/387822798 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb99c005900 con 0x7fb994067320 2023-10-09T11:47:12.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 msgr2=0x7fb9940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 0x7fb9940697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cdc90 tx=0x7fb99c009040 comp rx=0 tx=0).stop 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 msgr2=0x7fb9a80b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb99800cb60 tx=0x7fb9980017a0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 shutdown_connections 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fb994067320 0x7fb9940697d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9a815a5d0 0x7fb9a81571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9a80cb5a0 0x7fb9a80b53d0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 --2- 172.21.15.26:0/387822798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a80cb970 0x7fb9a8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 >> 172.21.15.26:0/387822798 conn(0x7fb9a8070e30 msgr2=0x7fb9a8153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 shutdown_connections 2023-10-09T11:47:12.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.253+0000 7fb9af7b8700 1 -- 172.21.15.26:0/387822798 wait complete. 2023-10-09T11:47:12.257 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T11:47:12.266 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T11:47:12.267 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.388+0000 7ff7ebb21700 1 Processor -- start 2023-10-09T11:47:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.388+0000 7ff7ebb21700 1 -- start start 2023-10-09T11:47:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ebb21700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7e40cb880 0x7ff7e40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ebb21700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7e40cd770 0x7ff7e41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ebb21700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40cf330 con 0x7ff7e40b04f0 2023-10-09T11:47:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ebb21700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40cdbd0 con 0x7ff7e40cd770 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ebb21700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40cead0 con 0x7ff7e40cb880 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ea0be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7e40cd770 0x7ff7e41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ea0be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7e40cd770 0x7ff7e41591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39858/0 (socket says 172.21.15.26:39858) 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.389+0000 7ff7ea0be700 1 -- 172.21.15.26:0/2406139892 learned_addr learned my addr 172.21.15.26:0/2406139892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7e98bd700 1 --2- 172.21.15.26:0/2406139892 >> v2:172.21.15.67:3300/0 conn(0x7ff7e40cb880 0x7ff7e40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ea0be700 1 -- 172.21.15.26:0/2406139892 >> v2:172.21.15.67:3300/0 conn(0x7ff7e40cb880 msgr2=0x7ff7e40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ea0be700 1 --2- 172.21.15.26:0/2406139892 >> v2:172.21.15.67:3300/0 conn(0x7ff7e40cb880 0x7ff7e40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ea0be700 1 -- 172.21.15.26:0/2406139892 >> v1:172.21.15.67:6789/0 conn(0x7ff7e40b04f0 legacy=0x7ff7e40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ea0be700 1 -- 172.21.15.26:0/2406139892 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40cddd0 con 0x7ff7e40cd770 2023-10-09T11:47:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ea0be700 1 --2- 172.21.15.26:0/2406139892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e41591e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40ce1c0 tx=0x7ff7d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675feaaaf6d108b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7e88bb700 1 -- 172.21.15.26:0/2406139892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400e070 con 0x7ff7e40cd770 2023-10-09T11:47:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7e88bb700 1 -- 172.21.15.26:0/2406139892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400ba10 con 0x7ff7e40cd770 2023-10-09T11:47:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7e88bb700 1 -- 172.21.15.26:0/2406139892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40092e0 con 0x7ff7e40cd770 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 -- 172.21.15.26:0/2406139892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 msgr2=0x7ff7e41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/2406139892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e41591e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40ce1c0 tx=0x7ff7d4009840 comp rx=0 tx=0).stop 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 -- 172.21.15.26:0/2406139892 shutdown_connections 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/2406139892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e41591e0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/2406139892 >> v2:172.21.15.67:3300/0 conn(0x7ff7e40cb880 0x7ff7e40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.390+0000 7ff7ebb21700 1 -- 172.21.15.26:0/2406139892 >> 172.21.15.26:0/2406139892 conn(0x7ff7e40703a0 msgr2=0x7ff7e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.391+0000 7ff7ebb21700 1 -- 172.21.15.26:0/2406139892 shutdown_connections 2023-10-09T11:47:12.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.391+0000 7ff7ebb21700 1 -- 172.21.15.26:0/2406139892 wait complete. 2023-10-09T11:47:12.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 Processor -- start 2023-10-09T11:47:12.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 -- start start 2023-10-09T11:47:12.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7e40b04f0 0x7ff7e40b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7e40cb880 0x7ff7e40c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40b54c0 con 0x7ff7e40cd770 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e41590e0 con 0x7ff7e40cb880 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ebb21700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e415b850 con 0x7ff7e40b04f0 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.392+0000 7ff7ea0be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e40ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39874/0 (socket says 172.21.15.26:39874) 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 -- 172.21.15.26:0/1051737633 learned_addr learned my addr 172.21.15.26:0/1051737633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7e90bc700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7e40cb880 0x7ff7e40c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7e98bd700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7e40b04f0 0x7ff7e40b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 -- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7e40b04f0 msgr2=0x7ff7e40b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7e40b04f0 0x7ff7e40b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 -- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7e40cb880 msgr2=0x7ff7e40c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7e40cb880 0x7ff7e40c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4009ae0 con 0x7ff7e40cd770 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ea0be700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e40ca2c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fd0 tx=0x7ff7d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40032f0 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4012d30 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e40c88e0 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4012ea0 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.393+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e40b4f00 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.394+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7e404c3c0 con 0x7ff7e40cd770 2023-10-09T11:47:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff7d401d8a0 con 0x7ff7e40cd770 2023-10-09T11:47:12.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff7d0067320 0x7ff7d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff7d4086260 con 0x7ff7e40cd770 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7ff7d006d170 0x7ff7d006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e98bd700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff7d0067320 0x7ff7d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7d006fc50 con 0x7ff7d006d170 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7d40887c0 con 0x7ff7e40cd770 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.395+0000 7ff7e90bc700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7ff7d006d170 0x7ff7d006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.396+0000 7ff7e98bd700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff7d0067320 0x7ff7d00697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006fd0 tx=0x7ff7dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.396+0000 7ff7e90bc700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7ff7d006d170 0x7ff7d006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.397+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== osd.6 v2:172.21.15.67:6816/91126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff7d006fc50 con 0x7ff7d006d170 2023-10-09T11:47:12.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.410+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 --> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff7e40b52a0 con 0x7ff7d006d170 2023-10-09T11:47:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7e1ffb700 1 -- 172.21.15.26:0/1051737633 <== osd.6 v2:172.21.15.67:6816/91126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff7e40b52a0 con 0x7ff7d006d170 2023-10-09T11:47:12.412 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:12.412 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:12.412 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7ff7d006d170 msgr2=0x7ff7d006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6816/91126,v1:172.21.15.67:6817/91126] conn(0x7ff7d006d170 0x7ff7d006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff7d0067320 msgr2=0x7ff7d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7ff7d0067320 0x7ff7d00697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006fd0 tx=0x7ff7dc008040 comp rx=0 tx=0).stop 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 msgr2=0x7ff7e40ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 --2- 172.21.15.26:0/1051737633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40cd770 0x7ff7e40ca2c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fd0 tx=0x7ff7d4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ea0be700 1 -- 172.21.15.26:0/1051737633 reap_dead start 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 shutdown_connections 2023-10-09T11:47:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 >> 172.21.15.26:0/1051737633 conn(0x7ff7e40703a0 msgr2=0x7ff7e41580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 shutdown_connections 2023-10-09T11:47:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.411+0000 7ff7ebb21700 1 -- 172.21.15.26:0/1051737633 wait complete. 2023-10-09T11:47:12.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T11:47:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.544+0000 7efe7bf43700 1 Processor -- start 2023-10-09T11:47:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.544+0000 7efe7bf43700 1 -- start start 2023-10-09T11:47:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7bf43700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7bf43700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe740cd9e0 0x7efe74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7bf43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7415ae40 con 0x7efe740cde50 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7bf43700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740d13f0 con 0x7efe740cd9e0 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7bf43700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415ab60 con 0x7efe740cb5a0 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe740cd9e0 0x7efe74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7a4e0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe740cde50 0x7efe74156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48042/0 (socket says 172.21.15.26:48042) 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe740cd9e0 0x7efe74159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39878/0 (socket says 172.21.15.26:39878) 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe7a4e0700 1 -- 172.21.15.26:0/1922854215 learned_addr learned my addr 172.21.15.26:0/1922854215 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe79cdf700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 -- 172.21.15.26:0/1922854215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 msgr2=0x7efe740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe740cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 -- 172.21.15.26:0/1922854215 >> v1:172.21.15.26:6789/0 conn(0x7efe740cde50 legacy=0x7efe74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 -- 172.21.15.26:0/1922854215 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740ccf00 con 0x7efe740cd9e0 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe78cdd700 1 -- 172.21.15.26:0/1922854215 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398686636 0 0) 0x7efe7415ae40 con 0x7efe740cde50 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe794de700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe74159ec0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7efe680098e0 tx=0x7efe680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175a0946d2c65d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe78cdd700 1 -- 172.21.15.26:0/1922854215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68009e80 con 0x7efe740cd9e0 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe78cdd700 1 -- 172.21.15.26:0/1922854215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800b860 con 0x7efe740cd9e0 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.545+0000 7efe78cdd700 1 -- 172.21.15.26:0/1922854215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800bbe0 con 0x7efe740cd9e0 2023-10-09T11:47:12.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 -- 172.21.15.26:0/1922854215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 msgr2=0x7efe74159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe74159ec0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7efe680098e0 tx=0x7efe680091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 -- 172.21.15.26:0/1922854215 shutdown_connections 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 --2- 172.21.15.26:0/1922854215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe74159ec0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 -- 172.21.15.26:0/1922854215 >> 172.21.15.26:0/1922854215 conn(0x7efe74070e30 msgr2=0x7efe740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 -- 172.21.15.26:0/1922854215 shutdown_connections 2023-10-09T11:47:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.546+0000 7efe7bf43700 1 -- 172.21.15.26:0/1922854215 wait complete. 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.547+0000 7efe7bf43700 1 Processor -- start 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.547+0000 7efe7bf43700 1 -- start start 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe74156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe740ca000 0x7efe740b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b5320 con 0x7efe740cd9e0 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b4710 con 0x7efe740ca000 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe7bf43700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b49f0 con 0x7efe740cb5a0 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39880/0 (socket says 172.21.15.26:39880) 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 -- 172.21.15.26:0/2941871006 learned_addr learned my addr 172.21.15.26:0/2941871006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 -- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 msgr2=0x7efe74156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe74156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 -- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe740ca000 msgr2=0x7efe740b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe740ca000 0x7efe740b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 -- 172.21.15.26:0/2941871006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009420 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe794de700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7efe7406ea60 tx=0x7efe68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.548+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800bbe0 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.549+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68011420 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.549+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe740b4cd0 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.549+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680117c0 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.549+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe74156740 con 0x7efe740cd9e0 2023-10-09T11:47:12.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.550+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7404c3c0 con 0x7efe740cd9e0 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.550+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efe68011bb0 con 0x7efe740cd9e0 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.551+0000 7efe71ffb700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 0x7efe600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.551+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efe680861d0 con 0x7efe740cd9e0 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.551+0000 7efe79cdf700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 0x7efe600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.551+0000 7efe79cdf700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 0x7efe600697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe64007ec0 tx=0x7efe640073b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.555+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe68053120 con 0x7efe740cd9e0 2023-10-09T11:47:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.749+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efe740cd1e0 con 0x7efe60067320 2023-10-09T11:47:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.749+0000 7efe71ffb700 1 -- 172.21.15.26:0/2941871006 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efe740cd1e0 con 0x7efe60067320 2023-10-09T11:47:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 msgr2=0x7efe600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 0x7efe600697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe64007ec0 tx=0x7efe640073b0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 msgr2=0x7efe740c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7efe7406ea60 tx=0x7efe68017000 comp rx=0 tx=0).stop 2023-10-09T11:47:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 shutdown_connections 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe740ca000 0x7efe740b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7efe60067320 0x7efe600697d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efe740cb5a0 0x7efe74156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 --2- 172.21.15.26:0/2941871006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe740cd9e0 0x7efe740c9ac0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.751+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 >> 172.21.15.26:0/2941871006 conn(0x7efe74070e30 msgr2=0x7efe740b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.752+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 shutdown_connections 2023-10-09T11:47:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.752+0000 7efe7bf43700 1 -- 172.21.15.26:0/2941871006 wait complete. 2023-10-09T11:47:12.755 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T11:47:12.766 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T11:47:12.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.887+0000 7f28e11c0700 1 Processor -- start 2023-10-09T11:47:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.887+0000 7f28e11c0700 1 -- start start 2023-10-09T11:47:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28e11c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28dc0cd770 0x7f28dc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28e11c0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28dc0b04f0 0x7f28dc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28e11c0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc0cf330 con 0x7f28dc0cb880 2023-10-09T11:47:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28e11c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0cead0 con 0x7f28dc0cd770 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28e11c0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0cdbc0 con 0x7f28dc0b04f0 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28da59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28dc0cd770 0x7f28dc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28da59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28dc0cd770 0x7f28dc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39886/0 (socket says 172.21.15.26:39886) 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.888+0000 7f28da59c700 1 -- 172.21.15.26:0/26923367 learned_addr learned my addr 172.21.15.26:0/26923367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28db59e700 1 --2- 172.21.15.26:0/26923367 >> v2:172.21.15.67:3300/0 conn(0x7f28dc0b04f0 0x7f28dc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28da59c700 1 -- 172.21.15.26:0/26923367 >> v2:172.21.15.67:3300/0 conn(0x7f28dc0b04f0 msgr2=0x7f28dc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28da59c700 1 --2- 172.21.15.26:0/26923367 >> v2:172.21.15.67:3300/0 conn(0x7f28dc0b04f0 0x7f28dc1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28da59c700 1 -- 172.21.15.26:0/26923367 >> v1:172.21.15.67:6789/0 conn(0x7f28dc0cb880 legacy=0x7f28dc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28da59c700 1 -- 172.21.15.26:0/26923367 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0cddd0 con 0x7f28dc0cd770 2023-10-09T11:47:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28da59c700 1 --2- 172.21.15.26:0/26923367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0cbc50 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0ccab0 tx=0x7f28c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b34f1aaf531e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28d9d9b700 1 -- 172.21.15.26:0/26923367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400b860 con 0x7f28dc0cd770 2023-10-09T11:47:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28d9d9b700 1 -- 172.21.15.26:0/26923367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400b9c0 con 0x7f28dc0cd770 2023-10-09T11:47:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28d9d9b700 1 -- 172.21.15.26:0/26923367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400bd60 con 0x7f28dc0cd770 2023-10-09T11:47:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28e11c0700 1 -- 172.21.15.26:0/26923367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 msgr2=0x7f28dc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.889+0000 7f28e11c0700 1 --2- 172.21.15.26:0/26923367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0cbc50 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0ccab0 tx=0x7f28c4009250 comp rx=0 tx=0).stop 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 -- 172.21.15.26:0/26923367 shutdown_connections 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 --2- 172.21.15.26:0/26923367 >> v2:172.21.15.67:3300/0 conn(0x7f28dc0b04f0 0x7f28dc1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 --2- 172.21.15.26:0/26923367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0cbc50 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 -- 172.21.15.26:0/26923367 >> 172.21.15.26:0/26923367 conn(0x7f28dc0703a0 msgr2=0x7f28dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 -- 172.21.15.26:0/26923367 shutdown_connections 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.890+0000 7f28e11c0700 1 -- 172.21.15.26:0/26923367 wait complete. 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.891+0000 7f28e11c0700 1 Processor -- start 2023-10-09T11:47:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.891+0000 7f28e11c0700 1 -- start start 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.891+0000 7f28e11c0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28dc0b04f0 0x7f28dc169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.891+0000 7f28e11c0700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28dc0cb880 0x7f28dc16c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1598e0 con 0x7f28dc0cd770 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c9690 con 0x7f28dc0b04f0 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc158fb0 con 0x7f28dc0cb880 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39894/0 (socket says 172.21.15.26:39894) 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 -- 172.21.15.26:0/2846826148 learned_addr learned my addr 172.21.15.26:0/2846826148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28dad9d700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28dc0b04f0 0x7f28dc169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28da59c700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28dc0cb880 0x7f28dc16c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 -- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28dc0cb880 msgr2=0x7f28dc16c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28dc0cb880 0x7f28dc16c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 -- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28dc0b04f0 msgr2=0x7f28dc169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28dc0b04f0 0x7f28dc169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40094f0 con 0x7f28dc0cd770 2023-10-09T11:47:12.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28da59c700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28dc0cb880 0x7f28dc16c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28db59e700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0b1100 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d890 tx=0x7f28d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40125f0 con 0x7f28dc0cd770 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4012770 con 0x7f28dc0cd770 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4012b30 con 0x7f28dc0cd770 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc159290 con 0x7f28dc0cd770 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.892+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc169fc0 con 0x7f28dc0cd770 2023-10-09T11:47:12.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.893+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28dc04c3c0 con 0x7f28dc0cd770 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f28d401e460 con 0x7f28dc0cd770 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28bc067320 0x7f28bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f28d4084f10 con 0x7f28dc0cd770 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f28bc06d170 0x7f28bc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28bc06fc50 con 0x7f28bc06d170 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=203) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28d4087470 con 0x7f28dc0cd770 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.894+0000 7f28dad9d700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28bc067320 0x7f28bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.895+0000 7f28da59c700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f28bc06d170 0x7f28bc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:12.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.895+0000 7f28dad9d700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28bc067320 0x7f28bc0697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f28cc007fd0 tx=0x7f28cc0016f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.895+0000 7f28da59c700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f28bc06d170 0x7f28bc06f580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:12.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.896+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== osd.7 v2:172.21.15.67:6824/91127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f28bc06fc50 con 0x7f28bc06d170 2023-10-09T11:47:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.910+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 --> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f28dc0cece0 con 0x7f28bc06d170 2023-10-09T11:47:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.910+0000 7f28d2ffd700 1 -- 172.21.15.26:0/2846826148 <== osd.7 v2:172.21.15.67:6824/91127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f28dc0cece0 con 0x7f28bc06d170 2023-10-09T11:47:12.912 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-09T11:47:12.912 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T11:47:12.912 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-09T11:47:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f28bc06d170 msgr2=0x7f28bc06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6824/91127,v1:172.21.15.67:6825/91127] conn(0x7f28bc06d170 0x7f28bc06f580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28bc067320 msgr2=0x7f28bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f28bc067320 0x7f28bc0697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f28cc007fd0 tx=0x7f28cc0016f0 comp rx=0 tx=0).stop 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 msgr2=0x7f28dc0b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 --2- 172.21.15.26:0/2846826148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28dc0cd770 0x7f28dc0b1100 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d890 tx=0x7f28d4008040 comp rx=0 tx=0).stop 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28db59e700 1 -- 172.21.15.26:0/2846826148 reap_dead start 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 shutdown_connections 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 >> 172.21.15.26:0/2846826148 conn(0x7f28dc0703a0 msgr2=0x7f28dc06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 shutdown_connections 2023-10-09T11:47:12.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:12.911+0000 7f28e11c0700 1 -- 172.21.15.26:0/2846826148 wait complete. 2023-10-09T11:47:12.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T11:47:13.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.042+0000 7f2feb3b1700 1 Processor -- start 2023-10-09T11:47:13.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 -- start start 2023-10-09T11:47:13.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe406e550 0x7f2fe40af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe40aeee0 con 0x7f2fe40a90d0 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe40ae680 con 0x7f2fe406e550 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.043+0000 7f2feb3b1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40cf490 con 0x7f2fe40a8d00 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe406e550 0x7f2fe40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe894c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2fe40a90d0 0x7f2fe406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48050/0 (socket says 172.21.15.26:48050) 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe894c700 1 -- 172.21.15.26:0/3448766818 learned_addr learned my addr 172.21.15.26:0/3448766818 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe914d700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 -- 172.21.15.26:0/3448766818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 msgr2=0x7f2fe40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 -- 172.21.15.26:0/3448766818 >> v1:172.21.15.26:6789/0 conn(0x7f2fe40a90d0 legacy=0x7f2fe406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 -- 172.21.15.26:0/3448766818 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe40ce330 con 0x7f2fe406e550 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe3fff700 1 -- 172.21.15.26:0/3448766818 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334744852 0 0) 0x7f2fe40aeee0 con 0x7f2fe40a90d0 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe914d700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe994e700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe40af370 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0098e0 tx=0x7f2fdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d61a1c29407ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe3fff700 1 -- 172.21.15.26:0/3448766818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc009e80 con 0x7f2fe406e550 2023-10-09T11:47:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe3fff700 1 -- 172.21.15.26:0/3448766818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc00b860 con 0x7f2fe406e550 2023-10-09T11:47:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.044+0000 7f2fe3fff700 1 -- 172.21.15.26:0/3448766818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00bbe0 con 0x7f2fe406e550 2023-10-09T11:47:13.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 -- 172.21.15.26:0/3448766818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 msgr2=0x7f2fe40af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe40af370 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0098e0 tx=0x7f2fdc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 -- 172.21.15.26:0/3448766818 shutdown_connections 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe40af370 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/3448766818 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 -- 172.21.15.26:0/3448766818 >> 172.21.15.26:0/3448766818 conn(0x7f2fe406ce80 msgr2=0x7f2fe40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 -- 172.21.15.26:0/3448766818 shutdown_connections 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.045+0000 7f2feb3b1700 1 -- 172.21.15.26:0/3448766818 wait complete. 2023-10-09T11:47:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.046+0000 7f2feb3b1700 1 Processor -- start 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.046+0000 7f2feb3b1700 1 -- start start 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fe40a90d0 0x7f2fe40cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe409b430 con 0x7f2fe406e550 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe409a860 con 0x7f2fe40a90d0 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2feb3b1700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe409ab00 con 0x7f2fe40a8d00 2023-10-09T11:47:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39898/0 (socket says 172.21.15.26:39898) 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 -- 172.21.15.26:0/2532353262 learned_addr learned my addr 172.21.15.26:0/2532353262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 -- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 msgr2=0x7f2fe40c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 -- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fe40a90d0 msgr2=0x7f2fe40cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fe40a90d0 0x7f2fe40cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 -- 172.21.15.26:0/2532353262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc009420 con 0x7f2fe406e550 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.047+0000 7f2fe914d700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400a300 tx=0x7f2fd40078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.048+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4015440 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.048+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40155a0 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.048+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe409ade0 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.048+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4015920 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.048+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe409b8c0 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.049+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe409b710 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.049+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2fd4015cd0 con 0x7f2fe406e550 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.049+0000 7f2fe17fa700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 0x7f2fd00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.049+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2fd40850a0 con 0x7f2fe406e550 2023-10-09T11:47:13.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.050+0000 7f2fe894c700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 0x7f2fd00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.050+0000 7f2fe894c700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 0x7f2fd00697d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2fe416d040 tx=0x7f2fd8007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.054+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fd404e5a0 con 0x7f2fe406e550 2023-10-09T11:47:13.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.250+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fe409b570 con 0x7f2fd0067320 2023-10-09T11:47:13.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.251+0000 7f2fe17fa700 1 -- 172.21.15.26:0/2532353262 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2fd80070d0 con 0x7f2fd0067320 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 msgr2=0x7f2fd00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 0x7f2fd00697d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2fe416d040 tx=0x7f2fd8007a40 comp rx=0 tx=0).stop 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 msgr2=0x7f2fe41508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400a300 tx=0x7f2fd40078c0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 shutdown_connections 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fe40a90d0 0x7f2fe40cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe406e550 0x7f2fe41508b0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f2fd0067320 0x7f2fd00697d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 --2- 172.21.15.26:0/2532353262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fe40a8d00 0x7f2fe40c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 >> 172.21.15.26:0/2532353262 conn(0x7f2fe406ce80 msgr2=0x7f2fe4068180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 shutdown_connections 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.253+0000 7f2feb3b1700 1 -- 172.21.15.26:0/2532353262 wait complete. 2023-10-09T11:47:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T11:47:13.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.384+0000 7f0f0d17d700 1 Processor -- start 2023-10-09T11:47:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.384+0000 7f0f0d17d700 1 -- start start 2023-10-09T11:47:13.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0d17d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f08153c30 0x7f0f0815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0d17d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f0815de50 0x7f0f080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0d17d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0815afd0 con 0x7f0f080cef40 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0d17d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0815b2b0 con 0x7f0f0815de50 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0d17d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0815b590 con 0x7f0f08153c30 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f0815de50 0x7f0f080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0c97c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0f080cef40 0x7f0f0806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48052/0 (socket says 172.21.15.26:48052) 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f0815de50 0x7f0f080cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39900/0 (socket says 172.21.15.26:39900) 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f0c97c700 1 -- 172.21.15.26:0/1720242921 learned_addr learned my addr 172.21.15.26:0/1720242921 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 -- 172.21.15.26:0/1720242921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f08153c30 msgr2=0x7f0f0815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:13.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 --2- 172.21.15.26:0/1720242921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f08153c30 0x7f0f0815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 -- 172.21.15.26:0/1720242921 >> v1:172.21.15.26:6789/0 conn(0x7f0f080cef40 legacy=0x7f0f0806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 -- 172.21.15.26:0/1720242921 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0815b870 con 0x7f0f0815de50 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f06ffd700 1 -- 172.21.15.26:0/1720242921 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734772074 0 0) 0x7f0f0815afd0 con 0x7f0f080cef40 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.385+0000 7f0f077fe700 1 --2- 172.21.15.26:0/1720242921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080cea00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098e0 tx=0x7f0efc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a7c1089a48919a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f06ffd700 1 -- 172.21.15.26:0/1720242921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc009e80 con 0x7f0f0815de50 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f06ffd700 1 -- 172.21.15.26:0/1720242921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00b860 con 0x7f0f0815de50 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f06ffd700 1 -- 172.21.15.26:0/1720242921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00bbe0 con 0x7f0f0815de50 2023-10-09T11:47:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 -- 172.21.15.26:0/1720242921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 msgr2=0x7f0f080cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/1720242921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080cea00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098e0 tx=0x7f0efc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 -- 172.21.15.26:0/1720242921 shutdown_connections 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/1720242921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f08153c30 0x7f0f0815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/1720242921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080cea00 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 -- 172.21.15.26:0/1720242921 >> 172.21.15.26:0/1720242921 conn(0x7f0f080703a0 msgr2=0x7f0f080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 -- 172.21.15.26:0/1720242921 shutdown_connections 2023-10-09T11:47:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.386+0000 7f0f0d17d700 1 -- 172.21.15.26:0/1720242921 wait complete. 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.387+0000 7f0f0d17d700 1 Processor -- start 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.387+0000 7f0f0d17d700 1 -- start start 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f080cef40 0x7f0f081522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f08153c30 0x7f0f080c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c8390 con 0x7f0f0815de50 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c8670 con 0x7f0f08153c30 2023-10-09T11:47:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0d17d700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c8950 con 0x7f0f080cef40 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0c97c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0c97c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39914/0 (socket says 172.21.15.26:39914) 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f0c97c700 1 -- 172.21.15.26:0/2763151837 learned_addr learned my addr 172.21.15.26:0/2763151837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f077fe700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f08153c30 0x7f0f080c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.388+0000 7f0f07fff700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f080cef40 0x7f0f081522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 -- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f080cef40 msgr2=0x7f0f081522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f080cef40 0x7f0f081522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 -- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f08153c30 msgr2=0x7f0f080c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f08153c30 0x7f0f080c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 -- 172.21.15.26:0/2763151837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009420 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0c97c700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000cbf0 tx=0x7f0f000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000a8b0 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0000aa10 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f080c8c30 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000add0 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.389+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f081527e0 con 0x7f0f0815de50 2023-10-09T11:47:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.390+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0804c3c0 con 0x7f0f0815de50 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.390+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f00007300 con 0x7f0f0815de50 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.391+0000 7f0eeffff700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 0x7f0ef40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.391+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0f00084be0 con 0x7f0f0815de50 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.391+0000 7f0f07fff700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 0x7f0ef40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.391+0000 7f0f07fff700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 0x7f0ef40697d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009bf0 tx=0x7f0ef80091a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.395+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f00051bf0 con 0x7f0f0815de50 2023-10-09T11:47:13.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.585+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f080c90d0 con 0x7f0ef4067320 2023-10-09T11:47:13.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.588+0000 7f0eeffff700 1 -- 172.21.15.26:0/2763151837 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50386 (secure 0 0 0) 0x7f0f080c90d0 con 0x7f0ef4067320 2023-10-09T11:47:13.590 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 msgr2=0x7f0ef40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 0x7f0ef40697d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009bf0 tx=0x7f0ef80091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 msgr2=0x7f0f080b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000cbf0 tx=0x7f0f000019b0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 shutdown_connections 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f0815de50 0x7f0f080b4590 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f0ef4067320 0x7f0ef40697d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f080cef40 0x7f0f081522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 --2- 172.21.15.26:0/2763151837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f08153c30 0x7f0f080c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 >> 172.21.15.26:0/2763151837 conn(0x7f0f080703a0 msgr2=0x7f0f08070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:13.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 shutdown_connections 2023-10-09T11:47:13.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:13.590+0000 7f0f0d17d700 1 -- 172.21.15.26:0/2763151837 wait complete. 2023-10-09T11:47:13.593 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:47:13.603 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2023-10-09T11:47:13.278974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448808,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752525912,"statfs":{"total":773094113280,"available":770586533888,"internally_reserved":0,"allocated":21864448,"data_stored":10474128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.576306"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":311,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-10-09T11:47:03.706314+0000","last_change":"2023-10-09T11:35:12.347577+0000","last_active":"2023-10-09T11:47:03.706314+0000","last_peered":"2023-10-09T11:47:03.706314+0000","last_clean":"2023-10-09T11:47:03.706314+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:47:03.706314+0000","last_undegraded":"2023-10-09T11:47:03.706314+0000","last_fullsized":"2023-10-09T11:47:03.706314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:11.286020+0000","last_clean_scrub_stamp":"2023-10-09T11:35:11.286020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:13.126741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542293,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304488,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067352,"statfs":{"total":96636764160,"available":96324968448,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":5.8700000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":2.6160000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":5.9450000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.256},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.71999999999999997},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":8.8940000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.77700000000000002},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.82499999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60299999999999998,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.376,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":2.7629999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.67600000000000005,"5min":0.76900000000000002,"15min":1.3},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":1.163},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":1.369},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71399999999999997,"5min":0.85899999999999999,"15min":0.999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.501}]}]},{"osd":6,"up_from":14,"seq":60129542293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.54200000000000004,"5min":0.32800000000000001,"15min":0.25900000000000001},"max":{"1min":0.78200000000000003,"5min":0.877,"15min":0.95599999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.32900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.153},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.92800000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.59599999999999997},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.499,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.1060000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":2.3559999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91600000000000004,"5min":2.895,"15min":2.895},"last":0.53400000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.29199999999999998},"max":{"1min":1,"5min":1.05,"15min":1.05},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83999999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.626},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.96699999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.032,"15min":1.032},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.59099999999999997,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.57299999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.215},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":11.06},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.67700000000000005},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.22900000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":2.1960000000000002,"15min":11.935},"last":0.36899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39200000000000002,"15min":0.57899999999999996},"min":{"1min":0.32400000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":11.087},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.436,"15min":0.499},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":5.0060000000000002},"last":0.316}]},{"osd":4,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.58899999999999997,"5min":0.41599999999999998,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.503},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.373},"max":{"1min":1.006,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.627,"15min":0.80300000000000005},"min":{"1min":0.51100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":10.939},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":4.9370000000000003},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.65100000000000002,"15min":0.83199999999999996},"min":{"1min":0.54600000000000004,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.871,"5min":1.0089999999999999,"15min":10.975},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.85499999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":0.98099999999999998,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":1.72,"15min":1.72},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67300000000000004,"15min":0.85699999999999998},"min":{"1min":0.61599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":11.000999999999999},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308584,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063256,"statfs":{"total":96636764160,"available":96320774144,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.443},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.189},"max":{"1min":0.55600000000000005,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":3.8180000000000001},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.41899999999999998,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.625,"15min":11.031000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.38200000000000001,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":12.589},"last":0.39300000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":1.6739999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.42099999999999999},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.77500000000000002,"15min":1.502},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":1.095,"15min":1.446},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":1.278},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.54200000000000004,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":0.93500000000000005,"5min":2.286,"15min":2.286},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.628,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":1.639},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.97899999999999998,"5min":1.077,"15min":1.3149999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.032,"15min":1.5629999999999999},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.82199999999999995,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.33600000000000002,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.749,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.315}]},{"osd":1,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42299999999999999},"min":{"1min":0.34399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.873},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.33400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.29499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.44500000000000001,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.23799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.246},"last":0.435},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.432},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"max":{"1min":0.88600000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":1.599,"15min":1.599},"last":0.42299999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":2.1579999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66200000000000003,"15min":0.61899999999999999},"min":{"1min":0.55500000000000005,"5min":0.42899999999999999,"15min":0.379},"max":{"1min":1.008,"5min":1.181,"15min":1.286},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.51300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.56499999999999995,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.55000000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.98099999999999998,"5min":1.018,"15min":1.3149999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67100000000000004,"15min":0.63500000000000001},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":1.359,"15min":1.359},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.312,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.67500000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.375,"15min":0.34699999999999998},"min":{"1min":0.311,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34200000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.39800000000000002,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.78100000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.441,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":0.63900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.54600000000000004,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.98299999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41799999999999998,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.95999999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.96399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.52900000000000003,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.63900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.93999999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63300000000000001,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.873},"last":0.67800000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.84899999999999998,"15min":1.056},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.63800000000000001},"min":{"1min":0.52500000000000002,"5min":0.34499999999999997,"15min":0.33000000000000002},"max":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":3.7400000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.436,"15min":0.372},"max":{"1min":0.83299999999999996,"5min":0.84799999999999998,"15min":3.8519999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83699999999999997,"15min":1.234},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.91800000000000004},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.33300000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75600000000000001,"5min":0.878,"15min":1.0229999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.878,"15min":1.282},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.31},"max":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.95499999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.65300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.307},"max":{"1min":0.81000000000000005,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.314},"max":{"1min":0.85099999999999998,"5min":5.0970000000000004,"15min":5.2519999999999998},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":0.80600000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.48599999999999999,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.82599999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.57499999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.48999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.79700000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.64900000000000002,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.78500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:47:13.607 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T11:35:11.286020+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=11, tm_min=35, tm_sec=11, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=11, tm_min=47, tm_sec=8, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T11:47:13.607 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T11:47:26.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:26.922 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:33.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.741+0000 7f6050411700 1 Processor -- start 2023-10-09T11:47:33.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.741+0000 7f6050411700 1 -- start start 2023-10-09T11:47:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f6050411700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60481598b0 0x7f60480af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f6050411700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6048159c80 0x7f60480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f6050411700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480ce9d0 con 0x7f60480af790 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f6050411700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60480afc30 con 0x7f60481598b0 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f6050411700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480aff10 con 0x7f6048159c80 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.742+0000 7f604e1ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60481598b0 0x7f60480af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60481598b0 0x7f60480af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55330/0 (socket says 172.21.15.26:55330) 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 -- 172.21.15.26:0/895517454 learned_addr learned my addr 172.21.15.26:0/895517454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:33.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604d9ac700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6048159c80 0x7f60480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 -- 172.21.15.26:0/895517454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6048159c80 msgr2=0x7f60480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6048159c80 0x7f60480cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 -- 172.21.15.26:0/895517454 >> v1:172.21.15.67:6789/0 conn(0x7f60480af790 legacy=0x7f60480cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 -- 172.21.15.26:0/895517454 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480ce380 con 0x7f60481598b0 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604e1ad700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60481598b0 0x7f60480af250 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f6040009f20 tx=0x7f6040009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347a6e8251f1725a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604d1ab700 1 -- 172.21.15.26:0/895517454 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000e070 con 0x7f60481598b0 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604d1ab700 1 -- 172.21.15.26:0/895517454 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000ba40 con 0x7f60481598b0 2023-10-09T11:47:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.743+0000 7f604d1ab700 1 -- 172.21.15.26:0/895517454 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400092e0 con 0x7f60481598b0 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 -- 172.21.15.26:0/895517454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60481598b0 msgr2=0x7f60480af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60481598b0 0x7f60480af250 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f6040009f20 tx=0x7f6040009840 comp rx=0 tx=0).stop 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 -- 172.21.15.26:0/895517454 shutdown_connections 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60481598b0 0x7f60480af250 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 --2- 172.21.15.26:0/895517454 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6048159c80 0x7f60480cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 -- 172.21.15.26:0/895517454 >> 172.21.15.26:0/895517454 conn(0x7f6048070e30 msgr2=0x7f60480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 -- 172.21.15.26:0/895517454 shutdown_connections 2023-10-09T11:47:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.744+0000 7f6050411700 1 -- 172.21.15.26:0/895517454 wait complete. 2023-10-09T11:47:33.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.745+0000 7f6050411700 1 Processor -- start 2023-10-09T11:47:33.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.745+0000 7f6050411700 1 -- start start 2023-10-09T11:47:33.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 0x7f604815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 0x7f6048153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604815f0f0 con 0x7f6048159c80 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048154260 con 0x7f60481598b0 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f6050411700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604815f580 con 0x7f60480af790 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55340/0 (socket says 172.21.15.26:55340) 2023-10-09T11:47:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 -- 172.21.15.26:0/3399293180 learned_addr learned my addr 172.21.15.26:0/3399293180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604d9ac700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 0x7f6048153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e1ad700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 0x7f604815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 -- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 msgr2=0x7f604815deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 0x7f604815deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 -- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 msgr2=0x7f6048153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 0x7f6048153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 -- 172.21.15.26:0/3399293180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009ae0 con 0x7f6048159c80 2023-10-09T11:47:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604d9ac700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 0x7f6048153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e1ad700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 0x7f604815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f604e9ae700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f603800c4f0 tx=0x7f6038007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.746+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011590 con 0x7f6048159c80 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.747+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380116f0 con 0x7f6048159c80 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.747+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604815e4e0 con 0x7f6048159c80 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.747+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011ab0 con 0x7f6048159c80 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.747+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604815eaa0 con 0x7f6048159c80 2023-10-09T11:47:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.748+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604815f260 con 0x7f6048159c80 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.748+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f603801c460 con 0x7f6048159c80 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.748+0000 7f60467fc700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 0x7f60340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.748+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6038084670 con 0x7f6048159c80 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.749+0000 7f604e1ad700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 0x7f60340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.749+0000 7f604e1ad700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 0x7f60340697d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6040009880 tx=0x7f6040017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.753+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6038051600 con 0x7f6048159c80 2023-10-09T11:47:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.940+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 --> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f604804c3c0 con 0x7f6034067320 2023-10-09T11:47:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.943+0000 7f60467fc700 1 -- 172.21.15.26:0/3399293180 <== mgr.4106 v2:172.21.15.67:6832/90511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50452 (secure 0 0 0) 0x7f604804c3c0 con 0x7f6034067320 2023-10-09T11:47:33.944 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 msgr2=0x7f60340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 0x7f60340697d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6040009880 tx=0x7f6040017000 comp rx=0 tx=0).stop 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 msgr2=0x7f60480b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f603800c4f0 tx=0x7f6038007f00 comp rx=0 tx=0).stop 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 shutdown_connections 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6048159c80 0x7f60480b53f0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f6034067320 0x7f60340697d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60480af790 0x7f604815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 --2- 172.21.15.26:0/3399293180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481598b0 0x7f6048153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 >> 172.21.15.26:0/3399293180 conn(0x7f6048070e30 msgr2=0x7f60480b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 shutdown_connections 2023-10-09T11:47:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:33.945+0000 7f6050411700 1 -- 172.21.15.26:0/3399293180 wait complete. 2023-10-09T11:47:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-09T11:47:33.957 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-10-09T11:47:33.283327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2448808,"kb_used_data":21352,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752525912,"statfs":{"total":773094113280,"available":770586533888,"internally_reserved":0,"allocated":21864448,"data_stored":10474128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002600"},"pg_stats":[{"pgid":"1.0","version":"203'119","reported_seq":324,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-10-09T11:47:17.303084+0000","last_change":"2023-10-09T11:47:17.303057+0000","last_active":"2023-10-09T11:47:17.303084+0000","last_peered":"2023-10-09T11:47:17.303084+0000","last_clean":"2023-10-09T11:47:17.303084+0000","last_became_active":"2023-10-09T11:35:12.346442+0000","last_became_peered":"2023-10-09T11:35:12.346442+0000","last_unstale":"2023-10-09T11:47:17.303084+0000","last_undegraded":"2023-10-09T11:47:17.303084+0000","last_fullsized":"2023-10-09T11:47:17.303084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'119","last_scrub_stamp":"2023-10-09T11:47:17.302952+0000","last_deep_scrub":"203'119","last_deep_scrub_stamp":"2023-10-09T11:47:17.302952+0000","last_clean_scrub_stamp":"2023-10-09T11:47:17.302952+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:38.716522+0000","scrub_duration":0.0053111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304488,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067352,"statfs":{"total":96636764160,"available":96324968448,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.23499999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":5.8700000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":2.6160000000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":5.9450000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":1.256},"last":0.625}]},{"osd":2,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.69299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":0.872,"15min":8.8940000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.374,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.84799999999999998,"15min":8.9309999999999992},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.82499999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":2.7629999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50800000000000001,"15min":0.53400000000000003},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.73399999999999999,"5min":0.747,"15min":1.3},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.78800000000000003,"15min":1.163},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54100000000000004,"15min":0.56399999999999995},"min":{"1min":0.38400000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72299999999999998,"5min":0.84099999999999997,"15min":1.1419999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":1.369},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73099999999999998,"5min":0.85899999999999999,"15min":0.999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.36499999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":1.1279999999999999},"last":0.60999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.877,"15min":0.95599999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.373,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.86299999999999999,"15min":1.153},"last":0.64700000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.65800000000000003,"5min":0.80000000000000004,"15min":0.92800000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.624,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79100000000000004,"5min":1.075,"15min":1.1060000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.753,"5min":0.92700000000000005,"15min":2.3559999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60999999999999999,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":2.895,"15min":2.895},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":1.05,"15min":1.05},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.70199999999999996,"5min":1.083,"15min":1.083},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70199999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.38300000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.74299999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.496}]},{"osd":7,"last update":"Mon Oct 9 11:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.39400000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.73399999999999999,"5min":1.032,"15min":1.032},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.63,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75600000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35299999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20300000000000001},"max":{"1min":0.59099999999999997,"5min":0.80900000000000005,"15min":5.0330000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.57299999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.215},"max":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":11.06},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41299999999999998,"15min":0.67700000000000005},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":15.933999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.22900000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":2.1960000000000002,"15min":11.935},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39200000000000002,"15min":0.57899999999999996},"min":{"1min":0.32400000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":11.087},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.436,"15min":0.499},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":5.0060000000000002},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.58899999999999997,"5min":0.41599999999999998,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":3.4830000000000001,"15min":4.9720000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.373},"max":{"1min":1.006,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.46400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.627,"15min":0.80300000000000005},"min":{"1min":0.51100000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":10.939},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":4.9370000000000003},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.65100000000000002,"15min":0.83199999999999996},"min":{"1min":0.54600000000000004,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.871,"5min":1.0089999999999999,"15min":10.975},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.85499999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":0.98099999999999998,"5min":1.0109999999999999,"15min":11.031000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":1.72,"15min":1.72},"last":0.501},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67300000000000004,"15min":0.85699999999999998},"min":{"1min":0.61599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":11.000999999999999},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308584,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063256,"statfs":{"total":96636764160,"available":96320774144,"internally_reserved":0,"allocated":3178496,"data_stored":1752042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.443},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.189},"max":{"1min":0.55600000000000005,"5min":0.66000000000000003,"15min":3.8650000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":3.8180000000000001},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.41899999999999998,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.625,"15min":11.031000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.44,"5min":0.38200000000000001,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":12.589},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.311,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":1.6739999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.42099999999999999},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.63900000000000001,"5min":0.77500000000000002,"15min":1.502},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":1.095,"15min":1.446},"last":0.503},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":1.278},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.54200000000000004,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":0.93500000000000005,"5min":2.286,"15min":2.286},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.628,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":1.639},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.628,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.97899999999999998,"5min":1.077,"15min":1.3149999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.45400000000000001,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.032,"15min":1.5629999999999999},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.82199999999999995,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.33600000000000002,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.749,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42299999999999999},"min":{"1min":0.34399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.873},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.33400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.442}]},{"osd":3,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.44500000000000001,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.23799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.246},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.432},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"max":{"1min":0.88600000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":1.599,"15min":1.599},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":2.1579999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66200000000000003,"15min":0.61899999999999999},"min":{"1min":0.55500000000000005,"5min":0.42899999999999999,"15min":0.379},"max":{"1min":1.008,"5min":1.181,"15min":1.286},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.51300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85699999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.56499999999999995,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2010000000000001,"15min":3.843},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.55000000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.98099999999999998,"5min":1.018,"15min":1.3149999999999999},"last":0.628},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67100000000000004,"15min":0.63500000000000001},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":1.359,"15min":1.359},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.312,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.67500000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.375,"15min":0.34699999999999998},"min":{"1min":0.311,"5min":0.23400000000000001,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.41799999999999998,"15min":0.40100000000000002},"min":{"1min":0.39800000000000002,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.78100000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.441,"15min":0.41799999999999998},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.26800000000000002},"max":{"1min":0.63900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.54600000000000004,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.98299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41799999999999998,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.95999999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61499999999999999,"15min":0.58899999999999997},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.96399999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.52900000000000003,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.93999999999999995},"last":0.623},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63300000000000001,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.873},"last":0.63700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.314},"max":{"1min":0.78600000000000003,"5min":0.84899999999999998,"15min":1.056},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56999999999999995,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.30199999999999999},"max":{"1min":0.749,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.495},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.82699999999999996,"15min":3.7400000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.84299999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.73099999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.66300000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":3.8519999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":1.234},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.62,"5min":0.78900000000000003,"15min":0.91800000000000004},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.29199999999999998},"max":{"1min":0.79500000000000004,"5min":0.878,"15min":1.0229999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73899999999999999,"5min":0.878,"15min":1.282},"last":0.68700000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.373,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.81299999999999994,"15min":0.95499999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63500000000000001,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.90200000000000002,"15min":1.2509999999999999},"last":0.65200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1161674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61799999999999999,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.307},"max":{"1min":0.80300000000000005,"5min":5.5229999999999997,"15min":5.5229999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":5.0970000000000004,"15min":5.2519999999999998},"last":0.65300000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59099999999999997,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.72099999999999997,"5min":0.89200000000000002,"15min":0.92700000000000005},"last":0.628}]},{"osd":2,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.56399999999999995},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.82599999999999996,"5min":1.109,"15min":1.109},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.86299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.627},"min":{"1min":0.53600000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72799999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.82399999999999995,"15min":0.86799999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66600000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.745,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:47:33.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T11:47:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.078+0000 7f427fca6700 1 Processor -- start 2023-10-09T11:47:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.078+0000 7f427fca6700 1 -- start start 2023-10-09T11:47:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427fca6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42781598b0 0x7f42780b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427fca6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f427806e050 0x7f42780cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427fca6700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427815d3e0 con 0x7f42780cd7c0 2023-10-09T11:47:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427fca6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427815df60 con 0x7f427806e050 2023-10-09T11:47:34.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427fca6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427815d630 con 0x7f42781598b0 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427e243700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f427806e050 0x7f42780cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427e243700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f427806e050 0x7f42780cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55354/0 (socket says 172.21.15.26:55354) 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.079+0000 7f427e243700 1 -- 172.21.15.26:0/224300797 learned_addr learned my addr 172.21.15.26:0/224300797 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427da42700 1 --2- 172.21.15.26:0/224300797 >> v2:172.21.15.67:3300/0 conn(0x7f42781598b0 0x7f42780b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427e243700 1 -- 172.21.15.26:0/224300797 >> v2:172.21.15.67:3300/0 conn(0x7f42781598b0 msgr2=0x7f42780b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427e243700 1 --2- 172.21.15.26:0/224300797 >> v2:172.21.15.67:3300/0 conn(0x7f42781598b0 0x7f42780b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427e243700 1 -- 172.21.15.26:0/224300797 >> v1:172.21.15.67:6789/0 conn(0x7f42780cd7c0 legacy=0x7f427806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427e243700 1 -- 172.21.15.26:0/224300797 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427815d910 con 0x7f427806e050 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427e243700 1 --2- 172.21.15.26:0/224300797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f427806e050 0x7f42780cb4d0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f427806e9b0 tx=0x7f4268009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed066858cb59c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427ca40700 1 -- 172.21.15.26:0/224300797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800e070 con 0x7f427806e050 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427ca40700 1 -- 172.21.15.26:0/224300797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800ba50 con 0x7f427806e050 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427ca40700 1 -- 172.21.15.26:0/224300797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680092e0 con 0x7f427806e050 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.080+0000 7f427fca6700 1 -- 172.21.15.26:0/224300797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f427806e050 msgr2=0x7f42780cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 --2- 172.21.15.26:0/224300797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f427806e050 0x7f42780cb4d0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f427806e9b0 tx=0x7f4268009840 comp rx=0 tx=0).stop 2023-10-09T11:47:34.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 -- 172.21.15.26:0/224300797 shutdown_connections 2023-10-09T11:47:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 --2- 172.21.15.26:0/224300797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f427806e050 0x7f42780cb4d0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 --2- 172.21.15.26:0/224300797 >> v2:172.21.15.67:3300/0 conn(0x7f42781598b0 0x7f42780b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 -- 172.21.15.26:0/224300797 >> 172.21.15.26:0/224300797 conn(0x7f42780703a0 msgr2=0x7f42780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 -- 172.21.15.26:0/224300797 shutdown_connections 2023-10-09T11:47:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.081+0000 7f427fca6700 1 -- 172.21.15.26:0/224300797 wait complete. 2023-10-09T11:47:34.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.082+0000 7f427fca6700 1 Processor -- start 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.082+0000 7f427fca6700 1 -- start start 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427806e050 0x7f427814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42781598b0 0x7f4278169980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c65e0 con 0x7f4278169ec0 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c5a10 con 0x7f42781598b0 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c5cb0 con 0x7f427806e050 2023-10-09T11:47:34.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 -- 172.21.15.26:0/1019146564 learned_addr learned my addr 172.21.15.26:0/1019146564 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427d241700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42781598b0 0x7f4278169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 -- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427806e050 msgr2=0x7f427814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427806e050 0x7f427814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 -- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42781598b0 msgr2=0x7f4278169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42781598b0 0x7f4278169980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 -- 172.21.15.26:0/1019146564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009ae0 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427e243700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f42780895f0 tx=0x7f4268018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268008e80 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800be60 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780c5f90 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.083+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268026690 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.084+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427814cfc0 con 0x7f4278169ec0 2023-10-09T11:47:34.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.084+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427804c3c0 con 0x7f4278169ec0 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.085+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4268003040 con 0x7f4278169ec0 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.085+0000 7f4275ffb700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 0x7f42640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.085+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4268086ad0 con 0x7f4278169ec0 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.085+0000 7f427da42700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 0x7f42640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.086+0000 7f427da42700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 0x7f42640697d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4270009a40 tx=0x7f4270008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.089+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4268053950 con 0x7f4278169ec0 2023-10-09T11:47:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.282+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f427815dbf0 con 0x7f4278169ec0 2023-10-09T11:47:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.285+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4268009450 con 0x7f4278169ec0 2023-10-09T11:47:34.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.286+0000 7f4275ffb700 1 -- 172.21.15.26:0/1019146564 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4268009940 con 0x7f4278169ec0 2023-10-09T11:47:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 msgr2=0x7f42640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 0x7f42640697d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4270009a40 tx=0x7f4270008040 comp rx=0 tx=0).stop 2023-10-09T11:47:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 msgr2=0x7f427815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f42780895f0 tx=0x7f4268018000 comp rx=0 tx=0).stop 2023-10-09T11:47:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 shutdown_connections 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4278169ec0 0x7f427815ca40 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7f4264067320 0x7f42640697d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427806e050 0x7f427814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 --2- 172.21.15.26:0/1019146564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42781598b0 0x7f4278169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 >> 172.21.15.26:0/1019146564 conn(0x7f42780703a0 msgr2=0x7f42780b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 shutdown_connections 2023-10-09T11:47:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.288+0000 7f427fca6700 1 -- 172.21.15.26:0/1019146564 wait complete. 2023-10-09T11:47:34.300 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:47:34.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.420+0000 7fad5759e700 1 Processor -- start 2023-10-09T11:47:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.420+0000 7fad5759e700 1 -- start start 2023-10-09T11:47:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad58068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5759e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fad5815d290 0x7fad5815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5759e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580687b0 con 0x7fad58153d20 2023-10-09T11:47:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5759e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5815e280 con 0x7fad5815d290 2023-10-09T11:47:34.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5806b7a0 con 0x7fad58067e00 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad58153d20 0x7fad5806b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54094/0 (socket says 172.21.15.26:54094) 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5659c700 1 -- 172.21.15.26:0/3359638371 learned_addr learned my addr 172.21.15.26:0/3359638371 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad55d9b700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad58068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad56d9d700 1 --2- 172.21.15.26:0/3359638371 >> v2:172.21.15.67:3300/0 conn(0x7fad5815d290 0x7fad5815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161555702 0 0) 0x7fad580687b0 con 0x7fad58153d20 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.421+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad44003570 con 0x7fad58153d20 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180585662 0 0) 0x7fad44003570 con 0x7fad58153d20 2023-10-09T11:47:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 msgr2=0x7fad58068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad58068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 >> v2:172.21.15.67:3300/0 conn(0x7fad5815d290 msgr2=0x7fad5815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 --2- 172.21.15.26:0/3359638371 >> v2:172.21.15.67:3300/0 conn(0x7fad5815d290 0x7fad5815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5815dfa0 con 0x7fad58153d20 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1536813195 0 0) 0x7fad480017f0 con 0x7fad58153d20 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 >> v1:172.21.15.26:6789/0 conn(0x7fad58153d20 legacy=0x7fad5806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad44003a60 0x7fad44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad44004810 0x7fad44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815e280 con 0x7fad44003a60 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5806b7a0 con 0x7fad44004810 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4400ba60 con 0x7fad58067e00 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad44003a60 0x7fad44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad55d9b700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad44004810 0x7fad44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad56d9d700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 -- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 msgr2=0x7fad440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad58067e00 0x7fad440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 -- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad44004810 msgr2=0x7fad44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad44004810 0x7fad44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 -- 172.21.15.26:0/3359638371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44003570 con 0x7fad44003a60 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad55d9b700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad44004810 0x7fad44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5659c700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad44003a60 0x7fad44003e70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a9a0 tx=0x7fad48002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06d953af30dcac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48012440 con 0x7fad44003a60 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad480125c0 con 0x7fad44003a60 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.422+0000 7fad5559a700 1 -- 172.21.15.26:0/3359638371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad480129a0 con 0x7fad44003a60 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 -- 172.21.15.26:0/3359638371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad44003a60 msgr2=0x7fad44003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 --2- 172.21.15.26:0/3359638371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad44003a60 0x7fad44003e70 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a9a0 tx=0x7fad48002210 comp rx=0 tx=0).stop 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad56d9d700 1 -- 172.21.15.26:0/3359638371 reap_dead start 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 -- 172.21.15.26:0/3359638371 shutdown_connections 2023-10-09T11:47:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 -- 172.21.15.26:0/3359638371 >> 172.21.15.26:0/3359638371 conn(0x7fad580cca00 msgr2=0x7fad580cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 -- 172.21.15.26:0/3359638371 shutdown_connections 2023-10-09T11:47:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.423+0000 7fad5759e700 1 -- 172.21.15.26:0/3359638371 wait complete. 2023-10-09T11:47:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.424+0000 7fad5759e700 1 Processor -- start 2023-10-09T11:47:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.424+0000 7fad5759e700 1 -- start start 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad44003a60 0x7fad5814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580b0fa0 0x7fad580b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58150150 con 0x7fad58151160 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58150cd0 con 0x7fad580b0fa0 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5759e700 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5814d9e0 con 0x7fad44003a60 2023-10-09T11:47:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad55d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580b0fa0 0x7fad580b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad5659c700 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad44003a60 0x7fad5814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55384/0 (socket says 172.21.15.26:55384) 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.425+0000 7fad56d9d700 1 -- 172.21.15.26:0/573466034 learned_addr learned my addr 172.21.15.26:0/573466034 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 -- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad44003a60 msgr2=0x7fad5814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad44003a60 0x7fad5814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 -- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580b0fa0 msgr2=0x7fad580b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580b0fa0 0x7fad580b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 -- 172.21.15.26:0/573466034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad581503a0 con 0x7fad58151160 2023-10-09T11:47:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad56d9d700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fad5806a150 tx=0x7fad50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50011ed0 con 0x7fad58151160 2023-10-09T11:47:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad50015670 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58150680 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50015a90 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.426+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad580b1950 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.427+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5804c3c0 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.427+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fad5001f410 con 0x7fad58151160 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.428+0000 7fad4e7fc700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 0x7fad380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.428+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fad50084530 con 0x7fad58151160 2023-10-09T11:47:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.428+0000 7fad5659c700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 0x7fad380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.428+0000 7fad5659c700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 0x7fad380697d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a8c0 tx=0x7fad48002210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.432+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad50051540 con 0x7fad58151160 2023-10-09T11:47:34.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.670+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad5806a5b0 con 0x7fad58151160 2023-10-09T11:47:34.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.670+0000 7fad4e7fc700 1 -- 172.21.15.26:0/573466034 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+3525 (secure 0 0 0) 0x7fad50084030 con 0x7fad58151160 2023-10-09T11:47:34.671 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-09T11:47:34.671 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":134,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/69942265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":69942265},{"type":"v1","addr":"172.21.15.67:6836","nonce":69942265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":8326,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2385998949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":2385998949},{"type":"v1","addr":"172.21.15.67:6837","nonce":2385998949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":134},{"gid":9126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/947811887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":947811887},{"type":"v1","addr":"172.21.15.26:6834","nonce":947811887}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126},{"gid":9129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/2272580459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":2272580459},{"type":"v1","addr":"172.21.15.26:6835","nonce":2272580459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":126}],"filesystems":[]} 2023-10-09T11:47:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 msgr2=0x7fad380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 0x7fad380697d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a8c0 tx=0x7fad48002210 comp rx=0 tx=0).stop 2023-10-09T11:47:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 msgr2=0x7fad581515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fad5806a150 tx=0x7fad50008040 comp rx=0 tx=0).stop 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 shutdown_connections 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58151160 0x7fad581515d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:6832/90511,v1:172.21.15.67:6833/90511] conn(0x7fad38067320 0x7fad380697d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fad44003a60 0x7fad5814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 --2- 172.21.15.26:0/573466034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580b0fa0 0x7fad580b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 >> 172.21.15.26:0/573466034 conn(0x7fad580cca00 msgr2=0x7fad5815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 shutdown_connections 2023-10-09T11:47:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-09T11:47:34.673+0000 7fad5759e700 1 -- 172.21.15.26:0/573466034 wait complete. 2023-10-09T11:47:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 134 2023-10-09T11:47:34.685 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T11:47:34.685 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T11:47:34.686 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:47:34.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.694 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:47:34.694 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:47:34.694 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.742 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:47:34.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:47:34.742 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.753 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:47:34.753 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:47:34.754 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.804 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:47:34.805 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T11:47:34.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T11:47:34.805 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.834 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T11:47:34.835 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T11:47:34.835 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.904 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T11:47:34.904 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T11:47:34.905 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:34.971 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T11:47:34.971 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T11:47:34.971 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-09T11:47:35.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-09T11:47:35.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T11:47:35.044 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T11:47:35.044 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T11:47:35.044 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.087 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T11:47:35.087 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T11:47:35.087 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.129 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T11:47:35.129 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T11:47:35.129 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.175 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T11:47:35.175 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T11:47:35.175 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.207 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T11:47:35.207 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T11:47:35.207 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T11:47:35.207 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.230 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T11:47:35.230 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T11:47:35.231 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.276 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T11:47:35.276 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T11:47:35.276 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T11:47:35.277 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.287 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T11:47:35.288 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T11:47:35.288 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.329 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T11:47:35.329 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T11:47:35.329 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:47:35.381 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T11:47:35.381 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T11:47:35.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-09T11:47:35.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:47:35.413 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T11:47:35.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:47:35.631 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T11:47:35.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:47:35.722 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T11:47:35.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:47:35.804 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T11:47:35.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:47:35.905 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T11:47:36.107 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:47:36.107 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T11:47:36.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:47:36.207 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T11:47:36.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:47:36.278 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T11:47:36.346 INFO:tasks.ceph:Archiving mon data... 2023-10-09T11:47:36.347 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/data/mon.a.tgz 2023-10-09T11:47:36.348 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-09T11:47:36.364 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.bTOTW8STsr 2023-10-09T11:47:36.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bTOTW8STsr 2023-10-09T11:47:36.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.bTOTW8STsr 2023-10-09T11:47:36.643 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.bTOTW8STsr is 604KB 2023-10-09T11:47:36.743 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.bTOTW8STsr 2023-10-09T11:47:36.757 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/data/mon.b.tgz 2023-10-09T11:47:36.757 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-10-09T11:47:36.774 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.dDKsvbkpr9 2023-10-09T11:47:36.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dDKsvbkpr9 2023-10-09T11:47:36.961 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.dDKsvbkpr9 2023-10-09T11:47:37.043 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.dDKsvbkpr9 is 612KB 2023-10-09T11:47:37.141 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.dDKsvbkpr9 2023-10-09T11:47:37.156 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/data/mon.c.tgz 2023-10-09T11:47:37.156 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-10-09T11:47:37.210 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.45PYKphBvK 2023-10-09T11:47:37.210 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.45PYKphBvK 2023-10-09T11:47:37.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.45PYKphBvK 2023-10-09T11:47:37.468 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.45PYKphBvK is 612KB 2023-10-09T11:47:37.567 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.45PYKphBvK 2023-10-09T11:47:37.582 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T11:47:37.582 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T11:47:37.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T11:47:37.647 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T11:47:37.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T11:47:37.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T11:47:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T11:47:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T11:47:37.718 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T11:47:37.719 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi026/crash 2023-10-09T11:47:37.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T11:47:37.754 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi067/crash 2023-10-09T11:47:37.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T11:47:37.782 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T11:47:37.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:37.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:37.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:37.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:37.936 INFO:tasks.ceph:Compressing logs... 2023-10-09T11:47:37.936 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T11:47:37.954 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T11:47:37.978 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171375.log 2023-10-09T11:47:37.978 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174822.log 2023-10-09T11:47:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100544.log 2023-10-09T11:47:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100137.log 2023-10-09T11:47:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100935.log 2023-10-09T11:47:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100544.log.gz 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90870.log 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100137.log.gz 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99370.log 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100935.log.gz 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90957.log 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90870.log.gz 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.99370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97297.log 2023-10-09T11:47:38.023 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99370.log.gz 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98408.log 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.97297.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90957.log.gz 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101332.log 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97297.log.gz 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98045.log 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98408.log.gz 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.101332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90828.log 2023-10-09T11:47:38.024 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101332.log.gz 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98045.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98045.log.gz 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97655.log 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.90828.log.gz 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100939.log 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.3.97655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100548.log 2023-10-09T11:47:38.025 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97655.log.gz 2023-10-09T11:47:38.026 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90704.log 2023-10-09T11:47:38.026 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100939.log.gz 2023-10-09T11:47:38.026 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100548.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T11:47:38.026 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100548.log.gz 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90704.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.7.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90704.log.gz 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97289.log 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98404.log 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.97289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97289.log.gz 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99742.log 2023-10-09T11:47:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98404.log.gz 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.99742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91000.log 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99742.log.gz 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.91000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99366.log 2023-10-09T11:47:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.4.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91000.log.gz 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101336.log 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.99366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98803.log 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99366.log.gz 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.101336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101336.log.gz 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98803.log.gz 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T11:47:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102115.log 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102111.log 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.102115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102115.log.gz 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90785.log 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.102111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102111.log.gz 2023-10-09T11:47:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T11:47:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90785.log: /var/log/ceph/ceph-osd.6.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90785.log.gz 2023-10-09T11:47:38.032 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101718.log 2023-10-09T11:47:38.032 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.101718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101718.log.gz 2023-10-09T11:47:38.032 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T11:47:38.036 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101714.log 2023-10-09T11:47:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.101714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101714.log.gz 2023-10-09T11:47:38.062 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T11:47:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90744.log 2023-10-09T11:47:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90744.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90744.log.gz 2023-10-09T11:47:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98799.log 2023-10-09T11:47:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98799.log.gz 2023-10-09T11:47:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90914.log 2023-10-09T11:47:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90914.log.gz 2023-10-09T11:47:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102519.log 2023-10-09T11:47:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.102519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102519.log.gz 2023-10-09T11:47:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T11:47:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98041.log 2023-10-09T11:47:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.98041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98041.log.gz 2023-10-09T11:47:38.103 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102523.log 2023-10-09T11:47:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.102523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102523.log.gz 2023-10-09T11:47:38.116 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100141.log 2023-10-09T11:47:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.100141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100141.log.gz 2023-10-09T11:47:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97659.log 2023-10-09T11:47:38.135 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.3.97659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97659.log.gz 2023-10-09T11:47:38.135 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99746.log 2023-10-09T11:47:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.99746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99746.log.gz 2023-10-09T11:47:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.171375.log: -- /var/log/ceph/ceph-client.admin.159954.log 2023-10-09T11:47:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178179.log 2023-10-09T11:47:38.189 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171375.log.gz 2023-10-09T11:47:38.189 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174822.log.gz 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179345.log 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178179.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159954.log.gz 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167193.log 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179345.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178179.log.gz 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100499.log 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179345.log.gz 2023-10-09T11:47:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177327.log 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1%/var/log/ceph/ceph-client.admin.100499.log: -- replaced with /var/log/ceph/ceph-client.admin.167193.log.gz 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175284.log 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176389.log 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100499.log.gz 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179647.log 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177327.log.gz 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175284.log.gz 2023-10-09T11:47:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101024.log 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176389.log.gz 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98456.log 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177199.log 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179647.log.gz 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101024.log.gz 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106712.log 2023-10-09T11:47:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177199.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.98456.log.gz--verbose 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.170938.log 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106712.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177199.log.gz 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90980.log 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106712.log.gz 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107010.log 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.90980.log: gzip 89.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.170938.log.gz--verbose 2023-10-09T11:47:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.170119.log 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107010.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90980.log.gz 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157170.log 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107010.log.gz 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164010.log 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170119.log.gz 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168816.log 2023-10-09T11:47:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158591.log 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157170.log.gz 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168816.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.106043.log -- replaced with /var/log/ceph/ceph-client.admin.164010.log.gz 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168816.log.gz 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104004.log 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106043.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158591.log.gz 2023-10-09T11:47:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166887.log 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106043.log.gz 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.104004.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.176599.log 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177899.log 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104004.log.gz 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176599.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166887.log.gz 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104268.log 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176599.log.gz 2023-10-09T11:47:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175840.log 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173602.log 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.177899.log.gz 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104268.log.gz 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106586.log 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175840.log.gz 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173459.log 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173602.log.gz 2023-10-09T11:47:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103733.log 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106001.log 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106586.log.gz 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103733.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.173459.log.gz-5 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.105707.log 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103733.log.gz 2023-10-09T11:47:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96495.log 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174650.log 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106001.log.gz 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96495.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105707.log.gz 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158284.log 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96495.log.gz 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170896.log 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164716.log 2023-10-09T11:47:38.199 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174650.log.gz 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96409.log 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158284.log.gz 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170896.log.gz 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170854.log 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163674.log 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164716.log.gz 2023-10-09T11:47:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170854.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96409.log.gz 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168858.log 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170854.log.gz 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176641.log 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177115.log 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163674.log.gz 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168858.log.gz 2023-10-09T11:47:38.201 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175669.log 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177115.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176641.log.gz 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179521.log 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177115.log.gz 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.175669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164629.log 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175669.log.gz 2023-10-09T11:47:38.202 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177833.log 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164629.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179521.log.gz 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161456.log 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164629.log.gz 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101169.log 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168225.log 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101169.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.177833.log.gz 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103313.log 2023-10-09T11:47:38.203 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161456.log.gz 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101169.log.gz 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176809.log 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168225.log.gz 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157728.log 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161414.log 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103313.log.gz 2023-10-09T11:47:38.204 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176809.log.gz 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96860.log 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162264.log 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157728.log.gz 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161414.log.gz 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165228.log 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96860.log.gz 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160534.log 2023-10-09T11:47:38.205 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163758.log 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162264.log.gz 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160534.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165228.log.gz 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164459.log 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160534.log.gz 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167151.log 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168359.log 2023-10-09T11:47:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164459.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163758.log.gz 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164968.log 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164459.log.gz 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167151.log.gz 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101289.log 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103607.log 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168359.log.gz 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101289.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164968.log.gz 2023-10-09T11:47:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176557.log 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101289.log.gz 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172200.log 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178372.log 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103607.log.gz 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172200.log: gzip -5 --verbose 88.9%-- /var/log/ceph/ceph-client.admin.168564.log -- replaced with /var/log/ceph/ceph-client.admin.176557.log.gz 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172200.log.gz 2023-10-09T11:47:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98842.log 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168564.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.178372.log.gz 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98842.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168564.log.gz 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175756.log 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98842.log.gz 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156593.log 2023-10-09T11:47:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.175756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.162684.log 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166425.log 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175756.log.gz 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156593.log.gz 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178685.log 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166425.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162684.log.gz 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97197.log 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%/var/log/ceph/ceph-client.admin.178685.log: -- replaced with /var/log/ceph/ceph-client.admin.166425.log.gz 2023-10-09T11:47:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165616.log 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178685.log.gz 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166173.log 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178096.log 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97197.log.gz 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166173.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165616.log.gz 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98162.log 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166173.log.gz 2023-10-09T11:47:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.178096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161036.log 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178096.log.gz 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105300.log 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161036.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98162.log.gz 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160898.log 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161036.log.gz 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97818.log 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105300.log.gz 2023-10-09T11:47:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161727.log 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158633.log 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160898.log.gz 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161727.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97818.log.gz 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104828.log 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161727.log.gz 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97201.log 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104828.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.158633.log.gz--verbose 2023-10-09T11:47:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.172072.log 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104828.log.gz 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173998.log 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97201.log.gz 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165978.log 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173998.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.172072.log.gz--verbose 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.104996.log 2023-10-09T11:47:38.214 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173998.log.gz 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165978.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165978.log.gz 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172114.log 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98204.log 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105749.log 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.104996.log.gz 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172114.log.gz 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173896.log 2023-10-09T11:47:38.215 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105749.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98204.log.gz 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165186.log 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105749.log.gz 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161204.log 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98246.log 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173896.log.gz 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165186.log.gz 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104954.log 2023-10-09T11:47:38.216 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161204.log.gz 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103793.log 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104954.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98246.log.gz 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170035.log 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104954.log.gz 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106754.log 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167321.log 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170035.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103793.log.gz 2023-10-09T11:47:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177581.log 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106754.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170035.log.gz 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178559.log 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106754.log.gz 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177581.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167321.log.gz 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178280.log 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177581.log.gz 2023-10-09T11:47:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105623.log 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178559.log.gz 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166949.log 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176431.log 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178280.log.gz 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166949.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105623.log.gz 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103649.log 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166949.log.gz 2023-10-09T11:47:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99784.log 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163632.log 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176431.log.gz 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103649.log.gz 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167795.log 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99784.log.gz 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96451.log 2023-10-09T11:47:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163632.log: /var/log/ceph/ceph-client.admin.167795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160040.log 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163632.log.gz 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3%/var/log/ceph/ceph-client.admin.96451.log: -- replaced with /var/log/ceph/ceph-client.admin.167795.log.gz 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104744.log 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96451.log.gz 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175326.log 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170508.log 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160040.log.gz 2023-10-09T11:47:38.221 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175326.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104744.log.gz 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171022.log 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175326.log.gz 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.170508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162432.log 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170508.log.gz 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100898.log 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171022.log.gz 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173228.log 2023-10-09T11:47:38.222 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162432.log.gz 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167277.log 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176955.log 88.7% 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100898.log.gz 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167277.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173228.log.gz 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102317.log 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167277.log.gz 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98372.log 2023-10-09T11:47:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102317.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.176955.log.gz--verbose 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.97530.log 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102317.log.gz 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177791.log 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98372.log.gz 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164318.log 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179105.log 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97530.log.gz 2023-10-09T11:47:38.224 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%/var/log/ceph/ceph-client.admin.164318.log: -- replaced with /var/log/ceph/ceph-client.admin.177791.log.gz 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174692.log 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164318.log.gz 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96690.log 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97532.log 88.7% 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179105.log.gz 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96690.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174692.log.gz 2023-10-09T11:47:38.225 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96117.log 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96690.log.gz 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156946.log 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96117.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.97532.log.gz-5 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.171766.log 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96117.log.gz 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180193.log 2023-10-09T11:47:38.226 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171766.log: gzip 89.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.156946.log.gz-- 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158675.log 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180193.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171766.log.gz 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165658.log 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180193.log.gz 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178413.log 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165658.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158675.log.gz 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159912.log 2023-10-09T11:47:38.227 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165658.log.gz 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177157.log 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.178413.log.gz 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100036.log 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177157.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.159912.log.gz-5 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.168690.log 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177157.log.gz 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163968.log 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100036.log.gz 2023-10-09T11:47:38.228 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105959.log 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171165.log 88.6% 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.168690.log.gz 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163968.log.gz 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166677.log 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171165.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105959.log.gz 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176263.log 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171165.log.gz 2023-10-09T11:47:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171501.log 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176263.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166677.log.gz 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99868.log 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176263.log.gz 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157600.log 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.171501.log.gz 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160292.log 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176033.log 2023-10-09T11:47:38.230 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99868.log.gz 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157600.log.gz 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168900.log 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160292.log.gz 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160468.log 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168900.log: gzip -5 --verbose 89.1%-- /var/log/ceph/ceph-client.admin.178853.log -- replaced with /var/log/ceph/ceph-client.admin.176033.log.gz 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168900.log.gz 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98540.log 2023-10-09T11:47:38.231 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179063.log 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98540.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.160468.log.gz 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178853.log.gz 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165378.log 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164543.log 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98540.log.gz 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179063.log: /var/log/ceph/ceph-client.admin.165378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179021.log 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179063.log.gz 2023-10-09T11:47:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101539.log 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165378.log.gz 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179021.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164543.log.gz 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102233.log 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179021.log.gz 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105468.log 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4%/var/log/ceph/ceph-client.admin.102233.log: -- replaced with /var/log/ceph/ceph-client.admin.101539.log.gz 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170717.log 2023-10-09T11:47:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156635.log 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102233.log.gz 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105468.log.gz/var/log/ceph/ceph-client.admin.170717.log: 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179731.log 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.170717.log.gz 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104702.log 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173644.log 2023-10-09T11:47:38.234 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156635.log.gz 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104702.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179731.log.gz 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107860.log 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104702.log.gz 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97194.log 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107860.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173644.log.gz 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107346.log 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107860.log.gz 2023-10-09T11:47:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176075.log 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97194.log.gz/var/log/ceph/ceph-client.admin.107346.log: 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176075.log: gzip -5 --verbose 87.5%-- /var/log/ceph/ceph-client.admin.169129.log -- replaced with /var/log/ceph/ceph-client.admin.107346.log.gz 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176075.log.gz 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167415.log 2023-10-09T11:47:38.236 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172158.log 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167415.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169129.log.gz 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102443.log 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173686.log 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167415.log.gz 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172158.log: /var/log/ceph/ceph-client.admin.102443.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172158.log.gzgzip 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.171333.log 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102443.log.gz 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161909.log 2023-10-09T11:47:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173686.log: /var/log/ceph/ceph-client.admin.171333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156341.log 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173686.log.gz 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161909.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171333.log.gz 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160731.log 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.161909.log.gz 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174167.log 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156341.log.gz 2023-10-09T11:47:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.160731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173728.log 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.160731.log.gz 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96986.log 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173728.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174167.log.gz 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166845.log 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96986.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173728.log.gz 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103070.log 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96986.log.gz 2023-10-09T11:47:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107178.log 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103070.log: gzip 87.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.166845.log.gz-- 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169611.log 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107178.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103070.log.gz 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166299.log 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107178.log.gz 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160814.log 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158843.log 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169611.log.gz 2023-10-09T11:47:38.240 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166299.log.gz 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170633.log 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160814.log.gz 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164926.log 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173543.log 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158843.log.gz 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164926.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170633.log.gz 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167837.log 2023-10-09T11:47:38.241 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164926.log.gz 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103565.log 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106842.log 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173543.log.gz 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161162.log 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103565.log.gz 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.167837.log.gz 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157686.log 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161162.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106842.log.gz 2023-10-09T11:47:38.242 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170812.log 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161162.log.gz 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161120.log 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170812.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.157686.log.gz-5 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.175074.log 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106628.log 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170812.log.gz 2023-10-09T11:47:38.243 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175074.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161120.log.gz 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106230.log 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175074.log.gz 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107136.log 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.99655.log 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106628.log.gz 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107136.log: gzip -5 88.8%--verbose -- replaced with /var/log/ceph/ceph-client.admin.106230.log.gz-- 2023-10-09T11:47:38.244 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175991.log 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107136.log.gz 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.2.99655.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.176725.log 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.99655.log.gz 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180109.log 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175991.log.gz 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161559.log 2023-10-09T11:47:38.245 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176725.log.gz 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.180109.log: -- /var/log/ceph/ceph-client.admin.157030.log 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164501.log 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180109.log.gz 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157030.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161559.log.gz 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96902.log 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157030.log.gz 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180067.log 2023-10-09T11:47:38.246 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169445.log 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164501.log.gz 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180067.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96902.log.gz 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101623.log 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180067.log.gz 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171291.log 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169445.log: /var/log/ceph/ceph-client.admin.101623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179899.log 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169445.log.gz 2023-10-09T11:47:38.247 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180297.log 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101623.log.gz 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171291.log.gz 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162008.log 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174251.log 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179899.log.gz 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163884.log 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180297.log.gz 2023-10-09T11:47:38.248 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174251.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162008.log.gz 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102831.log 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174251.log.gz 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165700.log 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102786.log 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163884.log.gz 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165700.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102831.log.gz 2023-10-09T11:47:38.249 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170161.log 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.102786.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165700.log.gz 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179605.log 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102786.log.gz 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170161.log: /var/log/ceph/ceph-client.admin.176117.log 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174083.log 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170161.log.gz 2023-10-09T11:47:38.250 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179605.log.gz 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104394.log 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176117.log: /var/log/ceph/ceph-client.admin.174083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158326.log 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176117.log.gz 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101791.log 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174083.log.gz 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104394.log.gz 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174041.log 2023-10-09T11:47:38.251 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158326.log.gz 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.101791.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104786.log 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178137.log 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101791.log.gz 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159776.log 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174041.log.gz 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178137.log: gzip -5 --verbose 88.2%-- /var/log/ceph/ceph-client.admin.97028.log -- replaced with /var/log/ceph/ceph-client.admin.104786.log.gz 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.252 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177455.log 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178137.log.gz 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159776.log.gz 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159465.log 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97028.log.gz 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107388.log 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100415.log 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177455.log.gz 2023-10-09T11:47:38.253 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107388.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159465.log.gz 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177665.log 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107388.log.gz 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100457.log 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100415.log: /var/log/ceph/ceph-client.admin.177665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163464.log 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100415.log.gz 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177665.log.gz 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108003.log 2023-10-09T11:47:38.254 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100457.log.gz 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162642.log 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159198.log 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.108003.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163464.log.gz 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162390.log 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108003.log.gz 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162642.log.gz 2023-10-09T11:47:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156904.log 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156467.log 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159198.log.gz 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105833.log 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162390.log.gz 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165312.log 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156904.log.gz 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156467.log.gz 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174990.log 2023-10-09T11:47:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165312.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.105833.log.gz--verbose 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.103481.log 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162852.log 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174990.log.gz 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163198.log 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.165312.log.gz 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102790.log 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103481.log.gz 2023-10-09T11:47:38.257 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179689.log 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162852.log.gz 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.102790.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163198.log.gz 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100078.log 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102790.log.gz 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104352.log 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98288.log 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179689.log.gz 2023-10-09T11:47:38.258 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168648.log 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100078.log.gz 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98288.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104352.log.gz 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98288.log.gz 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100797.log 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167627.log 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168648.log.gz 2023-10-09T11:47:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102401.log 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167627.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100797.log.gz 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175242.log 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159648.log 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167627.log.gz 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175242.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102401.log.gz 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156509.log 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.175242.log.gz 2023-10-09T11:47:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165880.log 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101665.log 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159648.log.gz 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165880.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156509.log.gz 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161372.log 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165880.log.gz 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103523.log 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101665.log: /var/log/ceph/ceph-client.admin.161372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102275.log 2023-10-09T11:47:38.261 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101665.log.gz 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103523.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161372.log.gz 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159547.log 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103523.log.gz 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177623.log 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159547.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102275.log.gz 2023-10-09T11:47:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180379.log 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159547.log.gz 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96818.log 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177623.log.gz 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107220.log 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180379.log: /var/log/ceph/ceph-client.admin.96818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161516.log 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180379.log.gz 2023-10-09T11:47:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107220.log: 87.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.96818.log.gz 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.107538.log 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107220.log.gz 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101370.log 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161831.log 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161516.log.gz 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107538.log.gz 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166341.log 2023-10-09T11:47:38.264 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101370.log.gz 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157642.log 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169695.log 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161831.log.gz 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157642.log: gzip 89.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.166341.log.gz--verbose 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.178769.log 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157642.log.gz 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100288.log 2023-10-09T11:47:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107094.log 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169695.log.gz 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178769.log.gz 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169739.log 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100288.log.gz 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179479.log 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168141.log 2023-10-09T11:47:38.266 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107094.log.gz 2023-10-09T11:47:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101066.log 2023-10-09T11:47:38.267 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169739.log.gz 2023-10-09T11:47:38.267 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179479.log.gz 2023-10-09T11:47:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.168141.log: --verbose -- /var/log/ceph/ceph-client.admin.170980.log 2023-10-09T11:47:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170077.log 2023-10-09T11:47:38.269 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168141.log.gz 2023-10-09T11:47:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101066.log.gz 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158239.log 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170980.log.gz 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157092.log 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170077.log.gz 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.158239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160124.log 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158239.log.gz 2023-10-09T11:47:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175476.log 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160124.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157092.log.gz 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177371.log 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101581.log 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160124.log.gz 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169367.log 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175476.log.gz 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101581.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.177371.log.gz-5 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.105527.log 2023-10-09T11:47:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166257.log 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101581.log.gz 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105527.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169367.log.gz 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162768.log 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105527.log.gz 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172560.log 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102191.log 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166257.log.gz 2023-10-09T11:47:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102527.log 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162768.log.gz 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172560.log.gz 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100120.log 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102191.log.gz 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159606.log 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178979.log 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.102527.log.gz 2023-10-09T11:47:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159606.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100120.log.gz 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159606.log.gz 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160940.log 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178979.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173938.log 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178979.log.gz 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98078.log 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.160940.log.gz 2023-10-09T11:47:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104616.log 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104658.log 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173938.log.gz 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104616.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98078.log.gz 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103962.log 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104616.log.gz 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163506.log 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157252.log 2023-10-09T11:47:38.275 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104658.log.gz 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103962.log.gz 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84583.log 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163506.log.gz 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163153.log 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157252.log.gz 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.84583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170591.log 2023-10-09T11:47:38.276 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84583.log.gz 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.163153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160250.log 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163153.log.gz 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159282.log 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162726.log 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.170591.log.gz 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159282.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160250.log.gz 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103836.log 2023-10-09T11:47:38.277 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159282.log.gz 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172368.log 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162726.log.gz 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174356.log 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176893.log 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103836.log.gz 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172368.log.gz 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97863.log 2023-10-09T11:47:38.278 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174356.log.gz 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179387.log 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158243.log 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176893.log.gz 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97863.log.gz 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96631.log 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179387.log.gz 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.158243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103397.log 2023-10-09T11:47:38.279 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158243.log.gz 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167457.log 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96631.log.gz 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166551.log 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167457.log: gzip -5 88.7%--verbose -- /var/log/ceph/ceph-client.admin.167235.log -- replaced with /var/log/ceph/ceph-client.admin.103397.log.gz 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166551.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.167457.log.gz 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.104186.log 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167235.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166551.log.gz 2023-10-09T11:47:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90833.log 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167235.log.gz 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176851.log 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.90833.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104186.log.gz 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176179.log 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90833.log.gz 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163590.log 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176851.log.gz 2023-10-09T11:47:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162220.log 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164417.log 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176179.log.gz 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162220.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163590.log.gz 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107052.log 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162220.log.gz 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107776.log 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107052.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.164417.log.gzgzip -5 2023-10-09T11:47:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.165010.log 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107776.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107052.log.gz 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171064.log 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107776.log.gz 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167109.log 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165010.log: /var/log/ceph/ceph-client.admin.171064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157464.log 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165010.log.gz 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171064.log.gz 2023-10-09T11:47:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180025.log 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167109.log.gz 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162474.log 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167903.log 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157464.log.gz 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.180025.log.gz 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172882.log 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162474.log.gz 2023-10-09T11:47:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159998.log 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172882.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.167903.log.gz--verbose 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.161769.log 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159998.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172882.log.gz 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168942.log 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159998.log.gz 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171417.log 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178221.log 2023-10-09T11:47:38.285 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161769.log.gz 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171417.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168942.log.gz 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169213.log 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171417.log.gz 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.178221.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.178811.log 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169825.log 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.178221.log.gz 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178811.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169213.log.gz 2023-10-09T11:47:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164842.log 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178811.log.gz 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172798.log 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101497.log 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169825.log.gz 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172798.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164842.log.gz 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106356.log 2023-10-09T11:47:38.287 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172798.log.gz 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162894.log 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106356.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101497.log.gz 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166467.log 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162894.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106356.log.gz 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167365.log 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102957.log 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.162894.log.gz 2023-10-09T11:47:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167365.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166467.log.gz 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174906.log 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156299.log 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7%/var/log/ceph/ceph-client.admin.102957.log: -- replaced with /var/log/ceph/ceph-client.admin.167365.log.gz 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106103.log 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102957.log.gz 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174906.log.gzgzip 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.96325.log 2023-10-09T11:47:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156299.log.gz 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177413.log 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96325.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106103.log.gz 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96283.log 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96325.log.gz 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177413.log: /var/log/ceph/ceph-client.admin.161246.log 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96539.log 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177413.log.gz 2023-10-09T11:47:38.290 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96283.log.gz 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161601.log 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161246.log.gz 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175714.log 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103198.log 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96539.log.gz 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156845.log 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161601.log.gz 2023-10-09T11:47:38.291 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175714.log.gz 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168502.log 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156845.log: 87.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.103198.log.gz--verbose 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.160342.log 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168502.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156845.log.gz 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104480.log 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168502.log.gz 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103355.log 2023-10-09T11:47:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104480.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.160342.log.gz--verbose 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.165826.log 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103355.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104480.log.gz 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175158.log 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103355.log.gz 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175932.log 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175158.log: gzip 88.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.165826.log.gz--verbose 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.106188.log 2023-10-09T11:47:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175932.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175158.log.gz 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169909.log 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.175932.log.gz 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172753.log 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169909.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.106188.log.gz--verbose 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.103878.log 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169909.log.gz 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.172753.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.0.172753.log.gz--verbose 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.102915.log 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160082.log 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102915.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103878.log.gz 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176305.log 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102915.log.gz 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159011.log 2023-10-09T11:47:38.295 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176305.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160082.log.gz 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169569.log 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176305.log.gz/var/log/ceph/ceph-client.admin.159011.log: 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107262.log 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169569.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159011.log.gz 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179563.log 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107262.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169569.log.gz 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175032.log 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179563.log: gzip -5 --verbose 88.9%-- -- replaced with /var/log/ceph/ceph-client.admin.107262.log.gz/var/log/ceph/ceph-client.admin.100373.log 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160208.log 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179563.log.gz 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100373.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175032.log.gz 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159870.log 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100373.log.gz 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164585.log 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159870.log: gzip 88.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.160208.log.gz-- 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.165571.log 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3%/var/log/ceph/ceph-client.admin.164585.log: -- replaced with /var/log/ceph/ceph-client.admin.159870.log.gz 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175116.log 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164585.log.gz 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.165571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97527.log 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165571.log.gz 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161330.log 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171543.log 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175116.log.gz 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157508.log 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97527.log.gz 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171543.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161330.log.gz 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159114.log 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171543.log.gz 2023-10-09T11:47:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104574.log 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157508.log.gz 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176767.log 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159114.log.gz 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161288.log 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176767.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104574.log.gz 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96198.log 2023-10-09T11:47:38.300 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176767.log.gz 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175368.log 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96198.log: gzip -5 --verbose -- 89.1%/var/log/ceph/ceph-client.admin.180235.log 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161288.log.gz 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175368.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96198.log.gz 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101454.log 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175368.log.gz 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165270.log 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101454.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180235.log.gz 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168606.log 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165270.log: gzip 89.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.101454.log.gz-- 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171249.log 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168606.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165270.log.gz 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179773.log 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168606.log.gz 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104436.log 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.171249.log.gz 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.179773.log: --verbose -- /var/log/ceph/ceph-client.admin.173270.log 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179983.log 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179773.log.gz 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104436.log.gz 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165052.log 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173270.log.gz 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173144.log 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106496.log 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179983.log.gz 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173144.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165052.log.gz 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175410.log 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173144.log.gz 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160384.log 2023-10-09T11:47:38.304 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157336.log 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106496.log.gz 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173102.log 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160384.log.gz 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157336.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.175410.log.gz 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97528.log 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180151.log 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157336.log.gz 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173102.log.gz 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156719.log 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97528.log.gz 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104912.log 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156719.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.180151.log.gz--verbose 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.169867.log 2023-10-09T11:47:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156719.log.gz 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106798.log 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104912.log.gz 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177749.log 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107430.log 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169867.log.gz 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177749.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106798.log.gz 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171808.log 2023-10-09T11:47:38.307 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177749.log.gz 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166761.log 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171808.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107430.log.gz 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99952.log 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171808.log.gz 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162600.log 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170311.log 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166761.log.gz 2023-10-09T11:47:38.308 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99952.log.gz 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.99659.log 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162600.log.gz 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103154.log 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170311.log.gz 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.2.99659.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.99659.log.gz 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107919.log 2023-10-09T11:47:38.309 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103154.log.gz 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107731.log 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156988.log 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107919.log: /var/log/ceph/ceph-client.0.107731.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107919.log.gz 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107731.log.gz 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106418.log 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159156.log 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156988.log: /var/log/ceph/ceph-client.admin.106418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174566.log 2023-10-09T11:47:38.310 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156988.log.gz 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159156.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106418.log.gz 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159156.log.gz 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107735.log 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174434.log 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174566.log.gz 2023-10-09T11:47:38.311 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.0.107735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175798.log 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107735.log.gz 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105062.log 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156803.log 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174434.log.gz 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175798.log.gz 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177497.log 2023-10-09T11:47:38.312 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174293.log 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156803.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105062.log.gz 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105384.log 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156803.log.gz 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177497.log.gz 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172494.log 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174293.log.gz 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174864.log 2023-10-09T11:47:38.313 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105384.log.gz 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106314.log 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99700.log 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2%/var/log/ceph/ceph-client.admin.106314.log: -- replaced with /var/log/ceph/ceph-client.admin.174864.log.gz 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163842.log 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.172494.log.gz 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106314.log.gz 2023-10-09T11:47:38.314 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175673.log 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162134.log 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163842.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99700.log.gz 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.175673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164240.log 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163842.log.gz 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175673.log.gz 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165742.log 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162134.log.gz 2023-10-09T11:47:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97534.log 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106272.log 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164240.log.gz 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98330.log 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97534.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165742.log.gz 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98666.log 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97534.log.gz 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162092.log 2023-10-09T11:47:38.316 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106272.log.gz 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176683.log 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98666.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98330.log.gz 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159071.log 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98666.log.gz 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162092.log.gz 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179857.log 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96734.log 2023-10-09T11:47:38.317 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176683.log.gz 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100331.log 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159071.log.gz 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179857.log.gz 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99742.log 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157770.log 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100331.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96734.log.gz 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96240.log 2023-10-09T11:47:38.318 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100331.log.gz 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99742.log.gz 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177033.log 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96240.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157770.log.gz 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172326.log 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177033.log: gzip -5 --verbose -- 88.6%/var/log/ceph/ceph-client.admin.166719.log 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96240.log.gz 2023-10-09T11:47:38.319 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177033.log.gz 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169171.log 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178643.log 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166719.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172326.log.gz 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90564.log 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166719.log.gz 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178643.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169171.log.gz 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166803.log 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178643.log.gz 2023-10-09T11:47:38.320 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.90564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106670.log 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164136.log 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90564.log.gz 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.166803.log.gz 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176347.log 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160772.log 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164136.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106670.log.gz 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176347.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164136.log.gz 2023-10-09T11:47:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177707.log 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176347.log.gz 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173186.log 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.160772.log.gz 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177707.log: /var/log/ceph/ceph-client.admin.173186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172410.log 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177707.log.gz 2023-10-09T11:47:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173186.log.gz 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105875.log 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172242.log 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172410.log: /var/log/ceph/ceph-client.admin.105875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100713.log 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172410.log.gz 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105875.log.gz 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102873.log 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173312.log 2023-10-09T11:47:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100713.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172242.log.gz 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102149.log 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100713.log.gz 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173312.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102873.log.gz 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156425.log 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173312.log.gz 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101937.log 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101126.log 2023-10-09T11:47:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156425.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102149.log.gz 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170245.log 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156425.log.gz 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101126.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101937.log.gz 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174608.log 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166593.log 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101126.log.gz 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96024.log 2023-10-09T11:47:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166593.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174608.log.gz 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.170245.log.gz 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166593.log.gz 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96024.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96024.log.gz 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178895.log 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164094.log 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172757.log 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173396.log 2023-10-09T11:47:38.326 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178895.log.gz 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.172757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171684.log 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164094.log.gz 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.172757.log.gz 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158368.log 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171684.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.103112.log 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173396.log.gz 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168418.log 2023-10-09T11:47:38.327 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171684.log.gz 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158368.log.gz 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174948.log 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99296.log 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103112.log.gz 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173501.log 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168418.log.gz 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174948.log.gz 2023-10-09T11:47:38.328 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105665.log 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171850.log 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99296.log.gz 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162960.log 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173501.log.gz 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171850.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105665.log.gz 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97814.log 2023-10-09T11:47:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162960.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171850.log.gz 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163716.log 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1%/var/log/ceph/ceph-client.admin.97814.log: -- replaced with /var/log/ceph/ceph-client.admin.162960.log.gz 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171459.log 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97814.log.gz 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100940.log 2023-10-09T11:47:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163716.log.gz 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102999.log 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171459.log.gz 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160426.log 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157558.log 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102999.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100940.log.gz 2023-10-09T11:47:38.331 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162558.log 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102999.log.gz 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106146.log 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160426.log.gz 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162558.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157558.log.gz 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163548.log 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169527.log /var/log/ceph/ceph-client.admin.106146.log: 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162558.log.gz 2023-10-09T11:47:38.332 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163548.log: gzip -5 --verbose 88.1%-- /var/log/ceph/ceph-client.admin.162050.log -- replaced with /var/log/ceph/ceph-client.admin.106146.log.gz 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169527.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163548.log.gz 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179941.log 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169527.log.gz 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158494.log 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173854.log 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179941.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162050.log.gz 2023-10-09T11:47:38.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165784.log 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179941.log.gz 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167753.log 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.158494.log.gz 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173854.log.gz 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156202.log 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162176.log 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167753.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165784.log.gz 2023-10-09T11:47:38.334 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168267.log 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167753.log.gz 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157896.log 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156202.log.gz 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162176.log.gz 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174125.log 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165575.log 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157896.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168267.log.gz 2023-10-09T11:47:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101887.log 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157896.log.gz 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.165575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105426.log 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174125.log.gz 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165575.log.gz 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97536.log 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169783.log 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101887.log.gz 2023-10-09T11:47:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97536.log: gzip -5 --verbose 87.9%-- /var/log/ceph/ceph-client.admin.158046.log -- replaced with /var/log/ceph/ceph-client.admin.105426.log.gz 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97536.log.gz 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157420.log 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164674.log 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158046.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169783.log.gz 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157854.log 2023-10-09T11:47:38.337 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158046.log.gz 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102593.log 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.157420.log.gz 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164674.log.gz 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107472.log 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179429.log 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102593.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157854.log.gz 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162348.log 2023-10-09T11:47:38.338 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102593.log.gz 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156383.log 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107472.log.gz 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162348.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179429.log.gz 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104046.log 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164884.log 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156383.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162348.log.gz 2023-10-09T11:47:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158452.log 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156383.log.gz 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172022.log 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104046.log.gz 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164884.log.gz 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156761.log 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.172022.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.166383.log 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158452.log.gz 2023-10-09T11:47:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97203.log 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172022.log.gz 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156761.log.gz 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107304.log 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157938.log 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166383.log.gz 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97742.log 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97203.log.gz 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107304.log.gz 2023-10-09T11:47:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172924.log 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98414.log 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97742.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157938.log.gz 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158969.log 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97742.log.gz 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173770.log 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172924.log.gz 2023-10-09T11:47:38.342 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98414.log.gz 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100629.log 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166215.log 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158969.log.gz 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178601.log 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173770.log.gz 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166215.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100629.log.gz 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176221.log 2023-10-09T11:47:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178601.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166215.log.gz 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101707.log 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.178601.log.gz 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161643.log 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101707.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176221.log.gz 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103920.log 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7%/var/log/ceph/ceph-client.admin.161643.log: -- replaced with /var/log/ceph/ceph-client.admin.101707.log.gz 2023-10-09T11:47:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170203.log 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103920.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161643.log.gz 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160166.log 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170203.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103920.log.gz 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100839.log 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170203.log.gz 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102107.log 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100839.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160166.log.gz 2023-10-09T11:47:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98498.log 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159732.log 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100839.log.gz 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.102107.log.gz 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101211.log 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179189.log 2023-10-09T11:47:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159732.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98498.log.gz 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180337.log 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159732.log.gz 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101211.log.gz 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96367.log 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99994.log 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179189.log.gz 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180337.log: /var/log/ceph/ceph-client.admin.96367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158759.log 2023-10-09T11:47:38.347 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180337.log.gz 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99255.log 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96367.log.gz 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99994.log.gz 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99247.log 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178937.log 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.99255.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158759.log.gz 2023-10-09T11:47:38.348 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99255.log.gz 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.99247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158801.log 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99247.log.gz 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102021.log 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178937.log.gz 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159324.log 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102021.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158801.log.gz 2023-10-09T11:47:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105342.log 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102021.log.gz 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172284.log 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105342.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159324.log.gz 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170504.log 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105342.log.gz 2023-10-09T11:47:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176473.log 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104870.log 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.170504.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172284.log.gz 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170504.log.gz 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159820.log 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104870.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176473.log.gz 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171106.log 2023-10-09T11:47:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95943.log 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104870.log.gz 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159820.log.gz 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162516.log 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95943.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171106.log.gz 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104108.log 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95943.log.gz 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174209.log 2023-10-09T11:47:38.352 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162516.log.gz 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179147.log 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174209.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104108.log.gz 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171606.log 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179147.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174209.log.gz 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101979.log 2023-10-09T11:47:38.353 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179147.log.gz 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99910.log 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171606.log.gz 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101979.log.gz 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99910.log.gz 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97200.log 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159387.log 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107818.log 2023-10-09T11:47:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168100.log 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97200.log.gz 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97202.log 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159387.log.gz 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.168100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97539.log 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107818.log.gz 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168100.log.gz 2023-10-09T11:47:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97815.log 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97539.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97202.log.gz 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97815.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97539.log.gz 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97815.log.gz 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163240.log 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173812.log 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174780.log 2023-10-09T11:47:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100204.log 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163240.log.gz 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97537.log 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173812.log.gz 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100204.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174780.log.gz 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100204.log.gz 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97537.log.gz 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169302.log 2023-10-09T11:47:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97878.log 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101412.log 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97878.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169302.log.gz 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101412.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97878.log.gz 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101412.log.gz 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159690.log 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168460.log 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165136.log 2023-10-09T11:47:38.358 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166635.log 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159690.log.gz 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164758.log 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168460.log.gz 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164800.log 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165136.log.gz 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164758.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166635.log.gz 2023-10-09T11:47:38.359 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164800.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164758.log.gz 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164800.log.gz 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105791.log 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97196.log 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166509.log 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103691.log 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105791.log.gz 2023-10-09T11:47:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102485.log 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97196.log.gz 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103691.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166509.log.gz 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103691.log.gz 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97877.log 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102485.log.gz 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156677.log 2023-10-09T11:47:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169044.log 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157980.log 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97877.log.gz 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165094.log 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156677.log.gz 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157980.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169044.log.gz 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169087.log 2023-10-09T11:47:38.362 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165094.log.gz 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.157980.log.gz 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156158.log 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106968.log 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168183.log 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169087.log.gz 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106968.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156158.log.gz 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169653.log 2023-10-09T11:47:38.363 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.106968.log.gz 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168183.log: /var/log/ceph/ceph-client.admin.169653.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168183.log.gz 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160727.log 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169653.log.gz 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163157.log 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.160727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168096.log 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.160727.log.gz 2023-10-09T11:47:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.163157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176515.log 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163157.log.gz 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.168096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100246.log 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168096.log.gz 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168732.log 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176515.log.gz 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168732.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100246.log.gz 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168732.log.gz 2023-10-09T11:47:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160856.log 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163283.log 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.160856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.171207.log 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163283.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160856.log.gz 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163283.log.gz 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98582.log 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171207.log.gz 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163325.log 2023-10-09T11:47:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97199.log 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96944.log 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98582.log.gz 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158717.log 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163325.log.gz 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104524.log 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97199.log.gz 2023-10-09T11:47:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158717.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96944.log.gz 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104524.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158717.log.gz 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104524.log.gz 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158927.log 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158927.log: /var/log/ceph/ceph-mgr.y.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158927.log.gz 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163367.log 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174524.log 2023-10-09T11:47:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163367.log: /var/log/ceph/ceph-client.admin.174524.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163367.log.gz 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174524.log.gz 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172452.log 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103439.log 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164052.log 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.103439.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172452.log.gz 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164052.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103439.log.gz 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164052.log.gz 2023-10-09T11:47:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101749.log 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100755.log 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106926.log 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101749.log.gz 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106926.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100755.log.gz 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106926.log.gz 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104310.log 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171978.log 2023-10-09T11:47:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.104310.log: /var/log/ceph/ceph-client.admin.171978.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104310.log.gz 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171978.log.gz 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173354.log 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100162.log 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173060.log 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100162.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173354.log.gz 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173060.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100162.log.gz 2023-10-09T11:47:38.371 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173060.log.gz 2023-10-09T11:47:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96589.log 2023-10-09T11:47:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171892.log 2023-10-09T11:47:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169255.log 2023-10-09T11:47:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171892.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96589.log.gz 2023-10-09T11:47:38.382 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169255.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171892.log.gz 2023-10-09T11:47:38.382 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169255.log.gz 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174736.log 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167027.log 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98708.log 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162306.log 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174736.log.gz 2023-10-09T11:47:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98708.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167027.log.gz 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162306.log: 91.3% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98708.log.gz 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162306.log.gz 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163800.log 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167501.log 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105917.log 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167585.log 2023-10-09T11:47:38.384 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167501.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163800.log.gz 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.105917.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167501.log.gz 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105917.log.gz 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167585.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167585.log.gz 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105255.log 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98624.log 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.105255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106884.log 2023-10-09T11:47:38.385 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105255.log.gz 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156551.log 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.106884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98624.log.gz 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156551.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106884.log.gz 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156551.log.gz 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107961.log 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177539.log 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.107961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100982.log 2023-10-09T11:47:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158410.log 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107961.log.gz 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169993.log 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177539.log.gz 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100982.log.gz 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169993.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158410.log.gz 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169993.log.gz 2023-10-09T11:47:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177241.log 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163926.log 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168984.log 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178727.log 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177241.log.gz 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171934.log 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163926.log.gz 2023-10-09T11:47:38.388 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177283.log 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178727.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168984.log.gz 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175200.log 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178727.log.gz 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%/var/log/ceph/ceph-client.admin.177283.log: -- replaced with /var/log/ceph/ceph-client.admin.171934.log.gz 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175200.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177283.log.gz 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175200.log.gz 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98120.log 2023-10-09T11:47:38.389 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172840.log 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97817.log 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.98120.log: /var/log/ceph/ceph-client.admin.172840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157294.log 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98120.log.gz 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.97817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178092.log 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172840.log.gz 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97817.log.gz 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100671.log 2023-10-09T11:47:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.178092.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.157294.log.gz--verbose 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.165936.log 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178092.log.gz 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.100671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161078.log 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165936.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100671.log.gz 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161078.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165936.log.gz 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161078.log.gz 2023-10-09T11:47:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101835.log 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169951.log 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.101835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99826.log 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167543.log 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101835.log.gz 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.99826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161685.log 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169951.log.gz 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167543.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99826.log.gz 2023-10-09T11:47:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161685.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167543.log.gz 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161685.log.gz 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159240.log 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96776.log 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167669.log 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.96776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102065.log 2023-10-09T11:47:38.393 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159240.log.gz 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170675.log 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96776.log.gz 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162810.log 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167669.log.gz 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158885.log 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102065.log.gz 2023-10-09T11:47:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168774.log 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170675.log.gz 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102359.log 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162810.log.gz 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168774.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158885.log.gz 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.102359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168774.log.gz 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102359.log.gz 2023-10-09T11:47:38.395 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170549.log 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105259.log 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173016.log 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.105259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157378.log 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170549.log.gz 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105259.log.gz 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167711.log 2023-10-09T11:47:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157378.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173016.log.gz 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167711.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157378.log.gz 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.167711.log.gz 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166041.log 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179815.log 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157812.log 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164178.log 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166041.log.gz 2023-10-09T11:47:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157812.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T11:47:38.398 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179815.log.gz 2023-10-09T11:47:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164178.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157812.log.gz 2023-10-09T11:47:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164178.log.gz 2023-10-09T11:47:38.398 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T11:47:38.572 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T11:47:38.750 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T11:47:38.787 INFO:teuthology.orchestra.run.smithi026.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T11:47:38.793 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T11:47:38.881 INFO:teuthology.orchestra.run.smithi026.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T11:47:38.883 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T11:47:38.917 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T11:47:38.959 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T11:47:38.960 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T11:47:39.011 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T11:47:39.013 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-09T11:47:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m1.046s 2023-10-09T11:47:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m4.050s 2023-10-09T11:47:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m0.508s 2023-10-09T11:47:39.045 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T11:47:40.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-09T11:47:40.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-09T11:47:40.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T11:47:43.495 INFO:teuthology.orchestra.run.smithi067.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T11:47:43.497 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-10-09T11:47:43.497 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m5.507s 2023-10-09T11:47:43.497 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m10.579s 2023-10-09T11:47:43.498 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.360s 2023-10-09T11:47:43.498 INFO:tasks.ceph:Archiving logs... 2023-10-09T11:47:43.498 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi026/log 2023-10-09T11:47:43.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T11:47:44.621 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi067/log 2023-10-09T11:47:44.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T11:47:45.929 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T11:47:45.938 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T11:47:45.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T11:47:45.941 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T11:47:46.026 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T11:47:46.035 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T11:47:46.035 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:47:46.037 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:47:46.050 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-10-09T11:47:46.053 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 -14us[ -14us] +/- 67ms 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 +90us[ +95us] +/- 69ms 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -39us[ -39us] +/- 67ms 2023-10-09T11:47:46.054 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:47:46.056 INFO:teuthology.orchestra.run.smithi067.stdout:210 Number of sources = 4 2023-10-09T11:47:46.056 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:47:46.056 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-10-09T11:47:46.056 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 -29us[ -29us] +/- 67ms 2023-10-09T11:47:46.057 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv02.front.sepia.ceph.com 3 6 377 20 +91us[ +97us] +/- 69ms 2023-10-09T11:47:46.057 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -28us[ -28us] +/- 67ms 2023-10-09T11:47:46.057 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:47:46.057 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T11:47:46.074 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T11:47:46.075 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T11:47:46.105 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T11:47:46.163 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T11:47:46.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:47:46.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:46.294 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:47:46.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:46.325 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T11:47:46.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T11:47:46.372 INFO:teuthology.task.internal:Duration was 1449.335481 seconds 2023-10-09T11:47:46.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T11:47:46.405 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T11:47:46.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T11:47:46.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T11:47:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:47:46.454 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:47:46.951 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T11:47:46.952 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-10-09T11:47:46.952 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T11:47:46.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2023-10-09T11:47:46.974 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T11:47:46.993 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T11:47:46.993 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T11:47:47.016 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T11:47:47.074 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T11:47:47.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T11:47:47.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T11:47:47.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T11:47:47.202 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T11:47:47.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T11:47:47.227 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T11:47:47.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T11:47:47.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:47:47.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:47:47.292 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-10-09T11:47:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2023-10-09T11:47:47.331 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:47:47.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:47.361 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:47:47.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:47.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T11:47:47.396 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T11:47:47.396 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi026 2023-10-09T11:47:47.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T11:47:47.437 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425/remote/smithi067 2023-10-09T11:47:47.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T11:47:47.472 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T11:47:47.473 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T11:47:47.475 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T11:47:47.521 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T11:47:47.533 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T11:47:47.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T11:47:47.556 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T11:47:47.556 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T11:47:47.559 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T11:47:47.571 INFO:teuthology.orchestra.run.smithi026.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 11:47 /home/ubuntu/cephtest 2023-10-09T11:47:47.576 INFO:teuthology.orchestra.run.smithi067.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 11:47 /home/ubuntu/cephtest 2023-10-09T11:47:47.577 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T11:47:47.589 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T11:47:47.657 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T11:47:47.683 DEBUG:teuthology.nuke:shortname: smithi026 2023-10-09T11:47:47.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:47:47.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.992544', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQPwAR7jfuyZjq2/T7yRLjXRu5wIqQBc/b9XplrhgboaQoDLoR4nvMWl64rbPbowUO1BJi5oduWkcwZZNvJEc4='} 2023-10-09T11:47:47.708 DEBUG:teuthology.nuke:shortname: smithi067 2023-10-09T11:47:47.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:47:47.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.994321', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtnQGeA3ZIqGsDMcojbchoWQx6n3QWRs0jse8s6mrpnnIWtTGMkUmFsG2zbobQgJ/H89ysJK8+ZjuMsSWFSMLY='} 2023-10-09T11:47:47.757 INFO:teuthology.orchestra.console.smithi026:Power off 2023-10-09T11:47:47.757 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:47:47.782 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-10-09T11:47:47.782 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:47.797 INFO:teuthology.orchestra.console.smithi067:Power off 2023-10-09T11:47:47.797 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:47:47.805 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-09T11:47:47.819 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-10-09T11:47:47.819 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:47.840 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-10-09T11:47:51.806 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:51.841 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:51.916 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-09T11:47:51.950 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-10-09T11:47:55.918 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:55.951 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:47:56.028 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-10-09T11:47:56.059 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-10-09T11:47:56.130 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-10-09T11:47:56.160 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-10-09T11:47:56.266 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1449.3354811668396 failure_reason: 'Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f9f741743b1e429799550345463f124c status: fail success: false 2023-10-09T11:47:56.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:47:56.345 INFO:teuthology.run:FAIL